2023-08-21T23:52:11.036 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T23:52:11.038 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi --verbose --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --archive /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555 -- /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/orig.config.yaml 2023-08-21T23:52:11.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T23:52:11.191 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555 branch: wip-yuri2-testing-2023-08-21-0910-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7374555' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-08-21-0910-pacific ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: b36cacbf4a85bad07ce8507b71923096132ebbad ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b36cacbf4a85bad07ce8507b71923096132ebbad selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-08-21-0910-pacific sha1: b36cacbf4a85bad07ce8507b71923096132ebbad owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6738 sha1: b36cacbf4a85bad07ce8507b71923096132ebbad sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri2-testing-2023-08-21-0910-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b36cacbf4a85bad07ce8507b71923096132ebbad/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b36cacbf4a85bad07ce8507b71923096132ebbad targets: smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZiQnS8g/mK3OoJng0ZrkMuUxfkOntvjaU3QE/0efvSB4xyzBhZc/Pri5NlPQiivydYoE3e7eoJEXc9oFdH88UZQ57UIRhkJq8kK0wEZ9/plkWiVw9eNbpgnfDZaDm/GPkpePhvBo3RU5atdC+bEpJkYncSvJ66TfcqWE8RYDCscBYkzWyYKnukAzhd7fKuCrJ+80KfKQ4waFfjJcfD3D5dkla/GeIZpOBFNdxXJeWNmmfGVZ23eNr7Ulex9BkDkpZOxLoOai/Dz27nTM8XqIEdQOjSN6U1rjV+Sy+6fDy+TP7wv6cwHHsX+h5sb+CFkXluc5QwtS3/echKMe2BWysXdqAoV474Js1Q+498oEyYzXbXiSa08YISUkfTxrdIRcP7S7uyefePb4bN+XDecJJLIdjrZKBUgiX3b74LC+dKC9L6dBtAKzdtiAtmrHtnK2DxGGOFAuiNqv8pzZuZ52oOQFPWla9l44b7zKDMtJO4vfYr2TeD0FlWuZaM1n+Pdc= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPu6U/zzJVSgMnmMq53VpQaUD0olSxj2DPoArhWeVzRR6ItaVcKqoMR/L48Vs6pQrz9Eb562pQAOj/+bPNgL4g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-21_21:30:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-21T23:52:11.191 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b36cacbf4a85bad07ce8507b71923096132ebbad/qa; will attempt to use it 2023-08-21T23:52:11.192 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b36cacbf4a85bad07ce8507b71923096132ebbad/qa/tasks 2023-08-21T23:52:11.192 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-21T23:52:11.197 INFO:teuthology.task.internal:Checking packages... 2023-08-21T23:52:11.232 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b36cacbf4a85bad07ce8507b71923096132ebbad' 2023-08-21T23:52:11.233 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-21T23:52:11.233 INFO:teuthology.packaging:ref: None 2023-08-21T23:52:11.234 INFO:teuthology.packaging:tag: None 2023-08-21T23:52:11.236 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-08-21-0910-pacific 2023-08-21T23:52:11.236 INFO:teuthology.packaging:sha1: b36cacbf4a85bad07ce8507b71923096132ebbad 2023-08-21T23:52:11.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-08-21-0910-pacific 2023-08-21T23:52:11.384 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-562.gb36cacbf 2023-08-21T23:52:11.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-21T23:52:11.397 INFO:teuthology.task.internal:no buildpackages task found 2023-08-21T23:52:11.397 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-21T23:52:11.427 INFO:teuthology.task.internal:Saving configuration 2023-08-21T23:52:11.445 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-21T23:52:11.453 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T23:52:11.478 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 23:46:24.272215', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrwnbv3JfMuRUAEmlKpH1RXZU/Xnlui6t2seSJ1MM9/lyQfAY27f6t5zcHcysoeDz6fFhv6/7PQPEDq4zCS8SA='} 2023-08-21T23:52:11.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 23:46:24.270396', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPu6U/zzJVSgMnmMq53VpQaUD0olSxj2DPoArhWeVzRR6ItaVcKqoMR/L48Vs6pQrz9Eb562pQAOj/+bPNgL4g='} 2023-08-21T23:52:11.502 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-21T23:52:11.509 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-21T23:52:11.510 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-21T23:52:11.510 INFO:teuthology.run_tasks:Running task console_log... 2023-08-21T23:52:11.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf9779a040>, signals=[15]) 2023-08-21T23:52:11.616 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-21T23:52:11.630 INFO:teuthology.task.internal:Opening connections... 2023-08-21T23:52:11.631 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2023-08-21T23:52:11.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:52:11.721 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-08-21T23:52:11.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:52:11.789 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-21T23:52:11.798 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-08-21T23:52:11.821 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-08-21T23:52:11.822 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-21T23:52:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-21T23:52:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-08-21T23:52:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-21T23:52:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-21T23:52:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-08-21T23:52:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-08-21T23:52:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T23:52:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-21T23:52:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T23:52:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-21T23:52:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T23:52:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T23:52:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T23:52:11.887 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-21T23:52:11.912 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-08-21T23:52:11.936 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-08-21T23:52:11.937 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-08-21T23:52:11.999 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-08-21T23:52:11.999 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8" 2023-08-21T23:52:11.999 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-08-21T23:52:12.000 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T23:52:12.002 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-08-21T23:52:12.002 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T23:52:12.002 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T23:52:12.002 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T23:52:12.002 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-08-21T23:52:12.021 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-21T23:52:12.033 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-21T23:52:12.044 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-21T23:52:12.044 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2023-08-21T23:52:12.047 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-08-21T23:52:12.068 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-21T23:52:12.077 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-21T23:52:12.078 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2023-08-21T23:52:12.109 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-08-21T23:52:12.140 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-21T23:52:12.203 INFO:teuthology.run_tasks:Running task kernel... 2023-08-21T23:52:12.226 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-21T23:52:12.227 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-21T23:52:12.228 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-21T23:52:12.229 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-21T23:52:12.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-21T23:52:12.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-21T23:52:12.253 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-08-21T23:52:12.254 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-08-21T23:52:12.315 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-489.el8.x86_64 2023-08-21T23:52:12.315 INFO:teuthology.task.kernel:Running kernel on smithi098: 4.18.0-489.el8.x86_64 2023-08-21T23:52:12.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2023-08-21T23:52:12.317 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-489.el8.x86_64 2023-08-21T23:52:12.317 INFO:teuthology.task.kernel:Running kernel on smithi118: 4.18.0-489.el8.x86_64 2023-08-21T23:52:12.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2023-08-21T23:52:16.754 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - AppStream 18 MB/s | 31 MB 00:01 2023-08-21T23:52:17.026 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 17 MB/s | 31 MB 00:01 2023-08-21T23:52:23.648 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - BaseOS 31 MB/s | 41 MB 00:01 2023-08-21T23:52:24.283 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-08-21T23:52:30.107 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-08-21T23:52:30.566 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.8 kB 00:00 2023-08-21T23:52:30.625 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-08-21T23:52:30.860 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-21T23:52:31.159 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.8 kB 00:00 2023-08-21T23:52:31.443 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-08-21T23:52:34.228 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-08-21T23:52:35.912 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 16 MB 00:04 2023-08-21T23:52:37.944 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 398 kB/s | 24 kB 00:00 2023-08-21T23:52:39.668 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 495 kB/s | 24 kB 00:00 2023-08-21T23:52:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-21T23:52:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-21T23:52:41.431 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-08-21T23:52:41.431 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-08-21T23:52:41.431 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2023-08-21T23:52:41.432 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-08-21T23:52:41.432 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:52:41.433 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-08-21T23:52:41.434 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-08-21T23:52:41.434 INFO:teuthology.orchestra.run.smithi118.stdout:Install 3 Packages 2023-08-21T23:52:41.434 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:52:41.434 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 88 M 2023-08-21T23:52:41.434 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 95 M 2023-08-21T23:52:41.435 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-08-21T23:52:42.858 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-21T23:52:42.859 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-21T23:52:43.116 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-08-21T23:52:43.116 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-08-21T23:52:43.117 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-08-21T23:52:43.117 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-08-21T23:52:43.118 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-08-21T23:52:43.124 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-08-21T23:52:43.125 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-08-21T23:52:43.126 INFO:teuthology.orchestra.run.smithi098.stdout:Install 3 Packages 2023-08-21T23:52:43.126 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:52:43.126 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 88 M 2023-08-21T23:52:43.127 INFO:teuthology.orchestra.run.smithi118.stdout:(1/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 21 MB/s | 35 MB 00:01 2023-08-21T23:52:43.127 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 95 M 2023-08-21T23:52:43.127 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-08-21T23:52:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:(2/3): kernel-4.18.0-500.el8.x86_64.rpm 5.6 MB/s | 9.8 MB 00:01 2023-08-21T23:52:43.871 INFO:teuthology.orchestra.run.smithi118.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 18 MB/s | 43 MB 00:02 2023-08-21T23:52:43.871 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-08-21T23:52:43.871 INFO:teuthology.orchestra.run.smithi118.stdout:Total 36 MB/s | 88 MB 00:02 2023-08-21T23:52:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-08-21T23:52:44.965 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-08-21T23:52:44.965 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-08-21T23:52:45.587 INFO:teuthology.orchestra.run.smithi098.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 4.1 MB/s | 9.8 MB 00:02 2023-08-21T23:52:46.245 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-08-21T23:52:46.292 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-08-21T23:52:46.802 INFO:teuthology.orchestra.run.smithi098.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 9.8 MB/s | 35 MB 00:03 2023-08-21T23:52:47.419 INFO:teuthology.orchestra.run.smithi098.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 10 MB/s | 43 MB 00:04 2023-08-21T23:52:47.420 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-08-21T23:52:47.421 INFO:teuthology.orchestra.run.smithi098.stdout:Total 20 MB/s | 88 MB 00:04 2023-08-21T23:52:48.083 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-08-21T23:52:48.507 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-08-21T23:52:48.508 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-08-21T23:52:48.979 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-08-21T23:52:49.424 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:52:49.702 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-08-21T23:52:49.719 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-08-21T23:52:52.464 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-08-21T23:52:52.960 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:52:52.971 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:52:53.355 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:52:56.545 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:52:56.710 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:52:56.951 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:52:57.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:00.303 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:53:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:18.705 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:18.728 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:19.063 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:19.064 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:53:19.070 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:53:19.821 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:53:19.822 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-08-21T23:53:19.961 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-08-21T23:53:20.235 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-21T23:53:20.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-21T23:53:20.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-21T23:53:20.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-21T23:53:20.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-21T23:53:20.236 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-08-21T23:53:20.236 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2023-08-21T23:53:20.237 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-08-21T23:53:20.442 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-21T23:53:20.443 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-21T23:53:20.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2023-08-21T23:53:20.477 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2023-08-21T23:53:20.478 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.02 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 129.el8 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Group : System Environment/Base 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 9265586 2023-08-21T23:53:20.479 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Relocations : (not relocatable) 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : CentOS BuildSystem 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2023-08-21T23:53:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-21T23:53:20.481 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2023-08-21T23:53:20.482 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2023-08-21T23:53:20.482 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:53:20.482 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-21T23:53:20.482 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-21T23:53:20.483 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-21T23:53:20.483 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2023-08-21T23:53:20.483 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-21T23:53:20.483 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2023-08-21T23:53:20.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-21T23:53:20.484 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 4.18.0-500.el8.x86_64 2023-08-21T23:53:20.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-21T23:53:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:22.520 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-21T23:53:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-21T23:53:23.036 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-08-21T23:53:23.514 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:53:23.515 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-08-21T23:53:23.630 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2023-08-21T23:53:23.849 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-21T23:53:23.850 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-21T23:53:23.851 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-21T23:53:23.851 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-21T23:53:23.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-21T23:53:23.852 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-08-21T23:53:23.852 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2023-08-21T23:53:23.852 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2023-08-21T23:53:24.065 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-21T23:53:24.065 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-21T23:53:24.065 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2023-08-21T23:53:24.099 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2023-08-21T23:53:24.099 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.02 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 129.el8 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Group : System Environment/Base 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 9265586 2023-08-21T23:53:24.100 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Relocations : (not relocatable) 2023-08-21T23:53:24.101 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : CentOS BuildSystem 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-21T23:53:24.102 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-21T23:53:24.103 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-21T23:53:24.103 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2023-08-21T23:53:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-21T23:53:24.104 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2023-08-21T23:53:24.105 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-21T23:53:24.105 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 4.18.0-500.el8.x86_64 2023-08-21T23:53:24.105 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-21T23:53:25.359 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-08-21T23:53:25.361 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-08-21T23:53:25.431 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.Wl49yGDZHX 2023-08-21T23:53:25.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Wl49yGDZHX 2023-08-21T23:53:25.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.Wl49yGDZHX 2023-08-21T23:53:25.544 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2023-08-21T23:53:25.605 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.Wl49yGDZHX is 6KB 2023-08-21T23:53:25.631 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.Wl49yGDZHX 2023-08-21T23:53:25.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2023-08-21T23:53:25.725 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-21T23:53:25.725 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-21T23:53:25.725 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-21T23:53:25.725 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-21T23:53:25.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-21T23:53:25.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-08-21T23:53:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:done 2023-08-21T23:53:28.050 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-08-21T23:53:28.079 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.gfYzeaZfDY 2023-08-21T23:53:28.079 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gfYzeaZfDY 2023-08-21T23:53:28.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.gfYzeaZfDY 2023-08-21T23:53:28.303 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.gfYzeaZfDY is 6KB 2023-08-21T23:53:28.351 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.gfYzeaZfDY 2023-08-21T23:53:28.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2023-08-21T23:53:28.443 INFO:teuthology.orchestra.run.smithi098.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-21T23:53:28.443 INFO:teuthology.orchestra.run.smithi098.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-21T23:53:28.443 INFO:teuthology.orchestra.run.smithi098.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-21T23:53:28.443 INFO:teuthology.orchestra.run.smithi098.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-21T23:53:28.444 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-21T23:53:28.620 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2023-08-21T23:53:55.904 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-08-21T23:53:55.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-21T23:53:55.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:53:58.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-08-21T23:53:58.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-21T23:53:58.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:54:14.256 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-21T23:54:17.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-21T23:54:23.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-21T23:54:23.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:54:26.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-21T23:54:26.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:54:26.320 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-21T23:54:29.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-21T23:54:38.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-21T23:54:38.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:54:41.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-21T23:54:41.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:54:41.460 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-21T23:54:56.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-21T23:54:56.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T23:55:13.861 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-21T23:55:14.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-21T23:55:14.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-500.el8.x86_64"... 2023-08-21T23:55:14.520 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-08-21T23:55:14.538 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-500.el8.x86_64 2023-08-21T23:55:14.539 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-21T23:55:14.539 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-21T23:55:14.539 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-21T23:55:15.541 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-21T23:55:15.541 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-21T23:55:15.602 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2023-08-21T23:55:15.614 DEBUG:teuthology.parallel:result is None 2023-08-21T23:55:28.363 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-08-21T23:55:28.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-21T23:55:28.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-500.el8.x86_64"... 2023-08-21T23:55:28.632 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-08-21T23:55:28.654 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-500.el8.x86_64 2023-08-21T23:55:28.654 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-21T23:55:28.655 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-21T23:55:28.655 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-21T23:55:29.656 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-21T23:55:29.656 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-21T23:55:29.763 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2023-08-21T23:55:29.779 DEBUG:teuthology.parallel:result is None 2023-08-21T23:55:29.779 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-21T23:55:29.787 INFO:teuthology.task.internal:Creating test directory... 2023-08-21T23:55:29.788 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-21T23:55:29.790 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-21T23:55:29.813 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-21T23:55:29.826 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-21T23:55:29.843 INFO:teuthology.task.internal:Creating archive directory... 2023-08-21T23:55:29.843 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-21T23:55:29.853 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-21T23:55:29.905 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-21T23:55:29.922 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-21T23:55:29.923 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-21T23:55:29.937 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-21T23:55:29.979 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-21T23:55:29.980 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-21T23:55:29.991 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-21T23:55:29.993 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-21T23:55:29.993 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-21T23:55:30.004 INFO:teuthology.task.internal:Configuring sudo... 2023-08-21T23:55:30.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-21T23:55:30.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-21T23:55:30.068 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-21T23:55:30.124 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-21T23:55:30.125 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-21T23:55:30.127 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-21T23:55:30.148 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-21T23:55:30.230 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-21T23:55:30.282 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-21T23:55:30.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-21T23:55:30.412 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-21T23:55:30.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-21T23:55:30.479 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-21T23:55:30.529 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-21T23:55:30.585 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-21T23:55:30.673 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-21T23:55:30.723 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-21T23:55:30.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-21T23:55:30.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2023-08-21T23:55:30.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-08-21T23:55:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-21T23:55:30.940 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-21T23:55:31.335 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-21T23:55:31.343 INFO:teuthology.task.internal:Starting timer... 2023-08-21T23:55:31.343 INFO:teuthology.run_tasks:Running task pcp... 2023-08-21T23:55:31.386 INFO:teuthology.run_tasks:Running task selinux... 2023-08-21T23:55:31.402 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-21T23:55:31.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2023-08-21T23:55:31.506 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2023-08-21T23:55:31.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-08-21T23:55:31.595 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2023-08-21T23:55:31.597 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-21T23:55:31.597 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2023-08-21T23:55:31.639 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2023-08-21T23:55:31.639 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-08-21T23:55:31.668 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-08-21T23:55:31.668 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2023-08-21T23:55:31.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-21T23:55:31.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-21T23:55:31.708 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-21T23:55:31.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-21T23:55:31.738 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-21T23:55:31.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2023-08-21T23:55:31.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-08-21T23:55:31.806 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-21T23:55:31.818 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-21T23:55:31.819 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-21T23:55:31.842 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-21T23:55:31.844 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-22T00:02:52.054 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2023-08-22T00:02:52.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-22T00:02:52.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T00:02:52.129 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-22T00:02:52.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-22T00:02:52.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-22T00:02:52.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T00:02:52.225 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-08-22T00:02:52.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-22T00:02:52.295 INFO:teuthology.run_tasks:Running task clock... 2023-08-22T00:02:52.314 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-22T00:02:52.315 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-22T00:02:52.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-22T00:02:52.317 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-22T00:02:52.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-22T00:02:52.348 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-22T00:02:52.362 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-22T00:02:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-22T00:02:52.382 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-22T00:02:52.418 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2023-08-22T00:02:52.429 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2023-08-22T00:02:52.444 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-22T00:02:52.455 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-08-22T00:02:52.456 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-22T00:02:52.467 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-08-22T00:02:52.480 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-22T00:02:52.493 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-22T00:02:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-08-22T00:02:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-22T00:02:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-08-22T00:02:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.570 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-08-22T00:02:52.573 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-22T00:02:52.573 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-08-22T00:02:52.573 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.574 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.574 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.574 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:02:52.575 INFO:teuthology.run_tasks:Running task install... 2023-08-22T00:02:52.585 DEBUG:teuthology.task.install:project ceph 2023-08-22T00:02:52.586 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'}} 2023-08-22T00:02:52.586 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'} 2023-08-22T00:02:52.586 INFO:teuthology.task.install:Using flavor: default 2023-08-22T00:02:52.592 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-22T00:02:52.592 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-22T00:02:52.593 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad', 'tag': None, 'wait_for_package': False} 2023-08-22T00:02:52.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b36cacbf4a85bad07ce8507b71923096132ebbad 2023-08-22T00:02:52.596 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad', 'tag': None, 'wait_for_package': False} 2023-08-22T00:02:52.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b36cacbf4a85bad07ce8507b71923096132ebbad 2023-08-22T00:02:52.816 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/ 2023-08-22T00:02:52.817 INFO:teuthology.task.install.rpm:Package version is 16.2.13-562.gb36cacbf 2023-08-22T00:02:52.833 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/ 2023-08-22T00:02:52.833 INFO:teuthology.task.install.rpm:Package version is 16.2.13-562.gb36cacbf 2023-08-22T00:02:52.936 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-22T00:02:52.936 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:02:52.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-22T00:02:52.966 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-22T00:02:52.966 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b36cacbf4a85bad07ce8507b71923096132ebbad/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-22T00:02:53.009 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-21-0910-pacific/b36cacbf4a85bad07ce8507b71923096132ebbad/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-22T00:02:53.011 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:02:53.011 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-22T00:02:53.034 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-22T00:02:53.042 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-22T00:02:53.043 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b36cacbf4a85bad07ce8507b71923096132ebbad/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-22T00:02:53.111 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-22T00:02:53.113 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-22T00:02:53.177 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2023-08-22T00:02:53.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2023-08-22T00:02:53.191 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-22T00:02:53.258 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-08-22T00:02:53.260 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-08-22T00:02:53.440 INFO:teuthology.orchestra.run.smithi098.stdout:73 files removed 2023-08-22T00:02:53.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-22T00:02:53.557 INFO:teuthology.orchestra.run.smithi118.stdout:73 files removed 2023-08-22T00:02:53.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-22T00:02:54.231 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 211 kB/s | 76 kB 00:00 2023-08-22T00:02:54.396 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 188 kB/s | 76 kB 00:00 2023-08-22T00:02:54.615 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 44 kB/s | 15 kB 00:00 2023-08-22T00:02:54.822 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 39 kB/s | 15 kB 00:00 2023-08-22T00:02:54.883 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 6.0 kB/s | 1.4 kB 00:00 2023-08-22T00:02:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2023-08-22T00:02:55.999 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - AppStream 28 MB/s | 31 MB 00:01 2023-08-22T00:02:56.531 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 22 MB/s | 31 MB 00:01 2023-08-22T00:03:03.450 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-08-22T00:03:03.682 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 41 MB 00:01 2023-08-22T00:03:10.282 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 29 kB/s | 18 kB 00:00 2023-08-22T00:03:11.023 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - Extras 11 kB/s | 18 kB 00:01 2023-08-22T00:03:11.808 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 5.0 kB/s | 6.8 kB 00:01 2023-08-22T00:03:11.809 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.8 kB 00:00 2023-08-22T00:03:14.286 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 8 - PowerTools 2.7 MB/s | 6.3 MB 00:02 2023-08-22T00:03:14.376 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - PowerTools 2.6 MB/s | 6.3 MB 00:02 2023-08-22T00:03:15.679 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-08-22T00:03:15.794 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-22T00:03:16.880 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-08-22T00:03:16.922 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-08-22T00:03:20.655 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 437 kB/s | 24 kB 00:00 2023-08-22T00:03:20.736 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 465 kB/s | 24 kB 00:00 2023-08-22T00:03:24.485 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-22T00:03:24.486 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-22T00:03:24.499 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-22T00:03:24.499 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-22T00:03:24.500 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-22T00:03:24.501 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-22T00:03:24.502 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-22T00:03:24.504 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-22T00:03:24.507 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-22T00:03:24.508 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-22T00:03:24.624 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-22T00:03:24.625 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-22T00:03:24.638 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-22T00:03:24.638 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-22T00:03:24.639 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-22T00:03:24.641 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-22T00:03:24.642 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-22T00:03:24.643 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-22T00:03:24.646 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-22T00:03:24.647 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-22T00:03:24.685 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-08-22T00:03:24.698 INFO:teuthology.orchestra.run.smithi098.stdout:==================================================================================================== 2023-08-22T00:03:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-08-22T00:03:24.699 INFO:teuthology.orchestra.run.smithi098.stdout:==================================================================================================== 2023-08-22T00:03:24.699 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-08-22T00:03:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-22T00:03:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 6.4 k 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 6.1 M 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 910 k 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 161 k 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 1.6 M 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 116 k 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 3.1 M 2023-08-22T00:03:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 8.6 M 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 27 k 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 12 M 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 52 M 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 84 k 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 256 k 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 19 k 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-22T00:03:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 25 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 824 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 131 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-22T00:03:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 215 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 390 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 369 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 114 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 88 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.7 M 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 173 k 2023-08-22T00:03:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-22T00:03:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-22T00:03:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-22T00:03:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.7 M 2023-08-22T00:03:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 4.2 M 2023-08-22T00:03:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-22T00:03:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-22T00:03:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-22T00:03:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-22T00:03:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-22T00:03:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-22T00:03:24.706 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 24 M 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 24 k 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 2.4 M 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 244 k 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 5.0 M 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 18 M 2023-08-22T00:03:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 15 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 26 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-22T00:03:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 174 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-22T00:03:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 494 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.8 M 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-22T00:03:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-22T00:03:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 45 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 99 k 2023-08-22T00:03:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-22T00:03:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-22T00:03:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-22T00:03:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-22T00:03:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-22T00:03:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-22T00:03:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-22T00:03:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-22T00:03:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-22T00:03:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:03:24.719 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-08-22T00:03:24.719 INFO:teuthology.orchestra.run.smithi098.stdout:==================================================================================================== 2023-08-22T00:03:24.720 INFO:teuthology.orchestra.run.smithi098.stdout:Install 123 Packages 2023-08-22T00:03:24.720 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 16 Packages 2023-08-22T00:03:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:03:24.721 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 209 M 2023-08-22T00:03:24.721 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-08-22T00:03:24.824 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-08-22T00:03:24.837 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-08-22T00:03:24.838 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-08-22T00:03:24.838 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-08-22T00:03:24.839 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-08-22T00:03:24.839 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-22T00:03:24.839 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 6.4 k 2023-08-22T00:03:24.839 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 6.1 M 2023-08-22T00:03:24.839 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 910 k 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 161 k 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 1.6 M 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 116 k 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 3.1 M 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 8.6 M 2023-08-22T00:03:24.840 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 27 k 2023-08-22T00:03:24.841 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 12 M 2023-08-22T00:03:24.841 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 52 M 2023-08-22T00:03:24.841 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 84 k 2023-08-22T00:03:24.841 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 256 k 2023-08-22T00:03:24.841 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 19 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 25 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 824 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 131 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-22T00:03:24.842 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 215 k 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 390 k 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 369 k 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 114 k 2023-08-22T00:03:24.843 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 88 k 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.7 M 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 173 k 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-22T00:03:24.844 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-22T00:03:24.845 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.7 M 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 4.2 M 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-22T00:03:24.846 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 24 M 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 24 k 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 2.4 M 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 244 k 2023-08-22T00:03:24.847 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 5.0 M 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 18 M 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:16.2.13-562.gb36cacbf.el8 ceph-noarch 15 k 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 26 k 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-22T00:03:24.848 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 174 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-22T00:03:24.849 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 494 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 3.8 M 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-22T00:03:24.850 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-22T00:03:24.851 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 45 k 2023-08-22T00:03:24.852 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:16.2.13-562.gb36cacbf.el8 ceph 99 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-22T00:03:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-22T00:03:24.854 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-22T00:03:24.855 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-22T00:03:24.856 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-22T00:03:24.857 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-22T00:03:24.858 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-22T00:03:24.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-22T00:03:24.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-22T00:03:24.859 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-22T00:03:24.860 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-22T00:03:24.860 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-22T00:03:24.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:03:24.860 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-08-22T00:03:24.860 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-08-22T00:03:24.861 INFO:teuthology.orchestra.run.smithi118.stdout:Install 123 Packages 2023-08-22T00:03:24.861 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 16 Packages 2023-08-22T00:03:24.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:03:24.861 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 209 M 2023-08-22T00:03:24.862 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-08-22T00:03:25.147 INFO:teuthology.orchestra.run.smithi118.stdout:(1/139): ceph-16.2.13-562.gb36cacbf.el8.x86_64. 47 kB/s | 6.4 kB 00:00 2023-08-22T00:03:25.298 INFO:teuthology.orchestra.run.smithi098.stdout:(1/139): ceph-16.2.13-562.gb36cacbf.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-08-22T00:03:25.363 INFO:teuthology.orchestra.run.smithi118.stdout:(2/139): ceph-fuse-16.2.13-562.gb36cacbf.el8.x8 4.1 MB/s | 910 kB 00:00 2023-08-22T00:03:25.422 INFO:teuthology.orchestra.run.smithi118.stdout:(3/139): ceph-immutable-object-cache-16.2.13-56 2.7 MB/s | 161 kB 00:00 2023-08-22T00:03:26.014 INFO:teuthology.orchestra.run.smithi118.stdout:(4/139): ceph-mds-16.2.13-562.gb36cacbf.el8.x86 4.1 MB/s | 2.4 MB 00:00 2023-08-22T00:03:26.098 INFO:teuthology.orchestra.run.smithi118.stdout:(5/139): ceph-base-16.2.13-562.gb36cacbf.el8.x8 5.6 MB/s | 6.1 MB 00:01 2023-08-22T00:03:26.349 INFO:teuthology.orchestra.run.smithi098.stdout:(2/139): ceph-fuse-16.2.13-562.gb36cacbf.el8.x8 867 kB/s | 910 kB 00:01 2023-08-22T00:03:26.398 INFO:teuthology.orchestra.run.smithi118.stdout:(6/139): ceph-mgr-16.2.13-562.gb36cacbf.el8.x86 4.2 MB/s | 1.6 MB 00:00 2023-08-22T00:03:26.566 INFO:teuthology.orchestra.run.smithi098.stdout:(3/139): ceph-immutable-object-cache-16.2.13-56 746 kB/s | 161 kB 00:00 2023-08-22T00:03:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:(7/139): ceph-mon-16.2.13-562.gb36cacbf.el8.x86 4.0 MB/s | 5.0 MB 00:01 2023-08-22T00:03:27.891 INFO:teuthology.orchestra.run.smithi098.stdout:(4/139): ceph-base-16.2.13-562.gb36cacbf.el8.x8 2.2 MB/s | 6.1 MB 00:02 2023-08-22T00:03:28.494 INFO:teuthology.orchestra.run.smithi098.stdout:(5/139): ceph-mgr-16.2.13-562.gb36cacbf.el8.x86 2.7 MB/s | 1.6 MB 00:00 2023-08-22T00:03:28.833 INFO:teuthology.orchestra.run.smithi098.stdout:(6/139): ceph-mds-16.2.13-562.gb36cacbf.el8.x86 1.1 MB/s | 2.4 MB 00:02 2023-08-22T00:03:29.007 INFO:teuthology.orchestra.run.smithi118.stdout:(8/139): ceph-osd-16.2.13-562.gb36cacbf.el8.x86 7.0 MB/s | 18 MB 00:02 2023-08-22T00:03:29.265 INFO:teuthology.orchestra.run.smithi118.stdout:(9/139): ceph-common-16.2.13-562.gb36cacbf.el8. 5.7 MB/s | 24 MB 00:04 2023-08-22T00:03:29.291 INFO:teuthology.orchestra.run.smithi118.stdout:(10/139): ceph-selinux-16.2.13-562.gb36cacbf.el 90 kB/s | 26 kB 00:00 2023-08-22T00:03:29.407 INFO:teuthology.orchestra.run.smithi118.stdout:(11/139): cephfs-mirror-16.2.13-562.gb36cacbf.e 2.2 MB/s | 256 kB 00:00 2023-08-22T00:03:29.483 INFO:teuthology.orchestra.run.smithi118.stdout:(12/139): libcephfs-devel-16.2.13-562.gb36cacbf 340 kB/s | 25 kB 00:00 2023-08-22T00:03:29.692 INFO:teuthology.orchestra.run.smithi118.stdout:(13/139): libcephfs2-16.2.13-562.gb36cacbf.el8. 3.9 MB/s | 824 kB 00:00 2023-08-22T00:03:29.767 INFO:teuthology.orchestra.run.smithi118.stdout:(14/139): libcephsqlite-16.2.13-562.gb36cacbf.e 2.3 MB/s | 174 kB 00:00 2023-08-22T00:03:29.951 INFO:teuthology.orchestra.run.smithi118.stdout:(15/139): ceph-radosgw-16.2.13-562.gb36cacbf.el 4.4 MB/s | 12 MB 00:02 2023-08-22T00:03:29.976 INFO:teuthology.orchestra.run.smithi118.stdout:(16/139): librados-devel-16.2.13-562.gb36cacbf. 627 kB/s | 131 kB 00:00 2023-08-22T00:03:30.085 INFO:teuthology.orchestra.run.smithi118.stdout:(17/139): libradosstriper1-16.2.13-562.gb36cacb 3.6 MB/s | 494 kB 00:00 2023-08-22T00:03:30.152 INFO:teuthology.orchestra.run.smithi118.stdout:(18/139): python3-ceph-argparse-16.2.13-562.gb3 676 kB/s | 45 kB 00:00 2023-08-22T00:03:30.235 INFO:teuthology.orchestra.run.smithi118.stdout:(19/139): python3-ceph-common-16.2.13-562.gb36c 1.2 MB/s | 99 kB 00:00 2023-08-22T00:03:30.327 INFO:teuthology.orchestra.run.smithi118.stdout:(20/139): python3-cephfs-16.2.13-562.gb36cacbf. 2.3 MB/s | 215 kB 00:00 2023-08-22T00:03:30.494 INFO:teuthology.orchestra.run.smithi118.stdout:(21/139): python3-rados-16.2.13-562.gb36cacbf.e 2.3 MB/s | 390 kB 00:00 2023-08-22T00:03:30.561 INFO:teuthology.orchestra.run.smithi118.stdout:(22/139): librgw2-16.2.13-562.gb36cacbf.el8.x86 6.4 MB/s | 3.8 MB 00:00 2023-08-22T00:03:30.637 INFO:teuthology.orchestra.run.smithi118.stdout:(23/139): python3-rbd-16.2.13-562.gb36cacbf.el8 2.5 MB/s | 369 kB 00:00 2023-08-22T00:03:30.662 INFO:teuthology.orchestra.run.smithi118.stdout:(24/139): python3-rgw-16.2.13-562.gb36cacbf.el8 1.1 MB/s | 114 kB 00:00 2023-08-22T00:03:30.704 INFO:teuthology.orchestra.run.smithi118.stdout:(25/139): rbd-fuse-16.2.13-562.gb36cacbf.el8.x8 1.3 MB/s | 88 kB 00:00 2023-08-22T00:03:30.796 INFO:teuthology.orchestra.run.smithi118.stdout:(26/139): rbd-nbd-16.2.13-562.gb36cacbf.el8.x86 1.8 MB/s | 173 kB 00:00 2023-08-22T00:03:30.888 INFO:teuthology.orchestra.run.smithi118.stdout:(27/139): ceph-grafana-dashboards-16.2.13-562.g 265 kB/s | 24 kB 00:00 2023-08-22T00:03:30.996 INFO:teuthology.orchestra.run.smithi118.stdout:(28/139): ceph-mgr-cephadm-16.2.13-562.gb36cacb 1.0 MB/s | 116 kB 00:00 2023-08-22T00:03:31.272 INFO:teuthology.orchestra.run.smithi118.stdout:(29/139): rbd-mirror-16.2.13-562.gb36cacbf.el8. 6.0 MB/s | 3.7 MB 00:00 2023-08-22T00:03:31.831 INFO:teuthology.orchestra.run.smithi118.stdout:(30/139): ceph-mgr-dashboard-16.2.13-562.gb36ca 3.8 MB/s | 3.1 MB 00:00 2023-08-22T00:03:31.908 INFO:teuthology.orchestra.run.smithi098.stdout:(7/139): ceph-common-16.2.13-562.gb36cacbf.el8. 3.5 MB/s | 24 MB 00:06 2023-08-22T00:03:31.939 INFO:teuthology.orchestra.run.smithi118.stdout:(31/139): ceph-mgr-modules-core-16.2.13-562.gb3 2.2 MB/s | 244 kB 00:00 2023-08-22T00:03:32.025 INFO:teuthology.orchestra.run.smithi098.stdout:(8/139): ceph-mon-16.2.13-562.gb36cacbf.el8.x86 1.4 MB/s | 5.0 MB 00:03 2023-08-22T00:03:32.039 INFO:teuthology.orchestra.run.smithi118.stdout:(32/139): ceph-mgr-rook-16.2.13-562.gb36cacbf.e 273 kB/s | 27 kB 00:00 2023-08-22T00:03:32.117 INFO:teuthology.orchestra.run.smithi098.stdout:(9/139): ceph-selinux-16.2.13-562.gb36cacbf.el8 280 kB/s | 26 kB 00:00 2023-08-22T00:03:32.131 INFO:teuthology.orchestra.run.smithi118.stdout:(33/139): ceph-prometheus-alerts-16.2.13-562.gb 162 kB/s | 15 kB 00:00 2023-08-22T00:03:32.257 INFO:teuthology.orchestra.run.smithi118.stdout:(34/139): cephadm-16.2.13-562.gb36cacbf.el8.noa 673 kB/s | 84 kB 00:00 2023-08-22T00:03:32.365 INFO:teuthology.orchestra.run.smithi118.stdout:(35/139): cephfs-top-16.2.13-562.gb36cacbf.el8. 171 kB/s | 19 kB 00:00 2023-08-22T00:03:32.657 INFO:teuthology.orchestra.run.smithi118.stdout:(36/139): ceph-mgr-diskprediction-local-16.2.13 6.2 MB/s | 8.6 MB 00:01 2023-08-22T00:03:32.883 INFO:teuthology.orchestra.run.smithi118.stdout:(37/139): automake-1.16.1-7.el8.noarch.rpm 1.3 MB/s | 713 kB 00:00 2023-08-22T00:03:32.950 INFO:teuthology.orchestra.run.smithi118.stdout:(38/139): bison-3.0.4-10.el8.x86_64.rpm 2.3 MB/s | 688 kB 00:00 2023-08-22T00:03:33.017 INFO:teuthology.orchestra.run.smithi118.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-08-22T00:03:33.042 INFO:teuthology.orchestra.run.smithi118.stdout:(40/139): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2023-08-22T00:03:33.092 INFO:teuthology.orchestra.run.smithi118.stdout:(41/139): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-08-22T00:03:33.159 INFO:teuthology.orchestra.run.smithi118.stdout:(42/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-08-22T00:03:33.235 INFO:teuthology.orchestra.run.smithi118.stdout:(43/139): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2023-08-22T00:03:33.260 INFO:teuthology.orchestra.run.smithi118.stdout:(44/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-08-22T00:03:33.494 INFO:teuthology.orchestra.run.smithi118.stdout:(45/139): openblas-threads-0.3.15-4.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-08-22T00:03:33.686 INFO:teuthology.orchestra.run.smithi118.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-08-22T00:03:33.761 INFO:teuthology.orchestra.run.smithi118.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 9.0 MB/s | 4.7 MB 00:00 2023-08-22T00:03:33.795 INFO:teuthology.orchestra.run.smithi118.stdout:(48/139): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2023-08-22T00:03:33.829 INFO:teuthology.orchestra.run.smithi118.stdout:(49/139): python3-jsonpatch-1.21-2.el8.noarch.r 395 kB/s | 27 kB 00:00 2023-08-22T00:03:33.871 INFO:teuthology.orchestra.run.smithi118.stdout:(50/139): python3-jsonpointer-1.10-11.el8.noarc 264 kB/s | 20 kB 00:00 2023-08-22T00:03:33.896 INFO:teuthology.orchestra.run.smithi118.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-22T00:03:33.921 INFO:teuthology.orchestra.run.smithi118.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2023-08-22T00:03:33.988 INFO:teuthology.orchestra.run.smithi118.stdout:(53/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-08-22T00:03:34.047 INFO:teuthology.orchestra.run.smithi118.stdout:(54/139): python3-prettytable-0.7.2-14.el8.noar 753 kB/s | 44 kB 00:00 2023-08-22T00:03:34.097 INFO:teuthology.orchestra.run.smithi118.stdout:(55/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-08-22T00:03:34.156 INFO:teuthology.orchestra.run.smithi118.stdout:(56/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-08-22T00:03:34.214 INFO:teuthology.orchestra.run.smithi118.stdout:(57/139): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-08-22T00:03:34.240 INFO:teuthology.orchestra.run.smithi118.stdout:(58/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-08-22T00:03:34.273 INFO:teuthology.orchestra.run.smithi118.stdout:(59/139): python3-pytz-2017.2-9.el8.noarch.rpm 922 kB/s | 54 kB 00:00 2023-08-22T00:03:34.374 INFO:teuthology.orchestra.run.smithi118.stdout:(60/139): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-08-22T00:03:34.466 INFO:teuthology.orchestra.run.smithi118.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-08-22T00:03:34.591 INFO:teuthology.orchestra.run.smithi118.stdout:(62/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 565 kB/s | 71 kB 00:00 2023-08-22T00:03:34.825 INFO:teuthology.orchestra.run.smithi098.stdout:(10/139): ceph-radosgw-16.2.13-562.gb36cacbf.el 4.0 MB/s | 12 MB 00:02 2023-08-22T00:03:34.875 INFO:teuthology.orchestra.run.smithi118.stdout:(63/139): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2023-08-22T00:03:34.900 INFO:teuthology.orchestra.run.smithi118.stdout:(64/139): elfutils-libelf-devel-0.189-2.el8.x86 199 kB/s | 61 kB 00:00 2023-08-22T00:03:34.975 INFO:teuthology.orchestra.run.smithi118.stdout:(65/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 640 kB/s | 48 kB 00:00 2023-08-22T00:03:35.034 INFO:teuthology.orchestra.run.smithi098.stdout:(11/139): cephfs-mirror-16.2.13-562.gb36cacbf.e 1.2 MB/s | 256 kB 00:00 2023-08-22T00:03:35.051 INFO:teuthology.orchestra.run.smithi118.stdout:(66/139): fuse-2.9.7-17.el8.x86_64.rpm 473 kB/s | 83 kB 00:00 2023-08-22T00:03:35.101 INFO:teuthology.orchestra.run.smithi098.stdout:(12/139): libcephfs-devel-16.2.13-562.gb36cacbf 384 kB/s | 25 kB 00:00 2023-08-22T00:03:35.118 INFO:teuthology.orchestra.run.smithi118.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-08-22T00:03:35.160 INFO:teuthology.orchestra.run.smithi118.stdout:(68/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-08-22T00:03:35.193 INFO:teuthology.orchestra.run.smithi118.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2023-08-22T00:03:35.293 INFO:teuthology.orchestra.run.smithi098.stdout:(13/139): libcephfs2-16.2.13-562.gb36cacbf.el8. 4.2 MB/s | 824 kB 00:00 2023-08-22T00:03:35.294 INFO:teuthology.orchestra.run.smithi118.stdout:(70/139): libgfortran-8.5.0-20.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2023-08-22T00:03:35.319 INFO:teuthology.orchestra.run.smithi118.stdout:(71/139): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-08-22T00:03:35.352 INFO:teuthology.orchestra.run.smithi118.stdout:(72/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-08-22T00:03:35.360 INFO:teuthology.orchestra.run.smithi098.stdout:(14/139): libcephsqlite-16.2.13-562.gb36cacbf.e 2.5 MB/s | 174 kB 00:00 2023-08-22T00:03:35.420 INFO:teuthology.orchestra.run.smithi118.stdout:(73/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-08-22T00:03:35.435 INFO:teuthology.orchestra.run.smithi098.stdout:(15/139): librados-devel-16.2.13-562.gb36cacbf. 1.7 MB/s | 131 kB 00:00 2023-08-22T00:03:35.445 INFO:teuthology.orchestra.run.smithi118.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-08-22T00:03:35.478 INFO:teuthology.orchestra.run.smithi118.stdout:(75/139): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-08-22T00:03:35.504 INFO:teuthology.orchestra.run.smithi118.stdout:(76/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 307 kB/s | 18 kB 00:00 2023-08-22T00:03:35.554 INFO:teuthology.orchestra.run.smithi118.stdout:(77/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 582 kB/s | 44 kB 00:00 2023-08-22T00:03:35.619 INFO:teuthology.orchestra.run.smithi098.stdout:(16/139): libradosstriper1-16.2.13-562.gb36cacb 2.6 MB/s | 494 kB 00:00 2023-08-22T00:03:35.647 INFO:teuthology.orchestra.run.smithi118.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-08-22T00:03:35.713 INFO:teuthology.orchestra.run.smithi118.stdout:(79/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-08-22T00:03:35.772 INFO:teuthology.orchestra.run.smithi118.stdout:(80/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-08-22T00:03:35.797 INFO:teuthology.orchestra.run.smithi118.stdout:(81/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-08-22T00:03:35.839 INFO:teuthology.orchestra.run.smithi118.stdout:(82/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.6 MB/s | 249 kB 00:00 2023-08-22T00:03:35.881 INFO:teuthology.orchestra.run.smithi118.stdout:(83/139): python3-cryptography-3.2.1-6.el8.x86_ 7.5 MB/s | 641 kB 00:00 2023-08-22T00:03:35.906 INFO:teuthology.orchestra.run.smithi118.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 636 kB/s | 43 kB 00:00 2023-08-22T00:03:35.940 INFO:teuthology.orchestra.run.smithi118.stdout:(85/139): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-08-22T00:03:35.965 INFO:teuthology.orchestra.run.smithi118.stdout:(86/139): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-08-22T00:03:36.007 INFO:teuthology.orchestra.run.smithi118.stdout:(87/139): python3-requests-oauthlib-1.0.0-1.el8 636 kB/s | 43 kB 00:00 2023-08-22T00:03:36.033 INFO:teuthology.orchestra.run.smithi118.stdout:(88/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2023-08-22T00:03:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:(89/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 993 kB/s | 58 kB 00:00 2023-08-22T00:03:36.652 INFO:teuthology.orchestra.run.smithi098.stdout:(17/139): librgw2-16.2.13-562.gb36cacbf.el8.x86 3.7 MB/s | 3.8 MB 00:01 2023-08-22T00:03:36.719 INFO:teuthology.orchestra.run.smithi098.stdout:(18/139): python3-ceph-argparse-16.2.13-562.gb3 677 kB/s | 45 kB 00:00 2023-08-22T00:03:36.733 INFO:teuthology.orchestra.run.smithi118.stdout:(90/139): leveldb-1.22-1.el8.x86_64.rpm 271 kB/s | 181 kB 00:00 2023-08-22T00:03:36.778 INFO:teuthology.orchestra.run.smithi098.stdout:(19/139): python3-ceph-common-16.2.13-562.gb36c 1.6 MB/s | 99 kB 00:00 2023-08-22T00:03:36.850 INFO:teuthology.orchestra.run.smithi118.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 504 kB/s | 59 kB 00:00 2023-08-22T00:03:36.875 INFO:teuthology.orchestra.run.smithi118.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 363 kB/s | 306 kB 00:00 2023-08-22T00:03:36.903 INFO:teuthology.orchestra.run.smithi098.stdout:(20/139): python3-cephfs-16.2.13-562.gb36cacbf. 1.7 MB/s | 215 kB 00:00 2023-08-22T00:03:36.992 INFO:teuthology.orchestra.run.smithi118.stdout:(93/139): python3-apipkg-1.5-6.el8.noarch.rpm 181 kB/s | 21 kB 00:00 2023-08-22T00:03:37.046 INFO:teuthology.orchestra.run.smithi098.stdout:(21/139): python3-rados-16.2.13-562.gb36cacbf.e 2.7 MB/s | 390 kB 00:00 2023-08-22T00:03:37.059 INFO:teuthology.orchestra.run.smithi118.stdout:(94/139): libunwind-1.3.1-3.el8.x86_64.rpm 359 kB/s | 75 kB 00:00 2023-08-22T00:03:37.110 INFO:teuthology.orchestra.run.smithi118.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2023-08-22T00:03:37.188 INFO:teuthology.orchestra.run.smithi098.stdout:(22/139): python3-rbd-16.2.13-562.gb36cacbf.el8 2.5 MB/s | 369 kB 00:00 2023-08-22T00:03:37.226 INFO:teuthology.orchestra.run.smithi118.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 283 kB/s | 33 kB 00:00 2023-08-22T00:03:37.271 INFO:teuthology.orchestra.run.smithi098.stdout:(23/139): python3-rgw-16.2.13-562.gb36cacbf.el8 1.3 MB/s | 114 kB 00:00 2023-08-22T00:03:37.338 INFO:teuthology.orchestra.run.smithi098.stdout:(24/139): rbd-fuse-16.2.13-562.gb36cacbf.el8.x8 1.3 MB/s | 88 kB 00:00 2023-08-22T00:03:37.352 INFO:teuthology.orchestra.run.smithi118.stdout:(97/139): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-08-22T00:03:37.469 INFO:teuthology.orchestra.run.smithi118.stdout:(98/139): python3-beautifulsoup4-4.6.3-2.el8.1. 452 kB/s | 185 kB 00:00 2023-08-22T00:03:37.661 INFO:teuthology.orchestra.run.smithi118.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 559 kB/s | 173 kB 00:00 2023-08-22T00:03:38.296 INFO:teuthology.orchestra.run.smithi098.stdout:(25/139): rbd-mirror-16.2.13-562.gb36cacbf.el8. 3.8 MB/s | 3.7 MB 00:00 2023-08-22T00:03:38.380 INFO:teuthology.orchestra.run.smithi098.stdout:(26/139): rbd-nbd-16.2.13-562.gb36cacbf.el8.x86 2.0 MB/s | 173 kB 00:00 2023-08-22T00:03:38.430 INFO:teuthology.orchestra.run.smithi098.stdout:(27/139): ceph-grafana-dashboards-16.2.13-562.g 487 kB/s | 24 kB 00:00 2023-08-22T00:03:38.497 INFO:teuthology.orchestra.run.smithi098.stdout:(28/139): ceph-mgr-cephadm-16.2.13-562.gb36cacb 1.7 MB/s | 116 kB 00:00 2023-08-22T00:03:38.511 INFO:teuthology.orchestra.run.smithi118.stdout:(100/139): ceph-test-16.2.13-562.gb36cacbf.el8. 5.6 MB/s | 52 MB 00:09 2023-08-22T00:03:38.536 INFO:teuthology.orchestra.run.smithi118.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 360 kB/s | 384 kB 00:01 2023-08-22T00:03:38.562 INFO:teuthology.orchestra.run.smithi118.stdout:(102/139): python3-execnet-1.7.1-1.el8.noarch.r 394 kB/s | 355 kB 00:00 2023-08-22T00:03:38.646 INFO:teuthology.orchestra.run.smithi118.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-08-22T00:03:38.671 INFO:teuthology.orchestra.run.smithi118.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-08-22T00:03:38.779 INFO:teuthology.orchestra.run.smithi118.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 449 kB/s | 49 kB 00:00 2023-08-22T00:03:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 441 kB/s | 59 kB 00:00 2023-08-22T00:03:38.980 INFO:teuthology.orchestra.run.smithi118.stdout:(107/139): python3-google-auth-1.1.1-10.el8.noa 174 kB/s | 81 kB 00:00 2023-08-22T00:03:39.097 INFO:teuthology.orchestra.run.smithi118.stdout:(108/139): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-08-22T00:03:39.205 INFO:teuthology.orchestra.run.smithi118.stdout:(109/139): python3-remoto-1.2.1-1.el8.noarch.rp 451 kB/s | 49 kB 00:00 2023-08-22T00:03:39.256 INFO:teuthology.orchestra.run.smithi098.stdout:(29/139): ceph-mgr-dashboard-16.2.13-562.gb36ca 4.1 MB/s | 3.1 MB 00:00 2023-08-22T00:03:39.347 INFO:teuthology.orchestra.run.smithi118.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 237 kB/s | 34 kB 00:00 2023-08-22T00:03:39.389 INFO:teuthology.orchestra.run.smithi118.stdout:(111/139): python3-pecan-1.3.2-9.el8.noarch.rpm 594 kB/s | 283 kB 00:00 2023-08-22T00:03:39.498 INFO:teuthology.orchestra.run.smithi118.stdout:(112/139): python3-rsa-4.9-2.el8.noarch.rpm 593 kB/s | 64 kB 00:00 2023-08-22T00:03:39.631 INFO:teuthology.orchestra.run.smithi118.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 140 kB/s | 19 kB 00:00 2023-08-22T00:03:39.774 INFO:teuthology.orchestra.run.smithi118.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 169 kB/s | 24 kB 00:00 2023-08-22T00:03:39.799 INFO:teuthology.orchestra.run.smithi118.stdout:(115/139): python3-routes-2.4.1-12.el8.noarch.r 435 kB/s | 196 kB 00:00 2023-08-22T00:03:39.823 INFO:teuthology.orchestra.run.smithi098.stdout:(30/139): ceph-osd-16.2.13-562.gb36cacbf.el8.x8 1.7 MB/s | 18 MB 00:10 2023-08-22T00:03:39.891 INFO:teuthology.orchestra.run.smithi118.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 250 kB/s | 29 kB 00:00 2023-08-22T00:03:39.916 INFO:teuthology.orchestra.run.smithi118.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 235 kB/s | 27 kB 00:00 2023-08-22T00:03:39.940 INFO:teuthology.orchestra.run.smithi098.stdout:(31/139): ceph-mgr-modules-core-16.2.13-562.gb3 2.1 MB/s | 244 kB 00:00 2023-08-22T00:03:40.048 INFO:teuthology.orchestra.run.smithi098.stdout:(32/139): ceph-mgr-rook-16.2.13-562.gb36cacbf.e 253 kB/s | 27 kB 00:00 2023-08-22T00:03:40.157 INFO:teuthology.orchestra.run.smithi098.stdout:(33/139): ceph-prometheus-alerts-16.2.13-562.gb 137 kB/s | 15 kB 00:00 2023-08-22T00:03:40.241 INFO:teuthology.orchestra.run.smithi098.stdout:(34/139): cephadm-16.2.13-562.gb36cacbf.el8.noa 1.0 MB/s | 84 kB 00:00 2023-08-22T00:03:40.300 INFO:teuthology.orchestra.run.smithi118.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 625 kB/s | 255 kB 00:00 2023-08-22T00:03:40.341 INFO:teuthology.orchestra.run.smithi098.stdout:(35/139): cephfs-top-16.2.13-562.gb36cacbf.el8. 186 kB/s | 19 kB 00:00 2023-08-22T00:03:40.417 INFO:teuthology.orchestra.run.smithi118.stdout:(119/139): python3-kubernetes-11.0.0-6.el8.noar 674 kB/s | 1.2 MB 00:01 2023-08-22T00:03:40.472 INFO:teuthology.orchestra.run.smithi118.stdout:(120/139): python3-webob-1.8.5-1.el8.1.noarch.r 452 kB/s | 251 kB 00:00 2023-08-22T00:03:40.501 INFO:teuthology.orchestra.run.smithi118.stdout:(121/139): python3-websocket-client-0.56.0-5.el 305 kB/s | 61 kB 00:00 2023-08-22T00:03:40.594 INFO:teuthology.orchestra.run.smithi118.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 190 kB/s | 23 kB 00:00 2023-08-22T00:03:40.627 INFO:teuthology.orchestra.run.smithi118.stdout:(123/139): python3-webtest-2.0.33-1.el8.noarch. 408 kB/s | 85 kB 00:00 2023-08-22T00:03:40.766 INFO:teuthology.orchestra.run.smithi098.stdout:(36/139): automake-1.16.1-7.el8.noarch.rpm 1.6 MB/s | 713 kB 00:00 2023-08-22T00:03:40.843 INFO:teuthology.orchestra.run.smithi118.stdout:(124/139): NetworkManager-initscripts-updown-1. 662 kB/s | 143 kB 00:00 2023-08-22T00:03:40.858 INFO:teuthology.orchestra.run.smithi098.stdout:(37/139): bison-3.0.4-10.el8.x86_64.rpm 7.3 MB/s | 688 kB 00:00 2023-08-22T00:03:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:(125/139): elfutils-debuginfod-client-0.189-2.e 1.1 MB/s | 76 kB 00:00 2023-08-22T00:03:40.917 INFO:teuthology.orchestra.run.smithi098.stdout:(38/139): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-08-22T00:03:40.976 INFO:teuthology.orchestra.run.smithi098.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-08-22T00:03:41.019 INFO:teuthology.orchestra.run.smithi118.stdout:(126/139): elfutils-libelf-0.189-2.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-08-22T00:03:41.059 INFO:teuthology.orchestra.run.smithi098.stdout:(40/139): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-08-22T00:03:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:(127/139): elfutils-libs-0.189-2.el8.x86_64.rpm 3.2 MB/s | 302 kB 00:00 2023-08-22T00:03:41.126 INFO:teuthology.orchestra.run.smithi098.stdout:(41/139): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-08-22T00:03:41.190 INFO:teuthology.orchestra.run.smithi098.stdout:(42/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-08-22T00:03:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:(128/139): iproute-6.2.0-2.el8.x86_64.rpm 6.9 MB/s | 880 kB 00:00 2023-08-22T00:03:41.244 INFO:teuthology.orchestra.run.smithi098.stdout:(43/139): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-08-22T00:03:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:(129/139): libblkid-2.32.1-42.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-22T00:03:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:(130/139): libfdisk-2.32.1-42.el8.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2023-08-22T00:03:41.386 INFO:teuthology.orchestra.run.smithi098.stdout:(44/139): ceph-mgr-diskprediction-local-16.2.13 4.0 MB/s | 8.6 MB 00:02 2023-08-22T00:03:41.446 INFO:teuthology.orchestra.run.smithi118.stdout:(131/139): libmount-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 236 kB 00:00 2023-08-22T00:03:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:(132/139): libsmartcols-2.32.1-42.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-08-22T00:03:41.511 INFO:teuthology.orchestra.run.smithi098.stdout:(45/139): openblas-0.3.15-4.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-08-22T00:03:41.563 INFO:teuthology.orchestra.run.smithi118.stdout:(133/139): libuuid-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 98 kB 00:00 2023-08-22T00:03:41.621 INFO:teuthology.orchestra.run.smithi118.stdout:(134/139): librados2-16.2.13-562.gb36cacbf.el8. 3.3 MB/s | 3.7 MB 00:01 2023-08-22T00:03:41.686 INFO:teuthology.orchestra.run.smithi098.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-08-22T00:03:41.738 INFO:teuthology.orchestra.run.smithi118.stdout:(135/139): util-linux-2.32.1-42.el8.x86_64.rpm 15 MB/s | 2.6 MB 00:00 2023-08-22T00:03:41.745 INFO:teuthology.orchestra.run.smithi098.stdout:(47/139): python3-jinja2-2.10.1-3.el8.noarch.rp 9.1 MB/s | 538 kB 00:00 2023-08-22T00:03:41.797 INFO:teuthology.orchestra.run.smithi118.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 5.6 MB/s | 334 kB 00:00 2023-08-22T00:03:41.803 INFO:teuthology.orchestra.run.smithi098.stdout:(48/139): python3-jsonpatch-1.21-2.el8.noarch.r 454 kB/s | 27 kB 00:00 2023-08-22T00:03:41.822 INFO:teuthology.orchestra.run.smithi118.stdout:(137/139): util-linux-user-2.32.1-42.el8.x86_64 510 kB/s | 102 kB 00:00 2023-08-22T00:03:41.889 INFO:teuthology.orchestra.run.smithi118.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2023-08-22T00:03:41.896 INFO:teuthology.orchestra.run.smithi098.stdout:(49/139): openblas-threads-0.3.15-4.el8.x86_64. 9.5 MB/s | 4.9 MB 00:00 2023-08-22T00:03:41.913 INFO:teuthology.orchestra.run.smithi098.stdout:(50/139): python3-jsonpointer-1.10-11.el8.noarc 183 kB/s | 20 kB 00:00 2023-08-22T00:03:41.947 INFO:teuthology.orchestra.run.smithi098.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-08-22T00:03:41.963 INFO:teuthology.orchestra.run.smithi098.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-08-22T00:03:42.022 INFO:teuthology.orchestra.run.smithi098.stdout:(53/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-08-22T00:03:42.072 INFO:teuthology.orchestra.run.smithi098.stdout:(54/139): python3-prettytable-0.7.2-14.el8.noar 876 kB/s | 44 kB 00:00 2023-08-22T00:03:42.131 INFO:teuthology.orchestra.run.smithi098.stdout:(55/139): python3-numpy-1.14.3-10.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-08-22T00:03:42.156 INFO:teuthology.orchestra.run.smithi098.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-08-22T00:03:42.190 INFO:teuthology.orchestra.run.smithi098.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-08-22T00:03:42.215 INFO:teuthology.orchestra.run.smithi098.stdout:(58/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-08-22T00:03:42.249 INFO:teuthology.orchestra.run.smithi098.stdout:(59/139): python3-pytz-2017.2-9.el8.noarch.rpm 925 kB/s | 54 kB 00:00 2023-08-22T00:03:42.316 INFO:teuthology.orchestra.run.smithi098.stdout:(60/139): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-08-22T00:03:42.364 INFO:teuthology.orchestra.run.smithi118.stdout:(139/139): librbd1-16.2.13-562.gb36cacbf.el8.x8 2.4 MB/s | 4.2 MB 00:01 2023-08-22T00:03:42.367 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-08-22T00:03:42.367 INFO:teuthology.orchestra.run.smithi118.stdout:Total 12 MB/s | 209 MB 00:17 2023-08-22T00:03:42.374 INFO:teuthology.orchestra.run.smithi098.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-22T00:03:42.425 INFO:teuthology.orchestra.run.smithi098.stdout:(62/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-08-22T00:03:42.633 INFO:teuthology.orchestra.run.smithi098.stdout:(63/139): python3-scipy-1.0.0-21.module_el8.5.0 33 MB/s | 14 MB 00:00 2023-08-22T00:03:42.659 INFO:teuthology.orchestra.run.smithi098.stdout:(64/139): elfutils-libelf-devel-0.189-2.el8.x86 263 kB/s | 61 kB 00:00 2023-08-22T00:03:42.734 INFO:teuthology.orchestra.run.smithi098.stdout:(65/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 641 kB/s | 48 kB 00:00 2023-08-22T00:03:42.809 INFO:teuthology.orchestra.run.smithi098.stdout:(66/139): fuse-2.9.7-17.el8.x86_64.rpm 473 kB/s | 83 kB 00:00 2023-08-22T00:03:42.868 INFO:teuthology.orchestra.run.smithi098.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-08-22T00:03:42.918 INFO:teuthology.orchestra.run.smithi098.stdout:(68/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-08-22T00:03:42.943 INFO:teuthology.orchestra.run.smithi098.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 515 kB/s | 39 kB 00:00 2023-08-22T00:03:43.019 INFO:teuthology.orchestra.run.smithi098.stdout:(70/139): libgfortran-8.5.0-20.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2023-08-22T00:03:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:(71/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 807 kB/s | 47 kB 00:00 2023-08-22T00:03:43.103 INFO:teuthology.orchestra.run.smithi098.stdout:(72/139): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2023-08-22T00:03:43.136 INFO:teuthology.orchestra.run.smithi098.stdout:(73/139): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-08-22T00:03:43.170 INFO:teuthology.orchestra.run.smithi098.stdout:(74/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-08-22T00:03:43.195 INFO:teuthology.orchestra.run.smithi098.stdout:(75/139): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-08-22T00:03:43.216 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-08-22T00:03:43.229 INFO:teuthology.orchestra.run.smithi098.stdout:(76/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-08-22T00:03:43.255 INFO:teuthology.orchestra.run.smithi098.stdout:(77/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 744 kB/s | 44 kB 00:00 2023-08-22T00:03:43.321 INFO:teuthology.orchestra.run.smithi098.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-08-22T00:03:43.388 INFO:teuthology.orchestra.run.smithi098.stdout:(79/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-08-22T00:03:43.455 INFO:teuthology.orchestra.run.smithi098.stdout:(80/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-08-22T00:03:43.564 INFO:teuthology.orchestra.run.smithi098.stdout:(81/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 9.5 MB/s | 3.2 MB 00:00 2023-08-22T00:03:43.597 INFO:teuthology.orchestra.run.smithi098.stdout:(82/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2023-08-22T00:03:43.639 INFO:teuthology.orchestra.run.smithi098.stdout:(83/139): python3-cryptography-3.2.1-6.el8.x86_ 8.3 MB/s | 641 kB 00:00 2023-08-22T00:03:43.641 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-08-22T00:03:43.641 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-08-22T00:03:43.656 INFO:teuthology.orchestra.run.smithi098.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 729 kB/s | 43 kB 00:00 2023-08-22T00:03:43.699 INFO:teuthology.orchestra.run.smithi098.stdout:(85/139): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-08-22T00:03:43.724 INFO:teuthology.orchestra.run.smithi098.stdout:(86/139): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-08-22T00:03:43.749 INFO:teuthology.orchestra.run.smithi098.stdout:(87/139): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-08-22T00:03:43.782 INFO:teuthology.orchestra.run.smithi098.stdout:(88/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-08-22T00:03:43.800 INFO:teuthology.orchestra.run.smithi098.stdout:(89/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-08-22T00:03:44.116 INFO:teuthology.orchestra.run.smithi098.stdout:(90/139): leveldb-1.22-1.el8.x86_64.rpm 572 kB/s | 181 kB 00:00 2023-08-22T00:03:44.167 INFO:teuthology.orchestra.run.smithi098.stdout:(91/139): gperftools-libs-2.7-9.el8.x86_64.rpm 798 kB/s | 306 kB 00:00 2023-08-22T00:03:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2023-08-22T00:03:44.362 INFO:teuthology.orchestra.run.smithi098.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 385 kB/s | 75 kB 00:00 2023-08-22T00:03:44.476 INFO:teuthology.orchestra.run.smithi098.stdout:(94/139): python3-apipkg-1.5-6.el8.noarch.rpm 134 kB/s | 21 kB 00:00 2023-08-22T00:03:44.535 INFO:teuthology.orchestra.run.smithi098.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 253 kB/s | 44 kB 00:00 2023-08-22T00:03:44.660 INFO:teuthology.orchestra.run.smithi098.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-08-22T00:03:44.719 INFO:teuthology.orchestra.run.smithi098.stdout:(97/139): python3-beautifulsoup4-4.6.3-2.el8.1. 765 kB/s | 185 kB 00:00 2023-08-22T00:03:44.786 INFO:teuthology.orchestra.run.smithi098.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-08-22T00:03:44.821 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-08-22T00:03:44.824 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-08-22T00:03:44.919 INFO:teuthology.orchestra.run.smithi098.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 862 kB/s | 173 kB 00:00 2023-08-22T00:03:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:(100/139): python3-cherrypy-18.4.0-1.el8.noarch 1.3 MB/s | 384 kB 00:00 2023-08-22T00:03:45.203 INFO:teuthology.orchestra.run.smithi098.stdout:(101/139): python3-execnet-1.7.1-1.el8.noarch.r 1.2 MB/s | 355 kB 00:00 2023-08-22T00:03:45.228 INFO:teuthology.orchestra.run.smithi098.stdout:(102/139): python3-google-auth-1.1.1-10.el8.noa 542 kB/s | 81 kB 00:00 2023-08-22T00:03:45.312 INFO:teuthology.orchestra.run.smithi098.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-08-22T00:03:45.354 INFO:teuthology.orchestra.run.smithi098.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2023-08-22T00:03:45.513 INFO:teuthology.orchestra.run.smithi098.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 308 kB/s | 49 kB 00:00 2023-08-22T00:03:45.705 INFO:teuthology.orchestra.run.smithi098.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 306 kB/s | 59 kB 00:00 2023-08-22T00:03:45.763 INFO:teuthology.orchestra.run.smithi098.stdout:(107/139): python3-kubernetes-11.0.0-6.el8.noar 2.6 MB/s | 1.2 MB 00:00 2023-08-22T00:03:46.272 INFO:teuthology.orchestra.run.smithi098.stdout:(108/139): ceph-test-16.2.13-562.gb36cacbf.el8. 3.6 MB/s | 52 MB 00:14 2023-08-22T00:03:46.297 INFO:teuthology.orchestra.run.smithi098.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 29 kB/s | 16 kB 00:00 2023-08-22T00:03:46.364 INFO:teuthology.orchestra.run.smithi098.stdout:(110/139): python3-pecan-1.3.2-9.el8.noarch.rpm 429 kB/s | 283 kB 00:00 2023-08-22T00:03:46.456 INFO:teuthology.orchestra.run.smithi098.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 212 kB/s | 34 kB 00:00 2023-08-22T00:03:46.482 INFO:teuthology.orchestra.run.smithi098.stdout:(112/139): python3-remoto-1.2.1-1.el8.noarch.rp 234 kB/s | 49 kB 00:00 2023-08-22T00:03:46.592 INFO:teuthology.orchestra.run.smithi098.stdout:(113/139): python3-routes-2.4.1-12.el8.noarch.r 871 kB/s | 196 kB 00:00 2023-08-22T00:03:46.615 INFO:teuthology.orchestra.run.smithi098.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 140 kB/s | 19 kB 00:00 2023-08-22T00:03:46.641 INFO:teuthology.orchestra.run.smithi098.stdout:(115/139): python3-rsa-4.9-2.el8.noarch.rpm 349 kB/s | 64 kB 00:00 2023-08-22T00:03:46.749 INFO:teuthology.orchestra.run.smithi098.stdout:(116/139): python3-singledispatch-3.4.0.3-18.el 150 kB/s | 24 kB 00:00 2023-08-22T00:03:46.775 INFO:teuthology.orchestra.run.smithi098.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 206 kB/s | 27 kB 00:00 2023-08-22T00:03:46.800 INFO:teuthology.orchestra.run.smithi098.stdout:(118/139): python3-tempora-1.14.1-5.el8.noarch. 159 kB/s | 29 kB 00:00 2023-08-22T00:03:46.951 INFO:teuthology.orchestra.run.smithi098.stdout:(119/139): python3-websocket-client-0.56.0-5.el 408 kB/s | 61 kB 00:00 2023-08-22T00:03:47.009 INFO:teuthology.orchestra.run.smithi098.stdout:(120/139): python3-waitress-1.4.3-1.el8.noarch. 986 kB/s | 255 kB 00:00 2023-08-22T00:03:47.059 INFO:teuthology.orchestra.run.smithi098.stdout:(121/139): python3-webob-1.8.5-1.el8.1.noarch.r 884 kB/s | 251 kB 00:00 2023-08-22T00:03:47.134 INFO:teuthology.orchestra.run.smithi098.stdout:(122/139): python3-webtest-2.0.33-1.el8.noarch. 465 kB/s | 85 kB 00:00 2023-08-22T00:03:47.168 INFO:teuthology.orchestra.run.smithi098.stdout:(123/139): python3-zc-lockfile-2.0-2.el8.noarch 144 kB/s | 23 kB 00:00 2023-08-22T00:03:47.377 INFO:teuthology.orchestra.run.smithi098.stdout:(124/139): NetworkManager-initscripts-updown-1. 688 kB/s | 143 kB 00:00 2023-08-22T00:03:47.444 INFO:teuthology.orchestra.run.smithi098.stdout:(125/139): elfutils-debuginfod-client-0.189-2.e 1.1 MB/s | 76 kB 00:00 2023-08-22T00:03:47.544 INFO:teuthology.orchestra.run.smithi098.stdout:(126/139): elfutils-libelf-0.189-2.el8.x86_64.r 2.3 MB/s | 232 kB 00:00 2023-08-22T00:03:47.627 INFO:teuthology.orchestra.run.smithi098.stdout:(127/139): elfutils-libs-0.189-2.el8.x86_64.rpm 3.6 MB/s | 302 kB 00:00 2023-08-22T00:03:47.736 INFO:teuthology.orchestra.run.smithi098.stdout:(128/139): iproute-6.2.0-2.el8.x86_64.rpm 7.9 MB/s | 880 kB 00:00 2023-08-22T00:03:47.795 INFO:teuthology.orchestra.run.smithi098.stdout:(129/139): libblkid-2.32.1-42.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-08-22T00:03:47.876 INFO:teuthology.orchestra.run.smithi098.stdout:(130/139): librados2-16.2.13-562.gb36cacbf.el8. 4.6 MB/s | 3.7 MB 00:00 2023-08-22T00:03:47.904 INFO:teuthology.orchestra.run.smithi098.stdout:(131/139): libfdisk-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2023-08-22T00:03:47.962 INFO:teuthology.orchestra.run.smithi098.stdout:(132/139): librbd1-16.2.13-562.gb36cacbf.el8.x8 5.0 MB/s | 4.2 MB 00:00 2023-08-22T00:03:47.988 INFO:teuthology.orchestra.run.smithi098.stdout:(133/139): libsmartcols-2.32.1-42.el8.x86_64.rp 2.1 MB/s | 179 kB 00:00 2023-08-22T00:03:48.121 INFO:teuthology.orchestra.run.smithi098.stdout:(134/139): util-linux-2.32.1-42.el8.x86_64.rpm 19 MB/s | 2.6 MB 00:00 2023-08-22T00:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout:(135/139): libuuid-2.32.1-42.el8.x86_64.rpm 491 kB/s | 98 kB 00:00 2023-08-22T00:03:48.189 INFO:teuthology.orchestra.run.smithi098.stdout:(136/139): libmount-2.32.1-42.el8.x86_64.rpm 756 kB/s | 236 kB 00:00 2023-08-22T00:03:48.214 INFO:teuthology.orchestra.run.smithi098.stdout:(137/139): util-linux-user-2.32.1-42.el8.x86_64 1.1 MB/s | 102 kB 00:00 2023-08-22T00:03:48.306 INFO:teuthology.orchestra.run.smithi098.stdout:(138/139): xfsdump-3.1.8-6.el8.x86_64.rpm 2.3 MB/s | 334 kB 00:00 2023-08-22T00:03:48.356 INFO:teuthology.orchestra.run.smithi098.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2023-08-22T00:03:48.359 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-08-22T00:03:48.360 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.8 MB/s | 209 MB 00:23 2023-08-22T00:03:49.216 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-08-22T00:03:49.640 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-08-22T00:03:49.641 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-08-22T00:03:50.003 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-08-22T00:03:50.070 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-22T00:03:50.216 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/155 2023-08-22T00:03:50.303 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/155 2023-08-22T00:03:50.466 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/155 2023-08-22T00:03:50.533 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/155 2023-08-22T00:03:50.725 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-08-22T00:03:50.838 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-08-22T00:03:50.841 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-08-22T00:03:50.959 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-08-22T00:03:51.162 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/155 2023-08-22T00:03:51.363 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-08-22T00:03:51.524 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-22T00:03:51.914 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-22T00:03:52.107 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:03:52.505 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:03:52.666 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:03:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:03:52.966 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:03:53.047 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:03:53.316 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 11/155 2023-08-22T00:03:53.474 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-22T00:03:53.851 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-22T00:03:53.982 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:03:54.199 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:03:54.432 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-22T00:03:54.487 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-22T00:03:54.731 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-08-22T00:03:54.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-08-22T00:03:55.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 17/155 2023-08-22T00:03:55.259 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 17/155 2023-08-22T00:03:55.407 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:03:55.529 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:03:55.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-08-22T00:03:55.863 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-08-22T00:03:56.032 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-22T00:03:56.164 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-08-22T00:03:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-22T00:03:56.202 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-22T00:03:56.298 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-22T00:03:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/155 2023-08-22T00:03:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/155 2023-08-22T00:03:56.579 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/155 2023-08-22T00:03:56.634 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/155 2023-08-22T00:03:56.829 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-08-22T00:03:56.877 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-22T00:03:57.082 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-08-22T00:03:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-08-22T00:03:57.284 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/155 2023-08-22T00:03:57.494 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-08-22T00:03:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-22T00:03:57.696 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-08-22T00:03:57.865 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-22T00:03:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-22T00:03:58.238 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:03:58.562 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-22T00:03:58.641 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:03:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:03:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-08-22T00:03:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:03:59.121 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-08-22T00:03:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:03:59.221 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:03:59.284 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/155 2023-08-22T00:03:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 11/155 2023-08-22T00:03:59.469 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-08-22T00:03:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-22T00:03:59.687 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:16.2.13-562.gb36cacbf.el8. 29/155 2023-08-22T00:03:59.862 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el 30/155 2023-08-22T00:04:00.014 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-22T00:04:00.110 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_6 31/155 2023-08-22T00:04:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:04:00.365 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:04:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-22T00:04:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-22T00:04:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-08-22T00:04:01.110 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-08-22T00:04:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-08-22T00:04:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 17/155 2023-08-22T00:04:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 17/155 2023-08-22T00:04:01.415 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-08-22T00:04:01.562 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:04:01.677 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:04:01.729 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-08-22T00:04:01.860 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-08-22T00:04:01.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-22T00:04:02.066 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-08-22T00:04:02.204 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-22T00:04:02.322 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-22T00:04:02.503 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-22T00:04:03.102 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-22T00:04:03.296 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-08-22T00:04:03.730 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-22T00:04:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-08-22T00:04:04.018 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-08-22T00:04:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-22T00:04:04.190 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-08-22T00:04:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-08-22T00:04:04.640 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 39/155 2023-08-22T00:04:04.779 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-22T00:04:04.810 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 40/155 2023-08-22T00:04:05.056 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_6 41/155 2023-08-22T00:04:05.091 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-08-22T00:04:05.268 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-08-22T00:04:05.278 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/155 2023-08-22T00:04:05.467 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/155 2023-08-22T00:04:05.473 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/155 2023-08-22T00:04:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-08-22T00:04:05.697 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/155 2023-08-22T00:04:05.766 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/155 2023-08-22T00:04:05.892 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:16.2.13-562.gb36cacbf.el8. 29/155 2023-08-22T00:04:05.997 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/155 2023-08-22T00:04:06.067 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/155 2023-08-22T00:04:06.085 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el 30/155 2023-08-22T00:04:06.209 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/155 2023-08-22T00:04:06.346 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_6 31/155 2023-08-22T00:04:06.397 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-08-22T00:04:06.942 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-08-22T00:04:07.181 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/155 2023-08-22T00:04:07.196 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/155 2023-08-22T00:04:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-08-22T00:04:07.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-08-22T00:04:07.618 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-08-22T00:04:07.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-08-22T00:04:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-08-22T00:04:07.904 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-08-22T00:04:08.059 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-08-22T00:04:08.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-22T00:04:08.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-08-22T00:04:08.439 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-08-22T00:04:08.684 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-08-22T00:04:08.850 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-08-22T00:04:09.036 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-08-22T00:04:09.217 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-08-22T00:04:09.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-08-22T00:04:09.607 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-08-22T00:04:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-08-22T00:04:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-22T00:04:10.014 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-08-22T00:04:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-08-22T00:04:10.246 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-08-22T00:04:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-08-22T00:04:10.482 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-08-22T00:04:10.618 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-08-22T00:04:10.833 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-08-22T00:04:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 39/155 2023-08-22T00:04:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 40/155 2023-08-22T00:04:11.086 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-08-22T00:04:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_6 41/155 2023-08-22T00:04:11.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-08-22T00:04:11.514 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/155 2023-08-22T00:04:11.610 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-08-22T00:04:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/155 2023-08-22T00:04:11.805 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-08-22T00:04:12.006 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-08-22T00:04:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/155 2023-08-22T00:04:12.254 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-08-22T00:04:12.317 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/155 2023-08-22T00:04:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/155 2023-08-22T00:04:12.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-08-22T00:04:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/155 2023-08-22T00:04:12.740 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/155 2023-08-22T00:04:12.905 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-08-22T00:04:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-08-22T00:04:13.166 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-08-22T00:04:13.381 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-08-22T00:04:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-08-22T00:04:13.659 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-08-22T00:04:13.754 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/155 2023-08-22T00:04:13.768 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/155 2023-08-22T00:04:13.893 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-08-22T00:04:13.955 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-08-22T00:04:14.212 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-08-22T00:04:14.434 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-08-22T00:04:14.640 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-08-22T00:04:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-08-22T00:04:14.959 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-08-22T00:04:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-08-22T00:04:15.204 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-08-22T00:04:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-08-22T00:04:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-08-22T00:04:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-08-22T00:04:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-08-22T00:04:15.815 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-08-22T00:04:16.000 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-08-22T00:04:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-08-22T00:04:16.267 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-08-22T00:04:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-08-22T00:04:16.547 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-08-22T00:04:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-08-22T00:04:16.773 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-08-22T00:04:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-08-22T00:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-08-22T00:04:17.114 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-08-22T00:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-08-22T00:04:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-08-22T00:04:17.576 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-08-22T00:04:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-08-22T00:04:17.731 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-08-22T00:04:17.945 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-08-22T00:04:17.966 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-08-22T00:04:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-08-22T00:04:18.259 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-08-22T00:04:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-08-22T00:04:18.483 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-08-22T00:04:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-08-22T00:04:18.643 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-08-22T00:04:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-08-22T00:04:18.855 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-08-22T00:04:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-08-22T00:04:19.055 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-08-22T00:04:19.284 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-08-22T00:04:19.413 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-08-22T00:04:19.509 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-08-22T00:04:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-08-22T00:04:19.695 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-08-22T00:04:19.855 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-08-22T00:04:19.912 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-08-22T00:04:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-08-22T00:04:20.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-08-22T00:04:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-08-22T00:04:21.735 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-08-22T00:04:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-08-22T00:04:22.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-08-22T00:04:22.359 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:22.587 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:22.595 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-08-22T00:04:22.870 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-08-22T00:04:23.090 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-08-22T00:04:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-08-22T00:04:23.594 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 99/155 2023-08-22T00:04:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-08-22T00:04:23.696 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 99/155 2023-08-22T00:04:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 100/155 2023-08-22T00:04:23.869 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-08-22T00:04:24.053 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-08-22T00:04:24.362 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-08-22T00:04:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-08-22T00:04:24.772 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-08-22T00:04:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-08-22T00:04:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-08-22T00:04:25.458 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-08-22T00:04:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-08-22T00:04:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-08-22T00:04:26.001 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-08-22T00:04:28.498 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 98/155 2023-08-22T00:04:29.789 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 99/155 2023-08-22T00:04:29.896 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 99/155 2023-08-22T00:04:30.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 100/155 2023-08-22T00:04:42.428 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 100/155 2023-08-22T00:04:42.428 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-08-22T00:04:42.428 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-08-22T00:04:42.428 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-08-22T00:04:42.428 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-08-22T00:04:42.429 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:04:42.866 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 101/155 2023-08-22T00:04:43.289 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 101/155 2023-08-22T00:04:43.525 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 102/155 2023-08-22T00:04:45.020 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 102/155 2023-08-22T00:04:45.242 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 103/155 2023-08-22T00:04:45.271 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 103/155 2023-08-22T00:04:45.482 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-08-22T00:04:45.720 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-08-22T00:04:45.866 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-22T00:04:45.952 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-22T00:04:46.204 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-08-22T00:04:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 108/155 2023-08-22T00:04:47.133 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 109/155 2023-08-22T00:04:47.302 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 109/155 2023-08-22T00:04:47.414 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.e 110/155 2023-08-22T00:04:47.601 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf. 111/155 2023-08-22T00:04:47.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 112/155 2023-08-22T00:04:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 100/155 2023-08-22T00:04:48.310 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2023-08-22T00:04:48.310 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2023-08-22T00:04:48.310 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-08-22T00:04:48.311 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /run 2023-08-22T00:04:48.311 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2023-08-22T00:04:48.311 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2023-08-22T00:04:48.312 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2023-08-22T00:04:48.312 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2023-08-22T00:04:48.312 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-08-22T00:04:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:04:48.739 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 112/155 2023-08-22T00:04:48.748 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 101/155 2023-08-22T00:04:49.023 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 113/155 2023-08-22T00:04:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 101/155 2023-08-22T00:04:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 102/155 2023-08-22T00:04:50.059 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 113/155 2023-08-22T00:04:50.273 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 114/155 2023-08-22T00:04:50.372 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 114/155 2023-08-22T00:04:50.772 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el 115/155 2023-08-22T00:04:50.863 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 102/155 2023-08-22T00:04:50.982 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 116/155 2023-08-22T00:04:51.008 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 116/155 2023-08-22T00:04:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 103/155 2023-08-22T00:04:51.109 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 103/155 2023-08-22T00:04:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 117/155 2023-08-22T00:04:51.218 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 117/155 2023-08-22T00:04:51.343 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-08-22T00:04:51.428 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 118/155 2023-08-22T00:04:51.550 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-08-22T00:04:51.581 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-08-22T00:04:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-22T00:04:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-22T00:04:52.056 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-08-22T00:04:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.1-7.el8.noarch 108/155 2023-08-22T00:04:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 109/155 2023-08-22T00:04:52.980 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 109/155 2023-08-22T00:04:53.103 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.e 110/155 2023-08-22T00:04:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf. 111/155 2023-08-22T00:04:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 112/155 2023-08-22T00:04:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 112/155 2023-08-22T00:04:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 113/155 2023-08-22T00:04:55.731 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 113/155 2023-08-22T00:04:55.935 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 114/155 2023-08-22T00:04:56.033 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 114/155 2023-08-22T00:04:56.115 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-08-22T00:04:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el 115/155 2023-08-22T00:04:56.610 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 116/155 2023-08-22T00:04:56.636 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 116/155 2023-08-22T00:04:56.797 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 117/155 2023-08-22T00:04:56.808 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 117/155 2023-08-22T00:04:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 118/155 2023-08-22T00:04:57.188 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-08-22T00:04:57.353 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 120/155 2023-08-22T00:04:57.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 121/155 2023-08-22T00:04:57.711 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 121/155 2023-08-22T00:04:57.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-562.gb36ca 122/155 2023-08-22T00:04:57.947 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-562.gb36ca 122/155 2023-08-22T00:04:58.139 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 123/155 2023-08-22T00:04:58.490 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 123/155 2023-08-22T00:04:58.664 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:04:58.756 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:04:59.655 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 125/155 2023-08-22T00:04:59.959 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-08-22T00:05:00.211 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 127/155 2023-08-22T00:05:00.466 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 128/155 2023-08-22T00:05:00.617 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-08-22T00:05:00.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_ 130/155 2023-08-22T00:05:01.076 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-08-22T00:05:01.263 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 132/155 2023-08-22T00:05:01.512 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 133/155 2023-08-22T00:05:01.703 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-08-22T00:05:01.896 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 134/155 2023-08-22T00:05:02.165 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-08-22T00:05:02.341 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-08-22T00:05:02.358 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-08-22T00:05:02.572 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-08-22T00:05:02.788 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-08-22T00:05:02.872 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-08-22T00:05:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 120/155 2023-08-22T00:05:03.105 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-08-22T00:05:03.119 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-08-22T00:05:03.143 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 121/155 2023-08-22T00:05:03.234 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 121/155 2023-08-22T00:05:03.298 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-08-22T00:05:03.413 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-562.gb36ca 122/155 2023-08-22T00:05:03.453 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-562.gb36ca 122/155 2023-08-22T00:05:03.466 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-08-22T00:05:03.609 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-08-22T00:05:03.610 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-22T00:05:03.671 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 123/155 2023-08-22T00:05:03.861 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-22T00:05:03.861 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-22T00:05:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 123/155 2023-08-22T00:05:04.098 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-22T00:05:04.104 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-22T00:05:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:05:04.233 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-22T00:05:04.233 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-22T00:05:04.303 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:05:04.489 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-22T00:05:04.707 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-08-22T00:05:04.864 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-08-22T00:05:05.065 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-22T00:05:05.065 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-22T00:05:05.219 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 125/155 2023-08-22T00:05:05.307 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-22T00:05:05.307 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:05.499 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:05.499 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-22T00:05:05.550 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-08-22T00:05:05.699 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-22T00:05:05.699 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-22T00:05:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 127/155 2023-08-22T00:05:05.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-22T00:05:05.899 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-22T00:05:06.032 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 128/155 2023-08-22T00:05:06.132 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-22T00:05:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-08-22T00:05:06.306 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-22T00:05:06.452 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_ 130/155 2023-08-22T00:05:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-08-22T00:05:06.870 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 132/155 2023-08-22T00:05:06.894 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-22T00:05:06.898 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 1/155 2023-08-22T00:05:06.898 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 2/155 2023-08-22T00:05:06.898 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 3/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 4/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-562.gb36ca 5/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 6/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 7/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:05:06.899 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 11/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 12/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_ 14/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 15/155 2023-08-22T00:05:06.900 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 16/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_6 17/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 19/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el 20/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:16.2.13-562.gb36cacbf.el8. 21/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_6 22/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 23/155 2023-08-22T00:05:06.901 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 24/155 2023-08-22T00:05:06.902 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 25/155 2023-08-22T00:05:06.904 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 26/155 2023-08-22T00:05:06.904 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 27/155 2023-08-22T00:05:06.916 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 28/155 2023-08-22T00:05:06.916 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf. 29/155 2023-08-22T00:05:06.916 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 30/155 2023-08-22T00:05:06.916 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 31/155 2023-08-22T00:05:06.916 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 32/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el 33/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 34/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.e 35/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 36/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 37/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 38/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-08-22T00:05:06.917 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-08-22T00:05:06.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-08-22T00:05:06.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-08-22T00:05:06.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-08-22T00:05:06.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-08-22T00:05:06.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-08-22T00:05:06.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 65/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-08-22T00:05:06.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-08-22T00:05:06.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-08-22T00:05:06.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-08-22T00:05:06.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 76/155 2023-08-22T00:05:06.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-08-22T00:05:06.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-08-22T00:05:06.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-08-22T00:05:06.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-08-22T00:05:06.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-08-22T00:05:06.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-08-22T00:05:06.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-08-22T00:05:06.929 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:05:06.930 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 126/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 128/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 130/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-08-22T00:05:06.931 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 132/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 134/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 138/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-08-22T00:05:06.932 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 140/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 142/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 144/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 146/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-08-22T00:05:06.933 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 148/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 150/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-08-22T00:05:06.934 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-08-22T00:05:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 133/155 2023-08-22T00:05:07.513 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 134/155 2023-08-22T00:05:07.791 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-08-22T00:05:07.955 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-08-22T00:05:07.967 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-08-22T00:05:08.168 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-08-22T00:05:08.387 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-08-22T00:05:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-08-22T00:05:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-08-22T00:05:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-08-22T00:05:08.913 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-08-22T00:05:08.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-08-22T00:05:08.961 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:08.961 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.963 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.964 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.965 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.966 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-22T00:05:08.967 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-7.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: leveldb-1.22-1.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.968 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.969 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-22T00:05:08.970 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-22T00:05:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-22T00:05:08.972 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-22T00:05:08.973 INFO:teuthology.orchestra.run.smithi118.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-22T00:05:08.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-22T00:05:08.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-22T00:05:08.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-22T00:05:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-22T00:05:08.978 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.979 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-22T00:05:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-22T00:05:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-22T00:05:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-22T00:05:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:08.981 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-08-22T00:05:09.062 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-08-22T00:05:09.191 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-08-22T00:05:09.191 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-22T00:05:09.235 DEBUG:teuthology.parallel:result is None 2023-08-22T00:05:09.456 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-22T00:05:09.457 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-22T00:05:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-22T00:05:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-22T00:05:09.799 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-22T00:05:09.799 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-22T00:05:10.051 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-22T00:05:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-08-22T00:05:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-08-22T00:05:10.655 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-22T00:05:10.655 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-22T00:05:10.864 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-22T00:05:10.864 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-22T00:05:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-22T00:05:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-22T00:05:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-22T00:05:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-22T00:05:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-22T00:05:11.804 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-22T00:05:12.397 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 1/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 2/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 3/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 4/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-562.gb36ca 5/155 2023-08-22T00:05:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 6/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 7/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 8/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 9/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 10/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 11/155 2023-08-22T00:05:12.399 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 12/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 13/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_ 14/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 15/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 16/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_6 17/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86 18/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 19/155 2023-08-22T00:05:12.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el 20/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:16.2.13-562.gb36cacbf.el8. 21/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_6 22/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 23/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 24/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 25/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 26/155 2023-08-22T00:05:12.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 27/155 2023-08-22T00:05:12.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 28/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf. 29/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noa 30/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.n 31/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-562.gb36 32/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el 33/155 2023-08-22T00:05:12.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 34/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.e 35/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 36/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 37/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.1-7.el8.noarch 38/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-08-22T00:05:12.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-08-22T00:05:12.422 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-08-22T00:05:12.423 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-08-22T00:05:12.424 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 65/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-08-22T00:05:12.425 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 76/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-08-22T00:05:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-08-22T00:05:12.427 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-08-22T00:05:12.427 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-08-22T00:05:12.427 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-08-22T00:05:12.427 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-08-22T00:05:12.428 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-08-22T00:05:12.428 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-08-22T00:05:12.428 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-08-22T00:05:12.428 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-08-22T00:05:12.429 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-08-22T00:05:12.430 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-08-22T00:05:12.431 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-08-22T00:05:12.432 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-08-22T00:05:12.433 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 124/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 126/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 128/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 130/155 2023-08-22T00:05:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 132/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 134/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 138/155 2023-08-22T00:05:12.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-08-22T00:05:12.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 140/155 2023-08-22T00:05:12.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 142/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 144/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 146/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-08-22T00:05:12.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 148/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 150/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-08-22T00:05:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-08-22T00:05:14.519 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-08-22T00:05:14.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:14.520 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2023-08-22T00:05:14.521 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-22T00:05:14.521 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-22T00:05:14.522 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-22T00:05:14.522 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-22T00:05:14.522 INFO:teuthology.orchestra.run.smithi098.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-22T00:05:14.522 INFO:teuthology.orchestra.run.smithi098.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.523 INFO:teuthology.orchestra.run.smithi098.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.523 INFO:teuthology.orchestra.run.smithi098.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.523 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.523 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.524 INFO:teuthology.orchestra.run.smithi098.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.533 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.1-7.el8.noarch 2023-08-22T00:05:14.534 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.0.4-10.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.535 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.536 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.536 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.536 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.537 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:16.2.13-562.gb36cacbf.el8.noarch 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.1-9.el8.x86_64 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-22T00:05:14.538 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-22T00:05:14.539 INFO:teuthology.orchestra.run.smithi098.stdout: jq-1.6-7.el8.x86_64 2023-08-22T00:05:14.539 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-22T00:05:14.539 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-22T00:05:14.539 INFO:teuthology.orchestra.run.smithi098.stdout: leveldb-1.22-1.el8.x86_64 2023-08-22T00:05:14.539 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-22T00:05:14.540 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-22T00:05:14.541 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-22T00:05:14.542 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-22T00:05:14.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.544 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-22T00:05:14.545 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-22T00:05:14.545 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-22T00:05:14.545 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-22T00:05:14.546 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-22T00:05:14.547 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-2.6-1.el8.noarch 2023-08-22T00:05:14.548 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.549 INFO:teuthology.orchestra.run.smithi098.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-22T00:05:14.550 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-22T00:05:14.550 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-22T00:05:14.550 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.550 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-22T00:05:14.551 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:16.2.13-562.gb36cacbf.el8.x86_64 2023-08-22T00:05:14.552 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-22T00:05:14.553 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-22T00:05:14.553 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-22T00:05:14.553 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-22T00:05:14.553 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:14.554 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-08-22T00:05:14.820 DEBUG:teuthology.parallel:result is None 2023-08-22T00:05:14.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b36cacbf4a85bad07ce8507b71923096132ebbad 2023-08-22T00:05:14.966 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-22T00:05:14.990 INFO:teuthology.orchestra.run.smithi098.stdout:16.2.13-562.gb36cacbf.el8 2023-08-22T00:05:14.991 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-562.gb36cacbf.el8 2023-08-22T00:05:14.991 INFO:teuthology.task.install:The correct ceph version 16.2.13-562.gb36cacbf is installed. 2023-08-22T00:05:14.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b36cacbf4a85bad07ce8507b71923096132ebbad 2023-08-22T00:05:15.224 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-22T00:05:15.257 INFO:teuthology.orchestra.run.smithi118.stdout:16.2.13-562.gb36cacbf.el8 2023-08-22T00:05:15.257 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-562.gb36cacbf.el8 2023-08-22T00:05:15.258 INFO:teuthology.task.install:The correct ceph version 16.2.13-562.gb36cacbf is installed. 2023-08-22T00:05:15.258 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-22T00:05:15.258 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:15.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-22T00:05:15.296 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:15.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-22T00:05:15.335 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-22T00:05:15.336 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:15.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2023-08-22T00:05:15.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-22T00:05:15.438 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:15.438 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-08-22T00:05:15.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-22T00:05:15.552 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-22T00:05:15.552 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:15.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-22T00:05:15.584 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-22T00:05:15.654 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:15.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-22T00:05:15.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-22T00:05:15.756 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-22T00:05:15.757 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:15.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2023-08-22T00:05:15.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-22T00:05:15.851 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:15.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-08-22T00:05:15.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-22T00:05:15.952 INFO:teuthology.run_tasks:Running task ceph... 2023-08-22T00:05:16.029 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-22T00:05:16.030 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2023-08-22T00:05:16.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-08-22T00:05:16.066 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-22T00:05:16.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-22T00:05:16.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-22T00:05:16.138 INFO:tasks.ceph:Creating extra log directories... 2023-08-22T00:05:16.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-22T00:05:16.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-22T00:05:16.231 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-22T00:05:16.232 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-22T00:05:16.232 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-22T00:05:16.232 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:16.233 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-22T00:05:16.268 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:16.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:16.429 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:16.430 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-22T00:05:16.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:16.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:16.604 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-22T00:05:16.604 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-22T00:05:16.604 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555', 'branch': 'wip-yuri2-testing-2023-08-21-0910-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7374555', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-08-21-0910-pacific'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2023-08-21-0910-pacific', 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6738, 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2023-08-21-0910-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b36cacbf4a85bad07ce8507b71923096132ebbad/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad', 'targets': {'smithi098.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZiQnS8g/mK3OoJng0ZrkMuUxfkOntvjaU3QE/0efvSB4xyzBhZc/Pri5NlPQiivydYoE3e7eoJEXc9oFdH88UZQ57UIRhkJq8kK0wEZ9/plkWiVw9eNbpgnfDZaDm/GPkpePhvBo3RU5atdC+bEpJkYncSvJ66TfcqWE8RYDCscBYkzWyYKnukAzhd7fKuCrJ+80KfKQ4waFfjJcfD3D5dkla/GeIZpOBFNdxXJeWNmmfGVZ23eNr7Ulex9BkDkpZOxLoOai/Dz27nTM8XqIEdQOjSN6U1rjV+Sy+6fDy+TP7wv6cwHHsX+h5sb+CFkXluc5QwtS3/echKMe2BWysXdqAoV474Js1Q+498oEyYzXbXiSa08YISUkfTxrdIRcP7S7uyefePb4bN+XDecJJLIdjrZKBUgiX3b74LC+dKC9L6dBtAKzdtiAtmrHtnK2DxGGOFAuiNqv8pzZuZ52oOQFPWla9l44b7zKDMtJO4vfYr2TeD0FlWuZaM1n+Pdc=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPu6U/zzJVSgMnmMq53VpQaUD0olSxj2DPoArhWeVzRR6ItaVcKqoMR/L48Vs6pQrz9Eb562pQAOj/+bPNgL4g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b36cacbf4a85bad07ce8507b71923096132ebbad'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-21_21:30:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-22T00:05:16.605 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-22T00:05:16.607 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-22T00:05:16.651 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2023-08-22T00:05:16.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-08-22T00:05:16.722 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:16.722 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2023-08-22T00:05:16.752 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-22T00:05:16.753 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2023-08-22T00:05:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-22T00:05:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 393703 Links: 1 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-08-22 00:05:12.029171424 +0000 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-08-22 00:02:15.600126990 +0000 2023-08-22T00:05:16.812 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-08-22 00:02:15.600126990 +0000 2023-08-22T00:05:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-08-22T00:05:16.813 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-22T00:05:16.878 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-08-22T00:05:16.878 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-08-22T00:05:16.878 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000201905 s, 2.5 MB/s 2023-08-22T00:05:16.879 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-22T00:05:16.938 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2023-08-22T00:05:16.996 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 389067 Links: 1 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-08-22 00:05:12.029171424 +0000 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-08-22 00:02:16.124120893 +0000 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-08-22 00:02:16.124120893 +0000 2023-08-22T00:05:16.997 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-08-22T00:05:16.998 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-22T00:05:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-08-22T00:05:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-08-22T00:05:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000240081 s, 2.1 MB/s 2023-08-22T00:05:17.063 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-22T00:05:17.123 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2023-08-22T00:05:17.181 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-22T00:05:17.182 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:17.182 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 394451 Links: 1 2023-08-22T00:05:17.182 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:17.182 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:17.182 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-08-22 00:05:12.029171424 +0000 2023-08-22T00:05:17.183 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-08-22 00:02:16.670114540 +0000 2023-08-22T00:05:17.183 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-08-22 00:02:16.670114540 +0000 2023-08-22T00:05:17.183 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-08-22T00:05:17.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-22T00:05:17.248 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-08-22T00:05:17.248 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-08-22T00:05:17.248 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000209647 s, 2.4 MB/s 2023-08-22T00:05:17.249 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-22T00:05:17.308 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2023-08-22T00:05:17.366 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 394591 Links: 1 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-08-22 00:05:12.029171424 +0000 2023-08-22T00:05:17.367 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-08-22 00:02:17.199108386 +0000 2023-08-22T00:05:17.368 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-08-22 00:02:17.199108386 +0000 2023-08-22T00:05:17.368 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-08-22T00:05:17.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-22T00:05:17.433 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-08-22T00:05:17.434 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-08-22T00:05:17.434 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000207411 s, 2.5 MB/s 2023-08-22T00:05:17.435 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-22T00:05:17.502 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:17.502 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:17.503 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-08-22T00:05:17.527 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-22T00:05:17.527 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-08-22T00:05:17.587 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-22T00:05:17.587 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:17.587 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 384697 Links: 1 2023-08-22T00:05:17.587 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:17.587 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:17.588 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-08-22 00:05:06.530471485 +0000 2023-08-22T00:05:17.588 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-08-22 00:02:16.987587732 +0000 2023-08-22T00:05:17.588 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-08-22 00:02:16.987587732 +0000 2023-08-22T00:05:17.588 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-08-22T00:05:17.588 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-22T00:05:17.658 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-08-22T00:05:17.658 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-08-22T00:05:17.658 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000133312 s, 3.8 MB/s 2023-08-22T00:05:17.659 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-22T00:05:17.720 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-08-22T00:05:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-22T00:05:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 378864 Links: 1 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-08-22 00:05:06.531471463 +0000 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-08-22 00:02:17.515576375 +0000 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-08-22 00:02:17.515576375 +0000 2023-08-22T00:05:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-08-22T00:05:17.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-22T00:05:17.846 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-08-22T00:05:17.847 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-08-22T00:05:17.847 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000104067 s, 4.9 MB/s 2023-08-22T00:05:17.848 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-22T00:05:17.907 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-08-22T00:05:17.967 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-22T00:05:17.967 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:17.967 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 384926 Links: 1 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-08-22 00:05:06.531471463 +0000 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-08-22 00:02:18.052564825 +0000 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-08-22 00:02:18.052564825 +0000 2023-08-22T00:05:17.968 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-08-22T00:05:17.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-22T00:05:18.034 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-08-22T00:05:18.034 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-08-22T00:05:18.034 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 8.1944e-05 s, 6.2 MB/s 2023-08-22T00:05:18.035 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-22T00:05:18.095 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-08-22T00:05:18.152 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-22T00:05:18.152 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 396316 Links: 1 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-08-22 00:05:06.531471463 +0000 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-08-22 00:02:18.574553597 +0000 2023-08-22T00:05:18.153 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-08-22 00:02:18.574553597 +0000 2023-08-22T00:05:18.154 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-08-22T00:05:18.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-22T00:05:18.218 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-08-22T00:05:18.218 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-08-22T00:05:18.219 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000118138 s, 4.3 MB/s 2023-08-22T00:05:18.220 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-22T00:05:18.278 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:18.279 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-22T00:05:18.279 INFO:tasks.ceph:Generating config... 2023-08-22T00:05:18.280 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-22T00:05:18.281 INFO:tasks.ceph:[client] debug client = 20 2023-08-22T00:05:18.281 INFO:tasks.ceph:[client] debug ms = 1 2023-08-22T00:05:18.281 INFO:tasks.ceph:[client] pid file = 2023-08-22T00:05:18.281 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-22T00:05:18.282 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-22T00:05:18.282 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-22T00:05:18.282 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-22T00:05:18.282 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-22T00:05:18.282 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-22T00:05:18.283 INFO:tasks.ceph:[mgr] debug client = 20 2023-08-22T00:05:18.284 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-08-22T00:05:18.284 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-22T00:05:18.285 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-22T00:05:18.286 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-22T00:05:18.286 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-22T00:05:18.286 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-22T00:05:18.286 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-22T00:05:18.286 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-22T00:05:18.287 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-22T00:05:18.287 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-22T00:05:18.287 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-22T00:05:18.287 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-22T00:05:18.287 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-22T00:05:18.288 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-22T00:05:18.288 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-22T00:05:18.288 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-22T00:05:18.288 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-22T00:05:18.288 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-22T00:05:18.289 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-22T00:05:18.289 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-22T00:05:18.290 INFO:tasks.ceph:Setting up mon.a... 2023-08-22T00:05:18.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-22T00:05:18.417 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.keyring 2023-08-22T00:05:18.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-22T00:05:18.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-22T00:05:18.500 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.98'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2023-08-22T00:05:18.501 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.98,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-22T00:05:18.502 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:18.502 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-22T00:05:18.561 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.98 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:18.647 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:18.648 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: generated fsid 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:05:18.648 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 0 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:fsid 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:last_changed 2023-08-22T00:05:18.647395+0000 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:created 2023-08-22T00:05:18.647395+0000 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:min_mon_release 0 (unknown) 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:election_strategy: 1 2023-08-22T00:05:18.649 INFO:teuthology.orchestra.run.smithi098.stdout:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2023-08-22T00:05:18.650 INFO:teuthology.orchestra.run.smithi098.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2023-08-22T00:05:18.650 INFO:teuthology.orchestra.run.smithi098.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2023-08-22T00:05:18.650 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-22T00:05:18.651 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-22T00:05:18.670 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1e61d47e-5294-4f44-ba3b-d3c83a49a88d... 2023-08-22T00:05:18.672 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-22T00:05:18.712 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-22T00:05:18.755 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2023-08-22T00:05:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2023-08-22T00:05:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-22T00:05:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2023-08-22T00:05:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-22T00:05:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2023-08-22T00:05:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-22T00:05:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2023-08-22T00:05:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-22T00:05:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.98,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-08-22T00:05:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2023-08-22T00:05:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 20 2023-08-22T00:05:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 20 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 10 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2023-08-22T00:05:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-08-22T00:05:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: debug finisher = 20 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2023-08-22T00:05:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2023-08-22T00:05:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2023-08-22T00:05:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-22T00:05:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-22T00:05:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: mon op complaint time = 120 2023-08-22T00:05:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:18.779 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2023-08-22T00:05:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2023-08-22T00:05:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2023-08-22T00:05:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2023-08-22T00:05:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-22T00:05:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 600 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = "" 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2023-08-22T00:05:18.781 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout:[mds] 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: debug mds = 20 2023-08-22T00:05:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug frag = True 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug scatterstat = True 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: mds op complaint time = 180 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: mds verify scatter = True 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-08-22T00:05:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-08-22T00:05:18.787 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-08-22T00:05:18.788 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-08-22T00:05:18.788 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-08-22T00:05:18.792 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-22T00:05:18.793 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.794 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-08-22T00:05:18.795 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-22T00:05:18.796 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-22T00:05:18.796 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-08-22T00:05:18.796 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.796 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-22T00:05:18.797 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.797 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-08-22T00:05:18.803 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.98,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.804 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-08-22T00:05:18.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-08-22T00:05:18.806 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.807 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-08-22T00:05:18.807 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.807 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-08-22T00:05:18.807 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-08-22T00:05:18.808 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.808 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-08-22T00:05:18.808 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-08-22T00:05:18.808 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-08-22T00:05:18.810 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-08-22T00:05:18.811 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2023-08-22T00:05:18.811 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2023-08-22T00:05:18.811 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:05:18.811 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-08-22T00:05:18.811 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2023-08-22T00:05:18.812 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-08-22T00:05:18.812 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.813 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-08-22T00:05:18.814 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:05:18.814 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-08-22T00:05:18.814 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-08-22T00:05:18.815 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-08-22T00:05:18.815 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:05:18.815 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: debug finisher = 20 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:05:18.816 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:05:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.818 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-08-22T00:05:18.819 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-22T00:05:18.819 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-22T00:05:18.819 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-08-22T00:05:18.819 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:05:18.819 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-22T00:05:18.820 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-08-22T00:05:18.821 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-08-22T00:05:18.822 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-08-22T00:05:18.822 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-08-22T00:05:18.822 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-08-22T00:05:18.822 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-08-22T00:05:18.822 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-08-22T00:05:18.823 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-08-22T00:05:18.824 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-08-22T00:05:18.824 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-08-22T00:05:18.824 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-22T00:05:18.825 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-22T00:05:18.879 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-22T00:05:18.880 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:18.881 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-22T00:05:18.900 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:18.901 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-22T00:05:18.962 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:05:18.963 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:18.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-22T00:05:18.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-22T00:05:19.038 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:19.039 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:19.099 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:05:19.100 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:19.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-22T00:05:19.101 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-22T00:05:19.147 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:19.148 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:19.212 INFO:tasks.ceph:Setting up mon nodes... 2023-08-22T00:05:19.213 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-22T00:05:19.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-22T00:05:19.265 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-22T00:05:19.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-22T00:05:19.419 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-22T00:05:19.419 INFO:tasks.ceph:Setting up mds nodes... 2023-08-22T00:05:19.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-22T00:05:19.477 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-22T00:05:19.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-22T00:05:19.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-22T00:05:19.597 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-22T00:05:19.600 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-22T00:05:19.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-22T00:05:19.689 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-22T00:05:19.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-22T00:05:19.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-22T00:05:19.819 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-22T00:05:19.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-22T00:05:19.849 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-22T00:05:19.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-22T00:05:19.889 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-22T00:05:19.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-22T00:05:19.983 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-22T00:05:20.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-22T00:05:20.045 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-22T00:05:20.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-22T00:05:20.138 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-22T00:05:20.157 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-22T00:05:20.157 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-22T00:05:20.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-22T00:05:20.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:20.189 INFO:tasks.ceph:role: osd.0 2023-08-22T00:05:20.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:05:20.198 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-22T00:05:20.264 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:20.264 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:20.264 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:20.265 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:20.694 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-08-22T00:05:20.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-08-22T00:05:20.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-22T00:05:20.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-22T00:05:20.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-22T00:05:20.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:20.986 INFO:tasks.ceph:role: osd.1 2023-08-22T00:05:20.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:05:20.987 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-22T00:05:21.064 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:21.065 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:21.066 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:21.485 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-08-22T00:05:21.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-08-22T00:05:21.486 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-22T00:05:21.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-22T00:05:21.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-22T00:05:21.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:21.691 INFO:tasks.ceph:role: osd.2 2023-08-22T00:05:21.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:05:21.693 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-22T00:05:21.770 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:21.771 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:21.772 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:21.772 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:22.225 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-08-22T00:05:22.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-08-22T00:05:22.227 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-22T00:05:22.383 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-22T00:05:22.417 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-22T00:05:22.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:22.485 INFO:tasks.ceph:role: osd.3 2023-08-22T00:05:22.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:05:22.486 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-22T00:05:22.560 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:22.561 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:22.562 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:22.562 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:22.569 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:22.997 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-08-22T00:05:22.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-08-22T00:05:22.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-22T00:05:23.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-22T00:05:23.225 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:23.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.325+0000 7f45c08d3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-22T00:05:23.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.325+0000 7f45c08d3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-22T00:05:23.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.325+0000 7f45c08d3200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-22T00:05:23.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.325+0000 7f45c08d3200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-22T00:05:23.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.325+0000 7f45c08d3200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-22T00:05:23.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:23.326+0000 7f45c08d3200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-22T00:05:26.168 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-22T00:05:26.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:26.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.296+0000 7f579de63200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-22T00:05:26.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.296+0000 7f579de63200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-22T00:05:26.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.296+0000 7f579de63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-22T00:05:26.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.296+0000 7f579de63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-22T00:05:26.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.297+0000 7f579de63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-22T00:05:26.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:26.297+0000 7f579de63200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-22T00:05:29.142 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-22T00:05:29.176 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-22T00:05:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-22T00:05:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-22T00:05:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-22T00:05:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-22T00:05:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:29.263+0000 7f500d74e200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-22T00:05:32.118 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-22T00:05:32.151 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:32.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.238+0000 7fa2bdb85200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-22T00:05:32.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.238+0000 7fa2bdb85200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-22T00:05:32.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.238+0000 7fa2bdb85200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-22T00:05:32.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.238+0000 7fa2bdb85200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-22T00:05:32.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.238+0000 7fa2bdb85200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-22T00:05:32.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:32.239+0000 7fa2bdb85200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-22T00:05:35.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-22T00:05:35.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-22T00:05:35.164 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:35.164 INFO:tasks.ceph:role: osd.4 2023-08-22T00:05:35.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:05:35.164 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-22T00:05:35.237 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:35.237 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:35.237 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:35.237 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:35.238 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:35.238 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:35.238 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:35.238 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:35.239 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:35.239 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:35.260 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-08-22T00:05:35.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-08-22T00:05:35.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-22T00:05:35.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-22T00:05:35.387 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-22T00:05:35.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:35.459 INFO:tasks.ceph:role: osd.5 2023-08-22T00:05:35.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:05:35.460 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-22T00:05:35.527 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:35.527 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:35.527 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:35.528 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:35.528 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:35.528 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:35.528 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:35.528 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:35.529 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:35.529 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:35.550 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-08-22T00:05:35.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-08-22T00:05:35.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-22T00:05:35.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-22T00:05:35.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-22T00:05:35.778 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:35.779 INFO:tasks.ceph:role: osd.6 2023-08-22T00:05:35.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:05:35.779 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-22T00:05:35.845 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:35.846 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:35.846 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:35.847 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:35.847 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:35.848 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:35.849 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:35.849 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:35.868 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-08-22T00:05:35.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-08-22T00:05:35.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-22T00:05:35.953 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-22T00:05:36.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-22T00:05:36.097 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-22T00:05:36.097 INFO:tasks.ceph:role: osd.7 2023-08-22T00:05:36.098 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:05:36.098 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-22T00:05:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-22T00:05:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-22T00:05:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-22T00:05:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-22T00:05:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-22T00:05:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-08-22T00:05:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-22T00:05:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-22T00:05:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-22T00:05:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-22T00:05:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-08-22T00:05:36.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-08-22T00:05:36.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-22T00:05:36.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-22T00:05:36.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.449+0000 7f928036d200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-22T00:05:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.450+0000 7f928036d200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-22T00:05:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.450+0000 7f928036d200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-22T00:05:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.450+0000 7f928036d200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-22T00:05:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.450+0000 7f928036d200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-22T00:05:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:36.450+0000 7f928036d200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-22T00:05:39.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-22T00:05:39.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:39.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-22T00:05:39.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-22T00:05:39.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-22T00:05:39.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-22T00:05:39.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-22T00:05:39.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:39.410+0000 7f633e387200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-22T00:05:42.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-22T00:05:42.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:42.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.383+0000 7f187fd08200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-22T00:05:42.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.383+0000 7f187fd08200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-22T00:05:42.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.383+0000 7f187fd08200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-22T00:05:42.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.383+0000 7f187fd08200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-22T00:05:42.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.383+0000 7f187fd08200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-22T00:05:42.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:42.384+0000 7f187fd08200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-22T00:05:45.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-22T00:05:45.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:45.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-22T00:05:45.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-22T00:05:45.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-22T00:05:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-22T00:05:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-22T00:05:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:45.340+0000 7f4a44379200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-22T00:05:46.607 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:46.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:05:48.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-22T00:05:48.218 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-22T00:05:48.219 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-22T00:05:48.251 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-22T00:05:48.326 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.327 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-22T00:05:48.397 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-22T00:05:48.471 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-22T00:05:48.540 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.540 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-22T00:05:48.608 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:48.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-22T00:05:48.677 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:48.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-22T00:05:48.711 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:48.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-22T00:05:48.785 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:48.785 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-22T00:05:48.859 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:48.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-22T00:05:48.931 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:48.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-22T00:05:49.006 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:49.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-22T00:05:49.079 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:49.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-22T00:05:49.154 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:49.155 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-22T00:05:49.176 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:49.177 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-22T00:05:49.238 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:49.238 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-22T00:05:49.265 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:49.265 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-22T00:05:49.328 INFO:tasks.ceph:Adding keys to all mons... 2023-08-22T00:05:49.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-22T00:05:49.333 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-22T00:05:49.373 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2023-08-22T00:05:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw== 2023-08-22T00:05:49.373 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-08-22T00:05:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ== 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q== 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw== 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ== 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2023-08-22T00:05:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA== 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA== 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw== 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg== 2023-08-22T00:05:49.375 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw== 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw== 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g== 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ== 2023-08-22T00:05:49.376 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA== 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA== 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout:[client.2] 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ== 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ== 2023-08-22T00:05:49.377 INFO:teuthology.orchestra.run.smithi098.stdout:[client.3] 2023-08-22T00:05:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g== 2023-08-22T00:05:49.401 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-08-22T00:05:49.401 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw== 2023-08-22T00:05:49.401 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ== 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q== 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw== 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-08-22T00:05:49.402 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ== 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA== 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA== 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-08-22T00:05:49.405 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw== 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg== 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw== 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw== 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-08-22T00:05:49.406 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g== 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ== 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA== 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA== 2023-08-22T00:05:49.407 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2023-08-22T00:05:49.408 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ== 2023-08-22T00:05:49.408 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2023-08-22T00:05:49.408 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ== 2023-08-22T00:05:49.408 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2023-08-22T00:05:49.408 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g== 2023-08-22T00:05:49.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-22T00:05:49.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-22T00:05:49.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.682 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.789 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:49.838 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-22T00:05:49.841 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-22T00:05:49.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-22T00:05:49.998 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.049 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.052 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-22T00:05:50.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.271 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-22T00:05:50.437 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-22T00:05:50.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-22T00:05:50.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-22T00:05:50.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-22T00:05:50.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-22T00:05:50.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-22T00:05:50.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-22T00:05:50.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-22T00:05:50.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-22T00:05:50.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-22T00:05:50.955 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:50.958 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-22T00:05:51.013 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-22T00:05:51.014 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-22T00:05:51.015 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-22T00:05:51.022 INFO:tasks.ceph.mon.a:Started 2023-08-22T00:05:51.023 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-22T00:05:51.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-22T00:05:51.055 INFO:tasks.ceph.mon.b:Started 2023-08-22T00:05:51.056 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-22T00:05:51.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-22T00:05:51.058 INFO:tasks.ceph.mon.c:Started 2023-08-22T00:05:51.059 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-22T00:05:51.059 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-22T00:05:51.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-22T00:05:51.061 INFO:tasks.ceph.mgr.y:Started 2023-08-22T00:05:51.062 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-22T00:05:51.062 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-22T00:05:51.064 INFO:tasks.ceph.mgr.x:Started 2023-08-22T00:05:51.064 INFO:tasks.ceph:Setting crush tunables to default 2023-08-22T00:05:51.064 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd crush tunables default 2023-08-22T00:05:51.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.181+0000 7f2b37625700 1 Processor -- start 2023-08-22T00:05:51.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.181+0000 7f2b37625700 1 -- start start 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b37625700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 0x7f2b300c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b37625700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b30066780 con 0x7f2b301507e0 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b37625700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300c75f0 con 0x7f2b300c71a0 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b37625700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300c2100 con 0x7f2b30065730 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b353c1700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2b301507e0 0x7f2b300c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51294/0 (socket says 172.21.15.98:51294) 2023-08-22T00:05:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b353c1700 1 -- 172.21.15.98:0/3536455825 learned_addr learned my addr 172.21.15.98:0/3536455825 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:05:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 0x7f2b300c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b34bc0700 1 -- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 msgr2=0x7f2b300c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-22T00:05:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b34bc0700 1 -- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 msgr2=0x7f2b300c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-22T00:05:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 0x7f2b300c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-22T00:05:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.182+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 0x7f2b300c6cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:05:51.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.350+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879632999 0 0) 0x7f2b30066780 con 0x7f2b301507e0 2023-08-22T00:05:51.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.350+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b1c0033f0 con 0x7f2b301507e0 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.350+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367363660 0 0) 0x7f2b300c75f0 con 0x7f2b300c71a0 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.350+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30066780 con 0x7f2b300c71a0 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409999673 0 0) 0x7f2b30066780 con 0x7f2b300c71a0 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 msgr2=0x7f2b300c6cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 --2- 172.21.15.98:0/3536455825 >> v2:172.21.15.118:3300/0 conn(0x7f2b30065730 0x7f2b300c6cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 >> v1:172.21.15.98:6789/0 conn(0x7f2b301507e0 legacy=0x7f2b300c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300c3dd0 con 0x7f2b300c71a0 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f2b280017f0 con 0x7f2b300c71a0 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 >> v1:172.21.15.118:6789/0 conn(0x7f2b300c71a0 legacy=0x7f2b30150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b1c003a70 0x7f2b1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 0x7f2b1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c005050 0x7f2b1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c2100 con 0x7f2b1c004690 2023-08-22T00:05:51.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bfc0 con 0x7f2b1c003a70 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00c180 con 0x7f2b1c005050 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b353c1700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b1c003a70 0x7f2b1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 0x7f2b1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b35bc2700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c005050 0x7f2b1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 -- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c005050 msgr2=0x7f2b1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c005050 0x7f2b1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 -- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b1c003a70 msgr2=0x7f2b1c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:51.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b1c003a70 0x7f2b1c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 -- 172.21.15.98:0/3536455825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30066780 con 0x7f2b1c004690 2023-08-22T00:05:51.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b35bc2700 1 -- 172.21.15.98:0/3536455825 reap_dead start 2023-08-22T00:05:51.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b353c1700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b1c003a70 0x7f2b1c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:51.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.351+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 0x7f2b1c004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b2c006fd0 tx=0x7f2b2c008040).ready entity=mon.0 client_cookie=e5f8ef3cdc64db04 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c013480 con 0x7f2b1c004690 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0135e0 con 0x7f2b1c004690 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b27fff700 1 -- 172.21.15.98:0/3536455825 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c013980 con 0x7f2b1c004690 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 -- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 msgr2=0x7f2b1c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 0x7f2b1c004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b2c006fd0 tx=0x7f2b2c008040).stop 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 -- 172.21.15.98:0/3536455825 shutdown_connections 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 --2- 172.21.15.98:0/3536455825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b1c004690 0x7f2b1c004b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 -- 172.21.15.98:0/3536455825 >> 172.21.15.98:0/3536455825 conn(0x7f2b300c7800 msgr2=0x7f2b300c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 -- 172.21.15.98:0/3536455825 shutdown_connections 2023-08-22T00:05:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.352+0000 7f2b37625700 1 -- 172.21.15.98:0/3536455825 wait complete. 2023-08-22T00:05:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.354+0000 7f2b37625700 1 Processor -- start 2023-08-22T00:05:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.354+0000 7f2b37625700 1 -- start start 2023-08-22T00:05:51.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c004690 0x7f2b3014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:51.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300a8450 con 0x7f2b3014aa90 2023-08-22T00:05:51.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b30065090 con 0x7f2b30063780 2023-08-22T00:05:51.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b37625700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300a7840 con 0x7f2b1c004690 2023-08-22T00:05:51.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b34bc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b35bc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.355+0000 7f2b34bc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35646/0 (socket says 172.21.15.98:35646) 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 -- 172.21.15.98:0/1216369958 learned_addr learned my addr 172.21.15.98:0/1216369958 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b35bc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38154/0 (socket says 172.21.15.98:38154) 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b353c1700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c004690 0x7f2b3014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 -- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c004690 msgr2=0x7f2b3014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c004690 0x7f2b3014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 -- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 msgr2=0x7f2b30143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 -- 172.21.15.98:0/1216369958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300a7b20 con 0x7f2b3014aa90 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b35bc2700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b34bc0700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2b2c006db0 tx=0x7f2b2c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c013750 con 0x7f2b3014aa90 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0138b0 con 0x7f2b3014aa90 2023-08-22T00:05:51.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b300a7e00 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c01d620 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.356+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b300a74c0 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.357+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b30069220 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.359+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2b2c01dcb0 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.359+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2b2c006030 con 0x7f2b3014aa90 2023-08-22T00:05:51.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.361+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2b2c022070 con 0x7f2b3014aa90 2023-08-22T00:05:51.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.432+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2b30046c20 con 0x7f2b3014aa90 2023-08-22T00:05:51.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.435+0000 7f2b257fa700 1 -- 172.21.15.98:0/1216369958 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2b2c018070 con 0x7f2b3014aa90 2023-08-22T00:05:51.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 msgr2=0x7f2b30063290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:51.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2b2c006db0 tx=0x7f2b2c018000).stop 2023-08-22T00:05:51.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 shutdown_connections 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b1c004690 0x7f2b3014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b30063780 0x7f2b30143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 --2- 172.21.15.98:0/1216369958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b3014aa90 0x7f2b30063290 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 >> 172.21.15.98:0/1216369958 conn(0x7f2b300c7800 msgr2=0x7f2b30145250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 shutdown_connections 2023-08-22T00:05:51.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:51.436+0000 7f2b37625700 1 -- 172.21.15.98:0/1216369958 wait complete. 2023-08-22T00:05:51.440 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2023-08-22T00:05:51.449 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-22T00:05:51.450 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:51.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-22T00:05:51.479 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:51.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-22T00:05:51.483 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:51.482+0000 7f9e1e1bd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:05:51.496 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:51.493+0000 7efdcafc6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:05:51.524 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:51.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-22T00:05:51.551 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:51.551+0000 7f9e1e1bd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:05:51.569 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:51.568+0000 7efdcafc6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:05:51.593 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-08-22T00:05:51.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-22T00:05:51.666 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:51.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-22T00:05:51.694 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:51.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-22T00:05:51.761 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:51.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-22T00:05:51.828 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-08-22T00:05:51.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-22T00:05:51.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 54428ccb-cd3d-4e94-89af-33cd114c4cf6 0 2023-08-22T00:05:52.016 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:52.015+0000 7efdcafc6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:05:52.050 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:52.049+0000 7f9e1e1bd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:05:52.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.052+0000 7fa6df340700 1 Processor -- start 2023-08-22T00:05:52.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.052+0000 7fa6df340700 1 -- start start 2023-08-22T00:05:52.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.053+0000 7fa6df340700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa6d80654d0 0x7fa6d80c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.053+0000 7fa6df340700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8154730 con 0x7fa6d80658b0 2023-08-22T00:05:52.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.053+0000 7fa6df340700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8154a10 con 0x7fa6d81542a0 2023-08-22T00:05:52.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.053+0000 7fa6df340700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d8154cf0 con 0x7fa6d80654d0 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd8dd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa6d81542a0 0x7fa6d8065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46448/0 (socket says 172.21.15.118:46448) 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd8dd700 1 -- 172.21.15.118:0/825466281 learned_addr learned my addr 172.21.15.118:0/825466281 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd0dc700 1 --2- 172.21.15.118:0/825466281 >> v2:172.21.15.98:3300/0 conn(0x7fa6d80654d0 0x7fa6d80c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309164902 0 0) 0x7fa6d8154a10 con 0x7fa6d81542a0 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c40033f0 con 0x7fa6d81542a0 2023-08-22T00:05:52.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866606584 0 0) 0x7fa6d8154730 con 0x7fa6d80658b0 2023-08-22T00:05:52.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8154a10 con 0x7fa6d80658b0 2023-08-22T00:05:52.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd0dc700 1 -- 172.21.15.118:0/825466281 >> v1:172.21.15.118:6789/0 conn(0x7fa6d81542a0 legacy=0x7fa6d8065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd0dc700 1 -- 172.21.15.118:0/825466281 >> v1:172.21.15.98:6789/0 conn(0x7fa6d80658b0 legacy=0x7fa6d80c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd0dc700 1 -- 172.21.15.118:0/825466281 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8154fd0 con 0x7fa6d80654d0 2023-08-22T00:05:52.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6dd0dc700 1 --2- 172.21.15.118:0/825466281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c3760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa6d4009760 tx=0x7fa6d4009060).ready entity=mon.0 client_cookie=c9597078786b8b5b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d400d4a0 con 0x7fa6d80654d0 2023-08-22T00:05:52.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d400d600 con 0x7fa6d80654d0 2023-08-22T00:05:52.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.054+0000 7fa6cffff700 1 -- 172.21.15.118:0/825466281 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d400d980 con 0x7fa6d80654d0 2023-08-22T00:05:52.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 -- 172.21.15.118:0/825466281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 msgr2=0x7fa6d80c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 --2- 172.21.15.118:0/825466281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c3760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa6d4009760 tx=0x7fa6d4009060).stop 2023-08-22T00:05:52.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 -- 172.21.15.118:0/825466281 shutdown_connections 2023-08-22T00:05:52.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 --2- 172.21.15.118:0/825466281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c3760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 -- 172.21.15.118:0/825466281 >> 172.21.15.118:0/825466281 conn(0x7fa6d80c7800 msgr2=0x7fa6d80c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 -- 172.21.15.118:0/825466281 shutdown_connections 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.055+0000 7fa6df340700 1 -- 172.21.15.118:0/825466281 wait complete. 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.056+0000 7fa6df340700 1 Processor -- start 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.056+0000 7fa6df340700 1 -- start start 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80a62e0 con 0x7fa6d80654d0 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8164060 con 0x7fa6d80658b0 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6df340700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80a76c0 con 0x7fa6d80c14a0 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dd8dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60742/0 (socket says 172.21.15.118:60742) 2023-08-22T00:05:52.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dd0dc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 -- 172.21.15.118:0/1513826059 learned_addr learned my addr 172.21.15.118:0/1513826059 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dd8dd700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56022/0 (socket says 172.21.15.118:56022) 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 -- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 msgr2=0x7fa6d80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 -- 172.21.15.118:0/1513826059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 msgr2=0x7fa6d80c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 -- 172.21.15.118:0/1513826059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40092a0 con 0x7fa6d80658b0 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dd0dc700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dd8dd700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.057+0000 7fa6dc8db700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa6c800c4c0 tx=0x7fa6c8007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800ce30 con 0x7fa6d80658b0 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800f470 con 0x7fa6d80658b0 2023-08-22T00:05:52.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d80a79a0 con 0x7fa6d80658b0 2023-08-22T00:05:52.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800f830 con 0x7fa6d80658b0 2023-08-22T00:05:52.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80a7f60 con 0x7fa6d80658b0 2023-08-22T00:05:52.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa6c801c440 con 0x7fa6d80658b0 2023-08-22T00:05:52.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.058+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fa6c800fe40 con 0x7fa6d80658b0 2023-08-22T00:05:52.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.059+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d8164220 con 0x7fa6d80658b0 2023-08-22T00:05:52.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.061+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa6c8017070 con 0x7fa6d80658b0 2023-08-22T00:05:52.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.140+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54428ccb-cd3d-4e94-89af-33cd114c4cf6", "id": 0} v 0) v1 -- 0x7fa6d80c3c50 con 0x7fa6d80658b0 2023-08-22T00:05:52.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.146+0000 7fa6cd7fa700 1 -- 172.21.15.118:0/1513826059 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54428ccb-cd3d-4e94-89af-33cd114c4cf6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa6c801c880 con 0x7fa6d80658b0 2023-08-22T00:05:52.149 INFO:teuthology.orchestra.run.smithi118.stdout:0 2023-08-22T00:05:52.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 msgr2=0x7fa6d81674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa6c800c4c0 tx=0x7fa6c8007c60).stop 2023-08-22T00:05:52.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 shutdown_connections 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c14a0 0x7fa6d80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d80654d0 0x7fa6d80c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 --2- 172.21.15.118:0/1513826059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80658b0 0x7fa6d81674e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 >> 172.21.15.118:0/1513826059 conn(0x7fa6d80c7800 msgr2=0x7fa6d8157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 shutdown_connections 2023-08-22T00:05:52.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.147+0000 7fa6df340700 1 -- 172.21.15.118:0/1513826059 wait complete. 2023-08-22T00:05:52.162 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 42b43cff-eb9a-4397-a186-1a7ef671bf51 1 2023-08-22T00:05:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.278+0000 7f4513dd9700 1 Processor -- start 2023-08-22T00:05:52.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.278+0000 7f4513dd9700 1 -- start start 2023-08-22T00:05:52.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4513dd9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 0x7f450c0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4513dd9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c154730 con 0x7f450c0658b0 2023-08-22T00:05:52.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4513dd9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c154a10 con 0x7f450c1542a0 2023-08-22T00:05:52.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4513dd9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c154cf0 con 0x7f450c0654d0 2023-08-22T00:05:52.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4512376700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f450c1542a0 0x7f450c065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46452/0 (socket says 172.21.15.118:46452) 2023-08-22T00:05:52.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4512376700 1 -- 172.21.15.118:0/3412114174 learned_addr learned my addr 172.21.15.118:0/3412114174 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:52.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.279+0000 7f4511b75700 1 --2- 172.21.15.118:0/3412114174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 0x7f450c0c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4510b73700 1 -- 172.21.15.118:0/3412114174 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619515411 0 0) 0x7f450c154a10 con 0x7f450c1542a0 2023-08-22T00:05:52.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4511b75700 1 -- 172.21.15.118:0/3412114174 >> v1:172.21.15.118:6789/0 conn(0x7f450c1542a0 legacy=0x7f450c065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4511b75700 1 -- 172.21.15.118:0/3412114174 >> v1:172.21.15.98:6789/0 conn(0x7f450c0658b0 legacy=0x7f450c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4511b75700 1 -- 172.21.15.118:0/3412114174 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c154fd0 con 0x7f450c0654d0 2023-08-22T00:05:52.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4511b75700 1 --2- 172.21.15.118:0/3412114174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 0x7f450c0c3760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4504009e90 tx=0x7f4504009780).ready entity=mon.2 client_cookie=d2c6ae8598c02bc8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4510b73700 1 -- 172.21.15.118:0/3412114174 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400e070 con 0x7f450c0654d0 2023-08-22T00:05:52.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4510b73700 1 -- 172.21.15.118:0/3412114174 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400bc30 con 0x7f450c0654d0 2023-08-22T00:05:52.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4510b73700 1 -- 172.21.15.118:0/3412114174 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504012410 con 0x7f450c0654d0 2023-08-22T00:05:52.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 -- 172.21.15.118:0/3412114174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 msgr2=0x7f450c0c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3412114174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 0x7f450c0c3760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4504009e90 tx=0x7f4504009780).stop 2023-08-22T00:05:52.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 -- 172.21.15.118:0/3412114174 shutdown_connections 2023-08-22T00:05:52.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3412114174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0654d0 0x7f450c0c3760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 -- 172.21.15.118:0/3412114174 >> 172.21.15.118:0/3412114174 conn(0x7f450c0c7800 msgr2=0x7f450c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 -- 172.21.15.118:0/3412114174 shutdown_connections 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.280+0000 7f4513dd9700 1 -- 172.21.15.118:0/3412114174 wait complete. 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.281+0000 7f4513dd9700 1 Processor -- start 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.281+0000 7f4513dd9700 1 -- start start 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c13c070 0x7f450c0c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c13bbe0 con 0x7f450c13c070 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c17e0 con 0x7f450c0654d0 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4513dd9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c13b2b0 con 0x7f450c0658b0 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4511b75700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4511374700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4511b75700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60744/0 (socket says 172.21.15.118:60744) 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4511374700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56032/0 (socket says 172.21.15.118:56032) 2023-08-22T00:05:52.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4511b75700 1 -- 172.21.15.118:0/3793888695 learned_addr learned my addr 172.21.15.118:0/3793888695 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:52.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.282+0000 7f4512376700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c13c070 0x7f450c0c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 -- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 msgr2=0x7f450c0bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 -- 172.21.15.118:0/3793888695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c13c070 msgr2=0x7f450c0c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c13c070 0x7f450c0c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 -- 172.21.15.118:0/3793888695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009a20 con 0x7f450c0658b0 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511b75700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4511374700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f450c0c77d0 tx=0x7f44fc007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc007020 con 0x7f450c0658b0 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc007180 con 0x7f450c0658b0 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c13b590 con 0x7f450c0658b0 2023-08-22T00:05:52.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc007520 con 0x7f450c0658b0 2023-08-22T00:05:52.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c13c4f0 con 0x7f450c0658b0 2023-08-22T00:05:52.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f44fc006b10 con 0x7f450c0658b0 2023-08-22T00:05:52.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.283+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f44fc01cc10 con 0x7f450c0658b0 2023-08-22T00:05:52.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.284+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c13bd50 con 0x7f450c0658b0 2023-08-22T00:05:52.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.286+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f44fc012400 con 0x7f450c0658b0 2023-08-22T00:05:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.367+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42b43cff-eb9a-4397-a186-1a7ef671bf51", "id": 1} v 0) v1 -- 0x7f450c0c3c50 con 0x7f450c0658b0 2023-08-22T00:05:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.375+0000 7f4501ffb700 1 -- 172.21.15.118:0/3793888695 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42b43cff-eb9a-4397-a186-1a7ef671bf51", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44fc0125a0 con 0x7f450c0658b0 2023-08-22T00:05:52.377 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-08-22T00:05:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 msgr2=0x7f450c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f450c0c77d0 tx=0x7f44fc007d40).stop 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 shutdown_connections 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c13c070 0x7f450c0c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f450c0654d0 0x7f450c0bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 --2- 172.21.15.118:0/3793888695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f450c0658b0 0x7f450c156950 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 >> 172.21.15.118:0/3793888695 conn(0x7f450c0c7800 msgr2=0x7f450c0bd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 shutdown_connections 2023-08-22T00:05:52.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.376+0000 7f4513dd9700 1 -- 172.21.15.118:0/3793888695 wait complete. 2023-08-22T00:05:52.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 4832bf14-be35-44c8-b575-aa4046e2f6ef 2 2023-08-22T00:05:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.504+0000 7f5338f06700 1 Processor -- start 2023-08-22T00:05:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.504+0000 7f5338f06700 1 -- start start 2023-08-22T00:05:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5338f06700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53340654d0 0x7f53340c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5338f06700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f53341542a0 0x7f5334065f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5338f06700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5334154730 con 0x7f53340658b0 2023-08-22T00:05:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5338f06700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334154a10 con 0x7f53341542a0 2023-08-22T00:05:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5338f06700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334154cf0 con 0x7f53340654d0 2023-08-22T00:05:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f533259c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53340654d0 0x7f53340c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5331d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f53340658b0 0x7f53340c6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46464/0 (socket says 172.21.15.118:46464) 2023-08-22T00:05:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.505+0000 7f5331d9b700 1 -- 172.21.15.118:0/3014236185 learned_addr learned my addr 172.21.15.118:0/3014236185 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f5332d9d700 1 --2- 172.21.15.118:0/3014236185 >> v2:172.21.15.98:3300/0 conn(0x7f53341542a0 0x7f5334065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533259c700 1 -- 172.21.15.118:0/3014236185 >> v2:172.21.15.98:3300/0 conn(0x7f53341542a0 msgr2=0x7f5334065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533259c700 1 --2- 172.21.15.118:0/3014236185 >> v2:172.21.15.98:3300/0 conn(0x7f53341542a0 0x7f5334065f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533259c700 1 -- 172.21.15.118:0/3014236185 >> v1:172.21.15.118:6789/0 conn(0x7f53340658b0 legacy=0x7f53340c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533159a700 1 -- 172.21.15.118:0/3014236185 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528103604 0 0) 0x7f5334154730 con 0x7f53340658b0 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533259c700 1 -- 172.21.15.118:0/3014236185 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334154fd0 con 0x7f53340654d0 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533259c700 1 --2- 172.21.15.118:0/3014236185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f53340c3760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f53340696c0 tx=0x7f5324009060).ready entity=mon.1 client_cookie=b367beb57296c62e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533159a700 1 -- 172.21.15.118:0/3014236185 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400b580 con 0x7f53340654d0 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533159a700 1 -- 172.21.15.118:0/3014236185 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400b6e0 con 0x7f53340654d0 2023-08-22T00:05:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f533159a700 1 -- 172.21.15.118:0/3014236185 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400ba60 con 0x7f53340654d0 2023-08-22T00:05:52.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f5338f06700 1 -- 172.21.15.118:0/3014236185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 msgr2=0x7f53340c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.506+0000 7f5338f06700 1 --2- 172.21.15.118:0/3014236185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f53340c3760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f53340696c0 tx=0x7f5324009060).stop 2023-08-22T00:05:52.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 -- 172.21.15.118:0/3014236185 shutdown_connections 2023-08-22T00:05:52.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 --2- 172.21.15.118:0/3014236185 >> v2:172.21.15.98:3300/0 conn(0x7f53341542a0 0x7f5334065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 --2- 172.21.15.118:0/3014236185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f53340c3760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 -- 172.21.15.118:0/3014236185 >> 172.21.15.118:0/3014236185 conn(0x7f53340c7800 msgr2=0x7f53340c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 -- 172.21.15.118:0/3014236185 shutdown_connections 2023-08-22T00:05:52.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.507+0000 7f5338f06700 1 -- 172.21.15.118:0/3014236185 wait complete. 2023-08-22T00:05:52.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 Processor -- start 2023-08-22T00:05:52.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 -- start start 2023-08-22T00:05:52.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53340658b0 0x7f53340be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 0x7f53340c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340bf1f0 con 0x7f53340658b0 2023-08-22T00:05:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c4a90 con 0x7f53340654d0 2023-08-22T00:05:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.508+0000 7f5338f06700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c4d50 con 0x7f53340bed90 2023-08-22T00:05:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f533259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f533259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60762/0 (socket says 172.21.15.118:60762) 2023-08-22T00:05:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f533259c700 1 -- 172.21.15.118:0/3064876294 learned_addr learned my addr 172.21.15.118:0/3064876294 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 0x7f53340c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5331d9b700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53340658b0 0x7f53340be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 -- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 msgr2=0x7f5334136270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 -- 172.21.15.118:0/3064876294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53340658b0 msgr2=0x7f53340be8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53340658b0 0x7f53340be8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 -- 172.21.15.118:0/3064876294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240092a0 con 0x7f53340bed90 2023-08-22T00:05:52.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f533259c700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5332d9d700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 0x7f53340c0cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f532c007e40 tx=0x7f532c0097b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00eac0 con 0x7f53340bed90 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00ec20 con 0x7f53340bed90 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c014400 con 0x7f53340bed90 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340c5030 con 0x7f53340bed90 2023-08-22T00:05:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5334136760 con 0x7f53340bed90 2023-08-22T00:05:52.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f532c014a10 con 0x7f53340bed90 2023-08-22T00:05:52.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.509+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f532c01d800 con 0x7f53340bed90 2023-08-22T00:05:52.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.510+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340c5830 con 0x7f53340bed90 2023-08-22T00:05:52.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.512+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f53340c5830 con 0x7f53340bed90 2023-08-22T00:05:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.592+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4832bf14-be35-44c8-b575-aa4046e2f6ef", "id": 2} v 0) v1 -- 0x7f53340c5620 con 0x7f53340bed90 2023-08-22T00:05:52.602 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.600+0000 7f53227fc700 1 -- 172.21.15.118:0/3064876294 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4832bf14-be35-44c8-b575-aa4046e2f6ef", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f532c019070 con 0x7f53340bed90 2023-08-22T00:05:52.603 INFO:teuthology.orchestra.run.smithi118.stdout:2 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 msgr2=0x7f53340c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 0x7f53340c0cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f532c007e40 tx=0x7f532c0097b0).stop 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 shutdown_connections 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340bed90 0x7f53340c0cf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340654d0 0x7f5334136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 --2- 172.21.15.118:0/3064876294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53340658b0 0x7f53340be8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 >> 172.21.15.118:0/3064876294 conn(0x7f53340c7800 msgr2=0x7f53340c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 shutdown_connections 2023-08-22T00:05:52.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.601+0000 7f5338f06700 1 -- 172.21.15.118:0/3064876294 wait complete. 2023-08-22T00:05:52.614 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 655026d5-05ea-4515-977d-63f4ecf40f16 3 2023-08-22T00:05:52.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.730+0000 7f93db393700 1 Processor -- start 2023-08-22T00:05:52.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.731+0000 7f93db393700 1 -- start start 2023-08-22T00:05:52.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93d40c34c0 0x7f93d40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 0x7f93d40c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40c2100 con 0x7f93d40c34c0 2023-08-22T00:05:52.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40c7690 con 0x7f93d40c3940 2023-08-22T00:05:52.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93db393700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c40b0 con 0x7f93d41507e0 2023-08-22T00:05:52.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d9930700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 0x7f93d40c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56036/0 (socket says 172.21.15.118:56036) 2023-08-22T00:05:52.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 -- 172.21.15.118:0/3787076312 learned_addr learned my addr 172.21.15.118:0/3787076312 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:52.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d892e700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.98:3300/0 conn(0x7f93d40c34c0 0x7f93d40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 -- 172.21.15.118:0/3787076312 >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 msgr2=0x7f93d40c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 0x7f93d40c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 -- 172.21.15.118:0/3787076312 >> v2:172.21.15.98:3300/0 conn(0x7f93d40c34c0 msgr2=0x7f93d40c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.98:3300/0 conn(0x7f93d40c34c0 0x7f93d40c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 -- 172.21.15.118:0/3787076312 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4066780 con 0x7f93d41507e0 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d9930700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 0x7f93d40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93d912f700 1 --2- 172.21.15.118:0/3787076312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f93c4006fd0 tx=0x7f93c40090f0).ready entity=mon.2 client_cookie=7c47f92cc151d5bc server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93cbfff700 1 -- 172.21.15.118:0/3787076312 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400f510 con 0x7f93d41507e0 2023-08-22T00:05:52.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93cbfff700 1 -- 172.21.15.118:0/3787076312 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400f670 con 0x7f93d41507e0 2023-08-22T00:05:52.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.732+0000 7f93cbfff700 1 -- 172.21.15.118:0/3787076312 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400f9f0 con 0x7f93d41507e0 2023-08-22T00:05:52.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 -- 172.21.15.118:0/3787076312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 msgr2=0x7f93d4065730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 --2- 172.21.15.118:0/3787076312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f93c4006fd0 tx=0x7f93c40090f0).stop 2023-08-22T00:05:52.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 -- 172.21.15.118:0/3787076312 shutdown_connections 2023-08-22T00:05:52.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 --2- 172.21.15.118:0/3787076312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d4065730 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.118:3300/0 conn(0x7f93d40c3940 0x7f93d40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 --2- 172.21.15.118:0/3787076312 >> v2:172.21.15.98:3300/0 conn(0x7f93d40c34c0 0x7f93d40c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 -- 172.21.15.118:0/3787076312 >> 172.21.15.118:0/3787076312 conn(0x7f93d40c7800 msgr2=0x7f93d40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 -- 172.21.15.118:0/3787076312 shutdown_connections 2023-08-22T00:05:52.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.733+0000 7f93db393700 1 -- 172.21.15.118:0/3787076312 wait complete. 2023-08-22T00:05:52.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.734+0000 7f93db393700 1 Processor -- start 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.734+0000 7f93db393700 1 -- start start 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d40c34c0 0x7f93d40a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93d40a9fe0 0x7f93d414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40a8010 con 0x7f93d40a9fe0 2023-08-22T00:05:52.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40a77d0 con 0x7f93d40c34c0 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93db393700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40ad3c0 con 0x7f93d41507e0 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56048/0 (socket says 172.21.15.118:56048) 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 -- 172.21.15.118:0/1276205798 learned_addr learned my addr 172.21.15.118:0/1276205798 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d912f700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d40c34c0 0x7f93d40a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d9930700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93d40a9fe0 0x7f93d414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 -- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d40c34c0 msgr2=0x7f93d40a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d40c34c0 0x7f93d40a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 -- 172.21.15.118:0/1276205798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93d40a9fe0 msgr2=0x7f93d414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93d40a9fe0 0x7f93d414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 -- 172.21.15.118:0/1276205798 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc00bc30 con 0x7f93d41507e0 2023-08-22T00:05:52.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.735+0000 7f93d892e700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f93d000e900 tx=0x7f93d0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:52.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0012600 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0012760 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c4009370 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0012ae0 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40a7d30 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f93d001b660 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.736+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f93d001a870 con 0x7f93d41507e0 2023-08-22T00:05:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.737+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4069220 con 0x7f93d41507e0 2023-08-22T00:05:52.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.739+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f93d003ae50 con 0x7f93d41507e0 2023-08-22T00:05:52.755 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:52.744+0000 7efdcafc6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:05:52.813 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:52.812+0000 7efdcafc6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:05:52.837 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:52.837+0000 7f9e1e1bd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:05:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.851+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "655026d5-05ea-4515-977d-63f4ecf40f16", "id": 3} v 0) v1 -- 0x7f93d40c3dd0 con 0x7f93d41507e0 2023-08-22T00:05:52.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.859+0000 7f93c97fa700 1 -- 172.21.15.118:0/1276205798 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "655026d5-05ea-4515-977d-63f4ecf40f16", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f93d0029030 con 0x7f93d41507e0 2023-08-22T00:05:52.861 INFO:teuthology.orchestra.run.smithi118.stdout:3 2023-08-22T00:05:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 msgr2=0x7f93d40aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f93d000e900 tx=0x7f93d0009060).stop 2023-08-22T00:05:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 shutdown_connections 2023-08-22T00:05:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93d40a9fe0 0x7f93d414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d40c34c0 0x7f93d40a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 --2- 172.21.15.118:0/1276205798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d41507e0 0x7f93d40aced0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 >> 172.21.15.118:0/1276205798 conn(0x7f93d40c7800 msgr2=0x7f93d4065280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 shutdown_connections 2023-08-22T00:05:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.860+0000 7f93db393700 1 -- 172.21.15.118:0/1276205798 wait complete. 2023-08-22T00:05:52.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 6e5f7031-d1cb-494e-bf0d-e42c54c825c3 4 2023-08-22T00:05:52.916 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:52.912+0000 7f9e1e1bd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:05:52.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.995+0000 7f0d93bfd700 1 Processor -- start 2023-08-22T00:05:52.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.995+0000 7f0d93bfd700 1 -- start start 2023-08-22T00:05:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d93bfd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d8c0654d0 0x7f0d8c0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d93bfd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c154730 con 0x7f0d8c1542a0 2023-08-22T00:05:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d93bfd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c154a10 con 0x7f0d8c0658b0 2023-08-22T00:05:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d93bfd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c154cf0 con 0x7f0d8c0654d0 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d91198700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0d8c0658b0 0x7f0d8c0c6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46472/0 (socket says 172.21.15.118:46472) 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d91198700 1 -- 172.21.15.118:0/2826439817 learned_addr learned my addr 172.21.15.118:0/2826439817 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.996+0000 7f0d91999700 1 --2- 172.21.15.118:0/2826439817 >> v2:172.21.15.98:3300/0 conn(0x7f0d8c0654d0 0x7f0d8c0c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419334883 0 0) 0x7f0d8c154a10 con 0x7f0d8c0658b0 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d780033f0 con 0x7f0d8c0658b0 2023-08-22T00:05:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442289531 0 0) 0x7f0d8c154730 con 0x7f0d8c1542a0 2023-08-22T00:05:53.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d8c154a10 con 0x7f0d8c1542a0 2023-08-22T00:05:53.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d91999700 1 -- 172.21.15.118:0/2826439817 >> v1:172.21.15.118:6789/0 conn(0x7f0d8c0658b0 legacy=0x7f0d8c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006499836 0 0) 0x7f0d8c154a10 con 0x7f0d8c1542a0 2023-08-22T00:05:53.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d91999700 1 -- 172.21.15.118:0/2826439817 >> v1:172.21.15.98:6789/0 conn(0x7f0d8c1542a0 legacy=0x7f0d8c065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d91999700 1 -- 172.21.15.118:0/2826439817 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c154fd0 con 0x7f0d8c0654d0 2023-08-22T00:05:53.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d91999700 1 --2- 172.21.15.118:0/2826439817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c0654d0 0x7f0d8c0c3760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0d88009760 tx=0x7f0d88009060).ready entity=mon.0 client_cookie=f6df11d6029f7939 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840017f0 con 0x7f0d8c0654d0 2023-08-22T00:05:53.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88011400 con 0x7f0d8c0654d0 2023-08-22T00:05:53.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.997+0000 7f0d90997700 1 -- 172.21.15.118:0/2826439817 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88011780 con 0x7f0d8c0654d0 2023-08-22T00:05:53.003 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:52.999+0000 7efdcafc6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:05:53.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2826439817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c0654d0 msgr2=0x7f0d8c0c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2826439817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c0654d0 0x7f0d8c0c3760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0d88009760 tx=0x7f0d88009060).stop 2023-08-22T00:05:53.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2826439817 shutdown_connections 2023-08-22T00:05:53.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2826439817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c0654d0 0x7f0d8c0c3760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2826439817 >> 172.21.15.118:0/2826439817 conn(0x7f0d8c0c7800 msgr2=0x7f0d8c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2826439817 shutdown_connections 2023-08-22T00:05:53.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.998+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2826439817 wait complete. 2023-08-22T00:05:53.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.999+0000 7f0d93bfd700 1 Processor -- start 2023-08-22T00:05:53.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:52.999+0000 7f0d93bfd700 1 -- start start 2023-08-22T00:05:53.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 0x7f0d8c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c1556d0 0x7f0d8c0a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0a9bb0 con 0x7f0d8c1556d0 2023-08-22T00:05:53.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c1567c0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c157140 con 0x7f0d8c0654d0 2023-08-22T00:05:53.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60796/0 (socket says 172.21.15.118:60796) 2023-08-22T00:05:53.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 -- 172.21.15.118:0/2170421450 learned_addr learned my addr 172.21.15.118:0/2170421450 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:53.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91999700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 0x7f0d8c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d9219a700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c1556d0 0x7f0d8c0a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 -- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 msgr2=0x7f0d8c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 0x7f0d8c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 -- 172.21.15.118:0/2170421450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c1556d0 msgr2=0x7f0d8c0a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c1556d0 0x7f0d8c0a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 -- 172.21.15.118:0/2170421450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d880092a0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91999700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 0x7f0d8c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d91198700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0d7c00c4f0 tx=0x7f0d7c007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00ce60 con 0x7f0d8c0658b0 2023-08-22T00:05:53.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0072e0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c155bb0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.000+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0057a0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.001+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0d7c013450 con 0x7f0d8c0658b0 2023-08-22T00:05:53.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.001+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c156170 con 0x7f0d8c0658b0 2023-08-22T00:05:53.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.001+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f0d7c005df0 con 0x7f0d8c0658b0 2023-08-22T00:05:53.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.002+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c069220 con 0x7f0d8c0658b0 2023-08-22T00:05:53.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.004+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0d7c018070 con 0x7f0d8c0658b0 2023-08-22T00:05:53.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.100+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e5f7031-d1cb-494e-bf0d-e42c54c825c3", "id": 4} v 0) v1 -- 0x7f0d8c0c3c50 con 0x7f0d8c0658b0 2023-08-22T00:05:53.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.108+0000 7f0d81ffb700 1 -- 172.21.15.118:0/2170421450 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e5f7031-d1cb-494e-bf0d-e42c54c825c3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d7c013930 con 0x7f0d8c0658b0 2023-08-22T00:05:53.109 INFO:teuthology.orchestra.run.smithi118.stdout:4 2023-08-22T00:05:53.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 msgr2=0x7f0d8c165170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0d7c00c4f0 tx=0x7f0d7c007c50).stop 2023-08-22T00:05:53.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 shutdown_connections 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d8c0654d0 0x7f0d8c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d8c1556d0 0x7f0d8c0a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 --2- 172.21.15.118:0/2170421450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c0658b0 0x7f0d8c165170 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 >> 172.21.15.118:0/2170421450 conn(0x7f0d8c0c7800 msgr2=0x7f0d8c14dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 shutdown_connections 2023-08-22T00:05:53.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.109+0000 7f0d93bfd700 1 -- 172.21.15.118:0/2170421450 wait complete. 2023-08-22T00:05:53.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 44ecb76c-5e72-4d65-96f4-e5f06015e549 5 2023-08-22T00:05:53.122 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:53.122+0000 7f9e1e1bd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:05:53.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.237+0000 7f5f37854700 1 Processor -- start 2023-08-22T00:05:53.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.237+0000 7f5f37854700 1 -- start start 2023-08-22T00:05:53.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f37854700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5f30065730 0x7f5f300c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f37854700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f30066780 con 0x7f5f301507e0 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f37854700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f300c75f0 con 0x7f5f300c71a0 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f37854700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f300c2100 con 0x7f5f30065730 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f35df1700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5f300c71a0 0x7f5f30150bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46484/0 (socket says 172.21.15.118:46484) 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f35df1700 1 -- 172.21.15.118:0/2120691003 learned_addr learned my addr 172.21.15.118:0/2120691003 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.238+0000 7f5f34def700 1 --2- 172.21.15.118:0/2120691003 >> v2:172.21.15.98:3300/0 conn(0x7f5f30065730 0x7f5f300c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258912568 0 0) 0x7f5f300c75f0 con 0x7f5f300c71a0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f1c0033f0 con 0x7f5f300c71a0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359809652 0 0) 0x7f5f30066780 con 0x7f5f301507e0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f300c75f0 con 0x7f5f301507e0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f34def700 1 -- 172.21.15.118:0/2120691003 >> v1:172.21.15.118:6789/0 conn(0x7f5f300c71a0 legacy=0x7f5f30150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667619906 0 0) 0x7f5f1c0033f0 con 0x7f5f300c71a0 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f34def700 1 -- 172.21.15.118:0/2120691003 >> v1:172.21.15.98:6789/0 conn(0x7f5f301507e0 legacy=0x7f5f300c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f34def700 1 -- 172.21.15.118:0/2120691003 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300c3dd0 con 0x7f5f30065730 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f34def700 1 --2- 172.21.15.118:0/2120691003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f30065730 0x7f5f300c6cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f5f200096e0 tx=0x7f5f20009060).ready entity=mon.0 client_cookie=6f8b1c7bedcb6a81 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280017f0 con 0x7f5f30065730 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20011400 con 0x7f5f30065730 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.239+0000 7f5f27fff700 1 -- 172.21.15.118:0/2120691003 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011780 con 0x7f5f30065730 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 -- 172.21.15.118:0/2120691003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f30065730 msgr2=0x7f5f300c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 --2- 172.21.15.118:0/2120691003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f30065730 0x7f5f300c6cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f5f200096e0 tx=0x7f5f20009060).stop 2023-08-22T00:05:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 -- 172.21.15.118:0/2120691003 shutdown_connections 2023-08-22T00:05:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 --2- 172.21.15.118:0/2120691003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f30065730 0x7f5f300c6cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 -- 172.21.15.118:0/2120691003 >> 172.21.15.118:0/2120691003 conn(0x7f5f300c7800 msgr2=0x7f5f300c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 -- 172.21.15.118:0/2120691003 shutdown_connections 2023-08-22T00:05:53.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.240+0000 7f5f37854700 1 -- 172.21.15.118:0/2120691003 wait complete. 2023-08-22T00:05:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.241+0000 7f5f37854700 1 Processor -- start 2023-08-22T00:05:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.241+0000 7f5f37854700 1 -- start start 2023-08-22T00:05:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f301507e0 0x7f5f300c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300c53d0 con 0x7f5f301507e0 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a7fd0 con 0x7f5f30065730 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f37854700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a82b0 con 0x7f5f300c71a0 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f355f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56058/0 (socket says 172.21.15.118:56058) 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f355f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60802/0 (socket says 172.21.15.118:60802) 2023-08-22T00:05:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 -- 172.21.15.118:0/2858530981 learned_addr learned my addr 172.21.15.118:0/2858530981 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f35df1700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f301507e0 0x7f5f300c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 -- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 msgr2=0x7f5f30143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 -- 172.21.15.118:0/2858530981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f301507e0 msgr2=0x7f5f300c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f301507e0 0x7f5f300c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 -- 172.21.15.118:0/2858530981 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200092a0 con 0x7f5f300c71a0 2023-08-22T00:05:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f355f0700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.242+0000 7f5f34def700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f5f200118a0 tx=0x7f5f20016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200106c0 con 0x7f5f300c71a0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20010820 con 0x7f5f300c71a0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f300a8590 con 0x7f5f300c71a0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20010ba0 con 0x7f5f300c71a0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f300a8b50 con 0x7f5f300c71a0 2023-08-22T00:05:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f5f20027440 con 0x7f5f300c71a0 2023-08-22T00:05:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.243+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f5f200276f0 con 0x7f5f300c71a0 2023-08-22T00:05:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.244+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f300a8d40 con 0x7f5f300c71a0 2023-08-22T00:05:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.246+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5f2002c060 con 0x7f5f300c71a0 2023-08-22T00:05:53.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.327+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44ecb76c-5e72-4d65-96f4-e5f06015e549", "id": 5} v 0) v1 -- 0x7f5f30046c20 con 0x7f5f300c71a0 2023-08-22T00:05:53.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.334+0000 7f5f257fa700 1 -- 172.21.15.118:0/2858530981 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44ecb76c-5e72-4d65-96f4-e5f06015e549", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f20022070 con 0x7f5f300c71a0 2023-08-22T00:05:53.338 INFO:teuthology.orchestra.run.smithi118.stdout:5 2023-08-22T00:05:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 msgr2=0x7f5f300c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f5f200118a0 tx=0x7f5f20016000).stop 2023-08-22T00:05:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 shutdown_connections 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f301507e0 0x7f5f300c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f30065730 0x7f5f30143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 --2- 172.21.15.118:0/2858530981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f300c71a0 0x7f5f300c49f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 >> 172.21.15.118:0/2858530981 conn(0x7f5f300c7800 msgr2=0x7f5f300c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 shutdown_connections 2023-08-22T00:05:53.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.335+0000 7f5f37854700 1 -- 172.21.15.118:0/2858530981 wait complete. 2023-08-22T00:05:53.349 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new a4ce6bf0-82c9-405e-a13a-b0a9115f24f1 6 2023-08-22T00:05:53.443 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:53.440+0000 7efdcafc6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:05:53.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.466+0000 7f83c178d700 1 Processor -- start 2023-08-22T00:05:53.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.466+0000 7f83c178d700 1 -- start start 2023-08-22T00:05:53.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83c178d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83bc150990 0x7f83bc0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83c178d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83c178d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc0672d0 con 0x7f83bc065a40 2023-08-22T00:05:53.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83c178d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc0c6e50 con 0x7f83bc150990 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83c178d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0c1a00 con 0x7f83bc150d70 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83baffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83bc150990 0x7f83bc0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83ba7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83baffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83bc150990 0x7f83bc0c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60816/0 (socket says 172.21.15.118:60816) 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83baffd700 1 -- 172.21.15.118:0/742014716 learned_addr learned my addr 172.21.15.118:0/742014716 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.467+0000 7f83bb7fe700 1 --1- 172.21.15.118:0/742014716 >> v1:172.21.15.118:6789/0 conn(0x7f83bc065a40 0x7f83bc065ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46490/0 (socket says 172.21.15.118:46490) 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83baffd700 1 -- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 msgr2=0x7f83bc0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:53.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83baffd700 1 --2- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc0c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83baffd700 1 -- 172.21.15.118:0/742014716 >> v1:172.21.15.118:6789/0 conn(0x7f83bc065a40 legacy=0x7f83bc065ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83baffd700 1 -- 172.21.15.118:0/742014716 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0666c0 con 0x7f83bc150990 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83b9ffb700 1 -- 172.21.15.118:0/742014716 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105470356 0 0) 0x7f83bc0672d0 con 0x7f83bc065a40 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83baffd700 1 --2- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc0c6470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f83ac006fd0 tx=0x7f83ac0090f0).ready entity=mon.1 client_cookie=a59d0ef2be0f20aa server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83b9ffb700 1 -- 172.21.15.118:0/742014716 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00b580 con 0x7f83bc150990 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83b9ffb700 1 -- 172.21.15.118:0/742014716 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00b6e0 con 0x7f83bc150990 2023-08-22T00:05:53.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.468+0000 7f83b9ffb700 1 -- 172.21.15.118:0/742014716 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00ba60 con 0x7f83bc150990 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 -- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 msgr2=0x7f83bc0c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 --2- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc0c6470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f83ac006fd0 tx=0x7f83ac0090f0).stop 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 -- 172.21.15.118:0/742014716 shutdown_connections 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 --2- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc0c6470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 --2- 172.21.15.118:0/742014716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 -- 172.21.15.118:0/742014716 >> 172.21.15.118:0/742014716 conn(0x7f83bc0c3a60 msgr2=0x7f83bc0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 -- 172.21.15.118:0/742014716 shutdown_connections 2023-08-22T00:05:53.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.469+0000 7f83c178d700 1 -- 172.21.15.118:0/742014716 wait complete. 2023-08-22T00:05:53.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.470+0000 7f83c178d700 1 Processor -- start 2023-08-22T00:05:53.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.470+0000 7f83c178d700 1 -- start start 2023-08-22T00:05:53.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83bc065a40 0x7f83bc0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc14d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc154b30 con 0x7f83bc065a40 2023-08-22T00:05:53.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc144ae0 con 0x7f83bc150990 2023-08-22T00:05:53.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83c178d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc144dc0 con 0x7f83bc150d70 2023-08-22T00:05:53.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc14d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60830/0 (socket says 172.21.15.118:60830) 2023-08-22T00:05:53.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 -- 172.21.15.118:0/2148735328 learned_addr learned my addr 172.21.15.118:0/2148735328 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:53.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83baffd700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83bc065a40 0x7f83bc0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 -- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 msgr2=0x7f83bc14d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc14d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 -- 172.21.15.118:0/2148735328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83bc065a40 msgr2=0x7f83bc0bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83bc065a40 0x7f83bc0bdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 -- 172.21.15.118:0/2148735328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009370 con 0x7f83bc150990 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83bb7fe700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83ba7fc700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f83b000e8d0 tx=0x7f83b0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.471+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0012600 con 0x7f83bc150990 2023-08-22T00:05:53.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0012760 con 0x7f83bc150990 2023-08-22T00:05:53.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc1547c0 con 0x7f83bc150990 2023-08-22T00:05:53.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0012ae0 con 0x7f83bc150990 2023-08-22T00:05:53.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc144760 con 0x7f83bc150990 2023-08-22T00:05:53.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f83b001b660 con 0x7f83bc150990 2023-08-22T00:05:53.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.472+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc154ce0 con 0x7f83bc150990 2023-08-22T00:05:53.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.473+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f83b001b910 con 0x7f83bc150990 2023-08-22T00:05:53.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.476+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f83b003ae50 con 0x7f83bc150990 2023-08-22T00:05:53.544 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:53.543+0000 7efdcafc6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:05:53.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.556+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a4ce6bf0-82c9-405e-a13a-b0a9115f24f1", "id": 6} v 0) v1 -- 0x7f83bc0669a0 con 0x7f83bc150990 2023-08-22T00:05:53.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.564+0000 7f83a2ffd700 1 -- 172.21.15.118:0/2148735328 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4ce6bf0-82c9-405e-a13a-b0a9115f24f1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83b0029070 con 0x7f83bc150990 2023-08-22T00:05:53.565 INFO:teuthology.orchestra.run.smithi118.stdout:6 2023-08-22T00:05:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 msgr2=0x7f83bc144270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f83b000e8d0 tx=0x7f83b0009060).stop 2023-08-22T00:05:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 shutdown_connections 2023-08-22T00:05:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83bc150d70 0x7f83bc14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83bc065a40 0x7f83bc0bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 --2- 172.21.15.118:0/2148735328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83bc150990 0x7f83bc144270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 >> 172.21.15.118:0/2148735328 conn(0x7f83bc0c3a60 msgr2=0x7f83bc0aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 shutdown_connections 2023-08-22T00:05:53.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.565+0000 7f83c178d700 1 -- 172.21.15.118:0/2148735328 wait complete. 2023-08-22T00:05:53.578 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 5b36e6d3-ac74-4e97-b2c1-936084855dba 7 2023-08-22T00:05:53.589 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:53.588+0000 7f9e1e1bd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:05:53.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.694+0000 7f355347d700 1 Processor -- start 2023-08-22T00:05:53.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.694+0000 7f355347d700 1 -- start start 2023-08-22T00:05:53.697 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:53.695+0000 7efdcafc6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:05:53.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f355347d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f354c066000 0x7f354c066480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f355347d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c157f80 con 0x7f354c153cf0 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f355347d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c066970 con 0x7f354c0c21c0 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f355347d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c1554b0 con 0x7f354c066000 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f3550a18700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f354c066000 0x7f354c066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f3551a1a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f354c0c21c0 0x7f354c0c2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46498/0 (socket says 172.21.15.118:46498) 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f3550a18700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f354c066000 0x7f354c066480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60846/0 (socket says 172.21.15.118:60846) 2023-08-22T00:05:53.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.695+0000 7f3551a1a700 1 -- 172.21.15.118:0/436900826 learned_addr learned my addr 172.21.15.118:0/436900826 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3550a18700 1 -- 172.21.15.118:0/436900826 >> v1:172.21.15.118:6789/0 conn(0x7f354c0c21c0 legacy=0x7f354c0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3543fff700 1 -- 172.21.15.118:0/436900826 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796040816 0 0) 0x7f354c066970 con 0x7f354c0c21c0 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3550a18700 1 -- 172.21.15.118:0/436900826 >> v1:172.21.15.98:6789/0 conn(0x7f354c153cf0 legacy=0x7f354c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3550a18700 1 -- 172.21.15.118:0/436900826 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0be630 con 0x7f354c066000 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3550a18700 1 --2- 172.21.15.118:0/436900826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c066000 0x7f354c066480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f353c009760 tx=0x7f353c009060).ready entity=mon.1 client_cookie=10400056f2acf078 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3543fff700 1 -- 172.21.15.118:0/436900826 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00b580 con 0x7f354c066000 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3543fff700 1 -- 172.21.15.118:0/436900826 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c00b6e0 con 0x7f354c066000 2023-08-22T00:05:53.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f3543fff700 1 -- 172.21.15.118:0/436900826 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00ba60 con 0x7f354c066000 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f355347d700 1 -- 172.21.15.118:0/436900826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c066000 msgr2=0x7f354c066480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f355347d700 1 --2- 172.21.15.118:0/436900826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c066000 0x7f354c066480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f353c009760 tx=0x7f353c009060).stop 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f355347d700 1 -- 172.21.15.118:0/436900826 shutdown_connections 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f355347d700 1 --2- 172.21.15.118:0/436900826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c066000 0x7f354c066480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.696+0000 7f355347d700 1 -- 172.21.15.118:0/436900826 >> 172.21.15.118:0/436900826 conn(0x7f354c0c7820 msgr2=0x7f354c0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.697+0000 7f355347d700 1 -- 172.21.15.118:0/436900826 shutdown_connections 2023-08-22T00:05:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.697+0000 7f355347d700 1 -- 172.21.15.118:0/436900826 wait complete. 2023-08-22T00:05:53.703 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:53.697+0000 7f9e1e1bd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:05:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.698+0000 7f355347d700 1 Processor -- start 2023-08-22T00:05:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.698+0000 7f355347d700 1 -- start start 2023-08-22T00:05:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f354c066000 0x7f354c167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 0x7f354c0a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c165740 con 0x7f354c066000 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0c0910 con 0x7f354c153cf0 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c168440 con 0x7f354c0c21c0 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3550a18700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 0x7f354c0a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3550a18700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:56084/0 (socket says 172.21.15.118:56084) 2023-08-22T00:05:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3550a18700 1 -- 172.21.15.118:0/3428582742 learned_addr learned my addr 172.21.15.118:0/3428582742 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551219700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f354c066000 0x7f354c167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 -- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 msgr2=0x7f354c165250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 -- 172.21.15.118:0/3428582742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f354c066000 msgr2=0x7f354c167d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f354c066000 0x7f354c167d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 -- 172.21.15.118:0/3428582742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0092a0 con 0x7f354c153cf0 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3550a18700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:05:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f3551a1a700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 0x7f354c0a9940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3544002230 tx=0x7f3544007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544005d30 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3544005e90 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c168720 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544007360 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.699+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c0a9e30 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.700+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c0c06b0 con 0x7f354c153cf0 2023-08-22T00:05:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.700+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f354401d440 con 0x7f354c153cf0 2023-08-22T00:05:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.700+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f3544013aa0 con 0x7f354c153cf0 2023-08-22T00:05:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.703+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3544013cb0 con 0x7f354c153cf0 2023-08-22T00:05:53.774 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:53.773+0000 7efdcafc6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:05:53.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.796+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5b36e6d3-ac74-4e97-b2c1-936084855dba", "id": 7} v 0) v1 -- 0x7f354c0691b0 con 0x7f354c153cf0 2023-08-22T00:05:53.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.804+0000 7f35417fa700 1 -- 172.21.15.118:0/3428582742 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b36e6d3-ac74-4e97-b2c1-936084855dba", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3544013e50 con 0x7f354c153cf0 2023-08-22T00:05:53.809 INFO:teuthology.orchestra.run.smithi118.stdout:7 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 msgr2=0x7f354c0a9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 0x7f354c0a9940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3544002230 tx=0x7f3544007eb0).stop 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 shutdown_connections 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f354c153cf0 0x7f354c0a9940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f354c066000 0x7f354c167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 --2- 172.21.15.118:0/3428582742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f354c0c21c0 0x7f354c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:53.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 >> 172.21.15.118:0/3428582742 conn(0x7f354c0c7820 msgr2=0x7f354c151330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:53.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 shutdown_connections 2023-08-22T00:05:53.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:05:53.805+0000 7f355347d700 1 -- 172.21.15.118:0/3428582742 wait complete. 2023-08-22T00:05:53.818 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-22T00:05:53.819 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-22T00:05:53.823 INFO:tasks.ceph.osd.0:Started 2023-08-22T00:05:53.823 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-22T00:05:53.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-22T00:05:53.827 INFO:tasks.ceph.osd.1:Started 2023-08-22T00:05:53.827 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-22T00:05:53.828 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-22T00:05:53.830 INFO:tasks.ceph.osd.2:Started 2023-08-22T00:05:53.831 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-22T00:05:53.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-22T00:05:53.834 INFO:tasks.ceph.osd.3:Started 2023-08-22T00:05:53.834 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-22T00:05:53.834 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-22T00:05:53.852 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:53.851+0000 7efdcafc6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:05:53.861 INFO:tasks.ceph.osd.4:Started 2023-08-22T00:05:53.861 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-22T00:05:53.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-22T00:05:53.863 INFO:tasks.ceph.osd.5:Started 2023-08-22T00:05:53.863 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-22T00:05:53.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-22T00:05:53.865 INFO:tasks.ceph.osd.6:Started 2023-08-22T00:05:53.866 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-22T00:05:53.866 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-22T00:05:53.868 INFO:tasks.ceph.osd.7:Started 2023-08-22T00:05:53.869 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:05:53.869 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:53.867+0000 7f9e1e1bd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:05:53.966 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:53.966+0000 7f9e1e1bd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:05:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.007+0000 7f2326610700 1 Processor -- start 2023-08-22T00:05:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.007+0000 7f2326610700 1 -- start start 2023-08-22T00:05:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2326610700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f232014bf70 0x7f2320152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2326610700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f23200c3e50 0x7f23201556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2326610700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2320153080 con 0x7f232014c350 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2326610700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2320066510 con 0x7f232014bf70 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2326610700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200667b0 con 0x7f23200c3e50 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f231ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f232014bf70 0x7f2320152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f231ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f232014bf70 0x7f2320152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35668/0 (socket says 172.21.15.98:35668) 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f231ffff700 1 -- 172.21.15.98:0/4230334967 learned_addr learned my addr 172.21.15.98:0/4230334967 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:05:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.008+0000 7f2324bad700 1 --2- 172.21.15.98:0/4230334967 >> v2:172.21.15.118:3300/0 conn(0x7f23200c3e50 0x7f23201556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231ffff700 1 -- 172.21.15.98:0/4230334967 >> v2:172.21.15.118:3300/0 conn(0x7f23200c3e50 msgr2=0x7f23201556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231ffff700 1 --2- 172.21.15.98:0/4230334967 >> v2:172.21.15.118:3300/0 conn(0x7f23200c3e50 0x7f23201556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231ffff700 1 -- 172.21.15.98:0/4230334967 >> v1:172.21.15.118:6789/0 conn(0x7f232014c350 legacy=0x7f23200c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231ffff700 1 -- 172.21.15.98:0/4230334967 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320155ba0 con 0x7f232014bf70 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231ffff700 1 --2- 172.21.15.98:0/4230334967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f232014bf70 0x7f2320152b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f23200a8280 tx=0x7f23100090f0).ready entity=mon.0 client_cookie=ed76710d401a1a78 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231effd700 1 -- 172.21.15.98:0/4230334967 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000b520 con 0x7f232014bf70 2023-08-22T00:05:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231effd700 1 -- 172.21.15.98:0/4230334967 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000b680 con 0x7f232014bf70 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.009+0000 7f231effd700 1 -- 172.21.15.98:0/4230334967 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000ba00 con 0x7f232014bf70 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 -- 172.21.15.98:0/4230334967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f232014bf70 msgr2=0x7f2320152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 --2- 172.21.15.98:0/4230334967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f232014bf70 0x7f2320152b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f23200a8280 tx=0x7f23100090f0).stop 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 -- 172.21.15.98:0/4230334967 shutdown_connections 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 --2- 172.21.15.98:0/4230334967 >> v2:172.21.15.118:3300/0 conn(0x7f23200c3e50 0x7f23201556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 --2- 172.21.15.98:0/4230334967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f232014bf70 0x7f2320152b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 -- 172.21.15.98:0/4230334967 >> 172.21.15.98:0/4230334967 conn(0x7f23200c5dc0 msgr2=0x7f2320068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 -- 172.21.15.98:0/4230334967 shutdown_connections 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.010+0000 7f2326610700 1 -- 172.21.15.98:0/4230334967 wait complete. 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.011+0000 7f2326610700 1 Processor -- start 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.011+0000 7f2326610700 1 -- start start 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:54.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f232014bf70 0x7f2320150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:54.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232014c350 0x7f2320150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:54.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320150b50 con 0x7f23200c3e50 2023-08-22T00:05:54.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200a9030 con 0x7f232014c350 2023-08-22T00:05:54.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2326610700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200a9310 con 0x7f232014bf70 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f231ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f231ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35676/0 (socket says 172.21.15.98:35676) 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f231ffff700 1 -- 172.21.15.98:0/3577034295 learned_addr learned my addr 172.21.15.98:0/3577034295 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f2324bad700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232014c350 0x7f2320150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.012+0000 7f231f7fe700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f232014bf70 0x7f2320150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 -- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f232014bf70 msgr2=0x7f2320150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f232014bf70 0x7f2320150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 -- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232014c350 msgr2=0x7f2320150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232014c350 0x7f2320150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 -- 172.21.15.98:0/3577034295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009370 con 0x7f23200c3e50 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f231ffff700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2310009130 tx=0x7f2310017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310000bc0 con 0x7f23200c3e50 2023-08-22T00:05:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000b7f0 con 0x7f23200c3e50 2023-08-22T00:05:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200a95f0 con 0x7f23200c3e50 2023-08-22T00:05:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310000d20 con 0x7f23200c3e50 2023-08-22T00:05:54.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232014ca30 con 0x7f23200c3e50 2023-08-22T00:05:54.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f231001cb20 con 0x7f23200c3e50 2023-08-22T00:05:54.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.013+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f2310025d60 con 0x7f23200c3e50 2023-08-22T00:05:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.014+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320047480 con 0x7f23200c3e50 2023-08-22T00:05:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.016+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2310044e50 con 0x7f23200c3e50 2023-08-22T00:05:54.038 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:54.037+0000 7f9e1e1bd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:05:54.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.081+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2320155e00 con 0x7f23200c3e50 2023-08-22T00:05:54.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.082+0000 7f2307fff700 1 -- 172.21.15.98:0/3577034295 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f2310033030 con 0x7f23200c3e50 2023-08-22T00:05:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:05:54.084 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":10,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:05:53.798203+0000","last_up_change":"0.000000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:05:54.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 msgr2=0x7f23200a87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2310009130 tx=0x7f2310017000).stop 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 shutdown_connections 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232014c350 0x7f2320150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23200c3e50 0x7f23200a87e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 --2- 172.21.15.98:0/3577034295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f232014bf70 0x7f2320150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:54.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 >> 172.21.15.98:0/3577034295 conn(0x7f23200c5dc0 msgr2=0x7f2320068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:54.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 shutdown_connections 2023-08-22T00:05:54.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:05:54.083+0000 7f2326610700 1 -- 172.21.15.98:0/3577034295 wait complete. 2023-08-22T00:05:54.096 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-22T00:05:54.097 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-22T00:05:54.143 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:54.142+0000 7efdcafc6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:05:54.298 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:54.296+0000 7f9e1e1bd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:05:54.340 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:54.338+0000 7efdcafc6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:05:54.436 INFO:tasks.ceph.osd.1.smithi098.stderr:2023-08-22T00:05:54.434+0000 7fbf67efa200 -1 Falling back to public interface 2023-08-22T00:05:54.440 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-08-22T00:05:54.438+0000 7f2ade1bf200 -1 Falling back to public interface 2023-08-22T00:05:54.449 INFO:tasks.ceph.osd.2.smithi098.stderr:2023-08-22T00:05:54.447+0000 7f1a3c72b200 -1 Falling back to public interface 2023-08-22T00:05:54.453 INFO:tasks.ceph.osd.3.smithi098.stderr:2023-08-22T00:05:54.452+0000 7f5dcedac200 -1 Falling back to public interface 2023-08-22T00:05:54.465 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-08-22T00:05:54.464+0000 7f8f23bab200 -1 Falling back to public interface 2023-08-22T00:05:54.476 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-08-22T00:05:54.475+0000 7fc9d3231200 -1 Falling back to public interface 2023-08-22T00:05:54.484 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-08-22T00:05:54.483+0000 7fbc3e74c200 -1 Falling back to public interface 2023-08-22T00:05:54.485 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-08-22T00:05:54.483+0000 7fbf99c1b200 -1 Falling back to public interface 2023-08-22T00:05:54.485 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-08-22T00:05:54.484+0000 7fbf93dc3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-08-22T00:05:54.494 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:54.493+0000 7f9e1e1bd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:05:54.902 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-22T00:05:55.015 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.014+0000 7fbd0a780700 1 Processor -- start 2023-08-22T00:05:55.016 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.014+0000 7fbd0a780700 1 -- start start 2023-08-22T00:05:55.018 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd0a780700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd04154f50 0x7fbd040bd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:55.018 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd0a780700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040bdc60 con 0x7fbd040c4a00 2023-08-22T00:05:55.018 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd0a780700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040c4fe0 con 0x7fbd04153b60 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd0a780700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040c59b0 con 0x7fbd04154f50 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd08d1d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbd040c4a00 0x7fbd04062d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51330/0 (socket says 172.21.15.98:51330) 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd08d1d700 1 -- 172.21.15.98:0/2702144156 learned_addr learned my addr 172.21.15.98:0/2702144156 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd037fe700 1 --2- 172.21.15.98:0/2702144156 >> v2:172.21.15.118:3300/0 conn(0x7fbd04154f50 0x7fbd040bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620152199 0 0) 0x7fbd040bdc60 con 0x7fbd040c4a00 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.015+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcec0033f0 con 0x7fbd040c4a00 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd037fe700 1 -- 172.21.15.98:0/2702144156 >> v1:172.21.15.118:6789/0 conn(0x7fbd04153b60 legacy=0x7fbd04062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.019 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045377829 0 0) 0x7fbcec0033f0 con 0x7fbd040c4a00 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd037fe700 1 -- 172.21.15.98:0/2702144156 >> v1:172.21.15.98:6789/0 conn(0x7fbd040c4a00 legacy=0x7fbd04062d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd037fe700 1 -- 172.21.15.98:0/2702144156 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040bce70 con 0x7fbd04154f50 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd037fe700 1 --2- 172.21.15.98:0/2702144156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040bd300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbcf4009760 tx=0x7fbcf4009060).ready entity=mon.1 client_cookie=6442bf9a2358df9a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0017f0 con 0x7fbd04154f50 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf4012410 con 0x7fbd04154f50 2023-08-22T00:05:55.020 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd02ffd700 1 -- 172.21.15.98:0/2702144156 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4012790 con 0x7fbd04154f50 2023-08-22T00:05:55.021 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 -- 172.21.15.98:0/2702144156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 msgr2=0x7fbd040bd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.021 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 --2- 172.21.15.98:0/2702144156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040bd300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbcf4009760 tx=0x7fbcf4009060).stop 2023-08-22T00:05:55.021 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 -- 172.21.15.98:0/2702144156 shutdown_connections 2023-08-22T00:05:55.022 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 --2- 172.21.15.98:0/2702144156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040bd300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.022 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 -- 172.21.15.98:0/2702144156 >> 172.21.15.98:0/2702144156 conn(0x7fbd040c3940 msgr2=0x7fbd040c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:55.022 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 -- 172.21.15.98:0/2702144156 shutdown_connections 2023-08-22T00:05:55.022 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.016+0000 7fbd0a780700 1 -- 172.21.15.98:0/2702144156 wait complete. 2023-08-22T00:05:55.023 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.017+0000 7efdcafc6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:05:55.025 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.018+0000 7fbd0a780700 1 Processor -- start 2023-08-22T00:05:55.025 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.018+0000 7fbd0a780700 1 -- start start 2023-08-22T00:05:55.025 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.018+0000 7fbd0a780700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.018+0000 7fbd0a780700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd04153b60 0x7fbd04158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.018+0000 7fbd0a780700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd0a780700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd041511e0 con 0x7fbd040c4a00 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd0a780700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd04151670 con 0x7fbd04154f50 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd0a780700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd041505d0 con 0x7fbd04153b60 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:55.026 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35688/0 (socket says 172.21.15.98:35688) 2023-08-22T00:05:55.027 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 -- 172.21.15.98:0/740860734 learned_addr learned my addr 172.21.15.98:0/740860734 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:05:55.027 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd037fe700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd04153b60 0x7fbd04158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:55.027 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd08d1d700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:05:55.028 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 -- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd04153b60 msgr2=0x7fbd04158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.028 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd04153b60 0x7fbd04158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 -- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 msgr2=0x7fbd040a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 -- 172.21.15.98:0/740860734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40092a0 con 0x7fbd040c4a00 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd03fff700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbcf800c810 tx=0x7fbcf8007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800e4a0 con 0x7fbd040c4a00 2023-08-22T00:05:55.029 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8001e90 con 0x7fbd040c4a00 2023-08-22T00:05:55.030 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd041508b0 con 0x7fbd040c4a00 2023-08-22T00:05:55.030 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800e810 con 0x7fbd040c4a00 2023-08-22T00:05:55.031 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.019+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd04150e70 con 0x7fbd040c4a00 2023-08-22T00:05:55.031 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.020+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbcf801b3f0 con 0x7fbd040c4a00 2023-08-22T00:05:55.031 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.020+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fbcf8012af0 con 0x7fbd040c4a00 2023-08-22T00:05:55.031 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.020+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd04047480 con 0x7fbd040c4a00 2023-08-22T00:05:55.031 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.022+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fbcf8020060 con 0x7fbd040c4a00 2023-08-22T00:05:55.089 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.088+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd04069940 con 0x7fbd040c4a00 2023-08-22T00:05:55.091 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.089+0000 7fbcebfff700 1 -- 172.21.15.98:0/740860734 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fbcf8029090 con 0x7fbd040c4a00 2023-08-22T00:05:55.091 INFO:teuthology.misc.health.smithi098.stdout: 2023-08-22T00:05:55.091 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":10,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:05:53.798203+0000","last_up_change":"0.000000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:05:55.092 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.089+0000 7efdcafc6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 msgr2=0x7fbd04147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbcf800c810 tx=0x7fbcf8007d80).stop 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 shutdown_connections 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd04154f50 0x7fbd040a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd040c4a00 0x7fbd04147fd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.093 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 --2- 172.21.15.98:0/740860734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd04153b60 0x7fbd04158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:05:55.094 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 >> 172.21.15.98:0/740860734 conn(0x7fbd040c3940 msgr2=0x7fbd041488e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:05:55.094 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 shutdown_connections 2023-08-22T00:05:55.094 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:05:55.090+0000 7fbd0a780700 1 -- 172.21.15.98:0/740860734 wait complete. 2023-08-22T00:05:55.101 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-22T00:05:55.158 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.157+0000 7f9e1e1bd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:05:55.172 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.170+0000 7efdcafc6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:05:55.227 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.226+0000 7f9e1e1bd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:05:55.305 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.305+0000 7f9e1e1bd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:05:55.322 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.320+0000 7efdcafc6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:05:55.393 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.392+0000 7efdcafc6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:05:55.457 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.455+0000 7f9e1e1bd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:05:55.510 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.509+0000 7efdcafc6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:05:55.526 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.525+0000 7f9e1e1bd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:05:55.619 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.618+0000 7efdcafc6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:05:55.643 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.642+0000 7f9e1e1bd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:05:55.750 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:55.749+0000 7f9e1e1bd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:05:55.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:55.939+0000 7efdcafc6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:05:56.011 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:56.009+0000 7efdcafc6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:05:56.073 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:56.073+0000 7f9e1e1bd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:05:56.146 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:05:56.145+0000 7f9e1e1bd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:05:57.034 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:57.033+0000 7efd804bf700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-22T00:05:57.035 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:05:57.033+0000 7efd804bf700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-22T00:05:57.889 INFO:tasks.ceph.osd.1.smithi098.stderr:2023-08-22T00:05:57.888+0000 7fbf67efa200 -1 osd.1 0 log_to_monitors {default=true} 2023-08-22T00:05:57.927 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-08-22T00:05:57.926+0000 7f8f23bab200 -1 osd.6 0 log_to_monitors {default=true} 2023-08-22T00:05:57.935 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-08-22T00:05:57.933+0000 7f2ade1bf200 -1 osd.0 0 log_to_monitors {default=true} 2023-08-22T00:05:57.962 INFO:tasks.ceph.osd.2.smithi098.stderr:2023-08-22T00:05:57.961+0000 7f1a3c72b200 -1 osd.2 0 log_to_monitors {default=true} 2023-08-22T00:05:57.978 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-08-22T00:05:57.977+0000 7fc9d3231200 -1 osd.7 0 log_to_monitors {default=true} 2023-08-22T00:05:57.979 INFO:tasks.ceph.osd.3.smithi098.stderr:2023-08-22T00:05:57.978+0000 7f5dcedac200 -1 osd.3 0 log_to_monitors {default=true} 2023-08-22T00:05:57.989 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-08-22T00:05:57.988+0000 7fbc3e74c200 -1 osd.4 0 log_to_monitors {default=true} 2023-08-22T00:05:58.001 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-08-22T00:05:58.000+0000 7fbf99c1b200 -1 osd.5 0 log_to_monitors {default=true} 2023-08-22T00:05:59.038 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-08-22T00:05:59.037+0000 7f8f1a54c700 -1 osd.6 0 waiting for initial osdmap 2023-08-22T00:05:59.039 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-08-22T00:05:59.037+0000 7fc9c9bd2700 -1 osd.7 0 waiting for initial osdmap 2023-08-22T00:05:59.039 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-08-22T00:05:59.038+0000 7fbc350ed700 -1 osd.4 0 waiting for initial osdmap 2023-08-22T00:05:59.040 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-08-22T00:05:59.038+0000 7fbf905bc700 -1 osd.5 0 waiting for initial osdmap 2023-08-22T00:05:59.040 INFO:tasks.ceph.osd.1.smithi098.stderr:2023-08-22T00:05:59.039+0000 7fbf5e89b700 -1 osd.1 0 waiting for initial osdmap 2023-08-22T00:05:59.041 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-08-22T00:05:59.040+0000 7f2ad4b60700 -1 osd.0 0 waiting for initial osdmap 2023-08-22T00:05:59.041 INFO:tasks.ceph.osd.3.smithi098.stderr:2023-08-22T00:05:59.040+0000 7f5dc574d700 -1 osd.3 0 waiting for initial osdmap 2023-08-22T00:05:59.043 INFO:tasks.ceph.osd.2.smithi098.stderr:2023-08-22T00:05:59.040+0000 7f1a330cc700 -1 osd.2 0 waiting for initial osdmap 2023-08-22T00:05:59.044 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-08-22T00:05:59.043+0000 7fbc31869700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.044 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-08-22T00:05:59.043+0000 7fc9c634e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.045 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-08-22T00:05:59.043+0000 7f8f16cc8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.045 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-08-22T00:05:59.044+0000 7fbf8cd38700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.051 INFO:tasks.ceph.osd.3.smithi098.stderr:2023-08-22T00:05:59.050+0000 7f5dc1ec9700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.052 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-08-22T00:05:59.051+0000 7f2ad12dc700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.053 INFO:tasks.ceph.osd.1.smithi098.stderr:2023-08-22T00:05:59.051+0000 7fbf5b017700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:05:59.053 INFO:tasks.ceph.osd.2.smithi098.stderr:2023-08-22T00:05:59.051+0000 7f1a2f848700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-22T00:06:01.911 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:02.036 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.032+0000 7ff5dde63700 1 Processor -- start 2023-08-22T00:06:02.036 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.032+0000 7ff5dde63700 1 -- start start 2023-08-22T00:06:02.038 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5dde63700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5d80640f0 0x7ff5d80be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.038 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5dde63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5d80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.039 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5dde63700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80645a0 con 0x7ff5d80a7e90 2023-08-22T00:06:02.041 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5dde63700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8154300 con 0x7ff5d80640f0 2023-08-22T00:06:02.041 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5dde63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80653e0 con 0x7ff5d80be6d0 2023-08-22T00:06:02.041 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff5d80a7e90 0x7ff5d8154e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54152/0 (socket says 172.21.15.98:54152) 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d77fe700 1 -- 172.21.15.98:0/1961933180 learned_addr learned my addr 172.21.15.98:0/1961933180 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273365609 0 0) 0x7ff5d80645a0 con 0x7ff5d80a7e90 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d6ffd700 1 --2- 172.21.15.98:0/1961933180 >> v2:172.21.15.118:3300/0 conn(0x7ff5d80640f0 0x7ff5d80be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c00033f0 con 0x7ff5d80a7e90 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5d80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2375488110 0 0) 0x7ff5c00033f0 con 0x7ff5d80a7e90 2023-08-22T00:06:02.042 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 msgr2=0x7ff5d80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.043 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5d80c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.043 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 >> v2:172.21.15.118:3300/0 conn(0x7ff5d80640f0 msgr2=0x7ff5d80be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.043 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 --2- 172.21.15.98:0/1961933180 >> v2:172.21.15.118:3300/0 conn(0x7ff5d80640f0 0x7ff5d80be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.043 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80beb00 con 0x7ff5d80a7e90 2023-08-22T00:06:02.046 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff5c80015f0 con 0x7ff5d80a7e90 2023-08-22T00:06:02.047 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.033+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 >> v1:172.21.15.98:6789/0 conn(0x7ff5d80a7e90 legacy=0x7ff5d8154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.047 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5c0003960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.047 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0003ee0 0x7ff5c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.047 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5c0004b80 0x7ff5c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80653e0 con 0x7ff5c0004b80 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c000b8e0 con 0x7ff5c0003ee0 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c000ba50 con 0x7ff5d80be6d0 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5c0004b80 0x7ff5c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d6ffd700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0003ee0 0x7ff5c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.048 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d77fe700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5c0003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 -- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 msgr2=0x7ff5c0003960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80be6d0 0x7ff5c0003960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 -- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0003ee0 msgr2=0x7ff5c0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0003ee0 0x7ff5c0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 -- 172.21.15.98:0/1961933180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00033f0 con 0x7ff5c0004b80 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5c0004b80 0x7ff5c0005000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff5d000e1c0 tx=0x7ff5d000b040).ready entity=mon.0 client_cookie=8aa3c008de9c775b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0009ac0 con 0x7ff5c0004b80 2023-08-22T00:06:02.049 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000f040 con 0x7ff5c0004b80 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.034+0000 7ff5d67fc700 1 -- 172.21.15.98:0/1961933180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000eca0 con 0x7ff5c0004b80 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 -- 172.21.15.98:0/1961933180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5c0004b80 msgr2=0x7ff5c0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 --2- 172.21.15.98:0/1961933180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5c0004b80 0x7ff5c0005000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff5d000e1c0 tx=0x7ff5d000b040).stop 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5d7fff700 1 -- 172.21.15.98:0/1961933180 reap_dead start 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 -- 172.21.15.98:0/1961933180 shutdown_connections 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 -- 172.21.15.98:0/1961933180 >> 172.21.15.98:0/1961933180 conn(0x7ff5d8091e90 msgr2=0x7ff5d80820d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 -- 172.21.15.98:0/1961933180 shutdown_connections 2023-08-22T00:06:02.050 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.035+0000 7ff5dde63700 1 -- 172.21.15.98:0/1961933180 wait complete. 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.036+0000 7ff5dde63700 1 Processor -- start 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.036+0000 7ff5dde63700 1 -- start start 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d80c1660 0x7ff5d80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80c4cd0 0x7ff5d80a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80c5150 con 0x7ff5d80bf900 2023-08-22T00:06:02.051 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8152590 con 0x7ff5d80c1660 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5dde63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80c4350 con 0x7ff5d80c4cd0 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53926/0 (socket says 172.21.15.98:53926) 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 -- 172.21.15.98:0/2764600820 learned_addr learned my addr 172.21.15.98:0/2764600820 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d7fff700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80c4cd0 0x7ff5d80a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d6ffd700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d80c1660 0x7ff5d80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 -- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80c4cd0 msgr2=0x7ff5d80a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.052 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80c4cd0 0x7ff5d80a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 -- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d80c1660 msgr2=0x7ff5d80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d80c1660 0x7ff5d80c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.037+0000 7ff5d77fe700 1 -- 172.21.15.98:0/2764600820 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80c3740 con 0x7ff5d80bf900 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5d77fe700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff5c800fa30 tx=0x7ff5c8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80070d0 con 0x7ff5d80bf900 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8007230 con 0x7ff5d80bf900 2023-08-22T00:06:02.053 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d80c3a20 con 0x7ff5d80bf900 2023-08-22T00:06:02.054 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8005670 con 0x7ff5d80bf900 2023-08-22T00:06:02.054 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.038+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d80c3fe0 con 0x7ff5d80bf900 2023-08-22T00:06:02.054 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.039+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8047480 con 0x7ff5d80bf900 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.039+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff5c80059e0 con 0x7ff5d80bf900 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.039+0000 7ff5bf7fe700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 0x7ff5c40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.040+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7ff5c80790d0 con 0x7ff5d80bf900 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.040+0000 7ff5d6ffd700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 0x7ff5c40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.040+0000 7ff5d6ffd700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 0x7ff5c40612a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff5d80ae7f0 tx=0x7ff5cc009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.055 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.044+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5c80498f0 con 0x7ff5d80bf900 2023-08-22T00:06:02.210 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.208+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5d80a9220 con 0x7ff5d80bf900 2023-08-22T00:06:02.210 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.209+0000 7ff5bf7fe700 1 -- 172.21.15.98:0/2764600820 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12298 (secure 0 0 0) 0x7ff5c804ab00 con 0x7ff5d80bf900 2023-08-22T00:06:02.211 INFO:teuthology.misc.health.smithi098.stdout: 2023-08-22T00:06:02.211 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":15,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:02.046303+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:02.212 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 msgr2=0x7ff5c40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.212 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 0x7ff5c40612a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff5d80ae7f0 tx=0x7ff5cc009060).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 msgr2=0x7ff5d80c2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff5c800fa30 tx=0x7ff5c8009040).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 shutdown_connections 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff5c405ede0 0x7ff5c40612a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d80c4cd0 0x7ff5d80a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5d80bf900 0x7ff5d80c2ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 --2- 172.21.15.98:0/2764600820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d80c1660 0x7ff5d80c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.213 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 >> 172.21.15.98:0/2764600820 conn(0x7ff5d8091e90 msgr2=0x7ff5d81548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:02.214 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 shutdown_connections 2023-08-22T00:06:02.214 INFO:teuthology.misc.health.smithi098.stderr:2023-08-22T00:06:02.211+0000 7ff5dde63700 1 -- 172.21.15.98:0/2764600820 wait complete. 2023-08-22T00:06:02.223 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-22T00:06:02.224 INFO:tasks.ceph:Creating RBD pool 2023-08-22T00:06:02.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-22T00:06:02.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.338+0000 7f808471f700 1 Processor -- start 2023-08-22T00:06:02.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.338+0000 7f808471f700 1 -- start start 2023-08-22T00:06:02.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.339+0000 7f808471f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f807c067d00 0x7f807c155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.339+0000 7f808471f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f807c0641b0 0x7f807c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.339+0000 7f808471f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c0654a0 con 0x7f807c14e720 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.339+0000 7f808471f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c064920 con 0x7f807c0641b0 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f808471f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c064c00 con 0x7f807c067d00 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f807c0641b0 0x7f807c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f807c0641b0 0x7f807c0c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53940/0 (socket says 172.21.15.98:53940) 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 -- 172.21.15.98:0/2372978203 learned_addr learned my addr 172.21.15.98:0/2372978203 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:02.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8081cba700 1 --2- 172.21.15.98:0/2372978203 >> v2:172.21.15.118:3300/0 conn(0x7f807c067d00 0x7f807c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 -- 172.21.15.98:0/2372978203 >> v2:172.21.15.118:3300/0 conn(0x7f807c067d00 msgr2=0x7f807c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 --2- 172.21.15.98:0/2372978203 >> v2:172.21.15.118:3300/0 conn(0x7f807c067d00 0x7f807c155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 -- 172.21.15.98:0/2372978203 >> v1:172.21.15.118:6789/0 conn(0x7f807c14e720 legacy=0x7f807c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 -- 172.21.15.98:0/2372978203 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c064ee0 con 0x7f807c0641b0 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f8082cbc700 1 --2- 172.21.15.98:0/2372978203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c0641b0 0x7f807c0c3b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f807c06ab80 tx=0x7f8074009840).ready entity=mon.0 client_cookie=d952c9062ecfdeca server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f80814b9700 1 -- 172.21.15.98:0/2372978203 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400e070 con 0x7f807c0641b0 2023-08-22T00:06:02.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f80814b9700 1 -- 172.21.15.98:0/2372978203 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400ba10 con 0x7f807c0641b0 2023-08-22T00:06:02.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.340+0000 7f80814b9700 1 -- 172.21.15.98:0/2372978203 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400bd90 con 0x7f807c0641b0 2023-08-22T00:06:02.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 -- 172.21.15.98:0/2372978203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c0641b0 msgr2=0x7f807c0c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 --2- 172.21.15.98:0/2372978203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c0641b0 0x7f807c0c3b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f807c06ab80 tx=0x7f8074009840).stop 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 -- 172.21.15.98:0/2372978203 shutdown_connections 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 --2- 172.21.15.98:0/2372978203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c0641b0 0x7f807c0c3b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 --2- 172.21.15.98:0/2372978203 >> v2:172.21.15.118:3300/0 conn(0x7f807c067d00 0x7f807c155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 -- 172.21.15.98:0/2372978203 >> 172.21.15.98:0/2372978203 conn(0x7f807c0c8950 msgr2=0x7f807c0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 -- 172.21.15.98:0/2372978203 shutdown_connections 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.341+0000 7f808471f700 1 -- 172.21.15.98:0/2372978203 wait complete. 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.342+0000 7f808471f700 1 Processor -- start 2023-08-22T00:06:02.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.342+0000 7f808471f700 1 -- start start 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f807c0641b0 0x7f807c1393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f807c067d00 0x7f807c165b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c14b060 con 0x7f807c14e720 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c14b320 con 0x7f807c0641b0 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c14b600 con 0x7f807c067d00 2023-08-22T00:06:02.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53954/0 (socket says 172.21.15.98:53954) 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 -- 172.21.15.98:0/2851745380 learned_addr learned my addr 172.21.15.98:0/2851745380 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f80824bb700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f807c0641b0 0x7f807c1393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 -- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f807c067d00 msgr2=0x7f807c165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f807c067d00 0x7f807c165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:02.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 -- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f807c0641b0 msgr2=0x7f807c1393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f807c0641b0 0x7f807c1393a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 -- 172.21.15.98:0/2851745380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074009ae0 con 0x7f807c14e720 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f8082cbc700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8074009540 tx=0x7f8074009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074013e90 con 0x7f807c14e720 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807401c400 con 0x7f807c14e720 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c14b8e0 con 0x7f807c14e720 2023-08-22T00:06:02.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807401c7a0 con 0x7f807c14e720 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.343+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c139890 con 0x7f807c14e720 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.344+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c14be00 con 0x7f807c14e720 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.345+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f807401cb90 con 0x7f807c14e720 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.345+0000 7f80727fc700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 0x7f8060061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.345+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7f807407b2a0 con 0x7f807c14e720 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.345+0000 7f80824bb700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 0x7f8060061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:02.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.345+0000 7f80824bb700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 0x7f8060061300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8078007fd0 tx=0x7f8078009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:02.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.349+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f807404cbc0 con 0x7f807c14e720 2023-08-22T00:06:02.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:02.509+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f807c14be00 con 0x7f807c14e720 2023-08-22T00:06:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.121+0000 7f80727fc700 1 -- 172.21.15.98:0/2851745380 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f80740501e0 con 0x7f807c14e720 2023-08-22T00:06:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 msgr2=0x7f8060061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 0x7f8060061300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8078007fd0 tx=0x7f8078009040).stop 2023-08-22T00:06:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 msgr2=0x7f807c166040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8074009540 tx=0x7f8074009840).stop 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 shutdown_connections 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c14e720 0x7f807c166040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f807c0641b0 0x7f807c1393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f806005ee40 0x7f8060061300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 --2- 172.21.15.98:0/2851745380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f807c067d00 0x7f807c165b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 >> 172.21.15.98:0/2851745380 conn(0x7f807c0c8950 msgr2=0x7f807c14dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 shutdown_connections 2023-08-22T00:06:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.124+0000 7f808471f700 1 -- 172.21.15.98:0/2851745380 wait complete. 2023-08-22T00:06:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'rbd' created 2023-08-22T00:06:03.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-22T00:06:03.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.257+0000 7fd8d6c81700 1 Processor -- start 2023-08-22T00:06:03.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.257+0000 7fd8d6c81700 1 -- start start 2023-08-22T00:06:03.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d6c81700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd8d0065490 0x7fd8d00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d6c81700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8d015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d6c81700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d0064050 con 0x7fd8d01519f0 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d6c81700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d00bd6e0 con 0x7fd8d0065490 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d6c81700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c4b00 con 0x7fd8d00c46b0 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d4a1d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd8d01519f0 0x7fd8d00be0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54156/0 (socket says 172.21.15.98:54156) 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d4a1d700 1 -- 172.21.15.98:0/4273848254 learned_addr learned my addr 172.21.15.98:0/4273848254 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8cffff700 1 --2- 172.21.15.98:0/4273848254 >> v2:172.21.15.118:3300/0 conn(0x7fd8d0065490 0x7fd8d00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8d521e700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8d015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524479055 0 0) 0x7fd8d0064050 con 0x7fd8d01519f0 2023-08-22T00:06:03.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.258+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c00033f0 con 0x7fd8d01519f0 2023-08-22T00:06:03.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342123804 0 0) 0x7fd8c00033f0 con 0x7fd8d01519f0 2023-08-22T00:06:03.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 msgr2=0x7fd8d015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:03.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8d015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 >> v2:172.21.15.118:3300/0 conn(0x7fd8d0065490 msgr2=0x7fd8d00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 --2- 172.21.15.98:0/4273848254 >> v2:172.21.15.118:3300/0 conn(0x7fd8d0065490 0x7fd8d00c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0151dd0 con 0x7fd8d01519f0 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd8c4001470 con 0x7fd8d01519f0 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cffff700 1 --2- 172.21.15.98:0/4273848254 >> v2:172.21.15.118:3300/0 conn(0x7fd8d0065490 0x7fd8d00c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d521e700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8d015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 >> v1:172.21.15.98:6789/0 conn(0x7fd8d01519f0 legacy=0x7fd8d00be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c00038e0 0x7fd8c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0004690 0x7fd8c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00bd6e0 con 0x7fd8c00038e0 2023-08-22T00:06:03.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c4b00 con 0x7fd8c0004690 2023-08-22T00:06:03.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00044f0 con 0x7fd8d00c46b0 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c00038e0 0x7fd8c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cffff700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0004690 0x7fd8c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d521e700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 -- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 msgr2=0x7fd8c0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00c46b0 0x7fd8c0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 -- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0004690 msgr2=0x7fd8c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0004690 0x7fd8c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 -- 172.21.15.98:0/4273848254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009a20 con 0x7fd8c00038e0 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c00038e0 0x7fd8c0003d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd8c400c210 tx=0x7fd8c4001e90).ready entity=mon.0 client_cookie=45d93bcdda66c025 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4007a60 con 0x7fd8c00038e0 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400cae0 con 0x7fd8c00038e0 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.259+0000 7fd8cf7fe700 1 -- 172.21.15.98:0/4273848254 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400ce80 con 0x7fd8c00038e0 2023-08-22T00:06:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 -- 172.21.15.98:0/4273848254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c00038e0 msgr2=0x7fd8c0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/4273848254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c00038e0 0x7fd8c0003d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd8c400c210 tx=0x7fd8c4001e90).stop 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d521e700 1 -- 172.21.15.98:0/4273848254 reap_dead start 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 -- 172.21.15.98:0/4273848254 shutdown_connections 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 -- 172.21.15.98:0/4273848254 >> 172.21.15.98:0/4273848254 conn(0x7fd8d006a910 msgr2=0x7fd8d0065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 -- 172.21.15.98:0/4273848254 shutdown_connections 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.260+0000 7fd8d6c81700 1 -- 172.21.15.98:0/4273848254 wait complete. 2023-08-22T00:06:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.261+0000 7fd8d6c81700 1 Processor -- start 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 -- start start 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00038e0 0x7fd8d014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00a44e0 0x7fd8d00c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00ad780 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00a4050 con 0x7fd8c00038e0 2023-08-22T00:06:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d6c81700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c7350 con 0x7fd8d00a44e0 2023-08-22T00:06:03.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.262+0000 7fd8d521e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53972/0 (socket says 172.21.15.98:53972) 2023-08-22T00:06:03.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 -- 172.21.15.98:0/1523713186 learned_addr learned my addr 172.21.15.98:0/1523713186 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00038e0 0x7fd8d014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8cffff700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00a44e0 0x7fd8d00c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 -- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00a44e0 msgr2=0x7fd8d00c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00a44e0 0x7fd8d00c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 -- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00038e0 msgr2=0x7fd8d014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00038e0 0x7fd8d014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 -- 172.21.15.98:0/1523713186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00ad4a0 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d521e700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd8c8009f00 tx=0x7fd8c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800e040 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c800f040 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800fda0 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d00a3a00 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.263+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d014b390 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.264+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d0047480 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.264+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd8c8015660 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.265+0000 7fd8ccff9700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 0x7fd8b40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:03.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.265+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fd8c807a5e0 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.265+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 0x7fd8b40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:03.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.265+0000 7fd8d4a1d700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 0x7fd8b40612a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd8c4001ed0 tx=0x7fd8c4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:03.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.269+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8c804bdb0 con 0x7fd8d00c6ed0 2023-08-22T00:06:03.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:03.433+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8d00a4190 con 0x7fd8d00c6ed0 2023-08-22T00:06:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.129+0000 7fd8ccff9700 1 -- 172.21.15.98:0/1523713186 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd8c804f3d0 con 0x7fd8d00c6ed0 2023-08-22T00:06:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.132+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 msgr2=0x7fd8b40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.132+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 0x7fd8b40612a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd8c4001ed0 tx=0x7fd8c4015000).stop 2023-08-22T00:06:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.132+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 msgr2=0x7fd8d00ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.132+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd8c8009f00 tx=0x7fd8c800b040).stop 2023-08-22T00:06:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 shutdown_connections 2023-08-22T00:06:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d00c6ed0 0x7fd8d00ac790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00038e0 0x7fd8d014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd8b405ede0 0x7fd8b40612a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 --2- 172.21.15.98:0/1523713186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8d00a44e0 0x7fd8d00c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 >> 172.21.15.98:0/1523713186 conn(0x7fd8d006a910 msgr2=0x7fd8d0153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 shutdown_connections 2023-08-22T00:06:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.133+0000 7fd8d6c81700 1 -- 172.21.15.98:0/1523713186 wait complete. 2023-08-22T00:06:04.154 INFO:teuthology.orchestra.run.smithi098.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-22T00:06:04.155 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-22T00:06:04.155 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:06:04.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:06:04.160 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:06:04.161 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:06:04.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:06:04.166 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:06:04.167 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:06:04.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:06:04.171 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:06:04.172 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:06:04.174 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:06:04.178 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:06:04.178 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-22T00:06:04.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:04.251 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:06:04.252 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:06:04.257 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:06:04.260 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:06:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.308+0000 7f1d1ec39700 1 Processor -- start 2023-08-22T00:06:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.308+0000 7f1d1ec39700 1 -- start start 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1ec39700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d180c61a0 0x7f1d1814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1ec39700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d181544f0 0x7f1d181549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1ec39700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d18155260 con 0x7f1d1814e0d0 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1ec39700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180c17b0 con 0x7f1d180c61a0 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1ec39700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180bf9e0 con 0x7f1d181544f0 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d180c61a0 0x7f1d1814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1c9d5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1d1814e0d0 0x7f1d180c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54186/0 (socket says 172.21.15.98:54186) 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d180c61a0 0x7f1d1814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53990/0 (socket says 172.21.15.98:53990) 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1c9d5700 1 -- 172.21.15.98:0/167524529 learned_addr learned my addr 172.21.15.98:0/167524529 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d1d1d6700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d181544f0 0x7f1d181549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 -- 172.21.15.98:0/167524529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d181544f0 msgr2=0x7f1d181549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d181544f0 0x7f1d181549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 -- 172.21.15.98:0/167524529 >> v1:172.21.15.98:6789/0 conn(0x7f1d1814e0d0 legacy=0x7f1d180c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d177fe700 1 -- 172.21.15.98:0/167524529 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130033588 0 0) 0x7f1d18155260 con 0x7f1d1814e0d0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 -- 172.21.15.98:0/167524529 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180bfcc0 con 0x7f1d180c61a0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d17fff700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d180c61a0 0x7f1d1814e4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1d04009760 tx=0x7f1d04009060).ready entity=mon.0 client_cookie=2a66ee5dedbbaff7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d177fe700 1 -- 172.21.15.98:0/167524529 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400b580 con 0x7f1d180c61a0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d177fe700 1 -- 172.21.15.98:0/167524529 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0400b6e0 con 0x7f1d180c61a0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.309+0000 7f1d177fe700 1 -- 172.21.15.98:0/167524529 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400ba60 con 0x7f1d180c61a0 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 -- 172.21.15.98:0/167524529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d180c61a0 msgr2=0x7f1d1814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d180c61a0 0x7f1d1814e4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1d04009760 tx=0x7f1d04009060).stop 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 -- 172.21.15.98:0/167524529 shutdown_connections 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d181544f0 0x7f1d181549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/167524529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d180c61a0 0x7f1d1814e4b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 -- 172.21.15.98:0/167524529 >> 172.21.15.98:0/167524529 conn(0x7f1d180caa80 msgr2=0x7f1d180cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 -- 172.21.15.98:0/167524529 shutdown_connections 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.310+0000 7f1d1ec39700 1 -- 172.21.15.98:0/167524529 wait complete. 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.311+0000 7f1d1ec39700 1 Processor -- start 2023-08-22T00:06:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.312+0000 7f1d1ec39700 1 -- start start 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.312+0000 7f1d1ec39700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d180c61a0 0x7f1d181444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.312+0000 7f1d1ec39700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d1814e0d0 0x7f1d18151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.312+0000 7f1d1ec39700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1ec39700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180aec00 con 0x7f1d181544f0 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1ec39700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180adb60 con 0x7f1d1814e0d0 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1ec39700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180ade40 con 0x7f1d180c61a0 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54004/0 (socket says 172.21.15.98:54004) 2023-08-22T00:06:04.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 -- 172.21.15.98:0/4198353878 learned_addr learned my addr 172.21.15.98:0/4198353878 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:04.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1c9d5700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d180c61a0 0x7f1d181444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d17fff700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d1814e0d0 0x7f1d18151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 -- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d180c61a0 msgr2=0x7f1d181444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d180c61a0 0x7f1d181444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 -- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d1814e0d0 msgr2=0x7f1d18151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d1814e0d0 0x7f1d18151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 -- 172.21.15.98:0/4198353878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040092a0 con 0x7f1d181544f0 2023-08-22T00:06:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1d1d6700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1d10009fa0 tx=0x7f1d10009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000ebc0 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000ed20 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10014610 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d180ae120 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.313+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d180ae6e0 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.314+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d18047480 con 0x7f1d181544f0 2023-08-22T00:06:04.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.314+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1d100149c0 con 0x7f1d181544f0 2023-08-22T00:06:04.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.315+0000 7f1d14ff9700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 0x7f1cfc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.315+0000 7f1d1c9d5700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 0x7f1cfc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.315+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1d10079e60 con 0x7f1d181544f0 2023-08-22T00:06:04.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.315+0000 7f1d1c9d5700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 0x7f1cfc0612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d0c0011e0 tx=0x7f1d0c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.319+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d1004b5c0 con 0x7f1d181544f0 2023-08-22T00:06:04.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.480+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d18064ef0 con 0x7f1d181544f0 2023-08-22T00:06:04.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.481+0000 7f1d14ff9700 1 -- 172.21.15.98:0/4198353878 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13818 (secure 0 0 0) 0x7f1d1004ebe0 con 0x7f1d181544f0 2023-08-22T00:06:04.490 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:04.492 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:04.118988+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 msgr2=0x7f1cfc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 0x7f1cfc0612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d0c0011e0 tx=0x7f1d0c007bd0).stop 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 msgr2=0x7f1d180af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1d10009fa0 tx=0x7f1d10009900).stop 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 shutdown_connections 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cfc05ee10 0x7f1cfc0612d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d180c61a0 0x7f1d181444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d181544f0 0x7f1d180af620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 --2- 172.21.15.98:0/4198353878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d1814e0d0 0x7f1d18151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 >> 172.21.15.98:0/4198353878 conn(0x7f1d180caa80 msgr2=0x7f1d18151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 shutdown_connections 2023-08-22T00:06:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.483+0000 7f1d1ec39700 1 -- 172.21.15.98:0/4198353878 wait complete. 2023-08-22T00:06:04.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:06:04.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.614+0000 7fdce2b2b700 1 Processor -- start 2023-08-22T00:06:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 -- start start 2023-08-22T00:06:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdcdc066150 0x7fdcdc066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdcdc157890 0x7fdcdc0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0c69b0 con 0x7fdcdc0c5360 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc1542c0 con 0x7fdcdc066150 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.615+0000 7fdce2b2b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c57f0 con 0x7fdcdc157890 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdcdc066150 0x7fdcdc066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdcdc066150 0x7fdcdc066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54014/0 (socket says 172.21.15.98:54014) 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 -- 172.21.15.98:0/3476119946 learned_addr learned my addr 172.21.15.98:0/3476119946 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce10c8700 1 --2- 172.21.15.98:0/3476119946 >> v2:172.21.15.118:3300/0 conn(0x7fdcdc157890 0x7fdcdc0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 -- 172.21.15.98:0/3476119946 >> v2:172.21.15.118:3300/0 conn(0x7fdcdc157890 msgr2=0x7fdcdc0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 --2- 172.21.15.98:0/3476119946 >> v2:172.21.15.118:3300/0 conn(0x7fdcdc157890 0x7fdcdc0c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 -- 172.21.15.98:0/3476119946 >> v1:172.21.15.118:6789/0 conn(0x7fdcdc0c5360 legacy=0x7fdcdc0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 -- 172.21.15.98:0/3476119946 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0c5ad0 con 0x7fdcdc066150 2023-08-22T00:06:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdce08c7700 1 --2- 172.21.15.98:0/3476119946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc066150 0x7fdcdc066530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdcdc06c600 tx=0x7fdcd00090f0).ready entity=mon.0 client_cookie=20edb52da86d4cba server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdcdb7fe700 1 -- 172.21.15.98:0/3476119946 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000b5a0 con 0x7fdcdc066150 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdcdb7fe700 1 -- 172.21.15.98:0/3476119946 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000b700 con 0x7fdcdc066150 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.616+0000 7fdcdb7fe700 1 -- 172.21.15.98:0/3476119946 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000ba80 con 0x7fdcdc066150 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 -- 172.21.15.98:0/3476119946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc066150 msgr2=0x7fdcdc066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/3476119946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc066150 0x7fdcdc066530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdcdc06c600 tx=0x7fdcd00090f0).stop 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 -- 172.21.15.98:0/3476119946 shutdown_connections 2023-08-22T00:06:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/3476119946 >> v2:172.21.15.118:3300/0 conn(0x7fdcdc157890 0x7fdcdc0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/3476119946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc066150 0x7fdcdc066530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 -- 172.21.15.98:0/3476119946 >> 172.21.15.98:0/3476119946 conn(0x7fdcdc0c7800 msgr2=0x7fdcdc0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 -- 172.21.15.98:0/3476119946 shutdown_connections 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.617+0000 7fdce2b2b700 1 -- 172.21.15.98:0/3476119946 wait complete. 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.618+0000 7fdce2b2b700 1 Processor -- start 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.618+0000 7fdce2b2b700 1 -- start start 2023-08-22T00:06:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc066150 0x7fdcdc14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 0x7fdcdc1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0a4640 con 0x7fdcdc157890 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14fc20 con 0x7fdcdc066150 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0a3a70 con 0x7fdcdc165170 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54028/0 (socket says 172.21.15.98:54028) 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 -- 172.21.15.98:0/589915603 learned_addr learned my addr 172.21.15.98:0/589915603 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce08c7700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc066150 0x7fdcdc14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce10c8700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 0x7fdcdc1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 -- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 msgr2=0x7fdcdc1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 0x7fdcdc1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 -- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc066150 msgr2=0x7fdcdc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc066150 0x7fdcdc14f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 -- 172.21.15.98:0/589915603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009370 con 0x7fdcdc157890 2023-08-22T00:06:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce10c8700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 0x7fdcdc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcdbfff700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdcc800b4a0 tx=0x7fdcc8006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8012410 con 0x7fdcdc157890 2023-08-22T00:06:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8012590 con 0x7fdcdc157890 2023-08-22T00:06:04.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc0a3d10 con 0x7fdcdc157890 2023-08-22T00:06:04.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8012950 con 0x7fdcdc157890 2023-08-22T00:06:04.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.619+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0a42d0 con 0x7fdcdc157890 2023-08-22T00:06:04.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.620+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0a47f0 con 0x7fdcdc157890 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.621+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdcc8012d00 con 0x7fdcdc157890 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.621+0000 7fdcd8ff9700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 0x7fdcc00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.621+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdcc80796d0 con 0x7fdcdc157890 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.621+0000 7fdce08c7700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 0x7fdcc00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.621+0000 7fdce08c7700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 0x7fdcc00612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdcd0009130 tx=0x7fdcd0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.625+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdcdc0a47f0 con 0x7fdcdc157890 2023-08-22T00:06:04.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.786+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdcdc0a47f0 con 0x7fdcdc157890 2023-08-22T00:06:04.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.787+0000 7fdcd8ff9700 1 -- 172.21.15.98:0/589915603 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdcdc0a47f0 con 0x7fdcdc157890 2023-08-22T00:06:04.788 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 msgr2=0x7fdcc00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 0x7fdcc00612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdcd0009130 tx=0x7fdcd0015000).stop 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 msgr2=0x7fdcdc0a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdcc800b4a0 tx=0x7fdcc8006f90).stop 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 shutdown_connections 2023-08-22T00:06:04.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdcc005ee10 0x7fdcc00612d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcdc165170 0x7fdcdc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc066150 0x7fdcdc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 --2- 172.21.15.98:0/589915603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcdc157890 0x7fdcdc0a54a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 >> 172.21.15.98:0/589915603 conn(0x7fdcdc0c7800 msgr2=0x7fdcdc0bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 shutdown_connections 2023-08-22T00:06:04.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.788+0000 7fdce2b2b700 1 -- 172.21.15.98:0/589915603 wait complete. 2023-08-22T00:06:04.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:04.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.930+0000 7f8298614700 1 Processor -- start 2023-08-22T00:06:04.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.930+0000 7f8298614700 1 -- start start 2023-08-22T00:06:04.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8298614700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82900c5750 0x7f82900c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8298614700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290064280 con 0x7f82901579e0 2023-08-22T00:06:04.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8298614700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900c4c20 con 0x7f8290063000 2023-08-22T00:06:04.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8298614700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900c1850 con 0x7f82900c5750 2023-08-22T00:06:04.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8295baf700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f82901579e0 0x7f82900c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54194/0 (socket says 172.21.15.98:54194) 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f8295baf700 1 -- 172.21.15.98:0/719417757 learned_addr learned my addr 172.21.15.98:0/719417757 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584004393 0 0) 0x7f8290064280 con 0x7f82901579e0 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c0033f0 con 0x7f82901579e0 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82963b0700 1 --2- 172.21.15.98:0/719417757 >> v2:172.21.15.118:3300/0 conn(0x7f82900c5750 0x7f82900c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4155784838 0 0) 0x7f827c0033f0 con 0x7f82901579e0 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 >> v2:172.21.15.118:3300/0 conn(0x7f82900c5750 msgr2=0x7f82900c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 --2- 172.21.15.98:0/719417757 >> v2:172.21.15.118:3300/0 conn(0x7f82900c5750 0x7f82900c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 >> v1:172.21.15.118:6789/0 conn(0x7f8290063000 legacy=0x7f8290154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290063670 con 0x7f82901579e0 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8280001470 con 0x7f82901579e0 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82963b0700 1 --2- 172.21.15.98:0/719417757 >> v2:172.21.15.118:3300/0 conn(0x7f82900c5750 0x7f82900c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 >> v1:172.21.15.98:6789/0 conn(0x7f82901579e0 legacy=0x7f82900c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f827c0038e0 0x7f827c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c004690 0x7f827c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 0x7f827c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c1850 con 0x7f827c005050 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00bfe0 con 0x7f827c004690 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.931+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00c1a0 con 0x7f827c0038e0 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 0x7f827c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8295baf700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c004690 0x7f827c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f82963b0700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f827c0038e0 0x7f827c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 -- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f827c0038e0 msgr2=0x7f827c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f827c0038e0 0x7f827c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 -- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c004690 msgr2=0x7f827c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c004690 0x7f827c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 -- 172.21.15.98:0/719417757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0033f0 con 0x7f827c005050 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 -- 172.21.15.98:0/719417757 reap_dead start 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8296bb1700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 0x7f827c00b8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8288001e30 tx=0x7f8288007f30).ready entity=mon.0 client_cookie=f4ac3b83dc418d44 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288006a20 con 0x7f827c005050 2023-08-22T00:06:04.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288006b80 con 0x7f827c005050 2023-08-22T00:06:04.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f82953ae700 1 -- 172.21.15.98:0/719417757 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800c5d0 con 0x7f827c005050 2023-08-22T00:06:04.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8298614700 1 -- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 msgr2=0x7f827c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.932+0000 7f8298614700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 0x7f827c00b8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8288001e30 tx=0x7f8288007f30).stop 2023-08-22T00:06:04.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.933+0000 7f8298614700 1 -- 172.21.15.98:0/719417757 shutdown_connections 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.933+0000 7f8298614700 1 --2- 172.21.15.98:0/719417757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f827c005050 0x7f827c00b8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.933+0000 7f8298614700 1 -- 172.21.15.98:0/719417757 >> 172.21.15.98:0/719417757 conn(0x7f82900c3a60 msgr2=0x7f82900c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.933+0000 7f8298614700 1 -- 172.21.15.98:0/719417757 shutdown_connections 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.933+0000 7f8298614700 1 -- 172.21.15.98:0/719417757 wait complete. 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.934+0000 7f8298614700 1 Processor -- start 2023-08-22T00:06:04.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.934+0000 7f8298614700 1 -- start start 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.934+0000 7f8298614700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 0x7f8290153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.934+0000 7f8298614700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82900ab430 0x7f82900ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829014e810 con 0x7f82900bfb30 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290157270 con 0x7f827c005050 2023-08-22T00:06:04.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900abd80 con 0x7f82900ab430 2023-08-22T00:06:04.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54038/0 (socket says 172.21.15.98:54038) 2023-08-22T00:06:04.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 -- 172.21.15.98:0/3825905049 learned_addr learned my addr 172.21.15.98:0/3825905049 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:04.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8296bb1700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82900ab430 0x7f82900ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f82963b0700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 0x7f8290153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 -- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82900ab430 msgr2=0x7f82900ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82900ab430 0x7f82900ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 -- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 msgr2=0x7f8290153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 0x7f8290153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 -- 172.21.15.98:0/3825905049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290157700 con 0x7f82900bfb30 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f82963b0700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 0x7f8290153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:04.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8295baf700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f82800046e0 tx=0x7f8280001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011590 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800116f0 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8290153e70 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011a90 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.935+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290156f00 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.936+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290068970 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.936+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f828001d3b0 con 0x7f82900bfb30 2023-08-22T00:06:04.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.937+0000 7f82867fc700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 0x7f82740612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:04.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.937+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8280079350 con 0x7f82900bfb30 2023-08-22T00:06:04.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.937+0000 7f82963b0700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 0x7f82740612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:04.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.937+0000 7f82963b0700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 0x7f82740612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f828c00b0b0 tx=0x7f828c00b040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:04.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:04.941+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f828004aab0 con 0x7f82900bfb30 2023-08-22T00:06:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.100+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f82900c4e10 con 0x7f82900bfb30 2023-08-22T00:06:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.100+0000 7f82867fc700 1 -- 172.21.15.98:0/3825905049 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8280019030 con 0x7f82900bfb30 2023-08-22T00:06:05.103 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 msgr2=0x7f82740612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 0x7f82740612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f828c00b0b0 tx=0x7f828c00b040).stop 2023-08-22T00:06:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 msgr2=0x7f82901543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f82800046e0 tx=0x7f8280001e50).stop 2023-08-22T00:06:05.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 shutdown_connections 2023-08-22T00:06:05.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f827405ee10 0x7f82740612d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82900ab430 0x7f82900ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f827c005050 0x7f8290153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 --2- 172.21.15.98:0/3825905049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82900bfb30 0x7f82901543c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 >> 172.21.15.98:0/3825905049 conn(0x7f82900c3a60 msgr2=0x7f82900bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 shutdown_connections 2023-08-22T00:06:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.102+0000 7f8298614700 1 -- 172.21.15.98:0/3825905049 wait complete. 2023-08-22T00:06:05.117 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:05.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.233+0000 7f51109a3700 1 Processor -- start 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.233+0000 7f51109a3700 1 -- start start 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 0x7f510c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f510c0c5a90 0x7f510c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 0x7f510c154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c155260 con 0x7f510c0c5a90 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0bf9e0 con 0x7f510c1544f0 2023-08-22T00:06:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f51109a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0bfcc0 con 0x7f510c14e0d0 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f510c0c5a90 0x7f510c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f510c0c5a90 0x7f510c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54044/0 (socket says 172.21.15.98:54044) 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 -- 172.21.15.98:0/1888946256 learned_addr learned my addr 172.21.15.98:0/1888946256 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510a59c700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 0x7f510c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510ad9d700 1 --2- 172.21.15.98:0/1888946256 >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 0x7f510c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 -- 172.21.15.98:0/1888946256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 msgr2=0x7f510c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 0x7f510c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 -- 172.21.15.98:0/1888946256 >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 msgr2=0x7f510c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:05.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 --2- 172.21.15.98:0/1888946256 >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 0x7f510c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 -- 172.21.15.98:0/1888946256 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0bffa0 con 0x7f510c0c5a90 2023-08-22T00:06:05.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510a59c700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 0x7f510c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510ad9d700 1 --2- 172.21.15.98:0/1888946256 >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 0x7f510c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f5109d9b700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c0c5a90 0x7f510c0c5f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f510c0c6bd0 tx=0x7f51000090f0).ready entity=mon.0 client_cookie=71deb619e191ae90 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510959a700 1 -- 172.21.15.98:0/1888946256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000b600 con 0x7f510c0c5a90 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.234+0000 7f510959a700 1 -- 172.21.15.98:0/1888946256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510000b760 con 0x7f510c0c5a90 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f510959a700 1 -- 172.21.15.98:0/1888946256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000bae0 con 0x7f510c0c5a90 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 -- 172.21.15.98:0/1888946256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c0c5a90 msgr2=0x7f510c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c0c5a90 0x7f510c0c5f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f510c0c6bd0 tx=0x7f51000090f0).stop 2023-08-22T00:06:05.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 -- 172.21.15.98:0/1888946256 shutdown_connections 2023-08-22T00:06:05.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c14e0d0 0x7f510c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 --2- 172.21.15.98:0/1888946256 >> v2:172.21.15.118:3300/0 conn(0x7f510c1544f0 0x7f510c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 --2- 172.21.15.98:0/1888946256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c0c5a90 0x7f510c0c5f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 -- 172.21.15.98:0/1888946256 >> 172.21.15.98:0/1888946256 conn(0x7f510c0caa80 msgr2=0x7f510c0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 -- 172.21.15.98:0/1888946256 shutdown_connections 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.235+0000 7f51109a3700 1 -- 172.21.15.98:0/1888946256 wait complete. 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.236+0000 7f51109a3700 1 Processor -- start 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.236+0000 7f51109a3700 1 -- start start 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f510c0c5a90 0x7f510c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c1544f0 0x7f510c163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0aeb70 con 0x7f510c14e0d0 2023-08-22T00:06:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c4510 con 0x7f510c0c5a90 2023-08-22T00:06:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f51109a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0aee10 con 0x7f510c1544f0 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54058/0 (socket says 172.21.15.98:54058) 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 -- 172.21.15.98:0/3931781576 learned_addr learned my addr 172.21.15.98:0/3931781576 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f510ad9d700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c1544f0 0x7f510c163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f510a59c700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f510c0c5a90 0x7f510c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 -- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c1544f0 msgr2=0x7f510c163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c1544f0 0x7f510c163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 -- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f510c0c5a90 msgr2=0x7f510c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f510c0c5a90 0x7f510c152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 -- 172.21.15.98:0/3931781576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100009370 con 0x7f510c14e0d0 2023-08-22T00:06:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.237+0000 7f5109d9b700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f510c0ca9e0 tx=0x7f5100017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.238+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000b8d0 con 0x7f510c14e0d0 2023-08-22T00:06:05.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.238+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510000ba30 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.238+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c1517c0 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.238+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510001c670 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.238+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c0c3f50 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.239+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c151cf0 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.239+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f510001ca20 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.239+0000 7f50fa7fc700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 0x7f50ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.239+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f510007b2e0 con 0x7f510c14e0d0 2023-08-22T00:06:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.239+0000 7f510a59c700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 0x7f50ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.240+0000 7f510a59c700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 0x7f50ec0612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f50fc00abd0 tx=0x7f50fc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.243+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f510004caa0 con 0x7f510c14e0d0 2023-08-22T00:06:05.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.446+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f510c047480 con 0x7f510c14e0d0 2023-08-22T00:06:05.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.446+0000 7f50fa7fc700 1 -- 172.21.15.98:0/3931781576 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f5100020090 con 0x7f510c14e0d0 2023-08-22T00:06:05.448 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:05.449 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 msgr2=0x7f50ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 0x7f50ec0612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f50fc00abd0 tx=0x7f50fc008040).stop 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 msgr2=0x7f510c0c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f510c0ca9e0 tx=0x7f5100017000).stop 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 shutdown_connections 2023-08-22T00:06:05.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f50ec05ee10 0x7f50ec0612d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f510c1544f0 0x7f510c163ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f510c0c5a90 0x7f510c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 --2- 172.21.15.98:0/3931781576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f510c14e0d0 0x7f510c0c34a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 >> 172.21.15.98:0/3931781576 conn(0x7f510c0caa80 msgr2=0x7f510c062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 shutdown_connections 2023-08-22T00:06:05.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.448+0000 7f51109a3700 1 -- 172.21.15.98:0/3931781576 wait complete. 2023-08-22T00:06:05.454 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 3 2023-08-22T00:06:05.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:05.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.582+0000 7f51f1883700 1 Processor -- start 2023-08-22T00:06:05.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 -- start start 2023-08-22T00:06:05.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f51ec0a8d30 0x7f51ec1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51ec0a9110 0x7f51ec0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0aa7a0 0x7f51ec0aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0c2fb0 con 0x7f51ec0a8d30 2023-08-22T00:06:05.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec154b30 con 0x7f51ec0a9110 2023-08-22T00:06:05.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51f1883700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec154e10 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.583+0000 7f51eaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f51ec0a8d30 0x7f51ec1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f51ec0a8d30 0x7f51ec1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54072/0 (socket says 172.21.15.98:54072) 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 -- 172.21.15.98:0/1113268394 learned_addr learned my addr 172.21.15.98:0/1113268394 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eb7fe700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0aa7a0 0x7f51ec0aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51ea7fc700 1 --2- 172.21.15.98:0/1113268394 >> v2:172.21.15.118:3300/0 conn(0x7f51ec0a9110 0x7f51ec0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 -- 172.21.15.98:0/1113268394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0aa7a0 msgr2=0x7f51ec0aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0aa7a0 0x7f51ec0aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 -- 172.21.15.98:0/1113268394 >> v2:172.21.15.118:3300/0 conn(0x7f51ec0a9110 msgr2=0x7f51ec0c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 --2- 172.21.15.98:0/1113268394 >> v2:172.21.15.118:3300/0 conn(0x7f51ec0a9110 0x7f51ec0c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 -- 172.21.15.98:0/1113268394 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec1550f0 con 0x7f51ec0a8d30 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51eaffd700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0a8d30 0x7f51ec1544e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f51ec157a10 tx=0x7f51dc0090f0).ready entity=mon.0 client_cookie=edec03a98c1c91ae server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51e9ffb700 1 -- 172.21.15.98:0/1113268394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00b600 con 0x7f51ec0a8d30 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51e9ffb700 1 -- 172.21.15.98:0/1113268394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc00b760 con 0x7f51ec0a8d30 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51e9ffb700 1 -- 172.21.15.98:0/1113268394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00bb00 con 0x7f51ec0a8d30 2023-08-22T00:06:05.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51f1883700 1 -- 172.21.15.98:0/1113268394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0a8d30 msgr2=0x7f51ec1544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51f1883700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0a8d30 0x7f51ec1544e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f51ec157a10 tx=0x7f51dc0090f0).stop 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51f1883700 1 -- 172.21.15.98:0/1113268394 shutdown_connections 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51f1883700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0aa7a0 0x7f51ec0aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.584+0000 7f51f1883700 1 --2- 172.21.15.98:0/1113268394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0a8d30 0x7f51ec1544e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.585+0000 7f51f1883700 1 --2- 172.21.15.98:0/1113268394 >> v2:172.21.15.118:3300/0 conn(0x7f51ec0a9110 0x7f51ec0c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.585+0000 7f51f1883700 1 -- 172.21.15.98:0/1113268394 >> 172.21.15.98:0/1113268394 conn(0x7f51ec0c5320 msgr2=0x7f51ec0c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.585+0000 7f51f1883700 1 -- 172.21.15.98:0/1113268394 shutdown_connections 2023-08-22T00:06:05.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.585+0000 7f51f1883700 1 -- 172.21.15.98:0/1113268394 wait complete. 2023-08-22T00:06:05.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.586+0000 7f51f1883700 1 Processor -- start 2023-08-22T00:06:05.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.586+0000 7f51f1883700 1 -- start start 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec0a8d30 0x7f51ec0c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0a9110 0x7f51ec0c0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0ab830 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c1300 con 0x7f51ec0a8d30 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c15e0 con 0x7f51ec0a9110 2023-08-22T00:06:05.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54082/0 (socket says 172.21.15.98:54082) 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 -- 172.21.15.98:0/2108536841 learned_addr learned my addr 172.21.15.98:0/2108536841 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eaffd700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec0a8d30 0x7f51ec0c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51ea7fc700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0a9110 0x7f51ec0c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 -- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0a9110 msgr2=0x7f51ec0c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0a9110 0x7f51ec0c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 -- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec0a8d30 msgr2=0x7f51ec0c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec0a8d30 0x7f51ec0c2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 -- 172.21.15.98:0/2108536841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009370 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51eb7fe700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f51e4009fa0 tx=0x7f51e4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400ed20 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400ee80 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0abaf0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4014610 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.587+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0653c0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.588+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec047480 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.589+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f51e401d3b0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.589+0000 7f51d2ffd700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 0x7f51d80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.589+0000 7f51eaffd700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 0x7f51d80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.589+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f51e407a050 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.589+0000 7f51eaffd700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 0x7f51d80612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f51dc00b3c0 tx=0x7f51dc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.593+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f51e404b7b0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.755+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ec1553d0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.756+0000 7f51d2ffd700 1 -- 172.21.15.98:0/2108536841 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13805 (secure 0 0 0) 0x7f51e404edd0 con 0x7f51ec0aa7a0 2023-08-22T00:06:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:05.758 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":18,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:05.125583+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 msgr2=0x7f51d80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 0x7f51d80612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f51dc00b3c0 tx=0x7f51dc017000).stop 2023-08-22T00:06:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 msgr2=0x7f51ec0c0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f51e4009fa0 tx=0x7f51e4009900).stop 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 shutdown_connections 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51ec0aa7a0 0x7f51ec0c0d20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec0a8d30 0x7f51ec0c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f51d805ee10 0x7f51d80612d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 --2- 172.21.15.98:0/2108536841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec0a9110 0x7f51ec0c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 >> 172.21.15.98:0/2108536841 conn(0x7f51ec0c5320 msgr2=0x7f51ec151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 shutdown_connections 2023-08-22T00:06:05.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.758+0000 7f51f1883700 1 -- 172.21.15.98:0/2108536841 wait complete. 2023-08-22T00:06:05.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:06:05.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:05.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.890+0000 7fa5c103e700 1 Processor -- start 2023-08-22T00:06:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.890+0000 7fa5c103e700 1 -- start start 2023-08-22T00:06:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5c103e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa5bc0675f0 0x7fa5bc0a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5c103e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc1525d0 con 0x7fa5bc0c39d0 2023-08-22T00:06:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5c103e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc152b80 con 0x7fa5bc14fd90 2023-08-22T00:06:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5c103e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc067bd0 con 0x7fa5bc0675f0 2023-08-22T00:06:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5ba59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa5bc0675f0 0x7fa5bc0a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5bb59e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa5bc0c39d0 0x7fa5bc0c3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54198/0 (socket says 172.21.15.98:54198) 2023-08-22T00:06:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5bb59e700 1 -- 172.21.15.98:0/2656415051 learned_addr learned my addr 172.21.15.98:0/2656415051 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5ba59c700 1 -- 172.21.15.98:0/2656415051 >> v1:172.21.15.118:6789/0 conn(0x7fa5bc14fd90 legacy=0x7fa5bc153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5ba59c700 1 -- 172.21.15.98:0/2656415051 >> v1:172.21.15.98:6789/0 conn(0x7fa5bc0c39d0 legacy=0x7fa5bc0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5b9d9b700 1 -- 172.21.15.98:0/2656415051 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710086596 0 0) 0x7fa5b4001490 con 0x7fa5bc0c39d0 2023-08-22T00:06:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5ba59c700 1 -- 172.21.15.98:0/2656415051 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc067eb0 con 0x7fa5bc0675f0 2023-08-22T00:06:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5ba59c700 1 --2- 172.21.15.98:0/2656415051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0a7c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa5b0009760 tx=0x7fa5b0009060).ready entity=mon.0 client_cookie=86751264c6431403 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5b9d9b700 1 -- 172.21.15.98:0/2656415051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0009120 con 0x7fa5bc0675f0 2023-08-22T00:06:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5b9d9b700 1 -- 172.21.15.98:0/2656415051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000b580 con 0x7fa5bc0675f0 2023-08-22T00:06:05.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.891+0000 7fa5b9d9b700 1 -- 172.21.15.98:0/2656415051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000b900 con 0x7fa5bc0675f0 2023-08-22T00:06:05.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 -- 172.21.15.98:0/2656415051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc0675f0 msgr2=0x7fa5bc0a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 --2- 172.21.15.98:0/2656415051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0a7c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa5b0009760 tx=0x7fa5b0009060).stop 2023-08-22T00:06:05.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 -- 172.21.15.98:0/2656415051 shutdown_connections 2023-08-22T00:06:05.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 --2- 172.21.15.98:0/2656415051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0a7c10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 -- 172.21.15.98:0/2656415051 >> 172.21.15.98:0/2656415051 conn(0x7fa5bc0c8950 msgr2=0x7fa5bc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:05.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 -- 172.21.15.98:0/2656415051 shutdown_connections 2023-08-22T00:06:05.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.892+0000 7fa5c103e700 1 -- 172.21.15.98:0/2656415051 wait complete. 2023-08-22T00:06:05.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.893+0000 7fa5c103e700 1 Processor -- start 2023-08-22T00:06:05.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.893+0000 7fa5c103e700 1 -- start start 2023-08-22T00:06:05.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5bc0c39d0 0x7fa5bc13e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc14c280 con 0x7fa5bc14fd90 2023-08-22T00:06:05.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc14c560 con 0x7fa5bc0675f0 2023-08-22T00:06:05.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5c103e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc13eb10 con 0x7fa5bc0c39d0 2023-08-22T00:06:05.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5bb59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5bb59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54108/0 (socket says 172.21.15.98:54108) 2023-08-22T00:06:05.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5bb59e700 1 -- 172.21.15.98:0/3313728113 learned_addr learned my addr 172.21.15.98:0/3313728113 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:05.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5ba59c700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5bc0c39d0 0x7fa5bc13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.894+0000 7fa5bad9d700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 -- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5bc0c39d0 msgr2=0x7fa5bc13e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5bc0c39d0 0x7fa5bc13e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 -- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5bc0675f0 msgr2=0x7fa5bc0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:05.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:05.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 -- 172.21.15.98:0/3313728113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00092a0 con 0x7fa5bc14fd90 2023-08-22T00:06:05.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5bb59e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa5b400c810 tx=0x7fa5b4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4005d30 con 0x7fa5bc14fd90 2023-08-22T00:06:05.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4005e90 con 0x7fa5bc14fd90 2023-08-22T00:06:05.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0c0b20 con 0x7fa5bc14fd90 2023-08-22T00:06:05.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4007320 con 0x7fa5bc14fd90 2023-08-22T00:06:05.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.895+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0c10e0 con 0x7fa5bc14fd90 2023-08-22T00:06:05.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.896+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc14c6d0 con 0x7fa5bc14fd90 2023-08-22T00:06:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.896+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa5b4007710 con 0x7fa5bc14fd90 2023-08-22T00:06:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.897+0000 7fa5a2ffd700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 0x7fa5a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.897+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa5b40797d0 con 0x7fa5bc14fd90 2023-08-22T00:06:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.897+0000 7fa5bad9d700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 0x7fa5a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.897+0000 7fa5bad9d700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 0x7fa5a80612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa5ac003940 tx=0x7fa5ac007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:05.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:05.901+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5b404af90 con 0x7fa5bc14fd90 2023-08-22T00:06:06.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.062+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa5bc1525d0 con 0x7fa5bc14fd90 2023-08-22T00:06:06.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.062+0000 7fa5a2ffd700 1 -- 172.21.15.98:0/3313728113 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa5bc1525d0 con 0x7fa5bc14fd90 2023-08-22T00:06:06.064 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:06.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 msgr2=0x7fa5a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 0x7fa5a80612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa5ac003940 tx=0x7fa5ac007d20).stop 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 msgr2=0x7fa5bc14c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa5b400c810 tx=0x7fa5b4007d90).stop 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 shutdown_connections 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5bc14fd90 0x7fa5bc14c9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5bc0675f0 0x7fa5bc0c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5a805ee10 0x7fa5a80612d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 --2- 172.21.15.98:0/3313728113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5bc0c39d0 0x7fa5bc13e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 >> 172.21.15.98:0/3313728113 conn(0x7fa5bc0c8950 msgr2=0x7fa5bc0c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 shutdown_connections 2023-08-22T00:06:06.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.064+0000 7fa5c103e700 1 -- 172.21.15.98:0/3313728113 wait complete. 2023-08-22T00:06:06.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:06.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.195+0000 7f5861e34700 1 Processor -- start 2023-08-22T00:06:06.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.195+0000 7f5861e34700 1 -- start start 2023-08-22T00:06:06.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f5861e34700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f585c066150 0x7f585c066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f5861e34700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f585c157890 0x7f585c0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f5861e34700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0c69b0 con 0x7f585c0c5360 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f5861e34700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c1542c0 con 0x7f585c157890 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f5861e34700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0c57f0 con 0x7f585c066150 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f585c157890 0x7f585c0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f585c157890 0x7f585c0c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54122/0 (socket says 172.21.15.98:54122) 2023-08-22T00:06:06.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 -- 172.21.15.98:0/879828286 learned_addr learned my addr 172.21.15.98:0/879828286 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585affd700 1 --1- 172.21.15.98:0/879828286 >> v1:172.21.15.98:6789/0 conn(0x7f585c0c5360 0x7f585c0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54204/0 (socket says 172.21.15.98:54204) 2023-08-22T00:06:06.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585b7fe700 1 --2- 172.21.15.98:0/879828286 >> v2:172.21.15.118:3300/0 conn(0x7f585c066150 0x7f585c066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 -- 172.21.15.98:0/879828286 >> v2:172.21.15.118:3300/0 conn(0x7f585c066150 msgr2=0x7f585c066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 --2- 172.21.15.98:0/879828286 >> v2:172.21.15.118:3300/0 conn(0x7f585c066150 0x7f585c066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 -- 172.21.15.98:0/879828286 >> v1:172.21.15.98:6789/0 conn(0x7f585c0c5360 legacy=0x7f585c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 -- 172.21.15.98:0/879828286 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0c5ad0 con 0x7f585c157890 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585a7fc700 1 -- 172.21.15.98:0/879828286 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263274731 0 0) 0x7f585c0c69b0 con 0x7f585c0c5360 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585bfff700 1 --2- 172.21.15.98:0/879828286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0c33f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f585c06b600 tx=0x7f5854009840).ready entity=mon.0 client_cookie=7130d871b6e261a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.196+0000 7f585a7fc700 1 -- 172.21.15.98:0/879828286 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400e070 con 0x7f585c157890 2023-08-22T00:06:06.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f585a7fc700 1 -- 172.21.15.98:0/879828286 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585400ba50 con 0x7f585c157890 2023-08-22T00:06:06.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f585a7fc700 1 -- 172.21.15.98:0/879828286 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400bdd0 con 0x7f585c157890 2023-08-22T00:06:06.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 -- 172.21.15.98:0/879828286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 msgr2=0x7f585c0c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 --2- 172.21.15.98:0/879828286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0c33f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f585c06b600 tx=0x7f5854009840).stop 2023-08-22T00:06:06.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 -- 172.21.15.98:0/879828286 shutdown_connections 2023-08-22T00:06:06.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 --2- 172.21.15.98:0/879828286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0c33f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 --2- 172.21.15.98:0/879828286 >> v2:172.21.15.118:3300/0 conn(0x7f585c066150 0x7f585c066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 -- 172.21.15.98:0/879828286 >> 172.21.15.98:0/879828286 conn(0x7f585c0c7800 msgr2=0x7f585c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 -- 172.21.15.98:0/879828286 shutdown_connections 2023-08-22T00:06:06.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.197+0000 7f5861e34700 1 -- 172.21.15.98:0/879828286 wait complete. 2023-08-22T00:06:06.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.198+0000 7f5861e34700 1 Processor -- start 2023-08-22T00:06:06.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.198+0000 7f5861e34700 1 -- start start 2023-08-22T00:06:06.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f585c066150 0x7f585c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f585c156af0 0x7f585c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ab480 con 0x7f585c157890 2023-08-22T00:06:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c167c80 con 0x7f585c156af0 2023-08-22T00:06:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f5861e34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c164fe0 con 0x7f585c066150 2023-08-22T00:06:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f585affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f585affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54130/0 (socket says 172.21.15.98:54130) 2023-08-22T00:06:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f585affd700 1 -- 172.21.15.98:0/1640094520 learned_addr learned my addr 172.21.15.98:0/1640094520 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f585b7fe700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f585c066150 0x7f585c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.199+0000 7f585bfff700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f585c156af0 0x7f585c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 -- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f585c066150 msgr2=0x7f585c156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f585c066150 0x7f585c156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 -- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f585c156af0 msgr2=0x7f585c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f585c156af0 0x7f585c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 -- 172.21.15.98:0/1640094520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5854009ae0 con 0x7f585c157890 2023-08-22T00:06:06.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f585affd700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f584c00c4e0 tx=0x7f584c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00ce50 con 0x7f585c157890 2023-08-22T00:06:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c0072e0 con 0x7f585c157890 2023-08-22T00:06:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c1652c0 con 0x7f585c157890 2023-08-22T00:06:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0056e0 con 0x7f585c157890 2023-08-22T00:06:06.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.200+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c0ab110 con 0x7f585c157890 2023-08-22T00:06:06.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.201+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c065810 con 0x7f585c157890 2023-08-22T00:06:06.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.201+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f584c005ad0 con 0x7f585c157890 2023-08-22T00:06:06.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.202+0000 7f58437fe700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 0x7f58480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.202+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f584c079120 con 0x7f585c157890 2023-08-22T00:06:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.202+0000 7f585b7fe700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 0x7f58480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.202+0000 7f585b7fe700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 0x7f58480612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f585000ab10 tx=0x7f5850008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.206+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f584c04a8e0 con 0x7f585c157890 2023-08-22T00:06:06.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.367+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f585c0c5db0 con 0x7f585c157890 2023-08-22T00:06:06.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.367+0000 7f58437fe700 1 -- 172.21.15.98:0/1640094520 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f584c04df00 con 0x7f585c157890 2023-08-22T00:06:06.370 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:06.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 msgr2=0x7f58480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 0x7f58480612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f585000ab10 tx=0x7f5850008040).stop 2023-08-22T00:06:06.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 msgr2=0x7f585c0ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f584c00c4e0 tx=0x7f584c007c60).stop 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 shutdown_connections 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f584805ee10 0x7f58480612d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f585c066150 0x7f585c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f585c156af0 0x7f585c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 --2- 172.21.15.98:0/1640094520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c157890 0x7f585c0ab910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 >> 172.21.15.98:0/1640094520 conn(0x7f585c0c7800 msgr2=0x7f585c0bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 shutdown_connections 2023-08-22T00:06:06.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.369+0000 7f5861e34700 1 -- 172.21.15.98:0/1640094520 wait complete. 2023-08-22T00:06:06.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:06:06.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.496+0000 7fe7a1826700 1 Processor -- start 2023-08-22T00:06:06.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 -- start start 2023-08-22T00:06:06.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe79c0a4db0 0x7fe79c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe79c1583a0 0x7fe79c0bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c0c6a80 con 0x7fe79c157ad0 2023-08-22T00:06:06.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0c2150 con 0x7fe79c1583a0 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.497+0000 7fe7a1826700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0c5e70 con 0x7fe79c0a4db0 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe79c1583a0 0x7fe79c0bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe79c1583a0 0x7fe79c0bbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54146/0 (socket says 172.21.15.98:54146) 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 -- 172.21.15.98:0/838844048 learned_addr learned my addr 172.21.15.98:0/838844048 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79a7fc700 1 --2- 172.21.15.98:0/838844048 >> v2:172.21.15.118:3300/0 conn(0x7fe79c0a4db0 0x7fe79c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 -- 172.21.15.98:0/838844048 >> v2:172.21.15.118:3300/0 conn(0x7fe79c0a4db0 msgr2=0x7fe79c157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 --2- 172.21.15.98:0/838844048 >> v2:172.21.15.118:3300/0 conn(0x7fe79c0a4db0 0x7fe79c157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 -- 172.21.15.98:0/838844048 >> v1:172.21.15.118:6789/0 conn(0x7fe79c157ad0 legacy=0x7fe79c0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 -- 172.21.15.98:0/838844048 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c0c6150 con 0x7fe79c1583a0 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe79b7fe700 1 --2- 172.21.15.98:0/838844048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c1583a0 0x7fe79c0bbe50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe79c069140 tx=0x7fe794009840).ready entity=mon.0 client_cookie=b4c2878acb9a15c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe799ffb700 1 -- 172.21.15.98:0/838844048 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400e070 con 0x7fe79c1583a0 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe799ffb700 1 -- 172.21.15.98:0/838844048 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400bae0 con 0x7fe79c1583a0 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.498+0000 7fe799ffb700 1 -- 172.21.15.98:0/838844048 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400be60 con 0x7fe79c1583a0 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 -- 172.21.15.98:0/838844048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c1583a0 msgr2=0x7fe79c0bbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 --2- 172.21.15.98:0/838844048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c1583a0 0x7fe79c0bbe50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe79c069140 tx=0x7fe794009840).stop 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 -- 172.21.15.98:0/838844048 shutdown_connections 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 --2- 172.21.15.98:0/838844048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c1583a0 0x7fe79c0bbe50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 --2- 172.21.15.98:0/838844048 >> v2:172.21.15.118:3300/0 conn(0x7fe79c0a4db0 0x7fe79c157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 -- 172.21.15.98:0/838844048 >> 172.21.15.98:0/838844048 conn(0x7fe79c0c3990 msgr2=0x7fe79c0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 -- 172.21.15.98:0/838844048 shutdown_connections 2023-08-22T00:06:06.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.499+0000 7fe7a1826700 1 -- 172.21.15.98:0/838844048 wait complete. 2023-08-22T00:06:06.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.500+0000 7fe7a1826700 1 Processor -- start 2023-08-22T00:06:06.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.500+0000 7fe7a1826700 1 -- start start 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe79c157ad0 0x7fe79c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79c1583a0 0x7fe79c063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0accf0 con 0x7fe79c0a4db0 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0ab350 con 0x7fe79c1583a0 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0aa740 con 0x7fe79c157ad0 2023-08-22T00:06:06.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54150/0 (socket says 172.21.15.98:54150) 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 -- 172.21.15.98:0/3541662841 learned_addr learned my addr 172.21.15.98:0/3541662841 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79a7fc700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe79c157ad0 0x7fe79c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79b7fe700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79c1583a0 0x7fe79c063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 -- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe79c157ad0 msgr2=0x7fe79c1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe79c157ad0 0x7fe79c1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 -- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79c1583a0 msgr2=0x7fe79c063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79c1583a0 0x7fe79c063710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 -- 172.21.15.98:0/3541662841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009ae0 con 0x7fe79c0a4db0 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe79affd700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe78c00c440 tx=0x7fe78c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00f470 con 0x7fe79c0a4db0 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00f5d0 con 0x7fe79c0a4db0 2023-08-22T00:06:06.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c0aaa20 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00f970 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.501+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c0aafe0 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.502+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c0ab630 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.503+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe78c01b3b0 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.503+0000 7fe782ffd700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 0x7fe7880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.503+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe78c079390 con 0x7fe79c0a4db0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.503+0000 7fe79a7fc700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 0x7fe7880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.504+0000 7fe79a7fc700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 0x7fe7880612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe79c154020 tx=0x7fe790008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.507+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe78c04ac40 con 0x7fe79c0a4db0 2023-08-22T00:06:06.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.670+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe79c047480 con 0x7fe79c0a4db0 2023-08-22T00:06:06.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.671+0000 7fe782ffd700 1 -- 172.21.15.98:0/3541662841 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe78c017020 con 0x7fe79c0a4db0 2023-08-22T00:06:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:06.673 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:06:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:06:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:06:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:06:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:06:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:06:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:06:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:06:06.675 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:06:06.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 msgr2=0x7fe7880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 0x7fe7880612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe79c154020 tx=0x7fe790008040).stop 2023-08-22T00:06:06.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 msgr2=0x7fe79c0a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe78c00c440 tx=0x7fe78c007dc0).stop 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 shutdown_connections 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79c1583a0 0x7fe79c063710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe79c0a4db0 0x7fe79c0a6a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78805ee10 0x7fe7880612d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 --2- 172.21.15.98:0/3541662841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe79c157ad0 0x7fe79c1528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 >> 172.21.15.98:0/3541662841 conn(0x7fe79c0c3990 msgr2=0x7fe79c156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 shutdown_connections 2023-08-22T00:06:06.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.673+0000 7fe7a1826700 1 -- 172.21.15.98:0/3541662841 wait complete. 2023-08-22T00:06:06.688 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:06:06.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:06:06.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.807+0000 7f5b44d69700 1 Processor -- start 2023-08-22T00:06:06.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.807+0000 7f5b44d69700 1 -- start start 2023-08-22T00:06:06.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.808+0000 7f5b44d69700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.808+0000 7f5b44d69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 0x7f5b400a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.808+0000 7f5b44d69700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b400a8c70 con 0x7f5b40069210 2023-08-22T00:06:06.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.808+0000 7f5b44d69700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b400a86f0 con 0x7f5b40154f60 2023-08-22T00:06:06.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.808+0000 7f5b44d69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b40068210 con 0x7f5b40067600 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 0x7f5b400a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:41830/0 (socket says 172.21.15.98:41830) 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3e59c700 1 -- 172.21.15.98:0/1448585353 learned_addr learned my addr 172.21.15.98:0/1448585353 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/1448585353 >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 msgr2=0x7f5b40068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 --2- 172.21.15.98:0/1448585353 >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/1448585353 >> v1:172.21.15.118:6789/0 conn(0x7f5b40069210 legacy=0x7f5b40066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/1448585353 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40069690 con 0x7f5b40067600 2023-08-22T00:06:06.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3e59c700 1 --2- 172.21.15.98:0/1448585353 >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:06.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3ed9d700 1 --2- 172.21.15.98:0/1448585353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 0x7f5b400a9100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f5b38009e60 tx=0x7f5b38009780).ready entity=mon.2 client_cookie=eb2cf8937e371881 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3d59a700 1 -- 172.21.15.98:0/1448585353 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800e070 con 0x7f5b40067600 2023-08-22T00:06:06.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3d59a700 1 -- 172.21.15.98:0/1448585353 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3800bb60 con 0x7f5b40067600 2023-08-22T00:06:06.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.809+0000 7f5b3d59a700 1 -- 172.21.15.98:0/1448585353 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38012410 con 0x7f5b40067600 2023-08-22T00:06:06.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 -- 172.21.15.98:0/1448585353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 msgr2=0x7f5b400a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 --2- 172.21.15.98:0/1448585353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 0x7f5b400a9100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f5b38009e60 tx=0x7f5b38009780).stop 2023-08-22T00:06:06.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 -- 172.21.15.98:0/1448585353 shutdown_connections 2023-08-22T00:06:06.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 --2- 172.21.15.98:0/1448585353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40067600 0x7f5b400a9100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 --2- 172.21.15.98:0/1448585353 >> v2:172.21.15.118:3300/0 conn(0x7f5b40154f60 0x7f5b40068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 -- 172.21.15.98:0/1448585353 >> 172.21.15.98:0/1448585353 conn(0x7f5b400c5dd0 msgr2=0x7f5b40068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 -- 172.21.15.98:0/1448585353 shutdown_connections 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.810+0000 7f5b44d69700 1 -- 172.21.15.98:0/1448585353 wait complete. 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.811+0000 7f5b44d69700 1 Processor -- start 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.811+0000 7f5b44d69700 1 -- start start 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b40067600 0x7f5b401533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40069210 0x7f5b400ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b401538e0 con 0x7f5b40154f60 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400adbd0 con 0x7f5b40067600 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400ac640 con 0x7f5b40069210 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54160/0 (socket says 172.21.15.98:54160) 2023-08-22T00:06:06.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/3545525616 learned_addr learned my addr 172.21.15.98:0/3545525616 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3dd9b700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40069210 0x7f5b400ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3e59c700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b40067600 0x7f5b401533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40069210 msgr2=0x7f5b400ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40069210 0x7f5b400ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b40067600 msgr2=0x7f5b401533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b40067600 0x7f5b401533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 -- 172.21.15.98:0/3545525616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009370 con 0x7f5b40154f60 2023-08-22T00:06:06.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b3ed9d700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5b3800b6c0 tx=0x7f5b38009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38012410 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3801d630 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b38009a20 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3801d9f0 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.812+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b400acc00 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.813+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b400ad530 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.814+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5b38003040 con 0x7f5b40154f60 2023-08-22T00:06:06.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.814+0000 7f5b367fc700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 0x7f5b200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:06.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.814+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5b3807c380 con 0x7f5b40154f60 2023-08-22T00:06:06.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.814+0000 7f5b3e59c700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 0x7f5b200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:06.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.815+0000 7f5b3e59c700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 0x7f5b200612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5b28009340 tx=0x7f5b28008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:06.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.818+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b3804da80 con 0x7f5b40154f60 2023-08-22T00:06:06.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:06.979+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5b40047480 con 0x7f5b40154f60 2023-08-22T00:06:07.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.266+0000 7f5b367fc700 1 -- 172.21.15.98:0/3545525616 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5b380510a0 con 0x7f5b40154f60 2023-08-22T00:06:07.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.269+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 msgr2=0x7f5b200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.269+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 0x7f5b200612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5b28009340 tx=0x7f5b28008040).stop 2023-08-22T00:06:07.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 msgr2=0x7f5b401587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5b3800b6c0 tx=0x7f5b38009780).stop 2023-08-22T00:06:07.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 shutdown_connections 2023-08-22T00:06:07.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40154f60 0x7f5b401587f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b40067600 0x7f5b401533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2005ee10 0x7f5b200612d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 --2- 172.21.15.98:0/3545525616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b40069210 0x7f5b400ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 >> 172.21.15.98:0/3545525616 conn(0x7f5b400c5dd0 msgr2=0x7f5b400c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:07.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 shutdown_connections 2023-08-22T00:06:07.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.270+0000 7f5b44d69700 1 -- 172.21.15.98:0/3545525616 wait complete. 2023-08-22T00:06:07.273 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:06:07.286 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-22T00:06:07.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.407+0000 7fda53f51700 1 Processor -- start 2023-08-22T00:06:07.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.407+0000 7fda53f51700 1 -- start start 2023-08-22T00:06:07.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.408+0000 7fda53f51700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 0x7fda4c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.408+0000 7fda53f51700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.408+0000 7fda53f51700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4c1541c0 con 0x7fda4c062600 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.408+0000 7fda53f51700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c0ca860 con 0x7fda4c157ab0 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.408+0000 7fda53f51700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c063fc0 con 0x7fda4c063b10 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda51ced700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 0x7fda4c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:34322/0 (socket says 172.21.15.98:34322) 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 -- 172.21.15.98:0/516737599 learned_addr learned my addr 172.21.15.98:0/516737599 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:07.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda51ced700 1 --2- 172.21.15.98:0/516737599 >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 0x7fda4c157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:41860/0 (socket says 172.21.15.98:41860) 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda514ec700 1 --1- 172.21.15.98:0/516737599 >> v1:172.21.15.118:6789/0 conn(0x7fda4c062600 0x7fda4c0ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:38658/0 (socket says 172.21.15.98:38658) 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 -- 172.21.15.98:0/516737599 >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 msgr2=0x7fda4c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 --2- 172.21.15.98:0/516737599 >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 0x7fda4c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 -- 172.21.15.98:0/516737599 >> v1:172.21.15.118:6789/0 conn(0x7fda4c062600 legacy=0x7fda4c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 -- 172.21.15.98:0/516737599 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c062a90 con 0x7fda4c063b10 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda524ee700 1 --2- 172.21.15.98:0/516737599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fda44009f20 tx=0x7fda44009840).ready entity=mon.2 client_cookie=ed029bb35871a1a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:07.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda50ceb700 1 -- 172.21.15.98:0/516737599 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400e070 con 0x7fda4c063b10 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda50ceb700 1 -- 172.21.15.98:0/516737599 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4400b9d0 con 0x7fda4c063b10 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.409+0000 7fda50ceb700 1 -- 172.21.15.98:0/516737599 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400bd50 con 0x7fda4c063b10 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 -- 172.21.15.98:0/516737599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 msgr2=0x7fda4c0acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 --2- 172.21.15.98:0/516737599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fda44009f20 tx=0x7fda44009840).stop 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 -- 172.21.15.98:0/516737599 shutdown_connections 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 --2- 172.21.15.98:0/516737599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c0acbf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 --2- 172.21.15.98:0/516737599 >> v2:172.21.15.118:3300/0 conn(0x7fda4c157ab0 0x7fda4c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 -- 172.21.15.98:0/516737599 >> 172.21.15.98:0/516737599 conn(0x7fda4c0cb600 msgr2=0x7fda4c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:07.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 -- 172.21.15.98:0/516737599 shutdown_connections 2023-08-22T00:06:07.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.410+0000 7fda53f51700 1 -- 172.21.15.98:0/516737599 wait complete. 2023-08-22T00:06:07.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.411+0000 7fda53f51700 1 Processor -- start 2023-08-22T00:06:07.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.411+0000 7fda53f51700 1 -- start start 2023-08-22T00:06:07.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda4c157ab0 0x7fda4c0ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c14ad90 con 0x7fda4c0abe30 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0ac2b0 con 0x7fda4c157ab0 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0ac520 con 0x7fda4c063b10 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54168/0 (socket says 172.21.15.98:54168) 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 -- 172.21.15.98:0/3159962578 learned_addr learned my addr 172.21.15.98:0/3159962578 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:07.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda51ced700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda514ec700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda4c157ab0 0x7fda4c0ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 -- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 msgr2=0x7fda4c14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 -- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda4c157ab0 msgr2=0x7fda4c0ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda4c157ab0 0x7fda4c0ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 -- 172.21.15.98:0/3159962578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44009ae0 con 0x7fda4c0abe30 2023-08-22T00:06:07.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda524ee700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fda4400be70 tx=0x7fda44009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440092e0 con 0x7fda4c0abe30 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4401e470 con 0x7fda4c0abe30 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.412+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4c0ac800 con 0x7fda4c0abe30 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.413+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4401e830 con 0x7fda4c0abe30 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.413+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c0acdc0 con 0x7fda4c0abe30 2023-08-22T00:06:07.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.414+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4c083670 con 0x7fda4c0abe30 2023-08-22T00:06:07.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.414+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fda44003040 con 0x7fda4c0abe30 2023-08-22T00:06:07.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.414+0000 7fda41ffb700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 0x7fda300612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:07.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.415+0000 7fda51ced700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 0x7fda300612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:07.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.415+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fda4407b070 con 0x7fda4c0abe30 2023-08-22T00:06:07.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.415+0000 7fda51ced700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 0x7fda300612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fda3c009b90 tx=0x7fda3c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:07.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.419+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda4404c770 con 0x7fda4c0abe30 2023-08-22T00:06:07.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:07.581+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fda4c062d70 con 0x7fda4c0abe30 2023-08-22T00:06:08.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.268+0000 7fda41ffb700 1 -- 172.21.15.98:0/3159962578 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fda44023030 con 0x7fda4c0abe30 2023-08-22T00:06:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.273+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 msgr2=0x7fda300612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.273+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 0x7fda300612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fda3c009b90 tx=0x7fda3c009060).stop 2023-08-22T00:06:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.273+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 msgr2=0x7fda4c0c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.273+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fda4400be70 tx=0x7fda44009840).stop 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 shutdown_connections 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda3005ee10 0x7fda300612d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda4c063b10 0x7fda4c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda4c0abe30 0x7fda4c0c07b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 --2- 172.21.15.98:0/3159962578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda4c157ab0 0x7fda4c0ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.275+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 >> 172.21.15.98:0/3159962578 conn(0x7fda4c0cb600 msgr2=0x7fda4c153600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.281+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 shutdown_connections 2023-08-22T00:06:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.282+0000 7fda53f51700 1 -- 172.21.15.98:0/3159962578 wait complete. 2023-08-22T00:06:08.299 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:06:08.307 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:06:08.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.427+0000 7f3fe530b700 1 Processor -- start 2023-08-22T00:06:08.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.427+0000 7f3fe530b700 1 -- start start 2023-08-22T00:06:08.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fe530b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3fe00acfa0 0x7f3fe0062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fe530b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 0x7f3fe0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fe530b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe0158200 con 0x7f3fe0063c80 2023-08-22T00:06:08.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fe530b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe01541c0 con 0x7f3fe00acfa0 2023-08-22T00:06:08.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fe530b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0062be0 con 0x7f3fe0157880 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3fe00acfa0 0x7f3fe0062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3fe00acfa0 0x7f3fe0062600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54184/0 (socket says 172.21.15.98:54184) 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2137177595 learned_addr learned my addr 172.21.15.98:0/2137177595 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdf7fe700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 0x7f3fe0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2137177595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 msgr2=0x7f3fe0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 0x7f3fe0157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2137177595 >> v1:172.21.15.118:6789/0 conn(0x7f3fe0063c80 legacy=0x7f3fe00ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:08.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2137177595 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0062ec0 con 0x7f3fe00acfa0 2023-08-22T00:06:08.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdf7fe700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 0x7f3fe0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:08.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fdeffd700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe00acfa0 0x7f3fe0062600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3fd0006fd0 tx=0x7f3fd00090f0).ready entity=mon.0 client_cookie=37859607e8643290 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fddffb700 1 -- 172.21.15.98:0/2137177595 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000b600 con 0x7f3fe00acfa0 2023-08-22T00:06:08.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fddffb700 1 -- 172.21.15.98:0/2137177595 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000b760 con 0x7f3fe00acfa0 2023-08-22T00:06:08.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.428+0000 7f3fddffb700 1 -- 172.21.15.98:0/2137177595 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000bae0 con 0x7f3fe00acfa0 2023-08-22T00:06:08.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 -- 172.21.15.98:0/2137177595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe00acfa0 msgr2=0x7f3fe0062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe00acfa0 0x7f3fe0062600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3fd0006fd0 tx=0x7f3fd00090f0).stop 2023-08-22T00:06:08.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 -- 172.21.15.98:0/2137177595 shutdown_connections 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe0157880 0x7f3fe0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2137177595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe00acfa0 0x7f3fe0062600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 -- 172.21.15.98:0/2137177595 >> 172.21.15.98:0/2137177595 conn(0x7f3fe00cb5e0 msgr2=0x7f3fe00c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 -- 172.21.15.98:0/2137177595 shutdown_connections 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.429+0000 7f3fe530b700 1 -- 172.21.15.98:0/2137177595 wait complete. 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.430+0000 7f3fe530b700 1 Processor -- start 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.430+0000 7f3fe530b700 1 -- start start 2023-08-22T00:06:08.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe00acfa0 0x7f3fe00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fe0157880 0x7f3fe00bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00b0190 con 0x7f3fe0063c80 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00af580 con 0x7f3fe0157880 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fe530b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00af860 con 0x7f3fe00acfa0 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54188/0 (socket says 172.21.15.98:54188) 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2032212502 learned_addr learned my addr 172.21.15.98:0/2032212502 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdf7fe700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fe0157880 0x7f3fe00bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fde7fc700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe00acfa0 0x7f3fe00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe00acfa0 msgr2=0x7f3fe00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe00acfa0 0x7f3fe00aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fe0157880 msgr2=0x7f3fe00bfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fe0157880 0x7f3fe00bfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 -- 172.21.15.98:0/2032212502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009370 con 0x7f3fe0063c80 2023-08-22T00:06:08.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fdeffd700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3fe0064260 tx=0x7f3fd0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.431+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000b8d0 con 0x7f3fe0063c80 2023-08-22T00:06:08.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.432+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000ba30 con 0x7f3fe0063c80 2023-08-22T00:06:08.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.432+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd001c670 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.432+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe00afb40 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.432+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe00a95c0 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.433+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0083350 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.433+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3fd001c9e0 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.433+0000 7f3fc6ffd700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 0x7f3fcc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.433+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f3fd007bba0 con 0x7f3fe0063c80 2023-08-22T00:06:08.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.433+0000 7f3fde7fc700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 0x7f3fcc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.434+0000 7f3fde7fc700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 0x7f3fcc0612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3fe0151b80 tx=0x7f3fd4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.438+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fd004d070 con 0x7f3fe0063c80 2023-08-22T00:06:08.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.639+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3fe00631a0 con 0x7f3fe0063c80 2023-08-22T00:06:08.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.649+0000 7f3fc6ffd700 1 -- 172.21.15.98:0/2032212502 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3fd0020070 con 0x7f3fe0063c80 2023-08-22T00:06:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 msgr2=0x7f3fcc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 0x7f3fcc0612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3fe0151b80 tx=0x7f3fd4008040).stop 2023-08-22T00:06:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 msgr2=0x7f3fe00a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3fe0064260 tx=0x7f3fd0017000).stop 2023-08-22T00:06:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 shutdown_connections 2023-08-22T00:06:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fe0157880 0x7f3fe00bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fe0063c80 0x7f3fe00a90d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fcc05ee10 0x7f3fcc0612d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 --2- 172.21.15.98:0/2032212502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fe00acfa0 0x7f3fe00aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.660+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 >> 172.21.15.98:0/2032212502 conn(0x7f3fe00cb5e0 msgr2=0x7f3fe00c1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.661+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 shutdown_connections 2023-08-22T00:06:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.661+0000 7f3fe530b700 1 -- 172.21.15.98:0/2032212502 wait complete. 2023-08-22T00:06:08.672 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 3 and data pool 4 2023-08-22T00:06:08.679 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-22T00:06:08.680 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-22T00:06:08.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.799+0000 7f7b207ea700 1 Processor -- start 2023-08-22T00:06:08.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.799+0000 7f7b207ea700 1 -- start start 2023-08-22T00:06:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b207ea700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7b18153ae0 0x7f7b180c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b207ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b207ea700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b18155360 con 0x7f7b180bfd80 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b207ea700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180c0670 con 0x7f7b18153ae0 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b207ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18157b50 con 0x7f7b180c0200 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7b18153ae0 0x7f7b180c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1dd85700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7b180bfd80 0x7f7b18157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54210/0 (socket says 172.21.15.98:54210) 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1dd85700 1 -- 172.21.15.98:0/1558337012 learned_addr learned my addr 172.21.15.98:0/1558337012 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1ed87700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 -- 172.21.15.98:0/1558337012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 msgr2=0x7f7b180645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1d584700 1 -- 172.21.15.98:0/1558337012 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500440992 0 0) 0x7f7b08001110 con 0x7f7b180bfd80 2023-08-22T00:06:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 -- 172.21.15.98:0/1558337012 >> v1:172.21.15.98:6789/0 conn(0x7f7b180bfd80 legacy=0x7f7b18157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 -- 172.21.15.98:0/1558337012 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180c6390 con 0x7f7b18153ae0 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1ed87700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1e586700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b18153ae0 0x7f7b180c5ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7b14009760 tx=0x7f7b14009060).ready entity=mon.0 client_cookie=4f896bda4feb54d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1d584700 1 -- 172.21.15.98:0/1558337012 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400b580 con 0x7f7b18153ae0 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1d584700 1 -- 172.21.15.98:0/1558337012 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400b6e0 con 0x7f7b18153ae0 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.800+0000 7f7b1d584700 1 -- 172.21.15.98:0/1558337012 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ba60 con 0x7f7b18153ae0 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 -- 172.21.15.98:0/1558337012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b18153ae0 msgr2=0x7f7b180c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b18153ae0 0x7f7b180c5ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7b14009760 tx=0x7f7b14009060).stop 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 -- 172.21.15.98:0/1558337012 shutdown_connections 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 --2- 172.21.15.98:0/1558337012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b18153ae0 0x7f7b180c5ea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 -- 172.21.15.98:0/1558337012 >> 172.21.15.98:0/1558337012 conn(0x7f7b180caa50 msgr2=0x7f7b180cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 -- 172.21.15.98:0/1558337012 shutdown_connections 2023-08-22T00:06:08.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.801+0000 7f7b207ea700 1 -- 172.21.15.98:0/1558337012 wait complete. 2023-08-22T00:06:08.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.802+0000 7f7b207ea700 1 Processor -- start 2023-08-22T00:06:08.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.802+0000 7f7b207ea700 1 -- start start 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b18153ae0 0x7f7b180afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180b09b0 con 0x7f7b180bfd80 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18164390 con 0x7f7b18153ae0 2023-08-22T00:06:08.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18159450 con 0x7f7b180c0200 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54200/0 (socket says 172.21.15.98:54200) 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 -- 172.21.15.98:0/238378717 learned_addr learned my addr 172.21.15.98:0/238378717 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 -- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 msgr2=0x7f7b180af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 -- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b18153ae0 msgr2=0x7f7b180afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b18153ae0 0x7f7b180afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:08.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 -- 172.21.15.98:0/238378717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140092a0 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b1e586700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7b14009eb0 tx=0x7f7b14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400b850 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400b9b0 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1401b690 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b180b03f0 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.803+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b181590e0 con 0x7f7b180bfd80 2023-08-22T00:06:08.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.804+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b18047480 con 0x7f7b180bfd80 2023-08-22T00:06:08.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.805+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7b1401ba40 con 0x7f7b180bfd80 2023-08-22T00:06:08.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.805+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 0x7f7afc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:08.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.805+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7b1407b890 con 0x7f7b180bfd80 2023-08-22T00:06:08.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.805+0000 7f7b1dd85700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 0x7f7afc0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:08.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.806+0000 7f7b1dd85700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 0x7f7afc0612a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7b18155e40 tx=0x7f7b08001270).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:08.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.809+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b1404cc40 con 0x7f7b180bfd80 2023-08-22T00:06:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:08.984+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7b18154ac0 con 0x7f7b180bfd80 2023-08-22T00:06:09.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.647+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/238378717 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7b14050260 con 0x7f7b180bfd80 2023-08-22T00:06:09.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.649+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 msgr2=0x7f7afc0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.649+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 0x7f7afc0612a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7b18155e40 tx=0x7f7b08001270).stop 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 msgr2=0x7f7b1814ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7b14009eb0 tx=0x7f7b14017000).stop 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 shutdown_connections 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b18153ae0 0x7f7b180afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b180bfd80 0x7f7b1814ee50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7afc05ede0 0x7f7afc0612a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 --2- 172.21.15.98:0/238378717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b180c0200 0x7f7b180af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:09.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 >> 172.21.15.98:0/238378717 conn(0x7f7b180caa50 msgr2=0x7f7b18155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:09.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 shutdown_connections 2023-08-22T00:06:09.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.650+0000 7f7b207ea700 1 -- 172.21.15.98:0/238378717 wait complete. 2023-08-22T00:06:09.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:06:09.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.798+0000 7f6ac800f700 1 Processor -- start 2023-08-22T00:06:09.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.798+0000 7f6ac800f700 1 -- start start 2023-08-22T00:06:09.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac800f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ac00c61f0 0x7f6ac0155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac800f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00c9ed0 con 0x7f6ac0154d50 2023-08-22T00:06:09.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac800f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00c92c0 con 0x7f6ac00aa1f0 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac800f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00c95a0 con 0x7f6ac00c61f0 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac5dab700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6ac0154d50 0x7f6ac00a9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54212/0 (socket says 172.21.15.98:54212) 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac5dab700 1 -- 172.21.15.98:0/1392236456 learned_addr learned my addr 172.21.15.98:0/1392236456 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac65ac700 1 --2- 172.21.15.98:0/1392236456 >> v2:172.21.15.118:3300/0 conn(0x7f6ac00c61f0 0x7f6ac0155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696312675 0 0) 0x7f6ac00c9ed0 con 0x7f6ac0154d50 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.799+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aac0033f0 con 0x7f6ac0154d50 2023-08-22T00:06:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 306028769 0 0) 0x7f6aac0033f0 con 0x7f6ac0154d50 2023-08-22T00:06:09.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 >> v2:172.21.15.118:3300/0 conn(0x7f6ac00c61f0 msgr2=0x7f6ac0155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:09.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 --2- 172.21.15.98:0/1392236456 >> v2:172.21.15.118:3300/0 conn(0x7f6ac00c61f0 0x7f6ac0155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 >> v1:172.21.15.118:6789/0 conn(0x7f6ac00aa1f0 legacy=0x7f6ac00c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00c9880 con 0x7f6ac0154d50 2023-08-22T00:06:09.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f6ab0001470 con 0x7f6ac0154d50 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 >> v1:172.21.15.98:6789/0 conn(0x7f6ac0154d50 legacy=0x7f6ac00a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac0038e0 0x7f6aac003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 0x7f6aac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6aac005050 0x7f6aac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c95a0 con 0x7f6aac004690 2023-08-22T00:06:09.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac00bfe0 con 0x7f6aac0038e0 2023-08-22T00:06:09.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac00c1a0 con 0x7f6aac005050 2023-08-22T00:06:09.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 0x7f6aac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac5dab700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac0038e0 0x7f6aac003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac65ac700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6aac005050 0x7f6aac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 -- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6aac005050 msgr2=0x7f6aac00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6aac005050 0x7f6aac00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 -- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac0038e0 msgr2=0x7f6aac003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac0038e0 0x7f6aac003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 -- 172.21.15.98:0/1392236456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0033f0 con 0x7f6aac004690 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac65ac700 1 -- 172.21.15.98:0/1392236456 reap_dead start 2023-08-22T00:06:09.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac55aa700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 0x7f6aac004b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6ac00c1b10 tx=0x7f6abc007bb0).ready entity=mon.0 client_cookie=69d7a11a6fc6d5f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007020 con 0x7f6aac004690 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc007180 con 0x7f6aac004690 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.800+0000 7f6ac4da9700 1 -- 172.21.15.98:0/1392236456 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007520 con 0x7f6aac004690 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 -- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 msgr2=0x7f6aac004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 0x7f6aac004b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6ac00c1b10 tx=0x7f6abc007bb0).stop 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 -- 172.21.15.98:0/1392236456 shutdown_connections 2023-08-22T00:06:09.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 --2- 172.21.15.98:0/1392236456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac004690 0x7f6aac004b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 -- 172.21.15.98:0/1392236456 >> 172.21.15.98:0/1392236456 conn(0x7f6ac00cb620 msgr2=0x7f6ac00c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 -- 172.21.15.98:0/1392236456 shutdown_connections 2023-08-22T00:06:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.801+0000 7f6ac800f700 1 -- 172.21.15.98:0/1392236456 wait complete. 2023-08-22T00:06:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.802+0000 7f6ac800f700 1 Processor -- start 2023-08-22T00:06:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.802+0000 7f6ac800f700 1 -- start start 2023-08-22T00:06:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac004690 0x7f6ac0165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac01506f0 0x7f6ac00c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c2b10 con 0x7f6ac00c3490 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c1f00 con 0x7f6aac004690 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c21e0 con 0x7f6ac01506f0 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54224/0 (socket says 172.21.15.98:54224) 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 -- 172.21.15.98:0/326301304 learned_addr learned my addr 172.21.15.98:0/326301304 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac5dab700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac004690 0x7f6ac0165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac55aa700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac01506f0 0x7f6ac00c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 -- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac01506f0 msgr2=0x7f6ac00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac01506f0 0x7f6ac00c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 -- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac004690 msgr2=0x7f6ac0165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac004690 0x7f6ac0165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:09.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 -- 172.21.15.98:0/326301304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00c24c0 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac65ac700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6ab80094d0 tx=0x7f6ab800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800e040 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800f040 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac00c27a0 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.803+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800fd10 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.804+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac00c1bb0 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.805+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac00835e0 con 0x7f6ac00c3490 2023-08-22T00:06:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.805+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6ab8015660 con 0x7f6ac00c3490 2023-08-22T00:06:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.805+0000 7f6ab5ffb700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 0x7f6aa40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.805+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f6ab807ac30 con 0x7f6ac00c3490 2023-08-22T00:06:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.805+0000 7f6ac5dab700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 0x7f6aa40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.806+0000 7f6ac5dab700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 0x7f6aa40612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ab00015a0 tx=0x7f6ab0001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.810+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ab804bee0 con 0x7f6ac00c3490 2023-08-22T00:06:09.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:09.972+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6ac00ae3d0 con 0x7f6ac00c3490 2023-08-22T00:06:10.261 INFO:tasks.ceph.mds.b.smithi118.stderr:2023-08-22T00:06:10.260+0000 7f23dc7fb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:06:11.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.663+0000 7f6ab5ffb700 1 -- 172.21.15.98:0/326301304 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f6ab804f500 con 0x7f6ac00c3490 2023-08-22T00:06:11.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.669+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 msgr2=0x7f6aa40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.669+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 0x7f6aa40612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ab00015a0 tx=0x7f6ab0001e50).stop 2023-08-22T00:06:11.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.669+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 msgr2=0x7f6ac00adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.669+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6ab80094d0 tx=0x7f6ab800b040).stop 2023-08-22T00:06:11.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 shutdown_connections 2023-08-22T00:06:11.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac00c3490 0x7f6ac00adac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aac004690 0x7f6ac0165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6aa405ee10 0x7f6aa40612d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 --2- 172.21.15.98:0/326301304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac01506f0 0x7f6ac00c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 >> 172.21.15.98:0/326301304 conn(0x7f6ac00cb620 msgr2=0x7f6ac0155130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 shutdown_connections 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.673+0000 7f6ac800f700 1 -- 172.21.15.98:0/326301304 wait complete. 2023-08-22T00:06:11.675 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data_ec' created 2023-08-22T00:06:11.689 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-22T00:06:11.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.812+0000 7f555f307700 1 Processor -- start 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.812+0000 7f555f307700 1 -- start start 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555f307700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f55580aa110 0x7f5558067600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555f307700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55580a8c70 con 0x7f5558069430 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555f307700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5558068210 con 0x7f5558154f60 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555f307700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55580a86f0 con 0x7f55580aa110 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555c8a2700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5558069430 0x7f5558066ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52196/0 (socket says 172.21.15.98:52196) 2023-08-22T00:06:11.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555c8a2700 1 -- 172.21.15.98:0/4211097908 learned_addr learned my addr 172.21.15.98:0/4211097908 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555d8a4700 1 --2- 172.21.15.98:0/4211097908 >> v2:172.21.15.118:3300/0 conn(0x7f55580aa110 0x7f5558067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281814909 0 0) 0x7f55580a8c70 con 0x7f5558069430 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55440033f0 con 0x7f5558069430 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2966498074 0 0) 0x7f55440033f0 con 0x7f5558069430 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 >> v2:172.21.15.118:3300/0 conn(0x7f55580aa110 msgr2=0x7f5558067600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 --2- 172.21.15.98:0/4211097908 >> v2:172.21.15.118:3300/0 conn(0x7f55580aa110 0x7f5558067600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 >> v1:172.21.15.118:6789/0 conn(0x7f5558154f60 legacy=0x7f5558068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558067c50 con 0x7f5558069430 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f5548001470 con 0x7f5558069430 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 >> v1:172.21.15.98:6789/0 conn(0x7f5558069430 legacy=0x7f5558066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 0x7f5544003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5544004690 0x7f5544004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5544005050 0x7f554400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55580a86f0 con 0x7f55440038e0 2023-08-22T00:06:11.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554400bfe0 con 0x7f5544005050 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554400c1a0 con 0x7f5544004690 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.813+0000 7f555d0a3700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 0x7f5544003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555c8a2700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5544004690 0x7f5544004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d8a4700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5544005050 0x7f554400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 -- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5544004690 msgr2=0x7f5544004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5544004690 0x7f5544004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 -- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5544005050 msgr2=0x7f554400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:11.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5544005050 0x7f554400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 -- 172.21.15.98:0/4211097908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440033f0 con 0x7f55440038e0 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d8a4700 1 -- 172.21.15.98:0/4211097908 reap_dead start 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555d0a3700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 0x7f5544003d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5554001700 tx=0x7f5554007bb0).ready entity=mon.0 client_cookie=cc1e51f984b9c07c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554007020 con 0x7f55440038e0 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5554007180 con 0x7f55440038e0 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f554ffff700 1 -- 172.21.15.98:0/4211097908 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554007520 con 0x7f55440038e0 2023-08-22T00:06:11.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555f307700 1 -- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 msgr2=0x7f5544003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555f307700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 0x7f5544003d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5554001700 tx=0x7f5554007bb0).stop 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555f307700 1 -- 172.21.15.98:0/4211097908 shutdown_connections 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555f307700 1 --2- 172.21.15.98:0/4211097908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55440038e0 0x7f5544003d00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.814+0000 7f555f307700 1 -- 172.21.15.98:0/4211097908 >> 172.21.15.98:0/4211097908 conn(0x7f55580c5dd0 msgr2=0x7f5558068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.815+0000 7f555f307700 1 -- 172.21.15.98:0/4211097908 shutdown_connections 2023-08-22T00:06:11.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.815+0000 7f555f307700 1 -- 172.21.15.98:0/4211097908 wait complete. 2023-08-22T00:06:11.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.816+0000 7f555f307700 1 Processor -- start 2023-08-22T00:06:11.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.816+0000 7f555f307700 1 -- start start 2023-08-22T00:06:11.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 0x7f555813e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55580c07e0 0x7f55580c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555814a7e0 con 0x7f55580c7ab0 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555814ace0 con 0x7f55440038e0 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55580abb80 con 0x7f55580c07e0 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32874/0 (socket says 172.21.15.98:32874) 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 -- 172.21.15.98:0/1029686705 learned_addr learned my addr 172.21.15.98:0/1029686705 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d0a3700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 0x7f555813e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555c8a2700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55580c07e0 0x7f55580c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 -- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55580c07e0 msgr2=0x7f55580c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55580c07e0 0x7f55580c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 -- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 msgr2=0x7f555813e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 0x7f555813e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:11.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 -- 172.21.15.98:0/1029686705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580c1150 con 0x7f55580c7ab0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d0a3700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 0x7f555813e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555d8a4700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f55580aa5a0 tx=0x7f555000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000e040 con 0x7f55580c7ab0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555000f040 con 0x7f55580c7ab0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55580c8420 con 0x7f55580c7ab0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000fdf0 con 0x7f55580c7ab0 2023-08-22T00:06:11.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.817+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55580c16a0 con 0x7f55580c7ab0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.818+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5558047480 con 0x7f55580c7ab0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.819+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5550015660 con 0x7f55580c7ab0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.819+0000 7f554d7fa700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 0x7f553c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.820+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6873+0+0 (secure 0 0 0) 0x7f555007bb80 con 0x7f55580c7ab0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.820+0000 7f555d0a3700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 0x7f553c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.820+0000 7f555d0a3700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 0x7f553c0612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5554001510 tx=0x7f5554016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:11.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.823+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f555004cda0 con 0x7f55580c7ab0 2023-08-22T00:06:11.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:11.985+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f55580c1cb0 con 0x7f55580c7ab0 2023-08-22T00:06:12.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.666+0000 7f554d7fa700 1 -- 172.21.15.98:0/1029686705 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55500503c0 con 0x7f55580c7ab0 2023-08-22T00:06:12.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.674+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 msgr2=0x7f553c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.674+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 0x7f553c0612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5554001510 tx=0x7f5554016000).stop 2023-08-22T00:06:12.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.674+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 msgr2=0x7f55580c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.674+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f55580aa5a0 tx=0x7f555000b040).stop 2023-08-22T00:06:12.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 shutdown_connections 2023-08-22T00:06:12.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55580c7ab0 0x7f55580c7f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55440038e0 0x7f555813e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f553c05ee10 0x7f553c0612d0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0x7f5554001510 tx=0x7f5554016000).stop 2023-08-22T00:06:12.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 --2- 172.21.15.98:0/1029686705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55580c07e0 0x7f55580c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.675+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 >> 172.21.15.98:0/1029686705 conn(0x7f55580c5dd0 msgr2=0x7f55580661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:12.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.676+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 shutdown_connections 2023-08-22T00:06:12.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.679+0000 7f555f307700 1 -- 172.21.15.98:0/1029686705 wait complete. 2023-08-22T00:06:12.686 INFO:teuthology.orchestra.run.smithi098.stderr:set pool 5 allow_ec_overwrites to true 2023-08-22T00:06:12.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-22T00:06:12.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.823+0000 7f3c4a135700 1 Processor -- start 2023-08-22T00:06:12.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c4a135700 1 -- start start 2023-08-22T00:06:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c4a135700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c44063400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c4a135700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44158900 con 0x7f3c440c5590 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c4a135700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44157cf0 con 0x7f3c440c30e0 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c4a135700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44157fd0 con 0x7f3c44153c90 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c3affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3c440c5590 0x7f3c44154070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52208/0 (socket says 172.21.15.98:52208) 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.824+0000 7f3c3affd700 1 -- 172.21.15.98:0/3808598138 learned_addr learned my addr 172.21.15.98:0/3808598138 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c437fe700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c44063400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143144031 0 0) 0x7f3c44158900 con 0x7f3c440c5590 2023-08-22T00:06:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c300033f0 con 0x7f3c440c5590 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376637371 0 0) 0x7f3c44157cf0 con 0x7f3c440c30e0 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44158900 con 0x7f3c440c30e0 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403595864 0 0) 0x7f3c300033f0 con 0x7f3c440c5590 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 msgr2=0x7f3c44063400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c44063400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 >> v1:172.21.15.118:6789/0 conn(0x7f3c440c30e0 legacy=0x7f3c44154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c441582b0 con 0x7f3c440c5590 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3c2c001470 con 0x7f3c440c5590 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 >> v1:172.21.15.98:6789/0 conn(0x7f3c440c5590 legacy=0x7f3c44154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c30003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c30003fb0 0x7f3c30004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c30004b80 0x7f3c30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44157fd0 con 0x7f3c30003fb0 2023-08-22T00:06:12.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000b990 con 0x7f3c30004b80 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000bb50 con 0x7f3c44153c90 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c30003fb0 0x7f3c30004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c437fe700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c30003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c43fff700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c30004b80 0x7f3c30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 -- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 msgr2=0x7f3c30003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c44153c90 0x7f3c30003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 -- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c30004b80 msgr2=0x7f3c30005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c30004b80 0x7f3c30005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 -- 172.21.15.98:0/3808598138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300033f0 con 0x7f3c30003fb0 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.825+0000 7f3c3affd700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c30003fb0 0x7f3c30004690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3c2c00c0e0 tx=0x7f3c2c001e10).ready entity=mon.0 client_cookie=8139ac65dde592b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007960 con 0x7f3c30003fb0 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00c9b0 con 0x7f3c30003fb0 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c42ffd700 1 -- 172.21.15.98:0/3808598138 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00cd30 con 0x7f3c30003fb0 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 -- 172.21.15.98:0/3808598138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c30003fb0 msgr2=0x7f3c30004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 --2- 172.21.15.98:0/3808598138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c30003fb0 0x7f3c30004690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3c2c00c0e0 tx=0x7f3c2c001e10).stop 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c43fff700 1 -- 172.21.15.98:0/3808598138 reap_dead start 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 -- 172.21.15.98:0/3808598138 shutdown_connections 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 -- 172.21.15.98:0/3808598138 >> 172.21.15.98:0/3808598138 conn(0x7f3c440c3a60 msgr2=0x7f3c440c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 -- 172.21.15.98:0/3808598138 shutdown_connections 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.826+0000 7f3c4a135700 1 -- 172.21.15.98:0/3808598138 wait complete. 2023-08-22T00:06:12.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.827+0000 7f3c4a135700 1 Processor -- start 2023-08-22T00:06:12.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.827+0000 7f3c4a135700 1 -- start start 2023-08-22T00:06:12.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c30003fb0 0x7f3c44150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c440c0e60 0x7f3c44154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441549e0 con 0x7f3c44154560 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44154cc0 con 0x7f3c440c0e60 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c4a135700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44154fa0 con 0x7f3c30003fb0 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32880/0 (socket says 172.21.15.98:32880) 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c43fff700 1 -- 172.21.15.98:0/2426766150 learned_addr learned my addr 172.21.15.98:0/2426766150 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c437fe700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c30003fb0 0x7f3c44150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.828+0000 7f3c3affd700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c440c0e60 0x7f3c44154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 -- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c30003fb0 msgr2=0x7f3c44150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c30003fb0 0x7f3c44150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 -- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c440c0e60 msgr2=0x7f3c44154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c440c0e60 0x7f3c44154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:12.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 -- 172.21.15.98:0/2426766150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44155280 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c43fff700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c44067560 tx=0x7f3c3c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00edf0 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00c5a0 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00c960 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c44155560 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.829+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c44150a40 con 0x7f3c44154560 2023-08-22T00:06:12.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.830+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c44068970 con 0x7f3c44154560 2023-08-22T00:06:12.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.830+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3c3c014480 con 0x7f3c44154560 2023-08-22T00:06:12.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.831+0000 7f3c3bfff700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 0x7f3c240612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:12.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.831+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6873+0+0 (secure 0 0 0) 0x7f3c3c079d50 con 0x7f3c44154560 2023-08-22T00:06:12.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.831+0000 7f3c437fe700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 0x7f3c240612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:12.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.831+0000 7f3c437fe700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 0x7f3c240612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3c34006d80 tx=0x7f3c34009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:12.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:12.835+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c3c04ae60 con 0x7f3c44154560 2023-08-22T00:06:13.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.037+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3c44158590 con 0x7f3c44154560 2023-08-22T00:06:13.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.041+0000 7f3c3bfff700 1 -- 172.21.15.98:0/2426766150 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3c3c019030 con 0x7f3c44154560 2023-08-22T00:06:13.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 msgr2=0x7f3c240612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 0x7f3c240612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3c34006d80 tx=0x7f3c34009060).stop 2023-08-22T00:06:13.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 msgr2=0x7f3c44155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c44067560 tx=0x7f3c3c007f30).stop 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 shutdown_connections 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c2405ee10 0x7f3c240612d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c30003fb0 0x7f3c44150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c44154560 0x7f3c44155a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 --2- 172.21.15.98:0/2426766150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c440c0e60 0x7f3c44154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 >> 172.21.15.98:0/2426766150 conn(0x7f3c440c3a60 msgr2=0x7f3c440bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 shutdown_connections 2023-08-22T00:06:13.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.043+0000 7f3c4a135700 1 -- 172.21.15.98:0/2426766150 wait complete. 2023-08-22T00:06:13.047 INFO:teuthology.orchestra.run.smithi098.stderr:added data pool 5 to fsmap 2023-08-22T00:06:13.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:13.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.173+0000 7fdf4aa05700 1 Processor -- start 2023-08-22T00:06:13.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.173+0000 7fdf4aa05700 1 -- start start 2023-08-22T00:06:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf4aa05700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf440c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf4aa05700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440bd3e0 con 0x7fdf44150e40 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf4aa05700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440bd0c0 con 0x7fdf44065f10 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf4aa05700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c3bb0 con 0x7fdf440bd870 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf43fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fdf44150e40 0x7fdf440a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52212/0 (socket says 172.21.15.98:52212) 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf43fff700 1 -- 172.21.15.98:0/492966216 learned_addr learned my addr 172.21.15.98:0/492966216 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf437fe700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf440c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855032915 0 0) 0x7fdf440bd3e0 con 0x7fdf44150e40 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.174+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf2c0033f0 con 0x7fdf44150e40 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707158071 0 0) 0x7fdf2c0033f0 con 0x7fdf44150e40 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 msgr2=0x7fdf440c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf440c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 >> v1:172.21.15.118:6789/0 conn(0x7fdf44065f10 legacy=0x7fdf44063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440c3e90 con 0x7fdf44150e40 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fdf38001470 con 0x7fdf44150e40 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 >> v1:172.21.15.98:6789/0 conn(0x7fdf44150e40 legacy=0x7fdf440a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf2c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2c004690 0x7fdf2c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf2c0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c3bb0 con 0x7fdf2c003910 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c00b9c0 con 0x7fdf2c004690 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c00bb80 con 0x7fdf440bd870 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf2c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf437fe700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2c004690 0x7fdf2c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf48fa2700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf2c0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 -- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 msgr2=0x7fdf2c0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf2c0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 -- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2c004690 msgr2=0x7fdf2c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2c004690 0x7fdf2c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 -- 172.21.15.98:0/492966216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0033f0 con 0x7fdf2c003910 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf48fa2700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf440bd870 0x7fdf2c0050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf43fff700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf2c003d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdf3800c190 tx=0x7fdf38001e50).ready entity=mon.0 client_cookie=974f5bfbd904f198 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38007a20 con 0x7fdf2c003910 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3800cac0 con 0x7fdf2c003910 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.175+0000 7fdf42ffd700 1 -- 172.21.15.98:0/492966216 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800ce40 con 0x7fdf2c003910 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 -- 172.21.15.98:0/492966216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 msgr2=0x7fdf2c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/492966216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf2c003d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdf3800c190 tx=0x7fdf38001e50).stop 2023-08-22T00:06:13.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf48fa2700 1 -- 172.21.15.98:0/492966216 reap_dead start 2023-08-22T00:06:13.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 -- 172.21.15.98:0/492966216 shutdown_connections 2023-08-22T00:06:13.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 -- 172.21.15.98:0/492966216 >> 172.21.15.98:0/492966216 conn(0x7fdf4406a980 msgr2=0x7fdf440c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 -- 172.21.15.98:0/492966216 shutdown_connections 2023-08-22T00:06:13.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.176+0000 7fdf4aa05700 1 -- 172.21.15.98:0/492966216 wait complete. 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.177+0000 7fdf4aa05700 1 Processor -- start 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.177+0000 7fdf4aa05700 1 -- start start 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf440a6be0 0x7fdf44151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf44151ef0 0x7fdf44062e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4414d880 con 0x7fdf2c003910 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44151220 con 0x7fdf440a6be0 2023-08-22T00:06:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf4aa05700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4414e2a0 con 0x7fdf44151ef0 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32894/0 (socket says 172.21.15.98:32894) 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 -- 172.21.15.98:0/2015014860 learned_addr learned my addr 172.21.15.98:0/2015014860 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf437fe700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf440a6be0 0x7fdf44151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf48fa2700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf44151ef0 0x7fdf44062e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 -- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf44151ef0 msgr2=0x7fdf44062e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf44151ef0 0x7fdf44062e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 -- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf440a6be0 msgr2=0x7fdf44151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf440a6be0 0x7fdf44151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 -- 172.21.15.98:0/2015014860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4414e580 con 0x7fdf2c003910 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.178+0000 7fdf43fff700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdf3800c780 tx=0x7fdf38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.179+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380075c0 con 0x7fdf2c003910 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.179+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf380046b0 con 0x7fdf2c003910 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.179+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4414e860 con 0x7fdf2c003910 2023-08-22T00:06:13.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.179+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38004a50 con 0x7fdf2c003910 2023-08-22T00:06:13.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.179+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4414df70 con 0x7fdf2c003910 2023-08-22T00:06:13.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdf38020480 con 0x7fdf2c003910 2023-08-22T00:06:13.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44151720 con 0x7fdf2c003910 2023-08-22T00:06:13.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf2bfff700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 0x7fdf300612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fdf3807af40 con 0x7fdf2c003910 2023-08-22T00:06:13.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf437fe700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 0x7fdf300612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.180+0000 7fdf437fe700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 0x7fdf300612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdf440c7190 tx=0x7fdf34009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.184+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf44151720 con 0x7fdf2c003910 2023-08-22T00:06:13.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.385+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf44151720 con 0x7fdf2c003910 2023-08-22T00:06:13.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.386+0000 7fdf2bfff700 1 -- 172.21.15.98:0/2015014860 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4488 (secure 0 0 0) 0x7fdf44151720 con 0x7fdf2c003910 2023-08-22T00:06:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:13.388 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:13.039128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-08-22T00:06:13.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.387+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 msgr2=0x7fdf300612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.387+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 0x7fdf300612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdf440c7190 tx=0x7fdf34009060).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 msgr2=0x7fdf441523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdf3800c780 tx=0x7fdf38015000).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 shutdown_connections 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf3005ee10 0x7fdf300612d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf44151ef0 0x7fdf44062e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf2c003910 0x7fdf441523c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 --2- 172.21.15.98:0/2015014860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf440a6be0 0x7fdf44151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 >> 172.21.15.98:0/2015014860 conn(0x7fdf4406a980 msgr2=0x7fdf440a74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 shutdown_connections 2023-08-22T00:06:13.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.388+0000 7fdf4aa05700 1 -- 172.21.15.98:0/2015014860 wait complete. 2023-08-22T00:06:13.391 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2023-08-22T00:06:13.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:13.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.516+0000 7f232af98700 1 Processor -- start 2023-08-22T00:06:13.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.516+0000 7f232af98700 1 -- start start 2023-08-22T00:06:13.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f232af98700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f23240653d0 0x7f232415f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f232af98700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2324158bf0 con 0x7f2324151d60 2023-08-22T00:06:13.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f232af98700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2324157d90 con 0x7f23240a6e50 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f232af98700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2324157fe0 con 0x7f23240653d0 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f2328d34700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2324151d60 0x7f2324155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52214/0 (socket says 172.21.15.98:52214) 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f2328d34700 1 -- 172.21.15.98:0/2112220489 learned_addr learned my addr 172.21.15.98:0/2112220489 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f2329535700 1 --2- 172.21.15.98:0/2112220489 >> v2:172.21.15.118:3300/0 conn(0x7f23240653d0 0x7f232415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903172586 0 0) 0x7f2324158bf0 con 0x7f2324151d60 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23140033f0 con 0x7f2324151d60 2023-08-22T00:06:13.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.517+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4116465732 0 0) 0x7f23140033f0 con 0x7f2324151d60 2023-08-22T00:06:13.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 >> v2:172.21.15.118:3300/0 conn(0x7f23240653d0 msgr2=0x7f232415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 --2- 172.21.15.98:0/2112220489 >> v2:172.21.15.118:3300/0 conn(0x7f23240653d0 0x7f232415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 >> v1:172.21.15.118:6789/0 conn(0x7f23240a6e50 legacy=0x7f2324065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23241582c0 con 0x7f2324151d60 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f2318001470 con 0x7f2324151d60 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 >> v1:172.21.15.98:6789/0 conn(0x7f2324151d60 legacy=0x7f2324155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23140038e0 0x7f2314003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314004690 0x7f2314004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 0x7f231400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324157fe0 con 0x7f2314005000 2023-08-22T00:06:13.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231400bf60 con 0x7f23140038e0 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231400c0f0 con 0x7f2314004690 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 0x7f231400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2328d34700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23140038e0 0x7f2314003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2323fff700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314004690 0x7f2314004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 -- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314004690 msgr2=0x7f2314004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314004690 0x7f2314004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 -- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23140038e0 msgr2=0x7f2314003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23140038e0 0x7f2314003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 -- 172.21.15.98:0/2112220489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140033f0 con 0x7f2314005000 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 -- 172.21.15.98:0/2112220489 reap_dead start 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f2329535700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 0x7f231400b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f231c00e210 tx=0x7f231c00b040).ready entity=mon.0 client_cookie=5557496b55ce99b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c009ac0 con 0x7f2314005000 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00f040 con 0x7f2314005000 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.518+0000 7f23237fe700 1 -- 172.21.15.98:0/2112220489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00ed10 con 0x7f2314005000 2023-08-22T00:06:13.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 -- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 msgr2=0x7f231400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 0x7f231400b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f231c00e210 tx=0x7f231c00b040).stop 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 -- 172.21.15.98:0/2112220489 shutdown_connections 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 --2- 172.21.15.98:0/2112220489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2314005000 0x7f231400b8e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 -- 172.21.15.98:0/2112220489 >> 172.21.15.98:0/2112220489 conn(0x7f232406a980 msgr2=0x7f23240c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 -- 172.21.15.98:0/2112220489 shutdown_connections 2023-08-22T00:06:13.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.519+0000 7f232af98700 1 -- 172.21.15.98:0/2112220489 wait complete. 2023-08-22T00:06:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.520+0000 7f232af98700 1 Processor -- start 2023-08-22T00:06:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.520+0000 7f232af98700 1 -- start start 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314005000 0x7f232414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23240ab990 0x7f23240a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240a7c50 con 0x7f23240ab510 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c61b0 con 0x7f23240ab990 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f232af98700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c80e0 con 0x7f2314005000 2023-08-22T00:06:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32910/0 (socket says 172.21.15.98:32910) 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 -- 172.21.15.98:0/3396765973 learned_addr learned my addr 172.21.15.98:0/3396765973 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2328d34700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314005000 0x7f232414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2329535700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23240ab990 0x7f23240a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 -- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314005000 msgr2=0x7f232414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314005000 0x7f232414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 -- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23240ab990 msgr2=0x7f23240a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23240ab990 0x7f23240a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 -- 172.21.15.98:0/3396765973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240c55a0 con 0x7f23240ab510 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2323fff700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2310003f10 tx=0x7f2310007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.521+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100114c0 con 0x7f23240ab510 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.522+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310011620 con 0x7f23240ab510 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.522+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23240c5880 con 0x7f23240ab510 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.522+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100119a0 con 0x7f23240ab510 2023-08-22T00:06:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.522+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240c5e40 con 0x7f23240ab510 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.523+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23241552d0 con 0x7f23240ab510 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.523+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2310011d10 con 0x7f23240ab510 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.523+0000 7f2320ff9700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 0x7f23080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.523+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2310079a30 con 0x7f23240ab510 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.523+0000 7f2328d34700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 0x7f23080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.524+0000 7f2328d34700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 0x7f23080612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2318007e30 tx=0x7f2318001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.527+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23100498f0 con 0x7f23240ab510 2023-08-22T00:06:13.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.690+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23240c6320 con 0x7f23240ab510 2023-08-22T00:06:13.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.691+0000 7f2320ff9700 1 -- 172.21.15.98:0/3396765973 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f231004ab80 con 0x7f23240ab510 2023-08-22T00:06:13.693 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:13.693 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:13.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 msgr2=0x7f23080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 0x7f23080612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2318007e30 tx=0x7f2318001e50).stop 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 msgr2=0x7f23240a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2310003f10 tx=0x7f2310007bb0).stop 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 shutdown_connections 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f230805ee10 0x7f23080612d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2314005000 0x7f232414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23240ab990 0x7f23240a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 --2- 172.21.15.98:0/3396765973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23240ab510 0x7f23240a7270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 >> 172.21.15.98:0/3396765973 conn(0x7f232406a980 msgr2=0x7f2324140840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 shutdown_connections 2023-08-22T00:06:13.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.693+0000 7f232af98700 1 -- 172.21.15.98:0/3396765973 wait complete. 2023-08-22T00:06:13.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:13.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.823+0000 7fe7b0ac1700 1 Processor -- start 2023-08-22T00:06:13.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.823+0000 7fe7b0ac1700 1 -- start start 2023-08-22T00:06:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7b0ac1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe7ac0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7b0ac1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7ac0c3490 0x7fe7ac0bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7b0ac1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac151e40 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7b0ac1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac0c4f80 con 0x7fe7ac0c3490 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7b0ac1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac151620 con 0x7fe7ac0a6590 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7aa59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe7ac0a61b0 0x7fe7ac150f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52230/0 (socket says 172.21.15.98:52230) 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7aa59c700 1 -- 172.21.15.98:0/726633493 learned_addr learned my addr 172.21.15.98:0/726633493 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7aad9d700 1 --2- 172.21.15.98:0/726633493 >> v2:172.21.15.118:3300/0 conn(0x7fe7ac0c3490 0x7fe7ac0bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe7ac0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534765025 0 0) 0x7fe7ac151e40 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.824+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7940033f0 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386292784 0 0) 0x7fe7940033f0 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 msgr2=0x7fe7ac0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe7ac0c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 >> v2:172.21.15.118:3300/0 conn(0x7fe7ac0c3490 msgr2=0x7fe7ac0bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 --2- 172.21.15.98:0/726633493 >> v2:172.21.15.118:3300/0 conn(0x7fe7ac0c3490 0x7fe7ac0bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac151880 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe7a0001470 con 0x7fe7ac0a61b0 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 >> v1:172.21.15.98:6789/0 conn(0x7fe7ac0a61b0 legacy=0x7fe7ac150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe794003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe794004690 0x7fe794004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe794005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0c4f80 con 0x7fe7940038e0 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac151620 con 0x7fe794004690 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79400b8e0 con 0x7fe7ac0a6590 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe794003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe794004690 0x7fe794004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aad9d700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe794005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 -- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 msgr2=0x7fe794005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac0a6590 0x7fe794005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 -- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe794004690 msgr2=0x7fe794004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe794004690 0x7fe794004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 -- 172.21.15.98:0/726633493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940033f0 con 0x7fe7940038e0 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe794003d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe7a000c210 tx=0x7fe7a0001e90).ready entity=mon.0 client_cookie=8f1d5c90e4dd5342 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0007a60 con 0x7fe7940038e0 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000cae0 con 0x7fe7940038e0 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.825+0000 7fe7a959a700 1 -- 172.21.15.98:0/726633493 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000ce80 con 0x7fe7940038e0 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/726633493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 msgr2=0x7fe794003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/726633493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe794003d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe7a000c210 tx=0x7fe7a0001e90).stop 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7aad9d700 1 -- 172.21.15.98:0/726633493 reap_dead start 2023-08-22T00:06:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/726633493 shutdown_connections 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/726633493 >> 172.21.15.98:0/726633493 conn(0x7fe7ac0c3980 msgr2=0x7fe7ac0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/726633493 shutdown_connections 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.826+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/726633493 wait complete. 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.827+0000 7fe7b0ac1700 1 Processor -- start 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.827+0000 7fe7b0ac1700 1 -- start start 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 0x7fe7ac153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac153970 0x7fe7ac1658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac153dd0 con 0x7fe7940038e0 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac161db0 con 0x7fe7ac0beff0 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7b0ac1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0bf5c0 con 0x7fe7ac153970 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32936/0 (socket says 172.21.15.98:32936) 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 -- 172.21.15.98:0/658698025 learned_addr learned my addr 172.21.15.98:0/658698025 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 0x7fe7ac153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aad9d700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac153970 0x7fe7ac1658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 -- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac153970 msgr2=0x7fe7ac1658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac153970 0x7fe7ac1658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 -- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 msgr2=0x7fe7ac153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 0x7fe7ac153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 -- 172.21.15.98:0/658698025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac162070 con 0x7fe7940038e0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 0x7fe7ac153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe7aa59c700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe7a0001ed0 tx=0x7fe7a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00074f0 con 0x7fe7940038e0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.828+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0007650 con 0x7fe7940038e0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.829+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0004900 con 0x7fe7940038e0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.829+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac162350 con 0x7fe7940038e0 2023-08-22T00:06:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.829+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac162b50 con 0x7fe7940038e0 2023-08-22T00:06:13.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.830+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac162d40 con 0x7fe7940038e0 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.830+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe7a0004c70 con 0x7fe7940038e0 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.830+0000 7fe79a7fc700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 0x7fe78c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.830+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe7a001c040 con 0x7fe7940038e0 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.830+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 0x7fe78c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.831+0000 7fe7a9d9b700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 0x7fe78c0612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe79c006d80 tx=0x7fe79c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:13.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.834+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7a004c120 con 0x7fe7940038e0 2023-08-22T00:06:13.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.996+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7ac047480 con 0x7fe7940038e0 2023-08-22T00:06:13.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.997+0000 7fe79a7fc700 1 -- 172.21.15.98:0/658698025 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fe7a0026070 con 0x7fe7940038e0 2023-08-22T00:06:13.999 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:13.999 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:14.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 msgr2=0x7fe78c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 0x7fe78c0612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe79c006d80 tx=0x7fe79c009060).stop 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 msgr2=0x7fe7ac0beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe7a0001ed0 tx=0x7fe7a0015000).stop 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 shutdown_connections 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe78c05ee10 0x7fe78c0612d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7ac153970 0x7fe7ac1658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7940038e0 0x7fe7ac0beb00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 --2- 172.21.15.98:0/658698025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7ac0beff0 0x7fe7ac153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 >> 172.21.15.98:0/658698025 conn(0x7fe7ac0c3980 msgr2=0x7fe7ac14d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:14.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 shutdown_connections 2023-08-22T00:06:14.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:13.999+0000 7fe7b0ac1700 1 -- 172.21.15.98:0/658698025 wait complete. 2023-08-22T00:06:14.026 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.142+0000 7f3e7d758700 1 Processor -- start 2023-08-22T00:06:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.142+0000 7f3e7d758700 1 -- start start 2023-08-22T00:06:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e7d758700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e780a9c60 0x7f3e780aa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e7d758700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e78153f70 0x7f3e780c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e7d758700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78062a10 con 0x7f3e780c0b60 2023-08-22T00:06:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e7d758700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780c0fe0 con 0x7f3e78153f70 2023-08-22T00:06:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e7d758700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780c64c0 con 0x7f3e780a9c60 2023-08-22T00:06:14.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e78153f70 0x7f3e780c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e78153f70 0x7f3e780c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32948/0 (socket says 172.21.15.98:32948) 2023-08-22T00:06:14.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 -- 172.21.15.98:0/1259287034 learned_addr learned my addr 172.21.15.98:0/1259287034 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:14.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e76ffd700 1 --2- 172.21.15.98:0/1259287034 >> v2:172.21.15.118:3300/0 conn(0x7f3e780a9c60 0x7f3e780aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 -- 172.21.15.98:0/1259287034 >> v2:172.21.15.118:3300/0 conn(0x7f3e780a9c60 msgr2=0x7f3e780aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:14.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 --2- 172.21.15.98:0/1259287034 >> v2:172.21.15.118:3300/0 conn(0x7f3e780a9c60 0x7f3e780aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 -- 172.21.15.98:0/1259287034 >> v1:172.21.15.118:6789/0 conn(0x7f3e780c0b60 legacy=0x7f3e78153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.143+0000 7f3e777fe700 1 -- 172.21.15.98:0/1259287034 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780c1230 con 0x7f3e78153f70 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e777fe700 1 --2- 172.21.15.98:0/1259287034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e78153f70 0x7f3e780c5fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3e780aa5e0 tx=0x7f3e70009840).ready entity=mon.0 client_cookie=e075eea93b3b303a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e75ffb700 1 -- 172.21.15.98:0/1259287034 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000e070 con 0x7f3e78153f70 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e75ffb700 1 -- 172.21.15.98:0/1259287034 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000ba10 con 0x7f3e78153f70 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e75ffb700 1 -- 172.21.15.98:0/1259287034 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000bd90 con 0x7f3e78153f70 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 -- 172.21.15.98:0/1259287034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e78153f70 msgr2=0x7f3e780c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1259287034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e78153f70 0x7f3e780c5fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3e780aa5e0 tx=0x7f3e70009840).stop 2023-08-22T00:06:14.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 -- 172.21.15.98:0/1259287034 shutdown_connections 2023-08-22T00:06:14.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1259287034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e78153f70 0x7f3e780c5fd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1259287034 >> v2:172.21.15.118:3300/0 conn(0x7f3e780a9c60 0x7f3e780aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 -- 172.21.15.98:0/1259287034 >> 172.21.15.98:0/1259287034 conn(0x7f3e780cb5a0 msgr2=0x7f3e780c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:14.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 -- 172.21.15.98:0/1259287034 shutdown_connections 2023-08-22T00:06:14.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.144+0000 7f3e7d758700 1 -- 172.21.15.98:0/1259287034 wait complete. 2023-08-22T00:06:14.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 Processor -- start 2023-08-22T00:06:14.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 -- start start 2023-08-22T00:06:14.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 0x7f3e780abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78153f70 0x7f3e780c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780ad1e0 con 0x7f3e780c0b60 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7814c2f0 con 0x7f3e780a9c60 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e7d758700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780ac5d0 con 0x7f3e78153f70 2023-08-22T00:06:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.146+0000 7f3e767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32954/0 (socket says 172.21.15.98:32954) 2023-08-22T00:06:14.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 -- 172.21.15.98:0/1562332858 learned_addr learned my addr 172.21.15.98:0/1562332858 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:14.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e76ffd700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 0x7f3e780abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e777fe700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78153f70 0x7f3e780c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 -- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78153f70 msgr2=0x7f3e780c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78153f70 0x7f3e780c1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 -- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 msgr2=0x7f3e780abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 0x7f3e780abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 -- 172.21.15.98:0/1562332858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009ae0 con 0x7f3e780c0b60 2023-08-22T00:06:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e76ffd700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 0x7f3e780abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e767fc700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3e6800c440 tx=0x7f3e68007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800f470 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800f5f0 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780ac8b0 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800f9b0 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.147+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780ace70 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.148+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78047480 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.148+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3e68012400 con 0x7f3e780c0b60 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.148+0000 7f3e5effd700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 0x7f3e640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.149+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3e68079620 con 0x7f3e780c0b60 2023-08-22T00:06:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.149+0000 7f3e76ffd700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 0x7f3e640612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.149+0000 7f3e76ffd700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 0x7f3e640612a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3e6c009810 tx=0x7f3e6c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.152+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e680488f0 con 0x7f3e780c0b60 2023-08-22T00:06:14.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.352+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e780c1510 con 0x7f3e780c0b60 2023-08-22T00:06:14.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.353+0000 7f3e5effd700 1 -- 172.21.15.98:0/1562332858 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f3e6804a7d0 con 0x7f3e780c0b60 2023-08-22T00:06:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:14.355 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:13.039128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-08-22T00:06:14.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 msgr2=0x7f3e640612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 0x7f3e640612a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3e6c009810 tx=0x7f3e6c008040).stop 2023-08-22T00:06:14.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 msgr2=0x7f3e780ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3e6800c440 tx=0x7f3e68007de0).stop 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 shutdown_connections 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e6405ede0 0x7f3e640612a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78153f70 0x7f3e780c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e780a9c60 0x7f3e780abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 --2- 172.21.15.98:0/1562332858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e780c0b60 0x7f3e780ac020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 >> 172.21.15.98:0/1562332858 conn(0x7f3e780cb5a0 msgr2=0x7f3e780c5820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:14.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 shutdown_connections 2023-08-22T00:06:14.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.355+0000 7f3e7d758700 1 -- 172.21.15.98:0/1562332858 wait complete. 2023-08-22T00:06:14.358 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2023-08-22T00:06:14.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:14.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.482+0000 7f79d0f92700 1 Processor -- start 2023-08-22T00:06:14.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.482+0000 7f79d0f92700 1 -- start start 2023-08-22T00:06:14.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79d0f92700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79cc0c61a0 0x7f79cc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79d0f92700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79d0f92700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc155260 con 0x7f79cc14e0d0 2023-08-22T00:06:14.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79d0f92700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0c17b0 con 0x7f79cc0c61a0 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79d0f92700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0bf9e0 con 0x7f79cc1544f0 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79c9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79cc0c61a0 0x7f79cc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79c9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79cc0c61a0 0x7f79cc14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32970/0 (socket says 172.21.15.98:32970) 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.483+0000 7f79c9d9b700 1 -- 172.21.15.98:0/1264063293 learned_addr learned my addr 172.21.15.98:0/1264063293 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79cad9d700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c9d9b700 1 -- 172.21.15.98:0/1264063293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 msgr2=0x7f79cc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:14.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c9d9b700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c9d9b700 1 -- 172.21.15.98:0/1264063293 >> v1:172.21.15.118:6789/0 conn(0x7f79cc14e0d0 legacy=0x7f79cc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c9d9b700 1 -- 172.21.15.98:0/1264063293 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0bfcc0 con 0x7f79cc0c61a0 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79cad9d700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c9d9b700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc0c61a0 0x7f79cc14e4b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f79cc0c6eb0 tx=0x7f79bc0090f0).ready entity=mon.0 client_cookie=5584cde4adc11184 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c959a700 1 -- 172.21.15.98:0/1264063293 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00b5a0 con 0x7f79cc0c61a0 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c959a700 1 -- 172.21.15.98:0/1264063293 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00b700 con 0x7f79cc0c61a0 2023-08-22T00:06:14.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79c959a700 1 -- 172.21.15.98:0/1264063293 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00ba80 con 0x7f79cc0c61a0 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79d0f92700 1 -- 172.21.15.98:0/1264063293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc0c61a0 msgr2=0x7f79cc14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.484+0000 7f79d0f92700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc0c61a0 0x7f79cc14e4b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f79cc0c6eb0 tx=0x7f79bc0090f0).stop 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 -- 172.21.15.98:0/1264063293 shutdown_connections 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 --2- 172.21.15.98:0/1264063293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc0c61a0 0x7f79cc14e4b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 -- 172.21.15.98:0/1264063293 >> 172.21.15.98:0/1264063293 conn(0x7f79cc0caa80 msgr2=0x7f79cc0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 -- 172.21.15.98:0/1264063293 shutdown_connections 2023-08-22T00:06:14.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.485+0000 7f79d0f92700 1 -- 172.21.15.98:0/1264063293 wait complete. 2023-08-22T00:06:14.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 Processor -- start 2023-08-22T00:06:14.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 -- start start 2023-08-22T00:06:14.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79cc0c61a0 0x7f79cc1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.486+0000 7f79d0f92700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc14eed0 con 0x7f79cc14e0d0 2023-08-22T00:06:14.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79d0f92700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0aea80 con 0x7f79cc0c61a0 2023-08-22T00:06:14.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79d0f92700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0aed60 con 0x7f79cc1544f0 2023-08-22T00:06:14.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32984/0 (socket says 172.21.15.98:32984) 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 -- 172.21.15.98:0/4139140972 learned_addr learned my addr 172.21.15.98:0/4139140972 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79ca59c700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79cc0c61a0 0x7f79cc1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79cad9d700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 -- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 msgr2=0x7f79cc0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc0afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 -- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79cc0c61a0 msgr2=0x7f79cc1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79cc0c61a0 0x7f79cc1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 -- 172.21.15.98:0/4139140972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc009370 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c9d9b700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f79bc009130 tx=0x7f79bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00b870 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00b9d0 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc01b660 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0af040 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.487+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0af600 con 0x7f79cc14e0d0 2023-08-22T00:06:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.488+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f79bc01ba10 con 0x7f79cc14e0d0 2023-08-22T00:06:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.488+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc047480 con 0x7f79cc14e0d0 2023-08-22T00:06:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.489+0000 7f79c27fc700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 0x7f79ac0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:14.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.489+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f79bc07baa0 con 0x7f79cc14e0d0 2023-08-22T00:06:14.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.489+0000 7f79ca59c700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 0x7f79ac0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:14.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.489+0000 7f79ca59c700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 0x7f79ac0612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f79b40038b0 tx=0x7f79b4007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:14.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.493+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79bc04cc00 con 0x7f79cc14e0d0 2023-08-22T00:06:14.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.656+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79cc0a98e0 con 0x7f79cc14e0d0 2023-08-22T00:06:14.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.657+0000 7f79c27fc700 1 -- 172.21.15.98:0/4139140972 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f79bc029090 con 0x7f79cc14e0d0 2023-08-22T00:06:14.659 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:14.659 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:14.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 msgr2=0x7f79ac0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 0x7f79ac0612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f79b40038b0 tx=0x7f79b4007d20).stop 2023-08-22T00:06:14.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 msgr2=0x7f79cc0afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f79bc009130 tx=0x7f79bc015000).stop 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 shutdown_connections 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79ac05ee10 0x7f79ac0612d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79cc1544f0 0x7f79cc0afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79cc0c61a0 0x7f79cc1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.658+0000 7f79d0f92700 1 --2- 172.21.15.98:0/4139140972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79cc14e0d0 0x7f79cc0afb00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:14.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.659+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 >> 172.21.15.98:0/4139140972 conn(0x7f79cc0caa80 msgr2=0x7f79cc14d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:14.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.659+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 shutdown_connections 2023-08-22T00:06:14.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:14.659+0000 7f79d0f92700 1 -- 172.21.15.98:0/4139140972 wait complete. 2023-08-22T00:06:15.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:06:08.641078+0000', 'modified': '2023-08-22T00:06:13.039128+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6833/3719023028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 3719023028}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 3719023028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-08-22T00:06:15.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:06:15.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-22T00:06:15.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.194+0000 7fd78773d700 1 Processor -- start 2023-08-22T00:06:15.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.194+0000 7fd78773d700 1 -- start start 2023-08-22T00:06:15.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd78773d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd780063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd78773d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800bfe30 con 0x7fd7800c5b70 2023-08-22T00:06:15.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd78773d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800636a0 con 0x7fd780153f80 2023-08-22T00:06:15.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd78773d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd780063980 con 0x7fd7800c5f50 2023-08-22T00:06:15.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd7854d9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd7800c5b70 0x7fd780153870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52234/0 (socket says 172.21.15.98:52234) 2023-08-22T00:06:15.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.195+0000 7fd7854d9700 1 -- 172.21.15.98:0/1795047767 learned_addr learned my addr 172.21.15.98:0/1795047767 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:15.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd785cda700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd780063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904009083 0 0) 0x7fd7800bfe30 con 0x7fd7800c5b70 2023-08-22T00:06:15.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76c0033f0 con 0x7fd7800c5b70 2023-08-22T00:06:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246998531 0 0) 0x7fd76c0033f0 con 0x7fd7800c5b70 2023-08-22T00:06:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 msgr2=0x7fd780063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd780063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 >> v1:172.21.15.118:6789/0 conn(0x7fd780153f80 legacy=0x7fd7800c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780063c60 con 0x7fd7800c5b70 2023-08-22T00:06:15.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd770001470 con 0x7fd7800c5b70 2023-08-22T00:06:15.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 >> v1:172.21.15.98:6789/0 conn(0x7fd7800c5b70 legacy=0x7fd780153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd76c003910 0x7fd76c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd76c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd76c004b80 0x7fd76c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780063980 con 0x7fd76c003910 2023-08-22T00:06:15.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c00b8e0 con 0x7fd76c004b80 2023-08-22T00:06:15.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c00ba50 con 0x7fd7800c5f50 2023-08-22T00:06:15.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd76c003910 0x7fd76c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd784cd8700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd76c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd785cda700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd76c004b80 0x7fd76c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 -- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 msgr2=0x7fd76c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd76c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 -- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd76c004b80 msgr2=0x7fd76c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd76c004b80 0x7fd76c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 -- 172.21.15.98:0/1795047767 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0033f0 con 0x7fd76c003910 2023-08-22T00:06:15.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd784cd8700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7800c5f50 0x7fd76c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:15.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd785cda700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd76c004b80 0x7fd76c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:15.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.196+0000 7fd7854d9700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd76c003910 0x7fd76c003cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd77000c1e0 tx=0x7fd7800bffc0).ready entity=mon.0 client_cookie=32ee34759db40201 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770007a60 con 0x7fd76c003910 2023-08-22T00:06:15.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000ca50 con 0x7fd76c003910 2023-08-22T00:06:15.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd777fff700 1 -- 172.21.15.98:0/1795047767 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000ce10 con 0x7fd76c003910 2023-08-22T00:06:15.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 -- 172.21.15.98:0/1795047767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd76c003910 msgr2=0x7fd76c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 --2- 172.21.15.98:0/1795047767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd76c003910 0x7fd76c003cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd77000c1e0 tx=0x7fd7800bffc0).stop 2023-08-22T00:06:15.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd785cda700 1 -- 172.21.15.98:0/1795047767 reap_dead start 2023-08-22T00:06:15.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 -- 172.21.15.98:0/1795047767 shutdown_connections 2023-08-22T00:06:15.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 -- 172.21.15.98:0/1795047767 >> 172.21.15.98:0/1795047767 conn(0x7fd7800cb610 msgr2=0x7fd7800c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 -- 172.21.15.98:0/1795047767 shutdown_connections 2023-08-22T00:06:15.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.197+0000 7fd78773d700 1 -- 172.21.15.98:0/1795047767 wait complete. 2023-08-22T00:06:15.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.198+0000 7fd78773d700 1 Processor -- start 2023-08-22T00:06:15.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.198+0000 7fd78773d700 1 -- start start 2023-08-22T00:06:15.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76c003910 0x7fd780164d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 0x7fd7801451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800b0600 con 0x7fd7800a4c80 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800afd60 con 0x7fd780144d30 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd78773d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800b0040 con 0x7fd76c003910 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32996/0 (socket says 172.21.15.98:32996) 2023-08-22T00:06:15.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd785cda700 1 -- 172.21.15.98:0/3926242840 learned_addr learned my addr 172.21.15.98:0/3926242840 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76c003910 0x7fd780164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.199+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 0x7fd7801451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 -- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76c003910 msgr2=0x7fd780164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76c003910 0x7fd780164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 -- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 msgr2=0x7fd7801451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 0x7fd7801451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 -- 172.21.15.98:0/3926242840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800b0320 con 0x7fd7800a4c80 2023-08-22T00:06:15.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 0x7fd7801451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd785cda700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd780083e00 tx=0x7fd77800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd7757fa700 1 -- 172.21.15.98:0/3926242840 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800e030 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd7757fa700 1 -- 172.21.15.98:0/3926242840 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800f040 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7801654d0 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd7757fa700 1 -- 172.21.15.98:0/3926242840 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778010e80 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.200+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800a55d0 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.201+0000 7fd7757fa700 1 -- 172.21.15.98:0/3926242840 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd778015690 con 0x7fd7800a4c80 2023-08-22T00:06:15.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.201+0000 7fd7757fa700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 0x7fd7640612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.201+0000 7fd7757fa700 1 -- 172.21.15.98:0/3926242840 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fd77807a920 con 0x7fd7800a4c80 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.202+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 0x7fd7640612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.202+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 0x7fd7640612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd77000ca20 tx=0x7fd770015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.203+0000 7fd7990f1b80 1 Processor -- start 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.203+0000 7fd7990f1b80 1 -- start start 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x5583760ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x5583760eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837602bdb0 con 0x558376137f60 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558376041030 con 0x5583760ef2c0 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x558376041170 con 0x5583760eaaf0 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd784cd8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd784cd8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33002/0 (socket says 172.21.15.98:33002) 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd784cd8700 1 -- 172.21.15.98:0/3065856863 learned_addr learned my addr 172.21.15.98:0/3065856863 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x5583760ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.204+0000 7fd785cda700 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x5583760eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 -- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 msgr2=0x5583760eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x5583760eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 -- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 msgr2=0x5583760ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x5583760ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 -- 172.21.15.98:0/3065856863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558376013b00 con 0x558376137f60 2023-08-22T00:06:15.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd77c003890 tx=0x7fd77c009040).ready entity=mon.0 client_cookie=258c26969242d4d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd76a7fc700 1 -- 172.21.15.98:0/3065856863 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c001570 con 0x558376137f60 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd76a7fc700 1 -- 172.21.15.98:0/3065856863 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c0016d0 con 0x558376137f60 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd76a7fc700 1 -- 172.21.15.98:0/3065856863 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c001a50 con 0x558376137f60 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3065856863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 msgr2=0x5583760ea600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd77c003890 tx=0x7fd77c009040).stop 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3065856863 shutdown_connections 2023-08-22T00:06:15.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x5583760eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x5583760ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3065856863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583760ea600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3065856863 >> 172.21.15.98:0/3065856863 conn(0x558375f59940 msgr2=0x5583761383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3065856863 shutdown_connections 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.205+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3065856863 wait complete. 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.206+0000 7fd7990f1b80 1 -- start start 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.206+0000 7fd7990f1b80 1 Processor -- start 2023-08-22T00:06:15.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.207+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x55837611e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558376137f60 0x558376116710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583760413f0 con 0x5583760ef2c0 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837600c920 con 0x5583760eaaf0 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55837611a8a0 con 0x558376137f60 2023-08-22T00:06:15.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 10 client.0 ll_register_callbacks cb 0x558375fe1ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33016/0 (socket says 172.21.15.98:33016) 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 -- 172.21.15.98:0/2657160793 learned_addr learned my addr 172.21.15.98:0/2657160793 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7854d9700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x55837611e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 -- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558376137f60 msgr2=0x558376116710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd785cda700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558376137f60 0x558376116710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558376137f60 0x558376116710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 -- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 msgr2=0x55837611e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x55837611e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 -- 172.21.15.98:0/2657160793 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c00f040 con 0x5583760ef2c0 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd784cd8700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd77c00a000 tx=0x7fd77c019000).ready entity=mon.0 client_cookie=c4686240b076c219 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:06:15.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0146e0 con 0x5583760ef2c0 2023-08-22T00:06:15.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583760e9aa0 con 0x5583760ef2c0 2023-08-22T00:06:15.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fd77c014840 con 0x5583760ef2c0 2023-08-22T00:06:15.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd77c014c10 con 0x5583760ef2c0 2023-08-22T00:06:15.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 10 client.4419 fetch_fsmap learned FSMap version 7 2023-08-22T00:06:15.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558376039f70 con 0x5583760ef2c0 2023-08-22T00:06:15.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583760e9aa0 con 0x5583760ef2c0 2023-08-22T00:06:15.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.208+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd77c01b070 con 0x5583760ef2c0 2023-08-22T00:06:15.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-08-22T00:06:15.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-22T00:06:15.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 20 client.4419 populate_metadata read hostname 'smithi098' 2023-08-22T00:06:15.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x558376119f50 0x55837611a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 4 client.4419 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:06:15.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 --> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558375ea9ef0 con 0x558376119f50 2023-08-22T00:06:15.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7854d9700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x558376119f50 0x55837611a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd7854d9700 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x558376119f50 0x55837611a330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7c3e56ffd0bffc6 server_cookie=c52b05a78257b3a7 in_seq=0 out_seq=0 2023-08-22T00:06:15.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.209+0000 7fd75f7fe700 10 client.4419 ms_handle_connect on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:15.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd75f7fe700 1 -- 172.21.15.98:0/2657160793 <== mds.0 v2:172.21.15.118:6832/3719023028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x558375ea9ef0 con 0x558376119f50 2023-08-22T00:06:15.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd75f7fe700 10 client.4419 handle_command_reply: tid=0 2023-08-22T00:06:15.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 client.4419 shutdown 2023-08-22T00:06:15.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 msgr2=0x558376116220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd77c00a000 tx=0x7fd77c019000).stop 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 shutdown_connections 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x558376119f50 0x55837611a330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558376137f60 0x558376116710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x55837611e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd75f7fe700 0 client.4419 ms_handle_reset on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:15.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/2657160793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583760ef2c0 0x558376116220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 >> 172.21.15.98:0/2657160793 conn(0x558375f59940 msgr2=0x5583760ef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 shutdown_connections 2023-08-22T00:06:15.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 1 -- 172.21.15.98:0/2657160793 wait complete. 2023-08-22T00:06:15.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.210+0000 7fd7990f1b80 20 client.4419 trim_cache size 0 max 16384 2023-08-22T00:06:15.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.226+0000 7fd7990f1b80 1 Processor -- start 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.226+0000 7fd7990f1b80 1 -- start start 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x558376116220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x558376116710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837611d900 con 0x558376137f60 2023-08-22T00:06:15.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558376116c00 con 0x5583760ef2c0 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583760f05c0 con 0x5583760eaaf0 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33018/0 (socket says 172.21.15.98:33018) 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 -- 172.21.15.98:0/3880753029 learned_addr learned my addr 172.21.15.98:0/3880753029 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x558376116710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x558376116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 -- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 msgr2=0x558376116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x558376116220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 -- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 msgr2=0x558376116710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x558376116710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 -- 172.21.15.98:0/3880753029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558376035580 con 0x558376137f60 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.227+0000 7fd785cda700 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd77804f670 tx=0x7fd77807a040).ready entity=mon.0 client_cookie=322f8bf8d65f97c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd76affd700 1 -- 172.21.15.98:0/3880753029 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778059070 con 0x558376137f60 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd76affd700 1 -- 172.21.15.98:0/3880753029 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77804f6e0 con 0x558376137f60 2023-08-22T00:06:15.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd76affd700 1 -- 172.21.15.98:0/3880753029 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778054070 con 0x558376137f60 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3880753029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 msgr2=0x5583761151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd77804f670 tx=0x7fd77807a040).stop 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3880753029 shutdown_connections 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760eaaf0 0x558376116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x5583761151d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3880753029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760ef2c0 0x558376116710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3880753029 >> 172.21.15.98:0/3880753029 conn(0x558375f59940 msgr2=0x5583761383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3880753029 shutdown_connections 2023-08-22T00:06:15.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.228+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3880753029 wait complete. 2023-08-22T00:06:15.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.229+0000 7fd7990f1b80 1 -- start start 2023-08-22T00:06:15.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.229+0000 7fd7990f1b80 1 Processor -- start 2023-08-22T00:06:15.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x558376115460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760ef2c0 0x558376115950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x558376115e40 con 0x558376137f60 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837619a620 con 0x5583760eaaf0 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55837619bde0 con 0x5583760ef2c0 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 10 client.0 ll_register_callbacks cb 0x558375fe1ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33034/0 (socket says 172.21.15.98:33034) 2023-08-22T00:06:15.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 -- 172.21.15.98:0/3800256340 learned_addr learned my addr 172.21.15.98:0/3800256340 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 -- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760ef2c0 msgr2=0x558376115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x558376115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd784cd8700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760ef2c0 0x558376115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760ef2c0 0x558376115950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 -- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 msgr2=0x558376115460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x558376115460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 -- 172.21.15.98:0/3800256340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800a55d0 con 0x558376137f60 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd785cda700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd778009c20 tx=0x7fd778059000).ready entity=mon.0 client_cookie=1d3155efaf3d06f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd75f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77804b530 con 0x558376137f60 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fd77804b690 con 0x558376137f60 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd77c0016d0 con 0x558376137f60 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd77804b850 con 0x558376137f60 2023-08-22T00:06:15.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5583760352d0 con 0x558376137f60 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.230+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c0016d0 con 0x558376137f60 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd778066020 con 0x558376137f60 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 20 client.4425 populate_metadata read hostname 'smithi098' 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x5583760f00b0 0x55837619af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 4 client.4425 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 --> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558375edf040 con 0x5583760f00b0 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x5583760f00b0 0x55837619af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd75f7fe700 10 client.4425 ms_handle_connect on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7854d9700 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x5583760f00b0 0x55837619af60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f0ccb012594825fc server_cookie=71f7213de7741311 in_seq=0 out_seq=0 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd75f7fe700 1 -- 172.21.15.98:0/3800256340 <== mds.0 v2:172.21.15.118:6832/3719023028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558375edf040 con 0x5583760f00b0 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd75f7fe700 10 client.4425 handle_command_reply: tid=0 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 client.4425 shutdown 2023-08-22T00:06:15.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 msgr2=0x55837619aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd778009c20 tx=0x7fd778059000).stop 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 shutdown_connections 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.231+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x5583760f00b0 0x55837619af60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558376137f60 0x55837619aa70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd75f7fe700 0 client.4425 ms_handle_reset on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5583760eaaf0 0x558376115460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 --2- 172.21.15.98:0/3800256340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5583760ef2c0 0x558376115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 >> 172.21.15.98:0/3800256340 conn(0x558375f59940 msgr2=0x5583760eaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 shutdown_connections 2023-08-22T00:06:15.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 1 -- 172.21.15.98:0/3800256340 wait complete. 2023-08-22T00:06:15.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd7990f1b80 20 client.4425 trim_cache size 0 max 16384 2023-08-22T00:06:15.257 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:06:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4285, 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 6.5893562770000003, 2023-08-22T00:06:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 7, 2023-08-22T00:06:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 26, 2023-08-22T00:06:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 25, 2023-08-22T00:06:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 10.976079482999999 2023-08-22T00:06:15.259 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:06:15.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 msgr2=0x7fd7640612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 0x7fd7640612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd77000ca20 tx=0x7fd770015000).stop 2023-08-22T00:06:15.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 msgr2=0x7fd7800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd780083e00 tx=0x7fd77800b040).stop 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 shutdown_connections 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd76405ee10 0x7fd7640612d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76c003910 0x7fd780164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7800a4c80 0x7fd7800a50e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 --2- 172.21.15.98:0/3926242840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd780144d30 0x7fd7801451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 >> 172.21.15.98:0/3926242840 conn(0x7fd7800cb610 msgr2=0x7fd7800abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 shutdown_connections 2023-08-22T00:06:15.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.232+0000 7fd78773d700 1 -- 172.21.15.98:0/3926242840 wait complete. 2023-08-22T00:06:15.262 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:06:15.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.366+0000 7f2636e93700 1 Processor -- start 2023-08-22T00:06:15.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.366+0000 7f2636e93700 1 -- start start 2023-08-22T00:06:15.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.366+0000 7f2636e93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26300aa030 0x7f26300c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2636e93700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300c0060 con 0x7f26300c60a0 2023-08-22T00:06:15.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2636e93700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300c79a0 con 0x7f26300a9c50 2023-08-22T00:06:15.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2636e93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300cade0 con 0x7f26300aa030 2023-08-22T00:06:15.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2635430700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f26300c60a0 0x7f26300aca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52238/0 (socket says 172.21.15.98:52238) 2023-08-22T00:06:15.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2635430700 1 -- 172.21.15.98:0/168202617 learned_addr learned my addr 172.21.15.98:0/168202617 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:15.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262ffff700 1 --2- 172.21.15.98:0/168202617 >> v2:172.21.15.118:3300/0 conn(0x7f26300aa030 0x7f26300c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583978951 0 0) 0x7f26300c0060 con 0x7f26300c60a0 2023-08-22T00:06:15.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26200033f0 con 0x7f26300c60a0 2023-08-22T00:06:15.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323935300 0 0) 0x7f26200033f0 con 0x7f26300c60a0 2023-08-22T00:06:15.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 >> v2:172.21.15.118:3300/0 conn(0x7f26300aa030 msgr2=0x7f26300c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 --2- 172.21.15.98:0/168202617 >> v2:172.21.15.118:3300/0 conn(0x7f26300aa030 0x7f26300c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 >> v1:172.21.15.118:6789/0 conn(0x7f26300a9c50 legacy=0x7f26300c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300c7c80 con 0x7f26300c60a0 2023-08-22T00:06:15.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f26280017f0 con 0x7f26300c60a0 2023-08-22T00:06:15.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 >> v1:172.21.15.98:6789/0 conn(0x7f26300c60a0 legacy=0x7f26300aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26200038e0 0x7f2620003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 0x7f2620004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620005000 0x7f262000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cade0 con 0x7f2620004690 2023-08-22T00:06:15.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262000bf60 con 0x7f2620005000 2023-08-22T00:06:15.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262000c0f0 con 0x7f26200038e0 2023-08-22T00:06:15.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f262ffff700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 0x7f2620004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2635430700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620005000 0x7f262000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.367+0000 7f2634c2f700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26200038e0 0x7f2620003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 -- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26200038e0 msgr2=0x7f2620003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26200038e0 0x7f2620003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 -- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620005000 msgr2=0x7f262000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620005000 0x7f262000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2635430700 1 -- 172.21.15.98:0/168202617 reap_dead start 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 -- 172.21.15.98:0/168202617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200033f0 con 0x7f2620004690 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2634c2f700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26200038e0 0x7f2620003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262ffff700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 0x7f2620004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f26300aa4a0 tx=0x7f261c009060).ready entity=mon.0 client_cookie=f9310d40a1f9e989 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c009430 con 0x7f2620004690 2023-08-22T00:06:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c009e70 con 0x7f2620004690 2023-08-22T00:06:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f262f7fe700 1 -- 172.21.15.98:0/168202617 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00e850 con 0x7f2620004690 2023-08-22T00:06:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 -- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 msgr2=0x7f2620004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 0x7f2620004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f26300aa4a0 tx=0x7f261c009060).stop 2023-08-22T00:06:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 -- 172.21.15.98:0/168202617 shutdown_connections 2023-08-22T00:06:15.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 --2- 172.21.15.98:0/168202617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2620004690 0x7f2620004b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 -- 172.21.15.98:0/168202617 >> 172.21.15.98:0/168202617 conn(0x7f2630082ac0 msgr2=0x7f2630069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 -- 172.21.15.98:0/168202617 shutdown_connections 2023-08-22T00:06:15.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.368+0000 7f2636e93700 1 -- 172.21.15.98:0/168202617 wait complete. 2023-08-22T00:06:15.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 Processor -- start 2023-08-22T00:06:15.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 -- start start 2023-08-22T00:06:15.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 0x7f2630149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26300af710 0x7f26300afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263014b7c0 con 0x7f26300c9a60 2023-08-22T00:06:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300ca3d0 con 0x7f2620004690 2023-08-22T00:06:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.370+0000 7f2636e93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263014a200 con 0x7f26300af710 2023-08-22T00:06:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33052/0 (socket says 172.21.15.98:33052) 2023-08-22T00:06:15.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 -- 172.21.15.98:0/72710079 learned_addr learned my addr 172.21.15.98:0/72710079 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:15.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f2634c2f700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 0x7f2630149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f2635430700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26300af710 0x7f26300afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 -- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26300af710 msgr2=0x7f26300afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26300af710 0x7f26300afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 -- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 msgr2=0x7f2630149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 0x7f2630149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 -- 172.21.15.98:0/72710079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263014e940 con 0x7f26300c9a60 2023-08-22T00:06:15.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f2634c2f700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 0x7f2630149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:15.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262ffff700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f261c01b780 tx=0x7f261c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c009430 con 0x7f26300c9a60 2023-08-22T00:06:15.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c01bcd0 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c024620 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300b0440 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.371+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300b0a00 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.372+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263014b970 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.373+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f261c0123f0 con 0x7f26300c9a60 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.373+0000 7f262cff9700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 0x7f26140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:15.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.373+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f261c07b740 con 0x7f26300c9a60 2023-08-22T00:06:15.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.373+0000 7f2634c2f700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 0x7f26140612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:15.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.373+0000 7f2634c2f700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 0x7f26140612a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2624000f60 tx=0x7f2624009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:15.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.377+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f263014b970 con 0x7f26300c9a60 2023-08-22T00:06:15.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.581+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f263014b970 con 0x7f26300c9a60 2023-08-22T00:06:15.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.581+0000 7f262cff9700 1 -- 172.21.15.98:0/72710079 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f263014b970 con 0x7f26300c9a60 2023-08-22T00:06:15.583 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-22T00:06:15.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 msgr2=0x7f26140612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 0x7f26140612a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2624000f60 tx=0x7f2624009040).stop 2023-08-22T00:06:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 msgr2=0x7f26300c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f261c01b780 tx=0x7f261c01a000).stop 2023-08-22T00:06:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 shutdown_connections 2023-08-22T00:06:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f261405ede0 0x7f26140612a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26300af710 0x7f26300afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620004690 0x7f2630149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 --2- 172.21.15.98:0/72710079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26300c9a60 0x7f26300c9ee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:15.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 >> 172.21.15.98:0/72710079 conn(0x7f2630082ac0 msgr2=0x7f26300c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:15.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 shutdown_connections 2023-08-22T00:06:15.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:15.583+0000 7f2636e93700 1 -- 172.21.15.98:0/72710079 wait complete. 2023-08-22T00:06:15.595 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-22T00:06:15.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:06:15.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:06:15.596 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-22T00:06:15.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:15.596 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-22T00:06:15.597 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:06:15.597 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:06:15.597 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-22T00:06:15.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:15.598 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:06:15.616 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42530sec preferred_lft 42530sec 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:06:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:15.620 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-22T00:06:15.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:15.621 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:15.621 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:15.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2023-08-22T00:06:15.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2023-08-22T00:06:15.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2023-08-22T00:06:15.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-22T00:06:15.622 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:15.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:15.775 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:06:15.806 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:06:15.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:15.808 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:06:15.887 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:06:15.887 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:06:15.887 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:06:15.888 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:06:15.888 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:06:15.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:15.889 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:15.889 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:15.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:06:15.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:06:15.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:06:15.890 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:16.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:16.174 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:06:16.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:16.192 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-08-22T00:06:16.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:16.251 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:16.251 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:16.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-22T00:06:16.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-22T00:06:16.252 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:16.345 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-22T00:06:16.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:16.347 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:16.348 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:16.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-22T00:06:16.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-22T00:06:16.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-22T00:06:16.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-22T00:06:16.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-22T00:06:16.352 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:16.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:16.587 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:16.587 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:16.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:06:16.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2023-08-22T00:06:16.588 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:16.693 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-22T00:06:16.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:16.694 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:16.713 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-22T00:06:16.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:16.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:06:16.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:06:16.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:16.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:16.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:16.871 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:16.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:16.871 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:16.929 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:06:16.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:16.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:16.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:17.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:17.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi098.stderr:2023-08-22T00:06:17.053+0000 7f693fbbb3c0 -1 init, newargv = 0x55eb857c7820 newargc=15 2023-08-22T00:06:17.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi098.stderr:ceph-fuse[123886]: starting ceph client 2023-08-22T00:06:17.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi098.stderr:ceph-fuse[123886]: starting fuse 2023-08-22T00:06:17.073 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:17.074 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:17.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:17.075 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:17.132 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:06:17.132 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:06:17.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:06:17.133 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:06:17.133 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:06:17.134 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:06:17.134 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:06:17.134 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:17.134 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:06:17.135 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-22T00:06:17.135 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:06:17.136 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-22T00:06:17.136 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:17.137 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:06:17.137 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:06:17.137 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:06:17.138 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:06:17.138 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:17.138 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:06:17.139 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:06:17.139 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:06:17.139 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:06:17.139 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:06:17.140 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:06:17.140 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:06:17.140 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:06:17.141 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:17.141 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.admin")) 2023-08-22T00:06:17.141 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:06:17.255 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.admin.123886.asok 2023-08-22T00:06:17.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.123886.asok 2023-08-22T00:06:17.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:17.439 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.123886.asok status 2023-08-22T00:06:17.590 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:06:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:06:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:06:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:06:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "admin", 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "123886", 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:06:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4440, 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 4440 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3658639146 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3658639146 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.4440 192.168.0.1:0/3658639146", 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/3658639146", 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 7, 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 26, 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:06:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:06:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:06:17.595 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:06:17.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:17.600 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:06:17.600 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:17.626 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:06:17.627 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:17.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:17.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:17.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:17.698 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-22T00:06:17.803 INFO:teuthology.orchestra.run.smithi098.stdout:# file: . 2023-08-22T00:06:17.803 INFO:teuthology.orchestra.run.smithi098.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-22T00:06:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:17.804 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:06:17.804 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:06:17.804 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-22T00:06:17.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi098.stderr:ceph-fuse[123886]: fuse finished with error 0 and tester_r 0 2023-08-22T00:06:17.843 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:06:23.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:06:23.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:23.947 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-22T00:06:23.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:24.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.148+0000 7f000ba84700 1 Processor -- start 2023-08-22T00:06:24.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.148+0000 7f000ba84700 1 -- start start 2023-08-22T00:06:24.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000ba84700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0004154260 0x7f00040c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000ba84700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f00040c64a0 0x7f0004154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000ba84700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040c4fb0 con 0x7f00040bc850 2023-08-22T00:06:24.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000ba84700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000414e7b0 con 0x7f00040c64a0 2023-08-22T00:06:24.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000ba84700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040bcfc0 con 0x7f0004154260 2023-08-22T00:06:24.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f00040c64a0 0x7f0004154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f00040c64a0 0x7f0004154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42782/0 (socket says 172.21.15.98:42782) 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 -- 172.21.15.98:0/1927538110 learned_addr learned my addr 172.21.15.98:0/1927538110 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 -- 172.21.15.98:0/1927538110 >> v2:172.21.15.118:3300/0 conn(0x7f0004154260 msgr2=0x7f00040c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f0009820700 1 --2- 172.21.15.98:0/1927538110 >> v2:172.21.15.118:3300/0 conn(0x7f0004154260 0x7f00040c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 --2- 172.21.15.98:0/1927538110 >> v2:172.21.15.118:3300/0 conn(0x7f0004154260 0x7f00040c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 -- 172.21.15.98:0/1927538110 >> v1:172.21.15.118:6789/0 conn(0x7f00040bc850 legacy=0x7f0004154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:24.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 -- 172.21.15.98:0/1927538110 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040bd2a0 con 0x7f00040c64a0 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.149+0000 7f000a021700 1 --2- 172.21.15.98:0/1927538110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040c64a0 0x7f0004154d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0004064f50 tx=0x7efffc009840).ready entity=mon.0 client_cookie=67bfc47f9efdbe05 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000881e700 1 -- 172.21.15.98:0/1927538110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00e070 con 0x7f00040c64a0 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000881e700 1 -- 172.21.15.98:0/1927538110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00baa0 con 0x7f00040c64a0 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000881e700 1 -- 172.21.15.98:0/1927538110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00be20 con 0x7f00040c64a0 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 -- 172.21.15.98:0/1927538110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040c64a0 msgr2=0x7f0004154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 --2- 172.21.15.98:0/1927538110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040c64a0 0x7f0004154d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0004064f50 tx=0x7efffc009840).stop 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 -- 172.21.15.98:0/1927538110 shutdown_connections 2023-08-22T00:06:24.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 --2- 172.21.15.98:0/1927538110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040c64a0 0x7f0004154d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 --2- 172.21.15.98:0/1927538110 >> v2:172.21.15.118:3300/0 conn(0x7f0004154260 0x7f00040c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 -- 172.21.15.98:0/1927538110 >> 172.21.15.98:0/1927538110 conn(0x7f00040c3980 msgr2=0x7f00040c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 -- 172.21.15.98:0/1927538110 shutdown_connections 2023-08-22T00:06:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.150+0000 7f000ba84700 1 -- 172.21.15.98:0/1927538110 wait complete. 2023-08-22T00:06:24.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.152+0000 7f000ba84700 1 Processor -- start 2023-08-22T00:06:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.152+0000 7f000ba84700 1 -- start start 2023-08-22T00:06:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00040c64a0 0x7f00041585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0004154260 0x7f0004158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004158fa0 con 0x7f00040bc850 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040acef0 con 0x7f00040c64a0 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00041522c0 con 0x7f0004154260 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42798/0 (socket says 172.21.15.98:42798) 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 -- 172.21.15.98:0/201223893 learned_addr learned my addr 172.21.15.98:0/201223893 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000901f700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00040c64a0 0x7f00041585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000a021700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0004154260 0x7f0004158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 -- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0004154260 msgr2=0x7f0004158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0004154260 0x7f0004158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 -- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00040c64a0 msgr2=0x7f00041585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00040c64a0 0x7f00041585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 -- 172.21.15.98:0/201223893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc009ae0 con 0x7f00040bc850 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f0009820700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f000000c650 tx=0x7f0000008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000010580 con 0x7f00040bc850 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00000106e0 con 0x7f00040bc850 2023-08-22T00:06:24.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000414d280 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.153+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000010a80 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.154+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040acc10 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.155+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004047480 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.155+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f000001b460 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.155+0000 7efff9ffb700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 0x7effe80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.155+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f0000079ef0 con 0x7f00040bc850 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.155+0000 7f000901f700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 0x7effe80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.156+0000 7f000901f700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 0x7effe80612d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f00040a9ac0 tx=0x7efff4006ee0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.159+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f000004b050 con 0x7f00040bc850 2023-08-22T00:06:24.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.323+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00040bd580 con 0x7f00040bc850 2023-08-22T00:06:24.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.324+0000 7efff9ffb700 1 -- 172.21.15.98:0/201223893 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f000004e670 con 0x7f00040bc850 2023-08-22T00:06:24.326 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:24.327 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 msgr2=0x7effe80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 0x7effe80612d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f00040a9ac0 tx=0x7efff4006ee0).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 msgr2=0x7f000414cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f000000c650 tx=0x7f0000008040).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 shutdown_connections 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effe805ee10 0x7effe80612d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0004154260 0x7f0004158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00040bc850 0x7f000414cd90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 --2- 172.21.15.98:0/201223893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00040c64a0 0x7f00041585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 >> 172.21.15.98:0/201223893 conn(0x7f00040c3980 msgr2=0x7f00041596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:24.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 shutdown_connections 2023-08-22T00:06:24.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.326+0000 7f000ba84700 1 -- 172.21.15.98:0/201223893 wait complete. 2023-08-22T00:06:24.343 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:24.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.458+0000 7f727ce38700 1 Processor -- start 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.458+0000 7f727ce38700 1 -- start start 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.459+0000 7f727ce38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c64a0 0x7f7278154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.459+0000 7f727ce38700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72780c2030 0x7f72780bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.459+0000 7f727ce38700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780bcd40 con 0x7f7278154260 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.459+0000 7f727ce38700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72780c24b0 con 0x7f72780c2030 2023-08-22T00:06:24.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.459+0000 7f727ce38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727814e7b0 con 0x7f72780c64a0 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72780c2030 0x7f72780bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7278154260 0x7f7278154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47470/0 (socket says 172.21.15.98:47470) 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727659c700 1 -- 172.21.15.98:0/791745105 learned_addr learned my addr 172.21.15.98:0/791745105 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7275d9b700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c64a0 0x7f7278154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 -- 172.21.15.98:0/791745105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c64a0 msgr2=0x7f7278154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c64a0 0x7f7278154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 -- 172.21.15.98:0/791745105 >> v1:172.21.15.98:6789/0 conn(0x7f7278154260 legacy=0x7f7278154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 -- 172.21.15.98:0/791745105 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780c4fb0 con 0x7f72780c2030 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727559a700 1 -- 172.21.15.98:0/791745105 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348731683 0 0) 0x7f72780bcd40 con 0x7f7278154260 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f7276d9d700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c2030 0x7f72780bc850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7270009e90 tx=0x7f7270009780).ready entity=mon.0 client_cookie=5d4d5c2c8e891250 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727559a700 1 -- 172.21.15.98:0/791745105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000e070 con 0x7f72780c2030 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727559a700 1 -- 172.21.15.98:0/791745105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000bc50 con 0x7f72780c2030 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.460+0000 7f727559a700 1 -- 172.21.15.98:0/791745105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270012410 con 0x7f72780c2030 2023-08-22T00:06:24.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 -- 172.21.15.98:0/791745105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c2030 msgr2=0x7f72780bc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c2030 0x7f72780bc850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7270009e90 tx=0x7f7270009780).stop 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 -- 172.21.15.98:0/791745105 shutdown_connections 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c2030 0x7f72780bc850 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 --2- 172.21.15.98:0/791745105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c64a0 0x7f7278154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 -- 172.21.15.98:0/791745105 >> 172.21.15.98:0/791745105 conn(0x7f72780c3980 msgr2=0x7f72780c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 -- 172.21.15.98:0/791745105 shutdown_connections 2023-08-22T00:06:24.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.461+0000 7f727ce38700 1 -- 172.21.15.98:0/791745105 wait complete. 2023-08-22T00:06:24.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.462+0000 7f727ce38700 1 Processor -- start 2023-08-22T00:06:24.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.462+0000 7f727ce38700 1 -- start start 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c2030 0x7f727814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7278154260 0x7f7278140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780a8940 con 0x7f72780c64a0 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278167650 con 0x7f7278154260 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278167910 con 0x7f72780c2030 2023-08-22T00:06:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42812/0 (socket says 172.21.15.98:42812) 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 -- 172.21.15.98:0/1296676812 learned_addr learned my addr 172.21.15.98:0/1296676812 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727659c700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c2030 0x7f727814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7276d9d700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7278154260 0x7f7278140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 -- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c2030 msgr2=0x7f727814d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c2030 0x7f727814d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 -- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7278154260 msgr2=0x7f7278140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7278154260 0x7f7278140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 -- 172.21.15.98:0/1296676812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009a20 con 0x7f72780c64a0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f7275d9b700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f726800d890 tx=0x7f7268008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268011590 con 0x7f72780c64a0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72680116f0 con 0x7f72780c64a0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7278167bf0 con 0x7f72780c64a0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268011a70 con 0x7f72780c64a0 2023-08-22T00:06:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.463+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72781672d0 con 0x7f72780c64a0 2023-08-22T00:06:24.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.464+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72780a8ab0 con 0x7f72780c64a0 2023-08-22T00:06:24.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.465+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7268012420 con 0x7f72780c64a0 2023-08-22T00:06:24.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.465+0000 7f726e7fc700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 0x7f72580612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.465+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7268079b70 con 0x7f72780c64a0 2023-08-22T00:06:24.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.465+0000 7f727659c700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 0x7f72580612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.465+0000 7f727659c700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 0x7f72580612d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f726000c7d0 tx=0x7f7260009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.469+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72780a8ab0 con 0x7f72780c64a0 2023-08-22T00:06:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.633+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72780a8a80 con 0x7f72780c64a0 2023-08-22T00:06:24.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.634+0000 7f726e7fc700 1 -- 172.21.15.98:0/1296676812 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f726804ac70 con 0x7f72780c64a0 2023-08-22T00:06:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:24.636 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:24.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 msgr2=0x7f72580612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 0x7f72580612d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f726000c7d0 tx=0x7f7260009040).stop 2023-08-22T00:06:24.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 msgr2=0x7f7278151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f726800d890 tx=0x7f7268008040).stop 2023-08-22T00:06:24.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 shutdown_connections 2023-08-22T00:06:24.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f725805ee10 0x7f72580612d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72780c2030 0x7f727814d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7278154260 0x7f7278140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 --2- 172.21.15.98:0/1296676812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72780c64a0 0x7f7278151e40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 >> 172.21.15.98:0/1296676812 conn(0x7f72780c3980 msgr2=0x7f7278066280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:24.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 shutdown_connections 2023-08-22T00:06:24.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.636+0000 7f727ce38700 1 -- 172.21.15.98:0/1296676812 wait complete. 2023-08-22T00:06:24.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:06:24.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.768+0000 7fc37cc6b700 1 Processor -- start 2023-08-22T00:06:24.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.768+0000 7fc37cc6b700 1 -- start start 2023-08-22T00:06:24.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc378151e10 0x7fc3780a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 0x7fc3780c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 0x7fc378066000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780c3d60 con 0x7fc378151e10 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780a9f50 con 0x7fc3780c2950 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37cc6b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780c3150 con 0x7fc3780a9ad0 2023-08-22T00:06:24.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.769+0000 7fc37659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc378151e10 0x7fc3780a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc378151e10 0x7fc3780a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42816/0 (socket says 172.21.15.98:42816) 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 -- 172.21.15.98:0/3775010542 learned_addr learned my addr 172.21.15.98:0/3775010542 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc36ffff700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 0x7fc3780c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc376d9d700 1 --2- 172.21.15.98:0/3775010542 >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 0x7fc378066000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 -- 172.21.15.98:0/3775010542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 msgr2=0x7fc3780c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 0x7fc3780c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 -- 172.21.15.98:0/3775010542 >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 msgr2=0x7fc378066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:24.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 --2- 172.21.15.98:0/3775010542 >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 0x7fc378066000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 -- 172.21.15.98:0/3775010542 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780c3430 con 0x7fc378151e10 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc376d9d700 1 --2- 172.21.15.98:0/3775010542 >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 0x7fc378066000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc36ffff700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 0x7fc3780c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc37659c700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc378151e10 0x7fc3780a95e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3780be870 tx=0x7fc3680090f0).ready entity=mon.0 client_cookie=b4c57202ca6d447c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc375d9b700 1 -- 172.21.15.98:0/3775010542 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800b600 con 0x7fc378151e10 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc375d9b700 1 -- 172.21.15.98:0/3775010542 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36800b760 con 0x7fc378151e10 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.770+0000 7fc375d9b700 1 -- 172.21.15.98:0/3775010542 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800bb00 con 0x7fc378151e10 2023-08-22T00:06:24.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3775010542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc378151e10 msgr2=0x7fc3780a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc378151e10 0x7fc3780a95e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3780be870 tx=0x7fc3680090f0).stop 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3775010542 shutdown_connections 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3775010542 >> v2:172.21.15.118:3300/0 conn(0x7fc3780c2950 0x7fc378066000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc378151e10 0x7fc3780a95e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3775010542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3780a9ad0 0x7fc3780c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3775010542 >> 172.21.15.98:0/3775010542 conn(0x7fc3780c7820 msgr2=0x7fc3780c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:24.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3775010542 shutdown_connections 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.771+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3775010542 wait complete. 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 Processor -- start 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 -- start start 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3780a9ad0 0x7fc37814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc378151e10 0x7fc378064b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc378065070 con 0x7fc3780c2950 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37814ad60 con 0x7fc3780a9ad0 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.772+0000 7fc37cc6b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780aa900 con 0x7fc378151e10 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42830/0 (socket says 172.21.15.98:42830) 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 -- 172.21.15.98:0/3410890708 learned_addr learned my addr 172.21.15.98:0/3410890708 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 -- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc378151e10 msgr2=0x7fc378064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc378151e10 0x7fc378064b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 -- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3780a9ad0 msgr2=0x7fc37814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3780a9ad0 0x7fc37814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 -- 172.21.15.98:0/3410890708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368009370 con 0x7fc3780c2950 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36ffff700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc36000c8b0 tx=0x7fc360008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360010580 con 0x7fc3780c2950 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600106e0 con 0x7fc3780c2950 2023-08-22T00:06:24.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc378153cd0 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360010a60 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.773+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc378154290 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.774+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3780691b0 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.774+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc36001b460 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.775+0000 7fc36e7fc700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 0x7fc3580612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.775+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fc36007a090 con 0x7fc3780c2950 2023-08-22T00:06:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.775+0000 7fc37659c700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 0x7fc3580612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.775+0000 7fc37659c700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 0x7fc3580612d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc36800b3c0 tx=0x7fc368017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.779+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc36004b190 con 0x7fc3780c2950 2023-08-22T00:06:24.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:24.980+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3780aaa40 con 0x7fc3780c2950 2023-08-22T00:06:25.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.126+0000 7fc36e7fc700 1 -- 172.21.15.98:0/3410890708 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc36004e7b0 con 0x7fc3780c2950 2023-08-22T00:06:25.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 msgr2=0x7fc3580612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 0x7fc3580612d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc36800b3c0 tx=0x7fc368017000).stop 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 msgr2=0x7fc378064690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc36000c8b0 tx=0x7fc360008040).stop 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 shutdown_connections 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35805ee10 0x7fc3580612d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc378151e10 0x7fc378064b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:25.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3780a9ad0 0x7fc37814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:25.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 --2- 172.21.15.98:0/3410890708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3780c2950 0x7fc378064690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:25.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 >> 172.21.15.98:0/3410890708 conn(0x7fc3780c7820 msgr2=0x7fc37814e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:25.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 shutdown_connections 2023-08-22T00:06:25.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.128+0000 7fc37cc6b700 1 -- 172.21.15.98:0/3410890708 wait complete. 2023-08-22T00:06:25.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:06:25.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.262+0000 7f916ac63700 1 Processor -- start 2023-08-22T00:06:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.262+0000 7f916ac63700 1 -- start start 2023-08-22T00:06:25.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f916ac63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 0x7f916415c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:25.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f916ac63700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91641560a0 con 0x7f9164154e90 2023-08-22T00:06:25.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f916ac63700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9164155770 con 0x7f9164155270 2023-08-22T00:06:25.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f916ac63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c2e10 con 0x7f91640a6e50 2023-08-22T00:06:25.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f91689ff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9164154e90 0x7f91640640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47484/0 (socket says 172.21.15.98:47484) 2023-08-22T00:06:25.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f91689ff700 1 -- 172.21.15.98:0/695707088 learned_addr learned my addr 172.21.15.98:0/695707088 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:25.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f9169200700 1 --2- 172.21.15.98:0/695707088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 0x7f916415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:25.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242311090 0 0) 0x7f91641560a0 con 0x7f9164154e90 2023-08-22T00:06:25.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.263+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91540033f0 con 0x7f9164154e90 2023-08-22T00:06:25.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239227982 0 0) 0x7f9164155770 con 0x7f9164155270 2023-08-22T00:06:25.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91641560a0 con 0x7f9164155270 2023-08-22T00:06:25.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f9169200700 1 -- 172.21.15.98:0/695707088 >> v1:172.21.15.118:6789/0 conn(0x7f9164155270 legacy=0x7f91640a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f9169200700 1 -- 172.21.15.98:0/695707088 >> v1:172.21.15.98:6789/0 conn(0x7f9164154e90 legacy=0x7f91640640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851180229 0 0) 0x7f91540033f0 con 0x7f9164154e90 2023-08-22T00:06:25.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f9169200700 1 -- 172.21.15.98:0/695707088 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164155a50 con 0x7f91640a6e50 2023-08-22T00:06:25.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f9169200700 1 --2- 172.21.15.98:0/695707088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 0x7f916415c860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f915c009e90 tx=0x7f915c009780).ready entity=mon.2 client_cookie=22479dd30e773e74 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:25.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00e070 con 0x7f91640a6e50 2023-08-22T00:06:25.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c00b7a0 con 0x7f91640a6e50 2023-08-22T00:06:25.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.264+0000 7f91637fe700 1 -- 172.21.15.98:0/695707088 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158001470 con 0x7f91640a6e50 2023-08-22T00:06:25.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 -- 172.21.15.98:0/695707088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 msgr2=0x7f916415c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 --2- 172.21.15.98:0/695707088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 0x7f916415c860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f915c009e90 tx=0x7f915c009780).stop 2023-08-22T00:06:25.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 -- 172.21.15.98:0/695707088 shutdown_connections 2023-08-22T00:06:25.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 --2- 172.21.15.98:0/695707088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91640a6e50 0x7f916415c860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:25.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 -- 172.21.15.98:0/695707088 >> 172.21.15.98:0/695707088 conn(0x7f91640c7800 msgr2=0x7f91640c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:25.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 -- 172.21.15.98:0/695707088 shutdown_connections 2023-08-22T00:06:25.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.265+0000 7f916ac63700 1 -- 172.21.15.98:0/695707088 wait complete. 2023-08-22T00:06:25.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.266+0000 7f916ac63700 1 Processor -- start 2023-08-22T00:06:25.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.266+0000 7f916ac63700 1 -- start start 2023-08-22T00:06:25.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:25.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9164154e90 0x7f91640a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:25.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 0x7f91640a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:25.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c6220 con 0x7f91640a6e50 2023-08-22T00:06:25.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640a9eb0 con 0x7f91640a4f50 2023-08-22T00:06:25.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640bf800 con 0x7f9164154e90 2023-08-22T00:06:25.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:25.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42846/0 (socket says 172.21.15.98:42846) 2023-08-22T00:06:25.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 -- 172.21.15.98:0/1772866113 learned_addr learned my addr 172.21.15.98:0/1772866113 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:25.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9169200700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 0x7f91640a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:25.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9163fff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9164154e90 0x7f91640a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:25.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 -- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9164154e90 msgr2=0x7f91640a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9164154e90 0x7f91640a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:25.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 -- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 msgr2=0x7f91640a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:25.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 0x7f91640a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:25.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 -- 172.21.15.98:0/1772866113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009a20 con 0x7f91640a6e50 2023-08-22T00:06:25.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9169200700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 0x7f91640a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:25.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f91689ff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f915800c810 tx=0x7f9158001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:25.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158007170 con 0x7f91640a6e50 2023-08-22T00:06:25.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91580072f0 con 0x7f91640a6e50 2023-08-22T00:06:25.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91641544b0 con 0x7f91640a6e50 2023-08-22T00:06:25.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580048c0 con 0x7f91640a6e50 2023-08-22T00:06:25.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.267+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640a56f0 con 0x7f91640a6e50 2023-08-22T00:06:25.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9164069220 con 0x7f91640a6e50 2023-08-22T00:06:25.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9158004c70 con 0x7f91640a6e50 2023-08-22T00:06:25.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f9160ff9700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 0x7f91480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:25.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f915807a250 con 0x7f91640a6e50 2023-08-22T00:06:25.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f9163fff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 0x7f91480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:25.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.269+0000 7f9163fff700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 0x7f91480612d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91640c73b0 tx=0x7f9150009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:25.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.273+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f915804b3b0 con 0x7f91640a6e50 2023-08-22T00:06:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:25.474+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9164155d30 con 0x7f91640a6e50 2023-08-22T00:06:26.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.131+0000 7f9160ff9700 1 -- 172.21.15.98:0/1772866113 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f915804e9d0 con 0x7f91640a6e50 2023-08-22T00:06:26.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 msgr2=0x7f91480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 0x7f91480612d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91640c73b0 tx=0x7f9150009040).stop 2023-08-22T00:06:26.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 msgr2=0x7f91640c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f915800c810 tx=0x7f9158001b50).stop 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 shutdown_connections 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91640a4f50 0x7f91640a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91640a6e50 0x7f91640c5d30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f914805ee10 0x7f91480612d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 --2- 172.21.15.98:0/1772866113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9164154e90 0x7f91640a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 >> 172.21.15.98:0/1772866113 conn(0x7f91640c7800 msgr2=0x7f916414e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 shutdown_connections 2023-08-22T00:06:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.133+0000 7f916ac63700 1 -- 172.21.15.98:0/1772866113 wait complete. 2023-08-22T00:06:26.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:26.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.276+0000 7fa32c013700 1 Processor -- start 2023-08-22T00:06:26.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.276+0000 7fa32c013700 1 -- start start 2023-08-22T00:06:26.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32c013700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa324153f40 0x7fa324157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32c013700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa324157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32c013700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240a8410 con 0x7fa324153b60 2023-08-22T00:06:26.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32c013700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3240a8cb0 con 0x7fa324153f40 2023-08-22T00:06:26.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32c013700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241586a0 con 0x7fa3240a9140 2023-08-22T00:06:26.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa3295ae700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa324153f40 0x7fa324157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa329daf700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa324153b60 0x7fa324068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47492/0 (socket says 172.21.15.98:47492) 2023-08-22T00:06:26.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa329daf700 1 -- 172.21.15.98:0/1665571470 learned_addr learned my addr 172.21.15.98:0/1665571470 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:26.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.277+0000 7fa32a5b0700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa324157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa3295ae700 1 -- 172.21.15.98:0/1665571470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 msgr2=0x7fa324157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:26.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa3295ae700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa324157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa3295ae700 1 -- 172.21.15.98:0/1665571470 >> v1:172.21.15.98:6789/0 conn(0x7fa324153b60 legacy=0x7fa324068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa3295ae700 1 -- 172.21.15.98:0/1665571470 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240a8660 con 0x7fa324153f40 2023-08-22T00:06:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa328dad700 1 -- 172.21.15.98:0/1665571470 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728116987 0 0) 0x7fa3240a8410 con 0x7fa324153b60 2023-08-22T00:06:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa3295ae700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153f40 0x7fa324157930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa320009760 tx=0x7fa320009060).ready entity=mon.0 client_cookie=62c5a607b11c961 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa328dad700 1 -- 172.21.15.98:0/1665571470 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000b580 con 0x7fa324153f40 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa328dad700 1 -- 172.21.15.98:0/1665571470 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b6e0 con 0x7fa324153f40 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa328dad700 1 -- 172.21.15.98:0/1665571470 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000ba60 con 0x7fa324153f40 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 -- 172.21.15.98:0/1665571470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153f40 msgr2=0x7fa324157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153f40 0x7fa324157930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa320009760 tx=0x7fa320009060).stop 2023-08-22T00:06:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 -- 172.21.15.98:0/1665571470 shutdown_connections 2023-08-22T00:06:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa324157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 --2- 172.21.15.98:0/1665571470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153f40 0x7fa324157930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 -- 172.21.15.98:0/1665571470 >> 172.21.15.98:0/1665571470 conn(0x7fa3240c5dc0 msgr2=0x7fa324068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 -- 172.21.15.98:0/1665571470 shutdown_connections 2023-08-22T00:06:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.278+0000 7fa32c013700 1 -- 172.21.15.98:0/1665571470 wait complete. 2023-08-22T00:06:26.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 Processor -- start 2023-08-22T00:06:26.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 -- start start 2023-08-22T00:06:26.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa32414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 0x7fa32414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c2750 con 0x7fa324153b60 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32414a8d0 con 0x7fa324153f40 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa32c013700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c2470 con 0x7fa3240a9140 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa3295ae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa3295ae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42860/0 (socket says 172.21.15.98:42860) 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.280+0000 7fa3295ae700 1 -- 172.21.15.98:0/1920119445 learned_addr learned my addr 172.21.15.98:0/1920119445 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa329daf700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa32414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa32a5b0700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 0x7fa32414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 -- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 msgr2=0x7fa32414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa32414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 -- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 msgr2=0x7fa32414a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 0x7fa32414a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 -- 172.21.15.98:0/1920119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200092a0 con 0x7fa324153b60 2023-08-22T00:06:26.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa32a5b0700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 0x7fa32414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:26.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa3295ae700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa320009eb0 tx=0x7fa320017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000b850 con 0x7fa324153b60 2023-08-22T00:06:26.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b9b0 con 0x7fa324153b60 2023-08-22T00:06:26.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32414ee70 con 0x7fa324153b60 2023-08-22T00:06:26.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32001b640 con 0x7fa324153b60 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.281+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32414f430 con 0x7fa324153b60 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.282+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa324047480 con 0x7fa324153b60 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.283+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa32001ba70 con 0x7fa324153b60 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.283+0000 7fa315ffb700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 0x7fa3080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.283+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa32007bba0 con 0x7fa324153b60 2023-08-22T00:06:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.283+0000 7fa329daf700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 0x7fa3080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.283+0000 7fa329daf700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 0x7fa3080612d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa3180011e0 tx=0x7fa318009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.287+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa32004cd00 con 0x7fa324153b60 2023-08-22T00:06:26.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.489+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3240a8940 con 0x7fa324153b60 2023-08-22T00:06:26.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.489+0000 7fa315ffb700 1 -- 172.21.15.98:0/1920119445 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7fa32001f020 con 0x7fa324153b60 2023-08-22T00:06:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:26.498 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:06:26.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 msgr2=0x7fa3080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 0x7fa3080612d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa3180011e0 tx=0x7fa318009040).stop 2023-08-22T00:06:26.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 msgr2=0x7fa3240c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa320009eb0 tx=0x7fa320017000).stop 2023-08-22T00:06:26.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 shutdown_connections 2023-08-22T00:06:26.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa30805ee10 0x7fa3080612d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3240a9140 0x7fa32414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa324153f40 0x7fa32414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 --2- 172.21.15.98:0/1920119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa324153b60 0x7fa3240c1e70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 >> 172.21.15.98:0/1920119445 conn(0x7fa3240c5dc0 msgr2=0x7fa3241525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:26.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.491+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 shutdown_connections 2023-08-22T00:06:26.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.492+0000 7fa32c013700 1 -- 172.21.15.98:0/1920119445 wait complete. 2023-08-22T00:06:26.504 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:06:26.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:26.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.623+0000 7fc0e3391700 1 Processor -- start 2023-08-22T00:06:26.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 -- start start 2023-08-22T00:06:26.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 0x7fc0dc0bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0bcd40 con 0x7fc0dc154260 2023-08-22T00:06:26.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0c24b0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.624+0000 7fc0e3391700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc14e7b0 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:47304/0 (socket says 172.21.15.98:47304) 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 -- 172.21.15.98:0/154202298 learned_addr learned my addr 172.21.15.98:0/154202298 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e192e700 1 --2- 172.21.15.98:0/154202298 >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 0x7fc0dc0bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 -- 172.21.15.98:0/154202298 >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 msgr2=0x7fc0dc0bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 --2- 172.21.15.98:0/154202298 >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 0x7fc0dc0bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 -- 172.21.15.98:0/154202298 >> v1:172.21.15.118:6789/0 conn(0x7fc0dc154260 legacy=0x7fc0dc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 -- 172.21.15.98:0/154202298 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0c4fb0 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e192e700 1 --2- 172.21.15.98:0/154202298 >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 0x7fc0dc0bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0e092c700 1 --2- 172.21.15.98:0/154202298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc0d8006fd0 tx=0x7fc0d80090f0).ready entity=mon.2 client_cookie=a4af6bfedefb292e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0d3fff700 1 -- 172.21.15.98:0/154202298 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800b610 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0d3fff700 1 -- 172.21.15.98:0/154202298 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d800b770 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.625+0000 7fc0d3fff700 1 -- 172.21.15.98:0/154202298 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800baf0 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 -- 172.21.15.98:0/154202298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 msgr2=0x7fc0dc154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 --2- 172.21.15.98:0/154202298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc0d8006fd0 tx=0x7fc0d80090f0).stop 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 -- 172.21.15.98:0/154202298 shutdown_connections 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 --2- 172.21.15.98:0/154202298 >> v2:172.21.15.118:3300/0 conn(0x7fc0dc0c2030 0x7fc0dc0bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 --2- 172.21.15.98:0/154202298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc0c64a0 0x7fc0dc154d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 -- 172.21.15.98:0/154202298 >> 172.21.15.98:0/154202298 conn(0x7fc0dc0c3980 msgr2=0x7fc0dc0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 -- 172.21.15.98:0/154202298 shutdown_connections 2023-08-22T00:06:26.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.626+0000 7fc0e3391700 1 -- 172.21.15.98:0/154202298 wait complete. 2023-08-22T00:06:26.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.627+0000 7fc0e3391700 1 Processor -- start 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.627+0000 7fc0e3391700 1 -- start start 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0dc0c64a0 0x7fc0dc167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc154260 0x7fc0dc152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc168420 con 0x7fc0dc0c2030 2023-08-22T00:06:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0a7530 con 0x7fc0dc0c64a0 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e3391700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0aa1a0 con 0x7fc0dc154260 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42868/0 (socket says 172.21.15.98:42868) 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 -- 172.21.15.98:0/3333525737 learned_addr learned my addr 172.21.15.98:0/3333525737 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e092c700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0dc0c64a0 0x7fc0dc167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e192e700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc154260 0x7fc0dc152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 -- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc154260 msgr2=0x7fc0dc152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc154260 0x7fc0dc152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 -- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0dc0c64a0 msgr2=0x7fc0dc167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0dc0c64a0 0x7fc0dc167f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.628+0000 7fc0e112d700 1 -- 172.21.15.98:0/3333525737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4009a20 con 0x7fc0dc0c2030 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0e112d700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc0cc00c470 tx=0x7fc0cc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc012400 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc012560 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc012900 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d8009370 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.629+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc0a6ee0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.630+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc0bda70 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.630+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc0cc01b3b0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.630+0000 7fc0d17fa700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 0x7fc0c00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.630+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fc0cc0798b0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.630+0000 7fc0e092c700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 0x7fc0c00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.631+0000 7fc0e092c700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 0x7fc0c00612d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc0d8009130 tx=0x7fc0d8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:26.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.634+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0cc04a9b0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.797+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0dc0c6d20 con 0x7fc0dc0c2030 2023-08-22T00:06:26.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.798+0000 7fc0d17fa700 1 -- 172.21.15.98:0/3333525737 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fc0cc04dfd0 con 0x7fc0dc0c2030 2023-08-22T00:06:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:26.874 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:26.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.799+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 msgr2=0x7fc0c00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.799+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 0x7fc0c00612d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc0d8009130 tx=0x7fc0d8017000).stop 2023-08-22T00:06:26.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.799+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 msgr2=0x7fc0dc167a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:26.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.799+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc0cc00c470 tx=0x7fc0cc007db0).stop 2023-08-22T00:06:26.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 shutdown_connections 2023-08-22T00:06:26.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0c005ee10 0x7fc0c00612d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0dc154260 0x7fc0dc152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0dc0c2030 0x7fc0dc167a40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 --2- 172.21.15.98:0/3333525737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0dc0c64a0 0x7fc0dc167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 >> 172.21.15.98:0/3333525737 conn(0x7fc0dc0c3980 msgr2=0x7fc0dc065580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 shutdown_connections 2023-08-22T00:06:26.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.800+0000 7fc0e3391700 1 -- 172.21.15.98:0/3333525737 wait complete. 2023-08-22T00:06:26.879 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:06:26.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:06:26.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.994+0000 7fb38ef69700 1 Processor -- start 2023-08-22T00:06:26.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.994+0000 7fb38ef69700 1 -- start start 2023-08-22T00:06:26.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38ef69700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb388153b60 0x7fb388068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38ef69700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb388153f40 0x7fb388069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38ef69700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880a8410 con 0x7fb3880a9140 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38ef69700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb388069720 con 0x7fb388153f40 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38ef69700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880a8cb0 con 0x7fb388153b60 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb387fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb388153f40 0x7fb388069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38d506700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb3880a9140 0x7fb388157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47498/0 (socket says 172.21.15.98:47498) 2023-08-22T00:06:26.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.995+0000 7fb38d506700 1 -- 172.21.15.98:0/820131419 learned_addr learned my addr 172.21.15.98:0/820131419 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb38cd05700 1 --2- 172.21.15.98:0/820131419 >> v2:172.21.15.118:3300/0 conn(0x7fb388153b60 0x7fb388068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb387fff700 1 -- 172.21.15.98:0/820131419 >> v2:172.21.15.118:3300/0 conn(0x7fb388153b60 msgr2=0x7fb388068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb387fff700 1 --2- 172.21.15.98:0/820131419 >> v2:172.21.15.118:3300/0 conn(0x7fb388153b60 0x7fb388068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb387fff700 1 -- 172.21.15.98:0/820131419 >> v1:172.21.15.98:6789/0 conn(0x7fb3880a9140 legacy=0x7fb388157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb387fff700 1 -- 172.21.15.98:0/820131419 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3881586a0 con 0x7fb388153f40 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb3877fe700 1 -- 172.21.15.98:0/820131419 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447665905 0 0) 0x7fb3880a8410 con 0x7fb3880a9140 2023-08-22T00:06:27.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb387fff700 1 --2- 172.21.15.98:0/820131419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153f40 0x7fb388069230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb38805fcb0 tx=0x7fb374009060).ready entity=mon.0 client_cookie=d5133744ecd9b3ff server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb3877fe700 1 -- 172.21.15.98:0/820131419 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400f510 con 0x7fb388153f40 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb3877fe700 1 -- 172.21.15.98:0/820131419 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400f670 con 0x7fb388153f40 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb3877fe700 1 -- 172.21.15.98:0/820131419 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400f9f0 con 0x7fb388153f40 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb38ef69700 1 -- 172.21.15.98:0/820131419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153f40 msgr2=0x7fb388069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.996+0000 7fb38ef69700 1 --2- 172.21.15.98:0/820131419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153f40 0x7fb388069230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb38805fcb0 tx=0x7fb374009060).stop 2023-08-22T00:06:27.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 -- 172.21.15.98:0/820131419 shutdown_connections 2023-08-22T00:06:27.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 --2- 172.21.15.98:0/820131419 >> v2:172.21.15.118:3300/0 conn(0x7fb388153b60 0x7fb388068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 --2- 172.21.15.98:0/820131419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153f40 0x7fb388069230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 -- 172.21.15.98:0/820131419 >> 172.21.15.98:0/820131419 conn(0x7fb3880c5dc0 msgr2=0x7fb388068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 -- 172.21.15.98:0/820131419 shutdown_connections 2023-08-22T00:06:27.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.997+0000 7fb38ef69700 1 -- 172.21.15.98:0/820131419 wait complete. 2023-08-22T00:06:27.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.998+0000 7fb38ef69700 1 Processor -- start 2023-08-22T00:06:27.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.998+0000 7fb38ef69700 1 -- start start 2023-08-22T00:06:27.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880a9140 0x7fb3880c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388153f40 0x7fb388066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388152230 con 0x7fb388153b60 2023-08-22T00:06:27.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c1f80 con 0x7fb3880a9140 2023-08-22T00:06:27.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c1370 con 0x7fb388153f40 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42878/0 (socket says 172.21.15.98:42878) 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 -- 172.21.15.98:0/3306505432 learned_addr learned my addr 172.21.15.98:0/3306505432 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38cd05700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880a9140 0x7fb3880c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38d506700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388153f40 0x7fb388066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 -- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388153f40 msgr2=0x7fb388066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388153f40 0x7fb388066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 -- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880a9140 msgr2=0x7fb3880c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880a9140 0x7fb3880c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 -- 172.21.15.98:0/3306505432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740092a0 con 0x7fb388153b60 2023-08-22T00:06:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb387fff700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb374009dd0 tx=0x7fb374017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400f7e0 con 0x7fb388153b60 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400f940 con 0x7fb388153b60 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880c1650 con 0x7fb388153b60 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37401b640 con 0x7fb388153b60 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:26.999+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3880c1c10 con 0x7fb388153b60 2023-08-22T00:06:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.000+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb388068630 con 0x7fb388153b60 2023-08-22T00:06:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.001+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb37401b9f0 con 0x7fb388153b60 2023-08-22T00:06:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.001+0000 7fb384ff9700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 0x7fb36c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.001+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb37407b830 con 0x7fb388153b60 2023-08-22T00:06:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.001+0000 7fb38cd05700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 0x7fb36c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.001+0000 7fb38cd05700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 0x7fb36c0612d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb37c009c30 tx=0x7fb37c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.005+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb37404c990 con 0x7fb388153b60 2023-08-22T00:06:27.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.164+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb388047480 con 0x7fb36c05ee10 2023-08-22T00:06:27.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.175+0000 7fb384ff9700 1 -- 172.21.15.98:0/3306505432 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410693 (secure 0 0 0) 0x7fb388047480 con 0x7fb36c05ee10 2023-08-22T00:06:27.185 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:27.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 msgr2=0x7fb36c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 0x7fb36c0612d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb37c009c30 tx=0x7fb37c009060).stop 2023-08-22T00:06:27.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 msgr2=0x7fb3880c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb374009dd0 tx=0x7fb374017000).stop 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 shutdown_connections 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb36c05ee10 0x7fb36c0612d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388153f40 0x7fb388066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880a9140 0x7fb3880c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 --2- 172.21.15.98:0/3306505432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb388153b60 0x7fb3880c0dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 >> 172.21.15.98:0/3306505432 conn(0x7fb3880c5dc0 msgr2=0x7fb388068810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 shutdown_connections 2023-08-22T00:06:27.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.179+0000 7fb38ef69700 1 -- 172.21.15.98:0/3306505432 wait complete. 2023-08-22T00:06:27.190 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:06:27.193 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-08-22T00:06:26.034577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379008,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595712,"statfs":{"total":773094113280,"available":770658009088,"internally_reserved":0,"allocated":2293760,"data_stored":937332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2180,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003200"},"pg_stats":[{"pgid":"3.3f","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678589+0000","last_change":"2023-08-22T00:06:08.291099+0000","last_active":"2023-08-22T00:06:12.678589+0000","last_peered":"2023-08-22T00:06:12.678589+0000","last_clean":"2023-08-22T00:06:12.678589+0000","last_became_active":"2023-08-22T00:06:08.290795+0000","last_became_peered":"2023-08-22T00:06:08.290795+0000","last_unstale":"2023-08-22T00:06:12.678589+0000","last_undegraded":"2023-08-22T00:06:12.678589+0000","last_fullsized":"2023-08-22T00:06:12.678589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673305+0000","last_change":"2023-08-22T00:06:08.656231+0000","last_active":"2023-08-22T00:06:12.673305+0000","last_peered":"2023-08-22T00:06:12.673305+0000","last_clean":"2023-08-22T00:06:12.673305+0000","last_became_active":"2023-08-22T00:06:08.655915+0000","last_became_peered":"2023-08-22T00:06:08.655915+0000","last_unstale":"2023-08-22T00:06:12.673305+0000","last_undegraded":"2023-08-22T00:06:12.673305+0000","last_fullsized":"2023-08-22T00:06:12.673305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684438+0000","last_change":"2023-08-22T00:06:08.288428+0000","last_active":"2023-08-22T00:06:12.684438+0000","last_peered":"2023-08-22T00:06:12.684438+0000","last_clean":"2023-08-22T00:06:12.684438+0000","last_became_active":"2023-08-22T00:06:08.286608+0000","last_became_peered":"2023-08-22T00:06:08.286608+0000","last_unstale":"2023-08-22T00:06:12.684438+0000","last_undegraded":"2023-08-22T00:06:12.684438+0000","last_fullsized":"2023-08-22T00:06:12.684438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671745+0000","last_change":"2023-08-22T00:06:08.662348+0000","last_active":"2023-08-22T00:06:12.671745+0000","last_peered":"2023-08-22T00:06:12.671745+0000","last_clean":"2023-08-22T00:06:12.671745+0000","last_became_active":"2023-08-22T00:06:08.661703+0000","last_became_peered":"2023-08-22T00:06:08.661703+0000","last_unstale":"2023-08-22T00:06:12.671745+0000","last_undegraded":"2023-08-22T00:06:12.671745+0000","last_fullsized":"2023-08-22T00:06:12.671745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675218+0000","last_change":"2023-08-22T00:06:08.287214+0000","last_active":"2023-08-22T00:06:12.675218+0000","last_peered":"2023-08-22T00:06:12.675218+0000","last_clean":"2023-08-22T00:06:12.675218+0000","last_became_active":"2023-08-22T00:06:08.286927+0000","last_became_peered":"2023-08-22T00:06:08.286927+0000","last_unstale":"2023-08-22T00:06:12.675218+0000","last_undegraded":"2023-08-22T00:06:12.675218+0000","last_fullsized":"2023-08-22T00:06:12.675218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666426+0000","last_change":"2023-08-22T00:06:08.656790+0000","last_active":"2023-08-22T00:06:12.666426+0000","last_peered":"2023-08-22T00:06:12.666426+0000","last_clean":"2023-08-22T00:06:12.666426+0000","last_became_active":"2023-08-22T00:06:08.656519+0000","last_became_peered":"2023-08-22T00:06:08.656519+0000","last_unstale":"2023-08-22T00:06:12.666426+0000","last_undegraded":"2023-08-22T00:06:12.666426+0000","last_fullsized":"2023-08-22T00:06:12.666426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672202+0000","last_change":"2023-08-22T00:06:08.293624+0000","last_active":"2023-08-22T00:06:12.672202+0000","last_peered":"2023-08-22T00:06:12.672202+0000","last_clean":"2023-08-22T00:06:12.672202+0000","last_became_active":"2023-08-22T00:06:08.293347+0000","last_became_peered":"2023-08-22T00:06:08.293347+0000","last_unstale":"2023-08-22T00:06:12.672202+0000","last_undegraded":"2023-08-22T00:06:12.672202+0000","last_fullsized":"2023-08-22T00:06:12.672202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681949+0000","last_change":"2023-08-22T00:06:08.659129+0000","last_active":"2023-08-22T00:06:12.681949+0000","last_peered":"2023-08-22T00:06:12.681949+0000","last_clean":"2023-08-22T00:06:12.681949+0000","last_became_active":"2023-08-22T00:06:08.658860+0000","last_became_peered":"2023-08-22T00:06:08.658860+0000","last_unstale":"2023-08-22T00:06:12.681949+0000","last_undegraded":"2023-08-22T00:06:12.681949+0000","last_fullsized":"2023-08-22T00:06:12.681949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673280+0000","last_change":"2023-08-22T00:06:08.289602+0000","last_active":"2023-08-22T00:06:12.673280+0000","last_peered":"2023-08-22T00:06:12.673280+0000","last_clean":"2023-08-22T00:06:12.673280+0000","last_became_active":"2023-08-22T00:06:08.289342+0000","last_became_peered":"2023-08-22T00:06:08.289342+0000","last_unstale":"2023-08-22T00:06:12.673280+0000","last_undegraded":"2023-08-22T00:06:12.673280+0000","last_fullsized":"2023-08-22T00:06:12.673280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666271+0000","last_change":"2023-08-22T00:06:08.661296+0000","last_active":"2023-08-22T00:06:12.666271+0000","last_peered":"2023-08-22T00:06:12.666271+0000","last_clean":"2023-08-22T00:06:12.666271+0000","last_became_active":"2023-08-22T00:06:08.660986+0000","last_became_peered":"2023-08-22T00:06:08.660986+0000","last_unstale":"2023-08-22T00:06:12.666271+0000","last_undegraded":"2023-08-22T00:06:12.666271+0000","last_fullsized":"2023-08-22T00:06:12.666271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673253+0000","last_change":"2023-08-22T00:06:08.288788+0000","last_active":"2023-08-22T00:06:12.673253+0000","last_peered":"2023-08-22T00:06:12.673253+0000","last_clean":"2023-08-22T00:06:12.673253+0000","last_became_active":"2023-08-22T00:06:08.288515+0000","last_became_peered":"2023-08-22T00:06:08.288515+0000","last_unstale":"2023-08-22T00:06:12.673253+0000","last_undegraded":"2023-08-22T00:06:12.673253+0000","last_fullsized":"2023-08-22T00:06:12.673253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666020+0000","last_change":"2023-08-22T00:06:08.658212+0000","last_active":"2023-08-22T00:06:12.666020+0000","last_peered":"2023-08-22T00:06:12.666020+0000","last_clean":"2023-08-22T00:06:12.666020+0000","last_became_active":"2023-08-22T00:06:08.657937+0000","last_became_peered":"2023-08-22T00:06:08.657937+0000","last_unstale":"2023-08-22T00:06:12.666020+0000","last_undegraded":"2023-08-22T00:06:12.666020+0000","last_fullsized":"2023-08-22T00:06:12.666020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671479+0000","last_change":"2023-08-22T00:06:08.297342+0000","last_active":"2023-08-22T00:06:12.671479+0000","last_peered":"2023-08-22T00:06:12.671479+0000","last_clean":"2023-08-22T00:06:12.671479+0000","last_became_active":"2023-08-22T00:06:08.291355+0000","last_became_peered":"2023-08-22T00:06:08.291355+0000","last_unstale":"2023-08-22T00:06:12.671479+0000","last_undegraded":"2023-08-22T00:06:12.671479+0000","last_fullsized":"2023-08-22T00:06:12.671479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674444+0000","last_change":"2023-08-22T00:06:08.660595+0000","last_active":"2023-08-22T00:06:12.674444+0000","last_peered":"2023-08-22T00:06:12.674444+0000","last_clean":"2023-08-22T00:06:12.674444+0000","last_became_active":"2023-08-22T00:06:08.660326+0000","last_became_peered":"2023-08-22T00:06:08.660326+0000","last_unstale":"2023-08-22T00:06:12.674444+0000","last_undegraded":"2023-08-22T00:06:12.674444+0000","last_fullsized":"2023-08-22T00:06:12.674444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666783+0000","last_change":"2023-08-22T00:06:08.289343+0000","last_active":"2023-08-22T00:06:12.666783+0000","last_peered":"2023-08-22T00:06:12.666783+0000","last_clean":"2023-08-22T00:06:12.666783+0000","last_became_active":"2023-08-22T00:06:08.289074+0000","last_became_peered":"2023-08-22T00:06:08.289074+0000","last_unstale":"2023-08-22T00:06:12.666783+0000","last_undegraded":"2023-08-22T00:06:12.666783+0000","last_fullsized":"2023-08-22T00:06:12.666783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670629+0000","last_change":"2023-08-22T00:06:08.665424+0000","last_active":"2023-08-22T00:06:12.670629+0000","last_peered":"2023-08-22T00:06:12.670629+0000","last_clean":"2023-08-22T00:06:12.670629+0000","last_became_active":"2023-08-22T00:06:08.665177+0000","last_became_peered":"2023-08-22T00:06:08.665177+0000","last_unstale":"2023-08-22T00:06:12.670629+0000","last_undegraded":"2023-08-22T00:06:12.670629+0000","last_fullsized":"2023-08-22T00:06:12.670629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678499+0000","last_change":"2023-08-22T00:06:08.291866+0000","last_active":"2023-08-22T00:06:12.678499+0000","last_peered":"2023-08-22T00:06:12.678499+0000","last_clean":"2023-08-22T00:06:12.678499+0000","last_became_active":"2023-08-22T00:06:08.291381+0000","last_became_peered":"2023-08-22T00:06:08.291381+0000","last_unstale":"2023-08-22T00:06:12.678499+0000","last_undegraded":"2023-08-22T00:06:12.678499+0000","last_fullsized":"2023-08-22T00:06:12.678499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665055+0000","last_change":"2023-08-22T00:06:08.658534+0000","last_active":"2023-08-22T00:06:12.665055+0000","last_peered":"2023-08-22T00:06:12.665055+0000","last_clean":"2023-08-22T00:06:12.665055+0000","last_became_active":"2023-08-22T00:06:08.658274+0000","last_became_peered":"2023-08-22T00:06:08.658274+0000","last_unstale":"2023-08-22T00:06:12.665055+0000","last_undegraded":"2023-08-22T00:06:12.665055+0000","last_fullsized":"2023-08-22T00:06:12.665055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666238+0000","last_change":"2023-08-22T00:06:08.287355+0000","last_active":"2023-08-22T00:06:12.666238+0000","last_peered":"2023-08-22T00:06:12.666238+0000","last_clean":"2023-08-22T00:06:12.666238+0000","last_became_active":"2023-08-22T00:06:08.287061+0000","last_became_peered":"2023-08-22T00:06:08.287061+0000","last_unstale":"2023-08-22T00:06:12.666238+0000","last_undegraded":"2023-08-22T00:06:12.666238+0000","last_fullsized":"2023-08-22T00:06:12.666238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671653+0000","last_change":"2023-08-22T00:06:08.662523+0000","last_active":"2023-08-22T00:06:12.671653+0000","last_peered":"2023-08-22T00:06:12.671653+0000","last_clean":"2023-08-22T00:06:12.671653+0000","last_became_active":"2023-08-22T00:06:08.662068+0000","last_became_peered":"2023-08-22T00:06:08.662068+0000","last_unstale":"2023-08-22T00:06:12.671653+0000","last_undegraded":"2023-08-22T00:06:12.671653+0000","last_fullsized":"2023-08-22T00:06:12.671653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664956+0000","last_change":"2023-08-22T00:06:08.286978+0000","last_active":"2023-08-22T00:06:12.664956+0000","last_peered":"2023-08-22T00:06:12.664956+0000","last_clean":"2023-08-22T00:06:12.664956+0000","last_became_active":"2023-08-22T00:06:08.286637+0000","last_became_peered":"2023-08-22T00:06:08.286637+0000","last_unstale":"2023-08-22T00:06:12.664956+0000","last_undegraded":"2023-08-22T00:06:12.664956+0000","last_fullsized":"2023-08-22T00:06:12.664956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672913+0000","last_change":"2023-08-22T00:06:08.659864+0000","last_active":"2023-08-22T00:06:12.672913+0000","last_peered":"2023-08-22T00:06:12.672913+0000","last_clean":"2023-08-22T00:06:12.672913+0000","last_became_active":"2023-08-22T00:06:08.659559+0000","last_became_peered":"2023-08-22T00:06:08.659559+0000","last_unstale":"2023-08-22T00:06:12.672913+0000","last_undegraded":"2023-08-22T00:06:12.672913+0000","last_fullsized":"2023-08-22T00:06:12.672913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:17.797484+0000","last_change":"2023-08-22T00:06:08.296851+0000","last_active":"2023-08-22T00:06:17.797484+0000","last_peered":"2023-08-22T00:06:17.797484+0000","last_clean":"2023-08-22T00:06:17.797484+0000","last_became_active":"2023-08-22T00:06:08.296567+0000","last_became_peered":"2023-08-22T00:06:08.296567+0000","last_unstale":"2023-08-22T00:06:17.797484+0000","last_undegraded":"2023-08-22T00:06:17.797484+0000","last_fullsized":"2023-08-22T00:06:17.797484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673049+0000","last_change":"2023-08-22T00:06:08.665352+0000","last_active":"2023-08-22T00:06:12.673049+0000","last_peered":"2023-08-22T00:06:12.673049+0000","last_clean":"2023-08-22T00:06:12.673049+0000","last_became_active":"2023-08-22T00:06:08.665087+0000","last_became_peered":"2023-08-22T00:06:08.665087+0000","last_unstale":"2023-08-22T00:06:12.673049+0000","last_undegraded":"2023-08-22T00:06:12.673049+0000","last_fullsized":"2023-08-22T00:06:12.673049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667424+0000","last_change":"2023-08-22T00:06:08.288914+0000","last_active":"2023-08-22T00:06:12.667424+0000","last_peered":"2023-08-22T00:06:12.667424+0000","last_clean":"2023-08-22T00:06:12.667424+0000","last_became_active":"2023-08-22T00:06:08.287814+0000","last_became_peered":"2023-08-22T00:06:08.287814+0000","last_unstale":"2023-08-22T00:06:12.667424+0000","last_undegraded":"2023-08-22T00:06:12.667424+0000","last_fullsized":"2023-08-22T00:06:12.667424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671643+0000","last_change":"2023-08-22T00:06:08.654359+0000","last_active":"2023-08-22T00:06:12.671643+0000","last_peered":"2023-08-22T00:06:12.671643+0000","last_clean":"2023-08-22T00:06:12.671643+0000","last_became_active":"2023-08-22T00:06:08.653920+0000","last_became_peered":"2023-08-22T00:06:08.653920+0000","last_unstale":"2023-08-22T00:06:12.671643+0000","last_undegraded":"2023-08-22T00:06:12.671643+0000","last_fullsized":"2023-08-22T00:06:12.671643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673398+0000","last_change":"2023-08-22T00:06:08.282186+0000","last_active":"2023-08-22T00:06:12.673398+0000","last_peered":"2023-08-22T00:06:12.673398+0000","last_clean":"2023-08-22T00:06:12.673398+0000","last_became_active":"2023-08-22T00:06:08.281908+0000","last_became_peered":"2023-08-22T00:06:08.281908+0000","last_unstale":"2023-08-22T00:06:12.673398+0000","last_undegraded":"2023-08-22T00:06:12.673398+0000","last_fullsized":"2023-08-22T00:06:12.673398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666143+0000","last_change":"2023-08-22T00:06:08.662549+0000","last_active":"2023-08-22T00:06:12.666143+0000","last_peered":"2023-08-22T00:06:12.666143+0000","last_clean":"2023-08-22T00:06:12.666143+0000","last_became_active":"2023-08-22T00:06:08.662262+0000","last_became_peered":"2023-08-22T00:06:08.662262+0000","last_unstale":"2023-08-22T00:06:12.666143+0000","last_undegraded":"2023-08-22T00:06:12.666143+0000","last_fullsized":"2023-08-22T00:06:12.666143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674164+0000","last_change":"2023-08-22T00:06:08.289283+0000","last_active":"2023-08-22T00:06:12.674164+0000","last_peered":"2023-08-22T00:06:12.674164+0000","last_clean":"2023-08-22T00:06:12.674164+0000","last_became_active":"2023-08-22T00:06:08.289007+0000","last_became_peered":"2023-08-22T00:06:08.289007+0000","last_unstale":"2023-08-22T00:06:12.674164+0000","last_undegraded":"2023-08-22T00:06:12.674164+0000","last_fullsized":"2023-08-22T00:06:12.674164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674326+0000","last_change":"2023-08-22T00:06:08.661468+0000","last_active":"2023-08-22T00:06:12.674326+0000","last_peered":"2023-08-22T00:06:12.674326+0000","last_clean":"2023-08-22T00:06:12.674326+0000","last_became_active":"2023-08-22T00:06:08.661197+0000","last_became_peered":"2023-08-22T00:06:08.661197+0000","last_unstale":"2023-08-22T00:06:12.674326+0000","last_undegraded":"2023-08-22T00:06:12.674326+0000","last_fullsized":"2023-08-22T00:06:12.674326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672725+0000","last_change":"2023-08-22T00:06:08.288133+0000","last_active":"2023-08-22T00:06:12.672725+0000","last_peered":"2023-08-22T00:06:12.672725+0000","last_clean":"2023-08-22T00:06:12.672725+0000","last_became_active":"2023-08-22T00:06:08.287879+0000","last_became_peered":"2023-08-22T00:06:08.287879+0000","last_unstale":"2023-08-22T00:06:12.672725+0000","last_undegraded":"2023-08-22T00:06:12.672725+0000","last_fullsized":"2023-08-22T00:06:12.672725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673390+0000","last_change":"2023-08-22T00:06:08.663390+0000","last_active":"2023-08-22T00:06:12.673390+0000","last_peered":"2023-08-22T00:06:12.673390+0000","last_clean":"2023-08-22T00:06:12.673390+0000","last_became_active":"2023-08-22T00:06:08.663010+0000","last_became_peered":"2023-08-22T00:06:08.663010+0000","last_unstale":"2023-08-22T00:06:12.673390+0000","last_undegraded":"2023-08-22T00:06:12.673390+0000","last_fullsized":"2023-08-22T00:06:12.673390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674564+0000","last_change":"2023-08-22T00:06:08.293331+0000","last_active":"2023-08-22T00:06:12.674564+0000","last_peered":"2023-08-22T00:06:12.674564+0000","last_clean":"2023-08-22T00:06:12.674564+0000","last_became_active":"2023-08-22T00:06:08.293020+0000","last_became_peered":"2023-08-22T00:06:08.293020+0000","last_unstale":"2023-08-22T00:06:12.674564+0000","last_undegraded":"2023-08-22T00:06:12.674564+0000","last_fullsized":"2023-08-22T00:06:12.674564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671788+0000","last_change":"2023-08-22T00:06:08.666837+0000","last_active":"2023-08-22T00:06:12.671788+0000","last_peered":"2023-08-22T00:06:12.671788+0000","last_clean":"2023-08-22T00:06:12.671788+0000","last_became_active":"2023-08-22T00:06:08.666560+0000","last_became_peered":"2023-08-22T00:06:08.666560+0000","last_unstale":"2023-08-22T00:06:12.671788+0000","last_undegraded":"2023-08-22T00:06:12.671788+0000","last_fullsized":"2023-08-22T00:06:12.671788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675040+0000","last_change":"2023-08-22T00:06:08.287559+0000","last_active":"2023-08-22T00:06:12.675040+0000","last_peered":"2023-08-22T00:06:12.675040+0000","last_clean":"2023-08-22T00:06:12.675040+0000","last_became_active":"2023-08-22T00:06:08.287287+0000","last_became_peered":"2023-08-22T00:06:08.287287+0000","last_unstale":"2023-08-22T00:06:12.675040+0000","last_undegraded":"2023-08-22T00:06:12.675040+0000","last_fullsized":"2023-08-22T00:06:12.675040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667298+0000","last_change":"2023-08-22T00:06:08.662355+0000","last_active":"2023-08-22T00:06:12.667298+0000","last_peered":"2023-08-22T00:06:12.667298+0000","last_clean":"2023-08-22T00:06:12.667298+0000","last_became_active":"2023-08-22T00:06:08.662086+0000","last_became_peered":"2023-08-22T00:06:08.662086+0000","last_unstale":"2023-08-22T00:06:12.667298+0000","last_undegraded":"2023-08-22T00:06:12.667298+0000","last_fullsized":"2023-08-22T00:06:12.667298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677300+0000","last_change":"2023-08-22T00:06:08.290222+0000","last_active":"2023-08-22T00:06:12.677300+0000","last_peered":"2023-08-22T00:06:12.677300+0000","last_clean":"2023-08-22T00:06:12.677300+0000","last_became_active":"2023-08-22T00:06:08.289968+0000","last_became_peered":"2023-08-22T00:06:08.289968+0000","last_unstale":"2023-08-22T00:06:12.677300+0000","last_undegraded":"2023-08-22T00:06:12.677300+0000","last_fullsized":"2023-08-22T00:06:12.677300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673232+0000","last_change":"2023-08-22T00:06:08.658917+0000","last_active":"2023-08-22T00:06:12.673232+0000","last_peered":"2023-08-22T00:06:12.673232+0000","last_clean":"2023-08-22T00:06:12.673232+0000","last_became_active":"2023-08-22T00:06:08.658657+0000","last_became_peered":"2023-08-22T00:06:08.658657+0000","last_unstale":"2023-08-22T00:06:12.673232+0000","last_undegraded":"2023-08-22T00:06:12.673232+0000","last_fullsized":"2023-08-22T00:06:12.673232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665200+0000","last_change":"2023-08-22T00:06:08.289093+0000","last_active":"2023-08-22T00:06:12.665200+0000","last_peered":"2023-08-22T00:06:12.665200+0000","last_clean":"2023-08-22T00:06:12.665200+0000","last_became_active":"2023-08-22T00:06:08.288806+0000","last_became_peered":"2023-08-22T00:06:08.288806+0000","last_unstale":"2023-08-22T00:06:12.665200+0000","last_undegraded":"2023-08-22T00:06:12.665200+0000","last_fullsized":"2023-08-22T00:06:12.665200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673099+0000","last_change":"2023-08-22T00:06:08.669493+0000","last_active":"2023-08-22T00:06:12.673099+0000","last_peered":"2023-08-22T00:06:12.673099+0000","last_clean":"2023-08-22T00:06:12.673099+0000","last_became_active":"2023-08-22T00:06:08.669220+0000","last_became_peered":"2023-08-22T00:06:08.669220+0000","last_unstale":"2023-08-22T00:06:12.673099+0000","last_undegraded":"2023-08-22T00:06:12.673099+0000","last_fullsized":"2023-08-22T00:06:12.673099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682034+0000","last_change":"2023-08-22T00:06:08.292202+0000","last_active":"2023-08-22T00:06:12.682034+0000","last_peered":"2023-08-22T00:06:12.682034+0000","last_clean":"2023-08-22T00:06:12.682034+0000","last_became_active":"2023-08-22T00:06:08.291929+0000","last_became_peered":"2023-08-22T00:06:08.291929+0000","last_unstale":"2023-08-22T00:06:12.682034+0000","last_undegraded":"2023-08-22T00:06:12.682034+0000","last_fullsized":"2023-08-22T00:06:12.682034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666941+0000","last_change":"2023-08-22T00:06:08.655196+0000","last_active":"2023-08-22T00:06:12.666941+0000","last_peered":"2023-08-22T00:06:12.666941+0000","last_clean":"2023-08-22T00:06:12.666941+0000","last_became_active":"2023-08-22T00:06:08.654928+0000","last_became_peered":"2023-08-22T00:06:08.654928+0000","last_unstale":"2023-08-22T00:06:12.666941+0000","last_undegraded":"2023-08-22T00:06:12.666941+0000","last_fullsized":"2023-08-22T00:06:12.666941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673092+0000","last_change":"2023-08-22T00:06:08.293074+0000","last_active":"2023-08-22T00:06:12.673092+0000","last_peered":"2023-08-22T00:06:12.673092+0000","last_clean":"2023-08-22T00:06:12.673092+0000","last_became_active":"2023-08-22T00:06:08.292434+0000","last_became_peered":"2023-08-22T00:06:08.292434+0000","last_unstale":"2023-08-22T00:06:12.673092+0000","last_undegraded":"2023-08-22T00:06:12.673092+0000","last_fullsized":"2023-08-22T00:06:12.673092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671455+0000","last_change":"2023-08-22T00:06:08.658335+0000","last_active":"2023-08-22T00:06:12.671455+0000","last_peered":"2023-08-22T00:06:12.671455+0000","last_clean":"2023-08-22T00:06:12.671455+0000","last_became_active":"2023-08-22T00:06:08.658035+0000","last_became_peered":"2023-08-22T00:06:08.658035+0000","last_unstale":"2023-08-22T00:06:12.671455+0000","last_undegraded":"2023-08-22T00:06:12.671455+0000","last_fullsized":"2023-08-22T00:06:12.671455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667365+0000","last_change":"2023-08-22T00:06:08.292375+0000","last_active":"2023-08-22T00:06:12.667365+0000","last_peered":"2023-08-22T00:06:12.667365+0000","last_clean":"2023-08-22T00:06:12.667365+0000","last_became_active":"2023-08-22T00:06:08.291934+0000","last_became_peered":"2023-08-22T00:06:08.291934+0000","last_unstale":"2023-08-22T00:06:12.667365+0000","last_undegraded":"2023-08-22T00:06:12.667365+0000","last_fullsized":"2023-08-22T00:06:12.667365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666290+0000","last_change":"2023-08-22T00:06:08.660996+0000","last_active":"2023-08-22T00:06:12.666290+0000","last_peered":"2023-08-22T00:06:12.666290+0000","last_clean":"2023-08-22T00:06:12.666290+0000","last_became_active":"2023-08-22T00:06:08.660728+0000","last_became_peered":"2023-08-22T00:06:08.660728+0000","last_unstale":"2023-08-22T00:06:12.666290+0000","last_undegraded":"2023-08-22T00:06:12.666290+0000","last_fullsized":"2023-08-22T00:06:12.666290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672623+0000","last_change":"2023-08-22T00:06:08.292852+0000","last_active":"2023-08-22T00:06:12.672623+0000","last_peered":"2023-08-22T00:06:12.672623+0000","last_clean":"2023-08-22T00:06:12.672623+0000","last_became_active":"2023-08-22T00:06:08.291935+0000","last_became_peered":"2023-08-22T00:06:08.291935+0000","last_unstale":"2023-08-22T00:06:12.672623+0000","last_undegraded":"2023-08-22T00:06:12.672623+0000","last_fullsized":"2023-08-22T00:06:12.672623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673471+0000","last_change":"2023-08-22T00:06:08.663264+0000","last_active":"2023-08-22T00:06:12.673471+0000","last_peered":"2023-08-22T00:06:12.673471+0000","last_clean":"2023-08-22T00:06:12.673471+0000","last_became_active":"2023-08-22T00:06:08.662705+0000","last_became_peered":"2023-08-22T00:06:08.662705+0000","last_unstale":"2023-08-22T00:06:12.673471+0000","last_undegraded":"2023-08-22T00:06:12.673471+0000","last_fullsized":"2023-08-22T00:06:12.673471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670566+0000","last_change":"2023-08-22T00:06:08.290617+0000","last_active":"2023-08-22T00:06:12.670566+0000","last_peered":"2023-08-22T00:06:12.670566+0000","last_clean":"2023-08-22T00:06:12.670566+0000","last_became_active":"2023-08-22T00:06:08.290300+0000","last_became_peered":"2023-08-22T00:06:08.290300+0000","last_unstale":"2023-08-22T00:06:12.670566+0000","last_undegraded":"2023-08-22T00:06:12.670566+0000","last_fullsized":"2023-08-22T00:06:12.670566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664704+0000","last_change":"2023-08-22T00:06:08.658939+0000","last_active":"2023-08-22T00:06:12.664704+0000","last_peered":"2023-08-22T00:06:12.664704+0000","last_clean":"2023-08-22T00:06:12.664704+0000","last_became_active":"2023-08-22T00:06:08.653702+0000","last_became_peered":"2023-08-22T00:06:08.653702+0000","last_unstale":"2023-08-22T00:06:12.664704+0000","last_undegraded":"2023-08-22T00:06:12.664704+0000","last_fullsized":"2023-08-22T00:06:12.664704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:13.043578+0000","last_change":"2023-08-22T00:06:08.285489+0000","last_active":"2023-08-22T00:06:13.043578+0000","last_peered":"2023-08-22T00:06:13.043578+0000","last_clean":"2023-08-22T00:06:13.043578+0000","last_became_active":"2023-08-22T00:06:08.283345+0000","last_became_peered":"2023-08-22T00:06:08.283345+0000","last_unstale":"2023-08-22T00:06:13.043578+0000","last_undegraded":"2023-08-22T00:06:13.043578+0000","last_fullsized":"2023-08-22T00:06:13.043578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668115+0000","last_change":"2023-08-22T00:06:08.661873+0000","last_active":"2023-08-22T00:06:12.668115+0000","last_peered":"2023-08-22T00:06:12.668115+0000","last_clean":"2023-08-22T00:06:12.668115+0000","last_became_active":"2023-08-22T00:06:08.661603+0000","last_became_peered":"2023-08-22T00:06:08.661603+0000","last_unstale":"2023-08-22T00:06:12.668115+0000","last_undegraded":"2023-08-22T00:06:12.668115+0000","last_fullsized":"2023-08-22T00:06:12.668115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684497+0000","last_change":"2023-08-22T00:06:08.284711+0000","last_active":"2023-08-22T00:06:12.684497+0000","last_peered":"2023-08-22T00:06:12.684497+0000","last_clean":"2023-08-22T00:06:12.684497+0000","last_became_active":"2023-08-22T00:06:08.284399+0000","last_became_peered":"2023-08-22T00:06:08.284399+0000","last_unstale":"2023-08-22T00:06:12.684497+0000","last_undegraded":"2023-08-22T00:06:12.684497+0000","last_fullsized":"2023-08-22T00:06:12.684497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666407+0000","last_change":"2023-08-22T00:06:08.658805+0000","last_active":"2023-08-22T00:06:12.666407+0000","last_peered":"2023-08-22T00:06:12.666407+0000","last_clean":"2023-08-22T00:06:12.666407+0000","last_became_active":"2023-08-22T00:06:08.658529+0000","last_became_peered":"2023-08-22T00:06:08.658529+0000","last_unstale":"2023-08-22T00:06:12.666407+0000","last_undegraded":"2023-08-22T00:06:12.666407+0000","last_fullsized":"2023-08-22T00:06:12.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669275+0000","last_change":"2023-08-22T00:06:08.291946+0000","last_active":"2023-08-22T00:06:12.669275+0000","last_peered":"2023-08-22T00:06:12.669275+0000","last_clean":"2023-08-22T00:06:12.669275+0000","last_became_active":"2023-08-22T00:06:08.291657+0000","last_became_peered":"2023-08-22T00:06:08.291657+0000","last_unstale":"2023-08-22T00:06:12.669275+0000","last_undegraded":"2023-08-22T00:06:12.669275+0000","last_fullsized":"2023-08-22T00:06:12.669275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668361+0000","last_change":"2023-08-22T00:06:08.665347+0000","last_active":"2023-08-22T00:06:12.668361+0000","last_peered":"2023-08-22T00:06:12.668361+0000","last_clean":"2023-08-22T00:06:12.668361+0000","last_became_active":"2023-08-22T00:06:08.665083+0000","last_became_peered":"2023-08-22T00:06:08.665083+0000","last_unstale":"2023-08-22T00:06:12.668361+0000","last_undegraded":"2023-08-22T00:06:12.668361+0000","last_fullsized":"2023-08-22T00:06:12.668361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682195+0000","last_change":"2023-08-22T00:06:08.286837+0000","last_active":"2023-08-22T00:06:12.682195+0000","last_peered":"2023-08-22T00:06:12.682195+0000","last_clean":"2023-08-22T00:06:12.682195+0000","last_became_active":"2023-08-22T00:06:08.286573+0000","last_became_peered":"2023-08-22T00:06:08.286573+0000","last_unstale":"2023-08-22T00:06:12.682195+0000","last_undegraded":"2023-08-22T00:06:12.682195+0000","last_fullsized":"2023-08-22T00:06:12.682195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681782+0000","last_change":"2023-08-22T00:06:08.665854+0000","last_active":"2023-08-22T00:06:12.681782+0000","last_peered":"2023-08-22T00:06:12.681782+0000","last_clean":"2023-08-22T00:06:12.681782+0000","last_became_active":"2023-08-22T00:06:08.665617+0000","last_became_peered":"2023-08-22T00:06:08.665617+0000","last_unstale":"2023-08-22T00:06:12.681782+0000","last_undegraded":"2023-08-22T00:06:12.681782+0000","last_fullsized":"2023-08-22T00:06:12.681782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672822+0000","last_change":"2023-08-22T00:06:08.293311+0000","last_active":"2023-08-22T00:06:12.672822+0000","last_peered":"2023-08-22T00:06:12.672822+0000","last_clean":"2023-08-22T00:06:12.672822+0000","last_became_active":"2023-08-22T00:06:08.292791+0000","last_became_peered":"2023-08-22T00:06:08.292791+0000","last_unstale":"2023-08-22T00:06:12.672822+0000","last_undegraded":"2023-08-22T00:06:12.672822+0000","last_fullsized":"2023-08-22T00:06:12.672822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673896+0000","last_change":"2023-08-22T00:06:08.668170+0000","last_active":"2023-08-22T00:06:12.673896+0000","last_peered":"2023-08-22T00:06:12.673896+0000","last_clean":"2023-08-22T00:06:12.673896+0000","last_became_active":"2023-08-22T00:06:08.667860+0000","last_became_peered":"2023-08-22T00:06:08.667860+0000","last_unstale":"2023-08-22T00:06:12.673896+0000","last_undegraded":"2023-08-22T00:06:12.673896+0000","last_fullsized":"2023-08-22T00:06:12.673896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670406+0000","last_change":"2023-08-22T00:06:08.285397+0000","last_active":"2023-08-22T00:06:12.670406+0000","last_peered":"2023-08-22T00:06:12.670406+0000","last_clean":"2023-08-22T00:06:12.670406+0000","last_became_active":"2023-08-22T00:06:08.285084+0000","last_became_peered":"2023-08-22T00:06:08.285084+0000","last_unstale":"2023-08-22T00:06:12.670406+0000","last_undegraded":"2023-08-22T00:06:12.670406+0000","last_fullsized":"2023-08-22T00:06:12.670406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684663+0000","last_change":"2023-08-22T00:06:08.651586+0000","last_active":"2023-08-22T00:06:12.684663+0000","last_peered":"2023-08-22T00:06:12.684663+0000","last_clean":"2023-08-22T00:06:12.684663+0000","last_became_active":"2023-08-22T00:06:08.651320+0000","last_became_peered":"2023-08-22T00:06:08.651320+0000","last_unstale":"2023-08-22T00:06:12.684663+0000","last_undegraded":"2023-08-22T00:06:12.684663+0000","last_fullsized":"2023-08-22T00:06:12.684663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664973+0000","last_change":"2023-08-22T00:06:08.282274+0000","last_active":"2023-08-22T00:06:12.664973+0000","last_peered":"2023-08-22T00:06:12.664973+0000","last_clean":"2023-08-22T00:06:12.664973+0000","last_became_active":"2023-08-22T00:06:08.281656+0000","last_became_peered":"2023-08-22T00:06:08.281656+0000","last_unstale":"2023-08-22T00:06:12.664973+0000","last_undegraded":"2023-08-22T00:06:12.664973+0000","last_fullsized":"2023-08-22T00:06:12.664973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684917+0000","last_change":"2023-08-22T00:06:08.655245+0000","last_active":"2023-08-22T00:06:12.684917+0000","last_peered":"2023-08-22T00:06:12.684917+0000","last_clean":"2023-08-22T00:06:12.684917+0000","last_became_active":"2023-08-22T00:06:08.653409+0000","last_became_peered":"2023-08-22T00:06:08.653409+0000","last_unstale":"2023-08-22T00:06:12.684917+0000","last_undegraded":"2023-08-22T00:06:12.684917+0000","last_fullsized":"2023-08-22T00:06:12.684917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673625+0000","last_change":"2023-08-22T00:06:08.286655+0000","last_active":"2023-08-22T00:06:12.673625+0000","last_peered":"2023-08-22T00:06:12.673625+0000","last_clean":"2023-08-22T00:06:12.673625+0000","last_became_active":"2023-08-22T00:06:08.286201+0000","last_became_peered":"2023-08-22T00:06:08.286201+0000","last_unstale":"2023-08-22T00:06:12.673625+0000","last_undegraded":"2023-08-22T00:06:12.673625+0000","last_fullsized":"2023-08-22T00:06:12.673625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664977+0000","last_change":"2023-08-22T00:06:08.669633+0000","last_active":"2023-08-22T00:06:12.664977+0000","last_peered":"2023-08-22T00:06:12.664977+0000","last_clean":"2023-08-22T00:06:12.664977+0000","last_became_active":"2023-08-22T00:06:08.669336+0000","last_became_peered":"2023-08-22T00:06:08.669336+0000","last_unstale":"2023-08-22T00:06:12.664977+0000","last_undegraded":"2023-08-22T00:06:12.664977+0000","last_fullsized":"2023-08-22T00:06:12.664977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701760+0000","last_change":"2023-08-22T00:06:12.688949+0000","last_active":"2023-08-22T00:06:12.701760+0000","last_peered":"2023-08-22T00:06:12.701760+0000","last_clean":"2023-08-22T00:06:12.701760+0000","last_became_active":"2023-08-22T00:06:12.688549+0000","last_became_peered":"2023-08-22T00:06:12.688549+0000","last_unstale":"2023-08-22T00:06:12.701760+0000","last_undegraded":"2023-08-22T00:06:12.701760+0000","last_fullsized":"2023-08-22T00:06:12.701760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670131+0000","last_change":"2023-08-22T00:06:08.287945+0000","last_active":"2023-08-22T00:06:12.670131+0000","last_peered":"2023-08-22T00:06:12.670131+0000","last_clean":"2023-08-22T00:06:12.670131+0000","last_became_active":"2023-08-22T00:06:08.287654+0000","last_became_peered":"2023-08-22T00:06:08.287654+0000","last_unstale":"2023-08-22T00:06:12.670131+0000","last_undegraded":"2023-08-22T00:06:12.670131+0000","last_fullsized":"2023-08-22T00:06:12.670131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667560+0000","last_change":"2023-08-22T00:06:08.663896+0000","last_active":"2023-08-22T00:06:12.667560+0000","last_peered":"2023-08-22T00:06:12.667560+0000","last_clean":"2023-08-22T00:06:12.667560+0000","last_became_active":"2023-08-22T00:06:08.659582+0000","last_became_peered":"2023-08-22T00:06:08.659582+0000","last_unstale":"2023-08-22T00:06:12.667560+0000","last_undegraded":"2023-08-22T00:06:12.667560+0000","last_fullsized":"2023-08-22T00:06:12.667560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.683352+0000","last_change":"2023-08-22T00:06:12.680740+0000","last_active":"2023-08-22T00:06:12.683352+0000","last_peered":"2023-08-22T00:06:12.683352+0000","last_clean":"2023-08-22T00:06:12.683352+0000","last_became_active":"2023-08-22T00:06:12.680354+0000","last_became_peered":"2023-08-22T00:06:12.680354+0000","last_unstale":"2023-08-22T00:06:12.683352+0000","last_undegraded":"2023-08-22T00:06:12.683352+0000","last_fullsized":"2023-08-22T00:06:12.683352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673712+0000","last_change":"2023-08-22T00:06:08.291655+0000","last_active":"2023-08-22T00:06:12.673712+0000","last_peered":"2023-08-22T00:06:12.673712+0000","last_clean":"2023-08-22T00:06:12.673712+0000","last_became_active":"2023-08-22T00:06:08.291408+0000","last_became_peered":"2023-08-22T00:06:08.291408+0000","last_unstale":"2023-08-22T00:06:12.673712+0000","last_undegraded":"2023-08-22T00:06:12.673712+0000","last_fullsized":"2023-08-22T00:06:12.673712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666066+0000","last_change":"2023-08-22T00:06:08.662948+0000","last_active":"2023-08-22T00:06:12.666066+0000","last_peered":"2023-08-22T00:06:12.666066+0000","last_clean":"2023-08-22T00:06:12.666066+0000","last_became_active":"2023-08-22T00:06:08.662627+0000","last_became_peered":"2023-08-22T00:06:08.662627+0000","last_unstale":"2023-08-22T00:06:12.666066+0000","last_undegraded":"2023-08-22T00:06:12.666066+0000","last_fullsized":"2023-08-22T00:06:12.666066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692108+0000","last_change":"2023-08-22T00:06:12.689153+0000","last_active":"2023-08-22T00:06:12.692108+0000","last_peered":"2023-08-22T00:06:12.692108+0000","last_clean":"2023-08-22T00:06:12.692108+0000","last_became_active":"2023-08-22T00:06:12.688700+0000","last_became_peered":"2023-08-22T00:06:12.688700+0000","last_unstale":"2023-08-22T00:06:12.692108+0000","last_undegraded":"2023-08-22T00:06:12.692108+0000","last_fullsized":"2023-08-22T00:06:12.692108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672366+0000","last_change":"2023-08-22T00:06:08.292695+0000","last_active":"2023-08-22T00:06:12.672366+0000","last_peered":"2023-08-22T00:06:12.672366+0000","last_clean":"2023-08-22T00:06:12.672366+0000","last_became_active":"2023-08-22T00:06:08.292417+0000","last_became_peered":"2023-08-22T00:06:08.292417+0000","last_unstale":"2023-08-22T00:06:12.672366+0000","last_undegraded":"2023-08-22T00:06:12.672366+0000","last_fullsized":"2023-08-22T00:06:12.672366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665496+0000","last_change":"2023-08-22T00:06:08.662935+0000","last_active":"2023-08-22T00:06:12.665496+0000","last_peered":"2023-08-22T00:06:12.665496+0000","last_clean":"2023-08-22T00:06:12.665496+0000","last_became_active":"2023-08-22T00:06:08.662634+0000","last_became_peered":"2023-08-22T00:06:08.662634+0000","last_unstale":"2023-08-22T00:06:12.665496+0000","last_undegraded":"2023-08-22T00:06:12.665496+0000","last_fullsized":"2023-08-22T00:06:12.665496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.689425+0000","last_change":"2023-08-22T00:06:12.686691+0000","last_active":"2023-08-22T00:06:12.689425+0000","last_peered":"2023-08-22T00:06:12.689425+0000","last_clean":"2023-08-22T00:06:12.689425+0000","last_became_active":"2023-08-22T00:06:12.686314+0000","last_became_peered":"2023-08-22T00:06:12.686314+0000","last_unstale":"2023-08-22T00:06:12.689425+0000","last_undegraded":"2023-08-22T00:06:12.689425+0000","last_fullsized":"2023-08-22T00:06:12.689425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702379+0000","last_change":"2023-08-22T00:06:12.697526+0000","last_active":"2023-08-22T00:06:12.702379+0000","last_peered":"2023-08-22T00:06:12.702379+0000","last_clean":"2023-08-22T00:06:12.702379+0000","last_became_active":"2023-08-22T00:06:12.697150+0000","last_became_peered":"2023-08-22T00:06:12.697150+0000","last_unstale":"2023-08-22T00:06:12.702379+0000","last_undegraded":"2023-08-22T00:06:12.702379+0000","last_fullsized":"2023-08-22T00:06:12.702379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682355+0000","last_change":"2023-08-22T00:06:08.290950+0000","last_active":"2023-08-22T00:06:12.682355+0000","last_peered":"2023-08-22T00:06:12.682355+0000","last_clean":"2023-08-22T00:06:12.682355+0000","last_became_active":"2023-08-22T00:06:08.290600+0000","last_became_peered":"2023-08-22T00:06:08.290600+0000","last_unstale":"2023-08-22T00:06:12.682355+0000","last_undegraded":"2023-08-22T00:06:12.682355+0000","last_fullsized":"2023-08-22T00:06:12.682355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671721+0000","last_change":"2023-08-22T00:06:08.654201+0000","last_active":"2023-08-22T00:06:12.671721+0000","last_peered":"2023-08-22T00:06:12.671721+0000","last_clean":"2023-08-22T00:06:12.671721+0000","last_became_active":"2023-08-22T00:06:08.653605+0000","last_became_peered":"2023-08-22T00:06:08.653605+0000","last_unstale":"2023-08-22T00:06:12.671721+0000","last_undegraded":"2023-08-22T00:06:12.671721+0000","last_fullsized":"2023-08-22T00:06:12.671721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665639+0000","last_change":"2023-08-22T00:06:08.667424+0000","last_active":"2023-08-22T00:06:12.665639+0000","last_peered":"2023-08-22T00:06:12.665639+0000","last_clean":"2023-08-22T00:06:12.665639+0000","last_became_active":"2023-08-22T00:06:08.667093+0000","last_became_peered":"2023-08-22T00:06:08.667093+0000","last_unstale":"2023-08-22T00:06:12.665639+0000","last_undegraded":"2023-08-22T00:06:12.665639+0000","last_fullsized":"2023-08-22T00:06:12.665639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680328+0000","last_change":"2023-08-22T00:06:08.285075+0000","last_active":"2023-08-22T00:06:12.680328+0000","last_peered":"2023-08-22T00:06:12.680328+0000","last_clean":"2023-08-22T00:06:12.680328+0000","last_became_active":"2023-08-22T00:06:08.284787+0000","last_became_peered":"2023-08-22T00:06:08.284787+0000","last_unstale":"2023-08-22T00:06:12.680328+0000","last_undegraded":"2023-08-22T00:06:12.680328+0000","last_fullsized":"2023-08-22T00:06:12.680328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665593+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:06:12.665593+0000","last_peered":"2023-08-22T00:06:12.665593+0000","last_clean":"2023-08-22T00:06:12.665593+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:06:12.665593+0000","last_undegraded":"2023-08-22T00:06:12.665593+0000","last_fullsized":"2023-08-22T00:06:12.665593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696704+0000","last_change":"2023-08-22T00:06:12.686550+0000","last_active":"2023-08-22T00:06:12.696704+0000","last_peered":"2023-08-22T00:06:12.696704+0000","last_clean":"2023-08-22T00:06:12.696704+0000","last_became_active":"2023-08-22T00:06:12.686171+0000","last_became_peered":"2023-08-22T00:06:12.686171+0000","last_unstale":"2023-08-22T00:06:12.696704+0000","last_undegraded":"2023-08-22T00:06:12.696704+0000","last_fullsized":"2023-08-22T00:06:12.696704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666712+0000","last_change":"2023-08-22T00:06:08.664638+0000","last_active":"2023-08-22T00:06:12.666712+0000","last_peered":"2023-08-22T00:06:12.666712+0000","last_clean":"2023-08-22T00:06:12.666712+0000","last_became_active":"2023-08-22T00:06:08.664382+0000","last_became_peered":"2023-08-22T00:06:08.664382+0000","last_unstale":"2023-08-22T00:06:12.666712+0000","last_undegraded":"2023-08-22T00:06:12.666712+0000","last_fullsized":"2023-08-22T00:06:12.666712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684583+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:06:12.684583+0000","last_peered":"2023-08-22T00:06:12.684583+0000","last_clean":"2023-08-22T00:06:12.684583+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:06:12.684583+0000","last_undegraded":"2023-08-22T00:06:12.684583+0000","last_fullsized":"2023-08-22T00:06:12.684583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670437+0000","last_change":"2023-08-22T00:06:08.285344+0000","last_active":"2023-08-22T00:06:12.670437+0000","last_peered":"2023-08-22T00:06:12.670437+0000","last_clean":"2023-08-22T00:06:12.670437+0000","last_became_active":"2023-08-22T00:06:08.285077+0000","last_became_peered":"2023-08-22T00:06:08.285077+0000","last_unstale":"2023-08-22T00:06:12.670437+0000","last_undegraded":"2023-08-22T00:06:12.670437+0000","last_fullsized":"2023-08-22T00:06:12.670437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688875+0000","last_change":"2023-08-22T00:06:12.687045+0000","last_active":"2023-08-22T00:06:12.688875+0000","last_peered":"2023-08-22T00:06:12.688875+0000","last_clean":"2023-08-22T00:06:12.688875+0000","last_became_active":"2023-08-22T00:06:12.686213+0000","last_became_peered":"2023-08-22T00:06:12.686213+0000","last_unstale":"2023-08-22T00:06:12.688875+0000","last_undegraded":"2023-08-22T00:06:12.688875+0000","last_fullsized":"2023-08-22T00:06:12.688875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682429+0000","last_change":"2023-08-22T00:06:08.656218+0000","last_active":"2023-08-22T00:06:12.682429+0000","last_peered":"2023-08-22T00:06:12.682429+0000","last_clean":"2023-08-22T00:06:12.682429+0000","last_became_active":"2023-08-22T00:06:08.655669+0000","last_became_peered":"2023-08-22T00:06:08.655669+0000","last_unstale":"2023-08-22T00:06:12.682429+0000","last_undegraded":"2023-08-22T00:06:12.682429+0000","last_fullsized":"2023-08-22T00:06:12.682429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681866+0000","last_change":"2023-08-22T00:06:08.286902+0000","last_active":"2023-08-22T00:06:12.681866+0000","last_peered":"2023-08-22T00:06:12.681866+0000","last_clean":"2023-08-22T00:06:12.681866+0000","last_became_active":"2023-08-22T00:06:08.285921+0000","last_became_peered":"2023-08-22T00:06:08.285921+0000","last_unstale":"2023-08-22T00:06:12.681866+0000","last_undegraded":"2023-08-22T00:06:12.681866+0000","last_fullsized":"2023-08-22T00:06:12.681866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677121+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:06:12.677121+0000","last_peered":"2023-08-22T00:06:12.677121+0000","last_clean":"2023-08-22T00:06:12.677121+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:06:12.677121+0000","last_undegraded":"2023-08-22T00:06:12.677121+0000","last_fullsized":"2023-08-22T00:06:12.677121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688925+0000","last_change":"2023-08-22T00:06:12.686660+0000","last_active":"2023-08-22T00:06:12.688925+0000","last_peered":"2023-08-22T00:06:12.688925+0000","last_clean":"2023-08-22T00:06:12.688925+0000","last_became_active":"2023-08-22T00:06:12.686272+0000","last_became_peered":"2023-08-22T00:06:12.686272+0000","last_unstale":"2023-08-22T00:06:12.688925+0000","last_undegraded":"2023-08-22T00:06:12.688925+0000","last_fullsized":"2023-08-22T00:06:12.688925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674247+0000","last_change":"2023-08-22T00:06:08.290975+0000","last_active":"2023-08-22T00:06:12.674247+0000","last_peered":"2023-08-22T00:06:12.674247+0000","last_clean":"2023-08-22T00:06:12.674247+0000","last_became_active":"2023-08-22T00:06:08.290710+0000","last_became_peered":"2023-08-22T00:06:08.290710+0000","last_unstale":"2023-08-22T00:06:12.674247+0000","last_undegraded":"2023-08-22T00:06:12.674247+0000","last_fullsized":"2023-08-22T00:06:12.674247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670925+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:06:12.670925+0000","last_peered":"2023-08-22T00:06:12.670925+0000","last_clean":"2023-08-22T00:06:12.670925+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:06:12.670925+0000","last_undegraded":"2023-08-22T00:06:12.670925+0000","last_fullsized":"2023-08-22T00:06:12.670925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680519+0000","last_change":"2023-08-22T00:06:08.658411+0000","last_active":"2023-08-22T00:06:12.680519+0000","last_peered":"2023-08-22T00:06:12.680519+0000","last_clean":"2023-08-22T00:06:12.680519+0000","last_became_active":"2023-08-22T00:06:08.658152+0000","last_became_peered":"2023-08-22T00:06:08.658152+0000","last_unstale":"2023-08-22T00:06:12.680519+0000","last_undegraded":"2023-08-22T00:06:12.680519+0000","last_fullsized":"2023-08-22T00:06:12.680519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692091+0000","last_change":"2023-08-22T00:06:12.688771+0000","last_active":"2023-08-22T00:06:12.692091+0000","last_peered":"2023-08-22T00:06:12.692091+0000","last_clean":"2023-08-22T00:06:12.692091+0000","last_became_active":"2023-08-22T00:06:12.688371+0000","last_became_peered":"2023-08-22T00:06:12.688371+0000","last_unstale":"2023-08-22T00:06:12.692091+0000","last_undegraded":"2023-08-22T00:06:12.692091+0000","last_fullsized":"2023-08-22T00:06:12.692091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667141+0000","last_change":"2023-08-22T00:06:08.288643+0000","last_active":"2023-08-22T00:06:12.667141+0000","last_peered":"2023-08-22T00:06:12.667141+0000","last_clean":"2023-08-22T00:06:12.667141+0000","last_became_active":"2023-08-22T00:06:08.288392+0000","last_became_peered":"2023-08-22T00:06:08.288392+0000","last_unstale":"2023-08-22T00:06:12.667141+0000","last_undegraded":"2023-08-22T00:06:12.667141+0000","last_fullsized":"2023-08-22T00:06:12.667141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670819+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:06:12.670819+0000","last_peered":"2023-08-22T00:06:12.670819+0000","last_clean":"2023-08-22T00:06:12.670819+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:06:12.670819+0000","last_undegraded":"2023-08-22T00:06:12.670819+0000","last_fullsized":"2023-08-22T00:06:12.670819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672489+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:06:12.672489+0000","last_peered":"2023-08-22T00:06:12.672489+0000","last_clean":"2023-08-22T00:06:12.672489+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:06:12.672489+0000","last_undegraded":"2023-08-22T00:06:12.672489+0000","last_fullsized":"2023-08-22T00:06:12.672489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665056+0000","last_change":"2023-08-22T00:06:08.659076+0000","last_active":"2023-08-22T00:06:12.665056+0000","last_peered":"2023-08-22T00:06:12.665056+0000","last_clean":"2023-08-22T00:06:12.665056+0000","last_became_active":"2023-08-22T00:06:08.657107+0000","last_became_peered":"2023-08-22T00:06:08.657107+0000","last_unstale":"2023-08-22T00:06:12.665056+0000","last_undegraded":"2023-08-22T00:06:12.665056+0000","last_fullsized":"2023-08-22T00:06:12.665056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685134+0000","last_change":"2023-08-22T00:06:12.681352+0000","last_active":"2023-08-22T00:06:12.685134+0000","last_peered":"2023-08-22T00:06:12.685134+0000","last_clean":"2023-08-22T00:06:12.685134+0000","last_became_active":"2023-08-22T00:06:12.680899+0000","last_became_peered":"2023-08-22T00:06:12.680899+0000","last_unstale":"2023-08-22T00:06:12.685134+0000","last_undegraded":"2023-08-22T00:06:12.685134+0000","last_fullsized":"2023-08-22T00:06:12.685134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677342+0000","last_change":"2023-08-22T00:06:08.287022+0000","last_active":"2023-08-22T00:06:12.677342+0000","last_peered":"2023-08-22T00:06:12.677342+0000","last_clean":"2023-08-22T00:06:12.677342+0000","last_became_active":"2023-08-22T00:06:08.285832+0000","last_became_peered":"2023-08-22T00:06:08.285832+0000","last_unstale":"2023-08-22T00:06:12.677342+0000","last_undegraded":"2023-08-22T00:06:12.677342+0000","last_fullsized":"2023-08-22T00:06:12.677342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670558+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:06:12.670558+0000","last_peered":"2023-08-22T00:06:12.670558+0000","last_clean":"2023-08-22T00:06:12.670558+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:06:12.670558+0000","last_undegraded":"2023-08-22T00:06:12.670558+0000","last_fullsized":"2023-08-22T00:06:12.670558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684997+0000","last_change":"2023-08-22T00:06:08.653884+0000","last_active":"2023-08-22T00:06:12.684997+0000","last_peered":"2023-08-22T00:06:12.684997+0000","last_clean":"2023-08-22T00:06:12.684997+0000","last_became_active":"2023-08-22T00:06:08.653713+0000","last_became_peered":"2023-08-22T00:06:08.653713+0000","last_unstale":"2023-08-22T00:06:12.684997+0000","last_undegraded":"2023-08-22T00:06:12.684997+0000","last_fullsized":"2023-08-22T00:06:12.684997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693863+0000","last_change":"2023-08-22T00:06:12.685577+0000","last_active":"2023-08-22T00:06:12.693863+0000","last_peered":"2023-08-22T00:06:12.693863+0000","last_clean":"2023-08-22T00:06:12.693863+0000","last_became_active":"2023-08-22T00:06:12.685126+0000","last_became_peered":"2023-08-22T00:06:12.685126+0000","last_unstale":"2023-08-22T00:06:12.693863+0000","last_undegraded":"2023-08-22T00:06:12.693863+0000","last_fullsized":"2023-08-22T00:06:12.693863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681621+0000","last_change":"2023-08-22T00:06:08.652088+0000","last_active":"2023-08-22T00:06:12.681621+0000","last_peered":"2023-08-22T00:06:12.681621+0000","last_clean":"2023-08-22T00:06:12.681621+0000","last_became_active":"2023-08-22T00:06:08.651847+0000","last_became_peered":"2023-08-22T00:06:08.651847+0000","last_unstale":"2023-08-22T00:06:12.681621+0000","last_undegraded":"2023-08-22T00:06:12.681621+0000","last_fullsized":"2023-08-22T00:06:12.681621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665579+0000","last_change":"2023-08-22T00:06:08.290805+0000","last_active":"2023-08-22T00:06:12.665579+0000","last_peered":"2023-08-22T00:06:12.665579+0000","last_clean":"2023-08-22T00:06:12.665579+0000","last_became_active":"2023-08-22T00:06:08.290543+0000","last_became_peered":"2023-08-22T00:06:08.290543+0000","last_unstale":"2023-08-22T00:06:12.665579+0000","last_undegraded":"2023-08-22T00:06:12.665579+0000","last_fullsized":"2023-08-22T00:06:12.665579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673003+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:06:12.673003+0000","last_peered":"2023-08-22T00:06:12.673003+0000","last_clean":"2023-08-22T00:06:12.673003+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:06:12.673003+0000","last_undegraded":"2023-08-22T00:06:12.673003+0000","last_fullsized":"2023-08-22T00:06:12.673003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691389+0000","last_change":"2023-08-22T00:06:12.686780+0000","last_active":"2023-08-22T00:06:12.691389+0000","last_peered":"2023-08-22T00:06:12.691389+0000","last_clean":"2023-08-22T00:06:12.691389+0000","last_became_active":"2023-08-22T00:06:12.686462+0000","last_became_peered":"2023-08-22T00:06:12.686462+0000","last_unstale":"2023-08-22T00:06:12.691389+0000","last_undegraded":"2023-08-22T00:06:12.691389+0000","last_fullsized":"2023-08-22T00:06:12.691389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681816+0000","last_change":"2023-08-22T00:06:08.655816+0000","last_active":"2023-08-22T00:06:12.681816+0000","last_peered":"2023-08-22T00:06:12.681816+0000","last_clean":"2023-08-22T00:06:12.681816+0000","last_became_active":"2023-08-22T00:06:08.655543+0000","last_became_peered":"2023-08-22T00:06:08.655543+0000","last_unstale":"2023-08-22T00:06:12.681816+0000","last_undegraded":"2023-08-22T00:06:12.681816+0000","last_fullsized":"2023-08-22T00:06:12.681816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673810+0000","last_change":"2023-08-22T00:06:08.293689+0000","last_active":"2023-08-22T00:06:12.673810+0000","last_peered":"2023-08-22T00:06:12.673810+0000","last_clean":"2023-08-22T00:06:12.673810+0000","last_became_active":"2023-08-22T00:06:08.293345+0000","last_became_peered":"2023-08-22T00:06:08.293345+0000","last_unstale":"2023-08-22T00:06:12.673810+0000","last_undegraded":"2023-08-22T00:06:12.673810+0000","last_fullsized":"2023-08-22T00:06:12.673810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681700+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:06:12.681700+0000","last_peered":"2023-08-22T00:06:12.681700+0000","last_clean":"2023-08-22T00:06:12.681700+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:06:12.681700+0000","last_undegraded":"2023-08-22T00:06:12.681700+0000","last_fullsized":"2023-08-22T00:06:12.681700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693109+0000","last_change":"2023-08-22T00:06:12.687580+0000","last_active":"2023-08-22T00:06:12.693109+0000","last_peered":"2023-08-22T00:06:12.693109+0000","last_clean":"2023-08-22T00:06:12.693109+0000","last_became_active":"2023-08-22T00:06:12.687255+0000","last_became_peered":"2023-08-22T00:06:12.687255+0000","last_unstale":"2023-08-22T00:06:12.693109+0000","last_undegraded":"2023-08-22T00:06:12.693109+0000","last_fullsized":"2023-08-22T00:06:12.693109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666637+0000","last_change":"2023-08-22T00:06:08.286120+0000","last_active":"2023-08-22T00:06:12.666637+0000","last_peered":"2023-08-22T00:06:12.666637+0000","last_clean":"2023-08-22T00:06:12.666637+0000","last_became_active":"2023-08-22T00:06:08.285828+0000","last_became_peered":"2023-08-22T00:06:08.285828+0000","last_unstale":"2023-08-22T00:06:12.666637+0000","last_undegraded":"2023-08-22T00:06:12.666637+0000","last_fullsized":"2023-08-22T00:06:12.666637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685079+0000","last_change":"2023-08-22T00:06:08.665123+0000","last_active":"2023-08-22T00:06:12.685079+0000","last_peered":"2023-08-22T00:06:12.685079+0000","last_clean":"2023-08-22T00:06:12.685079+0000","last_became_active":"2023-08-22T00:06:08.664679+0000","last_became_peered":"2023-08-22T00:06:08.664679+0000","last_unstale":"2023-08-22T00:06:12.685079+0000","last_undegraded":"2023-08-22T00:06:12.685079+0000","last_fullsized":"2023-08-22T00:06:12.685079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691293+0000","last_change":"2023-08-22T00:06:12.689186+0000","last_active":"2023-08-22T00:06:12.691293+0000","last_peered":"2023-08-22T00:06:12.691293+0000","last_clean":"2023-08-22T00:06:12.691293+0000","last_became_active":"2023-08-22T00:06:12.688721+0000","last_became_peered":"2023-08-22T00:06:12.688721+0000","last_unstale":"2023-08-22T00:06:12.691293+0000","last_undegraded":"2023-08-22T00:06:12.691293+0000","last_fullsized":"2023-08-22T00:06:12.691293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665445+0000","last_change":"2023-08-22T00:06:08.286239+0000","last_active":"2023-08-22T00:06:12.665445+0000","last_peered":"2023-08-22T00:06:12.665445+0000","last_clean":"2023-08-22T00:06:12.665445+0000","last_became_active":"2023-08-22T00:06:08.285947+0000","last_became_peered":"2023-08-22T00:06:08.285947+0000","last_unstale":"2023-08-22T00:06:12.665445+0000","last_undegraded":"2023-08-22T00:06:12.665445+0000","last_fullsized":"2023-08-22T00:06:12.665445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666624+0000","last_change":"2023-08-22T00:06:08.669823+0000","last_active":"2023-08-22T00:06:12.666624+0000","last_peered":"2023-08-22T00:06:12.666624+0000","last_clean":"2023-08-22T00:06:12.666624+0000","last_became_active":"2023-08-22T00:06:08.669205+0000","last_became_peered":"2023-08-22T00:06:08.669205+0000","last_unstale":"2023-08-22T00:06:12.666624+0000","last_undegraded":"2023-08-22T00:06:12.666624+0000","last_fullsized":"2023-08-22T00:06:12.666624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685064+0000","last_change":"2023-08-22T00:06:12.683405+0000","last_active":"2023-08-22T00:06:12.685064+0000","last_peered":"2023-08-22T00:06:12.685064+0000","last_clean":"2023-08-22T00:06:12.685064+0000","last_became_active":"2023-08-22T00:06:12.682920+0000","last_became_peered":"2023-08-22T00:06:12.682920+0000","last_unstale":"2023-08-22T00:06:12.685064+0000","last_undegraded":"2023-08-22T00:06:12.685064+0000","last_fullsized":"2023-08-22T00:06:12.685064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666050+0000","last_change":"2023-08-22T00:06:08.293922+0000","last_active":"2023-08-22T00:06:12.666050+0000","last_peered":"2023-08-22T00:06:12.666050+0000","last_clean":"2023-08-22T00:06:12.666050+0000","last_became_active":"2023-08-22T00:06:08.293634+0000","last_became_peered":"2023-08-22T00:06:08.293634+0000","last_unstale":"2023-08-22T00:06:12.666050+0000","last_undegraded":"2023-08-22T00:06:12.666050+0000","last_fullsized":"2023-08-22T00:06:12.666050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665867+0000","last_change":"2023-08-22T00:06:08.660591+0000","last_active":"2023-08-22T00:06:12.665867+0000","last_peered":"2023-08-22T00:06:12.665867+0000","last_clean":"2023-08-22T00:06:12.665867+0000","last_became_active":"2023-08-22T00:06:08.659961+0000","last_became_peered":"2023-08-22T00:06:08.659961+0000","last_unstale":"2023-08-22T00:06:12.665867+0000","last_undegraded":"2023-08-22T00:06:12.665867+0000","last_fullsized":"2023-08-22T00:06:12.665867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701768+0000","last_change":"2023-08-22T00:06:12.689578+0000","last_active":"2023-08-22T00:06:12.701768+0000","last_peered":"2023-08-22T00:06:12.701768+0000","last_clean":"2023-08-22T00:06:12.701768+0000","last_became_active":"2023-08-22T00:06:12.689081+0000","last_became_peered":"2023-08-22T00:06:12.689081+0000","last_unstale":"2023-08-22T00:06:12.701768+0000","last_undegraded":"2023-08-22T00:06:12.701768+0000","last_fullsized":"2023-08-22T00:06:12.701768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667259+0000","last_change":"2023-08-22T00:06:08.287748+0000","last_active":"2023-08-22T00:06:12.667259+0000","last_peered":"2023-08-22T00:06:12.667259+0000","last_clean":"2023-08-22T00:06:12.667259+0000","last_became_active":"2023-08-22T00:06:08.287494+0000","last_became_peered":"2023-08-22T00:06:08.287494+0000","last_unstale":"2023-08-22T00:06:12.667259+0000","last_undegraded":"2023-08-22T00:06:12.667259+0000","last_fullsized":"2023-08-22T00:06:12.667259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667054+0000","last_change":"2023-08-22T00:06:08.670010+0000","last_active":"2023-08-22T00:06:12.667054+0000","last_peered":"2023-08-22T00:06:12.667054+0000","last_clean":"2023-08-22T00:06:12.667054+0000","last_became_active":"2023-08-22T00:06:08.669725+0000","last_became_peered":"2023-08-22T00:06:08.669725+0000","last_unstale":"2023-08-22T00:06:12.667054+0000","last_undegraded":"2023-08-22T00:06:12.667054+0000","last_fullsized":"2023-08-22T00:06:12.667054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693735+0000","last_change":"2023-08-22T00:06:12.682981+0000","last_active":"2023-08-22T00:06:12.693735+0000","last_peered":"2023-08-22T00:06:12.693735+0000","last_clean":"2023-08-22T00:06:12.693735+0000","last_became_active":"2023-08-22T00:06:12.682564+0000","last_became_peered":"2023-08-22T00:06:12.682564+0000","last_unstale":"2023-08-22T00:06:12.693735+0000","last_undegraded":"2023-08-22T00:06:12.693735+0000","last_fullsized":"2023-08-22T00:06:12.693735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672285+0000","last_change":"2023-08-22T00:06:08.289593+0000","last_active":"2023-08-22T00:06:12.672285+0000","last_peered":"2023-08-22T00:06:12.672285+0000","last_clean":"2023-08-22T00:06:12.672285+0000","last_became_active":"2023-08-22T00:06:08.289269+0000","last_became_peered":"2023-08-22T00:06:08.289269+0000","last_unstale":"2023-08-22T00:06:12.672285+0000","last_undegraded":"2023-08-22T00:06:12.672285+0000","last_fullsized":"2023-08-22T00:06:12.672285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682276+0000","last_change":"2023-08-22T00:06:08.657006+0000","last_active":"2023-08-22T00:06:12.682276+0000","last_peered":"2023-08-22T00:06:12.682276+0000","last_clean":"2023-08-22T00:06:12.682276+0000","last_became_active":"2023-08-22T00:06:08.656769+0000","last_became_peered":"2023-08-22T00:06:08.656769+0000","last_unstale":"2023-08-22T00:06:12.682276+0000","last_undegraded":"2023-08-22T00:06:12.682276+0000","last_fullsized":"2023-08-22T00:06:12.682276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693819+0000","last_change":"2023-08-22T00:06:12.684195+0000","last_active":"2023-08-22T00:06:12.693819+0000","last_peered":"2023-08-22T00:06:12.693819+0000","last_clean":"2023-08-22T00:06:12.693819+0000","last_became_active":"2023-08-22T00:06:12.683612+0000","last_became_peered":"2023-08-22T00:06:12.683612+0000","last_unstale":"2023-08-22T00:06:12.693819+0000","last_undegraded":"2023-08-22T00:06:12.693819+0000","last_fullsized":"2023-08-22T00:06:12.693819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677098+0000","last_change":"2023-08-22T00:06:08.291933+0000","last_active":"2023-08-22T00:06:12.677098+0000","last_peered":"2023-08-22T00:06:12.677098+0000","last_clean":"2023-08-22T00:06:12.677098+0000","last_became_active":"2023-08-22T00:06:08.291627+0000","last_became_peered":"2023-08-22T00:06:08.291627+0000","last_unstale":"2023-08-22T00:06:12.677098+0000","last_undegraded":"2023-08-22T00:06:12.677098+0000","last_fullsized":"2023-08-22T00:06:12.677098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665964+0000","last_change":"2023-08-22T00:06:08.663881+0000","last_active":"2023-08-22T00:06:12.665964+0000","last_peered":"2023-08-22T00:06:12.665964+0000","last_clean":"2023-08-22T00:06:12.665964+0000","last_became_active":"2023-08-22T00:06:08.663600+0000","last_became_peered":"2023-08-22T00:06:08.663600+0000","last_unstale":"2023-08-22T00:06:12.665964+0000","last_undegraded":"2023-08-22T00:06:12.665964+0000","last_fullsized":"2023-08-22T00:06:12.665964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693913+0000","last_change":"2023-08-22T00:06:12.689051+0000","last_active":"2023-08-22T00:06:12.693913+0000","last_peered":"2023-08-22T00:06:12.693913+0000","last_clean":"2023-08-22T00:06:12.693913+0000","last_became_active":"2023-08-22T00:06:12.688661+0000","last_became_peered":"2023-08-22T00:06:12.688661+0000","last_unstale":"2023-08-22T00:06:12.693913+0000","last_undegraded":"2023-08-22T00:06:12.693913+0000","last_fullsized":"2023-08-22T00:06:12.693913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677466+0000","last_change":"2023-08-22T00:06:08.294656+0000","last_active":"2023-08-22T00:06:12.677466+0000","last_peered":"2023-08-22T00:06:12.677466+0000","last_clean":"2023-08-22T00:06:12.677466+0000","last_became_active":"2023-08-22T00:06:08.292560+0000","last_became_peered":"2023-08-22T00:06:08.292560+0000","last_unstale":"2023-08-22T00:06:12.677466+0000","last_undegraded":"2023-08-22T00:06:12.677466+0000","last_fullsized":"2023-08-22T00:06:12.677466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665464+0000","last_change":"2023-08-22T00:06:08.666434+0000","last_active":"2023-08-22T00:06:12.665464+0000","last_peered":"2023-08-22T00:06:12.665464+0000","last_clean":"2023-08-22T00:06:12.665464+0000","last_became_active":"2023-08-22T00:06:08.663063+0000","last_became_peered":"2023-08-22T00:06:08.663063+0000","last_unstale":"2023-08-22T00:06:12.665464+0000","last_undegraded":"2023-08-22T00:06:12.665464+0000","last_fullsized":"2023-08-22T00:06:12.665464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693999+0000","last_change":"2023-08-22T00:06:12.692897+0000","last_active":"2023-08-22T00:06:12.693999+0000","last_peered":"2023-08-22T00:06:12.693999+0000","last_clean":"2023-08-22T00:06:12.693999+0000","last_became_active":"2023-08-22T00:06:12.692484+0000","last_became_peered":"2023-08-22T00:06:12.692484+0000","last_unstale":"2023-08-22T00:06:12.693999+0000","last_undegraded":"2023-08-22T00:06:12.693999+0000","last_fullsized":"2023-08-22T00:06:12.693999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678309+0000","last_change":"2023-08-22T00:06:08.295114+0000","last_active":"2023-08-22T00:06:12.678309+0000","last_peered":"2023-08-22T00:06:12.678309+0000","last_clean":"2023-08-22T00:06:12.678309+0000","last_became_active":"2023-08-22T00:06:08.294743+0000","last_became_peered":"2023-08-22T00:06:08.294743+0000","last_unstale":"2023-08-22T00:06:12.678309+0000","last_undegraded":"2023-08-22T00:06:12.678309+0000","last_fullsized":"2023-08-22T00:06:12.678309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672539+0000","last_change":"2023-08-22T00:06:08.664800+0000","last_active":"2023-08-22T00:06:12.672539+0000","last_peered":"2023-08-22T00:06:12.672539+0000","last_clean":"2023-08-22T00:06:12.672539+0000","last_became_active":"2023-08-22T00:06:08.664511+0000","last_became_peered":"2023-08-22T00:06:08.664511+0000","last_unstale":"2023-08-22T00:06:12.672539+0000","last_undegraded":"2023-08-22T00:06:12.672539+0000","last_fullsized":"2023-08-22T00:06:12.672539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688234+0000","last_change":"2023-08-22T00:06:12.684602+0000","last_active":"2023-08-22T00:06:12.688234+0000","last_peered":"2023-08-22T00:06:12.688234+0000","last_clean":"2023-08-22T00:06:12.688234+0000","last_became_active":"2023-08-22T00:06:12.684197+0000","last_became_peered":"2023-08-22T00:06:12.684197+0000","last_unstale":"2023-08-22T00:06:12.688234+0000","last_undegraded":"2023-08-22T00:06:12.688234+0000","last_fullsized":"2023-08-22T00:06:12.688234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664815+0000","last_change":"2023-08-22T00:06:08.282647+0000","last_active":"2023-08-22T00:06:12.664815+0000","last_peered":"2023-08-22T00:06:12.664815+0000","last_clean":"2023-08-22T00:06:12.664815+0000","last_became_active":"2023-08-22T00:06:08.282022+0000","last_became_peered":"2023-08-22T00:06:08.282022+0000","last_unstale":"2023-08-22T00:06:12.664815+0000","last_undegraded":"2023-08-22T00:06:12.664815+0000","last_fullsized":"2023-08-22T00:06:12.664815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670644+0000","last_change":"2023-08-22T00:06:08.668740+0000","last_active":"2023-08-22T00:06:12.670644+0000","last_peered":"2023-08-22T00:06:12.670644+0000","last_clean":"2023-08-22T00:06:12.670644+0000","last_became_active":"2023-08-22T00:06:08.668441+0000","last_became_peered":"2023-08-22T00:06:08.668441+0000","last_unstale":"2023-08-22T00:06:12.670644+0000","last_undegraded":"2023-08-22T00:06:12.670644+0000","last_fullsized":"2023-08-22T00:06:12.670644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692932+0000","last_change":"2023-08-22T00:06:12.691493+0000","last_active":"2023-08-22T00:06:12.692932+0000","last_peered":"2023-08-22T00:06:12.692932+0000","last_clean":"2023-08-22T00:06:12.692932+0000","last_became_active":"2023-08-22T00:06:12.691093+0000","last_became_peered":"2023-08-22T00:06:12.691093+0000","last_unstale":"2023-08-22T00:06:12.692932+0000","last_undegraded":"2023-08-22T00:06:12.692932+0000","last_fullsized":"2023-08-22T00:06:12.692932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671568+0000","last_change":"2023-08-22T00:06:08.292035+0000","last_active":"2023-08-22T00:06:12.671568+0000","last_peered":"2023-08-22T00:06:12.671568+0000","last_clean":"2023-08-22T00:06:12.671568+0000","last_became_active":"2023-08-22T00:06:08.291203+0000","last_became_peered":"2023-08-22T00:06:08.291203+0000","last_unstale":"2023-08-22T00:06:12.671568+0000","last_undegraded":"2023-08-22T00:06:12.671568+0000","last_fullsized":"2023-08-22T00:06:12.671568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680614+0000","last_change":"2023-08-22T00:06:08.655585+0000","last_active":"2023-08-22T00:06:12.680614+0000","last_peered":"2023-08-22T00:06:12.680614+0000","last_clean":"2023-08-22T00:06:12.680614+0000","last_became_active":"2023-08-22T00:06:08.655310+0000","last_became_peered":"2023-08-22T00:06:08.655310+0000","last_unstale":"2023-08-22T00:06:12.680614+0000","last_undegraded":"2023-08-22T00:06:12.680614+0000","last_fullsized":"2023-08-22T00:06:12.680614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699073+0000","last_change":"2023-08-22T00:06:12.688045+0000","last_active":"2023-08-22T00:06:12.699073+0000","last_peered":"2023-08-22T00:06:12.699073+0000","last_clean":"2023-08-22T00:06:12.699073+0000","last_became_active":"2023-08-22T00:06:12.687684+0000","last_became_peered":"2023-08-22T00:06:12.687684+0000","last_unstale":"2023-08-22T00:06:12.699073+0000","last_undegraded":"2023-08-22T00:06:12.699073+0000","last_fullsized":"2023-08-22T00:06:12.699073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673315+0000","last_change":"2023-08-22T00:06:08.286986+0000","last_active":"2023-08-22T00:06:12.673315+0000","last_peered":"2023-08-22T00:06:12.673315+0000","last_clean":"2023-08-22T00:06:12.673315+0000","last_became_active":"2023-08-22T00:06:08.285641+0000","last_became_peered":"2023-08-22T00:06:08.285641+0000","last_unstale":"2023-08-22T00:06:12.673315+0000","last_undegraded":"2023-08-22T00:06:12.673315+0000","last_fullsized":"2023-08-22T00:06:12.673315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673919+0000","last_change":"2023-08-22T00:06:08.668481+0000","last_active":"2023-08-22T00:06:12.673919+0000","last_peered":"2023-08-22T00:06:12.673919+0000","last_clean":"2023-08-22T00:06:12.673919+0000","last_became_active":"2023-08-22T00:06:08.668192+0000","last_became_peered":"2023-08-22T00:06:08.668192+0000","last_unstale":"2023-08-22T00:06:12.673919+0000","last_undegraded":"2023-08-22T00:06:12.673919+0000","last_fullsized":"2023-08-22T00:06:12.673919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696626+0000","last_change":"2023-08-22T00:06:12.684100+0000","last_active":"2023-08-22T00:06:12.696626+0000","last_peered":"2023-08-22T00:06:12.696626+0000","last_clean":"2023-08-22T00:06:12.696626+0000","last_became_active":"2023-08-22T00:06:12.683707+0000","last_became_peered":"2023-08-22T00:06:12.683707+0000","last_unstale":"2023-08-22T00:06:12.696626+0000","last_undegraded":"2023-08-22T00:06:12.696626+0000","last_fullsized":"2023-08-22T00:06:12.696626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673189+0000","last_change":"2023-08-22T00:06:08.294557+0000","last_active":"2023-08-22T00:06:12.673189+0000","last_peered":"2023-08-22T00:06:12.673189+0000","last_clean":"2023-08-22T00:06:12.673189+0000","last_became_active":"2023-08-22T00:06:08.292498+0000","last_became_peered":"2023-08-22T00:06:08.292498+0000","last_unstale":"2023-08-22T00:06:12.673189+0000","last_undegraded":"2023-08-22T00:06:12.673189+0000","last_fullsized":"2023-08-22T00:06:12.673189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669639+0000","last_change":"2023-08-22T00:06:08.664640+0000","last_active":"2023-08-22T00:06:12.669639+0000","last_peered":"2023-08-22T00:06:12.669639+0000","last_clean":"2023-08-22T00:06:12.669639+0000","last_became_active":"2023-08-22T00:06:08.664404+0000","last_became_peered":"2023-08-22T00:06:08.664404+0000","last_unstale":"2023-08-22T00:06:12.669639+0000","last_undegraded":"2023-08-22T00:06:12.669639+0000","last_fullsized":"2023-08-22T00:06:12.669639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692623+0000","last_change":"2023-08-22T00:06:12.691313+0000","last_active":"2023-08-22T00:06:12.692623+0000","last_peered":"2023-08-22T00:06:12.692623+0000","last_clean":"2023-08-22T00:06:12.692623+0000","last_became_active":"2023-08-22T00:06:12.690888+0000","last_became_peered":"2023-08-22T00:06:12.690888+0000","last_unstale":"2023-08-22T00:06:12.692623+0000","last_undegraded":"2023-08-22T00:06:12.692623+0000","last_fullsized":"2023-08-22T00:06:12.692623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667060+0000","last_change":"2023-08-22T00:06:08.292435+0000","last_active":"2023-08-22T00:06:12.667060+0000","last_peered":"2023-08-22T00:06:12.667060+0000","last_clean":"2023-08-22T00:06:12.667060+0000","last_became_active":"2023-08-22T00:06:08.292078+0000","last_became_peered":"2023-08-22T00:06:08.292078+0000","last_unstale":"2023-08-22T00:06:12.667060+0000","last_undegraded":"2023-08-22T00:06:12.667060+0000","last_fullsized":"2023-08-22T00:06:12.667060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665745+0000","last_change":"2023-08-22T00:06:08.670166+0000","last_active":"2023-08-22T00:06:12.665745+0000","last_peered":"2023-08-22T00:06:12.665745+0000","last_clean":"2023-08-22T00:06:12.665745+0000","last_became_active":"2023-08-22T00:06:08.669343+0000","last_became_peered":"2023-08-22T00:06:08.669343+0000","last_unstale":"2023-08-22T00:06:12.665745+0000","last_undegraded":"2023-08-22T00:06:12.665745+0000","last_fullsized":"2023-08-22T00:06:12.665745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702398+0000","last_change":"2023-08-22T00:06:12.697624+0000","last_active":"2023-08-22T00:06:12.702398+0000","last_peered":"2023-08-22T00:06:12.702398+0000","last_clean":"2023-08-22T00:06:12.702398+0000","last_became_active":"2023-08-22T00:06:12.697230+0000","last_became_peered":"2023-08-22T00:06:12.697230+0000","last_unstale":"2023-08-22T00:06:12.702398+0000","last_undegraded":"2023-08-22T00:06:12.702398+0000","last_fullsized":"2023-08-22T00:06:12.702398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677201+0000","last_change":"2023-08-22T00:06:08.288780+0000","last_active":"2023-08-22T00:06:12.677201+0000","last_peered":"2023-08-22T00:06:12.677201+0000","last_clean":"2023-08-22T00:06:12.677201+0000","last_became_active":"2023-08-22T00:06:08.288449+0000","last_became_peered":"2023-08-22T00:06:08.288449+0000","last_unstale":"2023-08-22T00:06:12.677201+0000","last_undegraded":"2023-08-22T00:06:12.677201+0000","last_fullsized":"2023-08-22T00:06:12.677201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681899+0000","last_change":"2023-08-22T00:06:08.658370+0000","last_active":"2023-08-22T00:06:12.681899+0000","last_peered":"2023-08-22T00:06:12.681899+0000","last_clean":"2023-08-22T00:06:12.681899+0000","last_became_active":"2023-08-22T00:06:08.658088+0000","last_became_peered":"2023-08-22T00:06:08.658088+0000","last_unstale":"2023-08-22T00:06:12.681899+0000","last_undegraded":"2023-08-22T00:06:12.681899+0000","last_fullsized":"2023-08-22T00:06:12.681899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699205+0000","last_change":"2023-08-22T00:06:12.690837+0000","last_active":"2023-08-22T00:06:12.699205+0000","last_peered":"2023-08-22T00:06:12.699205+0000","last_clean":"2023-08-22T00:06:12.699205+0000","last_became_active":"2023-08-22T00:06:12.690046+0000","last_became_peered":"2023-08-22T00:06:12.690046+0000","last_unstale":"2023-08-22T00:06:12.699205+0000","last_undegraded":"2023-08-22T00:06:12.699205+0000","last_fullsized":"2023-08-22T00:06:12.699205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674238+0000","last_change":"2023-08-22T00:06:08.298405+0000","last_active":"2023-08-22T00:06:12.674238+0000","last_peered":"2023-08-22T00:06:12.674238+0000","last_clean":"2023-08-22T00:06:12.674238+0000","last_became_active":"2023-08-22T00:06:08.298085+0000","last_became_peered":"2023-08-22T00:06:08.298085+0000","last_unstale":"2023-08-22T00:06:12.674238+0000","last_undegraded":"2023-08-22T00:06:12.674238+0000","last_fullsized":"2023-08-22T00:06:12.674238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667438+0000","last_change":"2023-08-22T00:06:08.664353+0000","last_active":"2023-08-22T00:06:12.667438+0000","last_peered":"2023-08-22T00:06:12.667438+0000","last_clean":"2023-08-22T00:06:12.667438+0000","last_became_active":"2023-08-22T00:06:08.664104+0000","last_became_peered":"2023-08-22T00:06:08.664104+0000","last_unstale":"2023-08-22T00:06:12.667438+0000","last_undegraded":"2023-08-22T00:06:12.667438+0000","last_fullsized":"2023-08-22T00:06:12.667438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691805+0000","last_change":"2023-08-22T00:06:12.688530+0000","last_active":"2023-08-22T00:06:12.691805+0000","last_peered":"2023-08-22T00:06:12.691805+0000","last_clean":"2023-08-22T00:06:12.691805+0000","last_became_active":"2023-08-22T00:06:12.688138+0000","last_became_peered":"2023-08-22T00:06:12.688138+0000","last_unstale":"2023-08-22T00:06:12.691805+0000","last_undegraded":"2023-08-22T00:06:12.691805+0000","last_fullsized":"2023-08-22T00:06:12.691805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673548+0000","last_change":"2023-08-22T00:06:08.286478+0000","last_active":"2023-08-22T00:06:12.673548+0000","last_peered":"2023-08-22T00:06:12.673548+0000","last_clean":"2023-08-22T00:06:12.673548+0000","last_became_active":"2023-08-22T00:06:08.285839+0000","last_became_peered":"2023-08-22T00:06:08.285839+0000","last_unstale":"2023-08-22T00:06:12.673548+0000","last_undegraded":"2023-08-22T00:06:12.673548+0000","last_fullsized":"2023-08-22T00:06:12.673548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666553+0000","last_change":"2023-08-22T00:06:08.660300+0000","last_active":"2023-08-22T00:06:12.666553+0000","last_peered":"2023-08-22T00:06:12.666553+0000","last_clean":"2023-08-22T00:06:12.666553+0000","last_became_active":"2023-08-22T00:06:08.660029+0000","last_became_peered":"2023-08-22T00:06:08.660029+0000","last_unstale":"2023-08-22T00:06:12.666553+0000","last_undegraded":"2023-08-22T00:06:12.666553+0000","last_fullsized":"2023-08-22T00:06:12.666553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682861+0000","last_change":"2023-08-22T00:06:12.680840+0000","last_active":"2023-08-22T00:06:12.682861+0000","last_peered":"2023-08-22T00:06:12.682861+0000","last_clean":"2023-08-22T00:06:12.682861+0000","last_became_active":"2023-08-22T00:06:12.680150+0000","last_became_peered":"2023-08-22T00:06:12.680150+0000","last_unstale":"2023-08-22T00:06:12.682861+0000","last_undegraded":"2023-08-22T00:06:12.682861+0000","last_fullsized":"2023-08-22T00:06:12.682861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702263+0000","last_change":"2023-08-22T00:06:12.697155+0000","last_active":"2023-08-22T00:06:12.702263+0000","last_peered":"2023-08-22T00:06:12.702263+0000","last_clean":"2023-08-22T00:06:12.702263+0000","last_became_active":"2023-08-22T00:06:12.696776+0000","last_became_peered":"2023-08-22T00:06:12.696776+0000","last_unstale":"2023-08-22T00:06:12.702263+0000","last_undegraded":"2023-08-22T00:06:12.702263+0000","last_fullsized":"2023-08-22T00:06:12.702263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666911+0000","last_change":"2023-08-22T00:06:08.290382+0000","last_active":"2023-08-22T00:06:12.666911+0000","last_peered":"2023-08-22T00:06:12.666911+0000","last_clean":"2023-08-22T00:06:12.666911+0000","last_became_active":"2023-08-22T00:06:08.289805+0000","last_became_peered":"2023-08-22T00:06:08.289805+0000","last_unstale":"2023-08-22T00:06:12.666911+0000","last_undegraded":"2023-08-22T00:06:12.666911+0000","last_fullsized":"2023-08-22T00:06:12.666911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665485+0000","last_change":"2023-08-22T00:06:08.660218+0000","last_active":"2023-08-22T00:06:12.665485+0000","last_peered":"2023-08-22T00:06:12.665485+0000","last_clean":"2023-08-22T00:06:12.665485+0000","last_became_active":"2023-08-22T00:06:08.657393+0000","last_became_peered":"2023-08-22T00:06:08.657393+0000","last_unstale":"2023-08-22T00:06:12.665485+0000","last_undegraded":"2023-08-22T00:06:12.665485+0000","last_fullsized":"2023-08-22T00:06:12.665485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685964+0000","last_change":"2023-08-22T00:06:12.679635+0000","last_active":"2023-08-22T00:06:12.685964+0000","last_peered":"2023-08-22T00:06:12.685964+0000","last_clean":"2023-08-22T00:06:12.685964+0000","last_became_active":"2023-08-22T00:06:12.679242+0000","last_became_peered":"2023-08-22T00:06:12.679242+0000","last_unstale":"2023-08-22T00:06:12.685964+0000","last_undegraded":"2023-08-22T00:06:12.685964+0000","last_fullsized":"2023-08-22T00:06:12.685964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678592+0000","last_change":"2023-08-22T00:06:08.281551+0000","last_active":"2023-08-22T00:06:12.678592+0000","last_peered":"2023-08-22T00:06:12.678592+0000","last_clean":"2023-08-22T00:06:12.678592+0000","last_became_active":"2023-08-22T00:06:08.281148+0000","last_became_peered":"2023-08-22T00:06:08.281148+0000","last_unstale":"2023-08-22T00:06:12.678592+0000","last_undegraded":"2023-08-22T00:06:12.678592+0000","last_fullsized":"2023-08-22T00:06:12.678592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680434+0000","last_change":"2023-08-22T00:06:08.667817+0000","last_active":"2023-08-22T00:06:12.680434+0000","last_peered":"2023-08-22T00:06:12.680434+0000","last_clean":"2023-08-22T00:06:12.680434+0000","last_became_active":"2023-08-22T00:06:08.667588+0000","last_became_peered":"2023-08-22T00:06:08.667588+0000","last_unstale":"2023-08-22T00:06:12.680434+0000","last_undegraded":"2023-08-22T00:06:12.680434+0000","last_fullsized":"2023-08-22T00:06:12.680434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666260+0000","last_change":"2023-08-22T00:06:08.285483+0000","last_active":"2023-08-22T00:06:12.666260+0000","last_peered":"2023-08-22T00:06:12.666260+0000","last_clean":"2023-08-22T00:06:12.666260+0000","last_became_active":"2023-08-22T00:06:08.284913+0000","last_became_peered":"2023-08-22T00:06:08.284913+0000","last_unstale":"2023-08-22T00:06:12.666260+0000","last_undegraded":"2023-08-22T00:06:12.666260+0000","last_fullsized":"2023-08-22T00:06:12.666260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669933+0000","last_change":"2023-08-22T00:06:08.660823+0000","last_active":"2023-08-22T00:06:12.669933+0000","last_peered":"2023-08-22T00:06:12.669933+0000","last_clean":"2023-08-22T00:06:12.669933+0000","last_became_active":"2023-08-22T00:06:08.660576+0000","last_became_peered":"2023-08-22T00:06:08.660576+0000","last_unstale":"2023-08-22T00:06:12.669933+0000","last_undegraded":"2023-08-22T00:06:12.669933+0000","last_fullsized":"2023-08-22T00:06:12.669933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688868+0000","last_change":"2023-08-22T00:06:12.687512+0000","last_active":"2023-08-22T00:06:12.688868+0000","last_peered":"2023-08-22T00:06:12.688868+0000","last_clean":"2023-08-22T00:06:12.688868+0000","last_became_active":"2023-08-22T00:06:12.687104+0000","last_became_peered":"2023-08-22T00:06:12.687104+0000","last_unstale":"2023-08-22T00:06:12.688868+0000","last_undegraded":"2023-08-22T00:06:12.688868+0000","last_fullsized":"2023-08-22T00:06:12.688868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297396,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074444,"statfs":{"total":96636764160,"available":96332230656,"internally_reserved":0,"allocated":307200,"data_stored":117459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":119671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297388,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074452,"statfs":{"total":96636764160,"available":96332238848,"internally_reserved":0,"allocated":299008,"data_stored":119817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:06:27.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:06:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.352+0000 7f9389a2b700 1 Processor -- start 2023-08-22T00:06:27.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.352+0000 7f9389a2b700 1 -- start start 2023-08-22T00:06:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9389a2b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840c61a0 0x7f938414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9389a2b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93841544f0 0x7f93841549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9389a2b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9384155260 con 0x7f938414e0d0 2023-08-22T00:06:27.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9389a2b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840c17b0 con 0x7f93841544f0 2023-08-22T00:06:27.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9389a2b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840bf9e0 con 0x7f93840c61a0 2023-08-22T00:06:27.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9382ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f938414e0d0 0x7f93840c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47506/0 (socket says 172.21.15.98:47506) 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f9382ffd700 1 -- 172.21.15.98:0/3867038733 learned_addr learned my addr 172.21.15.98:0/3867038733 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f93827fc700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840c61a0 0x7f938414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.353+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> v2:172.21.15.118:3300/0 conn(0x7f93841544f0 0x7f93841549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638839591 0 0) 0x7f9384155260 con 0x7f938414e0d0 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f936c0033f0 con 0x7f938414e0d0 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739237142 0 0) 0x7f936c0033f0 con 0x7f938414e0d0 2023-08-22T00:06:27.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840c61a0 msgr2=0x7f938414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840c61a0 0x7f938414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 >> v2:172.21.15.118:3300/0 conn(0x7f93841544f0 msgr2=0x7f93841549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 --2- 172.21.15.98:0/3867038733 >> v2:172.21.15.118:3300/0 conn(0x7f93841544f0 0x7f93841549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840bfcc0 con 0x7f938414e0d0 2023-08-22T00:06:27.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9378001470 con 0x7f938414e0d0 2023-08-22T00:06:27.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 >> v1:172.21.15.98:6789/0 conn(0x7f938414e0d0 legacy=0x7f93840c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f936c0038e0 0x7f936c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f936c004690 0x7f936c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f936c005000 0x7f936c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c17b0 con 0x7f936c005000 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840bf9e0 con 0x7f936c0038e0 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c00bdd0 con 0x7f936c004690 2023-08-22T00:06:27.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> v2:172.21.15.118:3300/0 conn(0x7f93841544f0 0x7f93841549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:27.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93827fc700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840c61a0 0x7f938414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:27.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f936c005000 0x7f936c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f9382ffd700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f936c0038e0 0x7f936c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93827fc700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f936c004690 0x7f936c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 -- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f936c004690 msgr2=0x7f936c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f936c004690 0x7f936c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 -- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f936c0038e0 msgr2=0x7f936c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f936c0038e0 0x7f936c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 -- 172.21.15.98:0/3867038733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0033f0 con 0x7f936c005000 2023-08-22T00:06:27.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.354+0000 7f93837fe700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f936c005000 0x7f936c00b8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f937c00e3f0 tx=0x7f937c00b040).ready entity=mon.0 client_cookie=9ab46bdb8b5aea2e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c017070 con 0x7f936c005000 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00f040 con 0x7f936c005000 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9381ffb700 1 -- 172.21.15.98:0/3867038733 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00eeb0 con 0x7f936c005000 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 -- 172.21.15.98:0/3867038733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f936c005000 msgr2=0x7f936c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 --2- 172.21.15.98:0/3867038733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f936c005000 0x7f936c00b8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f937c00e3f0 tx=0x7f937c00b040).stop 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f93837fe700 1 -- 172.21.15.98:0/3867038733 reap_dead start 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 -- 172.21.15.98:0/3867038733 shutdown_connections 2023-08-22T00:06:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 -- 172.21.15.98:0/3867038733 >> 172.21.15.98:0/3867038733 conn(0x7f93840caa80 msgr2=0x7f93840cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 -- 172.21.15.98:0/3867038733 shutdown_connections 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.355+0000 7f9389a2b700 1 -- 172.21.15.98:0/3867038733 wait complete. 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.356+0000 7f9389a2b700 1 Processor -- start 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 -- start start 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 0x7f93841525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 0x7f938413e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c4330 con 0x7f93841672d0 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c3720 con 0x7f93840c2d60 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f9389a2b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c3a00 con 0x7f93841521f0 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f93827fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f93827fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42902/0 (socket says 172.21.15.98:42902) 2023-08-22T00:06:27.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.357+0000 7f93827fc700 1 -- 172.21.15.98:0/1073528839 learned_addr learned my addr 172.21.15.98:0/1073528839 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:27.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f9382ffd700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 0x7f93841525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93837fe700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 0x7f938413e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 -- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 msgr2=0x7f93841525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 0x7f93841525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 -- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 msgr2=0x7f938413e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 0x7f938413e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 -- 172.21.15.98:0/1073528839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840c3ce0 con 0x7f93841672d0 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f9382ffd700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 0x7f93841525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93837fe700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 0x7f938413e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f93827fc700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f93740119f0 tx=0x7f9374009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400f940 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400faa0 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93840c3fc0 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400fe20 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.358+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93840c31e0 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.359+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93840c44e0 con 0x7f93841672d0 2023-08-22T00:06:27.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.360+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9374014650 con 0x7f93841672d0 2023-08-22T00:06:27.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.360+0000 7f936affd700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 0x7f93700612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.360+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f937407abb0 con 0x7f93841672d0 2023-08-22T00:06:27.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.360+0000 7f9382ffd700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 0x7f93700612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.360+0000 7f9382ffd700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 0x7f93700612d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f93780015a0 tx=0x7f9378009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.364+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93840c44e0 con 0x7f93841672d0 2023-08-22T00:06:27.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.519+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93840c34c0 con 0x7f937005ee10 2023-08-22T00:06:27.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.529+0000 7f936affd700 1 -- 172.21.15.98:0/1073528839 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410693 (secure 0 0 0) 0x7f93840c34c0 con 0x7f937005ee10 2023-08-22T00:06:27.541 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:27.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 msgr2=0x7f93700612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 0x7f93700612d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f93780015a0 tx=0x7f9378009040).stop 2023-08-22T00:06:27.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 msgr2=0x7f93840c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f93740119f0 tx=0x7f9374009060).stop 2023-08-22T00:06:27.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 shutdown_connections 2023-08-22T00:06:27.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f937005ee10 0x7f93700612d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93841521f0 0x7f93841525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93840c2d60 0x7f938413e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 --2- 172.21.15.98:0/1073528839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93841672d0 0x7f93840c47c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 >> 172.21.15.98:0/1073528839 conn(0x7f93840caa80 msgr2=0x7f9384153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 shutdown_connections 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.533+0000 7f9389a2b700 1 -- 172.21.15.98:0/1073528839 wait complete. 2023-08-22T00:06:27.545 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:06:27.547 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-08-22T00:06:26.034577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379008,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595712,"statfs":{"total":773094113280,"available":770658009088,"internally_reserved":0,"allocated":2293760,"data_stored":937332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2180,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003200"},"pg_stats":[{"pgid":"3.3f","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678589+0000","last_change":"2023-08-22T00:06:08.291099+0000","last_active":"2023-08-22T00:06:12.678589+0000","last_peered":"2023-08-22T00:06:12.678589+0000","last_clean":"2023-08-22T00:06:12.678589+0000","last_became_active":"2023-08-22T00:06:08.290795+0000","last_became_peered":"2023-08-22T00:06:08.290795+0000","last_unstale":"2023-08-22T00:06:12.678589+0000","last_undegraded":"2023-08-22T00:06:12.678589+0000","last_fullsized":"2023-08-22T00:06:12.678589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673305+0000","last_change":"2023-08-22T00:06:08.656231+0000","last_active":"2023-08-22T00:06:12.673305+0000","last_peered":"2023-08-22T00:06:12.673305+0000","last_clean":"2023-08-22T00:06:12.673305+0000","last_became_active":"2023-08-22T00:06:08.655915+0000","last_became_peered":"2023-08-22T00:06:08.655915+0000","last_unstale":"2023-08-22T00:06:12.673305+0000","last_undegraded":"2023-08-22T00:06:12.673305+0000","last_fullsized":"2023-08-22T00:06:12.673305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684438+0000","last_change":"2023-08-22T00:06:08.288428+0000","last_active":"2023-08-22T00:06:12.684438+0000","last_peered":"2023-08-22T00:06:12.684438+0000","last_clean":"2023-08-22T00:06:12.684438+0000","last_became_active":"2023-08-22T00:06:08.286608+0000","last_became_peered":"2023-08-22T00:06:08.286608+0000","last_unstale":"2023-08-22T00:06:12.684438+0000","last_undegraded":"2023-08-22T00:06:12.684438+0000","last_fullsized":"2023-08-22T00:06:12.684438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671745+0000","last_change":"2023-08-22T00:06:08.662348+0000","last_active":"2023-08-22T00:06:12.671745+0000","last_peered":"2023-08-22T00:06:12.671745+0000","last_clean":"2023-08-22T00:06:12.671745+0000","last_became_active":"2023-08-22T00:06:08.661703+0000","last_became_peered":"2023-08-22T00:06:08.661703+0000","last_unstale":"2023-08-22T00:06:12.671745+0000","last_undegraded":"2023-08-22T00:06:12.671745+0000","last_fullsized":"2023-08-22T00:06:12.671745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675218+0000","last_change":"2023-08-22T00:06:08.287214+0000","last_active":"2023-08-22T00:06:12.675218+0000","last_peered":"2023-08-22T00:06:12.675218+0000","last_clean":"2023-08-22T00:06:12.675218+0000","last_became_active":"2023-08-22T00:06:08.286927+0000","last_became_peered":"2023-08-22T00:06:08.286927+0000","last_unstale":"2023-08-22T00:06:12.675218+0000","last_undegraded":"2023-08-22T00:06:12.675218+0000","last_fullsized":"2023-08-22T00:06:12.675218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666426+0000","last_change":"2023-08-22T00:06:08.656790+0000","last_active":"2023-08-22T00:06:12.666426+0000","last_peered":"2023-08-22T00:06:12.666426+0000","last_clean":"2023-08-22T00:06:12.666426+0000","last_became_active":"2023-08-22T00:06:08.656519+0000","last_became_peered":"2023-08-22T00:06:08.656519+0000","last_unstale":"2023-08-22T00:06:12.666426+0000","last_undegraded":"2023-08-22T00:06:12.666426+0000","last_fullsized":"2023-08-22T00:06:12.666426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672202+0000","last_change":"2023-08-22T00:06:08.293624+0000","last_active":"2023-08-22T00:06:12.672202+0000","last_peered":"2023-08-22T00:06:12.672202+0000","last_clean":"2023-08-22T00:06:12.672202+0000","last_became_active":"2023-08-22T00:06:08.293347+0000","last_became_peered":"2023-08-22T00:06:08.293347+0000","last_unstale":"2023-08-22T00:06:12.672202+0000","last_undegraded":"2023-08-22T00:06:12.672202+0000","last_fullsized":"2023-08-22T00:06:12.672202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681949+0000","last_change":"2023-08-22T00:06:08.659129+0000","last_active":"2023-08-22T00:06:12.681949+0000","last_peered":"2023-08-22T00:06:12.681949+0000","last_clean":"2023-08-22T00:06:12.681949+0000","last_became_active":"2023-08-22T00:06:08.658860+0000","last_became_peered":"2023-08-22T00:06:08.658860+0000","last_unstale":"2023-08-22T00:06:12.681949+0000","last_undegraded":"2023-08-22T00:06:12.681949+0000","last_fullsized":"2023-08-22T00:06:12.681949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673280+0000","last_change":"2023-08-22T00:06:08.289602+0000","last_active":"2023-08-22T00:06:12.673280+0000","last_peered":"2023-08-22T00:06:12.673280+0000","last_clean":"2023-08-22T00:06:12.673280+0000","last_became_active":"2023-08-22T00:06:08.289342+0000","last_became_peered":"2023-08-22T00:06:08.289342+0000","last_unstale":"2023-08-22T00:06:12.673280+0000","last_undegraded":"2023-08-22T00:06:12.673280+0000","last_fullsized":"2023-08-22T00:06:12.673280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666271+0000","last_change":"2023-08-22T00:06:08.661296+0000","last_active":"2023-08-22T00:06:12.666271+0000","last_peered":"2023-08-22T00:06:12.666271+0000","last_clean":"2023-08-22T00:06:12.666271+0000","last_became_active":"2023-08-22T00:06:08.660986+0000","last_became_peered":"2023-08-22T00:06:08.660986+0000","last_unstale":"2023-08-22T00:06:12.666271+0000","last_undegraded":"2023-08-22T00:06:12.666271+0000","last_fullsized":"2023-08-22T00:06:12.666271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673253+0000","last_change":"2023-08-22T00:06:08.288788+0000","last_active":"2023-08-22T00:06:12.673253+0000","last_peered":"2023-08-22T00:06:12.673253+0000","last_clean":"2023-08-22T00:06:12.673253+0000","last_became_active":"2023-08-22T00:06:08.288515+0000","last_became_peered":"2023-08-22T00:06:08.288515+0000","last_unstale":"2023-08-22T00:06:12.673253+0000","last_undegraded":"2023-08-22T00:06:12.673253+0000","last_fullsized":"2023-08-22T00:06:12.673253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666020+0000","last_change":"2023-08-22T00:06:08.658212+0000","last_active":"2023-08-22T00:06:12.666020+0000","last_peered":"2023-08-22T00:06:12.666020+0000","last_clean":"2023-08-22T00:06:12.666020+0000","last_became_active":"2023-08-22T00:06:08.657937+0000","last_became_peered":"2023-08-22T00:06:08.657937+0000","last_unstale":"2023-08-22T00:06:12.666020+0000","last_undegraded":"2023-08-22T00:06:12.666020+0000","last_fullsized":"2023-08-22T00:06:12.666020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671479+0000","last_change":"2023-08-22T00:06:08.297342+0000","last_active":"2023-08-22T00:06:12.671479+0000","last_peered":"2023-08-22T00:06:12.671479+0000","last_clean":"2023-08-22T00:06:12.671479+0000","last_became_active":"2023-08-22T00:06:08.291355+0000","last_became_peered":"2023-08-22T00:06:08.291355+0000","last_unstale":"2023-08-22T00:06:12.671479+0000","last_undegraded":"2023-08-22T00:06:12.671479+0000","last_fullsized":"2023-08-22T00:06:12.671479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674444+0000","last_change":"2023-08-22T00:06:08.660595+0000","last_active":"2023-08-22T00:06:12.674444+0000","last_peered":"2023-08-22T00:06:12.674444+0000","last_clean":"2023-08-22T00:06:12.674444+0000","last_became_active":"2023-08-22T00:06:08.660326+0000","last_became_peered":"2023-08-22T00:06:08.660326+0000","last_unstale":"2023-08-22T00:06:12.674444+0000","last_undegraded":"2023-08-22T00:06:12.674444+0000","last_fullsized":"2023-08-22T00:06:12.674444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666783+0000","last_change":"2023-08-22T00:06:08.289343+0000","last_active":"2023-08-22T00:06:12.666783+0000","last_peered":"2023-08-22T00:06:12.666783+0000","last_clean":"2023-08-22T00:06:12.666783+0000","last_became_active":"2023-08-22T00:06:08.289074+0000","last_became_peered":"2023-08-22T00:06:08.289074+0000","last_unstale":"2023-08-22T00:06:12.666783+0000","last_undegraded":"2023-08-22T00:06:12.666783+0000","last_fullsized":"2023-08-22T00:06:12.666783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670629+0000","last_change":"2023-08-22T00:06:08.665424+0000","last_active":"2023-08-22T00:06:12.670629+0000","last_peered":"2023-08-22T00:06:12.670629+0000","last_clean":"2023-08-22T00:06:12.670629+0000","last_became_active":"2023-08-22T00:06:08.665177+0000","last_became_peered":"2023-08-22T00:06:08.665177+0000","last_unstale":"2023-08-22T00:06:12.670629+0000","last_undegraded":"2023-08-22T00:06:12.670629+0000","last_fullsized":"2023-08-22T00:06:12.670629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678499+0000","last_change":"2023-08-22T00:06:08.291866+0000","last_active":"2023-08-22T00:06:12.678499+0000","last_peered":"2023-08-22T00:06:12.678499+0000","last_clean":"2023-08-22T00:06:12.678499+0000","last_became_active":"2023-08-22T00:06:08.291381+0000","last_became_peered":"2023-08-22T00:06:08.291381+0000","last_unstale":"2023-08-22T00:06:12.678499+0000","last_undegraded":"2023-08-22T00:06:12.678499+0000","last_fullsized":"2023-08-22T00:06:12.678499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665055+0000","last_change":"2023-08-22T00:06:08.658534+0000","last_active":"2023-08-22T00:06:12.665055+0000","last_peered":"2023-08-22T00:06:12.665055+0000","last_clean":"2023-08-22T00:06:12.665055+0000","last_became_active":"2023-08-22T00:06:08.658274+0000","last_became_peered":"2023-08-22T00:06:08.658274+0000","last_unstale":"2023-08-22T00:06:12.665055+0000","last_undegraded":"2023-08-22T00:06:12.665055+0000","last_fullsized":"2023-08-22T00:06:12.665055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666238+0000","last_change":"2023-08-22T00:06:08.287355+0000","last_active":"2023-08-22T00:06:12.666238+0000","last_peered":"2023-08-22T00:06:12.666238+0000","last_clean":"2023-08-22T00:06:12.666238+0000","last_became_active":"2023-08-22T00:06:08.287061+0000","last_became_peered":"2023-08-22T00:06:08.287061+0000","last_unstale":"2023-08-22T00:06:12.666238+0000","last_undegraded":"2023-08-22T00:06:12.666238+0000","last_fullsized":"2023-08-22T00:06:12.666238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671653+0000","last_change":"2023-08-22T00:06:08.662523+0000","last_active":"2023-08-22T00:06:12.671653+0000","last_peered":"2023-08-22T00:06:12.671653+0000","last_clean":"2023-08-22T00:06:12.671653+0000","last_became_active":"2023-08-22T00:06:08.662068+0000","last_became_peered":"2023-08-22T00:06:08.662068+0000","last_unstale":"2023-08-22T00:06:12.671653+0000","last_undegraded":"2023-08-22T00:06:12.671653+0000","last_fullsized":"2023-08-22T00:06:12.671653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664956+0000","last_change":"2023-08-22T00:06:08.286978+0000","last_active":"2023-08-22T00:06:12.664956+0000","last_peered":"2023-08-22T00:06:12.664956+0000","last_clean":"2023-08-22T00:06:12.664956+0000","last_became_active":"2023-08-22T00:06:08.286637+0000","last_became_peered":"2023-08-22T00:06:08.286637+0000","last_unstale":"2023-08-22T00:06:12.664956+0000","last_undegraded":"2023-08-22T00:06:12.664956+0000","last_fullsized":"2023-08-22T00:06:12.664956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672913+0000","last_change":"2023-08-22T00:06:08.659864+0000","last_active":"2023-08-22T00:06:12.672913+0000","last_peered":"2023-08-22T00:06:12.672913+0000","last_clean":"2023-08-22T00:06:12.672913+0000","last_became_active":"2023-08-22T00:06:08.659559+0000","last_became_peered":"2023-08-22T00:06:08.659559+0000","last_unstale":"2023-08-22T00:06:12.672913+0000","last_undegraded":"2023-08-22T00:06:12.672913+0000","last_fullsized":"2023-08-22T00:06:12.672913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:17.797484+0000","last_change":"2023-08-22T00:06:08.296851+0000","last_active":"2023-08-22T00:06:17.797484+0000","last_peered":"2023-08-22T00:06:17.797484+0000","last_clean":"2023-08-22T00:06:17.797484+0000","last_became_active":"2023-08-22T00:06:08.296567+0000","last_became_peered":"2023-08-22T00:06:08.296567+0000","last_unstale":"2023-08-22T00:06:17.797484+0000","last_undegraded":"2023-08-22T00:06:17.797484+0000","last_fullsized":"2023-08-22T00:06:17.797484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673049+0000","last_change":"2023-08-22T00:06:08.665352+0000","last_active":"2023-08-22T00:06:12.673049+0000","last_peered":"2023-08-22T00:06:12.673049+0000","last_clean":"2023-08-22T00:06:12.673049+0000","last_became_active":"2023-08-22T00:06:08.665087+0000","last_became_peered":"2023-08-22T00:06:08.665087+0000","last_unstale":"2023-08-22T00:06:12.673049+0000","last_undegraded":"2023-08-22T00:06:12.673049+0000","last_fullsized":"2023-08-22T00:06:12.673049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667424+0000","last_change":"2023-08-22T00:06:08.288914+0000","last_active":"2023-08-22T00:06:12.667424+0000","last_peered":"2023-08-22T00:06:12.667424+0000","last_clean":"2023-08-22T00:06:12.667424+0000","last_became_active":"2023-08-22T00:06:08.287814+0000","last_became_peered":"2023-08-22T00:06:08.287814+0000","last_unstale":"2023-08-22T00:06:12.667424+0000","last_undegraded":"2023-08-22T00:06:12.667424+0000","last_fullsized":"2023-08-22T00:06:12.667424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671643+0000","last_change":"2023-08-22T00:06:08.654359+0000","last_active":"2023-08-22T00:06:12.671643+0000","last_peered":"2023-08-22T00:06:12.671643+0000","last_clean":"2023-08-22T00:06:12.671643+0000","last_became_active":"2023-08-22T00:06:08.653920+0000","last_became_peered":"2023-08-22T00:06:08.653920+0000","last_unstale":"2023-08-22T00:06:12.671643+0000","last_undegraded":"2023-08-22T00:06:12.671643+0000","last_fullsized":"2023-08-22T00:06:12.671643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673398+0000","last_change":"2023-08-22T00:06:08.282186+0000","last_active":"2023-08-22T00:06:12.673398+0000","last_peered":"2023-08-22T00:06:12.673398+0000","last_clean":"2023-08-22T00:06:12.673398+0000","last_became_active":"2023-08-22T00:06:08.281908+0000","last_became_peered":"2023-08-22T00:06:08.281908+0000","last_unstale":"2023-08-22T00:06:12.673398+0000","last_undegraded":"2023-08-22T00:06:12.673398+0000","last_fullsized":"2023-08-22T00:06:12.673398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666143+0000","last_change":"2023-08-22T00:06:08.662549+0000","last_active":"2023-08-22T00:06:12.666143+0000","last_peered":"2023-08-22T00:06:12.666143+0000","last_clean":"2023-08-22T00:06:12.666143+0000","last_became_active":"2023-08-22T00:06:08.662262+0000","last_became_peered":"2023-08-22T00:06:08.662262+0000","last_unstale":"2023-08-22T00:06:12.666143+0000","last_undegraded":"2023-08-22T00:06:12.666143+0000","last_fullsized":"2023-08-22T00:06:12.666143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674164+0000","last_change":"2023-08-22T00:06:08.289283+0000","last_active":"2023-08-22T00:06:12.674164+0000","last_peered":"2023-08-22T00:06:12.674164+0000","last_clean":"2023-08-22T00:06:12.674164+0000","last_became_active":"2023-08-22T00:06:08.289007+0000","last_became_peered":"2023-08-22T00:06:08.289007+0000","last_unstale":"2023-08-22T00:06:12.674164+0000","last_undegraded":"2023-08-22T00:06:12.674164+0000","last_fullsized":"2023-08-22T00:06:12.674164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674326+0000","last_change":"2023-08-22T00:06:08.661468+0000","last_active":"2023-08-22T00:06:12.674326+0000","last_peered":"2023-08-22T00:06:12.674326+0000","last_clean":"2023-08-22T00:06:12.674326+0000","last_became_active":"2023-08-22T00:06:08.661197+0000","last_became_peered":"2023-08-22T00:06:08.661197+0000","last_unstale":"2023-08-22T00:06:12.674326+0000","last_undegraded":"2023-08-22T00:06:12.674326+0000","last_fullsized":"2023-08-22T00:06:12.674326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672725+0000","last_change":"2023-08-22T00:06:08.288133+0000","last_active":"2023-08-22T00:06:12.672725+0000","last_peered":"2023-08-22T00:06:12.672725+0000","last_clean":"2023-08-22T00:06:12.672725+0000","last_became_active":"2023-08-22T00:06:08.287879+0000","last_became_peered":"2023-08-22T00:06:08.287879+0000","last_unstale":"2023-08-22T00:06:12.672725+0000","last_undegraded":"2023-08-22T00:06:12.672725+0000","last_fullsized":"2023-08-22T00:06:12.672725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673390+0000","last_change":"2023-08-22T00:06:08.663390+0000","last_active":"2023-08-22T00:06:12.673390+0000","last_peered":"2023-08-22T00:06:12.673390+0000","last_clean":"2023-08-22T00:06:12.673390+0000","last_became_active":"2023-08-22T00:06:08.663010+0000","last_became_peered":"2023-08-22T00:06:08.663010+0000","last_unstale":"2023-08-22T00:06:12.673390+0000","last_undegraded":"2023-08-22T00:06:12.673390+0000","last_fullsized":"2023-08-22T00:06:12.673390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674564+0000","last_change":"2023-08-22T00:06:08.293331+0000","last_active":"2023-08-22T00:06:12.674564+0000","last_peered":"2023-08-22T00:06:12.674564+0000","last_clean":"2023-08-22T00:06:12.674564+0000","last_became_active":"2023-08-22T00:06:08.293020+0000","last_became_peered":"2023-08-22T00:06:08.293020+0000","last_unstale":"2023-08-22T00:06:12.674564+0000","last_undegraded":"2023-08-22T00:06:12.674564+0000","last_fullsized":"2023-08-22T00:06:12.674564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671788+0000","last_change":"2023-08-22T00:06:08.666837+0000","last_active":"2023-08-22T00:06:12.671788+0000","last_peered":"2023-08-22T00:06:12.671788+0000","last_clean":"2023-08-22T00:06:12.671788+0000","last_became_active":"2023-08-22T00:06:08.666560+0000","last_became_peered":"2023-08-22T00:06:08.666560+0000","last_unstale":"2023-08-22T00:06:12.671788+0000","last_undegraded":"2023-08-22T00:06:12.671788+0000","last_fullsized":"2023-08-22T00:06:12.671788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675040+0000","last_change":"2023-08-22T00:06:08.287559+0000","last_active":"2023-08-22T00:06:12.675040+0000","last_peered":"2023-08-22T00:06:12.675040+0000","last_clean":"2023-08-22T00:06:12.675040+0000","last_became_active":"2023-08-22T00:06:08.287287+0000","last_became_peered":"2023-08-22T00:06:08.287287+0000","last_unstale":"2023-08-22T00:06:12.675040+0000","last_undegraded":"2023-08-22T00:06:12.675040+0000","last_fullsized":"2023-08-22T00:06:12.675040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667298+0000","last_change":"2023-08-22T00:06:08.662355+0000","last_active":"2023-08-22T00:06:12.667298+0000","last_peered":"2023-08-22T00:06:12.667298+0000","last_clean":"2023-08-22T00:06:12.667298+0000","last_became_active":"2023-08-22T00:06:08.662086+0000","last_became_peered":"2023-08-22T00:06:08.662086+0000","last_unstale":"2023-08-22T00:06:12.667298+0000","last_undegraded":"2023-08-22T00:06:12.667298+0000","last_fullsized":"2023-08-22T00:06:12.667298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677300+0000","last_change":"2023-08-22T00:06:08.290222+0000","last_active":"2023-08-22T00:06:12.677300+0000","last_peered":"2023-08-22T00:06:12.677300+0000","last_clean":"2023-08-22T00:06:12.677300+0000","last_became_active":"2023-08-22T00:06:08.289968+0000","last_became_peered":"2023-08-22T00:06:08.289968+0000","last_unstale":"2023-08-22T00:06:12.677300+0000","last_undegraded":"2023-08-22T00:06:12.677300+0000","last_fullsized":"2023-08-22T00:06:12.677300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673232+0000","last_change":"2023-08-22T00:06:08.658917+0000","last_active":"2023-08-22T00:06:12.673232+0000","last_peered":"2023-08-22T00:06:12.673232+0000","last_clean":"2023-08-22T00:06:12.673232+0000","last_became_active":"2023-08-22T00:06:08.658657+0000","last_became_peered":"2023-08-22T00:06:08.658657+0000","last_unstale":"2023-08-22T00:06:12.673232+0000","last_undegraded":"2023-08-22T00:06:12.673232+0000","last_fullsized":"2023-08-22T00:06:12.673232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665200+0000","last_change":"2023-08-22T00:06:08.289093+0000","last_active":"2023-08-22T00:06:12.665200+0000","last_peered":"2023-08-22T00:06:12.665200+0000","last_clean":"2023-08-22T00:06:12.665200+0000","last_became_active":"2023-08-22T00:06:08.288806+0000","last_became_peered":"2023-08-22T00:06:08.288806+0000","last_unstale":"2023-08-22T00:06:12.665200+0000","last_undegraded":"2023-08-22T00:06:12.665200+0000","last_fullsized":"2023-08-22T00:06:12.665200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673099+0000","last_change":"2023-08-22T00:06:08.669493+0000","last_active":"2023-08-22T00:06:12.673099+0000","last_peered":"2023-08-22T00:06:12.673099+0000","last_clean":"2023-08-22T00:06:12.673099+0000","last_became_active":"2023-08-22T00:06:08.669220+0000","last_became_peered":"2023-08-22T00:06:08.669220+0000","last_unstale":"2023-08-22T00:06:12.673099+0000","last_undegraded":"2023-08-22T00:06:12.673099+0000","last_fullsized":"2023-08-22T00:06:12.673099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682034+0000","last_change":"2023-08-22T00:06:08.292202+0000","last_active":"2023-08-22T00:06:12.682034+0000","last_peered":"2023-08-22T00:06:12.682034+0000","last_clean":"2023-08-22T00:06:12.682034+0000","last_became_active":"2023-08-22T00:06:08.291929+0000","last_became_peered":"2023-08-22T00:06:08.291929+0000","last_unstale":"2023-08-22T00:06:12.682034+0000","last_undegraded":"2023-08-22T00:06:12.682034+0000","last_fullsized":"2023-08-22T00:06:12.682034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666941+0000","last_change":"2023-08-22T00:06:08.655196+0000","last_active":"2023-08-22T00:06:12.666941+0000","last_peered":"2023-08-22T00:06:12.666941+0000","last_clean":"2023-08-22T00:06:12.666941+0000","last_became_active":"2023-08-22T00:06:08.654928+0000","last_became_peered":"2023-08-22T00:06:08.654928+0000","last_unstale":"2023-08-22T00:06:12.666941+0000","last_undegraded":"2023-08-22T00:06:12.666941+0000","last_fullsized":"2023-08-22T00:06:12.666941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673092+0000","last_change":"2023-08-22T00:06:08.293074+0000","last_active":"2023-08-22T00:06:12.673092+0000","last_peered":"2023-08-22T00:06:12.673092+0000","last_clean":"2023-08-22T00:06:12.673092+0000","last_became_active":"2023-08-22T00:06:08.292434+0000","last_became_peered":"2023-08-22T00:06:08.292434+0000","last_unstale":"2023-08-22T00:06:12.673092+0000","last_undegraded":"2023-08-22T00:06:12.673092+0000","last_fullsized":"2023-08-22T00:06:12.673092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671455+0000","last_change":"2023-08-22T00:06:08.658335+0000","last_active":"2023-08-22T00:06:12.671455+0000","last_peered":"2023-08-22T00:06:12.671455+0000","last_clean":"2023-08-22T00:06:12.671455+0000","last_became_active":"2023-08-22T00:06:08.658035+0000","last_became_peered":"2023-08-22T00:06:08.658035+0000","last_unstale":"2023-08-22T00:06:12.671455+0000","last_undegraded":"2023-08-22T00:06:12.671455+0000","last_fullsized":"2023-08-22T00:06:12.671455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667365+0000","last_change":"2023-08-22T00:06:08.292375+0000","last_active":"2023-08-22T00:06:12.667365+0000","last_peered":"2023-08-22T00:06:12.667365+0000","last_clean":"2023-08-22T00:06:12.667365+0000","last_became_active":"2023-08-22T00:06:08.291934+0000","last_became_peered":"2023-08-22T00:06:08.291934+0000","last_unstale":"2023-08-22T00:06:12.667365+0000","last_undegraded":"2023-08-22T00:06:12.667365+0000","last_fullsized":"2023-08-22T00:06:12.667365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666290+0000","last_change":"2023-08-22T00:06:08.660996+0000","last_active":"2023-08-22T00:06:12.666290+0000","last_peered":"2023-08-22T00:06:12.666290+0000","last_clean":"2023-08-22T00:06:12.666290+0000","last_became_active":"2023-08-22T00:06:08.660728+0000","last_became_peered":"2023-08-22T00:06:08.660728+0000","last_unstale":"2023-08-22T00:06:12.666290+0000","last_undegraded":"2023-08-22T00:06:12.666290+0000","last_fullsized":"2023-08-22T00:06:12.666290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672623+0000","last_change":"2023-08-22T00:06:08.292852+0000","last_active":"2023-08-22T00:06:12.672623+0000","last_peered":"2023-08-22T00:06:12.672623+0000","last_clean":"2023-08-22T00:06:12.672623+0000","last_became_active":"2023-08-22T00:06:08.291935+0000","last_became_peered":"2023-08-22T00:06:08.291935+0000","last_unstale":"2023-08-22T00:06:12.672623+0000","last_undegraded":"2023-08-22T00:06:12.672623+0000","last_fullsized":"2023-08-22T00:06:12.672623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673471+0000","last_change":"2023-08-22T00:06:08.663264+0000","last_active":"2023-08-22T00:06:12.673471+0000","last_peered":"2023-08-22T00:06:12.673471+0000","last_clean":"2023-08-22T00:06:12.673471+0000","last_became_active":"2023-08-22T00:06:08.662705+0000","last_became_peered":"2023-08-22T00:06:08.662705+0000","last_unstale":"2023-08-22T00:06:12.673471+0000","last_undegraded":"2023-08-22T00:06:12.673471+0000","last_fullsized":"2023-08-22T00:06:12.673471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670566+0000","last_change":"2023-08-22T00:06:08.290617+0000","last_active":"2023-08-22T00:06:12.670566+0000","last_peered":"2023-08-22T00:06:12.670566+0000","last_clean":"2023-08-22T00:06:12.670566+0000","last_became_active":"2023-08-22T00:06:08.290300+0000","last_became_peered":"2023-08-22T00:06:08.290300+0000","last_unstale":"2023-08-22T00:06:12.670566+0000","last_undegraded":"2023-08-22T00:06:12.670566+0000","last_fullsized":"2023-08-22T00:06:12.670566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664704+0000","last_change":"2023-08-22T00:06:08.658939+0000","last_active":"2023-08-22T00:06:12.664704+0000","last_peered":"2023-08-22T00:06:12.664704+0000","last_clean":"2023-08-22T00:06:12.664704+0000","last_became_active":"2023-08-22T00:06:08.653702+0000","last_became_peered":"2023-08-22T00:06:08.653702+0000","last_unstale":"2023-08-22T00:06:12.664704+0000","last_undegraded":"2023-08-22T00:06:12.664704+0000","last_fullsized":"2023-08-22T00:06:12.664704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:13.043578+0000","last_change":"2023-08-22T00:06:08.285489+0000","last_active":"2023-08-22T00:06:13.043578+0000","last_peered":"2023-08-22T00:06:13.043578+0000","last_clean":"2023-08-22T00:06:13.043578+0000","last_became_active":"2023-08-22T00:06:08.283345+0000","last_became_peered":"2023-08-22T00:06:08.283345+0000","last_unstale":"2023-08-22T00:06:13.043578+0000","last_undegraded":"2023-08-22T00:06:13.043578+0000","last_fullsized":"2023-08-22T00:06:13.043578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668115+0000","last_change":"2023-08-22T00:06:08.661873+0000","last_active":"2023-08-22T00:06:12.668115+0000","last_peered":"2023-08-22T00:06:12.668115+0000","last_clean":"2023-08-22T00:06:12.668115+0000","last_became_active":"2023-08-22T00:06:08.661603+0000","last_became_peered":"2023-08-22T00:06:08.661603+0000","last_unstale":"2023-08-22T00:06:12.668115+0000","last_undegraded":"2023-08-22T00:06:12.668115+0000","last_fullsized":"2023-08-22T00:06:12.668115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684497+0000","last_change":"2023-08-22T00:06:08.284711+0000","last_active":"2023-08-22T00:06:12.684497+0000","last_peered":"2023-08-22T00:06:12.684497+0000","last_clean":"2023-08-22T00:06:12.684497+0000","last_became_active":"2023-08-22T00:06:08.284399+0000","last_became_peered":"2023-08-22T00:06:08.284399+0000","last_unstale":"2023-08-22T00:06:12.684497+0000","last_undegraded":"2023-08-22T00:06:12.684497+0000","last_fullsized":"2023-08-22T00:06:12.684497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666407+0000","last_change":"2023-08-22T00:06:08.658805+0000","last_active":"2023-08-22T00:06:12.666407+0000","last_peered":"2023-08-22T00:06:12.666407+0000","last_clean":"2023-08-22T00:06:12.666407+0000","last_became_active":"2023-08-22T00:06:08.658529+0000","last_became_peered":"2023-08-22T00:06:08.658529+0000","last_unstale":"2023-08-22T00:06:12.666407+0000","last_undegraded":"2023-08-22T00:06:12.666407+0000","last_fullsized":"2023-08-22T00:06:12.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669275+0000","last_change":"2023-08-22T00:06:08.291946+0000","last_active":"2023-08-22T00:06:12.669275+0000","last_peered":"2023-08-22T00:06:12.669275+0000","last_clean":"2023-08-22T00:06:12.669275+0000","last_became_active":"2023-08-22T00:06:08.291657+0000","last_became_peered":"2023-08-22T00:06:08.291657+0000","last_unstale":"2023-08-22T00:06:12.669275+0000","last_undegraded":"2023-08-22T00:06:12.669275+0000","last_fullsized":"2023-08-22T00:06:12.669275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668361+0000","last_change":"2023-08-22T00:06:08.665347+0000","last_active":"2023-08-22T00:06:12.668361+0000","last_peered":"2023-08-22T00:06:12.668361+0000","last_clean":"2023-08-22T00:06:12.668361+0000","last_became_active":"2023-08-22T00:06:08.665083+0000","last_became_peered":"2023-08-22T00:06:08.665083+0000","last_unstale":"2023-08-22T00:06:12.668361+0000","last_undegraded":"2023-08-22T00:06:12.668361+0000","last_fullsized":"2023-08-22T00:06:12.668361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682195+0000","last_change":"2023-08-22T00:06:08.286837+0000","last_active":"2023-08-22T00:06:12.682195+0000","last_peered":"2023-08-22T00:06:12.682195+0000","last_clean":"2023-08-22T00:06:12.682195+0000","last_became_active":"2023-08-22T00:06:08.286573+0000","last_became_peered":"2023-08-22T00:06:08.286573+0000","last_unstale":"2023-08-22T00:06:12.682195+0000","last_undegraded":"2023-08-22T00:06:12.682195+0000","last_fullsized":"2023-08-22T00:06:12.682195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681782+0000","last_change":"2023-08-22T00:06:08.665854+0000","last_active":"2023-08-22T00:06:12.681782+0000","last_peered":"2023-08-22T00:06:12.681782+0000","last_clean":"2023-08-22T00:06:12.681782+0000","last_became_active":"2023-08-22T00:06:08.665617+0000","last_became_peered":"2023-08-22T00:06:08.665617+0000","last_unstale":"2023-08-22T00:06:12.681782+0000","last_undegraded":"2023-08-22T00:06:12.681782+0000","last_fullsized":"2023-08-22T00:06:12.681782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672822+0000","last_change":"2023-08-22T00:06:08.293311+0000","last_active":"2023-08-22T00:06:12.672822+0000","last_peered":"2023-08-22T00:06:12.672822+0000","last_clean":"2023-08-22T00:06:12.672822+0000","last_became_active":"2023-08-22T00:06:08.292791+0000","last_became_peered":"2023-08-22T00:06:08.292791+0000","last_unstale":"2023-08-22T00:06:12.672822+0000","last_undegraded":"2023-08-22T00:06:12.672822+0000","last_fullsized":"2023-08-22T00:06:12.672822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673896+0000","last_change":"2023-08-22T00:06:08.668170+0000","last_active":"2023-08-22T00:06:12.673896+0000","last_peered":"2023-08-22T00:06:12.673896+0000","last_clean":"2023-08-22T00:06:12.673896+0000","last_became_active":"2023-08-22T00:06:08.667860+0000","last_became_peered":"2023-08-22T00:06:08.667860+0000","last_unstale":"2023-08-22T00:06:12.673896+0000","last_undegraded":"2023-08-22T00:06:12.673896+0000","last_fullsized":"2023-08-22T00:06:12.673896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670406+0000","last_change":"2023-08-22T00:06:08.285397+0000","last_active":"2023-08-22T00:06:12.670406+0000","last_peered":"2023-08-22T00:06:12.670406+0000","last_clean":"2023-08-22T00:06:12.670406+0000","last_became_active":"2023-08-22T00:06:08.285084+0000","last_became_peered":"2023-08-22T00:06:08.285084+0000","last_unstale":"2023-08-22T00:06:12.670406+0000","last_undegraded":"2023-08-22T00:06:12.670406+0000","last_fullsized":"2023-08-22T00:06:12.670406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684663+0000","last_change":"2023-08-22T00:06:08.651586+0000","last_active":"2023-08-22T00:06:12.684663+0000","last_peered":"2023-08-22T00:06:12.684663+0000","last_clean":"2023-08-22T00:06:12.684663+0000","last_became_active":"2023-08-22T00:06:08.651320+0000","last_became_peered":"2023-08-22T00:06:08.651320+0000","last_unstale":"2023-08-22T00:06:12.684663+0000","last_undegraded":"2023-08-22T00:06:12.684663+0000","last_fullsized":"2023-08-22T00:06:12.684663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664973+0000","last_change":"2023-08-22T00:06:08.282274+0000","last_active":"2023-08-22T00:06:12.664973+0000","last_peered":"2023-08-22T00:06:12.664973+0000","last_clean":"2023-08-22T00:06:12.664973+0000","last_became_active":"2023-08-22T00:06:08.281656+0000","last_became_peered":"2023-08-22T00:06:08.281656+0000","last_unstale":"2023-08-22T00:06:12.664973+0000","last_undegraded":"2023-08-22T00:06:12.664973+0000","last_fullsized":"2023-08-22T00:06:12.664973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684917+0000","last_change":"2023-08-22T00:06:08.655245+0000","last_active":"2023-08-22T00:06:12.684917+0000","last_peered":"2023-08-22T00:06:12.684917+0000","last_clean":"2023-08-22T00:06:12.684917+0000","last_became_active":"2023-08-22T00:06:08.653409+0000","last_became_peered":"2023-08-22T00:06:08.653409+0000","last_unstale":"2023-08-22T00:06:12.684917+0000","last_undegraded":"2023-08-22T00:06:12.684917+0000","last_fullsized":"2023-08-22T00:06:12.684917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673625+0000","last_change":"2023-08-22T00:06:08.286655+0000","last_active":"2023-08-22T00:06:12.673625+0000","last_peered":"2023-08-22T00:06:12.673625+0000","last_clean":"2023-08-22T00:06:12.673625+0000","last_became_active":"2023-08-22T00:06:08.286201+0000","last_became_peered":"2023-08-22T00:06:08.286201+0000","last_unstale":"2023-08-22T00:06:12.673625+0000","last_undegraded":"2023-08-22T00:06:12.673625+0000","last_fullsized":"2023-08-22T00:06:12.673625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664977+0000","last_change":"2023-08-22T00:06:08.669633+0000","last_active":"2023-08-22T00:06:12.664977+0000","last_peered":"2023-08-22T00:06:12.664977+0000","last_clean":"2023-08-22T00:06:12.664977+0000","last_became_active":"2023-08-22T00:06:08.669336+0000","last_became_peered":"2023-08-22T00:06:08.669336+0000","last_unstale":"2023-08-22T00:06:12.664977+0000","last_undegraded":"2023-08-22T00:06:12.664977+0000","last_fullsized":"2023-08-22T00:06:12.664977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701760+0000","last_change":"2023-08-22T00:06:12.688949+0000","last_active":"2023-08-22T00:06:12.701760+0000","last_peered":"2023-08-22T00:06:12.701760+0000","last_clean":"2023-08-22T00:06:12.701760+0000","last_became_active":"2023-08-22T00:06:12.688549+0000","last_became_peered":"2023-08-22T00:06:12.688549+0000","last_unstale":"2023-08-22T00:06:12.701760+0000","last_undegraded":"2023-08-22T00:06:12.701760+0000","last_fullsized":"2023-08-22T00:06:12.701760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670131+0000","last_change":"2023-08-22T00:06:08.287945+0000","last_active":"2023-08-22T00:06:12.670131+0000","last_peered":"2023-08-22T00:06:12.670131+0000","last_clean":"2023-08-22T00:06:12.670131+0000","last_became_active":"2023-08-22T00:06:08.287654+0000","last_became_peered":"2023-08-22T00:06:08.287654+0000","last_unstale":"2023-08-22T00:06:12.670131+0000","last_undegraded":"2023-08-22T00:06:12.670131+0000","last_fullsized":"2023-08-22T00:06:12.670131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667560+0000","last_change":"2023-08-22T00:06:08.663896+0000","last_active":"2023-08-22T00:06:12.667560+0000","last_peered":"2023-08-22T00:06:12.667560+0000","last_clean":"2023-08-22T00:06:12.667560+0000","last_became_active":"2023-08-22T00:06:08.659582+0000","last_became_peered":"2023-08-22T00:06:08.659582+0000","last_unstale":"2023-08-22T00:06:12.667560+0000","last_undegraded":"2023-08-22T00:06:12.667560+0000","last_fullsized":"2023-08-22T00:06:12.667560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.683352+0000","last_change":"2023-08-22T00:06:12.680740+0000","last_active":"2023-08-22T00:06:12.683352+0000","last_peered":"2023-08-22T00:06:12.683352+0000","last_clean":"2023-08-22T00:06:12.683352+0000","last_became_active":"2023-08-22T00:06:12.680354+0000","last_became_peered":"2023-08-22T00:06:12.680354+0000","last_unstale":"2023-08-22T00:06:12.683352+0000","last_undegraded":"2023-08-22T00:06:12.683352+0000","last_fullsized":"2023-08-22T00:06:12.683352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673712+0000","last_change":"2023-08-22T00:06:08.291655+0000","last_active":"2023-08-22T00:06:12.673712+0000","last_peered":"2023-08-22T00:06:12.673712+0000","last_clean":"2023-08-22T00:06:12.673712+0000","last_became_active":"2023-08-22T00:06:08.291408+0000","last_became_peered":"2023-08-22T00:06:08.291408+0000","last_unstale":"2023-08-22T00:06:12.673712+0000","last_undegraded":"2023-08-22T00:06:12.673712+0000","last_fullsized":"2023-08-22T00:06:12.673712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666066+0000","last_change":"2023-08-22T00:06:08.662948+0000","last_active":"2023-08-22T00:06:12.666066+0000","last_peered":"2023-08-22T00:06:12.666066+0000","last_clean":"2023-08-22T00:06:12.666066+0000","last_became_active":"2023-08-22T00:06:08.662627+0000","last_became_peered":"2023-08-22T00:06:08.662627+0000","last_unstale":"2023-08-22T00:06:12.666066+0000","last_undegraded":"2023-08-22T00:06:12.666066+0000","last_fullsized":"2023-08-22T00:06:12.666066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692108+0000","last_change":"2023-08-22T00:06:12.689153+0000","last_active":"2023-08-22T00:06:12.692108+0000","last_peered":"2023-08-22T00:06:12.692108+0000","last_clean":"2023-08-22T00:06:12.692108+0000","last_became_active":"2023-08-22T00:06:12.688700+0000","last_became_peered":"2023-08-22T00:06:12.688700+0000","last_unstale":"2023-08-22T00:06:12.692108+0000","last_undegraded":"2023-08-22T00:06:12.692108+0000","last_fullsized":"2023-08-22T00:06:12.692108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672366+0000","last_change":"2023-08-22T00:06:08.292695+0000","last_active":"2023-08-22T00:06:12.672366+0000","last_peered":"2023-08-22T00:06:12.672366+0000","last_clean":"2023-08-22T00:06:12.672366+0000","last_became_active":"2023-08-22T00:06:08.292417+0000","last_became_peered":"2023-08-22T00:06:08.292417+0000","last_unstale":"2023-08-22T00:06:12.672366+0000","last_undegraded":"2023-08-22T00:06:12.672366+0000","last_fullsized":"2023-08-22T00:06:12.672366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665496+0000","last_change":"2023-08-22T00:06:08.662935+0000","last_active":"2023-08-22T00:06:12.665496+0000","last_peered":"2023-08-22T00:06:12.665496+0000","last_clean":"2023-08-22T00:06:12.665496+0000","last_became_active":"2023-08-22T00:06:08.662634+0000","last_became_peered":"2023-08-22T00:06:08.662634+0000","last_unstale":"2023-08-22T00:06:12.665496+0000","last_undegraded":"2023-08-22T00:06:12.665496+0000","last_fullsized":"2023-08-22T00:06:12.665496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.689425+0000","last_change":"2023-08-22T00:06:12.686691+0000","last_active":"2023-08-22T00:06:12.689425+0000","last_peered":"2023-08-22T00:06:12.689425+0000","last_clean":"2023-08-22T00:06:12.689425+0000","last_became_active":"2023-08-22T00:06:12.686314+0000","last_became_peered":"2023-08-22T00:06:12.686314+0000","last_unstale":"2023-08-22T00:06:12.689425+0000","last_undegraded":"2023-08-22T00:06:12.689425+0000","last_fullsized":"2023-08-22T00:06:12.689425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702379+0000","last_change":"2023-08-22T00:06:12.697526+0000","last_active":"2023-08-22T00:06:12.702379+0000","last_peered":"2023-08-22T00:06:12.702379+0000","last_clean":"2023-08-22T00:06:12.702379+0000","last_became_active":"2023-08-22T00:06:12.697150+0000","last_became_peered":"2023-08-22T00:06:12.697150+0000","last_unstale":"2023-08-22T00:06:12.702379+0000","last_undegraded":"2023-08-22T00:06:12.702379+0000","last_fullsized":"2023-08-22T00:06:12.702379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682355+0000","last_change":"2023-08-22T00:06:08.290950+0000","last_active":"2023-08-22T00:06:12.682355+0000","last_peered":"2023-08-22T00:06:12.682355+0000","last_clean":"2023-08-22T00:06:12.682355+0000","last_became_active":"2023-08-22T00:06:08.290600+0000","last_became_peered":"2023-08-22T00:06:08.290600+0000","last_unstale":"2023-08-22T00:06:12.682355+0000","last_undegraded":"2023-08-22T00:06:12.682355+0000","last_fullsized":"2023-08-22T00:06:12.682355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671721+0000","last_change":"2023-08-22T00:06:08.654201+0000","last_active":"2023-08-22T00:06:12.671721+0000","last_peered":"2023-08-22T00:06:12.671721+0000","last_clean":"2023-08-22T00:06:12.671721+0000","last_became_active":"2023-08-22T00:06:08.653605+0000","last_became_peered":"2023-08-22T00:06:08.653605+0000","last_unstale":"2023-08-22T00:06:12.671721+0000","last_undegraded":"2023-08-22T00:06:12.671721+0000","last_fullsized":"2023-08-22T00:06:12.671721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665639+0000","last_change":"2023-08-22T00:06:08.667424+0000","last_active":"2023-08-22T00:06:12.665639+0000","last_peered":"2023-08-22T00:06:12.665639+0000","last_clean":"2023-08-22T00:06:12.665639+0000","last_became_active":"2023-08-22T00:06:08.667093+0000","last_became_peered":"2023-08-22T00:06:08.667093+0000","last_unstale":"2023-08-22T00:06:12.665639+0000","last_undegraded":"2023-08-22T00:06:12.665639+0000","last_fullsized":"2023-08-22T00:06:12.665639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680328+0000","last_change":"2023-08-22T00:06:08.285075+0000","last_active":"2023-08-22T00:06:12.680328+0000","last_peered":"2023-08-22T00:06:12.680328+0000","last_clean":"2023-08-22T00:06:12.680328+0000","last_became_active":"2023-08-22T00:06:08.284787+0000","last_became_peered":"2023-08-22T00:06:08.284787+0000","last_unstale":"2023-08-22T00:06:12.680328+0000","last_undegraded":"2023-08-22T00:06:12.680328+0000","last_fullsized":"2023-08-22T00:06:12.680328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665593+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:06:12.665593+0000","last_peered":"2023-08-22T00:06:12.665593+0000","last_clean":"2023-08-22T00:06:12.665593+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:06:12.665593+0000","last_undegraded":"2023-08-22T00:06:12.665593+0000","last_fullsized":"2023-08-22T00:06:12.665593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696704+0000","last_change":"2023-08-22T00:06:12.686550+0000","last_active":"2023-08-22T00:06:12.696704+0000","last_peered":"2023-08-22T00:06:12.696704+0000","last_clean":"2023-08-22T00:06:12.696704+0000","last_became_active":"2023-08-22T00:06:12.686171+0000","last_became_peered":"2023-08-22T00:06:12.686171+0000","last_unstale":"2023-08-22T00:06:12.696704+0000","last_undegraded":"2023-08-22T00:06:12.696704+0000","last_fullsized":"2023-08-22T00:06:12.696704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666712+0000","last_change":"2023-08-22T00:06:08.664638+0000","last_active":"2023-08-22T00:06:12.666712+0000","last_peered":"2023-08-22T00:06:12.666712+0000","last_clean":"2023-08-22T00:06:12.666712+0000","last_became_active":"2023-08-22T00:06:08.664382+0000","last_became_peered":"2023-08-22T00:06:08.664382+0000","last_unstale":"2023-08-22T00:06:12.666712+0000","last_undegraded":"2023-08-22T00:06:12.666712+0000","last_fullsized":"2023-08-22T00:06:12.666712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684583+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:06:12.684583+0000","last_peered":"2023-08-22T00:06:12.684583+0000","last_clean":"2023-08-22T00:06:12.684583+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:06:12.684583+0000","last_undegraded":"2023-08-22T00:06:12.684583+0000","last_fullsized":"2023-08-22T00:06:12.684583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670437+0000","last_change":"2023-08-22T00:06:08.285344+0000","last_active":"2023-08-22T00:06:12.670437+0000","last_peered":"2023-08-22T00:06:12.670437+0000","last_clean":"2023-08-22T00:06:12.670437+0000","last_became_active":"2023-08-22T00:06:08.285077+0000","last_became_peered":"2023-08-22T00:06:08.285077+0000","last_unstale":"2023-08-22T00:06:12.670437+0000","last_undegraded":"2023-08-22T00:06:12.670437+0000","last_fullsized":"2023-08-22T00:06:12.670437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688875+0000","last_change":"2023-08-22T00:06:12.687045+0000","last_active":"2023-08-22T00:06:12.688875+0000","last_peered":"2023-08-22T00:06:12.688875+0000","last_clean":"2023-08-22T00:06:12.688875+0000","last_became_active":"2023-08-22T00:06:12.686213+0000","last_became_peered":"2023-08-22T00:06:12.686213+0000","last_unstale":"2023-08-22T00:06:12.688875+0000","last_undegraded":"2023-08-22T00:06:12.688875+0000","last_fullsized":"2023-08-22T00:06:12.688875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682429+0000","last_change":"2023-08-22T00:06:08.656218+0000","last_active":"2023-08-22T00:06:12.682429+0000","last_peered":"2023-08-22T00:06:12.682429+0000","last_clean":"2023-08-22T00:06:12.682429+0000","last_became_active":"2023-08-22T00:06:08.655669+0000","last_became_peered":"2023-08-22T00:06:08.655669+0000","last_unstale":"2023-08-22T00:06:12.682429+0000","last_undegraded":"2023-08-22T00:06:12.682429+0000","last_fullsized":"2023-08-22T00:06:12.682429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681866+0000","last_change":"2023-08-22T00:06:08.286902+0000","last_active":"2023-08-22T00:06:12.681866+0000","last_peered":"2023-08-22T00:06:12.681866+0000","last_clean":"2023-08-22T00:06:12.681866+0000","last_became_active":"2023-08-22T00:06:08.285921+0000","last_became_peered":"2023-08-22T00:06:08.285921+0000","last_unstale":"2023-08-22T00:06:12.681866+0000","last_undegraded":"2023-08-22T00:06:12.681866+0000","last_fullsized":"2023-08-22T00:06:12.681866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677121+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:06:12.677121+0000","last_peered":"2023-08-22T00:06:12.677121+0000","last_clean":"2023-08-22T00:06:12.677121+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:06:12.677121+0000","last_undegraded":"2023-08-22T00:06:12.677121+0000","last_fullsized":"2023-08-22T00:06:12.677121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688925+0000","last_change":"2023-08-22T00:06:12.686660+0000","last_active":"2023-08-22T00:06:12.688925+0000","last_peered":"2023-08-22T00:06:12.688925+0000","last_clean":"2023-08-22T00:06:12.688925+0000","last_became_active":"2023-08-22T00:06:12.686272+0000","last_became_peered":"2023-08-22T00:06:12.686272+0000","last_unstale":"2023-08-22T00:06:12.688925+0000","last_undegraded":"2023-08-22T00:06:12.688925+0000","last_fullsized":"2023-08-22T00:06:12.688925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674247+0000","last_change":"2023-08-22T00:06:08.290975+0000","last_active":"2023-08-22T00:06:12.674247+0000","last_peered":"2023-08-22T00:06:12.674247+0000","last_clean":"2023-08-22T00:06:12.674247+0000","last_became_active":"2023-08-22T00:06:08.290710+0000","last_became_peered":"2023-08-22T00:06:08.290710+0000","last_unstale":"2023-08-22T00:06:12.674247+0000","last_undegraded":"2023-08-22T00:06:12.674247+0000","last_fullsized":"2023-08-22T00:06:12.674247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670925+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:06:12.670925+0000","last_peered":"2023-08-22T00:06:12.670925+0000","last_clean":"2023-08-22T00:06:12.670925+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:06:12.670925+0000","last_undegraded":"2023-08-22T00:06:12.670925+0000","last_fullsized":"2023-08-22T00:06:12.670925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680519+0000","last_change":"2023-08-22T00:06:08.658411+0000","last_active":"2023-08-22T00:06:12.680519+0000","last_peered":"2023-08-22T00:06:12.680519+0000","last_clean":"2023-08-22T00:06:12.680519+0000","last_became_active":"2023-08-22T00:06:08.658152+0000","last_became_peered":"2023-08-22T00:06:08.658152+0000","last_unstale":"2023-08-22T00:06:12.680519+0000","last_undegraded":"2023-08-22T00:06:12.680519+0000","last_fullsized":"2023-08-22T00:06:12.680519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692091+0000","last_change":"2023-08-22T00:06:12.688771+0000","last_active":"2023-08-22T00:06:12.692091+0000","last_peered":"2023-08-22T00:06:12.692091+0000","last_clean":"2023-08-22T00:06:12.692091+0000","last_became_active":"2023-08-22T00:06:12.688371+0000","last_became_peered":"2023-08-22T00:06:12.688371+0000","last_unstale":"2023-08-22T00:06:12.692091+0000","last_undegraded":"2023-08-22T00:06:12.692091+0000","last_fullsized":"2023-08-22T00:06:12.692091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667141+0000","last_change":"2023-08-22T00:06:08.288643+0000","last_active":"2023-08-22T00:06:12.667141+0000","last_peered":"2023-08-22T00:06:12.667141+0000","last_clean":"2023-08-22T00:06:12.667141+0000","last_became_active":"2023-08-22T00:06:08.288392+0000","last_became_peered":"2023-08-22T00:06:08.288392+0000","last_unstale":"2023-08-22T00:06:12.667141+0000","last_undegraded":"2023-08-22T00:06:12.667141+0000","last_fullsized":"2023-08-22T00:06:12.667141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670819+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:06:12.670819+0000","last_peered":"2023-08-22T00:06:12.670819+0000","last_clean":"2023-08-22T00:06:12.670819+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:06:12.670819+0000","last_undegraded":"2023-08-22T00:06:12.670819+0000","last_fullsized":"2023-08-22T00:06:12.670819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672489+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:06:12.672489+0000","last_peered":"2023-08-22T00:06:12.672489+0000","last_clean":"2023-08-22T00:06:12.672489+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:06:12.672489+0000","last_undegraded":"2023-08-22T00:06:12.672489+0000","last_fullsized":"2023-08-22T00:06:12.672489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665056+0000","last_change":"2023-08-22T00:06:08.659076+0000","last_active":"2023-08-22T00:06:12.665056+0000","last_peered":"2023-08-22T00:06:12.665056+0000","last_clean":"2023-08-22T00:06:12.665056+0000","last_became_active":"2023-08-22T00:06:08.657107+0000","last_became_peered":"2023-08-22T00:06:08.657107+0000","last_unstale":"2023-08-22T00:06:12.665056+0000","last_undegraded":"2023-08-22T00:06:12.665056+0000","last_fullsized":"2023-08-22T00:06:12.665056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685134+0000","last_change":"2023-08-22T00:06:12.681352+0000","last_active":"2023-08-22T00:06:12.685134+0000","last_peered":"2023-08-22T00:06:12.685134+0000","last_clean":"2023-08-22T00:06:12.685134+0000","last_became_active":"2023-08-22T00:06:12.680899+0000","last_became_peered":"2023-08-22T00:06:12.680899+0000","last_unstale":"2023-08-22T00:06:12.685134+0000","last_undegraded":"2023-08-22T00:06:12.685134+0000","last_fullsized":"2023-08-22T00:06:12.685134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677342+0000","last_change":"2023-08-22T00:06:08.287022+0000","last_active":"2023-08-22T00:06:12.677342+0000","last_peered":"2023-08-22T00:06:12.677342+0000","last_clean":"2023-08-22T00:06:12.677342+0000","last_became_active":"2023-08-22T00:06:08.285832+0000","last_became_peered":"2023-08-22T00:06:08.285832+0000","last_unstale":"2023-08-22T00:06:12.677342+0000","last_undegraded":"2023-08-22T00:06:12.677342+0000","last_fullsized":"2023-08-22T00:06:12.677342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670558+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:06:12.670558+0000","last_peered":"2023-08-22T00:06:12.670558+0000","last_clean":"2023-08-22T00:06:12.670558+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:06:12.670558+0000","last_undegraded":"2023-08-22T00:06:12.670558+0000","last_fullsized":"2023-08-22T00:06:12.670558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684997+0000","last_change":"2023-08-22T00:06:08.653884+0000","last_active":"2023-08-22T00:06:12.684997+0000","last_peered":"2023-08-22T00:06:12.684997+0000","last_clean":"2023-08-22T00:06:12.684997+0000","last_became_active":"2023-08-22T00:06:08.653713+0000","last_became_peered":"2023-08-22T00:06:08.653713+0000","last_unstale":"2023-08-22T00:06:12.684997+0000","last_undegraded":"2023-08-22T00:06:12.684997+0000","last_fullsized":"2023-08-22T00:06:12.684997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693863+0000","last_change":"2023-08-22T00:06:12.685577+0000","last_active":"2023-08-22T00:06:12.693863+0000","last_peered":"2023-08-22T00:06:12.693863+0000","last_clean":"2023-08-22T00:06:12.693863+0000","last_became_active":"2023-08-22T00:06:12.685126+0000","last_became_peered":"2023-08-22T00:06:12.685126+0000","last_unstale":"2023-08-22T00:06:12.693863+0000","last_undegraded":"2023-08-22T00:06:12.693863+0000","last_fullsized":"2023-08-22T00:06:12.693863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681621+0000","last_change":"2023-08-22T00:06:08.652088+0000","last_active":"2023-08-22T00:06:12.681621+0000","last_peered":"2023-08-22T00:06:12.681621+0000","last_clean":"2023-08-22T00:06:12.681621+0000","last_became_active":"2023-08-22T00:06:08.651847+0000","last_became_peered":"2023-08-22T00:06:08.651847+0000","last_unstale":"2023-08-22T00:06:12.681621+0000","last_undegraded":"2023-08-22T00:06:12.681621+0000","last_fullsized":"2023-08-22T00:06:12.681621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665579+0000","last_change":"2023-08-22T00:06:08.290805+0000","last_active":"2023-08-22T00:06:12.665579+0000","last_peered":"2023-08-22T00:06:12.665579+0000","last_clean":"2023-08-22T00:06:12.665579+0000","last_became_active":"2023-08-22T00:06:08.290543+0000","last_became_peered":"2023-08-22T00:06:08.290543+0000","last_unstale":"2023-08-22T00:06:12.665579+0000","last_undegraded":"2023-08-22T00:06:12.665579+0000","last_fullsized":"2023-08-22T00:06:12.665579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673003+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:06:12.673003+0000","last_peered":"2023-08-22T00:06:12.673003+0000","last_clean":"2023-08-22T00:06:12.673003+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:06:12.673003+0000","last_undegraded":"2023-08-22T00:06:12.673003+0000","last_fullsized":"2023-08-22T00:06:12.673003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691389+0000","last_change":"2023-08-22T00:06:12.686780+0000","last_active":"2023-08-22T00:06:12.691389+0000","last_peered":"2023-08-22T00:06:12.691389+0000","last_clean":"2023-08-22T00:06:12.691389+0000","last_became_active":"2023-08-22T00:06:12.686462+0000","last_became_peered":"2023-08-22T00:06:12.686462+0000","last_unstale":"2023-08-22T00:06:12.691389+0000","last_undegraded":"2023-08-22T00:06:12.691389+0000","last_fullsized":"2023-08-22T00:06:12.691389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681816+0000","last_change":"2023-08-22T00:06:08.655816+0000","last_active":"2023-08-22T00:06:12.681816+0000","last_peered":"2023-08-22T00:06:12.681816+0000","last_clean":"2023-08-22T00:06:12.681816+0000","last_became_active":"2023-08-22T00:06:08.655543+0000","last_became_peered":"2023-08-22T00:06:08.655543+0000","last_unstale":"2023-08-22T00:06:12.681816+0000","last_undegraded":"2023-08-22T00:06:12.681816+0000","last_fullsized":"2023-08-22T00:06:12.681816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673810+0000","last_change":"2023-08-22T00:06:08.293689+0000","last_active":"2023-08-22T00:06:12.673810+0000","last_peered":"2023-08-22T00:06:12.673810+0000","last_clean":"2023-08-22T00:06:12.673810+0000","last_became_active":"2023-08-22T00:06:08.293345+0000","last_became_peered":"2023-08-22T00:06:08.293345+0000","last_unstale":"2023-08-22T00:06:12.673810+0000","last_undegraded":"2023-08-22T00:06:12.673810+0000","last_fullsized":"2023-08-22T00:06:12.673810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681700+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:06:12.681700+0000","last_peered":"2023-08-22T00:06:12.681700+0000","last_clean":"2023-08-22T00:06:12.681700+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:06:12.681700+0000","last_undegraded":"2023-08-22T00:06:12.681700+0000","last_fullsized":"2023-08-22T00:06:12.681700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693109+0000","last_change":"2023-08-22T00:06:12.687580+0000","last_active":"2023-08-22T00:06:12.693109+0000","last_peered":"2023-08-22T00:06:12.693109+0000","last_clean":"2023-08-22T00:06:12.693109+0000","last_became_active":"2023-08-22T00:06:12.687255+0000","last_became_peered":"2023-08-22T00:06:12.687255+0000","last_unstale":"2023-08-22T00:06:12.693109+0000","last_undegraded":"2023-08-22T00:06:12.693109+0000","last_fullsized":"2023-08-22T00:06:12.693109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666637+0000","last_change":"2023-08-22T00:06:08.286120+0000","last_active":"2023-08-22T00:06:12.666637+0000","last_peered":"2023-08-22T00:06:12.666637+0000","last_clean":"2023-08-22T00:06:12.666637+0000","last_became_active":"2023-08-22T00:06:08.285828+0000","last_became_peered":"2023-08-22T00:06:08.285828+0000","last_unstale":"2023-08-22T00:06:12.666637+0000","last_undegraded":"2023-08-22T00:06:12.666637+0000","last_fullsized":"2023-08-22T00:06:12.666637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685079+0000","last_change":"2023-08-22T00:06:08.665123+0000","last_active":"2023-08-22T00:06:12.685079+0000","last_peered":"2023-08-22T00:06:12.685079+0000","last_clean":"2023-08-22T00:06:12.685079+0000","last_became_active":"2023-08-22T00:06:08.664679+0000","last_became_peered":"2023-08-22T00:06:08.664679+0000","last_unstale":"2023-08-22T00:06:12.685079+0000","last_undegraded":"2023-08-22T00:06:12.685079+0000","last_fullsized":"2023-08-22T00:06:12.685079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691293+0000","last_change":"2023-08-22T00:06:12.689186+0000","last_active":"2023-08-22T00:06:12.691293+0000","last_peered":"2023-08-22T00:06:12.691293+0000","last_clean":"2023-08-22T00:06:12.691293+0000","last_became_active":"2023-08-22T00:06:12.688721+0000","last_became_peered":"2023-08-22T00:06:12.688721+0000","last_unstale":"2023-08-22T00:06:12.691293+0000","last_undegraded":"2023-08-22T00:06:12.691293+0000","last_fullsized":"2023-08-22T00:06:12.691293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665445+0000","last_change":"2023-08-22T00:06:08.286239+0000","last_active":"2023-08-22T00:06:12.665445+0000","last_peered":"2023-08-22T00:06:12.665445+0000","last_clean":"2023-08-22T00:06:12.665445+0000","last_became_active":"2023-08-22T00:06:08.285947+0000","last_became_peered":"2023-08-22T00:06:08.285947+0000","last_unstale":"2023-08-22T00:06:12.665445+0000","last_undegraded":"2023-08-22T00:06:12.665445+0000","last_fullsized":"2023-08-22T00:06:12.665445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666624+0000","last_change":"2023-08-22T00:06:08.669823+0000","last_active":"2023-08-22T00:06:12.666624+0000","last_peered":"2023-08-22T00:06:12.666624+0000","last_clean":"2023-08-22T00:06:12.666624+0000","last_became_active":"2023-08-22T00:06:08.669205+0000","last_became_peered":"2023-08-22T00:06:08.669205+0000","last_unstale":"2023-08-22T00:06:12.666624+0000","last_undegraded":"2023-08-22T00:06:12.666624+0000","last_fullsized":"2023-08-22T00:06:12.666624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685064+0000","last_change":"2023-08-22T00:06:12.683405+0000","last_active":"2023-08-22T00:06:12.685064+0000","last_peered":"2023-08-22T00:06:12.685064+0000","last_clean":"2023-08-22T00:06:12.685064+0000","last_became_active":"2023-08-22T00:06:12.682920+0000","last_became_peered":"2023-08-22T00:06:12.682920+0000","last_unstale":"2023-08-22T00:06:12.685064+0000","last_undegraded":"2023-08-22T00:06:12.685064+0000","last_fullsized":"2023-08-22T00:06:12.685064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666050+0000","last_change":"2023-08-22T00:06:08.293922+0000","last_active":"2023-08-22T00:06:12.666050+0000","last_peered":"2023-08-22T00:06:12.666050+0000","last_clean":"2023-08-22T00:06:12.666050+0000","last_became_active":"2023-08-22T00:06:08.293634+0000","last_became_peered":"2023-08-22T00:06:08.293634+0000","last_unstale":"2023-08-22T00:06:12.666050+0000","last_undegraded":"2023-08-22T00:06:12.666050+0000","last_fullsized":"2023-08-22T00:06:12.666050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665867+0000","last_change":"2023-08-22T00:06:08.660591+0000","last_active":"2023-08-22T00:06:12.665867+0000","last_peered":"2023-08-22T00:06:12.665867+0000","last_clean":"2023-08-22T00:06:12.665867+0000","last_became_active":"2023-08-22T00:06:08.659961+0000","last_became_peered":"2023-08-22T00:06:08.659961+0000","last_unstale":"2023-08-22T00:06:12.665867+0000","last_undegraded":"2023-08-22T00:06:12.665867+0000","last_fullsized":"2023-08-22T00:06:12.665867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701768+0000","last_change":"2023-08-22T00:06:12.689578+0000","last_active":"2023-08-22T00:06:12.701768+0000","last_peered":"2023-08-22T00:06:12.701768+0000","last_clean":"2023-08-22T00:06:12.701768+0000","last_became_active":"2023-08-22T00:06:12.689081+0000","last_became_peered":"2023-08-22T00:06:12.689081+0000","last_unstale":"2023-08-22T00:06:12.701768+0000","last_undegraded":"2023-08-22T00:06:12.701768+0000","last_fullsized":"2023-08-22T00:06:12.701768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667259+0000","last_change":"2023-08-22T00:06:08.287748+0000","last_active":"2023-08-22T00:06:12.667259+0000","last_peered":"2023-08-22T00:06:12.667259+0000","last_clean":"2023-08-22T00:06:12.667259+0000","last_became_active":"2023-08-22T00:06:08.287494+0000","last_became_peered":"2023-08-22T00:06:08.287494+0000","last_unstale":"2023-08-22T00:06:12.667259+0000","last_undegraded":"2023-08-22T00:06:12.667259+0000","last_fullsized":"2023-08-22T00:06:12.667259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667054+0000","last_change":"2023-08-22T00:06:08.670010+0000","last_active":"2023-08-22T00:06:12.667054+0000","last_peered":"2023-08-22T00:06:12.667054+0000","last_clean":"2023-08-22T00:06:12.667054+0000","last_became_active":"2023-08-22T00:06:08.669725+0000","last_became_peered":"2023-08-22T00:06:08.669725+0000","last_unstale":"2023-08-22T00:06:12.667054+0000","last_undegraded":"2023-08-22T00:06:12.667054+0000","last_fullsized":"2023-08-22T00:06:12.667054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693735+0000","last_change":"2023-08-22T00:06:12.682981+0000","last_active":"2023-08-22T00:06:12.693735+0000","last_peered":"2023-08-22T00:06:12.693735+0000","last_clean":"2023-08-22T00:06:12.693735+0000","last_became_active":"2023-08-22T00:06:12.682564+0000","last_became_peered":"2023-08-22T00:06:12.682564+0000","last_unstale":"2023-08-22T00:06:12.693735+0000","last_undegraded":"2023-08-22T00:06:12.693735+0000","last_fullsized":"2023-08-22T00:06:12.693735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672285+0000","last_change":"2023-08-22T00:06:08.289593+0000","last_active":"2023-08-22T00:06:12.672285+0000","last_peered":"2023-08-22T00:06:12.672285+0000","last_clean":"2023-08-22T00:06:12.672285+0000","last_became_active":"2023-08-22T00:06:08.289269+0000","last_became_peered":"2023-08-22T00:06:08.289269+0000","last_unstale":"2023-08-22T00:06:12.672285+0000","last_undegraded":"2023-08-22T00:06:12.672285+0000","last_fullsized":"2023-08-22T00:06:12.672285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682276+0000","last_change":"2023-08-22T00:06:08.657006+0000","last_active":"2023-08-22T00:06:12.682276+0000","last_peered":"2023-08-22T00:06:12.682276+0000","last_clean":"2023-08-22T00:06:12.682276+0000","last_became_active":"2023-08-22T00:06:08.656769+0000","last_became_peered":"2023-08-22T00:06:08.656769+0000","last_unstale":"2023-08-22T00:06:12.682276+0000","last_undegraded":"2023-08-22T00:06:12.682276+0000","last_fullsized":"2023-08-22T00:06:12.682276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693819+0000","last_change":"2023-08-22T00:06:12.684195+0000","last_active":"2023-08-22T00:06:12.693819+0000","last_peered":"2023-08-22T00:06:12.693819+0000","last_clean":"2023-08-22T00:06:12.693819+0000","last_became_active":"2023-08-22T00:06:12.683612+0000","last_became_peered":"2023-08-22T00:06:12.683612+0000","last_unstale":"2023-08-22T00:06:12.693819+0000","last_undegraded":"2023-08-22T00:06:12.693819+0000","last_fullsized":"2023-08-22T00:06:12.693819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677098+0000","last_change":"2023-08-22T00:06:08.291933+0000","last_active":"2023-08-22T00:06:12.677098+0000","last_peered":"2023-08-22T00:06:12.677098+0000","last_clean":"2023-08-22T00:06:12.677098+0000","last_became_active":"2023-08-22T00:06:08.291627+0000","last_became_peered":"2023-08-22T00:06:08.291627+0000","last_unstale":"2023-08-22T00:06:12.677098+0000","last_undegraded":"2023-08-22T00:06:12.677098+0000","last_fullsized":"2023-08-22T00:06:12.677098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665964+0000","last_change":"2023-08-22T00:06:08.663881+0000","last_active":"2023-08-22T00:06:12.665964+0000","last_peered":"2023-08-22T00:06:12.665964+0000","last_clean":"2023-08-22T00:06:12.665964+0000","last_became_active":"2023-08-22T00:06:08.663600+0000","last_became_peered":"2023-08-22T00:06:08.663600+0000","last_unstale":"2023-08-22T00:06:12.665964+0000","last_undegraded":"2023-08-22T00:06:12.665964+0000","last_fullsized":"2023-08-22T00:06:12.665964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693913+0000","last_change":"2023-08-22T00:06:12.689051+0000","last_active":"2023-08-22T00:06:12.693913+0000","last_peered":"2023-08-22T00:06:12.693913+0000","last_clean":"2023-08-22T00:06:12.693913+0000","last_became_active":"2023-08-22T00:06:12.688661+0000","last_became_peered":"2023-08-22T00:06:12.688661+0000","last_unstale":"2023-08-22T00:06:12.693913+0000","last_undegraded":"2023-08-22T00:06:12.693913+0000","last_fullsized":"2023-08-22T00:06:12.693913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677466+0000","last_change":"2023-08-22T00:06:08.294656+0000","last_active":"2023-08-22T00:06:12.677466+0000","last_peered":"2023-08-22T00:06:12.677466+0000","last_clean":"2023-08-22T00:06:12.677466+0000","last_became_active":"2023-08-22T00:06:08.292560+0000","last_became_peered":"2023-08-22T00:06:08.292560+0000","last_unstale":"2023-08-22T00:06:12.677466+0000","last_undegraded":"2023-08-22T00:06:12.677466+0000","last_fullsized":"2023-08-22T00:06:12.677466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665464+0000","last_change":"2023-08-22T00:06:08.666434+0000","last_active":"2023-08-22T00:06:12.665464+0000","last_peered":"2023-08-22T00:06:12.665464+0000","last_clean":"2023-08-22T00:06:12.665464+0000","last_became_active":"2023-08-22T00:06:08.663063+0000","last_became_peered":"2023-08-22T00:06:08.663063+0000","last_unstale":"2023-08-22T00:06:12.665464+0000","last_undegraded":"2023-08-22T00:06:12.665464+0000","last_fullsized":"2023-08-22T00:06:12.665464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693999+0000","last_change":"2023-08-22T00:06:12.692897+0000","last_active":"2023-08-22T00:06:12.693999+0000","last_peered":"2023-08-22T00:06:12.693999+0000","last_clean":"2023-08-22T00:06:12.693999+0000","last_became_active":"2023-08-22T00:06:12.692484+0000","last_became_peered":"2023-08-22T00:06:12.692484+0000","last_unstale":"2023-08-22T00:06:12.693999+0000","last_undegraded":"2023-08-22T00:06:12.693999+0000","last_fullsized":"2023-08-22T00:06:12.693999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678309+0000","last_change":"2023-08-22T00:06:08.295114+0000","last_active":"2023-08-22T00:06:12.678309+0000","last_peered":"2023-08-22T00:06:12.678309+0000","last_clean":"2023-08-22T00:06:12.678309+0000","last_became_active":"2023-08-22T00:06:08.294743+0000","last_became_peered":"2023-08-22T00:06:08.294743+0000","last_unstale":"2023-08-22T00:06:12.678309+0000","last_undegraded":"2023-08-22T00:06:12.678309+0000","last_fullsized":"2023-08-22T00:06:12.678309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672539+0000","last_change":"2023-08-22T00:06:08.664800+0000","last_active":"2023-08-22T00:06:12.672539+0000","last_peered":"2023-08-22T00:06:12.672539+0000","last_clean":"2023-08-22T00:06:12.672539+0000","last_became_active":"2023-08-22T00:06:08.664511+0000","last_became_peered":"2023-08-22T00:06:08.664511+0000","last_unstale":"2023-08-22T00:06:12.672539+0000","last_undegraded":"2023-08-22T00:06:12.672539+0000","last_fullsized":"2023-08-22T00:06:12.672539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688234+0000","last_change":"2023-08-22T00:06:12.684602+0000","last_active":"2023-08-22T00:06:12.688234+0000","last_peered":"2023-08-22T00:06:12.688234+0000","last_clean":"2023-08-22T00:06:12.688234+0000","last_became_active":"2023-08-22T00:06:12.684197+0000","last_became_peered":"2023-08-22T00:06:12.684197+0000","last_unstale":"2023-08-22T00:06:12.688234+0000","last_undegraded":"2023-08-22T00:06:12.688234+0000","last_fullsized":"2023-08-22T00:06:12.688234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664815+0000","last_change":"2023-08-22T00:06:08.282647+0000","last_active":"2023-08-22T00:06:12.664815+0000","last_peered":"2023-08-22T00:06:12.664815+0000","last_clean":"2023-08-22T00:06:12.664815+0000","last_became_active":"2023-08-22T00:06:08.282022+0000","last_became_peered":"2023-08-22T00:06:08.282022+0000","last_unstale":"2023-08-22T00:06:12.664815+0000","last_undegraded":"2023-08-22T00:06:12.664815+0000","last_fullsized":"2023-08-22T00:06:12.664815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670644+0000","last_change":"2023-08-22T00:06:08.668740+0000","last_active":"2023-08-22T00:06:12.670644+0000","last_peered":"2023-08-22T00:06:12.670644+0000","last_clean":"2023-08-22T00:06:12.670644+0000","last_became_active":"2023-08-22T00:06:08.668441+0000","last_became_peered":"2023-08-22T00:06:08.668441+0000","last_unstale":"2023-08-22T00:06:12.670644+0000","last_undegraded":"2023-08-22T00:06:12.670644+0000","last_fullsized":"2023-08-22T00:06:12.670644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692932+0000","last_change":"2023-08-22T00:06:12.691493+0000","last_active":"2023-08-22T00:06:12.692932+0000","last_peered":"2023-08-22T00:06:12.692932+0000","last_clean":"2023-08-22T00:06:12.692932+0000","last_became_active":"2023-08-22T00:06:12.691093+0000","last_became_peered":"2023-08-22T00:06:12.691093+0000","last_unstale":"2023-08-22T00:06:12.692932+0000","last_undegraded":"2023-08-22T00:06:12.692932+0000","last_fullsized":"2023-08-22T00:06:12.692932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671568+0000","last_change":"2023-08-22T00:06:08.292035+0000","last_active":"2023-08-22T00:06:12.671568+0000","last_peered":"2023-08-22T00:06:12.671568+0000","last_clean":"2023-08-22T00:06:12.671568+0000","last_became_active":"2023-08-22T00:06:08.291203+0000","last_became_peered":"2023-08-22T00:06:08.291203+0000","last_unstale":"2023-08-22T00:06:12.671568+0000","last_undegraded":"2023-08-22T00:06:12.671568+0000","last_fullsized":"2023-08-22T00:06:12.671568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680614+0000","last_change":"2023-08-22T00:06:08.655585+0000","last_active":"2023-08-22T00:06:12.680614+0000","last_peered":"2023-08-22T00:06:12.680614+0000","last_clean":"2023-08-22T00:06:12.680614+0000","last_became_active":"2023-08-22T00:06:08.655310+0000","last_became_peered":"2023-08-22T00:06:08.655310+0000","last_unstale":"2023-08-22T00:06:12.680614+0000","last_undegraded":"2023-08-22T00:06:12.680614+0000","last_fullsized":"2023-08-22T00:06:12.680614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699073+0000","last_change":"2023-08-22T00:06:12.688045+0000","last_active":"2023-08-22T00:06:12.699073+0000","last_peered":"2023-08-22T00:06:12.699073+0000","last_clean":"2023-08-22T00:06:12.699073+0000","last_became_active":"2023-08-22T00:06:12.687684+0000","last_became_peered":"2023-08-22T00:06:12.687684+0000","last_unstale":"2023-08-22T00:06:12.699073+0000","last_undegraded":"2023-08-22T00:06:12.699073+0000","last_fullsized":"2023-08-22T00:06:12.699073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673315+0000","last_change":"2023-08-22T00:06:08.286986+0000","last_active":"2023-08-22T00:06:12.673315+0000","last_peered":"2023-08-22T00:06:12.673315+0000","last_clean":"2023-08-22T00:06:12.673315+0000","last_became_active":"2023-08-22T00:06:08.285641+0000","last_became_peered":"2023-08-22T00:06:08.285641+0000","last_unstale":"2023-08-22T00:06:12.673315+0000","last_undegraded":"2023-08-22T00:06:12.673315+0000","last_fullsized":"2023-08-22T00:06:12.673315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673919+0000","last_change":"2023-08-22T00:06:08.668481+0000","last_active":"2023-08-22T00:06:12.673919+0000","last_peered":"2023-08-22T00:06:12.673919+0000","last_clean":"2023-08-22T00:06:12.673919+0000","last_became_active":"2023-08-22T00:06:08.668192+0000","last_became_peered":"2023-08-22T00:06:08.668192+0000","last_unstale":"2023-08-22T00:06:12.673919+0000","last_undegraded":"2023-08-22T00:06:12.673919+0000","last_fullsized":"2023-08-22T00:06:12.673919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696626+0000","last_change":"2023-08-22T00:06:12.684100+0000","last_active":"2023-08-22T00:06:12.696626+0000","last_peered":"2023-08-22T00:06:12.696626+0000","last_clean":"2023-08-22T00:06:12.696626+0000","last_became_active":"2023-08-22T00:06:12.683707+0000","last_became_peered":"2023-08-22T00:06:12.683707+0000","last_unstale":"2023-08-22T00:06:12.696626+0000","last_undegraded":"2023-08-22T00:06:12.696626+0000","last_fullsized":"2023-08-22T00:06:12.696626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673189+0000","last_change":"2023-08-22T00:06:08.294557+0000","last_active":"2023-08-22T00:06:12.673189+0000","last_peered":"2023-08-22T00:06:12.673189+0000","last_clean":"2023-08-22T00:06:12.673189+0000","last_became_active":"2023-08-22T00:06:08.292498+0000","last_became_peered":"2023-08-22T00:06:08.292498+0000","last_unstale":"2023-08-22T00:06:12.673189+0000","last_undegraded":"2023-08-22T00:06:12.673189+0000","last_fullsized":"2023-08-22T00:06:12.673189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669639+0000","last_change":"2023-08-22T00:06:08.664640+0000","last_active":"2023-08-22T00:06:12.669639+0000","last_peered":"2023-08-22T00:06:12.669639+0000","last_clean":"2023-08-22T00:06:12.669639+0000","last_became_active":"2023-08-22T00:06:08.664404+0000","last_became_peered":"2023-08-22T00:06:08.664404+0000","last_unstale":"2023-08-22T00:06:12.669639+0000","last_undegraded":"2023-08-22T00:06:12.669639+0000","last_fullsized":"2023-08-22T00:06:12.669639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692623+0000","last_change":"2023-08-22T00:06:12.691313+0000","last_active":"2023-08-22T00:06:12.692623+0000","last_peered":"2023-08-22T00:06:12.692623+0000","last_clean":"2023-08-22T00:06:12.692623+0000","last_became_active":"2023-08-22T00:06:12.690888+0000","last_became_peered":"2023-08-22T00:06:12.690888+0000","last_unstale":"2023-08-22T00:06:12.692623+0000","last_undegraded":"2023-08-22T00:06:12.692623+0000","last_fullsized":"2023-08-22T00:06:12.692623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667060+0000","last_change":"2023-08-22T00:06:08.292435+0000","last_active":"2023-08-22T00:06:12.667060+0000","last_peered":"2023-08-22T00:06:12.667060+0000","last_clean":"2023-08-22T00:06:12.667060+0000","last_became_active":"2023-08-22T00:06:08.292078+0000","last_became_peered":"2023-08-22T00:06:08.292078+0000","last_unstale":"2023-08-22T00:06:12.667060+0000","last_undegraded":"2023-08-22T00:06:12.667060+0000","last_fullsized":"2023-08-22T00:06:12.667060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665745+0000","last_change":"2023-08-22T00:06:08.670166+0000","last_active":"2023-08-22T00:06:12.665745+0000","last_peered":"2023-08-22T00:06:12.665745+0000","last_clean":"2023-08-22T00:06:12.665745+0000","last_became_active":"2023-08-22T00:06:08.669343+0000","last_became_peered":"2023-08-22T00:06:08.669343+0000","last_unstale":"2023-08-22T00:06:12.665745+0000","last_undegraded":"2023-08-22T00:06:12.665745+0000","last_fullsized":"2023-08-22T00:06:12.665745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702398+0000","last_change":"2023-08-22T00:06:12.697624+0000","last_active":"2023-08-22T00:06:12.702398+0000","last_peered":"2023-08-22T00:06:12.702398+0000","last_clean":"2023-08-22T00:06:12.702398+0000","last_became_active":"2023-08-22T00:06:12.697230+0000","last_became_peered":"2023-08-22T00:06:12.697230+0000","last_unstale":"2023-08-22T00:06:12.702398+0000","last_undegraded":"2023-08-22T00:06:12.702398+0000","last_fullsized":"2023-08-22T00:06:12.702398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677201+0000","last_change":"2023-08-22T00:06:08.288780+0000","last_active":"2023-08-22T00:06:12.677201+0000","last_peered":"2023-08-22T00:06:12.677201+0000","last_clean":"2023-08-22T00:06:12.677201+0000","last_became_active":"2023-08-22T00:06:08.288449+0000","last_became_peered":"2023-08-22T00:06:08.288449+0000","last_unstale":"2023-08-22T00:06:12.677201+0000","last_undegraded":"2023-08-22T00:06:12.677201+0000","last_fullsized":"2023-08-22T00:06:12.677201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681899+0000","last_change":"2023-08-22T00:06:08.658370+0000","last_active":"2023-08-22T00:06:12.681899+0000","last_peered":"2023-08-22T00:06:12.681899+0000","last_clean":"2023-08-22T00:06:12.681899+0000","last_became_active":"2023-08-22T00:06:08.658088+0000","last_became_peered":"2023-08-22T00:06:08.658088+0000","last_unstale":"2023-08-22T00:06:12.681899+0000","last_undegraded":"2023-08-22T00:06:12.681899+0000","last_fullsized":"2023-08-22T00:06:12.681899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699205+0000","last_change":"2023-08-22T00:06:12.690837+0000","last_active":"2023-08-22T00:06:12.699205+0000","last_peered":"2023-08-22T00:06:12.699205+0000","last_clean":"2023-08-22T00:06:12.699205+0000","last_became_active":"2023-08-22T00:06:12.690046+0000","last_became_peered":"2023-08-22T00:06:12.690046+0000","last_unstale":"2023-08-22T00:06:12.699205+0000","last_undegraded":"2023-08-22T00:06:12.699205+0000","last_fullsized":"2023-08-22T00:06:12.699205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674238+0000","last_change":"2023-08-22T00:06:08.298405+0000","last_active":"2023-08-22T00:06:12.674238+0000","last_peered":"2023-08-22T00:06:12.674238+0000","last_clean":"2023-08-22T00:06:12.674238+0000","last_became_active":"2023-08-22T00:06:08.298085+0000","last_became_peered":"2023-08-22T00:06:08.298085+0000","last_unstale":"2023-08-22T00:06:12.674238+0000","last_undegraded":"2023-08-22T00:06:12.674238+0000","last_fullsized":"2023-08-22T00:06:12.674238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667438+0000","last_change":"2023-08-22T00:06:08.664353+0000","last_active":"2023-08-22T00:06:12.667438+0000","last_peered":"2023-08-22T00:06:12.667438+0000","last_clean":"2023-08-22T00:06:12.667438+0000","last_became_active":"2023-08-22T00:06:08.664104+0000","last_became_peered":"2023-08-22T00:06:08.664104+0000","last_unstale":"2023-08-22T00:06:12.667438+0000","last_undegraded":"2023-08-22T00:06:12.667438+0000","last_fullsized":"2023-08-22T00:06:12.667438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691805+0000","last_change":"2023-08-22T00:06:12.688530+0000","last_active":"2023-08-22T00:06:12.691805+0000","last_peered":"2023-08-22T00:06:12.691805+0000","last_clean":"2023-08-22T00:06:12.691805+0000","last_became_active":"2023-08-22T00:06:12.688138+0000","last_became_peered":"2023-08-22T00:06:12.688138+0000","last_unstale":"2023-08-22T00:06:12.691805+0000","last_undegraded":"2023-08-22T00:06:12.691805+0000","last_fullsized":"2023-08-22T00:06:12.691805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673548+0000","last_change":"2023-08-22T00:06:08.286478+0000","last_active":"2023-08-22T00:06:12.673548+0000","last_peered":"2023-08-22T00:06:12.673548+0000","last_clean":"2023-08-22T00:06:12.673548+0000","last_became_active":"2023-08-22T00:06:08.285839+0000","last_became_peered":"2023-08-22T00:06:08.285839+0000","last_unstale":"2023-08-22T00:06:12.673548+0000","last_undegraded":"2023-08-22T00:06:12.673548+0000","last_fullsized":"2023-08-22T00:06:12.673548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666553+0000","last_change":"2023-08-22T00:06:08.660300+0000","last_active":"2023-08-22T00:06:12.666553+0000","last_peered":"2023-08-22T00:06:12.666553+0000","last_clean":"2023-08-22T00:06:12.666553+0000","last_became_active":"2023-08-22T00:06:08.660029+0000","last_became_peered":"2023-08-22T00:06:08.660029+0000","last_unstale":"2023-08-22T00:06:12.666553+0000","last_undegraded":"2023-08-22T00:06:12.666553+0000","last_fullsized":"2023-08-22T00:06:12.666553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682861+0000","last_change":"2023-08-22T00:06:12.680840+0000","last_active":"2023-08-22T00:06:12.682861+0000","last_peered":"2023-08-22T00:06:12.682861+0000","last_clean":"2023-08-22T00:06:12.682861+0000","last_became_active":"2023-08-22T00:06:12.680150+0000","last_became_peered":"2023-08-22T00:06:12.680150+0000","last_unstale":"2023-08-22T00:06:12.682861+0000","last_undegraded":"2023-08-22T00:06:12.682861+0000","last_fullsized":"2023-08-22T00:06:12.682861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702263+0000","last_change":"2023-08-22T00:06:12.697155+0000","last_active":"2023-08-22T00:06:12.702263+0000","last_peered":"2023-08-22T00:06:12.702263+0000","last_clean":"2023-08-22T00:06:12.702263+0000","last_became_active":"2023-08-22T00:06:12.696776+0000","last_became_peered":"2023-08-22T00:06:12.696776+0000","last_unstale":"2023-08-22T00:06:12.702263+0000","last_undegraded":"2023-08-22T00:06:12.702263+0000","last_fullsized":"2023-08-22T00:06:12.702263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666911+0000","last_change":"2023-08-22T00:06:08.290382+0000","last_active":"2023-08-22T00:06:12.666911+0000","last_peered":"2023-08-22T00:06:12.666911+0000","last_clean":"2023-08-22T00:06:12.666911+0000","last_became_active":"2023-08-22T00:06:08.289805+0000","last_became_peered":"2023-08-22T00:06:08.289805+0000","last_unstale":"2023-08-22T00:06:12.666911+0000","last_undegraded":"2023-08-22T00:06:12.666911+0000","last_fullsized":"2023-08-22T00:06:12.666911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665485+0000","last_change":"2023-08-22T00:06:08.660218+0000","last_active":"2023-08-22T00:06:12.665485+0000","last_peered":"2023-08-22T00:06:12.665485+0000","last_clean":"2023-08-22T00:06:12.665485+0000","last_became_active":"2023-08-22T00:06:08.657393+0000","last_became_peered":"2023-08-22T00:06:08.657393+0000","last_unstale":"2023-08-22T00:06:12.665485+0000","last_undegraded":"2023-08-22T00:06:12.665485+0000","last_fullsized":"2023-08-22T00:06:12.665485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685964+0000","last_change":"2023-08-22T00:06:12.679635+0000","last_active":"2023-08-22T00:06:12.685964+0000","last_peered":"2023-08-22T00:06:12.685964+0000","last_clean":"2023-08-22T00:06:12.685964+0000","last_became_active":"2023-08-22T00:06:12.679242+0000","last_became_peered":"2023-08-22T00:06:12.679242+0000","last_unstale":"2023-08-22T00:06:12.685964+0000","last_undegraded":"2023-08-22T00:06:12.685964+0000","last_fullsized":"2023-08-22T00:06:12.685964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678592+0000","last_change":"2023-08-22T00:06:08.281551+0000","last_active":"2023-08-22T00:06:12.678592+0000","last_peered":"2023-08-22T00:06:12.678592+0000","last_clean":"2023-08-22T00:06:12.678592+0000","last_became_active":"2023-08-22T00:06:08.281148+0000","last_became_peered":"2023-08-22T00:06:08.281148+0000","last_unstale":"2023-08-22T00:06:12.678592+0000","last_undegraded":"2023-08-22T00:06:12.678592+0000","last_fullsized":"2023-08-22T00:06:12.678592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680434+0000","last_change":"2023-08-22T00:06:08.667817+0000","last_active":"2023-08-22T00:06:12.680434+0000","last_peered":"2023-08-22T00:06:12.680434+0000","last_clean":"2023-08-22T00:06:12.680434+0000","last_became_active":"2023-08-22T00:06:08.667588+0000","last_became_peered":"2023-08-22T00:06:08.667588+0000","last_unstale":"2023-08-22T00:06:12.680434+0000","last_undegraded":"2023-08-22T00:06:12.680434+0000","last_fullsized":"2023-08-22T00:06:12.680434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666260+0000","last_change":"2023-08-22T00:06:08.285483+0000","last_active":"2023-08-22T00:06:12.666260+0000","last_peered":"2023-08-22T00:06:12.666260+0000","last_clean":"2023-08-22T00:06:12.666260+0000","last_became_active":"2023-08-22T00:06:08.284913+0000","last_became_peered":"2023-08-22T00:06:08.284913+0000","last_unstale":"2023-08-22T00:06:12.666260+0000","last_undegraded":"2023-08-22T00:06:12.666260+0000","last_fullsized":"2023-08-22T00:06:12.666260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669933+0000","last_change":"2023-08-22T00:06:08.660823+0000","last_active":"2023-08-22T00:06:12.669933+0000","last_peered":"2023-08-22T00:06:12.669933+0000","last_clean":"2023-08-22T00:06:12.669933+0000","last_became_active":"2023-08-22T00:06:08.660576+0000","last_became_peered":"2023-08-22T00:06:08.660576+0000","last_unstale":"2023-08-22T00:06:12.669933+0000","last_undegraded":"2023-08-22T00:06:12.669933+0000","last_fullsized":"2023-08-22T00:06:12.669933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688868+0000","last_change":"2023-08-22T00:06:12.687512+0000","last_active":"2023-08-22T00:06:12.688868+0000","last_peered":"2023-08-22T00:06:12.688868+0000","last_clean":"2023-08-22T00:06:12.688868+0000","last_became_active":"2023-08-22T00:06:12.687104+0000","last_became_peered":"2023-08-22T00:06:12.687104+0000","last_unstale":"2023-08-22T00:06:12.688868+0000","last_undegraded":"2023-08-22T00:06:12.688868+0000","last_fullsized":"2023-08-22T00:06:12.688868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297396,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074444,"statfs":{"total":96636764160,"available":96332230656,"internally_reserved":0,"allocated":307200,"data_stored":117459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":119671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297388,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074452,"statfs":{"total":96636764160,"available":96332238848,"internally_reserved":0,"allocated":299008,"data_stored":119817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:06:27.556 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:06:27.556 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-22T00:06:27.557 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-22T00:06:27.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-22T00:06:27.557 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-22T00:06:27.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.701+0000 7f3729228700 1 Processor -- start 2023-08-22T00:06:27.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.702+0000 7f3729228700 1 -- start start 2023-08-22T00:06:27.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.702+0000 7f3729228700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3724154d50 0x7f37240c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.702+0000 7f3729228700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240c4fb0 con 0x7f37240c64a0 2023-08-22T00:06:27.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.702+0000 7f3729228700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240bcfc0 con 0x7f3724154260 2023-08-22T00:06:27.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.702+0000 7f3729228700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372414e7b0 con 0x7f3724154d50 2023-08-22T00:06:27.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3724154d50 0x7f37240c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372259c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f37240c64a0 0x7f372415b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47522/0 (socket says 172.21.15.98:47522) 2023-08-22T00:06:27.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372259c700 1 -- 172.21.15.98:0/3592232482 learned_addr learned my addr 172.21.15.98:0/3592232482 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:27.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372359e700 1 -- 172.21.15.98:0/3592232482 >> v1:172.21.15.118:6789/0 conn(0x7f3724154260 legacy=0x7f3724154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:27.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372359e700 1 -- 172.21.15.98:0/3592232482 >> v1:172.21.15.98:6789/0 conn(0x7f37240c64a0 legacy=0x7f372415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372359e700 1 -- 172.21.15.98:0/3592232482 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240bd2a0 con 0x7f3724154d50 2023-08-22T00:06:27.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3721d9b700 1 -- 172.21.15.98:0/3592232482 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534539278 0 0) 0x7f37240c4fb0 con 0x7f37240c64a0 2023-08-22T00:06:27.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f372359e700 1 --2- 172.21.15.98:0/3592232482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f37240c2030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f371c009e60 tx=0x7f371c009780).ready entity=mon.0 client_cookie=a710b7a258cfb362 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3721d9b700 1 -- 172.21.15.98:0/3592232482 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00e070 con 0x7f3724154d50 2023-08-22T00:06:27.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3721d9b700 1 -- 172.21.15.98:0/3592232482 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c00bbf0 con 0x7f3724154d50 2023-08-22T00:06:27.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3721d9b700 1 -- 172.21.15.98:0/3592232482 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c012410 con 0x7f3724154d50 2023-08-22T00:06:27.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3729228700 1 -- 172.21.15.98:0/3592232482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 msgr2=0x7f37240c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.703+0000 7f3729228700 1 --2- 172.21.15.98:0/3592232482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f37240c2030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f371c009e60 tx=0x7f371c009780).stop 2023-08-22T00:06:27.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.704+0000 7f3729228700 1 -- 172.21.15.98:0/3592232482 shutdown_connections 2023-08-22T00:06:27.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.704+0000 7f3729228700 1 --2- 172.21.15.98:0/3592232482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f37240c2030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.704+0000 7f3729228700 1 -- 172.21.15.98:0/3592232482 >> 172.21.15.98:0/3592232482 conn(0x7f37240c3980 msgr2=0x7f37240c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.704+0000 7f3729228700 1 -- 172.21.15.98:0/3592232482 shutdown_connections 2023-08-22T00:06:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.704+0000 7f3729228700 1 -- 172.21.15.98:0/3592232482 wait complete. 2023-08-22T00:06:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.705+0000 7f3729228700 1 Processor -- start 2023-08-22T00:06:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.705+0000 7f3729228700 1 -- start start 2023-08-22T00:06:27.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 0x7f37240c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 0x7f3724152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724153980 con 0x7f3724154d50 2023-08-22T00:06:27.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724166c40 con 0x7f3724154260 2023-08-22T00:06:27.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f3729228700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37241674e0 con 0x7f37240c64a0 2023-08-22T00:06:27.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f372359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f372359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42912/0 (socket says 172.21.15.98:42912) 2023-08-22T00:06:27.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.706+0000 7f372359e700 1 -- 172.21.15.98:0/3017258927 learned_addr learned my addr 172.21.15.98:0/3017258927 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:27.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372259c700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 0x7f3724152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f3722d9d700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 0x7f37240c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 -- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 msgr2=0x7f37240c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 0x7f37240c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 -- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 msgr2=0x7f3724152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 0x7f3724152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 -- 172.21.15.98:0/3017258927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c009a20 con 0x7f3724154d50 2023-08-22T00:06:27.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f3722d9d700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 0x7f37240c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372259c700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 0x7f3724152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f372359e700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f371c00b6c0 tx=0x7f371c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0117d0 con 0x7f3724154d50 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c011930 con 0x7f3724154d50 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c011cd0 con 0x7f3724154d50 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3724164430 con 0x7f3724154d50 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.707+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3724167170 con 0x7f3724154d50 2023-08-22T00:06:27.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.708+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724167650 con 0x7f3724154d50 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.708+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f371c01d630 con 0x7f3724154d50 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.709+0000 7f370affd700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 0x7f37100612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.709+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f371c07c320 con 0x7f3724154d50 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.709+0000 7f3722d9d700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 0x7f37100612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.709+0000 7f3722d9d700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 0x7f37100612d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f37240a9b30 tx=0x7f3718009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:27.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.713+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f371c04d420 con 0x7f3724154d50 2023-08-22T00:06:27.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.916+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3724047480 con 0x7f3724154d50 2023-08-22T00:06:27.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.919+0000 7f370affd700 1 -- 172.21.15.98:0/3017258927 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148559 (secure 0 0 0) 0x7f371c050a40 con 0x7f3724154d50 2023-08-22T00:06:27.926 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:27.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 msgr2=0x7f37100612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 0x7f37100612d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f37240a9b30 tx=0x7f3718009040).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 msgr2=0x7f3724153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f371c00b6c0 tx=0x7f371c009780).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 shutdown_connections 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f371005ee10 0x7f37100612d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37240c64a0 0x7f37240c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3724154d50 0x7f3724153490 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 --2- 172.21.15.98:0/3017258927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3724154260 0x7f3724152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:27.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 >> 172.21.15.98:0/3017258927 conn(0x7f37240c3980 msgr2=0x7f37240c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:27.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 shutdown_connections 2023-08-22T00:06:27.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:27.921+0000 7f3729228700 1 -- 172.21.15.98:0/3017258927 wait complete. 2023-08-22T00:06:27.935 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":4,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":118203},{"type":"v1","addr":"172.21.15.98:6833","nonce":118203}]},"active_addr":"172.21.15.98:6833/118203","active_change":"2023-08-22T00:05:56.023967+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":3866194044}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1133946166}]}]} 2023-08-22T00:06:27.955 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-22T00:06:27.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-22T00:06:27.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:28.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.071+0000 7f34147d6700 1 Processor -- start 2023-08-22T00:06:28.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.072+0000 7f34147d6700 1 -- start start 2023-08-22T00:06:28.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f34147d6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f340c153b60 0x7f340c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f34147d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c153f40 0x7f340c069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f34147d6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340c0a8410 con 0x7f340c0a9140 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f34147d6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c069720 con 0x7f340c153b60 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f34147d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a8cb0 con 0x7f340c153f40 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f340c153b60 0x7f340c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412d73700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f340c0a9140 0x7f340c157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47524/0 (socket says 172.21.15.98:47524) 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412d73700 1 -- 172.21.15.98:0/1648552635 learned_addr learned my addr 172.21.15.98:0/1648552635 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3411d71700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c153f40 0x7f340c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 -- 172.21.15.98:0/1648552635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c153f40 msgr2=0x7f340c069230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c153f40 0x7f340c069230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 -- 172.21.15.98:0/1648552635 >> v1:172.21.15.98:6789/0 conn(0x7f340c0a9140 legacy=0x7f340c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 -- 172.21.15.98:0/1648552635 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c1586a0 con 0x7f340c153b60 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3411570700 1 -- 172.21.15.98:0/1648552635 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559769954 0 0) 0x7f340c0a8410 con 0x7f340c0a9140 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3412572700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c068d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3408009760 tx=0x7f3408009060).ready entity=mon.0 client_cookie=1e242f223a94a80b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3411570700 1 -- 172.21.15.98:0/1648552635 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800b580 con 0x7f340c153b60 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3411570700 1 -- 172.21.15.98:0/1648552635 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800b6e0 con 0x7f340c153b60 2023-08-22T00:06:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.073+0000 7f3411570700 1 -- 172.21.15.98:0/1648552635 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800ba60 con 0x7f340c153b60 2023-08-22T00:06:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 -- 172.21.15.98:0/1648552635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 msgr2=0x7f340c068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c068d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3408009760 tx=0x7f3408009060).stop 2023-08-22T00:06:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 -- 172.21.15.98:0/1648552635 shutdown_connections 2023-08-22T00:06:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c068d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 --2- 172.21.15.98:0/1648552635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c153f40 0x7f340c069230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 -- 172.21.15.98:0/1648552635 >> 172.21.15.98:0/1648552635 conn(0x7f340c0c5dc0 msgr2=0x7f340c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 -- 172.21.15.98:0/1648552635 shutdown_connections 2023-08-22T00:06:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.074+0000 7f34147d6700 1 -- 172.21.15.98:0/1648552635 wait complete. 2023-08-22T00:06:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.075+0000 7f34147d6700 1 Processor -- start 2023-08-22T00:06:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.075+0000 7f34147d6700 1 -- start start 2023-08-22T00:06:28.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 0x7f340c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 0x7f340c0bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a6ee0 con 0x7f340c153b60 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a62d0 con 0x7f340c153f40 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f34147d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a65b0 con 0x7f340c0a9140 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42920/0 (socket says 172.21.15.98:42920) 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 -- 172.21.15.98:0/1328778766 learned_addr learned my addr 172.21.15.98:0/1328778766 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3412572700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 0x7f340c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3412d73700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 0x7f340c0bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 -- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 msgr2=0x7f340c0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 0x7f340c0a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 -- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 msgr2=0x7f340c0bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 0x7f340c0bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 -- 172.21.15.98:0/1328778766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080092a0 con 0x7f340c153b60 2023-08-22T00:06:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3412572700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 0x7f340c0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3412d73700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 0x7f340c0bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f3411d71700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f340000d890 tx=0x7f3400008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.076+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34000125f0 con 0x7f340c153b60 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.077+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400012750 con 0x7f340c153b60 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.077+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c0a6890 con 0x7f340c153b60 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.077+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400012ad0 con 0x7f340c153b60 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.077+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c151cc0 con 0x7f340c153b60 2023-08-22T00:06:28.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.078+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c0a7090 con 0x7f340c153b60 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.078+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3400013480 con 0x7f340c153b60 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.078+0000 7f33fe7fc700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 0x7f33f00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.078+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3400079ec0 con 0x7f340c153b60 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.079+0000 7f3412572700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 0x7f33f00612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.079+0000 7f3412572700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 0x7f33f00612a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f340c068830 tx=0x7f3408017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.083+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f340c0a7090 con 0x7f340c153b60 2023-08-22T00:06:28.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.246+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f340c047480 con 0x7f340c153b60 2023-08-22T00:06:28.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.247+0000 7f33fe7fc700 1 -- 172.21.15.98:0/1328778766 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f340004afc0 con 0x7f340c153b60 2023-08-22T00:06:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:28.250 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 msgr2=0x7f33f00612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 0x7f33f00612a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f340c068830 tx=0x7f3408017000).stop 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 msgr2=0x7f340c0a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f340000d890 tx=0x7f3400008040).stop 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 shutdown_connections 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33f005ede0 0x7f33f00612a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f340c0a9140 0x7f340c0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340c153f40 0x7f340c0bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 --2- 172.21.15.98:0/1328778766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c153b60 0x7f340c0a5c20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 >> 172.21.15.98:0/1328778766 conn(0x7f340c0c5dc0 msgr2=0x7f340c1525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 shutdown_connections 2023-08-22T00:06:28.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.249+0000 7f34147d6700 1 -- 172.21.15.98:0/1328778766 wait complete. 2023-08-22T00:06:28.263 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-22T00:06:28.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:28.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.379+0000 7f3c99408700 1 Processor -- start 2023-08-22T00:06:28.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.379+0000 7f3c99408700 1 -- start start 2023-08-22T00:06:28.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c99408700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3c94154c00 0x7f3c9414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c99408700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940c17b0 con 0x7f3c9414e0d0 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c99408700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c94155260 con 0x7f3c940c61a0 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c99408700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c940bf9e0 con 0x7f3c94154c00 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c92ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3c9414e0d0 0x7f3c940c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47536/0 (socket says 172.21.15.98:47536) 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c92ffd700 1 -- 172.21.15.98:0/2590123264 learned_addr learned my addr 172.21.15.98:0/2590123264 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:28.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c937fe700 1 --2- 172.21.15.98:0/2590123264 >> v2:172.21.15.118:3300/0 conn(0x7f3c94154c00 0x7f3c9414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946943566 0 0) 0x7f3c940c17b0 con 0x7f3c9414e0d0 2023-08-22T00:06:28.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c0033f0 con 0x7f3c9414e0d0 2023-08-22T00:06:28.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1478341836 0 0) 0x7f3c7c0033f0 con 0x7f3c9414e0d0 2023-08-22T00:06:28.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 >> v2:172.21.15.118:3300/0 conn(0x7f3c94154c00 msgr2=0x7f3c9414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/2590123264 >> v2:172.21.15.118:3300/0 conn(0x7f3c94154c00 0x7f3c9414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 >> v1:172.21.15.118:6789/0 conn(0x7f3c940c61a0 legacy=0x7f3c941544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940bfcc0 con 0x7f3c9414e0d0 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3c84001470 con 0x7f3c9414e0d0 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 >> v1:172.21.15.98:6789/0 conn(0x7f3c9414e0d0 legacy=0x7f3c940c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 0x7f3c7c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c004690 0x7f3c7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c7c005050 0x7f3c7c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940bf9e0 con 0x7f3c7c0038e0 2023-08-22T00:06:28.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00bfe0 con 0x7f3c7c005050 2023-08-22T00:06:28.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00c1a0 con 0x7f3c7c004690 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.380+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 0x7f3c7c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c937fe700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c7c005050 0x7f3c7c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c927fc700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c004690 0x7f3c7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 -- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c004690 msgr2=0x7f3c7c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c004690 0x7f3c7c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 -- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c7c005050 msgr2=0x7f3c7c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c7c005050 0x7f3c7c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c937fe700 1 -- 172.21.15.98:0/2590123264 reap_dead start 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 -- 172.21.15.98:0/2590123264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0033f0 con 0x7f3c7c0038e0 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c927fc700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c004690 0x7f3c7c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 0x7f3c7c003d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3c8400c190 tx=0x7f3c84001e50).ready entity=mon.0 client_cookie=2f37da21bac4e5ea server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84007a20 con 0x7f3c7c0038e0 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8400ca80 con 0x7f3c7c0038e0 2023-08-22T00:06:28.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c91ffb700 1 -- 172.21.15.98:0/2590123264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400ce00 con 0x7f3c7c0038e0 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c99408700 1 -- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 msgr2=0x7f3c7c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c99408700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 0x7f3c7c003d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3c8400c190 tx=0x7f3c84001e50).stop 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c99408700 1 -- 172.21.15.98:0/2590123264 shutdown_connections 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c99408700 1 --2- 172.21.15.98:0/2590123264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c7c0038e0 0x7f3c7c003d00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.381+0000 7f3c99408700 1 -- 172.21.15.98:0/2590123264 >> 172.21.15.98:0/2590123264 conn(0x7f3c940caa80 msgr2=0x7f3c940cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.382+0000 7f3c99408700 1 -- 172.21.15.98:0/2590123264 shutdown_connections 2023-08-22T00:06:28.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.382+0000 7f3c99408700 1 -- 172.21.15.98:0/2590123264 wait complete. 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.383+0000 7f3c99408700 1 Processor -- start 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.383+0000 7f3c99408700 1 -- start start 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.383+0000 7f3c99408700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c0038e0 0x7f3c940b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c940c3500 0x7f3c941677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c2af0 con 0x7f3c94167cd0 2023-08-22T00:06:28.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940b0bb0 con 0x7f3c940c3500 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c3070 con 0x7f3c7c0038e0 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42930/0 (socket says 172.21.15.98:42930) 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 -- 172.21.15.98:0/2427373469 learned_addr learned my addr 172.21.15.98:0/2427373469 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c927fc700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c940c3500 0x7f3c941677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c0038e0 0x7f3c940b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 -- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c0038e0 msgr2=0x7f3c940b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c0038e0 0x7f3c940b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 -- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c940c3500 msgr2=0x7f3c941677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c940c3500 0x7f3c941677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 -- 172.21.15.98:0/2427373469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94168230 con 0x7f3c94167cd0 2023-08-22T00:06:28.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c937fe700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3c940c6e80 tx=0x7f3c8c009710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c002d80 con 0x7f3c94167cd0 2023-08-22T00:06:28.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c016430 con 0x7f3c94167cd0 2023-08-22T00:06:28.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c94168510 con 0x7f3c94167cd0 2023-08-22T00:06:28.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c002ee0 con 0x7f3c94167cd0 2023-08-22T00:06:28.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.384+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c940c3980 con 0x7f3c94167cd0 2023-08-22T00:06:28.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.385+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c94047480 con 0x7f3c94167cd0 2023-08-22T00:06:28.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.385+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3c8c003040 con 0x7f3c94167cd0 2023-08-22T00:06:28.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.386+0000 7f3c7affd700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 0x7f3c800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.386+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3c8c07a3f0 con 0x7f3c94167cd0 2023-08-22T00:06:28.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.386+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 0x7f3c800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.386+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 0x7f3c800612d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3c84001ed0 tx=0x7f3c84015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.390+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c8c04b4f0 con 0x7f3c94167cd0 2023-08-22T00:06:28.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.553+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c94063680 con 0x7f3c94167cd0 2023-08-22T00:06:28.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.554+0000 7f3c7affd700 1 -- 172.21.15.98:0/2427373469 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f3c8c04eb10 con 0x7f3c94167cd0 2023-08-22T00:06:28.556 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:28.557 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:28.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 msgr2=0x7f3c800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 0x7f3c800612d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3c84001ed0 tx=0x7f3c84015000).stop 2023-08-22T00:06:28.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 msgr2=0x7f3c940c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3c940c6e80 tx=0x7f3c8c009710).stop 2023-08-22T00:06:28.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 shutdown_connections 2023-08-22T00:06:28.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c8005ee10 0x7f3c800612d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c7c0038e0 0x7f3c940b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94167cd0 0x7f3c940c9b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 --2- 172.21.15.98:0/2427373469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c940c3500 0x7f3c941677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 >> 172.21.15.98:0/2427373469 conn(0x7f3c940caa80 msgr2=0x7f3c94153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 shutdown_connections 2023-08-22T00:06:28.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.556+0000 7f3c99408700 1 -- 172.21.15.98:0/2427373469 wait complete. 2023-08-22T00:06:28.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-22T00:06:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.689+0000 7fa4c265f700 1 Processor -- start 2023-08-22T00:06:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.689+0000 7fa4c265f700 1 -- start start 2023-08-22T00:06:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c265f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4bc153f80 0x7fa4bc0c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c265f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc063010 0x7fa4bc0a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c265f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0aa3f0 con 0x7fa4bc0c5b70 2023-08-22T00:06:28.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c265f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc0634c0 con 0x7fa4bc153f80 2023-08-22T00:06:28.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c265f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0bfe30 con 0x7fa4bc063010 2023-08-22T00:06:28.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4bc153f80 0x7fa4bc0c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4bc153f80 0x7fa4bc0c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42934/0 (socket says 172.21.15.98:42934) 2023-08-22T00:06:28.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 -- 172.21.15.98:0/3588901964 learned_addr learned my addr 172.21.15.98:0/3588901964 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4c0bfc700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc063010 0x7fa4bc0a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 -- 172.21.15.98:0/3588901964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc063010 msgr2=0x7fa4bc0a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc063010 0x7fa4bc0a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 -- 172.21.15.98:0/3588901964 >> v1:172.21.15.118:6789/0 conn(0x7fa4bc0c5b70 legacy=0x7fa4bc153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 -- 172.21.15.98:0/3588901964 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0636a0 con 0x7fa4bc153f80 2023-08-22T00:06:28.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4b37fe700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc0c5f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa4a4006fd0 tx=0x7fa4a40090f0).ready entity=mon.0 client_cookie=f0145c4bd1215a5e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.690+0000 7fa4bb7fe700 1 -- 172.21.15.98:0/3588901964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400b580 con 0x7fa4bc153f80 2023-08-22T00:06:28.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4bb7fe700 1 -- 172.21.15.98:0/3588901964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400b6e0 con 0x7fa4bc153f80 2023-08-22T00:06:28.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4bb7fe700 1 -- 172.21.15.98:0/3588901964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400ba60 con 0x7fa4bc153f80 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 -- 172.21.15.98:0/3588901964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 msgr2=0x7fa4bc0c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc0c5f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa4a4006fd0 tx=0x7fa4a40090f0).stop 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 -- 172.21.15.98:0/3588901964 shutdown_connections 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc063010 0x7fa4bc0a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 --2- 172.21.15.98:0/3588901964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc0c5f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 -- 172.21.15.98:0/3588901964 >> 172.21.15.98:0/3588901964 conn(0x7fa4bc0cb610 msgr2=0x7fa4bc0c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 -- 172.21.15.98:0/3588901964 shutdown_connections 2023-08-22T00:06:28.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.691+0000 7fa4c265f700 1 -- 172.21.15.98:0/3588901964 wait complete. 2023-08-22T00:06:28.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.692+0000 7fa4c265f700 1 Processor -- start 2023-08-22T00:06:28.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 -- start start 2023-08-22T00:06:28.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4bc063010 0x7fa4bc164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc0c5b70 0x7fa4bc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b0050 con 0x7fa4bc153f80 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0af440 con 0x7fa4bc063010 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c265f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0af720 con 0x7fa4bc0c5b70 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c0bfc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c0bfc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42936/0 (socket says 172.21.15.98:42936) 2023-08-22T00:06:28.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.693+0000 7fa4c0bfc700 1 -- 172.21.15.98:0/1744156706 learned_addr learned my addr 172.21.15.98:0/1744156706 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4b37fe700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc0c5b70 0x7fa4bc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4bbfff700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4bc063010 0x7fa4bc164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 -- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc0c5b70 msgr2=0x7fa4bc0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4bc0c5b70 0x7fa4bc0aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 -- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4bc063010 msgr2=0x7fa4bc164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4bc063010 0x7fa4bc164df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4009370 con 0x7fa4bc153f80 2023-08-22T00:06:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c0bfc700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc152390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa4b400e8d0 tx=0x7fa4b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4012600 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4012760 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0afa00 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4012ae0 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.694+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc0af140 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.695+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4bc083350 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.695+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa4b401b400 con 0x7fa4bc153f80 2023-08-22T00:06:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b8ff9700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa49c05ee10 0x7fa49c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa4b407a530 con 0x7fa4bc153f80 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b8ff9700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7fa49c069660 0x7fa49c06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa49c06c180 con 0x7fa49c069660 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b407cb50 con 0x7fa4bc153f80 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4bbfff700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa49c05ee10 0x7fa49c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b37fe700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7fa49c069660 0x7fa49c06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4b37fe700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7fa49c069660 0x7fa49c06bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.696+0000 7fa4bbfff700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa49c05ee10 0x7fa49c0612d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa4ac004290 tx=0x7fa4ac001560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.697+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== osd.0 v2:172.21.15.98:6808/118497 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa49c06c180 con 0x7fa49c069660 2023-08-22T00:06:28.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 --> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4bc063980 con 0x7fa49c069660 2023-08-22T00:06:28.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4b8ff9700 1 -- 172.21.15.98:0/1744156706 <== osd.0 v2:172.21.15.98:6808/118497 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4bc063980 con 0x7fa49c069660 2023-08-22T00:06:28.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7fa49c069660 msgr2=0x7fa49c06bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7fa49c069660 0x7fa49c06bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa49c05ee10 msgr2=0x7fa49c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa49c05ee10 0x7fa49c0612d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa4ac004290 tx=0x7fa4ac001560).stop 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 msgr2=0x7fa4bc152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.711+0000 7fa4c265f700 1 --2- 172.21.15.98:0/1744156706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4bc153f80 0x7fa4bc152390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa4b400e8d0 tx=0x7fa4b4009060).stop 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.712+0000 7fa4c0bfc700 1 -- 172.21.15.98:0/1744156706 reap_dead start 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.712+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 shutdown_connections 2023-08-22T00:06:28.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.712+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 >> 172.21.15.98:0/1744156706 conn(0x7fa4bc0cb610 msgr2=0x7fa4bc0c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.712+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 shutdown_connections 2023-08-22T00:06:28.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.712+0000 7fa4c265f700 1 -- 172.21.15.98:0/1744156706 wait complete. 2023-08-22T00:06:28.724 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:28.724 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-22T00:06:28.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.839+0000 7f2c84fb5700 1 Processor -- start 2023-08-22T00:06:28.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.839+0000 7f2c84fb5700 1 -- start start 2023-08-22T00:06:28.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c84fb5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 0x7f2c800c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c84fb5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c800ab930 0x7f2c800be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c84fb5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c800c40a0 con 0x7f2c80153b90 2023-08-22T00:06:28.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c84fb5700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800c3490 con 0x7f2c800ab930 2023-08-22T00:06:28.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c84fb5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800c3770 con 0x7f2c80153f70 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c800ab930 0x7f2c800be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c800ab930 0x7f2c800be820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42944/0 (socket says 172.21.15.98:42944) 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/4041296628 learned_addr learned my addr 172.21.15.98:0/4041296628 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7dd9b700 1 --2- 172.21.15.98:0/4041296628 >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 0x7f2c800c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/4041296628 >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 msgr2=0x7f2c800c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 --2- 172.21.15.98:0/4041296628 >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 0x7f2c800c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/4041296628 >> v1:172.21.15.118:6789/0 conn(0x7f2c80153b90 legacy=0x7f2c800c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/4041296628 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800c3a50 con 0x7f2c800ab930 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7dd9b700 1 --2- 172.21.15.98:0/4041296628 >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 0x7f2c800c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7ed9d700 1 --2- 172.21.15.98:0/4041296628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c800ab930 0x7f2c800be820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2c800c63c0 tx=0x7f2c78009840).ready entity=mon.0 client_cookie=f85725eb619c4972 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.840+0000 7f2c7d59a700 1 -- 172.21.15.98:0/4041296628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800e070 con 0x7f2c800ab930 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c7d59a700 1 -- 172.21.15.98:0/4041296628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7800ba10 con 0x7f2c800ab930 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c7d59a700 1 -- 172.21.15.98:0/4041296628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800bd90 con 0x7f2c800ab930 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 -- 172.21.15.98:0/4041296628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c800ab930 msgr2=0x7f2c800be820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/4041296628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c800ab930 0x7f2c800be820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2c800c63c0 tx=0x7f2c78009840).stop 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 -- 172.21.15.98:0/4041296628 shutdown_connections 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/4041296628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c800ab930 0x7f2c800be820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/4041296628 >> v2:172.21.15.118:3300/0 conn(0x7f2c80153f70 0x7f2c800c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 -- 172.21.15.98:0/4041296628 >> 172.21.15.98:0/4041296628 conn(0x7f2c800c9350 msgr2=0x7f2c800c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 -- 172.21.15.98:0/4041296628 shutdown_connections 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.841+0000 7f2c84fb5700 1 -- 172.21.15.98:0/4041296628 wait complete. 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.842+0000 7f2c84fb5700 1 Processor -- start 2023-08-22T00:06:28.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.842+0000 7f2c84fb5700 1 -- start start 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c800ab930 0x7f2c8014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c80153b90 0x7f2c8014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 0x7f2c8014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8014e340 con 0x7f2c80153f70 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8014da30 con 0x7f2c800ab930 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c84fb5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80150020 con 0x7f2c80153b90 2023-08-22T00:06:28.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 0x7f2c8014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 0x7f2c8014e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42954/0 (socket says 172.21.15.98:42954) 2023-08-22T00:06:28.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/3719491205 learned_addr learned my addr 172.21.15.98:0/3719491205 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:28.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7e59c700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c800ab930 0x7f2c8014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7dd9b700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c80153b90 0x7f2c8014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c80153b90 msgr2=0x7f2c8014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c80153b90 0x7f2c8014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c800ab930 msgr2=0x7f2c8014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c800ab930 0x7f2c8014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78009ae0 con 0x7f2c80153f70 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.843+0000 7f2c7ed9d700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 0x7f2c8014e7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2c8006c620 tx=0x7f2c78009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780092e0 con 0x7f2c80153f70 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7801d410 con 0x7f2c80153f70 2023-08-22T00:06:28.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8014dcf0 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7801d7b0 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8014cd30 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.844+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c80069d50 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2c7801dba0 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c6005ee10 0x7f2c600612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2c7807bf00 con 0x7f2c80153f70 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c7e59c700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c6005ee10 0x7f2c600612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2c60069660 0x7f2c6006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c6006c180 con 0x7f2c60069660 2023-08-22T00:06:28.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.845+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c7807e520 con 0x7f2c80153f70 2023-08-22T00:06:28.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.846+0000 7f2c7dd9b700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2c60069660 0x7f2c6006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.846+0000 7f2c7e59c700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c6005ee10 0x7f2c600612d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2c700038b0 tx=0x7f2c70007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.846+0000 7f2c7dd9b700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2c60069660 0x7f2c6006bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:28.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.846+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== osd.1 v2:172.21.15.98:6800/118496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2c6006c180 con 0x7f2c60069660 2023-08-22T00:06:28.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.860+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 --> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c800c3d30 con 0x7f2c60069660 2023-08-22T00:06:28.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c6e7fc700 1 -- 172.21.15.98:0/3719491205 <== osd.1 v2:172.21.15.98:6800/118496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c800c3d30 con 0x7f2c60069660 2023-08-22T00:06:28.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2c60069660 msgr2=0x7f2c6006bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2c60069660 0x7f2c6006bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:28.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c6005ee10 msgr2=0x7f2c600612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c6005ee10 0x7f2c600612d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2c700038b0 tx=0x7f2c70007d20).stop 2023-08-22T00:06:28.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 msgr2=0x7f2c8014e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:28.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 --2- 172.21.15.98:0/3719491205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c80153f70 0x7f2c8014e7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2c8006c620 tx=0x7f2c78009840).stop 2023-08-22T00:06:28.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c7ed9d700 1 -- 172.21.15.98:0/3719491205 reap_dead start 2023-08-22T00:06:28.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 shutdown_connections 2023-08-22T00:06:28.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 >> 172.21.15.98:0/3719491205 conn(0x7f2c800c9350 msgr2=0x7f2c800c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:28.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 shutdown_connections 2023-08-22T00:06:28.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.861+0000 7f2c84fb5700 1 -- 172.21.15.98:0/3719491205 wait complete. 2023-08-22T00:06:28.876 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:28.876 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-22T00:06:28.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.993+0000 7f2e765a6700 1 Processor -- start 2023-08-22T00:06:28.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.993+0000 7f2e765a6700 1 -- start start 2023-08-22T00:06:28.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e765a6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2e700656c0 0x7f2e70156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e765a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e765a6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e70156a10 con 0x7f2e70062e70 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e765a6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e70067290 con 0x7f2e700656c0 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e765a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70152a70 con 0x7f2e70152500 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e6ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2e70062e70 0x7f2e70064fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47544/0 (socket says 172.21.15.98:47544) 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.994+0000 7f2e6ffff700 1 -- 172.21.15.98:0/2602939744 learned_addr learned my addr 172.21.15.98:0/2602939744 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 --2- 172.21.15.98:0/2602939744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6f7fe700 1 --2- 172.21.15.98:0/2602939744 >> v2:172.21.15.118:3300/0 conn(0x7f2e700656c0 0x7f2e70156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:28.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6effd700 1 -- 172.21.15.98:0/2602939744 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869495378 0 0) 0x7f2e70156a10 con 0x7f2e70062e70 2023-08-22T00:06:29.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6effd700 1 -- 172.21.15.98:0/2602939744 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e5c0033f0 con 0x7f2e70062e70 2023-08-22T00:06:29.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 -- 172.21.15.98:0/2602939744 >> v2:172.21.15.118:3300/0 conn(0x7f2e700656c0 msgr2=0x7f2e70156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 --2- 172.21.15.98:0/2602939744 >> v2:172.21.15.118:3300/0 conn(0x7f2e700656c0 0x7f2e70156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 -- 172.21.15.98:0/2602939744 >> v1:172.21.15.98:6789/0 conn(0x7f2e70062e70 legacy=0x7f2e70064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 -- 172.21.15.98:0/2602939744 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70152d50 con 0x7f2e70152500 2023-08-22T00:06:29.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e74b43700 1 --2- 172.21.15.98:0/2602939744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70156520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2e68009e60 tx=0x7f2e68009780).ready entity=mon.2 client_cookie=a035bb17ce47ccd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6effd700 1 -- 172.21.15.98:0/2602939744 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e070 con 0x7f2e70152500 2023-08-22T00:06:29.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6effd700 1 -- 172.21.15.98:0/2602939744 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800bab0 con 0x7f2e70152500 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.995+0000 7f2e6effd700 1 -- 172.21.15.98:0/2602939744 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800be30 con 0x7f2e70152500 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 -- 172.21.15.98:0/2602939744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 msgr2=0x7f2e70156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 --2- 172.21.15.98:0/2602939744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70156520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2e68009e60 tx=0x7f2e68009780).stop 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 -- 172.21.15.98:0/2602939744 shutdown_connections 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 --2- 172.21.15.98:0/2602939744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70156520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 --2- 172.21.15.98:0/2602939744 >> v2:172.21.15.118:3300/0 conn(0x7f2e700656c0 0x7f2e70156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 -- 172.21.15.98:0/2602939744 >> 172.21.15.98:0/2602939744 conn(0x7f2e700c42e0 msgr2=0x7f2e700c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 -- 172.21.15.98:0/2602939744 shutdown_connections 2023-08-22T00:06:29.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.996+0000 7f2e765a6700 1 -- 172.21.15.98:0/2602939744 wait complete. 2023-08-22T00:06:29.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.997+0000 7f2e765a6700 1 Processor -- start 2023-08-22T00:06:29.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.997+0000 7f2e765a6700 1 -- start start 2023-08-22T00:06:29.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 0x7f2e7014a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e700656c0 0x7f2e700c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700bf700 con 0x7f2e70062e70 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014a8f0 con 0x7f2e700656c0 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e765a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700bea80 con 0x7f2e70152500 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 0x7f2e7014a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 0x7f2e7014a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42960/0 (socket says 172.21.15.98:42960) 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 -- 172.21.15.98:0/828381887 learned_addr learned my addr 172.21.15.98:0/828381887 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6f7fe700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e700656c0 0x7f2e700c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e74b43700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 -- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 msgr2=0x7f2e70150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e70152500 0x7f2e70150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 -- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e700656c0 msgr2=0x7f2e700c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e700656c0 0x7f2e700c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009a20 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e6ffff700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 0x7f2e7014a0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f2e5800c440 tx=0x7f2e58007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580070d0 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.998+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58007230 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.999+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e700bed60 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.999+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580075d0 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.999+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700bf320 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:28.999+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e70069460 con 0x7f2e70062e70 2023-08-22T00:06:29.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2e580059b0 con 0x7f2e70062e70 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e5005ee10 0x7f2e500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2e580799a0 con 0x7f2e70062e70 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e6f7fe700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e5005ee10 0x7f2e500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f2e50069660 0x7f2e5006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e5006c180 con 0x7f2e50069660 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e58079c90 con 0x7f2e70062e70 2023-08-22T00:06:29.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.000+0000 7f2e74b43700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f2e50069660 0x7f2e5006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.001+0000 7f2e6f7fe700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e5005ee10 0x7f2e500612d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2e700bfeb0 tx=0x7f2e60009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.001+0000 7f2e74b43700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f2e50069660 0x7f2e5006bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.001+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== osd.2 v2:172.21.15.98:6816/118500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2e5006c180 con 0x7f2e50069660 2023-08-22T00:06:29.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.015+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 --> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e70153030 con 0x7f2e50069660 2023-08-22T00:06:29.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e67fff700 1 -- 172.21.15.98:0/828381887 <== osd.2 v2:172.21.15.98:6816/118500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e70153030 con 0x7f2e50069660 2023-08-22T00:06:29.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f2e50069660 msgr2=0x7f2e5006bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f2e50069660 0x7f2e5006bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e5005ee10 msgr2=0x7f2e500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e5005ee10 0x7f2e500612d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2e700bfeb0 tx=0x7f2e60009060).stop 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 msgr2=0x7f2e7014a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 --2- 172.21.15.98:0/828381887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70062e70 0x7f2e7014a0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f2e5800c440 tx=0x7f2e58007c70).stop 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e74b43700 1 -- 172.21.15.98:0/828381887 reap_dead start 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 shutdown_connections 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 >> 172.21.15.98:0/828381887 conn(0x7f2e700c42e0 msgr2=0x7f2e700be090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 shutdown_connections 2023-08-22T00:06:29.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.016+0000 7f2e765a6700 1 -- 172.21.15.98:0/828381887 wait complete. 2023-08-22T00:06:29.032 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:29.033 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-22T00:06:29.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.149+0000 7f1526b24700 1 Processor -- start 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.149+0000 7f1526b24700 1 -- start start 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f1526b24700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1520153b90 0x7f1520153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f1526b24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 0x7f15200be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f1526b24700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15200c40a0 con 0x7f15200c2eb0 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f1526b24700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200c3490 con 0x7f1520153b90 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f1526b24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200c3770 con 0x7f15200ab930 2023-08-22T00:06:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1520153b90 0x7f1520153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15250c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 0x7f15200be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1520153b90 0x7f1520153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:49250/0 (socket says 172.21.15.98:49250) 2023-08-22T00:06:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 -- 172.21.15.98:0/3214007479 learned_addr learned my addr 172.21.15.98:0/3214007479 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 -- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 msgr2=0x7f15200be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 0x7f15200be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 -- 172.21.15.98:0/3214007479 >> v1:172.21.15.118:6789/0 conn(0x7f15200c2eb0 legacy=0x7f15200c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f151f7fe700 1 -- 172.21.15.98:0/3214007479 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337296583 0 0) 0x7f15200c40a0 con 0x7f15200c2eb0 2023-08-22T00:06:29.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15248c0700 1 -- 172.21.15.98:0/3214007479 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200c3a50 con 0x7f1520153b90 2023-08-22T00:06:29.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.150+0000 7f15250c1700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 0x7f15200be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:29.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f15248c0700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1520153b90 0x7f1520153f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1514006fd0 tx=0x7f15140090f0).ready entity=mon.1 client_cookie=859da5634b35cc37 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f151f7fe700 1 -- 172.21.15.98:0/3214007479 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400b580 con 0x7f1520153b90 2023-08-22T00:06:29.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f151f7fe700 1 -- 172.21.15.98:0/3214007479 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400b6e0 con 0x7f1520153b90 2023-08-22T00:06:29.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f151f7fe700 1 -- 172.21.15.98:0/3214007479 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400ba60 con 0x7f1520153b90 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 -- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1520153b90 msgr2=0x7f1520153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1520153b90 0x7f1520153f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1514006fd0 tx=0x7f15140090f0).stop 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 -- 172.21.15.98:0/3214007479 shutdown_connections 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15200ab930 0x7f15200be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 --2- 172.21.15.98:0/3214007479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1520153b90 0x7f1520153f70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 -- 172.21.15.98:0/3214007479 >> 172.21.15.98:0/3214007479 conn(0x7f15200c9350 msgr2=0x7f15200c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 -- 172.21.15.98:0/3214007479 shutdown_connections 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.151+0000 7f1526b24700 1 -- 172.21.15.98:0/3214007479 wait complete. 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.152+0000 7f1526b24700 1 Processor -- start 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.152+0000 7f1526b24700 1 -- start start 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 0x7f152014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 0x7f1520064990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1520153b90 0x7f15200acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520165020 con 0x7f15200c2eb0 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152014ce00 con 0x7f15200ab930 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f1526b24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1520164410 con 0x7f1520153b90 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f151ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 0x7f1520064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f15248c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 0x7f152014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f15248c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 0x7f152014c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:49266/0 (socket says 172.21.15.98:49266) 2023-08-22T00:06:29.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f151ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 0x7f1520064990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42964/0 (socket says 172.21.15.98:42964) 2023-08-22T00:06:29.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f15248c0700 1 -- 172.21.15.98:0/3044711421 learned_addr learned my addr 172.21.15.98:0/3044711421 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.153+0000 7f15250c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1520153b90 0x7f15200acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 -- 172.21.15.98:0/3044711421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1520153b90 msgr2=0x7f15200acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1520153b90 0x7f15200acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 -- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 msgr2=0x7f1520064990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 0x7f1520064990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009a20 con 0x7f15200ab930 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f151ffff700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15200c2eb0 0x7f1520064990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f15248c0700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 0x7f152014c910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f152006c620 tx=0x7f1514017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400b850 con 0x7f15200ab930 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400b9b0 con 0x7f15200ab930 2023-08-22T00:06:29.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1514009370 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151401c670 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.154+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15201649d0 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.155+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1520069d50 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.155+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f151401ca60 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.155+0000 7f151cff9700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f150405ede0 0x7f15040612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.155+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f151407be00 con 0x7f15200ab930 2023-08-22T00:06:29.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.155+0000 7f151ffff700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f150405ede0 0x7f15040612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f151cff9700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f1504069630 0x7f150406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f150406c150 con 0x7f1504069630 2023-08-22T00:06:29.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f151407e360 con 0x7f15200ab930 2023-08-22T00:06:29.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f15250c1700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f1504069630 0x7f150406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f151ffff700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f150405ede0 0x7f15040612a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f150c007fd0 tx=0x7f150c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.156+0000 7f15250c1700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f1504069630 0x7f150406bad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.157+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== osd.3 v2:172.21.15.98:6824/118512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f150406c150 con 0x7f1504069630 2023-08-22T00:06:29.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.171+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 --> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1520165300 con 0x7f1504069630 2023-08-22T00:06:29.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.171+0000 7f151cff9700 1 -- 172.21.15.98:0/3044711421 <== osd.3 v2:172.21.15.98:6824/118512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1520165300 con 0x7f1504069630 2023-08-22T00:06:29.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.171+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f1504069630 msgr2=0x7f150406bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.171+0000 7f1526b24700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f1504069630 0x7f150406bad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f150405ede0 msgr2=0x7f15040612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f150405ede0 0x7f15040612a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f150c007fd0 tx=0x7f150c009040).stop 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 msgr2=0x7f152014c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 --2- 172.21.15.98:0/3044711421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15200ab930 0x7f152014c910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f152006c620 tx=0x7f1514017000).stop 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f15250c1700 1 -- 172.21.15.98:0/3044711421 reap_dead start 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 shutdown_connections 2023-08-22T00:06:29.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 >> 172.21.15.98:0/3044711421 conn(0x7f15200c9350 msgr2=0x7f152014fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 shutdown_connections 2023-08-22T00:06:29.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.172+0000 7f1526b24700 1 -- 172.21.15.98:0/3044711421 wait complete. 2023-08-22T00:06:29.185 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:29.186 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-22T00:06:29.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.302+0000 7f88f7e82700 1 Processor -- start 2023-08-22T00:06:29.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.302+0000 7f88f7e82700 1 -- start start 2023-08-22T00:06:29.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f7e82700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f00654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f7e82700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88f0067590 0x7f88f00679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f7e82700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f0065050 con 0x7f88f014e660 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f7e82700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f0067ec0 con 0x7f88f0067590 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f7e82700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00be650 con 0x7f88f014e280 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f641f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88f0067590 0x7f88f00679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f641f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88f0067590 0x7f88f00679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42976/0 (socket says 172.21.15.98:42976) 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f641f700 1 -- 172.21.15.98:0/3644691057 learned_addr learned my addr 172.21.15.98:0/3644691057 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.303+0000 7f88f5c1e700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f00654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f641f700 1 -- 172.21.15.98:0/3644691057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 msgr2=0x7f88f00654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f641f700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f00654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f641f700 1 -- 172.21.15.98:0/3644691057 >> v1:172.21.15.118:6789/0 conn(0x7f88f014e660 legacy=0x7f88f00bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f641f700 1 -- 172.21.15.98:0/3644691057 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0064440 con 0x7f88f0067590 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f641f700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00679d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f88e8009f20 tx=0x7f88e8009840).ready entity=mon.0 client_cookie=e4ed5ab8a20c5fca server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f4c1c700 1 -- 172.21.15.98:0/3644691057 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800e070 con 0x7f88f0067590 2023-08-22T00:06:29.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f4c1c700 1 -- 172.21.15.98:0/3644691057 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800ba80 con 0x7f88f0067590 2023-08-22T00:06:29.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f4c1c700 1 -- 172.21.15.98:0/3644691057 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800be00 con 0x7f88f0067590 2023-08-22T00:06:29.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 -- 172.21.15.98:0/3644691057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 msgr2=0x7f88f00679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00679d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f88e8009f20 tx=0x7f88e8009840).stop 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 -- 172.21.15.98:0/3644691057 shutdown_connections 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00679d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 --2- 172.21.15.98:0/3644691057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f00654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.304+0000 7f88f7e82700 1 -- 172.21.15.98:0/3644691057 >> 172.21.15.98:0/3644691057 conn(0x7f88f00c7800 msgr2=0x7f88f00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.305+0000 7f88f7e82700 1 -- 172.21.15.98:0/3644691057 shutdown_connections 2023-08-22T00:06:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.305+0000 7f88f7e82700 1 -- 172.21.15.98:0/3644691057 wait complete. 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 Processor -- start 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 -- start start 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f0148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f014e660 0x7f88f00a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00ab0c0 con 0x7f88f0067590 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0149550 con 0x7f88f014e660 2023-08-22T00:06:29.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f7e82700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00ad670 con 0x7f88f014e280 2023-08-22T00:06:29.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f5c1e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f5c1e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42980/0 (socket says 172.21.15.98:42980) 2023-08-22T00:06:29.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.306+0000 7f88f5c1e700 1 -- 172.21.15.98:0/197056072 learned_addr learned my addr 172.21.15.98:0/197056072 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f541d700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f0148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 -- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 msgr2=0x7f88f0148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f641f700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f014e660 0x7f88f00a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f014e280 0x7f88f0148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 -- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f014e660 msgr2=0x7f88f00a7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f014e660 0x7f88f00a7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009ae0 con 0x7f88f0067590 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f5c1e700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00ad0e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f88e000d890 tx=0x7f88e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00125f0 con 0x7f88f0067590 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0012750 con 0x7f88f0067590 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f00aa790 con 0x7f88f0067590 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0012ad0 con 0x7f88f0067590 2023-08-22T00:06:29.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.307+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00aad50 con 0x7f88f0067590 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.308+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88f0068e80 con 0x7f88f0067590 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.308+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f88e0013480 con 0x7f88f0067590 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88e5ffb700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88d405ee10 0x7f88d40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f88e0079f20 con 0x7f88f0067590 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88f541d700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88d405ee10 0x7f88d40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88e5ffb700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7f88d4069660 0x7f88d406bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88d406c180 con 0x7f88d4069660 2023-08-22T00:06:29.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88e007c540 con 0x7f88f0067590 2023-08-22T00:06:29.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88f541d700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88d405ee10 0x7f88d40612d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f88f00682a0 tx=0x7f88ec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.309+0000 7f88f641f700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7f88d4069660 0x7f88d406bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.310+0000 7f88f641f700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7f88d4069660 0x7f88d406bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.310+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== osd.4 v2:172.21.15.118:6816/118777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f88d406c180 con 0x7f88d4069660 2023-08-22T00:06:29.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.324+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 --> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88f00ab200 con 0x7f88d4069660 2023-08-22T00:06:29.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88e5ffb700 1 -- 172.21.15.98:0/197056072 <== osd.4 v2:172.21.15.118:6816/118777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88e800bd60 con 0x7f88d4069660 2023-08-22T00:06:29.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7f88d4069660 msgr2=0x7f88d406bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7f88d4069660 0x7f88d406bb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88d405ee10 msgr2=0x7f88d40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88d405ee10 0x7f88d40612d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f88f00682a0 tx=0x7f88ec009040).stop 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 msgr2=0x7f88f00ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 --2- 172.21.15.98:0/197056072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f0067590 0x7f88f00ad0e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f88e000d890 tx=0x7f88e0008040).stop 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f641f700 1 -- 172.21.15.98:0/197056072 reap_dead start 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 shutdown_connections 2023-08-22T00:06:29.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 >> 172.21.15.98:0/197056072 conn(0x7f88f00c7800 msgr2=0x7f88f0155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 shutdown_connections 2023-08-22T00:06:29.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.325+0000 7f88f7e82700 1 -- 172.21.15.98:0/197056072 wait complete. 2023-08-22T00:06:29.339 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:29.339 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-22T00:06:29.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.456+0000 7fbc5a0c4700 1 Processor -- start 2023-08-22T00:06:29.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.456+0000 7fbc5a0c4700 1 -- start start 2023-08-22T00:06:29.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.456+0000 7fbc5a0c4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc54151890 0x7fbc54151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.456+0000 7fbc5a0c4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc540bcf90 0x7fbc54063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc5a0c4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc540647f0 con 0x7fbc54064390 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc5a0c4700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc540bbef0 con 0x7fbc54151890 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc5a0c4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc540bc1d0 con 0x7fbc540bcf90 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc54151890 0x7fbc54151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc54151890 0x7fbc54151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42990/0 (socket says 172.21.15.98:42990) 2023-08-22T00:06:29.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 -- 172.21.15.98:0/3347756045 learned_addr learned my addr 172.21.15.98:0/3347756045 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc52ffd700 1 --2- 172.21.15.98:0/3347756045 >> v2:172.21.15.118:3300/0 conn(0x7fbc540bcf90 0x7fbc54063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 -- 172.21.15.98:0/3347756045 >> v2:172.21.15.118:3300/0 conn(0x7fbc540bcf90 msgr2=0x7fbc54063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 --2- 172.21.15.98:0/3347756045 >> v2:172.21.15.118:3300/0 conn(0x7fbc540bcf90 0x7fbc54063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 -- 172.21.15.98:0/3347756045 >> v1:172.21.15.118:6789/0 conn(0x7fbc54064390 legacy=0x7fbc540a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 -- 172.21.15.98:0/3347756045 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540bc4b0 con 0x7fbc54151890 2023-08-22T00:06:29.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc537fe700 1 --2- 172.21.15.98:0/3347756045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54151c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbc54069650 tx=0x7fbc440090f0).ready entity=mon.0 client_cookie=997da0a1a785bdd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc527fc700 1 -- 172.21.15.98:0/3347756045 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400b520 con 0x7fbc54151890 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc527fc700 1 -- 172.21.15.98:0/3347756045 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4400b680 con 0x7fbc54151890 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.457+0000 7fbc527fc700 1 -- 172.21.15.98:0/3347756045 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400ba00 con 0x7fbc54151890 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/3347756045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 msgr2=0x7fbc54151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/3347756045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54151c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbc54069650 tx=0x7fbc440090f0).stop 2023-08-22T00:06:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/3347756045 shutdown_connections 2023-08-22T00:06:29.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/3347756045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54151c70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/3347756045 >> v2:172.21.15.118:3300/0 conn(0x7fbc540bcf90 0x7fbc54063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/3347756045 >> 172.21.15.98:0/3347756045 conn(0x7fbc54069680 msgr2=0x7fbc54069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/3347756045 shutdown_connections 2023-08-22T00:06:29.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.458+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/3347756045 wait complete. 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.459+0000 7fbc5a0c4700 1 Processor -- start 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.459+0000 7fbc5a0c4700 1 -- start start 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54064390 0x7fbc540a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc540bcf90 0x7fbc540a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540be170 con 0x7fbc54151890 2023-08-22T00:06:29.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540be450 con 0x7fbc54064390 2023-08-22T00:06:29.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc5a0c4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540be730 con 0x7fbc540bcf90 2023-08-22T00:06:29.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42998/0 (socket says 172.21.15.98:42998) 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 -- 172.21.15.98:0/932267000 learned_addr learned my addr 172.21.15.98:0/932267000 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc537fe700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54064390 0x7fbc540a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc52ffd700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc540bcf90 0x7fbc540a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 -- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc540bcf90 msgr2=0x7fbc540a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc540bcf90 0x7fbc540a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 -- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54064390 msgr2=0x7fbc540a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54064390 0x7fbc540a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44009370 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.460+0000 7fbc53fff700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54152cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fbc4c002230 tx=0x7fbc4c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00e4a0 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00e600 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00e980 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc540bea10 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc540a8ed0 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.461+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc540be5c0 con 0x7fbc54151890 2023-08-22T00:06:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbc4c01b3b0 con 0x7fbc54151890 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3405ede0 0x7fbc340612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fbc4c079710 con 0x7fbc54151890 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc537fe700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3405ede0 0x7fbc340612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7fbc34069630 0x7fbc3406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc3406c150 con 0x7fbc34069630 2023-08-22T00:06:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.462+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc4c07bd30 con 0x7fbc54151890 2023-08-22T00:06:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.463+0000 7fbc52ffd700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7fbc34069630 0x7fbc3406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.463+0000 7fbc537fe700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3405ede0 0x7fbc340612a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbc44009130 tx=0x7fbc44017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.463+0000 7fbc52ffd700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7fbc34069630 0x7fbc3406bad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.464+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== osd.5 v2:172.21.15.118:6817/118771 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fbc3406c150 con 0x7fbc34069630 2023-08-22T00:06:29.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.477+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 --> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc54068320 con 0x7fbc34069630 2023-08-22T00:06:29.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.478+0000 7fbc4b7fe700 1 -- 172.21.15.98:0/932267000 <== osd.5 v2:172.21.15.118:6817/118771 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc54068320 con 0x7fbc34069630 2023-08-22T00:06:29.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.478+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7fbc34069630 msgr2=0x7fbc3406bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.478+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7fbc34069630 0x7fbc3406bad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3405ede0 msgr2=0x7fbc340612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3405ede0 0x7fbc340612a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbc44009130 tx=0x7fbc44017000).stop 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 msgr2=0x7fbc54152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 --2- 172.21.15.98:0/932267000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54151890 0x7fbc54152cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fbc4c002230 tx=0x7fbc4c0015e0).stop 2023-08-22T00:06:29.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc53fff700 1 -- 172.21.15.98:0/932267000 reap_dead start 2023-08-22T00:06:29.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 shutdown_connections 2023-08-22T00:06:29.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 >> 172.21.15.98:0/932267000 conn(0x7fbc54069680 msgr2=0x7fbc540c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 shutdown_connections 2023-08-22T00:06:29.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.479+0000 7fbc5a0c4700 1 -- 172.21.15.98:0/932267000 wait complete. 2023-08-22T00:06:29.493 INFO:teuthology.orchestra.run.smithi098.stdout:55834574855 2023-08-22T00:06:29.493 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-22T00:06:29.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.607+0000 7f6fd3c24700 1 Processor -- start 2023-08-22T00:06:29.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.608+0000 7f6fd3c24700 1 -- start start 2023-08-22T00:06:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.608+0000 7f6fd3c24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fcc153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd3c24700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6fcc0c2eb0 0x7f6fcc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd3c24700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0c40a0 con 0x7f6fcc0ab930 2023-08-22T00:06:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd3c24700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c3490 con 0x7f6fcc0c2eb0 2023-08-22T00:06:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd3c24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c3770 con 0x7f6fcc153b90 2023-08-22T00:06:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd21c1700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6fcc0ab930 0x7f6fcc0be820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47552/0 (socket says 172.21.15.98:47552) 2023-08-22T00:06:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd21c1700 1 -- 172.21.15.98:0/2688928650 learned_addr learned my addr 172.21.15.98:0/2688928650 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fcc153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300250989 0 0) 0x7f6fcc0c40a0 con 0x7f6fcc0ab930 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb80033f0 con 0x7f6fcc0ab930 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd11bf700 1 --2- 172.21.15.98:0/2688928650 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc0c2eb0 0x7f6fcc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416093774 0 0) 0x7f6fb80033f0 con 0x7f6fcc0ab930 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 msgr2=0x7f6fcc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fcc153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc0c2eb0 msgr2=0x7f6fcc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 --2- 172.21.15.98:0/2688928650 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc0c2eb0 0x7f6fcc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0c3a50 con 0x7f6fcc0ab930 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f6fc40017f0 con 0x7f6fcc0ab930 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 >> v1:172.21.15.98:6789/0 conn(0x7f6fcc0ab930 legacy=0x7f6fcc0be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fb80038e0 0x7f6fb8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fb8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb8004b80 0x7f6fb8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c3490 con 0x7f6fb80038e0 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c3770 con 0x7f6fb8004b80 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb800b8e0 con 0x7f6fcc153b90 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fb80038e0 0x7f6fb8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd21c1700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb8004b80 0x7f6fb8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.609+0000 7f6fd11bf700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fb8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 -- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 msgr2=0x7f6fb8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc153b90 0x7f6fb8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 -- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb8004b80 msgr2=0x7f6fb8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb8004b80 0x7f6fb8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 -- 172.21.15.98:0/2688928650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80033f0 con 0x7f6fb80038e0 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fb80038e0 0x7f6fb8003d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6fc0009a80 tx=0x7f6fc0009060).ready entity=mon.0 client_cookie=cd7920f2e0e3427f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0009430 con 0x7f6fb80038e0 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000e640 con 0x7f6fb80038e0 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd09be700 1 -- 172.21.15.98:0/2688928650 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e9c0 con 0x7f6fb80038e0 2023-08-22T00:06:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 -- 172.21.15.98:0/2688928650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fb80038e0 msgr2=0x7f6fb8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 --2- 172.21.15.98:0/2688928650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fb80038e0 0x7f6fb8003d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6fc0009a80 tx=0x7f6fc0009060).stop 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd21c1700 1 -- 172.21.15.98:0/2688928650 reap_dead start 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 -- 172.21.15.98:0/2688928650 shutdown_connections 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 -- 172.21.15.98:0/2688928650 >> 172.21.15.98:0/2688928650 conn(0x7f6fcc0c9350 msgr2=0x7f6fcc0c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 -- 172.21.15.98:0/2688928650 shutdown_connections 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.610+0000 7f6fd3c24700 1 -- 172.21.15.98:0/2688928650 wait complete. 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 Processor -- start 2023-08-22T00:06:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 -- start start 2023-08-22T00:06:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fb80038e0 0x7f6fcc1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 0x7f6fcc154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc154a00 0x7f6fcc1643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc157380 con 0x7f6fcc1436e0 2023-08-22T00:06:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c0040 con 0x7f6fcc154a00 2023-08-22T00:06:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd3c24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c0320 con 0x7f6fb80038e0 2023-08-22T00:06:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd11bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 0x7f6fcc154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd11bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 0x7f6fcc154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43024/0 (socket says 172.21.15.98:43024) 2023-08-22T00:06:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.612+0000 7f6fd11bf700 1 -- 172.21.15.98:0/1307014175 learned_addr learned my addr 172.21.15.98:0/1307014175 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fb80038e0 0x7f6fcc1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd21c1700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc154a00 0x7f6fcc1643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 -- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fb80038e0 msgr2=0x7f6fcc1431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fb80038e0 0x7f6fcc1431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 -- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc154a00 msgr2=0x7f6fcc1643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc154a00 0x7f6fcc1643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc156cc0 con 0x7f6fcc1436e0 2023-08-22T00:06:29.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd21c1700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc154a00 0x7f6fcc1643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:29.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd11bf700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 0x7f6fcc154510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6fc80119f0 tx=0x7f6fc8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800f940 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800faa0 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc156fa0 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800fe20 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.613+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0bfdb0 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.614+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fcc069d50 con 0x7f6fcc1436e0 2023-08-22T00:06:29.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.614+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6fc8014650 con 0x7f6fcc1436e0 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fbdffb700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6fb005ee10 0x7f6fb00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f6fc807a9d0 con 0x7f6fcc1436e0 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6fb005ee10 0x7f6fb00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fbdffb700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7f6fb0069660 0x7f6fb006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fb006c180 con 0x7f6fb0069660 2023-08-22T00:06:29.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fc807f220 con 0x7f6fcc1436e0 2023-08-22T00:06:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fd19c0700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6fb005ee10 0x7f6fb00612d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6fc0006d50 tx=0x7f6fc001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.615+0000 7f6fd21c1700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7f6fb0069660 0x7f6fb006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.616+0000 7f6fd21c1700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7f6fb0069660 0x7f6fb006bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.616+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== osd.6 v2:172.21.15.118:6800/118768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6fb006c180 con 0x7f6fb0069660 2023-08-22T00:06:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.630+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 --> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fcc0c3d30 con 0x7f6fb0069660 2023-08-22T00:06:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fbdffb700 1 -- 172.21.15.98:0/1307014175 <== osd.6 v2:172.21.15.118:6800/118768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fcc0c3d30 con 0x7f6fb0069660 2023-08-22T00:06:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7f6fb0069660 msgr2=0x7f6fb006bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7f6fb0069660 0x7f6fb006bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6fb005ee10 msgr2=0x7f6fb00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6fb005ee10 0x7f6fb00612d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6fc0006d50 tx=0x7f6fc001a000).stop 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 msgr2=0x7f6fcc154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 --2- 172.21.15.98:0/1307014175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fcc1436e0 0x7f6fcc154510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6fc80119f0 tx=0x7f6fc8009060).stop 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd21c1700 1 -- 172.21.15.98:0/1307014175 reap_dead start 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 shutdown_connections 2023-08-22T00:06:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 >> 172.21.15.98:0/1307014175 conn(0x7f6fcc0c9350 msgr2=0x7f6fcc150810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 shutdown_connections 2023-08-22T00:06:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.631+0000 7f6fd3c24700 1 -- 172.21.15.98:0/1307014175 wait complete. 2023-08-22T00:06:29.645 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:29.645 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-22T00:06:29.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.762+0000 7fa5eb75a700 1 Processor -- start 2023-08-22T00:06:29.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.762+0000 7fa5eb75a700 1 -- start start 2023-08-22T00:06:29.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5eb75a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa5e4153f70 0x7fa5e40c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5eb75a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5e40ab930 0x7fa5e40be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5eb75a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e40c40a0 con 0x7fa5e4153b90 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5eb75a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40c3490 con 0x7fa5e4153f70 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5eb75a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40c3770 con 0x7fa5e40ab930 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa5e4153f70 0x7fa5e40c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa5e4153f70 0x7fa5e40c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43026/0 (socket says 172.21.15.98:43026) 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 -- 172.21.15.98:0/4265370849 learned_addr learned my addr 172.21.15.98:0/4265370849 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e9cf7700 1 --2- 172.21.15.98:0/4265370849 >> v2:172.21.15.118:3300/0 conn(0x7fa5e40ab930 0x7fa5e40be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 -- 172.21.15.98:0/4265370849 >> v2:172.21.15.118:3300/0 conn(0x7fa5e40ab930 msgr2=0x7fa5e40be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/4265370849 >> v2:172.21.15.118:3300/0 conn(0x7fa5e40ab930 0x7fa5e40be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 -- 172.21.15.98:0/4265370849 >> v1:172.21.15.118:6789/0 conn(0x7fa5e4153b90 legacy=0x7fa5e40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 -- 172.21.15.98:0/4265370849 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40c3a50 con 0x7fa5e4153f70 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/4265370849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e40c2eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa5e405fc00 tx=0x7fa5d40090f0).ready entity=mon.0 client_cookie=eaca49f96257d198 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5dbfff700 1 -- 172.21.15.98:0/4265370849 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400b600 con 0x7fa5e4153f70 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5dbfff700 1 -- 172.21.15.98:0/4265370849 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400b760 con 0x7fa5e4153f70 2023-08-22T00:06:29.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.763+0000 7fa5dbfff700 1 -- 172.21.15.98:0/4265370849 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400bae0 con 0x7fa5e4153f70 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 -- 172.21.15.98:0/4265370849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 msgr2=0x7fa5e40c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/4265370849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e40c2eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa5e405fc00 tx=0x7fa5d40090f0).stop 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 -- 172.21.15.98:0/4265370849 shutdown_connections 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/4265370849 >> v2:172.21.15.118:3300/0 conn(0x7fa5e40ab930 0x7fa5e40be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/4265370849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e40c2eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 -- 172.21.15.98:0/4265370849 >> 172.21.15.98:0/4265370849 conn(0x7fa5e40c9350 msgr2=0x7fa5e40c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 -- 172.21.15.98:0/4265370849 shutdown_connections 2023-08-22T00:06:29.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.764+0000 7fa5eb75a700 1 -- 172.21.15.98:0/4265370849 wait complete. 2023-08-22T00:06:29.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.766+0000 7fa5eb75a700 1 Processor -- start 2023-08-22T00:06:29.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.766+0000 7fa5eb75a700 1 -- start start 2023-08-22T00:06:29.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ab930 0x7fa5e415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5e4153b90 0x7fa5e413cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e413d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40abd80 con 0x7fa5e4153f70 2023-08-22T00:06:29.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e413d8d0 con 0x7fa5e40ab930 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40acba0 con 0x7fa5e4153b90 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e413d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e413d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43036/0 (socket says 172.21.15.98:43036) 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 -- 172.21.15.98:0/2804329291 learned_addr learned my addr 172.21.15.98:0/2804329291 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5e4153b90 0x7fa5e413cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e94f6700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ab930 0x7fa5e415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 -- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5e4153b90 msgr2=0x7fa5e413cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5e4153b90 0x7fa5e413cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 -- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ab930 msgr2=0x7fa5e415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ab930 0x7fa5e415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009370 con 0x7fa5e4153f70 2023-08-22T00:06:29.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5e4153b90 0x7fa5e413cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:29.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5e9cf7700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e413d3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa5dc009fa0 tx=0x7fa5dc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00ed20 con 0x7fa5e4153f70 2023-08-22T00:06:29.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00ee80 con 0x7fa5e4153f70 2023-08-22T00:06:29.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e40abf90 con 0x7fa5e4153f70 2023-08-22T00:06:29.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc014610 con 0x7fa5e4153f70 2023-08-22T00:06:29.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.767+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e40ac5d0 con 0x7fa5e4153f70 2023-08-22T00:06:29.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.768+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5e4069d50 con 0x7fa5e4153f70 2023-08-22T00:06:29.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa5dc01d3b0 con 0x7fa5e4153f70 2023-08-22T00:06:29.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5c805ee10 0x7fa5c80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa5dc07a710 con 0x7fa5e4153f70 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5e94f6700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5c805ee10 0x7fa5c80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7fa5c8069660 0x7fa5c806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5c806c180 con 0x7fa5c8069660 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5dc07cd30 con 0x7fa5e4153f70 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7fa5c8069660 0x7fa5c806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.769+0000 7fa5e94f6700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5c805ee10 0x7fa5c80612d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa5e00036d0 tx=0x7fa5e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.770+0000 7fa5e8cf5700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7fa5c8069660 0x7fa5c806bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.770+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== osd.7 v2:172.21.15.118:6808/118770 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa5c806c180 con 0x7fa5c8069660 2023-08-22T00:06:29.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.784+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 --> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5e40ac8f0 con 0x7fa5c8069660 2023-08-22T00:06:29.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5d97fa700 1 -- 172.21.15.98:0/2804329291 <== osd.7 v2:172.21.15.118:6808/118770 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5e40ac8f0 con 0x7fa5c8069660 2023-08-22T00:06:29.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7fa5c8069660 msgr2=0x7fa5c806bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7fa5c8069660 0x7fa5c806bb00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5c805ee10 msgr2=0x7fa5c80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa5c805ee10 0x7fa5c80612d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa5e00036d0 tx=0x7fa5e0009040).stop 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 msgr2=0x7fa5e413d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5eb75a700 1 --2- 172.21.15.98:0/2804329291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5e4153f70 0x7fa5e413d3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa5dc009fa0 tx=0x7fa5dc009900).stop 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.785+0000 7fa5e9cf7700 1 -- 172.21.15.98:0/2804329291 reap_dead start 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.786+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 shutdown_connections 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.786+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 >> 172.21.15.98:0/2804329291 conn(0x7fa5e40c9350 msgr2=0x7fa5e40c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.786+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 shutdown_connections 2023-08-22T00:06:29.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.786+0000 7fa5eb75a700 1 -- 172.21.15.98:0/2804329291 wait complete. 2023-08-22T00:06:29.798 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:29.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-22T00:06:29.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.915+0000 7f5803d03700 1 Processor -- start 2023-08-22T00:06:29.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.915+0000 7f5803d03700 1 -- start start 2023-08-22T00:06:29.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5803d03700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f57fc0a6800 0x7f57fc0a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5803d03700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c4b90 0x7f57fc0675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5803d03700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc0c4700 con 0x7f57fc0c5010 2023-08-22T00:06:29.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5803d03700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc0c8740 con 0x7f57fc0a6800 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5803d03700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0c8460 con 0x7f57fc0c4b90 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5801a9f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f57fc0a6800 0x7f57fc0a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f58022a0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f57fc0c5010 0x7f57fc067ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:47566/0 (socket says 172.21.15.98:47566) 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f58022a0700 1 -- 172.21.15.98:0/3438106726 learned_addr learned my addr 172.21.15.98:0/3438106726 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f580129e700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c4b90 0x7f57fc0675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5801a9f700 1 -- 172.21.15.98:0/3438106726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c4b90 msgr2=0x7f57fc0675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:29.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5801a9f700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c4b90 0x7f57fc0675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5801a9f700 1 -- 172.21.15.98:0/3438106726 >> v1:172.21.15.98:6789/0 conn(0x7f57fc0c5010 legacy=0x7f57fc067ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5801a9f700 1 -- 172.21.15.98:0/3438106726 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc0c40b0 con 0x7f57fc0a6800 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.916+0000 7f5800a9d700 1 -- 172.21.15.98:0/3438106726 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459235144 0 0) 0x7f57fc0c4700 con 0x7f57fc0c5010 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5801a9f700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0a6800 0x7f57fc0a6be0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f57f0009760 tx=0x7f57f0009060).ready entity=mon.0 client_cookie=d62f6153288348d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5800a9d700 1 -- 172.21.15.98:0/3438106726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f000b580 con 0x7f57fc0a6800 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5800a9d700 1 -- 172.21.15.98:0/3438106726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f000b6e0 con 0x7f57fc0a6800 2023-08-22T00:06:29.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5800a9d700 1 -- 172.21.15.98:0/3438106726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ba60 con 0x7f57fc0a6800 2023-08-22T00:06:29.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 -- 172.21.15.98:0/3438106726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0a6800 msgr2=0x7f57fc0a6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0a6800 0x7f57fc0a6be0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f57f0009760 tx=0x7f57f0009060).stop 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 -- 172.21.15.98:0/3438106726 shutdown_connections 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0a6800 0x7f57fc0a6be0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 --2- 172.21.15.98:0/3438106726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c4b90 0x7f57fc0675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 -- 172.21.15.98:0/3438106726 >> 172.21.15.98:0/3438106726 conn(0x7f57fc0aa8c0 msgr2=0x7f57fc0aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 -- 172.21.15.98:0/3438106726 shutdown_connections 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.917+0000 7f5803d03700 1 -- 172.21.15.98:0/3438106726 wait complete. 2023-08-22T00:06:29.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.918+0000 7f5803d03700 1 Processor -- start 2023-08-22T00:06:29.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.918+0000 7f5803d03700 1 -- start start 2023-08-22T00:06:29.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57fc0a6800 0x7f57fc0c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c5010 0x7f57fc0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0be8e0 con 0x7f57fc0c4b90 2023-08-22T00:06:29.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0bf420 con 0x7f57fc0a6800 2023-08-22T00:06:29.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5803d03700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0beaf0 con 0x7f57fc0c5010 2023-08-22T00:06:29.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f580129e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f580129e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43044/0 (socket says 172.21.15.98:43044) 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f580129e700 1 -- 172.21.15.98:0/2471546604 learned_addr learned my addr 172.21.15.98:0/2471546604 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f58022a0700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c5010 0x7f57fc0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.919+0000 7f5801a9f700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57fc0a6800 0x7f57fc0c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 -- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c5010 msgr2=0x7f57fc0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c5010 0x7f57fc0a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 -- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57fc0a6800 msgr2=0x7f57fc0c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57fc0a6800 0x7f57fc0c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:29.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 -- 172.21.15.98:0/2471546604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00092a0 con 0x7f57fc0c4b90 2023-08-22T00:06:29.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f580129e700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f57f800d860 tx=0x7f57f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8011590 con 0x7f57fc0c4b90 2023-08-22T00:06:29.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f80116f0 con 0x7f57fc0c4b90 2023-08-22T00:06:29.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0bedd0 con 0x7f57fc0c4b90 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8011a70 con 0x7f57fc0c4b90 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.920+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc147b00 con 0x7f57fc0c4b90 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.921+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc0bf5b0 con 0x7f57fc0c4b90 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.921+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f57f801c460 con 0x7f57fc0c4b90 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.921+0000 7f57edffb700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 0x7f57e00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:29.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.922+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f57f807a120 con 0x7f57fc0c4b90 2023-08-22T00:06:29.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.922+0000 7f5801a9f700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 0x7f57e00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:29.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.922+0000 7f5801a9f700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 0x7f57e00612d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f57f000b340 tx=0x7f57f0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:29.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:29.926+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57f804b220 con 0x7f57fc0c4b90 2023-08-22T00:06:30.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.089+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57fc0c5440 con 0x7f57fc0c4b90 2023-08-22T00:06:30.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.089+0000 7f57edffb700 1 -- 172.21.15.98:0/2471546604 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57f804e840 con 0x7f57fc0c4b90 2023-08-22T00:06:30.094 INFO:teuthology.orchestra.run.smithi098.stdout:55834574855 2023-08-22T00:06:30.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 msgr2=0x7f57e00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 0x7f57e00612d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f57f000b340 tx=0x7f57f0017000).stop 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 msgr2=0x7f57fc147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f57f800d860 tx=0x7f57f8008040).stop 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 shutdown_connections 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e005ee10 0x7f57e00612d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57fc0c5010 0x7f57fc0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:30.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57fc0a6800 0x7f57fc0c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:30.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 --2- 172.21.15.98:0/2471546604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57fc0c4b90 0x7f57fc147610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:30.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 >> 172.21.15.98:0/2471546604 conn(0x7f57fc0aa8c0 msgr2=0x7f57fc153710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:30.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 shutdown_connections 2023-08-22T00:06:30.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:30.091+0000 7f5803d03700 1 -- 172.21.15.98:0/2471546604 wait complete. 2023-08-22T00:06:30.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-08-22T00:06:31.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-22T00:06:31.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.234+0000 7f6c8dd59700 1 Processor -- start 2023-08-22T00:06:31.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.234+0000 7f6c8dd59700 1 -- start start 2023-08-22T00:06:31.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c8dd59700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6c88150750 0x7f6c88150b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c8dd59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c880bdec0 0x7f6c880c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c8dd59700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c88067590 con 0x7f6c88065870 2023-08-22T00:06:31.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c8dd59700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c88067870 con 0x7f6c88150750 2023-08-22T00:06:31.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c8dd59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88067b50 con 0x7f6c880bdec0 2023-08-22T00:06:31.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c877fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6c88150750 0x7f6c88150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c877fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6c88150750 0x7f6c88150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35472/0 (socket says 172.21.15.98:35472) 2023-08-22T00:06:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c877fe700 1 -- 172.21.15.98:0/1005521947 learned_addr learned my addr 172.21.15.98:0/1005521947 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c87fff700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c880bdec0 0x7f6c880c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c877fe700 1 -- 172.21.15.98:0/1005521947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c880bdec0 msgr2=0x7f6c880c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.235+0000 7f6c877fe700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c880bdec0 0x7f6c880c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c877fe700 1 -- 172.21.15.98:0/1005521947 >> v1:172.21.15.118:6789/0 conn(0x7f6c88065870 legacy=0x7f6c880a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c877fe700 1 -- 172.21.15.98:0/1005521947 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88067e30 con 0x7f6c88150750 2023-08-22T00:06:31.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c877fe700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c88150b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6c7c006fd0 tx=0x7f6c7c0090f0).ready entity=mon.0 client_cookie=27c9f14bd6da0e6f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c867fc700 1 -- 172.21.15.98:0/1005521947 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00b580 con 0x7f6c88150750 2023-08-22T00:06:31.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c867fc700 1 -- 172.21.15.98:0/1005521947 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00b6e0 con 0x7f6c88150750 2023-08-22T00:06:31.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c867fc700 1 -- 172.21.15.98:0/1005521947 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00ba60 con 0x7f6c88150750 2023-08-22T00:06:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 -- 172.21.15.98:0/1005521947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 msgr2=0x7f6c88150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c88150b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6c7c006fd0 tx=0x7f6c7c0090f0).stop 2023-08-22T00:06:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 -- 172.21.15.98:0/1005521947 shutdown_connections 2023-08-22T00:06:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c880bdec0 0x7f6c880c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/1005521947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c88150b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 -- 172.21.15.98:0/1005521947 >> 172.21.15.98:0/1005521947 conn(0x7f6c880c7800 msgr2=0x7f6c880c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 -- 172.21.15.98:0/1005521947 shutdown_connections 2023-08-22T00:06:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.236+0000 7f6c8dd59700 1 -- 172.21.15.98:0/1005521947 wait complete. 2023-08-22T00:06:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.238+0000 7f6c8dd59700 1 Processor -- start 2023-08-22T00:06:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.238+0000 7f6c8dd59700 1 -- start start 2023-08-22T00:06:31.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.238+0000 7f6c8dd59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c88065870 0x7f6c880c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.238+0000 7f6c8dd59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 0x7f6c880a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c6060 con 0x7f6c88150750 2023-08-22T00:06:31.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c6240 con 0x7f6c880bdec0 2023-08-22T00:06:31.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c6520 con 0x7f6c88065870 2023-08-22T00:06:31.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35480/0 (socket says 172.21.15.98:35480) 2023-08-22T00:06:31.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 -- 172.21.15.98:0/2536304687 learned_addr learned my addr 172.21.15.98:0/2536304687 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:31.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c86ffd700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 0x7f6c880a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c877fe700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c88065870 0x7f6c880c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 -- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c88065870 msgr2=0x7f6c880c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c88065870 0x7f6c880c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 -- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 msgr2=0x7f6c880a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 0x7f6c880a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 -- 172.21.15.98:0/2536304687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c009370 con 0x7f6c88150750 2023-08-22T00:06:31.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c86ffd700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 0x7f6c880a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:31.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c87fff700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6c80009e90 tx=0x7f6c8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000cc20 con 0x7f6c88150750 2023-08-22T00:06:31.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000f040 con 0x7f6c88150750 2023-08-22T00:06:31.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c880a43f0 con 0x7f6c88150750 2023-08-22T00:06:31.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80013400 con 0x7f6c88150750 2023-08-22T00:06:31.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.239+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880a4ad0 con 0x7f6c88150750 2023-08-22T00:06:31.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.240+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88068e80 con 0x7f6c88150750 2023-08-22T00:06:31.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.241+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6c800137b0 con 0x7f6c88150750 2023-08-22T00:06:31.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.241+0000 7f6c6f7fe700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 0x7f6c740612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.241+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f6c8007aa50 con 0x7f6c88150750 2023-08-22T00:06:31.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.241+0000 7f6c877fe700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 0x7f6c740612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.241+0000 7f6c877fe700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 0x7f6c740612a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6c7c009fd0 tx=0x7f6c7c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.245+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c8004bbb0 con 0x7f6c88150750 2023-08-22T00:06:31.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.410+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c880be320 con 0x7f6c88150750 2023-08-22T00:06:31.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.410+0000 7f6c6f7fe700 1 -- 172.21.15.98:0/2536304687 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c8004f1d0 con 0x7f6c88150750 2023-08-22T00:06:31.418 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:31.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 msgr2=0x7f6c740612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 0x7f6c740612a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6c7c009fd0 tx=0x7f6c7c017000).stop 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 msgr2=0x7f6c8814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6c80009e90 tx=0x7f6c8000b040).stop 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 shutdown_connections 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c7405ede0 0x7f6c740612a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c88065870 0x7f6c880c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88150750 0x7f6c8814dd80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 --2- 172.21.15.98:0/2536304687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c880bdec0 0x7f6c880a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 >> 172.21.15.98:0/2536304687 conn(0x7f6c880c7800 msgr2=0x7f6c880a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:31.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 shutdown_connections 2023-08-22T00:06:31.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.412+0000 7f6c8dd59700 1 -- 172.21.15.98:0/2536304687 wait complete. 2023-08-22T00:06:31.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-08-22T00:06:31.425 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-22T00:06:31.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.540+0000 7f034b145700 1 Processor -- start 2023-08-22T00:06:31.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.540+0000 7f034b145700 1 -- start start 2023-08-22T00:06:31.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.541+0000 7f034b145700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f03440a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.541+0000 7f034b145700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440a4d90 con 0x7f0344153f70 2023-08-22T00:06:31.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.541+0000 7f034b145700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440c1910 con 0x7f03440c2c40 2023-08-22T00:06:31.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.541+0000 7f034b145700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440654c0 con 0x7f0344153b90 2023-08-22T00:06:31.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0343fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0344153f70 0x7f03440c2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54836/0 (socket says 172.21.15.98:54836) 2023-08-22T00:06:31.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0343fff700 1 -- 172.21.15.98:0/3203060531 learned_addr learned my addr 172.21.15.98:0/3203060531 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0348ee1700 1 --2- 172.21.15.98:0/3203060531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f03440a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840849454 0 0) 0x7f03440a4d90 con 0x7f0344153f70 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03340033f0 con 0x7f0344153f70 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698031272 0 0) 0x7f03340033f0 con 0x7f0344153f70 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0348ee1700 1 -- 172.21.15.98:0/3203060531 >> v1:172.21.15.118:6789/0 conn(0x7f03440c2c40 legacy=0x7f0344063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0348ee1700 1 -- 172.21.15.98:0/3203060531 >> v1:172.21.15.98:6789/0 conn(0x7f0344153f70 legacy=0x7f03440c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0348ee1700 1 -- 172.21.15.98:0/3203060531 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440657a0 con 0x7f0344153b90 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f0348ee1700 1 --2- 172.21.15.98:0/3203060531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f03440a48a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0338009790 tx=0x7f0338009060).ready entity=mon.2 client_cookie=e212dae77f7b7773 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0330001470 con 0x7f0344153b90 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338012410 con 0x7f0344153b90 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.542+0000 7f03437fe700 1 -- 172.21.15.98:0/3203060531 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338012790 con 0x7f0344153b90 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 -- 172.21.15.98:0/3203060531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 msgr2=0x7f03440a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 --2- 172.21.15.98:0/3203060531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f03440a48a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0338009790 tx=0x7f0338009060).stop 2023-08-22T00:06:31.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 -- 172.21.15.98:0/3203060531 shutdown_connections 2023-08-22T00:06:31.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 --2- 172.21.15.98:0/3203060531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f03440a48a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 -- 172.21.15.98:0/3203060531 >> 172.21.15.98:0/3203060531 conn(0x7f0344069630 msgr2=0x7f0344069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:31.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 -- 172.21.15.98:0/3203060531 shutdown_connections 2023-08-22T00:06:31.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.543+0000 7f034b145700 1 -- 172.21.15.98:0/3203060531 wait complete. 2023-08-22T00:06:31.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.544+0000 7f034b145700 1 Processor -- start 2023-08-22T00:06:31.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 -- start start 2023-08-22T00:06:31.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f0344167be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 0x7f03440c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034414c680 con 0x7f03440c2c40 2023-08-22T00:06:31.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034414c330 con 0x7f03440a8f00 2023-08-22T00:06:31.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f034b145700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03441680d0 con 0x7f0344153b90 2023-08-22T00:06:31.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.545+0000 7f0348ee1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35490/0 (socket says 172.21.15.98:35490) 2023-08-22T00:06:31.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 -- 172.21.15.98:0/2582068590 learned_addr learned my addr 172.21.15.98:0/2582068590 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:31.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0343fff700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f0344167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f03496e2700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 0x7f03440c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 -- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 msgr2=0x7f0344167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f0344167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 -- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 msgr2=0x7f03440c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 0x7f03440c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 -- 172.21.15.98:0/2582068590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380092a0 con 0x7f03440c2c40 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0343fff700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f0344167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f03496e2700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 0x7f03440c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0348ee1700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0338009e30 tx=0x7f0338009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011a70 con 0x7f03440c2c40 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338011bd0 con 0x7f03440c2c40 2023-08-22T00:06:31.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03441683a0 con 0x7f03440c2c40 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033801d3f0 con 0x7f03440c2c40 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.546+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344168960 con 0x7f03440c2c40 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.547+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03440685b0 con 0x7f03440c2c40 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.547+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f033801d7e0 con 0x7f03440c2c40 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.548+0000 7f0340ff9700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 0x7f03280612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.548+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f033807bbe0 con 0x7f03440c2c40 2023-08-22T00:06:31.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.548+0000 7f0343fff700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 0x7f03280612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.548+0000 7f0343fff700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 0x7f03280612d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0344150b50 tx=0x7f03300014d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.552+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f033804cd40 con 0x7f03440c2c40 2023-08-22T00:06:31.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.713+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f03440685b0 con 0x7f03440c2c40 2023-08-22T00:06:31.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.713+0000 7f0340ff9700 1 -- 172.21.15.98:0/2582068590 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0338050360 con 0x7f03440c2c40 2023-08-22T00:06:31.715 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:31.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.714+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 msgr2=0x7f03280612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 0x7f03280612d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0344150b50 tx=0x7f03300014d0).stop 2023-08-22T00:06:31.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 msgr2=0x7f03440bebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0338009e30 tx=0x7f0338009060).stop 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 shutdown_connections 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03440a8f00 0x7f03440c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03440c2c40 0x7f03440bebd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f032805ee10 0x7f03280612d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 --2- 172.21.15.98:0/2582068590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0344153b90 0x7f0344167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 >> 172.21.15.98:0/2582068590 conn(0x7f0344069630 msgr2=0x7f03440bbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 shutdown_connections 2023-08-22T00:06:31.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.715+0000 7f034b145700 1 -- 172.21.15.98:0/2582068590 wait complete. 2023-08-22T00:06:31.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-08-22T00:06:31.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-22T00:06:31.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.854+0000 7f95d9068700 1 Processor -- start 2023-08-22T00:06:31.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.854+0000 7f95d9068700 1 -- start start 2023-08-22T00:06:31.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95d4153b90 0x7f95d40a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d4153f70 0x7f95d40c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 0x7f95d4063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40a4d90 con 0x7f95d4153b90 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40c1910 con 0x7f95d40c2a20 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d9068700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40c2e90 con 0x7f95d4153f70 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95d4153b90 0x7f95d40a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95d4153b90 0x7f95d40a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35492/0 (socket says 172.21.15.98:35492) 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d2d9d700 1 -- 172.21.15.98:0/785645502 learned_addr learned my addr 172.21.15.98:0/785645502 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:31.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d259c700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d4153f70 0x7f95d40c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.855+0000 7f95d359e700 1 --2- 172.21.15.98:0/785645502 >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 0x7f95d4063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 -- 172.21.15.98:0/785645502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d4153f70 msgr2=0x7f95d40c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d4153f70 0x7f95d40c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 -- 172.21.15.98:0/785645502 >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 msgr2=0x7f95d4063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/785645502 >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 0x7f95d4063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 -- 172.21.15.98:0/785645502 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40654c0 con 0x7f95d4153b90 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d359e700 1 --2- 172.21.15.98:0/785645502 >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 0x7f95d4063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:31.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d4153b90 0x7f95d40a48a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95d41589d0 tx=0x7f95c80090f0).ready entity=mon.0 client_cookie=566415ae3007ad9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d1d9b700 1 -- 172.21.15.98:0/785645502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800b520 con 0x7f95d4153b90 2023-08-22T00:06:31.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d1d9b700 1 -- 172.21.15.98:0/785645502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800b680 con 0x7f95d4153b90 2023-08-22T00:06:31.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d1d9b700 1 -- 172.21.15.98:0/785645502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800ba00 con 0x7f95d4153b90 2023-08-22T00:06:31.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 -- 172.21.15.98:0/785645502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d4153b90 msgr2=0x7f95d40a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d4153b90 0x7f95d40a48a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95d41589d0 tx=0x7f95c80090f0).stop 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 -- 172.21.15.98:0/785645502 shutdown_connections 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 --2- 172.21.15.98:0/785645502 >> v2:172.21.15.118:3300/0 conn(0x7f95d40c2a20 0x7f95d4063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d4153b90 0x7f95d40a48a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 --2- 172.21.15.98:0/785645502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d4153f70 0x7f95d40c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 -- 172.21.15.98:0/785645502 >> 172.21.15.98:0/785645502 conn(0x7f95d4069630 msgr2=0x7f95d4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:31.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 -- 172.21.15.98:0/785645502 shutdown_connections 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.856+0000 7f95d9068700 1 -- 172.21.15.98:0/785645502 wait complete. 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 Processor -- start 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 -- start start 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95d4153b90 0x7f95d4150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d40a7ee0 0x7f95d40a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40a9290 con 0x7f95d40c2a20 2023-08-22T00:06:31.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4150570 con 0x7f95d4153b90 2023-08-22T00:06:31.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d9068700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40a8680 con 0x7f95d40a7ee0 2023-08-22T00:06:31.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35496/0 (socket says 172.21.15.98:35496) 2023-08-22T00:06:31.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.858+0000 7f95d2d9d700 1 -- 172.21.15.98:0/3966229283 learned_addr learned my addr 172.21.15.98:0/3966229283 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d359e700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d40a7ee0 0x7f95d40a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d259c700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95d4153b90 0x7f95d4150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 -- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d40a7ee0 msgr2=0x7f95d40a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d40a7ee0 0x7f95d40a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 -- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95d4153b90 msgr2=0x7f95d4150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95d4153b90 0x7f95d4150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 -- 172.21.15.98:0/3966229283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8009370 con 0x7f95d40c2a20 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d2d9d700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f95d4064b70 tx=0x7f95c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8000bc0 con 0x7f95d40c2a20 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800b7f0 con 0x7f95d40c2a20 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d40a8960 con 0x7f95d40c2a20 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8000d20 con 0x7f95d40c2a20 2023-08-22T00:06:31.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.859+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d40a8f20 con 0x7f95d40c2a20 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.860+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d40a90e0 con 0x7f95d40c2a20 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.860+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f95c801c8c0 con 0x7f95d40c2a20 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.861+0000 7f95baffd700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 0x7f95c00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.861+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f95c807bd70 con 0x7f95d40c2a20 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.861+0000 7f95d259c700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 0x7f95c00612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:31.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.861+0000 7f95d259c700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 0x7f95c00612a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f95c4009270 tx=0x7f95c4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:31.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:31.865+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95c804ced0 con 0x7f95d40c2a20 2023-08-22T00:06:32.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.025+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95d40657a0 con 0x7f95d40c2a20 2023-08-22T00:06:32.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.025+0000 7f95baffd700 1 -- 172.21.15.98:0/3966229283 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95c802a070 con 0x7f95d40c2a20 2023-08-22T00:06:32.028 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 msgr2=0x7f95c00612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 0x7f95c00612a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f95c4009270 tx=0x7f95c4008040).stop 2023-08-22T00:06:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 msgr2=0x7f95d40bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f95d4064b70 tx=0x7f95c8017000).stop 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 shutdown_connections 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f95c005ede0 0x7f95c00612a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95d40a7ee0 0x7f95d40a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95d40c2a20 0x7f95d40bfc10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 --2- 172.21.15.98:0/3966229283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95d4153b90 0x7f95d4150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 >> 172.21.15.98:0/3966229283 conn(0x7f95d4069630 msgr2=0x7f95d4069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 shutdown_connections 2023-08-22T00:06:32.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.027+0000 7f95d9068700 1 -- 172.21.15.98:0/3966229283 wait complete. 2023-08-22T00:06:32.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-08-22T00:06:32.052 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-22T00:06:32.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.172+0000 7fa67386c700 1 Processor -- start 2023-08-22T00:06:32.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.172+0000 7fa67386c700 1 -- start start 2023-08-22T00:06:32.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa67386c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa66c14e280 0x7fa66c0654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa67386c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c065050 con 0x7fa66c067590 2023-08-22T00:06:32.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa67386c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0be650 con 0x7fa66c14e660 2023-08-22T00:06:32.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa67386c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c064440 con 0x7fa66c14e280 2023-08-22T00:06:32.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa671608700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa66c14e280 0x7fa66c0654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa671e09700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa66c067590 0x7fa66c0679b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54838/0 (socket says 172.21.15.98:54838) 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.173+0000 7fa671e09700 1 -- 172.21.15.98:0/824751490 learned_addr learned my addr 172.21.15.98:0/824751490 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa671608700 1 -- 172.21.15.98:0/824751490 >> v1:172.21.15.118:6789/0 conn(0x7fa66c14e660 legacy=0x7fa66c0bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa671608700 1 -- 172.21.15.98:0/824751490 >> v1:172.21.15.98:6789/0 conn(0x7fa66c067590 legacy=0x7fa66c0679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa663fff700 1 -- 172.21.15.98:0/824751490 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573159291 0 0) 0x7fa66c065050 con 0x7fa66c067590 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa671608700 1 -- 172.21.15.98:0/824751490 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c064720 con 0x7fa66c14e280 2023-08-22T00:06:32.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa671608700 1 --2- 172.21.15.98:0/824751490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e280 0x7fa66c0654e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa65c009760 tx=0x7fa65c009060).ready entity=mon.0 client_cookie=bf75019cb7a89ff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa663fff700 1 -- 172.21.15.98:0/824751490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00b520 con 0x7fa66c14e280 2023-08-22T00:06:32.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa663fff700 1 -- 172.21.15.98:0/824751490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00b680 con 0x7fa66c14e280 2023-08-22T00:06:32.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa663fff700 1 -- 172.21.15.98:0/824751490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ba00 con 0x7fa66c14e280 2023-08-22T00:06:32.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa67386c700 1 -- 172.21.15.98:0/824751490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e280 msgr2=0x7fa66c0654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.174+0000 7fa67386c700 1 --2- 172.21.15.98:0/824751490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e280 0x7fa66c0654e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa65c009760 tx=0x7fa65c009060).stop 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.175+0000 7fa67386c700 1 -- 172.21.15.98:0/824751490 shutdown_connections 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.175+0000 7fa67386c700 1 --2- 172.21.15.98:0/824751490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e280 0x7fa66c0654e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.175+0000 7fa67386c700 1 -- 172.21.15.98:0/824751490 >> 172.21.15.98:0/824751490 conn(0x7fa66c0c7800 msgr2=0x7fa66c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.175+0000 7fa67386c700 1 -- 172.21.15.98:0/824751490 shutdown_connections 2023-08-22T00:06:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.175+0000 7fa67386c700 1 -- 172.21.15.98:0/824751490 wait complete. 2023-08-22T00:06:32.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.176+0000 7fa67386c700 1 Processor -- start 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.176+0000 7fa67386c700 1 -- start start 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 0x7fa66c0a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa66c14e280 0x7fa66c164340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c149ed0 con 0x7fa66c14e660 2023-08-22T00:06:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0aab80 con 0x7fa66c067590 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0aa850 con 0x7fa66c14e280 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35504/0 (socket says 172.21.15.98:35504) 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 -- 172.21.15.98:0/92441594 learned_addr learned my addr 172.21.15.98:0/92441594 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671608700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 0x7fa66c0a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa670e07700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa66c14e280 0x7fa66c164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 -- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa66c14e280 msgr2=0x7fa66c164340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa66c14e280 0x7fa66c164340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 -- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 msgr2=0x7fa66c0a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 0x7fa66c0a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 -- 172.21.15.98:0/92441594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0092a0 con 0x7fa66c14e660 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671608700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 0x7fa66c0a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa671e09700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fa66400c810 tx=0x7fa6640014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664005d30 con 0x7fa66c14e660 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664005e90 con 0x7fa66c14e660 2023-08-22T00:06:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c164cf0 con 0x7fa66c14e660 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664007320 con 0x7fa66c14e660 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.177+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c1652b0 con 0x7fa66c14e660 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.178+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0aad10 con 0x7fa66c14e660 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.179+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa664007710 con 0x7fa66c14e660 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.179+0000 7fa6617fa700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 0x7fa6500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.179+0000 7fa671608700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 0x7fa6500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.179+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa664079fb0 con 0x7fa66c14e660 2023-08-22T00:06:32.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.180+0000 7fa671608700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 0x7fa6500612d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa66c1541a0 tx=0x7fa65c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.183+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa66404b110 con 0x7fa66c14e660 2023-08-22T00:06:32.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.354+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa66c068e80 con 0x7fa66c14e660 2023-08-22T00:06:32.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.354+0000 7fa6617fa700 1 -- 172.21.15.98:0/92441594 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa66404e730 con 0x7fa66c14e660 2023-08-22T00:06:32.360 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:32.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 msgr2=0x7fa6500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 0x7fa6500612d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa66c1541a0 tx=0x7fa65c017000).stop 2023-08-22T00:06:32.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 msgr2=0x7fa66c14bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fa66400c810 tx=0x7fa6640014d0).stop 2023-08-22T00:06:32.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 shutdown_connections 2023-08-22T00:06:32.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c14e660 0x7fa66c14bf80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa66c067590 0x7fa66c0a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa65005ee10 0x7fa6500612d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 --2- 172.21.15.98:0/92441594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa66c14e280 0x7fa66c164340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 >> 172.21.15.98:0/92441594 conn(0x7fa66c0c7800 msgr2=0x7fa66c14a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 shutdown_connections 2023-08-22T00:06:32.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.356+0000 7fa67386c700 1 -- 172.21.15.98:0/92441594 wait complete. 2023-08-22T00:06:32.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2023-08-22T00:06:32.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-22T00:06:32.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.486+0000 7f3c995fd700 1 Processor -- start 2023-08-22T00:06:32.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.487+0000 7f3c995fd700 1 -- start start 2023-08-22T00:06:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.487+0000 7f3c995fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c94153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.487+0000 7f3c995fd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940c1800 con 0x7f3c940aa1e0 2023-08-22T00:06:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.487+0000 7f3c995fd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940c0bf0 con 0x7f3c94153a60 2023-08-22T00:06:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.487+0000 7f3c995fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c0ed0 con 0x7f3c940c6210 2023-08-22T00:06:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c927fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3c940aa1e0 0x7f3c940c5b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54852/0 (socket says 172.21.15.98:54852) 2023-08-22T00:06:32.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c927fc700 1 -- 172.21.15.98:0/276061488 learned_addr learned my addr 172.21.15.98:0/276061488 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:32.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c937fe700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c94153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694887737 0 0) 0x7f3c940c1800 con 0x7f3c940aa1e0 2023-08-22T00:06:32.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c800033f0 con 0x7f3c940aa1e0 2023-08-22T00:06:32.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674232398 0 0) 0x7f3c800033f0 con 0x7f3c940aa1e0 2023-08-22T00:06:32.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 msgr2=0x7f3c94153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c94153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 >> v1:172.21.15.118:6789/0 conn(0x7f3c94153a60 legacy=0x7f3c940a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940c11b0 con 0x7f3c940aa1e0 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3c84001470 con 0x7f3c940aa1e0 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 >> v1:172.21.15.98:6789/0 conn(0x7f3c940aa1e0 legacy=0x7f3c940c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c80003910 0x7f3c80003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c80004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c80004b80 0x7f3c80005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c0ed0 con 0x7f3c80003910 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8000b910 con 0x7f3c80004b80 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8000bad0 con 0x7f3c940c6210 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c80003910 0x7f3c80003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c937fe700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c80004b80 0x7f3c80005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c927fc700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c80004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c92ffd700 1 -- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 msgr2=0x7f3c80004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c80004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c92ffd700 1 -- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c80004b80 msgr2=0x7f3c80005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.488+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c80004b80 0x7f3c80005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c92ffd700 1 -- 172.21.15.98:0/276061488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800033f0 con 0x7f3c80003910 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c927fc700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c940c6210 0x7f3c80004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c937fe700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c80004b80 0x7f3c80005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c80003910 0x7f3c80003d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3c7c001730 tx=0x7f3c7c007bb0).ready entity=mon.0 client_cookie=2f20f27c7b9c8121 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007020 con 0x7f3c80003910 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c007180 con 0x7f3c80003910 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c91ffb700 1 -- 172.21.15.98:0/276061488 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007500 con 0x7f3c80003910 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 -- 172.21.15.98:0/276061488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c80003910 msgr2=0x7f3c80003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 --2- 172.21.15.98:0/276061488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c80003910 0x7f3c80003d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3c7c001730 tx=0x7f3c7c007bb0).stop 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c937fe700 1 -- 172.21.15.98:0/276061488 reap_dead start 2023-08-22T00:06:32.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 -- 172.21.15.98:0/276061488 shutdown_connections 2023-08-22T00:06:32.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 -- 172.21.15.98:0/276061488 >> 172.21.15.98:0/276061488 conn(0x7f3c940650f0 msgr2=0x7f3c940cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 -- 172.21.15.98:0/276061488 shutdown_connections 2023-08-22T00:06:32.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.489+0000 7f3c995fd700 1 -- 172.21.15.98:0/276061488 wait complete. 2023-08-22T00:06:32.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.490+0000 7f3c995fd700 1 Processor -- start 2023-08-22T00:06:32.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 -- start start 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 0x7f3c941521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c9413d1d0 0x7f3c940aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9414fd50 con 0x7f3c94152690 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c941508d0 con 0x7f3c9413d1d0 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c995fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9413d630 con 0x7f3c80003910 2023-08-22T00:06:32.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c927fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c927fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35524/0 (socket says 172.21.15.98:35524) 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.491+0000 7f3c927fc700 1 -- 172.21.15.98:0/64053166 learned_addr learned my addr 172.21.15.98:0/64053166 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 0x7f3c941521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c937fe700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c9413d1d0 0x7f3c940aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 -- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 msgr2=0x7f3c941521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 0x7f3c941521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 -- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c9413d1d0 msgr2=0x7f3c940aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c9413d1d0 0x7f3c940aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 -- 172.21.15.98:0/64053166 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9414ffa0 con 0x7f3c94152690 2023-08-22T00:06:32.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 0x7f3c941521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c927fc700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3c84004710 tx=0x7f3c84000f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84010520 con 0x7f3c94152690 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84010680 con 0x7f3c94152690 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84010a20 con 0x7f3c94152690 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c94150280 con 0x7f3c94152690 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.492+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9413d920 con 0x7f3c94152690 2023-08-22T00:06:32.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.493+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c940af900 con 0x7f3c94152690 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.493+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3c84014430 con 0x7f3c94152690 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.493+0000 7f3c8affd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 0x7f3c740612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.494+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3c84079c20 con 0x7f3c94152690 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.494+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 0x7f3c740612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.494+0000 7f3c92ffd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 0x7f3c740612d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3c7c001010 tx=0x7f3c7c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.498+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c840498f0 con 0x7f3c94152690 2023-08-22T00:06:32.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.660+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3c940c1490 con 0x7f3c94152690 2023-08-22T00:06:32.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.661+0000 7f3c8affd700 1 -- 172.21.15.98:0/64053166 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c8404ad20 con 0x7f3c94152690 2023-08-22T00:06:32.663 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:32.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 msgr2=0x7f3c740612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 0x7f3c740612d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3c7c001010 tx=0x7f3c7c015000).stop 2023-08-22T00:06:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 msgr2=0x7f3c9413cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3c84004710 tx=0x7f3c84000f90).stop 2023-08-22T00:06:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 shutdown_connections 2023-08-22T00:06:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c7405ee10 0x7f3c740612d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c80003910 0x7f3c941521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c9413d1d0 0x7f3c940aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 --2- 172.21.15.98:0/64053166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c94152690 0x7f3c9413cce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 >> 172.21.15.98:0/64053166 conn(0x7f3c940650f0 msgr2=0x7f3c940a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 shutdown_connections 2023-08-22T00:06:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.663+0000 7f3c995fd700 1 -- 172.21.15.98:0/64053166 wait complete. 2023-08-22T00:06:32.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2023-08-22T00:06:32.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-22T00:06:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.797+0000 7f8967628700 1 Processor -- start 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.797+0000 7f8967628700 1 -- start start 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8967628700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8960155050 0x7f8960063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8967628700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600c2b40 con 0x7f8960151960 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8967628700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600647b0 con 0x7f8960064390 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8967628700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600c1d40 con 0x7f8960155050 2023-08-22T00:06:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8964bc3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8960155050 0x7f8960063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f89653c4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8960151960 0x7f89600c1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54856/0 (socket says 172.21.15.98:54856) 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f89653c4700 1 -- 172.21.15.98:0/1118155385 learned_addr learned my addr 172.21.15.98:0/1118155385 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8964bc3700 1 -- 172.21.15.98:0/1118155385 >> v1:172.21.15.118:6789/0 conn(0x7f8960064390 legacy=0x7f89600a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8964bc3700 1 -- 172.21.15.98:0/1118155385 >> v1:172.21.15.98:6789/0 conn(0x7f8960151960 legacy=0x7f89600c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8964bc3700 1 -- 172.21.15.98:0/1118155385 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960151d40 con 0x7f8960155050 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8964bc3700 1 --2- 172.21.15.98:0/1118155385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f8960063ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8950009760 tx=0x7f8950009060).ready entity=mon.0 client_cookie=84ea291ebebcd232 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.798+0000 7f8957fff700 1 -- 172.21.15.98:0/1118155385 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000b520 con 0x7f8960155050 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8957fff700 1 -- 172.21.15.98:0/1118155385 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000b680 con 0x7f8960155050 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8957fff700 1 -- 172.21.15.98:0/1118155385 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ba00 con 0x7f8960155050 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 -- 172.21.15.98:0/1118155385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 msgr2=0x7f8960063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 --2- 172.21.15.98:0/1118155385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f8960063ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8950009760 tx=0x7f8950009060).stop 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 -- 172.21.15.98:0/1118155385 shutdown_connections 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 --2- 172.21.15.98:0/1118155385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f8960063ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 -- 172.21.15.98:0/1118155385 >> 172.21.15.98:0/1118155385 conn(0x7f8960069680 msgr2=0x7f8960069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 -- 172.21.15.98:0/1118155385 shutdown_connections 2023-08-22T00:06:32.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.799+0000 7f8967628700 1 -- 172.21.15.98:0/1118155385 wait complete. 2023-08-22T00:06:32.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.800+0000 7f8967628700 1 Processor -- start 2023-08-22T00:06:32.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.800+0000 7f8967628700 1 -- start start 2023-08-22T00:06:32.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8960064390 0x7f896015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8960151960 0x7f896014a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896015a840 con 0x7f8960155050 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960158510 con 0x7f8960151960 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8967628700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960157900 con 0x7f8960064390 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8965bc5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8965bc5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35542/0 (socket says 172.21.15.98:35542) 2023-08-22T00:06:32.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8965bc5700 1 -- 172.21.15.98:0/868419362 learned_addr learned my addr 172.21.15.98:0/868419362 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:32.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f89653c4700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8960064390 0x7f896015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.801+0000 7f8964bc3700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8960151960 0x7f896014a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 -- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8960064390 msgr2=0x7f896015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8960064390 0x7f896015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 -- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8960151960 msgr2=0x7f896014a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8960151960 0x7f896014a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 -- 172.21.15.98:0/868419362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500092a0 con 0x7f8960155050 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8965bc5700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f895800b810 tx=0x7f8958009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800d500 con 0x7f8960155050 2023-08-22T00:06:32.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800d660 con 0x7f8960155050 2023-08-22T00:06:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960157be0 con 0x7f8960155050 2023-08-22T00:06:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800da20 con 0x7f8960155050 2023-08-22T00:06:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.802+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89601581a0 con 0x7f8960155050 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.803+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89600c1f30 con 0x7f8960155050 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.803+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8958011460 con 0x7f8960155050 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.804+0000 7f89557fa700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 0x7f89440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.804+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8958079ba0 con 0x7f8960155050 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.804+0000 7f89653c4700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 0x7f89440612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.804+0000 7f89653c4700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 0x7f89440612a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f89600c1d10 tx=0x7f895c007d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.808+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89580478f0 con 0x7f8960155050 2023-08-22T00:06:32.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.968+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8960154e30 con 0x7f8960155050 2023-08-22T00:06:32.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.968+0000 7f89557fa700 1 -- 172.21.15.98:0/868419362 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f895804ad50 con 0x7f8960155050 2023-08-22T00:06:32.972 INFO:teuthology.orchestra.run.smithi098.stdout:55834574856 2023-08-22T00:06:32.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 msgr2=0x7f89440612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 0x7f89440612a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f89600c1d10 tx=0x7f895c007d30).stop 2023-08-22T00:06:32.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 msgr2=0x7f896014ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:32.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f895800b810 tx=0x7f8958009290).stop 2023-08-22T00:06:32.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 shutdown_connections 2023-08-22T00:06:32.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f894405ede0 0x7f89440612a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8960064390 0x7f896015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8960155050 0x7f896014ab50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 --2- 172.21.15.98:0/868419362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8960151960 0x7f896014a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:32.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 >> 172.21.15.98:0/868419362 conn(0x7f8960069680 msgr2=0x7f896015a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:32.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 shutdown_connections 2023-08-22T00:06:32.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:32.970+0000 7f8967628700 1 -- 172.21.15.98:0/868419362 wait complete. 2023-08-22T00:06:32.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2023-08-22T00:06:32.984 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-22T00:06:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.100+0000 7f9b13887700 1 Processor -- start 2023-08-22T00:06:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.100+0000 7f9b13887700 1 -- start start 2023-08-22T00:06:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b13887700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b0c153b90 0x7f9b0c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b13887700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b0c0ab930 0x7f9b0c0be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b13887700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c0c40a0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b13887700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c3490 con 0x7f9b0c153b90 2023-08-22T00:06:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b13887700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c3770 con 0x7f9b0c0ab930 2023-08-22T00:06:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11623700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b0c153b90 0x7f9b0c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b10e22700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9b0c0c2eb0 0x7f9b0c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54860/0 (socket says 172.21.15.98:54860) 2023-08-22T00:06:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b10e22700 1 -- 172.21.15.98:0/51710845 learned_addr learned my addr 172.21.15.98:0/51710845 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11e24700 1 --2- 172.21.15.98:0/51710845 >> v2:172.21.15.118:3300/0 conn(0x7f9b0c0ab930 0x7f9b0c0be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11623700 1 -- 172.21.15.98:0/51710845 >> v2:172.21.15.118:3300/0 conn(0x7f9b0c0ab930 msgr2=0x7f9b0c0be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11623700 1 --2- 172.21.15.98:0/51710845 >> v2:172.21.15.118:3300/0 conn(0x7f9b0c0ab930 0x7f9b0c0be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11623700 1 -- 172.21.15.98:0/51710845 >> v1:172.21.15.98:6789/0 conn(0x7f9b0c0c2eb0 legacy=0x7f9b0c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b03fff700 1 -- 172.21.15.98:0/51710845 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197830744 0 0) 0x7f9b0c0c40a0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.101+0000 7f9b11623700 1 -- 172.21.15.98:0/51710845 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0c3a50 con 0x7f9b0c153b90 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b11623700 1 --2- 172.21.15.98:0/51710845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c153b90 0x7f9b0c153f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9b0c06aa40 tx=0x7f9afc009060).ready entity=mon.0 client_cookie=d15d1f022bcc63d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b03fff700 1 -- 172.21.15.98:0/51710845 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00b580 con 0x7f9b0c153b90 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b03fff700 1 -- 172.21.15.98:0/51710845 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc00b6e0 con 0x7f9b0c153b90 2023-08-22T00:06:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b03fff700 1 -- 172.21.15.98:0/51710845 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00ba60 con 0x7f9b0c153b90 2023-08-22T00:06:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 -- 172.21.15.98:0/51710845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c153b90 msgr2=0x7f9b0c153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 --2- 172.21.15.98:0/51710845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c153b90 0x7f9b0c153f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9b0c06aa40 tx=0x7f9afc009060).stop 2023-08-22T00:06:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 -- 172.21.15.98:0/51710845 shutdown_connections 2023-08-22T00:06:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 --2- 172.21.15.98:0/51710845 >> v2:172.21.15.118:3300/0 conn(0x7f9b0c0ab930 0x7f9b0c0be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 --2- 172.21.15.98:0/51710845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c153b90 0x7f9b0c153f70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 -- 172.21.15.98:0/51710845 >> 172.21.15.98:0/51710845 conn(0x7f9b0c0c9350 msgr2=0x7f9b0c0c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 -- 172.21.15.98:0/51710845 shutdown_connections 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.102+0000 7f9b13887700 1 -- 172.21.15.98:0/51710845 wait complete. 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.103+0000 7f9b13887700 1 Processor -- start 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.103+0000 7f9b13887700 1 -- start start 2023-08-22T00:06:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 0x7f9b0c0c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b0c153b90 0x7f9b0c164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c14dd10 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c0390 con 0x7f9b0c153b90 2023-08-22T00:06:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b13887700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0bfa60 con 0x7f9b0c0ab930 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b10e22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b10e22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35558/0 (socket says 172.21.15.98:35558) 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.104+0000 7f9b10e22700 1 -- 172.21.15.98:0/3666241021 learned_addr learned my addr 172.21.15.98:0/3666241021 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b11e24700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b0c153b90 0x7f9b0c164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b11623700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 0x7f9b0c0c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 -- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 msgr2=0x7f9b0c0c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 0x7f9b0c0c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 -- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b0c153b90 msgr2=0x7f9b0c164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b0c153b90 0x7f9b0c164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 -- 172.21.15.98:0/3666241021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0092a0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b11623700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 0x7f9b0c0c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b10e22700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9b0800c510 tx=0x7f9b08007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080072e0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08007440 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080057a0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c0bfd40 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.105+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c0a4b00 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.106+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c069d50 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.106+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9b08005bd0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.107+0000 7f9b017fa700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 0x7f9af00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.107+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9b08079950 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.107+0000 7f9b11623700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 0x7f9af00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.107+0000 7f9b11623700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 0x7f9af00612d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9afc00b340 tx=0x7f9afc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.111+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b0804aab0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.275+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9b0c0c3d30 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.275+0000 7f9b017fa700 1 -- 172.21.15.98:0/3666241021 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b08007db0 con 0x7f9b0c0c2eb0 2023-08-22T00:06:33.277 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 msgr2=0x7f9af00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 0x7f9af00612d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9afc00b340 tx=0x7f9afc017000).stop 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 msgr2=0x7f9b0c0a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9b0800c510 tx=0x7f9b08007c70).stop 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 shutdown_connections 2023-08-22T00:06:33.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9af005ee10 0x7f9af00612d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b0c0ab930 0x7f9b0c0c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b0c153b90 0x7f9b0c164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 --2- 172.21.15.98:0/3666241021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b0c0c2eb0 0x7f9b0c0a42b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 >> 172.21.15.98:0/3666241021 conn(0x7f9b0c0c9350 msgr2=0x7f9b0c0c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 shutdown_connections 2023-08-22T00:06:33.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.277+0000 7f9b13887700 1 -- 172.21.15.98:0/3666241021 wait complete. 2023-08-22T00:06:33.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.6 2023-08-22T00:06:33.291 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-22T00:06:33.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.407+0000 7fafee693700 1 Processor -- start 2023-08-22T00:06:33.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.407+0000 7fafee693700 1 -- start start 2023-08-22T00:06:33.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.407+0000 7fafee693700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 0x7fafe80c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.407+0000 7fafee693700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.407+0000 7fafee693700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe8064840 con 0x7fafe8064390 2023-08-22T00:06:33.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafee693700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80c2b40 con 0x7fafe8155050 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafee693700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8151d40 con 0x7fafe8151960 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 0x7fafe80c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:60266/0 (socket says 172.21.15.98:60266) 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe77fe700 1 -- 172.21.15.98:0/155408304 learned_addr learned my addr 172.21.15.98:0/155408304 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafecc30700 1 --1- 172.21.15.98:0/155408304 >> v1:172.21.15.118:6789/0 conn(0x7fafe8064390 0x7fafe8157900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:52434/0 (socket says 172.21.15.98:52434) 2023-08-22T00:06:33.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 -- 172.21.15.98:0/155408304 >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 msgr2=0x7fafe8063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 --2- 172.21.15.98:0/155408304 >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 -- 172.21.15.98:0/155408304 >> v1:172.21.15.118:6789/0 conn(0x7fafe8064390 legacy=0x7fafe8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 -- 172.21.15.98:0/155408304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80c1f30 con 0x7fafe8151960 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe6ffd700 1 -- 172.21.15.98:0/155408304 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106340982 0 0) 0x7fafe0001490 con 0x7fafe8064390 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe77fe700 1 --2- 172.21.15.98:0/155408304 >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.408+0000 7fafe7fff700 1 --2- 172.21.15.98:0/155408304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 0x7fafe80c1630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fafd8009760 tx=0x7fafd8009060).ready entity=mon.2 client_cookie=34c1b0e2dd820408 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafe6ffd700 1 -- 172.21.15.98:0/155408304 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800f510 con 0x7fafe8151960 2023-08-22T00:06:33.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafe6ffd700 1 -- 172.21.15.98:0/155408304 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800f670 con 0x7fafe8151960 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafe6ffd700 1 -- 172.21.15.98:0/155408304 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800f9f0 con 0x7fafe8151960 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 -- 172.21.15.98:0/155408304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 msgr2=0x7fafe80c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 --2- 172.21.15.98:0/155408304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 0x7fafe80c1630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fafd8009760 tx=0x7fafd8009060).stop 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 -- 172.21.15.98:0/155408304 shutdown_connections 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 --2- 172.21.15.98:0/155408304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8151960 0x7fafe80c1630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 --2- 172.21.15.98:0/155408304 >> v2:172.21.15.118:3300/0 conn(0x7fafe8155050 0x7fafe8063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 -- 172.21.15.98:0/155408304 >> 172.21.15.98:0/155408304 conn(0x7fafe8069680 msgr2=0x7fafe8069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 -- 172.21.15.98:0/155408304 shutdown_connections 2023-08-22T00:06:33.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.409+0000 7fafee693700 1 -- 172.21.15.98:0/155408304 wait complete. 2023-08-22T00:06:33.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.410+0000 7fafee693700 1 Processor -- start 2023-08-22T00:06:33.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.410+0000 7fafee693700 1 -- start start 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe8064390 0x7fafe814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8155050 0x7fafe80a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80be5e0 con 0x7fafe8151960 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80671d0 con 0x7fafe8064390 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafee693700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c0f00 con 0x7fafe8155050 2023-08-22T00:06:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafe77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafecc30700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8155050 0x7fafe80a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafe77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35574/0 (socket says 172.21.15.98:35574) 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafe77fe700 1 -- 172.21.15.98:0/749230647 learned_addr learned my addr 172.21.15.98:0/749230647 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.411+0000 7fafe7fff700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe8064390 0x7fafe814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 -- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8155050 msgr2=0x7fafe80a8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8155050 0x7fafe80a8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 -- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe8064390 msgr2=0x7fafe814fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe8064390 0x7fafe814fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 -- 172.21.15.98:0/749230647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009370 con 0x7fafe8151960 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafe77fe700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fafdc00e9d0 tx=0x7fafdc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00c6a0 con 0x7fafe8151960 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00c800 con 0x7fafe8151960 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80092a0 con 0x7fafe8151960 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00cb80 con 0x7fafe8151960 2023-08-22T00:06:33.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.412+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe80c0c20 con 0x7fafe8151960 2023-08-22T00:06:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.413+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80be0b0 con 0x7fafe8151960 2023-08-22T00:06:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.413+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fafdc01b400 con 0x7fafe8151960 2023-08-22T00:06:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.414+0000 7fafcffff700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 0x7fafd40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.414+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fafdc07a690 con 0x7fafe8151960 2023-08-22T00:06:33.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.414+0000 7fafe7fff700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 0x7fafd40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.414+0000 7fafe7fff700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 0x7fafd40612d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fafd8009fd0 tx=0x7fafd8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.418+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafdc04b8a0 con 0x7fafe8151960 2023-08-22T00:06:33.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.581+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fafe80c2210 con 0x7fafe8151960 2023-08-22T00:06:33.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.581+0000 7fafcffff700 1 -- 172.21.15.98:0/749230647 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafdc04eec0 con 0x7fafe8151960 2023-08-22T00:06:33.591 INFO:teuthology.orchestra.run.smithi098.stdout:55834574857 2023-08-22T00:06:33.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 msgr2=0x7fafd40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 0x7fafd40612d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fafd8009fd0 tx=0x7fafd8017000).stop 2023-08-22T00:06:33.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 msgr2=0x7fafe80a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fafdc00e9d0 tx=0x7fafdc0090f0).stop 2023-08-22T00:06:33.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 shutdown_connections 2023-08-22T00:06:33.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fafd405ee10 0x7fafd40612d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafe8155050 0x7fafe80a8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe8064390 0x7fafe814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 --2- 172.21.15.98:0/749230647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe8151960 0x7fafe80a7c60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 >> 172.21.15.98:0/749230647 conn(0x7fafe8069680 msgr2=0x7fafe8156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 shutdown_connections 2023-08-22T00:06:33.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.583+0000 7fafee693700 1 -- 172.21.15.98:0/749230647 wait complete. 2023-08-22T00:06:33.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2023-08-22T00:06:33.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-22T00:06:33.597 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:06:33.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 Processor -- start 2023-08-22T00:06:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 -- start start 2023-08-22T00:06:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b6c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4b6c0c2030 0x7f4b6c0bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c0bcd40 con 0x7f4b6c154260 2023-08-22T00:06:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0c24b0 con 0x7f4b6c0c2030 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.712+0000 7f4b72161700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14e7b0 con 0x7f4b6c0c64a0 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4b6c154260 0x7f4b6c154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54874/0 (socket says 172.21.15.98:54874) 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6b7fe700 1 -- 172.21.15.98:0/3114652208 learned_addr learned my addr 172.21.15.98:0/3114652208 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/3114652208 >> v2:172.21.15.118:3300/0 conn(0x7f4b6c0c2030 0x7f4b6c0bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6affd700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b6c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008943699 0 0) 0x7f4b6c0bcd40 con 0x7f4b6c154260 2023-08-22T00:06:33.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b580033f0 con 0x7f4b6c154260 2023-08-22T00:06:33.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2921840172 0 0) 0x7f4b580033f0 con 0x7f4b6c154260 2023-08-22T00:06:33.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 msgr2=0x7f4b6c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b6c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 >> v2:172.21.15.118:3300/0 conn(0x7f4b6c0c2030 msgr2=0x7f4b6c0bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 --2- 172.21.15.98:0/3114652208 >> v2:172.21.15.118:3300/0 conn(0x7f4b6c0c2030 0x7f4b6c0bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0c4fb0 con 0x7f4b6c154260 2023-08-22T00:06:33.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4b54001470 con 0x7f4b6c154260 2023-08-22T00:06:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 >> v1:172.21.15.98:6789/0 conn(0x7f4b6c154260 legacy=0x7f4b6c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b58003910 0x7f4b58003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b58004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b58004b80 0x7f4b58005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0c24b0 con 0x7f4b58004b80 2023-08-22T00:06:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580044f0 con 0x7f4b58003910 2023-08-22T00:06:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5800b960 con 0x7f4b6c0c64a0 2023-08-22T00:06:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b58004b80 0x7f4b58005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6b7fe700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b58003910 0x7f4b58003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.713+0000 7f4b6affd700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b58004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 -- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 msgr2=0x7f4b58004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0c64a0 0x7f4b58004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 -- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b58003910 msgr2=0x7f4b58003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b58003910 0x7f4b58003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 -- 172.21.15.98:0/3114652208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580033f0 con 0x7f4b58004b80 2023-08-22T00:06:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b58004b80 0x7f4b58005000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f4b6400e210 tx=0x7f4b6400b040).ready entity=mon.0 client_cookie=b70069d89c4b2afc server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64009ac0 con 0x7f4b58004b80 2023-08-22T00:06:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x7f4b58004b80 2023-08-22T00:06:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6a7fc700 1 -- 172.21.15.98:0/3114652208 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400ecd0 con 0x7f4b58004b80 2023-08-22T00:06:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 -- 172.21.15.98:0/3114652208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b58004b80 msgr2=0x7f4b58005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 --2- 172.21.15.98:0/3114652208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b58004b80 0x7f4b58005000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f4b6400e210 tx=0x7f4b6400b040).stop 2023-08-22T00:06:33.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b6bfff700 1 -- 172.21.15.98:0/3114652208 reap_dead start 2023-08-22T00:06:33.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 -- 172.21.15.98:0/3114652208 shutdown_connections 2023-08-22T00:06:33.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 -- 172.21.15.98:0/3114652208 >> 172.21.15.98:0/3114652208 conn(0x7f4b6c0c3980 msgr2=0x7f4b6c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 -- 172.21.15.98:0/3114652208 shutdown_connections 2023-08-22T00:06:33.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.714+0000 7f4b72161700 1 -- 172.21.15.98:0/3114652208 wait complete. 2023-08-22T00:06:33.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.716+0000 7f4b72161700 1 Processor -- start 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.716+0000 7f4b72161700 1 -- start start 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 0x7f4b6c066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0aa070 0x7f4b6c0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0670e0 con 0x7f4b6c14dd30 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0a76f0 con 0x7f4b6c14d950 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b72161700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0aa9e0 con 0x7f4b6c0aa070 2023-08-22T00:06:33.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35590/0 (socket says 172.21.15.98:35590) 2023-08-22T00:06:33.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 -- 172.21.15.98:0/2489512607 learned_addr learned my addr 172.21.15.98:0/2489512607 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:33.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6bfff700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0aa070 0x7f4b6c0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6b7fe700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 0x7f4b6c066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 -- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0aa070 msgr2=0x7f4b6c0aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0aa070 0x7f4b6c0aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 -- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 msgr2=0x7f4b6c066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 0x7f4b6c066700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6affd700 1 -- 172.21.15.98:0/2489512607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0a6ae0 con 0x7f4b6c14dd30 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.717+0000 7f4b6b7fe700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 0x7f4b6c066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b6affd700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4b5c011940 tx=0x7f4b5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c011ee0 con 0x7f4b6c14dd30 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c00f9d0 con 0x7f4b6c14dd30 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c0a6dc0 con 0x7f4b6c14dd30 2023-08-22T00:06:33.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00fd50 con 0x7f4b6c14dd30 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.718+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c0a7380 con 0x7f4b6c14dd30 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.719+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c0a7880 con 0x7f4b6c14dd30 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.719+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4b5c014650 con 0x7f4b6c14dd30 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.719+0000 7f4b637fe700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 0x7f4b4c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.719+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4b5c07aa00 con 0x7f4b6c14dd30 2023-08-22T00:06:33.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.719+0000 7f4b6b7fe700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 0x7f4b4c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:33.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.720+0000 7f4b6b7fe700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 0x7f4b4c061300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4b54007dd0 tx=0x7f4b54009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:33.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.723+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b5c04bb60 con 0x7f4b6c14dd30 2023-08-22T00:06:33.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.877+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b6c047480 con 0x7f4b4c05ee40 2023-08-22T00:06:33.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.888+0000 7f4b637fe700 1 -- 172.21.15.98:0/2489512607 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410619 (secure 0 0 0) 0x7f4b6c047480 con 0x7f4b4c05ee40 2023-08-22T00:06:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:33.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 msgr2=0x7f4b4c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 0x7f4b4c061300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4b54007dd0 tx=0x7f4b54009040).stop 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 msgr2=0x7f4b6c066bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4b5c011940 tx=0x7f4b5c009060).stop 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 shutdown_connections 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b4c05ee40 0x7f4b4c061300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6c0aa070 0x7f4b6c0aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6c14d950 0x7f4b6c066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 --2- 172.21.15.98:0/2489512607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b6c14dd30 0x7f4b6c066bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:33.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 >> 172.21.15.98:0/2489512607 conn(0x7f4b6c0c3980 msgr2=0x7f4b6c0bbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:33.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 shutdown_connections 2023-08-22T00:06:33.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:33.892+0000 7f4b72161700 1 -- 172.21.15.98:0/2489512607 wait complete. 2023-08-22T00:06:33.898 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:06:33.908 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-08-22T00:06:32.036324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379008,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595712,"statfs":{"total":773094113280,"available":770658009088,"internally_reserved":0,"allocated":2293760,"data_stored":937332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2180,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003484"},"pg_stats":[{"pgid":"3.3f","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678589+0000","last_change":"2023-08-22T00:06:08.291099+0000","last_active":"2023-08-22T00:06:12.678589+0000","last_peered":"2023-08-22T00:06:12.678589+0000","last_clean":"2023-08-22T00:06:12.678589+0000","last_became_active":"2023-08-22T00:06:08.290795+0000","last_became_peered":"2023-08-22T00:06:08.290795+0000","last_unstale":"2023-08-22T00:06:12.678589+0000","last_undegraded":"2023-08-22T00:06:12.678589+0000","last_fullsized":"2023-08-22T00:06:12.678589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673305+0000","last_change":"2023-08-22T00:06:08.656231+0000","last_active":"2023-08-22T00:06:12.673305+0000","last_peered":"2023-08-22T00:06:12.673305+0000","last_clean":"2023-08-22T00:06:12.673305+0000","last_became_active":"2023-08-22T00:06:08.655915+0000","last_became_peered":"2023-08-22T00:06:08.655915+0000","last_unstale":"2023-08-22T00:06:12.673305+0000","last_undegraded":"2023-08-22T00:06:12.673305+0000","last_fullsized":"2023-08-22T00:06:12.673305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684438+0000","last_change":"2023-08-22T00:06:08.288428+0000","last_active":"2023-08-22T00:06:12.684438+0000","last_peered":"2023-08-22T00:06:12.684438+0000","last_clean":"2023-08-22T00:06:12.684438+0000","last_became_active":"2023-08-22T00:06:08.286608+0000","last_became_peered":"2023-08-22T00:06:08.286608+0000","last_unstale":"2023-08-22T00:06:12.684438+0000","last_undegraded":"2023-08-22T00:06:12.684438+0000","last_fullsized":"2023-08-22T00:06:12.684438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671745+0000","last_change":"2023-08-22T00:06:08.662348+0000","last_active":"2023-08-22T00:06:12.671745+0000","last_peered":"2023-08-22T00:06:12.671745+0000","last_clean":"2023-08-22T00:06:12.671745+0000","last_became_active":"2023-08-22T00:06:08.661703+0000","last_became_peered":"2023-08-22T00:06:08.661703+0000","last_unstale":"2023-08-22T00:06:12.671745+0000","last_undegraded":"2023-08-22T00:06:12.671745+0000","last_fullsized":"2023-08-22T00:06:12.671745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675218+0000","last_change":"2023-08-22T00:06:08.287214+0000","last_active":"2023-08-22T00:06:12.675218+0000","last_peered":"2023-08-22T00:06:12.675218+0000","last_clean":"2023-08-22T00:06:12.675218+0000","last_became_active":"2023-08-22T00:06:08.286927+0000","last_became_peered":"2023-08-22T00:06:08.286927+0000","last_unstale":"2023-08-22T00:06:12.675218+0000","last_undegraded":"2023-08-22T00:06:12.675218+0000","last_fullsized":"2023-08-22T00:06:12.675218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666426+0000","last_change":"2023-08-22T00:06:08.656790+0000","last_active":"2023-08-22T00:06:12.666426+0000","last_peered":"2023-08-22T00:06:12.666426+0000","last_clean":"2023-08-22T00:06:12.666426+0000","last_became_active":"2023-08-22T00:06:08.656519+0000","last_became_peered":"2023-08-22T00:06:08.656519+0000","last_unstale":"2023-08-22T00:06:12.666426+0000","last_undegraded":"2023-08-22T00:06:12.666426+0000","last_fullsized":"2023-08-22T00:06:12.666426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672202+0000","last_change":"2023-08-22T00:06:08.293624+0000","last_active":"2023-08-22T00:06:12.672202+0000","last_peered":"2023-08-22T00:06:12.672202+0000","last_clean":"2023-08-22T00:06:12.672202+0000","last_became_active":"2023-08-22T00:06:08.293347+0000","last_became_peered":"2023-08-22T00:06:08.293347+0000","last_unstale":"2023-08-22T00:06:12.672202+0000","last_undegraded":"2023-08-22T00:06:12.672202+0000","last_fullsized":"2023-08-22T00:06:12.672202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681949+0000","last_change":"2023-08-22T00:06:08.659129+0000","last_active":"2023-08-22T00:06:12.681949+0000","last_peered":"2023-08-22T00:06:12.681949+0000","last_clean":"2023-08-22T00:06:12.681949+0000","last_became_active":"2023-08-22T00:06:08.658860+0000","last_became_peered":"2023-08-22T00:06:08.658860+0000","last_unstale":"2023-08-22T00:06:12.681949+0000","last_undegraded":"2023-08-22T00:06:12.681949+0000","last_fullsized":"2023-08-22T00:06:12.681949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673280+0000","last_change":"2023-08-22T00:06:08.289602+0000","last_active":"2023-08-22T00:06:12.673280+0000","last_peered":"2023-08-22T00:06:12.673280+0000","last_clean":"2023-08-22T00:06:12.673280+0000","last_became_active":"2023-08-22T00:06:08.289342+0000","last_became_peered":"2023-08-22T00:06:08.289342+0000","last_unstale":"2023-08-22T00:06:12.673280+0000","last_undegraded":"2023-08-22T00:06:12.673280+0000","last_fullsized":"2023-08-22T00:06:12.673280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666271+0000","last_change":"2023-08-22T00:06:08.661296+0000","last_active":"2023-08-22T00:06:12.666271+0000","last_peered":"2023-08-22T00:06:12.666271+0000","last_clean":"2023-08-22T00:06:12.666271+0000","last_became_active":"2023-08-22T00:06:08.660986+0000","last_became_peered":"2023-08-22T00:06:08.660986+0000","last_unstale":"2023-08-22T00:06:12.666271+0000","last_undegraded":"2023-08-22T00:06:12.666271+0000","last_fullsized":"2023-08-22T00:06:12.666271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673253+0000","last_change":"2023-08-22T00:06:08.288788+0000","last_active":"2023-08-22T00:06:12.673253+0000","last_peered":"2023-08-22T00:06:12.673253+0000","last_clean":"2023-08-22T00:06:12.673253+0000","last_became_active":"2023-08-22T00:06:08.288515+0000","last_became_peered":"2023-08-22T00:06:08.288515+0000","last_unstale":"2023-08-22T00:06:12.673253+0000","last_undegraded":"2023-08-22T00:06:12.673253+0000","last_fullsized":"2023-08-22T00:06:12.673253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666020+0000","last_change":"2023-08-22T00:06:08.658212+0000","last_active":"2023-08-22T00:06:12.666020+0000","last_peered":"2023-08-22T00:06:12.666020+0000","last_clean":"2023-08-22T00:06:12.666020+0000","last_became_active":"2023-08-22T00:06:08.657937+0000","last_became_peered":"2023-08-22T00:06:08.657937+0000","last_unstale":"2023-08-22T00:06:12.666020+0000","last_undegraded":"2023-08-22T00:06:12.666020+0000","last_fullsized":"2023-08-22T00:06:12.666020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671479+0000","last_change":"2023-08-22T00:06:08.297342+0000","last_active":"2023-08-22T00:06:12.671479+0000","last_peered":"2023-08-22T00:06:12.671479+0000","last_clean":"2023-08-22T00:06:12.671479+0000","last_became_active":"2023-08-22T00:06:08.291355+0000","last_became_peered":"2023-08-22T00:06:08.291355+0000","last_unstale":"2023-08-22T00:06:12.671479+0000","last_undegraded":"2023-08-22T00:06:12.671479+0000","last_fullsized":"2023-08-22T00:06:12.671479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674444+0000","last_change":"2023-08-22T00:06:08.660595+0000","last_active":"2023-08-22T00:06:12.674444+0000","last_peered":"2023-08-22T00:06:12.674444+0000","last_clean":"2023-08-22T00:06:12.674444+0000","last_became_active":"2023-08-22T00:06:08.660326+0000","last_became_peered":"2023-08-22T00:06:08.660326+0000","last_unstale":"2023-08-22T00:06:12.674444+0000","last_undegraded":"2023-08-22T00:06:12.674444+0000","last_fullsized":"2023-08-22T00:06:12.674444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666783+0000","last_change":"2023-08-22T00:06:08.289343+0000","last_active":"2023-08-22T00:06:12.666783+0000","last_peered":"2023-08-22T00:06:12.666783+0000","last_clean":"2023-08-22T00:06:12.666783+0000","last_became_active":"2023-08-22T00:06:08.289074+0000","last_became_peered":"2023-08-22T00:06:08.289074+0000","last_unstale":"2023-08-22T00:06:12.666783+0000","last_undegraded":"2023-08-22T00:06:12.666783+0000","last_fullsized":"2023-08-22T00:06:12.666783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670629+0000","last_change":"2023-08-22T00:06:08.665424+0000","last_active":"2023-08-22T00:06:12.670629+0000","last_peered":"2023-08-22T00:06:12.670629+0000","last_clean":"2023-08-22T00:06:12.670629+0000","last_became_active":"2023-08-22T00:06:08.665177+0000","last_became_peered":"2023-08-22T00:06:08.665177+0000","last_unstale":"2023-08-22T00:06:12.670629+0000","last_undegraded":"2023-08-22T00:06:12.670629+0000","last_fullsized":"2023-08-22T00:06:12.670629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678499+0000","last_change":"2023-08-22T00:06:08.291866+0000","last_active":"2023-08-22T00:06:12.678499+0000","last_peered":"2023-08-22T00:06:12.678499+0000","last_clean":"2023-08-22T00:06:12.678499+0000","last_became_active":"2023-08-22T00:06:08.291381+0000","last_became_peered":"2023-08-22T00:06:08.291381+0000","last_unstale":"2023-08-22T00:06:12.678499+0000","last_undegraded":"2023-08-22T00:06:12.678499+0000","last_fullsized":"2023-08-22T00:06:12.678499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665055+0000","last_change":"2023-08-22T00:06:08.658534+0000","last_active":"2023-08-22T00:06:12.665055+0000","last_peered":"2023-08-22T00:06:12.665055+0000","last_clean":"2023-08-22T00:06:12.665055+0000","last_became_active":"2023-08-22T00:06:08.658274+0000","last_became_peered":"2023-08-22T00:06:08.658274+0000","last_unstale":"2023-08-22T00:06:12.665055+0000","last_undegraded":"2023-08-22T00:06:12.665055+0000","last_fullsized":"2023-08-22T00:06:12.665055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666238+0000","last_change":"2023-08-22T00:06:08.287355+0000","last_active":"2023-08-22T00:06:12.666238+0000","last_peered":"2023-08-22T00:06:12.666238+0000","last_clean":"2023-08-22T00:06:12.666238+0000","last_became_active":"2023-08-22T00:06:08.287061+0000","last_became_peered":"2023-08-22T00:06:08.287061+0000","last_unstale":"2023-08-22T00:06:12.666238+0000","last_undegraded":"2023-08-22T00:06:12.666238+0000","last_fullsized":"2023-08-22T00:06:12.666238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671653+0000","last_change":"2023-08-22T00:06:08.662523+0000","last_active":"2023-08-22T00:06:12.671653+0000","last_peered":"2023-08-22T00:06:12.671653+0000","last_clean":"2023-08-22T00:06:12.671653+0000","last_became_active":"2023-08-22T00:06:08.662068+0000","last_became_peered":"2023-08-22T00:06:08.662068+0000","last_unstale":"2023-08-22T00:06:12.671653+0000","last_undegraded":"2023-08-22T00:06:12.671653+0000","last_fullsized":"2023-08-22T00:06:12.671653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664956+0000","last_change":"2023-08-22T00:06:08.286978+0000","last_active":"2023-08-22T00:06:12.664956+0000","last_peered":"2023-08-22T00:06:12.664956+0000","last_clean":"2023-08-22T00:06:12.664956+0000","last_became_active":"2023-08-22T00:06:08.286637+0000","last_became_peered":"2023-08-22T00:06:08.286637+0000","last_unstale":"2023-08-22T00:06:12.664956+0000","last_undegraded":"2023-08-22T00:06:12.664956+0000","last_fullsized":"2023-08-22T00:06:12.664956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672913+0000","last_change":"2023-08-22T00:06:08.659864+0000","last_active":"2023-08-22T00:06:12.672913+0000","last_peered":"2023-08-22T00:06:12.672913+0000","last_clean":"2023-08-22T00:06:12.672913+0000","last_became_active":"2023-08-22T00:06:08.659559+0000","last_became_peered":"2023-08-22T00:06:08.659559+0000","last_unstale":"2023-08-22T00:06:12.672913+0000","last_undegraded":"2023-08-22T00:06:12.672913+0000","last_fullsized":"2023-08-22T00:06:12.672913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:17.797484+0000","last_change":"2023-08-22T00:06:08.296851+0000","last_active":"2023-08-22T00:06:17.797484+0000","last_peered":"2023-08-22T00:06:17.797484+0000","last_clean":"2023-08-22T00:06:17.797484+0000","last_became_active":"2023-08-22T00:06:08.296567+0000","last_became_peered":"2023-08-22T00:06:08.296567+0000","last_unstale":"2023-08-22T00:06:17.797484+0000","last_undegraded":"2023-08-22T00:06:17.797484+0000","last_fullsized":"2023-08-22T00:06:17.797484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673049+0000","last_change":"2023-08-22T00:06:08.665352+0000","last_active":"2023-08-22T00:06:12.673049+0000","last_peered":"2023-08-22T00:06:12.673049+0000","last_clean":"2023-08-22T00:06:12.673049+0000","last_became_active":"2023-08-22T00:06:08.665087+0000","last_became_peered":"2023-08-22T00:06:08.665087+0000","last_unstale":"2023-08-22T00:06:12.673049+0000","last_undegraded":"2023-08-22T00:06:12.673049+0000","last_fullsized":"2023-08-22T00:06:12.673049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667424+0000","last_change":"2023-08-22T00:06:08.288914+0000","last_active":"2023-08-22T00:06:12.667424+0000","last_peered":"2023-08-22T00:06:12.667424+0000","last_clean":"2023-08-22T00:06:12.667424+0000","last_became_active":"2023-08-22T00:06:08.287814+0000","last_became_peered":"2023-08-22T00:06:08.287814+0000","last_unstale":"2023-08-22T00:06:12.667424+0000","last_undegraded":"2023-08-22T00:06:12.667424+0000","last_fullsized":"2023-08-22T00:06:12.667424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671643+0000","last_change":"2023-08-22T00:06:08.654359+0000","last_active":"2023-08-22T00:06:12.671643+0000","last_peered":"2023-08-22T00:06:12.671643+0000","last_clean":"2023-08-22T00:06:12.671643+0000","last_became_active":"2023-08-22T00:06:08.653920+0000","last_became_peered":"2023-08-22T00:06:08.653920+0000","last_unstale":"2023-08-22T00:06:12.671643+0000","last_undegraded":"2023-08-22T00:06:12.671643+0000","last_fullsized":"2023-08-22T00:06:12.671643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673398+0000","last_change":"2023-08-22T00:06:08.282186+0000","last_active":"2023-08-22T00:06:12.673398+0000","last_peered":"2023-08-22T00:06:12.673398+0000","last_clean":"2023-08-22T00:06:12.673398+0000","last_became_active":"2023-08-22T00:06:08.281908+0000","last_became_peered":"2023-08-22T00:06:08.281908+0000","last_unstale":"2023-08-22T00:06:12.673398+0000","last_undegraded":"2023-08-22T00:06:12.673398+0000","last_fullsized":"2023-08-22T00:06:12.673398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666143+0000","last_change":"2023-08-22T00:06:08.662549+0000","last_active":"2023-08-22T00:06:12.666143+0000","last_peered":"2023-08-22T00:06:12.666143+0000","last_clean":"2023-08-22T00:06:12.666143+0000","last_became_active":"2023-08-22T00:06:08.662262+0000","last_became_peered":"2023-08-22T00:06:08.662262+0000","last_unstale":"2023-08-22T00:06:12.666143+0000","last_undegraded":"2023-08-22T00:06:12.666143+0000","last_fullsized":"2023-08-22T00:06:12.666143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674164+0000","last_change":"2023-08-22T00:06:08.289283+0000","last_active":"2023-08-22T00:06:12.674164+0000","last_peered":"2023-08-22T00:06:12.674164+0000","last_clean":"2023-08-22T00:06:12.674164+0000","last_became_active":"2023-08-22T00:06:08.289007+0000","last_became_peered":"2023-08-22T00:06:08.289007+0000","last_unstale":"2023-08-22T00:06:12.674164+0000","last_undegraded":"2023-08-22T00:06:12.674164+0000","last_fullsized":"2023-08-22T00:06:12.674164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674326+0000","last_change":"2023-08-22T00:06:08.661468+0000","last_active":"2023-08-22T00:06:12.674326+0000","last_peered":"2023-08-22T00:06:12.674326+0000","last_clean":"2023-08-22T00:06:12.674326+0000","last_became_active":"2023-08-22T00:06:08.661197+0000","last_became_peered":"2023-08-22T00:06:08.661197+0000","last_unstale":"2023-08-22T00:06:12.674326+0000","last_undegraded":"2023-08-22T00:06:12.674326+0000","last_fullsized":"2023-08-22T00:06:12.674326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672725+0000","last_change":"2023-08-22T00:06:08.288133+0000","last_active":"2023-08-22T00:06:12.672725+0000","last_peered":"2023-08-22T00:06:12.672725+0000","last_clean":"2023-08-22T00:06:12.672725+0000","last_became_active":"2023-08-22T00:06:08.287879+0000","last_became_peered":"2023-08-22T00:06:08.287879+0000","last_unstale":"2023-08-22T00:06:12.672725+0000","last_undegraded":"2023-08-22T00:06:12.672725+0000","last_fullsized":"2023-08-22T00:06:12.672725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673390+0000","last_change":"2023-08-22T00:06:08.663390+0000","last_active":"2023-08-22T00:06:12.673390+0000","last_peered":"2023-08-22T00:06:12.673390+0000","last_clean":"2023-08-22T00:06:12.673390+0000","last_became_active":"2023-08-22T00:06:08.663010+0000","last_became_peered":"2023-08-22T00:06:08.663010+0000","last_unstale":"2023-08-22T00:06:12.673390+0000","last_undegraded":"2023-08-22T00:06:12.673390+0000","last_fullsized":"2023-08-22T00:06:12.673390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674564+0000","last_change":"2023-08-22T00:06:08.293331+0000","last_active":"2023-08-22T00:06:12.674564+0000","last_peered":"2023-08-22T00:06:12.674564+0000","last_clean":"2023-08-22T00:06:12.674564+0000","last_became_active":"2023-08-22T00:06:08.293020+0000","last_became_peered":"2023-08-22T00:06:08.293020+0000","last_unstale":"2023-08-22T00:06:12.674564+0000","last_undegraded":"2023-08-22T00:06:12.674564+0000","last_fullsized":"2023-08-22T00:06:12.674564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671788+0000","last_change":"2023-08-22T00:06:08.666837+0000","last_active":"2023-08-22T00:06:12.671788+0000","last_peered":"2023-08-22T00:06:12.671788+0000","last_clean":"2023-08-22T00:06:12.671788+0000","last_became_active":"2023-08-22T00:06:08.666560+0000","last_became_peered":"2023-08-22T00:06:08.666560+0000","last_unstale":"2023-08-22T00:06:12.671788+0000","last_undegraded":"2023-08-22T00:06:12.671788+0000","last_fullsized":"2023-08-22T00:06:12.671788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675040+0000","last_change":"2023-08-22T00:06:08.287559+0000","last_active":"2023-08-22T00:06:12.675040+0000","last_peered":"2023-08-22T00:06:12.675040+0000","last_clean":"2023-08-22T00:06:12.675040+0000","last_became_active":"2023-08-22T00:06:08.287287+0000","last_became_peered":"2023-08-22T00:06:08.287287+0000","last_unstale":"2023-08-22T00:06:12.675040+0000","last_undegraded":"2023-08-22T00:06:12.675040+0000","last_fullsized":"2023-08-22T00:06:12.675040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667298+0000","last_change":"2023-08-22T00:06:08.662355+0000","last_active":"2023-08-22T00:06:12.667298+0000","last_peered":"2023-08-22T00:06:12.667298+0000","last_clean":"2023-08-22T00:06:12.667298+0000","last_became_active":"2023-08-22T00:06:08.662086+0000","last_became_peered":"2023-08-22T00:06:08.662086+0000","last_unstale":"2023-08-22T00:06:12.667298+0000","last_undegraded":"2023-08-22T00:06:12.667298+0000","last_fullsized":"2023-08-22T00:06:12.667298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677300+0000","last_change":"2023-08-22T00:06:08.290222+0000","last_active":"2023-08-22T00:06:12.677300+0000","last_peered":"2023-08-22T00:06:12.677300+0000","last_clean":"2023-08-22T00:06:12.677300+0000","last_became_active":"2023-08-22T00:06:08.289968+0000","last_became_peered":"2023-08-22T00:06:08.289968+0000","last_unstale":"2023-08-22T00:06:12.677300+0000","last_undegraded":"2023-08-22T00:06:12.677300+0000","last_fullsized":"2023-08-22T00:06:12.677300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673232+0000","last_change":"2023-08-22T00:06:08.658917+0000","last_active":"2023-08-22T00:06:12.673232+0000","last_peered":"2023-08-22T00:06:12.673232+0000","last_clean":"2023-08-22T00:06:12.673232+0000","last_became_active":"2023-08-22T00:06:08.658657+0000","last_became_peered":"2023-08-22T00:06:08.658657+0000","last_unstale":"2023-08-22T00:06:12.673232+0000","last_undegraded":"2023-08-22T00:06:12.673232+0000","last_fullsized":"2023-08-22T00:06:12.673232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665200+0000","last_change":"2023-08-22T00:06:08.289093+0000","last_active":"2023-08-22T00:06:12.665200+0000","last_peered":"2023-08-22T00:06:12.665200+0000","last_clean":"2023-08-22T00:06:12.665200+0000","last_became_active":"2023-08-22T00:06:08.288806+0000","last_became_peered":"2023-08-22T00:06:08.288806+0000","last_unstale":"2023-08-22T00:06:12.665200+0000","last_undegraded":"2023-08-22T00:06:12.665200+0000","last_fullsized":"2023-08-22T00:06:12.665200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673099+0000","last_change":"2023-08-22T00:06:08.669493+0000","last_active":"2023-08-22T00:06:12.673099+0000","last_peered":"2023-08-22T00:06:12.673099+0000","last_clean":"2023-08-22T00:06:12.673099+0000","last_became_active":"2023-08-22T00:06:08.669220+0000","last_became_peered":"2023-08-22T00:06:08.669220+0000","last_unstale":"2023-08-22T00:06:12.673099+0000","last_undegraded":"2023-08-22T00:06:12.673099+0000","last_fullsized":"2023-08-22T00:06:12.673099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682034+0000","last_change":"2023-08-22T00:06:08.292202+0000","last_active":"2023-08-22T00:06:12.682034+0000","last_peered":"2023-08-22T00:06:12.682034+0000","last_clean":"2023-08-22T00:06:12.682034+0000","last_became_active":"2023-08-22T00:06:08.291929+0000","last_became_peered":"2023-08-22T00:06:08.291929+0000","last_unstale":"2023-08-22T00:06:12.682034+0000","last_undegraded":"2023-08-22T00:06:12.682034+0000","last_fullsized":"2023-08-22T00:06:12.682034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666941+0000","last_change":"2023-08-22T00:06:08.655196+0000","last_active":"2023-08-22T00:06:12.666941+0000","last_peered":"2023-08-22T00:06:12.666941+0000","last_clean":"2023-08-22T00:06:12.666941+0000","last_became_active":"2023-08-22T00:06:08.654928+0000","last_became_peered":"2023-08-22T00:06:08.654928+0000","last_unstale":"2023-08-22T00:06:12.666941+0000","last_undegraded":"2023-08-22T00:06:12.666941+0000","last_fullsized":"2023-08-22T00:06:12.666941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673092+0000","last_change":"2023-08-22T00:06:08.293074+0000","last_active":"2023-08-22T00:06:12.673092+0000","last_peered":"2023-08-22T00:06:12.673092+0000","last_clean":"2023-08-22T00:06:12.673092+0000","last_became_active":"2023-08-22T00:06:08.292434+0000","last_became_peered":"2023-08-22T00:06:08.292434+0000","last_unstale":"2023-08-22T00:06:12.673092+0000","last_undegraded":"2023-08-22T00:06:12.673092+0000","last_fullsized":"2023-08-22T00:06:12.673092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671455+0000","last_change":"2023-08-22T00:06:08.658335+0000","last_active":"2023-08-22T00:06:12.671455+0000","last_peered":"2023-08-22T00:06:12.671455+0000","last_clean":"2023-08-22T00:06:12.671455+0000","last_became_active":"2023-08-22T00:06:08.658035+0000","last_became_peered":"2023-08-22T00:06:08.658035+0000","last_unstale":"2023-08-22T00:06:12.671455+0000","last_undegraded":"2023-08-22T00:06:12.671455+0000","last_fullsized":"2023-08-22T00:06:12.671455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667365+0000","last_change":"2023-08-22T00:06:08.292375+0000","last_active":"2023-08-22T00:06:12.667365+0000","last_peered":"2023-08-22T00:06:12.667365+0000","last_clean":"2023-08-22T00:06:12.667365+0000","last_became_active":"2023-08-22T00:06:08.291934+0000","last_became_peered":"2023-08-22T00:06:08.291934+0000","last_unstale":"2023-08-22T00:06:12.667365+0000","last_undegraded":"2023-08-22T00:06:12.667365+0000","last_fullsized":"2023-08-22T00:06:12.667365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666290+0000","last_change":"2023-08-22T00:06:08.660996+0000","last_active":"2023-08-22T00:06:12.666290+0000","last_peered":"2023-08-22T00:06:12.666290+0000","last_clean":"2023-08-22T00:06:12.666290+0000","last_became_active":"2023-08-22T00:06:08.660728+0000","last_became_peered":"2023-08-22T00:06:08.660728+0000","last_unstale":"2023-08-22T00:06:12.666290+0000","last_undegraded":"2023-08-22T00:06:12.666290+0000","last_fullsized":"2023-08-22T00:06:12.666290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672623+0000","last_change":"2023-08-22T00:06:08.292852+0000","last_active":"2023-08-22T00:06:12.672623+0000","last_peered":"2023-08-22T00:06:12.672623+0000","last_clean":"2023-08-22T00:06:12.672623+0000","last_became_active":"2023-08-22T00:06:08.291935+0000","last_became_peered":"2023-08-22T00:06:08.291935+0000","last_unstale":"2023-08-22T00:06:12.672623+0000","last_undegraded":"2023-08-22T00:06:12.672623+0000","last_fullsized":"2023-08-22T00:06:12.672623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673471+0000","last_change":"2023-08-22T00:06:08.663264+0000","last_active":"2023-08-22T00:06:12.673471+0000","last_peered":"2023-08-22T00:06:12.673471+0000","last_clean":"2023-08-22T00:06:12.673471+0000","last_became_active":"2023-08-22T00:06:08.662705+0000","last_became_peered":"2023-08-22T00:06:08.662705+0000","last_unstale":"2023-08-22T00:06:12.673471+0000","last_undegraded":"2023-08-22T00:06:12.673471+0000","last_fullsized":"2023-08-22T00:06:12.673471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670566+0000","last_change":"2023-08-22T00:06:08.290617+0000","last_active":"2023-08-22T00:06:12.670566+0000","last_peered":"2023-08-22T00:06:12.670566+0000","last_clean":"2023-08-22T00:06:12.670566+0000","last_became_active":"2023-08-22T00:06:08.290300+0000","last_became_peered":"2023-08-22T00:06:08.290300+0000","last_unstale":"2023-08-22T00:06:12.670566+0000","last_undegraded":"2023-08-22T00:06:12.670566+0000","last_fullsized":"2023-08-22T00:06:12.670566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664704+0000","last_change":"2023-08-22T00:06:08.658939+0000","last_active":"2023-08-22T00:06:12.664704+0000","last_peered":"2023-08-22T00:06:12.664704+0000","last_clean":"2023-08-22T00:06:12.664704+0000","last_became_active":"2023-08-22T00:06:08.653702+0000","last_became_peered":"2023-08-22T00:06:08.653702+0000","last_unstale":"2023-08-22T00:06:12.664704+0000","last_undegraded":"2023-08-22T00:06:12.664704+0000","last_fullsized":"2023-08-22T00:06:12.664704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:13.043578+0000","last_change":"2023-08-22T00:06:08.285489+0000","last_active":"2023-08-22T00:06:13.043578+0000","last_peered":"2023-08-22T00:06:13.043578+0000","last_clean":"2023-08-22T00:06:13.043578+0000","last_became_active":"2023-08-22T00:06:08.283345+0000","last_became_peered":"2023-08-22T00:06:08.283345+0000","last_unstale":"2023-08-22T00:06:13.043578+0000","last_undegraded":"2023-08-22T00:06:13.043578+0000","last_fullsized":"2023-08-22T00:06:13.043578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668115+0000","last_change":"2023-08-22T00:06:08.661873+0000","last_active":"2023-08-22T00:06:12.668115+0000","last_peered":"2023-08-22T00:06:12.668115+0000","last_clean":"2023-08-22T00:06:12.668115+0000","last_became_active":"2023-08-22T00:06:08.661603+0000","last_became_peered":"2023-08-22T00:06:08.661603+0000","last_unstale":"2023-08-22T00:06:12.668115+0000","last_undegraded":"2023-08-22T00:06:12.668115+0000","last_fullsized":"2023-08-22T00:06:12.668115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684497+0000","last_change":"2023-08-22T00:06:08.284711+0000","last_active":"2023-08-22T00:06:12.684497+0000","last_peered":"2023-08-22T00:06:12.684497+0000","last_clean":"2023-08-22T00:06:12.684497+0000","last_became_active":"2023-08-22T00:06:08.284399+0000","last_became_peered":"2023-08-22T00:06:08.284399+0000","last_unstale":"2023-08-22T00:06:12.684497+0000","last_undegraded":"2023-08-22T00:06:12.684497+0000","last_fullsized":"2023-08-22T00:06:12.684497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666407+0000","last_change":"2023-08-22T00:06:08.658805+0000","last_active":"2023-08-22T00:06:12.666407+0000","last_peered":"2023-08-22T00:06:12.666407+0000","last_clean":"2023-08-22T00:06:12.666407+0000","last_became_active":"2023-08-22T00:06:08.658529+0000","last_became_peered":"2023-08-22T00:06:08.658529+0000","last_unstale":"2023-08-22T00:06:12.666407+0000","last_undegraded":"2023-08-22T00:06:12.666407+0000","last_fullsized":"2023-08-22T00:06:12.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669275+0000","last_change":"2023-08-22T00:06:08.291946+0000","last_active":"2023-08-22T00:06:12.669275+0000","last_peered":"2023-08-22T00:06:12.669275+0000","last_clean":"2023-08-22T00:06:12.669275+0000","last_became_active":"2023-08-22T00:06:08.291657+0000","last_became_peered":"2023-08-22T00:06:08.291657+0000","last_unstale":"2023-08-22T00:06:12.669275+0000","last_undegraded":"2023-08-22T00:06:12.669275+0000","last_fullsized":"2023-08-22T00:06:12.669275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668361+0000","last_change":"2023-08-22T00:06:08.665347+0000","last_active":"2023-08-22T00:06:12.668361+0000","last_peered":"2023-08-22T00:06:12.668361+0000","last_clean":"2023-08-22T00:06:12.668361+0000","last_became_active":"2023-08-22T00:06:08.665083+0000","last_became_peered":"2023-08-22T00:06:08.665083+0000","last_unstale":"2023-08-22T00:06:12.668361+0000","last_undegraded":"2023-08-22T00:06:12.668361+0000","last_fullsized":"2023-08-22T00:06:12.668361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682195+0000","last_change":"2023-08-22T00:06:08.286837+0000","last_active":"2023-08-22T00:06:12.682195+0000","last_peered":"2023-08-22T00:06:12.682195+0000","last_clean":"2023-08-22T00:06:12.682195+0000","last_became_active":"2023-08-22T00:06:08.286573+0000","last_became_peered":"2023-08-22T00:06:08.286573+0000","last_unstale":"2023-08-22T00:06:12.682195+0000","last_undegraded":"2023-08-22T00:06:12.682195+0000","last_fullsized":"2023-08-22T00:06:12.682195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681782+0000","last_change":"2023-08-22T00:06:08.665854+0000","last_active":"2023-08-22T00:06:12.681782+0000","last_peered":"2023-08-22T00:06:12.681782+0000","last_clean":"2023-08-22T00:06:12.681782+0000","last_became_active":"2023-08-22T00:06:08.665617+0000","last_became_peered":"2023-08-22T00:06:08.665617+0000","last_unstale":"2023-08-22T00:06:12.681782+0000","last_undegraded":"2023-08-22T00:06:12.681782+0000","last_fullsized":"2023-08-22T00:06:12.681782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672822+0000","last_change":"2023-08-22T00:06:08.293311+0000","last_active":"2023-08-22T00:06:12.672822+0000","last_peered":"2023-08-22T00:06:12.672822+0000","last_clean":"2023-08-22T00:06:12.672822+0000","last_became_active":"2023-08-22T00:06:08.292791+0000","last_became_peered":"2023-08-22T00:06:08.292791+0000","last_unstale":"2023-08-22T00:06:12.672822+0000","last_undegraded":"2023-08-22T00:06:12.672822+0000","last_fullsized":"2023-08-22T00:06:12.672822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673896+0000","last_change":"2023-08-22T00:06:08.668170+0000","last_active":"2023-08-22T00:06:12.673896+0000","last_peered":"2023-08-22T00:06:12.673896+0000","last_clean":"2023-08-22T00:06:12.673896+0000","last_became_active":"2023-08-22T00:06:08.667860+0000","last_became_peered":"2023-08-22T00:06:08.667860+0000","last_unstale":"2023-08-22T00:06:12.673896+0000","last_undegraded":"2023-08-22T00:06:12.673896+0000","last_fullsized":"2023-08-22T00:06:12.673896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670406+0000","last_change":"2023-08-22T00:06:08.285397+0000","last_active":"2023-08-22T00:06:12.670406+0000","last_peered":"2023-08-22T00:06:12.670406+0000","last_clean":"2023-08-22T00:06:12.670406+0000","last_became_active":"2023-08-22T00:06:08.285084+0000","last_became_peered":"2023-08-22T00:06:08.285084+0000","last_unstale":"2023-08-22T00:06:12.670406+0000","last_undegraded":"2023-08-22T00:06:12.670406+0000","last_fullsized":"2023-08-22T00:06:12.670406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684663+0000","last_change":"2023-08-22T00:06:08.651586+0000","last_active":"2023-08-22T00:06:12.684663+0000","last_peered":"2023-08-22T00:06:12.684663+0000","last_clean":"2023-08-22T00:06:12.684663+0000","last_became_active":"2023-08-22T00:06:08.651320+0000","last_became_peered":"2023-08-22T00:06:08.651320+0000","last_unstale":"2023-08-22T00:06:12.684663+0000","last_undegraded":"2023-08-22T00:06:12.684663+0000","last_fullsized":"2023-08-22T00:06:12.684663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664973+0000","last_change":"2023-08-22T00:06:08.282274+0000","last_active":"2023-08-22T00:06:12.664973+0000","last_peered":"2023-08-22T00:06:12.664973+0000","last_clean":"2023-08-22T00:06:12.664973+0000","last_became_active":"2023-08-22T00:06:08.281656+0000","last_became_peered":"2023-08-22T00:06:08.281656+0000","last_unstale":"2023-08-22T00:06:12.664973+0000","last_undegraded":"2023-08-22T00:06:12.664973+0000","last_fullsized":"2023-08-22T00:06:12.664973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684917+0000","last_change":"2023-08-22T00:06:08.655245+0000","last_active":"2023-08-22T00:06:12.684917+0000","last_peered":"2023-08-22T00:06:12.684917+0000","last_clean":"2023-08-22T00:06:12.684917+0000","last_became_active":"2023-08-22T00:06:08.653409+0000","last_became_peered":"2023-08-22T00:06:08.653409+0000","last_unstale":"2023-08-22T00:06:12.684917+0000","last_undegraded":"2023-08-22T00:06:12.684917+0000","last_fullsized":"2023-08-22T00:06:12.684917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673625+0000","last_change":"2023-08-22T00:06:08.286655+0000","last_active":"2023-08-22T00:06:12.673625+0000","last_peered":"2023-08-22T00:06:12.673625+0000","last_clean":"2023-08-22T00:06:12.673625+0000","last_became_active":"2023-08-22T00:06:08.286201+0000","last_became_peered":"2023-08-22T00:06:08.286201+0000","last_unstale":"2023-08-22T00:06:12.673625+0000","last_undegraded":"2023-08-22T00:06:12.673625+0000","last_fullsized":"2023-08-22T00:06:12.673625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664977+0000","last_change":"2023-08-22T00:06:08.669633+0000","last_active":"2023-08-22T00:06:12.664977+0000","last_peered":"2023-08-22T00:06:12.664977+0000","last_clean":"2023-08-22T00:06:12.664977+0000","last_became_active":"2023-08-22T00:06:08.669336+0000","last_became_peered":"2023-08-22T00:06:08.669336+0000","last_unstale":"2023-08-22T00:06:12.664977+0000","last_undegraded":"2023-08-22T00:06:12.664977+0000","last_fullsized":"2023-08-22T00:06:12.664977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701760+0000","last_change":"2023-08-22T00:06:12.688949+0000","last_active":"2023-08-22T00:06:12.701760+0000","last_peered":"2023-08-22T00:06:12.701760+0000","last_clean":"2023-08-22T00:06:12.701760+0000","last_became_active":"2023-08-22T00:06:12.688549+0000","last_became_peered":"2023-08-22T00:06:12.688549+0000","last_unstale":"2023-08-22T00:06:12.701760+0000","last_undegraded":"2023-08-22T00:06:12.701760+0000","last_fullsized":"2023-08-22T00:06:12.701760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670131+0000","last_change":"2023-08-22T00:06:08.287945+0000","last_active":"2023-08-22T00:06:12.670131+0000","last_peered":"2023-08-22T00:06:12.670131+0000","last_clean":"2023-08-22T00:06:12.670131+0000","last_became_active":"2023-08-22T00:06:08.287654+0000","last_became_peered":"2023-08-22T00:06:08.287654+0000","last_unstale":"2023-08-22T00:06:12.670131+0000","last_undegraded":"2023-08-22T00:06:12.670131+0000","last_fullsized":"2023-08-22T00:06:12.670131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667560+0000","last_change":"2023-08-22T00:06:08.663896+0000","last_active":"2023-08-22T00:06:12.667560+0000","last_peered":"2023-08-22T00:06:12.667560+0000","last_clean":"2023-08-22T00:06:12.667560+0000","last_became_active":"2023-08-22T00:06:08.659582+0000","last_became_peered":"2023-08-22T00:06:08.659582+0000","last_unstale":"2023-08-22T00:06:12.667560+0000","last_undegraded":"2023-08-22T00:06:12.667560+0000","last_fullsized":"2023-08-22T00:06:12.667560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.683352+0000","last_change":"2023-08-22T00:06:12.680740+0000","last_active":"2023-08-22T00:06:12.683352+0000","last_peered":"2023-08-22T00:06:12.683352+0000","last_clean":"2023-08-22T00:06:12.683352+0000","last_became_active":"2023-08-22T00:06:12.680354+0000","last_became_peered":"2023-08-22T00:06:12.680354+0000","last_unstale":"2023-08-22T00:06:12.683352+0000","last_undegraded":"2023-08-22T00:06:12.683352+0000","last_fullsized":"2023-08-22T00:06:12.683352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673712+0000","last_change":"2023-08-22T00:06:08.291655+0000","last_active":"2023-08-22T00:06:12.673712+0000","last_peered":"2023-08-22T00:06:12.673712+0000","last_clean":"2023-08-22T00:06:12.673712+0000","last_became_active":"2023-08-22T00:06:08.291408+0000","last_became_peered":"2023-08-22T00:06:08.291408+0000","last_unstale":"2023-08-22T00:06:12.673712+0000","last_undegraded":"2023-08-22T00:06:12.673712+0000","last_fullsized":"2023-08-22T00:06:12.673712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666066+0000","last_change":"2023-08-22T00:06:08.662948+0000","last_active":"2023-08-22T00:06:12.666066+0000","last_peered":"2023-08-22T00:06:12.666066+0000","last_clean":"2023-08-22T00:06:12.666066+0000","last_became_active":"2023-08-22T00:06:08.662627+0000","last_became_peered":"2023-08-22T00:06:08.662627+0000","last_unstale":"2023-08-22T00:06:12.666066+0000","last_undegraded":"2023-08-22T00:06:12.666066+0000","last_fullsized":"2023-08-22T00:06:12.666066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692108+0000","last_change":"2023-08-22T00:06:12.689153+0000","last_active":"2023-08-22T00:06:12.692108+0000","last_peered":"2023-08-22T00:06:12.692108+0000","last_clean":"2023-08-22T00:06:12.692108+0000","last_became_active":"2023-08-22T00:06:12.688700+0000","last_became_peered":"2023-08-22T00:06:12.688700+0000","last_unstale":"2023-08-22T00:06:12.692108+0000","last_undegraded":"2023-08-22T00:06:12.692108+0000","last_fullsized":"2023-08-22T00:06:12.692108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672366+0000","last_change":"2023-08-22T00:06:08.292695+0000","last_active":"2023-08-22T00:06:12.672366+0000","last_peered":"2023-08-22T00:06:12.672366+0000","last_clean":"2023-08-22T00:06:12.672366+0000","last_became_active":"2023-08-22T00:06:08.292417+0000","last_became_peered":"2023-08-22T00:06:08.292417+0000","last_unstale":"2023-08-22T00:06:12.672366+0000","last_undegraded":"2023-08-22T00:06:12.672366+0000","last_fullsized":"2023-08-22T00:06:12.672366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665496+0000","last_change":"2023-08-22T00:06:08.662935+0000","last_active":"2023-08-22T00:06:12.665496+0000","last_peered":"2023-08-22T00:06:12.665496+0000","last_clean":"2023-08-22T00:06:12.665496+0000","last_became_active":"2023-08-22T00:06:08.662634+0000","last_became_peered":"2023-08-22T00:06:08.662634+0000","last_unstale":"2023-08-22T00:06:12.665496+0000","last_undegraded":"2023-08-22T00:06:12.665496+0000","last_fullsized":"2023-08-22T00:06:12.665496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.689425+0000","last_change":"2023-08-22T00:06:12.686691+0000","last_active":"2023-08-22T00:06:12.689425+0000","last_peered":"2023-08-22T00:06:12.689425+0000","last_clean":"2023-08-22T00:06:12.689425+0000","last_became_active":"2023-08-22T00:06:12.686314+0000","last_became_peered":"2023-08-22T00:06:12.686314+0000","last_unstale":"2023-08-22T00:06:12.689425+0000","last_undegraded":"2023-08-22T00:06:12.689425+0000","last_fullsized":"2023-08-22T00:06:12.689425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702379+0000","last_change":"2023-08-22T00:06:12.697526+0000","last_active":"2023-08-22T00:06:12.702379+0000","last_peered":"2023-08-22T00:06:12.702379+0000","last_clean":"2023-08-22T00:06:12.702379+0000","last_became_active":"2023-08-22T00:06:12.697150+0000","last_became_peered":"2023-08-22T00:06:12.697150+0000","last_unstale":"2023-08-22T00:06:12.702379+0000","last_undegraded":"2023-08-22T00:06:12.702379+0000","last_fullsized":"2023-08-22T00:06:12.702379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682355+0000","last_change":"2023-08-22T00:06:08.290950+0000","last_active":"2023-08-22T00:06:12.682355+0000","last_peered":"2023-08-22T00:06:12.682355+0000","last_clean":"2023-08-22T00:06:12.682355+0000","last_became_active":"2023-08-22T00:06:08.290600+0000","last_became_peered":"2023-08-22T00:06:08.290600+0000","last_unstale":"2023-08-22T00:06:12.682355+0000","last_undegraded":"2023-08-22T00:06:12.682355+0000","last_fullsized":"2023-08-22T00:06:12.682355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671721+0000","last_change":"2023-08-22T00:06:08.654201+0000","last_active":"2023-08-22T00:06:12.671721+0000","last_peered":"2023-08-22T00:06:12.671721+0000","last_clean":"2023-08-22T00:06:12.671721+0000","last_became_active":"2023-08-22T00:06:08.653605+0000","last_became_peered":"2023-08-22T00:06:08.653605+0000","last_unstale":"2023-08-22T00:06:12.671721+0000","last_undegraded":"2023-08-22T00:06:12.671721+0000","last_fullsized":"2023-08-22T00:06:12.671721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665639+0000","last_change":"2023-08-22T00:06:08.667424+0000","last_active":"2023-08-22T00:06:12.665639+0000","last_peered":"2023-08-22T00:06:12.665639+0000","last_clean":"2023-08-22T00:06:12.665639+0000","last_became_active":"2023-08-22T00:06:08.667093+0000","last_became_peered":"2023-08-22T00:06:08.667093+0000","last_unstale":"2023-08-22T00:06:12.665639+0000","last_undegraded":"2023-08-22T00:06:12.665639+0000","last_fullsized":"2023-08-22T00:06:12.665639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680328+0000","last_change":"2023-08-22T00:06:08.285075+0000","last_active":"2023-08-22T00:06:12.680328+0000","last_peered":"2023-08-22T00:06:12.680328+0000","last_clean":"2023-08-22T00:06:12.680328+0000","last_became_active":"2023-08-22T00:06:08.284787+0000","last_became_peered":"2023-08-22T00:06:08.284787+0000","last_unstale":"2023-08-22T00:06:12.680328+0000","last_undegraded":"2023-08-22T00:06:12.680328+0000","last_fullsized":"2023-08-22T00:06:12.680328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665593+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:06:12.665593+0000","last_peered":"2023-08-22T00:06:12.665593+0000","last_clean":"2023-08-22T00:06:12.665593+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:06:12.665593+0000","last_undegraded":"2023-08-22T00:06:12.665593+0000","last_fullsized":"2023-08-22T00:06:12.665593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696704+0000","last_change":"2023-08-22T00:06:12.686550+0000","last_active":"2023-08-22T00:06:12.696704+0000","last_peered":"2023-08-22T00:06:12.696704+0000","last_clean":"2023-08-22T00:06:12.696704+0000","last_became_active":"2023-08-22T00:06:12.686171+0000","last_became_peered":"2023-08-22T00:06:12.686171+0000","last_unstale":"2023-08-22T00:06:12.696704+0000","last_undegraded":"2023-08-22T00:06:12.696704+0000","last_fullsized":"2023-08-22T00:06:12.696704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666712+0000","last_change":"2023-08-22T00:06:08.664638+0000","last_active":"2023-08-22T00:06:12.666712+0000","last_peered":"2023-08-22T00:06:12.666712+0000","last_clean":"2023-08-22T00:06:12.666712+0000","last_became_active":"2023-08-22T00:06:08.664382+0000","last_became_peered":"2023-08-22T00:06:08.664382+0000","last_unstale":"2023-08-22T00:06:12.666712+0000","last_undegraded":"2023-08-22T00:06:12.666712+0000","last_fullsized":"2023-08-22T00:06:12.666712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684583+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:06:12.684583+0000","last_peered":"2023-08-22T00:06:12.684583+0000","last_clean":"2023-08-22T00:06:12.684583+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:06:12.684583+0000","last_undegraded":"2023-08-22T00:06:12.684583+0000","last_fullsized":"2023-08-22T00:06:12.684583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670437+0000","last_change":"2023-08-22T00:06:08.285344+0000","last_active":"2023-08-22T00:06:12.670437+0000","last_peered":"2023-08-22T00:06:12.670437+0000","last_clean":"2023-08-22T00:06:12.670437+0000","last_became_active":"2023-08-22T00:06:08.285077+0000","last_became_peered":"2023-08-22T00:06:08.285077+0000","last_unstale":"2023-08-22T00:06:12.670437+0000","last_undegraded":"2023-08-22T00:06:12.670437+0000","last_fullsized":"2023-08-22T00:06:12.670437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688875+0000","last_change":"2023-08-22T00:06:12.687045+0000","last_active":"2023-08-22T00:06:12.688875+0000","last_peered":"2023-08-22T00:06:12.688875+0000","last_clean":"2023-08-22T00:06:12.688875+0000","last_became_active":"2023-08-22T00:06:12.686213+0000","last_became_peered":"2023-08-22T00:06:12.686213+0000","last_unstale":"2023-08-22T00:06:12.688875+0000","last_undegraded":"2023-08-22T00:06:12.688875+0000","last_fullsized":"2023-08-22T00:06:12.688875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682429+0000","last_change":"2023-08-22T00:06:08.656218+0000","last_active":"2023-08-22T00:06:12.682429+0000","last_peered":"2023-08-22T00:06:12.682429+0000","last_clean":"2023-08-22T00:06:12.682429+0000","last_became_active":"2023-08-22T00:06:08.655669+0000","last_became_peered":"2023-08-22T00:06:08.655669+0000","last_unstale":"2023-08-22T00:06:12.682429+0000","last_undegraded":"2023-08-22T00:06:12.682429+0000","last_fullsized":"2023-08-22T00:06:12.682429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681866+0000","last_change":"2023-08-22T00:06:08.286902+0000","last_active":"2023-08-22T00:06:12.681866+0000","last_peered":"2023-08-22T00:06:12.681866+0000","last_clean":"2023-08-22T00:06:12.681866+0000","last_became_active":"2023-08-22T00:06:08.285921+0000","last_became_peered":"2023-08-22T00:06:08.285921+0000","last_unstale":"2023-08-22T00:06:12.681866+0000","last_undegraded":"2023-08-22T00:06:12.681866+0000","last_fullsized":"2023-08-22T00:06:12.681866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677121+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:06:12.677121+0000","last_peered":"2023-08-22T00:06:12.677121+0000","last_clean":"2023-08-22T00:06:12.677121+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:06:12.677121+0000","last_undegraded":"2023-08-22T00:06:12.677121+0000","last_fullsized":"2023-08-22T00:06:12.677121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688925+0000","last_change":"2023-08-22T00:06:12.686660+0000","last_active":"2023-08-22T00:06:12.688925+0000","last_peered":"2023-08-22T00:06:12.688925+0000","last_clean":"2023-08-22T00:06:12.688925+0000","last_became_active":"2023-08-22T00:06:12.686272+0000","last_became_peered":"2023-08-22T00:06:12.686272+0000","last_unstale":"2023-08-22T00:06:12.688925+0000","last_undegraded":"2023-08-22T00:06:12.688925+0000","last_fullsized":"2023-08-22T00:06:12.688925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674247+0000","last_change":"2023-08-22T00:06:08.290975+0000","last_active":"2023-08-22T00:06:12.674247+0000","last_peered":"2023-08-22T00:06:12.674247+0000","last_clean":"2023-08-22T00:06:12.674247+0000","last_became_active":"2023-08-22T00:06:08.290710+0000","last_became_peered":"2023-08-22T00:06:08.290710+0000","last_unstale":"2023-08-22T00:06:12.674247+0000","last_undegraded":"2023-08-22T00:06:12.674247+0000","last_fullsized":"2023-08-22T00:06:12.674247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670925+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:06:12.670925+0000","last_peered":"2023-08-22T00:06:12.670925+0000","last_clean":"2023-08-22T00:06:12.670925+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:06:12.670925+0000","last_undegraded":"2023-08-22T00:06:12.670925+0000","last_fullsized":"2023-08-22T00:06:12.670925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680519+0000","last_change":"2023-08-22T00:06:08.658411+0000","last_active":"2023-08-22T00:06:12.680519+0000","last_peered":"2023-08-22T00:06:12.680519+0000","last_clean":"2023-08-22T00:06:12.680519+0000","last_became_active":"2023-08-22T00:06:08.658152+0000","last_became_peered":"2023-08-22T00:06:08.658152+0000","last_unstale":"2023-08-22T00:06:12.680519+0000","last_undegraded":"2023-08-22T00:06:12.680519+0000","last_fullsized":"2023-08-22T00:06:12.680519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692091+0000","last_change":"2023-08-22T00:06:12.688771+0000","last_active":"2023-08-22T00:06:12.692091+0000","last_peered":"2023-08-22T00:06:12.692091+0000","last_clean":"2023-08-22T00:06:12.692091+0000","last_became_active":"2023-08-22T00:06:12.688371+0000","last_became_peered":"2023-08-22T00:06:12.688371+0000","last_unstale":"2023-08-22T00:06:12.692091+0000","last_undegraded":"2023-08-22T00:06:12.692091+0000","last_fullsized":"2023-08-22T00:06:12.692091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667141+0000","last_change":"2023-08-22T00:06:08.288643+0000","last_active":"2023-08-22T00:06:12.667141+0000","last_peered":"2023-08-22T00:06:12.667141+0000","last_clean":"2023-08-22T00:06:12.667141+0000","last_became_active":"2023-08-22T00:06:08.288392+0000","last_became_peered":"2023-08-22T00:06:08.288392+0000","last_unstale":"2023-08-22T00:06:12.667141+0000","last_undegraded":"2023-08-22T00:06:12.667141+0000","last_fullsized":"2023-08-22T00:06:12.667141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670819+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:06:12.670819+0000","last_peered":"2023-08-22T00:06:12.670819+0000","last_clean":"2023-08-22T00:06:12.670819+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:06:12.670819+0000","last_undegraded":"2023-08-22T00:06:12.670819+0000","last_fullsized":"2023-08-22T00:06:12.670819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672489+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:06:12.672489+0000","last_peered":"2023-08-22T00:06:12.672489+0000","last_clean":"2023-08-22T00:06:12.672489+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:06:12.672489+0000","last_undegraded":"2023-08-22T00:06:12.672489+0000","last_fullsized":"2023-08-22T00:06:12.672489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665056+0000","last_change":"2023-08-22T00:06:08.659076+0000","last_active":"2023-08-22T00:06:12.665056+0000","last_peered":"2023-08-22T00:06:12.665056+0000","last_clean":"2023-08-22T00:06:12.665056+0000","last_became_active":"2023-08-22T00:06:08.657107+0000","last_became_peered":"2023-08-22T00:06:08.657107+0000","last_unstale":"2023-08-22T00:06:12.665056+0000","last_undegraded":"2023-08-22T00:06:12.665056+0000","last_fullsized":"2023-08-22T00:06:12.665056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685134+0000","last_change":"2023-08-22T00:06:12.681352+0000","last_active":"2023-08-22T00:06:12.685134+0000","last_peered":"2023-08-22T00:06:12.685134+0000","last_clean":"2023-08-22T00:06:12.685134+0000","last_became_active":"2023-08-22T00:06:12.680899+0000","last_became_peered":"2023-08-22T00:06:12.680899+0000","last_unstale":"2023-08-22T00:06:12.685134+0000","last_undegraded":"2023-08-22T00:06:12.685134+0000","last_fullsized":"2023-08-22T00:06:12.685134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677342+0000","last_change":"2023-08-22T00:06:08.287022+0000","last_active":"2023-08-22T00:06:12.677342+0000","last_peered":"2023-08-22T00:06:12.677342+0000","last_clean":"2023-08-22T00:06:12.677342+0000","last_became_active":"2023-08-22T00:06:08.285832+0000","last_became_peered":"2023-08-22T00:06:08.285832+0000","last_unstale":"2023-08-22T00:06:12.677342+0000","last_undegraded":"2023-08-22T00:06:12.677342+0000","last_fullsized":"2023-08-22T00:06:12.677342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670558+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:06:12.670558+0000","last_peered":"2023-08-22T00:06:12.670558+0000","last_clean":"2023-08-22T00:06:12.670558+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:06:12.670558+0000","last_undegraded":"2023-08-22T00:06:12.670558+0000","last_fullsized":"2023-08-22T00:06:12.670558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684997+0000","last_change":"2023-08-22T00:06:08.653884+0000","last_active":"2023-08-22T00:06:12.684997+0000","last_peered":"2023-08-22T00:06:12.684997+0000","last_clean":"2023-08-22T00:06:12.684997+0000","last_became_active":"2023-08-22T00:06:08.653713+0000","last_became_peered":"2023-08-22T00:06:08.653713+0000","last_unstale":"2023-08-22T00:06:12.684997+0000","last_undegraded":"2023-08-22T00:06:12.684997+0000","last_fullsized":"2023-08-22T00:06:12.684997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693863+0000","last_change":"2023-08-22T00:06:12.685577+0000","last_active":"2023-08-22T00:06:12.693863+0000","last_peered":"2023-08-22T00:06:12.693863+0000","last_clean":"2023-08-22T00:06:12.693863+0000","last_became_active":"2023-08-22T00:06:12.685126+0000","last_became_peered":"2023-08-22T00:06:12.685126+0000","last_unstale":"2023-08-22T00:06:12.693863+0000","last_undegraded":"2023-08-22T00:06:12.693863+0000","last_fullsized":"2023-08-22T00:06:12.693863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681621+0000","last_change":"2023-08-22T00:06:08.652088+0000","last_active":"2023-08-22T00:06:12.681621+0000","last_peered":"2023-08-22T00:06:12.681621+0000","last_clean":"2023-08-22T00:06:12.681621+0000","last_became_active":"2023-08-22T00:06:08.651847+0000","last_became_peered":"2023-08-22T00:06:08.651847+0000","last_unstale":"2023-08-22T00:06:12.681621+0000","last_undegraded":"2023-08-22T00:06:12.681621+0000","last_fullsized":"2023-08-22T00:06:12.681621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665579+0000","last_change":"2023-08-22T00:06:08.290805+0000","last_active":"2023-08-22T00:06:12.665579+0000","last_peered":"2023-08-22T00:06:12.665579+0000","last_clean":"2023-08-22T00:06:12.665579+0000","last_became_active":"2023-08-22T00:06:08.290543+0000","last_became_peered":"2023-08-22T00:06:08.290543+0000","last_unstale":"2023-08-22T00:06:12.665579+0000","last_undegraded":"2023-08-22T00:06:12.665579+0000","last_fullsized":"2023-08-22T00:06:12.665579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673003+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:06:12.673003+0000","last_peered":"2023-08-22T00:06:12.673003+0000","last_clean":"2023-08-22T00:06:12.673003+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:06:12.673003+0000","last_undegraded":"2023-08-22T00:06:12.673003+0000","last_fullsized":"2023-08-22T00:06:12.673003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691389+0000","last_change":"2023-08-22T00:06:12.686780+0000","last_active":"2023-08-22T00:06:12.691389+0000","last_peered":"2023-08-22T00:06:12.691389+0000","last_clean":"2023-08-22T00:06:12.691389+0000","last_became_active":"2023-08-22T00:06:12.686462+0000","last_became_peered":"2023-08-22T00:06:12.686462+0000","last_unstale":"2023-08-22T00:06:12.691389+0000","last_undegraded":"2023-08-22T00:06:12.691389+0000","last_fullsized":"2023-08-22T00:06:12.691389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681816+0000","last_change":"2023-08-22T00:06:08.655816+0000","last_active":"2023-08-22T00:06:12.681816+0000","last_peered":"2023-08-22T00:06:12.681816+0000","last_clean":"2023-08-22T00:06:12.681816+0000","last_became_active":"2023-08-22T00:06:08.655543+0000","last_became_peered":"2023-08-22T00:06:08.655543+0000","last_unstale":"2023-08-22T00:06:12.681816+0000","last_undegraded":"2023-08-22T00:06:12.681816+0000","last_fullsized":"2023-08-22T00:06:12.681816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673810+0000","last_change":"2023-08-22T00:06:08.293689+0000","last_active":"2023-08-22T00:06:12.673810+0000","last_peered":"2023-08-22T00:06:12.673810+0000","last_clean":"2023-08-22T00:06:12.673810+0000","last_became_active":"2023-08-22T00:06:08.293345+0000","last_became_peered":"2023-08-22T00:06:08.293345+0000","last_unstale":"2023-08-22T00:06:12.673810+0000","last_undegraded":"2023-08-22T00:06:12.673810+0000","last_fullsized":"2023-08-22T00:06:12.673810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681700+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:06:12.681700+0000","last_peered":"2023-08-22T00:06:12.681700+0000","last_clean":"2023-08-22T00:06:12.681700+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:06:12.681700+0000","last_undegraded":"2023-08-22T00:06:12.681700+0000","last_fullsized":"2023-08-22T00:06:12.681700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693109+0000","last_change":"2023-08-22T00:06:12.687580+0000","last_active":"2023-08-22T00:06:12.693109+0000","last_peered":"2023-08-22T00:06:12.693109+0000","last_clean":"2023-08-22T00:06:12.693109+0000","last_became_active":"2023-08-22T00:06:12.687255+0000","last_became_peered":"2023-08-22T00:06:12.687255+0000","last_unstale":"2023-08-22T00:06:12.693109+0000","last_undegraded":"2023-08-22T00:06:12.693109+0000","last_fullsized":"2023-08-22T00:06:12.693109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666637+0000","last_change":"2023-08-22T00:06:08.286120+0000","last_active":"2023-08-22T00:06:12.666637+0000","last_peered":"2023-08-22T00:06:12.666637+0000","last_clean":"2023-08-22T00:06:12.666637+0000","last_became_active":"2023-08-22T00:06:08.285828+0000","last_became_peered":"2023-08-22T00:06:08.285828+0000","last_unstale":"2023-08-22T00:06:12.666637+0000","last_undegraded":"2023-08-22T00:06:12.666637+0000","last_fullsized":"2023-08-22T00:06:12.666637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685079+0000","last_change":"2023-08-22T00:06:08.665123+0000","last_active":"2023-08-22T00:06:12.685079+0000","last_peered":"2023-08-22T00:06:12.685079+0000","last_clean":"2023-08-22T00:06:12.685079+0000","last_became_active":"2023-08-22T00:06:08.664679+0000","last_became_peered":"2023-08-22T00:06:08.664679+0000","last_unstale":"2023-08-22T00:06:12.685079+0000","last_undegraded":"2023-08-22T00:06:12.685079+0000","last_fullsized":"2023-08-22T00:06:12.685079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691293+0000","last_change":"2023-08-22T00:06:12.689186+0000","last_active":"2023-08-22T00:06:12.691293+0000","last_peered":"2023-08-22T00:06:12.691293+0000","last_clean":"2023-08-22T00:06:12.691293+0000","last_became_active":"2023-08-22T00:06:12.688721+0000","last_became_peered":"2023-08-22T00:06:12.688721+0000","last_unstale":"2023-08-22T00:06:12.691293+0000","last_undegraded":"2023-08-22T00:06:12.691293+0000","last_fullsized":"2023-08-22T00:06:12.691293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665445+0000","last_change":"2023-08-22T00:06:08.286239+0000","last_active":"2023-08-22T00:06:12.665445+0000","last_peered":"2023-08-22T00:06:12.665445+0000","last_clean":"2023-08-22T00:06:12.665445+0000","last_became_active":"2023-08-22T00:06:08.285947+0000","last_became_peered":"2023-08-22T00:06:08.285947+0000","last_unstale":"2023-08-22T00:06:12.665445+0000","last_undegraded":"2023-08-22T00:06:12.665445+0000","last_fullsized":"2023-08-22T00:06:12.665445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666624+0000","last_change":"2023-08-22T00:06:08.669823+0000","last_active":"2023-08-22T00:06:12.666624+0000","last_peered":"2023-08-22T00:06:12.666624+0000","last_clean":"2023-08-22T00:06:12.666624+0000","last_became_active":"2023-08-22T00:06:08.669205+0000","last_became_peered":"2023-08-22T00:06:08.669205+0000","last_unstale":"2023-08-22T00:06:12.666624+0000","last_undegraded":"2023-08-22T00:06:12.666624+0000","last_fullsized":"2023-08-22T00:06:12.666624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685064+0000","last_change":"2023-08-22T00:06:12.683405+0000","last_active":"2023-08-22T00:06:12.685064+0000","last_peered":"2023-08-22T00:06:12.685064+0000","last_clean":"2023-08-22T00:06:12.685064+0000","last_became_active":"2023-08-22T00:06:12.682920+0000","last_became_peered":"2023-08-22T00:06:12.682920+0000","last_unstale":"2023-08-22T00:06:12.685064+0000","last_undegraded":"2023-08-22T00:06:12.685064+0000","last_fullsized":"2023-08-22T00:06:12.685064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666050+0000","last_change":"2023-08-22T00:06:08.293922+0000","last_active":"2023-08-22T00:06:12.666050+0000","last_peered":"2023-08-22T00:06:12.666050+0000","last_clean":"2023-08-22T00:06:12.666050+0000","last_became_active":"2023-08-22T00:06:08.293634+0000","last_became_peered":"2023-08-22T00:06:08.293634+0000","last_unstale":"2023-08-22T00:06:12.666050+0000","last_undegraded":"2023-08-22T00:06:12.666050+0000","last_fullsized":"2023-08-22T00:06:12.666050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665867+0000","last_change":"2023-08-22T00:06:08.660591+0000","last_active":"2023-08-22T00:06:12.665867+0000","last_peered":"2023-08-22T00:06:12.665867+0000","last_clean":"2023-08-22T00:06:12.665867+0000","last_became_active":"2023-08-22T00:06:08.659961+0000","last_became_peered":"2023-08-22T00:06:08.659961+0000","last_unstale":"2023-08-22T00:06:12.665867+0000","last_undegraded":"2023-08-22T00:06:12.665867+0000","last_fullsized":"2023-08-22T00:06:12.665867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701768+0000","last_change":"2023-08-22T00:06:12.689578+0000","last_active":"2023-08-22T00:06:12.701768+0000","last_peered":"2023-08-22T00:06:12.701768+0000","last_clean":"2023-08-22T00:06:12.701768+0000","last_became_active":"2023-08-22T00:06:12.689081+0000","last_became_peered":"2023-08-22T00:06:12.689081+0000","last_unstale":"2023-08-22T00:06:12.701768+0000","last_undegraded":"2023-08-22T00:06:12.701768+0000","last_fullsized":"2023-08-22T00:06:12.701768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667259+0000","last_change":"2023-08-22T00:06:08.287748+0000","last_active":"2023-08-22T00:06:12.667259+0000","last_peered":"2023-08-22T00:06:12.667259+0000","last_clean":"2023-08-22T00:06:12.667259+0000","last_became_active":"2023-08-22T00:06:08.287494+0000","last_became_peered":"2023-08-22T00:06:08.287494+0000","last_unstale":"2023-08-22T00:06:12.667259+0000","last_undegraded":"2023-08-22T00:06:12.667259+0000","last_fullsized":"2023-08-22T00:06:12.667259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667054+0000","last_change":"2023-08-22T00:06:08.670010+0000","last_active":"2023-08-22T00:06:12.667054+0000","last_peered":"2023-08-22T00:06:12.667054+0000","last_clean":"2023-08-22T00:06:12.667054+0000","last_became_active":"2023-08-22T00:06:08.669725+0000","last_became_peered":"2023-08-22T00:06:08.669725+0000","last_unstale":"2023-08-22T00:06:12.667054+0000","last_undegraded":"2023-08-22T00:06:12.667054+0000","last_fullsized":"2023-08-22T00:06:12.667054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693735+0000","last_change":"2023-08-22T00:06:12.682981+0000","last_active":"2023-08-22T00:06:12.693735+0000","last_peered":"2023-08-22T00:06:12.693735+0000","last_clean":"2023-08-22T00:06:12.693735+0000","last_became_active":"2023-08-22T00:06:12.682564+0000","last_became_peered":"2023-08-22T00:06:12.682564+0000","last_unstale":"2023-08-22T00:06:12.693735+0000","last_undegraded":"2023-08-22T00:06:12.693735+0000","last_fullsized":"2023-08-22T00:06:12.693735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672285+0000","last_change":"2023-08-22T00:06:08.289593+0000","last_active":"2023-08-22T00:06:12.672285+0000","last_peered":"2023-08-22T00:06:12.672285+0000","last_clean":"2023-08-22T00:06:12.672285+0000","last_became_active":"2023-08-22T00:06:08.289269+0000","last_became_peered":"2023-08-22T00:06:08.289269+0000","last_unstale":"2023-08-22T00:06:12.672285+0000","last_undegraded":"2023-08-22T00:06:12.672285+0000","last_fullsized":"2023-08-22T00:06:12.672285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682276+0000","last_change":"2023-08-22T00:06:08.657006+0000","last_active":"2023-08-22T00:06:12.682276+0000","last_peered":"2023-08-22T00:06:12.682276+0000","last_clean":"2023-08-22T00:06:12.682276+0000","last_became_active":"2023-08-22T00:06:08.656769+0000","last_became_peered":"2023-08-22T00:06:08.656769+0000","last_unstale":"2023-08-22T00:06:12.682276+0000","last_undegraded":"2023-08-22T00:06:12.682276+0000","last_fullsized":"2023-08-22T00:06:12.682276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693819+0000","last_change":"2023-08-22T00:06:12.684195+0000","last_active":"2023-08-22T00:06:12.693819+0000","last_peered":"2023-08-22T00:06:12.693819+0000","last_clean":"2023-08-22T00:06:12.693819+0000","last_became_active":"2023-08-22T00:06:12.683612+0000","last_became_peered":"2023-08-22T00:06:12.683612+0000","last_unstale":"2023-08-22T00:06:12.693819+0000","last_undegraded":"2023-08-22T00:06:12.693819+0000","last_fullsized":"2023-08-22T00:06:12.693819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677098+0000","last_change":"2023-08-22T00:06:08.291933+0000","last_active":"2023-08-22T00:06:12.677098+0000","last_peered":"2023-08-22T00:06:12.677098+0000","last_clean":"2023-08-22T00:06:12.677098+0000","last_became_active":"2023-08-22T00:06:08.291627+0000","last_became_peered":"2023-08-22T00:06:08.291627+0000","last_unstale":"2023-08-22T00:06:12.677098+0000","last_undegraded":"2023-08-22T00:06:12.677098+0000","last_fullsized":"2023-08-22T00:06:12.677098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665964+0000","last_change":"2023-08-22T00:06:08.663881+0000","last_active":"2023-08-22T00:06:12.665964+0000","last_peered":"2023-08-22T00:06:12.665964+0000","last_clean":"2023-08-22T00:06:12.665964+0000","last_became_active":"2023-08-22T00:06:08.663600+0000","last_became_peered":"2023-08-22T00:06:08.663600+0000","last_unstale":"2023-08-22T00:06:12.665964+0000","last_undegraded":"2023-08-22T00:06:12.665964+0000","last_fullsized":"2023-08-22T00:06:12.665964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693913+0000","last_change":"2023-08-22T00:06:12.689051+0000","last_active":"2023-08-22T00:06:12.693913+0000","last_peered":"2023-08-22T00:06:12.693913+0000","last_clean":"2023-08-22T00:06:12.693913+0000","last_became_active":"2023-08-22T00:06:12.688661+0000","last_became_peered":"2023-08-22T00:06:12.688661+0000","last_unstale":"2023-08-22T00:06:12.693913+0000","last_undegraded":"2023-08-22T00:06:12.693913+0000","last_fullsized":"2023-08-22T00:06:12.693913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677466+0000","last_change":"2023-08-22T00:06:08.294656+0000","last_active":"2023-08-22T00:06:12.677466+0000","last_peered":"2023-08-22T00:06:12.677466+0000","last_clean":"2023-08-22T00:06:12.677466+0000","last_became_active":"2023-08-22T00:06:08.292560+0000","last_became_peered":"2023-08-22T00:06:08.292560+0000","last_unstale":"2023-08-22T00:06:12.677466+0000","last_undegraded":"2023-08-22T00:06:12.677466+0000","last_fullsized":"2023-08-22T00:06:12.677466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665464+0000","last_change":"2023-08-22T00:06:08.666434+0000","last_active":"2023-08-22T00:06:12.665464+0000","last_peered":"2023-08-22T00:06:12.665464+0000","last_clean":"2023-08-22T00:06:12.665464+0000","last_became_active":"2023-08-22T00:06:08.663063+0000","last_became_peered":"2023-08-22T00:06:08.663063+0000","last_unstale":"2023-08-22T00:06:12.665464+0000","last_undegraded":"2023-08-22T00:06:12.665464+0000","last_fullsized":"2023-08-22T00:06:12.665464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693999+0000","last_change":"2023-08-22T00:06:12.692897+0000","last_active":"2023-08-22T00:06:12.693999+0000","last_peered":"2023-08-22T00:06:12.693999+0000","last_clean":"2023-08-22T00:06:12.693999+0000","last_became_active":"2023-08-22T00:06:12.692484+0000","last_became_peered":"2023-08-22T00:06:12.692484+0000","last_unstale":"2023-08-22T00:06:12.693999+0000","last_undegraded":"2023-08-22T00:06:12.693999+0000","last_fullsized":"2023-08-22T00:06:12.693999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678309+0000","last_change":"2023-08-22T00:06:08.295114+0000","last_active":"2023-08-22T00:06:12.678309+0000","last_peered":"2023-08-22T00:06:12.678309+0000","last_clean":"2023-08-22T00:06:12.678309+0000","last_became_active":"2023-08-22T00:06:08.294743+0000","last_became_peered":"2023-08-22T00:06:08.294743+0000","last_unstale":"2023-08-22T00:06:12.678309+0000","last_undegraded":"2023-08-22T00:06:12.678309+0000","last_fullsized":"2023-08-22T00:06:12.678309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672539+0000","last_change":"2023-08-22T00:06:08.664800+0000","last_active":"2023-08-22T00:06:12.672539+0000","last_peered":"2023-08-22T00:06:12.672539+0000","last_clean":"2023-08-22T00:06:12.672539+0000","last_became_active":"2023-08-22T00:06:08.664511+0000","last_became_peered":"2023-08-22T00:06:08.664511+0000","last_unstale":"2023-08-22T00:06:12.672539+0000","last_undegraded":"2023-08-22T00:06:12.672539+0000","last_fullsized":"2023-08-22T00:06:12.672539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688234+0000","last_change":"2023-08-22T00:06:12.684602+0000","last_active":"2023-08-22T00:06:12.688234+0000","last_peered":"2023-08-22T00:06:12.688234+0000","last_clean":"2023-08-22T00:06:12.688234+0000","last_became_active":"2023-08-22T00:06:12.684197+0000","last_became_peered":"2023-08-22T00:06:12.684197+0000","last_unstale":"2023-08-22T00:06:12.688234+0000","last_undegraded":"2023-08-22T00:06:12.688234+0000","last_fullsized":"2023-08-22T00:06:12.688234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664815+0000","last_change":"2023-08-22T00:06:08.282647+0000","last_active":"2023-08-22T00:06:12.664815+0000","last_peered":"2023-08-22T00:06:12.664815+0000","last_clean":"2023-08-22T00:06:12.664815+0000","last_became_active":"2023-08-22T00:06:08.282022+0000","last_became_peered":"2023-08-22T00:06:08.282022+0000","last_unstale":"2023-08-22T00:06:12.664815+0000","last_undegraded":"2023-08-22T00:06:12.664815+0000","last_fullsized":"2023-08-22T00:06:12.664815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670644+0000","last_change":"2023-08-22T00:06:08.668740+0000","last_active":"2023-08-22T00:06:12.670644+0000","last_peered":"2023-08-22T00:06:12.670644+0000","last_clean":"2023-08-22T00:06:12.670644+0000","last_became_active":"2023-08-22T00:06:08.668441+0000","last_became_peered":"2023-08-22T00:06:08.668441+0000","last_unstale":"2023-08-22T00:06:12.670644+0000","last_undegraded":"2023-08-22T00:06:12.670644+0000","last_fullsized":"2023-08-22T00:06:12.670644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692932+0000","last_change":"2023-08-22T00:06:12.691493+0000","last_active":"2023-08-22T00:06:12.692932+0000","last_peered":"2023-08-22T00:06:12.692932+0000","last_clean":"2023-08-22T00:06:12.692932+0000","last_became_active":"2023-08-22T00:06:12.691093+0000","last_became_peered":"2023-08-22T00:06:12.691093+0000","last_unstale":"2023-08-22T00:06:12.692932+0000","last_undegraded":"2023-08-22T00:06:12.692932+0000","last_fullsized":"2023-08-22T00:06:12.692932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671568+0000","last_change":"2023-08-22T00:06:08.292035+0000","last_active":"2023-08-22T00:06:12.671568+0000","last_peered":"2023-08-22T00:06:12.671568+0000","last_clean":"2023-08-22T00:06:12.671568+0000","last_became_active":"2023-08-22T00:06:08.291203+0000","last_became_peered":"2023-08-22T00:06:08.291203+0000","last_unstale":"2023-08-22T00:06:12.671568+0000","last_undegraded":"2023-08-22T00:06:12.671568+0000","last_fullsized":"2023-08-22T00:06:12.671568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680614+0000","last_change":"2023-08-22T00:06:08.655585+0000","last_active":"2023-08-22T00:06:12.680614+0000","last_peered":"2023-08-22T00:06:12.680614+0000","last_clean":"2023-08-22T00:06:12.680614+0000","last_became_active":"2023-08-22T00:06:08.655310+0000","last_became_peered":"2023-08-22T00:06:08.655310+0000","last_unstale":"2023-08-22T00:06:12.680614+0000","last_undegraded":"2023-08-22T00:06:12.680614+0000","last_fullsized":"2023-08-22T00:06:12.680614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699073+0000","last_change":"2023-08-22T00:06:12.688045+0000","last_active":"2023-08-22T00:06:12.699073+0000","last_peered":"2023-08-22T00:06:12.699073+0000","last_clean":"2023-08-22T00:06:12.699073+0000","last_became_active":"2023-08-22T00:06:12.687684+0000","last_became_peered":"2023-08-22T00:06:12.687684+0000","last_unstale":"2023-08-22T00:06:12.699073+0000","last_undegraded":"2023-08-22T00:06:12.699073+0000","last_fullsized":"2023-08-22T00:06:12.699073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673315+0000","last_change":"2023-08-22T00:06:08.286986+0000","last_active":"2023-08-22T00:06:12.673315+0000","last_peered":"2023-08-22T00:06:12.673315+0000","last_clean":"2023-08-22T00:06:12.673315+0000","last_became_active":"2023-08-22T00:06:08.285641+0000","last_became_peered":"2023-08-22T00:06:08.285641+0000","last_unstale":"2023-08-22T00:06:12.673315+0000","last_undegraded":"2023-08-22T00:06:12.673315+0000","last_fullsized":"2023-08-22T00:06:12.673315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673919+0000","last_change":"2023-08-22T00:06:08.668481+0000","last_active":"2023-08-22T00:06:12.673919+0000","last_peered":"2023-08-22T00:06:12.673919+0000","last_clean":"2023-08-22T00:06:12.673919+0000","last_became_active":"2023-08-22T00:06:08.668192+0000","last_became_peered":"2023-08-22T00:06:08.668192+0000","last_unstale":"2023-08-22T00:06:12.673919+0000","last_undegraded":"2023-08-22T00:06:12.673919+0000","last_fullsized":"2023-08-22T00:06:12.673919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696626+0000","last_change":"2023-08-22T00:06:12.684100+0000","last_active":"2023-08-22T00:06:12.696626+0000","last_peered":"2023-08-22T00:06:12.696626+0000","last_clean":"2023-08-22T00:06:12.696626+0000","last_became_active":"2023-08-22T00:06:12.683707+0000","last_became_peered":"2023-08-22T00:06:12.683707+0000","last_unstale":"2023-08-22T00:06:12.696626+0000","last_undegraded":"2023-08-22T00:06:12.696626+0000","last_fullsized":"2023-08-22T00:06:12.696626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673189+0000","last_change":"2023-08-22T00:06:08.294557+0000","last_active":"2023-08-22T00:06:12.673189+0000","last_peered":"2023-08-22T00:06:12.673189+0000","last_clean":"2023-08-22T00:06:12.673189+0000","last_became_active":"2023-08-22T00:06:08.292498+0000","last_became_peered":"2023-08-22T00:06:08.292498+0000","last_unstale":"2023-08-22T00:06:12.673189+0000","last_undegraded":"2023-08-22T00:06:12.673189+0000","last_fullsized":"2023-08-22T00:06:12.673189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669639+0000","last_change":"2023-08-22T00:06:08.664640+0000","last_active":"2023-08-22T00:06:12.669639+0000","last_peered":"2023-08-22T00:06:12.669639+0000","last_clean":"2023-08-22T00:06:12.669639+0000","last_became_active":"2023-08-22T00:06:08.664404+0000","last_became_peered":"2023-08-22T00:06:08.664404+0000","last_unstale":"2023-08-22T00:06:12.669639+0000","last_undegraded":"2023-08-22T00:06:12.669639+0000","last_fullsized":"2023-08-22T00:06:12.669639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692623+0000","last_change":"2023-08-22T00:06:12.691313+0000","last_active":"2023-08-22T00:06:12.692623+0000","last_peered":"2023-08-22T00:06:12.692623+0000","last_clean":"2023-08-22T00:06:12.692623+0000","last_became_active":"2023-08-22T00:06:12.690888+0000","last_became_peered":"2023-08-22T00:06:12.690888+0000","last_unstale":"2023-08-22T00:06:12.692623+0000","last_undegraded":"2023-08-22T00:06:12.692623+0000","last_fullsized":"2023-08-22T00:06:12.692623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667060+0000","last_change":"2023-08-22T00:06:08.292435+0000","last_active":"2023-08-22T00:06:12.667060+0000","last_peered":"2023-08-22T00:06:12.667060+0000","last_clean":"2023-08-22T00:06:12.667060+0000","last_became_active":"2023-08-22T00:06:08.292078+0000","last_became_peered":"2023-08-22T00:06:08.292078+0000","last_unstale":"2023-08-22T00:06:12.667060+0000","last_undegraded":"2023-08-22T00:06:12.667060+0000","last_fullsized":"2023-08-22T00:06:12.667060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665745+0000","last_change":"2023-08-22T00:06:08.670166+0000","last_active":"2023-08-22T00:06:12.665745+0000","last_peered":"2023-08-22T00:06:12.665745+0000","last_clean":"2023-08-22T00:06:12.665745+0000","last_became_active":"2023-08-22T00:06:08.669343+0000","last_became_peered":"2023-08-22T00:06:08.669343+0000","last_unstale":"2023-08-22T00:06:12.665745+0000","last_undegraded":"2023-08-22T00:06:12.665745+0000","last_fullsized":"2023-08-22T00:06:12.665745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702398+0000","last_change":"2023-08-22T00:06:12.697624+0000","last_active":"2023-08-22T00:06:12.702398+0000","last_peered":"2023-08-22T00:06:12.702398+0000","last_clean":"2023-08-22T00:06:12.702398+0000","last_became_active":"2023-08-22T00:06:12.697230+0000","last_became_peered":"2023-08-22T00:06:12.697230+0000","last_unstale":"2023-08-22T00:06:12.702398+0000","last_undegraded":"2023-08-22T00:06:12.702398+0000","last_fullsized":"2023-08-22T00:06:12.702398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677201+0000","last_change":"2023-08-22T00:06:08.288780+0000","last_active":"2023-08-22T00:06:12.677201+0000","last_peered":"2023-08-22T00:06:12.677201+0000","last_clean":"2023-08-22T00:06:12.677201+0000","last_became_active":"2023-08-22T00:06:08.288449+0000","last_became_peered":"2023-08-22T00:06:08.288449+0000","last_unstale":"2023-08-22T00:06:12.677201+0000","last_undegraded":"2023-08-22T00:06:12.677201+0000","last_fullsized":"2023-08-22T00:06:12.677201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681899+0000","last_change":"2023-08-22T00:06:08.658370+0000","last_active":"2023-08-22T00:06:12.681899+0000","last_peered":"2023-08-22T00:06:12.681899+0000","last_clean":"2023-08-22T00:06:12.681899+0000","last_became_active":"2023-08-22T00:06:08.658088+0000","last_became_peered":"2023-08-22T00:06:08.658088+0000","last_unstale":"2023-08-22T00:06:12.681899+0000","last_undegraded":"2023-08-22T00:06:12.681899+0000","last_fullsized":"2023-08-22T00:06:12.681899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699205+0000","last_change":"2023-08-22T00:06:12.690837+0000","last_active":"2023-08-22T00:06:12.699205+0000","last_peered":"2023-08-22T00:06:12.699205+0000","last_clean":"2023-08-22T00:06:12.699205+0000","last_became_active":"2023-08-22T00:06:12.690046+0000","last_became_peered":"2023-08-22T00:06:12.690046+0000","last_unstale":"2023-08-22T00:06:12.699205+0000","last_undegraded":"2023-08-22T00:06:12.699205+0000","last_fullsized":"2023-08-22T00:06:12.699205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674238+0000","last_change":"2023-08-22T00:06:08.298405+0000","last_active":"2023-08-22T00:06:12.674238+0000","last_peered":"2023-08-22T00:06:12.674238+0000","last_clean":"2023-08-22T00:06:12.674238+0000","last_became_active":"2023-08-22T00:06:08.298085+0000","last_became_peered":"2023-08-22T00:06:08.298085+0000","last_unstale":"2023-08-22T00:06:12.674238+0000","last_undegraded":"2023-08-22T00:06:12.674238+0000","last_fullsized":"2023-08-22T00:06:12.674238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667438+0000","last_change":"2023-08-22T00:06:08.664353+0000","last_active":"2023-08-22T00:06:12.667438+0000","last_peered":"2023-08-22T00:06:12.667438+0000","last_clean":"2023-08-22T00:06:12.667438+0000","last_became_active":"2023-08-22T00:06:08.664104+0000","last_became_peered":"2023-08-22T00:06:08.664104+0000","last_unstale":"2023-08-22T00:06:12.667438+0000","last_undegraded":"2023-08-22T00:06:12.667438+0000","last_fullsized":"2023-08-22T00:06:12.667438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691805+0000","last_change":"2023-08-22T00:06:12.688530+0000","last_active":"2023-08-22T00:06:12.691805+0000","last_peered":"2023-08-22T00:06:12.691805+0000","last_clean":"2023-08-22T00:06:12.691805+0000","last_became_active":"2023-08-22T00:06:12.688138+0000","last_became_peered":"2023-08-22T00:06:12.688138+0000","last_unstale":"2023-08-22T00:06:12.691805+0000","last_undegraded":"2023-08-22T00:06:12.691805+0000","last_fullsized":"2023-08-22T00:06:12.691805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673548+0000","last_change":"2023-08-22T00:06:08.286478+0000","last_active":"2023-08-22T00:06:12.673548+0000","last_peered":"2023-08-22T00:06:12.673548+0000","last_clean":"2023-08-22T00:06:12.673548+0000","last_became_active":"2023-08-22T00:06:08.285839+0000","last_became_peered":"2023-08-22T00:06:08.285839+0000","last_unstale":"2023-08-22T00:06:12.673548+0000","last_undegraded":"2023-08-22T00:06:12.673548+0000","last_fullsized":"2023-08-22T00:06:12.673548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666553+0000","last_change":"2023-08-22T00:06:08.660300+0000","last_active":"2023-08-22T00:06:12.666553+0000","last_peered":"2023-08-22T00:06:12.666553+0000","last_clean":"2023-08-22T00:06:12.666553+0000","last_became_active":"2023-08-22T00:06:08.660029+0000","last_became_peered":"2023-08-22T00:06:08.660029+0000","last_unstale":"2023-08-22T00:06:12.666553+0000","last_undegraded":"2023-08-22T00:06:12.666553+0000","last_fullsized":"2023-08-22T00:06:12.666553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682861+0000","last_change":"2023-08-22T00:06:12.680840+0000","last_active":"2023-08-22T00:06:12.682861+0000","last_peered":"2023-08-22T00:06:12.682861+0000","last_clean":"2023-08-22T00:06:12.682861+0000","last_became_active":"2023-08-22T00:06:12.680150+0000","last_became_peered":"2023-08-22T00:06:12.680150+0000","last_unstale":"2023-08-22T00:06:12.682861+0000","last_undegraded":"2023-08-22T00:06:12.682861+0000","last_fullsized":"2023-08-22T00:06:12.682861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702263+0000","last_change":"2023-08-22T00:06:12.697155+0000","last_active":"2023-08-22T00:06:12.702263+0000","last_peered":"2023-08-22T00:06:12.702263+0000","last_clean":"2023-08-22T00:06:12.702263+0000","last_became_active":"2023-08-22T00:06:12.696776+0000","last_became_peered":"2023-08-22T00:06:12.696776+0000","last_unstale":"2023-08-22T00:06:12.702263+0000","last_undegraded":"2023-08-22T00:06:12.702263+0000","last_fullsized":"2023-08-22T00:06:12.702263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666911+0000","last_change":"2023-08-22T00:06:08.290382+0000","last_active":"2023-08-22T00:06:12.666911+0000","last_peered":"2023-08-22T00:06:12.666911+0000","last_clean":"2023-08-22T00:06:12.666911+0000","last_became_active":"2023-08-22T00:06:08.289805+0000","last_became_peered":"2023-08-22T00:06:08.289805+0000","last_unstale":"2023-08-22T00:06:12.666911+0000","last_undegraded":"2023-08-22T00:06:12.666911+0000","last_fullsized":"2023-08-22T00:06:12.666911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665485+0000","last_change":"2023-08-22T00:06:08.660218+0000","last_active":"2023-08-22T00:06:12.665485+0000","last_peered":"2023-08-22T00:06:12.665485+0000","last_clean":"2023-08-22T00:06:12.665485+0000","last_became_active":"2023-08-22T00:06:08.657393+0000","last_became_peered":"2023-08-22T00:06:08.657393+0000","last_unstale":"2023-08-22T00:06:12.665485+0000","last_undegraded":"2023-08-22T00:06:12.665485+0000","last_fullsized":"2023-08-22T00:06:12.665485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685964+0000","last_change":"2023-08-22T00:06:12.679635+0000","last_active":"2023-08-22T00:06:12.685964+0000","last_peered":"2023-08-22T00:06:12.685964+0000","last_clean":"2023-08-22T00:06:12.685964+0000","last_became_active":"2023-08-22T00:06:12.679242+0000","last_became_peered":"2023-08-22T00:06:12.679242+0000","last_unstale":"2023-08-22T00:06:12.685964+0000","last_undegraded":"2023-08-22T00:06:12.685964+0000","last_fullsized":"2023-08-22T00:06:12.685964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678592+0000","last_change":"2023-08-22T00:06:08.281551+0000","last_active":"2023-08-22T00:06:12.678592+0000","last_peered":"2023-08-22T00:06:12.678592+0000","last_clean":"2023-08-22T00:06:12.678592+0000","last_became_active":"2023-08-22T00:06:08.281148+0000","last_became_peered":"2023-08-22T00:06:08.281148+0000","last_unstale":"2023-08-22T00:06:12.678592+0000","last_undegraded":"2023-08-22T00:06:12.678592+0000","last_fullsized":"2023-08-22T00:06:12.678592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680434+0000","last_change":"2023-08-22T00:06:08.667817+0000","last_active":"2023-08-22T00:06:12.680434+0000","last_peered":"2023-08-22T00:06:12.680434+0000","last_clean":"2023-08-22T00:06:12.680434+0000","last_became_active":"2023-08-22T00:06:08.667588+0000","last_became_peered":"2023-08-22T00:06:08.667588+0000","last_unstale":"2023-08-22T00:06:12.680434+0000","last_undegraded":"2023-08-22T00:06:12.680434+0000","last_fullsized":"2023-08-22T00:06:12.680434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666260+0000","last_change":"2023-08-22T00:06:08.285483+0000","last_active":"2023-08-22T00:06:12.666260+0000","last_peered":"2023-08-22T00:06:12.666260+0000","last_clean":"2023-08-22T00:06:12.666260+0000","last_became_active":"2023-08-22T00:06:08.284913+0000","last_became_peered":"2023-08-22T00:06:08.284913+0000","last_unstale":"2023-08-22T00:06:12.666260+0000","last_undegraded":"2023-08-22T00:06:12.666260+0000","last_fullsized":"2023-08-22T00:06:12.666260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669933+0000","last_change":"2023-08-22T00:06:08.660823+0000","last_active":"2023-08-22T00:06:12.669933+0000","last_peered":"2023-08-22T00:06:12.669933+0000","last_clean":"2023-08-22T00:06:12.669933+0000","last_became_active":"2023-08-22T00:06:08.660576+0000","last_became_peered":"2023-08-22T00:06:08.660576+0000","last_unstale":"2023-08-22T00:06:12.669933+0000","last_undegraded":"2023-08-22T00:06:12.669933+0000","last_fullsized":"2023-08-22T00:06:12.669933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688868+0000","last_change":"2023-08-22T00:06:12.687512+0000","last_active":"2023-08-22T00:06:12.688868+0000","last_peered":"2023-08-22T00:06:12.688868+0000","last_clean":"2023-08-22T00:06:12.688868+0000","last_became_active":"2023-08-22T00:06:12.687104+0000","last_became_peered":"2023-08-22T00:06:12.687104+0000","last_unstale":"2023-08-22T00:06:12.688868+0000","last_undegraded":"2023-08-22T00:06:12.688868+0000","last_fullsized":"2023-08-22T00:06:12.688868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297396,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074444,"statfs":{"total":96636764160,"available":96332230656,"internally_reserved":0,"allocated":307200,"data_stored":117459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":119671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297388,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074452,"statfs":{"total":96636764160,"available":96332238848,"internally_reserved":0,"allocated":299008,"data_stored":119817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:06:33.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:06:34.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.062+0000 7f2b8c151700 1 Processor -- start 2023-08-22T00:06:34.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.062+0000 7f2b8c151700 1 -- start start 2023-08-22T00:06:34.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8c151700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2b84153b60 0x7f2b84068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8c151700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b840a9140 0x7f2b84158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8c151700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b840a8410 con 0x7f2b84153f40 2023-08-22T00:06:34.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8c151700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840a8cb0 con 0x7f2b84153b60 2023-08-22T00:06:34.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8c151700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b841586a0 con 0x7f2b840a9140 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2b84153b60 0x7f2b84068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b896ec700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2b84153f40 0x7f2b84157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54876/0 (socket says 172.21.15.98:54876) 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b896ec700 1 -- 172.21.15.98:0/2294449830 learned_addr learned my addr 172.21.15.98:0/2294449830 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b8a6ee700 1 --2- 172.21.15.98:0/2294449830 >> v2:172.21.15.118:3300/0 conn(0x7f2b840a9140 0x7f2b84158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 -- 172.21.15.98:0/2294449830 >> v2:172.21.15.118:3300/0 conn(0x7f2b840a9140 msgr2=0x7f2b84158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 --2- 172.21.15.98:0/2294449830 >> v2:172.21.15.118:3300/0 conn(0x7f2b840a9140 0x7f2b84158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 -- 172.21.15.98:0/2294449830 >> v1:172.21.15.98:6789/0 conn(0x7f2b84153f40 legacy=0x7f2b84157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b88eeb700 1 -- 172.21.15.98:0/2294449830 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235549416 0 0) 0x7f2b840a8410 con 0x7f2b84153f40 2023-08-22T00:06:34.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 -- 172.21.15.98:0/2294449830 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840a8660 con 0x7f2b84153b60 2023-08-22T00:06:34.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.063+0000 7f2b89eed700 1 --2- 172.21.15.98:0/2294449830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153b60 0x7f2b84068d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f2b840a8c20 tx=0x7f2b80009060).ready entity=mon.0 client_cookie=99ad68f1a8d69522 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b88eeb700 1 -- 172.21.15.98:0/2294449830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000f510 con 0x7f2b84153b60 2023-08-22T00:06:34.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b88eeb700 1 -- 172.21.15.98:0/2294449830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000f670 con 0x7f2b84153b60 2023-08-22T00:06:34.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b88eeb700 1 -- 172.21.15.98:0/2294449830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000f9f0 con 0x7f2b84153b60 2023-08-22T00:06:34.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 -- 172.21.15.98:0/2294449830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153b60 msgr2=0x7f2b84068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 --2- 172.21.15.98:0/2294449830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153b60 0x7f2b84068d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f2b840a8c20 tx=0x7f2b80009060).stop 2023-08-22T00:06:34.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 -- 172.21.15.98:0/2294449830 shutdown_connections 2023-08-22T00:06:34.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 --2- 172.21.15.98:0/2294449830 >> v2:172.21.15.118:3300/0 conn(0x7f2b840a9140 0x7f2b84158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 --2- 172.21.15.98:0/2294449830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153b60 0x7f2b84068d40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 -- 172.21.15.98:0/2294449830 >> 172.21.15.98:0/2294449830 conn(0x7f2b840c5dc0 msgr2=0x7f2b84068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 -- 172.21.15.98:0/2294449830 shutdown_connections 2023-08-22T00:06:34.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.064+0000 7f2b8c151700 1 -- 172.21.15.98:0/2294449830 wait complete. 2023-08-22T00:06:34.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.066+0000 7f2b8c151700 1 Processor -- start 2023-08-22T00:06:34.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.066+0000 7f2b8c151700 1 -- start start 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 0x7f2b8414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b84153b60 0x7f2b841560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841545a0 con 0x7f2b84153f40 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84154880 con 0x7f2b840a9140 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84156ac0 con 0x7f2b84153b60 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35606/0 (socket says 172.21.15.98:35606) 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 -- 172.21.15.98:0/1076825610 learned_addr learned my addr 172.21.15.98:0/1076825610 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b89eed700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 0x7f2b8414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b896ec700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b84153b60 0x7f2b841560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 -- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b84153b60 msgr2=0x7f2b841560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b84153b60 0x7f2b841560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 -- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 msgr2=0x7f2b8414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 0x7f2b8414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 -- 172.21.15.98:0/1076825610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800092a0 con 0x7f2b84153f40 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b89eed700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 0x7f2b8414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8a6ee700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2b7c009f20 tx=0x7f2b7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00cc80 con 0x7f2b84153f40 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c00f040 con 0x7f2b84153f40 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b84156da0 con 0x7f2b84153f40 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.067+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c013400 con 0x7f2b84153f40 2023-08-22T00:06:34.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.068+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b840ada40 con 0x7f2b84153f40 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.069+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b84154a10 con 0x7f2b84153f40 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.069+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2b7c0137b0 con 0x7f2b84153f40 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.069+0000 7f2b79ffb700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 0x7f2b68061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.069+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2b7c07aa20 con 0x7f2b84153f40 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.069+0000 7f2b89eed700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 0x7f2b68061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.070+0000 7f2b89eed700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 0x7f2b68061300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2b840a8c20 tx=0x7f2b80017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.073+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b7c04bb80 con 0x7f2b84153f40 2023-08-22T00:06:34.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.230+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b84047480 con 0x7f2b6805ee40 2023-08-22T00:06:34.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.241+0000 7f2b79ffb700 1 -- 172.21.15.98:0/1076825610 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410616 (secure 0 0 0) 0x7f2b84047480 con 0x7f2b6805ee40 2023-08-22T00:06:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 msgr2=0x7f2b68061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 0x7f2b68061300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2b840a8c20 tx=0x7f2b80017000).stop 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 msgr2=0x7f2b840c0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2b7c009f20 tx=0x7f2b7c00b040).stop 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 shutdown_connections 2023-08-22T00:06:34.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b84153f40 0x7f2b840c0c20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b840a9140 0x7f2b8414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b6805ee40 0x7f2b68061300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 --2- 172.21.15.98:0/1076825610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b84153b60 0x7f2b841560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 >> 172.21.15.98:0/1076825610 conn(0x7f2b840c5dc0 msgr2=0x7f2b8414b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 shutdown_connections 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.245+0000 7f2b8c151700 1 -- 172.21.15.98:0/1076825610 wait complete. 2023-08-22T00:06:34.250 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:06:34.258 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-08-22T00:06:34.036882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379008,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595712,"statfs":{"total":773094113280,"available":770658009088,"internally_reserved":0,"allocated":2293760,"data_stored":937332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003538"},"pg_stats":[{"pgid":"3.3f","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678589+0000","last_change":"2023-08-22T00:06:08.291099+0000","last_active":"2023-08-22T00:06:12.678589+0000","last_peered":"2023-08-22T00:06:12.678589+0000","last_clean":"2023-08-22T00:06:12.678589+0000","last_became_active":"2023-08-22T00:06:08.290795+0000","last_became_peered":"2023-08-22T00:06:08.290795+0000","last_unstale":"2023-08-22T00:06:12.678589+0000","last_undegraded":"2023-08-22T00:06:12.678589+0000","last_fullsized":"2023-08-22T00:06:12.678589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673305+0000","last_change":"2023-08-22T00:06:08.656231+0000","last_active":"2023-08-22T00:06:12.673305+0000","last_peered":"2023-08-22T00:06:12.673305+0000","last_clean":"2023-08-22T00:06:12.673305+0000","last_became_active":"2023-08-22T00:06:08.655915+0000","last_became_peered":"2023-08-22T00:06:08.655915+0000","last_unstale":"2023-08-22T00:06:12.673305+0000","last_undegraded":"2023-08-22T00:06:12.673305+0000","last_fullsized":"2023-08-22T00:06:12.673305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684438+0000","last_change":"2023-08-22T00:06:08.288428+0000","last_active":"2023-08-22T00:06:12.684438+0000","last_peered":"2023-08-22T00:06:12.684438+0000","last_clean":"2023-08-22T00:06:12.684438+0000","last_became_active":"2023-08-22T00:06:08.286608+0000","last_became_peered":"2023-08-22T00:06:08.286608+0000","last_unstale":"2023-08-22T00:06:12.684438+0000","last_undegraded":"2023-08-22T00:06:12.684438+0000","last_fullsized":"2023-08-22T00:06:12.684438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671745+0000","last_change":"2023-08-22T00:06:08.662348+0000","last_active":"2023-08-22T00:06:12.671745+0000","last_peered":"2023-08-22T00:06:12.671745+0000","last_clean":"2023-08-22T00:06:12.671745+0000","last_became_active":"2023-08-22T00:06:08.661703+0000","last_became_peered":"2023-08-22T00:06:08.661703+0000","last_unstale":"2023-08-22T00:06:12.671745+0000","last_undegraded":"2023-08-22T00:06:12.671745+0000","last_fullsized":"2023-08-22T00:06:12.671745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675218+0000","last_change":"2023-08-22T00:06:08.287214+0000","last_active":"2023-08-22T00:06:12.675218+0000","last_peered":"2023-08-22T00:06:12.675218+0000","last_clean":"2023-08-22T00:06:12.675218+0000","last_became_active":"2023-08-22T00:06:08.286927+0000","last_became_peered":"2023-08-22T00:06:08.286927+0000","last_unstale":"2023-08-22T00:06:12.675218+0000","last_undegraded":"2023-08-22T00:06:12.675218+0000","last_fullsized":"2023-08-22T00:06:12.675218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666426+0000","last_change":"2023-08-22T00:06:08.656790+0000","last_active":"2023-08-22T00:06:12.666426+0000","last_peered":"2023-08-22T00:06:12.666426+0000","last_clean":"2023-08-22T00:06:12.666426+0000","last_became_active":"2023-08-22T00:06:08.656519+0000","last_became_peered":"2023-08-22T00:06:08.656519+0000","last_unstale":"2023-08-22T00:06:12.666426+0000","last_undegraded":"2023-08-22T00:06:12.666426+0000","last_fullsized":"2023-08-22T00:06:12.666426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672202+0000","last_change":"2023-08-22T00:06:08.293624+0000","last_active":"2023-08-22T00:06:12.672202+0000","last_peered":"2023-08-22T00:06:12.672202+0000","last_clean":"2023-08-22T00:06:12.672202+0000","last_became_active":"2023-08-22T00:06:08.293347+0000","last_became_peered":"2023-08-22T00:06:08.293347+0000","last_unstale":"2023-08-22T00:06:12.672202+0000","last_undegraded":"2023-08-22T00:06:12.672202+0000","last_fullsized":"2023-08-22T00:06:12.672202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681949+0000","last_change":"2023-08-22T00:06:08.659129+0000","last_active":"2023-08-22T00:06:12.681949+0000","last_peered":"2023-08-22T00:06:12.681949+0000","last_clean":"2023-08-22T00:06:12.681949+0000","last_became_active":"2023-08-22T00:06:08.658860+0000","last_became_peered":"2023-08-22T00:06:08.658860+0000","last_unstale":"2023-08-22T00:06:12.681949+0000","last_undegraded":"2023-08-22T00:06:12.681949+0000","last_fullsized":"2023-08-22T00:06:12.681949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673280+0000","last_change":"2023-08-22T00:06:08.289602+0000","last_active":"2023-08-22T00:06:12.673280+0000","last_peered":"2023-08-22T00:06:12.673280+0000","last_clean":"2023-08-22T00:06:12.673280+0000","last_became_active":"2023-08-22T00:06:08.289342+0000","last_became_peered":"2023-08-22T00:06:08.289342+0000","last_unstale":"2023-08-22T00:06:12.673280+0000","last_undegraded":"2023-08-22T00:06:12.673280+0000","last_fullsized":"2023-08-22T00:06:12.673280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666271+0000","last_change":"2023-08-22T00:06:08.661296+0000","last_active":"2023-08-22T00:06:12.666271+0000","last_peered":"2023-08-22T00:06:12.666271+0000","last_clean":"2023-08-22T00:06:12.666271+0000","last_became_active":"2023-08-22T00:06:08.660986+0000","last_became_peered":"2023-08-22T00:06:08.660986+0000","last_unstale":"2023-08-22T00:06:12.666271+0000","last_undegraded":"2023-08-22T00:06:12.666271+0000","last_fullsized":"2023-08-22T00:06:12.666271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673253+0000","last_change":"2023-08-22T00:06:08.288788+0000","last_active":"2023-08-22T00:06:12.673253+0000","last_peered":"2023-08-22T00:06:12.673253+0000","last_clean":"2023-08-22T00:06:12.673253+0000","last_became_active":"2023-08-22T00:06:08.288515+0000","last_became_peered":"2023-08-22T00:06:08.288515+0000","last_unstale":"2023-08-22T00:06:12.673253+0000","last_undegraded":"2023-08-22T00:06:12.673253+0000","last_fullsized":"2023-08-22T00:06:12.673253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666020+0000","last_change":"2023-08-22T00:06:08.658212+0000","last_active":"2023-08-22T00:06:12.666020+0000","last_peered":"2023-08-22T00:06:12.666020+0000","last_clean":"2023-08-22T00:06:12.666020+0000","last_became_active":"2023-08-22T00:06:08.657937+0000","last_became_peered":"2023-08-22T00:06:08.657937+0000","last_unstale":"2023-08-22T00:06:12.666020+0000","last_undegraded":"2023-08-22T00:06:12.666020+0000","last_fullsized":"2023-08-22T00:06:12.666020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671479+0000","last_change":"2023-08-22T00:06:08.297342+0000","last_active":"2023-08-22T00:06:12.671479+0000","last_peered":"2023-08-22T00:06:12.671479+0000","last_clean":"2023-08-22T00:06:12.671479+0000","last_became_active":"2023-08-22T00:06:08.291355+0000","last_became_peered":"2023-08-22T00:06:08.291355+0000","last_unstale":"2023-08-22T00:06:12.671479+0000","last_undegraded":"2023-08-22T00:06:12.671479+0000","last_fullsized":"2023-08-22T00:06:12.671479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674444+0000","last_change":"2023-08-22T00:06:08.660595+0000","last_active":"2023-08-22T00:06:12.674444+0000","last_peered":"2023-08-22T00:06:12.674444+0000","last_clean":"2023-08-22T00:06:12.674444+0000","last_became_active":"2023-08-22T00:06:08.660326+0000","last_became_peered":"2023-08-22T00:06:08.660326+0000","last_unstale":"2023-08-22T00:06:12.674444+0000","last_undegraded":"2023-08-22T00:06:12.674444+0000","last_fullsized":"2023-08-22T00:06:12.674444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666783+0000","last_change":"2023-08-22T00:06:08.289343+0000","last_active":"2023-08-22T00:06:12.666783+0000","last_peered":"2023-08-22T00:06:12.666783+0000","last_clean":"2023-08-22T00:06:12.666783+0000","last_became_active":"2023-08-22T00:06:08.289074+0000","last_became_peered":"2023-08-22T00:06:08.289074+0000","last_unstale":"2023-08-22T00:06:12.666783+0000","last_undegraded":"2023-08-22T00:06:12.666783+0000","last_fullsized":"2023-08-22T00:06:12.666783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670629+0000","last_change":"2023-08-22T00:06:08.665424+0000","last_active":"2023-08-22T00:06:12.670629+0000","last_peered":"2023-08-22T00:06:12.670629+0000","last_clean":"2023-08-22T00:06:12.670629+0000","last_became_active":"2023-08-22T00:06:08.665177+0000","last_became_peered":"2023-08-22T00:06:08.665177+0000","last_unstale":"2023-08-22T00:06:12.670629+0000","last_undegraded":"2023-08-22T00:06:12.670629+0000","last_fullsized":"2023-08-22T00:06:12.670629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678499+0000","last_change":"2023-08-22T00:06:08.291866+0000","last_active":"2023-08-22T00:06:12.678499+0000","last_peered":"2023-08-22T00:06:12.678499+0000","last_clean":"2023-08-22T00:06:12.678499+0000","last_became_active":"2023-08-22T00:06:08.291381+0000","last_became_peered":"2023-08-22T00:06:08.291381+0000","last_unstale":"2023-08-22T00:06:12.678499+0000","last_undegraded":"2023-08-22T00:06:12.678499+0000","last_fullsized":"2023-08-22T00:06:12.678499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665055+0000","last_change":"2023-08-22T00:06:08.658534+0000","last_active":"2023-08-22T00:06:12.665055+0000","last_peered":"2023-08-22T00:06:12.665055+0000","last_clean":"2023-08-22T00:06:12.665055+0000","last_became_active":"2023-08-22T00:06:08.658274+0000","last_became_peered":"2023-08-22T00:06:08.658274+0000","last_unstale":"2023-08-22T00:06:12.665055+0000","last_undegraded":"2023-08-22T00:06:12.665055+0000","last_fullsized":"2023-08-22T00:06:12.665055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666238+0000","last_change":"2023-08-22T00:06:08.287355+0000","last_active":"2023-08-22T00:06:12.666238+0000","last_peered":"2023-08-22T00:06:12.666238+0000","last_clean":"2023-08-22T00:06:12.666238+0000","last_became_active":"2023-08-22T00:06:08.287061+0000","last_became_peered":"2023-08-22T00:06:08.287061+0000","last_unstale":"2023-08-22T00:06:12.666238+0000","last_undegraded":"2023-08-22T00:06:12.666238+0000","last_fullsized":"2023-08-22T00:06:12.666238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671653+0000","last_change":"2023-08-22T00:06:08.662523+0000","last_active":"2023-08-22T00:06:12.671653+0000","last_peered":"2023-08-22T00:06:12.671653+0000","last_clean":"2023-08-22T00:06:12.671653+0000","last_became_active":"2023-08-22T00:06:08.662068+0000","last_became_peered":"2023-08-22T00:06:08.662068+0000","last_unstale":"2023-08-22T00:06:12.671653+0000","last_undegraded":"2023-08-22T00:06:12.671653+0000","last_fullsized":"2023-08-22T00:06:12.671653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664956+0000","last_change":"2023-08-22T00:06:08.286978+0000","last_active":"2023-08-22T00:06:12.664956+0000","last_peered":"2023-08-22T00:06:12.664956+0000","last_clean":"2023-08-22T00:06:12.664956+0000","last_became_active":"2023-08-22T00:06:08.286637+0000","last_became_peered":"2023-08-22T00:06:08.286637+0000","last_unstale":"2023-08-22T00:06:12.664956+0000","last_undegraded":"2023-08-22T00:06:12.664956+0000","last_fullsized":"2023-08-22T00:06:12.664956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672913+0000","last_change":"2023-08-22T00:06:08.659864+0000","last_active":"2023-08-22T00:06:12.672913+0000","last_peered":"2023-08-22T00:06:12.672913+0000","last_clean":"2023-08-22T00:06:12.672913+0000","last_became_active":"2023-08-22T00:06:08.659559+0000","last_became_peered":"2023-08-22T00:06:08.659559+0000","last_unstale":"2023-08-22T00:06:12.672913+0000","last_undegraded":"2023-08-22T00:06:12.672913+0000","last_fullsized":"2023-08-22T00:06:12.672913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:17.797484+0000","last_change":"2023-08-22T00:06:08.296851+0000","last_active":"2023-08-22T00:06:17.797484+0000","last_peered":"2023-08-22T00:06:17.797484+0000","last_clean":"2023-08-22T00:06:17.797484+0000","last_became_active":"2023-08-22T00:06:08.296567+0000","last_became_peered":"2023-08-22T00:06:08.296567+0000","last_unstale":"2023-08-22T00:06:17.797484+0000","last_undegraded":"2023-08-22T00:06:17.797484+0000","last_fullsized":"2023-08-22T00:06:17.797484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673049+0000","last_change":"2023-08-22T00:06:08.665352+0000","last_active":"2023-08-22T00:06:12.673049+0000","last_peered":"2023-08-22T00:06:12.673049+0000","last_clean":"2023-08-22T00:06:12.673049+0000","last_became_active":"2023-08-22T00:06:08.665087+0000","last_became_peered":"2023-08-22T00:06:08.665087+0000","last_unstale":"2023-08-22T00:06:12.673049+0000","last_undegraded":"2023-08-22T00:06:12.673049+0000","last_fullsized":"2023-08-22T00:06:12.673049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667424+0000","last_change":"2023-08-22T00:06:08.288914+0000","last_active":"2023-08-22T00:06:12.667424+0000","last_peered":"2023-08-22T00:06:12.667424+0000","last_clean":"2023-08-22T00:06:12.667424+0000","last_became_active":"2023-08-22T00:06:08.287814+0000","last_became_peered":"2023-08-22T00:06:08.287814+0000","last_unstale":"2023-08-22T00:06:12.667424+0000","last_undegraded":"2023-08-22T00:06:12.667424+0000","last_fullsized":"2023-08-22T00:06:12.667424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671643+0000","last_change":"2023-08-22T00:06:08.654359+0000","last_active":"2023-08-22T00:06:12.671643+0000","last_peered":"2023-08-22T00:06:12.671643+0000","last_clean":"2023-08-22T00:06:12.671643+0000","last_became_active":"2023-08-22T00:06:08.653920+0000","last_became_peered":"2023-08-22T00:06:08.653920+0000","last_unstale":"2023-08-22T00:06:12.671643+0000","last_undegraded":"2023-08-22T00:06:12.671643+0000","last_fullsized":"2023-08-22T00:06:12.671643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673398+0000","last_change":"2023-08-22T00:06:08.282186+0000","last_active":"2023-08-22T00:06:12.673398+0000","last_peered":"2023-08-22T00:06:12.673398+0000","last_clean":"2023-08-22T00:06:12.673398+0000","last_became_active":"2023-08-22T00:06:08.281908+0000","last_became_peered":"2023-08-22T00:06:08.281908+0000","last_unstale":"2023-08-22T00:06:12.673398+0000","last_undegraded":"2023-08-22T00:06:12.673398+0000","last_fullsized":"2023-08-22T00:06:12.673398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666143+0000","last_change":"2023-08-22T00:06:08.662549+0000","last_active":"2023-08-22T00:06:12.666143+0000","last_peered":"2023-08-22T00:06:12.666143+0000","last_clean":"2023-08-22T00:06:12.666143+0000","last_became_active":"2023-08-22T00:06:08.662262+0000","last_became_peered":"2023-08-22T00:06:08.662262+0000","last_unstale":"2023-08-22T00:06:12.666143+0000","last_undegraded":"2023-08-22T00:06:12.666143+0000","last_fullsized":"2023-08-22T00:06:12.666143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674164+0000","last_change":"2023-08-22T00:06:08.289283+0000","last_active":"2023-08-22T00:06:12.674164+0000","last_peered":"2023-08-22T00:06:12.674164+0000","last_clean":"2023-08-22T00:06:12.674164+0000","last_became_active":"2023-08-22T00:06:08.289007+0000","last_became_peered":"2023-08-22T00:06:08.289007+0000","last_unstale":"2023-08-22T00:06:12.674164+0000","last_undegraded":"2023-08-22T00:06:12.674164+0000","last_fullsized":"2023-08-22T00:06:12.674164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674326+0000","last_change":"2023-08-22T00:06:08.661468+0000","last_active":"2023-08-22T00:06:12.674326+0000","last_peered":"2023-08-22T00:06:12.674326+0000","last_clean":"2023-08-22T00:06:12.674326+0000","last_became_active":"2023-08-22T00:06:08.661197+0000","last_became_peered":"2023-08-22T00:06:08.661197+0000","last_unstale":"2023-08-22T00:06:12.674326+0000","last_undegraded":"2023-08-22T00:06:12.674326+0000","last_fullsized":"2023-08-22T00:06:12.674326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672725+0000","last_change":"2023-08-22T00:06:08.288133+0000","last_active":"2023-08-22T00:06:12.672725+0000","last_peered":"2023-08-22T00:06:12.672725+0000","last_clean":"2023-08-22T00:06:12.672725+0000","last_became_active":"2023-08-22T00:06:08.287879+0000","last_became_peered":"2023-08-22T00:06:08.287879+0000","last_unstale":"2023-08-22T00:06:12.672725+0000","last_undegraded":"2023-08-22T00:06:12.672725+0000","last_fullsized":"2023-08-22T00:06:12.672725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673390+0000","last_change":"2023-08-22T00:06:08.663390+0000","last_active":"2023-08-22T00:06:12.673390+0000","last_peered":"2023-08-22T00:06:12.673390+0000","last_clean":"2023-08-22T00:06:12.673390+0000","last_became_active":"2023-08-22T00:06:08.663010+0000","last_became_peered":"2023-08-22T00:06:08.663010+0000","last_unstale":"2023-08-22T00:06:12.673390+0000","last_undegraded":"2023-08-22T00:06:12.673390+0000","last_fullsized":"2023-08-22T00:06:12.673390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674564+0000","last_change":"2023-08-22T00:06:08.293331+0000","last_active":"2023-08-22T00:06:12.674564+0000","last_peered":"2023-08-22T00:06:12.674564+0000","last_clean":"2023-08-22T00:06:12.674564+0000","last_became_active":"2023-08-22T00:06:08.293020+0000","last_became_peered":"2023-08-22T00:06:08.293020+0000","last_unstale":"2023-08-22T00:06:12.674564+0000","last_undegraded":"2023-08-22T00:06:12.674564+0000","last_fullsized":"2023-08-22T00:06:12.674564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671788+0000","last_change":"2023-08-22T00:06:08.666837+0000","last_active":"2023-08-22T00:06:12.671788+0000","last_peered":"2023-08-22T00:06:12.671788+0000","last_clean":"2023-08-22T00:06:12.671788+0000","last_became_active":"2023-08-22T00:06:08.666560+0000","last_became_peered":"2023-08-22T00:06:08.666560+0000","last_unstale":"2023-08-22T00:06:12.671788+0000","last_undegraded":"2023-08-22T00:06:12.671788+0000","last_fullsized":"2023-08-22T00:06:12.671788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.675040+0000","last_change":"2023-08-22T00:06:08.287559+0000","last_active":"2023-08-22T00:06:12.675040+0000","last_peered":"2023-08-22T00:06:12.675040+0000","last_clean":"2023-08-22T00:06:12.675040+0000","last_became_active":"2023-08-22T00:06:08.287287+0000","last_became_peered":"2023-08-22T00:06:08.287287+0000","last_unstale":"2023-08-22T00:06:12.675040+0000","last_undegraded":"2023-08-22T00:06:12.675040+0000","last_fullsized":"2023-08-22T00:06:12.675040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667298+0000","last_change":"2023-08-22T00:06:08.662355+0000","last_active":"2023-08-22T00:06:12.667298+0000","last_peered":"2023-08-22T00:06:12.667298+0000","last_clean":"2023-08-22T00:06:12.667298+0000","last_became_active":"2023-08-22T00:06:08.662086+0000","last_became_peered":"2023-08-22T00:06:08.662086+0000","last_unstale":"2023-08-22T00:06:12.667298+0000","last_undegraded":"2023-08-22T00:06:12.667298+0000","last_fullsized":"2023-08-22T00:06:12.667298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677300+0000","last_change":"2023-08-22T00:06:08.290222+0000","last_active":"2023-08-22T00:06:12.677300+0000","last_peered":"2023-08-22T00:06:12.677300+0000","last_clean":"2023-08-22T00:06:12.677300+0000","last_became_active":"2023-08-22T00:06:08.289968+0000","last_became_peered":"2023-08-22T00:06:08.289968+0000","last_unstale":"2023-08-22T00:06:12.677300+0000","last_undegraded":"2023-08-22T00:06:12.677300+0000","last_fullsized":"2023-08-22T00:06:12.677300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673232+0000","last_change":"2023-08-22T00:06:08.658917+0000","last_active":"2023-08-22T00:06:12.673232+0000","last_peered":"2023-08-22T00:06:12.673232+0000","last_clean":"2023-08-22T00:06:12.673232+0000","last_became_active":"2023-08-22T00:06:08.658657+0000","last_became_peered":"2023-08-22T00:06:08.658657+0000","last_unstale":"2023-08-22T00:06:12.673232+0000","last_undegraded":"2023-08-22T00:06:12.673232+0000","last_fullsized":"2023-08-22T00:06:12.673232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665200+0000","last_change":"2023-08-22T00:06:08.289093+0000","last_active":"2023-08-22T00:06:12.665200+0000","last_peered":"2023-08-22T00:06:12.665200+0000","last_clean":"2023-08-22T00:06:12.665200+0000","last_became_active":"2023-08-22T00:06:08.288806+0000","last_became_peered":"2023-08-22T00:06:08.288806+0000","last_unstale":"2023-08-22T00:06:12.665200+0000","last_undegraded":"2023-08-22T00:06:12.665200+0000","last_fullsized":"2023-08-22T00:06:12.665200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673099+0000","last_change":"2023-08-22T00:06:08.669493+0000","last_active":"2023-08-22T00:06:12.673099+0000","last_peered":"2023-08-22T00:06:12.673099+0000","last_clean":"2023-08-22T00:06:12.673099+0000","last_became_active":"2023-08-22T00:06:08.669220+0000","last_became_peered":"2023-08-22T00:06:08.669220+0000","last_unstale":"2023-08-22T00:06:12.673099+0000","last_undegraded":"2023-08-22T00:06:12.673099+0000","last_fullsized":"2023-08-22T00:06:12.673099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682034+0000","last_change":"2023-08-22T00:06:08.292202+0000","last_active":"2023-08-22T00:06:12.682034+0000","last_peered":"2023-08-22T00:06:12.682034+0000","last_clean":"2023-08-22T00:06:12.682034+0000","last_became_active":"2023-08-22T00:06:08.291929+0000","last_became_peered":"2023-08-22T00:06:08.291929+0000","last_unstale":"2023-08-22T00:06:12.682034+0000","last_undegraded":"2023-08-22T00:06:12.682034+0000","last_fullsized":"2023-08-22T00:06:12.682034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666941+0000","last_change":"2023-08-22T00:06:08.655196+0000","last_active":"2023-08-22T00:06:12.666941+0000","last_peered":"2023-08-22T00:06:12.666941+0000","last_clean":"2023-08-22T00:06:12.666941+0000","last_became_active":"2023-08-22T00:06:08.654928+0000","last_became_peered":"2023-08-22T00:06:08.654928+0000","last_unstale":"2023-08-22T00:06:12.666941+0000","last_undegraded":"2023-08-22T00:06:12.666941+0000","last_fullsized":"2023-08-22T00:06:12.666941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673092+0000","last_change":"2023-08-22T00:06:08.293074+0000","last_active":"2023-08-22T00:06:12.673092+0000","last_peered":"2023-08-22T00:06:12.673092+0000","last_clean":"2023-08-22T00:06:12.673092+0000","last_became_active":"2023-08-22T00:06:08.292434+0000","last_became_peered":"2023-08-22T00:06:08.292434+0000","last_unstale":"2023-08-22T00:06:12.673092+0000","last_undegraded":"2023-08-22T00:06:12.673092+0000","last_fullsized":"2023-08-22T00:06:12.673092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671455+0000","last_change":"2023-08-22T00:06:08.658335+0000","last_active":"2023-08-22T00:06:12.671455+0000","last_peered":"2023-08-22T00:06:12.671455+0000","last_clean":"2023-08-22T00:06:12.671455+0000","last_became_active":"2023-08-22T00:06:08.658035+0000","last_became_peered":"2023-08-22T00:06:08.658035+0000","last_unstale":"2023-08-22T00:06:12.671455+0000","last_undegraded":"2023-08-22T00:06:12.671455+0000","last_fullsized":"2023-08-22T00:06:12.671455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667365+0000","last_change":"2023-08-22T00:06:08.292375+0000","last_active":"2023-08-22T00:06:12.667365+0000","last_peered":"2023-08-22T00:06:12.667365+0000","last_clean":"2023-08-22T00:06:12.667365+0000","last_became_active":"2023-08-22T00:06:08.291934+0000","last_became_peered":"2023-08-22T00:06:08.291934+0000","last_unstale":"2023-08-22T00:06:12.667365+0000","last_undegraded":"2023-08-22T00:06:12.667365+0000","last_fullsized":"2023-08-22T00:06:12.667365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666290+0000","last_change":"2023-08-22T00:06:08.660996+0000","last_active":"2023-08-22T00:06:12.666290+0000","last_peered":"2023-08-22T00:06:12.666290+0000","last_clean":"2023-08-22T00:06:12.666290+0000","last_became_active":"2023-08-22T00:06:08.660728+0000","last_became_peered":"2023-08-22T00:06:08.660728+0000","last_unstale":"2023-08-22T00:06:12.666290+0000","last_undegraded":"2023-08-22T00:06:12.666290+0000","last_fullsized":"2023-08-22T00:06:12.666290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672623+0000","last_change":"2023-08-22T00:06:08.292852+0000","last_active":"2023-08-22T00:06:12.672623+0000","last_peered":"2023-08-22T00:06:12.672623+0000","last_clean":"2023-08-22T00:06:12.672623+0000","last_became_active":"2023-08-22T00:06:08.291935+0000","last_became_peered":"2023-08-22T00:06:08.291935+0000","last_unstale":"2023-08-22T00:06:12.672623+0000","last_undegraded":"2023-08-22T00:06:12.672623+0000","last_fullsized":"2023-08-22T00:06:12.672623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673471+0000","last_change":"2023-08-22T00:06:08.663264+0000","last_active":"2023-08-22T00:06:12.673471+0000","last_peered":"2023-08-22T00:06:12.673471+0000","last_clean":"2023-08-22T00:06:12.673471+0000","last_became_active":"2023-08-22T00:06:08.662705+0000","last_became_peered":"2023-08-22T00:06:08.662705+0000","last_unstale":"2023-08-22T00:06:12.673471+0000","last_undegraded":"2023-08-22T00:06:12.673471+0000","last_fullsized":"2023-08-22T00:06:12.673471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670566+0000","last_change":"2023-08-22T00:06:08.290617+0000","last_active":"2023-08-22T00:06:12.670566+0000","last_peered":"2023-08-22T00:06:12.670566+0000","last_clean":"2023-08-22T00:06:12.670566+0000","last_became_active":"2023-08-22T00:06:08.290300+0000","last_became_peered":"2023-08-22T00:06:08.290300+0000","last_unstale":"2023-08-22T00:06:12.670566+0000","last_undegraded":"2023-08-22T00:06:12.670566+0000","last_fullsized":"2023-08-22T00:06:12.670566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664704+0000","last_change":"2023-08-22T00:06:08.658939+0000","last_active":"2023-08-22T00:06:12.664704+0000","last_peered":"2023-08-22T00:06:12.664704+0000","last_clean":"2023-08-22T00:06:12.664704+0000","last_became_active":"2023-08-22T00:06:08.653702+0000","last_became_peered":"2023-08-22T00:06:08.653702+0000","last_unstale":"2023-08-22T00:06:12.664704+0000","last_undegraded":"2023-08-22T00:06:12.664704+0000","last_fullsized":"2023-08-22T00:06:12.664704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-22T00:06:13.043578+0000","last_change":"2023-08-22T00:06:08.285489+0000","last_active":"2023-08-22T00:06:13.043578+0000","last_peered":"2023-08-22T00:06:13.043578+0000","last_clean":"2023-08-22T00:06:13.043578+0000","last_became_active":"2023-08-22T00:06:08.283345+0000","last_became_peered":"2023-08-22T00:06:08.283345+0000","last_unstale":"2023-08-22T00:06:13.043578+0000","last_undegraded":"2023-08-22T00:06:13.043578+0000","last_fullsized":"2023-08-22T00:06:13.043578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668115+0000","last_change":"2023-08-22T00:06:08.661873+0000","last_active":"2023-08-22T00:06:12.668115+0000","last_peered":"2023-08-22T00:06:12.668115+0000","last_clean":"2023-08-22T00:06:12.668115+0000","last_became_active":"2023-08-22T00:06:08.661603+0000","last_became_peered":"2023-08-22T00:06:08.661603+0000","last_unstale":"2023-08-22T00:06:12.668115+0000","last_undegraded":"2023-08-22T00:06:12.668115+0000","last_fullsized":"2023-08-22T00:06:12.668115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684497+0000","last_change":"2023-08-22T00:06:08.284711+0000","last_active":"2023-08-22T00:06:12.684497+0000","last_peered":"2023-08-22T00:06:12.684497+0000","last_clean":"2023-08-22T00:06:12.684497+0000","last_became_active":"2023-08-22T00:06:08.284399+0000","last_became_peered":"2023-08-22T00:06:08.284399+0000","last_unstale":"2023-08-22T00:06:12.684497+0000","last_undegraded":"2023-08-22T00:06:12.684497+0000","last_fullsized":"2023-08-22T00:06:12.684497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666407+0000","last_change":"2023-08-22T00:06:08.658805+0000","last_active":"2023-08-22T00:06:12.666407+0000","last_peered":"2023-08-22T00:06:12.666407+0000","last_clean":"2023-08-22T00:06:12.666407+0000","last_became_active":"2023-08-22T00:06:08.658529+0000","last_became_peered":"2023-08-22T00:06:08.658529+0000","last_unstale":"2023-08-22T00:06:12.666407+0000","last_undegraded":"2023-08-22T00:06:12.666407+0000","last_fullsized":"2023-08-22T00:06:12.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669275+0000","last_change":"2023-08-22T00:06:08.291946+0000","last_active":"2023-08-22T00:06:12.669275+0000","last_peered":"2023-08-22T00:06:12.669275+0000","last_clean":"2023-08-22T00:06:12.669275+0000","last_became_active":"2023-08-22T00:06:08.291657+0000","last_became_peered":"2023-08-22T00:06:08.291657+0000","last_unstale":"2023-08-22T00:06:12.669275+0000","last_undegraded":"2023-08-22T00:06:12.669275+0000","last_fullsized":"2023-08-22T00:06:12.669275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.668361+0000","last_change":"2023-08-22T00:06:08.665347+0000","last_active":"2023-08-22T00:06:12.668361+0000","last_peered":"2023-08-22T00:06:12.668361+0000","last_clean":"2023-08-22T00:06:12.668361+0000","last_became_active":"2023-08-22T00:06:08.665083+0000","last_became_peered":"2023-08-22T00:06:08.665083+0000","last_unstale":"2023-08-22T00:06:12.668361+0000","last_undegraded":"2023-08-22T00:06:12.668361+0000","last_fullsized":"2023-08-22T00:06:12.668361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682195+0000","last_change":"2023-08-22T00:06:08.286837+0000","last_active":"2023-08-22T00:06:12.682195+0000","last_peered":"2023-08-22T00:06:12.682195+0000","last_clean":"2023-08-22T00:06:12.682195+0000","last_became_active":"2023-08-22T00:06:08.286573+0000","last_became_peered":"2023-08-22T00:06:08.286573+0000","last_unstale":"2023-08-22T00:06:12.682195+0000","last_undegraded":"2023-08-22T00:06:12.682195+0000","last_fullsized":"2023-08-22T00:06:12.682195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681782+0000","last_change":"2023-08-22T00:06:08.665854+0000","last_active":"2023-08-22T00:06:12.681782+0000","last_peered":"2023-08-22T00:06:12.681782+0000","last_clean":"2023-08-22T00:06:12.681782+0000","last_became_active":"2023-08-22T00:06:08.665617+0000","last_became_peered":"2023-08-22T00:06:08.665617+0000","last_unstale":"2023-08-22T00:06:12.681782+0000","last_undegraded":"2023-08-22T00:06:12.681782+0000","last_fullsized":"2023-08-22T00:06:12.681782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672822+0000","last_change":"2023-08-22T00:06:08.293311+0000","last_active":"2023-08-22T00:06:12.672822+0000","last_peered":"2023-08-22T00:06:12.672822+0000","last_clean":"2023-08-22T00:06:12.672822+0000","last_became_active":"2023-08-22T00:06:08.292791+0000","last_became_peered":"2023-08-22T00:06:08.292791+0000","last_unstale":"2023-08-22T00:06:12.672822+0000","last_undegraded":"2023-08-22T00:06:12.672822+0000","last_fullsized":"2023-08-22T00:06:12.672822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673896+0000","last_change":"2023-08-22T00:06:08.668170+0000","last_active":"2023-08-22T00:06:12.673896+0000","last_peered":"2023-08-22T00:06:12.673896+0000","last_clean":"2023-08-22T00:06:12.673896+0000","last_became_active":"2023-08-22T00:06:08.667860+0000","last_became_peered":"2023-08-22T00:06:08.667860+0000","last_unstale":"2023-08-22T00:06:12.673896+0000","last_undegraded":"2023-08-22T00:06:12.673896+0000","last_fullsized":"2023-08-22T00:06:12.673896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670406+0000","last_change":"2023-08-22T00:06:08.285397+0000","last_active":"2023-08-22T00:06:12.670406+0000","last_peered":"2023-08-22T00:06:12.670406+0000","last_clean":"2023-08-22T00:06:12.670406+0000","last_became_active":"2023-08-22T00:06:08.285084+0000","last_became_peered":"2023-08-22T00:06:08.285084+0000","last_unstale":"2023-08-22T00:06:12.670406+0000","last_undegraded":"2023-08-22T00:06:12.670406+0000","last_fullsized":"2023-08-22T00:06:12.670406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684663+0000","last_change":"2023-08-22T00:06:08.651586+0000","last_active":"2023-08-22T00:06:12.684663+0000","last_peered":"2023-08-22T00:06:12.684663+0000","last_clean":"2023-08-22T00:06:12.684663+0000","last_became_active":"2023-08-22T00:06:08.651320+0000","last_became_peered":"2023-08-22T00:06:08.651320+0000","last_unstale":"2023-08-22T00:06:12.684663+0000","last_undegraded":"2023-08-22T00:06:12.684663+0000","last_fullsized":"2023-08-22T00:06:12.684663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664973+0000","last_change":"2023-08-22T00:06:08.282274+0000","last_active":"2023-08-22T00:06:12.664973+0000","last_peered":"2023-08-22T00:06:12.664973+0000","last_clean":"2023-08-22T00:06:12.664973+0000","last_became_active":"2023-08-22T00:06:08.281656+0000","last_became_peered":"2023-08-22T00:06:08.281656+0000","last_unstale":"2023-08-22T00:06:12.664973+0000","last_undegraded":"2023-08-22T00:06:12.664973+0000","last_fullsized":"2023-08-22T00:06:12.664973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684917+0000","last_change":"2023-08-22T00:06:08.655245+0000","last_active":"2023-08-22T00:06:12.684917+0000","last_peered":"2023-08-22T00:06:12.684917+0000","last_clean":"2023-08-22T00:06:12.684917+0000","last_became_active":"2023-08-22T00:06:08.653409+0000","last_became_peered":"2023-08-22T00:06:08.653409+0000","last_unstale":"2023-08-22T00:06:12.684917+0000","last_undegraded":"2023-08-22T00:06:12.684917+0000","last_fullsized":"2023-08-22T00:06:12.684917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673625+0000","last_change":"2023-08-22T00:06:08.286655+0000","last_active":"2023-08-22T00:06:12.673625+0000","last_peered":"2023-08-22T00:06:12.673625+0000","last_clean":"2023-08-22T00:06:12.673625+0000","last_became_active":"2023-08-22T00:06:08.286201+0000","last_became_peered":"2023-08-22T00:06:08.286201+0000","last_unstale":"2023-08-22T00:06:12.673625+0000","last_undegraded":"2023-08-22T00:06:12.673625+0000","last_fullsized":"2023-08-22T00:06:12.673625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664977+0000","last_change":"2023-08-22T00:06:08.669633+0000","last_active":"2023-08-22T00:06:12.664977+0000","last_peered":"2023-08-22T00:06:12.664977+0000","last_clean":"2023-08-22T00:06:12.664977+0000","last_became_active":"2023-08-22T00:06:08.669336+0000","last_became_peered":"2023-08-22T00:06:08.669336+0000","last_unstale":"2023-08-22T00:06:12.664977+0000","last_undegraded":"2023-08-22T00:06:12.664977+0000","last_fullsized":"2023-08-22T00:06:12.664977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701760+0000","last_change":"2023-08-22T00:06:12.688949+0000","last_active":"2023-08-22T00:06:12.701760+0000","last_peered":"2023-08-22T00:06:12.701760+0000","last_clean":"2023-08-22T00:06:12.701760+0000","last_became_active":"2023-08-22T00:06:12.688549+0000","last_became_peered":"2023-08-22T00:06:12.688549+0000","last_unstale":"2023-08-22T00:06:12.701760+0000","last_undegraded":"2023-08-22T00:06:12.701760+0000","last_fullsized":"2023-08-22T00:06:12.701760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670131+0000","last_change":"2023-08-22T00:06:08.287945+0000","last_active":"2023-08-22T00:06:12.670131+0000","last_peered":"2023-08-22T00:06:12.670131+0000","last_clean":"2023-08-22T00:06:12.670131+0000","last_became_active":"2023-08-22T00:06:08.287654+0000","last_became_peered":"2023-08-22T00:06:08.287654+0000","last_unstale":"2023-08-22T00:06:12.670131+0000","last_undegraded":"2023-08-22T00:06:12.670131+0000","last_fullsized":"2023-08-22T00:06:12.670131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667560+0000","last_change":"2023-08-22T00:06:08.663896+0000","last_active":"2023-08-22T00:06:12.667560+0000","last_peered":"2023-08-22T00:06:12.667560+0000","last_clean":"2023-08-22T00:06:12.667560+0000","last_became_active":"2023-08-22T00:06:08.659582+0000","last_became_peered":"2023-08-22T00:06:08.659582+0000","last_unstale":"2023-08-22T00:06:12.667560+0000","last_undegraded":"2023-08-22T00:06:12.667560+0000","last_fullsized":"2023-08-22T00:06:12.667560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.683352+0000","last_change":"2023-08-22T00:06:12.680740+0000","last_active":"2023-08-22T00:06:12.683352+0000","last_peered":"2023-08-22T00:06:12.683352+0000","last_clean":"2023-08-22T00:06:12.683352+0000","last_became_active":"2023-08-22T00:06:12.680354+0000","last_became_peered":"2023-08-22T00:06:12.680354+0000","last_unstale":"2023-08-22T00:06:12.683352+0000","last_undegraded":"2023-08-22T00:06:12.683352+0000","last_fullsized":"2023-08-22T00:06:12.683352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673712+0000","last_change":"2023-08-22T00:06:08.291655+0000","last_active":"2023-08-22T00:06:12.673712+0000","last_peered":"2023-08-22T00:06:12.673712+0000","last_clean":"2023-08-22T00:06:12.673712+0000","last_became_active":"2023-08-22T00:06:08.291408+0000","last_became_peered":"2023-08-22T00:06:08.291408+0000","last_unstale":"2023-08-22T00:06:12.673712+0000","last_undegraded":"2023-08-22T00:06:12.673712+0000","last_fullsized":"2023-08-22T00:06:12.673712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666066+0000","last_change":"2023-08-22T00:06:08.662948+0000","last_active":"2023-08-22T00:06:12.666066+0000","last_peered":"2023-08-22T00:06:12.666066+0000","last_clean":"2023-08-22T00:06:12.666066+0000","last_became_active":"2023-08-22T00:06:08.662627+0000","last_became_peered":"2023-08-22T00:06:08.662627+0000","last_unstale":"2023-08-22T00:06:12.666066+0000","last_undegraded":"2023-08-22T00:06:12.666066+0000","last_fullsized":"2023-08-22T00:06:12.666066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692108+0000","last_change":"2023-08-22T00:06:12.689153+0000","last_active":"2023-08-22T00:06:12.692108+0000","last_peered":"2023-08-22T00:06:12.692108+0000","last_clean":"2023-08-22T00:06:12.692108+0000","last_became_active":"2023-08-22T00:06:12.688700+0000","last_became_peered":"2023-08-22T00:06:12.688700+0000","last_unstale":"2023-08-22T00:06:12.692108+0000","last_undegraded":"2023-08-22T00:06:12.692108+0000","last_fullsized":"2023-08-22T00:06:12.692108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672366+0000","last_change":"2023-08-22T00:06:08.292695+0000","last_active":"2023-08-22T00:06:12.672366+0000","last_peered":"2023-08-22T00:06:12.672366+0000","last_clean":"2023-08-22T00:06:12.672366+0000","last_became_active":"2023-08-22T00:06:08.292417+0000","last_became_peered":"2023-08-22T00:06:08.292417+0000","last_unstale":"2023-08-22T00:06:12.672366+0000","last_undegraded":"2023-08-22T00:06:12.672366+0000","last_fullsized":"2023-08-22T00:06:12.672366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665496+0000","last_change":"2023-08-22T00:06:08.662935+0000","last_active":"2023-08-22T00:06:12.665496+0000","last_peered":"2023-08-22T00:06:12.665496+0000","last_clean":"2023-08-22T00:06:12.665496+0000","last_became_active":"2023-08-22T00:06:08.662634+0000","last_became_peered":"2023-08-22T00:06:08.662634+0000","last_unstale":"2023-08-22T00:06:12.665496+0000","last_undegraded":"2023-08-22T00:06:12.665496+0000","last_fullsized":"2023-08-22T00:06:12.665496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.689425+0000","last_change":"2023-08-22T00:06:12.686691+0000","last_active":"2023-08-22T00:06:12.689425+0000","last_peered":"2023-08-22T00:06:12.689425+0000","last_clean":"2023-08-22T00:06:12.689425+0000","last_became_active":"2023-08-22T00:06:12.686314+0000","last_became_peered":"2023-08-22T00:06:12.686314+0000","last_unstale":"2023-08-22T00:06:12.689425+0000","last_undegraded":"2023-08-22T00:06:12.689425+0000","last_fullsized":"2023-08-22T00:06:12.689425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702379+0000","last_change":"2023-08-22T00:06:12.697526+0000","last_active":"2023-08-22T00:06:12.702379+0000","last_peered":"2023-08-22T00:06:12.702379+0000","last_clean":"2023-08-22T00:06:12.702379+0000","last_became_active":"2023-08-22T00:06:12.697150+0000","last_became_peered":"2023-08-22T00:06:12.697150+0000","last_unstale":"2023-08-22T00:06:12.702379+0000","last_undegraded":"2023-08-22T00:06:12.702379+0000","last_fullsized":"2023-08-22T00:06:12.702379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682355+0000","last_change":"2023-08-22T00:06:08.290950+0000","last_active":"2023-08-22T00:06:12.682355+0000","last_peered":"2023-08-22T00:06:12.682355+0000","last_clean":"2023-08-22T00:06:12.682355+0000","last_became_active":"2023-08-22T00:06:08.290600+0000","last_became_peered":"2023-08-22T00:06:08.290600+0000","last_unstale":"2023-08-22T00:06:12.682355+0000","last_undegraded":"2023-08-22T00:06:12.682355+0000","last_fullsized":"2023-08-22T00:06:12.682355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671721+0000","last_change":"2023-08-22T00:06:08.654201+0000","last_active":"2023-08-22T00:06:12.671721+0000","last_peered":"2023-08-22T00:06:12.671721+0000","last_clean":"2023-08-22T00:06:12.671721+0000","last_became_active":"2023-08-22T00:06:08.653605+0000","last_became_peered":"2023-08-22T00:06:08.653605+0000","last_unstale":"2023-08-22T00:06:12.671721+0000","last_undegraded":"2023-08-22T00:06:12.671721+0000","last_fullsized":"2023-08-22T00:06:12.671721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665639+0000","last_change":"2023-08-22T00:06:08.667424+0000","last_active":"2023-08-22T00:06:12.665639+0000","last_peered":"2023-08-22T00:06:12.665639+0000","last_clean":"2023-08-22T00:06:12.665639+0000","last_became_active":"2023-08-22T00:06:08.667093+0000","last_became_peered":"2023-08-22T00:06:08.667093+0000","last_unstale":"2023-08-22T00:06:12.665639+0000","last_undegraded":"2023-08-22T00:06:12.665639+0000","last_fullsized":"2023-08-22T00:06:12.665639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680328+0000","last_change":"2023-08-22T00:06:08.285075+0000","last_active":"2023-08-22T00:06:12.680328+0000","last_peered":"2023-08-22T00:06:12.680328+0000","last_clean":"2023-08-22T00:06:12.680328+0000","last_became_active":"2023-08-22T00:06:08.284787+0000","last_became_peered":"2023-08-22T00:06:08.284787+0000","last_unstale":"2023-08-22T00:06:12.680328+0000","last_undegraded":"2023-08-22T00:06:12.680328+0000","last_fullsized":"2023-08-22T00:06:12.680328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665593+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:06:12.665593+0000","last_peered":"2023-08-22T00:06:12.665593+0000","last_clean":"2023-08-22T00:06:12.665593+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:06:12.665593+0000","last_undegraded":"2023-08-22T00:06:12.665593+0000","last_fullsized":"2023-08-22T00:06:12.665593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696704+0000","last_change":"2023-08-22T00:06:12.686550+0000","last_active":"2023-08-22T00:06:12.696704+0000","last_peered":"2023-08-22T00:06:12.696704+0000","last_clean":"2023-08-22T00:06:12.696704+0000","last_became_active":"2023-08-22T00:06:12.686171+0000","last_became_peered":"2023-08-22T00:06:12.686171+0000","last_unstale":"2023-08-22T00:06:12.696704+0000","last_undegraded":"2023-08-22T00:06:12.696704+0000","last_fullsized":"2023-08-22T00:06:12.696704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666712+0000","last_change":"2023-08-22T00:06:08.664638+0000","last_active":"2023-08-22T00:06:12.666712+0000","last_peered":"2023-08-22T00:06:12.666712+0000","last_clean":"2023-08-22T00:06:12.666712+0000","last_became_active":"2023-08-22T00:06:08.664382+0000","last_became_peered":"2023-08-22T00:06:08.664382+0000","last_unstale":"2023-08-22T00:06:12.666712+0000","last_undegraded":"2023-08-22T00:06:12.666712+0000","last_fullsized":"2023-08-22T00:06:12.666712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684583+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:06:12.684583+0000","last_peered":"2023-08-22T00:06:12.684583+0000","last_clean":"2023-08-22T00:06:12.684583+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:06:12.684583+0000","last_undegraded":"2023-08-22T00:06:12.684583+0000","last_fullsized":"2023-08-22T00:06:12.684583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670437+0000","last_change":"2023-08-22T00:06:08.285344+0000","last_active":"2023-08-22T00:06:12.670437+0000","last_peered":"2023-08-22T00:06:12.670437+0000","last_clean":"2023-08-22T00:06:12.670437+0000","last_became_active":"2023-08-22T00:06:08.285077+0000","last_became_peered":"2023-08-22T00:06:08.285077+0000","last_unstale":"2023-08-22T00:06:12.670437+0000","last_undegraded":"2023-08-22T00:06:12.670437+0000","last_fullsized":"2023-08-22T00:06:12.670437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688875+0000","last_change":"2023-08-22T00:06:12.687045+0000","last_active":"2023-08-22T00:06:12.688875+0000","last_peered":"2023-08-22T00:06:12.688875+0000","last_clean":"2023-08-22T00:06:12.688875+0000","last_became_active":"2023-08-22T00:06:12.686213+0000","last_became_peered":"2023-08-22T00:06:12.686213+0000","last_unstale":"2023-08-22T00:06:12.688875+0000","last_undegraded":"2023-08-22T00:06:12.688875+0000","last_fullsized":"2023-08-22T00:06:12.688875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682429+0000","last_change":"2023-08-22T00:06:08.656218+0000","last_active":"2023-08-22T00:06:12.682429+0000","last_peered":"2023-08-22T00:06:12.682429+0000","last_clean":"2023-08-22T00:06:12.682429+0000","last_became_active":"2023-08-22T00:06:08.655669+0000","last_became_peered":"2023-08-22T00:06:08.655669+0000","last_unstale":"2023-08-22T00:06:12.682429+0000","last_undegraded":"2023-08-22T00:06:12.682429+0000","last_fullsized":"2023-08-22T00:06:12.682429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681866+0000","last_change":"2023-08-22T00:06:08.286902+0000","last_active":"2023-08-22T00:06:12.681866+0000","last_peered":"2023-08-22T00:06:12.681866+0000","last_clean":"2023-08-22T00:06:12.681866+0000","last_became_active":"2023-08-22T00:06:08.285921+0000","last_became_peered":"2023-08-22T00:06:08.285921+0000","last_unstale":"2023-08-22T00:06:12.681866+0000","last_undegraded":"2023-08-22T00:06:12.681866+0000","last_fullsized":"2023-08-22T00:06:12.681866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677121+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:06:12.677121+0000","last_peered":"2023-08-22T00:06:12.677121+0000","last_clean":"2023-08-22T00:06:12.677121+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:06:12.677121+0000","last_undegraded":"2023-08-22T00:06:12.677121+0000","last_fullsized":"2023-08-22T00:06:12.677121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688925+0000","last_change":"2023-08-22T00:06:12.686660+0000","last_active":"2023-08-22T00:06:12.688925+0000","last_peered":"2023-08-22T00:06:12.688925+0000","last_clean":"2023-08-22T00:06:12.688925+0000","last_became_active":"2023-08-22T00:06:12.686272+0000","last_became_peered":"2023-08-22T00:06:12.686272+0000","last_unstale":"2023-08-22T00:06:12.688925+0000","last_undegraded":"2023-08-22T00:06:12.688925+0000","last_fullsized":"2023-08-22T00:06:12.688925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674247+0000","last_change":"2023-08-22T00:06:08.290975+0000","last_active":"2023-08-22T00:06:12.674247+0000","last_peered":"2023-08-22T00:06:12.674247+0000","last_clean":"2023-08-22T00:06:12.674247+0000","last_became_active":"2023-08-22T00:06:08.290710+0000","last_became_peered":"2023-08-22T00:06:08.290710+0000","last_unstale":"2023-08-22T00:06:12.674247+0000","last_undegraded":"2023-08-22T00:06:12.674247+0000","last_fullsized":"2023-08-22T00:06:12.674247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670925+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:06:12.670925+0000","last_peered":"2023-08-22T00:06:12.670925+0000","last_clean":"2023-08-22T00:06:12.670925+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:06:12.670925+0000","last_undegraded":"2023-08-22T00:06:12.670925+0000","last_fullsized":"2023-08-22T00:06:12.670925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680519+0000","last_change":"2023-08-22T00:06:08.658411+0000","last_active":"2023-08-22T00:06:12.680519+0000","last_peered":"2023-08-22T00:06:12.680519+0000","last_clean":"2023-08-22T00:06:12.680519+0000","last_became_active":"2023-08-22T00:06:08.658152+0000","last_became_peered":"2023-08-22T00:06:08.658152+0000","last_unstale":"2023-08-22T00:06:12.680519+0000","last_undegraded":"2023-08-22T00:06:12.680519+0000","last_fullsized":"2023-08-22T00:06:12.680519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692091+0000","last_change":"2023-08-22T00:06:12.688771+0000","last_active":"2023-08-22T00:06:12.692091+0000","last_peered":"2023-08-22T00:06:12.692091+0000","last_clean":"2023-08-22T00:06:12.692091+0000","last_became_active":"2023-08-22T00:06:12.688371+0000","last_became_peered":"2023-08-22T00:06:12.688371+0000","last_unstale":"2023-08-22T00:06:12.692091+0000","last_undegraded":"2023-08-22T00:06:12.692091+0000","last_fullsized":"2023-08-22T00:06:12.692091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667141+0000","last_change":"2023-08-22T00:06:08.288643+0000","last_active":"2023-08-22T00:06:12.667141+0000","last_peered":"2023-08-22T00:06:12.667141+0000","last_clean":"2023-08-22T00:06:12.667141+0000","last_became_active":"2023-08-22T00:06:08.288392+0000","last_became_peered":"2023-08-22T00:06:08.288392+0000","last_unstale":"2023-08-22T00:06:12.667141+0000","last_undegraded":"2023-08-22T00:06:12.667141+0000","last_fullsized":"2023-08-22T00:06:12.667141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670819+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:06:12.670819+0000","last_peered":"2023-08-22T00:06:12.670819+0000","last_clean":"2023-08-22T00:06:12.670819+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:06:12.670819+0000","last_undegraded":"2023-08-22T00:06:12.670819+0000","last_fullsized":"2023-08-22T00:06:12.670819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672489+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:06:12.672489+0000","last_peered":"2023-08-22T00:06:12.672489+0000","last_clean":"2023-08-22T00:06:12.672489+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:06:12.672489+0000","last_undegraded":"2023-08-22T00:06:12.672489+0000","last_fullsized":"2023-08-22T00:06:12.672489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665056+0000","last_change":"2023-08-22T00:06:08.659076+0000","last_active":"2023-08-22T00:06:12.665056+0000","last_peered":"2023-08-22T00:06:12.665056+0000","last_clean":"2023-08-22T00:06:12.665056+0000","last_became_active":"2023-08-22T00:06:08.657107+0000","last_became_peered":"2023-08-22T00:06:08.657107+0000","last_unstale":"2023-08-22T00:06:12.665056+0000","last_undegraded":"2023-08-22T00:06:12.665056+0000","last_fullsized":"2023-08-22T00:06:12.665056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685134+0000","last_change":"2023-08-22T00:06:12.681352+0000","last_active":"2023-08-22T00:06:12.685134+0000","last_peered":"2023-08-22T00:06:12.685134+0000","last_clean":"2023-08-22T00:06:12.685134+0000","last_became_active":"2023-08-22T00:06:12.680899+0000","last_became_peered":"2023-08-22T00:06:12.680899+0000","last_unstale":"2023-08-22T00:06:12.685134+0000","last_undegraded":"2023-08-22T00:06:12.685134+0000","last_fullsized":"2023-08-22T00:06:12.685134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677342+0000","last_change":"2023-08-22T00:06:08.287022+0000","last_active":"2023-08-22T00:06:12.677342+0000","last_peered":"2023-08-22T00:06:12.677342+0000","last_clean":"2023-08-22T00:06:12.677342+0000","last_became_active":"2023-08-22T00:06:08.285832+0000","last_became_peered":"2023-08-22T00:06:08.285832+0000","last_unstale":"2023-08-22T00:06:12.677342+0000","last_undegraded":"2023-08-22T00:06:12.677342+0000","last_fullsized":"2023-08-22T00:06:12.677342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670558+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:06:12.670558+0000","last_peered":"2023-08-22T00:06:12.670558+0000","last_clean":"2023-08-22T00:06:12.670558+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:06:12.670558+0000","last_undegraded":"2023-08-22T00:06:12.670558+0000","last_fullsized":"2023-08-22T00:06:12.670558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.684997+0000","last_change":"2023-08-22T00:06:08.653884+0000","last_active":"2023-08-22T00:06:12.684997+0000","last_peered":"2023-08-22T00:06:12.684997+0000","last_clean":"2023-08-22T00:06:12.684997+0000","last_became_active":"2023-08-22T00:06:08.653713+0000","last_became_peered":"2023-08-22T00:06:08.653713+0000","last_unstale":"2023-08-22T00:06:12.684997+0000","last_undegraded":"2023-08-22T00:06:12.684997+0000","last_fullsized":"2023-08-22T00:06:12.684997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693863+0000","last_change":"2023-08-22T00:06:12.685577+0000","last_active":"2023-08-22T00:06:12.693863+0000","last_peered":"2023-08-22T00:06:12.693863+0000","last_clean":"2023-08-22T00:06:12.693863+0000","last_became_active":"2023-08-22T00:06:12.685126+0000","last_became_peered":"2023-08-22T00:06:12.685126+0000","last_unstale":"2023-08-22T00:06:12.693863+0000","last_undegraded":"2023-08-22T00:06:12.693863+0000","last_fullsized":"2023-08-22T00:06:12.693863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681621+0000","last_change":"2023-08-22T00:06:08.652088+0000","last_active":"2023-08-22T00:06:12.681621+0000","last_peered":"2023-08-22T00:06:12.681621+0000","last_clean":"2023-08-22T00:06:12.681621+0000","last_became_active":"2023-08-22T00:06:08.651847+0000","last_became_peered":"2023-08-22T00:06:08.651847+0000","last_unstale":"2023-08-22T00:06:12.681621+0000","last_undegraded":"2023-08-22T00:06:12.681621+0000","last_fullsized":"2023-08-22T00:06:12.681621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665579+0000","last_change":"2023-08-22T00:06:08.290805+0000","last_active":"2023-08-22T00:06:12.665579+0000","last_peered":"2023-08-22T00:06:12.665579+0000","last_clean":"2023-08-22T00:06:12.665579+0000","last_became_active":"2023-08-22T00:06:08.290543+0000","last_became_peered":"2023-08-22T00:06:08.290543+0000","last_unstale":"2023-08-22T00:06:12.665579+0000","last_undegraded":"2023-08-22T00:06:12.665579+0000","last_fullsized":"2023-08-22T00:06:12.665579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673003+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:06:12.673003+0000","last_peered":"2023-08-22T00:06:12.673003+0000","last_clean":"2023-08-22T00:06:12.673003+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:06:12.673003+0000","last_undegraded":"2023-08-22T00:06:12.673003+0000","last_fullsized":"2023-08-22T00:06:12.673003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691389+0000","last_change":"2023-08-22T00:06:12.686780+0000","last_active":"2023-08-22T00:06:12.691389+0000","last_peered":"2023-08-22T00:06:12.691389+0000","last_clean":"2023-08-22T00:06:12.691389+0000","last_became_active":"2023-08-22T00:06:12.686462+0000","last_became_peered":"2023-08-22T00:06:12.686462+0000","last_unstale":"2023-08-22T00:06:12.691389+0000","last_undegraded":"2023-08-22T00:06:12.691389+0000","last_fullsized":"2023-08-22T00:06:12.691389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681816+0000","last_change":"2023-08-22T00:06:08.655816+0000","last_active":"2023-08-22T00:06:12.681816+0000","last_peered":"2023-08-22T00:06:12.681816+0000","last_clean":"2023-08-22T00:06:12.681816+0000","last_became_active":"2023-08-22T00:06:08.655543+0000","last_became_peered":"2023-08-22T00:06:08.655543+0000","last_unstale":"2023-08-22T00:06:12.681816+0000","last_undegraded":"2023-08-22T00:06:12.681816+0000","last_fullsized":"2023-08-22T00:06:12.681816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673810+0000","last_change":"2023-08-22T00:06:08.293689+0000","last_active":"2023-08-22T00:06:12.673810+0000","last_peered":"2023-08-22T00:06:12.673810+0000","last_clean":"2023-08-22T00:06:12.673810+0000","last_became_active":"2023-08-22T00:06:08.293345+0000","last_became_peered":"2023-08-22T00:06:08.293345+0000","last_unstale":"2023-08-22T00:06:12.673810+0000","last_undegraded":"2023-08-22T00:06:12.673810+0000","last_fullsized":"2023-08-22T00:06:12.673810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681700+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:06:12.681700+0000","last_peered":"2023-08-22T00:06:12.681700+0000","last_clean":"2023-08-22T00:06:12.681700+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:06:12.681700+0000","last_undegraded":"2023-08-22T00:06:12.681700+0000","last_fullsized":"2023-08-22T00:06:12.681700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693109+0000","last_change":"2023-08-22T00:06:12.687580+0000","last_active":"2023-08-22T00:06:12.693109+0000","last_peered":"2023-08-22T00:06:12.693109+0000","last_clean":"2023-08-22T00:06:12.693109+0000","last_became_active":"2023-08-22T00:06:12.687255+0000","last_became_peered":"2023-08-22T00:06:12.687255+0000","last_unstale":"2023-08-22T00:06:12.693109+0000","last_undegraded":"2023-08-22T00:06:12.693109+0000","last_fullsized":"2023-08-22T00:06:12.693109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666637+0000","last_change":"2023-08-22T00:06:08.286120+0000","last_active":"2023-08-22T00:06:12.666637+0000","last_peered":"2023-08-22T00:06:12.666637+0000","last_clean":"2023-08-22T00:06:12.666637+0000","last_became_active":"2023-08-22T00:06:08.285828+0000","last_became_peered":"2023-08-22T00:06:08.285828+0000","last_unstale":"2023-08-22T00:06:12.666637+0000","last_undegraded":"2023-08-22T00:06:12.666637+0000","last_fullsized":"2023-08-22T00:06:12.666637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685079+0000","last_change":"2023-08-22T00:06:08.665123+0000","last_active":"2023-08-22T00:06:12.685079+0000","last_peered":"2023-08-22T00:06:12.685079+0000","last_clean":"2023-08-22T00:06:12.685079+0000","last_became_active":"2023-08-22T00:06:08.664679+0000","last_became_peered":"2023-08-22T00:06:08.664679+0000","last_unstale":"2023-08-22T00:06:12.685079+0000","last_undegraded":"2023-08-22T00:06:12.685079+0000","last_fullsized":"2023-08-22T00:06:12.685079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691293+0000","last_change":"2023-08-22T00:06:12.689186+0000","last_active":"2023-08-22T00:06:12.691293+0000","last_peered":"2023-08-22T00:06:12.691293+0000","last_clean":"2023-08-22T00:06:12.691293+0000","last_became_active":"2023-08-22T00:06:12.688721+0000","last_became_peered":"2023-08-22T00:06:12.688721+0000","last_unstale":"2023-08-22T00:06:12.691293+0000","last_undegraded":"2023-08-22T00:06:12.691293+0000","last_fullsized":"2023-08-22T00:06:12.691293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665445+0000","last_change":"2023-08-22T00:06:08.286239+0000","last_active":"2023-08-22T00:06:12.665445+0000","last_peered":"2023-08-22T00:06:12.665445+0000","last_clean":"2023-08-22T00:06:12.665445+0000","last_became_active":"2023-08-22T00:06:08.285947+0000","last_became_peered":"2023-08-22T00:06:08.285947+0000","last_unstale":"2023-08-22T00:06:12.665445+0000","last_undegraded":"2023-08-22T00:06:12.665445+0000","last_fullsized":"2023-08-22T00:06:12.665445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666624+0000","last_change":"2023-08-22T00:06:08.669823+0000","last_active":"2023-08-22T00:06:12.666624+0000","last_peered":"2023-08-22T00:06:12.666624+0000","last_clean":"2023-08-22T00:06:12.666624+0000","last_became_active":"2023-08-22T00:06:08.669205+0000","last_became_peered":"2023-08-22T00:06:08.669205+0000","last_unstale":"2023-08-22T00:06:12.666624+0000","last_undegraded":"2023-08-22T00:06:12.666624+0000","last_fullsized":"2023-08-22T00:06:12.666624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685064+0000","last_change":"2023-08-22T00:06:12.683405+0000","last_active":"2023-08-22T00:06:12.685064+0000","last_peered":"2023-08-22T00:06:12.685064+0000","last_clean":"2023-08-22T00:06:12.685064+0000","last_became_active":"2023-08-22T00:06:12.682920+0000","last_became_peered":"2023-08-22T00:06:12.682920+0000","last_unstale":"2023-08-22T00:06:12.685064+0000","last_undegraded":"2023-08-22T00:06:12.685064+0000","last_fullsized":"2023-08-22T00:06:12.685064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666050+0000","last_change":"2023-08-22T00:06:08.293922+0000","last_active":"2023-08-22T00:06:12.666050+0000","last_peered":"2023-08-22T00:06:12.666050+0000","last_clean":"2023-08-22T00:06:12.666050+0000","last_became_active":"2023-08-22T00:06:08.293634+0000","last_became_peered":"2023-08-22T00:06:08.293634+0000","last_unstale":"2023-08-22T00:06:12.666050+0000","last_undegraded":"2023-08-22T00:06:12.666050+0000","last_fullsized":"2023-08-22T00:06:12.666050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665867+0000","last_change":"2023-08-22T00:06:08.660591+0000","last_active":"2023-08-22T00:06:12.665867+0000","last_peered":"2023-08-22T00:06:12.665867+0000","last_clean":"2023-08-22T00:06:12.665867+0000","last_became_active":"2023-08-22T00:06:08.659961+0000","last_became_peered":"2023-08-22T00:06:08.659961+0000","last_unstale":"2023-08-22T00:06:12.665867+0000","last_undegraded":"2023-08-22T00:06:12.665867+0000","last_fullsized":"2023-08-22T00:06:12.665867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.701768+0000","last_change":"2023-08-22T00:06:12.689578+0000","last_active":"2023-08-22T00:06:12.701768+0000","last_peered":"2023-08-22T00:06:12.701768+0000","last_clean":"2023-08-22T00:06:12.701768+0000","last_became_active":"2023-08-22T00:06:12.689081+0000","last_became_peered":"2023-08-22T00:06:12.689081+0000","last_unstale":"2023-08-22T00:06:12.701768+0000","last_undegraded":"2023-08-22T00:06:12.701768+0000","last_fullsized":"2023-08-22T00:06:12.701768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667259+0000","last_change":"2023-08-22T00:06:08.287748+0000","last_active":"2023-08-22T00:06:12.667259+0000","last_peered":"2023-08-22T00:06:12.667259+0000","last_clean":"2023-08-22T00:06:12.667259+0000","last_became_active":"2023-08-22T00:06:08.287494+0000","last_became_peered":"2023-08-22T00:06:08.287494+0000","last_unstale":"2023-08-22T00:06:12.667259+0000","last_undegraded":"2023-08-22T00:06:12.667259+0000","last_fullsized":"2023-08-22T00:06:12.667259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667054+0000","last_change":"2023-08-22T00:06:08.670010+0000","last_active":"2023-08-22T00:06:12.667054+0000","last_peered":"2023-08-22T00:06:12.667054+0000","last_clean":"2023-08-22T00:06:12.667054+0000","last_became_active":"2023-08-22T00:06:08.669725+0000","last_became_peered":"2023-08-22T00:06:08.669725+0000","last_unstale":"2023-08-22T00:06:12.667054+0000","last_undegraded":"2023-08-22T00:06:12.667054+0000","last_fullsized":"2023-08-22T00:06:12.667054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693735+0000","last_change":"2023-08-22T00:06:12.682981+0000","last_active":"2023-08-22T00:06:12.693735+0000","last_peered":"2023-08-22T00:06:12.693735+0000","last_clean":"2023-08-22T00:06:12.693735+0000","last_became_active":"2023-08-22T00:06:12.682564+0000","last_became_peered":"2023-08-22T00:06:12.682564+0000","last_unstale":"2023-08-22T00:06:12.693735+0000","last_undegraded":"2023-08-22T00:06:12.693735+0000","last_fullsized":"2023-08-22T00:06:12.693735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672285+0000","last_change":"2023-08-22T00:06:08.289593+0000","last_active":"2023-08-22T00:06:12.672285+0000","last_peered":"2023-08-22T00:06:12.672285+0000","last_clean":"2023-08-22T00:06:12.672285+0000","last_became_active":"2023-08-22T00:06:08.289269+0000","last_became_peered":"2023-08-22T00:06:08.289269+0000","last_unstale":"2023-08-22T00:06:12.672285+0000","last_undegraded":"2023-08-22T00:06:12.672285+0000","last_fullsized":"2023-08-22T00:06:12.672285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682276+0000","last_change":"2023-08-22T00:06:08.657006+0000","last_active":"2023-08-22T00:06:12.682276+0000","last_peered":"2023-08-22T00:06:12.682276+0000","last_clean":"2023-08-22T00:06:12.682276+0000","last_became_active":"2023-08-22T00:06:08.656769+0000","last_became_peered":"2023-08-22T00:06:08.656769+0000","last_unstale":"2023-08-22T00:06:12.682276+0000","last_undegraded":"2023-08-22T00:06:12.682276+0000","last_fullsized":"2023-08-22T00:06:12.682276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693819+0000","last_change":"2023-08-22T00:06:12.684195+0000","last_active":"2023-08-22T00:06:12.693819+0000","last_peered":"2023-08-22T00:06:12.693819+0000","last_clean":"2023-08-22T00:06:12.693819+0000","last_became_active":"2023-08-22T00:06:12.683612+0000","last_became_peered":"2023-08-22T00:06:12.683612+0000","last_unstale":"2023-08-22T00:06:12.693819+0000","last_undegraded":"2023-08-22T00:06:12.693819+0000","last_fullsized":"2023-08-22T00:06:12.693819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677098+0000","last_change":"2023-08-22T00:06:08.291933+0000","last_active":"2023-08-22T00:06:12.677098+0000","last_peered":"2023-08-22T00:06:12.677098+0000","last_clean":"2023-08-22T00:06:12.677098+0000","last_became_active":"2023-08-22T00:06:08.291627+0000","last_became_peered":"2023-08-22T00:06:08.291627+0000","last_unstale":"2023-08-22T00:06:12.677098+0000","last_undegraded":"2023-08-22T00:06:12.677098+0000","last_fullsized":"2023-08-22T00:06:12.677098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665964+0000","last_change":"2023-08-22T00:06:08.663881+0000","last_active":"2023-08-22T00:06:12.665964+0000","last_peered":"2023-08-22T00:06:12.665964+0000","last_clean":"2023-08-22T00:06:12.665964+0000","last_became_active":"2023-08-22T00:06:08.663600+0000","last_became_peered":"2023-08-22T00:06:08.663600+0000","last_unstale":"2023-08-22T00:06:12.665964+0000","last_undegraded":"2023-08-22T00:06:12.665964+0000","last_fullsized":"2023-08-22T00:06:12.665964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693913+0000","last_change":"2023-08-22T00:06:12.689051+0000","last_active":"2023-08-22T00:06:12.693913+0000","last_peered":"2023-08-22T00:06:12.693913+0000","last_clean":"2023-08-22T00:06:12.693913+0000","last_became_active":"2023-08-22T00:06:12.688661+0000","last_became_peered":"2023-08-22T00:06:12.688661+0000","last_unstale":"2023-08-22T00:06:12.693913+0000","last_undegraded":"2023-08-22T00:06:12.693913+0000","last_fullsized":"2023-08-22T00:06:12.693913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677466+0000","last_change":"2023-08-22T00:06:08.294656+0000","last_active":"2023-08-22T00:06:12.677466+0000","last_peered":"2023-08-22T00:06:12.677466+0000","last_clean":"2023-08-22T00:06:12.677466+0000","last_became_active":"2023-08-22T00:06:08.292560+0000","last_became_peered":"2023-08-22T00:06:08.292560+0000","last_unstale":"2023-08-22T00:06:12.677466+0000","last_undegraded":"2023-08-22T00:06:12.677466+0000","last_fullsized":"2023-08-22T00:06:12.677466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665464+0000","last_change":"2023-08-22T00:06:08.666434+0000","last_active":"2023-08-22T00:06:12.665464+0000","last_peered":"2023-08-22T00:06:12.665464+0000","last_clean":"2023-08-22T00:06:12.665464+0000","last_became_active":"2023-08-22T00:06:08.663063+0000","last_became_peered":"2023-08-22T00:06:08.663063+0000","last_unstale":"2023-08-22T00:06:12.665464+0000","last_undegraded":"2023-08-22T00:06:12.665464+0000","last_fullsized":"2023-08-22T00:06:12.665464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.693999+0000","last_change":"2023-08-22T00:06:12.692897+0000","last_active":"2023-08-22T00:06:12.693999+0000","last_peered":"2023-08-22T00:06:12.693999+0000","last_clean":"2023-08-22T00:06:12.693999+0000","last_became_active":"2023-08-22T00:06:12.692484+0000","last_became_peered":"2023-08-22T00:06:12.692484+0000","last_unstale":"2023-08-22T00:06:12.693999+0000","last_undegraded":"2023-08-22T00:06:12.693999+0000","last_fullsized":"2023-08-22T00:06:12.693999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678309+0000","last_change":"2023-08-22T00:06:08.295114+0000","last_active":"2023-08-22T00:06:12.678309+0000","last_peered":"2023-08-22T00:06:12.678309+0000","last_clean":"2023-08-22T00:06:12.678309+0000","last_became_active":"2023-08-22T00:06:08.294743+0000","last_became_peered":"2023-08-22T00:06:08.294743+0000","last_unstale":"2023-08-22T00:06:12.678309+0000","last_undegraded":"2023-08-22T00:06:12.678309+0000","last_fullsized":"2023-08-22T00:06:12.678309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.672539+0000","last_change":"2023-08-22T00:06:08.664800+0000","last_active":"2023-08-22T00:06:12.672539+0000","last_peered":"2023-08-22T00:06:12.672539+0000","last_clean":"2023-08-22T00:06:12.672539+0000","last_became_active":"2023-08-22T00:06:08.664511+0000","last_became_peered":"2023-08-22T00:06:08.664511+0000","last_unstale":"2023-08-22T00:06:12.672539+0000","last_undegraded":"2023-08-22T00:06:12.672539+0000","last_fullsized":"2023-08-22T00:06:12.672539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688234+0000","last_change":"2023-08-22T00:06:12.684602+0000","last_active":"2023-08-22T00:06:12.688234+0000","last_peered":"2023-08-22T00:06:12.688234+0000","last_clean":"2023-08-22T00:06:12.688234+0000","last_became_active":"2023-08-22T00:06:12.684197+0000","last_became_peered":"2023-08-22T00:06:12.684197+0000","last_unstale":"2023-08-22T00:06:12.688234+0000","last_undegraded":"2023-08-22T00:06:12.688234+0000","last_fullsized":"2023-08-22T00:06:12.688234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.664815+0000","last_change":"2023-08-22T00:06:08.282647+0000","last_active":"2023-08-22T00:06:12.664815+0000","last_peered":"2023-08-22T00:06:12.664815+0000","last_clean":"2023-08-22T00:06:12.664815+0000","last_became_active":"2023-08-22T00:06:08.282022+0000","last_became_peered":"2023-08-22T00:06:08.282022+0000","last_unstale":"2023-08-22T00:06:12.664815+0000","last_undegraded":"2023-08-22T00:06:12.664815+0000","last_fullsized":"2023-08-22T00:06:12.664815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.670644+0000","last_change":"2023-08-22T00:06:08.668740+0000","last_active":"2023-08-22T00:06:12.670644+0000","last_peered":"2023-08-22T00:06:12.670644+0000","last_clean":"2023-08-22T00:06:12.670644+0000","last_became_active":"2023-08-22T00:06:08.668441+0000","last_became_peered":"2023-08-22T00:06:08.668441+0000","last_unstale":"2023-08-22T00:06:12.670644+0000","last_undegraded":"2023-08-22T00:06:12.670644+0000","last_fullsized":"2023-08-22T00:06:12.670644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692932+0000","last_change":"2023-08-22T00:06:12.691493+0000","last_active":"2023-08-22T00:06:12.692932+0000","last_peered":"2023-08-22T00:06:12.692932+0000","last_clean":"2023-08-22T00:06:12.692932+0000","last_became_active":"2023-08-22T00:06:12.691093+0000","last_became_peered":"2023-08-22T00:06:12.691093+0000","last_unstale":"2023-08-22T00:06:12.692932+0000","last_undegraded":"2023-08-22T00:06:12.692932+0000","last_fullsized":"2023-08-22T00:06:12.692932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.671568+0000","last_change":"2023-08-22T00:06:08.292035+0000","last_active":"2023-08-22T00:06:12.671568+0000","last_peered":"2023-08-22T00:06:12.671568+0000","last_clean":"2023-08-22T00:06:12.671568+0000","last_became_active":"2023-08-22T00:06:08.291203+0000","last_became_peered":"2023-08-22T00:06:08.291203+0000","last_unstale":"2023-08-22T00:06:12.671568+0000","last_undegraded":"2023-08-22T00:06:12.671568+0000","last_fullsized":"2023-08-22T00:06:12.671568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680614+0000","last_change":"2023-08-22T00:06:08.655585+0000","last_active":"2023-08-22T00:06:12.680614+0000","last_peered":"2023-08-22T00:06:12.680614+0000","last_clean":"2023-08-22T00:06:12.680614+0000","last_became_active":"2023-08-22T00:06:08.655310+0000","last_became_peered":"2023-08-22T00:06:08.655310+0000","last_unstale":"2023-08-22T00:06:12.680614+0000","last_undegraded":"2023-08-22T00:06:12.680614+0000","last_fullsized":"2023-08-22T00:06:12.680614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699073+0000","last_change":"2023-08-22T00:06:12.688045+0000","last_active":"2023-08-22T00:06:12.699073+0000","last_peered":"2023-08-22T00:06:12.699073+0000","last_clean":"2023-08-22T00:06:12.699073+0000","last_became_active":"2023-08-22T00:06:12.687684+0000","last_became_peered":"2023-08-22T00:06:12.687684+0000","last_unstale":"2023-08-22T00:06:12.699073+0000","last_undegraded":"2023-08-22T00:06:12.699073+0000","last_fullsized":"2023-08-22T00:06:12.699073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673315+0000","last_change":"2023-08-22T00:06:08.286986+0000","last_active":"2023-08-22T00:06:12.673315+0000","last_peered":"2023-08-22T00:06:12.673315+0000","last_clean":"2023-08-22T00:06:12.673315+0000","last_became_active":"2023-08-22T00:06:08.285641+0000","last_became_peered":"2023-08-22T00:06:08.285641+0000","last_unstale":"2023-08-22T00:06:12.673315+0000","last_undegraded":"2023-08-22T00:06:12.673315+0000","last_fullsized":"2023-08-22T00:06:12.673315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673919+0000","last_change":"2023-08-22T00:06:08.668481+0000","last_active":"2023-08-22T00:06:12.673919+0000","last_peered":"2023-08-22T00:06:12.673919+0000","last_clean":"2023-08-22T00:06:12.673919+0000","last_became_active":"2023-08-22T00:06:08.668192+0000","last_became_peered":"2023-08-22T00:06:08.668192+0000","last_unstale":"2023-08-22T00:06:12.673919+0000","last_undegraded":"2023-08-22T00:06:12.673919+0000","last_fullsized":"2023-08-22T00:06:12.673919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.696626+0000","last_change":"2023-08-22T00:06:12.684100+0000","last_active":"2023-08-22T00:06:12.696626+0000","last_peered":"2023-08-22T00:06:12.696626+0000","last_clean":"2023-08-22T00:06:12.696626+0000","last_became_active":"2023-08-22T00:06:12.683707+0000","last_became_peered":"2023-08-22T00:06:12.683707+0000","last_unstale":"2023-08-22T00:06:12.696626+0000","last_undegraded":"2023-08-22T00:06:12.696626+0000","last_fullsized":"2023-08-22T00:06:12.696626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673189+0000","last_change":"2023-08-22T00:06:08.294557+0000","last_active":"2023-08-22T00:06:12.673189+0000","last_peered":"2023-08-22T00:06:12.673189+0000","last_clean":"2023-08-22T00:06:12.673189+0000","last_became_active":"2023-08-22T00:06:08.292498+0000","last_became_peered":"2023-08-22T00:06:08.292498+0000","last_unstale":"2023-08-22T00:06:12.673189+0000","last_undegraded":"2023-08-22T00:06:12.673189+0000","last_fullsized":"2023-08-22T00:06:12.673189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669639+0000","last_change":"2023-08-22T00:06:08.664640+0000","last_active":"2023-08-22T00:06:12.669639+0000","last_peered":"2023-08-22T00:06:12.669639+0000","last_clean":"2023-08-22T00:06:12.669639+0000","last_became_active":"2023-08-22T00:06:08.664404+0000","last_became_peered":"2023-08-22T00:06:08.664404+0000","last_unstale":"2023-08-22T00:06:12.669639+0000","last_undegraded":"2023-08-22T00:06:12.669639+0000","last_fullsized":"2023-08-22T00:06:12.669639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.692623+0000","last_change":"2023-08-22T00:06:12.691313+0000","last_active":"2023-08-22T00:06:12.692623+0000","last_peered":"2023-08-22T00:06:12.692623+0000","last_clean":"2023-08-22T00:06:12.692623+0000","last_became_active":"2023-08-22T00:06:12.690888+0000","last_became_peered":"2023-08-22T00:06:12.690888+0000","last_unstale":"2023-08-22T00:06:12.692623+0000","last_undegraded":"2023-08-22T00:06:12.692623+0000","last_fullsized":"2023-08-22T00:06:12.692623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667060+0000","last_change":"2023-08-22T00:06:08.292435+0000","last_active":"2023-08-22T00:06:12.667060+0000","last_peered":"2023-08-22T00:06:12.667060+0000","last_clean":"2023-08-22T00:06:12.667060+0000","last_became_active":"2023-08-22T00:06:08.292078+0000","last_became_peered":"2023-08-22T00:06:08.292078+0000","last_unstale":"2023-08-22T00:06:12.667060+0000","last_undegraded":"2023-08-22T00:06:12.667060+0000","last_fullsized":"2023-08-22T00:06:12.667060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665745+0000","last_change":"2023-08-22T00:06:08.670166+0000","last_active":"2023-08-22T00:06:12.665745+0000","last_peered":"2023-08-22T00:06:12.665745+0000","last_clean":"2023-08-22T00:06:12.665745+0000","last_became_active":"2023-08-22T00:06:08.669343+0000","last_became_peered":"2023-08-22T00:06:08.669343+0000","last_unstale":"2023-08-22T00:06:12.665745+0000","last_undegraded":"2023-08-22T00:06:12.665745+0000","last_fullsized":"2023-08-22T00:06:12.665745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702398+0000","last_change":"2023-08-22T00:06:12.697624+0000","last_active":"2023-08-22T00:06:12.702398+0000","last_peered":"2023-08-22T00:06:12.702398+0000","last_clean":"2023-08-22T00:06:12.702398+0000","last_became_active":"2023-08-22T00:06:12.697230+0000","last_became_peered":"2023-08-22T00:06:12.697230+0000","last_unstale":"2023-08-22T00:06:12.702398+0000","last_undegraded":"2023-08-22T00:06:12.702398+0000","last_fullsized":"2023-08-22T00:06:12.702398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.677201+0000","last_change":"2023-08-22T00:06:08.288780+0000","last_active":"2023-08-22T00:06:12.677201+0000","last_peered":"2023-08-22T00:06:12.677201+0000","last_clean":"2023-08-22T00:06:12.677201+0000","last_became_active":"2023-08-22T00:06:08.288449+0000","last_became_peered":"2023-08-22T00:06:08.288449+0000","last_unstale":"2023-08-22T00:06:12.677201+0000","last_undegraded":"2023-08-22T00:06:12.677201+0000","last_fullsized":"2023-08-22T00:06:12.677201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.681899+0000","last_change":"2023-08-22T00:06:08.658370+0000","last_active":"2023-08-22T00:06:12.681899+0000","last_peered":"2023-08-22T00:06:12.681899+0000","last_clean":"2023-08-22T00:06:12.681899+0000","last_became_active":"2023-08-22T00:06:08.658088+0000","last_became_peered":"2023-08-22T00:06:08.658088+0000","last_unstale":"2023-08-22T00:06:12.681899+0000","last_undegraded":"2023-08-22T00:06:12.681899+0000","last_fullsized":"2023-08-22T00:06:12.681899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.699205+0000","last_change":"2023-08-22T00:06:12.690837+0000","last_active":"2023-08-22T00:06:12.699205+0000","last_peered":"2023-08-22T00:06:12.699205+0000","last_clean":"2023-08-22T00:06:12.699205+0000","last_became_active":"2023-08-22T00:06:12.690046+0000","last_became_peered":"2023-08-22T00:06:12.690046+0000","last_unstale":"2023-08-22T00:06:12.699205+0000","last_undegraded":"2023-08-22T00:06:12.699205+0000","last_fullsized":"2023-08-22T00:06:12.699205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.674238+0000","last_change":"2023-08-22T00:06:08.298405+0000","last_active":"2023-08-22T00:06:12.674238+0000","last_peered":"2023-08-22T00:06:12.674238+0000","last_clean":"2023-08-22T00:06:12.674238+0000","last_became_active":"2023-08-22T00:06:08.298085+0000","last_became_peered":"2023-08-22T00:06:08.298085+0000","last_unstale":"2023-08-22T00:06:12.674238+0000","last_undegraded":"2023-08-22T00:06:12.674238+0000","last_fullsized":"2023-08-22T00:06:12.674238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.667438+0000","last_change":"2023-08-22T00:06:08.664353+0000","last_active":"2023-08-22T00:06:12.667438+0000","last_peered":"2023-08-22T00:06:12.667438+0000","last_clean":"2023-08-22T00:06:12.667438+0000","last_became_active":"2023-08-22T00:06:08.664104+0000","last_became_peered":"2023-08-22T00:06:08.664104+0000","last_unstale":"2023-08-22T00:06:12.667438+0000","last_undegraded":"2023-08-22T00:06:12.667438+0000","last_fullsized":"2023-08-22T00:06:12.667438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.691805+0000","last_change":"2023-08-22T00:06:12.688530+0000","last_active":"2023-08-22T00:06:12.691805+0000","last_peered":"2023-08-22T00:06:12.691805+0000","last_clean":"2023-08-22T00:06:12.691805+0000","last_became_active":"2023-08-22T00:06:12.688138+0000","last_became_peered":"2023-08-22T00:06:12.688138+0000","last_unstale":"2023-08-22T00:06:12.691805+0000","last_undegraded":"2023-08-22T00:06:12.691805+0000","last_fullsized":"2023-08-22T00:06:12.691805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.673548+0000","last_change":"2023-08-22T00:06:08.286478+0000","last_active":"2023-08-22T00:06:12.673548+0000","last_peered":"2023-08-22T00:06:12.673548+0000","last_clean":"2023-08-22T00:06:12.673548+0000","last_became_active":"2023-08-22T00:06:08.285839+0000","last_became_peered":"2023-08-22T00:06:08.285839+0000","last_unstale":"2023-08-22T00:06:12.673548+0000","last_undegraded":"2023-08-22T00:06:12.673548+0000","last_fullsized":"2023-08-22T00:06:12.673548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666553+0000","last_change":"2023-08-22T00:06:08.660300+0000","last_active":"2023-08-22T00:06:12.666553+0000","last_peered":"2023-08-22T00:06:12.666553+0000","last_clean":"2023-08-22T00:06:12.666553+0000","last_became_active":"2023-08-22T00:06:08.660029+0000","last_became_peered":"2023-08-22T00:06:08.660029+0000","last_unstale":"2023-08-22T00:06:12.666553+0000","last_undegraded":"2023-08-22T00:06:12.666553+0000","last_fullsized":"2023-08-22T00:06:12.666553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.682861+0000","last_change":"2023-08-22T00:06:12.680840+0000","last_active":"2023-08-22T00:06:12.682861+0000","last_peered":"2023-08-22T00:06:12.682861+0000","last_clean":"2023-08-22T00:06:12.682861+0000","last_became_active":"2023-08-22T00:06:12.680150+0000","last_became_peered":"2023-08-22T00:06:12.680150+0000","last_unstale":"2023-08-22T00:06:12.682861+0000","last_undegraded":"2023-08-22T00:06:12.682861+0000","last_fullsized":"2023-08-22T00:06:12.682861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.702263+0000","last_change":"2023-08-22T00:06:12.697155+0000","last_active":"2023-08-22T00:06:12.702263+0000","last_peered":"2023-08-22T00:06:12.702263+0000","last_clean":"2023-08-22T00:06:12.702263+0000","last_became_active":"2023-08-22T00:06:12.696776+0000","last_became_peered":"2023-08-22T00:06:12.696776+0000","last_unstale":"2023-08-22T00:06:12.702263+0000","last_undegraded":"2023-08-22T00:06:12.702263+0000","last_fullsized":"2023-08-22T00:06:12.702263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666911+0000","last_change":"2023-08-22T00:06:08.290382+0000","last_active":"2023-08-22T00:06:12.666911+0000","last_peered":"2023-08-22T00:06:12.666911+0000","last_clean":"2023-08-22T00:06:12.666911+0000","last_became_active":"2023-08-22T00:06:08.289805+0000","last_became_peered":"2023-08-22T00:06:08.289805+0000","last_unstale":"2023-08-22T00:06:12.666911+0000","last_undegraded":"2023-08-22T00:06:12.666911+0000","last_fullsized":"2023-08-22T00:06:12.666911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.665485+0000","last_change":"2023-08-22T00:06:08.660218+0000","last_active":"2023-08-22T00:06:12.665485+0000","last_peered":"2023-08-22T00:06:12.665485+0000","last_clean":"2023-08-22T00:06:12.665485+0000","last_became_active":"2023-08-22T00:06:08.657393+0000","last_became_peered":"2023-08-22T00:06:08.657393+0000","last_unstale":"2023-08-22T00:06:12.665485+0000","last_undegraded":"2023-08-22T00:06:12.665485+0000","last_fullsized":"2023-08-22T00:06:12.665485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.685964+0000","last_change":"2023-08-22T00:06:12.679635+0000","last_active":"2023-08-22T00:06:12.685964+0000","last_peered":"2023-08-22T00:06:12.685964+0000","last_clean":"2023-08-22T00:06:12.685964+0000","last_became_active":"2023-08-22T00:06:12.679242+0000","last_became_peered":"2023-08-22T00:06:12.679242+0000","last_unstale":"2023-08-22T00:06:12.685964+0000","last_undegraded":"2023-08-22T00:06:12.685964+0000","last_fullsized":"2023-08-22T00:06:12.685964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.678592+0000","last_change":"2023-08-22T00:06:08.281551+0000","last_active":"2023-08-22T00:06:12.678592+0000","last_peered":"2023-08-22T00:06:12.678592+0000","last_clean":"2023-08-22T00:06:12.678592+0000","last_became_active":"2023-08-22T00:06:08.281148+0000","last_became_peered":"2023-08-22T00:06:08.281148+0000","last_unstale":"2023-08-22T00:06:12.678592+0000","last_undegraded":"2023-08-22T00:06:12.678592+0000","last_fullsized":"2023-08-22T00:06:12.678592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.680434+0000","last_change":"2023-08-22T00:06:08.667817+0000","last_active":"2023-08-22T00:06:12.680434+0000","last_peered":"2023-08-22T00:06:12.680434+0000","last_clean":"2023-08-22T00:06:12.680434+0000","last_became_active":"2023-08-22T00:06:08.667588+0000","last_became_peered":"2023-08-22T00:06:08.667588+0000","last_unstale":"2023-08-22T00:06:12.680434+0000","last_undegraded":"2023-08-22T00:06:12.680434+0000","last_fullsized":"2023-08-22T00:06:12.680434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.666260+0000","last_change":"2023-08-22T00:06:08.285483+0000","last_active":"2023-08-22T00:06:12.666260+0000","last_peered":"2023-08-22T00:06:12.666260+0000","last_clean":"2023-08-22T00:06:12.666260+0000","last_became_active":"2023-08-22T00:06:08.284913+0000","last_became_peered":"2023-08-22T00:06:08.284913+0000","last_unstale":"2023-08-22T00:06:12.666260+0000","last_undegraded":"2023-08-22T00:06:12.666260+0000","last_fullsized":"2023-08-22T00:06:12.666260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:07.257411+0000","last_clean_scrub_stamp":"2023-08-22T00:06:07.257411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.669933+0000","last_change":"2023-08-22T00:06:08.660823+0000","last_active":"2023-08-22T00:06:12.669933+0000","last_peered":"2023-08-22T00:06:12.669933+0000","last_clean":"2023-08-22T00:06:12.669933+0000","last_became_active":"2023-08-22T00:06:08.660576+0000","last_became_peered":"2023-08-22T00:06:08.660576+0000","last_unstale":"2023-08-22T00:06:12.669933+0000","last_undegraded":"2023-08-22T00:06:12.669933+0000","last_fullsized":"2023-08-22T00:06:12.669933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:08.263879+0000","last_clean_scrub_stamp":"2023-08-22T00:06:08.263879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-22T00:06:12.688868+0000","last_change":"2023-08-22T00:06:12.687512+0000","last_active":"2023-08-22T00:06:12.688868+0000","last_peered":"2023-08-22T00:06:12.688868+0000","last_clean":"2023-08-22T00:06:12.688868+0000","last_became_active":"2023-08-22T00:06:12.687104+0000","last_became_peered":"2023-08-22T00:06:12.687104+0000","last_unstale":"2023-08-22T00:06:12.688868+0000","last_undegraded":"2023-08-22T00:06:12.688868+0000","last_fullsized":"2023-08-22T00:06:12.688868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:11.651428+0000","last_clean_scrub_stamp":"2023-08-22T00:06:11.651428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4486,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297396,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074444,"statfs":{"total":96636764160,"available":96332230656,"internally_reserved":0,"allocated":307200,"data_stored":117459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":119671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297372,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074468,"statfs":{"total":96636764160,"available":96332255232,"internally_reserved":0,"allocated":282624,"data_stored":116135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297388,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074452,"statfs":{"total":96636764160,"available":96332238848,"internally_reserved":0,"allocated":299008,"data_stored":119817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297368,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074472,"statfs":{"total":96636764160,"available":96332259328,"internally_reserved":0,"allocated":278528,"data_stored":116045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:06:34.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-22T00:06:34.285 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-22T00:06:34.285 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-22T00:06:34.286 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-22T00:06:34.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.413+0000 7f3685c37700 1 Processor -- start 2023-08-22T00:06:34.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.413+0000 7f3685c37700 1 -- start start 2023-08-22T00:06:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.413+0000 7f3685c37700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 0x7f3680068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.413+0000 7f3685c37700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3680153f40 0x7f3680069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.413+0000 7f3685c37700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800a8410 con 0x7f36800a9140 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f3685c37700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3680069720 con 0x7f3680153f40 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f3685c37700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800a8cb0 con 0x7f3680153b60 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3680153f40 0x7f3680069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3680153f40 0x7f3680069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35620/0 (socket says 172.21.15.98:35620) 2023-08-22T00:06:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 -- 172.21.15.98:0/4090707543 learned_addr learned my addr 172.21.15.98:0/4090707543 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367f7fe700 1 --2- 172.21.15.98:0/4090707543 >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 0x7f3680068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 -- 172.21.15.98:0/4090707543 >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 msgr2=0x7f3680068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 --2- 172.21.15.98:0/4090707543 >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 0x7f3680068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 -- 172.21.15.98:0/4090707543 >> v1:172.21.15.118:6789/0 conn(0x7f36800a9140 legacy=0x7f3680157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 -- 172.21.15.98:0/4090707543 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36801586a0 con 0x7f3680153f40 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367f7fe700 1 --2- 172.21.15.98:0/4090707543 >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 0x7f3680068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367effd700 1 --2- 172.21.15.98:0/4090707543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680069230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f368005fcb0 tx=0x7f36680090f0).ready entity=mon.0 client_cookie=1547d8eb6ac58e0e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367e7fc700 1 -- 172.21.15.98:0/4090707543 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800b5a0 con 0x7f3680153f40 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367e7fc700 1 -- 172.21.15.98:0/4090707543 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800b700 con 0x7f3680153f40 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.414+0000 7f367e7fc700 1 -- 172.21.15.98:0/4090707543 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800ba80 con 0x7f3680153f40 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 -- 172.21.15.98:0/4090707543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 msgr2=0x7f3680069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 --2- 172.21.15.98:0/4090707543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680069230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f368005fcb0 tx=0x7f36680090f0).stop 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 -- 172.21.15.98:0/4090707543 shutdown_connections 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 --2- 172.21.15.98:0/4090707543 >> v2:172.21.15.118:3300/0 conn(0x7f3680153b60 0x7f3680068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 --2- 172.21.15.98:0/4090707543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680069230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 -- 172.21.15.98:0/4090707543 >> 172.21.15.98:0/4090707543 conn(0x7f36800c5dc0 msgr2=0x7f3680068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 -- 172.21.15.98:0/4090707543 shutdown_connections 2023-08-22T00:06:34.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.415+0000 7f3685c37700 1 -- 172.21.15.98:0/4090707543 wait complete. 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.416+0000 7f3685c37700 1 Processor -- start 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.416+0000 7f3685c37700 1 -- start start 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36800a9140 0x7f3680147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3680153b60 0x7f368014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680151100 con 0x7f3680153f40 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680150060 con 0x7f36800a9140 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f3685c37700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680150340 con 0x7f3680153b60 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35630/0 (socket says 172.21.15.98:35630) 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 -- 172.21.15.98:0/2076410266 learned_addr learned my addr 172.21.15.98:0/2076410266 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367f7fe700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36800a9140 0x7f3680147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367effd700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3680153b60 0x7f368014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 -- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3680153b60 msgr2=0x7f368014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3680153b60 0x7f368014f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 -- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36800a9140 msgr2=0x7f3680147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36800a9140 0x7f3680147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.417+0000 7f367ffff700 1 -- 172.21.15.98:0/2076410266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009370 con 0x7f3680153f40 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f367ffff700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f367800c490 tx=0x7f3678007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780123f0 con 0x7f3680153f40 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678012570 con 0x7f3680153f40 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3680150620 con 0x7f3680153f40 2023-08-22T00:06:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678012930 con 0x7f3680153f40 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.418+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3680150be0 con 0x7f3680153f40 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.419+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680148220 con 0x7f3680153f40 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.419+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f36780113a0 con 0x7f3680153f40 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.420+0000 7f36777fe700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 0x7f3660061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.420+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3678079710 con 0x7f3680153f40 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.420+0000 7f367f7fe700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 0x7f3660061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.420+0000 7f367f7fe700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 0x7f3660061300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f367000d6e0 tx=0x7f3670007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.424+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f36780478f0 con 0x7f3680153f40 2023-08-22T00:06:34.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.623+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3680047480 con 0x7f3680153f40 2023-08-22T00:06:34.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.624+0000 7f36777fe700 1 -- 172.21.15.98:0/2076410266 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f367804a810 con 0x7f3680153f40 2023-08-22T00:06:34.625 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:34.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 msgr2=0x7f3660061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 0x7f3660061300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f367000d6e0 tx=0x7f3670007850).stop 2023-08-22T00:06:34.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 msgr2=0x7f3680156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f367800c490 tx=0x7f3678007db0).stop 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 shutdown_connections 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3680153f40 0x7f3680156510 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36800a9140 0x7f3680147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f366005ee40 0x7f3660061300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 --2- 172.21.15.98:0/2076410266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3680153b60 0x7f368014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 >> 172.21.15.98:0/2076410266 conn(0x7f36800c5dc0 msgr2=0x7f36800bf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 shutdown_connections 2023-08-22T00:06:34.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.625+0000 7f3685c37700 1 -- 172.21.15.98:0/2076410266 wait complete. 2023-08-22T00:06:34.639 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-22T00:06:34.640 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-22T00:06:34.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:34.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.755+0000 7fba6d8ca700 1 Processor -- start 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.755+0000 7fba6d8ca700 1 -- start start 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153b60 0x7fba68068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba68153f40 0x7fba68069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 0x7fba68157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba68069720 con 0x7fba68153f40 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680a8410 con 0x7fba680a9140 2023-08-22T00:06:34.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba6d8ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680a8cb0 con 0x7fba68153b60 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba68153f40 0x7fba68069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba68153f40 0x7fba68069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35634/0 (socket says 172.21.15.98:35634) 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 -- 172.21.15.98:0/881932885 learned_addr learned my addr 172.21.15.98:0/881932885 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba677fe700 1 --2- 172.21.15.98:0/881932885 >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 0x7fba68157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba66ffd700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153b60 0x7fba68068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 -- 172.21.15.98:0/881932885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153b60 msgr2=0x7fba68068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:34.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153b60 0x7fba68068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 -- 172.21.15.98:0/881932885 >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 msgr2=0x7fba68157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:34.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 --2- 172.21.15.98:0/881932885 >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 0x7fba68157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 -- 172.21.15.98:0/881932885 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba681586a0 con 0x7fba68153f40 2023-08-22T00:06:34.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba677fe700 1 --2- 172.21.15.98:0/881932885 >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 0x7fba68157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:34.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba667fc700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153f40 0x7fba68069230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fba5c006fd0 tx=0x7fba5c0090f0).ready entity=mon.0 client_cookie=2c72984d7d105fcb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba65ffb700 1 -- 172.21.15.98:0/881932885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00b600 con 0x7fba68153f40 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba65ffb700 1 -- 172.21.15.98:0/881932885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c00b760 con 0x7fba68153f40 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.756+0000 7fba65ffb700 1 -- 172.21.15.98:0/881932885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00bae0 con 0x7fba68153f40 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 -- 172.21.15.98:0/881932885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153f40 msgr2=0x7fba68069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153f40 0x7fba68069230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fba5c006fd0 tx=0x7fba5c0090f0).stop 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 -- 172.21.15.98:0/881932885 shutdown_connections 2023-08-22T00:06:34.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153b60 0x7fba68068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/881932885 >> v2:172.21.15.118:3300/0 conn(0x7fba680a9140 0x7fba68157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/881932885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153f40 0x7fba68069230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 -- 172.21.15.98:0/881932885 >> 172.21.15.98:0/881932885 conn(0x7fba680c5dc0 msgr2=0x7fba68068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 -- 172.21.15.98:0/881932885 shutdown_connections 2023-08-22T00:06:34.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.757+0000 7fba6d8ca700 1 -- 172.21.15.98:0/881932885 wait complete. 2023-08-22T00:06:34.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.758+0000 7fba6d8ca700 1 Processor -- start 2023-08-22T00:06:34.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.758+0000 7fba6d8ca700 1 -- start start 2023-08-22T00:06:34.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba680a9140 0x7fba680c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153f40 0x7fba680bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680ad6d0 con 0x7fba68153b60 2023-08-22T00:06:34.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68165400 con 0x7fba680a9140 2023-08-22T00:06:34.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba6d8ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba68167cd0 con 0x7fba68153f40 2023-08-22T00:06:34.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35640/0 (socket says 172.21.15.98:35640) 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 -- 172.21.15.98:0/2033223726 learned_addr learned my addr 172.21.15.98:0/2033223726 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba66ffd700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba680a9140 0x7fba680c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba677fe700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153f40 0x7fba680bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 -- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153f40 msgr2=0x7fba680bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153f40 0x7fba680bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 -- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba680a9140 msgr2=0x7fba680c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba680a9140 0x7fba680c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.759+0000 7fba667fc700 1 -- 172.21.15.98:0/2033223726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009370 con 0x7fba68153b60 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba667fc700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fba68063a30 tx=0x7fba5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00b8d0 con 0x7fba68153b60 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c00ba30 con 0x7fba68153b60 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c01b640 con 0x7fba68153b60 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba680c2250 con 0x7fba68153b60 2023-08-22T00:06:34.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.760+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba680c0e10 con 0x7fba68153b60 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.761+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba680c1030 con 0x7fba68153b60 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.761+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fba5c01b9f0 con 0x7fba68153b60 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.761+0000 7fba4effd700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.761+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fba5c07bbc0 con 0x7fba68153b60 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.761+0000 7fba66ffd700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:34.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.762+0000 7fba66ffd700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fba5800bbc0 tx=0x7fba58008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:34.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.765+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba5c04cd20 con 0x7fba68153b60 2023-08-22T00:06:34.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.926+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba680c2770 con 0x7fba68153b60 2023-08-22T00:06:34.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.927+0000 7fba4effd700 1 -- 172.21.15.98:0/2033223726 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fba5c01f070 con 0x7fba68153b60 2023-08-22T00:06:34.929 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:34.929 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:34.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 msgr2=0x7fba540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fba5800bbc0 tx=0x7fba58008040).stop 2023-08-22T00:06:34.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 msgr2=0x7fba68168160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fba68063a30 tx=0x7fba5c017000).stop 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 shutdown_connections 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68153f40 0x7fba680bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba680a9140 0x7fba680c0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 --2- 172.21.15.98:0/2033223726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba68153b60 0x7fba68168160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:34.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 >> 172.21.15.98:0/2033223726 conn(0x7fba680c5dc0 msgr2=0x7fba681511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:34.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 shutdown_connections 2023-08-22T00:06:34.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:34.929+0000 7fba6d8ca700 1 -- 172.21.15.98:0/2033223726 wait complete. 2023-08-22T00:06:34.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:34.943 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:35.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.060+0000 7f801d071700 1 Processor -- start 2023-08-22T00:06:35.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 -- start start 2023-08-22T00:06:35.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80180c39f0 0x7f8018154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8018151e80 con 0x7f801814ae70 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8018066b90 con 0x7f80180c39f0 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.061+0000 7f801d071700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8018065560 con 0x7f801814b250 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80180c39f0 0x7f8018154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80180c39f0 0x7f8018154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:60356/0 (socket says 172.21.15.98:60356) 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:39900/0 (socket says 172.21.15.98:39900) 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 -- 172.21.15.98:0/1272302549 learned_addr learned my addr 172.21.15.98:0/1272302549 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f8016d9d700 1 --1- 172.21.15.98:0/1272302549 >> v1:172.21.15.118:6789/0 conn(0x7f801814ae70 0x7f80180c6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:52440/0 (socket says 172.21.15.98:52440) 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 -- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 msgr2=0x7f80180c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 -- 172.21.15.98:0/1272302549 >> v1:172.21.15.118:6789/0 conn(0x7f801814ae70 legacy=0x7f80180c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 -- 172.21.15.98:0/1272302549 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180c7590 con 0x7f80180c39f0 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f8015d9b700 1 -- 172.21.15.98:0/1272302549 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376008628 0 0) 0x7f8018151e80 con 0x7f801814ae70 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801659c700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f801759e700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80180c39f0 0x7f8018154730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f801000d1a0 tx=0x7f801000ba50).ready entity=mon.1 client_cookie=6b6c7c4c90f8ca0c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f8015d9b700 1 -- 172.21.15.98:0/1272302549 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010010070 con 0x7f80180c39f0 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.062+0000 7f8015d9b700 1 -- 172.21.15.98:0/1272302549 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000de10 con 0x7f80180c39f0 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f8015d9b700 1 -- 172.21.15.98:0/1272302549 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000b2e0 con 0x7f80180c39f0 2023-08-22T00:06:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 -- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80180c39f0 msgr2=0x7f8018154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80180c39f0 0x7f8018154730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f801000d1a0 tx=0x7f801000ba50).stop 2023-08-22T00:06:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 -- 172.21.15.98:0/1272302549 shutdown_connections 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80180c39f0 0x7f8018154730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 --2- 172.21.15.98:0/1272302549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f801814b250 0x7f80180c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 -- 172.21.15.98:0/1272302549 >> 172.21.15.98:0/1272302549 conn(0x7f80180c7800 msgr2=0x7f80180c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 -- 172.21.15.98:0/1272302549 shutdown_connections 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.063+0000 7f801d071700 1 -- 172.21.15.98:0/1272302549 wait complete. 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.064+0000 7f801d071700 1 Processor -- start 2023-08-22T00:06:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.064+0000 7f801d071700 1 -- start start 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80180c39f0 0x7f80180a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f801814b250 0x7f80181532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801814dbc0 con 0x7f801814ae70 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801814cd30 con 0x7f801814b250 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801d071700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801814cfb0 con 0x7f80180c39f0 2023-08-22T00:06:35.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35650/0 (socket says 172.21.15.98:35650) 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 -- 172.21.15.98:0/2003763565 learned_addr learned my addr 172.21.15.98:0/2003763565 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801759e700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f801814b250 0x7f80181532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f8016d9d700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80180c39f0 0x7f80180a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 -- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80180c39f0 msgr2=0x7f80180a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80180c39f0 0x7f80180a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 -- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f801814b250 msgr2=0x7f80181532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.065+0000 7f801659c700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f801814b250 0x7f80181532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f801659c700 1 -- 172.21.15.98:0/2003763565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080092a0 con 0x7f801814ae70 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f801659c700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f800800ea50 tx=0x7f8008009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800c640 con 0x7f801814ae70 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801000bcf0 con 0x7f801814ae70 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800800c7a0 con 0x7f801814ae70 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800cb20 con 0x7f801814ae70 2023-08-22T00:06:35.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.066+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801814d570 con 0x7f801814ae70 2023-08-22T00:06:35.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.067+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8018069220 con 0x7f801814ae70 2023-08-22T00:06:35.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.067+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f80080123f0 con 0x7f801814ae70 2023-08-22T00:06:35.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.067+0000 7f7ffeffd700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 0x7f80040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.068+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f800807a060 con 0x7f801814ae70 2023-08-22T00:06:35.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.068+0000 7f8016d9d700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 0x7f80040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.068+0000 7f8016d9d700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 0x7f80040612d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f800c0011e0 tx=0x7f800c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.072+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f800804b160 con 0x7f801814ae70 2023-08-22T00:06:35.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.234+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8018150fb0 con 0x7f801814ae70 2023-08-22T00:06:35.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.234+0000 7f7ffeffd700 1 -- 172.21.15.98:0/2003763565 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f800804e780 con 0x7f801814ae70 2023-08-22T00:06:35.249 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:35.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 msgr2=0x7f80040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 0x7f80040612d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f800c0011e0 tx=0x7f800c007bd0).stop 2023-08-22T00:06:35.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 msgr2=0x7f801814c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f800800ea50 tx=0x7f8008009060).stop 2023-08-22T00:06:35.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 shutdown_connections 2023-08-22T00:06:35.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f800405ee10 0x7f80040612d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80180c39f0 0x7f80180a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f801814b250 0x7f80181532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 --2- 172.21.15.98:0/2003763565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f801814ae70 0x7f801814c840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 >> 172.21.15.98:0/2003763565 conn(0x7f80180c7800 msgr2=0x7f801814a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 shutdown_connections 2023-08-22T00:06:35.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.236+0000 7f801d071700 1 -- 172.21.15.98:0/2003763565 wait complete. 2023-08-22T00:06:35.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:35.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.370+0000 7ff1addc5700 1 Processor -- start 2023-08-22T00:06:35.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 -- start start 2023-08-22T00:06:35.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 0x7ff1a80630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 0x7ff1a80c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80c2620 con 0x7ff1a80c21f0 2023-08-22T00:06:35.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a8063a50 con 0x7ff1a8152c30 2023-08-22T00:06:35.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1addc5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8065b70 con 0x7ff1a80635d0 2023-08-22T00:06:35.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.371+0000 7ff1a7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff1a80c21f0 0x7ff1a8155780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54886/0 (socket says 172.21.15.98:54886) 2023-08-22T00:06:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a7fff700 1 -- 172.21.15.98:0/3643845883 learned_addr learned my addr 172.21.15.98:0/3643845883 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/3643845883 >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 0x7ff1a80630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/3643845883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 0x7ff1a80c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776571100 0 0) 0x7ff1a80c2620 con 0x7ff1a80c21f0 2023-08-22T00:06:35.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1940033f0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427945976 0 0) 0x7ff1940033f0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/3643845883 >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 msgr2=0x7ff1a80630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:35.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/3643845883 >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 0x7ff1a80630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/3643845883 >> v1:172.21.15.98:6789/0 conn(0x7ff1a80c21f0 legacy=0x7ff1a8155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/3643845883 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a81524c0 con 0x7ff1a80635d0 2023-08-22T00:06:35.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/3643845883 >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 0x7ff1a80630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:35.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/3643845883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 0x7ff1a80c1d00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff198009760 tx=0x7ff198009060).ready entity=mon.2 client_cookie=9f5b82c9e4639b65 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00017f0 con 0x7ff1a80635d0 2023-08-22T00:06:35.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198011400 con 0x7ff1a80635d0 2023-08-22T00:06:35.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.372+0000 7ff1a67fc700 1 -- 172.21.15.98:0/3643845883 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011780 con 0x7ff1a80635d0 2023-08-22T00:06:35.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 -- 172.21.15.98:0/3643845883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 msgr2=0x7ff1a80c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 --2- 172.21.15.98:0/3643845883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 0x7ff1a80c1d00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff198009760 tx=0x7ff198009060).stop 2023-08-22T00:06:35.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 -- 172.21.15.98:0/3643845883 shutdown_connections 2023-08-22T00:06:35.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 --2- 172.21.15.98:0/3643845883 >> v2:172.21.15.118:3300/0 conn(0x7ff1a8152c30 0x7ff1a80630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 --2- 172.21.15.98:0/3643845883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a80635d0 0x7ff1a80c1d00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 -- 172.21.15.98:0/3643845883 >> 172.21.15.98:0/3643845883 conn(0x7ff1a80c3a60 msgr2=0x7ff1a80c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 -- 172.21.15.98:0/3643845883 shutdown_connections 2023-08-22T00:06:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.373+0000 7ff1addc5700 1 -- 172.21.15.98:0/3643845883 wait complete. 2023-08-22T00:06:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.375+0000 7ff1addc5700 1 Processor -- start 2023-08-22T00:06:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.375+0000 7ff1addc5700 1 -- start start 2023-08-22T00:06:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 0x7ff1a8162930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a8152c30 0x7ff1a80a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80a7920 con 0x7ff1a80c21f0 2023-08-22T00:06:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80a7c00 con 0x7ff1a80635d0 2023-08-22T00:06:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80a7ee0 con 0x7ff1a8152c30 2023-08-22T00:06:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35666/0 (socket says 172.21.15.98:35666) 2023-08-22T00:06:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/2680939074 learned_addr learned my addr 172.21.15.98:0/2680939074 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 0x7ff1a8162930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a7fff700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a8152c30 0x7ff1a80a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a8152c30 msgr2=0x7ff1a80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a8152c30 0x7ff1a80a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 msgr2=0x7ff1a8162930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 0x7ff1a8162930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 -- 172.21.15.98:0/2680939074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900092a0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 0x7ff1a8162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:35.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1a6ffd700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff198009d50 tx=0x7ff198016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198010950 con 0x7ff1a80c21f0 2023-08-22T00:06:35.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198010ab0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198010e50 con 0x7ff1a80c21f0 2023-08-22T00:06:35.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980092a0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.376+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80a84a0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.377+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a80a86c0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.378+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff19801d640 con 0x7ff1a80c21f0 2023-08-22T00:06:35.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.378+0000 7ff19f7fe700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 0x7ff1880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.378+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff19807adf0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.378+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 0x7ff1880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.379+0000 7ff1a77fe700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 0x7ff1880612d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff190009270 tx=0x7ff190008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.382+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff19804bfa0 con 0x7ff1a80c21f0 2023-08-22T00:06:35.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.546+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1a8063c50 con 0x7ff1a80c21f0 2023-08-22T00:06:35.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.546+0000 7ff19f7fe700 1 -- 172.21.15.98:0/2680939074 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff198022030 con 0x7ff1a80c21f0 2023-08-22T00:06:35.548 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:35.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 msgr2=0x7ff1880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 0x7ff1880612d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff190009270 tx=0x7ff190008040).stop 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 msgr2=0x7ff1a813a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff198009d50 tx=0x7ff198016000).stop 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 shutdown_connections 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff18805ee10 0x7ff1880612d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1a8152c30 0x7ff1a80a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1a80635d0 0x7ff1a8162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 --2- 172.21.15.98:0/2680939074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a80c21f0 0x7ff1a813a760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 >> 172.21.15.98:0/2680939074 conn(0x7ff1a80c3a60 msgr2=0x7ff1a8154030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 shutdown_connections 2023-08-22T00:06:35.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.548+0000 7ff1addc5700 1 -- 172.21.15.98:0/2680939074 wait complete. 2023-08-22T00:06:35.562 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 Processor -- start 2023-08-22T00:06:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 -- start start 2023-08-22T00:06:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f09a0157890 0x7f09a0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a00c8c90 con 0x7f09a0153df0 2023-08-22T00:06:35.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a01581d0 con 0x7f09a0153a10 2023-08-22T00:06:35.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.680+0000 7f09a5cc0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00c8ee0 con 0x7f09a0157890 2023-08-22T00:06:35.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f09a0153df0 0x7f09a0063610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54902/0 (socket says 172.21.15.98:54902) 2023-08-22T00:06:35.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099effd700 1 -- 172.21.15.98:0/1512027859 learned_addr learned my addr 172.21.15.98:0/1512027859 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f09a0157890 0x7f09a0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099ffff700 1 -- 172.21.15.98:0/1512027859 >> v1:172.21.15.118:6789/0 conn(0x7f09a0153a10 legacy=0x7f09a00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099ffff700 1 -- 172.21.15.98:0/1512027859 >> v1:172.21.15.98:6789/0 conn(0x7f09a0153df0 legacy=0x7f09a0063610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099ffff700 1 -- 172.21.15.98:0/1512027859 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00c91c0 con 0x7f09a0157890 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099e7fc700 1 -- 172.21.15.98:0/1512027859 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654369186 0 0) 0x7f09a00c8c90 con 0x7f09a0153df0 2023-08-22T00:06:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099ffff700 1 --2- 172.21.15.98:0/1512027859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0157890 0x7f09a0157ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0998009e60 tx=0x7f0998009780).ready entity=mon.0 client_cookie=99cb70748f5c8879 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099e7fc700 1 -- 172.21.15.98:0/1512027859 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800e070 con 0x7f09a0157890 2023-08-22T00:06:35.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099e7fc700 1 -- 172.21.15.98:0/1512027859 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800bc30 con 0x7f09a0157890 2023-08-22T00:06:35.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.681+0000 7f099e7fc700 1 -- 172.21.15.98:0/1512027859 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998012410 con 0x7f09a0157890 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 -- 172.21.15.98:0/1512027859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0157890 msgr2=0x7f09a0157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/1512027859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0157890 0x7f09a0157ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0998009e60 tx=0x7f0998009780).stop 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 -- 172.21.15.98:0/1512027859 shutdown_connections 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/1512027859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0157890 0x7f09a0157ce0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 -- 172.21.15.98:0/1512027859 >> 172.21.15.98:0/1512027859 conn(0x7f09a00c75c0 msgr2=0x7f09a00c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 -- 172.21.15.98:0/1512027859 shutdown_connections 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.682+0000 7f09a5cc0700 1 -- 172.21.15.98:0/1512027859 wait complete. 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.683+0000 7f09a5cc0700 1 Processor -- start 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.683+0000 7f09a5cc0700 1 -- start start 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a0153a10 0x7f09a0142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a0157890 0x7f09a00aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00ae8d0 con 0x7f09a0153df0 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c2f90 con 0x7f09a0153a10 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c20b0 con 0x7f09a0157890 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35694/0 (socket says 172.21.15.98:35694) 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 -- 172.21.15.98:0/4271531293 learned_addr learned my addr 172.21.15.98:0/4271531293 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 -- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a0157890 msgr2=0x7f09a00aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a0157890 0x7f09a00aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 -- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a0153a10 msgr2=0x7f09a0142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099f7fe700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a0153a10 0x7f09a0142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a0153a10 0x7f09a0142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 -- 172.21.15.98:0/4271531293 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998009a20 con 0x7f09a0153df0 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f099effd700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f099400c4c0 tx=0x7f0994007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940072e0 con 0x7f09a0153df0 2023-08-22T00:06:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994007440 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940057a0 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00c2380 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.684+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a00c2940 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.685+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0083330 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.686+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0994005b90 con 0x7f09a0153df0 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.686+0000 7f09877fe700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 0x7f098c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.686+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f09940798a0 con 0x7f09a0153df0 2023-08-22T00:06:35.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.686+0000 7f099f7fe700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 0x7f098c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.686+0000 7f099f7fe700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 0x7f098c0612d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0990007fd0 tx=0x7f0990009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.690+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f099404aa00 con 0x7f09a0153df0 2023-08-22T00:06:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.847+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09a00c30d0 con 0x7f09a0153df0 2023-08-22T00:06:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.848+0000 7f09877fe700 1 -- 172.21.15.98:0/4271531293 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f099404e020 con 0x7f09a0153df0 2023-08-22T00:06:35.850 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 msgr2=0x7f098c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 0x7f098c0612d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0990007fd0 tx=0x7f0990009040).stop 2023-08-22T00:06:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 msgr2=0x7f09a00c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f099400c4c0 tx=0x7f0994007c10).stop 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 shutdown_connections 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f098c05ee10 0x7f098c0612d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a0157890 0x7f09a00aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a0153a10 0x7f09a0142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 --2- 172.21.15.98:0/4271531293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09a0153df0 0x7f09a00c1bc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 >> 172.21.15.98:0/4271531293 conn(0x7f09a00c75c0 msgr2=0x7f09a014e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 shutdown_connections 2023-08-22T00:06:35.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.850+0000 7f09a5cc0700 1 -- 172.21.15.98:0/4271531293 wait complete. 2023-08-22T00:06:35.863 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:35.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.980+0000 7ff36353a700 1 Processor -- start 2023-08-22T00:06:35.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.980+0000 7ff36353a700 1 -- start start 2023-08-22T00:06:35.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff36353a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff35c153e90 0x7ff35c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff36353a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff36353a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0c8d30 con 0x7ff35c157a80 2023-08-22T00:06:35.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff36353a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c1582b0 con 0x7ff35c153e90 2023-08-22T00:06:35.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff36353a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0c9010 con 0x7ff35c157e60 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff35c153e90 0x7ff35c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff35c153e90 0x7ff35c0aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35696/0 (socket says 172.21.15.98:35696) 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 -- 172.21.15.98:0/4129167851 learned_addr learned my addr 172.21.15.98:0/4129167851 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff361ad7700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 -- 172.21.15.98:0/4129167851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 msgr2=0x7ff35c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:35.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 -- 172.21.15.98:0/4129167851 >> v1:172.21.15.118:6789/0 conn(0x7ff35c157a80 legacy=0x7ff35c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 -- 172.21.15.98:0/4129167851 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0c92f0 con 0x7ff35c153e90 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff360ad5700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c153e90 0x7ff35c0aa920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff358006fd0 tx=0x7ff3580090f0).ready entity=mon.0 client_cookie=4e7d84206ae62a01 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff353fff700 1 -- 172.21.15.98:0/4129167851 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800b580 con 0x7ff35c153e90 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff353fff700 1 -- 172.21.15.98:0/4129167851 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800b6e0 con 0x7ff35c153e90 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.981+0000 7ff353fff700 1 -- 172.21.15.98:0/4129167851 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800ba60 con 0x7ff35c153e90 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 -- 172.21.15.98:0/4129167851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c153e90 msgr2=0x7ff35c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c153e90 0x7ff35c0aa920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff358006fd0 tx=0x7ff3580090f0).stop 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 -- 172.21.15.98:0/4129167851 shutdown_connections 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 --2- 172.21.15.98:0/4129167851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c153e90 0x7ff35c0aa920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 -- 172.21.15.98:0/4129167851 >> 172.21.15.98:0/4129167851 conn(0x7ff35c0cb5f0 msgr2=0x7ff35c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 -- 172.21.15.98:0/4129167851 shutdown_connections 2023-08-22T00:06:35.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.982+0000 7ff36353a700 1 -- 172.21.15.98:0/4129167851 wait complete. 2023-08-22T00:06:35.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.983+0000 7ff36353a700 1 Processor -- start 2023-08-22T00:06:35.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.983+0000 7ff36353a700 1 -- start start 2023-08-22T00:06:35.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 0x7ff35c141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0c5f30 con 0x7ff35c157a80 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c167f90 con 0x7ff35c153e90 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff36353a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c167680 con 0x7ff35c157e60 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35712/0 (socket says 172.21.15.98:35712) 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 -- 172.21.15.98:0/301870513 learned_addr learned my addr 172.21.15.98:0/301870513 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff361ad7700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff3612d6700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 0x7ff35c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 -- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 msgr2=0x7ff35c0c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c0c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 -- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 msgr2=0x7ff35c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 0x7ff35c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff360ad5700 1 -- 172.21.15.98:0/301870513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009370 con 0x7ff35c157a80 2023-08-22T00:06:35.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.984+0000 7ff3612d6700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 0x7ff35c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:35.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff360ad5700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff358009130 tx=0x7ff358017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800b850 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800b9b0 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c164ec0 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35801c670 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.985+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c167c20 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.986+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c083630 con 0x7ff35c157a80 2023-08-22T00:06:35.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.986+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff35801ca20 con 0x7ff35c157a80 2023-08-22T00:06:35.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.986+0000 7ff3517fa700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 0x7ff3400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:35.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.986+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff35807bda0 con 0x7ff35c157a80 2023-08-22T00:06:35.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.987+0000 7ff3612d6700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 0x7ff3400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:35.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.987+0000 7ff3612d6700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 0x7ff3400612d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff35c0c2e50 tx=0x7ff34c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:35.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:35.991+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff35804cf00 con 0x7ff35c157a80 2023-08-22T00:06:36.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.153+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff35c0c95d0 con 0x7ff35c157a80 2023-08-22T00:06:36.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.153+0000 7ff3517fa700 1 -- 172.21.15.98:0/301870513 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff35802a070 con 0x7ff35c157a80 2023-08-22T00:06:36.156 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:36.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.155+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 msgr2=0x7ff3400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.155+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 0x7ff3400612d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff35c0c2e50 tx=0x7ff34c009040).stop 2023-08-22T00:06:36.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.155+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 msgr2=0x7ff35c0c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.155+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff358009130 tx=0x7ff358017000).stop 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 shutdown_connections 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff34005ee10 0x7ff3400612d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35c157e60 0x7ff35c0c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c153e90 0x7ff35c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 --2- 172.21.15.98:0/301870513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff35c157a80 0x7ff35c0c5550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 >> 172.21.15.98:0/301870513 conn(0x7ff35c0cb5f0 msgr2=0x7ff35c14d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 shutdown_connections 2023-08-22T00:06:36.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.156+0000 7ff36353a700 1 -- 172.21.15.98:0/301870513 wait complete. 2023-08-22T00:06:36.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:36.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.287+0000 7f2c723ec700 1 Processor -- start 2023-08-22T00:06:36.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 -- start start 2023-08-22T00:06:36.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c6c0c5750 0x7f2c6c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c6c063000 0x7f2c6c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c064280 con 0x7f2c6c1579e0 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c0c1850 con 0x7f2c6c063000 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c723ec700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c063470 con 0x7f2c6c0c5750 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.288+0000 7f2c70989700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c6c063000 0x7f2c6c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c6c063000 0x7f2c6c154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35718/0 (socket says 172.21.15.98:35718) 2023-08-22T00:06:36.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 -- 172.21.15.98:0/3042413562 learned_addr learned my addr 172.21.15.98:0/3042413562 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:36.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c6bfff700 1 --2- 172.21.15.98:0/3042413562 >> v2:172.21.15.118:3300/0 conn(0x7f2c6c0c5750 0x7f2c6c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 -- 172.21.15.98:0/3042413562 >> v2:172.21.15.118:3300/0 conn(0x7f2c6c0c5750 msgr2=0x7f2c6c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 --2- 172.21.15.98:0/3042413562 >> v2:172.21.15.118:3300/0 conn(0x7f2c6c0c5750 0x7f2c6c0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 -- 172.21.15.98:0/3042413562 >> v1:172.21.15.118:6789/0 conn(0x7f2c6c1579e0 legacy=0x7f2c6c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 -- 172.21.15.98:0/3042413562 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0c4c20 con 0x7f2c6c063000 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c70989700 1 --2- 172.21.15.98:0/3042413562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c063000 0x7f2c6c154a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f2c6c067590 tx=0x7f2c64009840).ready entity=mon.0 client_cookie=8ab6fb8dbba0793b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c6affd700 1 -- 172.21.15.98:0/3042413562 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e070 con 0x7f2c6c063000 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c6affd700 1 -- 172.21.15.98:0/3042413562 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400ba10 con 0x7f2c6c063000 2023-08-22T00:06:36.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c6affd700 1 -- 172.21.15.98:0/3042413562 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400bd90 con 0x7f2c6c063000 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.289+0000 7f2c723ec700 1 -- 172.21.15.98:0/3042413562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c063000 msgr2=0x7f2c6c154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 --2- 172.21.15.98:0/3042413562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c063000 0x7f2c6c154a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f2c6c067590 tx=0x7f2c64009840).stop 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 -- 172.21.15.98:0/3042413562 shutdown_connections 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 --2- 172.21.15.98:0/3042413562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c063000 0x7f2c6c154a60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 --2- 172.21.15.98:0/3042413562 >> v2:172.21.15.118:3300/0 conn(0x7f2c6c0c5750 0x7f2c6c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 -- 172.21.15.98:0/3042413562 >> 172.21.15.98:0/3042413562 conn(0x7f2c6c0c3a60 msgr2=0x7f2c6c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 -- 172.21.15.98:0/3042413562 shutdown_connections 2023-08-22T00:06:36.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.290+0000 7f2c723ec700 1 -- 172.21.15.98:0/3042413562 wait complete. 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.291+0000 7f2c723ec700 1 Processor -- start 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.291+0000 7f2c723ec700 1 -- start start 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 0x7f2c6c150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c6c1579e0 0x7f2c6c153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c150950 con 0x7f2c6c0c5750 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c154e20 con 0x7f2c6c063000 2023-08-22T00:06:36.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0bf540 con 0x7f2c6c1579e0 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35726/0 (socket says 172.21.15.98:35726) 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 -- 172.21.15.98:0/2597371769 learned_addr learned my addr 172.21.15.98:0/2597371769 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6bfff700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 0x7f2c6c150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c70989700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c6c1579e0 0x7f2c6c153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 -- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c6c1579e0 msgr2=0x7f2c6c153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c6c1579e0 0x7f2c6c153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 -- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 msgr2=0x7f2c6c150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 0x7f2c6c150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 -- 172.21.15.98:0/2597371769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009ae0 con 0x7f2c6c0c5750 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6bfff700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 0x7f2c6c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c6b7fe700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2c6000b490 tx=0x7f2c60006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60002320 con 0x7f2c6c0c5750 2023-08-22T00:06:36.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c600024a0 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c154860 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60002860 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.292+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0bf1d0 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.293+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c068970 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.294+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2c60002c10 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.294+0000 7f2c53fff700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 0x7f2c58061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.294+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2c60079ec0 con 0x7f2c6c0c5750 2023-08-22T00:06:36.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.294+0000 7f2c6bfff700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 0x7f2c58061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.294+0000 7f2c6bfff700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 0x7f2c58061300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2c5c008900 tx=0x7f2c5c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.298+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c6004b020 con 0x7f2c6c0c5750 2023-08-22T00:06:36.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.458+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2c6c0bf680 con 0x7f2c6c0c5750 2023-08-22T00:06:36.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.458+0000 7f2c53fff700 1 -- 172.21.15.98:0/2597371769 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2c6004e640 con 0x7f2c6c0c5750 2023-08-22T00:06:36.460 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:36.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 msgr2=0x7f2c58061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 0x7f2c58061300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2c5c008900 tx=0x7f2c5c008040).stop 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 msgr2=0x7f2c6c0bf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2c6000b490 tx=0x7f2c60006ef0).stop 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 shutdown_connections 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c5805ee40 0x7f2c58061300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c6c1579e0 0x7f2c6c153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c6c063000 0x7f2c6c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 --2- 172.21.15.98:0/2597371769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c6c0c5750 0x7f2c6c0bf9d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 >> 172.21.15.98:0/2597371769 conn(0x7f2c6c0c3a60 msgr2=0x7f2c6c0c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 shutdown_connections 2023-08-22T00:06:36.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.460+0000 7f2c723ec700 1 -- 172.21.15.98:0/2597371769 wait complete. 2023-08-22T00:06:36.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:36.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.592+0000 7f2300dea700 1 Processor -- start 2023-08-22T00:06:36.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.592+0000 7f2300dea700 1 -- start start 2023-08-22T00:06:36.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f2300dea700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f22fc0c61a0 0x7f22fc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f2300dea700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0c17b0 con 0x7f22fc1544f0 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f2300dea700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc155260 con 0x7f22fc14e0d0 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f2300dea700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0bf9e0 con 0x7f22fc0c61a0 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f22f9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f22fc0c61a0 0x7f22fc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f22fad9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f22fc1544f0 0x7f22fc1549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54912/0 (socket says 172.21.15.98:54912) 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.593+0000 7f22fad9d700 1 -- 172.21.15.98:0/877463280 learned_addr learned my addr 172.21.15.98:0/877463280 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:36.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f9d9b700 1 -- 172.21.15.98:0/877463280 >> v1:172.21.15.118:6789/0 conn(0x7f22fc14e0d0 legacy=0x7f22fc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f9d9b700 1 -- 172.21.15.98:0/877463280 >> v1:172.21.15.98:6789/0 conn(0x7f22fc1544f0 legacy=0x7f22fc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f959a700 1 -- 172.21.15.98:0/877463280 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107095952 0 0) 0x7f22fc0c17b0 con 0x7f22fc1544f0 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f9d9b700 1 -- 172.21.15.98:0/877463280 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0bfcc0 con 0x7f22fc0c61a0 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f9d9b700 1 --2- 172.21.15.98:0/877463280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc0c61a0 0x7f22fc14e4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f22ec009760 tx=0x7f22ec009060).ready entity=mon.0 client_cookie=f8053d4adfe4e939 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f959a700 1 -- 172.21.15.98:0/877463280 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00b580 con 0x7f22fc0c61a0 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f959a700 1 -- 172.21.15.98:0/877463280 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00b6e0 con 0x7f22fc0c61a0 2023-08-22T00:06:36.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f22f959a700 1 -- 172.21.15.98:0/877463280 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00ba60 con 0x7f22fc0c61a0 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f2300dea700 1 -- 172.21.15.98:0/877463280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc0c61a0 msgr2=0x7f22fc14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f2300dea700 1 --2- 172.21.15.98:0/877463280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc0c61a0 0x7f22fc14e4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f22ec009760 tx=0x7f22ec009060).stop 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f2300dea700 1 -- 172.21.15.98:0/877463280 shutdown_connections 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f2300dea700 1 --2- 172.21.15.98:0/877463280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc0c61a0 0x7f22fc14e4b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.594+0000 7f2300dea700 1 -- 172.21.15.98:0/877463280 >> 172.21.15.98:0/877463280 conn(0x7f22fc0caa80 msgr2=0x7f22fc0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.595+0000 7f2300dea700 1 -- 172.21.15.98:0/877463280 shutdown_connections 2023-08-22T00:06:36.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.595+0000 7f2300dea700 1 -- 172.21.15.98:0/877463280 wait complete. 2023-08-22T00:06:36.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 Processor -- start 2023-08-22T00:06:36.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 -- start start 2023-08-22T00:06:36.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22fc0c61a0 0x7f22fc167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22fc1544f0 0x7f22fc062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc14be80 con 0x7f22fc14e0d0 2023-08-22T00:06:36.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1507c0 con 0x7f22fc1544f0 2023-08-22T00:06:36.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.596+0000 7f2300dea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc14fbb0 con 0x7f22fc0c61a0 2023-08-22T00:06:36.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35738/0 (socket says 172.21.15.98:35738) 2023-08-22T00:06:36.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 -- 172.21.15.98:0/3957076707 learned_addr learned my addr 172.21.15.98:0/3957076707 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22fad9d700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22fc1544f0 0x7f22fc062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 -- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22fc0c61a0 msgr2=0x7f22fc167520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22fc0c61a0 0x7f22fc167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 -- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22fc1544f0 msgr2=0x7f22fc062dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22fc1544f0 0x7f22fc062dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 -- 172.21.15.98:0/3957076707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0092a0 con 0x7f22fc14e0d0 2023-08-22T00:06:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f9d9b700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f22fc1543e0 tx=0x7f22ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00ba60 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec000c90 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc14fe90 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec01b670 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.597+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc150450 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.598+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc047480 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.598+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f22ec01ba60 con 0x7f22fc14e0d0 2023-08-22T00:06:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.599+0000 7f22f27fc700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 0x7f22dc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.599+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f22ec07b910 con 0x7f22fc14e0d0 2023-08-22T00:06:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.599+0000 7f22fa59c700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 0x7f22dc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.599+0000 7f22fa59c700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 0x7f22dc0612d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f22e4001510 tx=0x7f22e40079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.603+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22ec04ca70 con 0x7f22fc14e0d0 2023-08-22T00:06:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.808+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22fc0636e0 con 0x7f22fc14e0d0 2023-08-22T00:06:36.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.809+0000 7f22f27fc700 1 -- 172.21.15.98:0/3957076707 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f22ec028090 con 0x7f22fc14e0d0 2023-08-22T00:06:36.810 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:36.811 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:06:36.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 msgr2=0x7f22dc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 0x7f22dc0612d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f22e4001510 tx=0x7f22e40079c0).stop 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 msgr2=0x7f22fc1515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f22fc1543e0 tx=0x7f22ec017000).stop 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 shutdown_connections 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22dc05ee10 0x7f22dc0612d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22fc0c61a0 0x7f22fc167520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22fc1544f0 0x7f22fc062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 --2- 172.21.15.98:0/3957076707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22fc14e0d0 0x7f22fc1515e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 >> 172.21.15.98:0/3957076707 conn(0x7f22fc0caa80 msgr2=0x7f22fc152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 shutdown_connections 2023-08-22T00:06:36.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.811+0000 7f2300dea700 1 -- 172.21.15.98:0/3957076707 wait complete. 2023-08-22T00:06:36.815 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:06:36.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:36.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.940+0000 7fb777bff700 1 Processor -- start 2023-08-22T00:06:36.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.940+0000 7fb777bff700 1 -- start start 2023-08-22T00:06:36.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb770154260 0x7fb7700c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb770154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb770154b30 0x7fb7700c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77014e7b0 con 0x7fb770154260 2023-08-22T00:06:36.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700c4fb0 con 0x7fb770154b30 2023-08-22T00:06:36.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb777bff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700bcfc0 con 0x7fb7700bc850 2023-08-22T00:06:36.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.941+0000 7fb77599b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb770154260 0x7fb7700c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb770154260 0x7fb7700c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35748/0 (socket says 172.21.15.98:35748) 2023-08-22T00:06:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 -- 172.21.15.98:0/2074613904 learned_addr learned my addr 172.21.15.98:0/2074613904 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77519a700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb770154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77619c700 1 --2- 172.21.15.98:0/2074613904 >> v2:172.21.15.118:3300/0 conn(0x7fb770154b30 0x7fb7700c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 -- 172.21.15.98:0/2074613904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 msgr2=0x7fb770154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb770154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 -- 172.21.15.98:0/2074613904 >> v2:172.21.15.118:3300/0 conn(0x7fb770154b30 msgr2=0x7fb7700c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 --2- 172.21.15.98:0/2074613904 >> v2:172.21.15.118:3300/0 conn(0x7fb770154b30 0x7fb7700c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 -- 172.21.15.98:0/2074613904 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700bd2a0 con 0x7fb770154260 2023-08-22T00:06:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77519a700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb770154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb77599b700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7700c2030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb7700c3750 tx=0x7fb7640090f0).ready entity=mon.0 client_cookie=e09e6eb680771ccb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb774999700 1 -- 172.21.15.98:0/2074613904 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400b5b0 con 0x7fb770154260 2023-08-22T00:06:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb774999700 1 -- 172.21.15.98:0/2074613904 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400b710 con 0x7fb770154260 2023-08-22T00:06:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.942+0000 7fb774999700 1 -- 172.21.15.98:0/2074613904 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ba90 con 0x7fb770154260 2023-08-22T00:06:36.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 -- 172.21.15.98:0/2074613904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 msgr2=0x7fb7700c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7700c2030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb7700c3750 tx=0x7fb7640090f0).stop 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 -- 172.21.15.98:0/2074613904 shutdown_connections 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 --2- 172.21.15.98:0/2074613904 >> v2:172.21.15.118:3300/0 conn(0x7fb770154b30 0x7fb7700c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7700c2030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 --2- 172.21.15.98:0/2074613904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb770154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 -- 172.21.15.98:0/2074613904 >> 172.21.15.98:0/2074613904 conn(0x7fb7700c3980 msgr2=0x7fb7700c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 -- 172.21.15.98:0/2074613904 shutdown_connections 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.943+0000 7fb777bff700 1 -- 172.21.15.98:0/2074613904 wait complete. 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.944+0000 7fb777bff700 1 Processor -- start 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.944+0000 7fb777bff700 1 -- start start 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb7700a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 0x7fb7700a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770157ae0 con 0x7fb770154260 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700be670 con 0x7fb770154b30 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700a97f0 con 0x7fb7700bc850 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35756/0 (socket says 172.21.15.98:35756) 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 -- 172.21.15.98:0/1302685951 learned_addr learned my addr 172.21.15.98:0/1302685951 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77619c700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 0x7fb7700a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77599b700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb7700a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 -- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 msgr2=0x7fb7700a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb7700a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 -- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 msgr2=0x7fb7700a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 0x7fb7700a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 -- 172.21.15.98:0/1302685951 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb764009370 con 0x7fb770154260 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77619c700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 0x7fb7700a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb77519a700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb76c00d860 tx=0x7fb76c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c011590 con 0x7fb770154260 2023-08-22T00:06:36.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c0116f0 con 0x7fb770154260 2023-08-22T00:06:36.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c011a70 con 0x7fb770154260 2023-08-22T00:06:36.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.945+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700be020 con 0x7fb770154260 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.946+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700a9500 con 0x7fb770154260 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.947+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700bde80 con 0x7fb770154260 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.947+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb76c012420 con 0x7fb770154260 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.947+0000 7fb761ffb700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 0x7fb7540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.947+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb76c079c80 con 0x7fb770154260 2023-08-22T00:06:36.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.947+0000 7fb77599b700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 0x7fb7540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:36.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.948+0000 7fb77599b700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 0x7fb7540612d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb764009130 tx=0x7fb764017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:36.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:36.951+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7700bde80 con 0x7fb770154260 2023-08-22T00:06:37.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.114+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7700bde80 con 0x7fb770154260 2023-08-22T00:06:37.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.115+0000 7fb761ffb700 1 -- 172.21.15.98:0/1302685951 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fb7700bde80 con 0x7fb770154260 2023-08-22T00:06:37.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:37.117 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:37.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 msgr2=0x7fb7540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 0x7fb7540612d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb764009130 tx=0x7fb764017000).stop 2023-08-22T00:06:37.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 msgr2=0x7fb7701575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb76c00d860 tx=0x7fb76c008040).stop 2023-08-22T00:06:37.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 shutdown_connections 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb75405ee10 0x7fb7540612d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7700bc850 0x7fb7700a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb770154b30 0x7fb7700a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 --2- 172.21.15.98:0/1302685951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb770154260 0x7fb7701575f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 >> 172.21.15.98:0/1302685951 conn(0x7fb7700c3980 msgr2=0x7fb7700c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.116+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 shutdown_connections 2023-08-22T00:06:37.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.117+0000 7fb777bff700 1 -- 172.21.15.98:0/1302685951 wait complete. 2023-08-22T00:06:37.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:37.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:37.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.252+0000 7f4d3a1f8700 1 Processor -- start 2023-08-22T00:06:37.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.252+0000 7f4d3a1f8700 1 -- start start 2023-08-22T00:06:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d3a1f8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4d340c4960 0x7f4d34068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d3a1f8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d340beff0 0x7f4d340c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d3a1f8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d341524b0 con 0x7f4d34066c20 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d3a1f8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3414ffe0 con 0x7f4d340c4960 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d3a1f8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340689f0 con 0x7f4d340beff0 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d337fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4d340c4960 0x7f4d34068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d32ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4d34066c20 0x7f4d340be8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54928/0 (socket says 172.21.15.98:54928) 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d337fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4d340c4960 0x7f4d34068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35758/0 (socket says 172.21.15.98:35758) 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d32ffd700 1 -- 172.21.15.98:0/1854311087 learned_addr learned my addr 172.21.15.98:0/1854311087 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.253+0000 7f4d33fff700 1 --2- 172.21.15.98:0/1854311087 >> v2:172.21.15.118:3300/0 conn(0x7f4d340beff0 0x7f4d340c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d337fe700 1 -- 172.21.15.98:0/1854311087 >> v2:172.21.15.118:3300/0 conn(0x7f4d340beff0 msgr2=0x7f4d340c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d337fe700 1 --2- 172.21.15.98:0/1854311087 >> v2:172.21.15.118:3300/0 conn(0x7f4d340beff0 0x7f4d340c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d337fe700 1 -- 172.21.15.98:0/1854311087 >> v1:172.21.15.98:6789/0 conn(0x7f4d34066c20 legacy=0x7f4d340be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d337fe700 1 -- 172.21.15.98:0/1854311087 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d341526f0 con 0x7f4d340c4960 2023-08-22T00:06:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d337fe700 1 --2- 172.21.15.98:0/1854311087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d34068110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4d340ab5f0 tx=0x7f4d1c009060).ready entity=mon.0 client_cookie=d01c536aa6e343f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d327fc700 1 -- 172.21.15.98:0/1854311087 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0090d0 con 0x7f4d340c4960 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d327fc700 1 -- 172.21.15.98:0/1854311087 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00f510 con 0x7f4d340c4960 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d327fc700 1 -- 172.21.15.98:0/1854311087 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00f890 con 0x7f4d340c4960 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/1854311087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 msgr2=0x7f4d34068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/1854311087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d34068110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4d340ab5f0 tx=0x7f4d1c009060).stop 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/1854311087 shutdown_connections 2023-08-22T00:06:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/1854311087 >> v2:172.21.15.118:3300/0 conn(0x7f4d340beff0 0x7f4d340c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/1854311087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d34068110 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/1854311087 >> 172.21.15.98:0/1854311087 conn(0x7f4d340c5ee0 msgr2=0x7f4d340661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/1854311087 shutdown_connections 2023-08-22T00:06:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.254+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/1854311087 wait complete. 2023-08-22T00:06:37.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 Processor -- start 2023-08-22T00:06:37.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 -- start start 2023-08-22T00:06:37.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 0x7f4d340bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d340beff0 0x7f4d340a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34143160 con 0x7f4d340c4960 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340c0e70 con 0x7f4d34066c20 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.256+0000 7f4d3a1f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340c1300 con 0x7f4d340beff0 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35762/0 (socket says 172.21.15.98:35762) 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 -- 172.21.15.98:0/17990452 learned_addr learned my addr 172.21.15.98:0/17990452 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d337fe700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 0x7f4d340bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d32ffd700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d340beff0 0x7f4d340a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 -- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d340beff0 msgr2=0x7f4d340a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d340beff0 0x7f4d340a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 -- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 msgr2=0x7f4d340bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 0x7f4d340bfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 -- 172.21.15.98:0/17990452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0092a0 con 0x7f4d340c4960 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d337fe700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 0x7f4d340bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d33fff700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4d2c007f20 tx=0x7f4d2c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00ebf0 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00ed50 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c014610 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d340c0260 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.257+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340c0820 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.258+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d340c3de0 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.258+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4d2c01d3b0 con 0x7f4d340c4960 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.259+0000 7f4d2b7fe700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 0x7f4d140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.259+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4d2c07a110 con 0x7f4d340c4960 2023-08-22T00:06:37.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.259+0000 7f4d337fe700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 0x7f4d140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.259+0000 7f4d337fe700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 0x7f4d140612d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d1c006f70 tx=0x7f4d1c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.263+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d2c04a8f0 con 0x7f4d340c4960 2023-08-22T00:06:37.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.421+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4d341529d0 con 0x7f4d340c4960 2023-08-22T00:06:37.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.421+0000 7f4d2b7fe700 1 -- 172.21.15.98:0/17990452 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4d2c04b2c0 con 0x7f4d340c4960 2023-08-22T00:06:37.423 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:37.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 msgr2=0x7f4d140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 0x7f4d140612d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d1c006f70 tx=0x7f4d1c017000).stop 2023-08-22T00:06:37.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 msgr2=0x7f4d340c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4d2c007f20 tx=0x7f4d2c0098a0).stop 2023-08-22T00:06:37.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 shutdown_connections 2023-08-22T00:06:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d340c4960 0x7f4d340c1a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d34066c20 0x7f4d340bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d1405ee10 0x7f4d140612d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 --2- 172.21.15.98:0/17990452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d340beff0 0x7f4d340a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 >> 172.21.15.98:0/17990452 conn(0x7f4d340c5ee0 msgr2=0x7f4d34150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 shutdown_connections 2023-08-22T00:06:37.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.423+0000 7f4d3a1f8700 1 -- 172.21.15.98:0/17990452 wait complete. 2023-08-22T00:06:37.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:37.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.554+0000 7ff3c14c2700 1 Processor -- start 2023-08-22T00:06:37.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.554+0000 7ff3c14c2700 1 -- start start 2023-08-22T00:06:37.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3c14c2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3bc155290 0x7ff3bc0641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3c14c2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0646a0 con 0x7ff3bc067d00 2023-08-22T00:06:37.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3c14c2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc155690 con 0x7ff3bc14e720 2023-08-22T00:06:37.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3c14c2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3bc0654a0 con 0x7ff3bc155290 2023-08-22T00:06:37.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3ba7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff3bc067d00 0x7ff3bc0c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54940/0 (socket says 172.21.15.98:54940) 2023-08-22T00:06:37.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3ba7fc700 1 -- 172.21.15.98:0/735230155 learned_addr learned my addr 172.21.15.98:0/735230155 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:37.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/735230155 >> v2:172.21.15.118:3300/0 conn(0x7ff3bc155290 0x7ff3bc0641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803594318 0 0) 0x7ff3bc0646a0 con 0x7ff3bc067d00 2023-08-22T00:06:37.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a40033f0 con 0x7ff3bc067d00 2023-08-22T00:06:37.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 418802071 0 0) 0x7ff3a40033f0 con 0x7ff3bc067d00 2023-08-22T00:06:37.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 >> v2:172.21.15.118:3300/0 conn(0x7ff3bc155290 msgr2=0x7ff3bc0641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 --2- 172.21.15.98:0/735230155 >> v2:172.21.15.118:3300/0 conn(0x7ff3bc155290 0x7ff3bc0641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 >> v1:172.21.15.118:6789/0 conn(0x7ff3bc14e720 legacy=0x7ff3bc0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc064920 con 0x7ff3bc067d00 2023-08-22T00:06:37.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff3b0001470 con 0x7ff3bc067d00 2023-08-22T00:06:37.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 >> v1:172.21.15.98:6789/0 conn(0x7ff3bc067d00 legacy=0x7ff3bc0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a40038e0 0x7ff3a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.555+0000 7ff3b9ffb700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a4004690 0x7ff3a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 0x7ff3a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0654a0 con 0x7ff3a4005000 2023-08-22T00:06:37.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a400bf60 con 0x7ff3a40038e0 2023-08-22T00:06:37.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a400c0f0 con 0x7ff3a4004690 2023-08-22T00:06:37.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 0x7ff3a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3ba7fc700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a4004690 0x7ff3a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3baffd700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a40038e0 0x7ff3a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a4004690 msgr2=0x7ff3a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a4004690 0x7ff3a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a40038e0 msgr2=0x7ff3a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a40038e0 0x7ff3a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/735230155 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a40033f0 con 0x7ff3a4005000 2023-08-22T00:06:37.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/735230155 reap_dead start 2023-08-22T00:06:37.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 0x7ff3a400b8e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff3b400e1c0 tx=0x7ff3b400b040).ready entity=mon.0 client_cookie=9c0fef1a43f818c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4017070 con 0x7ff3a4005000 2023-08-22T00:06:37.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b400f040 con 0x7ff3a4005000 2023-08-22T00:06:37.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.556+0000 7ff3b9ffb700 1 -- 172.21.15.98:0/735230155 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400eca0 con 0x7ff3a4005000 2023-08-22T00:06:37.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 -- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 msgr2=0x7ff3a400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 0x7ff3a400b8e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff3b400e1c0 tx=0x7ff3b400b040).stop 2023-08-22T00:06:37.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 -- 172.21.15.98:0/735230155 shutdown_connections 2023-08-22T00:06:37.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/735230155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a4005000 0x7ff3a400b8e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 -- 172.21.15.98:0/735230155 >> 172.21.15.98:0/735230155 conn(0x7ff3bc0c8950 msgr2=0x7ff3bc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 -- 172.21.15.98:0/735230155 shutdown_connections 2023-08-22T00:06:37.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.557+0000 7ff3c14c2700 1 -- 172.21.15.98:0/735230155 wait complete. 2023-08-22T00:06:37.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.558+0000 7ff3c14c2700 1 Processor -- start 2023-08-22T00:06:37.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.558+0000 7ff3c14c2700 1 -- start start 2023-08-22T00:06:37.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 0x7ff3bc1687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 0x7ff3bc14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc168360 con 0x7ff3bc0c0720 2023-08-22T00:06:37.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0a7300 con 0x7ff3a4005000 2023-08-22T00:06:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc168030 con 0x7ff3bc0ab140 2023-08-22T00:06:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35780/0 (socket says 172.21.15.98:35780) 2023-08-22T00:06:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/18691135 learned_addr learned my addr 172.21.15.98:0/18691135 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3ba7fc700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 0x7ff3bc14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3baffd700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 0x7ff3bc1687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 msgr2=0x7ff3bc14d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 0x7ff3bc14d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 msgr2=0x7ff3bc1687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 0x7ff3bc1687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/18691135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0a75a0 con 0x7ff3bc0c0720 2023-08-22T00:06:37.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3ba7fc700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 0x7ff3bc14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:37.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3baffd700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 0x7ff3bc1687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:37.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff3b4000f80 tx=0x7ff3b4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4009ac0 con 0x7ff3bc0c0720 2023-08-22T00:06:37.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4013e10 con 0x7ff3bc0c0720 2023-08-22T00:06:37.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc0a7880 con 0x7ff3bc0c0720 2023-08-22T00:06:37.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.559+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b401e870 con 0x7ff3bc0c0720 2023-08-22T00:06:37.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.560+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc14db30 con 0x7ff3bc0c0720 2023-08-22T00:06:37.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.561+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc069d50 con 0x7ff3bc0c0720 2023-08-22T00:06:37.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.561+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff3b4003040 con 0x7ff3bc0c0720 2023-08-22T00:06:37.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.561+0000 7ff3a2ffd700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.561+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff3b407c480 con 0x7ff3bc0c0720 2023-08-22T00:06:37.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.561+0000 7ff3baffd700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.562+0000 7ff3baffd700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 0x7ff3a80612d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff3ac007cc0 tx=0x7ff3ac009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.565+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3b404d580 con 0x7ff3bc0c0720 2023-08-22T00:06:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.724+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3bc064c00 con 0x7ff3bc0c0720 2023-08-22T00:06:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.724+0000 7ff3a2ffd700 1 -- 172.21.15.98:0/18691135 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3b4050ba0 con 0x7ff3bc0c0720 2023-08-22T00:06:37.727 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:37.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 msgr2=0x7ff3a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 0x7ff3a80612d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff3ac007cc0 tx=0x7ff3ac009040).stop 2023-08-22T00:06:37.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 msgr2=0x7ff3bc0c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff3b4000f80 tx=0x7ff3b4019000).stop 2023-08-22T00:06:37.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 shutdown_connections 2023-08-22T00:06:37.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc0c0720 0x7ff3bc0c7c70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a4005000 0x7ff3bc1687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 --2- 172.21.15.98:0/18691135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3bc0ab140 0x7ff3bc14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 >> 172.21.15.98:0/18691135 conn(0x7ff3bc0c8950 msgr2=0x7ff3bc0befe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 shutdown_connections 2023-08-22T00:06:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.726+0000 7ff3c14c2700 1 -- 172.21.15.98:0/18691135 wait complete. 2023-08-22T00:06:37.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:37.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.862+0000 7fb08c057700 1 Processor -- start 2023-08-22T00:06:37.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.862+0000 7fb08c057700 1 -- start start 2023-08-22T00:06:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08c057700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb0840aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08c057700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb084063d20 con 0x7fb084157e60 2023-08-22T00:06:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08c057700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840c8d30 con 0x7fb084157a80 2023-08-22T00:06:37.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08c057700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c9010 con 0x7fb084153e90 2023-08-22T00:06:37.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08a5f4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb084157e60 0x7fb084062600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54956/0 (socket says 172.21.15.98:54956) 2023-08-22T00:06:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb08a5f4700 1 -- 172.21.15.98:0/1829812299 learned_addr learned my addr 172.21.15.98:0/1829812299 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb0895f2700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb0840aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812786252 0 0) 0x7fb084063d20 con 0x7fb084157e60 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0700033f0 con 0x7fb084157e60 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2649437636 0 0) 0x7fb0700033f0 con 0x7fb084157e60 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 msgr2=0x7fb0840aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb0840aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 >> v1:172.21.15.118:6789/0 conn(0x7fb084157a80 legacy=0x7fb084153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840c92f0 con 0x7fb084157e60 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.863+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb07c0017f0 con 0x7fb084157e60 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 >> v1:172.21.15.98:6789/0 conn(0x7fb084157e60 legacy=0x7fb084062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb070003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb070003e40 0x7fb070004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070004b80 0x7fb070005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c9010 con 0x7fb070003e40 2023-08-22T00:06:37.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07000b990 con 0x7fb070004b80 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07000bb50 con 0x7fb084153e90 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb070003e40 0x7fb070004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb089df3700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb070003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb08a5f4700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070004b80 0x7fb070005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 -- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 msgr2=0x7fb070003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb070003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 -- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070004b80 msgr2=0x7fb070005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070004b80 0x7fb070005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 -- 172.21.15.98:0/1829812299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700033f0 con 0x7fb070003e40 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb08a5f4700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070004b80 0x7fb070005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb089df3700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084153e90 0x7fb070003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:37.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb0895f2700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb070003e40 0x7fb070004690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb074009a80 tx=0x7fb074009060).ready entity=mon.0 client_cookie=a586ab0e42785306 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074009430 con 0x7fb070003e40 2023-08-22T00:06:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400e640 con 0x7fb070003e40 2023-08-22T00:06:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.864+0000 7fb088df1700 1 -- 172.21.15.98:0/1829812299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400e9c0 con 0x7fb070003e40 2023-08-22T00:06:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 -- 172.21.15.98:0/1829812299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb070003e40 msgr2=0x7fb070004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 --2- 172.21.15.98:0/1829812299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb070003e40 0x7fb070004690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb074009a80 tx=0x7fb074009060).stop 2023-08-22T00:06:37.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08a5f4700 1 -- 172.21.15.98:0/1829812299 reap_dead start 2023-08-22T00:06:37.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 -- 172.21.15.98:0/1829812299 shutdown_connections 2023-08-22T00:06:37.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 -- 172.21.15.98:0/1829812299 >> 172.21.15.98:0/1829812299 conn(0x7fb0840cb5f0 msgr2=0x7fb0840c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:37.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 -- 172.21.15.98:0/1829812299 shutdown_connections 2023-08-22T00:06:37.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.865+0000 7fb08c057700 1 -- 172.21.15.98:0/1829812299 wait complete. 2023-08-22T00:06:37.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.866+0000 7fb08c057700 1 Processor -- start 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.866+0000 7fb08c057700 1 -- start start 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070003e40 0x7fb08414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084167740 0x7fb084164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084167bc0 con 0x7fb0840af300 2023-08-22T00:06:37.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841562f0 con 0x7fb070003e40 2023-08-22T00:06:37.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08c057700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084165120 con 0x7fb084167740 2023-08-22T00:06:37.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08a5f4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08a5f4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35806/0 (socket says 172.21.15.98:35806) 2023-08-22T00:06:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.867+0000 7fb08a5f4700 1 -- 172.21.15.98:0/4122009588 learned_addr learned my addr 172.21.15.98:0/4122009588 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb089df3700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070003e40 0x7fb08414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb0895f2700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084167740 0x7fb084164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 -- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084167740 msgr2=0x7fb084164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084167740 0x7fb084164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 -- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070003e40 msgr2=0x7fb08414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070003e40 0x7fb08414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 -- 172.21.15.98:0/4122009588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084167dd0 con 0x7fb0840af300 2023-08-22T00:06:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08a5f4700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb084158240 tx=0x7fb07c0013e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0017f0 con 0x7fb0840af300 2023-08-22T00:06:37.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0079e0 con 0x7fb0840af300 2023-08-22T00:06:37.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0841680b0 con 0x7fb0840af300 2023-08-22T00:06:37.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00ea20 con 0x7fb0840af300 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.868+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840af780 con 0x7fb0840af300 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.869+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0841560c0 con 0x7fb0840af300 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.869+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb07c01f440 con 0x7fb0840af300 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.870+0000 7fb079ffb700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 0x7fb0680612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.870+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb07c079e10 con 0x7fb0840af300 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.870+0000 7fb089df3700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 0x7fb0680612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:37.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.870+0000 7fb089df3700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 0x7fb0680612d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb080003850 tx=0x7fb080009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:37.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:37.874+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb0841560c0 con 0x7fb0840af300 2023-08-22T00:06:38.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.034+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0841560c0 con 0x7fb0840af300 2023-08-22T00:06:38.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.034+0000 7fb079ffb700 1 -- 172.21.15.98:0/4122009588 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0841560c0 con 0x7fb0840af300 2023-08-22T00:06:38.036 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:38.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 msgr2=0x7fb0680612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 0x7fb0680612d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb080003850 tx=0x7fb080009040).stop 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 msgr2=0x7fb0840c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb084158240 tx=0x7fb07c0013e0).stop 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 shutdown_connections 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0840af300 0x7fb0840c5550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb070003e40 0x7fb08414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb06805ee10 0x7fb0680612d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 --2- 172.21.15.98:0/4122009588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb084167740 0x7fb084164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 >> 172.21.15.98:0/4122009588 conn(0x7fb0840cb5f0 msgr2=0x7fb084063720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 shutdown_connections 2023-08-22T00:06:38.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.036+0000 7fb08c057700 1 -- 172.21.15.98:0/4122009588 wait complete. 2023-08-22T00:06:38.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:38.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.167+0000 7f4732b4c700 1 Processor -- start 2023-08-22T00:06:38.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.167+0000 7f4732b4c700 1 -- start start 2023-08-22T00:06:38.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.168+0000 7f4732b4c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f472c157a80 0x7f472c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.168+0000 7f4732b4c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f472c153e90 0x7f472c062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.168+0000 7f4732b4c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0c8d30 con 0x7f472c157e60 2023-08-22T00:06:38.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.168+0000 7f4732b4c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c0c9010 con 0x7f472c157a80 2023-08-22T00:06:38.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.168+0000 7f4732b4c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c0c92f0 con 0x7f472c153e90 2023-08-22T00:06:38.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f472c157a80 0x7f472c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f472c157a80 0x7f472c0aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35810/0 (socket says 172.21.15.98:35810) 2023-08-22T00:06:38.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 -- 172.21.15.98:0/1717318491 learned_addr learned my addr 172.21.15.98:0/1717318491 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47310e9700 1 --2- 172.21.15.98:0/1717318491 >> v2:172.21.15.118:3300/0 conn(0x7f472c153e90 0x7f472c062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 -- 172.21.15.98:0/1717318491 >> v2:172.21.15.118:3300/0 conn(0x7f472c153e90 msgr2=0x7f472c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 --2- 172.21.15.98:0/1717318491 >> v2:172.21.15.118:3300/0 conn(0x7f472c153e90 0x7f472c062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 -- 172.21.15.98:0/1717318491 >> v1:172.21.15.118:6789/0 conn(0x7f472c157e60 legacy=0x7f472c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 -- 172.21.15.98:0/1717318491 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0c95d0 con 0x7f472c157a80 2023-08-22T00:06:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f47308e8700 1 --2- 172.21.15.98:0/1717318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c157a80 0x7f472c0aa920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f472c1589c0 tx=0x7f47200090f0).ready entity=mon.0 client_cookie=e02f2bd07111d237 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f472b7fe700 1 -- 172.21.15.98:0/1717318491 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000b520 con 0x7f472c157a80 2023-08-22T00:06:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.169+0000 7f472b7fe700 1 -- 172.21.15.98:0/1717318491 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000b680 con 0x7f472c157a80 2023-08-22T00:06:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f472b7fe700 1 -- 172.21.15.98:0/1717318491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000ba20 con 0x7f472c157a80 2023-08-22T00:06:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 -- 172.21.15.98:0/1717318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c157a80 msgr2=0x7f472c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 --2- 172.21.15.98:0/1717318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c157a80 0x7f472c0aa920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f472c1589c0 tx=0x7f47200090f0).stop 2023-08-22T00:06:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 -- 172.21.15.98:0/1717318491 shutdown_connections 2023-08-22T00:06:38.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 --2- 172.21.15.98:0/1717318491 >> v2:172.21.15.118:3300/0 conn(0x7f472c153e90 0x7f472c062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 --2- 172.21.15.98:0/1717318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c157a80 0x7f472c0aa920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 -- 172.21.15.98:0/1717318491 >> 172.21.15.98:0/1717318491 conn(0x7f472c0cb5f0 msgr2=0x7f472c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 -- 172.21.15.98:0/1717318491 shutdown_connections 2023-08-22T00:06:38.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.170+0000 7f4732b4c700 1 -- 172.21.15.98:0/1717318491 wait complete. 2023-08-22T00:06:38.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.171+0000 7f4732b4c700 1 Processor -- start 2023-08-22T00:06:38.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 -- start start 2023-08-22T00:06:38.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f472c157a80 0x7f472c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f472c157e60 0x7f472c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c155660 con 0x7f472c153e90 2023-08-22T00:06:38.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c154a50 con 0x7f472c157e60 2023-08-22T00:06:38.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f4732b4c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c154d30 con 0x7f472c157a80 2023-08-22T00:06:38.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f47308e8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f47308e8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35822/0 (socket says 172.21.15.98:35822) 2023-08-22T00:06:38.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f47308e8700 1 -- 172.21.15.98:0/2464216118 learned_addr learned my addr 172.21.15.98:0/2464216118 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:38.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47310e9700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f472c157e60 0x7f472c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.172+0000 7f472bfff700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f472c157a80 0x7f472c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 -- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f472c157a80 msgr2=0x7f472c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f472c157a80 0x7f472c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 -- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f472c157e60 msgr2=0x7f472c14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f472c157e60 0x7f472c14c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 -- 172.21.15.98:0/2464216118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009370 con 0x7f472c153e90 2023-08-22T00:06:38.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f47308e8700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4720006fd0 tx=0x7f4720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720006d90 con 0x7f472c153e90 2023-08-22T00:06:38.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720000bc0 con 0x7f472c153e90 2023-08-22T00:06:38.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c155010 con 0x7f472c153e90 2023-08-22T00:06:38.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472001c420 con 0x7f472c153e90 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.173+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c154760 con 0x7f472c153e90 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.174+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c083630 con 0x7f472c153e90 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.174+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f472001c7d0 con 0x7f472c153e90 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.175+0000 7f4728ff9700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 0x7f47100612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.175+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f472007bb50 con 0x7f472c153e90 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.175+0000 7f472bfff700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 0x7f47100612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.175+0000 7f472bfff700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 0x7f47100612d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f472c156f70 tx=0x7f4718007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.179+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f472004ccb0 con 0x7f472c153e90 2023-08-22T00:06:38.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.338+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f472c046c20 con 0x7f472c153e90 2023-08-22T00:06:38.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.339+0000 7f4728ff9700 1 -- 172.21.15.98:0/2464216118 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f472002a020 con 0x7f472c153e90 2023-08-22T00:06:38.348 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:38.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.340+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 msgr2=0x7f47100612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.340+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 0x7f47100612d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f472c156f70 tx=0x7f4718007d20).stop 2023-08-22T00:06:38.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.340+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 msgr2=0x7f472c156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.340+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4720006fd0 tx=0x7f4720017000).stop 2023-08-22T00:06:38.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 shutdown_connections 2023-08-22T00:06:38.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f472c157e60 0x7f472c14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f472c153e90 0x7f472c156a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f471005ee10 0x7f47100612d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 --2- 172.21.15.98:0/2464216118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f472c157a80 0x7f472c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 >> 172.21.15.98:0/2464216118 conn(0x7f472c0cb5f0 msgr2=0x7f472c0c0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 shutdown_connections 2023-08-22T00:06:38.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.341+0000 7f4732b4c700 1 -- 172.21.15.98:0/2464216118 wait complete. 2023-08-22T00:06:38.354 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:38.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.471+0000 7f1d8ef31700 1 Processor -- start 2023-08-22T00:06:38.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 -- start start 2023-08-22T00:06:38.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d8814e720 0x7f1d88155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d880641b0 0x7f1d880675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880654a0 con 0x7f1d88067ae0 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d88064660 con 0x7f1d8814e720 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.472+0000 7f1d8ef31700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d88064920 con 0x7f1d880641b0 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d8814e720 0x7f1d88155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8d4ce700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1d88067ae0 0x7f1d88157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54970/0 (socket says 172.21.15.98:54970) 2023-08-22T00:06:38.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8d4ce700 1 -- 172.21.15.98:0/1054991334 learned_addr learned my addr 172.21.15.98:0/1054991334 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d87fff700 1 --2- 172.21.15.98:0/1054991334 >> v2:172.21.15.118:3300/0 conn(0x7f1d880641b0 0x7f1d880675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 -- 172.21.15.98:0/1054991334 >> v2:172.21.15.118:3300/0 conn(0x7f1d880641b0 msgr2=0x7f1d880675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 --2- 172.21.15.98:0/1054991334 >> v2:172.21.15.118:3300/0 conn(0x7f1d880641b0 0x7f1d880675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 -- 172.21.15.98:0/1054991334 >> v1:172.21.15.98:6789/0 conn(0x7f1d88067ae0 legacy=0x7f1d88157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d877fe700 1 -- 172.21.15.98:0/1054991334 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406101011 0 0) 0x7f1d880654a0 con 0x7f1d88067ae0 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 -- 172.21.15.98:0/1054991334 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88064c00 con 0x7f1d8814e720 2023-08-22T00:06:38.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d8cccd700 1 --2- 172.21.15.98:0/1054991334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d8814e720 0x7f1d88155290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1d8806ab80 tx=0x7f1d7c009060).ready entity=mon.0 client_cookie=a0ec578f7524bf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d877fe700 1 -- 172.21.15.98:0/1054991334 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00f510 con 0x7f1d8814e720 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d877fe700 1 -- 172.21.15.98:0/1054991334 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00f670 con 0x7f1d8814e720 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.473+0000 7f1d877fe700 1 -- 172.21.15.98:0/1054991334 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00f9f0 con 0x7f1d8814e720 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 -- 172.21.15.98:0/1054991334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d8814e720 msgr2=0x7f1d88155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/1054991334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d8814e720 0x7f1d88155290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1d8806ab80 tx=0x7f1d7c009060).stop 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 -- 172.21.15.98:0/1054991334 shutdown_connections 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/1054991334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d8814e720 0x7f1d88155290 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/1054991334 >> v2:172.21.15.118:3300/0 conn(0x7f1d880641b0 0x7f1d880675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 -- 172.21.15.98:0/1054991334 >> 172.21.15.98:0/1054991334 conn(0x7f1d880c8950 msgr2=0x7f1d880c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 -- 172.21.15.98:0/1054991334 shutdown_connections 2023-08-22T00:06:38.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.474+0000 7f1d8ef31700 1 -- 172.21.15.98:0/1054991334 wait complete. 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.475+0000 7f1d8ef31700 1 Processor -- start 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.475+0000 7f1d8ef31700 1 -- start start 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d880641b0 0x7f1d8814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d8814e720 0x7f1d880ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880c1570 con 0x7f1d88067ae0 2023-08-22T00:06:38.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8814dca0 con 0x7f1d880641b0 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88168d80 con 0x7f1d8814e720 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35850/0 (socket says 172.21.15.98:35850) 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 -- 172.21.15.98:0/2842300944 learned_addr learned my addr 172.21.15.98:0/2842300944 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8cccd700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d880641b0 0x7f1d8814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8d4ce700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d8814e720 0x7f1d880ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 -- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d8814e720 msgr2=0x7f1d880ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d8814e720 0x7f1d880ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 -- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d880641b0 msgr2=0x7f1d8814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d880641b0 0x7f1d8814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 -- 172.21.15.98:0/2842300944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0092a0 con 0x7f1d88067ae0 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d87fff700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f1d7400e930 tx=0x7f1d74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012600 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74012760 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88153f00 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012ae0 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.476+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d881544c0 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.478+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1d7401b400 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.478+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d880c1720 con 0x7f1d88067ae0 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.478+0000 7f1d84ff9700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 0x7f1d6c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.478+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f1d7407a380 con 0x7f1d88067ae0 2023-08-22T00:06:38.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.478+0000 7f1d8cccd700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 0x7f1d6c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.479+0000 7f1d8cccd700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 0x7f1d6c0612d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1d8806ab80 tx=0x7f1d7c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.482+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d880c1720 con 0x7f1d88067ae0 2023-08-22T00:06:38.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.642+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1d88069d50 con 0x7f1d88067ae0 2023-08-22T00:06:38.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.643+0000 7f1d84ff9700 1 -- 172.21.15.98:0/2842300944 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1d7404b480 con 0x7f1d88067ae0 2023-08-22T00:06:38.645 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:38.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 msgr2=0x7f1d6c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 0x7f1d6c0612d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1d8806ab80 tx=0x7f1d7c017000).stop 2023-08-22T00:06:38.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 msgr2=0x7f1d88168890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f1d7400e930 tx=0x7f1d74009060).stop 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 shutdown_connections 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6c05ee10 0x7f1d6c0612d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d8814e720 0x7f1d880ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d880641b0 0x7f1d8814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 --2- 172.21.15.98:0/2842300944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d88067ae0 0x7f1d88168890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.644+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 >> 172.21.15.98:0/2842300944 conn(0x7f1d880c8950 msgr2=0x7f1d88065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.645+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 shutdown_connections 2023-08-22T00:06:38.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.645+0000 7f1d8ef31700 1 -- 172.21.15.98:0/2842300944 wait complete. 2023-08-22T00:06:38.658 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:38.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.773+0000 7f9f9ac41700 1 Processor -- start 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.773+0000 7f9f9ac41700 1 -- start start 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.774+0000 7f9f9ac41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 0x7f9f94068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.774+0000 7f9f9ac41700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940a8410 con 0x7f9f940a9140 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.774+0000 7f9f9ac41700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940a8cb0 con 0x7f9f94153f40 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.774+0000 7f9f9ac41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941586a0 con 0x7f9f94153b60 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.774+0000 7f9f991de700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9f940a9140 0x7f9f940c3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54980/0 (socket says 172.21.15.98:54980) 2023-08-22T00:06:38.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f991de700 1 -- 172.21.15.98:0/3661775643 learned_addr learned my addr 172.21.15.98:0/3661775643 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f989dd700 1 --2- 172.21.15.98:0/3661775643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 0x7f9f94068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500891833 0 0) 0x7f9f940a8410 con 0x7f9f940a9140 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f840033f0 con 0x7f9f940a9140 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639598926 0 0) 0x7f9f940a8cb0 con 0x7f9f94153f40 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f940a8410 con 0x7f9f94153f40 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f989dd700 1 -- 172.21.15.98:0/3661775643 >> v1:172.21.15.118:6789/0 conn(0x7f9f94153f40 legacy=0x7f9f94157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021914777 0 0) 0x7f9f840033f0 con 0x7f9f940a9140 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f989dd700 1 -- 172.21.15.98:0/3661775643 >> v1:172.21.15.98:6789/0 conn(0x7f9f940a9140 legacy=0x7f9f940c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f989dd700 1 -- 172.21.15.98:0/3661775643 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940a8660 con 0x7f9f94153b60 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f989dd700 1 --2- 172.21.15.98:0/3661775643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 0x7f9f94068d40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9f880097c0 tx=0x7f9f88009060).ready entity=mon.2 client_cookie=8c59effd17d031a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0017f0 con 0x7f9f94153b60 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88011400 con 0x7f9f94153b60 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.775+0000 7f9f937fe700 1 -- 172.21.15.98:0/3661775643 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88011780 con 0x7f9f94153b60 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3661775643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 msgr2=0x7f9f94068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3661775643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 0x7f9f94068d40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9f880097c0 tx=0x7f9f88009060).stop 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3661775643 shutdown_connections 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3661775643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153b60 0x7f9f94068d40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3661775643 >> 172.21.15.98:0/3661775643 conn(0x7f9f940c5dc0 msgr2=0x7f9f94068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3661775643 shutdown_connections 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.776+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3661775643 wait complete. 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.777+0000 7f9f9ac41700 1 Processor -- start 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.777+0000 7f9f9ac41700 1 -- start start 2023-08-22T00:06:38.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f940a9140 0x7f9f9414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153f40 0x7f9f940abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940ac1d0 con 0x7f9f94153b60 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94155a40 con 0x7f9f940a9140 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f9ac41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94154e70 con 0x7f9f94153f40 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35856/0 (socket says 172.21.15.98:35856) 2023-08-22T00:06:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 -- 172.21.15.98:0/3186522129 learned_addr learned my addr 172.21.15.98:0/3186522129 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f989dd700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f940a9140 0x7f9f9414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f991de700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153f40 0x7f9f940abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 -- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153f40 msgr2=0x7f9f940abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153f40 0x7f9f940abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 -- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f940a9140 msgr2=0x7f9f9414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f940a9140 0x7f9f9414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 -- 172.21.15.98:0/3186522129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880092a0 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.778+0000 7f9f93fff700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9f8000c3f0 tx=0x7f9f80007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.779+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80012400 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.779+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80012560 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.779+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94155110 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.779+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80012920 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.779+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f941556d0 con 0x7f9f94153b60 2023-08-22T00:06:38.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.780+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f940c4b90 con 0x7f9f94153b60 2023-08-22T00:06:38.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.780+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9f8001b3b0 con 0x7f9f94153b60 2023-08-22T00:06:38.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.780+0000 7f9f90ff9700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 0x7f9f780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:38.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.780+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9f800792d0 con 0x7f9f94153b60 2023-08-22T00:06:38.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.780+0000 7f9f989dd700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 0x7f9f780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:38.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.781+0000 7f9f989dd700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 0x7f9f780612d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9f88006d30 tx=0x7f9f88016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:38.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.785+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f800488f0 con 0x7f9f94153b60 2023-08-22T00:06:38.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.984+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f94047480 con 0x7f9f94153b60 2023-08-22T00:06:38.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.985+0000 7f9f90ff9700 1 -- 172.21.15.98:0/3186522129 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f9f8004a480 con 0x7f9f94153b60 2023-08-22T00:06:38.986 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:38.987 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:06:38.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 msgr2=0x7f9f780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 0x7f9f780612d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9f88006d30 tx=0x7f9f88016000).stop 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 msgr2=0x7f9f940ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9f8000c3f0 tx=0x7f9f80007bd0).stop 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 shutdown_connections 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f7805ee10 0x7f9f780612d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f94153f40 0x7f9f940abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f940a9140 0x7f9f9414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 --2- 172.21.15.98:0/3186522129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f94153b60 0x7f9f940ab7f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:38.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 >> 172.21.15.98:0/3186522129 conn(0x7f9f940c5dc0 msgr2=0x7f9f940ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:38.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 shutdown_connections 2023-08-22T00:06:38.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:38.987+0000 7f9f9ac41700 1 -- 172.21.15.98:0/3186522129 wait complete. 2023-08-22T00:06:38.991 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:06:39.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:39.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.116+0000 7fe01d2ff700 1 Processor -- start 2023-08-22T00:06:39.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.116+0000 7fe01d2ff700 1 -- start start 2023-08-22T00:06:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe01d2ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe01814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe01d2ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0181544f0 0x7fe018154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe01d2ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe018155260 con 0x7fe0180c5a90 2023-08-22T00:06:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe01d2ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180c17b0 con 0x7fe0181544f0 2023-08-22T00:06:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe01d2ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180bf9e0 con 0x7fe01814e0d0 2023-08-22T00:06:39.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe0167fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe0180c5a90 0x7fe0180c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54990/0 (socket says 172.21.15.98:54990) 2023-08-22T00:06:39.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe0167fc700 1 -- 172.21.15.98:0/2659056077 learned_addr learned my addr 172.21.15.98:0/2659056077 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:39.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe0177fe700 1 --2- 172.21.15.98:0/2659056077 >> v2:172.21.15.118:3300/0 conn(0x7fe0181544f0 0x7fe018154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe016ffd700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe01814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296444619 0 0) 0x7fe018155260 con 0x7fe0180c5a90 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0000033f0 con 0x7fe0180c5a90 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003585614 0 0) 0x7fe0000033f0 con 0x7fe0180c5a90 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 msgr2=0x7fe01814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe01814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 >> v2:172.21.15.118:3300/0 conn(0x7fe0181544f0 msgr2=0x7fe018154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 --2- 172.21.15.98:0/2659056077 >> v2:172.21.15.118:3300/0 conn(0x7fe0181544f0 0x7fe018154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180bfcc0 con 0x7fe0180c5a90 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe00c001470 con 0x7fe0180c5a90 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 >> v1:172.21.15.98:6789/0 conn(0x7fe0180c5a90 legacy=0x7fe0180c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0000038e0 0x7fe000003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe000004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe000004b80 0x7fe000005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180c17b0 con 0x7fe0000038e0 2023-08-22T00:06:39.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180bf9e0 con 0x7fe000004b80 2023-08-22T00:06:39.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00000b8e0 con 0x7fe01814e0d0 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.117+0000 7fe016ffd700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0000038e0 0x7fe000003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe0177fe700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe000004b80 0x7fe000005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe0167fc700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe000004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 -- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 msgr2=0x7fe000004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe01814e0d0 0x7fe000004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 -- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe000004b80 msgr2=0x7fe000005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe000004b80 0x7fe000005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 -- 172.21.15.98:0/2659056077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000033f0 con 0x7fe0000038e0 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe016ffd700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0000038e0 0x7fe000003d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe008009a60 tx=0x7fe008009060).ready entity=mon.0 client_cookie=482d5c17933df5ed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008009ea0 con 0x7fe0000038e0 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008009430 con 0x7fe0000038e0 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe015ffb700 1 -- 172.21.15.98:0/2659056077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800e870 con 0x7fe0000038e0 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe01d2ff700 1 -- 172.21.15.98:0/2659056077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0000038e0 msgr2=0x7fe000003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/2659056077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0000038e0 0x7fe000003d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe008009a60 tx=0x7fe008009060).stop 2023-08-22T00:06:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe0177fe700 1 -- 172.21.15.98:0/2659056077 reap_dead start 2023-08-22T00:06:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe01d2ff700 1 -- 172.21.15.98:0/2659056077 shutdown_connections 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.118+0000 7fe01d2ff700 1 -- 172.21.15.98:0/2659056077 >> 172.21.15.98:0/2659056077 conn(0x7fe0180caa80 msgr2=0x7fe0180cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.119+0000 7fe01d2ff700 1 -- 172.21.15.98:0/2659056077 shutdown_connections 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.119+0000 7fe01d2ff700 1 -- 172.21.15.98:0/2659056077 wait complete. 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.120+0000 7fe01d2ff700 1 Processor -- start 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.120+0000 7fe01d2ff700 1 -- start start 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.120+0000 7fe01d2ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe018157e30 0x7fe018167400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 0x7fe018167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180c30a0 con 0x7fe0180aefd0 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018168260 con 0x7fe018157e30 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180c2490 con 0x7fe0181678f0 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35882/0 (socket says 172.21.15.98:35882) 2023-08-22T00:06:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 -- 172.21.15.98:0/4244796594 learned_addr learned my addr 172.21.15.98:0/4244796594 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe0177fe700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 0x7fe018167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe0167fc700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe018157e30 0x7fe018167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 -- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 msgr2=0x7fe018167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 0x7fe018167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 -- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe018157e30 msgr2=0x7fe018167400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe018157e30 0x7fe018167400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 -- 172.21.15.98:0/4244796594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180c2770 con 0x7fe0180aefd0 2023-08-22T00:06:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe0177fe700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 0x7fe018167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe016ffd700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe000004490 tx=0x7fe00801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008009ea0 con 0x7fe0180aefd0 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00801bc40 con 0x7fe0180aefd0 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0180c2a50 con 0x7fe0180aefd0 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008025440 con 0x7fe0180aefd0 2023-08-22T00:06:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.121+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0181582b0 con 0x7fe0180aefd0 2023-08-22T00:06:39.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.122+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe018047480 con 0x7fe0180aefd0 2023-08-22T00:06:39.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.122+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe00802e440 con 0x7fe0180aefd0 2023-08-22T00:06:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.123+0000 7fdffeffd700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 0x7fe0040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.123+0000 7fe0167fc700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 0x7fe0040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.123+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe00807ba30 con 0x7fe0180aefd0 2023-08-22T00:06:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.123+0000 7fe0167fc700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 0x7fe0040612d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe00c001c40 tx=0x7fe00c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.127+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe00804cb30 con 0x7fe0180aefd0 2023-08-22T00:06:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.288+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0180bffa0 con 0x7fe0180aefd0 2023-08-22T00:06:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.289+0000 7fdffeffd700 1 -- 172.21.15.98:0/4244796594 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fe008016090 con 0x7fe0180aefd0 2023-08-22T00:06:39.290 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:39.291 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 msgr2=0x7fe0040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 0x7fe0040612d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe00c001c40 tx=0x7fe00c009040).stop 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 msgr2=0x7fe018157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe000004490 tx=0x7fe00801a000).stop 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 shutdown_connections 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe00405ee10 0x7fe0040612d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0181678f0 0x7fe018167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0180aefd0 0x7fe018157940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 --2- 172.21.15.98:0/4244796594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe018157e30 0x7fe018167400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 >> 172.21.15.98:0/4244796594 conn(0x7fe0180caa80 msgr2=0x7fe0180c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:39.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 shutdown_connections 2023-08-22T00:06:39.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.291+0000 7fe01d2ff700 1 -- 172.21.15.98:0/4244796594 wait complete. 2023-08-22T00:06:39.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:39.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.422+0000 7f396cbe3700 1 Processor -- start 2023-08-22T00:06:39.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.423+0000 7f396cbe3700 1 -- start start 2023-08-22T00:06:39.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396cbe3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3968153f40 0x7f3968157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396cbe3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3968157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396cbe3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39680a8410 con 0x7f3968153b60 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396cbe3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680a8cb0 con 0x7f3968153f40 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396cbe3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39681586a0 con 0x7f39680a9140 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3968153b60 0x7f3968068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:54992/0 (socket says 172.21.15.98:54992) 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396659c700 1 -- 172.21.15.98:0/1172413306 learned_addr learned my addr 172.21.15.98:0/1172413306 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f3965d9b700 1 --2- 172.21.15.98:0/1172413306 >> v2:172.21.15.118:3300/0 conn(0x7f3968153f40 0x7f3968157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f3966d9d700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3968157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504001429 0 0) 0x7f39680a8410 con 0x7f3968153b60 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39500033f0 con 0x7f3968153b60 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2028064052 0 0) 0x7f39500033f0 con 0x7f3968153b60 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 msgr2=0x7f3968157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3968157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 >> v2:172.21.15.118:3300/0 conn(0x7f3968153f40 msgr2=0x7f3968157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 --2- 172.21.15.98:0/1172413306 >> v2:172.21.15.118:3300/0 conn(0x7f3968153f40 0x7f3968157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680a8660 con 0x7f3968153b60 2023-08-22T00:06:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3958001470 con 0x7f3968153b60 2023-08-22T00:06:39.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f3966d9d700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3968157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:39.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 >> v1:172.21.15.98:6789/0 conn(0x7f3968153b60 legacy=0x7f3968068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39500038e0 0x7f3950003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3950004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3950004b80 0x7f3950005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680a8cb0 con 0x7f39500038e0 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681586a0 con 0x7f3950004b80 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395000b8e0 con 0x7f39680a9140 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f3965d9b700 1 --2- 172.21.15.98:0/1172413306 >> v2:172.21.15.118:3300/0 conn(0x7f3968153f40 0x7f3968157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.424+0000 7f396659c700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39500038e0 0x7f3950003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f3966d9d700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3950004b80 0x7f3950005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f3965d9b700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3950004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 -- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 msgr2=0x7f3950004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39680a9140 0x7f3950004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 -- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3950004b80 msgr2=0x7f3950005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3950004b80 0x7f3950005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 -- 172.21.15.98:0/1172413306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960009a20 con 0x7f39500038e0 2023-08-22T00:06:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f3966d9d700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3950004b80 0x7f3950005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396659c700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39500038e0 0x7f3950003d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f395800c210 tx=0x7f3958001e90).ready entity=mon.0 client_cookie=a09ccc2fa9d2062b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958007a60 con 0x7f39500038e0 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800cae0 con 0x7f39500038e0 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396559a700 1 -- 172.21.15.98:0/1172413306 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800ce80 con 0x7f39500038e0 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396cbe3700 1 -- 172.21.15.98:0/1172413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39500038e0 msgr2=0x7f3950003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f396cbe3700 1 --2- 172.21.15.98:0/1172413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39500038e0 0x7f3950003d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f395800c210 tx=0x7f3958001e90).stop 2023-08-22T00:06:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.425+0000 7f3966d9d700 1 -- 172.21.15.98:0/1172413306 reap_dead start 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.426+0000 7f396cbe3700 1 -- 172.21.15.98:0/1172413306 shutdown_connections 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.426+0000 7f396cbe3700 1 -- 172.21.15.98:0/1172413306 >> 172.21.15.98:0/1172413306 conn(0x7f39680c5dc0 msgr2=0x7f3968068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.426+0000 7f396cbe3700 1 -- 172.21.15.98:0/1172413306 shutdown_connections 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.426+0000 7f396cbe3700 1 -- 172.21.15.98:0/1172413306 wait complete. 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 Processor -- start 2023-08-22T00:06:39.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 -- start start 2023-08-22T00:06:39.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39500038e0 0x7f3968063d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3968142f10 0x7f3968143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968066460 con 0x7f3968068e90 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968143880 con 0x7f39500038e0 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.427+0000 7f396cbe3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680666e0 con 0x7f3968142f10 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35894/0 (socket says 172.21.15.98:35894) 2023-08-22T00:06:39.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 -- 172.21.15.98:0/6452967 learned_addr learned my addr 172.21.15.98:0/6452967 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3966d9d700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3968142f10 0x7f3968143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f396659c700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39500038e0 0x7f3968063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 -- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3968142f10 msgr2=0x7f3968143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3968142f10 0x7f3968143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 -- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39500038e0 msgr2=0x7f3968063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39500038e0 0x7f3968063d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 -- 172.21.15.98:0/6452967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680669c0 con 0x7f3968068e90 2023-08-22T00:06:39.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f3965d9b700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f395c011910 tx=0x7f395c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c011e50 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c00f8e0 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968066ca0 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00fc60 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.428+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968067260 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.429+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3968067480 con 0x7f3968068e90 2023-08-22T00:06:39.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.429+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f395c015690 con 0x7f3968068e90 2023-08-22T00:06:39.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.430+0000 7f39567fc700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 0x7f3948061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:39.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.430+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f395c07aa50 con 0x7f3968068e90 2023-08-22T00:06:39.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.430+0000 7f396659c700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 0x7f3948061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:39.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.430+0000 7f396659c700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 0x7f3948061300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3958001ed0 tx=0x7f3958015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:39.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.434+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f395c04bbb0 con 0x7f3968068e90 2023-08-22T00:06:39.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.633+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3968047480 con 0x7f3968068e90 2023-08-22T00:06:39.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.634+0000 7f39567fc700 1 -- 172.21.15.98:0/6452967 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f395c04f1d0 con 0x7f3968068e90 2023-08-22T00:06:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:39.637 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:06:39.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 msgr2=0x7f3948061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 0x7f3948061300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3958001ed0 tx=0x7f3958015000).stop 2023-08-22T00:06:39.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 msgr2=0x7f3968069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:39.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f395c011910 tx=0x7f395c008040).stop 2023-08-22T00:06:39.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 shutdown_connections 2023-08-22T00:06:39.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f394805ee40 0x7f3948061300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3968142f10 0x7f3968143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39500038e0 0x7f3968063d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 --2- 172.21.15.98:0/6452967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3968068e90 0x7f3968069310 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:39.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 >> 172.21.15.98:0/6452967 conn(0x7f39680c5dc0 msgr2=0x7f39680beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:39.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 shutdown_connections 2023-08-22T00:06:39.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:39.636+0000 7f396cbe3700 1 -- 172.21.15.98:0/6452967 wait complete. 2023-08-22T00:06:39.643 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:06:40.054 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:06:08.641078+0000', 'modified': '2023-08-22T00:06:26.126981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6833/3719023028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 3719023028}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 3719023028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:06:40.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:06:40.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-22T00:06:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.172+0000 7fcb922ec700 1 Processor -- start 2023-08-22T00:06:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.172+0000 7fcb922ec700 1 -- start start 2023-08-22T00:06:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb8c153f10 0x7fcb8c0c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb8c0be450 0x7fcb8c0bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c065400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0a6440 con 0x7fcb8c0be450 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0658f0 con 0x7fcb8c153f10 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb922ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0bd3b0 con 0x7fcb8c064fb0 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb8b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb8c0be450 0x7fcb8c0bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb8b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb8c0be450 0x7fcb8c0bcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35910/0 (socket says 172.21.15.98:35910) 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/2509333631 learned_addr learned my addr 172.21.15.98:0/2509333631 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/2509333631 >> v2:172.21.15.118:3300/0 conn(0x7fcb8c153f10 0x7fcb8c0c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.173+0000 7fcb90889700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/2509333631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 msgr2=0x7fcb8c065400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c065400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/2509333631 >> v2:172.21.15.118:3300/0 conn(0x7fcb8c153f10 msgr2=0x7fcb8c0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/2509333631 >> v2:172.21.15.118:3300/0 conn(0x7fcb8c153f10 0x7fcb8c0c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/2509333631 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0bd690 con 0x7fcb8c0be450 2023-08-22T00:06:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c0be450 0x7fcb8c0bcb60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fcb8c0c7750 tx=0x7fcb800090f0).ready entity=mon.0 client_cookie=c99db95bfd7507e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8affd700 1 -- 172.21.15.98:0/2509333631 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000f510 con 0x7fcb8c0be450 2023-08-22T00:06:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8affd700 1 -- 172.21.15.98:0/2509333631 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000f670 con 0x7fcb8c0be450 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.174+0000 7fcb8affd700 1 -- 172.21.15.98:0/2509333631 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000f9f0 con 0x7fcb8c0be450 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 -- 172.21.15.98:0/2509333631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c0be450 msgr2=0x7fcb8c0bcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c0be450 0x7fcb8c0bcb60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fcb8c0c7750 tx=0x7fcb800090f0).stop 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 -- 172.21.15.98:0/2509333631 shutdown_connections 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c065400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 --2- 172.21.15.98:0/2509333631 >> v2:172.21.15.118:3300/0 conn(0x7fcb8c153f10 0x7fcb8c0c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 --2- 172.21.15.98:0/2509333631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c0be450 0x7fcb8c0bcb60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 -- 172.21.15.98:0/2509333631 >> 172.21.15.98:0/2509333631 conn(0x7fcb8c0c42e0 msgr2=0x7fcb8c0c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 -- 172.21.15.98:0/2509333631 shutdown_connections 2023-08-22T00:06:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.175+0000 7fcb922ec700 1 -- 172.21.15.98:0/2509333631 wait complete. 2023-08-22T00:06:40.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.176+0000 7fcb922ec700 1 Processor -- start 2023-08-22T00:06:40.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.176+0000 7fcb922ec700 1 -- start start 2023-08-22T00:06:40.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c0ab950 0x7fcb8c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0bf890 con 0x7fcb8c153f10 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0bec80 con 0x7fcb8c0ab950 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb922ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0bef60 con 0x7fcb8c064fb0 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35920/0 (socket says 172.21.15.98:35920) 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3081486736 learned_addr learned my addr 172.21.15.98:0/3081486736 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.177+0000 7fcb90889700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c0ab950 0x7fcb8c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 msgr2=0x7fcb8c149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c0ab950 msgr2=0x7fcb8c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c0ab950 0x7fcb8c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3081486736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009370 con 0x7fcb8c153f10 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fcb80011000 tx=0x7fcb80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb73fff700 1 -- 172.21.15.98:0/3081486736 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000f7e0 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb73fff700 1 -- 172.21.15.98:0/3081486736 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000f940 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0bf240 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb73fff700 1 -- 172.21.15.98:0/3081486736 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8001c670 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.178+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0be8e0 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.179+0000 7fcb73fff700 1 -- 172.21.15.98:0/3081486736 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcb8001ca60 con 0x7fcb8c153f10 2023-08-22T00:06:40.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.180+0000 7fcb73fff700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 0x7fcb780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.180+0000 7fcb73fff700 1 -- 172.21.15.98:0/3081486736 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcb8007b6b0 con 0x7fcb8c153f10 2023-08-22T00:06:40.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.180+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 0x7fcb780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.180+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 0x7fcb780612d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcb7c009b90 tx=0x7fcb7c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 Processor -- start 2023-08-22T00:06:40.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 -- start start 2023-08-22T00:06:40.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a799600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 0x56174a799f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a6dadb0 con 0x56174a79e2c0 2023-08-22T00:06:40.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a6f0030 con 0x56174a799af0 2023-08-22T00:06:40.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.182+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56174a6f0170 con 0x56174a7e6f60 2023-08-22T00:06:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35922/0 (socket says 172.21.15.98:35922) 2023-08-22T00:06:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 -- 172.21.15.98:0/1766744066 learned_addr learned my addr 172.21.15.98:0/1766744066 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb90889700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 0x56174a799f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a799600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 -- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 msgr2=0x56174a799600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a799600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 -- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 msgr2=0x56174a799f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 0x56174a799f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 -- 172.21.15.98:0/1766744066 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56174a6c2b00 con 0x56174a79e2c0 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a799600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb90889700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 0x56174a799f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fcb7c011cc0 tx=0x7fcb7c017000).ready entity=mon.0 client_cookie=f7c834ba12de3c10 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb717fa700 1 -- 172.21.15.98:0/1766744066 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c011e70 con 0x56174a79e2c0 2023-08-22T00:06:40.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb717fa700 1 -- 172.21.15.98:0/1766744066 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c014c60 con 0x56174a79e2c0 2023-08-22T00:06:40.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.183+0000 7fcb717fa700 1 -- 172.21.15.98:0/1766744066 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c01e3f0 con 0x56174a79e2c0 2023-08-22T00:06:40.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/1766744066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 msgr2=0x56174a79e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fcb7c011cc0 tx=0x7fcb7c017000).stop 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/1766744066 shutdown_connections 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a799af0 0x56174a799f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a79e6a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/1766744066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a799600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/1766744066 >> 172.21.15.98:0/1766744066 conn(0x56174a608940 msgr2=0x56174a7e73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/1766744066 shutdown_connections 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/1766744066 wait complete. 2023-08-22T00:06:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.184+0000 7fcba3ca0b80 1 -- start start 2023-08-22T00:06:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 Processor -- start 2023-08-22T00:06:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a7e6f60 0x56174a7f3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a6f03f0 con 0x56174a79e2c0 2023-08-22T00:06:40.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a6bb920 con 0x56174a7e6f60 2023-08-22T00:06:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56174a7cbdb0 con 0x56174a799af0 2023-08-22T00:06:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcba3ca0b80 10 client.0 ll_register_callbacks cb 0x56174a690ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:06:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35928/0 (socket says 172.21.15.98:35928) 2023-08-22T00:06:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3862081502 learned_addr learned my addr 172.21.15.98:0/3862081502 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.185+0000 7fcb90889700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a7e6f60 0x56174a7f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 msgr2=0x56174a7c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a7e6f60 msgr2=0x56174a7f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a7e6f60 0x56174a7f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 -- 172.21.15.98:0/3862081502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c0118e0 con 0x56174a79e2c0 2023-08-22T00:06:40.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fcb80050400 tx=0x7fcb8007b040).ready entity=mon.0 client_cookie=f5857d024792384 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:06:40.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80050470 con 0x56174a79e2c0 2023-08-22T00:06:40.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcb8001cd10 con 0x56174a79e2c0 2023-08-22T00:06:40.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56174a798aa0 con 0x56174a79e2c0 2023-08-22T00:06:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb8004cbe0 con 0x56174a79e2c0 2023-08-22T00:06:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 10 client.4764 fetch_fsmap learned FSMap version 9 2023-08-22T00:06:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56174a6e8f70 con 0x56174a79e2c0 2023-08-22T00:06:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56174a798aa0 con 0x56174a79e2c0 2023-08-22T00:06:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fcb8004f9c0 con 0x56174a79e2c0 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 10 client.4764 fetch_fsmap finished waiting for FSMap version 9 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 10 client.4764 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 20 client.4764 populate_metadata read hostname 'smithi098' 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7c8f70 0x56174a7c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 4 client.4764 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:06:40.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.186+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 --> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56174a558ef0 con 0x56174a7c8f70 2023-08-22T00:06:40.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.187+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7c8f70 0x56174a7c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.187+0000 7fcb6a7fc700 10 client.4764 ms_handle_connect on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:40.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.187+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7c8f70 0x56174a7c9350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f612590584df5aa2 server_cookie=29da1109afc17779 in_seq=0 out_seq=0 2023-08-22T00:06:40.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.187+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3862081502 <== mds.0 v2:172.21.15.118:6832/3719023028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56174a558ef0 con 0x56174a7c8f70 2023-08-22T00:06:40.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcb6a7fc700 10 client.4764 handle_command_reply: tid=0 2023-08-22T00:06:40.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 client.4764 shutdown 2023-08-22T00:06:40.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 msgr2=0x56174a7cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fcb80050400 tx=0x7fcb8007b040).stop 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 shutdown_connections 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7c8f70 0x56174a7c9350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a7e6f60 0x56174a7f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcb6a7fc700 0 client.4764 ms_handle_reset on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3862081502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a79e2c0 0x56174a7cb440 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 >> 172.21.15.98:0/3862081502 conn(0x56174a608940 msgr2=0x56174a79c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 shutdown_connections 2023-08-22T00:06:40.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3862081502 wait complete. 2023-08-22T00:06:40.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.188+0000 7fcba3ca0b80 20 client.4764 trim_cache size 0 max 16384 2023-08-22T00:06:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.204+0000 7fcba3ca0b80 1 Processor -- start 2023-08-22T00:06:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.204+0000 7fcba3ca0b80 1 -- start start 2023-08-22T00:06:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7df970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a7dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a792e30 con 0x56174a799af0 2023-08-22T00:06:40.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a79aff0 con 0x56174a79e2c0 2023-08-22T00:06:40.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56174a7c5660 con 0x56174a7e6f60 2023-08-22T00:06:40.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35934/0 (socket says 172.21.15.98:35934) 2023-08-22T00:06:40.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 -- 172.21.15.98:0/3521371905 learned_addr learned my addr 172.21.15.98:0/3521371905 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb90889700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a7dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 -- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 msgr2=0x56174a7dfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a7dfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 -- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 msgr2=0x56174a7df970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7df970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 -- 172.21.15.98:0/3521371905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56174a6e4580 con 0x56174a799af0 2023-08-22T00:06:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb90889700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a7dfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fcb7c014ab0 tx=0x7fcb7c021000).ready entity=mon.0 client_cookie=5e4c1f83b6230f7b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb71ffb700 1 -- 172.21.15.98:0/3521371905 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c030040 con 0x56174a799af0 2023-08-22T00:06:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb71ffb700 1 -- 172.21.15.98:0/3521371905 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c014dd0 con 0x56174a799af0 2023-08-22T00:06:40.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.205+0000 7fcb71ffb700 1 -- 172.21.15.98:0/3521371905 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c034280 con 0x56174a799af0 2023-08-22T00:06:40.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3521371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 msgr2=0x56174a794ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fcb7c014ab0 tx=0x7fcb7c021000).stop 2023-08-22T00:06:40.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3521371905 shutdown_connections 2023-08-22T00:06:40.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a7e6f60 0x56174a7dfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a799af0 0x56174a794ea0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3521371905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3521371905 >> 172.21.15.98:0/3521371905 conn(0x56174a608940 msgr2=0x56174a79b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3521371905 shutdown_connections 2023-08-22T00:06:40.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.206+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3521371905 wait complete. 2023-08-22T00:06:40.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 -- start start 2023-08-22T00:06:40.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 Processor -- start 2023-08-22T00:06:40.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a7cad60 con 0x56174a7e6f60 2023-08-22T00:06:40.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174a849a20 con 0x56174a79e2c0 2023-08-22T00:06:40.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56174a7ec020 con 0x56174a799af0 2023-08-22T00:06:40.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.207+0000 7fcba3ca0b80 10 client.0 ll_register_callbacks cb 0x56174a690ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:06:40.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35942/0 (socket says 172.21.15.98:35942) 2023-08-22T00:06:40.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 -- 172.21.15.98:0/3569425189 learned_addr learned my addr 172.21.15.98:0/3569425189 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb8b7fe700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 -- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 msgr2=0x56174a7ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 -- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 msgr2=0x56174a7ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 -- 172.21.15.98:0/3569425189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56174a6c2b00 con 0x56174a7e6f60 2023-08-22T00:06:40.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb90889700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fcb84017500 tx=0x7fcb8400b040).ready entity=mon.0 client_cookie=dde6e605cc7703d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:06:40.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400e040 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcb84017ca0 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb7c014c60 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb84017eb0 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 10 client.4770 fetch_fsmap learned FSMap version 9 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56174a6e42d0 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c014c60 con 0x56174a7e6f60 2023-08-22T00:06:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fcb84018630 con 0x56174a7e6f60 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 10 client.4770 fetch_fsmap finished waiting for FSMap version 9 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 10 client.4770 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.208+0000 7fcba3ca0b80 20 client.4770 populate_metadata read hostname 'smithi098' 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7e44b0 0x56174a7e4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 4 client.4770 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 --> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56174a58e040 con 0x56174a7e44b0 2023-08-22T00:06:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7e44b0 0x56174a7e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb6a7fc700 10 client.4770 ms_handle_connect on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb8bfff700 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7e44b0 0x56174a7e4890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b81a704e3f1f6c3a server_cookie=4639c35b5bab57ef in_seq=0 out_seq=0 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb6a7fc700 1 -- 172.21.15.98:0/3569425189 <== mds.0 v2:172.21.15.118:6832/3719023028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x56174a58e040 con 0x56174a7e44b0 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb6a7fc700 10 client.4770 handle_command_reply: tid=0 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 client.4770 shutdown 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 msgr2=0x56174a7ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fcb84017500 tx=0x7fcb8400b040).stop 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 shutdown_connections 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:6832/3719023028,v1:172.21.15.118:6833/3719023028] conn(0x56174a7e44b0 0x56174a7e4890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56174a799af0 0x56174a7ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56174a7e6f60 0x56174a7ca870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 --2- 172.21.15.98:0/3569425189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56174a79e2c0 0x56174a7ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcb6a7fc700 0 client.4770 ms_handle_reset on v2:172.21.15.118:6832/3719023028 2023-08-22T00:06:40.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 >> 172.21.15.98:0/3569425189 conn(0x56174a608940 msgr2=0x56174a7e2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.209+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 shutdown_connections 2023-08-22T00:06:40.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcba3ca0b80 1 -- 172.21.15.98:0/3569425189 wait complete. 2023-08-22T00:06:40.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcba3ca0b80 20 client.4770 trim_cache size 0 max 16384 2023-08-22T00:06:40.249 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4285, 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:06:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 31.56728025, 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 9, 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 26, 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 26, 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 35.954005924999997 2023-08-22T00:06:40.251 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 msgr2=0x7fcb780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 0x7fcb780612d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcb7c009b90 tx=0x7fcb7c009060).stop 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 msgr2=0x7fcb8c163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fcb80011000 tx=0x7fcb80017000).stop 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 shutdown_connections 2023-08-22T00:06:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcb7805ee10 0x7fcb780612d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8c064fb0 0x7fcb8c149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c0ab950 0x7fcb8c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 --2- 172.21.15.98:0/3081486736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8c153f10 0x7fcb8c163df0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 >> 172.21.15.98:0/3081486736 conn(0x7fcb8c0c42e0 msgr2=0x7fcb8c0c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 shutdown_connections 2023-08-22T00:06:40.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.210+0000 7fcb922ec700 1 -- 172.21.15.98:0/3081486736 wait complete. 2023-08-22T00:06:40.255 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-22T00:06:40.268 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-22T00:06:40.268 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-22T00:06:40.268 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-22T00:06:40.269 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-22T00:06:40.269 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-22T00:06:40.269 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-22T00:06:40.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.270 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-08-22T00:06:40.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-08-22T00:06:40.371 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-08-22T00:06:40.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:06:40.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.373 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:06:40.391 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-22T00:06:40.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.392 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-22T00:06:40.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-08-22T00:06:40.567 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-22T00:06:40.568 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:06:40.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.673+0000 7f74b1b22700 1 Processor -- start 2023-08-22T00:06:40.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.673+0000 7f74b1b22700 1 -- start start 2023-08-22T00:06:40.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74b1b22700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74ac068ec0 0x7f74ac0692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74b1b22700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74ac1503b0 0x7f74ac0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74b1b22700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0662b0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74b1b22700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0bc660 con 0x7f74ac068ec0 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74b1b22700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0c1a70 con 0x7f74ac1503b0 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74ab7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74ac068ec0 0x7f74ac0692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74aaffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f74ac0c0f00 0x7f74ac14fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52040/0 (socket says 172.21.15.98:52040) 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74aaffd700 1 -- 172.21.15.98:0/1946287848 learned_addr learned my addr 172.21.15.98:0/1946287848 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74abfff700 1 --2- 172.21.15.98:0/1946287848 >> v2:172.21.15.118:3300/0 conn(0x7f74ac1503b0 0x7f74ac0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74ab7fe700 1 -- 172.21.15.98:0/1946287848 >> v2:172.21.15.118:3300/0 conn(0x7f74ac1503b0 msgr2=0x7f74ac0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74ab7fe700 1 --2- 172.21.15.98:0/1946287848 >> v2:172.21.15.118:3300/0 conn(0x7f74ac1503b0 0x7f74ac0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74ab7fe700 1 -- 172.21.15.98:0/1946287848 >> v1:172.21.15.98:6789/0 conn(0x7f74ac0c0f00 legacy=0x7f74ac14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74aa7fc700 1 -- 172.21.15.98:0/1946287848 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830320486 0 0) 0x7f74ac0662b0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.674+0000 7f74ab7fe700 1 -- 172.21.15.98:0/1946287848 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0c1d50 con 0x7f74ac068ec0 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74ab7fe700 1 --2- 172.21.15.98:0/1946287848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac068ec0 0x7f74ac0692a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f74a0009760 tx=0x7f74a0009060).ready entity=mon.0 client_cookie=46ee4b6cf17be3dd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74aa7fc700 1 -- 172.21.15.98:0/1946287848 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000b520 con 0x7f74ac068ec0 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74aa7fc700 1 -- 172.21.15.98:0/1946287848 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000b680 con 0x7f74ac068ec0 2023-08-22T00:06:40.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74aa7fc700 1 -- 172.21.15.98:0/1946287848 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000ba00 con 0x7f74ac068ec0 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 -- 172.21.15.98:0/1946287848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac068ec0 msgr2=0x7f74ac0692a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1946287848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac068ec0 0x7f74ac0692a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f74a0009760 tx=0x7f74a0009060).stop 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 -- 172.21.15.98:0/1946287848 shutdown_connections 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1946287848 >> v2:172.21.15.118:3300/0 conn(0x7f74ac1503b0 0x7f74ac0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1946287848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac068ec0 0x7f74ac0692a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 -- 172.21.15.98:0/1946287848 >> 172.21.15.98:0/1946287848 conn(0x7f74ac0c66f0 msgr2=0x7f74ac0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 -- 172.21.15.98:0/1946287848 shutdown_connections 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.675+0000 7f74b1b22700 1 -- 172.21.15.98:0/1946287848 wait complete. 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 Processor -- start 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 -- start start 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74ac068ec0 0x7f74ac147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74ac1503b0 0x7f74ac0a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0a77d0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0a8630 con 0x7f74ac1503b0 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74b1b22700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac147c10 con 0x7f74ac068ec0 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74aaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74aaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41470/0 (socket says 172.21.15.98:41470) 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.677+0000 7f74aaffd700 1 -- 172.21.15.98:0/1136222002 learned_addr learned my addr 172.21.15.98:0/1136222002 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74abfff700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74ac1503b0 0x7f74ac0a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74ab7fe700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74ac068ec0 0x7f74ac147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 -- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74ac068ec0 msgr2=0x7f74ac147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74ac068ec0 0x7f74ac147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 -- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74ac1503b0 msgr2=0x7f74ac0a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74ac1503b0 0x7f74ac0a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 -- 172.21.15.98:0/1136222002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00092a0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74aaffd700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f749c00c510 tx=0x7f749c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0072e0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c007440 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0ac730 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0057a0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.678+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0a7d00 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.679+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac047480 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.679+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f749c005bd0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.680+0000 7f74937fe700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 0x7f74980612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:40.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.680+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f749c0799a0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.680+0000 7f74ab7fe700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 0x7f74980612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:40.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.680+0000 7f74ab7fe700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 0x7f74980612a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f74a000b2e0 tx=0x7f74a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:40.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.685+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f749c04ab00 con 0x7f74ac0c0f00 2023-08-22T00:06:40.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.888+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74ac063790 con 0x7f74ac0c0f00 2023-08-22T00:06:40.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.888+0000 7f74937fe700 1 -- 172.21.15.98:0/1136222002 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f749c007db0 con 0x7f74ac0c0f00 2023-08-22T00:06:40.890 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-22T00:06:40.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 msgr2=0x7f74980612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 0x7f74980612a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f74a000b2e0 tx=0x7f74a0017000).stop 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 msgr2=0x7f74ac147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f749c00c510 tx=0x7f749c007c70).stop 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 shutdown_connections 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f749805ede0 0x7f74980612a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74ac068ec0 0x7f74ac147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74ac1503b0 0x7f74ac0a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 --2- 172.21.15.98:0/1136222002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74ac0c0f00 0x7f74ac147720 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:40.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 >> 172.21.15.98:0/1136222002 conn(0x7f74ac0c66f0 msgr2=0x7f74ac0664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:40.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 shutdown_connections 2023-08-22T00:06:40.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:40.890+0000 7f74b1b22700 1 -- 172.21.15.98:0/1136222002 wait complete. 2023-08-22T00:06:40.902 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:06:40.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:06:40.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:06:40.904 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:06:40.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.904 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:06:40.924 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:40.924 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:40.925 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:40.925 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:40.925 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:40.925 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:06:40.926 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42505sec preferred_lft 42505sec 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:06:40.927 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:40.928 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-22T00:06:40.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:40.929 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:40.929 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:40.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2023-08-22T00:06:40.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2023-08-22T00:06:40.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2023-08-22T00:06:40.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-22T00:06:40.930 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:41.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.042 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:06:41.068 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:06:41.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.070 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:06:41.131 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:06:41.131 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:06:41.131 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:06:41.132 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:06:41.132 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:06:41.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.133 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:41.133 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:41.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:06:41.134 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:06:41.134 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:06:41.135 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:41.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.238 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:06:41.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.258 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-08-22T00:06:41.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.316 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:41.316 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:41.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:06:41.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-22T00:06:41.317 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:41.410 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-22T00:06:41.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.411 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:41.411 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:41.411 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-22T00:06:41.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-22T00:06:41.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-22T00:06:41.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-22T00:06:41.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-22T00:06:41.414 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:41.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:41.604 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:41.604 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:41.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:06:41.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2023-08-22T00:06:41.605 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:41.703 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:06:41.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:41.704 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:41.722 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:06:41.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:41.794 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:41.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:41.861 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:41.862 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:41.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:41.863 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:41.921 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:06:41.922 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:41.966 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:41.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:41.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:42.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:06:42.046+0000 7f6008f123c0 -1 init, newargv = 0x55e94de22580 newargc=15 2023-08-22T00:06:42.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[127206]: starting ceph client 2023-08-22T00:06:42.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[127206]: starting fuse 2023-08-22T00:06:42.067 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:42.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:42.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:42.069 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:42.128 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:06:42.128 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:06:42.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:06:42.129 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:06:42.129 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:06:42.129 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:06:42.130 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:06:42.130 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:42.137 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:06:42.138 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:06:42.138 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:06:42.138 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:06:42.139 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:42.139 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:06:42.139 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:06:42.140 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:06:42.140 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:06:42.140 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:42.140 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:06:42.141 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:06:42.141 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:06:42.141 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:06:42.142 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:06:42.142 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:06:42.143 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:06:42.143 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:06:42.143 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:42.143 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:06:42.144 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:06:42.252 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.127206.asok 2023-08-22T00:06:42.434 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127206.asok 2023-08-22T00:06:42.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:42.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.127206.asok status 2023-08-22T00:06:42.587 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:06:42.587 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:06:42.587 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "127206", 2023-08-22T00:06:42.588 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4788, 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:06:42.589 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 4788 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:42.590 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2433193433 2023-08-22T00:06:42.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:06:42.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:42.591 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:42.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:42.592 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:42.592 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2433193433 2023-08-22T00:06:42.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:42.593 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.4788 192.168.0.1:0/2433193433", 2023-08-22T00:06:42.593 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/2433193433", 2023-08-22T00:06:42.593 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:06:42.593 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 9, 2023-08-22T00:06:42.593 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 26, 2023-08-22T00:06:42.594 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:06:42.594 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:06:42.594 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:06:42.594 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:06:42.597 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:06:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.702+0000 7fc4470d4700 1 Processor -- start 2023-08-22T00:06:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.702+0000 7fc4470d4700 1 -- start start 2023-08-22T00:06:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc4470d4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 0x7fc440065010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc4470d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 0x7fc4400a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc4470d4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4400c78a0 con 0x7fc4400a5ba0 2023-08-22T00:06:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc4470d4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4400c6c90 con 0x7fc440153ea0 2023-08-22T00:06:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc4470d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400c6f70 con 0x7fc4400c6800 2023-08-22T00:06:42.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc444e70700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 0x7fc440065010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc43ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 0x7fc4400a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc445671700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc4400a5ba0 0x7fc4400be2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:47720/0 (socket says 172.21.15.98:47720) 2023-08-22T00:06:42.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.703+0000 7fc445671700 1 -- 172.21.15.98:0/4237711701 learned_addr learned my addr 172.21.15.98:0/4237711701 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:42.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43ffff700 1 -- 172.21.15.98:0/4237711701 >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 msgr2=0x7fc440065010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:42.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43ffff700 1 --2- 172.21.15.98:0/4237711701 >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 0x7fc440065010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43ffff700 1 -- 172.21.15.98:0/4237711701 >> v1:172.21.15.118:6789/0 conn(0x7fc4400a5ba0 legacy=0x7fc4400be2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43ffff700 1 -- 172.21.15.98:0/4237711701 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4400c7250 con 0x7fc4400c6800 2023-08-22T00:06:42.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43f7fe700 1 -- 172.21.15.98:0/4237711701 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978493213 0 0) 0x7fc4400c78a0 con 0x7fc4400a5ba0 2023-08-22T00:06:42.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc444e70700 1 --2- 172.21.15.98:0/4237711701 >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 0x7fc440065010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:42.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43ffff700 1 --2- 172.21.15.98:0/4237711701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 0x7fc4400a56b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc42c009760 tx=0x7fc42c009060).ready entity=mon.2 client_cookie=b2cc94ae5f3b0a89 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:42.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43f7fe700 1 -- 172.21.15.98:0/4237711701 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00f510 con 0x7fc4400c6800 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43f7fe700 1 -- 172.21.15.98:0/4237711701 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00f670 con 0x7fc4400c6800 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc43f7fe700 1 -- 172.21.15.98:0/4237711701 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00f9f0 con 0x7fc4400c6800 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc4470d4700 1 -- 172.21.15.98:0/4237711701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 msgr2=0x7fc4400a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.704+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4237711701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 0x7fc4400a56b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc42c009760 tx=0x7fc42c009060).stop 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 -- 172.21.15.98:0/4237711701 shutdown_connections 2023-08-22T00:06:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4237711701 >> v2:172.21.15.118:3300/0 conn(0x7fc440153ea0 0x7fc440065010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4237711701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400c6800 0x7fc4400a56b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 -- 172.21.15.98:0/4237711701 >> 172.21.15.98:0/4237711701 conn(0x7fc440091f80 msgr2=0x7fc440062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 -- 172.21.15.98:0/4237711701 shutdown_connections 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.705+0000 7fc4470d4700 1 -- 172.21.15.98:0/4237711701 wait complete. 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.706+0000 7fc4470d4700 1 Processor -- start 2023-08-22T00:06:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.706+0000 7fc4470d4700 1 -- start start 2023-08-22T00:06:42.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400a5ba0 0x7fc440167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc440153ea0 0x7fc44014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4401681c0 con 0x7fc4400a7270 2023-08-22T00:06:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400ac860 con 0x7fc440153ea0 2023-08-22T00:06:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44014d600 con 0x7fc4400a5ba0 2023-08-22T00:06:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41476/0 (socket says 172.21.15.98:41476) 2023-08-22T00:06:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 -- 172.21.15.98:0/4015123295 learned_addr learned my addr 172.21.15.98:0/4015123295 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc444e70700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400a5ba0 0x7fc440167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc43ffff700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc440153ea0 0x7fc44014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 -- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400a5ba0 msgr2=0x7fc440167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400a5ba0 0x7fc440167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 -- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc440153ea0 msgr2=0x7fc44014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc440153ea0 0x7fc44014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 -- 172.21.15.98:0/4015123295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434009250 con 0x7fc4400a7270 2023-08-22T00:06:42.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc445671700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc43800c810 tx=0x7fc438007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:42.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438005d30 con 0x7fc4400a7270 2023-08-22T00:06:42.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438007110 con 0x7fc4400a7270 2023-08-22T00:06:42.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c0092a0 con 0x7fc4400a7270 2023-08-22T00:06:42.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380074d0 con 0x7fc4400a7270 2023-08-22T00:06:42.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.707+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44014dfa0 con 0x7fc4400a7270 2023-08-22T00:06:42.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.708+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc440047480 con 0x7fc4400a7270 2023-08-22T00:06:42.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.709+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc438007840 con 0x7fc4400a7270 2023-08-22T00:06:42.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.709+0000 7fc43cff9700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 0x7fc4240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:42.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.709+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fc43807a0d0 con 0x7fc4400a7270 2023-08-22T00:06:42.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.709+0000 7fc444e70700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 0x7fc4240612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.710+0000 7fc444e70700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 0x7fc4240612a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc44014e3b0 tx=0x7fc434008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.713+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43804b230 con 0x7fc4400a7270 2023-08-22T00:06:42.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.916+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4400bdd20 con 0x7fc4400a7270 2023-08-22T00:06:42.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.916+0000 7fc43cff9700 1 -- 172.21.15.98:0/4015123295 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc43804e850 con 0x7fc4400a7270 2023-08-22T00:06:42.917 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-22T00:06:42.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 msgr2=0x7fc4240612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 0x7fc4240612a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc44014e3b0 tx=0x7fc434008040).stop 2023-08-22T00:06:42.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 msgr2=0x7fc4400a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:42.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc43800c810 tx=0x7fc438007e90).stop 2023-08-22T00:06:42.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 shutdown_connections 2023-08-22T00:06:42.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc42405ede0 0x7fc4240612a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4400a5ba0 0x7fc440167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4400a7270 0x7fc4400a76f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 --2- 172.21.15.98:0/4015123295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc440153ea0 0x7fc44014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:42.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 >> 172.21.15.98:0/4015123295 conn(0x7fc440091f80 msgr2=0x7fc44014e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:42.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 shutdown_connections 2023-08-22T00:06:42.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:42.918+0000 7fc4470d4700 1 -- 172.21.15.98:0/4015123295 wait complete. 2023-08-22T00:06:42.929 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:06:42.930 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:06:42.930 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:06:42.930 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-22T00:06:42.931 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:42.931 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:06:42.931 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:06:42.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:06:42.931 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-22T00:06:42.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:42.932 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:06:42.951 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:42.951 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:42.951 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:42.952 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:42.953 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42503sec preferred_lft 42503sec 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:06:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:06:42.956 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link tentative 2023-08-22T00:06:42.956 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:42.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:42.956 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:06:43.017 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:06:43.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.019 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:06:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:06:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:06:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:06:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:06:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:06:43.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.080 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:43.081 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:43.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:06:43.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:06:43.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:06:43.082 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:43.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.184 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:06:43.203 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:06:43.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.204 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-08-22T00:06:43.261 INFO:teuthology.orchestra.run.smithi098.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-22T00:06:43.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.262 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:43.262 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:43.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:06:43.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-22T00:06:43.263 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:43.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.357 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-22T00:06:43.396 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:43.396 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:43.396 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:43.397 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.397 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:43.397 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.397 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:43.397 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether d6:7c:66:68:ca:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-22T00:06:43.398 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-22T00:06:43.398 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.398 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::d47c:66ff:fe68:ca36/64 scope link 2023-08-22T00:06:43.398 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.410 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-22T00:06:43.491 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:43.491 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:43.491 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:43.491 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.491 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether d6:7c:66:68:ca:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::d47c:66ff:fe68:ca36/64 scope link 2023-08-22T00:06:43.492 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:43.506 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-22T00:06:43.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.506 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:43.507 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:43.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-22T00:06:43.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-22T00:06:43.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-22T00:06:43.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-22T00:06:43.508 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-22T00:06:43.508 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:43.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:43.737 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:06:43.737 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:06:43.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.1 up 2023-08-22T00:06:43.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.1 master ceph-brx 2023-08-22T00:06:43.738 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:06:43.837 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-22T00:06:43.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:43.837 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:43.856 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-22T00:06:43.856 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:43.926 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:43.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:43.992 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:43.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:43.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:43.994 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:44.056 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:06:44.056 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-08-22T00:06:44.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 2 /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:44.099 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:06:44.126 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:44.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:44.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi098.stderr:2023-08-22T00:06:44.180+0000 7efee764e3c0 -1 init, newargv = 0x558a68954ab0 newargc=15 2023-08-22T00:06:44.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi098.stderr:ceph-fuse[127903]: starting ceph client 2023-08-22T00:06:44.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi098.stderr:ceph-fuse[127903]: starting fuse 2023-08-22T00:06:44.196 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:44.197 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:44.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:44.198 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:06:44.257 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:06:44.257 INFO:teuthology.orchestra.run.smithi098.stdout:48 2023-08-22T00:06:44.257 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-08-22T00:06:44.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:06:44.258 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:06:44.258 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:06:44.259 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:06:44.262 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:06:44.263 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:44.263 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:06:44.263 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-22T00:06:44.264 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:06:44.265 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-22T00:06:44.265 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:44.265 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:06:44.266 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:06:44.266 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:06:44.266 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:06:44.267 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:44.267 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:06:44.267 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:06:44.268 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:06:44.268 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:06:44.268 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:06:44.268 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:06:44.269 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:06:44.269 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:06:44.269 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:06:44.269 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.2")) 2023-08-22T00:06:44.270 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:06:44.381 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.2.127903.asok 2023-08-22T00:06:44.564 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.127903.asok 2023-08-22T00:06:44.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:44.564 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.127903.asok status 2023-08-22T00:06:44.718 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:06:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "2", 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-22T00:06:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "127903", 2023-08-22T00:06:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:06:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:06:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4800, 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 4800 2023-08-22T00:06:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.2:0", 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 194296297 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:06:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.2:0", 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 194296297 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.4800 192.168.0.2:0/194296297", 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.2:0/194296297", 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:06:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 9, 2023-08-22T00:06:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 26, 2023-08-22T00:06:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:06:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:06:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:06:44.724 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:06:44.728 DEBUG:teuthology.orchestra.run.smithi118:> ceph fs ls 2023-08-22T00:06:44.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.846+0000 7f90a9217700 1 Processor -- start 2023-08-22T00:06:44.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.846+0000 7f90a9217700 1 -- start start 2023-08-22T00:06:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a9217700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f90a40c41c0 0x7f90a4154820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a9217700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a41585c0 con 0x7f90a40c4c30 2023-08-22T00:06:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a9217700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40c7150 con 0x7f90a40c3d80 2023-08-22T00:06:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a9217700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a40bd9b0 con 0x7f90a40c41c0 2023-08-22T00:06:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f90a40c3d80 0x7f90a40625f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:51690/0 (socket says 172.21.15.118:51690) 2023-08-22T00:06:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a259c700 1 -- 172.21.15.118:0/1267186189 learned_addr learned my addr 172.21.15.118:0/1267186189 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:06:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a359e700 1 --2- 172.21.15.118:0/1267186189 >> v2:172.21.15.98:3300/0 conn(0x7f90a40c41c0 0x7f90a4154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327648764 0 0) 0x7f90a40c7150 con 0x7f90a40c3d80 2023-08-22T00:06:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f908c0033f0 con 0x7f90a40c3d80 2023-08-22T00:06:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a359e700 1 -- 172.21.15.118:0/1267186189 >> v1:172.21.15.118:6789/0 conn(0x7f90a40c3d80 legacy=0x7f90a40625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a359e700 1 -- 172.21.15.118:0/1267186189 >> v1:172.21.15.98:6789/0 conn(0x7f90a40c4c30 legacy=0x7f90a40bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163240758 0 0) 0x7f90a41585c0 con 0x7f90a40c4c30 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a359e700 1 -- 172.21.15.118:0/1267186189 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40c7430 con 0x7f90a40c41c0 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.847+0000 7f90a359e700 1 --2- 172.21.15.118:0/1267186189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a4154820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f909c009e60 tx=0x7f909c009780).ready entity=mon.0 client_cookie=8dabb757527722a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c00e070 con 0x7f90a40c41c0 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c00bb60 con 0x7f90a40c41c0 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a1d9b700 1 -- 172.21.15.118:0/1267186189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c00bee0 con 0x7f90a40c41c0 2023-08-22T00:06:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 -- 172.21.15.118:0/1267186189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 msgr2=0x7f90a4154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 --2- 172.21.15.118:0/1267186189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a4154820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f909c009e60 tx=0x7f909c009780).stop 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 -- 172.21.15.118:0/1267186189 shutdown_connections 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 --2- 172.21.15.118:0/1267186189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a4154820 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 -- 172.21.15.118:0/1267186189 >> 172.21.15.118:0/1267186189 conn(0x7f90a4063ee0 msgr2=0x7f90a4090a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 -- 172.21.15.118:0/1267186189 shutdown_connections 2023-08-22T00:06:44.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.848+0000 7f90a9217700 1 -- 172.21.15.118:0/1267186189 wait complete. 2023-08-22T00:06:44.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.849+0000 7f90a9217700 1 Processor -- start 2023-08-22T00:06:44.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.849+0000 7f90a9217700 1 -- start start 2023-08-22T00:06:44.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:44.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a41553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:44.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 0x7f90a40bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:44.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4157b40 con 0x7f90a40c41c0 2023-08-22T00:06:44.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4156630 con 0x7f90a40c3d80 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a9217700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4155a20 con 0x7f90a40c4c30 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 0x7f90a40bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56456/0 (socket says 172.21.15.118:56456) 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a2d9d700 1 -- 172.21.15.118:0/2382054639 learned_addr learned my addr 172.21.15.118:0/2382054639 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.850+0000 7f90a259c700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a41553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 -- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 msgr2=0x7f90a40bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 0x7f90a40bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 -- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 msgr2=0x7f90a41553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a41553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 -- 172.21.15.118:0/2382054639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c009a20 con 0x7f90a40c3d80 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a359e700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 0x7f90a40bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a2d9d700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f909400c410 tx=0x7f9094007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:44.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094007020 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90940071a0 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a4155d00 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094007560 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.851+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a41562c0 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.852+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a4047480 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.852+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f90940068b0 con 0x7f90a40c3d80 2023-08-22T00:06:44.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.852+0000 7f908affd700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 0x7f90900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:44.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.853+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f90940793d0 con 0x7f90a40c3d80 2023-08-22T00:06:44.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.853+0000 7f90a259c700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 0x7f90900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:44.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.853+0000 7f90a259c700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 0x7f90900612d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f90a41574c0 tx=0x7f9098009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:44.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:44.857+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90940478f0 con 0x7f90a40c3d80 2023-08-22T00:06:45.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.059+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90a406a1b0 con 0x7f90a40c3d80 2023-08-22T00:06:45.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.059+0000 7f908affd700 1 -- 172.21.15.118:0/2382054639 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f909404a530 con 0x7f90a40c3d80 2023-08-22T00:06:45.060 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-22T00:06:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 msgr2=0x7f90900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 0x7f90900612d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f90a41574c0 tx=0x7f9098009040).stop 2023-08-22T00:06:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 msgr2=0x7f90a4154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f909400c410 tx=0x7f9094007e00).stop 2023-08-22T00:06:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 shutdown_connections 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f909005ee10 0x7f90900612d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90a40c4c30 0x7f90a40bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a40c3d80 0x7f90a4154eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 --2- 172.21.15.118:0/2382054639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a40c41c0 0x7f90a41553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 >> 172.21.15.118:0/2382054639 conn(0x7f90a4063ee0 msgr2=0x7f90a4066420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 shutdown_connections 2023-08-22T00:06:45.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:45.061+0000 7f90a9217700 1 -- 172.21.15.118:0/2382054639 wait complete. 2023-08-22T00:06:45.073 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:06:45.074 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:06:45.074 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-08-22T00:06:45.075 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-22T00:06:45.075 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:45.075 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:06:45.076 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:06:45.076 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:06:45.077 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-22T00:06:45.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.078 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-08-22T00:06:45.099 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:45.099 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:45.099 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:45.099 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:45.100 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:06:45.101 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42511sec preferred_lft 42511sec 2023-08-22T00:06:45.102 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-08-22T00:06:45.102 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:45.102 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-22T00:06:45.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.103 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:45.103 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:45.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-08-22T00:06:45.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-08-22T00:06:45.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-08-22T00:06:45.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-22T00:06:45.104 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:45.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.266 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:06:45.297 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-08-22T00:06:45.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.299 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-08-22T00:06:45.377 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-08-22T00:06:45.378 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:06:45.378 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:06:45.378 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:06:45.378 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:06:45.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.380 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:45.380 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:45.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:06:45.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:06:45.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:06:45.381 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:45.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.643 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-08-22T00:06:45.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.662 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-08-22T00:06:45.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.720 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:45.720 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:45.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-22T00:06:45.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-22T00:06:45.721 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:45.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-22T00:06:45.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:45.816 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:45.817 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:45.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-22T00:06:45.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-22T00:06:45.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-22T00:06:45.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-22T00:06:45.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-22T00:06:45.819 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:46.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:46.047 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:46.047 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:46.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-08-22T00:06:46.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-08-22T00:06:46.049 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:46.147 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-22T00:06:46.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:46.148 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:46.166 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-22T00:06:46.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-08-22T00:06:46.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:46.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:46.307 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:46.308 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:46.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:46.309 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-08-22T00:06:46.368 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:06:46.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:46.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-08-22T00:06:46.443 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:46.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:46.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:2023-08-22T00:06:46.494+0000 7f1f73c2c3c0 -1 init, newargv = 0x55c5a9878180 newargc=15 2023-08-22T00:06:46.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[122898]: starting ceph client 2023-08-22T00:06:46.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[122898]: starting fuse 2023-08-22T00:06:46.512 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:46.513 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:46.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:46.514 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-08-22T00:06:46.573 INFO:teuthology.orchestra.run.smithi118.stdout:46 2023-08-22T00:06:46.574 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:06:46.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:06:46.577 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-08-22T00:06:46.578 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-08-22T00:06:46.578 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-08-22T00:06:46.579 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-08-22T00:06:46.579 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:46.580 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-08-22T00:06:46.580 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-22T00:06:46.581 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-08-22T00:06:46.581 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-22T00:06:46.581 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:46.582 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-08-22T00:06:46.582 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-08-22T00:06:46.582 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-08-22T00:06:46.582 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-08-22T00:06:46.583 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:46.583 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-08-22T00:06:46.583 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:06:46.583 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:06:46.584 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:06:46.584 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-08-22T00:06:46.585 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-08-22T00:06:46.585 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-08-22T00:06:46.585 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:06:46.586 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:46.587 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.1")) 2023-08-22T00:06:46.587 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-08-22T00:06:46.697 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.1.122898.asok 2023-08-22T00:06:46.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:06:46.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:06:46.879 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.122898.asok 2023-08-22T00:06:46.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:46.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.122898.asok status 2023-08-22T00:06:47.029 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-08-22T00:06:47.030 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-08-22T00:06:47.030 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:06:47.031 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:06:47.031 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "1", 2023-08-22T00:06:47.031 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-08-22T00:06:47.031 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "122898", 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-08-22T00:06:47.032 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4520, 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4520 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-08-22T00:06:47.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-08-22T00:06:47.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:47.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1434051208 2023-08-22T00:06:47.034 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-08-22T00:06:47.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:47.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-08-22T00:06:47.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-08-22T00:06:47.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:06:47.036 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1434051208 2023-08-22T00:06:47.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:47.036 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4520 192.168.0.1:0/1434051208", 2023-08-22T00:06:47.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/1434051208", 2023-08-22T00:06:47.037 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-08-22T00:06:47.037 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 9, 2023-08-22T00:06:47.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 26, 2023-08-22T00:06:47.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:06:47.043 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-08-22T00:06:47.046 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-08-22T00:06:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-08-22T00:06:47.048 DEBUG:teuthology.orchestra.run.smithi118:> ceph fs ls 2023-08-22T00:06:47.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.150+0000 7fd46bbe2700 1 Processor -- start 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.150+0000 7fd46bbe2700 1 -- start start 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46bbe2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd4640bc760 0x7fd4640c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46bbe2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640c6e90 con 0x7fd464062cb0 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46bbe2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd464062820 con 0x7fd4640c58c0 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46bbe2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640c6590 con 0x7fd4640bc760 2023-08-22T00:06:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46997e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd4640c58c0 0x7fd4640be030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:51698/0 (socket says 172.21.15.118:51698) 2023-08-22T00:06:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46997e700 1 -- 172.21.15.118:0/4022162068 learned_addr learned my addr 172.21.15.118:0/4022162068 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-08-22T00:06:47.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.151+0000 7fd46917d700 1 --2- 172.21.15.118:0/4022162068 >> v2:172.21.15.98:3300/0 conn(0x7fd4640bc760 0x7fd4640c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563051143 0 0) 0x7fd464062820 con 0x7fd4640c58c0 2023-08-22T00:06:47.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4500033f0 con 0x7fd4640c58c0 2023-08-22T00:06:47.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191828616 0 0) 0x7fd4500033f0 con 0x7fd4640c58c0 2023-08-22T00:06:47.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 >> v2:172.21.15.98:3300/0 conn(0x7fd4640bc760 msgr2=0x7fd4640c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:47.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 --2- 172.21.15.118:0/4022162068 >> v2:172.21.15.98:3300/0 conn(0x7fd4640bc760 0x7fd4640c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 >> v1:172.21.15.98:6789/0 conn(0x7fd464062cb0 legacy=0x7fd4640a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640c70e0 con 0x7fd4640c58c0 2023-08-22T00:06:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd4540015f0 con 0x7fd4640c58c0 2023-08-22T00:06:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 >> v1:172.21.15.118:6789/0 conn(0x7fd4640c58c0 legacy=0x7fd4640be030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4500038e0 0x7fd450003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450004690 0x7fd450004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 0x7fd45000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640c6590 con 0x7fd4500038e0 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000beb0 con 0x7fd450005000 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000c070 con 0x7fd450004690 2023-08-22T00:06:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46917d700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450004690 0x7fd450004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 0x7fd45000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46997e700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4500038e0 0x7fd450003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 -- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450004690 msgr2=0x7fd450004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450004690 0x7fd450004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 -- 172.21.15.118:0/4022162068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4500038e0 msgr2=0x7fd450003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4500038e0 0x7fd450003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 -- 172.21.15.118:0/4022162068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500033f0 con 0x7fd450005000 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46917d700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450004690 0x7fd450004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 -- 172.21.15.118:0/4022162068 reap_dead start 2023-08-22T00:06:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.152+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 0x7fd45000b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd45c001e30 tx=0x7fd45c007f30).ready entity=mon.1 client_cookie=b701ffe76c8a3854 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c006a20 con 0x7fd450005000 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c006b80 con 0x7fd450005000 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46897c700 1 -- 172.21.15.118:0/4022162068 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00c5d0 con 0x7fd450005000 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 msgr2=0x7fd45000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 0x7fd45000b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd45c001e30 tx=0x7fd45c007f30).stop 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4022162068 shutdown_connections 2023-08-22T00:06:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4022162068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd450005000 0x7fd45000b8e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4022162068 >> 172.21.15.118:0/4022162068 conn(0x7fd464090e80 msgr2=0x7fd464063ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4022162068 shutdown_connections 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.153+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4022162068 wait complete. 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.155+0000 7fd46bbe2700 1 Processor -- start 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.155+0000 7fd46bbe2700 1 -- start start 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 0x7fd464151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 0x7fd464151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640bf280 con 0x7fd46414f9e0 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640bf560 con 0x7fd46414f560 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640bf840 con 0x7fd450005000 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46997e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46997e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:50200/0 (socket says 172.21.15.118:50200) 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46997e700 1 -- 172.21.15.118:0/4247081228 learned_addr learned my addr 172.21.15.118:0/4247081228 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-08-22T00:06:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 0x7fd464151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 0x7fd464151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 -- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 msgr2=0x7fd4640a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 -- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 msgr2=0x7fd464151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 0x7fd464151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 -- 172.21.15.118:0/4247081228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640bfb20 con 0x7fd46414f560 2023-08-22T00:06:47.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46997e700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46a17f700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 0x7fd464151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46917d700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 0x7fd464151240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd460006d80 tx=0x7fd460009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460011eb0 con 0x7fd46414f560 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000f9a0 con 0x7fd46414f560 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000fd20 con 0x7fd46414f560 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.156+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640bfe00 con 0x7fd46414f560 2023-08-22T00:06:47.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.157+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464151c20 con 0x7fd46414f560 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.157+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464047480 con 0x7fd46414f560 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.158+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd460014650 con 0x7fd46414f560 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.158+0000 7fd459ffb700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 0x7fd448061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.158+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fd46007aa50 con 0x7fd46414f560 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.158+0000 7fd46997e700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 0x7fd448061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:47.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.159+0000 7fd46997e700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 0x7fd448061300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd454001720 tx=0x7fd454009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:47.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.162+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd46004bbb0 con 0x7fd46414f560 2023-08-22T00:06:47.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.365+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4640c73c0 con 0x7fd46414f560 2023-08-22T00:06:47.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.365+0000 7fd459ffb700 1 -- 172.21.15.118:0/4247081228 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd460022020 con 0x7fd46414f560 2023-08-22T00:06:47.501 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-22T00:06:47.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 msgr2=0x7fd448061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 0x7fd448061300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd454001720 tx=0x7fd454009040).stop 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 msgr2=0x7fd464151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 0x7fd464151240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd460006d80 tx=0x7fd460009060).stop 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 shutdown_connections 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd44805ee40 0x7fd448061300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd450005000 0x7fd4640a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd46414f9e0 0x7fd464151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 --2- 172.21.15.118:0/4247081228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd46414f560 0x7fd464151240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:47.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 >> 172.21.15.118:0/4247081228 conn(0x7fd464090e80 msgr2=0x7fd464152980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:47.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 shutdown_connections 2023-08-22T00:06:47.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-08-22T00:06:47.367+0000 7fd46bbe2700 1 -- 172.21.15.118:0/4247081228 wait complete. 2023-08-22T00:06:47.504 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:06:47.504 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:06:47.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-08-22T00:06:47.505 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-22T00:06:47.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:47.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:06:47.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:06:47.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:06:47.506 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-22T00:06:47.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.506 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-08-22T00:06:47.526 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:47.526 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:47.526 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:47.526 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.526 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-08-22T00:06:47.527 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42509sec preferred_lft 42509sec 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-08-22T00:06:47.528 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 52:7d:26:f1:9b:cf brd ff:ff:ff:ff:ff:ff 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c00a:20ff:fe7f:638a/64 scope link 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:06:47.529 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 52:7d:26:f1:9b:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-22T00:06:47.530 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::507d:26ff:fef1:9bcf/64 scope link tentative 2023-08-22T00:06:47.530 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.532 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:06:47.606 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-08-22T00:06:47.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.609 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-08-22T00:06:47.672 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-08-22T00:06:47.673 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:06:47.673 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:06:47.673 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:06:47.674 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:06:47.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.675 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:47.675 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:47.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:06:47.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:06:47.676 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:06:47.676 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:47.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.777 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-08-22T00:06:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-22T00:06:47.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.796 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-08-22T00:06:47.853 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-22T00:06:47.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.854 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:47.854 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:47.855 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-22T00:06:47.855 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-22T00:06:47.855 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:47.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:47.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-22T00:06:47.986 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:47.986 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:47.987 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:47.987 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.987 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:47.988 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.988 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:47.988 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 26:73:a8:81:cf:9e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-22T00:06:47.988 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-22T00:06:47.989 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:47.989 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::2473:a8ff:fe81:cf9e/64 scope link 2023-08-22T00:06:47.989 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:48.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:48.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-22T00:06:48.089 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:06:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 26:73:a8:81:cf:9e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-22T00:06:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-22T00:06:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::2473:a8ff:fe81:cf9e/64 scope link 2023-08-22T00:06:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:06:48.097 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-22T00:06:48.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:48.097 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:48.098 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:48.098 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-22T00:06:48.098 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-22T00:06:48.098 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-22T00:06:48.098 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-22T00:06:48.099 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-22T00:06:48.099 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:48.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:48.324 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-08-22T00:06:48.325 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-08-22T00:06:48.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2023-08-22T00:06:48.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2023-08-22T00:06:48.329 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-08-22T00:06:48.428 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-22T00:06:48.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:48.429 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:48.448 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-22T00:06:48.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-08-22T00:06:48.516 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:48.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:48.588 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:48.589 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:48.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:48.589 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-08-22T00:06:48.647 INFO:teuthology.orchestra.run.smithi118.stdout:46 2023-08-22T00:06:48.648 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-08-22T00:06:48.651 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 3 /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:48.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-08-22T00:06:48.733 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:06:48.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:06:48.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:2023-08-22T00:06:48.773+0000 7fb5b3ecc3c0 -1 init, newargv = 0x56402e16cbd0 newargc=15 2023-08-22T00:06:48.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[123619]: starting ceph client 2023-08-22T00:06:48.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[123619]: starting fuse 2023-08-22T00:06:48.809 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:06:48.810 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:06:48.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:48.810 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-08-22T00:06:48.870 INFO:teuthology.orchestra.run.smithi118.stdout:46 2023-08-22T00:06:48.871 INFO:teuthology.orchestra.run.smithi118.stdout:48 2023-08-22T00:06:48.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-08-22T00:06:48.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:06:48.872 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-08-22T00:06:48.872 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-08-22T00:06:48.873 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-08-22T00:06:48.873 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-08-22T00:06:48.873 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:48.873 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-08-22T00:06:48.873 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-22T00:06:48.874 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-08-22T00:06:48.874 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-22T00:06:48.874 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:48.874 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-08-22T00:06:48.886 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-08-22T00:06:48.887 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-08-22T00:06:48.887 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-08-22T00:06:48.887 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:48.887 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-08-22T00:06:48.887 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:06:48.888 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:06:48.888 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:06:48.888 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-08-22T00:06:48.888 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-08-22T00:06:48.889 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-08-22T00:06:48.889 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:06:48.889 DEBUG:teuthology.orchestra.run.smithi118:> 2023-08-22T00:06:48.889 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.3")) 2023-08-22T00:06:48.890 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-08-22T00:06:48.994 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.3.123619.asok 2023-08-22T00:06:49.178 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.123619.asok 2023-08-22T00:06:49.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.123619.asok status 2023-08-22T00:06:49.332 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "3", 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-08-22T00:06:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "123619", 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4529, 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-08-22T00:06:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4529 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 128760213 2023-08-22T00:06:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-08-22T00:06:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-08-22T00:06:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-08-22T00:06:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2023-08-22T00:06:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 128760213 2023-08-22T00:06:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-08-22T00:06:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4529 192.168.0.2:0/128760213", 2023-08-22T00:06:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.2:0/128760213", 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 9, 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 26, 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-08-22T00:06:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-08-22T00:06:49.339 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-08-22T00:06:49.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.340 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:06:49.340 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:49.365 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:06:49.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:49.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:49.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.442 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:06:49.442 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:06:49.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:49.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:49.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.572 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-08-22T00:06:49.572 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:49.601 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-08-22T00:06:49.603 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:49.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.603 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:49.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.668 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-08-22T00:06:49.669 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:49.727 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-08-22T00:06:49.728 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:49.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:06:49.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:49.800 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-22T00:06:49.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:49.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.973+0000 7fae44da2700 1 Processor -- start 2023-08-22T00:06:49.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.973+0000 7fae44da2700 1 -- start start 2023-08-22T00:06:49.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae44da2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae400bdbe0 0x7fae400be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae44da2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400bd750 con 0x7fae401550e0 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae44da2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400a7030 con 0x7fae40153cf0 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae44da2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae400c2010 con 0x7fae400bdbe0 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae400bdbe0 0x7fae400be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae400bdbe0 0x7fae400be070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41484/0 (socket says 172.21.15.98:41484) 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 -- 172.21.15.98:0/2297745378 learned_addr learned my addr 172.21.15.98:0/2297745378 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3dd9b700 1 --1- 172.21.15.98:0/2297745378 >> v1:172.21.15.98:6789/0 conn(0x7fae401550e0 0x7fae40065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52046/0 (socket says 172.21.15.98:52046) 2023-08-22T00:06:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 -- 172.21.15.98:0/2297745378 >> v1:172.21.15.118:6789/0 conn(0x7fae40153cf0 legacy=0x7fae401584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 -- 172.21.15.98:0/2297745378 >> v1:172.21.15.98:6789/0 conn(0x7fae401550e0 legacy=0x7fae40065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 -- 172.21.15.98:0/2297745378 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400a6d50 con 0x7fae400bdbe0 2023-08-22T00:06:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3d59a700 1 -- 172.21.15.98:0/2297745378 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886659582 0 0) 0x7fae400bd750 con 0x7fae401550e0 2023-08-22T00:06:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3ed9d700 1 --2- 172.21.15.98:0/2297745378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400be070 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fae38009f20 tx=0x7fae38009840).ready entity=mon.0 client_cookie=44617879a4d69b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3d59a700 1 -- 172.21.15.98:0/2297745378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800e070 con 0x7fae400bdbe0 2023-08-22T00:06:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3d59a700 1 -- 172.21.15.98:0/2297745378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800ba80 con 0x7fae400bdbe0 2023-08-22T00:06:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.974+0000 7fae3d59a700 1 -- 172.21.15.98:0/2297745378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800be00 con 0x7fae400bdbe0 2023-08-22T00:06:49.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 -- 172.21.15.98:0/2297745378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 msgr2=0x7fae400be070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 --2- 172.21.15.98:0/2297745378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400be070 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fae38009f20 tx=0x7fae38009840).stop 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 -- 172.21.15.98:0/2297745378 shutdown_connections 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 --2- 172.21.15.98:0/2297745378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400be070 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 -- 172.21.15.98:0/2297745378 >> 172.21.15.98:0/2297745378 conn(0x7fae400c7770 msgr2=0x7fae400c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 -- 172.21.15.98:0/2297745378 shutdown_connections 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.975+0000 7fae44da2700 1 -- 172.21.15.98:0/2297745378 wait complete. 2023-08-22T00:06:49.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.977+0000 7fae44da2700 1 Processor -- start 2023-08-22T00:06:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.977+0000 7fae44da2700 1 -- start start 2023-08-22T00:06:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 0x7fae4014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 0x7fae4014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4014cde0 con 0x7fae400bdbe0 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae40157050 con 0x7fae40153cf0 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae401564d0 con 0x7fae401550e0 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41498/0 (socket says 172.21.15.98:41498) 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 -- 172.21.15.98:0/2956228480 learned_addr learned my addr 172.21.15.98:0/2956228480 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3dd9b700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 0x7fae4014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3ed9d700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 0x7fae4014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 -- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 msgr2=0x7fae4014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 0x7fae4014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 -- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 msgr2=0x7fae4014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 0x7fae4014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 -- 172.21.15.98:0/2956228480 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009ae0 con 0x7fae400bdbe0 2023-08-22T00:06:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3dd9b700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 0x7fae4014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:49.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3ed9d700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 0x7fae4014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:49.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae3e59c700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fae2800c4c0 tx=0x7fae28007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:49.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28007020 con 0x7fae400bdbe0 2023-08-22T00:06:49.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae28001e90 con 0x7fae400bdbe0 2023-08-22T00:06:49.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae401567b0 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280073b0 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.978+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae40156d70 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.979+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40047480 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.980+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fae280068b0 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.980+0000 7fae367fc700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 0x7fae200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.980+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fae28079a80 con 0x7fae400bdbe0 2023-08-22T00:06:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.980+0000 7fae3dd9b700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 0x7fae200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:49.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.980+0000 7fae3dd9b700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 0x7fae200612d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fae40063c70 tx=0x7fae30007b10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:49.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:49.984+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae2804abe0 con 0x7fae400bdbe0 2023-08-22T00:06:50.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.145+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae400a4540 con 0x7fae400bdbe0 2023-08-22T00:06:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.146+0000 7fae367fc700 1 -- 172.21.15.98:0/2956228480 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fae2804e200 con 0x7fae400bdbe0 2023-08-22T00:06:50.147 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:50.147 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:50.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 msgr2=0x7fae200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 0x7fae200612d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fae40063c70 tx=0x7fae30007b10).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 msgr2=0x7fae400a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fae2800c4c0 tx=0x7fae28007e00).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 shutdown_connections 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae2005ee10 0x7fae200612d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae401550e0 0x7fae4014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae400bdbe0 0x7fae400a7bf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 --2- 172.21.15.98:0/2956228480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae40153cf0 0x7fae4014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 >> 172.21.15.98:0/2956228480 conn(0x7fae400c7770 msgr2=0x7fae4014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 shutdown_connections 2023-08-22T00:06:50.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.148+0000 7fae44da2700 1 -- 172.21.15.98:0/2956228480 wait complete. 2023-08-22T00:06:50.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:50.162 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.282+0000 7f278bea9700 1 Processor -- start 2023-08-22T00:06:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.283+0000 7f278bea9700 1 -- start start 2023-08-22T00:06:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.283+0000 7f278bea9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f278414b130 0x7f2784063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.283+0000 7f278bea9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784064490 con 0x7f27840c15c0 2023-08-22T00:06:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.283+0000 7f278bea9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784151390 con 0x7f2784065a40 2023-08-22T00:06:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.283+0000 7f278bea9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784151110 con 0x7f278414b130 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f278414b130 0x7f2784063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789444700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f27840c15c0 0x7f2784151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59262/0 (socket says 172.21.15.98:59262) 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789444700 1 -- 172.21.15.98:0/2849988011 learned_addr learned my addr 172.21.15.98:0/2849988011 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 --2- 172.21.15.98:0/2849988011 >> v2:172.21.15.98:3300/0 conn(0x7f278414b130 0x7f2784063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39774/0 (socket says 172.21.15.98:39774) 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 -- 172.21.15.98:0/2849988011 >> v1:172.21.15.118:6789/0 conn(0x7f2784065a40 legacy=0x7f27840c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:50.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2788c43700 1 -- 172.21.15.98:0/2849988011 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110184179 0 0) 0x7f2780001110 con 0x7f27840c15c0 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 -- 172.21.15.98:0/2849988011 >> v1:172.21.15.98:6789/0 conn(0x7f27840c15c0 legacy=0x7f2784151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 -- 172.21.15.98:0/2849988011 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27840c6610 con 0x7f278414b130 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2789c45700 1 --2- 172.21.15.98:0/2849988011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784063fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2774009760 tx=0x7f2774009060).ready entity=mon.0 client_cookie=d42db62fb974a402 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2788c43700 1 -- 172.21.15.98:0/2849988011 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740090d0 con 0x7f278414b130 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2788c43700 1 -- 172.21.15.98:0/2849988011 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400b520 con 0x7f278414b130 2023-08-22T00:06:50.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.284+0000 7f2788c43700 1 -- 172.21.15.98:0/2849988011 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400b8a0 con 0x7f278414b130 2023-08-22T00:06:50.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 -- 172.21.15.98:0/2849988011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 msgr2=0x7f2784063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 --2- 172.21.15.98:0/2849988011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784063fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2774009760 tx=0x7f2774009060).stop 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 -- 172.21.15.98:0/2849988011 shutdown_connections 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 --2- 172.21.15.98:0/2849988011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784063fa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 -- 172.21.15.98:0/2849988011 >> 172.21.15.98:0/2849988011 conn(0x7f27840c3a60 msgr2=0x7f27840c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 -- 172.21.15.98:0/2849988011 shutdown_connections 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.285+0000 7f278bea9700 1 -- 172.21.15.98:0/2849988011 wait complete. 2023-08-22T00:06:50.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.286+0000 7f278bea9700 1 Processor -- start 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.286+0000 7f278bea9700 1 -- start start 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 0x7f278414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27840c15c0 0x7f278414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ac800 con 0x7f278414b130 2023-08-22T00:06:50.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27840aa0f0 con 0x7f2784065a40 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27840aa3d0 con 0x7f27840c15c0 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39784/0 (socket says 172.21.15.98:39784) 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 -- 172.21.15.98:0/3849206077 learned_addr learned my addr 172.21.15.98:0/3849206077 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2789c45700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 0x7f278414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2789444700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27840c15c0 0x7f278414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 -- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27840c15c0 msgr2=0x7f278414b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27840c15c0 0x7f278414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 -- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 msgr2=0x7f278414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 0x7f278414e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 -- 172.21.15.98:0/3849206077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740092a0 con 0x7f278414b130 2023-08-22T00:06:50.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2789c45700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 0x7f278414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278a446700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f277c00b810 tx=0x7f277c009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00d600 con 0x7f278414b130 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00d7a0 con 0x7f278414b130 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278414bd80 con 0x7f278414b130 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.287+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00db60 con 0x7f278414b130 2023-08-22T00:06:50.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.288+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27841612a0 con 0x7f278414b130 2023-08-22T00:06:50.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.289+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784068970 con 0x7f278414b130 2023-08-22T00:06:50.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.289+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f277c019460 con 0x7f278414b130 2023-08-22T00:06:50.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.289+0000 7f2779ffb700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 0x7f27680612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.289+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f277c07a150 con 0x7f278414b130 2023-08-22T00:06:50.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.289+0000 7f2789c45700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 0x7f27680612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.290+0000 7f2789c45700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 0x7f27680612d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f277400b2e0 tx=0x7f2774017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.293+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f277c04b250 con 0x7f278414b130 2023-08-22T00:06:50.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.454+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f27840c68f0 con 0x7f278414b130 2023-08-22T00:06:50.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.455+0000 7f2779ffb700 1 -- 172.21.15.98:0/3849206077 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f277c04e870 con 0x7f278414b130 2023-08-22T00:06:50.456 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:50.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 msgr2=0x7f27680612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 0x7f27680612d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f277400b2e0 tx=0x7f2774017000).stop 2023-08-22T00:06:50.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 msgr2=0x7f2784160db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f277c00b810 tx=0x7f277c009290).stop 2023-08-22T00:06:50.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 shutdown_connections 2023-08-22T00:06:50.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f278414b130 0x7f2784160db0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2784065a40 0x7f278414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f276805ee10 0x7f27680612d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 --2- 172.21.15.98:0/3849206077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27840c15c0 0x7f278414b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 >> 172.21.15.98:0/3849206077 conn(0x7f27840c3a60 msgr2=0x7f278414ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 shutdown_connections 2023-08-22T00:06:50.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.457+0000 7f278bea9700 1 -- 172.21.15.98:0/3849206077 wait complete. 2023-08-22T00:06:50.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:50.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.587+0000 7f353817e700 1 Processor -- start 2023-08-22T00:06:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.588+0000 7f353817e700 1 -- start start 2023-08-22T00:06:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.588+0000 7f353817e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35300c5750 0x7f35300c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.588+0000 7f353817e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530064280 con 0x7f3530063000 2023-08-22T00:06:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.588+0000 7f353817e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300c4c20 con 0x7f35301579e0 2023-08-22T00:06:50.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.588+0000 7f353817e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300c1850 con 0x7f35300c5750 2023-08-22T00:06:50.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f353671b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3530063000 0x7f3530154a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59268/0 (socket says 172.21.15.98:59268) 2023-08-22T00:06:50.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f353671b700 1 -- 172.21.15.98:0/897349589 learned_addr learned my addr 172.21.15.98:0/897349589 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3535f1a700 1 --2- 172.21.15.98:0/897349589 >> v2:172.21.15.118:3300/0 conn(0x7f35300c5750 0x7f35300c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598108149 0 0) 0x7f3530064280 con 0x7f3530063000 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c0033f0 con 0x7f3530063000 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3535f1a700 1 -- 172.21.15.98:0/897349589 >> v1:172.21.15.118:6789/0 conn(0x7f35301579e0 legacy=0x7f35300c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732603199 0 0) 0x7f35300c4c20 con 0x7f35301579e0 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3535f1a700 1 -- 172.21.15.98:0/897349589 >> v1:172.21.15.98:6789/0 conn(0x7f3530063000 legacy=0x7f3530154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3535f1a700 1 -- 172.21.15.98:0/897349589 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530063670 con 0x7f35300c5750 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3535f1a700 1 --2- 172.21.15.98:0/897349589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300c5750 0x7f35300c5b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3520009760 tx=0x7f3520009060).ready entity=mon.1 client_cookie=cd4ff910459491b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280017f0 con 0x7f35300c5750 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520012410 con 0x7f35300c5750 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.589+0000 7f3534f18700 1 -- 172.21.15.98:0/897349589 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520012790 con 0x7f35300c5750 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 -- 172.21.15.98:0/897349589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300c5750 msgr2=0x7f35300c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 --2- 172.21.15.98:0/897349589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300c5750 0x7f35300c5b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3520009760 tx=0x7f3520009060).stop 2023-08-22T00:06:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 -- 172.21.15.98:0/897349589 shutdown_connections 2023-08-22T00:06:50.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 --2- 172.21.15.98:0/897349589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300c5750 0x7f35300c5b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 -- 172.21.15.98:0/897349589 >> 172.21.15.98:0/897349589 conn(0x7f35300c3a60 msgr2=0x7f35300c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 -- 172.21.15.98:0/897349589 shutdown_connections 2023-08-22T00:06:50.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.590+0000 7f353817e700 1 -- 172.21.15.98:0/897349589 wait complete. 2023-08-22T00:06:50.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.591+0000 7f353817e700 1 Processor -- start 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.591+0000 7f353817e700 1 -- start start 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530063000 0x7f35301569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 0x7f3530143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530157630 con 0x7f35300c5750 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300bf790 con 0x7f35301579e0 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353817e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3530157070 con 0x7f3530063000 2023-08-22T00:06:50.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39790/0 (socket says 172.21.15.98:39790) 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 -- 172.21.15.98:0/3831741577 learned_addr learned my addr 172.21.15.98:0/3831741577 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353671b700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 0x7f3530143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535f1a700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530063000 0x7f35301569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 -- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530063000 msgr2=0x7f35301569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530063000 0x7f35301569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 -- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 msgr2=0x7f3530143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 0x7f3530143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 -- 172.21.15.98:0/3831741577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200092a0 con 0x7f35300c5750 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f353671b700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 0x7f3530143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3535719700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f352c001eb0 tx=0x7f352c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.592+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00f470 con 0x7f35300c5750 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.593+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c00f5f0 con 0x7f35300c5750 2023-08-22T00:06:50.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.593+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530157350 con 0x7f35300c5750 2023-08-22T00:06:50.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.593+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00f9b0 con 0x7f35300c5750 2023-08-22T00:06:50.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.593+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301549c0 con 0x7f35300c5750 2023-08-22T00:06:50.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.594+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300bf280 con 0x7f35300c5750 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.594+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f352c00fd20 con 0x7f35300c5750 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.594+0000 7f3525ffb700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 0x7f35140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.594+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f352c079760 con 0x7f35300c5750 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.594+0000 7f3535f1a700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 0x7f35140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.595+0000 7f3535f1a700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 0x7f35140612d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3520009760 tx=0x7f3520015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.598+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35300bf280 con 0x7f35300c5750 2023-08-22T00:06:50.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.757+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35300bf280 con 0x7f35300c5750 2023-08-22T00:06:50.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.757+0000 7f3525ffb700 1 -- 172.21.15.98:0/3831741577 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35300bf280 con 0x7f35300c5750 2023-08-22T00:06:50.762 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:50.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 msgr2=0x7f35140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 0x7f35140612d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3520009760 tx=0x7f3520015000).stop 2023-08-22T00:06:50.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 msgr2=0x7f35301544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f352c001eb0 tx=0x7f352c007c40).stop 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 shutdown_connections 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f351405ee10 0x7f35140612d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530063000 0x7f35301569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35301579e0 0x7f3530143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 --2- 172.21.15.98:0/3831741577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35300c5750 0x7f35301544d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 >> 172.21.15.98:0/3831741577 conn(0x7f35300c3a60 msgr2=0x7f3530152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 shutdown_connections 2023-08-22T00:06:50.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.759+0000 7f353817e700 1 -- 172.21.15.98:0/3831741577 wait complete. 2023-08-22T00:06:50.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:50.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.890+0000 7fe803ef5700 1 Processor -- start 2023-08-22T00:06:50.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.891+0000 7fe803ef5700 1 -- start start 2023-08-22T00:06:50.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe803ef5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7fc0c5360 0x7fe7fc066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe803ef5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7fc0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe803ef5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0c69b0 con 0x7fe7fc066150 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe803ef5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc1542c0 con 0x7fe7fc0c5360 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe803ef5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c57f0 con 0x7fe7fc157890 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe801c91700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe7fc066150 0x7fe7fc0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59272/0 (socket says 172.21.15.98:59272) 2023-08-22T00:06:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe801c91700 1 -- 172.21.15.98:0/3106098448 learned_addr learned my addr 172.21.15.98:0/3106098448 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe802492700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7fc0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe801490700 1 --2- 172.21.15.98:0/3106098448 >> v2:172.21.15.118:3300/0 conn(0x7fe7fc0c5360 0x7fe7fc066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156331812 0 0) 0x7fe7fc0c69b0 con 0x7fe7fc066150 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e80033f0 con 0x7fe7fc066150 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317597507 0 0) 0x7fe7e80033f0 con 0x7fe7fc066150 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 msgr2=0x7fe7fc0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7fc0c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 >> v2:172.21.15.118:3300/0 conn(0x7fe7fc0c5360 msgr2=0x7fe7fc066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:50.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 --2- 172.21.15.98:0/3106098448 >> v2:172.21.15.118:3300/0 conn(0x7fe7fc0c5360 0x7fe7fc066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0c5ad0 con 0x7fe7fc066150 2023-08-22T00:06:50.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe7ec001470 con 0x7fe7fc066150 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 >> v1:172.21.15.98:6789/0 conn(0x7fe7fc066150 legacy=0x7fe7fc0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7e80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8003e10 0x7fe7e8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e8004b80 0x7fe7e8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1542c0 con 0x7fe7e8004b80 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c57f0 con 0x7fe7e8003e10 2023-08-22T00:06:50.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e800b8e0 con 0x7fe7fc157890 2023-08-22T00:06:50.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.892+0000 7fe802492700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e8004b80 0x7fe7e8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe801c91700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7e80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe801490700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8003e10 0x7fe7e8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 -- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 msgr2=0x7fe7e80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:50.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc157890 0x7fe7e80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 -- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8003e10 msgr2=0x7fe7e8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:50.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8003e10 0x7fe7e8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 -- 172.21.15.98:0/3106098448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80033f0 con 0x7fe7e8004b80 2023-08-22T00:06:50.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e8004b80 0x7fe7e8005000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe7f400e1f0 tx=0x7fe7f400b040).ready entity=mon.0 client_cookie=d684f4158b58fb3f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4009ac0 con 0x7fe7e8004b80 2023-08-22T00:06:50.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400f040 con 0x7fe7e8004b80 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe800c8f700 1 -- 172.21.15.98:0/3106098448 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400ecd0 con 0x7fe7e8004b80 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe803ef5700 1 -- 172.21.15.98:0/3106098448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e8004b80 msgr2=0x7fe7e8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe803ef5700 1 --2- 172.21.15.98:0/3106098448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e8004b80 0x7fe7e8005000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe7f400e1f0 tx=0x7fe7f400b040).stop 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.893+0000 7fe802492700 1 -- 172.21.15.98:0/3106098448 reap_dead start 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.894+0000 7fe803ef5700 1 -- 172.21.15.98:0/3106098448 shutdown_connections 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.894+0000 7fe803ef5700 1 -- 172.21.15.98:0/3106098448 >> 172.21.15.98:0/3106098448 conn(0x7fe7fc0c7800 msgr2=0x7fe7fc0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.894+0000 7fe803ef5700 1 -- 172.21.15.98:0/3106098448 shutdown_connections 2023-08-22T00:06:50.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.894+0000 7fe803ef5700 1 -- 172.21.15.98:0/3106098448 wait complete. 2023-08-22T00:06:50.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.895+0000 7fe803ef5700 1 Processor -- start 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.895+0000 7fe803ef5700 1 -- start start 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc167f40 0x7fe7fc0a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7fc0aae00 0x7fe7fc0ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0ab770 con 0x7fe7fc153640 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1683c0 con 0x7fe7fc0aae00 2023-08-22T00:06:50.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe803ef5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc168e70 con 0x7fe7fc167f40 2023-08-22T00:06:50.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801c91700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801c91700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39818/0 (socket says 172.21.15.98:39818) 2023-08-22T00:06:50.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801c91700 1 -- 172.21.15.98:0/2130428659 learned_addr learned my addr 172.21.15.98:0/2130428659 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:50.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801490700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc167f40 0x7fe7fc0a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe802492700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7fc0aae00 0x7fe7fc0ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801c91700 1 -- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc167f40 msgr2=0x7fe7fc0a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.896+0000 7fe801c91700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc167f40 0x7fe7fc0a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe801c91700 1 -- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7fc0aae00 msgr2=0x7fe7fc0ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:50.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe801c91700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7fc0aae00 0x7fe7fc0ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe801c91700 1 -- 172.21.15.98:0/2130428659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0aa970 con 0x7fe7fc153640 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe801c91700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe7ec007860 tx=0x7fe7ec001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00f630 con 0x7fe7fc153640 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00f790 con 0x7fe7fc153640 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00fb50 con 0x7fe7fc153640 2023-08-22T00:06:50.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0a5b40 con 0x7fe7fc153640 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.897+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc1688b0 con 0x7fe7fc153640 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.898+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc069220 con 0x7fe7fc153640 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.898+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe7ec01c360 con 0x7fe7fc153640 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.898+0000 7fe7f1ffb700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 0x7fe7e00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.898+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe7ec0797f0 con 0x7fe7fc153640 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.898+0000 7fe801490700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 0x7fe7e00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.899+0000 7fe801490700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 0x7fe7e00612d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe7fc167ea0 tx=0x7fe7f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:50.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:50.903+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7ec04a8f0 con 0x7fe7fc153640 2023-08-22T00:06:51.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.064+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7fc0c5db0 con 0x7fe7fc153640 2023-08-22T00:06:51.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.065+0000 7fe7f1ffb700 1 -- 172.21.15.98:0/2130428659 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7ec019030 con 0x7fe7fc153640 2023-08-22T00:06:51.065 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 msgr2=0x7fe7e00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 0x7fe7e00612d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe7fc167ea0 tx=0x7fe7f8008040).stop 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 msgr2=0x7fe7fc153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe7ec007860 tx=0x7fe7ec001e90).stop 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 shutdown_connections 2023-08-22T00:06:51.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7fc0aae00 0x7fe7fc0ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7fc153640 0x7fe7fc153a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7e005ee10 0x7fe7e00612d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 --2- 172.21.15.98:0/2130428659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7fc167f40 0x7fe7fc0a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 >> 172.21.15.98:0/2130428659 conn(0x7fe7fc0c7800 msgr2=0x7fe7fc063ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 shutdown_connections 2023-08-22T00:06:51.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.067+0000 7fe803ef5700 1 -- 172.21.15.98:0/2130428659 wait complete. 2023-08-22T00:06:51.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:51.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.199+0000 7f8bbb752700 1 Processor -- start 2023-08-22T00:06:51.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.199+0000 7f8bbb752700 1 -- start start 2023-08-22T00:06:51.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bbb752700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8bb4154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bbb752700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb4151e80 con 0x7f8bb414b250 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bbb752700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb4065560 con 0x7f8bb414ae70 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bbb752700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4066b90 con 0x7f8bb40c3c10 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bb8ced700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8bb414b250 0x7f8bb40c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59274/0 (socket says 172.21.15.98:59274) 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.200+0000 7f8bb8ced700 1 -- 172.21.15.98:0/2144194869 learned_addr learned my addr 172.21.15.98:0/2144194869 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:51.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb9cef700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8bb4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851895366 0 0) 0x7f8bb4151e80 con 0x7f8bb414b250 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba00033f0 con 0x7f8bb414b250 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397052069 0 0) 0x7f8bb4065560 con 0x7f8bb414ae70 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb4151e80 con 0x7f8bb414ae70 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220962173 0 0) 0x7f8ba00033f0 con 0x7f8bb414b250 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 msgr2=0x7f8bb4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:51.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8bb4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 >> v1:172.21.15.118:6789/0 conn(0x7f8bb414ae70 legacy=0x7f8bb40c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40c7590 con 0x7f8bb414b250 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8ba4001470 con 0x7f8bb414b250 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb9cef700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8bb4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 >> v1:172.21.15.98:6789/0 conn(0x7f8bb414b250 legacy=0x7f8bb40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba0003aa0 0x7f8ba0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8ba0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0004b80 0x7f8ba0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4066b90 con 0x7f8ba0003aa0 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba000b8e0 con 0x7f8ba0004b80 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba000ba70 con 0x7f8bb40c3c10 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba0003aa0 0x7f8ba0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb8ced700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8ba0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb9cef700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0004b80 0x7f8ba0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 -- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 msgr2=0x7f8ba0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:51.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40c3c10 0x7f8ba0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 -- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0004b80 msgr2=0x7f8ba0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0004b80 0x7f8ba0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.201+0000 7f8bb94ee700 1 -- 172.21.15.98:0/2144194869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009a20 con 0x7f8ba0003aa0 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba0003aa0 0x7f8ba0003ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f8bb00018d0 tx=0x7f8bb0007bb0).ready entity=mon.0 client_cookie=16a84bfeab89cd9b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007020 con 0x7f8ba0003aa0 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0007180 con 0x7f8ba0003aa0 2023-08-22T00:06:51.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8babfff700 1 -- 172.21.15.98:0/2144194869 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007500 con 0x7f8ba0003aa0 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 -- 172.21.15.98:0/2144194869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba0003aa0 msgr2=0x7f8ba0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 --2- 172.21.15.98:0/2144194869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba0003aa0 0x7f8ba0003ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f8bb00018d0 tx=0x7f8bb0007bb0).stop 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bb9cef700 1 -- 172.21.15.98:0/2144194869 reap_dead start 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 -- 172.21.15.98:0/2144194869 shutdown_connections 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 -- 172.21.15.98:0/2144194869 >> 172.21.15.98:0/2144194869 conn(0x7f8bb40c7800 msgr2=0x7f8bb40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 -- 172.21.15.98:0/2144194869 shutdown_connections 2023-08-22T00:06:51.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.202+0000 7f8bbb752700 1 -- 172.21.15.98:0/2144194869 wait complete. 2023-08-22T00:06:51.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.203+0000 7f8bbb752700 1 Processor -- start 2023-08-22T00:06:51.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.203+0000 7f8bbb752700 1 -- start start 2023-08-22T00:06:51.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 0x7f8bb4148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40a72e0 0x7f8bb40a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a8be0 con 0x7f8bb40a92e0 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a9c50 con 0x7f8ba0003aa0 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bbb752700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a7fd0 con 0x7f8bb40a72e0 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bb8ced700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bb8ced700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39822/0 (socket says 172.21.15.98:39822) 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.204+0000 7f8bb8ced700 1 -- 172.21.15.98:0/560938961 learned_addr learned my addr 172.21.15.98:0/560938961 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb9cef700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40a72e0 0x7f8bb40a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 0x7f8bb4148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 -- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40a72e0 msgr2=0x7f8bb40a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40a72e0 0x7f8bb40a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 -- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 msgr2=0x7f8bb4148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 0x7f8bb4148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 -- 172.21.15.98:0/560938961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40a82b0 con 0x7f8bb40a92e0 2023-08-22T00:06:51.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 0x7f8bb4148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:51.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bb8ced700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f8ba4007740 tx=0x7f8ba4001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4001470 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba40114c0 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40a8590 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4011840 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.205+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb4148a70 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.206+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4069220 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.206+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8ba4011bb0 con 0x7f8bb40a92e0 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.207+0000 7f8ba97fa700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 0x7f8b980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.207+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8ba4079ae0 con 0x7f8bb40a92e0 2023-08-22T00:06:51.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.207+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 0x7f8b980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.207+0000 7f8bb94ee700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 0x7f8b980612d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8bb00016b0 tx=0x7f8bb0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.211+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ba404ac40 con 0x7f8bb40a92e0 2023-08-22T00:06:51.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.371+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8bb40bd920 con 0x7f8bb40a92e0 2023-08-22T00:06:51.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.371+0000 7f8ba97fa700 1 -- 172.21.15.98:0/560938961 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ba4011e60 con 0x7f8bb40a92e0 2023-08-22T00:06:51.372 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:51.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 msgr2=0x7f8b980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 0x7f8b980612d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8bb00016b0 tx=0x7f8bb0016000).stop 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 msgr2=0x7f8bb40a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f8ba4007740 tx=0x7f8ba4001df0).stop 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 shutdown_connections 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b9805ee10 0x7f8b980612d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bb40a72e0 0x7f8bb40a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ba0003aa0 0x7f8bb4148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 --2- 172.21.15.98:0/560938961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb40a92e0 0x7f8bb40a9760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 >> 172.21.15.98:0/560938961 conn(0x7f8bb40c7800 msgr2=0x7f8bb40bd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 shutdown_connections 2023-08-22T00:06:51.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.373+0000 7f8bbb752700 1 -- 172.21.15.98:0/560938961 wait complete. 2023-08-22T00:06:51.391 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:51.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.511+0000 7fe7640a1700 1 Processor -- start 2023-08-22T00:06:51.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.511+0000 7fe7640a1700 1 -- start start 2023-08-22T00:06:51.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe7640a1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe75c157a80 0x7fe75c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe7640a1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c063d20 con 0x7fe75c157e60 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe7640a1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c0c8d30 con 0x7fe75c153e90 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe7640a1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0c9010 con 0x7fe75c157a80 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe761e3d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe75c157a80 0x7fe75c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe76163c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe75c157e60 0x7fe75c153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59286/0 (socket says 172.21.15.98:59286) 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe761e3d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe75c157a80 0x7fe75c0aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39830/0 (socket says 172.21.15.98:39830) 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.512+0000 7fe76163c700 1 -- 172.21.15.98:0/2169994741 learned_addr learned my addr 172.21.15.98:0/2169994741 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:51.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe761e3d700 1 -- 172.21.15.98:0/2169994741 >> v1:172.21.15.118:6789/0 conn(0x7fe75c153e90 legacy=0x7fe75c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe761e3d700 1 -- 172.21.15.98:0/2169994741 >> v1:172.21.15.98:6789/0 conn(0x7fe75c157e60 legacy=0x7fe75c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe761e3d700 1 -- 172.21.15.98:0/2169994741 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0c92f0 con 0x7fe75c157a80 2023-08-22T00:06:51.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe760e3b700 1 -- 172.21.15.98:0/2169994741 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816467300 0 0) 0x7fe75c063d20 con 0x7fe75c157e60 2023-08-22T00:06:51.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe761e3d700 1 --2- 172.21.15.98:0/2169994741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c157a80 0x7fe75c0aa920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fe74c009760 tx=0x7fe74c009060).ready entity=mon.0 client_cookie=2bed744fb528fdd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe760e3b700 1 -- 172.21.15.98:0/2169994741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c009120 con 0x7fe75c157a80 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe760e3b700 1 -- 172.21.15.98:0/2169994741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00b580 con 0x7fe75c157a80 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe760e3b700 1 -- 172.21.15.98:0/2169994741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00b900 con 0x7fe75c157a80 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 -- 172.21.15.98:0/2169994741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c157a80 msgr2=0x7fe75c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2169994741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c157a80 0x7fe75c0aa920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fe74c009760 tx=0x7fe74c009060).stop 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 -- 172.21.15.98:0/2169994741 shutdown_connections 2023-08-22T00:06:51.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2169994741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c157a80 0x7fe75c0aa920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 -- 172.21.15.98:0/2169994741 >> 172.21.15.98:0/2169994741 conn(0x7fe75c0cb5f0 msgr2=0x7fe75c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 -- 172.21.15.98:0/2169994741 shutdown_connections 2023-08-22T00:06:51.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.513+0000 7fe7640a1700 1 -- 172.21.15.98:0/2169994741 wait complete. 2023-08-22T00:06:51.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.514+0000 7fe7640a1700 1 Processor -- start 2023-08-22T00:06:51.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 -- start start 2023-08-22T00:06:51.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe75c157a80 0x7fe75c14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe75c157e60 0x7fe75c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c144f40 con 0x7fe75c153e90 2023-08-22T00:06:51.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c14dab0 con 0x7fe75c157a80 2023-08-22T00:06:51.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe7640a1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c165240 con 0x7fe75c157e60 2023-08-22T00:06:51.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe761e3d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe761e3d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39838/0 (socket says 172.21.15.98:39838) 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe761e3d700 1 -- 172.21.15.98:0/2508296805 learned_addr learned my addr 172.21.15.98:0/2508296805 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe76163c700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe75c157a80 0x7fe75c14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.515+0000 7fe76263e700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe75c157e60 0x7fe75c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 -- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe75c157e60 msgr2=0x7fe75c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe75c157e60 0x7fe75c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 -- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe75c157a80 msgr2=0x7fe75c14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe75c157a80 0x7fe75c14d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 -- 172.21.15.98:0/2508296805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0092a0 con 0x7fe75c153e90 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe761e3d700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe74c006e00 tx=0x7fe74c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00b900 con 0x7fe75c153e90 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c000d10 con 0x7fe75c153e90 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c168530 con 0x7fe75c153e90 2023-08-22T00:06:51.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00bed0 con 0x7fe75c153e90 2023-08-22T00:06:51.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.516+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c1645d0 con 0x7fe75c153e90 2023-08-22T00:06:51.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.517+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c083630 con 0x7fe75c153e90 2023-08-22T00:06:51.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.518+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe74c01b620 con 0x7fe75c153e90 2023-08-22T00:06:51.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.518+0000 7fe751ffb700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 0x7fe7400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.518+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe74c07bbb0 con 0x7fe75c153e90 2023-08-22T00:06:51.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.518+0000 7fe76163c700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 0x7fe7400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.518+0000 7fe76163c700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 0x7fe7400612d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe75c0c39f0 tx=0x7fe758007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.522+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe74c04ccb0 con 0x7fe75c153e90 2023-08-22T00:06:51.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.684+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe75c046c20 con 0x7fe75c153e90 2023-08-22T00:06:51.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.684+0000 7fe751ffb700 1 -- 172.21.15.98:0/2508296805 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe74c006970 con 0x7fe75c153e90 2023-08-22T00:06:51.685 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:51.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 msgr2=0x7fe7400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 0x7fe7400612d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe75c0c39f0 tx=0x7fe758007b90).stop 2023-08-22T00:06:51.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 msgr2=0x7fe75c168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe74c006e00 tx=0x7fe74c017000).stop 2023-08-22T00:06:51.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 shutdown_connections 2023-08-22T00:06:51.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe74005ee10 0x7fe7400612d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe75c157e60 0x7fe75c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe75c153e90 0x7fe75c168040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 --2- 172.21.15.98:0/2508296805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe75c157a80 0x7fe75c14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 >> 172.21.15.98:0/2508296805 conn(0x7fe75c0cb5f0 msgr2=0x7fe75c0c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 shutdown_connections 2023-08-22T00:06:51.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.686+0000 7fe7640a1700 1 -- 172.21.15.98:0/2508296805 wait complete. 2023-08-22T00:06:51.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:51.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.816+0000 7f5427570700 1 Processor -- start 2023-08-22T00:06:51.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.817+0000 7f5427570700 1 -- start start 2023-08-22T00:06:51.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5427570700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5420151d60 0x7f5420155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5427570700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5420066620 0x7f54200643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5427570700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5420158bf0 con 0x7f54200a6e50 2023-08-22T00:06:51.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5427570700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5420157d90 con 0x7f5420151d60 2023-08-22T00:06:51.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5427570700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5420157fe0 con 0x7f5420066620 2023-08-22T00:06:51.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5420151d60 0x7f5420155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5424b0b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f54200a6e50 0x7f5420065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59294/0 (socket says 172.21.15.98:59294) 2023-08-22T00:06:51.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5424b0b700 1 -- 172.21.15.98:0/198526591 learned_addr learned my addr 172.21.15.98:0/198526591 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:51.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5425b0d700 1 --2- 172.21.15.98:0/198526591 >> v2:172.21.15.118:3300/0 conn(0x7f5420066620 0x7f54200643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 -- 172.21.15.98:0/198526591 >> v2:172.21.15.118:3300/0 conn(0x7f5420066620 msgr2=0x7f54200643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:51.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 --2- 172.21.15.98:0/198526591 >> v2:172.21.15.118:3300/0 conn(0x7f5420066620 0x7f54200643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 -- 172.21.15.98:0/198526591 >> v1:172.21.15.98:6789/0 conn(0x7f54200a6e50 legacy=0x7f5420065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 -- 172.21.15.98:0/198526591 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54201582c0 con 0x7f5420151d60 2023-08-22T00:06:51.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5417fff700 1 -- 172.21.15.98:0/198526591 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377438377 0 0) 0x7f5420158bf0 con 0x7f54200a6e50 2023-08-22T00:06:51.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f542530c700 1 --2- 172.21.15.98:0/198526591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420151d60 0x7f5420155240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f5420046dc0 tx=0x7f541c009060).ready entity=mon.0 client_cookie=6280ce69e2dd5447 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5417fff700 1 -- 172.21.15.98:0/198526591 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00b580 con 0x7f5420151d60 2023-08-22T00:06:51.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5417fff700 1 -- 172.21.15.98:0/198526591 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b6e0 con 0x7f5420151d60 2023-08-22T00:06:51.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.818+0000 7f5417fff700 1 -- 172.21.15.98:0/198526591 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00ba60 con 0x7f5420151d60 2023-08-22T00:06:51.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 -- 172.21.15.98:0/198526591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420151d60 msgr2=0x7f5420155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 --2- 172.21.15.98:0/198526591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420151d60 0x7f5420155240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f5420046dc0 tx=0x7f541c009060).stop 2023-08-22T00:06:51.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 -- 172.21.15.98:0/198526591 shutdown_connections 2023-08-22T00:06:51.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 --2- 172.21.15.98:0/198526591 >> v2:172.21.15.118:3300/0 conn(0x7f5420066620 0x7f54200643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 --2- 172.21.15.98:0/198526591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420151d60 0x7f5420155240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 -- 172.21.15.98:0/198526591 >> 172.21.15.98:0/198526591 conn(0x7f542006a980 msgr2=0x7f54200c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:51.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 -- 172.21.15.98:0/198526591 shutdown_connections 2023-08-22T00:06:51.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.819+0000 7f5427570700 1 -- 172.21.15.98:0/198526591 wait complete. 2023-08-22T00:06:51.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.820+0000 7f5427570700 1 Processor -- start 2023-08-22T00:06:51.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.820+0000 7f5427570700 1 -- start start 2023-08-22T00:06:51.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54200a6e50 0x7f542013d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5420151d60 0x7f54200acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54200a51d0 con 0x7f5420066620 2023-08-22T00:06:51.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54200a3c40 con 0x7f5420151d60 2023-08-22T00:06:51.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5427570700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54200a3f20 con 0x7f54200a6e50 2023-08-22T00:06:51.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39854/0 (socket says 172.21.15.98:39854) 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 -- 172.21.15.98:0/4153163358 learned_addr learned my addr 172.21.15.98:0/4153163358 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5425b0d700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5420151d60 0x7f54200acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f5424b0b700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54200a6e50 0x7f542013d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 -- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54200a6e50 msgr2=0x7f542013d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54200a6e50 0x7f542013d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 -- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5420151d60 msgr2=0x7f54200acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5420151d60 0x7f54200acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:51.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 -- 172.21.15.98:0/4153163358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0092a0 con 0x7f5420066620 2023-08-22T00:06:51.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.821+0000 7f542530c700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5420062ac0 tx=0x7f541c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.822+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00b850 con 0x7f5420066620 2023-08-22T00:06:51.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.822+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b9b0 con 0x7f5420066620 2023-08-22T00:06:51.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.822+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c01b670 con 0x7f5420066620 2023-08-22T00:06:51.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.822+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54200a4200 con 0x7f5420066620 2023-08-22T00:06:51.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.822+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54200a47c0 con 0x7f5420066620 2023-08-22T00:06:51.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.823+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54200a49e0 con 0x7f5420066620 2023-08-22T00:06:51.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.823+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f541c01baa0 con 0x7f5420066620 2023-08-22T00:06:51.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.824+0000 7f54157fa700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 0x7f54040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:51.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.824+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f541c07c240 con 0x7f5420066620 2023-08-22T00:06:51.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.824+0000 7f5424b0b700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 0x7f54040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:51.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.824+0000 7f5424b0b700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 0x7f54040612d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5420063bb0 tx=0x7f5410009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:51.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.827+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f541c04d3a0 con 0x7f5420066620 2023-08-22T00:06:51.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.987+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5420047480 con 0x7f5420066620 2023-08-22T00:06:51.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.988+0000 7f54157fa700 1 -- 172.21.15.98:0/4153163358 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f541c0509c0 con 0x7f5420066620 2023-08-22T00:06:51.990 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:51.990 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:51.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 msgr2=0x7f54040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:51.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 0x7f54040612d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5420063bb0 tx=0x7f5410009040).stop 2023-08-22T00:06:52.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 msgr2=0x7f54200a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5420062ac0 tx=0x7f541c017000).stop 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 shutdown_connections 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5420151d60 0x7f54200acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420066620 0x7f54200a4ce0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f540405ee10 0x7f54040612d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 --2- 172.21.15.98:0/4153163358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54200a6e50 0x7f542013d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 >> 172.21.15.98:0/4153163358 conn(0x7f542006a980 msgr2=0x7f5420152340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.989+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 shutdown_connections 2023-08-22T00:06:52.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:51.990+0000 7f5427570700 1 -- 172.21.15.98:0/4153163358 wait complete. 2023-08-22T00:06:52.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:52.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:52.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.125+0000 7fb6a363e700 1 Processor -- start 2023-08-22T00:06:52.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.125+0000 7fb6a363e700 1 -- start start 2023-08-22T00:06:52.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a363e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb69c0c5750 0x7fb69c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a363e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb69c063000 0x7fb69c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a363e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c064280 con 0x7fb69c1579e0 2023-08-22T00:06:52.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a363e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c0c1850 con 0x7fb69c0c5750 2023-08-22T00:06:52.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a363e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c063470 con 0x7fb69c063000 2023-08-22T00:06:52.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a13da700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb69c0c5750 0x7fb69c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a13da700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb69c0c5750 0x7fb69c0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39866/0 (socket says 172.21.15.98:39866) 2023-08-22T00:06:52.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.126+0000 7fb6a13da700 1 -- 172.21.15.98:0/158397238 learned_addr learned my addr 172.21.15.98:0/158397238 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:52.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a1bdb700 1 --2- 172.21.15.98:0/158397238 >> v2:172.21.15.118:3300/0 conn(0x7fb69c063000 0x7fb69c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a13da700 1 -- 172.21.15.98:0/158397238 >> v2:172.21.15.118:3300/0 conn(0x7fb69c063000 msgr2=0x7fb69c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a13da700 1 --2- 172.21.15.98:0/158397238 >> v2:172.21.15.118:3300/0 conn(0x7fb69c063000 0x7fb69c154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a13da700 1 -- 172.21.15.98:0/158397238 >> v1:172.21.15.118:6789/0 conn(0x7fb69c1579e0 legacy=0x7fb69c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a13da700 1 -- 172.21.15.98:0/158397238 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0c4c20 con 0x7fb69c0c5750 2023-08-22T00:06:52.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a13da700 1 --2- 172.21.15.98:0/158397238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c0c5750 0x7fb69c0c5b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb69c0c14f0 tx=0x7fb68c0090f0).ready entity=mon.0 client_cookie=251c60e03fc74a1d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb693fff700 1 -- 172.21.15.98:0/158397238 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00b5a0 con 0x7fb69c0c5750 2023-08-22T00:06:52.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb693fff700 1 -- 172.21.15.98:0/158397238 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00b700 con 0x7fb69c0c5750 2023-08-22T00:06:52.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb693fff700 1 -- 172.21.15.98:0/158397238 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00ba80 con 0x7fb69c0c5750 2023-08-22T00:06:52.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 -- 172.21.15.98:0/158397238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c0c5750 msgr2=0x7fb69c0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 --2- 172.21.15.98:0/158397238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c0c5750 0x7fb69c0c5b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb69c0c14f0 tx=0x7fb68c0090f0).stop 2023-08-22T00:06:52.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 -- 172.21.15.98:0/158397238 shutdown_connections 2023-08-22T00:06:52.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 --2- 172.21.15.98:0/158397238 >> v2:172.21.15.118:3300/0 conn(0x7fb69c063000 0x7fb69c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 --2- 172.21.15.98:0/158397238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c0c5750 0x7fb69c0c5b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 -- 172.21.15.98:0/158397238 >> 172.21.15.98:0/158397238 conn(0x7fb69c0c3a60 msgr2=0x7fb69c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.127+0000 7fb6a363e700 1 -- 172.21.15.98:0/158397238 shutdown_connections 2023-08-22T00:06:52.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.128+0000 7fb6a363e700 1 -- 172.21.15.98:0/158397238 wait complete. 2023-08-22T00:06:52.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.129+0000 7fb6a363e700 1 Processor -- start 2023-08-22T00:06:52.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.129+0000 7fb6a363e700 1 -- start start 2023-08-22T00:06:52.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb69c0c5750 0x7fb69c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb69c1579e0 0x7fb69c1677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1681f0 con 0x7fb69c063000 2023-08-22T00:06:52.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1684d0 con 0x7fb69c0c5750 2023-08-22T00:06:52.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c14d820 con 0x7fb69c1579e0 2023-08-22T00:06:52.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39874/0 (socket says 172.21.15.98:39874) 2023-08-22T00:06:52.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 -- 172.21.15.98:0/2739688246 learned_addr learned my addr 172.21.15.98:0/2739688246 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:52.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a1bdb700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb69c1579e0 0x7fb69c1677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a0bd9700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb69c0c5750 0x7fb69c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 -- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb69c1579e0 msgr2=0x7fb69c1677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb69c1579e0 0x7fb69c1677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 -- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb69c0c5750 msgr2=0x7fb69c14e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb69c0c5750 0x7fb69c14e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 -- 172.21.15.98:0/2739688246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009370 con 0x7fb69c063000 2023-08-22T00:06:52.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a13da700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fb68c009130 tx=0x7fb68c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00b870 con 0x7fb69c063000 2023-08-22T00:06:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00b9d0 con 0x7fb69c063000 2023-08-22T00:06:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c01a430 con 0x7fb69c063000 2023-08-22T00:06:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c14db00 con 0x7fb69c063000 2023-08-22T00:06:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.130+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c0c0840 con 0x7fb69c063000 2023-08-22T00:06:52.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.131+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c14dd20 con 0x7fb69c063000 2023-08-22T00:06:52.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.132+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb68c021020 con 0x7fb69c063000 2023-08-22T00:06:52.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.133+0000 7fb6917fa700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 0x7fb680061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.133+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb68c07bae0 con 0x7fb69c063000 2023-08-22T00:06:52.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.133+0000 7fb6a0bd9700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 0x7fb680061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.133+0000 7fb6a0bd9700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 0x7fb680061300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb69c0ac0d0 tx=0x7fb698008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.136+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb68c04cce0 con 0x7fb69c063000 2023-08-22T00:06:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.298+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb69c063670 con 0x7fb69c063000 2023-08-22T00:06:52.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.299+0000 7fb6917fa700 1 -- 172.21.15.98:0/2739688246 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb68c0290b0 con 0x7fb69c063000 2023-08-22T00:06:52.305 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.300+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 msgr2=0x7fb680061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.300+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 0x7fb680061300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb69c0ac0d0 tx=0x7fb698008040).stop 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.300+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 msgr2=0x7fb69c0c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.300+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fb68c009130 tx=0x7fb68c015000).stop 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 shutdown_connections 2023-08-22T00:06:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb68005ee40 0x7fb680061300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb69c1579e0 0x7fb69c1677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb69c063000 0x7fb69c0c0350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 --2- 172.21.15.98:0/2739688246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb69c0c5750 0x7fb69c14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 >> 172.21.15.98:0/2739688246 conn(0x7fb69c0c3a60 msgr2=0x7fb69c0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 shutdown_connections 2023-08-22T00:06:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.301+0000 7fb6a363e700 1 -- 172.21.15.98:0/2739688246 wait complete. 2023-08-22T00:06:52.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:52.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.438+0000 7f5f28ecc700 1 Processor -- start 2023-08-22T00:06:52.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.439+0000 7f5f28ecc700 1 -- start start 2023-08-22T00:06:52.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f28ecc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f2414e720 0x7f5f24155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f28ecc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f240654a0 con 0x7f5f24067d00 2023-08-22T00:06:52.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f28ecc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f24064660 con 0x7f5f240641b0 2023-08-22T00:06:52.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f28ecc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f24064920 con 0x7f5f2414e720 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f22d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5f24067d00 0x7f5f240c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59296/0 (socket says 172.21.15.98:59296) 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f22d9d700 1 -- 172.21.15.98:0/664280533 learned_addr learned my addr 172.21.15.98:0/664280533 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2259c700 1 --2- 172.21.15.98:0/664280533 >> v2:172.21.15.118:3300/0 conn(0x7f5f2414e720 0x7f5f24155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674739178 0 0) 0x7f5f240654a0 con 0x7f5f24067d00 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c0033f0 con 0x7f5f24067d00 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346620180 0 0) 0x7f5f0c0033f0 con 0x7f5f24067d00 2023-08-22T00:06:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 >> v2:172.21.15.118:3300/0 conn(0x7f5f2414e720 msgr2=0x7f5f24155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 --2- 172.21.15.98:0/664280533 >> v2:172.21.15.118:3300/0 conn(0x7f5f2414e720 0x7f5f24155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 >> v1:172.21.15.118:6789/0 conn(0x7f5f240641b0 legacy=0x7f5f240675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24064c00 con 0x7f5f24067d00 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f5f1c0017f0 con 0x7f5f24067d00 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 >> v1:172.21.15.98:6789/0 conn(0x7f5f24067d00 legacy=0x7f5f240c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f0c0038e0 0x7f5f0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 0x7f5f0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c005000 0x7f5f0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24064920 con 0x7f5f0c004690 2023-08-22T00:06:52.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c00bf60 con 0x7f5f0c005000 2023-08-22T00:06:52.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c00c0f0 con 0x7f5f0c0038e0 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.440+0000 7f5f21d9b700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 0x7f5f0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f2259c700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f0c0038e0 0x7f5f0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f22d9d700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c005000 0x7f5f0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 -- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f0c0038e0 msgr2=0x7f5f0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f0c0038e0 0x7f5f0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 -- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c005000 msgr2=0x7f5f0c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c005000 0x7f5f0c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 -- 172.21.15.98:0/664280533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0033f0 con 0x7f5f0c004690 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f22d9d700 1 -- 172.21.15.98:0/664280533 reap_dead start 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f21d9b700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 0x7f5f0c004b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f5f18001760 tx=0x7f5f18007bb0).ready entity=mon.0 client_cookie=3aec8bda13f1bac1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18007020 con 0x7f5f0c004690 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f18007180 con 0x7f5f0c004690 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f2159a700 1 -- 172.21.15.98:0/664280533 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18007520 con 0x7f5f0c004690 2023-08-22T00:06:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f28ecc700 1 -- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 msgr2=0x7f5f0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.441+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 0x7f5f0c004b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f5f18001760 tx=0x7f5f18007bb0).stop 2023-08-22T00:06:52.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.442+0000 7f5f28ecc700 1 -- 172.21.15.98:0/664280533 shutdown_connections 2023-08-22T00:06:52.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.442+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/664280533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f0c004690 0x7f5f0c004b10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.442+0000 7f5f28ecc700 1 -- 172.21.15.98:0/664280533 >> 172.21.15.98:0/664280533 conn(0x7f5f240c8950 msgr2=0x7f5f240c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.442+0000 7f5f28ecc700 1 -- 172.21.15.98:0/664280533 shutdown_connections 2023-08-22T00:06:52.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.442+0000 7f5f28ecc700 1 -- 172.21.15.98:0/664280533 wait complete. 2023-08-22T00:06:52.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 Processor -- start 2023-08-22T00:06:52.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 -- start start 2023-08-22T00:06:52.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 0x7f5f240ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2414ccd0 0x7f5f240bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240ad350 con 0x7f5f240bef80 2023-08-22T00:06:52.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240bf400 con 0x7f5f0c004690 2023-08-22T00:06:52.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.443+0000 7f5f28ecc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240aca20 con 0x7f5f2414ccd0 2023-08-22T00:06:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39894/0 (socket says 172.21.15.98:39894) 2023-08-22T00:06:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 -- 172.21.15.98:0/3504095182 learned_addr learned my addr 172.21.15.98:0/3504095182 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:52.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f21d9b700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2414ccd0 0x7f5f240bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f2259c700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 0x7f5f240ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 -- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2414ccd0 msgr2=0x7f5f240bea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2414ccd0 0x7f5f240bea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 -- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 msgr2=0x7f5f240ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 0x7f5f240ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 -- 172.21.15.98:0/3504095182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240acd00 con 0x7f5f240bef80 2023-08-22T00:06:52.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f2259c700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 0x7f5f240ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f22d9d700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5f24157d10 tx=0x7f5f1c007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00f8a0 con 0x7f5f240bef80 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00fa00 con 0x7f5f240bef80 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f240acfe0 con 0x7f5f240bef80 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00fda0 con 0x7f5f240bef80 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.444+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2414d150 con 0x7f5f240bef80 2023-08-22T00:06:52.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.445+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f240ad170 con 0x7f5f240bef80 2023-08-22T00:06:52.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.445+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5f1c015620 con 0x7f5f240bef80 2023-08-22T00:06:52.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.446+0000 7f5f127fc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 0x7f5f040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.446+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f5f1c079f00 con 0x7f5f240bef80 2023-08-22T00:06:52.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.446+0000 7f5f2259c700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 0x7f5f040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.446+0000 7f5f2259c700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 0x7f5f040612d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5f14006d80 tx=0x7f5f14008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.450+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f1c04b060 con 0x7f5f240bef80 2023-08-22T00:06:52.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.610+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f24069d50 con 0x7f5f240bef80 2023-08-22T00:06:52.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.611+0000 7f5f127fc700 1 -- 172.21.15.98:0/3504095182 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f1c01b030 con 0x7f5f240bef80 2023-08-22T00:06:52.628 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:52.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 msgr2=0x7f5f040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 0x7f5f040612d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5f14006d80 tx=0x7f5f14008040).stop 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 msgr2=0x7f5f240c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5f24157d10 tx=0x7f5f1c007ca0).stop 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 shutdown_connections 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f240bef80 0x7f5f240c1730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f0c004690 0x7f5f240ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f0405ee10 0x7f5f040612d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 --2- 172.21.15.98:0/3504095182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2414ccd0 0x7f5f240bea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 >> 172.21.15.98:0/3504095182 conn(0x7f5f240c8950 msgr2=0x7f5f2414dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 shutdown_connections 2023-08-22T00:06:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.612+0000 7f5f28ecc700 1 -- 172.21.15.98:0/3504095182 wait complete. 2023-08-22T00:06:52.631 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:52.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.754+0000 7f12b5f82700 1 Processor -- start 2023-08-22T00:06:52.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.754+0000 7f12b5f82700 1 -- start start 2023-08-22T00:06:52.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12b5f82700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 0x7f12b0063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12b5f82700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f12b00c15c0 0x7f12b0151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12b5f82700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b0064490 con 0x7f12b0151d10 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12b5f82700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b0151110 con 0x7f12b00c15c0 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12b5f82700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b0151390 con 0x7f12b014b130 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f12b00c15c0 0x7f12b0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12affff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f12b0151d10 0x7f12b0065a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59312/0 (socket says 172.21.15.98:59312) 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12affff700 1 -- 172.21.15.98:0/118081442 learned_addr learned my addr 172.21.15.98:0/118081442 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12af7fe700 1 --2- 172.21.15.98:0/118081442 >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 0x7f12b0063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 -- 172.21.15.98:0/118081442 >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 msgr2=0x7f12b0063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 --2- 172.21.15.98:0/118081442 >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 0x7f12b0063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 -- 172.21.15.98:0/118081442 >> v1:172.21.15.98:6789/0 conn(0x7f12b0151d10 legacy=0x7f12b0065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 -- 172.21.15.98:0/118081442 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00c6610 con 0x7f12b00c15c0 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12ae7fc700 1 -- 172.21.15.98:0/118081442 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611908041 0 0) 0x7f12a8001490 con 0x7f12b0151d10 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12af7fe700 1 --2- 172.21.15.98:0/118081442 >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 0x7f12b0063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12aeffd700 1 --2- 172.21.15.98:0/118081442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00c15c0 0x7f12b0151820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f12b0068e10 tx=0x7f12a4009060).ready entity=mon.0 client_cookie=6544baf1f1899013 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12ae7fc700 1 -- 172.21.15.98:0/118081442 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40090d0 con 0x7f12b00c15c0 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12ae7fc700 1 -- 172.21.15.98:0/118081442 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400b580 con 0x7f12b00c15c0 2023-08-22T00:06:52.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.755+0000 7f12ae7fc700 1 -- 172.21.15.98:0/118081442 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400b900 con 0x7f12b00c15c0 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 -- 172.21.15.98:0/118081442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00c15c0 msgr2=0x7f12b0151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 --2- 172.21.15.98:0/118081442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00c15c0 0x7f12b0151820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f12b0068e10 tx=0x7f12a4009060).stop 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 -- 172.21.15.98:0/118081442 shutdown_connections 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 --2- 172.21.15.98:0/118081442 >> v2:172.21.15.118:3300/0 conn(0x7f12b014b130 0x7f12b0063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 --2- 172.21.15.98:0/118081442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00c15c0 0x7f12b0151820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 -- 172.21.15.98:0/118081442 >> 172.21.15.98:0/118081442 conn(0x7f12b00c3a60 msgr2=0x7f12b00c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 -- 172.21.15.98:0/118081442 shutdown_connections 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.756+0000 7f12b5f82700 1 -- 172.21.15.98:0/118081442 wait complete. 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.758+0000 7f12b5f82700 1 Processor -- start 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.758+0000 7f12b5f82700 1 -- start start 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 0x7f12b014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12b014b130 0x7f12b013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b014ccf0 con 0x7f12b0151d10 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00c0b30 con 0x7f12b014b130 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00bff20 con 0x7f12b00c15c0 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39906/0 (socket says 172.21.15.98:39906) 2023-08-22T00:06:52.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 -- 172.21.15.98:0/3256559065 learned_addr learned my addr 172.21.15.98:0/3256559065 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12af7fe700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 0x7f12b014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12aeffd700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12b014b130 0x7f12b013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 -- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 msgr2=0x7f12b014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 0x7f12b014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 -- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12b014b130 msgr2=0x7f12b013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12b014b130 0x7f12b013c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 -- 172.21.15.98:0/3256559065 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40092a0 con 0x7f12b0151d10 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12af7fe700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 0x7f12b014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12affff700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f12a800c730 tx=0x7f12a8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8005d30 con 0x7f12b0151d10 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a8005e90 con 0x7f12b0151d10 2023-08-22T00:06:52.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b00c0200 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8007340 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.759+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b00c07c0 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.760+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b00bfcb0 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.760+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f12a80076f0 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.761+0000 7f12977fe700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 0x7f129c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.761+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f12a8079f90 con 0x7f12b0151d10 2023-08-22T00:06:52.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.761+0000 7f12af7fe700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 0x7f129c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:52.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.761+0000 7f12af7fe700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 0x7f129c0612d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f12a0006d80 tx=0x7f12a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:52.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.765+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12a804b0f0 con 0x7f12b0151d10 2023-08-22T00:06:52.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.924+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12b0064490 con 0x7f12b0151d10 2023-08-22T00:06:52.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.924+0000 7f12977fe700 1 -- 172.21.15.98:0/3256559065 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12b0064490 con 0x7f12b0151d10 2023-08-22T00:06:52.925 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:52.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 msgr2=0x7f129c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 0x7f129c0612d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f12a0006d80 tx=0x7f12a0008040).stop 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 msgr2=0x7f12b014fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f12a800c730 tx=0x7f12a8001520).stop 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 shutdown_connections 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f129c05ee10 0x7f129c0612d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12b00c15c0 0x7f12b014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b0151d10 0x7f12b014fd30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 --2- 172.21.15.98:0/3256559065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12b014b130 0x7f12b013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 >> 172.21.15.98:0/3256559065 conn(0x7f12b00c3a60 msgr2=0x7f12b00634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 shutdown_connections 2023-08-22T00:06:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:52.926+0000 7f12b5f82700 1 -- 172.21.15.98:0/3256559065 wait complete. 2023-08-22T00:06:52.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:53.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.062+0000 7ff7a2ca7700 1 Processor -- start 2023-08-22T00:06:53.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 -- start start 2023-08-22T00:06:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff79c153dd0 0x7ff79c0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff79c0c3230 0x7ff79c064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c064a90 con 0x7ff79c064600 2023-08-22T00:06:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c158970 con 0x7ff79c153dd0 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.063+0000 7ff7a2ca7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c0c28b0 con 0x7ff79c0c3230 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff79c153dd0 0x7ff79c0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff79c153dd0 0x7ff79c0c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39918/0 (socket says 172.21.15.98:39918) 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a1244700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff79c064600 0x7ff79c066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59320/0 (socket says 172.21.15.98:59320) 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 -- 172.21.15.98:0/938923249 learned_addr learned my addr 172.21.15.98:0/938923249 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff79bfff700 1 --2- 172.21.15.98:0/938923249 >> v2:172.21.15.118:3300/0 conn(0x7ff79c0c3230 0x7ff79c064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 -- 172.21.15.98:0/938923249 >> v2:172.21.15.118:3300/0 conn(0x7ff79c0c3230 msgr2=0x7ff79c064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 --2- 172.21.15.98:0/938923249 >> v2:172.21.15.118:3300/0 conn(0x7ff79c0c3230 0x7ff79c064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 -- 172.21.15.98:0/938923249 >> v1:172.21.15.98:6789/0 conn(0x7ff79c064600 legacy=0x7ff79c066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 -- 172.21.15.98:0/938923249 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c158690 con 0x7ff79c153dd0 2023-08-22T00:06:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff79b7fe700 1 -- 172.21.15.98:0/938923249 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455763298 0 0) 0x7ff794001490 con 0x7ff79c064600 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff7a0a43700 1 --2- 172.21.15.98:0/938923249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c153dd0 0x7ff79c0c2d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff79c0ad9d0 tx=0x7ff7900090f0).ready entity=mon.0 client_cookie=160f4f6b36114fdb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff79b7fe700 1 -- 172.21.15.98:0/938923249 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000b600 con 0x7ff79c153dd0 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff79b7fe700 1 -- 172.21.15.98:0/938923249 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000b760 con 0x7ff79c153dd0 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.064+0000 7ff79b7fe700 1 -- 172.21.15.98:0/938923249 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000bae0 con 0x7ff79c153dd0 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/938923249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c153dd0 msgr2=0x7ff79c0c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/938923249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c153dd0 0x7ff79c0c2d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff79c0ad9d0 tx=0x7ff7900090f0).stop 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/938923249 shutdown_connections 2023-08-22T00:06:53.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/938923249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c153dd0 0x7ff79c0c2d40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/938923249 >> v2:172.21.15.118:3300/0 conn(0x7ff79c0c3230 0x7ff79c064110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/938923249 >> 172.21.15.98:0/938923249 conn(0x7ff79c0c7820 msgr2=0x7ff79c0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/938923249 shutdown_connections 2023-08-22T00:06:53.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.065+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/938923249 wait complete. 2023-08-22T00:06:53.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.066+0000 7ff7a2ca7700 1 Processor -- start 2023-08-22T00:06:53.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.066+0000 7ff7a2ca7700 1 -- start start 2023-08-22T00:06:53.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff79c064600 0x7ff79c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 0x7ff79c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c168810 con 0x7ff79c0c3230 2023-08-22T00:06:53.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c167c00 con 0x7ff79c153dd0 2023-08-22T00:06:53.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c167ee0 con 0x7ff79c064600 2023-08-22T00:06:53.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39932/0 (socket says 172.21.15.98:39932) 2023-08-22T00:06:53.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 -- 172.21.15.98:0/3218171535 learned_addr learned my addr 172.21.15.98:0/3218171535 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a0a43700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff79c064600 0x7ff79c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a1244700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 0x7ff79c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 -- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff79c064600 msgr2=0x7ff79c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff79c064600 0x7ff79c14d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 -- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 msgr2=0x7ff79c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 0x7ff79c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 -- 172.21.15.98:0/3218171535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009370 con 0x7ff79c0c3230 2023-08-22T00:06:53.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a1244700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 0x7ff79c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:53.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff79bfff700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7ff78800d890 tx=0x7ff788008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880125f0 con 0x7ff79c0c3230 2023-08-22T00:06:53.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788012750 con 0x7ff79c0c3230 2023-08-22T00:06:53.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788012ad0 con 0x7ff79c0c3230 2023-08-22T00:06:53.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c1681c0 con 0x7ff79c0c3230 2023-08-22T00:06:53.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.067+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c0aa030 con 0x7ff79c0c3230 2023-08-22T00:06:53.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.068+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c0c2180 con 0x7ff79c0c3230 2023-08-22T00:06:53.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.069+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff788013480 con 0x7ff79c0c3230 2023-08-22T00:06:53.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.069+0000 7ff798ff9700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 0x7ff7800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.069+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff78807a1f0 con 0x7ff79c0c3230 2023-08-22T00:06:53.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.069+0000 7ff7a0a43700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 0x7ff7800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.069+0000 7ff7a0a43700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 0x7ff7800612d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff790009130 tx=0x7ff790017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.073+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff78804b2f0 con 0x7ff79c0c3230 2023-08-22T00:06:53.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.234+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff79c0c3d60 con 0x7ff79c0c3230 2023-08-22T00:06:53.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.234+0000 7ff798ff9700 1 -- 172.21.15.98:0/3218171535 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff78804e910 con 0x7ff79c0c3230 2023-08-22T00:06:53.242 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:53.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 msgr2=0x7ff7800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 0x7ff7800612d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff790009130 tx=0x7ff790017000).stop 2023-08-22T00:06:53.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 msgr2=0x7ff79c0a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7ff78800d890 tx=0x7ff788008040).stop 2023-08-22T00:06:53.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 shutdown_connections 2023-08-22T00:06:53.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff78005ee10 0x7ff7800612d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff79c064600 0x7ff79c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79c153dd0 0x7ff79c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 --2- 172.21.15.98:0/3218171535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff79c0c3230 0x7ff79c0a7cd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 >> 172.21.15.98:0/3218171535 conn(0x7ff79c0c7820 msgr2=0x7ff79c0c61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 shutdown_connections 2023-08-22T00:06:53.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.236+0000 7ff7a2ca7700 1 -- 172.21.15.98:0/3218171535 wait complete. 2023-08-22T00:06:53.253 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.392+0000 7f8d0190c700 1 Processor -- start 2023-08-22T00:06:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.392+0000 7f8d0190c700 1 -- start start 2023-08-22T00:06:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8cfc062600 0x7f8cfc063b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc1541c0 con 0x7f8cfc0ca150 2023-08-22T00:06:53.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc064000 con 0x7f8cfc062600 2023-08-22T00:06:53.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8d0190c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc062a90 con 0x7f8cfc157ab0 2023-08-22T00:06:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39948/0 (socket says 172.21.15.98:39948) 2023-08-22T00:06:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 -- 172.21.15.98:0/3240669615 learned_addr learned my addr 172.21.15.98:0/3240669615 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfa7fc700 1 --2- 172.21.15.98:0/3240669615 >> v2:172.21.15.118:3300/0 conn(0x7f8cfc062600 0x7f8cfc063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfaffd700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 -- 172.21.15.98:0/3240669615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 msgr2=0x7f8cfc157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 -- 172.21.15.98:0/3240669615 >> v2:172.21.15.118:3300/0 conn(0x7f8cfc062600 msgr2=0x7f8cfc063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 --2- 172.21.15.98:0/3240669615 >> v2:172.21.15.118:3300/0 conn(0x7f8cfc062600 0x7f8cfc063b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.393+0000 7f8cfb7fe700 1 -- 172.21.15.98:0/3240669615 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc062d70 con 0x7f8cfc0ca150 2023-08-22T00:06:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8cfb7fe700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f8cfc05f080 tx=0x7f8cf4009840).ready entity=mon.0 client_cookie=88fdfe8112a9ec5a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8cf9ffb700 1 -- 172.21.15.98:0/3240669615 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400e070 con 0x7f8cfc0ca150 2023-08-22T00:06:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8cf9ffb700 1 -- 172.21.15.98:0/3240669615 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400ba50 con 0x7f8cfc0ca150 2023-08-22T00:06:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8cf9ffb700 1 -- 172.21.15.98:0/3240669615 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400bdd0 con 0x7f8cfc0ca150 2023-08-22T00:06:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 -- 172.21.15.98:0/3240669615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 msgr2=0x7f8cfc0acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f8cfc05f080 tx=0x7f8cf4009840).stop 2023-08-22T00:06:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 -- 172.21.15.98:0/3240669615 shutdown_connections 2023-08-22T00:06:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 --2- 172.21.15.98:0/3240669615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc0acbf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 --2- 172.21.15.98:0/3240669615 >> v2:172.21.15.118:3300/0 conn(0x7f8cfc062600 0x7f8cfc063b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 -- 172.21.15.98:0/3240669615 >> 172.21.15.98:0/3240669615 conn(0x7f8cfc0cb600 msgr2=0x7f8cfc0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 -- 172.21.15.98:0/3240669615 shutdown_connections 2023-08-22T00:06:53.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.394+0000 7f8d0190c700 1 -- 172.21.15.98:0/3240669615 wait complete. 2023-08-22T00:06:53.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 Processor -- start 2023-08-22T00:06:53.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 -- start start 2023-08-22T00:06:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc0646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cfc064bb0 0x7f8cfc0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1683b0 con 0x7f8cfc0ca150 2023-08-22T00:06:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc064fd0 con 0x7f8cfc064bb0 2023-08-22T00:06:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8d0190c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1677a0 con 0x7f8cfc157ab0 2023-08-22T00:06:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39962/0 (socket says 172.21.15.98:39962) 2023-08-22T00:06:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.396+0000 7f8cfaffd700 1 -- 172.21.15.98:0/4276187072 learned_addr learned my addr 172.21.15.98:0/4276187072 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfa7fc700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc0646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfb7fe700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cfc064bb0 0x7f8cfc0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 -- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 msgr2=0x7f8cfc0646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc0646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 -- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cfc064bb0 msgr2=0x7f8cfc0c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cfc064bb0 0x7f8cfc0c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 -- 172.21.15.98:0/4276187072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009ae0 con 0x7f8cfc0ca150 2023-08-22T00:06:53.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8cfaffd700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f8cf000d860 tx=0x7f8cf0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0011590 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf00116f0 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc167a80 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0011a70 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.397+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc168040 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.398+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc083670 con 0x7f8cfc0ca150 2023-08-22T00:06:53.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.398+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8cf001c460 con 0x7f8cfc0ca150 2023-08-22T00:06:53.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.399+0000 7f8ce2ffd700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 0x7f8ce80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.399+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8cf0079e80 con 0x7f8cfc0ca150 2023-08-22T00:06:53.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.399+0000 7f8cfa7fc700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 0x7f8ce80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.399+0000 7f8cfa7fc700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 0x7f8ce80612d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f8cfc084120 tx=0x7f8cec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.403+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8cf004af80 con 0x7f8cfc0ca150 2023-08-22T00:06:53.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.562+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8cfc063050 con 0x7f8cfc0ca150 2023-08-22T00:06:53.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.563+0000 7f8ce2ffd700 1 -- 172.21.15.98:0/4276187072 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8cf0011e60 con 0x7f8cfc0ca150 2023-08-22T00:06:53.564 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:53.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 msgr2=0x7f8ce80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 0x7f8ce80612d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f8cfc084120 tx=0x7f8cec008040).stop 2023-08-22T00:06:53.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 msgr2=0x7f8cfc1509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f8cf000d860 tx=0x7f8cf0008040).stop 2023-08-22T00:06:53.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 shutdown_connections 2023-08-22T00:06:53.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cfc064bb0 0x7f8cfc0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cfc0ca150 0x7f8cfc1509f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8ce805ee10 0x7f8ce80612d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 --2- 172.21.15.98:0/4276187072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8cfc157ab0 0x7f8cfc0646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 >> 172.21.15.98:0/4276187072 conn(0x7f8cfc0cb600 msgr2=0x7f8cfc0aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 shutdown_connections 2023-08-22T00:06:53.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.565+0000 7f8d0190c700 1 -- 172.21.15.98:0/4276187072 wait complete. 2023-08-22T00:06:53.580 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:53.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.696+0000 7f40cc7ce700 1 Processor -- start 2023-08-22T00:06:53.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.697+0000 7f40cc7ce700 1 -- start start 2023-08-22T00:06:53.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cc7ce700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 0x7f40c4063210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cc7ce700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40c40bbe40 0x7f40c40bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cc7ce700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40bcb10 con 0x7f40c4062e30 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cc7ce700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40bcdf0 con 0x7f40c40bbe40 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cc7ce700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40bd0d0 con 0x7f40c414c2d0 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40c40bbe40 0x7f40c40bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40c40bbe40 0x7f40c40bc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39964/0 (socket says 172.21.15.98:39964) 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 -- 172.21.15.98:0/4030255856 learned_addr learned my addr 172.21.15.98:0/4030255856 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40c9d69700 1 --2- 172.21.15.98:0/4030255856 >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 0x7f40c4063210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 -- 172.21.15.98:0/4030255856 >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 msgr2=0x7f40c4063210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 --2- 172.21.15.98:0/4030255856 >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 0x7f40c4063210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 -- 172.21.15.98:0/4030255856 >> v1:172.21.15.118:6789/0 conn(0x7f40c4062e30 legacy=0x7f40c414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 -- 172.21.15.98:0/4030255856 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40bd3b0 con 0x7f40c40bbe40 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40c9d69700 1 --2- 172.21.15.98:0/4030255856 >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 0x7f40c4063210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:53.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40cad6b700 1 --2- 172.21.15.98:0/4030255856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40bc2b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f40c4069100 tx=0x7f40bc009840).ready entity=mon.0 client_cookie=f01bb6ee96a2b4de server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40c9568700 1 -- 172.21.15.98:0/4030255856 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00e070 con 0x7f40c40bbe40 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40c9568700 1 -- 172.21.15.98:0/4030255856 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00bae0 con 0x7f40c40bbe40 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.698+0000 7f40c9568700 1 -- 172.21.15.98:0/4030255856 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00be60 con 0x7f40c40bbe40 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 -- 172.21.15.98:0/4030255856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 msgr2=0x7f40c40bc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/4030255856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40bc2b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f40c4069100 tx=0x7f40bc009840).stop 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 -- 172.21.15.98:0/4030255856 shutdown_connections 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/4030255856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40bc2b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/4030255856 >> v2:172.21.15.118:3300/0 conn(0x7f40c414c2d0 0x7f40c4063210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 -- 172.21.15.98:0/4030255856 >> 172.21.15.98:0/4030255856 conn(0x7f40c40c3980 msgr2=0x7f40c40c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 -- 172.21.15.98:0/4030255856 shutdown_connections 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.699+0000 7f40cc7ce700 1 -- 172.21.15.98:0/4030255856 wait complete. 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.700+0000 7f40cc7ce700 1 Processor -- start 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.700+0000 7f40cc7ce700 1 -- start start 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 0x7f40c40a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 0x7f40c4167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c414a5b0 con 0x7f40c40bbe40 2023-08-22T00:06:53.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40a80d0 con 0x7f40c414c2d0 2023-08-22T00:06:53.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40a8f30 con 0x7f40c4062e30 2023-08-22T00:06:53.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39968/0 (socket says 172.21.15.98:39968) 2023-08-22T00:06:53.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 -- 172.21.15.98:0/2466143497 learned_addr learned my addr 172.21.15.98:0/2466143497 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:53.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40ca56a700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 0x7f40c40a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cad6b700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 0x7f40c4167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 -- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 msgr2=0x7f40c40a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 0x7f40c40a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 -- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 msgr2=0x7f40c4167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 0x7f40c4167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 -- 172.21.15.98:0/2466143497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009ae0 con 0x7f40c40bbe40 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40ca56a700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 0x7f40c40a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cad6b700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 0x7f40c4167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40c9d69700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f40c000d890 tx=0x7f40c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00125f0 con 0x7f40c40bbe40 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0012750 con 0x7f40c40bbe40 2023-08-22T00:06:53.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.701+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40a98b0 con 0x7f40c40bbe40 2023-08-22T00:06:53.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.702+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0012ad0 con 0x7f40c40bbe40 2023-08-22T00:06:53.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.702+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40a88e0 con 0x7f40c40bbe40 2023-08-22T00:06:53.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.702+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c4047480 con 0x7f40c40bbe40 2023-08-22T00:06:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.703+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f40c0013480 con 0x7f40c40bbe40 2023-08-22T00:06:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.703+0000 7f40ba7fc700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 0x7f40a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:53.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.703+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f40c0079eb0 con 0x7f40c40bbe40 2023-08-22T00:06:53.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.703+0000 7f40ca56a700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 0x7f40a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:53.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.704+0000 7f40ca56a700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 0x7f40a80612d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f40b4001730 tx=0x7f40b4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:53.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.707+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40c004afb0 con 0x7f40c40bbe40 2023-08-22T00:06:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.869+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40c40a9070 con 0x7f40c40bbe40 2023-08-22T00:06:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.870+0000 7f40ba7fc700 1 -- 172.21.15.98:0/2466143497 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7f40c004e5d0 con 0x7f40c40bbe40 2023-08-22T00:06:53.871 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:53.872 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 msgr2=0x7f40a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 0x7f40a80612d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f40b4001730 tx=0x7f40b4009040).stop 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 msgr2=0x7f40c40c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f40c000d890 tx=0x7f40c0008040).stop 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 shutdown_connections 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40a805ee10 0x7f40a80612d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40c4062e30 0x7f40c40a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40c414c2d0 0x7f40c4167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 --2- 172.21.15.98:0/2466143497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40c40bbe40 0x7f40c40c6060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 >> 172.21.15.98:0/2466143497 conn(0x7f40c40c3980 msgr2=0x7f40c414ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 shutdown_connections 2023-08-22T00:06:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:53.872+0000 7f40cc7ce700 1 -- 172.21.15.98:0/2466143497 wait complete. 2023-08-22T00:06:53.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:53.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:54.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.011+0000 7fbb1077f700 1 Processor -- start 2023-08-22T00:06:54.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.011+0000 7fbb1077f700 1 -- start start 2023-08-22T00:06:54.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb1077f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb08153e90 0x7fbb080aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb1077f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157e60 0x7fbb08062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb1077f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080c8d30 con 0x7fbb08157a80 2023-08-22T00:06:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb1077f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb081582b0 con 0x7fbb08153e90 2023-08-22T00:06:54.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb1077f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080c9010 con 0x7fbb08157e60 2023-08-22T00:06:54.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb08153e90 0x7fbb080aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0e51b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbb08157a80 0x7fbb08153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59336/0 (socket says 172.21.15.98:59336) 2023-08-22T00:06:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb08153e90 0x7fbb080aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39976/0 (socket says 172.21.15.98:39976) 2023-08-22T00:06:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0e51b700 1 -- 172.21.15.98:0/3877732126 learned_addr learned my addr 172.21.15.98:0/3877732126 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0ed1c700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157e60 0x7fbb08062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 -- 172.21.15.98:0/3877732126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157e60 msgr2=0x7fbb08062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157e60 0x7fbb08062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 -- 172.21.15.98:0/3877732126 >> v1:172.21.15.98:6789/0 conn(0x7fbb08157a80 legacy=0x7fbb08153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 -- 172.21.15.98:0/3877732126 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080c92f0 con 0x7fbb08153e90 2023-08-22T00:06:54.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0d519700 1 -- 172.21.15.98:0/3877732126 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176614370 0 0) 0x7fbb080c8d30 con 0x7fbb08157a80 2023-08-22T00:06:54.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0dd1a700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08153e90 0x7fbb080aa920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fbaf8009760 tx=0x7fbaf8009060).ready entity=mon.0 client_cookie=90c9b6a212c610e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0d519700 1 -- 172.21.15.98:0/3877732126 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800b580 con 0x7fbb08153e90 2023-08-22T00:06:54.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0d519700 1 -- 172.21.15.98:0/3877732126 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf800b6e0 con 0x7fbb08153e90 2023-08-22T00:06:54.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.012+0000 7fbb0d519700 1 -- 172.21.15.98:0/3877732126 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800ba60 con 0x7fbb08153e90 2023-08-22T00:06:54.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 -- 172.21.15.98:0/3877732126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08153e90 msgr2=0x7fbb080aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08153e90 0x7fbb080aa920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fbaf8009760 tx=0x7fbaf8009060).stop 2023-08-22T00:06:54.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 -- 172.21.15.98:0/3877732126 shutdown_connections 2023-08-22T00:06:54.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157e60 0x7fbb08062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 --2- 172.21.15.98:0/3877732126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08153e90 0x7fbb080aa920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 -- 172.21.15.98:0/3877732126 >> 172.21.15.98:0/3877732126 conn(0x7fbb080cb5f0 msgr2=0x7fbb080c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 -- 172.21.15.98:0/3877732126 shutdown_connections 2023-08-22T00:06:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.013+0000 7fbb1077f700 1 -- 172.21.15.98:0/3877732126 wait complete. 2023-08-22T00:06:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.014+0000 7fbb1077f700 1 Processor -- start 2023-08-22T00:06:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.014+0000 7fbb1077f700 1 -- start start 2023-08-22T00:06:54.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 0x7fbb080c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 0x7fbb08164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08164c20 con 0x7fbb08157e60 2023-08-22T00:06:54.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08142920 con 0x7fbb08153e90 2023-08-22T00:06:54.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb1077f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08167350 con 0x7fbb08157a80 2023-08-22T00:06:54.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39992/0 (socket says 172.21.15.98:39992) 2023-08-22T00:06:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 -- 172.21.15.98:0/2974259091 learned_addr learned my addr 172.21.15.98:0/2974259091 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0dd1a700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 0x7fbb08164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0e51b700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 0x7fbb080c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 -- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 msgr2=0x7fbb08164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 0x7fbb08164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 -- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 msgr2=0x7fbb080c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 0x7fbb080c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 -- 172.21.15.98:0/2974259091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80092a0 con 0x7fbb08157e60 2023-08-22T00:06:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0dd1a700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 0x7fbb08164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0e51b700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 0x7fbb080c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbb0ed1c700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbb00007f20 tx=0x7fbb00009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000eca0 con 0x7fbb08157e60 2023-08-22T00:06:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.015+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000ee00 con 0x7fbb08157e60 2023-08-22T00:06:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.016+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08154330 con 0x7fbb08157e60 2023-08-22T00:06:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.016+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00014610 con 0x7fbb08157e60 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.016+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb081675f0 con 0x7fbb08157e60 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb081677e0 con 0x7fbb08157e60 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbb00014980 con 0x7fbb08157e60 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbafe7fc700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 0x7fbaec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fbb0007a5e0 con 0x7fbb08157e60 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbb0e51b700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 0x7fbaec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.017+0000 7fbb0e51b700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 0x7fbaec0612d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbb04007fd0 tx=0x7fbb04009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.021+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb0004b740 con 0x7fbb08157e60 2023-08-22T00:06:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.182+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbb08083630 con 0x7fbb08157e60 2023-08-22T00:06:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.182+0000 7fbafe7fc700 1 -- 172.21.15.98:0/2974259091 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb0004ed60 con 0x7fbb08157e60 2023-08-22T00:06:54.183 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:54.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 msgr2=0x7fbaec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 0x7fbaec0612d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbb04007fd0 tx=0x7fbb04009040).stop 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 msgr2=0x7fbb08142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbb00007f20 tx=0x7fbb00009860).stop 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 shutdown_connections 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb08157e60 0x7fbb08142430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb08153e90 0x7fbb080c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbaec05ee10 0x7fbaec0612d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 --2- 172.21.15.98:0/2974259091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157a80 0x7fbb08164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 >> 172.21.15.98:0/2974259091 conn(0x7fbb080cb5f0 msgr2=0x7fbb0814e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 shutdown_connections 2023-08-22T00:06:54.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.184+0000 7fbb1077f700 1 -- 172.21.15.98:0/2974259091 wait complete. 2023-08-22T00:06:54.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.318+0000 7f0b1fdb5700 1 Processor -- start 2023-08-22T00:06:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.318+0000 7f0b1fdb5700 1 -- start start 2023-08-22T00:06:54.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1fdb5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 0x7f0b18068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1fdb5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1fdb5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180c47d0 con 0x7f0b18153ff0 2023-08-22T00:06:54.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1fdb5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180c3730 con 0x7f0b180bef90 2023-08-22T00:06:54.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1fdb5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180c3a10 con 0x7f0b18153c10 2023-08-22T00:06:54.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1e352700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1db51700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 0x7f0b18068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1e352700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:42768/0 (socket says 172.21.15.98:42768) 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1e352700 1 -- 172.21.15.98:0/3454828363 learned_addr learned my addr 172.21.15.98:0/3454828363 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.319+0000 7f0b1d350700 1 --1- 172.21.15.98:0/3454828363 >> v1:172.21.15.118:6789/0 conn(0x7f0b18153ff0 0x7f0b180be880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:47556/0 (socket says 172.21.15.98:47556) 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1db51700 1 -- 172.21.15.98:0/3454828363 >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 msgr2=0x7f0b18063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1db51700 1 --2- 172.21.15.98:0/3454828363 >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1db51700 1 -- 172.21.15.98:0/3454828363 >> v1:172.21.15.118:6789/0 conn(0x7f0b18153ff0 legacy=0x7f0b180be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1cb4f700 1 -- 172.21.15.98:0/3454828363 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542938684 0 0) 0x7f0b180c47d0 con 0x7f0b18153ff0 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1db51700 1 -- 172.21.15.98:0/3454828363 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180c3cf0 con 0x7f0b18153c10 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1e352700 1 --2- 172.21.15.98:0/3454828363 >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1db51700 1 --2- 172.21.15.98:0/3454828363 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 0x7f0b18068db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0b14009760 tx=0x7f0b14009060).ready entity=mon.2 client_cookie=18dddb4eb75b2cff server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1cb4f700 1 -- 172.21.15.98:0/3454828363 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140090d0 con 0x7f0b18153c10 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1cb4f700 1 -- 172.21.15.98:0/3454828363 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1400f510 con 0x7f0b18153c10 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1cb4f700 1 -- 172.21.15.98:0/3454828363 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400f890 con 0x7f0b18153c10 2023-08-22T00:06:54.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/3454828363 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 msgr2=0x7f0b18068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/3454828363 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 0x7f0b18068db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0b14009760 tx=0x7f0b14009060).stop 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/3454828363 shutdown_connections 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/3454828363 >> v2:172.21.15.118:3300/0 conn(0x7f0b180bef90 0x7f0b18063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/3454828363 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153c10 0x7f0b18068db0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.320+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/3454828363 >> 172.21.15.98:0/3454828363 conn(0x7f0b180c5e80 msgr2=0x7f0b180661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.321+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/3454828363 shutdown_connections 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.321+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/3454828363 wait complete. 2023-08-22T00:06:54.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 Processor -- start 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 -- start start 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b18153c10 0x7f0b180a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153ff0 0x7f0b180a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180a9ea0 con 0x7f0b180bef90 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180aa180 con 0x7f0b18153c10 2023-08-22T00:06:54.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.322+0000 7f0b1fdb5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180aa460 con 0x7f0b18153ff0 2023-08-22T00:06:54.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39996/0 (socket says 172.21.15.98:39996) 2023-08-22T00:06:54.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 -- 172.21.15.98:0/2782086752 learned_addr learned my addr 172.21.15.98:0/2782086752 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1d350700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b18153c10 0x7f0b180a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1e352700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153ff0 0x7f0b180a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 -- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153ff0 msgr2=0x7f0b180a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153ff0 0x7f0b180a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 -- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b18153c10 msgr2=0x7f0b180a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b18153c10 0x7f0b180a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 -- 172.21.15.98:0/2782086752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009ae0 con 0x7f0b180bef90 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1db51700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f0b14009e00 tx=0x7f0b14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400f890 con 0x7f0b180bef90 2023-08-22T00:06:54.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14009e30 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400fea0 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140092a0 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.323+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b180aaa20 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.324+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1806a2f0 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.325+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0b1401b620 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.325+0000 7f0b0dffb700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 0x7f0afc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.325+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f0b1407ba30 con 0x7f0b180bef90 2023-08-22T00:06:54.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.325+0000 7f0b1d350700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 0x7f0afc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.325+0000 7f0b1d350700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 0x7f0afc0612d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0b180a6e90 tx=0x7f0b08007d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.329+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b1404cb30 con 0x7f0b180bef90 2023-08-22T00:06:54.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.488+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b180c3fd0 con 0x7f0b180bef90 2023-08-22T00:06:54.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.489+0000 7f0b0dffb700 1 -- 172.21.15.98:0/2782086752 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b14028020 con 0x7f0b180bef90 2023-08-22T00:06:54.493 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:54.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.490+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 msgr2=0x7f0afc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.490+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 0x7f0afc0612d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0b180a6e90 tx=0x7f0b08007d10).stop 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.490+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 msgr2=0x7f0b18148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.490+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f0b14009e00 tx=0x7f0b14017000).stop 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 shutdown_connections 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0afc05ee10 0x7f0afc0612d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b18153ff0 0x7f0b180a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b180bef90 0x7f0b18148330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 --2- 172.21.15.98:0/2782086752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b18153c10 0x7f0b180a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 >> 172.21.15.98:0/2782086752 conn(0x7f0b180c5e80 msgr2=0x7f0b180bd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 shutdown_connections 2023-08-22T00:06:54.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.491+0000 7f0b1fdb5700 1 -- 172.21.15.98:0/2782086752 wait complete. 2023-08-22T00:06:54.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:54.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.620+0000 7fea1a27c700 1 Processor -- start 2023-08-22T00:06:54.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.620+0000 7fea1a27c700 1 -- start start 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea1a27c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea1a27c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea14063380 0x7fea140c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea1a27c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea14063f90 con 0x7fea140c2400 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea1a27c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140656f0 con 0x7fea14063380 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea1a27c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140637e0 con 0x7fea141505e0 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea137fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea14063380 0x7fea140c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:43670/0 (socket says 172.21.15.98:43670) 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 -- 172.21.15.98:0/3892729733 learned_addr learned my addr 172.21.15.98:0/3892729733 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 -- 172.21.15.98:0/3892729733 >> v2:172.21.15.118:3300/0 conn(0x7fea14063380 msgr2=0x7fea140c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 --2- 172.21.15.98:0/3892729733 >> v2:172.21.15.118:3300/0 conn(0x7fea14063380 0x7fea140c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 -- 172.21.15.98:0/3892729733 >> v1:172.21.15.118:6789/0 conn(0x7fea140c2400 legacy=0x7fea140bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 -- 172.21.15.98:0/3892729733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea141509c0 con 0x7fea141505e0 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.621+0000 7fea13fff700 1 --2- 172.21.15.98:0/3892729733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fea04006fd0 tx=0x7fea040090f0).ready entity=mon.2 client_cookie=a017e9d40393c4b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea12ffd700 1 -- 172.21.15.98:0/3892729733 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400b580 con 0x7fea141505e0 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea12ffd700 1 -- 172.21.15.98:0/3892729733 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400b6e0 con 0x7fea141505e0 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea12ffd700 1 -- 172.21.15.98:0/3892729733 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400ba60 con 0x7fea141505e0 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 -- 172.21.15.98:0/3892729733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 msgr2=0x7fea14062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 --2- 172.21.15.98:0/3892729733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fea04006fd0 tx=0x7fea040090f0).stop 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 -- 172.21.15.98:0/3892729733 shutdown_connections 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 --2- 172.21.15.98:0/3892729733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea141505e0 0x7fea14062e90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 --2- 172.21.15.98:0/3892729733 >> v2:172.21.15.118:3300/0 conn(0x7fea14063380 0x7fea140c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 -- 172.21.15.98:0/3892729733 >> 172.21.15.98:0/3892729733 conn(0x7fea140c31d0 msgr2=0x7fea140c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 -- 172.21.15.98:0/3892729733 shutdown_connections 2023-08-22T00:06:54.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.622+0000 7fea1a27c700 1 -- 172.21.15.98:0/3892729733 wait complete. 2023-08-22T00:06:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.623+0000 7fea1a27c700 1 Processor -- start 2023-08-22T00:06:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 -- start start 2023-08-22T00:06:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14063380 0x7fea14147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea140c2400 0x7fea140aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140a9a00 con 0x7fea141505e0 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140be2b0 con 0x7fea140c2400 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.624+0000 7fea1a27c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140be500 con 0x7fea14063380 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40008/0 (socket says 172.21.15.98:40008) 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 -- 172.21.15.98:0/1246578189 learned_addr learned my addr 172.21.15.98:0/1246578189 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea13fff700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14063380 0x7fea14147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea137fe700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea140c2400 0x7fea140aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 -- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14063380 msgr2=0x7fea14147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14063380 0x7fea14147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 -- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea140c2400 msgr2=0x7fea140aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea140c2400 0x7fea140aa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 -- 172.21.15.98:0/1246578189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009370 con 0x7fea141505e0 2023-08-22T00:06:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea18819700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fea0c00c7c0 tx=0x7fea0c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00e4a0 con 0x7fea141505e0 2023-08-22T00:06:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00e600 con 0x7fea141505e0 2023-08-22T00:06:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea140be7e0 con 0x7fea141505e0 2023-08-22T00:06:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00e980 con 0x7fea141505e0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.625+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea140beda0 con 0x7fea141505e0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.626+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140befc0 con 0x7fea141505e0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.626+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fea0c012400 con 0x7fea141505e0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.627+0000 7fe9fbfff700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 0x7fea000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.627+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fea0c079750 con 0x7fea141505e0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.627+0000 7fea13fff700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 0x7fea000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.627+0000 7fea13fff700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 0x7fea000612d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fea04009130 tx=0x7fea04017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.631+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea0c0488f0 con 0x7fea141505e0 2023-08-22T00:06:54.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.789+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea14063d70 con 0x7fea141505e0 2023-08-22T00:06:54.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.789+0000 7fe9fbfff700 1 -- 172.21.15.98:0/1246578189 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea0c017020 con 0x7fea141505e0 2023-08-22T00:06:54.792 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:54.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 msgr2=0x7fea000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 0x7fea000612d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fea04009130 tx=0x7fea04017000).stop 2023-08-22T00:06:54.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 msgr2=0x7fea140aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fea0c00c7c0 tx=0x7fea0c001510).stop 2023-08-22T00:06:54.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 shutdown_connections 2023-08-22T00:06:54.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fea0005ee10 0x7fea000612d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14063380 0x7fea14147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea141505e0 0x7fea140aaae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 --2- 172.21.15.98:0/1246578189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea140c2400 0x7fea140aa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 >> 172.21.15.98:0/1246578189 conn(0x7fea140c31d0 msgr2=0x7fea140c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 shutdown_connections 2023-08-22T00:06:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.791+0000 7fea1a27c700 1 -- 172.21.15.98:0/1246578189 wait complete. 2023-08-22T00:06:54.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.922+0000 7f2752474700 1 Processor -- start 2023-08-22T00:06:54.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.922+0000 7f2752474700 1 -- start start 2023-08-22T00:06:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f274c14e720 0x7f274c155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 0x7f274c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c067f30 con 0x7f274c14e720 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0654a0 con 0x7f274c067ae0 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f2752474700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c064920 con 0x7f274c0641b0 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f274bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f274c14e720 0x7f274c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f274bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f274c14e720 0x7f274c155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40012/0 (socket says 172.21.15.98:40012) 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f274bfff700 1 -- 172.21.15.98:0/2397724004 learned_addr learned my addr 172.21.15.98:0/2397724004 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.923+0000 7f274b7fe700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2750a11700 1 --2- 172.21.15.98:0/2397724004 >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 0x7f274c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 -- 172.21.15.98:0/2397724004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 msgr2=0x7f274c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c0675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 -- 172.21.15.98:0/2397724004 >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 msgr2=0x7f274c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 --2- 172.21.15.98:0/2397724004 >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 0x7f274c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 -- 172.21.15.98:0/2397724004 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c064c00 con 0x7f274c14e720 2023-08-22T00:06:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274b7fe700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c0675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2750a11700 1 --2- 172.21.15.98:0/2397724004 >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 0x7f274c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274bfff700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c155290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f274c063c50 tx=0x7f273c0090f0).ready entity=mon.0 client_cookie=3645813741377b83 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274affd700 1 -- 172.21.15.98:0/2397724004 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00b600 con 0x7f274c14e720 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274affd700 1 -- 172.21.15.98:0/2397724004 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c00b760 con 0x7f274c14e720 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f274affd700 1 -- 172.21.15.98:0/2397724004 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00bae0 con 0x7f274c14e720 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 -- 172.21.15.98:0/2397724004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 msgr2=0x7f274c155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c155290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f274c063c50 tx=0x7f273c0090f0).stop 2023-08-22T00:06:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 -- 172.21.15.98:0/2397724004 shutdown_connections 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 --2- 172.21.15.98:0/2397724004 >> v2:172.21.15.118:3300/0 conn(0x7f274c067ae0 0x7f274c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c155290 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 --2- 172.21.15.98:0/2397724004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c0675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 -- 172.21.15.98:0/2397724004 >> 172.21.15.98:0/2397724004 conn(0x7f274c0c8950 msgr2=0x7f274c0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 -- 172.21.15.98:0/2397724004 shutdown_connections 2023-08-22T00:06:54.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.924+0000 7f2752474700 1 -- 172.21.15.98:0/2397724004 wait complete. 2023-08-22T00:06:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 Processor -- start 2023-08-22T00:06:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 -- start start 2023-08-22T00:06:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 0x7f274c0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0a8130 con 0x7f274c14e720 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0ae160 con 0x7f274c067ae0 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.926+0000 7f2752474700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0ae440 con 0x7f274c0641b0 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40022/0 (socket says 172.21.15.98:40022) 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 -- 172.21.15.98:0/666512726 learned_addr learned my addr 172.21.15.98:0/666512726 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f274b7fe700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 0x7f274c0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f274bfff700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 -- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 msgr2=0x7f274c13e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c13e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 -- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 msgr2=0x7f274c0ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:54.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 0x7f274c0ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 -- 172.21.15.98:0/666512726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c009370 con 0x7f274c14e720 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f274b7fe700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 0x7f274c0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f274bfff700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c13e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2750a11700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f2744007f30 tx=0x7f2744009930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274400dce0 con 0x7f274c14e720 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274400f040 con 0x7f274c14e720 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c0a83d0 con 0x7f274c14e720 2023-08-22T00:06:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744013600 con 0x7f274c14e720 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.927+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c13ea20 con 0x7f274c14e720 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.928+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c0a85c0 con 0x7f274c14e720 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.928+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f27440139b0 con 0x7f274c14e720 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.929+0000 7f2733fff700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 0x7f27380612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.929+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f274407a710 con 0x7f274c14e720 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.929+0000 7f274bfff700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 0x7f27380612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:54.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.929+0000 7f274bfff700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 0x7f27380612d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f273c009130 tx=0x7f273c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:54.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:54.933+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f274404b810 con 0x7f274c14e720 2023-08-22T00:06:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.093+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f274c069d50 con 0x7f274c14e720 2023-08-22T00:06:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.093+0000 7f2733fff700 1 -- 172.21.15.98:0/666512726 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f274404ee30 con 0x7f274c14e720 2023-08-22T00:06:55.097 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:55.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 msgr2=0x7f27380612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 0x7f27380612d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f273c009130 tx=0x7f273c017000).stop 2023-08-22T00:06:55.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 msgr2=0x7f274c0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f2744007f30 tx=0x7f2744009930).stop 2023-08-22T00:06:55.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 shutdown_connections 2023-08-22T00:06:55.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f273805ee10 0x7f27380612d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f274c0641b0 0x7f274c13e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274c14e720 0x7f274c0aa100 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 --2- 172.21.15.98:0/666512726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f274c067ae0 0x7f274c0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 >> 172.21.15.98:0/666512726 conn(0x7f274c0c8950 msgr2=0x7f274c0c3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 shutdown_connections 2023-08-22T00:06:55.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.095+0000 7f2752474700 1 -- 172.21.15.98:0/666512726 wait complete. 2023-08-22T00:06:55.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.233+0000 7f15f7074700 1 Processor -- start 2023-08-22T00:06:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.233+0000 7f15f7074700 1 -- start start 2023-08-22T00:06:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f7074700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15f014b250 0x7f15f00c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f7074700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f00c39f0 0x7f15f0154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f7074700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f0151e80 con 0x7f15f014ae70 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f7074700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f0066b90 con 0x7f15f014b250 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f7074700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0065560 con 0x7f15f00c39f0 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15f014b250 0x7f15f00c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15f014b250 0x7f15f00c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40036/0 (socket says 172.21.15.98:40036) 2023-08-22T00:06:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 -- 172.21.15.98:0/3215608573 learned_addr learned my addr 172.21.15.98:0/3215608573 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15f5611700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f00c39f0 0x7f15f0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 -- 172.21.15.98:0/3215608573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f00c39f0 msgr2=0x7f15f0154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f00c39f0 0x7f15f0154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 -- 172.21.15.98:0/3215608573 >> v1:172.21.15.118:6789/0 conn(0x7f15f014ae70 legacy=0x7f15f00c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.234+0000 7f15effff700 1 -- 172.21.15.98:0/3215608573 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00c7590 con 0x7f15f014b250 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15effff700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c3500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f15dc006fd0 tx=0x7f15dc00b3b0).ready entity=mon.0 client_cookie=214f2f6826269187 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15ef7fe700 1 -- 172.21.15.98:0/3215608573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00da70 con 0x7f15f014b250 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15ef7fe700 1 -- 172.21.15.98:0/3215608573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc00dbd0 con 0x7f15f014b250 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15ef7fe700 1 -- 172.21.15.98:0/3215608573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc010470 con 0x7f15f014b250 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 -- 172.21.15.98:0/3215608573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 msgr2=0x7f15f00c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c3500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f15dc006fd0 tx=0x7f15dc00b3b0).stop 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 -- 172.21.15.98:0/3215608573 shutdown_connections 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f00c39f0 0x7f15f0154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 --2- 172.21.15.98:0/3215608573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c3500 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 -- 172.21.15.98:0/3215608573 >> 172.21.15.98:0/3215608573 conn(0x7f15f00c7800 msgr2=0x7f15f00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 -- 172.21.15.98:0/3215608573 shutdown_connections 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.235+0000 7f15f7074700 1 -- 172.21.15.98:0/3215608573 wait complete. 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.236+0000 7f15f7074700 1 Processor -- start 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 -- start start 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f00c39f0 0x7f15f00a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f014ae70 0x7f15f00a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a7cb0 con 0x7f15f014b250 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a7380 con 0x7f15f00c39f0 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f7074700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a7660 con 0x7f15f014ae70 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.237+0000 7f15f5611700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40052/0 (socket says 172.21.15.98:40052) 2023-08-22T00:06:55.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 -- 172.21.15.98:0/3838653137 learned_addr learned my addr 172.21.15.98:0/3838653137 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15effff700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f014ae70 0x7f15f00a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f4e10700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f00c39f0 0x7f15f00a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 -- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f014ae70 msgr2=0x7f15f00a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f014ae70 0x7f15f00a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 -- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f00c39f0 msgr2=0x7f15f00a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f00c39f0 0x7f15f00a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 -- 172.21.15.98:0/3838653137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc00b610 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f5611700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f15e8009df0 tx=0x7f15e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800caa0 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800f040 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800ce10 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00a7940 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.238+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00c1800 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.239+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00a7e60 con 0x7f15f014b250 2023-08-22T00:06:55.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.239+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f15e8013610 con 0x7f15f014b250 2023-08-22T00:06:55.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.240+0000 7f15ecff9700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 0x7f15d40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.240+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f15e807a820 con 0x7f15f014b250 2023-08-22T00:06:55.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.240+0000 7f15f4e10700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 0x7f15d40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.240+0000 7f15f4e10700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 0x7f15d40612d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f15e4003900 tx=0x7f15e4007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.244+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15f00a7e60 con 0x7f15f014b250 2023-08-22T00:06:55.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.404+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15f00a7df0 con 0x7f15f014b250 2023-08-22T00:06:55.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.404+0000 7f15ecff9700 1 -- 172.21.15.98:0/3838653137 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15e804b980 con 0x7f15f014b250 2023-08-22T00:06:55.406 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:55.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 msgr2=0x7f15d40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 0x7f15d40612d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f15e4003900 tx=0x7f15e4007d40).stop 2023-08-22T00:06:55.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 msgr2=0x7f15f00c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f15e8009df0 tx=0x7f15e800b040).stop 2023-08-22T00:06:55.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 shutdown_connections 2023-08-22T00:06:55.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f014b250 0x7f15f00c0eb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f00c39f0 0x7f15f00a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15d405ee10 0x7f15d40612d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 --2- 172.21.15.98:0/3838653137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f014ae70 0x7f15f00a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.406+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 >> 172.21.15.98:0/3838653137 conn(0x7f15f00c7800 msgr2=0x7f15f00c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.407+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 shutdown_connections 2023-08-22T00:06:55.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.407+0000 7f15f7074700 1 -- 172.21.15.98:0/3838653137 wait complete. 2023-08-22T00:06:55.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:55.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.535+0000 7fb47ce80700 1 Processor -- start 2023-08-22T00:06:55.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.535+0000 7fb47ce80700 1 -- start start 2023-08-22T00:06:55.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.536+0000 7fb47ce80700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb478153e20 0x7fb478154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.536+0000 7fb47ce80700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb478062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.536+0000 7fb47ce80700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780c4cf0 con 0x7fb4780c5d00 2023-08-22T00:06:55.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.536+0000 7fb47ce80700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780c5870 con 0x7fb478153e20 2023-08-22T00:06:55.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.536+0000 7fb47ce80700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb478154a30 con 0x7fb4780c6180 2023-08-22T00:06:55.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb475d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb4780c5d00 0x7fb4780bd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59342/0 (socket says 172.21.15.98:59342) 2023-08-22T00:06:55.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb475d9b700 1 -- 172.21.15.98:0/1544424383 learned_addr learned my addr 172.21.15.98:0/1544424383 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:55.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb476d9d700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb478062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47659c700 1 --2- 172.21.15.98:0/1544424383 >> v2:172.21.15.118:3300/0 conn(0x7fb478153e20 0x7fb478154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867875348 0 0) 0x7fb4780c4cf0 con 0x7fb4780c5d00 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4640033f0 con 0x7fb4780c5d00 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029198211 0 0) 0x7fb4640033f0 con 0x7fb4780c5d00 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 msgr2=0x7fb478062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb478062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 >> v2:172.21.15.118:3300/0 conn(0x7fb478153e20 msgr2=0x7fb478154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 --2- 172.21.15.98:0/1544424383 >> v2:172.21.15.118:3300/0 conn(0x7fb478153e20 0x7fb478154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780c4f40 con 0x7fb4780c5d00 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb460001470 con 0x7fb4780c5d00 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 >> v1:172.21.15.98:6789/0 conn(0x7fb4780c5d00 legacy=0x7fb4780bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4640038e0 0x7fb464003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb464004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb464005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c5870 con 0x7fb464004b80 2023-08-22T00:06:55.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb478154a30 con 0x7fb4640038e0 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46400b8e0 con 0x7fb4780c6180 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb476d9d700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb464005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb47659c700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4640038e0 0x7fb464003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.537+0000 7fb475d9b700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb464004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 -- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 msgr2=0x7fb464004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780c6180 0x7fb464004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 -- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4640038e0 msgr2=0x7fb464003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4640038e0 0x7fb464003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 -- 172.21.15.98:0/1544424383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640033f0 con 0x7fb464004b80 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb464005000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb4700103e0 tx=0x7fb47000b040).ready entity=mon.0 client_cookie=6d8882c20460caad server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470009bb0 con 0x7fb464004b80 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470010c30 con 0x7fb464004b80 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47559a700 1 -- 172.21.15.98:0/1544424383 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470016480 con 0x7fb464004b80 2023-08-22T00:06:55.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 -- 172.21.15.98:0/1544424383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 msgr2=0x7fb464005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 --2- 172.21.15.98:0/1544424383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb464005000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb4700103e0 tx=0x7fb47000b040).stop 2023-08-22T00:06:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb476d9d700 1 -- 172.21.15.98:0/1544424383 reap_dead start 2023-08-22T00:06:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 -- 172.21.15.98:0/1544424383 shutdown_connections 2023-08-22T00:06:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 -- 172.21.15.98:0/1544424383 >> 172.21.15.98:0/1544424383 conn(0x7fb4780c3980 msgr2=0x7fb4780c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 -- 172.21.15.98:0/1544424383 shutdown_connections 2023-08-22T00:06:55.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.538+0000 7fb47ce80700 1 -- 172.21.15.98:0/1544424383 wait complete. 2023-08-22T00:06:55.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 Processor -- start 2023-08-22T00:06:55.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 -- start start 2023-08-22T00:06:55.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4780c02b0 0x7fb478162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 0x7fb4780acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c0f70 con 0x7fb464004b80 2023-08-22T00:06:55.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780ac2b0 con 0x7fb4780c02b0 2023-08-22T00:06:55.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47ce80700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c0800 con 0x7fb4780ac740 2023-08-22T00:06:55.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40076/0 (socket says 172.21.15.98:40076) 2023-08-22T00:06:55.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.540+0000 7fb47659c700 1 -- 172.21.15.98:0/88513302 learned_addr learned my addr 172.21.15.98:0/88513302 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:55.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb476d9d700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 0x7fb4780acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb475d9b700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4780c02b0 0x7fb478162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 -- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 msgr2=0x7fb4780acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 0x7fb4780acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 -- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4780c02b0 msgr2=0x7fb478162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4780c02b0 0x7fb478162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 -- 172.21.15.98:0/88513302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780abc60 con 0x7fb464004b80 2023-08-22T00:06:55.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb476d9d700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 0x7fb4780acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47659c700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fb4680119c0 tx=0x7fb468009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468011e50 con 0x7fb464004b80 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800f940 con 0x7fb464004b80 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800fcc0 con 0x7fb464004b80 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4780abf40 con 0x7fb464004b80 2023-08-22T00:06:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.541+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4780ab910 con 0x7fb464004b80 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.542+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4780ac590 con 0x7fb464004b80 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.542+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb468014650 con 0x7fb464004b80 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.543+0000 7fb46e7fc700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 0x7fb4580612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.543+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb46807abb0 con 0x7fb464004b80 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.543+0000 7fb475d9b700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 0x7fb4580612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.543+0000 7fb475d9b700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 0x7fb4580612d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb4600015a0 tx=0x7fb4780c59b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.547+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb46804bd10 con 0x7fb464004b80 2023-08-22T00:06:55.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.708+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb478047480 con 0x7fb464004b80 2023-08-22T00:06:55.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.709+0000 7fb46e7fc700 1 -- 172.21.15.98:0/88513302 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fb46804f330 con 0x7fb464004b80 2023-08-22T00:06:55.713 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:55.713 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:13.038923+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 msgr2=0x7fb4580612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 0x7fb4580612d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb4600015a0 tx=0x7fb4780c59b0).stop 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 msgr2=0x7fb4780bf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fb4680119c0 tx=0x7fb468009060).stop 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 shutdown_connections 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb45805ee10 0x7fb4580612d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4780ac740 0x7fb4780acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb464004b80 0x7fb4780bf610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 --2- 172.21.15.98:0/88513302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4780c02b0 0x7fb478162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 >> 172.21.15.98:0/88513302 conn(0x7fb4780c3980 msgr2=0x7fb478069650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 shutdown_connections 2023-08-22T00:06:55.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.711+0000 7fb47ce80700 1 -- 172.21.15.98:0/88513302 wait complete. 2023-08-22T00:06:55.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:55.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.858+0000 7f781579c700 1 Processor -- start 2023-08-22T00:06:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.858+0000 7f781579c700 1 -- start start 2023-08-22T00:06:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f781579c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78100c3220 0x7f7810068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f781579c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100c4350 con 0x7f7810153df0 2023-08-22T00:06:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f781579c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100c37a0 con 0x7f78101541d0 2023-08-22T00:06:55.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f781579c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78101545d0 con 0x7f78100c3220 2023-08-22T00:06:55.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7810153df0 0x7f7810155110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59354/0 (socket says 172.21.15.98:59354) 2023-08-22T00:06:55.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780effd700 1 -- 172.21.15.98:0/3588108644 learned_addr learned my addr 172.21.15.98:0/3588108644 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:55.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3588108644 >> v2:172.21.15.118:3300/0 conn(0x7f78100c3220 0x7f7810068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485529704 0 0) 0x7f78100c4350 con 0x7f7810153df0 2023-08-22T00:06:55.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f80033f0 con 0x7f7810153df0 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2595764888 0 0) 0x7f77f80033f0 con 0x7f7810153df0 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 >> v2:172.21.15.118:3300/0 conn(0x7f78100c3220 msgr2=0x7f7810068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 --2- 172.21.15.98:0/3588108644 >> v2:172.21.15.118:3300/0 conn(0x7f78100c3220 0x7f7810068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 >> v1:172.21.15.118:6789/0 conn(0x7f78101541d0 legacy=0x7f78100be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100c3a40 con 0x7f7810153df0 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7800001470 con 0x7f7810153df0 2023-08-22T00:06:55.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3588108644 >> v2:172.21.15.118:3300/0 conn(0x7f78100c3220 0x7f7810068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 >> v1:172.21.15.98:6789/0 conn(0x7f7810153df0 legacy=0x7f7810155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 0x7f77f8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f8004690 0x7f77f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8005000 0x7f77f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101545d0 con 0x7f77f80038e0 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800bf60 con 0x7f77f8005000 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800c0f0 con 0x7f77f8004690 2023-08-22T00:06:55.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780effd700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 0x7f77f8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.859+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f8004690 0x7f77f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780f7fe700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8005000 0x7f77f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 -- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f8004690 msgr2=0x7f77f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f8004690 0x7f77f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 -- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8005000 msgr2=0x7f77f800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8005000 0x7f77f800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 -- 172.21.15.98:0/3588108644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80033f0 con 0x7f77f80038e0 2023-08-22T00:06:55.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780f7fe700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8005000 0x7f77f800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f8004690 0x7f77f8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780f7fe700 1 -- 172.21.15.98:0/3588108644 reap_dead start 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780effd700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 0x7f77f8003d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f780000c190 tx=0x7f7800001e50).ready entity=mon.0 client_cookie=f8cabef4aa566328 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800007a20 con 0x7f77f80038e0 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000cac0 con 0x7f77f80038e0 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f780dffb700 1 -- 172.21.15.98:0/3588108644 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000ce40 con 0x7f77f80038e0 2023-08-22T00:06:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 -- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 msgr2=0x7f77f8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 0x7f77f8003d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f780000c190 tx=0x7f7800001e50).stop 2023-08-22T00:06:55.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 -- 172.21.15.98:0/3588108644 shutdown_connections 2023-08-22T00:06:55.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 --2- 172.21.15.98:0/3588108644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f80038e0 0x7f77f8003d00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 -- 172.21.15.98:0/3588108644 >> 172.21.15.98:0/3588108644 conn(0x7f78100c5ee0 msgr2=0x7f78100661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 -- 172.21.15.98:0/3588108644 shutdown_connections 2023-08-22T00:06:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.860+0000 7f781579c700 1 -- 172.21.15.98:0/3588108644 wait complete. 2023-08-22T00:06:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.862+0000 7f781579c700 1 Processor -- start 2023-08-22T00:06:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.862+0000 7f781579c700 1 -- start start 2023-08-22T00:06:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.862+0000 7f781579c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f80038e0 0x7f78101523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.862+0000 7f781579c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 0x7f7810164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.862+0000 7f781579c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f781579c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101653d0 con 0x7f78100c1ba0 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f781579c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c00c0 con 0x7f78100bfa10 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f781579c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c0bf0 con 0x7f77f80038e0 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40096/0 (socket says 172.21.15.98:40096) 2023-08-22T00:06:55.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 -- 172.21.15.98:0/3787190319 learned_addr learned my addr 172.21.15.98:0/3787190319 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780effd700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f80038e0 0x7f78101523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 0x7f7810164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 -- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f80038e0 msgr2=0x7f78101523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f80038e0 0x7f78101523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 -- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 msgr2=0x7f7810164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 0x7f7810164df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 -- 172.21.15.98:0/3787190319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100c2510 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780e7fc700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 0x7f7810164df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f780f7fe700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f780800e5c0 tx=0x7f7808009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808002490 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78080025f0 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100c02c0 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808002970 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.863+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100c0880 con 0x7f78100c1ba0 2023-08-22T00:06:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.864+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78100c0da0 con 0x7f78100c1ba0 2023-08-22T00:06:55.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.864+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7808003070 con 0x7f78100c1ba0 2023-08-22T00:06:55.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.865+0000 7f77f6ffd700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 0x7f77fc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:55.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.865+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7808079930 con 0x7f78100c1ba0 2023-08-22T00:06:55.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.865+0000 7f780effd700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 0x7f77fc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:55.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.865+0000 7f780effd700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 0x7f77fc0612d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7800001ed0 tx=0x7f7800015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:55.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:55.869+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78080498f0 con 0x7f78100c1ba0 2023-08-22T00:06:56.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.028+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7810046c20 con 0x7f78100c1ba0 2023-08-22T00:06:56.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.028+0000 7f77f6ffd700 1 -- 172.21.15.98:0/3787190319 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78100c0da0 con 0x7f78100c1ba0 2023-08-22T00:06:56.030 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:06:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 msgr2=0x7f77fc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 0x7f77fc0612d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7800001ed0 tx=0x7f7800015000).stop 2023-08-22T00:06:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 msgr2=0x7f78100c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f780800e5c0 tx=0x7f7808009040).stop 2023-08-22T00:06:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 shutdown_connections 2023-08-22T00:06:56.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77fc05ee10 0x7f77fc0612d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77f80038e0 0x7f78101523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78100c1ba0 0x7f78100c2020 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 --2- 172.21.15.98:0/3787190319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78100bfa10 0x7f7810164df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 >> 172.21.15.98:0/3787190319 conn(0x7f78100c5ee0 msgr2=0x7f78100be8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 shutdown_connections 2023-08-22T00:06:56.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.030+0000 7f781579c700 1 -- 172.21.15.98:0/3787190319 wait complete. 2023-08-22T00:06:56.044 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:06:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.165+0000 7f3847615700 1 Processor -- start 2023-08-22T00:06:56.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.165+0000 7f3847615700 1 -- start start 2023-08-22T00:06:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3847615700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3847615700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3840065a40 0x7f3840065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3847615700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3840064490 con 0x7f38400c15c0 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3847615700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3840151110 con 0x7f3840065a40 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3847615700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840151390 con 0x7f384014b130 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3845bb2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3840065a40 0x7f3840065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f38453b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f38453b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:43770/0 (socket says 172.21.15.98:43770) 2023-08-22T00:06:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3845bb2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3840065a40 0x7f3840065ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:42902/0 (socket says 172.21.15.98:42902) 2023-08-22T00:06:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f38453b1700 1 -- 172.21.15.98:0/4191987950 learned_addr learned my addr 172.21.15.98:0/4191987950 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3844bb0700 1 --1- 172.21.15.98:0/4191987950 >> v1:172.21.15.118:6789/0 conn(0x7f38400c15c0 0x7f3840151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:47588/0 (socket says 172.21.15.98:47588) 2023-08-22T00:06:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3845bb2700 1 -- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 msgr2=0x7f3840063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:56.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.166+0000 7f3845bb2700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3845bb2700 1 -- 172.21.15.98:0/4191987950 >> v1:172.21.15.118:6789/0 conn(0x7f38400c15c0 legacy=0x7f3840151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3837fff700 1 -- 172.21.15.98:0/4191987950 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296575251 0 0) 0x7f3830001110 con 0x7f38400c15c0 2023-08-22T00:06:56.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3845bb2700 1 -- 172.21.15.98:0/4191987950 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400c6610 con 0x7f3840065a40 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f38453b1700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3845bb2700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3840065a40 0x7f3840065ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3838009e60 tx=0x7f3838009780).ready entity=mon.1 client_cookie=c668cdd4fba2da94 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3837fff700 1 -- 172.21.15.98:0/4191987950 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800e070 con 0x7f3840065a40 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3837fff700 1 -- 172.21.15.98:0/4191987950 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800bb60 con 0x7f3840065a40 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3837fff700 1 -- 172.21.15.98:0/4191987950 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838012410 con 0x7f3840065a40 2023-08-22T00:06:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 -- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3840065a40 msgr2=0x7f3840065ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3840065a40 0x7f3840065ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3838009e60 tx=0x7f3838009780).stop 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 -- 172.21.15.98:0/4191987950 shutdown_connections 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3840065a40 0x7f3840065ef0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 --2- 172.21.15.98:0/4191987950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f384014b130 0x7f3840063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 -- 172.21.15.98:0/4191987950 >> 172.21.15.98:0/4191987950 conn(0x7f38400c3a60 msgr2=0x7f38400c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 -- 172.21.15.98:0/4191987950 shutdown_connections 2023-08-22T00:06:56.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.167+0000 7f3847615700 1 -- 172.21.15.98:0/4191987950 wait complete. 2023-08-22T00:06:56.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.169+0000 7f3847615700 1 Processor -- start 2023-08-22T00:06:56.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.169+0000 7f3847615700 1 -- start start 2023-08-22T00:06:56.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.169+0000 7f3847615700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38400c15c0 0x7f384014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f384014b130 0x7f3840150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840150710 con 0x7f3840065a40 2023-08-22T00:06:56.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384014cc40 con 0x7f384014b130 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840163140 con 0x7f38400c15c0 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40104/0 (socket says 172.21.15.98:40104) 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 -- 172.21.15.98:0/3558878402 learned_addr learned my addr 172.21.15.98:0/3558878402 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3844bb0700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38400c15c0 0x7f384014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3845bb2700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f384014b130 0x7f3840150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 -- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38400c15c0 msgr2=0x7f384014fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38400c15c0 0x7f384014fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 -- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f384014b130 msgr2=0x7f3840150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f384014b130 0x7f3840150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 -- 172.21.15.98:0/3558878402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c009370 con 0x7f3840065a40 2023-08-22T00:06:56.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38453b1700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f383c006d00 tx=0x7f383c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c012600 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c012760 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c012ae0 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3838009a20 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.170+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3840163420 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.171+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3840163700 con 0x7f3840065a40 2023-08-22T00:06:56.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.172+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f383c01b400 con 0x7f3840065a40 2023-08-22T00:06:56.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.172+0000 7f38357fa700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 0x7f3824061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.172+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f383c07a580 con 0x7f3840065a40 2023-08-22T00:06:56.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.172+0000 7f3844bb0700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 0x7f3824061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.172+0000 7f3844bb0700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 0x7f3824061300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3830007fd0 tx=0x7f3830007d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.176+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f383c04b680 con 0x7f3840065a40 2023-08-22T00:06:56.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.347+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3840160a50 con 0x7f3840065a40 2023-08-22T00:06:56.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.348+0000 7f38357fa700 1 -- 172.21.15.98:0/3558878402 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3840160a50 con 0x7f3840065a40 2023-08-22T00:06:56.353 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:06:56.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 msgr2=0x7f3824061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 0x7f3824061300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3830007fd0 tx=0x7f3830007d70).stop 2023-08-22T00:06:56.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 msgr2=0x7f384015fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f383c006d00 tx=0x7f383c0090f0).stop 2023-08-22T00:06:56.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 shutdown_connections 2023-08-22T00:06:56.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f384014b130 0x7f3840150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3840065a40 0x7f384015fb70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f382405ee40 0x7f3824061300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 --2- 172.21.15.98:0/3558878402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38400c15c0 0x7f384014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 >> 172.21.15.98:0/3558878402 conn(0x7f38400c3a60 msgr2=0x7f3840062fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 shutdown_connections 2023-08-22T00:06:56.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.350+0000 7f3847615700 1 -- 172.21.15.98:0/3558878402 wait complete. 2023-08-22T00:06:56.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:06:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.487+0000 7fd595170700 1 Processor -- start 2023-08-22T00:06:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.487+0000 7fd595170700 1 -- start start 2023-08-22T00:06:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd59014e720 0x7fd590155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5900641b0 0x7fd5900675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd590067ae0 0x7fd590157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd590067f30 con 0x7fd5900641b0 2023-08-22T00:06:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900654a0 con 0x7fd59014e720 2023-08-22T00:06:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd595170700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590064660 con 0x7fd590067ae0 2023-08-22T00:06:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd58e59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5900641b0 0x7fd5900675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd58e59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5900641b0 0x7fd5900675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40120/0 (socket says 172.21.15.98:40120) 2023-08-22T00:06:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.488+0000 7fd58e59c700 1 -- 172.21.15.98:0/1863614503 learned_addr learned my addr 172.21.15.98:0/1863614503 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58ed9d700 1 --2- 172.21.15.98:0/1863614503 >> v2:172.21.15.118:3300/0 conn(0x7fd59014e720 0x7fd590155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58f59e700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd590067ae0 0x7fd590157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 -- 172.21.15.98:0/1863614503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd590067ae0 msgr2=0x7fd590157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd590067ae0 0x7fd590157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 -- 172.21.15.98:0/1863614503 >> v2:172.21.15.118:3300/0 conn(0x7fd59014e720 msgr2=0x7fd590155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 --2- 172.21.15.98:0/1863614503 >> v2:172.21.15.118:3300/0 conn(0x7fd59014e720 0x7fd590155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 -- 172.21.15.98:0/1863614503 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590064920 con 0x7fd5900641b0 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58e59c700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5900641b0 0x7fd5900675f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fd590069bc0 tx=0x7fd5800090f0).ready entity=mon.0 client_cookie=99d61cbe889c33e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58dd9b700 1 -- 172.21.15.98:0/1863614503 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000b600 con 0x7fd5900641b0 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58dd9b700 1 -- 172.21.15.98:0/1863614503 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000b760 con 0x7fd5900641b0 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd58dd9b700 1 -- 172.21.15.98:0/1863614503 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000bae0 con 0x7fd5900641b0 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 -- 172.21.15.98:0/1863614503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5900641b0 msgr2=0x7fd5900675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5900641b0 0x7fd5900675f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fd590069bc0 tx=0x7fd5800090f0).stop 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 -- 172.21.15.98:0/1863614503 shutdown_connections 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd590067ae0 0x7fd590157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 --2- 172.21.15.98:0/1863614503 >> v2:172.21.15.118:3300/0 conn(0x7fd59014e720 0x7fd590155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 --2- 172.21.15.98:0/1863614503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5900641b0 0x7fd5900675f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 -- 172.21.15.98:0/1863614503 >> 172.21.15.98:0/1863614503 conn(0x7fd5900c8950 msgr2=0x7fd5900c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 -- 172.21.15.98:0/1863614503 shutdown_connections 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.489+0000 7fd595170700 1 -- 172.21.15.98:0/1863614503 wait complete. 2023-08-22T00:06:56.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 Processor -- start 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 -- start start 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5900641b0 0x7fd5900a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd59014e720 0x7fd590147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a9900 con 0x7fd590067ae0 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c0fd0 con 0x7fd59014e720 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.491+0000 7fd595170700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590164540 con 0x7fd5900641b0 2023-08-22T00:06:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40122/0 (socket says 172.21.15.98:40122) 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 -- 172.21.15.98:0/2595502657 learned_addr learned my addr 172.21.15.98:0/2595502657 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 -- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5900641b0 msgr2=0x7fd5900a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58ed9d700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5900641b0 0x7fd5900a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5900641b0 0x7fd5900a8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58f59e700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd59014e720 0x7fd590147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 -- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd59014e720 msgr2=0x7fd590147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd59014e720 0x7fd590147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 -- 172.21.15.98:0/2595502657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009370 con 0x7fd590067ae0 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd58e59c700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd580009130 tx=0x7fd580017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000b8d0 con 0x7fd590067ae0 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000ba30 con 0x7fd590067ae0 2023-08-22T00:06:56.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58001b660 con 0x7fd590067ae0 2023-08-22T00:06:56.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900a9060 con 0x7fd590067ae0 2023-08-22T00:06:56.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.492+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900c11e0 con 0x7fd590067ae0 2023-08-22T00:06:56.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.493+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900c1550 con 0x7fd590067ae0 2023-08-22T00:06:56.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.493+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd58001b9d0 con 0x7fd590067ae0 2023-08-22T00:06:56.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.494+0000 7fd576ffd700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 0x7fd57c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.494+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fd58007b710 con 0x7fd590067ae0 2023-08-22T00:06:56.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.494+0000 7fd58ed9d700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 0x7fd57c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.494+0000 7fd58ed9d700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 0x7fd57c0612d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd584006fd0 tx=0x7fd584008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.498+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd58004c860 con 0x7fd590067ae0 2023-08-22T00:06:56.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.659+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5900c1370 con 0x7fd590067ae0 2023-08-22T00:06:56.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.659+0000 7fd576ffd700 1 -- 172.21.15.98:0/2595502657 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd58001f020 con 0x7fd590067ae0 2023-08-22T00:06:56.662 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 msgr2=0x7fd57c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 0x7fd57c0612d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd584006fd0 tx=0x7fd584008040).stop 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 msgr2=0x7fd5900adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd580009130 tx=0x7fd580017000).stop 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 shutdown_connections 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd57c05ee10 0x7fd57c0612d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5900641b0 0x7fd5900a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd59014e720 0x7fd590147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 --2- 172.21.15.98:0/2595502657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd590067ae0 0x7fd5900adbf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 >> 172.21.15.98:0/2595502657 conn(0x7fd5900c8950 msgr2=0x7fd5900c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 shutdown_connections 2023-08-22T00:06:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.661+0000 7fd595170700 1 -- 172.21.15.98:0/2595502657 wait complete. 2023-08-22T00:06:56.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:06:56.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.793+0000 7f60e1966700 1 Processor -- start 2023-08-22T00:06:56.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.793+0000 7f60e1966700 1 -- start start 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0bd260 0x7f60dc0c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 0x7f60dc0bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc0bd640 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc155380 con 0x7f60dc0bb770 2023-08-22T00:06:56.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60e1966700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc155620 con 0x7f60dc0bd260 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40130/0 (socket says 172.21.15.98:40130) 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 -- 172.21.15.98:0/3796473324 learned_addr learned my addr 172.21.15.98:0/3796473324 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60da7fc700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0bd260 0x7f60dc0c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60db7fe700 1 --2- 172.21.15.98:0/3796473324 >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 0x7f60dc0bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 -- 172.21.15.98:0/3796473324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0bd260 msgr2=0x7f60dc0c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0bd260 0x7f60dc0c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 -- 172.21.15.98:0/3796473324 >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 msgr2=0x7f60dc0bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 --2- 172.21.15.98:0/3796473324 >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 0x7f60dc0bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 -- 172.21.15.98:0/3796473324 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0c12c0 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60db7fe700 1 --2- 172.21.15.98:0/3796473324 >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 0x7f60dc0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60daffd700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f60dc0c1ce0 tx=0x7f60cc0090f0).ready entity=mon.0 client_cookie=1f93f45956ced06a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60d9ffb700 1 -- 172.21.15.98:0/3796473324 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00b520 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60d9ffb700 1 -- 172.21.15.98:0/3796473324 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc00b680 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.794+0000 7f60d9ffb700 1 -- 172.21.15.98:0/3796473324 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00ba00 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 -- 172.21.15.98:0/3796473324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0a8ac0 msgr2=0x7f60dc0a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f60dc0c1ce0 tx=0x7f60cc0090f0).stop 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 -- 172.21.15.98:0/3796473324 shutdown_connections 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 --2- 172.21.15.98:0/3796473324 >> v2:172.21.15.118:3300/0 conn(0x7f60dc0bb770 0x7f60dc0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0a8ac0 0x7f60dc0a8ea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 --2- 172.21.15.98:0/3796473324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0bd260 0x7f60dc0c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 -- 172.21.15.98:0/3796473324 >> 172.21.15.98:0/3796473324 conn(0x7f60dc0c31d0 msgr2=0x7f60dc0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 -- 172.21.15.98:0/3796473324 shutdown_connections 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.795+0000 7f60e1966700 1 -- 172.21.15.98:0/3796473324 wait complete. 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.796+0000 7f60e1966700 1 Processor -- start 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.796+0000 7f60e1966700 1 -- start start 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 0x7f60dc0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 0x7f60dc14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0bdbd0 con 0x7f60dc0bb770 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc1682b0 con 0x7f60dc0bd260 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60e1966700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc168510 con 0x7f60dc0a8ac0 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40138/0 (socket says 172.21.15.98:40138) 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 -- 172.21.15.98:0/1300100120 learned_addr learned my addr 172.21.15.98:0/1300100120 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60daffd700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 0x7f60dc0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60db7fe700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 0x7f60dc14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 -- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 msgr2=0x7f60dc0a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 0x7f60dc0a9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 -- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 msgr2=0x7f60dc14a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 0x7f60dc14a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 -- 172.21.15.98:0/1300100120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc009370 con 0x7f60dc0bb770 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60daffd700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 0x7f60dc0a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:56.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60db7fe700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 0x7f60dc14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.797+0000 7f60da7fc700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f60d000e900 tx=0x7f60d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.798+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000c640 con 0x7f60dc0bb770 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.798+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000c7a0 con 0x7f60dc0bb770 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.798+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc1687f0 con 0x7f60dc0bb770 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.798+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000cb20 con 0x7f60dc0bb770 2023-08-22T00:06:56.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.798+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc14a890 con 0x7f60dc0bb770 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.799+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc0bdd10 con 0x7f60dc0bb770 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.799+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f60d001b400 con 0x7f60dc0bb770 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.799+0000 7f60c2ffd700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 0x7f60c80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.799+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f60d007a6e0 con 0x7f60dc0bb770 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.799+0000 7f60daffd700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 0x7f60c80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.800+0000 7f60daffd700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 0x7f60c80612d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f60cc009340 tx=0x7f60cc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:56.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.803+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60d004b730 con 0x7f60dc0bb770 2023-08-22T00:06:56.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.963+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60dc0bd9a0 con 0x7f60dc0bb770 2023-08-22T00:06:56.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.963+0000 7f60c2ffd700 1 -- 172.21.15.98:0/1300100120 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60d0016020 con 0x7f60dc0bb770 2023-08-22T00:06:56.966 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:06:56.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 msgr2=0x7f60c80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 0x7f60c80612d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f60cc009340 tx=0x7f60cc017000).stop 2023-08-22T00:06:56.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 msgr2=0x7f60dc167dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:56.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f60d000e900 tx=0x7f60d0009060).stop 2023-08-22T00:06:56.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 shutdown_connections 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f60c805ee10 0x7f60c80612d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60dc0a8ac0 0x7f60dc0a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60dc0bd260 0x7f60dc14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 --2- 172.21.15.98:0/1300100120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60dc0bb770 0x7f60dc167dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.965+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 >> 172.21.15.98:0/1300100120 conn(0x7f60dc0c31d0 msgr2=0x7f60dc14ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:56.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.966+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 shutdown_connections 2023-08-22T00:06:56.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:56.966+0000 7f60e1966700 1 -- 172.21.15.98:0/1300100120 wait complete. 2023-08-22T00:06:56.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:06:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.100+0000 7efc4a1f9700 1 Processor -- start 2023-08-22T00:06:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.100+0000 7efc4a1f9700 1 -- start start 2023-08-22T00:06:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc4a1f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc440a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc4a1f9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc44155380 con 0x7efc440bd260 2023-08-22T00:06:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc4a1f9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc44155620 con 0x7efc440a8ac0 2023-08-22T00:06:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc4a1f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440bd6f0 con 0x7efc440bc780 2023-08-22T00:06:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc43fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efc440bd260 0x7efc44150680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59358/0 (socket says 172.21.15.98:59358) 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc43fff700 1 -- 172.21.15.98:0/1021393265 learned_addr learned my addr 172.21.15.98:0/1021393265 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc42ffd700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc440a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988593719 0 0) 0x7efc44155380 con 0x7efc440bd260 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc2c0033f0 con 0x7efc440bd260 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.101+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629796263 0 0) 0x7efc2c0033f0 con 0x7efc440bd260 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 msgr2=0x7efc440a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc440a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 >> v1:172.21.15.118:6789/0 conn(0x7efc440a8ac0 legacy=0x7efc440c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440c2ae0 con 0x7efc440bd260 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7efc3c0017f0 con 0x7efc440bd260 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 >> v1:172.21.15.98:6789/0 conn(0x7efc440bd260 legacy=0x7efc44150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc2c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c003e40 0x7efc2c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c004b80 0x7efc2c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440bd6f0 con 0x7efc2c004b80 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c00dba0 con 0x7efc2c003e40 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c00dd60 con 0x7efc440bc780 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c004b80 0x7efc2c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc437fe700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc2c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc42ffd700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c003e40 0x7efc2c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 -- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 msgr2=0x7efc2c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc440bc780 0x7efc2c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 -- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c003e40 msgr2=0x7efc2c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c003e40 0x7efc2c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 -- 172.21.15.98:0/1021393265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0033f0 con 0x7efc2c004b80 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc43fff700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c004b80 0x7efc2c005000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7efc3c00c5f0 tx=0x7efc44155510).ready entity=mon.0 client_cookie=918f774a7d85fbe3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00cdf0 con 0x7efc2c004b80 2023-08-22T00:06:57.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c005b20 con 0x7efc2c004b80 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.102+0000 7efc427fc700 1 -- 172.21.15.98:0/1021393265 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c005ea0 con 0x7efc2c004b80 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 -- 172.21.15.98:0/1021393265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c004b80 msgr2=0x7efc2c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/1021393265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c004b80 0x7efc2c005000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7efc3c00c5f0 tx=0x7efc44155510).stop 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc43fff700 1 -- 172.21.15.98:0/1021393265 reap_dead start 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 -- 172.21.15.98:0/1021393265 shutdown_connections 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 -- 172.21.15.98:0/1021393265 >> 172.21.15.98:0/1021393265 conn(0x7efc440c31d0 msgr2=0x7efc440c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:57.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 -- 172.21.15.98:0/1021393265 shutdown_connections 2023-08-22T00:06:57.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.103+0000 7efc4a1f9700 1 -- 172.21.15.98:0/1021393265 wait complete. 2023-08-22T00:06:57.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.104+0000 7efc4a1f9700 1 Processor -- start 2023-08-22T00:06:57.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.104+0000 7efc4a1f9700 1 -- start start 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc4414fab0 0x7efc440be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc441601d0 0x7efc440abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440bf790 con 0x7efc4414f6d0 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440be8b0 con 0x7efc4414fab0 2023-08-22T00:06:57.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc4a1f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440beb80 con 0x7efc441601d0 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40148/0 (socket says 172.21.15.98:40148) 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 -- 172.21.15.98:0/617861241 learned_addr learned my addr 172.21.15.98:0/617861241 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc43fff700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc441601d0 0x7efc440abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc42ffd700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc4414fab0 0x7efc440be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 -- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc441601d0 msgr2=0x7efc440abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc441601d0 0x7efc440abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 -- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc4414fab0 msgr2=0x7efc440be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc4414fab0 0x7efc440be3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.105+0000 7efc437fe700 1 -- 172.21.15.98:0/617861241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440bee60 con 0x7efc4414f6d0 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc437fe700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7efc380028c0 tx=0x7efc38007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011590 con 0x7efc4414f6d0 2023-08-22T00:06:57.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc380116f0 con 0x7efc4414f6d0 2023-08-22T00:06:57.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc440bf140 con 0x7efc4414f6d0 2023-08-22T00:06:57.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011a70 con 0x7efc4414f6d0 2023-08-22T00:06:57.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.106+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc44160630 con 0x7efc4414f6d0 2023-08-22T00:06:57.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.107+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc441608b0 con 0x7efc4414f6d0 2023-08-22T00:06:57.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.107+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7efc3801c3b0 con 0x7efc4414f6d0 2023-08-22T00:06:57.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.108+0000 7efc2b7fe700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 0x7efc300612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.108+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7079+0+0 (secure 0 0 0) 0x7efc38079bd0 con 0x7efc4414f6d0 2023-08-22T00:06:57.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.108+0000 7efc42ffd700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 0x7efc300612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.108+0000 7efc42ffd700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 0x7efc300612d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc440ac940 tx=0x7efc34009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.112+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc380498f0 con 0x7efc4414f6d0 2023-08-22T00:06:57.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.278+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc440c2dc0 con 0x7efc4414f6d0 2023-08-22T00:06:57.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.278+0000 7efc2b7fe700 1 -- 172.21.15.98:0/617861241 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc3804ac10 con 0x7efc4414f6d0 2023-08-22T00:06:57.280 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:06:57.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 msgr2=0x7efc300612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 0x7efc300612d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc440ac940 tx=0x7efc34009060).stop 2023-08-22T00:06:57.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 msgr2=0x7efc440aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7efc380028c0 tx=0x7efc38007bb0).stop 2023-08-22T00:06:57.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 shutdown_connections 2023-08-22T00:06:57.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc3005ee10 0x7efc300612d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc441601d0 0x7efc440abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc4414f6d0 0x7efc440aa0f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 --2- 172.21.15.98:0/617861241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc4414fab0 0x7efc440be3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 >> 172.21.15.98:0/617861241 conn(0x7efc440c31d0 msgr2=0x7efc44151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:57.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 shutdown_connections 2023-08-22T00:06:57.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.280+0000 7efc4a1f9700 1 -- 172.21.15.98:0/617861241 wait complete. 2023-08-22T00:06:57.306 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-08-22T00:06:57.308 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:06:57.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-22T00:06:57.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.424+0000 7fddec4f3700 1 Processor -- start 2023-08-22T00:06:57.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.424+0000 7fddec4f3700 1 -- start start 2023-08-22T00:06:57.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.425+0000 7fddec4f3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 0x7fdde4150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.425+0000 7fddec4f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.425+0000 7fddec4f3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40c2220 con 0x7fdde40c59b0 2023-08-22T00:06:57.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.425+0000 7fddec4f3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde40c3f30 con 0x7fdde4150040 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.425+0000 7fddec4f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c1ef0 con 0x7fdde4153f10 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fddea28f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 0x7fdde4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:43840/0 (socket says 172.21.15.98:43840) 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 -- 172.21.15.98:0/3131781938 learned_addr learned my addr 172.21.15.98:0/3131781938 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 -- 172.21.15.98:0/3131781938 >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 msgr2=0x7fdde4150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 --2- 172.21.15.98:0/3131781938 >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 0x7fdde4150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 -- 172.21.15.98:0/3131781938 >> v1:172.21.15.118:6789/0 conn(0x7fdde40c59b0 legacy=0x7fdde40c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 -- 172.21.15.98:0/3131781938 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40c5e30 con 0x7fdde4153f10 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fddea28f700 1 --2- 172.21.15.98:0/3131781938 >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 0x7fdde4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde928d700 1 -- 172.21.15.98:0/3131781938 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161843481 0 0) 0x7fdde40c2220 con 0x7fdde40c59b0 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde9a8e700 1 --2- 172.21.15.98:0/3131781938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fddd8006fd0 tx=0x7fddd80090f0).ready entity=mon.2 client_cookie=a6eb6224b345c475 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde928d700 1 -- 172.21.15.98:0/3131781938 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800b580 con 0x7fdde4153f10 2023-08-22T00:06:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde928d700 1 -- 172.21.15.98:0/3131781938 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd800b6e0 con 0x7fdde4153f10 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.426+0000 7fdde928d700 1 -- 172.21.15.98:0/3131781938 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800ba60 con 0x7fdde4153f10 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 -- 172.21.15.98:0/3131781938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 msgr2=0x7fdde40c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 --2- 172.21.15.98:0/3131781938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fddd8006fd0 tx=0x7fddd80090f0).stop 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 -- 172.21.15.98:0/3131781938 shutdown_connections 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 --2- 172.21.15.98:0/3131781938 >> v2:172.21.15.118:3300/0 conn(0x7fdde4150040 0x7fdde4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 --2- 172.21.15.98:0/3131781938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4153f10 0x7fdde40c54c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 -- 172.21.15.98:0/3131781938 >> 172.21.15.98:0/3131781938 conn(0x7fdde40c7140 msgr2=0x7fdde40c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:57.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 -- 172.21.15.98:0/3131781938 shutdown_connections 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.427+0000 7fddec4f3700 1 -- 172.21.15.98:0/3131781938 wait complete. 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.428+0000 7fddec4f3700 1 Processor -- start 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.428+0000 7fddec4f3700 1 -- start start 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 0x7fdde414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4150040 0x7fdde40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40a3c80 con 0x7fdde4153f10 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40a4ae0 con 0x7fdde40c59b0 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddec4f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde414e880 con 0x7fdde4150040 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40152/0 (socket says 172.21.15.98:40152) 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 -- 172.21.15.98:0/38307499 learned_addr learned my addr 172.21.15.98:0/38307499 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fdde9a8e700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4150040 0x7fdde40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddea28f700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 0x7fdde414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 -- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4150040 msgr2=0x7fdde40abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4150040 0x7fdde40abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 -- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 msgr2=0x7fdde414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 0x7fdde414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddeaa90700 1 -- 172.21.15.98:0/38307499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00092a0 con 0x7fdde4153f10 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.429+0000 7fddea28f700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 0x7fdde414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddeaa90700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdddc00c810 tx=0x7fdddc007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc010510 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc010690 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd8009370 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc010a50 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.430+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40a41b0 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.431+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde40bc2b0 con 0x7fdde4153f10 2023-08-22T00:06:57.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.431+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdddc01b400 con 0x7fdde4153f10 2023-08-22T00:06:57.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.431+0000 7fddd67fc700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 0x7fddc80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:57.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.431+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fdddc07a060 con 0x7fdde4153f10 2023-08-22T00:06:57.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.431+0000 7fddea28f700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 0x7fddc80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:57.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.432+0000 7fddea28f700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 0x7fddc80612d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdde0009270 tx=0x7fdde0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:57.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.436+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdddc04b110 con 0x7fdde4153f10 2023-08-22T00:06:57.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:57.661+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fdde40a4c50 con 0x7fdde4153f10 2023-08-22T00:06:58.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.227+0000 7fddd67fc700 1 -- 172.21.15.98:0/38307499 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdddc001630 con 0x7fdde4153f10 2023-08-22T00:06:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 msgr2=0x7fddc80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 0x7fddc80612d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdde0009270 tx=0x7fdde0008040).stop 2023-08-22T00:06:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 msgr2=0x7fdde40ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdddc00c810 tx=0x7fdddc007ee0).stop 2023-08-22T00:06:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 shutdown_connections 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdde4153f10 0x7fdde40ac2b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde40c59b0 0x7fdde414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fddc805ee10 0x7fddc80612d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 --2- 172.21.15.98:0/38307499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdde4150040 0x7fdde40abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 >> 172.21.15.98:0/38307499 conn(0x7fdde40c7140 msgr2=0x7fdde40bcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 shutdown_connections 2023-08-22T00:06:58.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.229+0000 7fddec4f3700 1 -- 172.21.15.98:0/38307499 wait complete. 2023-08-22T00:06:58.244 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:06:58.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.365+0000 7fc0cc139700 1 Processor -- start 2023-08-22T00:06:58.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.365+0000 7fc0cc139700 1 -- start start 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0cc139700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 0x7fc0c40c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0cc139700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 0x7fc0c4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0cc139700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c4063f90 con 0x7fc0c41505e0 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0cc139700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c40656f0 con 0x7fc0c40635a0 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0cc139700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c41509c0 con 0x7fc0c40c2400 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0c9ed5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc0c41505e0 0x7fc0c4062e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59360/0 (socket says 172.21.15.98:59360) 2023-08-22T00:06:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0c9ed5700 1 -- 172.21.15.98:0/836625690 learned_addr learned my addr 172.21.15.98:0/836625690 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0ca6d6700 1 --2- 172.21.15.98:0/836625690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 0x7fc0c4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0c96d4700 1 --2- 172.21.15.98:0/836625690 >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 0x7fc0c40c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362965797 0 0) 0x7fc0c4063f90 con 0x7fc0c41505e0 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.366+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b00033f0 con 0x7fc0c41505e0 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0ca6d6700 1 -- 172.21.15.98:0/836625690 >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 msgr2=0x7fc0c40c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1626509658 0 0) 0x7fc0b00033f0 con 0x7fc0c41505e0 2023-08-22T00:06:58.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0ca6d6700 1 --2- 172.21.15.98:0/836625690 >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 0x7fc0c40c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0ca6d6700 1 -- 172.21.15.98:0/836625690 >> v1:172.21.15.98:6789/0 conn(0x7fc0c41505e0 legacy=0x7fc0c4062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0ca6d6700 1 -- 172.21.15.98:0/836625690 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c40650c0 con 0x7fc0c40c2400 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0c96d4700 1 --2- 172.21.15.98:0/836625690 >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 0x7fc0c40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0ca6d6700 1 --2- 172.21.15.98:0/836625690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 0x7fc0c4065b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc0bc009e60 tx=0x7fc0bc009780).ready entity=mon.2 client_cookie=ade63a58146aa501 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00e070 con 0x7fc0c40c2400 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc00b7a0 con 0x7fc0c40c2400 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0c8ed3700 1 -- 172.21.15.98:0/836625690 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0001470 con 0x7fc0c40c2400 2023-08-22T00:06:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 -- 172.21.15.98:0/836625690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 msgr2=0x7fc0c4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 --2- 172.21.15.98:0/836625690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 0x7fc0c4065b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc0bc009e60 tx=0x7fc0bc009780).stop 2023-08-22T00:06:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 -- 172.21.15.98:0/836625690 shutdown_connections 2023-08-22T00:06:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 --2- 172.21.15.98:0/836625690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c40c2400 0x7fc0c4065b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 --2- 172.21.15.98:0/836625690 >> v2:172.21.15.118:3300/0 conn(0x7fc0c40635a0 0x7fc0c40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 -- 172.21.15.98:0/836625690 >> 172.21.15.98:0/836625690 conn(0x7fc0c40c31d0 msgr2=0x7fc0c40c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 -- 172.21.15.98:0/836625690 shutdown_connections 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.367+0000 7fc0cc139700 1 -- 172.21.15.98:0/836625690 wait complete. 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 Processor -- start 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 -- start start 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c40c2400 0x7fc0c4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c41505e0 0x7fc0c40bea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c414e930 con 0x7fc0c40635a0 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c4157570 con 0x7fc0c40c2400 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0cc139700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40c0190 con 0x7fc0c41505e0 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0c9ed5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0c9ed5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40166/0 (socket says 172.21.15.98:40166) 2023-08-22T00:06:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.369+0000 7fc0c9ed5700 1 -- 172.21.15.98:0/485809776 learned_addr learned my addr 172.21.15.98:0/485809776 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0ca6d6700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c41505e0 0x7fc0c40bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c96d4700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c40c2400 0x7fc0c4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 -- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c41505e0 msgr2=0x7fc0c40bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c41505e0 0x7fc0c40bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 -- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c40c2400 msgr2=0x7fc0c4157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c40c2400 0x7fc0c4157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 -- 172.21.15.98:0/485809776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40092a0 con 0x7fc0c40635a0 2023-08-22T00:06:58.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0c9ed5700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc0c000c840 tx=0x7fc0c0001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0001b30 con 0x7fc0c40635a0 2023-08-22T00:06:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0007170 con 0x7fc0c40635a0 2023-08-22T00:06:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc009a20 con 0x7fc0c40635a0 2023-08-22T00:06:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0007530 con 0x7fc0c40635a0 2023-08-22T00:06:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.370+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c4154460 con 0x7fc0c40635a0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.371+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c40c2bf0 con 0x7fc0c40635a0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.371+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc0c0004ad0 con 0x7fc0c40635a0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.372+0000 7fc0b9ffb700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 0x7fc0a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.372+0000 7fc0c96d4700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 0x7fc0a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.372+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fc0c0079dc0 con 0x7fc0c40635a0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.372+0000 7fc0c96d4700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 0x7fc0a80612d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc0b4009270 tx=0x7fc0b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.376+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0c004ae70 con 0x7fc0c40635a0 2023-08-22T00:06:58.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.537+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc0c4046c20 con 0x7fc0c40635a0 2023-08-22T00:06:58.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.541+0000 7fc0b9ffb700 1 -- 172.21.15.98:0/485809776 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0c0019070 con 0x7fc0c40635a0 2023-08-22T00:06:58.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 msgr2=0x7fc0a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 0x7fc0a80612d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc0b4009270 tx=0x7fc0b4008040).stop 2023-08-22T00:06:58.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 msgr2=0x7fc0c4156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc0c000c840 tx=0x7fc0c0001aa0).stop 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 shutdown_connections 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0a805ee10 0x7fc0a80612d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0c41505e0 0x7fc0c40bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0c40635a0 0x7fc0c4156b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 --2- 172.21.15.98:0/485809776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c40c2400 0x7fc0c4157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 >> 172.21.15.98:0/485809776 conn(0x7fc0c40c31d0 msgr2=0x7fc0c4152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 shutdown_connections 2023-08-22T00:06:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:58.543+0000 7fc0cc139700 1 -- 172.21.15.98:0/485809776 wait complete. 2023-08-22T00:06:58.565 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:06:58.566 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:06:58.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:06:58.667 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:06:58.668 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:06:58.674 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:06:58.674 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:06:58.720 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:06:58.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:06:58.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:58.722 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:06:58.774 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-08-22T00:06:58.775 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:06:58.775 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-22T00:06:58.824 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:06:58.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:06:58.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:58.825 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:06:58.896 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:06:58.897 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:06:58.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-22T00:06:58.937 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:06:58.938 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:06:58.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:58.938 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:06:59.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-08-22T00:06:59.002 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:06:59.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-22T00:06:59.049 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:06:59.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:06:59.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:06:59.050 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:06:59.118 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:06:59.118 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:06:59.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.234+0000 7f246e154700 1 Processor -- start 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.234+0000 7f246e154700 1 -- start start 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f246e154700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f246814e0d0 0x7f246814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f246e154700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680c17b0 con 0x7f24681544f0 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f246e154700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2468155260 con 0x7f24680c5a90 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f246e154700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680bf9e0 con 0x7f246814e0d0 2023-08-22T00:06:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24677fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f246814e0d0 0x7f246814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f2467fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f24681544f0 0x7f24681549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59368/0 (socket says 172.21.15.98:59368) 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f2467fff700 1 -- 172.21.15.98:0/1348266183 learned_addr learned my addr 172.21.15.98:0/1348266183 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24677fe700 1 -- 172.21.15.98:0/1348266183 >> v1:172.21.15.118:6789/0 conn(0x7f24680c5a90 legacy=0x7f24680c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24677fe700 1 -- 172.21.15.98:0/1348266183 >> v1:172.21.15.98:6789/0 conn(0x7f24681544f0 legacy=0x7f24681549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24677fe700 1 -- 172.21.15.98:0/1348266183 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680bfcc0 con 0x7f246814e0d0 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24667fc700 1 -- 172.21.15.98:0/1348266183 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407559294 0 0) 0x7f24680c17b0 con 0x7f24681544f0 2023-08-22T00:06:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24677fe700 1 --2- 172.21.15.98:0/1348266183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f246814e0d0 0x7f246814e4b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f2458009760 tx=0x7f2458009060).ready entity=mon.0 client_cookie=27b38355d619633c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24667fc700 1 -- 172.21.15.98:0/1348266183 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800b580 con 0x7f246814e0d0 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24667fc700 1 -- 172.21.15.98:0/1348266183 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245800b6e0 con 0x7f246814e0d0 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.235+0000 7f24667fc700 1 -- 172.21.15.98:0/1348266183 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800ba60 con 0x7f246814e0d0 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 -- 172.21.15.98:0/1348266183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f246814e0d0 msgr2=0x7f246814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 --2- 172.21.15.98:0/1348266183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f246814e0d0 0x7f246814e4b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f2458009760 tx=0x7f2458009060).stop 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 -- 172.21.15.98:0/1348266183 shutdown_connections 2023-08-22T00:06:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 --2- 172.21.15.98:0/1348266183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f246814e0d0 0x7f246814e4b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 -- 172.21.15.98:0/1348266183 >> 172.21.15.98:0/1348266183 conn(0x7f24680caa80 msgr2=0x7f24680cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 -- 172.21.15.98:0/1348266183 shutdown_connections 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.236+0000 7f246e154700 1 -- 172.21.15.98:0/1348266183 wait complete. 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.237+0000 7f246e154700 1 Processor -- start 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 -- start start 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24680c5a90 0x7f24680c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246814e0d0 0x7f24681675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468167f80 con 0x7f24681544f0 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680b0320 con 0x7f246814e0d0 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.238+0000 7f246e154700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680af710 con 0x7f24680c5a90 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40176/0 (socket says 172.21.15.98:40176) 2023-08-22T00:06:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 -- 172.21.15.98:0/2360453881 learned_addr learned my addr 172.21.15.98:0/2360453881 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f24677fe700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24680c5a90 0x7f24680c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2466ffd700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246814e0d0 0x7f24681675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 -- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24680c5a90 msgr2=0x7f24680c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24680c5a90 0x7f24680c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 -- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246814e0d0 msgr2=0x7f24681675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246814e0d0 0x7f24681675a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 -- 172.21.15.98:0/2360453881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580092a0 con 0x7f24681544f0 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f2467fff700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f246000c7e0 tx=0x7f2460007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460005d30 con 0x7f24681544f0 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460005e90 con 0x7f24681544f0 2023-08-22T00:06:59.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680af9f0 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460007320 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.239+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680affb0 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.240+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246814f350 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.240+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f24600076d0 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.241+0000 7f244f7fe700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 0x7f24540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.241+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f246007a160 con 0x7f24681544f0 2023-08-22T00:06:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.241+0000 7f24677fe700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 0x7f24540612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.241+0000 7f24677fe700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 0x7f24540612a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f245800b340 tx=0x7f2458017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.245+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f246814f350 con 0x7f24681544f0 2023-08-22T00:06:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.447+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f246814f350 con 0x7f24681544f0 2023-08-22T00:06:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.447+0000 7f244f7fe700 1 -- 172.21.15.98:0/2360453881 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f246814f350 con 0x7f24681544f0 2023-08-22T00:06:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:59.454 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:06:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 msgr2=0x7f24540612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 0x7f24540612a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f245800b340 tx=0x7f2458017000).stop 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 msgr2=0x7f2468167a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f246000c7e0 tx=0x7f2460007f90).stop 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 shutdown_connections 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f245405ede0 0x7f24540612a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24680c5a90 0x7f24680c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24681544f0 0x7f2468167a90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.449+0000 7f246e154700 1 --2- 172.21.15.98:0/2360453881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246814e0d0 0x7f24681675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.450+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 >> 172.21.15.98:0/2360453881 conn(0x7f24680caa80 msgr2=0x7f24680ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.450+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 shutdown_connections 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.450+0000 7f246e154700 1 -- 172.21.15.98:0/2360453881 wait complete. 2023-08-22T00:06:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:06:59.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:06:59.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.579+0000 7f83ed35f700 1 Processor -- start 2023-08-22T00:06:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.579+0000 7f83ed35f700 1 -- start start 2023-08-22T00:06:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83ed35f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f83e814e0d0 0x7f83e814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83ed35f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80c17b0 con 0x7f83e81544f0 2023-08-22T00:06:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83ed35f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e8155260 con 0x7f83e80c5a90 2023-08-22T00:06:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83ed35f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80bf9e0 con 0x7f83e814e0d0 2023-08-22T00:06:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f83e814e0d0 0x7f83e814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f83e81544f0 0x7f83e81549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:59380/0 (socket says 172.21.15.98:59380) 2023-08-22T00:06:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e77fe700 1 -- 172.21.15.98:0/1652230107 learned_addr learned my addr 172.21.15.98:0/1652230107 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:06:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e6ffd700 1 -- 172.21.15.98:0/1652230107 >> v1:172.21.15.118:6789/0 conn(0x7f83e80c5a90 legacy=0x7f83e80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e6ffd700 1 -- 172.21.15.98:0/1652230107 >> v1:172.21.15.98:6789/0 conn(0x7f83e81544f0 legacy=0x7f83e81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e6ffd700 1 -- 172.21.15.98:0/1652230107 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80bfcc0 con 0x7f83e814e0d0 2023-08-22T00:06:59.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e5ffb700 1 -- 172.21.15.98:0/1652230107 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018828660 0 0) 0x7f83e80c17b0 con 0x7f83e81544f0 2023-08-22T00:06:59.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.580+0000 7f83e6ffd700 1 --2- 172.21.15.98:0/1652230107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e814e0d0 0x7f83e814e4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f83dc009760 tx=0x7f83dc009060).ready entity=mon.0 client_cookie=a3b1b88042cb8a19 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83e5ffb700 1 -- 172.21.15.98:0/1652230107 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00b520 con 0x7f83e814e0d0 2023-08-22T00:06:59.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83e5ffb700 1 -- 172.21.15.98:0/1652230107 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00b680 con 0x7f83e814e0d0 2023-08-22T00:06:59.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83e5ffb700 1 -- 172.21.15.98:0/1652230107 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00ba00 con 0x7f83e814e0d0 2023-08-22T00:06:59.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 -- 172.21.15.98:0/1652230107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e814e0d0 msgr2=0x7f83e814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1652230107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e814e0d0 0x7f83e814e4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f83dc009760 tx=0x7f83dc009060).stop 2023-08-22T00:06:59.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 -- 172.21.15.98:0/1652230107 shutdown_connections 2023-08-22T00:06:59.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1652230107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e814e0d0 0x7f83e814e4b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 -- 172.21.15.98:0/1652230107 >> 172.21.15.98:0/1652230107 conn(0x7f83e80caa80 msgr2=0x7f83e80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:59.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 -- 172.21.15.98:0/1652230107 shutdown_connections 2023-08-22T00:06:59.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.581+0000 7f83ed35f700 1 -- 172.21.15.98:0/1652230107 wait complete. 2023-08-22T00:06:59.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.583+0000 7f83ed35f700 1 Processor -- start 2023-08-22T00:06:59.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.583+0000 7f83ed35f700 1 -- start start 2023-08-22T00:06:59.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80c5a90 0x7f83e80c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83e814e0d0 0x7f83e81657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e813f000 con 0x7f83e81544f0 2023-08-22T00:06:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80aeb60 con 0x7f83e80c5a90 2023-08-22T00:06:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80aee40 con 0x7f83e814e0d0 2023-08-22T00:06:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40186/0 (socket says 172.21.15.98:40186) 2023-08-22T00:06:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 -- 172.21.15.98:0/1683661546 learned_addr learned my addr 172.21.15.98:0/1683661546 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e6ffd700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80c5a90 0x7f83e80c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e67fc700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83e814e0d0 0x7f83e81657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 -- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83e814e0d0 msgr2=0x7f83e81657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83e814e0d0 0x7f83e81657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 -- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80c5a90 msgr2=0x7f83e80c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80c5a90 0x7f83e80c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 -- 172.21.15.98:0/1683661546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0092a0 con 0x7f83e81544f0 2023-08-22T00:06:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83e77fe700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f83e000c790 tx=0x7f83e0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0005d30 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0007110 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e80af120 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.584+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00074d0 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.585+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e80c49f0 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.586+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e8047480 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.586+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f83e0007840 con 0x7f83e81544f0 2023-08-22T00:06:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.586+0000 7f83ceffd700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 0x7f83d40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.586+0000 7f83e6ffd700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 0x7f83d40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.586+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f83e007a0a0 con 0x7f83e81544f0 2023-08-22T00:06:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.587+0000 7f83e6ffd700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 0x7f83d40612a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f83dc00b2e0 tx=0x7f83dc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.590+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83e004b150 con 0x7f83e81544f0 2023-08-22T00:06:59.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.750+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e80aa230 con 0x7f83e81544f0 2023-08-22T00:06:59.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.751+0000 7f83ceffd700 1 -- 172.21.15.98:0/1683661546 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19177 (secure 0 0 0) 0x7f83e004e770 con 0x7f83e81544f0 2023-08-22T00:06:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:06:59.753 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":28,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:57.211195+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:06:59.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 msgr2=0x7f83d40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 0x7f83d40612a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f83dc00b2e0 tx=0x7f83dc017000).stop 2023-08-22T00:06:59.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 msgr2=0x7f83e8151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f83e000c790 tx=0x7f83e0007f30).stop 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 shutdown_connections 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83e81544f0 0x7f83e8151210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80c5a90 0x7f83e80c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83d405ede0 0x7f83d40612a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 --2- 172.21.15.98:0/1683661546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83e814e0d0 0x7f83e81657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 >> 172.21.15.98:0/1683661546 conn(0x7f83e80caa80 msgr2=0x7f83e80c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:59.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 shutdown_connections 2023-08-22T00:06:59.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.753+0000 7f83ed35f700 1 -- 172.21.15.98:0/1683661546 wait complete. 2023-08-22T00:06:59.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:06:07.002336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:06:07.603848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-22T00:06:10.670760+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:06:59.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:06:59.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.884+0000 7fa7f2867700 1 Processor -- start 2023-08-22T00:06:59.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.884+0000 7fa7f2867700 1 -- start start 2023-08-22T00:06:59.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec0688b0 0x7fa7ec152190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa7ec066cd0 0x7fa7ec0be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa7ec152680 0x7fa7ec0bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0bf260 con 0x7fa7ec066cd0 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c33b0 con 0x7fa7ec152680 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7f2867700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec153160 con 0x7fa7ec0688b0 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7eb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa7ec066cd0 0x7fa7ec0be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.885+0000 7fa7eb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa7ec066cd0 0x7fa7ec0be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40198/0 (socket says 172.21.15.98:40198) 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 -- 172.21.15.98:0/4203273238 learned_addr learned my addr 172.21.15.98:0/4203273238 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7ebfff700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec0688b0 0x7fa7ec152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7f0e04700 1 --2- 172.21.15.98:0/4203273238 >> v2:172.21.15.118:3300/0 conn(0x7fa7ec152680 0x7fa7ec0bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 -- 172.21.15.98:0/4203273238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec0688b0 msgr2=0x7fa7ec152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec0688b0 0x7fa7ec152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 -- 172.21.15.98:0/4203273238 >> v2:172.21.15.118:3300/0 conn(0x7fa7ec152680 msgr2=0x7fa7ec0bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/4203273238 >> v2:172.21.15.118:3300/0 conn(0x7fa7ec152680 0x7fa7ec0bed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 -- 172.21.15.98:0/4203273238 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec152ba0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec0be880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa7ec1568a0 tx=0x7fa7dc0090f0).ready entity=mon.0 client_cookie=a08bc1adec847685 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eaffd700 1 -- 172.21.15.98:0/4203273238 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00b600 con 0x7fa7ec066cd0 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eaffd700 1 -- 172.21.15.98:0/4203273238 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00b760 con 0x7fa7ec066cd0 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.886+0000 7fa7eaffd700 1 -- 172.21.15.98:0/4203273238 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00bb00 con 0x7fa7ec066cd0 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 -- 172.21.15.98:0/4203273238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 msgr2=0x7fa7ec0be880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec0be880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa7ec1568a0 tx=0x7fa7dc0090f0).stop 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 -- 172.21.15.98:0/4203273238 shutdown_connections 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec0688b0 0x7fa7ec152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 --2- 172.21.15.98:0/4203273238 >> v2:172.21.15.118:3300/0 conn(0x7fa7ec152680 0x7fa7ec0bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 --2- 172.21.15.98:0/4203273238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec0be880 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 -- 172.21.15.98:0/4203273238 >> 172.21.15.98:0/4203273238 conn(0x7fa7ec0c5e80 msgr2=0x7fa7ec0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:06:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 -- 172.21.15.98:0/4203273238 shutdown_connections 2023-08-22T00:06:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.887+0000 7fa7f2867700 1 -- 172.21.15.98:0/4203273238 wait complete. 2023-08-22T00:06:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.888+0000 7fa7f2867700 1 Processor -- start 2023-08-22T00:06:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.888+0000 7fa7f2867700 1 -- start start 2023-08-22T00:06:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec0688b0 0x7fa7ec0c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec152680 0x7fa7ec0ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec13f970 con 0x7fa7ec066cd0 2023-08-22T00:06:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0a9310 con 0x7fa7ec0688b0 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7f2867700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c0c00 con 0x7fa7ec152680 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7ebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7ebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40210/0 (socket says 172.21.15.98:40210) 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.889+0000 7fa7ebfff700 1 -- 172.21.15.98:0/2015780086 learned_addr learned my addr 172.21.15.98:0/2015780086 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec0688b0 0x7fa7ec0c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7f0e04700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec152680 0x7fa7ec0ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 -- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec152680 msgr2=0x7fa7ec0ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec152680 0x7fa7ec0ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 -- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec0688b0 msgr2=0x7fa7ec0c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec0688b0 0x7fa7ec0c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 -- 172.21.15.98:0/2015780086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc009370 con 0x7fa7ec066cd0 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7ebfff700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa7e000d890 tx=0x7fa7e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00125f0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0012750 con 0x7fa7ec066cd0 2023-08-22T00:06:59.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec0ad150 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0012ad0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.890+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec0a8cc0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.891+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0a95f0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.891+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa7e0013480 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.891+0000 7fa7d3fff700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 0x7fa7d80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.891+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fa7e0079fe0 con 0x7fa7ec066cd0 2023-08-22T00:06:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.892+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 0x7fa7d80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:06:59.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.892+0000 7fa7eb7fe700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 0x7fa7d80612d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa7ec0bf800 tx=0x7fa7dc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:06:59.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:06:59.896+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7e00a88f0 con 0x7fa7ec066cd0 2023-08-22T00:07:00.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.055+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa7ec152e80 con 0x7fa7ec066cd0 2023-08-22T00:07:00.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.055+0000 7fa7d3fff700 1 -- 172.21.15.98:0/2015780086 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa7e004afd0 con 0x7fa7ec066cd0 2023-08-22T00:07:00.058 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 msgr2=0x7fa7d80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 0x7fa7d80612d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa7ec0bf800 tx=0x7fa7dc017000).stop 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 msgr2=0x7fa7ec13f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa7e000d890 tx=0x7fa7e0008040).stop 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 shutdown_connections 2023-08-22T00:07:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa7d805ee10 0x7fa7d80612d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ec152680 0x7fa7ec0ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ec066cd0 0x7fa7ec13f480 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 --2- 172.21.15.98:0/2015780086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec0688b0 0x7fa7ec0c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 >> 172.21.15.98:0/2015780086 conn(0x7fa7ec0c5e80 msgr2=0x7fa7ec0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 shutdown_connections 2023-08-22T00:07:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.057+0000 7fa7f2867700 1 -- 172.21.15.98:0/2015780086 wait complete. 2023-08-22T00:07:00.072 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:07:00.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.193+0000 7f5351a97700 1 Processor -- start 2023-08-22T00:07:00.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.193+0000 7f5351a97700 1 -- start start 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f534c0a8b20 0x7f534c0a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f534c0bc160 0x7f534c155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c062600 con 0x7f534c0a8b20 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c066120 con 0x7f534c0bc160 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f5351a97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c066400 con 0x7f534c0bc5f0 2023-08-22T00:07:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f534b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f534c0a8b20 0x7f534c0a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f534b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f534c0a8b20 0x7f534c0a8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40226/0 (socket says 172.21.15.98:40226) 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f534b7fe700 1 -- 172.21.15.98:0/3173534111 learned_addr learned my addr 172.21.15.98:0/3173534111 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f534affd700 1 --2- 172.21.15.98:0/3173534111 >> v2:172.21.15.118:3300/0 conn(0x7f534c0bc160 0x7f534c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.194+0000 7f534bfff700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 -- 172.21.15.98:0/3173534111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 msgr2=0x7f534c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 -- 172.21.15.98:0/3173534111 >> v2:172.21.15.118:3300/0 conn(0x7f534c0bc160 msgr2=0x7f534c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 --2- 172.21.15.98:0/3173534111 >> v2:172.21.15.118:3300/0 conn(0x7f534c0bc160 0x7f534c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 -- 172.21.15.98:0/3173534111 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0666e0 con 0x7f534c0a8b20 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534b7fe700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0a8b20 0x7f534c0a8f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f534c06a230 tx=0x7f53340090f0).ready entity=mon.0 client_cookie=d6633120bad382f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534a7fc700 1 -- 172.21.15.98:0/3173534111 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400f510 con 0x7f534c0a8b20 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534a7fc700 1 -- 172.21.15.98:0/3173534111 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533400f670 con 0x7f534c0a8b20 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f534a7fc700 1 -- 172.21.15.98:0/3173534111 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400fa10 con 0x7f534c0a8b20 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 -- 172.21.15.98:0/3173534111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0a8b20 msgr2=0x7f534c0a8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0a8b20 0x7f534c0a8f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f534c06a230 tx=0x7f53340090f0).stop 2023-08-22T00:07:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 -- 172.21.15.98:0/3173534111 shutdown_connections 2023-08-22T00:07:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 --2- 172.21.15.98:0/3173534111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0a8b20 0x7f534c0a8f00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 --2- 172.21.15.98:0/3173534111 >> v2:172.21.15.118:3300/0 conn(0x7f534c0bc160 0x7f534c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 -- 172.21.15.98:0/3173534111 >> 172.21.15.98:0/3173534111 conn(0x7f534c0c31d0 msgr2=0x7f534c0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 -- 172.21.15.98:0/3173534111 shutdown_connections 2023-08-22T00:07:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.195+0000 7f5351a97700 1 -- 172.21.15.98:0/3173534111 wait complete. 2023-08-22T00:07:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.197+0000 7f5351a97700 1 Processor -- start 2023-08-22T00:07:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.197+0000 7f5351a97700 1 -- start start 2023-08-22T00:07:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 0x7f534c1383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0bf470 con 0x7f534c0bc160 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1388b0 con 0x7f534c0a8b20 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f5351a97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0be860 con 0x7f534c0bc5f0 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40238/0 (socket says 172.21.15.98:40238) 2023-08-22T00:07:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 -- 172.21.15.98:0/2517425027 learned_addr learned my addr 172.21.15.98:0/2517425027 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534bfff700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534b7fe700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 0x7f534c1383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 -- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 msgr2=0x7f534c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 -- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 msgr2=0x7f534c1383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 0x7f534c1383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 -- 172.21.15.98:0/2517425027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009370 con 0x7f534c0bc160 2023-08-22T00:07:00.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534b7fe700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 0x7f534c1383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f534affd700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f533c00e930 tx=0x7f533c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00eed0 con 0x7f534c0bc160 2023-08-22T00:07:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.198+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00c850 con 0x7f534c0bc160 2023-08-22T00:07:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.199+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cbd0 con 0x7f534c0bc160 2023-08-22T00:07:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.199+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0beb40 con 0x7f534c0bc160 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.199+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c0bf100 con 0x7f534c0bc160 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.200+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c150fb0 con 0x7f534c0bc160 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.200+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f533c01b400 con 0x7f534c0bc160 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.200+0000 7f53437fe700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 0x7f532c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.200+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f533c07a720 con 0x7f534c0bc160 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.200+0000 7f534b7fe700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 0x7f532c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.201+0000 7f534b7fe700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 0x7f532c0612d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f534c06a230 tx=0x7f5334016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.204+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f533c04b820 con 0x7f534c0bc160 2023-08-22T00:07:00.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.365+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f534c0669c0 con 0x7f534c0bc160 2023-08-22T00:07:00.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.366+0000 7f53437fe700 1 -- 172.21.15.98:0/2517425027 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f533c04ee40 con 0x7f534c0bc160 2023-08-22T00:07:00.373 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:07:00.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 msgr2=0x7f532c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 0x7f532c0612d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f534c06a230 tx=0x7f5334016000).stop 2023-08-22T00:07:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 msgr2=0x7f534c0bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f533c00e930 tx=0x7f533c009060).stop 2023-08-22T00:07:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 shutdown_connections 2023-08-22T00:07:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f532c05ee10 0x7f532c0612d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f534c0bc5f0 0x7f534c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f534c0a8b20 0x7f534c1383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 --2- 172.21.15.98:0/2517425027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f534c0bc160 0x7f534c0bf900 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 >> 172.21.15.98:0/2517425027 conn(0x7f534c0c31d0 msgr2=0x7f534c0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 shutdown_connections 2023-08-22T00:07:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.367+0000 7f5351a97700 1 -- 172.21.15.98:0/2517425027 wait complete. 2023-08-22T00:07:00.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:07:00.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.504+0000 7f5f91d78700 1 Processor -- start 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.504+0000 7f5f91d78700 1 -- start start 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f91d78700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f8c0beff0 0x7f5f8c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f91d78700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c0c3c00 con 0x7f5f8c151dd0 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f91d78700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c0c3ee0 con 0x7f5f8c1519f0 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f91d78700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c0c4780 con 0x7f5f8c0beff0 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f8affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5f8c151dd0 0x7f5f8c0be8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56372/0 (socket says 172.21.15.98:56372) 2023-08-22T00:07:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f8affd700 1 -- 172.21.15.98:0/2007499237 learned_addr learned my addr 172.21.15.98:0/2007499237 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f8bfff700 1 --2- 172.21.15.98:0/2007499237 >> v2:172.21.15.118:3300/0 conn(0x7f5f8c0beff0 0x7f5f8c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727207367 0 0) 0x7f5f8c0c3c00 con 0x7f5f8c151dd0 2023-08-22T00:07:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.505+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f740033f0 con 0x7f5f8c151dd0 2023-08-22T00:07:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018643223 0 0) 0x7f5f740033f0 con 0x7f5f8c151dd0 2023-08-22T00:07:00.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 >> v2:172.21.15.118:3300/0 conn(0x7f5f8c0beff0 msgr2=0x7f5f8c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 --2- 172.21.15.98:0/2007499237 >> v2:172.21.15.118:3300/0 conn(0x7f5f8c0beff0 0x7f5f8c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 >> v1:172.21.15.118:6789/0 conn(0x7f5f8c1519f0 legacy=0x7f5f8c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c0c41c0 con 0x7f5f8c151dd0 2023-08-22T00:07:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f5f7c001470 con 0x7f5f8c151dd0 2023-08-22T00:07:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 >> v1:172.21.15.98:6789/0 conn(0x7f5f8c151dd0 legacy=0x7f5f8c0be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 0x7f5f74003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f74004690 0x7f5f74004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f74005000 0x7f5f7400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0c4780 con 0x7f5f740038e0 2023-08-22T00:07:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7400bf60 con 0x7f5f74005000 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7400c120 con 0x7f5f74004690 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 0x7f5f74003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8bfff700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f74005000 0x7f5f7400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8affd700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f74004690 0x7f5f74004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 -- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f74004690 msgr2=0x7f5f74004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f74004690 0x7f5f74004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 -- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f74005000 msgr2=0x7f5f7400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f74005000 0x7f5f7400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8bfff700 1 -- 172.21.15.98:0/2007499237 reap_dead start 2023-08-22T00:07:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 -- 172.21.15.98:0/2007499237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740033f0 con 0x7f5f740038e0 2023-08-22T00:07:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 0x7f5f74003d20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5f80001730 tx=0x7f5f80007bb0).ready entity=mon.0 client_cookie=f6de97afc3fab83d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007020 con 0x7f5f740038e0 2023-08-22T00:07:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80007180 con 0x7f5f740038e0 2023-08-22T00:07:00.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.506+0000 7f5f8a7fc700 1 -- 172.21.15.98:0/2007499237 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007520 con 0x7f5f740038e0 2023-08-22T00:07:00.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 -- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 msgr2=0x7f5f74003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 0x7f5f74003d20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5f80001730 tx=0x7f5f80007bb0).stop 2023-08-22T00:07:00.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 -- 172.21.15.98:0/2007499237 shutdown_connections 2023-08-22T00:07:00.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 --2- 172.21.15.98:0/2007499237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f740038e0 0x7f5f74003d20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 -- 172.21.15.98:0/2007499237 >> 172.21.15.98:0/2007499237 conn(0x7f5f8c0c5ea0 msgr2=0x7f5f8c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 -- 172.21.15.98:0/2007499237 shutdown_connections 2023-08-22T00:07:00.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.507+0000 7f5f91d78700 1 -- 172.21.15.98:0/2007499237 wait complete. 2023-08-22T00:07:00.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.508+0000 7f5f91d78700 1 Processor -- start 2023-08-22T00:07:00.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.508+0000 7f5f91d78700 1 -- start start 2023-08-22T00:07:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 0x7f5f8c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 0x7f5f8c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0abae0 con 0x7f5f8c150000 2023-08-22T00:07:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0a8410 con 0x7f5f740038e0 2023-08-22T00:07:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f91d78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0a9230 con 0x7f5f8c0a96c0 2023-08-22T00:07:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35798/0 (socket says 172.21.15.98:35798) 2023-08-22T00:07:00.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 -- 172.21.15.98:0/4024721308 learned_addr learned my addr 172.21.15.98:0/4024721308 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:00.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 0x7f5f8c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8affd700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 0x7f5f8c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 -- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 msgr2=0x7f5f8c14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 0x7f5f8c14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 -- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 msgr2=0x7f5f8c13d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 0x7f5f8c13d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8bfff700 1 -- 172.21.15.98:0/4024721308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c0a8620 con 0x7f5f8c150000 2023-08-22T00:07:00.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 0x7f5f8c13d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:00.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.509+0000 7f5f8affd700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 0x7f5f8c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:00.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f8bfff700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5f840094d0 tx=0x7f5f8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400e040 con 0x7f5f8c150000 2023-08-22T00:07:00.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8400f040 con 0x7f5f8c150000 2023-08-22T00:07:00.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c0a8900 con 0x7f5f8c150000 2023-08-22T00:07:00.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400fe20 con 0x7f5f8c150000 2023-08-22T00:07:00.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.510+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c0a8ec0 con 0x7f5f8c150000 2023-08-22T00:07:00.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.511+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c0c44a0 con 0x7f5f8c150000 2023-08-22T00:07:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.511+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5f84015660 con 0x7f5f8c150000 2023-08-22T00:07:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.511+0000 7f5f737fe700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 0x7f5f780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.512+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f5f8407acc0 con 0x7f5f8c150000 2023-08-22T00:07:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.512+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 0x7f5f780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.512+0000 7f5f8b7fe700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 0x7f5f780612d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5f8c0a80a0 tx=0x7f5f80015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.516+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f8404bd70 con 0x7f5f8c150000 2023-08-22T00:07:00.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.676+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f8c151240 con 0x7f5f8c150000 2023-08-22T00:07:00.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.676+0000 7f5f737fe700 1 -- 172.21.15.98:0/4024721308 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f8404f390 con 0x7f5f8c150000 2023-08-22T00:07:00.680 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:07:00.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 msgr2=0x7f5f780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 0x7f5f780612d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5f8c0a80a0 tx=0x7f5f80015000).stop 2023-08-22T00:07:00.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 msgr2=0x7f5f8c0a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5f840094d0 tx=0x7f5f8400b040).stop 2023-08-22T00:07:00.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 shutdown_connections 2023-08-22T00:07:00.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f8c150000 0x7f5f8c0a9b40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f740038e0 0x7f5f8c13d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f7805ee10 0x7f5f780612d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 --2- 172.21.15.98:0/4024721308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8c0a96c0 0x7f5f8c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 >> 172.21.15.98:0/4024721308 conn(0x7f5f8c0c5ea0 msgr2=0x7f5f8c1569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 shutdown_connections 2023-08-22T00:07:00.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.678+0000 7f5f91d78700 1 -- 172.21.15.98:0/4024721308 wait complete. 2023-08-22T00:07:00.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:07:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.821+0000 7f96ed4db700 1 Processor -- start 2023-08-22T00:07:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.821+0000 7f96ed4db700 1 -- start start 2023-08-22T00:07:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96ed4db700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f96e8154170 0x7f96e8158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96ed4db700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96ed4db700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80bcf30 con 0x7f96e8063ea0 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96ed4db700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8154550 con 0x7f96e8154170 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96ed4db700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8158b00 con 0x7f96e8064320 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f96e8154170 0x7f96e8158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e67fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f96e8063ea0 0x7f96e80c15e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56386/0 (socket says 172.21.15.98:56386) 2023-08-22T00:07:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f96e8154170 0x7f96e8158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35812/0 (socket says 172.21.15.98:35812) 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e67fc700 1 -- 172.21.15.98:0/3259127594 learned_addr learned my addr 172.21.15.98:0/3259127594 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e77fe700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 -- 172.21.15.98:0/3259127594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 msgr2=0x7f96e80c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80c1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 -- 172.21.15.98:0/3259127594 >> v1:172.21.15.98:6789/0 conn(0x7f96e8063ea0 legacy=0x7f96e80c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e5ffb700 1 -- 172.21.15.98:0/3259127594 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664948681 0 0) 0x7f96e80bcf30 con 0x7f96e8063ea0 2023-08-22T00:07:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 -- 172.21.15.98:0/3259127594 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80676b0 con 0x7f96e8154170 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e6ffd700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8154170 0x7f96e8158610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f96d8009760 tx=0x7f96d8009060).ready entity=mon.0 client_cookie=decfbeceb6b489e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e5ffb700 1 -- 172.21.15.98:0/3259127594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800b580 con 0x7f96e8154170 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e5ffb700 1 -- 172.21.15.98:0/3259127594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800b6e0 con 0x7f96e8154170 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.822+0000 7f96e5ffb700 1 -- 172.21.15.98:0/3259127594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800ba60 con 0x7f96e8154170 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 -- 172.21.15.98:0/3259127594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8154170 msgr2=0x7f96e8158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8154170 0x7f96e8158610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f96d8009760 tx=0x7f96d8009060).stop 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 -- 172.21.15.98:0/3259127594 shutdown_connections 2023-08-22T00:07:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 --2- 172.21.15.98:0/3259127594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8154170 0x7f96e8158610 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 -- 172.21.15.98:0/3259127594 >> 172.21.15.98:0/3259127594 conn(0x7f96e8069680 msgr2=0x7f96e8069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 -- 172.21.15.98:0/3259127594 shutdown_connections 2023-08-22T00:07:00.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.823+0000 7f96ed4db700 1 -- 172.21.15.98:0/3259127594 wait complete. 2023-08-22T00:07:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.824+0000 7f96ed4db700 1 Processor -- start 2023-08-22T00:07:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.824+0000 7f96ed4db700 1 -- start start 2023-08-22T00:07:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 0x7f96e80666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80a38d0 con 0x7f96e8063ea0 2023-08-22T00:07:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8168270 con 0x7f96e8154170 2023-08-22T00:07:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96ed4db700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80a6560 con 0x7f96e8064320 2023-08-22T00:07:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35826/0 (socket says 172.21.15.98:35826) 2023-08-22T00:07:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 -- 172.21.15.98:0/393075889 learned_addr learned my addr 172.21.15.98:0/393075889 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:00.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e67fc700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e77fe700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 0x7f96e80666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 -- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 msgr2=0x7f96e80a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 -- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 msgr2=0x7f96e80666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 0x7f96e80666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e6ffd700 1 -- 172.21.15.98:0/393075889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80092a0 con 0x7f96e8063ea0 2023-08-22T00:07:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.825+0000 7f96e67fc700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96e77fe700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 0x7f96e80666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96e6ffd700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f96d8009eb0 tx=0x7f96d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800b850 con 0x7f96e8063ea0 2023-08-22T00:07:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800b9b0 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8167940 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d801b660 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.826+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8167f00 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.827+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8068600 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.827+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f96d801ba50 con 0x7f96e8063ea0 2023-08-22T00:07:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.827+0000 7f96ceffd700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 0x7f96d40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.827+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f96d807bd90 con 0x7f96e8063ea0 2023-08-22T00:07:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.827+0000 7f96e67fc700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 0x7f96d40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.828+0000 7f96e67fc700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 0x7f96d40612d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f96e80a79f0 tx=0x7f96dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.832+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96d804ce40 con 0x7f96e8063ea0 2023-08-22T00:07:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.990+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96e8046c20 con 0x7f96e8063ea0 2023-08-22T00:07:00.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.991+0000 7f96ceffd700 1 -- 172.21.15.98:0/393075889 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96d801f020 con 0x7f96e8063ea0 2023-08-22T00:07:00.993 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:07:00.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 msgr2=0x7f96d40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 0x7f96d40612d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f96e80a79f0 tx=0x7f96dc009040).stop 2023-08-22T00:07:00.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 msgr2=0x7f96e8149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f96d8009eb0 tx=0x7f96d8017000).stop 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 shutdown_connections 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e8154170 0x7f96e80666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96e8063ea0 0x7f96e8149960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f96d405ee10 0x7f96d40612d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.992+0000 7f96ed4db700 1 --2- 172.21.15.98:0/393075889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96e8064320 0x7f96e80a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.993+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 >> 172.21.15.98:0/393075889 conn(0x7f96e8069680 msgr2=0x7f96e8151ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.993+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 shutdown_connections 2023-08-22T00:07:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:00.993+0000 7f96ed4db700 1 -- 172.21.15.98:0/393075889 wait complete. 2023-08-22T00:07:01.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-22T00:07:01.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.125+0000 7f39282b3700 1 Processor -- start 2023-08-22T00:07:01.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.125+0000 7f39282b3700 1 -- start start 2023-08-22T00:07:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f39282b3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 0x7f3920155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f39282b3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3920067d00 0x7f39200c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f39282b3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39200654a0 con 0x7f39200641b0 2023-08-22T00:07:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f39282b3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3920064660 con 0x7f3920067d00 2023-08-22T00:07:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f39282b3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3920064920 con 0x7f392014e720 2023-08-22T00:07:01.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f3926850700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3920067d00 0x7f39200c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f3926850700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3920067d00 0x7f39200c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35840/0 (socket says 172.21.15.98:35840) 2023-08-22T00:07:01.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f392584e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f39200641b0 0x7f39200675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56388/0 (socket says 172.21.15.98:56388) 2023-08-22T00:07:01.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f3926850700 1 -- 172.21.15.98:0/2151485202 learned_addr learned my addr 172.21.15.98:0/2151485202 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:01.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f3926850700 1 -- 172.21.15.98:0/2151485202 >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 msgr2=0x7f3920155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:01.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f392604f700 1 --2- 172.21.15.98:0/2151485202 >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 0x7f3920155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.126+0000 7f392504d700 1 -- 172.21.15.98:0/2151485202 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965334652 0 0) 0x7f39200654a0 con 0x7f39200641b0 2023-08-22T00:07:01.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f3926850700 1 --2- 172.21.15.98:0/2151485202 >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 0x7f3920155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f3926850700 1 -- 172.21.15.98:0/2151485202 >> v1:172.21.15.98:6789/0 conn(0x7f39200641b0 legacy=0x7f39200675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f3926850700 1 -- 172.21.15.98:0/2151485202 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920064c00 con 0x7f3920067d00 2023-08-22T00:07:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f392604f700 1 --2- 172.21.15.98:0/2151485202 >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 0x7f3920155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f3926850700 1 --2- 172.21.15.98:0/2151485202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200c3b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f3920069bc0 tx=0x7f3918009840).ready entity=mon.0 client_cookie=1c4e6eba5155d019 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f392504d700 1 -- 172.21.15.98:0/2151485202 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800e070 con 0x7f3920067d00 2023-08-22T00:07:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f392504d700 1 -- 172.21.15.98:0/2151485202 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800ba50 con 0x7f3920067d00 2023-08-22T00:07:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f392504d700 1 -- 172.21.15.98:0/2151485202 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800bdd0 con 0x7f3920067d00 2023-08-22T00:07:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 -- 172.21.15.98:0/2151485202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 msgr2=0x7f39200c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 --2- 172.21.15.98:0/2151485202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200c3b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f3920069bc0 tx=0x7f3918009840).stop 2023-08-22T00:07:01.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 -- 172.21.15.98:0/2151485202 shutdown_connections 2023-08-22T00:07:01.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 --2- 172.21.15.98:0/2151485202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200c3b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 --2- 172.21.15.98:0/2151485202 >> v2:172.21.15.118:3300/0 conn(0x7f392014e720 0x7f3920155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 -- 172.21.15.98:0/2151485202 >> 172.21.15.98:0/2151485202 conn(0x7f39200c8950 msgr2=0x7f39200c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 -- 172.21.15.98:0/2151485202 shutdown_connections 2023-08-22T00:07:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.127+0000 7f39282b3700 1 -- 172.21.15.98:0/2151485202 wait complete. 2023-08-22T00:07:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.128+0000 7f39282b3700 1 Processor -- start 2023-08-22T00:07:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 -- start start 2023-08-22T00:07:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39200641b0 0x7f39200a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 0x7f39200a7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200aa1a0 con 0x7f3920067d00 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200aac20 con 0x7f39200641b0 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f39282b3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200c0f20 con 0x7f392014e720 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f392584e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f392584e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35852/0 (socket says 172.21.15.98:35852) 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.129+0000 7f392584e700 1 -- 172.21.15.98:0/1452947999 learned_addr learned my addr 172.21.15.98:0/1452947999 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392604f700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39200641b0 0x7f39200a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f3926850700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 0x7f39200a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 -- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 msgr2=0x7f39200a7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 0x7f39200a7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 -- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39200641b0 msgr2=0x7f39200a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39200641b0 0x7f39200a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 -- 172.21.15.98:0/1452947999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009ae0 con 0x7f3920067d00 2023-08-22T00:07:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f3926850700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 0x7f39200a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f392584e700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f391c00c470 tx=0x7f391c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0072e0 con 0x7f3920067d00 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c007440 con 0x7f3920067d00 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39200ac890 con 0x7f3920067d00 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c005910 con 0x7f3920067d00 2023-08-22T00:07:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.130+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39200aa6e0 con 0x7f3920067d00 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.131+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3920069d50 con 0x7f3920067d00 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.131+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f391c005d00 con 0x7f3920067d00 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.132+0000 7f39167fc700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 0x7f39040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.132+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f391c079830 con 0x7f3920067d00 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.132+0000 7f392604f700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 0x7f39040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.132+0000 7f392604f700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 0x7f39040612d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f391000aa70 tx=0x7f3910008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.136+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f391c04a8e0 con 0x7f3920067d00 2023-08-22T00:07:01.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.297+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f39200aaa00 con 0x7f3920067d00 2023-08-22T00:07:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.297+0000 7f39167fc700 1 -- 172.21.15.98:0/1452947999 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f391c018070 con 0x7f3920067d00 2023-08-22T00:07:01.299 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2023-08-22T00:07:01.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 msgr2=0x7f39040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 0x7f39040612d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f391000aa70 tx=0x7f3910008040).stop 2023-08-22T00:07:01.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 msgr2=0x7f39200ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f391c00c470 tx=0x7f391c007e30).stop 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 shutdown_connections 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f390405ee10 0x7f39040612d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392014e720 0x7f39200a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39200641b0 0x7f39200a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 --2- 172.21.15.98:0/1452947999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3920067d00 0x7f39200ac3a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 >> 172.21.15.98:0/1452947999 conn(0x7f39200c8950 msgr2=0x7f39200bf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 shutdown_connections 2023-08-22T00:07:01.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.299+0000 7f39282b3700 1 -- 172.21.15.98:0/1452947999 wait complete. 2023-08-22T00:07:01.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:07:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.428+0000 7fd10f605700 1 Processor -- start 2023-08-22T00:07:01.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.428+0000 7fd10f605700 1 -- start start 2023-08-22T00:07:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10f605700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd108153e20 0x7fd108154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10f605700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 0x7fd108062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10f605700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080c4cf0 con 0x7fd1080c5d00 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10f605700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080c5870 con 0x7fd108153e20 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10f605700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd108154a30 con 0x7fd1080c6180 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10d3a1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd108153e20 0x7fd108154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10cba0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd1080c5d00 0x7fd1080bd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56390/0 (socket says 172.21.15.98:56390) 2023-08-22T00:07:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10cba0700 1 -- 172.21.15.98:0/689271171 learned_addr learned my addr 172.21.15.98:0/689271171 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.429+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/689271171 >> v2:172.21.15.98:3300/0 conn(0x7fd108153e20 0x7fd108154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35860/0 (socket says 172.21.15.98:35860) 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10dba2700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 0x7fd108062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10d3a1700 1 -- 172.21.15.98:0/689271171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 msgr2=0x7fd108062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 0x7fd108062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10d3a1700 1 -- 172.21.15.98:0/689271171 >> v1:172.21.15.98:6789/0 conn(0x7fd1080c5d00 legacy=0x7fd1080bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd0fffff700 1 -- 172.21.15.98:0/689271171 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33886063 0 0) 0x7fd1080c4cf0 con 0x7fd1080c5d00 2023-08-22T00:07:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10d3a1700 1 -- 172.21.15.98:0/689271171 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080c4f40 con 0x7fd108153e20 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10dba2700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 0x7fd108062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd108153e20 0x7fd108154200 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fd0f800a900 tx=0x7fd0f800a200).ready entity=mon.0 client_cookie=22eee5fb58be92af server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd0fffff700 1 -- 172.21.15.98:0/689271171 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800aea0 con 0x7fd108153e20 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd0fffff700 1 -- 172.21.15.98:0/689271171 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800c970 con 0x7fd108153e20 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd0fffff700 1 -- 172.21.15.98:0/689271171 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800ccf0 con 0x7fd108153e20 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 -- 172.21.15.98:0/689271171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd108153e20 msgr2=0x7fd108154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd108153e20 0x7fd108154200 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fd0f800a900 tx=0x7fd0f800a200).stop 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 -- 172.21.15.98:0/689271171 shutdown_connections 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1080c6180 0x7fd108062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 --2- 172.21.15.98:0/689271171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd108153e20 0x7fd108154200 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.430+0000 7fd10f605700 1 -- 172.21.15.98:0/689271171 >> 172.21.15.98:0/689271171 conn(0x7fd1080c3980 msgr2=0x7fd1080c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.431+0000 7fd10f605700 1 -- 172.21.15.98:0/689271171 shutdown_connections 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.431+0000 7fd10f605700 1 -- 172.21.15.98:0/689271171 wait complete. 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.432+0000 7fd10f605700 1 Processor -- start 2023-08-22T00:07:01.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.432+0000 7fd10f605700 1 -- start start 2023-08-22T00:07:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1080c6180 0x7fd10813d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd108153e20 0x7fd1080aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080ab610 con 0x7fd1080c5d00 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080aaa00 con 0x7fd1080c6180 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080aace0 con 0x7fd108153e20 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35868/0 (socket says 172.21.15.98:35868) 2023-08-22T00:07:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 -- 172.21.15.98:0/1475642575 learned_addr learned my addr 172.21.15.98:0/1475642575 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10dba2700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd108153e20 0x7fd1080aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10cba0700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1080c6180 0x7fd10813d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 -- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd108153e20 msgr2=0x7fd1080aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd108153e20 0x7fd1080aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 -- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1080c6180 msgr2=0x7fd10813d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1080c6180 0x7fd10813d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 -- 172.21.15.98:0/1475642575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f800a440 con 0x7fd1080c5d00 2023-08-22T00:07:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10d3a1700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fd0f800a240 tx=0x7fd1080c59b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8019630 con 0x7fd1080c5d00 2023-08-22T00:07:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8019790 con 0x7fd1080c5d00 2023-08-22T00:07:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8019b50 con 0x7fd1080c5d00 2023-08-22T00:07:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1080aafc0 con 0x7fd1080c5d00 2023-08-22T00:07:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.433+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1080bfc10 con 0x7fd1080c5d00 2023-08-22T00:07:01.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.434+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1080ab460 con 0x7fd1080c5d00 2023-08-22T00:07:01.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.434+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd0f80183b0 con 0x7fd1080c5d00 2023-08-22T00:07:01.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.435+0000 7fd0fd7fa700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 0x7fd0ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.435+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fd0f807b730 con 0x7fd1080c5d00 2023-08-22T00:07:01.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.435+0000 7fd10cba0700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 0x7fd0ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.435+0000 7fd10cba0700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 0x7fd0ec0612d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd1080bfa80 tx=0x7fd104009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.439+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0f804c780 con 0x7fd1080c5d00 2023-08-22T00:07:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.638+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1080ab8f0 con 0x7fd1080c5d00 2023-08-22T00:07:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.639+0000 7fd0fd7fa700 1 -- 172.21.15.98:0/1475642575 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7fd0f804fda0 con 0x7fd1080c5d00 2023-08-22T00:07:01.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:01.649 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:07:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.640+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 msgr2=0x7fd0ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.640+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 0x7fd0ec0612d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd1080bfa80 tx=0x7fd104009040).stop 2023-08-22T00:07:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.640+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 msgr2=0x7fd1080abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.640+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fd0f800a240 tx=0x7fd1080c59b0).stop 2023-08-22T00:07:01.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 shutdown_connections 2023-08-22T00:07:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0ec05ee10 0x7fd0ec0612d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd108153e20 0x7fd1080aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080c5d00 0x7fd1080abaa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 --2- 172.21.15.98:0/1475642575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1080c6180 0x7fd10813d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 >> 172.21.15.98:0/1475642575 conn(0x7fd1080c3980 msgr2=0x7fd1080a4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 shutdown_connections 2023-08-22T00:07:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.641+0000 7fd10f605700 1 -- 172.21.15.98:0/1475642575 wait complete. 2023-08-22T00:07:01.664 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:07:01.665 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.780+0000 7f8e01fdd700 1 Processor -- start 2023-08-22T00:07:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.780+0000 7f8e01fdd700 1 -- start start 2023-08-22T00:07:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8e01fdd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8dfc150040 0x7f8dfc150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8e01fdd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8dfc0c26b0 0x7f8dfc0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8e01fdd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0c2220 con 0x7f8dfc153f10 2023-08-22T00:07:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8e01fdd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c5bd0 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8e01fdd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c1ef0 con 0x7f8dfc150040 2023-08-22T00:07:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8dfc0c26b0 0x7f8dfc0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfaffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8dfc153f10 0x7f8dfc0c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56398/0 (socket says 172.21.15.98:56398) 2023-08-22T00:07:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfaffd700 1 -- 172.21.15.98:0/761823305 learned_addr learned my addr 172.21.15.98:0/761823305 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 -- 172.21.15.98:0/761823305 >> v2:172.21.15.118:3300/0 conn(0x7f8dfc150040 msgr2=0x7f8dfc150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfb7fe700 1 --2- 172.21.15.98:0/761823305 >> v2:172.21.15.118:3300/0 conn(0x7f8dfc150040 0x7f8dfc150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 --2- 172.21.15.98:0/761823305 >> v2:172.21.15.118:3300/0 conn(0x7f8dfc150040 0x7f8dfc150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfa7fc700 1 -- 172.21.15.98:0/761823305 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523424738 0 0) 0x7f8dfc0c2220 con 0x7f8dfc153f10 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 -- 172.21.15.98:0/761823305 >> v1:172.21.15.98:6789/0 conn(0x7f8dfc153f10 legacy=0x7f8dfc0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 -- 172.21.15.98:0/761823305 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0c5e30 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.781+0000 7f8dfbfff700 1 --2- 172.21.15.98:0/761823305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0c2b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f8dfc067f40 tx=0x7f8df400b990).ready entity=mon.0 client_cookie=afbee9a17ebfeea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8dfa7fc700 1 -- 172.21.15.98:0/761823305 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4010070 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8dfa7fc700 1 -- 172.21.15.98:0/761823305 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400ddc0 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8dfa7fc700 1 -- 172.21.15.98:0/761823305 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4015680 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 -- 172.21.15.98:0/761823305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc0c26b0 msgr2=0x7f8dfc0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/761823305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0c2b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f8dfc067f40 tx=0x7f8df400b990).stop 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 -- 172.21.15.98:0/761823305 shutdown_connections 2023-08-22T00:07:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/761823305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0c2b00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/761823305 >> v2:172.21.15.118:3300/0 conn(0x7f8dfc150040 0x7f8dfc150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 -- 172.21.15.98:0/761823305 >> 172.21.15.98:0/761823305 conn(0x7f8dfc0c7140 msgr2=0x7f8dfc0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 -- 172.21.15.98:0/761823305 shutdown_connections 2023-08-22T00:07:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.782+0000 7f8e01fdd700 1 -- 172.21.15.98:0/761823305 wait complete. 2023-08-22T00:07:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.783+0000 7f8e01fdd700 1 Processor -- start 2023-08-22T00:07:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.783+0000 7f8e01fdd700 1 -- start start 2023-08-22T00:07:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 0x7f8dfc0657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1530e0 con 0x7f8dfc150040 2023-08-22T00:07:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1524d0 con 0x7f8dfc0c26b0 2023-08-22T00:07:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8e01fdd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1527b0 con 0x7f8dfc153f10 2023-08-22T00:07:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35898/0 (socket says 172.21.15.98:35898) 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 -- 172.21.15.98:0/1209879628 learned_addr learned my addr 172.21.15.98:0/1209879628 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfb7fe700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfbfff700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 0x7f8dfc0657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 -- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 msgr2=0x7f8dfc0657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 0x7f8dfc0657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 -- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dfc0c26b0 msgr2=0x7f8dfc0ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.784+0000 7f8dfaffd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8dfaffd700 1 -- 172.21.15.98:0/1209879628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df400bc30 con 0x7f8dfc150040 2023-08-22T00:07:01.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8dfbfff700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 0x7f8dfc0657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:01.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8dfaffd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f8df0001eb0 tx=0x7f8df0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00072e0 con 0x7f8dfc150040 2023-08-22T00:07:01.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0007440 con 0x7f8dfc150040 2023-08-22T00:07:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00057a0 con 0x7f8dfc150040 2023-08-22T00:07:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc152a90 con 0x7f8dfc150040 2023-08-22T00:07:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.785+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc0ac6b0 con 0x7f8dfc150040 2023-08-22T00:07:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.786+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8df0005b90 con 0x7f8dfc150040 2023-08-22T00:07:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.786+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc153290 con 0x7f8dfc150040 2023-08-22T00:07:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.786+0000 7f8de37fe700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 0x7f8de80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.786+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f8df0079940 con 0x7f8dfc150040 2023-08-22T00:07:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.786+0000 7f8dfb7fe700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 0x7f8de80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.787+0000 7f8dfb7fe700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 0x7f8de80612d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8dec00ab30 tx=0x7f8dec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:01.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.791+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8df004a9f0 con 0x7f8dfc150040 2023-08-22T00:07:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.952+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dfc047480 con 0x7f8dfc150040 2023-08-22T00:07:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.953+0000 7f8de37fe700 1 -- 172.21.15.98:0/1209879628 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19177 (secure 0 0 0) 0x7f8df004e010 con 0x7f8dfc150040 2023-08-22T00:07:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:01.958 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":28,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:57.211195+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 msgr2=0x7f8de80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 0x7f8de80612d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8dec00ab30 tx=0x7f8dec008040).stop 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 msgr2=0x7f8dfc151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f8df0001eb0 tx=0x7f8df0007e90).stop 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 shutdown_connections 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ee10 0x7f8de80612d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dfc153f10 0x7f8dfc0657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dfc0c26b0 0x7f8dfc0ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 --2- 172.21.15.98:0/1209879628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dfc150040 0x7f8dfc151740 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 >> 172.21.15.98:0/1209879628 conn(0x7f8dfc0c7140 msgr2=0x7f8dfc0bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 shutdown_connections 2023-08-22T00:07:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:01.955+0000 7f8e01fdd700 1 -- 172.21.15.98:0/1209879628 wait complete. 2023-08-22T00:07:01.969 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:07:01.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:07:02.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.085+0000 7f96528d0700 1 Processor -- start 2023-08-22T00:07:02.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.085+0000 7f96528d0700 1 -- start start 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f96528d0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f96528d0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 0x7f964c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f96528d0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0a8410 con 0x7f964c153f40 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f96528d0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c0a8cb0 con 0x7f964c0a9140 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f96528d0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c1586a0 con 0x7f964c153b60 2023-08-22T00:07:02.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f9650e6d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 0x7f964c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f964bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f964b7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f964c153f40 0x7f964c157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:53334/0 (socket says 172.21.15.98:53334) 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.086+0000 7f964b7fe700 1 -- 172.21.15.98:0/3097793126 learned_addr learned my addr 172.21.15.98:0/3097793126 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964bfff700 1 -- 172.21.15.98:0/3097793126 >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 msgr2=0x7f964c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964bfff700 1 --2- 172.21.15.98:0/3097793126 >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 0x7f964c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964bfff700 1 -- 172.21.15.98:0/3097793126 >> v1:172.21.15.118:6789/0 conn(0x7f964c153f40 legacy=0x7f964c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964bfff700 1 -- 172.21.15.98:0/3097793126 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0a8660 con 0x7f964c153b60 2023-08-22T00:07:02.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964affd700 1 -- 172.21.15.98:0/3097793126 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236869776 0 0) 0x7f964c0a8410 con 0x7f964c153f40 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f9650e6d700 1 --2- 172.21.15.98:0/3097793126 >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 0x7f964c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964bfff700 1 --2- 172.21.15.98:0/3097793126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c068d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9640009790 tx=0x7f9640009060).ready entity=mon.2 client_cookie=1ca42d29ca91eb2c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964affd700 1 -- 172.21.15.98:0/3097793126 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000f510 con 0x7f964c153b60 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964affd700 1 -- 172.21.15.98:0/3097793126 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000f670 con 0x7f964c153b60 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.087+0000 7f964affd700 1 -- 172.21.15.98:0/3097793126 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000f9f0 con 0x7f964c153b60 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 -- 172.21.15.98:0/3097793126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 msgr2=0x7f964c068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 --2- 172.21.15.98:0/3097793126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c068d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9640009790 tx=0x7f9640009060).stop 2023-08-22T00:07:02.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 -- 172.21.15.98:0/3097793126 shutdown_connections 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 --2- 172.21.15.98:0/3097793126 >> v2:172.21.15.118:3300/0 conn(0x7f964c0a9140 0x7f964c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 --2- 172.21.15.98:0/3097793126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c068d40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 -- 172.21.15.98:0/3097793126 >> 172.21.15.98:0/3097793126 conn(0x7f964c0c5dc0 msgr2=0x7f964c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 -- 172.21.15.98:0/3097793126 shutdown_connections 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.088+0000 7f96528d0700 1 -- 172.21.15.98:0/3097793126 wait complete. 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.089+0000 7f96528d0700 1 Processor -- start 2023-08-22T00:07:02.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.089+0000 7f96528d0700 1 -- start start 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f964c0a9140 0x7f964c150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c0bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0c0b10 con 0x7f964c153f40 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c1544c0 con 0x7f964c0a9140 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f96528d0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c150880 con 0x7f964c153b60 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f9650e6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f9650e6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35912/0 (socket says 172.21.15.98:35912) 2023-08-22T00:07:02.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.090+0000 7f9650e6d700 1 -- 172.21.15.98:0/3861118047 learned_addr learned my addr 172.21.15.98:0/3861118047 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:02.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f964b7fe700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c0bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f964bfff700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f964c0a9140 0x7f964c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 -- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 msgr2=0x7f964c0bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c0bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 -- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f964c0a9140 msgr2=0x7f964c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f964c0a9140 0x7f964c150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 -- 172.21.15.98:0/3861118047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009a20 con 0x7f964c153f40 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9650e6d700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f964400ef90 tx=0x7f964400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400cbd0 con 0x7f964c153f40 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400f040 con 0x7f964c153f40 2023-08-22T00:07:02.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96400092a0 con 0x7f964c153f40 2023-08-22T00:07:02.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644013400 con 0x7f964c153f40 2023-08-22T00:07:02.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.091+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c0c0550 con 0x7f964c153f40 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.092+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c068840 con 0x7f964c153f40 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.093+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9644013830 con 0x7f964c153f40 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.093+0000 7f9633fff700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 0x7f96380612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.093+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f964407b5c0 con 0x7f964c153f40 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.093+0000 7f964bfff700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 0x7f96380612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.094+0000 7f964bfff700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 0x7f96380612d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f9640006d30 tx=0x7f9640017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.097+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f964404c610 con 0x7f964c153f40 2023-08-22T00:07:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.298+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f964c154320 con 0x7f964c153f40 2023-08-22T00:07:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.299+0000 7f9633fff700 1 -- 172.21.15.98:0/3861118047 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7f964c154320 con 0x7f964c153f40 2023-08-22T00:07:02.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:02.321 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:07:02.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 msgr2=0x7f96380612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 0x7f96380612d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f9640006d30 tx=0x7f9640017000).stop 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 msgr2=0x7f964c0be990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f964400ef90 tx=0x7f964400b040).stop 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 shutdown_connections 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c153f40 0x7f964c0be990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f964c0a9140 0x7f964c150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f963805ee10 0x7f96380612d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 --2- 172.21.15.98:0/3861118047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f964c153b60 0x7f964c0bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.300+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 >> 172.21.15.98:0/3861118047 conn(0x7f964c0c5dc0 msgr2=0x7f964c0abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.301+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 shutdown_connections 2023-08-22T00:07:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.301+0000 7f96528d0700 1 -- 172.21.15.98:0/3861118047 wait complete. 2023-08-22T00:07:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:07:02.326 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:07:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.443+0000 7fe17b99c700 1 Processor -- start 2023-08-22T00:07:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.443+0000 7fe17b99c700 1 -- start start 2023-08-22T00:07:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe17b99c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1740653d0 0x7fe17415f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe17b99c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174158bf0 con 0x7fe174151d60 2023-08-22T00:07:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe17b99c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174157d90 con 0x7fe1740a6e50 2023-08-22T00:07:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe17b99c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe174157fe0 con 0x7fe1740653d0 2023-08-22T00:07:02.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe179738700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe174151d60 0x7fe174155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56414/0 (socket says 172.21.15.98:56414) 2023-08-22T00:07:02.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.444+0000 7fe179738700 1 -- 172.21.15.98:0/2720579283 learned_addr learned my addr 172.21.15.98:0/2720579283 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:02.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179f39700 1 --2- 172.21.15.98:0/2720579283 >> v2:172.21.15.118:3300/0 conn(0x7fe1740653d0 0x7fe17415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420597140 0 0) 0x7fe174158bf0 con 0x7fe174151d60 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1600033f0 con 0x7fe174151d60 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1430171330 0 0) 0x7fe1600033f0 con 0x7fe174151d60 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 >> v2:172.21.15.118:3300/0 conn(0x7fe1740653d0 msgr2=0x7fe17415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 --2- 172.21.15.98:0/2720579283 >> v2:172.21.15.118:3300/0 conn(0x7fe1740653d0 0x7fe17415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 >> v1:172.21.15.118:6789/0 conn(0x7fe1740a6e50 legacy=0x7fe174065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1741582c0 con 0x7fe174151d60 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe164001470 con 0x7fe174151d60 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 >> v1:172.21.15.98:6789/0 conn(0x7fe174151d60 legacy=0x7fe174155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 0x7fe160003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe160004690 0x7fe160004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe160005000 0x7fe16000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174157fe0 con 0x7fe1600038e0 2023-08-22T00:07:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16000bf60 con 0x7fe160004690 2023-08-22T00:07:02.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16000c0f0 con 0x7fe160005000 2023-08-22T00:07:02.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 0x7fe160003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179f39700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe160005000 0x7fe16000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe178f37700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe160004690 0x7fe160004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 -- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe160005000 msgr2=0x7fe16000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:02.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe160005000 0x7fe16000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 -- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe160004690 msgr2=0x7fe160004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe160004690 0x7fe160004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179738700 1 -- 172.21.15.98:0/2720579283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600033f0 con 0x7fe1600038e0 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.445+0000 7fe179f39700 1 -- 172.21.15.98:0/2720579283 reap_dead start 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe179738700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 0x7fe160003d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe16400c190 tx=0x7fe164001e50).ready entity=mon.0 client_cookie=ef2bbb7e039973e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164007a20 con 0x7fe1600038e0 2023-08-22T00:07:02.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400cac0 con 0x7fe1600038e0 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe16bfff700 1 -- 172.21.15.98:0/2720579283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400ce40 con 0x7fe1600038e0 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 -- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 msgr2=0x7fe160003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 0x7fe160003d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe16400c190 tx=0x7fe164001e50).stop 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 -- 172.21.15.98:0/2720579283 shutdown_connections 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2720579283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1600038e0 0x7fe160003d00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 -- 172.21.15.98:0/2720579283 >> 172.21.15.98:0/2720579283 conn(0x7fe17406a980 msgr2=0x7fe1740c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 -- 172.21.15.98:0/2720579283 shutdown_connections 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.446+0000 7fe17b99c700 1 -- 172.21.15.98:0/2720579283 wait complete. 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.447+0000 7fe17b99c700 1 Processor -- start 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.447+0000 7fe17b99c700 1 -- start start 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600038e0 0x7fe17414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1740a49f0 0x7fe1740a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740a45f0 con 0x7fe1740c4210 2023-08-22T00:07:02.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c4b80 con 0x7fe1740a49f0 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe17b99c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740a3970 con 0x7fe1600038e0 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe178f37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe178f37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35936/0 (socket says 172.21.15.98:35936) 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe178f37700 1 -- 172.21.15.98:0/2956416999 learned_addr learned my addr 172.21.15.98:0/2956416999 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe179738700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600038e0 0x7fe17414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.448+0000 7fe179f39700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1740a49f0 0x7fe1740a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 -- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600038e0 msgr2=0x7fe17414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600038e0 0x7fe17414b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 -- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1740a49f0 msgr2=0x7fe1740a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1740a49f0 0x7fe1740a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 -- 172.21.15.98:0/2956416999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740a3c50 con 0x7fe1740c4210 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe178f37700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe170002920 tx=0x7fe170007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011590 con 0x7fe1740c4210 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1700116f0 con 0x7fe1740c4210 2023-08-22T00:07:02.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011a70 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1740a3f30 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.449+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1740a5360 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.450+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1740a43d0 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.450+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe17001c3b0 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.450+0000 7fe1697fa700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 0x7fe1580612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.451+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fe170079ad0 con 0x7fe1740c4210 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.451+0000 7fe179738700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 0x7fe1580612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.451+0000 7fe179738700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 0x7fe1580612d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fe164001ed0 tx=0x7fe164015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.455+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1700498f0 con 0x7fe1740c4210 2023-08-22T00:07:02.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.657+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1740a4730 con 0x7fe1740c4210 2023-08-22T00:07:02.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.657+0000 7fe1697fa700 1 -- 172.21.15.98:0/2956416999 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4488 (secure 0 0 0) 0x7fe1740a4730 con 0x7fe1740c4210 2023-08-22T00:07:02.659 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:02.659 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3141762636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3141762636},{"type":"v1","addr":"172.21.15.98:6835","nonce":3141762636}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/273515596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":273515596},{"type":"v1","addr":"172.21.15.98:6837","nonce":273515596}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1686704323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1686704323},{"type":"v1","addr":"172.21.15.118:6835","nonce":1686704323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:06:08.641078+0000","modified":"2023-08-22T00:06:26.126981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6833/3719023028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3719023028},{"type":"v1","addr":"172.21.15.118:6833","nonce":3719023028}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-22T00:07:02.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 msgr2=0x7fe1580612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 0x7fe1580612d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fe164001ed0 tx=0x7fe164015000).stop 2023-08-22T00:07:02.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 msgr2=0x7fe1740c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe170002920 tx=0x7fe170007bb0).stop 2023-08-22T00:07:02.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 shutdown_connections 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe15805ee10 0x7fe1580612d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600038e0 0x7fe17414b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1740a49f0 0x7fe1740a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 --2- 172.21.15.98:0/2956416999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1740c4210 0x7fe1740c4690 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 >> 172.21.15.98:0/2956416999 conn(0x7fe17406a980 msgr2=0x7fe1741526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 shutdown_connections 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.659+0000 7fe17b99c700 1 -- 172.21.15.98:0/2956416999 wait complete. 2023-08-22T00:07:02.662 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 9 2023-08-22T00:07:02.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.800+0000 7fc106c84700 1 Processor -- start 2023-08-22T00:07:02.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.800+0000 7fc106c84700 1 -- start start 2023-08-22T00:07:02.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc106c84700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc100150e40 0x7fc1000c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc106c84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc100066380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc106c84700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000bd3e0 con 0x7fc1000bd870 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc106c84700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc100066870 con 0x7fc100150e40 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc106c84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000bd0c0 con 0x7fc100065f10 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc100150e40 0x7fc1000c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc100150e40 0x7fc1000c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35952/0 (socket says 172.21.15.98:35952) 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 -- 172.21.15.98:0/2806143847 learned_addr learned my addr 172.21.15.98:0/2806143847 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc105221700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc100066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 -- 172.21.15.98:0/2806143847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 msgr2=0x7fc100066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc100066380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 -- 172.21.15.98:0/2806143847 >> v1:172.21.15.118:6789/0 conn(0x7fc1000bd870 legacy=0x7fc1000a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.801+0000 7fc104a20700 1 -- 172.21.15.98:0/2806143847 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000c3bb0 con 0x7fc100150e40 2023-08-22T00:07:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc104a20700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc1000c2050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fc0f4006fd0 tx=0x7fc0f40090f0).ready entity=mon.0 client_cookie=79cbd2be81c42bbe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc0ff7fe700 1 -- 172.21.15.98:0/2806143847 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400b580 con 0x7fc100150e40 2023-08-22T00:07:02.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc0ff7fe700 1 -- 172.21.15.98:0/2806143847 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400b6e0 con 0x7fc100150e40 2023-08-22T00:07:02.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc0ff7fe700 1 -- 172.21.15.98:0/2806143847 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400ba80 con 0x7fc100150e40 2023-08-22T00:07:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 -- 172.21.15.98:0/2806143847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 msgr2=0x7fc1000c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc1000c2050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fc0f4006fd0 tx=0x7fc0f40090f0).stop 2023-08-22T00:07:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 -- 172.21.15.98:0/2806143847 shutdown_connections 2023-08-22T00:07:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc100066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 --2- 172.21.15.98:0/2806143847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc1000c2050 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 -- 172.21.15.98:0/2806143847 >> 172.21.15.98:0/2806143847 conn(0x7fc10006a980 msgr2=0x7fc1000c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 -- 172.21.15.98:0/2806143847 shutdown_connections 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.802+0000 7fc106c84700 1 -- 172.21.15.98:0/2806143847 wait complete. 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.804+0000 7fc106c84700 1 Processor -- start 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.804+0000 7fc106c84700 1 -- start start 2023-08-22T00:07:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc1001661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1000bd870 0x7fc100063050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100154110 con 0x7fc100150e40 2023-08-22T00:07:02.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000abf70 con 0x7fc1000bd870 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc106c84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc100148a80 con 0x7fc100065f10 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35960/0 (socket says 172.21.15.98:35960) 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 -- 172.21.15.98:0/749058990 learned_addr learned my addr 172.21.15.98:0/749058990 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc104a20700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc1001661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc0fffff700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1000bd870 0x7fc100063050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 -- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 msgr2=0x7fc1001661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc1001661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 -- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1000bd870 msgr2=0x7fc100063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1000bd870 0x7fc100063050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.805+0000 7fc105221700 1 -- 172.21.15.98:0/749058990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009370 con 0x7fc100150e40 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc105221700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fc0f8009e90 tx=0x7fc0f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800cc20 con 0x7fc100150e40 2023-08-22T00:07:02.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800f040 con 0x7fc100150e40 2023-08-22T00:07:02.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1001666d0 con 0x7fc100150e40 2023-08-22T00:07:02.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8013400 con 0x7fc100150e40 2023-08-22T00:07:02.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.806+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc100153eb0 con 0x7fc100150e40 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.807+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100047480 con 0x7fc100150e40 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.807+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc0f80137b0 con 0x7fc100150e40 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.808+0000 7fc0fcff9700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 0x7fc0e40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.808+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7fc0f807ab00 con 0x7fc100150e40 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.808+0000 7fc104a20700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 0x7fc0e40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.808+0000 7fc104a20700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 0x7fc0e40612d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc0f4009fd0 tx=0x7fc0f4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:02.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.812+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0f804bbb0 con 0x7fc100150e40 2023-08-22T00:07:02.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.972+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1000a6c90 con 0x7fc100150e40 2023-08-22T00:07:02.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.973+0000 7fc0fcff9700 1 -- 172.21.15.98:0/749058990 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19177 (secure 0 0 0) 0x7fc0f804f1d0 con 0x7fc100150e40 2023-08-22T00:07:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:02.979 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":28,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:06:57.211195+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:06:07.002336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-22T00:06:07.603848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-22T00:06:10.670760+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:02.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.974+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 msgr2=0x7fc0e40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.974+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 0x7fc0e40612d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc0f4009fd0 tx=0x7fc0f4017000).stop 2023-08-22T00:07:02.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.974+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 msgr2=0x7fc10013bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:02.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.974+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fc0f8009e90 tx=0x7fc0f800b040).stop 2023-08-22T00:07:02.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 shutdown_connections 2023-08-22T00:07:02.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc0e405ee10 0x7fc0e40612d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc100065f10 0x7fc1001661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100150e40 0x7fc10013bff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 --2- 172.21.15.98:0/749058990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1000bd870 0x7fc100063050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:02.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 >> 172.21.15.98:0/749058990 conn(0x7fc10006a980 msgr2=0x7fc1000c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:02.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 shutdown_connections 2023-08-22T00:07:02.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:02.975+0000 7fc106c84700 1 -- 172.21.15.98:0/749058990 wait complete. 2023-08-22T00:07:02.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.107+0000 7f6ae1ab7700 1 Processor -- start 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.107+0000 7f6ae1ab7700 1 -- start start 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ae1ab7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6adc0bcff0 0x7f6adc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ae1ab7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0c1840 con 0x7f6adc0bcc10 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ae1ab7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0bc640 con 0x7f6adc066da0 2023-08-22T00:07:03.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ae1ab7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0bd400 con 0x7f6adc0bcff0 2023-08-22T00:07:03.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6adb7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6adc0bcc10 0x7f6adc066690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56424/0 (socket says 172.21.15.98:56424) 2023-08-22T00:07:03.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6adb7fe700 1 -- 172.21.15.98:0/3903434061 learned_addr learned my addr 172.21.15.98:0/3903434061 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:03.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853473506 0 0) 0x7f6adc0c1840 con 0x7f6adc0bcc10 2023-08-22T00:07:03.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac40033f0 con 0x7f6adc0bcc10 2023-08-22T00:07:03.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6adbfff700 1 --2- 172.21.15.98:0/3903434061 >> v2:172.21.15.118:3300/0 conn(0x7f6adc0bcff0 0x7f6adc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1081191514 0 0) 0x7f6ac40033f0 con 0x7f6adc0bcc10 2023-08-22T00:07:03.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 >> v2:172.21.15.118:3300/0 conn(0x7f6adc0bcff0 msgr2=0x7f6adc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:03.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 --2- 172.21.15.98:0/3903434061 >> v2:172.21.15.118:3300/0 conn(0x7f6adc0bcff0 0x7f6adc0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 >> v1:172.21.15.118:6789/0 conn(0x7f6adc066da0 legacy=0x7f6adc14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0c0f10 con 0x7f6adc0bcc10 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f6ad0001470 con 0x7f6adc0bcc10 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 >> v1:172.21.15.98:6789/0 conn(0x7f6adc0bcc10 legacy=0x7f6adc066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac40038e0 0x7f6ac4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 0x7f6ac4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.108+0000 7f6ada7fc700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4005050 0x7f6ac400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400bfb0 con 0x7f6ac4004690 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c120 con 0x7f6ac4005050 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c2e0 con 0x7f6ac40038e0 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 0x7f6ac4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adb7fe700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac40038e0 0x7f6ac4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adbfff700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4005050 0x7f6ac400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 -- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac40038e0 msgr2=0x7f6ac4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:03.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ac40038e0 0x7f6ac4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 -- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4005050 msgr2=0x7f6ac400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4005050 0x7f6ac400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 -- 172.21.15.98:0/3903434061 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40033f0 con 0x7f6ac4004690 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adbfff700 1 -- 172.21.15.98:0/3903434061 reap_dead start 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6adaffd700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 0x7f6ac4004b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6acc001760 tx=0x7f6acc007bb0).ready entity=mon.0 client_cookie=f5608cd455fd40c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:03.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007020 con 0x7f6ac4004690 2023-08-22T00:07:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc007180 con 0x7f6ac4004690 2023-08-22T00:07:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ada7fc700 1 -- 172.21.15.98:0/3903434061 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007520 con 0x7f6ac4004690 2023-08-22T00:07:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 msgr2=0x7f6ac4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.109+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 0x7f6ac4004b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6acc001760 tx=0x7f6acc007bb0).stop 2023-08-22T00:07:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.110+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/3903434061 shutdown_connections 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.110+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/3903434061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac4004690 0x7f6ac4004b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.110+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/3903434061 >> 172.21.15.98:0/3903434061 conn(0x7f6adc0c3170 msgr2=0x7f6adc0c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.110+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/3903434061 shutdown_connections 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.110+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/3903434061 wait complete. 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.111+0000 7f6ae1ab7700 1 Processor -- start 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.111+0000 7f6ae1ab7700 1 -- start start 2023-08-22T00:07:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 0x7f6adc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 0x7f6adc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ab480 con 0x7f6adc0a9680 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0a9b00 con 0x7f6ac4004690 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc152800 con 0x7f6adc14c130 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35982/0 (socket says 172.21.15.98:35982) 2023-08-22T00:07:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 -- 172.21.15.98:0/513864559 learned_addr learned my addr 172.21.15.98:0/513864559 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adbfff700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 0x7f6adc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adb7fe700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 0x7f6adc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 -- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 msgr2=0x7f6adc068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 0x7f6adc068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 -- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 msgr2=0x7f6adc152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 0x7f6adc152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 -- 172.21.15.98:0/513864559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc152ae0 con 0x7f6adc0a9680 2023-08-22T00:07:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adbfff700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 0x7f6adc068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adb7fe700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 0x7f6adc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6adaffd700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6ac400c0f0 tx=0x7f6acc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc006ee0 con 0x7f6adc0a9680 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc01e440 con 0x7f6adc0a9680 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc152dc0 con 0x7f6adc0a9680 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc01e800 con 0x7f6adc0a9680 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.112+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc161cd0 con 0x7f6adc0a9680 2023-08-22T00:07:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.113+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc067d20 con 0x7f6adc0a9680 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.114+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6acc012400 con 0x7f6adc0a9680 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.114+0000 7f6ac37fe700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 0x7f6ac80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.114+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7079+0+0 (secure 0 0 0) 0x7f6acc07b210 con 0x7f6adc0a9680 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.114+0000 7f6adb7fe700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 0x7f6ac80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.114+0000 7f6adb7fe700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 0x7f6ac80612d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6adc154230 tx=0x7f6ad0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.118+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6acc04c260 con 0x7f6adc0a9680 2023-08-22T00:07:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:03.320+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6adc0c11f0 con 0x7f6adc0a9680 2023-08-22T00:07:04.244 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:07:04.243+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:07:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.248+0000 7f6ac37fe700 1 -- 172.21.15.98:0/513864559 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6acc023020 con 0x7f6adc0a9680 2023-08-22T00:07:04.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 msgr2=0x7f6ac80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 0x7f6ac80612d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6adc154230 tx=0x7f6ad0009040).stop 2023-08-22T00:07:04.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 msgr2=0x7f6adc1617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6ac400c0f0 tx=0x7f6acc016000).stop 2023-08-22T00:07:04.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 shutdown_connections 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac805ee10 0x7f6ac80612d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6adc14c130 0x7f6adc068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac4004690 0x7f6adc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 --2- 172.21.15.98:0/513864559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6adc0a9680 0x7f6adc1617e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 >> 172.21.15.98:0/513864559 conn(0x7f6adc0c3170 msgr2=0x7f6adc0c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 shutdown_connections 2023-08-22T00:07:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.251+0000 7f6ae1ab7700 1 -- 172.21.15.98:0/513864559 wait complete. 2023-08-22T00:07:04.255 INFO:tasks.ceph.mds.b.smithi118.stderr: -4305> 2023-08-22T00:06:10.260+0000 7f23dc7fb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:07:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:07:04.268 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:07:04.282 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:07:04.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.394+0000 7f06b5d4b700 1 Processor -- start 2023-08-22T00:07:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.395+0000 7f06b5d4b700 1 -- start start 2023-08-22T00:07:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.395+0000 7f06b5d4b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f06b00654d0 0x7f06b00c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.395+0000 7f06b5d4b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b0154730 con 0x7f06b01542a0 2023-08-22T00:07:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.395+0000 7f06b5d4b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b0154a10 con 0x7f06b00658b0 2023-08-22T00:07:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.395+0000 7f06b5d4b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b0154cf0 con 0x7f06b00654d0 2023-08-22T00:07:04.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06affff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f06b01542a0 0x7f06b0065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56438/0 (socket says 172.21.15.98:56438) 2023-08-22T00:07:04.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06affff700 1 -- 172.21.15.98:0/2504598621 learned_addr learned my addr 172.21.15.98:0/2504598621 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:04.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336657022 0 0) 0x7f06b0154730 con 0x7f06b01542a0 2023-08-22T00:07:04.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06980033f0 con 0x7f06b01542a0 2023-08-22T00:07:04.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 --2- 172.21.15.98:0/2504598621 >> v2:172.21.15.118:3300/0 conn(0x7f06b00654d0 0x7f06b00c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419847888 0 0) 0x7f06980033f0 con 0x7f06b01542a0 2023-08-22T00:07:04.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 >> v2:172.21.15.118:3300/0 conn(0x7f06b00654d0 msgr2=0x7f06b00c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:04.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 --2- 172.21.15.98:0/2504598621 >> v2:172.21.15.118:3300/0 conn(0x7f06b00654d0 0x7f06b00c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 >> v1:172.21.15.118:6789/0 conn(0x7f06b00658b0 legacy=0x7f06b00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0154fd0 con 0x7f06b01542a0 2023-08-22T00:07:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f06a80017f0 con 0x7f06b01542a0 2023-08-22T00:07:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 >> v1:172.21.15.98:6789/0 conn(0x7f06b01542a0 legacy=0x7f06b0065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 0x7f0698003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0698004690 0x7f0698004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0698005000 0x7f069800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0154cf0 con 0x7f06980038e0 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069800bf60 con 0x7f0698005000 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069800c0f0 con 0x7f0698004690 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 0x7f0698003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06aeffd700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0698004690 0x7f0698004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06affff700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0698005000 0x7f069800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 -- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0698004690 msgr2=0x7f0698004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0698004690 0x7f0698004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 -- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0698005000 msgr2=0x7f069800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0698005000 0x7f069800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06af7fe700 1 -- 172.21.15.98:0/2504598621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980033f0 con 0x7f06980038e0 2023-08-22T00:07:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06aeffd700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0698004690 0x7f0698004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06affff700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0698005000 0x7f069800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.396+0000 7f06affff700 1 -- 172.21.15.98:0/2504598621 reap_dead start 2023-08-22T00:07:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06af7fe700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 0x7f0698003d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f06a4009a80 tx=0x7f06a4009060).ready entity=mon.0 client_cookie=f50b0fcd7e4c8764 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4009430 con 0x7f06980038e0 2023-08-22T00:07:04.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400e640 con 0x7f06980038e0 2023-08-22T00:07:04.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06ae7fc700 1 -- 172.21.15.98:0/2504598621 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400e9c0 con 0x7f06980038e0 2023-08-22T00:07:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 -- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 msgr2=0x7f0698003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 0x7f0698003d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f06a4009a80 tx=0x7f06a4009060).stop 2023-08-22T00:07:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 -- 172.21.15.98:0/2504598621 shutdown_connections 2023-08-22T00:07:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/2504598621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06980038e0 0x7f0698003d00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 -- 172.21.15.98:0/2504598621 >> 172.21.15.98:0/2504598621 conn(0x7f06b00c7800 msgr2=0x7f06b00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 -- 172.21.15.98:0/2504598621 shutdown_connections 2023-08-22T00:07:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.397+0000 7f06b5d4b700 1 -- 172.21.15.98:0/2504598621 wait complete. 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 Processor -- start 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 -- start start 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 0x7f06b00a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b00a81a0 0x7f06b0167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00a8bb0 con 0x7f06b014d5f0 2023-08-22T00:07:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00a8e90 con 0x7f06b00a81a0 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06b5d4b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00a9170 con 0x7f06980038e0 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06aeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06aeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36008/0 (socket says 172.21.15.98:36008) 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.399+0000 7f06aeffd700 1 -- 172.21.15.98:0/3079250378 learned_addr learned my addr 172.21.15.98:0/3079250378 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06affff700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b00a81a0 0x7f06b0167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06af7fe700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 0x7f06b00a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 -- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 msgr2=0x7f06b00a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 0x7f06b00a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 -- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b00a81a0 msgr2=0x7f06b0167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b00a81a0 0x7f06b0167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 -- 172.21.15.98:0/3079250378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00a9450 con 0x7f06b014d5f0 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06af7fe700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 0x7f06b00a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06aeffd700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f06a0000f60 tx=0x7f06a0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0010450 con 0x7f06b014d5f0 2023-08-22T00:07:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00105b0 con 0x7f06b014d5f0 2023-08-22T00:07:04.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b00a9e60 con 0x7f06b014d5f0 2023-08-22T00:07:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0010930 con 0x7f06b014d5f0 2023-08-22T00:07:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.400+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b0168100 con 0x7f06b014d5f0 2023-08-22T00:07:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.401+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b00a9640 con 0x7f06b014d5f0 2023-08-22T00:07:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.401+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f06a0010ce0 con 0x7f06b014d5f0 2023-08-22T00:07:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.402+0000 7f06977fe700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 0x7f069c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.402+0000 7f06af7fe700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 0x7f069c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.402+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7165+0+0 (secure 0 0 0) 0x7f06a007a1f0 con 0x7f06b014d5f0 2023-08-22T00:07:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.402+0000 7f06af7fe700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 0x7f069c061300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f06a4006d50 tx=0x7f06a401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.406+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06a004b250 con 0x7f06b014d5f0 2023-08-22T00:07:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:04.607+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06b00c3230 con 0x7f06b014d5f0 2023-08-22T00:07:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.249+0000 7f06977fe700 1 -- 172.21.15.98:0/3079250378 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f06a004e870 con 0x7f06b014d5f0 2023-08-22T00:07:05.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 msgr2=0x7f069c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 0x7f069c061300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f06a4006d50 tx=0x7f06a401a000).stop 2023-08-22T00:07:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 msgr2=0x7f06b00a7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f06a0000f60 tx=0x7f06a0009040).stop 2023-08-22T00:07:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 shutdown_connections 2023-08-22T00:07:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069c05ee40 0x7f069c061300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06980038e0 0x7f06b00a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b00a81a0 0x7f06b0167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 --2- 172.21.15.98:0/3079250378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b014d5f0 0x7f06b00a7cb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 >> 172.21.15.98:0/3079250378 conn(0x7f06b00c7800 msgr2=0x7f06b00bd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 shutdown_connections 2023-08-22T00:07:05.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.252+0000 7f06b5d4b700 1 -- 172.21.15.98:0/3079250378 wait complete. 2023-08-22T00:07:05.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:07:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.399+0000 7f1cc5a2c700 1 Processor -- start 2023-08-22T00:07:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.399+0000 7f1cc5a2c700 1 -- start start 2023-08-22T00:07:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cc5a2c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1cc00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cc5a2c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1cc00bfd80 0x7f1cc00c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cc5a2c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0155360 con 0x7f1cc0157fe0 2023-08-22T00:07:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cc5a2c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc0157b50 con 0x7f1cc00bfd80 2023-08-22T00:07:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cc5a2c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c6390 con 0x7f1cc0153ae0 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbf7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1cc0157fe0 0x7f1cc00645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56450/0 (socket says 172.21.15.98:56450) 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbf7fe700 1 -- 172.21.15.98:0/872920999 learned_addr learned my addr 172.21.15.98:0/872920999 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793855061 0 0) 0x7f1cb8001490 con 0x7f1cc0157fe0 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbe7fc700 1 --2- 172.21.15.98:0/872920999 >> v2:172.21.15.118:3300/0 conn(0x7f1cc00bfd80 0x7f1cc00c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1cc00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca80033f0 con 0x7f1cc0157fe0 2023-08-22T00:07:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544210182 0 0) 0x7f1ca80033f0 con 0x7f1cc0157fe0 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 msgr2=0x7f1cc00c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1cc00c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 >> v2:172.21.15.118:3300/0 conn(0x7f1cc00bfd80 msgr2=0x7f1cc00c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 --2- 172.21.15.98:0/872920999 >> v2:172.21.15.118:3300/0 conn(0x7f1cc00bfd80 0x7f1cc00c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0154ac0 con 0x7f1cc0157fe0 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.400+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f1cb8001980 con 0x7f1cc0157fe0 2023-08-22T00:07:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 >> v1:172.21.15.98:6789/0 conn(0x7f1cc0157fe0 legacy=0x7f1cc00645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca80038e0 0x7f1ca8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1ca8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca8004b80 0x7f1ca8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0157b50 con 0x7f1ca80038e0 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c6390 con 0x7f1ca8004b80 2023-08-22T00:07:05.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800b8e0 con 0x7f1cc0153ae0 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca80038e0 0x7f1ca8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbe7fc700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1ca8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbf7fe700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca8004b80 0x7f1ca8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 -- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 msgr2=0x7f1ca8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0153ae0 0x7f1ca8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 -- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca8004b80 msgr2=0x7f1ca8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca8004b80 0x7f1ca8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 -- 172.21.15.98:0/872920999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80033f0 con 0x7f1ca80038e0 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca80038e0 0x7f1ca8003d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1cb4009a80 tx=0x7f1cb4009060).ready entity=mon.0 client_cookie=7a375153229d023f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4009430 con 0x7f1ca80038e0 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400e640 con 0x7f1ca80038e0 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.401+0000 7f1cbdffb700 1 -- 172.21.15.98:0/872920999 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400e9c0 con 0x7f1ca80038e0 2023-08-22T00:07:05.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/872920999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca80038e0 msgr2=0x7f1ca8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/872920999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca80038e0 0x7f1ca8003d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1cb4009a80 tx=0x7f1cb4009060).stop 2023-08-22T00:07:05.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cbf7fe700 1 -- 172.21.15.98:0/872920999 reap_dead start 2023-08-22T00:07:05.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/872920999 shutdown_connections 2023-08-22T00:07:05.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/872920999 >> 172.21.15.98:0/872920999 conn(0x7f1cc00caa50 msgr2=0x7f1cc00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:05.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/872920999 shutdown_connections 2023-08-22T00:07:05.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.402+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/872920999 wait complete. 2023-08-22T00:07:05.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.403+0000 7f1cc5a2c700 1 Processor -- start 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.403+0000 7f1cc5a2c700 1 -- start start 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca80038e0 0x7f1cc00ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 0x7f1cc00ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c2e30 con 0x7f1cc014d480 2023-08-22T00:07:05.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c4570 con 0x7f1ca80038e0 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cc5a2c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00a9a80 con 0x7f1cc0152540 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36026/0 (socket says 172.21.15.98:36026) 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 -- 172.21.15.98:0/309564183 learned_addr learned my addr 172.21.15.98:0/309564183 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca80038e0 0x7f1cc00ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbf7fe700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 0x7f1cc00ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 -- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 msgr2=0x7f1cc00ac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 0x7f1cc00ac560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 -- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca80038e0 msgr2=0x7f1cc00ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca80038e0 0x7f1cc00ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 -- 172.21.15.98:0/309564183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00a9d20 con 0x7f1cc014d480 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbf7fe700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 0x7f1cc00ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:05.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.404+0000 7f1cbe7fc700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1cb00119c0 tx=0x7f1cb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.405+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0011eb0 con 0x7f1cc014d480 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.405+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000f940 con 0x7f1cc014d480 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.405+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000fce0 con 0x7f1cc014d480 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.405+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00aa000 con 0x7f1cc014d480 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.405+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc014d900 con 0x7f1cc014d480 2023-08-22T00:07:05.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.406+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc014db50 con 0x7f1cc014d480 2023-08-22T00:07:05.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.406+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1cb0014650 con 0x7f1cc014d480 2023-08-22T00:07:05.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.406+0000 7f1ca6ffd700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 0x7f1cac061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:05.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.406+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7165+0+0 (secure 0 0 0) 0x7f1cb007a9e0 con 0x7f1cc014d480 2023-08-22T00:07:05.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.406+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 0x7f1cac061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:05.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.407+0000 7f1cbeffd700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 0x7f1cac061300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1cb4006d50 tx=0x7f1cb401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:05.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.411+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cb004ba40 con 0x7f1cc014d480 2023-08-22T00:07:05.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:05.573+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1cc0047480 con 0x7f1cc014d480 2023-08-22T00:07:06.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.253+0000 7f1ca6ffd700 1 -- 172.21.15.98:0/309564183 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1cb0022070 con 0x7f1cc014d480 2023-08-22T00:07:06.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 msgr2=0x7f1cac061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 0x7f1cac061300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1cb4006d50 tx=0x7f1cb401a000).stop 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 msgr2=0x7f1cc0152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1cb00119c0 tx=0x7f1cb0009060).stop 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 shutdown_connections 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cac05ee40 0x7f1cac061300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cc0152540 0x7f1cc00ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ca80038e0 0x7f1cc00ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 --2- 172.21.15.98:0/309564183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc014d480 0x7f1cc0152050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.256+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 >> 172.21.15.98:0/309564183 conn(0x7f1cc00caa50 msgr2=0x7f1cc0156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:06.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.257+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 shutdown_connections 2023-08-22T00:07:06.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.257+0000 7f1cc5a2c700 1 -- 172.21.15.98:0/309564183 wait complete. 2023-08-22T00:07:06.265 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:07:06.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:07:06.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.396+0000 7f8d54e95700 1 Processor -- start 2023-08-22T00:07:06.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.396+0000 7f8d54e95700 1 -- start start 2023-08-22T00:07:06.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.397+0000 7f8d54e95700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.397+0000 7f8d54e95700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d500c4940 0x7f8d500bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.397+0000 7f8d54e95700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500bd650 con 0x7f8d50151e40 2023-08-22T00:07:06.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.397+0000 7f8d54e95700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500639a0 con 0x7f8d500c4940 2023-08-22T00:07:06.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.397+0000 7f8d54e95700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50063070 con 0x7f8d50151a60 2023-08-22T00:07:06.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d500c4940 0x7f8d500bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4e59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d500c4940 0x7f8d500bc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38918/0 (socket says 172.21.15.98:38918) 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4e59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:57936/0 (socket says 172.21.15.98:57936) 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/3891781972 learned_addr learned my addr 172.21.15.98:0/3891781972 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4dd9b700 1 --1- 172.21.15.98:0/3891781972 >> v1:172.21.15.118:6789/0 conn(0x7f8d50151e40 0x7f8d500c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:53366/0 (socket says 172.21.15.98:53366) 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 msgr2=0x7f8d500a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/3891781972 >> v1:172.21.15.118:6789/0 conn(0x7f8d50151e40 legacy=0x7f8d500c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/3891781972 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50063350 con 0x7f8d500c4940 2023-08-22T00:07:06.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4e59c700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:06.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4ed9d700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d500bc8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8d48009f50 tx=0x7f8d48009840).ready entity=mon.1 client_cookie=b5c7a142333c6c60 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:06.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4d59a700 1 -- 172.21.15.98:0/3891781972 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800e070 con 0x7f8d500c4940 2023-08-22T00:07:06.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4d59a700 1 -- 172.21.15.98:0/3891781972 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800b9c0 con 0x7f8d500c4940 2023-08-22T00:07:06.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.398+0000 7f8d4d59a700 1 -- 172.21.15.98:0/3891781972 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800bd40 con 0x7f8d500c4940 2023-08-22T00:07:06.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 -- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 msgr2=0x7f8d500bc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d500bc8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8d48009f50 tx=0x7f8d48009840).stop 2023-08-22T00:07:06.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 -- 172.21.15.98:0/3891781972 shutdown_connections 2023-08-22T00:07:06.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d500bc8c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 --2- 172.21.15.98:0/3891781972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 -- 172.21.15.98:0/3891781972 >> 172.21.15.98:0/3891781972 conn(0x7f8d5006a910 msgr2=0x7f8d50065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 -- 172.21.15.98:0/3891781972 shutdown_connections 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.399+0000 7f8d54e95700 1 -- 172.21.15.98:0/3891781972 wait complete. 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.400+0000 7f8d54e95700 1 Processor -- start 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 -- start start 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d5014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500a69f0 con 0x7f8d50151e40 2023-08-22T00:07:06.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500a6cd0 con 0x7f8d500c4940 2023-08-22T00:07:06.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.401+0000 7f8d54e95700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500a6fb0 con 0x7f8d50151a60 2023-08-22T00:07:06.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36038/0 (socket says 172.21.15.98:36038) 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/1142035998 learned_addr learned my addr 172.21.15.98:0/1142035998 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4e59c700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d5014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4dd9b700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 msgr2=0x7f8d500ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 msgr2=0x7f8d5014bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d5014bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 -- 172.21.15.98:0/1142035998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440092a0 con 0x7f8d50151e40 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4e59c700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d5014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d4ed9d700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8d48009540 tx=0x7f8d48009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480092e0 con 0x7f8d50151e40 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4801e470 con 0x7f8d50151e40 2023-08-22T00:07:06.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d48009ae0 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4801e830 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.402+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500bebb0 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.403+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500beda0 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.403+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8d48003040 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.404+0000 7f8d3e7fc700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 0x7f8d300612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.404+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f8d4807b690 con 0x7f8d50151e40 2023-08-22T00:07:06.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.404+0000 7f8d4e59c700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 0x7f8d300612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:06.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.404+0000 7f8d4e59c700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 0x7f8d300612d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8d44009270 tx=0x7f8d44008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:06.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.408+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d4804c910 con 0x7f8d50151e40 2023-08-22T00:07:06.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:06.571+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8d50047480 con 0x7f8d50151e40 2023-08-22T00:07:07.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.258+0000 7f8d3e7fc700 1 -- 172.21.15.98:0/1142035998 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8d48023070 con 0x7f8d50151e40 2023-08-22T00:07:07.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 msgr2=0x7f8d300612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:07.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 0x7f8d300612d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8d44009270 tx=0x7f8d44008040).stop 2023-08-22T00:07:07.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 msgr2=0x7f8d500c0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:07.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8d48009540 tx=0x7f8d48009840).stop 2023-08-22T00:07:07.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 shutdown_connections 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d50151e40 0x7f8d500c0880 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d500c4940 0x7f8d5014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8d3005ee10 0x7f8d300612d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 --2- 172.21.15.98:0/1142035998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d50151a60 0x7f8d500ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.261+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 >> 172.21.15.98:0/1142035998 conn(0x7f8d5006a910 msgr2=0x7f8d50156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.262+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 shutdown_connections 2023-08-22T00:07:07.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.262+0000 7f8d54e95700 1 -- 172.21.15.98:0/1142035998 wait complete. 2023-08-22T00:07:07.339 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:07:07.339 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-22T00:07:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.467+0000 7f22ea06f700 1 Processor -- start 2023-08-22T00:07:07.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.467+0000 7f22ea06f700 1 -- start start 2023-08-22T00:07:07.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22ea06f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f22e40c5a30 0x7f22e40a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22ea06f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 0x7f22e40c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22ea06f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40a8b20 con 0x7f22e4153d40 2023-08-22T00:07:07.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22ea06f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40c4630 con 0x7f22e40c5a30 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22ea06f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40a9330 con 0x7f22e40c2e80 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22e2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f22e40c5a30 0x7f22e40a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22e2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f22e40c5a30 0x7f22e40a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36042/0 (socket says 172.21.15.98:36042) 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.468+0000 7f22e2ffd700 1 -- 172.21.15.98:0/407060262 learned_addr learned my addr 172.21.15.98:0/407060262 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e2ffd700 1 -- 172.21.15.98:0/407060262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 msgr2=0x7f22e40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e3fff700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 0x7f22e40c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e2ffd700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 0x7f22e40c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e2ffd700 1 -- 172.21.15.98:0/407060262 >> v1:172.21.15.118:6789/0 conn(0x7f22e4153d40 legacy=0x7f22e40aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e2ffd700 1 -- 172.21.15.98:0/407060262 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40c61a0 con 0x7f22e40c5a30 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e3fff700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 0x7f22e40c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e2ffd700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e40c5a30 0x7f22e40a8e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f22d4006fd0 tx=0x7f22d40090f0).ready entity=mon.0 client_cookie=c9679cda3d3ac77 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e27fc700 1 -- 172.21.15.98:0/407060262 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400b600 con 0x7f22e40c5a30 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e27fc700 1 -- 172.21.15.98:0/407060262 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400b760 con 0x7f22e40c5a30 2023-08-22T00:07:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.469+0000 7f22e27fc700 1 -- 172.21.15.98:0/407060262 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400bae0 con 0x7f22e40c5a30 2023-08-22T00:07:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 -- 172.21.15.98:0/407060262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e40c5a30 msgr2=0x7f22e40a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e40c5a30 0x7f22e40a8e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f22d4006fd0 tx=0x7f22d40090f0).stop 2023-08-22T00:07:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 -- 172.21.15.98:0/407060262 shutdown_connections 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e40c2e80 0x7f22e40c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 --2- 172.21.15.98:0/407060262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e40c5a30 0x7f22e40a8e40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 -- 172.21.15.98:0/407060262 >> 172.21.15.98:0/407060262 conn(0x7f22e40c9320 msgr2=0x7f22e40c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 -- 172.21.15.98:0/407060262 shutdown_connections 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.470+0000 7f22ea06f700 1 -- 172.21.15.98:0/407060262 wait complete. 2023-08-22T00:07:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.471+0000 7f22ea06f700 1 Processor -- start 2023-08-22T00:07:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.471+0000 7f22ea06f700 1 -- start start 2023-08-22T00:07:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 0x7f22e4064c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 0x7f22e4147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40c0060 con 0x7f22e4067010 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e41478f0 con 0x7f22e40c2e80 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4067b80 con 0x7f22e4153d40 2023-08-22T00:07:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36058/0 (socket says 172.21.15.98:36058) 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 -- 172.21.15.98:0/3957447572 learned_addr learned my addr 172.21.15.98:0/3957447572 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e2ffd700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 0x7f22e4147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e37fe700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 0x7f22e4064c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 -- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 msgr2=0x7f22e4147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 0x7f22e4147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 -- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 msgr2=0x7f22e4064c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 0x7f22e4064c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 -- 172.21.15.98:0/3957447572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009370 con 0x7f22e4067010 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e2ffd700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 0x7f22e4147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e37fe700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 0x7f22e4064c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22e3fff700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f22dc00a380 tx=0x7f22dc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00ae10 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00d650 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e40bfa50 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.472+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00d9d0 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.473+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e40bfcf0 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.473+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e40c0210 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.474+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f22dc013070 con 0x7f22e4067010 2023-08-22T00:07:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.474+0000 7f22db7fe700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 0x7f22c40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.474+0000 7f22e37fe700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 0x7f22c40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.474+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f22dc07a630 con 0x7f22e4067010 2023-08-22T00:07:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.474+0000 7f22e37fe700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 0x7f22c40612a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f22cc00a820 tx=0x7f22cc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.478+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22dc04ba90 con 0x7f22e4067010 2023-08-22T00:07:07.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:07.643+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22e4047480 con 0x7f22e4067010 2023-08-22T00:07:08.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.265+0000 7f22db7fe700 1 -- 172.21.15.98:0/3957447572 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f22dc01b0d0 con 0x7f22e4067010 2023-08-22T00:07:08.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 msgr2=0x7f22c40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:08.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 0x7f22c40612a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f22cc00a820 tx=0x7f22cc008040).stop 2023-08-22T00:07:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 msgr2=0x7f22e40c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f22dc00a380 tx=0x7f22dc007900).stop 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 shutdown_connections 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e4067010 0x7f22e40c7360 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e40c2e80 0x7f22e4064c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22c405ede0 0x7f22c40612a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 --2- 172.21.15.98:0/3957447572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22e4153d40 0x7f22e4147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.268+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 >> 172.21.15.98:0/3957447572 conn(0x7f22e40c9320 msgr2=0x7f22e40ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.269+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 shutdown_connections 2023-08-22T00:07:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.269+0000 7f22ea06f700 1 -- 172.21.15.98:0/3957447572 wait complete. 2023-08-22T00:07:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data_ec' removed 2023-08-22T00:07:08.289 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:07:08.290 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:07:08.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:07:08.290 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:07:08.291 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:07:08.291 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:07:08.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:07:08.291 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:07:08.292 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:07:08.292 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:07:08.292 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:07:08.292 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:07:08.293 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:07:08.293 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:07:08.293 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:07:08.293 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:07:08.301 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:07:08.301 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:07:08.302 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:07:08.302 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:07:08.303 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:07:08.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:07:08.304 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:07:08.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:07:08.343 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:07:08.344 DEBUG:teuthology.parallel:result is None 2023-08-22T00:07:08.345 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:07:08.345 DEBUG:teuthology.parallel:result is None 2023-08-22T00:07:08.347 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:07:08.347 DEBUG:teuthology.parallel:result is None 2023-08-22T00:07:08.348 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:07:08.348 DEBUG:teuthology.parallel:result is None 2023-08-22T00:07:08.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:07:08.420 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:07:08.420 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:07:08.440 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:07:08.441 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:07:08.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.480+0000 7fcf08a76700 1 Processor -- start 2023-08-22T00:07:08.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.480+0000 7fcf08a76700 1 -- start start 2023-08-22T00:07:08.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf08a76700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf0414e280 0x7fcf040654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf08a76700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 0x7fcf040679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf08a76700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf04065050 con 0x7fcf0414e660 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf08a76700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf040be650 con 0x7fcf0414e280 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf08a76700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04067ea0 con 0x7fcf04067590 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf0259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf0414e280 0x7fcf040654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf0259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf0414e280 0x7fcf040654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36092/0 (socket says 172.21.15.98:36092) 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.481+0000 7fcf0259c700 1 -- 172.21.15.98:0/785574927 learned_addr learned my addr 172.21.15.98:0/785574927 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf02d9d700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 0x7fcf040679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0259c700 1 -- 172.21.15.98:0/785574927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 msgr2=0x7fcf040679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0259c700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 0x7fcf040679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0259c700 1 -- 172.21.15.98:0/785574927 >> v1:172.21.15.118:6789/0 conn(0x7fcf0414e660 legacy=0x7fcf040bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0259c700 1 -- 172.21.15.98:0/785574927 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04064440 con 0x7fcf0414e280 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf02d9d700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 0x7fcf040679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0259c700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e280 0x7fcf040654e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fcef4006fd0 tx=0x7fcef40090f0).ready entity=mon.0 client_cookie=dff2717c4c2af9b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0159a700 1 -- 172.21.15.98:0/785574927 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400b600 con 0x7fcf0414e280 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0159a700 1 -- 172.21.15.98:0/785574927 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef400b760 con 0x7fcf0414e280 2023-08-22T00:07:08.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.482+0000 7fcf0159a700 1 -- 172.21.15.98:0/785574927 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400bae0 con 0x7fcf0414e280 2023-08-22T00:07:08.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 -- 172.21.15.98:0/785574927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e280 msgr2=0x7fcf040654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:08.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e280 0x7fcf040654e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fcef4006fd0 tx=0x7fcef40090f0).stop 2023-08-22T00:07:08.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 -- 172.21.15.98:0/785574927 shutdown_connections 2023-08-22T00:07:08.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf04067590 0x7fcf040679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 --2- 172.21.15.98:0/785574927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e280 0x7fcf040654e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 -- 172.21.15.98:0/785574927 >> 172.21.15.98:0/785574927 conn(0x7fcf040c7800 msgr2=0x7fcf040c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:08.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 -- 172.21.15.98:0/785574927 shutdown_connections 2023-08-22T00:07:08.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.483+0000 7fcf08a76700 1 -- 172.21.15.98:0/785574927 wait complete. 2023-08-22T00:07:08.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.484+0000 7fcf08a76700 1 Processor -- start 2023-08-22T00:07:08.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.484+0000 7fcf08a76700 1 -- start start 2023-08-22T00:07:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf04067590 0x7fcf040c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf0414e280 0x7fcf04149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040bf990 con 0x7fcf0414e660 2023-08-22T00:07:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0414a920 con 0x7fcf04067590 2023-08-22T00:07:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040bed60 con 0x7fcf0414e280 2023-08-22T00:07:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36100/0 (socket says 172.21.15.98:36100) 2023-08-22T00:07:08.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 -- 172.21.15.98:0/2723270154 learned_addr learned my addr 172.21.15.98:0/2723270154 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:08.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf01d9b700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf0414e280 0x7fcf04149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf0259c700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf04067590 0x7fcf040c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 -- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf0414e280 msgr2=0x7fcf04149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf0414e280 0x7fcf04149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 -- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf04067590 msgr2=0x7fcf040c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf04067590 0x7fcf040c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 -- 172.21.15.98:0/2723270154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009370 con 0x7fcf0414e660 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf02d9d700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fcefc00cef0 tx=0x7fcefc007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00ad20 con 0x7fcf0414e660 2023-08-22T00:07:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc00ae80 con 0x7fcf0414e660 2023-08-22T00:07:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf040bf340 con 0x7fcf0414e660 2023-08-22T00:07:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.485+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc016610 con 0x7fcf0414e660 2023-08-22T00:07:08.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.486+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf040c1690 con 0x7fcf0414e660 2023-08-22T00:07:08.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040bfb00 con 0x7fcf0414e660 2023-08-22T00:07:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcefc01f3f0 con 0x7fcf0414e660 2023-08-22T00:07:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcef27fc700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 0x7fcee40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fcefc07a250 con 0x7fcf0414e660 2023-08-22T00:07:08.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcf0259c700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 0x7fcee40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:08.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.487+0000 7fcf0259c700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 0x7fcee40612d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcef4009130 tx=0x7fcef4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:08.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.491+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcefc04b800 con 0x7fcf0414e660 2023-08-22T00:07:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:08.668+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcf041551b0 con 0x7fcf0414e660 2023-08-22T00:07:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.475+0000 7fcef27fc700 1 -- 172.21.15.98:0/2723270154 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcefc04ee20 con 0x7fcf0414e660 2023-08-22T00:07:09.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 msgr2=0x7fcee40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 0x7fcee40612d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcef4009130 tx=0x7fcef4017000).stop 2023-08-22T00:07:09.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 msgr2=0x7fcf0414bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fcefc00cef0 tx=0x7fcefc007860).stop 2023-08-22T00:07:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 shutdown_connections 2023-08-22T00:07:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0414e660 0x7fcf0414bc10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf04067590 0x7fcf040c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcee405ee10 0x7fcee40612d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 --2- 172.21.15.98:0/2723270154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf0414e280 0x7fcf04149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 >> 172.21.15.98:0/2723270154 conn(0x7fcf040c7800 msgr2=0x7fcf04156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 shutdown_connections 2023-08-22T00:07:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.477+0000 7fcf08a76700 1 -- 172.21.15.98:0/2723270154 wait complete. 2023-08-22T00:07:09.483 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:07:09.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:07:09.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.617+0000 7f13e0263700 1 Processor -- start 2023-08-22T00:07:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.617+0000 7f13e0263700 1 -- start start 2023-08-22T00:07:09.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.618+0000 7f13e0263700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 0x7f13d80c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.618+0000 7f13e0263700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f13d8065f10 0x7f13d8066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.618+0000 7f13e0263700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80bd3e0 con 0x7f13d80bd870 2023-08-22T00:07:09.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.618+0000 7f13e0263700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80bd0c0 con 0x7f13d8065f10 2023-08-22T00:07:09.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.618+0000 7f13e0263700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d8066830 con 0x7f13d8150e40 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f13d8065f10 0x7f13d8066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f13d8065f10 0x7f13d8066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36114/0 (socket says 172.21.15.98:36114) 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 -- 172.21.15.98:0/1613711008 learned_addr learned my addr 172.21.15.98:0/1613711008 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1613711008 >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 0x7f13d80c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 -- 172.21.15.98:0/1613711008 >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 msgr2=0x7f13d80c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 --2- 172.21.15.98:0/1613711008 >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 0x7f13d80c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 -- 172.21.15.98:0/1613711008 >> v1:172.21.15.118:6789/0 conn(0x7f13d80bd870 legacy=0x7f13d80a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 -- 172.21.15.98:0/1613711008 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80c3bb0 con 0x7f13d8065f10 2023-08-22T00:07:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1613711008 >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 0x7f13d80c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13de800700 1 --2- 172.21.15.98:0/1613711008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8065f10 0x7f13d8066340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f13d80c52a0 tx=0x7f13d0009840).ready entity=mon.0 client_cookie=dd4d8c0aa7178fac server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13dcffd700 1 -- 172.21.15.98:0/1613711008 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000e070 con 0x7f13d8065f10 2023-08-22T00:07:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13dcffd700 1 -- 172.21.15.98:0/1613711008 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000ba10 con 0x7f13d8065f10 2023-08-22T00:07:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.619+0000 7f13dcffd700 1 -- 172.21.15.98:0/1613711008 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000bd90 con 0x7f13d8065f10 2023-08-22T00:07:09.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 -- 172.21.15.98:0/1613711008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8065f10 msgr2=0x7f13d8066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 --2- 172.21.15.98:0/1613711008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8065f10 0x7f13d8066340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f13d80c52a0 tx=0x7f13d0009840).stop 2023-08-22T00:07:09.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 -- 172.21.15.98:0/1613711008 shutdown_connections 2023-08-22T00:07:09.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 --2- 172.21.15.98:0/1613711008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8065f10 0x7f13d8066340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 --2- 172.21.15.98:0/1613711008 >> v2:172.21.15.118:3300/0 conn(0x7f13d8150e40 0x7f13d80c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 -- 172.21.15.98:0/1613711008 >> 172.21.15.98:0/1613711008 conn(0x7f13d806a980 msgr2=0x7f13d80c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 -- 172.21.15.98:0/1613711008 shutdown_connections 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.620+0000 7f13e0263700 1 -- 172.21.15.98:0/1613711008 wait complete. 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.621+0000 7f13e0263700 1 Processor -- start 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.621+0000 7f13e0263700 1 -- start start 2023-08-22T00:07:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 0x7f13d80ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 0x7f13d8164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80a38d0 con 0x7f13d8150e40 2023-08-22T00:07:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80a3e90 con 0x7f13d8065f10 2023-08-22T00:07:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8164cd0 con 0x7f13d80bd870 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36120/0 (socket says 172.21.15.98:36120) 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 -- 172.21.15.98:0/1231493018 learned_addr learned my addr 172.21.15.98:0/1231493018 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13dd7fe700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 0x7f13d8164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 0x7f13d80ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 -- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 msgr2=0x7f13d8164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 0x7f13d8164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 -- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 msgr2=0x7f13d80ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 0x7f13d80ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 -- 172.21.15.98:0/1231493018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009ae0 con 0x7f13d8150e40 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 0x7f13d80ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13dd7fe700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 0x7f13d8164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13de800700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f13d80c8800 tx=0x7f13d80be6d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00092e0 con 0x7f13d8150e40 2023-08-22T00:07:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d00070e0 con 0x7f13d8150e40 2023-08-22T00:07:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d001e6a0 con 0x7f13d8150e40 2023-08-22T00:07:09.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.622+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d8164fb0 con 0x7f13d8150e40 2023-08-22T00:07:09.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.623+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d80ac430 con 0x7f13d8150e40 2023-08-22T00:07:09.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.624+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d80a4000 con 0x7f13d8150e40 2023-08-22T00:07:09.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.624+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f13d0003040 con 0x7f13d8150e40 2023-08-22T00:07:09.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.624+0000 7f13cdffb700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 0x7f13bc061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:09.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.624+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f13d007b240 con 0x7f13d8150e40 2023-08-22T00:07:09.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.624+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 0x7f13bc061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:09.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.625+0000 7f13ddfff700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 0x7f13bc061300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f13d4006fd0 tx=0x7f13d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:09.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.628+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13d004c8a0 con 0x7f13d8150e40 2023-08-22T00:07:09.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.851+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f13d8047480 con 0x7f13d8150e40 2023-08-22T00:07:09.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.852+0000 7f13cdffb700 1 -- 172.21.15.98:0/1231493018 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f13d0023070 con 0x7f13d8150e40 2023-08-22T00:07:09.854 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:09.854 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:07:09.854 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:07:09.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.854 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:07:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.857 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:07:09.858 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.860 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:07:09.860 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:07:09.860 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.860 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:07:09.861 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:07:09.862 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.862 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.862 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.862 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.863 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.864 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:07:09.865 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:07:09.866 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.867 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.870 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:07:09.870 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:07:09.870 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.872 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:07:09.872 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:07:09.872 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.872 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:07:09.873 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:07:09.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:07:09.876 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mds", 2023-08-22T00:07:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++NknvJuFBAAdGnbWuhJJ+kJXBhHxGvtSA==", 2023-08-22T00:07:09.878 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.878 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mds" 2023-08-22T00:07:09.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mgr", 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++NkCP1uFBAAwjX06SAtK96GPOysLDwkKw==", 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.879 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-osd", 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++NkfQRvFBAAMKiebI1U7q7Gp0nos6VjKg==", 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-osd" 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd", 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++NkawtvFBAAoo1jv4AbGXBlg55kOzOj7g==", 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.881 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-22T00:07:09.882 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++NkoRJvFBAAyUxilVke14E7aF0L+EQFsw==", 2023-08-22T00:07:09.882 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rgw", 2023-08-22T00:07:09.883 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDf++Nk6RlvFBAA6MrgcJxVTUaoj3R6c82RLQ==", 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:07:09.884 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:07:09.885 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:07:09.886 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:07:09.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 msgr2=0x7f13bc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 0x7f13bc061300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f13d4006fd0 tx=0x7f13d4008040).stop 2023-08-22T00:07:09.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 msgr2=0x7f13d8164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:09.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f13d80c8800 tx=0x7f13d80be6d0).stop 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 shutdown_connections 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d8150e40 0x7f13d8164610 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d8065f10 0x7f13d80ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13bc05ee40 0x7f13bc061300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 --2- 172.21.15.98:0/1231493018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d80bd870 0x7f13d8164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 >> 172.21.15.98:0/1231493018 conn(0x7f13d806a980 msgr2=0x7f13d80c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 shutdown_connections 2023-08-22T00:07:09.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:09.854+0000 7f13e0263700 1 -- 172.21.15.98:0/1231493018 wait complete. 2023-08-22T00:07:09.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-22T00:07:10.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.005+0000 7f95395a0700 1 Processor -- start 2023-08-22T00:07:10.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.005+0000 7f95395a0700 1 -- start start 2023-08-22T00:07:10.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9534150030 0x7f95340bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9534150410 0x7f9534154620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95340c2020 0x7f9534062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340c2570 con 0x7f9534150410 2023-08-22T00:07:10.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340c2850 con 0x7f9534150030 2023-08-22T00:07:10.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95395a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9534153e20 con 0x7f95340c2020 2023-08-22T00:07:10.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95327fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9534150410 0x7f9534154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95327fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9534150410 0x7f9534154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36122/0 (socket says 172.21.15.98:36122) 2023-08-22T00:07:10.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95327fc700 1 -- 172.21.15.98:0/1147020813 learned_addr learned my addr 172.21.15.98:0/1147020813 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:10.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f95337fe700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95340c2020 0x7f9534062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.006+0000 7f9532ffd700 1 --2- 172.21.15.98:0/1147020813 >> v2:172.21.15.118:3300/0 conn(0x7f9534150030 0x7f95340bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 -- 172.21.15.98:0/1147020813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95340c2020 msgr2=0x7f9534062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95340c2020 0x7f9534062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 -- 172.21.15.98:0/1147020813 >> v2:172.21.15.118:3300/0 conn(0x7f9534150030 msgr2=0x7f95340bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 --2- 172.21.15.98:0/1147020813 >> v2:172.21.15.118:3300/0 conn(0x7f9534150030 0x7f95340bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 -- 172.21.15.98:0/1147020813 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534154100 con 0x7f9534150410 2023-08-22T00:07:10.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95327fc700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9534150410 0x7f9534154620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9534068210 tx=0x7f95240090f0).ready entity=mon.0 client_cookie=18a3ff9a0b340b71 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f9531ffb700 1 -- 172.21.15.98:0/1147020813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400b600 con 0x7f9534150410 2023-08-22T00:07:10.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f9531ffb700 1 -- 172.21.15.98:0/1147020813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400b760 con 0x7f9534150410 2023-08-22T00:07:10.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f9531ffb700 1 -- 172.21.15.98:0/1147020813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400bae0 con 0x7f9534150410 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 -- 172.21.15.98:0/1147020813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9534150410 msgr2=0x7f9534154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9534150410 0x7f9534154620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9534068210 tx=0x7f95240090f0).stop 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 -- 172.21.15.98:0/1147020813 shutdown_connections 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95340c2020 0x7f9534062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 --2- 172.21.15.98:0/1147020813 >> v2:172.21.15.118:3300/0 conn(0x7f9534150030 0x7f95340bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 --2- 172.21.15.98:0/1147020813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9534150410 0x7f9534154620 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 -- 172.21.15.98:0/1147020813 >> 172.21.15.98:0/1147020813 conn(0x7f95340c3170 msgr2=0x7f95340c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 -- 172.21.15.98:0/1147020813 shutdown_connections 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.007+0000 7f95395a0700 1 -- 172.21.15.98:0/1147020813 wait complete. 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 Processor -- start 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 -- start start 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9534150030 0x7f95341474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 0x7f9534130f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340a66a0 con 0x7f95340c2020 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95341479b0 con 0x7f9534150410 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.009+0000 7f95395a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95340a74a0 con 0x7f9534150030 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36136/0 (socket says 172.21.15.98:36136) 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 -- 172.21.15.98:0/2562479177 learned_addr learned my addr 172.21.15.98:0/2562479177 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f95327fc700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9534150030 0x7f95341474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f95337fe700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 0x7f9534130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 -- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9534150030 msgr2=0x7f95341474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9534150030 0x7f95341474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 -- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 msgr2=0x7f9534130f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 0x7f9534130f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 -- 172.21.15.98:0/2562479177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009370 con 0x7f95340c2020 2023-08-22T00:07:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f95337fe700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 0x7f9534130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:10.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f9532ffd700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f952800d890 tx=0x7f9528008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280125f0 con 0x7f95340c2020 2023-08-22T00:07:10.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528012750 con 0x7f95340c2020 2023-08-22T00:07:10.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95340a6890 con 0x7f95340c2020 2023-08-22T00:07:10.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528012ad0 con 0x7f95340c2020 2023-08-22T00:07:10.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.010+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95340a6e50 con 0x7f95340c2020 2023-08-22T00:07:10.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.011+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9534067d20 con 0x7f95340c2020 2023-08-22T00:07:10.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.012+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9528013480 con 0x7f95340c2020 2023-08-22T00:07:10.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.012+0000 7f951affd700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 0x7f95200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.012+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9528079950 con 0x7f95340c2020 2023-08-22T00:07:10.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.012+0000 7f95327fc700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 0x7f95200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.012+0000 7f95327fc700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 0x7f95200612d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9534068210 tx=0x7f9524017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.016+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f952804af50 con 0x7f95340c2020 2023-08-22T00:07:10.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.238+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f95340bc4f0 con 0x7f95340c2020 2023-08-22T00:07:10.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.242+0000 7f951affd700 1 -- 172.21.15.98:0/2562479177 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f952804e570 con 0x7f95340c2020 2023-08-22T00:07:10.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 msgr2=0x7f95200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 0x7f95200612d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9534068210 tx=0x7f9524017000).stop 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 msgr2=0x7f95340a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f952800d890 tx=0x7f9528008040).stop 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 shutdown_connections 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9534150410 0x7f9534130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95340c2020 0x7f95340a61b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f952005ee10 0x7f95200612d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 --2- 172.21.15.98:0/2562479177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9534150030 0x7f95341474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 >> 172.21.15.98:0/2562479177 conn(0x7f95340c3170 msgr2=0x7f95340c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 shutdown_connections 2023-08-22T00:07:10.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.244+0000 7f95395a0700 1 -- 172.21.15.98:0/2562479177 wait complete. 2023-08-22T00:07:10.247 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:10.257 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-22T00:07:10.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.373+0000 7fc1c96cf700 1 Processor -- start 2023-08-22T00:07:10.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.373+0000 7fc1c96cf700 1 -- start start 2023-08-22T00:07:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c96cf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc1c4153a60 0x7fc1c4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c96cf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1c40a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c96cf700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40c1800 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c96cf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40aa440 con 0x7fc1c4153a60 2023-08-22T00:07:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c96cf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40c0bf0 con 0x7fc1c40c6210 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c27fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc1c40a9ad0 0x7fc1c40c5b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55380/0 (socket says 172.21.15.98:55380) 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c27fc700 1 -- 172.21.15.98:0/3502592444 learned_addr learned my addr 172.21.15.98:0/3502592444 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c37fe700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1c40a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3502592444 >> v2:172.21.15.118:3300/0 conn(0x7fc1c4153a60 0x7fc1c4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732352122 0 0) 0x7fc1c40c1800 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.374+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b00033f0 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 916810017 0 0) 0x7fc1b00033f0 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 msgr2=0x7fc1c40a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1c40a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 >> v2:172.21.15.118:3300/0 conn(0x7fc1c4153a60 msgr2=0x7fc1c4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 --2- 172.21.15.98:0/3502592444 >> v2:172.21.15.118:3300/0 conn(0x7fc1c4153a60 0x7fc1c4153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40c0ed0 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc1ac001470 con 0x7fc1c40a9ad0 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 >> v1:172.21.15.98:6789/0 conn(0x7fc1c40a9ad0 legacy=0x7fc1c40c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0004b80 0x7fc1b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40aa440 con 0x7fc1b00038e0 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40c0bf0 con 0x7fc1b0004b80 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000b8e0 con 0x7fc1c40c6210 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c27fc700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c37fe700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0004b80 0x7fc1b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 msgr2=0x7fc1b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40c6210 0x7fc1b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0004b80 msgr2=0x7fc1b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0004b80 0x7fc1b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3502592444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00033f0 con 0x7fc1b00038e0 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc1b4009a80 tx=0x7fc1b4009060).ready entity=mon.0 client_cookie=5e7f7d050dd55b9f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4009430 con 0x7fc1b00038e0 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400e640 con 0x7fc1b00038e0 2023-08-22T00:07:10.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.375+0000 7fc1c1ffb700 1 -- 172.21.15.98:0/3502592444 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400e9c0 con 0x7fc1b00038e0 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3502592444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 msgr2=0x7fc1b0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3502592444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc1b4009a80 tx=0x7fc1b4009060).stop 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c37fe700 1 -- 172.21.15.98:0/3502592444 reap_dead start 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3502592444 shutdown_connections 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3502592444 >> 172.21.15.98:0/3502592444 conn(0x7fc1c40650f0 msgr2=0x7fc1c40cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3502592444 shutdown_connections 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.376+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3502592444 wait complete. 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.377+0000 7fc1c96cf700 1 Processor -- start 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.377+0000 7fc1c96cf700 1 -- start start 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c4163e80 0x7fc1c40aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 0x7fc1c41522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40af5b0 con 0x7fc1b00038e0 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40af7d0 con 0x7fc1c4163e80 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c96cf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40ae000 con 0x7fc1c40af150 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60550/0 (socket says 172.21.15.98:60550) 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3983260766 learned_addr learned my addr 172.21.15.98:0/3983260766 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c27fc700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c4163e80 0x7fc1c40aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c37fe700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 0x7fc1c41522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 msgr2=0x7fc1c41522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 0x7fc1c41522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c4163e80 msgr2=0x7fc1c40aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c4163e80 0x7fc1c40aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c2ffd700 1 -- 172.21.15.98:0/3983260766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4150350 con 0x7fc1b00038e0 2023-08-22T00:07:10.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.378+0000 7fc1c37fe700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 0x7fc1c41522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:10.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1c2ffd700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fc1b0004490 tx=0x7fc1b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400ed30 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400eeb0 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c4150630 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b401b450 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.379+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c4150bf0 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.380+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c40c11b0 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.380+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc1b401b800 con 0x7fc1b00038e0 2023-08-22T00:07:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.380+0000 7fc1baffd700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 0x7fc1a40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.380+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fc1b407b520 con 0x7fc1b00038e0 2023-08-22T00:07:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.380+0000 7fc1c27fc700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 0x7fc1a40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.381+0000 7fc1c27fc700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 0x7fc1a40612d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc1c414fce0 tx=0x7fc1ac001e90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.385+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1b404cb20 con 0x7fc1b00038e0 2023-08-22T00:07:10.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.605+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc1c4150f60 con 0x7fc1b00038e0 2023-08-22T00:07:10.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.609+0000 7fc1baffd700 1 -- 172.21.15.98:0/3983260766 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc1b402b020 con 0x7fc1b00038e0 2023-08-22T00:07:10.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 msgr2=0x7fc1a40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 0x7fc1a40612d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc1c414fce0 tx=0x7fc1ac001e90).stop 2023-08-22T00:07:10.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 msgr2=0x7fc1c4163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fc1b0004490 tx=0x7fc1b401a000).stop 2023-08-22T00:07:10.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 shutdown_connections 2023-08-22T00:07:10.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc1a405ee10 0x7fc1a40612d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1c40af150 0x7fc1c41522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1b00038e0 0x7fc1c4163990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 --2- 172.21.15.98:0/3983260766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c4163e80 0x7fc1c40aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 >> 172.21.15.98:0/3983260766 conn(0x7fc1c40650f0 msgr2=0x7fc1c40aaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 shutdown_connections 2023-08-22T00:07:10.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.611+0000 7fc1c96cf700 1 -- 172.21.15.98:0/3983260766 wait complete. 2023-08-22T00:07:10.622 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:10.629 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-22T00:07:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.750+0000 7f01afc72700 1 Processor -- start 2023-08-22T00:07:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.751+0000 7f01afc72700 1 -- start start 2023-08-22T00:07:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.751+0000 7f01afc72700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f01a80a6a80 0x7f01a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.751+0000 7f01afc72700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a8154b30 con 0x7f01a8154fc0 2023-08-22T00:07:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01afc72700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a8066820 con 0x7f01a80a6e60 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01afc72700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a81547e0 con 0x7f01a80a6a80 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ada0e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f01a80a6a80 0x7f01a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ae20f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f01a8154fc0 0x7f01a8064fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55386/0 (socket says 172.21.15.98:55386) 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ae20f700 1 -- 172.21.15.98:0/166032095 learned_addr learned my addr 172.21.15.98:0/166032095 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ada0e700 1 -- 172.21.15.98:0/166032095 >> v1:172.21.15.118:6789/0 conn(0x7f01a80a6e60 legacy=0x7f01a8066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ada0e700 1 -- 172.21.15.98:0/166032095 >> v1:172.21.15.98:6789/0 conn(0x7f01a8154fc0 legacy=0x7f01a8064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ada0e700 1 -- 172.21.15.98:0/166032095 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8068260 con 0x7f01a80a6a80 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01aca0c700 1 -- 172.21.15.98:0/166032095 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780874451 0 0) 0x7f01a8154b30 con 0x7f01a8154fc0 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01ada0e700 1 --2- 172.21.15.98:0/166032095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6a80 0x7f01a8067c60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0198009760 tx=0x7f0198009060).ready entity=mon.0 client_cookie=d91bc300f6d3507a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01aca0c700 1 -- 172.21.15.98:0/166032095 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800b580 con 0x7f01a80a6a80 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01aca0c700 1 -- 172.21.15.98:0/166032095 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800b6e0 con 0x7f01a80a6a80 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.752+0000 7f01aca0c700 1 -- 172.21.15.98:0/166032095 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800ba60 con 0x7f01a80a6a80 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 -- 172.21.15.98:0/166032095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6a80 msgr2=0x7f01a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 --2- 172.21.15.98:0/166032095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6a80 0x7f01a8067c60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0198009760 tx=0x7f0198009060).stop 2023-08-22T00:07:10.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 -- 172.21.15.98:0/166032095 shutdown_connections 2023-08-22T00:07:10.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 --2- 172.21.15.98:0/166032095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6a80 0x7f01a8067c60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 -- 172.21.15.98:0/166032095 >> 172.21.15.98:0/166032095 conn(0x7f01a80c42e0 msgr2=0x7f01a80c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 -- 172.21.15.98:0/166032095 shutdown_connections 2023-08-22T00:07:10.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.753+0000 7f01afc72700 1 -- 172.21.15.98:0/166032095 wait complete. 2023-08-22T00:07:10.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.754+0000 7f01afc72700 1 Processor -- start 2023-08-22T00:07:10.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.754+0000 7f01afc72700 1 -- start start 2023-08-22T00:07:10.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01a80a6a80 0x7f01a8143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01a8154fc0 0x7f01a80c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8153c00 con 0x7f01a80a6e60 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80ac360 con 0x7f01a80a6a80 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80ac640 con 0x7f01a8154fc0 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60564/0 (socket says 172.21.15.98:60564) 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 -- 172.21.15.98:0/3241348167 learned_addr learned my addr 172.21.15.98:0/3241348167 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ada0e700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01a80a6a80 0x7f01a8143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ae20f700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01a8154fc0 0x7f01a80c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 -- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01a8154fc0 msgr2=0x7f01a80c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01a8154fc0 0x7f01a80c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 -- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01a80a6a80 msgr2=0x7f01a8143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01a80a6a80 0x7f01a8143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 -- 172.21.15.98:0/3241348167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980092a0 con 0x7f01a80a6e60 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01ad20d700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f01a400c4c0 tx=0x7f01a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4007020 con 0x7f01a80a6e60 2023-08-22T00:07:10.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4001e90 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80ac920 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.755+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40073b0 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.756+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80acee0 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.756+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a80ad100 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.757+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f01a40068b0 con 0x7f01a80a6e60 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.757+0000 7f019dffb700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 0x7f018c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:10.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.757+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f01a4079580 con 0x7f01a80a6e60 2023-08-22T00:07:10.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.757+0000 7f01ada0e700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 0x7f018c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:10.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.757+0000 7f01ada0e700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 0x7f018c0612d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f019800b340 tx=0x7f0198017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:10.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.761+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01a404abe0 con 0x7f01a80a6e60 2023-08-22T00:07:10.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.986+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f01a8068540 con 0x7f01a80a6e60 2023-08-22T00:07:10.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.990+0000 7f019dffb700 1 -- 172.21.15.98:0/3241348167 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f01a404e200 con 0x7f01a80a6e60 2023-08-22T00:07:10.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 msgr2=0x7f018c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 0x7f018c0612d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f019800b340 tx=0x7f0198017000).stop 2023-08-22T00:07:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 msgr2=0x7f01a80c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f01a400c4c0 tx=0x7f01a4007e00).stop 2023-08-22T00:07:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 shutdown_connections 2023-08-22T00:07:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f018c05ee10 0x7f018c0612d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01a8154fc0 0x7f01a80c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01a80a6a80 0x7f01a8143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 --2- 172.21.15.98:0/3241348167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01a80a6e60 0x7f01a80c46c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 >> 172.21.15.98:0/3241348167 conn(0x7f01a80c42e0 msgr2=0x7f01a8064f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 shutdown_connections 2023-08-22T00:07:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:10.992+0000 7f01afc72700 1 -- 172.21.15.98:0/3241348167 wait complete. 2023-08-22T00:07:10.996 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:11.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-22T00:07:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.129+0000 7f134232b700 1 Processor -- start 2023-08-22T00:07:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.129+0000 7f134232b700 1 -- start start 2023-08-22T00:07:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f134232b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f133c150c60 0x7f133c063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f134232b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f133c064390 0x7f133c0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f134232b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c155570 con 0x7f133c150880 2023-08-22T00:07:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f134232b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0647d0 con 0x7f133c064390 2023-08-22T00:07:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f134232b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c1549f0 con 0x7f133c150c60 2023-08-22T00:07:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f13408c8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f133c064390 0x7f133c0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f13408c8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f133c064390 0x7f133c0c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60580/0 (socket says 172.21.15.98:60580) 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f13408c8700 1 -- 172.21.15.98:0/3089896866 learned_addr learned my addr 172.21.15.98:0/3089896866 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f13408c8700 1 -- 172.21.15.98:0/3089896866 >> v2:172.21.15.118:3300/0 conn(0x7f133c150c60 msgr2=0x7f133c063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.130+0000 7f13408c8700 1 --2- 172.21.15.98:0/3089896866 >> v2:172.21.15.118:3300/0 conn(0x7f133c150c60 0x7f133c063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f13408c8700 1 -- 172.21.15.98:0/3089896866 >> v1:172.21.15.118:6789/0 conn(0x7f133c150880 legacy=0x7f133c0a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f13408c8700 1 -- 172.21.15.98:0/3089896866 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c154cd0 con 0x7f133c064390 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f13408c8700 1 --2- 172.21.15.98:0/3089896866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c064390 0x7f133c0c19a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f133c0c15e0 tx=0x7f1334009840).ready entity=mon.0 client_cookie=1e5c122b63e9e3de server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f133affd700 1 -- 172.21.15.98:0/3089896866 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400e070 con 0x7f133c064390 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f133affd700 1 -- 172.21.15.98:0/3089896866 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400ba10 con 0x7f133c064390 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f133affd700 1 -- 172.21.15.98:0/3089896866 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400bd90 con 0x7f133c064390 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 -- 172.21.15.98:0/3089896866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c064390 msgr2=0x7f133c0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 --2- 172.21.15.98:0/3089896866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c064390 0x7f133c0c19a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f133c0c15e0 tx=0x7f1334009840).stop 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 -- 172.21.15.98:0/3089896866 shutdown_connections 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 --2- 172.21.15.98:0/3089896866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c064390 0x7f133c0c19a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 --2- 172.21.15.98:0/3089896866 >> v2:172.21.15.118:3300/0 conn(0x7f133c150c60 0x7f133c063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:11.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 -- 172.21.15.98:0/3089896866 >> 172.21.15.98:0/3089896866 conn(0x7f133c069680 msgr2=0x7f133c069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:11.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 -- 172.21.15.98:0/3089896866 shutdown_connections 2023-08-22T00:07:11.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.131+0000 7f134232b700 1 -- 172.21.15.98:0/3089896866 wait complete. 2023-08-22T00:07:11.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.133+0000 7f134232b700 1 Processor -- start 2023-08-22T00:07:11.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.133+0000 7f134232b700 1 -- start start 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 0x7f133c0a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 0x7f133c0672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0a61d0 con 0x7f133c150880 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0a64b0 con 0x7f133c064390 2023-08-22T00:07:11.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f134232b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0a6790 con 0x7f133c150c60 2023-08-22T00:07:11.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60586/0 (socket says 172.21.15.98:60586) 2023-08-22T00:07:11.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 -- 172.21.15.98:0/1394304393 learned_addr learned my addr 172.21.15.98:0/1394304393 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:11.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f13408c8700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 0x7f133c0672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133bfff700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 0x7f133c0a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 -- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 msgr2=0x7f133c0672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 0x7f133c0672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 -- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 msgr2=0x7f133c0a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 0x7f133c0a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 -- 172.21.15.98:0/1394304393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334009ae0 con 0x7f133c150880 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f13408c8700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 0x7f133c0672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133bfff700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 0x7f133c0a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.134+0000 7f133b7fe700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f132c00da20 tx=0x7f132c00b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.135+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00e9a0 con 0x7f133c150880 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.135+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0a6a70 con 0x7f133c150880 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.135+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c012070 con 0x7f133c150880 2023-08-22T00:07:11.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.135+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00eb60 con 0x7f133c150880 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.135+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0a5cf0 con 0x7f133c150880 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.136+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f132c01f350 con 0x7f133c150880 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.136+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0a5f70 con 0x7f133c150880 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.136+0000 7f1323fff700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 0x7f13280612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.136+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f132c07b6e0 con 0x7f133c150880 2023-08-22T00:07:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.136+0000 7f133bfff700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 0x7f13280612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.137+0000 7f133bfff700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 0x7f13280612d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f133000a8a0 tx=0x7f1330008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.141+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f132c04cce0 con 0x7f133c150880 2023-08-22T00:07:11.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.364+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f133c154fb0 con 0x7f133c150880 2023-08-22T00:07:11.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.368+0000 7f1323fff700 1 -- 172.21.15.98:0/1394304393 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f132c01c030 con 0x7f133c150880 2023-08-22T00:07:11.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 msgr2=0x7f13280612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 0x7f13280612d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f133000a8a0 tx=0x7f1330008040).stop 2023-08-22T00:07:11.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 msgr2=0x7f133c1438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f132c00da20 tx=0x7f132c00b300).stop 2023-08-22T00:07:11.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 shutdown_connections 2023-08-22T00:07:11.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f132805ee10 0x7f13280612d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f133c150c60 0x7f133c0672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f133c064390 0x7f133c0a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 --2- 172.21.15.98:0/1394304393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c150880 0x7f133c1438e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 >> 172.21.15.98:0/1394304393 conn(0x7f133c069680 msgr2=0x7f133c14fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:11.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 shutdown_connections 2023-08-22T00:07:11.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.370+0000 7f134232b700 1 -- 172.21.15.98:0/1394304393 wait complete. 2023-08-22T00:07:11.377 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:11.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-22T00:07:11.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.510+0000 7fc420d37700 1 Processor -- start 2023-08-22T00:07:11.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.510+0000 7fc420d37700 1 -- start start 2023-08-22T00:07:11.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc420d37700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 0x7fc41c0654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc420d37700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc420d37700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c065050 con 0x7fc41c14e280 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc420d37700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0be650 con 0x7fc41c14e660 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc420d37700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c067ea0 con 0x7fc41c067590 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc41ad9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc419d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 0x7fc41c0654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc41ad9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:56910/0 (socket says 172.21.15.98:56910) 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc41ad9d700 1 -- 172.21.15.98:0/3712539852 learned_addr learned my addr 172.21.15.98:0/3712539852 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.511+0000 7fc41a59c700 1 --1- 172.21.15.98:0/3712539852 >> v1:172.21.15.118:6789/0 conn(0x7fc41c14e280 0x7fc41c0bdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:49154/0 (socket says 172.21.15.98:49154) 2023-08-22T00:07:11.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41ad9d700 1 -- 172.21.15.98:0/3712539852 >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 msgr2=0x7fc41c0654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41ad9d700 1 --2- 172.21.15.98:0/3712539852 >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 0x7fc41c0654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41ad9d700 1 -- 172.21.15.98:0/3712539852 >> v1:172.21.15.118:6789/0 conn(0x7fc41c14e280 legacy=0x7fc41c0bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41ad9d700 1 -- 172.21.15.98:0/3712539852 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c064440 con 0x7fc41c067590 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc419d9b700 1 --2- 172.21.15.98:0/3712539852 >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 0x7fc41c0654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41ad9d700 1 --2- 172.21.15.98:0/3712539852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc414009f20 tx=0x7fc414009840).ready entity=mon.2 client_cookie=3a59532e93639617 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41959a700 1 -- 172.21.15.98:0/3712539852 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400e070 con 0x7fc41c067590 2023-08-22T00:07:11.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41959a700 1 -- 172.21.15.98:0/3712539852 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41400b9d0 con 0x7fc41c067590 2023-08-22T00:07:11.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc41959a700 1 -- 172.21.15.98:0/3712539852 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400bd50 con 0x7fc41c067590 2023-08-22T00:07:11.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 -- 172.21.15.98:0/3712539852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 msgr2=0x7fc41c0679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 --2- 172.21.15.98:0/3712539852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc414009f20 tx=0x7fc414009840).stop 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 -- 172.21.15.98:0/3712539852 shutdown_connections 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 --2- 172.21.15.98:0/3712539852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0679b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 --2- 172.21.15.98:0/3712539852 >> v2:172.21.15.118:3300/0 conn(0x7fc41c14e660 0x7fc41c0654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.512+0000 7fc420d37700 1 -- 172.21.15.98:0/3712539852 >> 172.21.15.98:0/3712539852 conn(0x7fc41c0c7800 msgr2=0x7fc41c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.513+0000 7fc420d37700 1 -- 172.21.15.98:0/3712539852 shutdown_connections 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.513+0000 7fc420d37700 1 -- 172.21.15.98:0/3712539852 wait complete. 2023-08-22T00:07:11.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 Processor -- start 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 -- start start 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc41c14e280 0x7fc41c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c15a1a0 con 0x7fc41c14e660 2023-08-22T00:07:11.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c1592e0 con 0x7fc41c14e280 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.514+0000 7fc420d37700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c159590 con 0x7fc41c067590 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60588/0 (socket says 172.21.15.98:60588) 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 -- 172.21.15.98:0/6985604 learned_addr learned my addr 172.21.15.98:0/6985604 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc419d9b700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc41c14e280 0x7fc41c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41a59c700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 -- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 msgr2=0x7fc41c0a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 -- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc41c14e280 msgr2=0x7fc41c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc41c14e280 0x7fc41c158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 -- 172.21.15.98:0/6985604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0092a0 con 0x7fc41c14e660 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc41ad9d700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc41c067fe0 tx=0x7fc41c064fc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400bd50 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4140092e0 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc414009ae0 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41401d6b0 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.515+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c159b50 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.516+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c068e80 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.516+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc414003040 con 0x7fc41c14e660 2023-08-22T00:07:11.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.517+0000 7fc40a7fc700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 0x7fc3fc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.517+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fc41407ad60 con 0x7fc41c14e660 2023-08-22T00:07:11.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.517+0000 7fc41a59c700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 0x7fc3fc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.517+0000 7fc41a59c700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 0x7fc3fc0612d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fc410007fd0 tx=0x7fc410007d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.521+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc41404c470 con 0x7fc41c14e660 2023-08-22T00:07:11.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.743+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc41c046c20 con 0x7fc41c14e660 2023-08-22T00:07:11.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.747+0000 7fc40a7fc700 1 -- 172.21.15.98:0/6985604 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc414022030 con 0x7fc41c14e660 2023-08-22T00:07:11.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 msgr2=0x7fc3fc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 0x7fc3fc0612d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fc410007fd0 tx=0x7fc410007d30).stop 2023-08-22T00:07:11.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 msgr2=0x7fc41c158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc41c067fe0 tx=0x7fc41c064fc0).stop 2023-08-22T00:07:11.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 shutdown_connections 2023-08-22T00:07:11.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3fc05ee10 0x7fc3fc0612d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc41c067590 0x7fc41c0a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc41c14e660 0x7fc41c158df0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 --2- 172.21.15.98:0/6985604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc41c14e280 0x7fc41c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 >> 172.21.15.98:0/6985604 conn(0x7fc41c0c7800 msgr2=0x7fc41c154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 shutdown_connections 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.749+0000 7fc420d37700 1 -- 172.21.15.98:0/6985604 wait complete. 2023-08-22T00:07:11.756 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:11.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-22T00:07:11.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.888+0000 7f5d6a7af700 1 Processor -- start 2023-08-22T00:07:11.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 -- start start 2023-08-22T00:07:11.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5d64151960 0x7f5d640c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5d640645b0 0x7f5d640a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d640c2b40 con 0x7f5d64155050 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d64151d40 con 0x7f5d640645b0 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.889+0000 7f5d6a7af700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640c1f30 con 0x7f5d64151960 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d637fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5d64155050 0x7f5d64063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55390/0 (socket says 172.21.15.98:55390) 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d637fe700 1 -- 172.21.15.98:0/3933910761 learned_addr learned my addr 172.21.15.98:0/3933910761 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5d640645b0 0x7f5d640a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d63fff700 1 --2- 172.21.15.98:0/3933910761 >> v2:172.21.15.118:3300/0 conn(0x7f5d64151960 0x7f5d640c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 -- 172.21.15.98:0/3933910761 >> v2:172.21.15.118:3300/0 conn(0x7f5d64151960 msgr2=0x7f5d640c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 --2- 172.21.15.98:0/3933910761 >> v2:172.21.15.118:3300/0 conn(0x7f5d64151960 0x7f5d640c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 -- 172.21.15.98:0/3933910761 >> v1:172.21.15.98:6789/0 conn(0x7f5d64155050 legacy=0x7f5d64063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 -- 172.21.15.98:0/3933910761 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640c2210 con 0x7f5d640645b0 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d68d4c700 1 --2- 172.21.15.98:0/3933910761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640645b0 0x7f5d640a4930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5d640687e0 tx=0x7f5d5c009780).ready entity=mon.0 client_cookie=6355ec0faea3d91e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d62ffd700 1 -- 172.21.15.98:0/3933910761 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00e070 con 0x7f5d640645b0 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d62ffd700 1 -- 172.21.15.98:0/3933910761 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00bc30 con 0x7f5d640645b0 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.890+0000 7f5d62ffd700 1 -- 172.21.15.98:0/3933910761 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c012410 con 0x7f5d640645b0 2023-08-22T00:07:11.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 -- 172.21.15.98:0/3933910761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640645b0 msgr2=0x7f5d640a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/3933910761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640645b0 0x7f5d640a4930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5d640687e0 tx=0x7f5d5c009780).stop 2023-08-22T00:07:11.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 -- 172.21.15.98:0/3933910761 shutdown_connections 2023-08-22T00:07:11.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/3933910761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640645b0 0x7f5d640a4930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/3933910761 >> v2:172.21.15.118:3300/0 conn(0x7f5d64151960 0x7f5d640c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 -- 172.21.15.98:0/3933910761 >> 172.21.15.98:0/3933910761 conn(0x7f5d64069680 msgr2=0x7f5d64069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:11.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 -- 172.21.15.98:0/3933910761 shutdown_connections 2023-08-22T00:07:11.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.891+0000 7f5d6a7af700 1 -- 172.21.15.98:0/3933910761 wait complete. 2023-08-22T00:07:11.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.892+0000 7f5d6a7af700 1 Processor -- start 2023-08-22T00:07:11.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.892+0000 7f5d6a7af700 1 -- start start 2023-08-22T00:07:11.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 0x7f5d640a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d64155050 0x7f5d640bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6414e860 con 0x7f5d64151960 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640bc7d0 con 0x7f5d640645b0 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d6a7af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640bcab0 con 0x7f5d64155050 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60598/0 (socket says 172.21.15.98:60598) 2023-08-22T00:07:11.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 -- 172.21.15.98:0/2162668037 learned_addr learned my addr 172.21.15.98:0/2162668037 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:11.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d63fff700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 0x7f5d640a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 -- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d64155050 msgr2=0x7f5d640bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d68d4c700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d64155050 0x7f5d640bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d64155050 0x7f5d640bbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 -- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 msgr2=0x7f5d640a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:11.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 0x7f5d640a6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:11.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 -- 172.21.15.98:0/2162668037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009a20 con 0x7f5d64151960 2023-08-22T00:07:11.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d63fff700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 0x7f5d640a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:11.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d637fe700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5d4c00c440 tx=0x7f5d4c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0072e0 con 0x7f5d64151960 2023-08-22T00:07:11.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.893+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c007440 con 0x7f5d64151960 2023-08-22T00:07:11.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.894+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0057a0 con 0x7f5d64151960 2023-08-22T00:07:11.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.894+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d640bcd90 con 0x7f5d64151960 2023-08-22T00:07:11.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.894+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d64164330 con 0x7f5d64151960 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.895+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6414e9d0 con 0x7f5d64151960 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.895+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5d4c005bd0 con 0x7f5d64151960 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.895+0000 7f5d5bfff700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 0x7f5d440612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.895+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5d4c0792f0 con 0x7f5d64151960 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.895+0000 7f5d63fff700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 0x7f5d440612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:11.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.896+0000 7f5d63fff700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 0x7f5d440612d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5d540098c0 tx=0x7f5d54008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:11.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:11.899+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d4c04a950 con 0x7f5d64151960 2023-08-22T00:07:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.125+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5d64068320 con 0x7f5d64151960 2023-08-22T00:07:12.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.128+0000 7f5d5bfff700 1 -- 172.21.15.98:0/2162668037 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5d4c04df70 con 0x7f5d64151960 2023-08-22T00:07:12.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 msgr2=0x7f5d440612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 0x7f5d440612d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5d540098c0 tx=0x7f5d54008040).stop 2023-08-22T00:07:12.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 msgr2=0x7f5d64163e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5d4c00c440 tx=0x7f5d4c007e20).stop 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 shutdown_connections 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d4405ee10 0x7f5d440612d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d64155050 0x7f5d640bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d640645b0 0x7f5d640a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 --2- 172.21.15.98:0/2162668037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d64151960 0x7f5d64163e40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.130+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 >> 172.21.15.98:0/2162668037 conn(0x7f5d64069680 msgr2=0x7f5d640c56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.131+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 shutdown_connections 2023-08-22T00:07:12.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.131+0000 7f5d6a7af700 1 -- 172.21.15.98:0/2162668037 wait complete. 2023-08-22T00:07:12.138 INFO:teuthology.orchestra.run.smithi098.stderr:updated 2023-08-22T00:07:12.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:12.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.259+0000 7ff7dcd20700 1 Processor -- start 2023-08-22T00:07:12.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.259+0000 7ff7dcd20700 1 -- start start 2023-08-22T00:07:12.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7dcd20700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7d8157ae0 0x7ff7d80c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7dcd20700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80a8440 con 0x7ff7d80a9170 2023-08-22T00:07:12.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7dcd20700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80a8ce0 con 0x7ff7d80aad10 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7dcd20700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80a9620 con 0x7ff7d8157ae0 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7d5d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff7d80a9170 0x7ff7d8157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55396/0 (socket says 172.21.15.98:55396) 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7d5d9b700 1 -- 172.21.15.98:0/3644901409 learned_addr learned my addr 172.21.15.98:0/3644901409 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7d659c700 1 --2- 172.21.15.98:0/3644901409 >> v2:172.21.15.118:3300/0 conn(0x7ff7d8157ae0 0x7ff7d80c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578811584 0 0) 0x7ff7d80a8440 con 0x7ff7d80a9170 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.260+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c00033f0 con 0x7ff7d80a9170 2023-08-22T00:07:12.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001330246 0 0) 0x7ff7c00033f0 con 0x7ff7d80a9170 2023-08-22T00:07:12.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 >> v2:172.21.15.118:3300/0 conn(0x7ff7d8157ae0 msgr2=0x7ff7d80c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 --2- 172.21.15.98:0/3644901409 >> v2:172.21.15.118:3300/0 conn(0x7ff7d8157ae0 0x7ff7d80c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 >> v1:172.21.15.118:6789/0 conn(0x7ff7d80aad10 legacy=0x7ff7d80bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80c45b0 con 0x7ff7d80a9170 2023-08-22T00:07:12.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff7c8001470 con 0x7ff7d80a9170 2023-08-22T00:07:12.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 >> v1:172.21.15.98:6789/0 conn(0x7ff7d80a9170 legacy=0x7ff7d8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 0x7ff7c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7c0004690 0x7ff7c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c0005050 0x7ff7c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80a9620 con 0x7ff7c00038e0 2023-08-22T00:07:12.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000bfe0 con 0x7ff7c0005050 2023-08-22T00:07:12.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000c1a0 con 0x7ff7c0004690 2023-08-22T00:07:12.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 0x7ff7c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d5d9b700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7c0004690 0x7ff7c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d6d9d700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c0005050 0x7ff7c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 -- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7c0004690 msgr2=0x7ff7c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7c0004690 0x7ff7c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 -- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c0005050 msgr2=0x7ff7c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c0005050 0x7ff7c000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d6d9d700 1 -- 172.21.15.98:0/3644901409 reap_dead start 2023-08-22T00:07:12.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 -- 172.21.15.98:0/3644901409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00033f0 con 0x7ff7c00038e0 2023-08-22T00:07:12.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d659c700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 0x7ff7c0003d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff7cc006d80 tx=0x7ff7cc009060).ready entity=mon.0 client_cookie=60839748bc757fb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc009e90 con 0x7ff7c00038e0 2023-08-22T00:07:12.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.261+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc009430 con 0x7ff7c00038e0 2023-08-22T00:07:12.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7d559a700 1 -- 172.21.15.98:0/3644901409 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00e850 con 0x7ff7c00038e0 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 -- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 msgr2=0x7ff7c0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 0x7ff7c0003d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff7cc006d80 tx=0x7ff7cc009060).stop 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 -- 172.21.15.98:0/3644901409 shutdown_connections 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/3644901409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7c00038e0 0x7ff7c0003d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 -- 172.21.15.98:0/3644901409 >> 172.21.15.98:0/3644901409 conn(0x7ff7d80c5330 msgr2=0x7ff7d80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 -- 172.21.15.98:0/3644901409 shutdown_connections 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.262+0000 7ff7dcd20700 1 -- 172.21.15.98:0/3644901409 wait complete. 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.263+0000 7ff7dcd20700 1 Processor -- start 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.263+0000 7ff7dcd20700 1 -- start start 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 0x7ff7d80ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d81639e0 0x7ff7d8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8163e60 con 0x7ff7d8152b10 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8164c80 con 0x7ff7c00038e0 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7dcd20700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8153480 con 0x7ff7d81639e0 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60614/0 (socket says 172.21.15.98:60614) 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 -- 172.21.15.98:0/440056002 learned_addr learned my addr 172.21.15.98:0/440056002 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d5d9b700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d81639e0 0x7ff7d8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d659c700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 0x7ff7d80ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 -- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d81639e0 msgr2=0x7ff7d8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d81639e0 0x7ff7d8152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 -- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 msgr2=0x7ff7d80ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 0x7ff7d80ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 -- 172.21.15.98:0/440056002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8164070 con 0x7ff7d8152b10 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d659c700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 0x7ff7d80ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.264+0000 7ff7d6d9d700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ff7d80c3510 tx=0x7ff7d0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.265+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0006c30 con 0x7ff7d8152b10 2023-08-22T00:07:12.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.265+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d0006d90 con 0x7ff7d8152b10 2023-08-22T00:07:12.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.265+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d8164350 con 0x7ff7d8152b10 2023-08-22T00:07:12.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.265+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0007260 con 0x7ff7d8152b10 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.265+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d8164910 con 0x7ff7d8152b10 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.266+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d8164aa0 con 0x7ff7d8152b10 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.266+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff7d0007610 con 0x7ff7d8152b10 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.266+0000 7ff7c67fc700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 0x7ff7b80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.266+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7ff7d00793b0 con 0x7ff7d8152b10 2023-08-22T00:07:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.266+0000 7ff7d659c700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 0x7ff7b80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.267+0000 7ff7d659c700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 0x7ff7b80612d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff7cc0095a0 tx=0x7ff7cc01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.270+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7d004aa10 con 0x7ff7d8152b10 2023-08-22T00:07:12.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.434+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7d8047480 con 0x7ff7d8152b10 2023-08-22T00:07:12.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.435+0000 7ff7c67fc700 1 -- 172.21.15.98:0/440056002 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14044 (secure 0 0 0) 0x7ff7d004e030 con 0x7ff7d8152b10 2023-08-22T00:07:12.437 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:12.437 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":37,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:07:09.468049+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:12.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 msgr2=0x7ff7b80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 0x7ff7b80612d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff7cc0095a0 tx=0x7ff7cc01a000).stop 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 msgr2=0x7ff7d8152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ff7d80c3510 tx=0x7ff7d0007f30).stop 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 shutdown_connections 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7d8152b10 0x7ff7d8152f90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c00038e0 0x7ff7d80ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff7b805ee10 0x7ff7b80612d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 --2- 172.21.15.98:0/440056002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d81639e0 0x7ff7d8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 >> 172.21.15.98:0/440056002 conn(0x7ff7d80c5330 msgr2=0x7ff7d8150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 shutdown_connections 2023-08-22T00:07:12.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.437+0000 7ff7dcd20700 1 -- 172.21.15.98:0/440056002 wait complete. 2023-08-22T00:07:12.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:07:12.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:07:12.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.569+0000 7fb710b34700 1 Processor -- start 2023-08-22T00:07:12.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.569+0000 7fb710b34700 1 -- start start 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb710b34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1508b0 0x7fb70c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb710b34700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb70c0a6740 0x7fb70c0a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb710b34700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c0654c0 con 0x7fb70c1550a0 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb710b34700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70c0be6e0 con 0x7fb70c0a6740 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb710b34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0a70e0 con 0x7fb70c1508b0 2023-08-22T00:07:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb70c0a6740 0x7fb70c0a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb709d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb70c1550a0 0x7fb70c0c38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55402/0 (socket says 172.21.15.98:55402) 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb709d9b700 1 -- 172.21.15.98:0/2362946774 learned_addr learned my addr 172.21.15.98:0/2362946774 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70a59c700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1508b0 0x7fb70c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 -- 172.21.15.98:0/2362946774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1508b0 msgr2=0x7fb70c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1508b0 0x7fb70c150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 -- 172.21.15.98:0/2362946774 >> v1:172.21.15.98:6789/0 conn(0x7fb70c1550a0 legacy=0x7fb70c0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70959a700 1 -- 172.21.15.98:0/2362946774 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477853910 0 0) 0x7fb70c0654c0 con 0x7fb70c1550a0 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 -- 172.21.15.98:0/2362946774 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0c3fb0 con 0x7fb70c0a6740 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.570+0000 7fb70ad9d700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0a6bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb704009e60 tx=0x7fb704009780).ready entity=mon.0 client_cookie=9c56b5b5900f1485 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb70959a700 1 -- 172.21.15.98:0/2362946774 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400e070 con 0x7fb70c0a6740 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb70959a700 1 -- 172.21.15.98:0/2362946774 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400bc30 con 0x7fb70c0a6740 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb70959a700 1 -- 172.21.15.98:0/2362946774 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704012410 con 0x7fb70c0a6740 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 -- 172.21.15.98:0/2362946774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 msgr2=0x7fb70c0a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0a6bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb704009e60 tx=0x7fb704009780).stop 2023-08-22T00:07:12.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 -- 172.21.15.98:0/2362946774 shutdown_connections 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0a6bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 --2- 172.21.15.98:0/2362946774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1508b0 0x7fb70c150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 -- 172.21.15.98:0/2362946774 >> 172.21.15.98:0/2362946774 conn(0x7fb70c0c7820 msgr2=0x7fb70c0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 -- 172.21.15.98:0/2362946774 shutdown_connections 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.571+0000 7fb710b34700 1 -- 172.21.15.98:0/2362946774 wait complete. 2023-08-22T00:07:12.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.572+0000 7fb710b34700 1 Processor -- start 2023-08-22T00:07:12.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.572+0000 7fb710b34700 1 -- start start 2023-08-22T00:07:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb70c1508b0 0x7fb70c0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1550a0 0x7fb70c0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0a76c0 con 0x7fb70c0a6740 2023-08-22T00:07:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0a79a0 con 0x7fb70c1508b0 2023-08-22T00:07:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb710b34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0a7c80 con 0x7fb70c1550a0 2023-08-22T00:07:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60628/0 (socket says 172.21.15.98:60628) 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 -- 172.21.15.98:0/2119080430 learned_addr learned my addr 172.21.15.98:0/2119080430 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb709d9b700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb70c1508b0 0x7fb70c0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70ad9d700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1550a0 0x7fb70c0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 -- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1550a0 msgr2=0x7fb70c0a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1550a0 0x7fb70c0a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 -- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb70c1508b0 msgr2=0x7fb70c0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.573+0000 7fb70a59c700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb70c1508b0 0x7fb70c0a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb70a59c700 1 -- 172.21.15.98:0/2119080430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704009a20 con 0x7fb70c0a6740 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb70a59c700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fb6fc00fbf0 tx=0x7fb6fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0097c0 con 0x7fb70c0a6740 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc009920 con 0x7fb70c0a6740 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c0a7f60 con 0x7fb70c0a6740 2023-08-22T00:07:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc009ca0 con 0x7fb70c0a6740 2023-08-22T00:07:12.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.574+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c0a7300 con 0x7fb70c0a6740 2023-08-22T00:07:12.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.575+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c0a8400 con 0x7fb70c0a6740 2023-08-22T00:07:12.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.575+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb6fc005880 con 0x7fb70c0a6740 2023-08-22T00:07:12.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.575+0000 7fb6fa7fc700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 0x7fb6ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.575+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fb6fc07bc40 con 0x7fb70c0a6740 2023-08-22T00:07:12.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.576+0000 7fb709d9b700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 0x7fb6ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.576+0000 7fb709d9b700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 0x7fb6ec0612d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb70c163f30 tx=0x7fb700007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.579+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6fc04d240 con 0x7fb70c0a6740 2023-08-22T00:07:12.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.741+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb70c0be120 con 0x7fb70c0a6740 2023-08-22T00:07:12.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.741+0000 7fb6fa7fc700 1 -- 172.21.15.98:0/2119080430 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v37) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb6fc050860 con 0x7fb70c0a6740 2023-08-22T00:07:12.743 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 msgr2=0x7fb6ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 0x7fb6ec0612d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb70c163f30 tx=0x7fb700007b90).stop 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 msgr2=0x7fb70c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fb6fc00fbf0 tx=0x7fb6fc008040).stop 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 shutdown_connections 2023-08-22T00:07:12.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb6ec05ee10 0x7fb6ec0612d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb70c1550a0 0x7fb70c0a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb70c0a6740 0x7fb70c0ace10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 --2- 172.21.15.98:0/2119080430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb70c1508b0 0x7fb70c0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 >> 172.21.15.98:0/2119080430 conn(0x7fb70c0c7820 msgr2=0x7fb70c14d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 shutdown_connections 2023-08-22T00:07:12.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.743+0000 7fb710b34700 1 -- 172.21.15.98:0/2119080430 wait complete. 2023-08-22T00:07:12.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:07:12.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.874+0000 7f39456ab700 1 Processor -- start 2023-08-22T00:07:12.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.874+0000 7f39456ab700 1 -- start start 2023-08-22T00:07:12.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f39456ab700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3940157ab0 0x7f3940157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f39456ab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39400acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f39456ab700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39401541c0 con 0x7f3940062600 2023-08-22T00:07:12.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f39456ab700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400ca860 con 0x7f3940157ab0 2023-08-22T00:07:12.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f39456ab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940063fc0 con 0x7f3940063b10 2023-08-22T00:07:12.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393e7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3940062600 0x7f39400ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55416/0 (socket says 172.21.15.98:55416) 2023-08-22T00:07:12.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393e7fc700 1 -- 172.21.15.98:0/1854595232 learned_addr learned my addr 172.21.15.98:0/1854595232 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:12.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393f7fe700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39400acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393effd700 1 --2- 172.21.15.98:0/1854595232 >> v2:172.21.15.118:3300/0 conn(0x7f3940157ab0 0x7f3940157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936796385 0 0) 0x7f39401541c0 con 0x7f3940062600 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.875+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39280033f0 con 0x7f3940062600 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2246635322 0 0) 0x7f39280033f0 con 0x7f3940062600 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 msgr2=0x7f39400acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39400acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 >> v2:172.21.15.118:3300/0 conn(0x7f3940157ab0 msgr2=0x7f3940157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 --2- 172.21.15.98:0/1854595232 >> v2:172.21.15.118:3300/0 conn(0x7f3940157ab0 0x7f3940157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940062a90 con 0x7f3940062600 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3930001470 con 0x7f3940062600 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 >> v1:172.21.15.98:6789/0 conn(0x7f3940062600 legacy=0x7f39400ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39280038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928003e10 0x7f3928004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928004b80 0x7f3928005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400ca860 con 0x7f3928004b80 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940063fc0 con 0x7f3928003e10 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392800b8e0 con 0x7f3940063b10 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928004b80 0x7f3928005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393effd700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39280038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393e7fc700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928003e10 0x7f3928004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 -- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 msgr2=0x7f39280038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3940063b10 0x7f39280038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 -- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928003e10 msgr2=0x7f3928004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928003e10 0x7f3928004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 -- 172.21.15.98:0/1854595232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280033f0 con 0x7f3928004b80 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393f7fe700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928004b80 0x7f3928005000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f393800e240 tx=0x7f393800b040).ready entity=mon.0 client_cookie=ae8c71cc52d74ad9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938009ac0 con 0x7f3928004b80 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393800f040 con 0x7f3928004b80 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.876+0000 7f393dffb700 1 -- 172.21.15.98:0/1854595232 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800ed00 con 0x7f3928004b80 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 -- 172.21.15.98:0/1854595232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928004b80 msgr2=0x7f3928005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 --2- 172.21.15.98:0/1854595232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928004b80 0x7f3928005000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f393800e240 tx=0x7f393800b040).stop 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f393f7fe700 1 -- 172.21.15.98:0/1854595232 reap_dead start 2023-08-22T00:07:12.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 -- 172.21.15.98:0/1854595232 shutdown_connections 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 -- 172.21.15.98:0/1854595232 >> 172.21.15.98:0/1854595232 conn(0x7f39400cb600 msgr2=0x7f39400c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 -- 172.21.15.98:0/1854595232 shutdown_connections 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.877+0000 7f39456ab700 1 -- 172.21.15.98:0/1854595232 wait complete. 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.878+0000 7f39456ab700 1 Processor -- start 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.878+0000 7f39456ab700 1 -- start start 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928004b80 0x7f39400c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39401485a0 0x7f39400c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940167a80 con 0x7f3940167580 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940167d60 con 0x7f3928004b80 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f39456ab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940168040 con 0x7f39401485a0 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60632/0 (socket says 172.21.15.98:60632) 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 -- 172.21.15.98:0/656102970 learned_addr learned my addr 172.21.15.98:0/656102970 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393effd700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928004b80 0x7f39400c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393f7fe700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39401485a0 0x7f39400c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 -- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39401485a0 msgr2=0x7f39400c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39401485a0 0x7f39400c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 -- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928004b80 msgr2=0x7f39400c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:12.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928004b80 0x7f39400c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 -- 172.21.15.98:0/656102970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940168320 con 0x7f3940167580 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f393e7fc700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f39300049e0 tx=0x7f3930001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.879+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930011590 con 0x7f3940167580 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.880+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39300116f0 con 0x7f3940167580 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.880+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3940163f80 con 0x7f3940167580 2023-08-22T00:07:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.880+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930011ab0 con 0x7f3940167580 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.880+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940155d40 con 0x7f3940167580 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940168180 con 0x7f3940167580 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f393001c360 con 0x7f3940167580 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f3926ffd700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 0x7f392c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f39300792c0 con 0x7f3940167580 2023-08-22T00:07:12.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f393effd700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 0x7f392c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.881+0000 7f393effd700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 0x7f392c0612d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3934006d80 tx=0x7f3934009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:12.885+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39300498f0 con 0x7f3940167580 2023-08-22T00:07:13.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.046+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3940164170 con 0x7f3940167580 2023-08-22T00:07:13.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.046+0000 7f3926ffd700 1 -- 172.21.15.98:0/656102970 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3940168180 con 0x7f3940167580 2023-08-22T00:07:13.048 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 msgr2=0x7f392c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 0x7f392c0612d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3934006d80 tx=0x7f3934009060).stop 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 msgr2=0x7f3940155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f39300049e0 tx=0x7f3930001e90).stop 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 shutdown_connections 2023-08-22T00:07:13.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f392c05ee10 0x7f392c0612d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39401485a0 0x7f39400c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3928004b80 0x7f39400c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 --2- 172.21.15.98:0/656102970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3940167580 0x7f3940155850 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 >> 172.21.15.98:0/656102970 conn(0x7f39400cb600 msgr2=0x7f39400ac6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 shutdown_connections 2023-08-22T00:07:13.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.048+0000 7f39456ab700 1 -- 172.21.15.98:0/656102970 wait complete. 2023-08-22T00:07:13.061 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:07:13.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.176+0000 7fb49cc77700 1 Processor -- start 2023-08-22T00:07:13.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.176+0000 7fb49cc77700 1 -- start start 2023-08-22T00:07:13.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49cc77700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb4981550e0 0x7fb498065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49cc77700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 0x7fb4980bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49cc77700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980bd750 con 0x7fb498153cf0 2023-08-22T00:07:13.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49cc77700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980a7030 con 0x7fb4981550e0 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49cc77700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c2010 con 0x7fb498066400 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb498153cf0 0x7fb4981584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55428/0 (socket says 172.21.15.98:55428) 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.177+0000 7fb49659c700 1 -- 172.21.15.98:0/3270350114 learned_addr learned my addr 172.21.15.98:0/3270350114 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb496d9d700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 0x7fb4980bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 --2- 172.21.15.98:0/3270350114 >> v2:172.21.15.118:3300/0 conn(0x7fb4981550e0 0x7fb498065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299998096 0 0) 0x7fb4980bd750 con 0x7fb498153cf0 2023-08-22T00:07:13.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4840033f0 con 0x7fb498153cf0 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 646813545 0 0) 0x7fb4840033f0 con 0x7fb498153cf0 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 -- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 msgr2=0x7fb4980bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 0x7fb4980bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 -- 172.21.15.98:0/3270350114 >> v1:172.21.15.98:6789/0 conn(0x7fb498153cf0 legacy=0x7fb4981584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 -- 172.21.15.98:0/3270350114 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980a6d50 con 0x7fb4981550e0 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb496d9d700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 0x7fb4980bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:13.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb495d9b700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4981550e0 0x7fb498065f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb488009760 tx=0x7fb488009060).ready entity=mon.1 client_cookie=5f5ff3a02b68f653 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480001470 con 0x7fb4981550e0 2023-08-22T00:07:13.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb488011400 con 0x7fb4981550e0 2023-08-22T00:07:13.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.178+0000 7fb49559a700 1 -- 172.21.15.98:0/3270350114 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488011780 con 0x7fb4981550e0 2023-08-22T00:07:13.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 -- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4981550e0 msgr2=0x7fb498065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4981550e0 0x7fb498065f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb488009760 tx=0x7fb488009060).stop 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 -- 172.21.15.98:0/3270350114 shutdown_connections 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498066400 0x7fb4980bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 --2- 172.21.15.98:0/3270350114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4981550e0 0x7fb498065f10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 -- 172.21.15.98:0/3270350114 >> 172.21.15.98:0/3270350114 conn(0x7fb4980c7770 msgr2=0x7fb4980c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 -- 172.21.15.98:0/3270350114 shutdown_connections 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.179+0000 7fb49cc77700 1 -- 172.21.15.98:0/3270350114 wait complete. 2023-08-22T00:07:13.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.180+0000 7fb49cc77700 1 Processor -- start 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.180+0000 7fb49cc77700 1 -- start start 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb498066400 0x7fb4981528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 0x7fb498063fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498064b40 con 0x7fb4981550e0 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498065600 con 0x7fb498066400 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb498063b40 con 0x7fb498153cf0 2023-08-22T00:07:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60640/0 (socket says 172.21.15.98:60640) 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 -- 172.21.15.98:0/2722741047 learned_addr learned my addr 172.21.15.98:0/2722741047 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb495d9b700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 0x7fb498063fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49659c700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb498066400 0x7fb4981528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 -- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 msgr2=0x7fb498063fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 0x7fb498063fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 -- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb498066400 msgr2=0x7fb4981528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb498066400 0x7fb4981528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 -- 172.21.15.98:0/2722741047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009a20 con 0x7fb4981550e0 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb495d9b700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 0x7fb498063fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb496d9d700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb49000ef90 tx=0x7fb49000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000cd30 con 0x7fb4981550e0 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000f040 con 0x7fb4981550e0 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.181+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4880092a0 con 0x7fb4981550e0 2023-08-22T00:07:13.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.182+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490013610 con 0x7fb4981550e0 2023-08-22T00:07:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.182+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4980634f0 con 0x7fb4981550e0 2023-08-22T00:07:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4980a67a0 con 0x7fb4981550e0 2023-08-22T00:07:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb490013a40 con 0x7fb4981550e0 2023-08-22T00:07:13.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb48e7fc700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 0x7fb4780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fb49007a640 con 0x7fb4981550e0 2023-08-22T00:07:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb49659c700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 0x7fb4780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.183+0000 7fb49659c700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 0x7fb4780612d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb4800059e0 tx=0x7fb480001470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.187+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb49004bce0 con 0x7fb4981550e0 2023-08-22T00:07:13.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.351+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb498063cb0 con 0x7fb4981550e0 2023-08-22T00:07:13.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.351+0000 7fb48e7fc700 1 -- 172.21.15.98:0/2722741047 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb49004f300 con 0x7fb4981550e0 2023-08-22T00:07:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:13.354 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:07:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:07:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:13.356 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 msgr2=0x7fb4780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 0x7fb4780612d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb4800059e0 tx=0x7fb480001470).stop 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 msgr2=0x7fb498065110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb49000ef90 tx=0x7fb49000b040).stop 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 shutdown_connections 2023-08-22T00:07:13.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4981550e0 0x7fb498065110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb498066400 0x7fb4981528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb47805ee10 0x7fb4780612d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 --2- 172.21.15.98:0/2722741047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb498153cf0 0x7fb498063fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 >> 172.21.15.98:0/2722741047 conn(0x7fb4980c7770 msgr2=0x7fb49814ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 shutdown_connections 2023-08-22T00:07:13.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.353+0000 7fb49cc77700 1 -- 172.21.15.98:0/2722741047 wait complete. 2023-08-22T00:07:13.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:07:13.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:07:13.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.489+0000 7f7687fb9700 1 Processor -- start 2023-08-22T00:07:13.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.489+0000 7f7687fb9700 1 -- start start 2023-08-22T00:07:13.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f768014e360 0x7f76801541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f76800c5ce0 0x7f7680063e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76800675b0 0x7f7680067a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76800c6160 con 0x7f76800675b0 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7680067f50 con 0x7f76800c5ce0 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7687fb9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c6580 con 0x7f768014e360 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.490+0000 7f7686556700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76800675b0 0x7f7680067a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76800675b0 0x7f7680067a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60654/0 (socket says 172.21.15.98:60654) 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 -- 172.21.15.98:0/1570670827 learned_addr learned my addr 172.21.15.98:0/1570670827 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7685554700 1 --2- 172.21.15.98:0/1570670827 >> v2:172.21.15.118:3300/0 conn(0x7f76800c5ce0 0x7f7680063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7685d55700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f768014e360 0x7f76801541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 -- 172.21.15.98:0/1570670827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f768014e360 msgr2=0x7f76801541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f768014e360 0x7f76801541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 -- 172.21.15.98:0/1570670827 >> v2:172.21.15.118:3300/0 conn(0x7f76800c5ce0 msgr2=0x7f7680063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:13.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 --2- 172.21.15.98:0/1570670827 >> v2:172.21.15.118:3300/0 conn(0x7f76800c5ce0 0x7f7680063e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 -- 172.21.15.98:0/1570670827 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768014e740 con 0x7f76800675b0 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7686556700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800675b0 0x7f7680067a60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f7680062a90 tx=0x7f7678009840).ready entity=mon.0 client_cookie=dd6b876d0765601e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7684d53700 1 -- 172.21.15.98:0/1570670827 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800e070 con 0x7f76800675b0 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7684d53700 1 -- 172.21.15.98:0/1570670827 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800ba50 con 0x7f76800675b0 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7684d53700 1 -- 172.21.15.98:0/1570670827 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800bdd0 con 0x7f76800675b0 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7687fb9700 1 -- 172.21.15.98:0/1570670827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800675b0 msgr2=0x7f7680067a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.491+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800675b0 0x7f7680067a60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f7680062a90 tx=0x7f7678009840).stop 2023-08-22T00:07:13.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 -- 172.21.15.98:0/1570670827 shutdown_connections 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f768014e360 0x7f76801541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1570670827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800675b0 0x7f7680067a60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1570670827 >> v2:172.21.15.118:3300/0 conn(0x7f76800c5ce0 0x7f7680063e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 -- 172.21.15.98:0/1570670827 >> 172.21.15.98:0/1570670827 conn(0x7f7680066a70 msgr2=0x7f76800c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 -- 172.21.15.98:0/1570670827 shutdown_connections 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.492+0000 7f7687fb9700 1 -- 172.21.15.98:0/1570670827 wait complete. 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.493+0000 7f7687fb9700 1 Processor -- start 2023-08-22T00:07:13.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.493+0000 7f7687fb9700 1 -- start start 2023-08-22T00:07:13.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.493+0000 7f7687fb9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76800675b0 0x7f76800a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f768014e360 0x7f7680152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800a4ed0 con 0x7f76800c5ce0 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800ab800 con 0x7f768014e360 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800ab520 con 0x7f76800675b0 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60668/0 (socket says 172.21.15.98:60668) 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 -- 172.21.15.98:0/1115934915 learned_addr learned my addr 172.21.15.98:0/1115934915 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7686556700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f768014e360 0x7f7680152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685d55700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76800675b0 0x7f76800a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 -- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76800675b0 msgr2=0x7f76800a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76800675b0 0x7f76800a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 -- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f768014e360 msgr2=0x7f7680152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f768014e360 0x7f7680152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:13.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 -- 172.21.15.98:0/1115934915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009ae0 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7685554700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f767c00d890 tx=0x7f767c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c011590 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c0116f0 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800a4880 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c011a70 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.494+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768014cc00 con 0x7f76800c5ce0 2023-08-22T00:07:13.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.495+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76800a5080 con 0x7f76800c5ce0 2023-08-22T00:07:13.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.496+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f767c012420 con 0x7f76800c5ce0 2023-08-22T00:07:13.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.496+0000 7f7675ffb700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 0x7f76640612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:13.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.496+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f767c0796c0 con 0x7f76800c5ce0 2023-08-22T00:07:13.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.496+0000 7f7685d55700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 0x7f76640612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:13.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.496+0000 7f7685d55700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 0x7f76640612d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7670006fd0 tx=0x7f7670008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:13.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.500+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76800a5080 con 0x7f76800c5ce0 2023-08-22T00:07:13.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:13.660+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7680047480 con 0x7f76800c5ce0 2023-08-22T00:07:14.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.281+0000 7f7675ffb700 1 -- 172.21.15.98:0/1115934915 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7f767c04acc0 con 0x7f76800c5ce0 2023-08-22T00:07:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 msgr2=0x7f76640612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 0x7f76640612d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7670006fd0 tx=0x7f7670008040).stop 2023-08-22T00:07:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 msgr2=0x7f768014c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f767c00d890 tx=0x7f767c008040).stop 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 shutdown_connections 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f766405ee10 0x7f76640612d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76800675b0 0x7f76800a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f768014e360 0x7f7680152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 --2- 172.21.15.98:0/1115934915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76800c5ce0 0x7f768014c710 secure :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0x7f767c00d890 tx=0x7f767c008040).stop 2023-08-22T00:07:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.284+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 >> 172.21.15.98:0/1115934915 conn(0x7f7680066a70 msgr2=0x7f7680155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.286+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 shutdown_connections 2023-08-22T00:07:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.288+0000 7f7687fb9700 1 -- 172.21.15.98:0/1115934915 wait complete. 2023-08-22T00:07:14.292 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:07:14.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.427+0000 7fcce6284700 1 Processor -- start 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.427+0000 7fcce6284700 1 -- start start 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fcce6284700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcce0067260 0x7fcce0063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fcce6284700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce014ad80 con 0x7fcce00c5d40 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fcce6284700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00647b0 con 0x7fcce0064390 2023-08-22T00:07:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fcce6284700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce0154e30 con 0x7fcce0067260 2023-08-22T00:07:14.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcce0067260 0x7fcce0063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:14.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcce0067260 0x7fcce0063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60672/0 (socket says 172.21.15.98:60672) 2023-08-22T00:07:14.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 -- 172.21.15.98:0/1101826209 learned_addr learned my addr 172.21.15.98:0/1101826209 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:14.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcce00c5d40 0x7fcce00c6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55440/0 (socket says 172.21.15.98:55440) 2023-08-22T00:07:14.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 -- 172.21.15.98:0/1101826209 >> v1:172.21.15.118:6789/0 conn(0x7fcce0064390 legacy=0x7fcce0153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:14.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 -- 172.21.15.98:0/1101826209 >> v1:172.21.15.98:6789/0 conn(0x7fcce00c5d40 legacy=0x7fcce00c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 -- 172.21.15.98:0/1101826209 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0154b50 con 0x7fcce0067260 2023-08-22T00:07:14.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdeffd700 1 -- 172.21.15.98:0/1101826209 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053387739 0 0) 0x7fcce014ad80 con 0x7fcce00c5d40 2023-08-22T00:07:14.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdf7fe700 1 --2- 172.21.15.98:0/1101826209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce0067260 0x7fcce0063ea0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fcce014af70 tx=0x7fccd000b3b0).ready entity=mon.0 client_cookie=a2088e89376c01ff server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:14.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdeffd700 1 -- 172.21.15.98:0/1101826209 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000dad0 con 0x7fcce0067260 2023-08-22T00:07:14.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdeffd700 1 -- 172.21.15.98:0/1101826209 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000dc30 con 0x7fcce0067260 2023-08-22T00:07:14.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.428+0000 7fccdeffd700 1 -- 172.21.15.98:0/1101826209 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0010470 con 0x7fcce0067260 2023-08-22T00:07:14.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 -- 172.21.15.98:0/1101826209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce0067260 msgr2=0x7fcce0063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 --2- 172.21.15.98:0/1101826209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce0067260 0x7fcce0063ea0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fcce014af70 tx=0x7fccd000b3b0).stop 2023-08-22T00:07:14.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 -- 172.21.15.98:0/1101826209 shutdown_connections 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 --2- 172.21.15.98:0/1101826209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce0067260 0x7fcce0063ea0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 -- 172.21.15.98:0/1101826209 >> 172.21.15.98:0/1101826209 conn(0x7fcce00c3a60 msgr2=0x7fcce00c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 -- 172.21.15.98:0/1101826209 shutdown_connections 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.429+0000 7fcce6284700 1 -- 172.21.15.98:0/1101826209 wait complete. 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.430+0000 7fcce6284700 1 Processor -- start 2023-08-22T00:07:14.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.430+0000 7fcce6284700 1 -- start start 2023-08-22T00:07:14.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce0064390 0x7fcce00c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:14.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce0067260 0x7fcce0163d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:14.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:14.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce01646e0 con 0x7fcce00c5d40 2023-08-22T00:07:14.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a84c0 con 0x7fcce0067260 2023-08-22T00:07:14.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce6284700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a74b0 con 0x7fcce0064390 2023-08-22T00:07:14.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:14.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60680/0 (socket says 172.21.15.98:60680) 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 -- 172.21.15.98:0/3612815349 learned_addr learned my addr 172.21.15.98:0/3612815349 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fccdf7fe700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce0067260 0x7fcce0163d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fccdffff700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce0064390 0x7fcce00c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 -- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce0064390 msgr2=0x7fcce00c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce0064390 0x7fcce00c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 -- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce0067260 msgr2=0x7fcce0163d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce0067260 0x7fcce0163d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.431+0000 7fcce4821700 1 -- 172.21.15.98:0/3612815349 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd000b610 con 0x7fcce00c5d40 2023-08-22T00:07:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fcce4821700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fccd800b810 tx=0x7fccd8009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800d5a0 con 0x7fcce00c5d40 2023-08-22T00:07:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800d720 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce00a8030 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800dae0 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.432+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00a7cc0 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.433+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce00a81c0 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.433+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fccd8019460 con 0x7fcce00c5d40 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.433+0000 7fccc7fff700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 0x7fcccc061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.434+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fccd8079c80 con 0x7fcce00c5d40 2023-08-22T00:07:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.434+0000 7fccdffff700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 0x7fcccc061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.434+0000 7fccdffff700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 0x7fcccc061300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fccd4007750 tx=0x7fccd4007c90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.438+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccd804b110 con 0x7fcce00c5d40 2023-08-22T00:07:14.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:14.600+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcce0066780 con 0x7fcce00c5d40 2023-08-22T00:07:15.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.286+0000 7fccc7fff700 1 -- 172.21.15.98:0/3612815349 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fccd804e730 con 0x7fcce00c5d40 2023-08-22T00:07:15.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.291+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 msgr2=0x7fcccc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.291+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 0x7fcccc061300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fccd4007750 tx=0x7fccd4007c90).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.291+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 msgr2=0x7fcce01641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.291+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fccd800b810 tx=0x7fccd8009290).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 shutdown_connections 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcccc05ee40 0x7fcccc061300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce0064390 0x7fcce00c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce00c5d40 0x7fcce01641f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 --2- 172.21.15.98:0/3612815349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce0067260 0x7fcce0163d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.292+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 >> 172.21.15.98:0/3612815349 conn(0x7fcce00c3a60 msgr2=0x7fcce0063b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:15.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.293+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 shutdown_connections 2023-08-22T00:07:15.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.293+0000 7fcce6284700 1 -- 172.21.15.98:0/3612815349 wait complete. 2023-08-22T00:07:15.312 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:07:15.325 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:07:15.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.443+0000 7f73a8625700 1 Processor -- start 2023-08-22T00:07:15.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.444+0000 7f73a8625700 1 -- start start 2023-08-22T00:07:15.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.444+0000 7f73a8625700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73a014b130 0x7f73a0063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.444+0000 7f73a8625700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f73a0065a40 0x7f73a0065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a8625700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a0064490 con 0x7f73a00c15c0 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a8625700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a0151110 con 0x7f73a0065a40 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a8625700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a0151390 con 0x7f73a014b130 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f73a0065a40 0x7f73a0065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f73a0065a40 0x7f73a0065ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60692/0 (socket says 172.21.15.98:60692) 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 -- 172.21.15.98:0/3060566370 learned_addr learned my addr 172.21.15.98:0/3060566370 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a63c1700 1 --2- 172.21.15.98:0/3060566370 >> v2:172.21.15.118:3300/0 conn(0x7f73a014b130 0x7f73a0063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 -- 172.21.15.98:0/3060566370 >> v2:172.21.15.118:3300/0 conn(0x7f73a014b130 msgr2=0x7f73a0063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 --2- 172.21.15.98:0/3060566370 >> v2:172.21.15.118:3300/0 conn(0x7f73a014b130 0x7f73a0063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 -- 172.21.15.98:0/3060566370 >> v1:172.21.15.118:6789/0 conn(0x7f73a00c15c0 legacy=0x7f73a0151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 -- 172.21.15.98:0/3060566370 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00c6610 con 0x7f73a0065a40 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a6bc2700 1 --2- 172.21.15.98:0/3060566370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a0065a40 0x7f73a0065ef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f73a0068e10 tx=0x7f739800ba50).ready entity=mon.0 client_cookie=8956fb5135c170d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a53bf700 1 -- 172.21.15.98:0/3060566370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398010070 con 0x7f73a0065a40 2023-08-22T00:07:15.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a53bf700 1 -- 172.21.15.98:0/3060566370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739800dde0 con 0x7f73a0065a40 2023-08-22T00:07:15.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.445+0000 7f73a53bf700 1 -- 172.21.15.98:0/3060566370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739800b2e0 con 0x7f73a0065a40 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 -- 172.21.15.98:0/3060566370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a0065a40 msgr2=0x7f73a0065ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 --2- 172.21.15.98:0/3060566370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a0065a40 0x7f73a0065ef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f73a0068e10 tx=0x7f739800ba50).stop 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 -- 172.21.15.98:0/3060566370 shutdown_connections 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 --2- 172.21.15.98:0/3060566370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a0065a40 0x7f73a0065ef0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 --2- 172.21.15.98:0/3060566370 >> v2:172.21.15.118:3300/0 conn(0x7f73a014b130 0x7f73a0063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 -- 172.21.15.98:0/3060566370 >> 172.21.15.98:0/3060566370 conn(0x7f73a00c3a60 msgr2=0x7f73a00c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 -- 172.21.15.98:0/3060566370 shutdown_connections 2023-08-22T00:07:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.446+0000 7f73a8625700 1 -- 172.21.15.98:0/3060566370 wait complete. 2023-08-22T00:07:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.447+0000 7f73a8625700 1 Processor -- start 2023-08-22T00:07:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.447+0000 7f73a8625700 1 -- start start 2023-08-22T00:07:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73a0065a40 0x7f73a014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73a014b130 0x7f73a015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0151c90 con 0x7f73a00c15c0 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a014e5b0 con 0x7f73a0065a40 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a8625700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a014dd10 con 0x7f73a014b130 2023-08-22T00:07:15.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60708/0 (socket says 172.21.15.98:60708) 2023-08-22T00:07:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 -- 172.21.15.98:0/3847162702 learned_addr learned my addr 172.21.15.98:0/3847162702 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a63c1700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73a0065a40 0x7f73a014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a6bc2700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73a014b130 0x7f73a015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 -- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73a014b130 msgr2=0x7f73a015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73a014b130 0x7f73a015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 -- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73a0065a40 msgr2=0x7f73a014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73a0065a40 0x7f73a014b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 -- 172.21.15.98:0/3847162702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739800bcf0 con 0x7f73a00c15c0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73a5bc0700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f739000c470 tx=0x7f7390007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900123f0 con 0x7f73a00c15c0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.448+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7390012550 con 0x7f73a00c15c0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.449+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a014dff0 con 0x7f73a00c15c0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.449+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900128f0 con 0x7f73a00c15c0 2023-08-22T00:07:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.449+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a0144940 con 0x7f73a00c15c0 2023-08-22T00:07:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.449+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0151a60 con 0x7f73a00c15c0 2023-08-22T00:07:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.450+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7390012c60 con 0x7f73a00c15c0 2023-08-22T00:07:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.450+0000 7f73967fc700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 0x7f73840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.450+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f73900790e0 con 0x7f73a00c15c0 2023-08-22T00:07:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.450+0000 7f73a63c1700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 0x7f73840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.450+0000 7f73a63c1700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 0x7f73840612d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f739c010b40 tx=0x7f739c012040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.454+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73900478f0 con 0x7f73a00c15c0 2023-08-22T00:07:15.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.657+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f73a0064490 con 0x7f73a00c15c0 2023-08-22T00:07:15.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.665+0000 7f73967fc700 1 -- 172.21.15.98:0/3847162702 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f73a0064490 con 0x7f73a00c15c0 2023-08-22T00:07:15.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 msgr2=0x7f73840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 0x7f73840612d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f739c010b40 tx=0x7f739c012040).stop 2023-08-22T00:07:15.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 msgr2=0x7f73a014ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f739000c470 tx=0x7f7390007d80).stop 2023-08-22T00:07:15.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 shutdown_connections 2023-08-22T00:07:15.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f738405ee10 0x7f73840612d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73a014b130 0x7f73a015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73a0065a40 0x7f73a014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 --2- 172.21.15.98:0/3847162702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73a00c15c0 0x7f73a014ba00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.683+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 >> 172.21.15.98:0/3847162702 conn(0x7f73a00c3a60 msgr2=0x7f73a0149f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:15.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.684+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 shutdown_connections 2023-08-22T00:07:15.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.685+0000 7f73a8625700 1 -- 172.21.15.98:0/3847162702 wait complete. 2023-08-22T00:07:15.688 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 6 and data pool 7 2023-08-22T00:07:15.702 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:15.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.817+0000 7f6875fb9700 1 Processor -- start 2023-08-22T00:07:15.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.817+0000 7f6875fb9700 1 -- start start 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f6875fb9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f68700bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f6875fb9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700bd800 con 0x7f68700a4db0 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f6875fb9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700c6a80 con 0x7f6870157ad0 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f6875fb9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700c2150 con 0x7f68700bce60 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f68700a4db0 0x7f6870157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55446/0 (socket says 172.21.15.98:55446) 2023-08-22T00:07:15.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686effd700 1 -- 172.21.15.98:0/260420385 learned_addr learned my addr 172.21.15.98:0/260420385 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488070103 0 0) 0x7f6860001110 con 0x7f68700a4db0 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68580033f0 con 0x7f68700a4db0 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686ffff700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f68700bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333287630 0 0) 0x7f68580033f0 con 0x7f68700a4db0 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 msgr2=0x7f68700bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f68700bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 >> v1:172.21.15.118:6789/0 conn(0x7f6870157ad0 legacy=0x7f68700c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700c5e70 con 0x7f68700a4db0 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f6860001600 con 0x7f68700a4db0 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 >> v1:172.21.15.98:6789/0 conn(0x7f68700a4db0 legacy=0x7f6870157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.818+0000 7f686e7fc700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858003910 0x7f6858003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6858004690 0x7f6858004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f6858005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700c2150 con 0x7f6858004690 2023-08-22T00:07:15.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685800b910 con 0x7f6858003910 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685800bad0 con 0x7f68700bce60 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6858004690 0x7f6858004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686f7fe700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858003910 0x7f6858003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686ffff700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f6858005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 -- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 msgr2=0x7f6858005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68700bce60 0x7f6858005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 -- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858003910 msgr2=0x7f6858003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858003910 0x7f6858003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 -- 172.21.15.98:0/260420385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580033f0 con 0x7f6858004690 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686effd700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6858004690 0x7f6858004b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f68700a5240 tx=0x7f68600078d0).ready entity=mon.0 client_cookie=6fb0f84458348c1d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000cc30 con 0x7f6858004690 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000cd90 con 0x7f6858004690 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.819+0000 7f686e7fc700 1 -- 172.21.15.98:0/260420385 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600072e0 con 0x7f6858004690 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 -- 172.21.15.98:0/260420385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6858004690 msgr2=0x7f6858004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 --2- 172.21.15.98:0/260420385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6858004690 0x7f6858004b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f68700a5240 tx=0x7f68600078d0).stop 2023-08-22T00:07:15.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f686ffff700 1 -- 172.21.15.98:0/260420385 reap_dead start 2023-08-22T00:07:15.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 -- 172.21.15.98:0/260420385 shutdown_connections 2023-08-22T00:07:15.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 -- 172.21.15.98:0/260420385 >> 172.21.15.98:0/260420385 conn(0x7f68700c3990 msgr2=0x7f68700c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:15.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 -- 172.21.15.98:0/260420385 shutdown_connections 2023-08-22T00:07:15.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.820+0000 7f6875fb9700 1 -- 172.21.15.98:0/260420385 wait complete. 2023-08-22T00:07:15.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.821+0000 7f6875fb9700 1 Processor -- start 2023-08-22T00:07:15.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.821+0000 7f6875fb9700 1 -- start start 2023-08-22T00:07:15.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858004690 0x7f68700bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6870163df0 0x7f6870164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870164de0 con 0x7f6870066640 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701444f0 con 0x7f6858004690 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870066fb0 con 0x7f6870163df0 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60724/0 (socket says 172.21.15.98:60724) 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 -- 172.21.15.98:0/195872869 learned_addr learned my addr 172.21.15.98:0/195872869 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686f7fe700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858004690 0x7f68700bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686effd700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6870163df0 0x7f6870164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 -- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6870163df0 msgr2=0x7f6870164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6870163df0 0x7f6870164270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 -- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858004690 msgr2=0x7f68700bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858004690 0x7f68700bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 -- 172.21.15.98:0/195872869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870164820 con 0x7f6870066640 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f686ffff700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f68680094d0 tx=0x7f686800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800e040 con 0x7f6870066640 2023-08-22T00:07:15.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800f040 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6870164b00 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800fdf0 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.822+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6870167860 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.823+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870167a80 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.824+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6868015660 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.824+0000 7f68577fe700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 0x7f685c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.824+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f686807aab0 con 0x7f6870066640 2023-08-22T00:07:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.824+0000 7f686f7fe700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 0x7f685c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.824+0000 7f686f7fe700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 0x7f685c061300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f68640039b0 tx=0x7f6864009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.828+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f686804bdc0 con 0x7f6870066640 2023-08-22T00:07:15.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.990+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6870047480 con 0x7f6870066640 2023-08-22T00:07:15.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.991+0000 7f68577fe700 1 -- 172.21.15.98:0/195872869 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17273 (secure 0 0 0) 0x7f686804f3e0 con 0x7f6870066640 2023-08-22T00:07:15.993 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:15.997 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":40,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:07:15.658697+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:15.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.992+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 msgr2=0x7f685c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.992+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 0x7f685c061300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f68640039b0 tx=0x7f6864009040).stop 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.992+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 msgr2=0x7f6870066ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.992+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f68680094d0 tx=0x7f686800b040).stop 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 shutdown_connections 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6870066640 0x7f6870066ac0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6858004690 0x7f68700bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f685c05ee40 0x7f685c061300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 --2- 172.21.15.98:0/195872869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6870163df0 0x7f6870164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:15.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 >> 172.21.15.98:0/195872869 conn(0x7f68700c3990 msgr2=0x7f68700657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:15.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 shutdown_connections 2023-08-22T00:07:15.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:15.993+0000 7f6875fb9700 1 -- 172.21.15.98:0/195872869 wait complete. 2023-08-22T00:07:16.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:16.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.124+0000 7f3e8dd17700 1 Processor -- start 2023-08-22T00:07:16.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.124+0000 7f3e8dd17700 1 -- start start 2023-08-22T00:07:16.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e8dd17700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 0x7f3e880c1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e8dd17700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e88158340 0x7f3e880bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e8dd17700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e880c6a80 con 0x7f3e88157eb0 2023-08-22T00:07:16.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e8dd17700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e881587d0 con 0x7f3e88158340 2023-08-22T00:07:16.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e8dd17700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e880c2150 con 0x7f3e88157ad0 2023-08-22T00:07:16.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e88158340 0x7f3e880bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3e88158340 0x7f3e880bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60732/0 (socket says 172.21.15.98:60732) 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 -- 172.21.15.98:0/868706257 learned_addr learned my addr 172.21.15.98:0/868706257 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e877fe700 1 --2- 172.21.15.98:0/868706257 >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 0x7f3e880c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 -- 172.21.15.98:0/868706257 >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 msgr2=0x7f3e880c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 --2- 172.21.15.98:0/868706257 >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 0x7f3e880c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 -- 172.21.15.98:0/868706257 >> v1:172.21.15.118:6789/0 conn(0x7f3e88157eb0 legacy=0x7f3e880a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 -- 172.21.15.98:0/868706257 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e880c5e70 con 0x7f3e88158340 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e877fe700 1 --2- 172.21.15.98:0/868706257 >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 0x7f3e880c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.125+0000 7f3e87fff700 1 --2- 172.21.15.98:0/868706257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88158340 0x7f3e880bce60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f3e80009f20 tx=0x7f3e80009840).ready entity=mon.0 client_cookie=c3d86af75b4ea9c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e867fc700 1 -- 172.21.15.98:0/868706257 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000e070 con 0x7f3e88158340 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e867fc700 1 -- 172.21.15.98:0/868706257 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000bad0 con 0x7f3e88158340 2023-08-22T00:07:16.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e867fc700 1 -- 172.21.15.98:0/868706257 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000be50 con 0x7f3e88158340 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 -- 172.21.15.98:0/868706257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88158340 msgr2=0x7f3e880bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/868706257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88158340 0x7f3e880bce60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f3e80009f20 tx=0x7f3e80009840).stop 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 -- 172.21.15.98:0/868706257 shutdown_connections 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/868706257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88158340 0x7f3e880bce60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/868706257 >> v2:172.21.15.118:3300/0 conn(0x7f3e88157ad0 0x7f3e880c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 -- 172.21.15.98:0/868706257 >> 172.21.15.98:0/868706257 conn(0x7f3e880c3990 msgr2=0x7f3e880c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 -- 172.21.15.98:0/868706257 shutdown_connections 2023-08-22T00:07:16.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.126+0000 7f3e8dd17700 1 -- 172.21.15.98:0/868706257 wait complete. 2023-08-22T00:07:16.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.127+0000 7f3e8dd17700 1 Processor -- start 2023-08-22T00:07:16.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.127+0000 7f3e8dd17700 1 -- start start 2023-08-22T00:07:16.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e88157ad0 0x7f3e88154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e88158340 0x7f3e880aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88155f10 con 0x7f3e88157eb0 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88155300 con 0x7f3e88157ad0 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e8dd17700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e881555e0 con 0x7f3e88158340 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e86ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e86ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60742/0 (socket says 172.21.15.98:60742) 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e86ffd700 1 -- 172.21.15.98:0/1459632624 learned_addr learned my addr 172.21.15.98:0/1459632624 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e877fe700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e88157ad0 0x7f3e88154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.128+0000 7f3e87fff700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e88158340 0x7f3e880aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 -- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e88158340 msgr2=0x7f3e880aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e88158340 0x7f3e880aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 -- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e88157ad0 msgr2=0x7f3e88154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e88157ad0 0x7f3e88154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 -- 172.21.15.98:0/1459632624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009ae0 con 0x7f3e88157eb0 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e86ffd700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f3e7c00c440 tx=0x7f3e7c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c012400 con 0x7f3e88157eb0 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c012560 con 0x7f3e88157eb0 2023-08-22T00:07:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e881558c0 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c012900 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.129+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e880a85e0 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.130+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e88047480 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.130+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3e7c01b3b0 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.131+0000 7f3e6f7fe700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 0x7f3e740612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.131+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3e7c079240 con 0x7f3e88157eb0 2023-08-22T00:07:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.131+0000 7f3e877fe700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 0x7f3e740612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.131+0000 7f3e877fe700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 0x7f3e740612d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3e78006d80 tx=0x7f3e78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.135+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e7c0488f0 con 0x7f3e88157eb0 2023-08-22T00:07:16.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.298+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e880c6150 con 0x7f3e88157eb0 2023-08-22T00:07:16.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.299+0000 7f3e6f7fe700 1 -- 172.21.15.98:0/1459632624 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17273 (secure 0 0 0) 0x7f3e7c017070 con 0x7f3e88157eb0 2023-08-22T00:07:16.301 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:16.301 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":40,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:07:15.658697+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 msgr2=0x7f3e740612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 0x7f3e740612d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3e78006d80 tx=0x7f3e78008040).stop 2023-08-22T00:07:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 msgr2=0x7f3e880a80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f3e7c00c440 tx=0x7f3e7c007dc0).stop 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 shutdown_connections 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3e7405ee10 0x7f3e740612d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e88158340 0x7f3e880aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e88157ad0 0x7f3e88154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 --2- 172.21.15.98:0/1459632624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e88157eb0 0x7f3e880a80f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 >> 172.21.15.98:0/1459632624 conn(0x7f3e880c3990 msgr2=0x7f3e880660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 shutdown_connections 2023-08-22T00:07:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.301+0000 7f3e8dd17700 1 -- 172.21.15.98:0/1459632624 wait complete. 2023-08-22T00:07:16.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:07:16.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.433+0000 7f3b2e07c700 1 Processor -- start 2023-08-22T00:07:16.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.433+0000 7f3b2e07c700 1 -- start start 2023-08-22T00:07:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b2e07c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b28158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b2e07c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b28064320 0x7f3b280c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b2e07c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b280bcf30 con 0x7f3b28063ea0 2023-08-22T00:07:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b2e07c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b28154550 con 0x7f3b28064320 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b2e07c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28158b00 con 0x7f3b28154170 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b277fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b28158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b28064320 0x7f3b280c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b28064320 0x7f3b280c1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53562/0 (socket says 172.21.15.98:53562) 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b277fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b28158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:57064/0 (socket says 172.21.15.98:57064) 2023-08-22T00:07:16.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 -- 172.21.15.98:0/1623823232 learned_addr learned my addr 172.21.15.98:0/1623823232 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:16.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 -- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 msgr2=0x7f3b28158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:16.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 --2- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b28158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 -- 172.21.15.98:0/1623823232 >> v1:172.21.15.118:6789/0 conn(0x7f3b28063ea0 legacy=0x7f3b280c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b27fff700 1 -- 172.21.15.98:0/1623823232 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280676b0 con 0x7f3b28064320 2023-08-22T00:07:16.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.434+0000 7f3b267fc700 1 -- 172.21.15.98:0/1623823232 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219888758 0 0) 0x7f3b280bcf30 con 0x7f3b28063ea0 2023-08-22T00:07:16.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b27fff700 1 --2- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28064320 0x7f3b280c1cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f3b20009f20 tx=0x7f3b20009840).ready entity=mon.1 client_cookie=97eefd4036af9d89 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b267fc700 1 -- 172.21.15.98:0/1623823232 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000e070 con 0x7f3b28064320 2023-08-22T00:07:16.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b267fc700 1 -- 172.21.15.98:0/1623823232 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2000b9d0 con 0x7f3b28064320 2023-08-22T00:07:16.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b267fc700 1 -- 172.21.15.98:0/1623823232 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000bd50 con 0x7f3b28064320 2023-08-22T00:07:16.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 -- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28064320 msgr2=0x7f3b280c1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28064320 0x7f3b280c1cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f3b20009f20 tx=0x7f3b20009840).stop 2023-08-22T00:07:16.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 -- 172.21.15.98:0/1623823232 shutdown_connections 2023-08-22T00:07:16.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28064320 0x7f3b280c1cf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/1623823232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b28158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 -- 172.21.15.98:0/1623823232 >> 172.21.15.98:0/1623823232 conn(0x7f3b28069680 msgr2=0x7f3b28069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:16.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 -- 172.21.15.98:0/1623823232 shutdown_connections 2023-08-22T00:07:16.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.435+0000 7f3b2e07c700 1 -- 172.21.15.98:0/1623823232 wait complete. 2023-08-22T00:07:16.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 Processor -- start 2023-08-22T00:07:16.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 -- start start 2023-08-22T00:07:16.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28063ea0 0x7f3b280a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b280c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28144210 con 0x7f3b28064320 2023-08-22T00:07:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280a8270 con 0x7f3b28063ea0 2023-08-22T00:07:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b2e07c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280a7cb0 con 0x7f3b28154170 2023-08-22T00:07:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b26ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b26ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60746/0 (socket says 172.21.15.98:60746) 2023-08-22T00:07:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.437+0000 7f3b26ffd700 1 -- 172.21.15.98:0/3538054192 learned_addr learned my addr 172.21.15.98:0/3538054192 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b27fff700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b280c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b277fe700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28063ea0 0x7f3b280a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 -- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 msgr2=0x7f3b280c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b280c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 -- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28063ea0 msgr2=0x7f3b280a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28063ea0 0x7f3b280a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 -- 172.21.15.98:0/3538054192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009ae0 con 0x7f3b28064320 2023-08-22T00:07:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b26ffd700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f3b1800c4c0 tx=0x7f3b18007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18001ea0 con 0x7f3b28064320 2023-08-22T00:07:16.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18007020 con 0x7f3b28064320 2023-08-22T00:07:16.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b280a7f90 con 0x7f3b28064320 2023-08-22T00:07:16.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180073c0 con 0x7f3b28064320 2023-08-22T00:07:16.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.438+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b280a4d00 con 0x7f3b28064320 2023-08-22T00:07:16.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.439+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b28068600 con 0x7f3b28064320 2023-08-22T00:07:16.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.440+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3b180068b0 con 0x7f3b28064320 2023-08-22T00:07:16.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.440+0000 7f3b0f7fe700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 0x7f3b140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:16.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.440+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3b180796e0 con 0x7f3b28064320 2023-08-22T00:07:16.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.440+0000 7f3b277fe700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 0x7f3b140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:16.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.440+0000 7f3b277fe700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 0x7f3b140612d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3b1c009c30 tx=0x7f3b1c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:16.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.444+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b1804a9f0 con 0x7f3b28064320 2023-08-22T00:07:16.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:16.648+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3b28046c20 con 0x7f3b28064320 2023-08-22T00:07:16.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:07:16.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:07:17.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.292+0000 7f3b0f7fe700 1 -- 172.21.15.98:0/3538054192 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3b1804e010 con 0x7f3b28064320 2023-08-22T00:07:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 msgr2=0x7f3b140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 0x7f3b140612d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3b1c009c30 tx=0x7f3b1c009060).stop 2023-08-22T00:07:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 msgr2=0x7f3b28143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f3b1800c4c0 tx=0x7f3b18007dd0).stop 2023-08-22T00:07:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 shutdown_connections 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b1405ee10 0x7f3b140612d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b28154170 0x7f3b280c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b28063ea0 0x7f3b280a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 --2- 172.21.15.98:0/3538054192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28064320 0x7f3b28143d20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 >> 172.21.15.98:0/3538054192 conn(0x7f3b28069680 msgr2=0x7f3b280678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 shutdown_connections 2023-08-22T00:07:17.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.294+0000 7f3b2e07c700 1 -- 172.21.15.98:0/3538054192 wait complete. 2023-08-22T00:07:17.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:07:17.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.427+0000 7fa401979700 1 Processor -- start 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.427+0000 7fa401979700 1 -- start start 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.428+0000 7fa401979700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3fc0675f0 0x7fa3fc0a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.428+0000 7fa401979700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc1525d0 con 0x7fa3fc14fd90 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.428+0000 7fa401979700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc152b80 con 0x7fa3fc0c39d0 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.428+0000 7fa401979700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc067bd0 con 0x7fa3fc0675f0 2023-08-22T00:07:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3faffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa3fc14fd90 0x7fa3fc153010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55458/0 (socket says 172.21.15.98:55458) 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3faffd700 1 -- 172.21.15.98:0/3540850269 learned_addr learned my addr 172.21.15.98:0/3540850269 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127998395 0 0) 0x7fa3f0001110 con 0x7fa3fc14fd90 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e40033f0 con 0x7fa3fc14fd90 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/3540850269 >> v2:172.21.15.118:3300/0 conn(0x7fa3fc0675f0 0x7fa3fc0a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297606439 0 0) 0x7fa3e40033f0 con 0x7fa3fc14fd90 2023-08-22T00:07:17.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 >> v2:172.21.15.118:3300/0 conn(0x7fa3fc0675f0 msgr2=0x7fa3fc0a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 --2- 172.21.15.98:0/3540850269 >> v2:172.21.15.118:3300/0 conn(0x7fa3fc0675f0 0x7fa3fc0a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 >> v1:172.21.15.118:6789/0 conn(0x7fa3fc0c39d0 legacy=0x7fa3fc0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc067eb0 con 0x7fa3fc14fd90 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fa3f0001600 con 0x7fa3fc14fd90 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 >> v1:172.21.15.98:6789/0 conn(0x7fa3fc14fd90 legacy=0x7fa3fc153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4004690 0x7fa3e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3e4005050 0x7fa3e400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc067bd0 con 0x7fa3e40038e0 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e400bfe0 con 0x7fa3e4004690 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e400c1a0 con 0x7fa3e4005050 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3faffd700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4004690 0x7fa3e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.429+0000 7fa3fb7fe700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3e4005050 0x7fa3e400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 -- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3e4005050 msgr2=0x7fa3e400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3e4005050 0x7fa3e400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 -- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4004690 msgr2=0x7fa3e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4004690 0x7fa3e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 -- 172.21.15.98:0/3540850269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40033f0 con 0x7fa3e40038e0 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3fb7fe700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3e4005050 0x7fa3e400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3fb7fe700 1 -- 172.21.15.98:0/3540850269 reap_dead start 2023-08-22T00:07:17.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3faffd700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3e4003d00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fa3f0001ed0 tx=0x7fa3f00078d0).ready entity=mon.0 client_cookie=ed7d732bd835cf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:17.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000cc30 con 0x7fa3e40038e0 2023-08-22T00:07:17.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f000cd90 con 0x7fa3e40038e0 2023-08-22T00:07:17.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa3f9ffb700 1 -- 172.21.15.98:0/3540850269 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00072e0 con 0x7fa3e40038e0 2023-08-22T00:07:17.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 -- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 msgr2=0x7fa3e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3e4003d00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fa3f0001ed0 tx=0x7fa3f00078d0).stop 2023-08-22T00:07:17.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 -- 172.21.15.98:0/3540850269 shutdown_connections 2023-08-22T00:07:17.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 --2- 172.21.15.98:0/3540850269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3e4003d00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 -- 172.21.15.98:0/3540850269 >> 172.21.15.98:0/3540850269 conn(0x7fa3fc0c8950 msgr2=0x7fa3fc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 -- 172.21.15.98:0/3540850269 shutdown_connections 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.430+0000 7fa401979700 1 -- 172.21.15.98:0/3540850269 wait complete. 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 Processor -- start 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 -- start start 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 0x7fa3fc14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3fc14eab0 0x7fa3fc151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc168e50 con 0x7fa3e40038e0 2023-08-22T00:07:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc165cb0 con 0x7fa3fc14eab0 2023-08-22T00:07:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.432+0000 7fa401979700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc165850 con 0x7fa3fc1653d0 2023-08-22T00:07:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60754/0 (socket says 172.21.15.98:60754) 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 -- 172.21.15.98:0/1962279693 learned_addr learned my addr 172.21.15.98:0/1962279693 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 0x7fa3fc14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 -- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 msgr2=0x7fa3fc14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 0x7fa3fc14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 -- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3fc14eab0 msgr2=0x7fa3fc151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3fb7fe700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3fc14eab0 0x7fa3fc151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3fc14eab0 0x7fa3fc151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 -- 172.21.15.98:0/1962279693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc1685b0 con 0x7fa3e40038e0 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 0x7fa3fc14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3faffd700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa3f0007ce0 tx=0x7fa3f0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0007690 con 0x7fa3e40038e0 2023-08-22T00:07:17.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0000c30 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00017e0 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc168890 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.433+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc151820 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.434+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc165a60 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.434+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa3f001c020 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.435+0000 7fa3e2ffd700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 0x7fa3e80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.435+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa3f007a110 con 0x7fa3e40038e0 2023-08-22T00:07:17.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.435+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 0x7fa3e80612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.435+0000 7fa3fa7fc700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 0x7fa3e80612a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa3ec006c40 tx=0x7fa3ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.439+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3f004b570 con 0x7fa3e40038e0 2023-08-22T00:07:17.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:17.640+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa3fc1525d0 con 0x7fa3e40038e0 2023-08-22T00:07:18.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.297+0000 7fa3e2ffd700 1 -- 172.21.15.98:0/1962279693 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa3fc1525d0 con 0x7fa3e40038e0 2023-08-22T00:07:18.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 msgr2=0x7fa3e80612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 0x7fa3e80612a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa3ec006c40 tx=0x7fa3ec008040).stop 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 msgr2=0x7fa3fc167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa3f0007ce0 tx=0x7fa3f0015000).stop 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 shutdown_connections 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3fc14eab0 0x7fa3fc151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3e40038e0 0x7fa3fc167f20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa3e805ede0 0x7fa3e80612a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 --2- 172.21.15.98:0/1962279693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3fc1653d0 0x7fa3fc14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 >> 172.21.15.98:0/1962279693 conn(0x7fa3fc0c8950 msgr2=0x7fa3fc0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 shutdown_connections 2023-08-22T00:07:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.299+0000 7fa401979700 1 -- 172.21.15.98:0/1962279693 wait complete. 2023-08-22T00:07:18.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:07:18.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.443+0000 7f854748c700 1 Processor -- start 2023-08-22T00:07:18.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.443+0000 7f854748c700 1 -- start start 2023-08-22T00:07:18.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f854748c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8540153f40 0x7f8540157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f854748c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85400a9140 0x7f8540157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f854748c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400a8410 con 0x7f8540153b60 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f854748c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400a8cb0 con 0x7f85400a9140 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f854748c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85401586a0 con 0x7f8540153f40 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.444+0000 7f8545a29700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85400a9140 0x7f8540157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85400a9140 0x7f8540157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60762/0 (socket says 172.21.15.98:60762) 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 -- 172.21.15.98:0/143507249 learned_addr learned my addr 172.21.15.98:0/143507249 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8544a27700 1 --2- 172.21.15.98:0/143507249 >> v2:172.21.15.118:3300/0 conn(0x7f8540153f40 0x7f8540157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 -- 172.21.15.98:0/143507249 >> v2:172.21.15.118:3300/0 conn(0x7f8540153f40 msgr2=0x7f8540157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 --2- 172.21.15.98:0/143507249 >> v2:172.21.15.118:3300/0 conn(0x7f8540153f40 0x7f8540157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 -- 172.21.15.98:0/143507249 >> v1:172.21.15.118:6789/0 conn(0x7f8540153b60 legacy=0x7f8540068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 -- 172.21.15.98:0/143507249 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400a8660 con 0x7f85400a9140 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8545a29700 1 --2- 172.21.15.98:0/143507249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85400a9140 0x7f8540157e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f85400c2e10 tx=0x7f8538009840).ready entity=mon.0 client_cookie=aa2a3bffccebd217 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8537fff700 1 -- 172.21.15.98:0/143507249 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800e070 con 0x7f85400a9140 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8537fff700 1 -- 172.21.15.98:0/143507249 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800ba50 con 0x7f85400a9140 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f8537fff700 1 -- 172.21.15.98:0/143507249 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800bdd0 con 0x7f85400a9140 2023-08-22T00:07:18.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f854748c700 1 -- 172.21.15.98:0/143507249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85400a9140 msgr2=0x7f8540157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.445+0000 7f854748c700 1 --2- 172.21.15.98:0/143507249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85400a9140 0x7f8540157e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f85400c2e10 tx=0x7f8538009840).stop 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 -- 172.21.15.98:0/143507249 shutdown_connections 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 --2- 172.21.15.98:0/143507249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85400a9140 0x7f8540157e20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 --2- 172.21.15.98:0/143507249 >> v2:172.21.15.118:3300/0 conn(0x7f8540153f40 0x7f8540157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 -- 172.21.15.98:0/143507249 >> 172.21.15.98:0/143507249 conn(0x7f85400c5dc0 msgr2=0x7f8540068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 -- 172.21.15.98:0/143507249 shutdown_connections 2023-08-22T00:07:18.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.446+0000 7f854748c700 1 -- 172.21.15.98:0/143507249 wait complete. 2023-08-22T00:07:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.447+0000 7f854748c700 1 Processor -- start 2023-08-22T00:07:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.447+0000 7f854748c700 1 -- start start 2023-08-22T00:07:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85400a9140 0x7f85400bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8540153b60 0x7f854014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854014af40 con 0x7f8540153f40 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8540148f30 con 0x7f85400a9140 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85400bff70 con 0x7f8540153b60 2023-08-22T00:07:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60768/0 (socket says 172.21.15.98:60768) 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 -- 172.21.15.98:0/681868923 learned_addr learned my addr 172.21.15.98:0/681868923 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545228700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85400a9140 0x7f85400bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8544a27700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8540153b60 0x7f854014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 -- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8540153b60 msgr2=0x7f854014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8540153b60 0x7f854014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 -- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85400a9140 msgr2=0x7f85400bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85400a9140 0x7f85400bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 -- 172.21.15.98:0/681868923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009ae0 con 0x7f8540153f40 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f8545a29700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8538010000 tx=0x7f85400a8df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538013e30 con 0x7f8540153f40 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8538009500 con 0x7f8540153f40 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85400c0250 con 0x7f8540153f40 2023-08-22T00:07:18.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853801d620 con 0x7f8540153f40 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.448+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85400c0530 con 0x7f8540153f40 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.449+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540047480 con 0x7f8540153f40 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.450+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f853801da10 con 0x7f8540153f40 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.450+0000 7f85357fa700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 0x7f85240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.450+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f853807ba40 con 0x7f8540153f40 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.450+0000 7f8545228700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 0x7f85240612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.450+0000 7f8545228700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 0x7f85240612a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f85300036d0 tx=0x7f8530009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.454+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f853807de60 con 0x7f8540153f40 2023-08-22T00:07:18.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.655+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85400a8940 con 0x7f8540153f40 2023-08-22T00:07:18.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.655+0000 7f85357fa700 1 -- 172.21.15.98:0/681868923 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f853804cd50 con 0x7f8540153f40 2023-08-22T00:07:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:18.657 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:07:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 msgr2=0x7f85240612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 0x7f85240612a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f85300036d0 tx=0x7f8530009040).stop 2023-08-22T00:07:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 msgr2=0x7f8540148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8538010000 tx=0x7f85400a8df0).stop 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 shutdown_connections 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8540153f40 0x7f8540148460 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85400a9140 0x7f85400bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f852405ede0 0x7f85240612a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 --2- 172.21.15.98:0/681868923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8540153b60 0x7f854014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 >> 172.21.15.98:0/681868923 conn(0x7f85400c5dc0 msgr2=0x7f854014b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:18.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 shutdown_connections 2023-08-22T00:07:18.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.657+0000 7f854748c700 1 -- 172.21.15.98:0/681868923 wait complete. 2023-08-22T00:07:18.661 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:07:18.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:07:18.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.788+0000 7f3d611da700 1 Processor -- start 2023-08-22T00:07:18.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.788+0000 7f3d611da700 1 -- start start 2023-08-22T00:07:18.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d611da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 0x7f3d5c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d611da700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0c6a80 con 0x7f3d5c1583a0 2023-08-22T00:07:18.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d611da700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0c2150 con 0x7f3d5c157ad0 2023-08-22T00:07:18.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d611da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c5e70 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d5b59e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3d5c1583a0 0x7f3d5c0bbe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55466/0 (socket says 172.21.15.98:55466) 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d5b59e700 1 -- 172.21.15.98:0/3067426479 learned_addr learned my addr 172.21.15.98:0/3067426479 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d5a59c700 1 --2- 172.21.15.98:0/3067426479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 0x7f3d5c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411565425 0 0) 0x7f3d5c0c6a80 con 0x7f3d5c1583a0 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d440033f0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609717638 0 0) 0x7f3d5c0c2150 con 0x7f3d5c157ad0 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.789+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d5c0c6a80 con 0x7f3d5c157ad0 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d5a59c700 1 -- 172.21.15.98:0/3067426479 >> v1:172.21.15.118:6789/0 conn(0x7f3d5c157ad0 legacy=0x7f3d5c0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d5a59c700 1 -- 172.21.15.98:0/3067426479 >> v1:172.21.15.98:6789/0 conn(0x7f3d5c1583a0 legacy=0x7f3d5c0bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d5a59c700 1 -- 172.21.15.98:0/3067426479 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0c6150 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d5a59c700 1 --2- 172.21.15.98:0/3067426479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 0x7f3d5c157eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3d4c009790 tx=0x7f3d4c009060).ready entity=mon.2 client_cookie=5f432dc069d62375 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00f510 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00f670 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d59d9b700 1 -- 172.21.15.98:0/3067426479 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00f9f0 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 -- 172.21.15.98:0/3067426479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 msgr2=0x7f3d5c157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 --2- 172.21.15.98:0/3067426479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 0x7f3d5c157eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3d4c009790 tx=0x7f3d4c009060).stop 2023-08-22T00:07:18.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 -- 172.21.15.98:0/3067426479 shutdown_connections 2023-08-22T00:07:18.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 --2- 172.21.15.98:0/3067426479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c0a4db0 0x7f3d5c157eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 -- 172.21.15.98:0/3067426479 >> 172.21.15.98:0/3067426479 conn(0x7f3d5c0c3990 msgr2=0x7f3d5c0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:18.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 -- 172.21.15.98:0/3067426479 shutdown_connections 2023-08-22T00:07:18.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.790+0000 7f3d611da700 1 -- 172.21.15.98:0/3067426479 wait complete. 2023-08-22T00:07:18.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 Processor -- start 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 -- start start 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5c0a4db0 0x7f3d5c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c157ad0 0x7f3d5c0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c1650f0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0a6b20 con 0x7f3d5c0a4db0 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.792+0000 7f3d611da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c1644e0 con 0x7f3d5c157ad0 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60772/0 (socket says 172.21.15.98:60772) 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 -- 172.21.15.98:0/3045814931 learned_addr learned my addr 172.21.15.98:0/3045814931 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5a59c700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c157ad0 0x7f3d5c0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5ad9d700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5c0a4db0 0x7f3d5c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 -- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c157ad0 msgr2=0x7f3d5c0a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c157ad0 0x7f3d5c0a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 -- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5c0a4db0 msgr2=0x7f3d5c146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5c0a4db0 0x7f3d5c146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 -- 172.21.15.98:0/3045814931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0092a0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d5b59e700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3d54001560 tx=0x7f3d540015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54005d30 con 0x7f3d5c1583a0 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54005e90 con 0x7f3d5c1583a0 2023-08-22T00:07:18.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c1647c0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540072e0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.793+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c164d80 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.794+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c167760 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.794+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3d54007650 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.795+0000 7f3d42ffd700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 0x7f3d480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.795+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3d540799b0 con 0x7f3d5c1583a0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.795+0000 7f3d5ad9d700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 0x7f3d480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:18.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.795+0000 7f3d5ad9d700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 0x7f3d480612d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f3d50000c00 tx=0x7f3d50007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:18.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.799+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d5c167760 con 0x7f3d5c1583a0 2023-08-22T00:07:18.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.961+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d5c167760 con 0x7f3d5c1583a0 2023-08-22T00:07:18.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.962+0000 7f3d42ffd700 1 -- 172.21.15.98:0/3045814931 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17260 (secure 0 0 0) 0x7f3d5c167760 con 0x7f3d5c1583a0 2023-08-22T00:07:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:18.964 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":41,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:07:16.660920+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:07:18.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 msgr2=0x7f3d480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 0x7f3d480612d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f3d50000c00 tx=0x7f3d50007bb0).stop 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 msgr2=0x7f3d5c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3d54001560 tx=0x7f3d540015b0).stop 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 shutdown_connections 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d5c1583a0 0x7f3d5c156bc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5c0a4db0 0x7f3d5c146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4805ee10 0x7f3d480612d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 --2- 172.21.15.98:0/3045814931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d5c157ad0 0x7f3d5c0a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:18.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 >> 172.21.15.98:0/3045814931 conn(0x7f3d5c0c3990 msgr2=0x7f3d5c065630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:18.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 shutdown_connections 2023-08-22T00:07:18.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:18.964+0000 7f3d611da700 1 -- 172.21.15.98:0/3045814931 wait complete. 2023-08-22T00:07:18.978 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:07:18.978 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:07:19.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.092+0000 7ff0ef8ca700 1 Processor -- start 2023-08-22T00:07:19.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.092+0000 7ff0ef8ca700 1 -- start start 2023-08-22T00:07:19.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff0e8155a80 0x7ff0e8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e80bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff0e814bd20 0x7ff0e814c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80be5d0 con 0x7ff0e8155a80 2023-08-22T00:07:19.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80be8b0 con 0x7ff0e814bd20 2023-08-22T00:07:19.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ef8ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80beb90 con 0x7ff0e80bd860 2023-08-22T00:07:19.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ed666700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff0e8155a80 0x7ff0e8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ed666700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff0e8155a80 0x7ff0e8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60780/0 (socket says 172.21.15.98:60780) 2023-08-22T00:07:19.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.093+0000 7ff0ed666700 1 -- 172.21.15.98:0/2685690584 learned_addr learned my addr 172.21.15.98:0/2685690584 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:19.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ece65700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e80bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ede67700 1 --2- 172.21.15.98:0/2685690584 >> v2:172.21.15.118:3300/0 conn(0x7ff0e814bd20 0x7ff0e814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 -- 172.21.15.98:0/2685690584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 msgr2=0x7ff0e80bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:19.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e80bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 -- 172.21.15.98:0/2685690584 >> v2:172.21.15.118:3300/0 conn(0x7ff0e814bd20 msgr2=0x7ff0e814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:19.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 --2- 172.21.15.98:0/2685690584 >> v2:172.21.15.118:3300/0 conn(0x7ff0e814bd20 0x7ff0e814c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 -- 172.21.15.98:0/2685690584 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80bee70 con 0x7ff0e8155a80 2023-08-22T00:07:19.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ece65700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e80bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:19.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ed666700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8155a80 0x7ff0e8155e60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7ff0e80bf700 tx=0x7ff0d80090f0).ready entity=mon.0 client_cookie=c402ce3598585583 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0dffff700 1 -- 172.21.15.98:0/2685690584 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800b600 con 0x7ff0e8155a80 2023-08-22T00:07:19.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0dffff700 1 -- 172.21.15.98:0/2685690584 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800b760 con 0x7ff0e8155a80 2023-08-22T00:07:19.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0dffff700 1 -- 172.21.15.98:0/2685690584 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800bae0 con 0x7ff0e8155a80 2023-08-22T00:07:19.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/2685690584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8155a80 msgr2=0x7ff0e8155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.094+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8155a80 0x7ff0e8155e60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7ff0e80bf700 tx=0x7ff0d80090f0).stop 2023-08-22T00:07:19.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/2685690584 shutdown_connections 2023-08-22T00:07:19.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/2685690584 >> v2:172.21.15.118:3300/0 conn(0x7ff0e814bd20 0x7ff0e814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8155a80 0x7ff0e8155e60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/2685690584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e80bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/2685690584 >> 172.21.15.98:0/2685690584 conn(0x7ff0e80c5330 msgr2=0x7ff0e80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:19.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/2685690584 shutdown_connections 2023-08-22T00:07:19.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.095+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/2685690584 wait complete. 2023-08-22T00:07:19.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.096+0000 7ff0ef8ca700 1 Processor -- start 2023-08-22T00:07:19.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.096+0000 7ff0ef8ca700 1 -- start start 2023-08-22T00:07:19.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0e8155a80 0x7ff0e80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80ac810 con 0x7ff0e814bd20 2023-08-22T00:07:19.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80abc00 con 0x7ff0e8155a80 2023-08-22T00:07:19.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ef8ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80abee0 con 0x7ff0e80bd860 2023-08-22T00:07:19.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ece65700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ece65700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60786/0 (socket says 172.21.15.98:60786) 2023-08-22T00:07:19.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ece65700 1 -- 172.21.15.98:0/1611148957 learned_addr learned my addr 172.21.15.98:0/1611148957 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:19.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.097+0000 7ff0ed666700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ede67700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0e8155a80 0x7ff0e80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 -- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 msgr2=0x7ff0e813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 -- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0e8155a80 msgr2=0x7ff0e80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0e8155a80 0x7ff0e80c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 -- 172.21.15.98:0/1611148957 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009370 con 0x7ff0e814bd20 2023-08-22T00:07:19.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ece65700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7ff0e400d860 tx=0x7ff0e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011590 con 0x7ff0e814bd20 2023-08-22T00:07:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40116f0 con 0x7ff0e814bd20 2023-08-22T00:07:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011a70 con 0x7ff0e814bd20 2023-08-22T00:07:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80ac1c0 con 0x7ff0e814bd20 2023-08-22T00:07:19.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.098+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e813ca30 con 0x7ff0e814bd20 2023-08-22T00:07:19.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.099+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e8047480 con 0x7ff0e814bd20 2023-08-22T00:07:19.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.099+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff0e401c460 con 0x7ff0e814bd20 2023-08-22T00:07:19.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.099+0000 7ff0dd7fa700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 0x7ff0cc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.100+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff0e4079d60 con 0x7ff0e814bd20 2023-08-22T00:07:19.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.100+0000 7ff0ed666700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 0x7ff0cc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.100+0000 7ff0ed666700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 0x7ff0cc0612d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff0d8009fd0 tx=0x7ff0d8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.104+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0e404b010 con 0x7ff0e814bd20 2023-08-22T00:07:19.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.261+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0e80bf150 con 0x7ff0cc05ee10 2023-08-22T00:07:19.270 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:07:19.269+0000 7fd3b4d45700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:07:19.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.271+0000 7ff0dd7fa700 1 -- 172.21.15.98:0/1611148957 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361527 (secure 0 0 0) 0x7ff0e80bf150 con 0x7ff0cc05ee10 2023-08-22T00:07:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:19.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 msgr2=0x7ff0cc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 0x7ff0cc0612d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff0d8009fd0 tx=0x7ff0d8017000).stop 2023-08-22T00:07:19.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 msgr2=0x7ff0e8154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7ff0e400d860 tx=0x7ff0e4008040).stop 2023-08-22T00:07:19.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 shutdown_connections 2023-08-22T00:07:19.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff0cc05ee10 0x7ff0cc0612d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0e80bd860 0x7ff0e813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0e8155a80 0x7ff0e80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 --2- 172.21.15.98:0/1611148957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e814bd20 0x7ff0e8154960 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 >> 172.21.15.98:0/1611148957 conn(0x7ff0e80c5330 msgr2=0x7ff0e8067020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:19.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 shutdown_connections 2023-08-22T00:07:19.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.275+0000 7ff0ef8ca700 1 -- 172.21.15.98:0/1611148957 wait complete. 2023-08-22T00:07:19.285 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:07:19.288 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-08-22T00:07:18.046547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380388,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594332,"statfs":{"total":773094113280,"available":770656595968,"internally_reserved":0,"allocated":3706880,"data_stored":1657102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3968,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-12,"num_write_kb":-9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.210620"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684675+0000","last_change":"2023-08-22T00:07:15.684675+0000","last_active":"2023-08-22T00:07:15.684675+0000","last_peered":"2023-08-22T00:07:15.684675+0000","last_clean":"2023-08-22T00:07:15.684675+0000","last_became_active":"2023-08-22T00:07:15.684334+0000","last_became_peered":"2023-08-22T00:07:15.684334+0000","last_unstale":"2023-08-22T00:07:15.684675+0000","last_undegraded":"2023-08-22T00:07:15.684675+0000","last_fullsized":"2023-08-22T00:07:15.684675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"40'3","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.681859+0000","last_change":"2023-08-22T00:07:15.305621+0000","last_active":"2023-08-22T00:07:15.681859+0000","last_peered":"2023-08-22T00:07:15.681859+0000","last_clean":"2023-08-22T00:07:15.681859+0000","last_became_active":"2023-08-22T00:07:15.305184+0000","last_became_peered":"2023-08-22T00:07:15.305184+0000","last_unstale":"2023-08-22T00:07:15.681859+0000","last_undegraded":"2023-08-22T00:07:15.681859+0000","last_fullsized":"2023-08-22T00:07:15.681859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684661+0000","last_change":"2023-08-22T00:07:15.684661+0000","last_active":"2023-08-22T00:07:15.684661+0000","last_peered":"2023-08-22T00:07:15.684661+0000","last_clean":"2023-08-22T00:07:15.684661+0000","last_became_active":"2023-08-22T00:07:15.684198+0000","last_became_peered":"2023-08-22T00:07:15.684198+0000","last_unstale":"2023-08-22T00:07:15.684661+0000","last_undegraded":"2023-08-22T00:07:15.684661+0000","last_fullsized":"2023-08-22T00:07:15.684661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305436+0000","last_change":"2023-08-22T00:07:15.300410+0000","last_active":"2023-08-22T00:07:15.305436+0000","last_peered":"2023-08-22T00:07:15.305436+0000","last_clean":"2023-08-22T00:07:15.305436+0000","last_became_active":"2023-08-22T00:07:15.300129+0000","last_became_peered":"2023-08-22T00:07:15.300129+0000","last_unstale":"2023-08-22T00:07:15.305436+0000","last_undegraded":"2023-08-22T00:07:15.305436+0000","last_fullsized":"2023-08-22T00:07:15.305436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682445+0000","last_change":"2023-08-22T00:07:15.682445+0000","last_active":"2023-08-22T00:07:15.682445+0000","last_peered":"2023-08-22T00:07:15.682445+0000","last_clean":"2023-08-22T00:07:15.682445+0000","last_became_active":"2023-08-22T00:07:15.682201+0000","last_became_peered":"2023-08-22T00:07:15.682201+0000","last_unstale":"2023-08-22T00:07:15.682445+0000","last_undegraded":"2023-08-22T00:07:15.682445+0000","last_fullsized":"2023-08-22T00:07:15.682445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.314759+0000","last_change":"2023-08-22T00:07:15.310600+0000","last_active":"2023-08-22T00:07:15.314759+0000","last_peered":"2023-08-22T00:07:15.314759+0000","last_clean":"2023-08-22T00:07:15.314759+0000","last_became_active":"2023-08-22T00:07:15.310129+0000","last_became_peered":"2023-08-22T00:07:15.310129+0000","last_unstale":"2023-08-22T00:07:15.314759+0000","last_undegraded":"2023-08-22T00:07:15.314759+0000","last_fullsized":"2023-08-22T00:07:15.314759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.674072+0000","last_change":"2023-08-22T00:07:15.674072+0000","last_active":"2023-08-22T00:07:15.674072+0000","last_peered":"2023-08-22T00:07:15.674072+0000","last_clean":"2023-08-22T00:07:15.674072+0000","last_became_active":"2023-08-22T00:07:15.673764+0000","last_became_peered":"2023-08-22T00:07:15.673764+0000","last_unstale":"2023-08-22T00:07:15.674072+0000","last_undegraded":"2023-08-22T00:07:15.674072+0000","last_fullsized":"2023-08-22T00:07:15.674072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677741+0000","last_change":"2023-08-22T00:07:15.307731+0000","last_active":"2023-08-22T00:07:15.677741+0000","last_peered":"2023-08-22T00:07:15.677741+0000","last_clean":"2023-08-22T00:07:15.677741+0000","last_became_active":"2023-08-22T00:07:15.307484+0000","last_became_peered":"2023-08-22T00:07:15.307484+0000","last_unstale":"2023-08-22T00:07:15.677741+0000","last_undegraded":"2023-08-22T00:07:15.677741+0000","last_fullsized":"2023-08-22T00:07:15.677741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683956+0000","last_change":"2023-08-22T00:07:15.683956+0000","last_active":"2023-08-22T00:07:15.683956+0000","last_peered":"2023-08-22T00:07:15.683956+0000","last_clean":"2023-08-22T00:07:15.683956+0000","last_became_active":"2023-08-22T00:07:15.683693+0000","last_became_peered":"2023-08-22T00:07:15.683693+0000","last_unstale":"2023-08-22T00:07:15.683956+0000","last_undegraded":"2023-08-22T00:07:15.683956+0000","last_fullsized":"2023-08-22T00:07:15.683956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.664902+0000","last_change":"2023-08-22T00:07:15.308084+0000","last_active":"2023-08-22T00:07:15.664902+0000","last_peered":"2023-08-22T00:07:15.664902+0000","last_clean":"2023-08-22T00:07:15.664902+0000","last_became_active":"2023-08-22T00:07:15.307793+0000","last_became_peered":"2023-08-22T00:07:15.307793+0000","last_unstale":"2023-08-22T00:07:15.664902+0000","last_undegraded":"2023-08-22T00:07:15.664902+0000","last_fullsized":"2023-08-22T00:07:15.664902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687034+0000","last_change":"2023-08-22T00:07:15.687034+0000","last_active":"2023-08-22T00:07:15.687034+0000","last_peered":"2023-08-22T00:07:15.687034+0000","last_clean":"2023-08-22T00:07:15.687034+0000","last_became_active":"2023-08-22T00:07:15.686718+0000","last_became_peered":"2023-08-22T00:07:15.686718+0000","last_unstale":"2023-08-22T00:07:15.687034+0000","last_undegraded":"2023-08-22T00:07:15.687034+0000","last_fullsized":"2023-08-22T00:07:15.687034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.676596+0000","last_change":"2023-08-22T00:07:15.306181+0000","last_active":"2023-08-22T00:07:15.676596+0000","last_peered":"2023-08-22T00:07:15.676596+0000","last_clean":"2023-08-22T00:07:15.676596+0000","last_became_active":"2023-08-22T00:07:15.305933+0000","last_became_peered":"2023-08-22T00:07:15.305933+0000","last_unstale":"2023-08-22T00:07:15.676596+0000","last_undegraded":"2023-08-22T00:07:15.676596+0000","last_fullsized":"2023-08-22T00:07:15.676596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683956+0000","last_change":"2023-08-22T00:07:15.683956+0000","last_active":"2023-08-22T00:07:15.683956+0000","last_peered":"2023-08-22T00:07:15.683956+0000","last_clean":"2023-08-22T00:07:15.683956+0000","last_became_active":"2023-08-22T00:07:15.683699+0000","last_became_peered":"2023-08-22T00:07:15.683699+0000","last_unstale":"2023-08-22T00:07:15.683956+0000","last_undegraded":"2023-08-22T00:07:15.683956+0000","last_fullsized":"2023-08-22T00:07:15.683956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.316097+0000","last_change":"2023-08-22T00:07:15.315526+0000","last_active":"2023-08-22T00:07:15.316097+0000","last_peered":"2023-08-22T00:07:15.316097+0000","last_clean":"2023-08-22T00:07:15.316097+0000","last_became_active":"2023-08-22T00:07:15.314144+0000","last_became_peered":"2023-08-22T00:07:15.314144+0000","last_unstale":"2023-08-22T00:07:15.316097+0000","last_undegraded":"2023-08-22T00:07:15.316097+0000","last_fullsized":"2023-08-22T00:07:15.316097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684775+0000","last_change":"2023-08-22T00:07:15.684775+0000","last_active":"2023-08-22T00:07:15.684775+0000","last_peered":"2023-08-22T00:07:15.684775+0000","last_clean":"2023-08-22T00:07:15.684775+0000","last_became_active":"2023-08-22T00:07:15.682814+0000","last_became_peered":"2023-08-22T00:07:15.682814+0000","last_unstale":"2023-08-22T00:07:15.684775+0000","last_undegraded":"2023-08-22T00:07:15.684775+0000","last_fullsized":"2023-08-22T00:07:15.684775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311505+0000","last_change":"2023-08-22T00:07:15.304730+0000","last_active":"2023-08-22T00:07:15.311505+0000","last_peered":"2023-08-22T00:07:15.311505+0000","last_clean":"2023-08-22T00:07:15.311505+0000","last_became_active":"2023-08-22T00:07:15.304482+0000","last_became_peered":"2023-08-22T00:07:15.304482+0000","last_unstale":"2023-08-22T00:07:15.311505+0000","last_undegraded":"2023-08-22T00:07:15.311505+0000","last_fullsized":"2023-08-22T00:07:15.311505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683496+0000","last_change":"2023-08-22T00:07:15.683496+0000","last_active":"2023-08-22T00:07:15.683496+0000","last_peered":"2023-08-22T00:07:15.683496+0000","last_clean":"2023-08-22T00:07:15.683496+0000","last_became_active":"2023-08-22T00:07:15.683146+0000","last_became_peered":"2023-08-22T00:07:15.683146+0000","last_unstale":"2023-08-22T00:07:15.683496+0000","last_undegraded":"2023-08-22T00:07:15.683496+0000","last_fullsized":"2023-08-22T00:07:15.683496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311876+0000","last_change":"2023-08-22T00:07:15.310010+0000","last_active":"2023-08-22T00:07:15.311876+0000","last_peered":"2023-08-22T00:07:15.311876+0000","last_clean":"2023-08-22T00:07:15.311876+0000","last_became_active":"2023-08-22T00:07:15.309705+0000","last_became_peered":"2023-08-22T00:07:15.309705+0000","last_unstale":"2023-08-22T00:07:15.311876+0000","last_undegraded":"2023-08-22T00:07:15.311876+0000","last_fullsized":"2023-08-22T00:07:15.311876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687703+0000","last_change":"2023-08-22T00:07:15.687703+0000","last_active":"2023-08-22T00:07:15.687703+0000","last_peered":"2023-08-22T00:07:15.687703+0000","last_clean":"2023-08-22T00:07:15.687703+0000","last_became_active":"2023-08-22T00:07:15.682780+0000","last_became_peered":"2023-08-22T00:07:15.682780+0000","last_unstale":"2023-08-22T00:07:15.687703+0000","last_undegraded":"2023-08-22T00:07:15.687703+0000","last_fullsized":"2023-08-22T00:07:15.687703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.312134+0000","last_change":"2023-08-22T00:07:15.306017+0000","last_active":"2023-08-22T00:07:15.312134+0000","last_peered":"2023-08-22T00:07:15.312134+0000","last_clean":"2023-08-22T00:07:15.312134+0000","last_became_active":"2023-08-22T00:07:15.305733+0000","last_became_peered":"2023-08-22T00:07:15.305733+0000","last_unstale":"2023-08-22T00:07:15.312134+0000","last_undegraded":"2023-08-22T00:07:15.312134+0000","last_fullsized":"2023-08-22T00:07:15.312134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683703+0000","last_change":"2023-08-22T00:07:15.683703+0000","last_active":"2023-08-22T00:07:15.683703+0000","last_peered":"2023-08-22T00:07:15.683703+0000","last_clean":"2023-08-22T00:07:15.683703+0000","last_became_active":"2023-08-22T00:07:15.683419+0000","last_became_peered":"2023-08-22T00:07:15.683419+0000","last_unstale":"2023-08-22T00:07:15.683703+0000","last_undegraded":"2023-08-22T00:07:15.683703+0000","last_fullsized":"2023-08-22T00:07:15.683703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315520+0000","last_change":"2023-08-22T00:07:15.309608+0000","last_active":"2023-08-22T00:07:15.315520+0000","last_peered":"2023-08-22T00:07:15.315520+0000","last_clean":"2023-08-22T00:07:15.315520+0000","last_became_active":"2023-08-22T00:07:15.309321+0000","last_became_peered":"2023-08-22T00:07:15.309321+0000","last_unstale":"2023-08-22T00:07:15.315520+0000","last_undegraded":"2023-08-22T00:07:15.315520+0000","last_fullsized":"2023-08-22T00:07:15.315520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686061+0000","last_change":"2023-08-22T00:07:15.686061+0000","last_active":"2023-08-22T00:07:15.686061+0000","last_peered":"2023-08-22T00:07:15.686061+0000","last_clean":"2023-08-22T00:07:15.686061+0000","last_became_active":"2023-08-22T00:07:15.685794+0000","last_became_peered":"2023-08-22T00:07:15.685794+0000","last_unstale":"2023-08-22T00:07:15.686061+0000","last_undegraded":"2023-08-22T00:07:15.686061+0000","last_fullsized":"2023-08-22T00:07:15.686061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.692160+0000","last_change":"2023-08-22T00:07:15.308598+0000","last_active":"2023-08-22T00:07:15.692160+0000","last_peered":"2023-08-22T00:07:15.692160+0000","last_clean":"2023-08-22T00:07:15.692160+0000","last_became_active":"2023-08-22T00:07:15.308349+0000","last_became_peered":"2023-08-22T00:07:15.308349+0000","last_unstale":"2023-08-22T00:07:15.692160+0000","last_undegraded":"2023-08-22T00:07:15.692160+0000","last_fullsized":"2023-08-22T00:07:15.692160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680295+0000","last_change":"2023-08-22T00:07:15.680295+0000","last_active":"2023-08-22T00:07:15.680295+0000","last_peered":"2023-08-22T00:07:15.680295+0000","last_clean":"2023-08-22T00:07:15.680295+0000","last_became_active":"2023-08-22T00:07:15.680034+0000","last_became_peered":"2023-08-22T00:07:15.680034+0000","last_unstale":"2023-08-22T00:07:15.680295+0000","last_undegraded":"2023-08-22T00:07:15.680295+0000","last_fullsized":"2023-08-22T00:07:15.680295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.672804+0000","last_change":"2023-08-22T00:07:15.314044+0000","last_active":"2023-08-22T00:07:15.672804+0000","last_peered":"2023-08-22T00:07:15.672804+0000","last_clean":"2023-08-22T00:07:15.672804+0000","last_became_active":"2023-08-22T00:07:15.312548+0000","last_became_peered":"2023-08-22T00:07:15.312548+0000","last_unstale":"2023-08-22T00:07:15.672804+0000","last_undegraded":"2023-08-22T00:07:15.672804+0000","last_fullsized":"2023-08-22T00:07:15.672804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686993+0000","last_change":"2023-08-22T00:07:15.686993+0000","last_active":"2023-08-22T00:07:15.686993+0000","last_peered":"2023-08-22T00:07:15.686993+0000","last_clean":"2023-08-22T00:07:15.686993+0000","last_became_active":"2023-08-22T00:07:15.686736+0000","last_became_peered":"2023-08-22T00:07:15.686736+0000","last_unstale":"2023-08-22T00:07:15.686993+0000","last_undegraded":"2023-08-22T00:07:15.686993+0000","last_fullsized":"2023-08-22T00:07:15.686993+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308992+0000","last_change":"2023-08-22T00:07:15.302885+0000","last_active":"2023-08-22T00:07:15.308992+0000","last_peered":"2023-08-22T00:07:15.308992+0000","last_clean":"2023-08-22T00:07:15.308992+0000","last_became_active":"2023-08-22T00:07:15.302592+0000","last_became_peered":"2023-08-22T00:07:15.302592+0000","last_unstale":"2023-08-22T00:07:15.308992+0000","last_undegraded":"2023-08-22T00:07:15.308992+0000","last_fullsized":"2023-08-22T00:07:15.308992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682517+0000","last_change":"2023-08-22T00:07:15.682517+0000","last_active":"2023-08-22T00:07:15.682517+0000","last_peered":"2023-08-22T00:07:15.682517+0000","last_clean":"2023-08-22T00:07:15.682517+0000","last_became_active":"2023-08-22T00:07:15.681506+0000","last_became_peered":"2023-08-22T00:07:15.681506+0000","last_unstale":"2023-08-22T00:07:15.682517+0000","last_undegraded":"2023-08-22T00:07:15.682517+0000","last_fullsized":"2023-08-22T00:07:15.682517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.314677+0000","last_change":"2023-08-22T00:07:15.312480+0000","last_active":"2023-08-22T00:07:15.314677+0000","last_peered":"2023-08-22T00:07:15.314677+0000","last_clean":"2023-08-22T00:07:15.314677+0000","last_became_active":"2023-08-22T00:07:15.311732+0000","last_became_peered":"2023-08-22T00:07:15.311732+0000","last_unstale":"2023-08-22T00:07:15.314677+0000","last_undegraded":"2023-08-22T00:07:15.314677+0000","last_fullsized":"2023-08-22T00:07:15.314677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679085+0000","last_change":"2023-08-22T00:07:15.679085+0000","last_active":"2023-08-22T00:07:15.679085+0000","last_peered":"2023-08-22T00:07:15.679085+0000","last_clean":"2023-08-22T00:07:15.679085+0000","last_became_active":"2023-08-22T00:07:15.678808+0000","last_became_peered":"2023-08-22T00:07:15.678808+0000","last_unstale":"2023-08-22T00:07:15.679085+0000","last_undegraded":"2023-08-22T00:07:15.679085+0000","last_fullsized":"2023-08-22T00:07:15.679085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689999+0000","last_change":"2023-08-22T00:07:15.305884+0000","last_active":"2023-08-22T00:07:15.689999+0000","last_peered":"2023-08-22T00:07:15.689999+0000","last_clean":"2023-08-22T00:07:15.689999+0000","last_became_active":"2023-08-22T00:07:15.305610+0000","last_became_peered":"2023-08-22T00:07:15.305610+0000","last_unstale":"2023-08-22T00:07:15.689999+0000","last_undegraded":"2023-08-22T00:07:15.689999+0000","last_fullsized":"2023-08-22T00:07:15.689999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686960+0000","last_change":"2023-08-22T00:07:15.686960+0000","last_active":"2023-08-22T00:07:15.686960+0000","last_peered":"2023-08-22T00:07:15.686960+0000","last_clean":"2023-08-22T00:07:15.686960+0000","last_became_active":"2023-08-22T00:07:15.686501+0000","last_became_peered":"2023-08-22T00:07:15.686501+0000","last_unstale":"2023-08-22T00:07:15.686960+0000","last_undegraded":"2023-08-22T00:07:15.686960+0000","last_fullsized":"2023-08-22T00:07:15.686960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313850+0000","last_change":"2023-08-22T00:07:15.313334+0000","last_active":"2023-08-22T00:07:15.313850+0000","last_peered":"2023-08-22T00:07:15.313850+0000","last_clean":"2023-08-22T00:07:15.313850+0000","last_became_active":"2023-08-22T00:07:15.313017+0000","last_became_peered":"2023-08-22T00:07:15.313017+0000","last_unstale":"2023-08-22T00:07:15.313850+0000","last_undegraded":"2023-08-22T00:07:15.313850+0000","last_fullsized":"2023-08-22T00:07:15.313850+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675499+0000","last_change":"2023-08-22T00:07:15.675499+0000","last_active":"2023-08-22T00:07:15.675499+0000","last_peered":"2023-08-22T00:07:15.675499+0000","last_clean":"2023-08-22T00:07:15.675499+0000","last_became_active":"2023-08-22T00:07:15.675196+0000","last_became_peered":"2023-08-22T00:07:15.675196+0000","last_unstale":"2023-08-22T00:07:15.675499+0000","last_undegraded":"2023-08-22T00:07:15.675499+0000","last_fullsized":"2023-08-22T00:07:15.675499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310103+0000","last_change":"2023-08-22T00:07:15.307644+0000","last_active":"2023-08-22T00:07:15.310103+0000","last_peered":"2023-08-22T00:07:15.310103+0000","last_clean":"2023-08-22T00:07:15.310103+0000","last_became_active":"2023-08-22T00:07:15.307335+0000","last_became_peered":"2023-08-22T00:07:15.307335+0000","last_unstale":"2023-08-22T00:07:15.310103+0000","last_undegraded":"2023-08-22T00:07:15.310103+0000","last_fullsized":"2023-08-22T00:07:15.310103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687592+0000","last_change":"2023-08-22T00:07:15.687592+0000","last_active":"2023-08-22T00:07:15.687592+0000","last_peered":"2023-08-22T00:07:15.687592+0000","last_clean":"2023-08-22T00:07:15.687592+0000","last_became_active":"2023-08-22T00:07:15.682783+0000","last_became_peered":"2023-08-22T00:07:15.682783+0000","last_unstale":"2023-08-22T00:07:15.687592+0000","last_undegraded":"2023-08-22T00:07:15.687592+0000","last_fullsized":"2023-08-22T00:07:15.687592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.665114+0000","last_change":"2023-08-22T00:07:15.296965+0000","last_active":"2023-08-22T00:07:15.665114+0000","last_peered":"2023-08-22T00:07:15.665114+0000","last_clean":"2023-08-22T00:07:15.665114+0000","last_became_active":"2023-08-22T00:07:15.296693+0000","last_became_peered":"2023-08-22T00:07:15.296693+0000","last_unstale":"2023-08-22T00:07:15.665114+0000","last_undegraded":"2023-08-22T00:07:15.665114+0000","last_fullsized":"2023-08-22T00:07:15.665114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686629+0000","last_change":"2023-08-22T00:07:15.686629+0000","last_active":"2023-08-22T00:07:15.686629+0000","last_peered":"2023-08-22T00:07:15.686629+0000","last_clean":"2023-08-22T00:07:15.686629+0000","last_became_active":"2023-08-22T00:07:15.685428+0000","last_became_peered":"2023-08-22T00:07:15.685428+0000","last_unstale":"2023-08-22T00:07:15.686629+0000","last_undegraded":"2023-08-22T00:07:15.686629+0000","last_fullsized":"2023-08-22T00:07:15.686629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310136+0000","last_change":"2023-08-22T00:07:15.308106+0000","last_active":"2023-08-22T00:07:15.310136+0000","last_peered":"2023-08-22T00:07:15.310136+0000","last_clean":"2023-08-22T00:07:15.310136+0000","last_became_active":"2023-08-22T00:07:15.307831+0000","last_became_peered":"2023-08-22T00:07:15.307831+0000","last_unstale":"2023-08-22T00:07:15.310136+0000","last_undegraded":"2023-08-22T00:07:15.310136+0000","last_fullsized":"2023-08-22T00:07:15.310136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679296+0000","last_change":"2023-08-22T00:07:15.679296+0000","last_active":"2023-08-22T00:07:15.679296+0000","last_peered":"2023-08-22T00:07:15.679296+0000","last_clean":"2023-08-22T00:07:15.679296+0000","last_became_active":"2023-08-22T00:07:15.678964+0000","last_became_peered":"2023-08-22T00:07:15.678964+0000","last_unstale":"2023-08-22T00:07:15.679296+0000","last_undegraded":"2023-08-22T00:07:15.679296+0000","last_fullsized":"2023-08-22T00:07:15.679296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.672952+0000","last_change":"2023-08-22T00:07:15.311755+0000","last_active":"2023-08-22T00:07:15.672952+0000","last_peered":"2023-08-22T00:07:15.672952+0000","last_clean":"2023-08-22T00:07:15.672952+0000","last_became_active":"2023-08-22T00:07:15.309523+0000","last_became_peered":"2023-08-22T00:07:15.309523+0000","last_unstale":"2023-08-22T00:07:15.672952+0000","last_undegraded":"2023-08-22T00:07:15.672952+0000","last_fullsized":"2023-08-22T00:07:15.672952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684365+0000","last_change":"2023-08-22T00:07:15.684365+0000","last_active":"2023-08-22T00:07:15.684365+0000","last_peered":"2023-08-22T00:07:15.684365+0000","last_clean":"2023-08-22T00:07:15.684365+0000","last_became_active":"2023-08-22T00:07:15.683344+0000","last_became_peered":"2023-08-22T00:07:15.683344+0000","last_unstale":"2023-08-22T00:07:15.684365+0000","last_undegraded":"2023-08-22T00:07:15.684365+0000","last_fullsized":"2023-08-22T00:07:15.684365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308972+0000","last_change":"2023-08-22T00:07:15.301110+0000","last_active":"2023-08-22T00:07:15.308972+0000","last_peered":"2023-08-22T00:07:15.308972+0000","last_clean":"2023-08-22T00:07:15.308972+0000","last_became_active":"2023-08-22T00:07:15.300813+0000","last_became_peered":"2023-08-22T00:07:15.300813+0000","last_unstale":"2023-08-22T00:07:15.308972+0000","last_undegraded":"2023-08-22T00:07:15.308972+0000","last_fullsized":"2023-08-22T00:07:15.308972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684252+0000","last_change":"2023-08-22T00:07:15.684252+0000","last_active":"2023-08-22T00:07:15.684252+0000","last_peered":"2023-08-22T00:07:15.684252+0000","last_clean":"2023-08-22T00:07:15.684252+0000","last_became_active":"2023-08-22T00:07:15.683840+0000","last_became_peered":"2023-08-22T00:07:15.683840+0000","last_unstale":"2023-08-22T00:07:15.684252+0000","last_undegraded":"2023-08-22T00:07:15.684252+0000","last_fullsized":"2023-08-22T00:07:15.684252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310661+0000","last_change":"2023-08-22T00:07:15.308815+0000","last_active":"2023-08-22T00:07:15.310661+0000","last_peered":"2023-08-22T00:07:15.310661+0000","last_clean":"2023-08-22T00:07:15.310661+0000","last_became_active":"2023-08-22T00:07:15.308523+0000","last_became_peered":"2023-08-22T00:07:15.308523+0000","last_unstale":"2023-08-22T00:07:15.310661+0000","last_undegraded":"2023-08-22T00:07:15.310661+0000","last_fullsized":"2023-08-22T00:07:15.310661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679887+0000","last_change":"2023-08-22T00:07:15.679887+0000","last_active":"2023-08-22T00:07:15.679887+0000","last_peered":"2023-08-22T00:07:15.679887+0000","last_clean":"2023-08-22T00:07:15.679887+0000","last_became_active":"2023-08-22T00:07:15.679426+0000","last_became_peered":"2023-08-22T00:07:15.679426+0000","last_unstale":"2023-08-22T00:07:15.679887+0000","last_undegraded":"2023-08-22T00:07:15.679887+0000","last_fullsized":"2023-08-22T00:07:15.679887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303358+0000","last_change":"2023-08-22T00:07:15.298812+0000","last_active":"2023-08-22T00:07:15.303358+0000","last_peered":"2023-08-22T00:07:15.303358+0000","last_clean":"2023-08-22T00:07:15.303358+0000","last_became_active":"2023-08-22T00:07:15.298542+0000","last_became_peered":"2023-08-22T00:07:15.298542+0000","last_unstale":"2023-08-22T00:07:15.303358+0000","last_undegraded":"2023-08-22T00:07:15.303358+0000","last_fullsized":"2023-08-22T00:07:15.303358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686823+0000","last_change":"2023-08-22T00:07:15.686823+0000","last_active":"2023-08-22T00:07:15.686823+0000","last_peered":"2023-08-22T00:07:15.686823+0000","last_clean":"2023-08-22T00:07:15.686823+0000","last_became_active":"2023-08-22T00:07:15.686561+0000","last_became_peered":"2023-08-22T00:07:15.686561+0000","last_unstale":"2023-08-22T00:07:15.686823+0000","last_undegraded":"2023-08-22T00:07:15.686823+0000","last_fullsized":"2023-08-22T00:07:15.686823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308349+0000","last_change":"2023-08-22T00:07:15.303806+0000","last_active":"2023-08-22T00:07:15.308349+0000","last_peered":"2023-08-22T00:07:15.308349+0000","last_clean":"2023-08-22T00:07:15.308349+0000","last_became_active":"2023-08-22T00:07:15.303393+0000","last_became_peered":"2023-08-22T00:07:15.303393+0000","last_unstale":"2023-08-22T00:07:15.308349+0000","last_undegraded":"2023-08-22T00:07:15.308349+0000","last_fullsized":"2023-08-22T00:07:15.308349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682049+0000","last_change":"2023-08-22T00:07:15.682049+0000","last_active":"2023-08-22T00:07:15.682049+0000","last_peered":"2023-08-22T00:07:15.682049+0000","last_clean":"2023-08-22T00:07:15.682049+0000","last_became_active":"2023-08-22T00:07:15.681774+0000","last_became_peered":"2023-08-22T00:07:15.681774+0000","last_unstale":"2023-08-22T00:07:15.682049+0000","last_undegraded":"2023-08-22T00:07:15.682049+0000","last_fullsized":"2023-08-22T00:07:15.682049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308204+0000","last_change":"2023-08-22T00:07:15.306539+0000","last_active":"2023-08-22T00:07:15.308204+0000","last_peered":"2023-08-22T00:07:15.308204+0000","last_clean":"2023-08-22T00:07:15.308204+0000","last_became_active":"2023-08-22T00:07:15.306329+0000","last_became_peered":"2023-08-22T00:07:15.306329+0000","last_unstale":"2023-08-22T00:07:15.308204+0000","last_undegraded":"2023-08-22T00:07:15.308204+0000","last_fullsized":"2023-08-22T00:07:15.308204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689536+0000","last_change":"2023-08-22T00:07:15.689536+0000","last_active":"2023-08-22T00:07:15.689536+0000","last_peered":"2023-08-22T00:07:15.689536+0000","last_clean":"2023-08-22T00:07:15.689536+0000","last_became_active":"2023-08-22T00:07:15.689221+0000","last_became_peered":"2023-08-22T00:07:15.689221+0000","last_unstale":"2023-08-22T00:07:15.689536+0000","last_undegraded":"2023-08-22T00:07:15.689536+0000","last_fullsized":"2023-08-22T00:07:15.689536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307597+0000","last_change":"2023-08-22T00:07:15.300782+0000","last_active":"2023-08-22T00:07:15.307597+0000","last_peered":"2023-08-22T00:07:15.307597+0000","last_clean":"2023-08-22T00:07:15.307597+0000","last_became_active":"2023-08-22T00:07:15.300507+0000","last_became_peered":"2023-08-22T00:07:15.300507+0000","last_unstale":"2023-08-22T00:07:15.307597+0000","last_undegraded":"2023-08-22T00:07:15.307597+0000","last_fullsized":"2023-08-22T00:07:15.307597+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679004+0000","last_change":"2023-08-22T00:07:15.679004+0000","last_active":"2023-08-22T00:07:15.679004+0000","last_peered":"2023-08-22T00:07:15.679004+0000","last_clean":"2023-08-22T00:07:15.679004+0000","last_became_active":"2023-08-22T00:07:15.678703+0000","last_became_peered":"2023-08-22T00:07:15.678703+0000","last_unstale":"2023-08-22T00:07:15.679004+0000","last_undegraded":"2023-08-22T00:07:15.679004+0000","last_fullsized":"2023-08-22T00:07:15.679004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315909+0000","last_change":"2023-08-22T00:07:15.314919+0000","last_active":"2023-08-22T00:07:15.315909+0000","last_peered":"2023-08-22T00:07:15.315909+0000","last_clean":"2023-08-22T00:07:15.315909+0000","last_became_active":"2023-08-22T00:07:15.314547+0000","last_became_peered":"2023-08-22T00:07:15.314547+0000","last_unstale":"2023-08-22T00:07:15.315909+0000","last_undegraded":"2023-08-22T00:07:15.315909+0000","last_fullsized":"2023-08-22T00:07:15.315909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.674600+0000","last_change":"2023-08-22T00:07:15.674600+0000","last_active":"2023-08-22T00:07:15.674600+0000","last_peered":"2023-08-22T00:07:15.674600+0000","last_clean":"2023-08-22T00:07:15.674600+0000","last_became_active":"2023-08-22T00:07:15.673495+0000","last_became_peered":"2023-08-22T00:07:15.673495+0000","last_unstale":"2023-08-22T00:07:15.674600+0000","last_undegraded":"2023-08-22T00:07:15.674600+0000","last_fullsized":"2023-08-22T00:07:15.674600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305410+0000","last_change":"2023-08-22T00:07:15.298846+0000","last_active":"2023-08-22T00:07:15.305410+0000","last_peered":"2023-08-22T00:07:15.305410+0000","last_clean":"2023-08-22T00:07:15.305410+0000","last_became_active":"2023-08-22T00:07:15.298583+0000","last_became_peered":"2023-08-22T00:07:15.298583+0000","last_unstale":"2023-08-22T00:07:15.305410+0000","last_undegraded":"2023-08-22T00:07:15.305410+0000","last_fullsized":"2023-08-22T00:07:15.305410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682025+0000","last_change":"2023-08-22T00:07:15.682025+0000","last_active":"2023-08-22T00:07:15.682025+0000","last_peered":"2023-08-22T00:07:15.682025+0000","last_clean":"2023-08-22T00:07:15.682025+0000","last_became_active":"2023-08-22T00:07:15.681652+0000","last_became_peered":"2023-08-22T00:07:15.681652+0000","last_unstale":"2023-08-22T00:07:15.682025+0000","last_undegraded":"2023-08-22T00:07:15.682025+0000","last_fullsized":"2023-08-22T00:07:15.682025+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308798+0000","last_change":"2023-08-22T00:07:15.305802+0000","last_active":"2023-08-22T00:07:15.308798+0000","last_peered":"2023-08-22T00:07:15.308798+0000","last_clean":"2023-08-22T00:07:15.308798+0000","last_became_active":"2023-08-22T00:07:15.305526+0000","last_became_peered":"2023-08-22T00:07:15.305526+0000","last_unstale":"2023-08-22T00:07:15.308798+0000","last_undegraded":"2023-08-22T00:07:15.308798+0000","last_fullsized":"2023-08-22T00:07:15.308798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680701+0000","last_change":"2023-08-22T00:07:15.680701+0000","last_active":"2023-08-22T00:07:15.680701+0000","last_peered":"2023-08-22T00:07:15.680701+0000","last_clean":"2023-08-22T00:07:15.680701+0000","last_became_active":"2023-08-22T00:07:15.680443+0000","last_became_peered":"2023-08-22T00:07:15.680443+0000","last_unstale":"2023-08-22T00:07:15.680701+0000","last_undegraded":"2023-08-22T00:07:15.680701+0000","last_fullsized":"2023-08-22T00:07:15.680701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310699+0000","last_change":"2023-08-22T00:07:15.308866+0000","last_active":"2023-08-22T00:07:15.310699+0000","last_peered":"2023-08-22T00:07:15.310699+0000","last_clean":"2023-08-22T00:07:15.310699+0000","last_became_active":"2023-08-22T00:07:15.308534+0000","last_became_peered":"2023-08-22T00:07:15.308534+0000","last_unstale":"2023-08-22T00:07:15.310699+0000","last_undegraded":"2023-08-22T00:07:15.310699+0000","last_fullsized":"2023-08-22T00:07:15.310699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688386+0000","last_change":"2023-08-22T00:07:15.688386+0000","last_active":"2023-08-22T00:07:15.688386+0000","last_peered":"2023-08-22T00:07:15.688386+0000","last_clean":"2023-08-22T00:07:15.688386+0000","last_became_active":"2023-08-22T00:07:15.688120+0000","last_became_peered":"2023-08-22T00:07:15.688120+0000","last_unstale":"2023-08-22T00:07:15.688386+0000","last_undegraded":"2023-08-22T00:07:15.688386+0000","last_fullsized":"2023-08-22T00:07:15.688386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303392+0000","last_change":"2023-08-22T00:07:15.300528+0000","last_active":"2023-08-22T00:07:15.303392+0000","last_peered":"2023-08-22T00:07:15.303392+0000","last_clean":"2023-08-22T00:07:15.303392+0000","last_became_active":"2023-08-22T00:07:15.300225+0000","last_became_peered":"2023-08-22T00:07:15.300225+0000","last_unstale":"2023-08-22T00:07:15.303392+0000","last_undegraded":"2023-08-22T00:07:15.303392+0000","last_fullsized":"2023-08-22T00:07:15.303392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686077+0000","last_change":"2023-08-22T00:07:15.686077+0000","last_active":"2023-08-22T00:07:15.686077+0000","last_peered":"2023-08-22T00:07:15.686077+0000","last_clean":"2023-08-22T00:07:15.686077+0000","last_became_active":"2023-08-22T00:07:15.685867+0000","last_became_peered":"2023-08-22T00:07:15.685867+0000","last_unstale":"2023-08-22T00:07:15.686077+0000","last_undegraded":"2023-08-22T00:07:15.686077+0000","last_fullsized":"2023-08-22T00:07:15.686077+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.669484+0000","last_change":"2023-08-22T00:07:15.303281+0000","last_active":"2023-08-22T00:07:15.669484+0000","last_peered":"2023-08-22T00:07:15.669484+0000","last_clean":"2023-08-22T00:07:15.669484+0000","last_became_active":"2023-08-22T00:07:15.302998+0000","last_became_peered":"2023-08-22T00:07:15.302998+0000","last_unstale":"2023-08-22T00:07:15.669484+0000","last_undegraded":"2023-08-22T00:07:15.669484+0000","last_fullsized":"2023-08-22T00:07:15.669484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.669916+0000","last_change":"2023-08-22T00:07:15.669916+0000","last_active":"2023-08-22T00:07:15.669916+0000","last_peered":"2023-08-22T00:07:15.669916+0000","last_clean":"2023-08-22T00:07:15.669916+0000","last_became_active":"2023-08-22T00:07:15.669633+0000","last_became_peered":"2023-08-22T00:07:15.669633+0000","last_unstale":"2023-08-22T00:07:15.669916+0000","last_undegraded":"2023-08-22T00:07:15.669916+0000","last_fullsized":"2023-08-22T00:07:15.669916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.666580+0000","last_change":"2023-08-22T00:07:15.298717+0000","last_active":"2023-08-22T00:07:15.666580+0000","last_peered":"2023-08-22T00:07:15.666580+0000","last_clean":"2023-08-22T00:07:15.666580+0000","last_became_active":"2023-08-22T00:07:15.298424+0000","last_became_peered":"2023-08-22T00:07:15.298424+0000","last_unstale":"2023-08-22T00:07:15.666580+0000","last_undegraded":"2023-08-22T00:07:15.666580+0000","last_fullsized":"2023-08-22T00:07:15.666580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688351+0000","last_change":"2023-08-22T00:07:15.688351+0000","last_active":"2023-08-22T00:07:15.688351+0000","last_peered":"2023-08-22T00:07:15.688351+0000","last_clean":"2023-08-22T00:07:15.688351+0000","last_became_active":"2023-08-22T00:07:15.688042+0000","last_became_peered":"2023-08-22T00:07:15.688042+0000","last_unstale":"2023-08-22T00:07:15.688351+0000","last_undegraded":"2023-08-22T00:07:15.688351+0000","last_fullsized":"2023-08-22T00:07:15.688351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.691779+0000","last_change":"2023-08-22T00:07:15.311044+0000","last_active":"2023-08-22T00:07:15.691779+0000","last_peered":"2023-08-22T00:07:15.691779+0000","last_clean":"2023-08-22T00:07:15.691779+0000","last_became_active":"2023-08-22T00:07:15.310652+0000","last_became_peered":"2023-08-22T00:07:15.310652+0000","last_unstale":"2023-08-22T00:07:15.691779+0000","last_undegraded":"2023-08-22T00:07:15.691779+0000","last_fullsized":"2023-08-22T00:07:15.691779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683517+0000","last_change":"2023-08-22T00:07:15.683517+0000","last_active":"2023-08-22T00:07:15.683517+0000","last_peered":"2023-08-22T00:07:15.683517+0000","last_clean":"2023-08-22T00:07:15.683517+0000","last_became_active":"2023-08-22T00:07:15.683185+0000","last_became_peered":"2023-08-22T00:07:15.683185+0000","last_unstale":"2023-08-22T00:07:15.683517+0000","last_undegraded":"2023-08-22T00:07:15.683517+0000","last_fullsized":"2023-08-22T00:07:15.683517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313445+0000","last_change":"2023-08-22T00:07:15.312490+0000","last_active":"2023-08-22T00:07:15.313445+0000","last_peered":"2023-08-22T00:07:15.313445+0000","last_clean":"2023-08-22T00:07:15.313445+0000","last_became_active":"2023-08-22T00:07:15.312185+0000","last_became_peered":"2023-08-22T00:07:15.312185+0000","last_unstale":"2023-08-22T00:07:15.313445+0000","last_undegraded":"2023-08-22T00:07:15.313445+0000","last_fullsized":"2023-08-22T00:07:15.313445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.668009+0000","last_change":"2023-08-22T00:07:15.668009+0000","last_active":"2023-08-22T00:07:15.668009+0000","last_peered":"2023-08-22T00:07:15.668009+0000","last_clean":"2023-08-22T00:07:15.668009+0000","last_became_active":"2023-08-22T00:07:15.667714+0000","last_became_peered":"2023-08-22T00:07:15.667714+0000","last_unstale":"2023-08-22T00:07:15.668009+0000","last_undegraded":"2023-08-22T00:07:15.668009+0000","last_fullsized":"2023-08-22T00:07:15.668009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310299+0000","last_change":"2023-08-22T00:07:15.300223+0000","last_active":"2023-08-22T00:07:15.310299+0000","last_peered":"2023-08-22T00:07:15.310299+0000","last_clean":"2023-08-22T00:07:15.310299+0000","last_became_active":"2023-08-22T00:07:15.299956+0000","last_became_peered":"2023-08-22T00:07:15.299956+0000","last_unstale":"2023-08-22T00:07:15.310299+0000","last_undegraded":"2023-08-22T00:07:15.310299+0000","last_fullsized":"2023-08-22T00:07:15.310299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682518+0000","last_change":"2023-08-22T00:07:15.682518+0000","last_active":"2023-08-22T00:07:15.682518+0000","last_peered":"2023-08-22T00:07:15.682518+0000","last_clean":"2023-08-22T00:07:15.682518+0000","last_became_active":"2023-08-22T00:07:15.682085+0000","last_became_peered":"2023-08-22T00:07:15.682085+0000","last_unstale":"2023-08-22T00:07:15.682518+0000","last_undegraded":"2023-08-22T00:07:15.682518+0000","last_fullsized":"2023-08-22T00:07:15.682518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.309009+0000","last_change":"2023-08-22T00:07:15.306373+0000","last_active":"2023-08-22T00:07:15.309009+0000","last_peered":"2023-08-22T00:07:15.309009+0000","last_clean":"2023-08-22T00:07:15.309009+0000","last_became_active":"2023-08-22T00:07:15.306085+0000","last_became_peered":"2023-08-22T00:07:15.306085+0000","last_unstale":"2023-08-22T00:07:15.309009+0000","last_undegraded":"2023-08-22T00:07:15.309009+0000","last_fullsized":"2023-08-22T00:07:15.309009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.681570+0000","last_change":"2023-08-22T00:07:15.681570+0000","last_active":"2023-08-22T00:07:15.681570+0000","last_peered":"2023-08-22T00:07:15.681570+0000","last_clean":"2023-08-22T00:07:15.681570+0000","last_became_active":"2023-08-22T00:07:15.681271+0000","last_became_peered":"2023-08-22T00:07:15.681271+0000","last_unstale":"2023-08-22T00:07:15.681570+0000","last_undegraded":"2023-08-22T00:07:15.681570+0000","last_fullsized":"2023-08-22T00:07:15.681570+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.312570+0000","last_change":"2023-08-22T00:07:15.309737+0000","last_active":"2023-08-22T00:07:15.312570+0000","last_peered":"2023-08-22T00:07:15.312570+0000","last_clean":"2023-08-22T00:07:15.312570+0000","last_became_active":"2023-08-22T00:07:15.309462+0000","last_became_peered":"2023-08-22T00:07:15.309462+0000","last_unstale":"2023-08-22T00:07:15.312570+0000","last_undegraded":"2023-08-22T00:07:15.312570+0000","last_fullsized":"2023-08-22T00:07:15.312570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679698+0000","last_change":"2023-08-22T00:07:15.679698+0000","last_active":"2023-08-22T00:07:15.679698+0000","last_peered":"2023-08-22T00:07:15.679698+0000","last_clean":"2023-08-22T00:07:15.679698+0000","last_became_active":"2023-08-22T00:07:15.679121+0000","last_became_peered":"2023-08-22T00:07:15.679121+0000","last_unstale":"2023-08-22T00:07:15.679698+0000","last_undegraded":"2023-08-22T00:07:15.679698+0000","last_fullsized":"2023-08-22T00:07:15.679698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.306695+0000","last_change":"2023-08-22T00:07:15.302715+0000","last_active":"2023-08-22T00:07:15.306695+0000","last_peered":"2023-08-22T00:07:15.306695+0000","last_clean":"2023-08-22T00:07:15.306695+0000","last_became_active":"2023-08-22T00:07:15.302438+0000","last_became_peered":"2023-08-22T00:07:15.302438+0000","last_unstale":"2023-08-22T00:07:15.306695+0000","last_undegraded":"2023-08-22T00:07:15.306695+0000","last_fullsized":"2023-08-22T00:07:15.306695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686764+0000","last_change":"2023-08-22T00:07:15.686764+0000","last_active":"2023-08-22T00:07:15.686764+0000","last_peered":"2023-08-22T00:07:15.686764+0000","last_clean":"2023-08-22T00:07:15.686764+0000","last_became_active":"2023-08-22T00:07:15.686133+0000","last_became_peered":"2023-08-22T00:07:15.686133+0000","last_unstale":"2023-08-22T00:07:15.686764+0000","last_undegraded":"2023-08-22T00:07:15.686764+0000","last_fullsized":"2023-08-22T00:07:15.686764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.309922+0000","last_change":"2023-08-22T00:07:15.301165+0000","last_active":"2023-08-22T00:07:15.309922+0000","last_peered":"2023-08-22T00:07:15.309922+0000","last_clean":"2023-08-22T00:07:15.309922+0000","last_became_active":"2023-08-22T00:07:15.300828+0000","last_became_peered":"2023-08-22T00:07:15.300828+0000","last_unstale":"2023-08-22T00:07:15.309922+0000","last_undegraded":"2023-08-22T00:07:15.309922+0000","last_fullsized":"2023-08-22T00:07:15.309922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.690415+0000","last_change":"2023-08-22T00:07:15.690415+0000","last_active":"2023-08-22T00:07:15.690415+0000","last_peered":"2023-08-22T00:07:15.690415+0000","last_clean":"2023-08-22T00:07:15.690415+0000","last_became_active":"2023-08-22T00:07:15.690059+0000","last_became_peered":"2023-08-22T00:07:15.690059+0000","last_unstale":"2023-08-22T00:07:15.690415+0000","last_undegraded":"2023-08-22T00:07:15.690415+0000","last_fullsized":"2023-08-22T00:07:15.690415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307692+0000","last_change":"2023-08-22T00:07:15.304428+0000","last_active":"2023-08-22T00:07:15.307692+0000","last_peered":"2023-08-22T00:07:15.307692+0000","last_clean":"2023-08-22T00:07:15.307692+0000","last_became_active":"2023-08-22T00:07:15.304166+0000","last_became_peered":"2023-08-22T00:07:15.304166+0000","last_unstale":"2023-08-22T00:07:15.307692+0000","last_undegraded":"2023-08-22T00:07:15.307692+0000","last_fullsized":"2023-08-22T00:07:15.307692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.690042+0000","last_change":"2023-08-22T00:07:15.690042+0000","last_active":"2023-08-22T00:07:15.690042+0000","last_peered":"2023-08-22T00:07:15.690042+0000","last_clean":"2023-08-22T00:07:15.690042+0000","last_became_active":"2023-08-22T00:07:15.689765+0000","last_became_peered":"2023-08-22T00:07:15.689765+0000","last_unstale":"2023-08-22T00:07:15.690042+0000","last_undegraded":"2023-08-22T00:07:15.690042+0000","last_fullsized":"2023-08-22T00:07:15.690042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.685652+0000","last_change":"2023-08-22T00:07:15.307829+0000","last_active":"2023-08-22T00:07:15.685652+0000","last_peered":"2023-08-22T00:07:15.685652+0000","last_clean":"2023-08-22T00:07:15.685652+0000","last_became_active":"2023-08-22T00:07:15.307544+0000","last_became_peered":"2023-08-22T00:07:15.307544+0000","last_unstale":"2023-08-22T00:07:15.685652+0000","last_undegraded":"2023-08-22T00:07:15.685652+0000","last_fullsized":"2023-08-22T00:07:15.685652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686163+0000","last_change":"2023-08-22T00:07:15.686163+0000","last_active":"2023-08-22T00:07:15.686163+0000","last_peered":"2023-08-22T00:07:15.686163+0000","last_clean":"2023-08-22T00:07:15.686163+0000","last_became_active":"2023-08-22T00:07:15.684715+0000","last_became_peered":"2023-08-22T00:07:15.684715+0000","last_unstale":"2023-08-22T00:07:15.686163+0000","last_undegraded":"2023-08-22T00:07:15.686163+0000","last_fullsized":"2023-08-22T00:07:15.686163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677907+0000","last_change":"2023-08-22T00:07:15.307685+0000","last_active":"2023-08-22T00:07:15.677907+0000","last_peered":"2023-08-22T00:07:15.677907+0000","last_clean":"2023-08-22T00:07:15.677907+0000","last_became_active":"2023-08-22T00:07:15.307425+0000","last_became_peered":"2023-08-22T00:07:15.307425+0000","last_unstale":"2023-08-22T00:07:15.677907+0000","last_undegraded":"2023-08-22T00:07:15.677907+0000","last_fullsized":"2023-08-22T00:07:15.677907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684878+0000","last_change":"2023-08-22T00:07:15.684878+0000","last_active":"2023-08-22T00:07:15.684878+0000","last_peered":"2023-08-22T00:07:15.684878+0000","last_clean":"2023-08-22T00:07:15.684878+0000","last_became_active":"2023-08-22T00:07:15.681908+0000","last_became_peered":"2023-08-22T00:07:15.681908+0000","last_unstale":"2023-08-22T00:07:15.684878+0000","last_undegraded":"2023-08-22T00:07:15.684878+0000","last_fullsized":"2023-08-22T00:07:15.684878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675420+0000","last_change":"2023-08-22T00:07:15.308300+0000","last_active":"2023-08-22T00:07:15.675420+0000","last_peered":"2023-08-22T00:07:15.675420+0000","last_clean":"2023-08-22T00:07:15.675420+0000","last_became_active":"2023-08-22T00:07:15.305253+0000","last_became_peered":"2023-08-22T00:07:15.305253+0000","last_unstale":"2023-08-22T00:07:15.675420+0000","last_undegraded":"2023-08-22T00:07:15.675420+0000","last_fullsized":"2023-08-22T00:07:15.675420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686702+0000","last_change":"2023-08-22T00:07:15.686702+0000","last_active":"2023-08-22T00:07:15.686702+0000","last_peered":"2023-08-22T00:07:15.686702+0000","last_clean":"2023-08-22T00:07:15.686702+0000","last_became_active":"2023-08-22T00:07:15.686446+0000","last_became_peered":"2023-08-22T00:07:15.686446+0000","last_unstale":"2023-08-22T00:07:15.686702+0000","last_undegraded":"2023-08-22T00:07:15.686702+0000","last_fullsized":"2023-08-22T00:07:15.686702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303426+0000","last_change":"2023-08-22T00:07:15.301608+0000","last_active":"2023-08-22T00:07:15.303426+0000","last_peered":"2023-08-22T00:07:15.303426+0000","last_clean":"2023-08-22T00:07:15.303426+0000","last_became_active":"2023-08-22T00:07:15.301338+0000","last_became_peered":"2023-08-22T00:07:15.301338+0000","last_unstale":"2023-08-22T00:07:15.303426+0000","last_undegraded":"2023-08-22T00:07:15.303426+0000","last_fullsized":"2023-08-22T00:07:15.303426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688840+0000","last_change":"2023-08-22T00:07:15.688840+0000","last_active":"2023-08-22T00:07:15.688840+0000","last_peered":"2023-08-22T00:07:15.688840+0000","last_clean":"2023-08-22T00:07:15.688840+0000","last_became_active":"2023-08-22T00:07:15.688602+0000","last_became_peered":"2023-08-22T00:07:15.688602+0000","last_unstale":"2023-08-22T00:07:15.688840+0000","last_undegraded":"2023-08-22T00:07:15.688840+0000","last_fullsized":"2023-08-22T00:07:15.688840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313132+0000","last_change":"2023-08-22T00:07:15.311000+0000","last_active":"2023-08-22T00:07:15.313132+0000","last_peered":"2023-08-22T00:07:15.313132+0000","last_clean":"2023-08-22T00:07:15.313132+0000","last_became_active":"2023-08-22T00:07:15.310714+0000","last_became_peered":"2023-08-22T00:07:15.310714+0000","last_unstale":"2023-08-22T00:07:15.313132+0000","last_undegraded":"2023-08-22T00:07:15.313132+0000","last_fullsized":"2023-08-22T00:07:15.313132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686010+0000","last_change":"2023-08-22T00:07:15.686010+0000","last_active":"2023-08-22T00:07:15.686010+0000","last_peered":"2023-08-22T00:07:15.686010+0000","last_clean":"2023-08-22T00:07:15.686010+0000","last_became_active":"2023-08-22T00:07:15.682584+0000","last_became_peered":"2023-08-22T00:07:15.682584+0000","last_unstale":"2023-08-22T00:07:15.686010+0000","last_undegraded":"2023-08-22T00:07:15.686010+0000","last_fullsized":"2023-08-22T00:07:15.686010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.692003+0000","last_change":"2023-08-22T00:07:15.310429+0000","last_active":"2023-08-22T00:07:15.692003+0000","last_peered":"2023-08-22T00:07:15.692003+0000","last_clean":"2023-08-22T00:07:15.692003+0000","last_became_active":"2023-08-22T00:07:15.310119+0000","last_became_peered":"2023-08-22T00:07:15.310119+0000","last_unstale":"2023-08-22T00:07:15.692003+0000","last_undegraded":"2023-08-22T00:07:15.692003+0000","last_fullsized":"2023-08-22T00:07:15.692003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677716+0000","last_change":"2023-08-22T00:07:15.677716+0000","last_active":"2023-08-22T00:07:15.677716+0000","last_peered":"2023-08-22T00:07:15.677716+0000","last_clean":"2023-08-22T00:07:15.677716+0000","last_became_active":"2023-08-22T00:07:15.677414+0000","last_became_peered":"2023-08-22T00:07:15.677414+0000","last_unstale":"2023-08-22T00:07:15.677716+0000","last_undegraded":"2023-08-22T00:07:15.677716+0000","last_fullsized":"2023-08-22T00:07:15.677716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.665730+0000","last_change":"2023-08-22T00:07:15.302237+0000","last_active":"2023-08-22T00:07:15.665730+0000","last_peered":"2023-08-22T00:07:15.665730+0000","last_clean":"2023-08-22T00:07:15.665730+0000","last_became_active":"2023-08-22T00:07:15.301967+0000","last_became_peered":"2023-08-22T00:07:15.301967+0000","last_unstale":"2023-08-22T00:07:15.665730+0000","last_undegraded":"2023-08-22T00:07:15.665730+0000","last_fullsized":"2023-08-22T00:07:15.665730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688320+0000","last_change":"2023-08-22T00:07:15.688320+0000","last_active":"2023-08-22T00:07:15.688320+0000","last_peered":"2023-08-22T00:07:15.688320+0000","last_clean":"2023-08-22T00:07:15.688320+0000","last_became_active":"2023-08-22T00:07:15.687947+0000","last_became_peered":"2023-08-22T00:07:15.687947+0000","last_unstale":"2023-08-22T00:07:15.688320+0000","last_undegraded":"2023-08-22T00:07:15.688320+0000","last_fullsized":"2023-08-22T00:07:15.688320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683326+0000","last_change":"2023-08-22T00:07:15.297679+0000","last_active":"2023-08-22T00:07:15.683326+0000","last_peered":"2023-08-22T00:07:15.683326+0000","last_clean":"2023-08-22T00:07:15.683326+0000","last_became_active":"2023-08-22T00:07:15.297375+0000","last_became_peered":"2023-08-22T00:07:15.297375+0000","last_unstale":"2023-08-22T00:07:15.683326+0000","last_undegraded":"2023-08-22T00:07:15.683326+0000","last_fullsized":"2023-08-22T00:07:15.683326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683394+0000","last_change":"2023-08-22T00:07:15.683394+0000","last_active":"2023-08-22T00:07:15.683394+0000","last_peered":"2023-08-22T00:07:15.683394+0000","last_clean":"2023-08-22T00:07:15.683394+0000","last_became_active":"2023-08-22T00:07:15.683122+0000","last_became_peered":"2023-08-22T00:07:15.683122+0000","last_unstale":"2023-08-22T00:07:15.683394+0000","last_undegraded":"2023-08-22T00:07:15.683394+0000","last_fullsized":"2023-08-22T00:07:15.683394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315534+0000","last_change":"2023-08-22T00:07:15.314296+0000","last_active":"2023-08-22T00:07:15.315534+0000","last_peered":"2023-08-22T00:07:15.315534+0000","last_clean":"2023-08-22T00:07:15.315534+0000","last_became_active":"2023-08-22T00:07:15.310027+0000","last_became_peered":"2023-08-22T00:07:15.310027+0000","last_unstale":"2023-08-22T00:07:15.315534+0000","last_undegraded":"2023-08-22T00:07:15.315534+0000","last_fullsized":"2023-08-22T00:07:15.315534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686727+0000","last_change":"2023-08-22T00:07:15.686727+0000","last_active":"2023-08-22T00:07:15.686727+0000","last_peered":"2023-08-22T00:07:15.686727+0000","last_clean":"2023-08-22T00:07:15.686727+0000","last_became_active":"2023-08-22T00:07:15.685781+0000","last_became_peered":"2023-08-22T00:07:15.685781+0000","last_unstale":"2023-08-22T00:07:15.686727+0000","last_undegraded":"2023-08-22T00:07:15.686727+0000","last_fullsized":"2023-08-22T00:07:15.686727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305355+0000","last_change":"2023-08-22T00:07:15.298620+0000","last_active":"2023-08-22T00:07:15.305355+0000","last_peered":"2023-08-22T00:07:15.305355+0000","last_clean":"2023-08-22T00:07:15.305355+0000","last_became_active":"2023-08-22T00:07:15.298350+0000","last_became_peered":"2023-08-22T00:07:15.298350+0000","last_unstale":"2023-08-22T00:07:15.305355+0000","last_undegraded":"2023-08-22T00:07:15.305355+0000","last_fullsized":"2023-08-22T00:07:15.305355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688959+0000","last_change":"2023-08-22T00:07:15.688959+0000","last_active":"2023-08-22T00:07:15.688959+0000","last_peered":"2023-08-22T00:07:15.688959+0000","last_clean":"2023-08-22T00:07:15.688959+0000","last_became_active":"2023-08-22T00:07:15.688739+0000","last_became_peered":"2023-08-22T00:07:15.688739+0000","last_unstale":"2023-08-22T00:07:15.688959+0000","last_undegraded":"2023-08-22T00:07:15.688959+0000","last_fullsized":"2023-08-22T00:07:15.688959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675505+0000","last_change":"2023-08-22T00:07:15.298073+0000","last_active":"2023-08-22T00:07:15.675505+0000","last_peered":"2023-08-22T00:07:15.675505+0000","last_clean":"2023-08-22T00:07:15.675505+0000","last_became_active":"2023-08-22T00:07:15.297813+0000","last_became_peered":"2023-08-22T00:07:15.297813+0000","last_unstale":"2023-08-22T00:07:15.675505+0000","last_undegraded":"2023-08-22T00:07:15.675505+0000","last_fullsized":"2023-08-22T00:07:15.675505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.693182+0000","last_change":"2023-08-22T00:07:15.693182+0000","last_active":"2023-08-22T00:07:15.693182+0000","last_peered":"2023-08-22T00:07:15.693182+0000","last_clean":"2023-08-22T00:07:15.693182+0000","last_became_active":"2023-08-22T00:07:15.692922+0000","last_became_peered":"2023-08-22T00:07:15.692922+0000","last_unstale":"2023-08-22T00:07:15.693182+0000","last_undegraded":"2023-08-22T00:07:15.693182+0000","last_fullsized":"2023-08-22T00:07:15.693182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315015+0000","last_change":"2023-08-22T00:07:15.314117+0000","last_active":"2023-08-22T00:07:15.315015+0000","last_peered":"2023-08-22T00:07:15.315015+0000","last_clean":"2023-08-22T00:07:15.315015+0000","last_became_active":"2023-08-22T00:07:15.312318+0000","last_became_peered":"2023-08-22T00:07:15.312318+0000","last_unstale":"2023-08-22T00:07:15.315015+0000","last_undegraded":"2023-08-22T00:07:15.315015+0000","last_fullsized":"2023-08-22T00:07:15.315015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684045+0000","last_change":"2023-08-22T00:07:15.684045+0000","last_active":"2023-08-22T00:07:15.684045+0000","last_peered":"2023-08-22T00:07:15.684045+0000","last_clean":"2023-08-22T00:07:15.684045+0000","last_became_active":"2023-08-22T00:07:15.683783+0000","last_became_peered":"2023-08-22T00:07:15.683783+0000","last_unstale":"2023-08-22T00:07:15.684045+0000","last_undegraded":"2023-08-22T00:07:15.684045+0000","last_fullsized":"2023-08-22T00:07:15.684045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307668+0000","last_change":"2023-08-22T00:07:15.304333+0000","last_active":"2023-08-22T00:07:15.307668+0000","last_peered":"2023-08-22T00:07:15.307668+0000","last_clean":"2023-08-22T00:07:15.307668+0000","last_became_active":"2023-08-22T00:07:15.304075+0000","last_became_peered":"2023-08-22T00:07:15.304075+0000","last_unstale":"2023-08-22T00:07:15.307668+0000","last_undegraded":"2023-08-22T00:07:15.307668+0000","last_fullsized":"2023-08-22T00:07:15.307668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682341+0000","last_change":"2023-08-22T00:07:15.682341+0000","last_active":"2023-08-22T00:07:15.682341+0000","last_peered":"2023-08-22T00:07:15.682341+0000","last_clean":"2023-08-22T00:07:15.682341+0000","last_became_active":"2023-08-22T00:07:15.682058+0000","last_became_peered":"2023-08-22T00:07:15.682058+0000","last_unstale":"2023-08-22T00:07:15.682341+0000","last_undegraded":"2023-08-22T00:07:15.682341+0000","last_fullsized":"2023-08-22T00:07:15.682341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303315+0000","last_change":"2023-08-22T00:07:15.300904+0000","last_active":"2023-08-22T00:07:15.303315+0000","last_peered":"2023-08-22T00:07:15.303315+0000","last_clean":"2023-08-22T00:07:15.303315+0000","last_became_active":"2023-08-22T00:07:15.300623+0000","last_became_peered":"2023-08-22T00:07:15.300623+0000","last_unstale":"2023-08-22T00:07:15.303315+0000","last_undegraded":"2023-08-22T00:07:15.303315+0000","last_fullsized":"2023-08-22T00:07:15.303315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683186+0000","last_change":"2023-08-22T00:07:15.683186+0000","last_active":"2023-08-22T00:07:15.683186+0000","last_peered":"2023-08-22T00:07:15.683186+0000","last_clean":"2023-08-22T00:07:15.683186+0000","last_became_active":"2023-08-22T00:07:15.682905+0000","last_became_peered":"2023-08-22T00:07:15.682905+0000","last_unstale":"2023-08-22T00:07:15.683186+0000","last_undegraded":"2023-08-22T00:07:15.683186+0000","last_fullsized":"2023-08-22T00:07:15.683186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310316+0000","last_change":"2023-08-22T00:07:15.307872+0000","last_active":"2023-08-22T00:07:15.310316+0000","last_peered":"2023-08-22T00:07:15.310316+0000","last_clean":"2023-08-22T00:07:15.310316+0000","last_became_active":"2023-08-22T00:07:15.307527+0000","last_became_peered":"2023-08-22T00:07:15.307527+0000","last_unstale":"2023-08-22T00:07:15.310316+0000","last_undegraded":"2023-08-22T00:07:15.310316+0000","last_fullsized":"2023-08-22T00:07:15.310316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.296589+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:07:15.296589+0000","last_peered":"2023-08-22T00:07:15.296589+0000","last_clean":"2023-08-22T00:07:15.296589+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:07:15.296589+0000","last_undegraded":"2023-08-22T00:07:15.296589+0000","last_fullsized":"2023-08-22T00:07:15.296589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689410+0000","last_change":"2023-08-22T00:07:15.689410+0000","last_active":"2023-08-22T00:07:15.689410+0000","last_peered":"2023-08-22T00:07:15.689410+0000","last_clean":"2023-08-22T00:07:15.689410+0000","last_became_active":"2023-08-22T00:07:15.689234+0000","last_became_peered":"2023-08-22T00:07:15.689234+0000","last_unstale":"2023-08-22T00:07:15.689410+0000","last_undegraded":"2023-08-22T00:07:15.689410+0000","last_fullsized":"2023-08-22T00:07:15.689410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.306922+0000","last_change":"2023-08-22T00:07:15.299922+0000","last_active":"2023-08-22T00:07:15.306922+0000","last_peered":"2023-08-22T00:07:15.306922+0000","last_clean":"2023-08-22T00:07:15.306922+0000","last_became_active":"2023-08-22T00:07:15.299635+0000","last_became_peered":"2023-08-22T00:07:15.299635+0000","last_unstale":"2023-08-22T00:07:15.306922+0000","last_undegraded":"2023-08-22T00:07:15.306922+0000","last_fullsized":"2023-08-22T00:07:15.306922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.291580+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:07:15.291580+0000","last_peered":"2023-08-22T00:07:15.291580+0000","last_clean":"2023-08-22T00:07:15.291580+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:07:15.291580+0000","last_undegraded":"2023-08-22T00:07:15.291580+0000","last_fullsized":"2023-08-22T00:07:15.291580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684600+0000","last_change":"2023-08-22T00:07:15.684600+0000","last_active":"2023-08-22T00:07:15.684600+0000","last_peered":"2023-08-22T00:07:15.684600+0000","last_clean":"2023-08-22T00:07:15.684600+0000","last_became_active":"2023-08-22T00:07:15.684302+0000","last_became_peered":"2023-08-22T00:07:15.684302+0000","last_unstale":"2023-08-22T00:07:15.684600+0000","last_undegraded":"2023-08-22T00:07:15.684600+0000","last_fullsized":"2023-08-22T00:07:15.684600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.299307+0000","last_change":"2023-08-22T00:07:15.297277+0000","last_active":"2023-08-22T00:07:15.299307+0000","last_peered":"2023-08-22T00:07:15.299307+0000","last_clean":"2023-08-22T00:07:15.299307+0000","last_became_active":"2023-08-22T00:07:15.297006+0000","last_became_peered":"2023-08-22T00:07:15.297006+0000","last_unstale":"2023-08-22T00:07:15.299307+0000","last_undegraded":"2023-08-22T00:07:15.299307+0000","last_fullsized":"2023-08-22T00:07:15.299307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.294222+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:07:15.294222+0000","last_peered":"2023-08-22T00:07:15.294222+0000","last_clean":"2023-08-22T00:07:15.294222+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:07:15.294222+0000","last_undegraded":"2023-08-22T00:07:15.294222+0000","last_fullsized":"2023-08-22T00:07:15.294222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688587+0000","last_change":"2023-08-22T00:07:15.688587+0000","last_active":"2023-08-22T00:07:15.688587+0000","last_peered":"2023-08-22T00:07:15.688587+0000","last_clean":"2023-08-22T00:07:15.688587+0000","last_became_active":"2023-08-22T00:07:15.688303+0000","last_became_peered":"2023-08-22T00:07:15.688303+0000","last_unstale":"2023-08-22T00:07:15.688587+0000","last_undegraded":"2023-08-22T00:07:15.688587+0000","last_fullsized":"2023-08-22T00:07:15.688587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307942+0000","last_change":"2023-08-22T00:07:15.306391+0000","last_active":"2023-08-22T00:07:15.307942+0000","last_peered":"2023-08-22T00:07:15.307942+0000","last_clean":"2023-08-22T00:07:15.307942+0000","last_became_active":"2023-08-22T00:07:15.306112+0000","last_became_peered":"2023-08-22T00:07:15.306112+0000","last_unstale":"2023-08-22T00:07:15.307942+0000","last_undegraded":"2023-08-22T00:07:15.307942+0000","last_fullsized":"2023-08-22T00:07:15.307942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.292790+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:07:15.292790+0000","last_peered":"2023-08-22T00:07:15.292790+0000","last_clean":"2023-08-22T00:07:15.292790+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:07:15.292790+0000","last_undegraded":"2023-08-22T00:07:15.292790+0000","last_fullsized":"2023-08-22T00:07:15.292790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686645+0000","last_change":"2023-08-22T00:07:15.686645+0000","last_active":"2023-08-22T00:07:15.686645+0000","last_peered":"2023-08-22T00:07:15.686645+0000","last_clean":"2023-08-22T00:07:15.686645+0000","last_became_active":"2023-08-22T00:07:15.686389+0000","last_became_peered":"2023-08-22T00:07:15.686389+0000","last_unstale":"2023-08-22T00:07:15.686645+0000","last_undegraded":"2023-08-22T00:07:15.686645+0000","last_fullsized":"2023-08-22T00:07:15.686645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686424+0000","last_change":"2023-08-22T00:07:15.314568+0000","last_active":"2023-08-22T00:07:15.686424+0000","last_peered":"2023-08-22T00:07:15.686424+0000","last_clean":"2023-08-22T00:07:15.686424+0000","last_became_active":"2023-08-22T00:07:15.314134+0000","last_became_peered":"2023-08-22T00:07:15.314134+0000","last_unstale":"2023-08-22T00:07:15.686424+0000","last_undegraded":"2023-08-22T00:07:15.686424+0000","last_fullsized":"2023-08-22T00:07:15.686424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.292701+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:07:15.292701+0000","last_peered":"2023-08-22T00:07:15.292701+0000","last_clean":"2023-08-22T00:07:15.292701+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:07:15.292701+0000","last_undegraded":"2023-08-22T00:07:15.292701+0000","last_fullsized":"2023-08-22T00:07:15.292701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305951+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:07:15.305951+0000","last_peered":"2023-08-22T00:07:15.305951+0000","last_clean":"2023-08-22T00:07:15.305951+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:07:15.305951+0000","last_undegraded":"2023-08-22T00:07:15.305951+0000","last_fullsized":"2023-08-22T00:07:15.305951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682006+0000","last_change":"2023-08-22T00:07:15.682006+0000","last_active":"2023-08-22T00:07:15.682006+0000","last_peered":"2023-08-22T00:07:15.682006+0000","last_clean":"2023-08-22T00:07:15.682006+0000","last_became_active":"2023-08-22T00:07:15.681762+0000","last_became_peered":"2023-08-22T00:07:15.681762+0000","last_unstale":"2023-08-22T00:07:15.682006+0000","last_undegraded":"2023-08-22T00:07:15.682006+0000","last_fullsized":"2023-08-22T00:07:15.682006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310343+0000","last_change":"2023-08-22T00:07:15.307885+0000","last_active":"2023-08-22T00:07:15.310343+0000","last_peered":"2023-08-22T00:07:15.310343+0000","last_clean":"2023-08-22T00:07:15.310343+0000","last_became_active":"2023-08-22T00:07:15.307606+0000","last_became_peered":"2023-08-22T00:07:15.307606+0000","last_unstale":"2023-08-22T00:07:15.310343+0000","last_undegraded":"2023-08-22T00:07:15.310343+0000","last_fullsized":"2023-08-22T00:07:15.310343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.290890+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:07:15.290890+0000","last_peered":"2023-08-22T00:07:15.290890+0000","last_clean":"2023-08-22T00:07:15.290890+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:07:15.290890+0000","last_undegraded":"2023-08-22T00:07:15.290890+0000","last_fullsized":"2023-08-22T00:07:15.290890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687515+0000","last_change":"2023-08-22T00:07:15.687515+0000","last_active":"2023-08-22T00:07:15.687515+0000","last_peered":"2023-08-22T00:07:15.687515+0000","last_clean":"2023-08-22T00:07:15.687515+0000","last_became_active":"2023-08-22T00:07:15.687190+0000","last_became_peered":"2023-08-22T00:07:15.687190+0000","last_unstale":"2023-08-22T00:07:15.687515+0000","last_undegraded":"2023-08-22T00:07:15.687515+0000","last_fullsized":"2023-08-22T00:07:15.687515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311217+0000","last_change":"2023-08-22T00:07:15.302238+0000","last_active":"2023-08-22T00:07:15.311217+0000","last_peered":"2023-08-22T00:07:15.311217+0000","last_clean":"2023-08-22T00:07:15.311217+0000","last_became_active":"2023-08-22T00:07:15.301970+0000","last_became_peered":"2023-08-22T00:07:15.301970+0000","last_unstale":"2023-08-22T00:07:15.311217+0000","last_undegraded":"2023-08-22T00:07:15.311217+0000","last_fullsized":"2023-08-22T00:07:15.311217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305326+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:07:15.305326+0000","last_peered":"2023-08-22T00:07:15.305326+0000","last_clean":"2023-08-22T00:07:15.305326+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:07:15.305326+0000","last_undegraded":"2023-08-22T00:07:15.305326+0000","last_fullsized":"2023-08-22T00:07:15.305326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680281+0000","last_change":"2023-08-22T00:07:15.680281+0000","last_active":"2023-08-22T00:07:15.680281+0000","last_peered":"2023-08-22T00:07:15.680281+0000","last_clean":"2023-08-22T00:07:15.680281+0000","last_became_active":"2023-08-22T00:07:15.679806+0000","last_became_peered":"2023-08-22T00:07:15.679806+0000","last_unstale":"2023-08-22T00:07:15.680281+0000","last_undegraded":"2023-08-22T00:07:15.680281+0000","last_fullsized":"2023-08-22T00:07:15.680281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307702+0000","last_change":"2023-08-22T00:07:15.304066+0000","last_active":"2023-08-22T00:07:15.307702+0000","last_peered":"2023-08-22T00:07:15.307702+0000","last_clean":"2023-08-22T00:07:15.307702+0000","last_became_active":"2023-08-22T00:07:15.303800+0000","last_became_peered":"2023-08-22T00:07:15.303800+0000","last_unstale":"2023-08-22T00:07:15.307702+0000","last_undegraded":"2023-08-22T00:07:15.307702+0000","last_fullsized":"2023-08-22T00:07:15.307702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.289993+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:07:15.289993+0000","last_peered":"2023-08-22T00:07:15.289993+0000","last_clean":"2023-08-22T00:07:15.289993+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:07:15.289993+0000","last_undegraded":"2023-08-22T00:07:15.289993+0000","last_fullsized":"2023-08-22T00:07:15.289993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":209628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.499}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":438272,"data_stored":194974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.504},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.622},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":209608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.33400000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.254}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.434}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39600000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.379}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":211018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.36799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":450560,"data_stored":202006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.215}]},{"osd":1,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44500000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":210148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.315}]},{"osd":1,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.29299999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33100000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":11.163,"5min":11.163,"15min":11.163},"last":0.433}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.502},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":471040,"data_stored":210182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.371}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":462848,"data_stored":209538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.50700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.498},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.374}]},{"osd":6,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:07:19.298 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:07:19.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.442+0000 7f06badab700 1 Processor -- start 2023-08-22T00:07:19.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.442+0000 7f06badab700 1 -- start start 2023-08-22T00:07:19.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06badab700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06b4154200 0x7f06b40bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06badab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b40bd8c0 0x7f06b4062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06badab700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b40c4cf0 con 0x7f06b4153e20 2023-08-22T00:07:19.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06badab700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b40bdd30 con 0x7f06b4154200 2023-08-22T00:07:19.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06badab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40c5870 con 0x7f06b40bd8c0 2023-08-22T00:07:19.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06b3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06b4154200 0x7f06b40bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06b3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06b4154200 0x7f06b40bd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60800/0 (socket says 172.21.15.98:60800) 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06b3fff700 1 -- 172.21.15.98:0/207042691 learned_addr learned my addr 172.21.15.98:0/207042691 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.443+0000 7f06b8b47700 1 --1- 172.21.15.98:0/207042691 >> v1:172.21.15.98:6789/0 conn(0x7f06b4153e20 0x7f06b40c5d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55474/0 (socket says 172.21.15.98:55474) 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b9348700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b40bd8c0 0x7f06b4062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b3fff700 1 -- 172.21.15.98:0/207042691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b40bd8c0 msgr2=0x7f06b4062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b3fff700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b40bd8c0 0x7f06b4062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b3fff700 1 -- 172.21.15.98:0/207042691 >> v1:172.21.15.98:6789/0 conn(0x7f06b4153e20 legacy=0x7f06b40c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b37fe700 1 -- 172.21.15.98:0/207042691 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592073654 0 0) 0x7f06b40c4cf0 con 0x7f06b4153e20 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b3fff700 1 -- 172.21.15.98:0/207042691 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4154a30 con 0x7f06b4154200 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b3fff700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b4154200 0x7f06b40bd3d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f06a0006fd0 tx=0x7f06a00090f0).ready entity=mon.0 client_cookie=698171ba3c9ec23b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b37fe700 1 -- 172.21.15.98:0/207042691 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000b600 con 0x7f06b4154200 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b37fe700 1 -- 172.21.15.98:0/207042691 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a000b760 con 0x7f06b4154200 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.444+0000 7f06b37fe700 1 -- 172.21.15.98:0/207042691 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000bae0 con 0x7f06b4154200 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 -- 172.21.15.98:0/207042691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b4154200 msgr2=0x7f06b40bd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b4154200 0x7f06b40bd3d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f06a0006fd0 tx=0x7f06a00090f0).stop 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 -- 172.21.15.98:0/207042691 shutdown_connections 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b40bd8c0 0x7f06b4062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 --2- 172.21.15.98:0/207042691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b4154200 0x7f06b40bd3d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 -- 172.21.15.98:0/207042691 >> 172.21.15.98:0/207042691 conn(0x7f06b40c3980 msgr2=0x7f06b40c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 -- 172.21.15.98:0/207042691 shutdown_connections 2023-08-22T00:07:19.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.445+0000 7f06badab700 1 -- 172.21.15.98:0/207042691 wait complete. 2023-08-22T00:07:19.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.446+0000 7f06badab700 1 Processor -- start 2023-08-22T00:07:19.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.446+0000 7f06badab700 1 -- start start 2023-08-22T00:07:19.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b4153e20 0x7f06b40ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b4154200 0x7f06b4147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4148cd0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40acdc0 con 0x7f06b4153e20 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4164880 con 0x7f06b4154200 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60810/0 (socket says 172.21.15.98:60810) 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 -- 172.21.15.98:0/3965575970 learned_addr learned my addr 172.21.15.98:0/3965575970 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b9348700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b4154200 0x7f06b4147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b3fff700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b4153e20 0x7f06b40ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 -- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b4154200 msgr2=0x7f06b4147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b4154200 0x7f06b4147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 -- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b4153e20 msgr2=0x7f06b40ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b4153e20 0x7f06b40ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 -- 172.21.15.98:0/3965575970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0009370 con 0x7f06b40bd8c0 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b8b47700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f06a800c510 tx=0x7f06a8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a80062e0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a8006440 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b41489f0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a80048a0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.447+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b414a140 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.448+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b40648f0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.449+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f06a8004c90 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.449+0000 7f06b0ff9700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 0x7f06980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.449+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f06a80798e0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.449+0000 7f06b3fff700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 0x7f06980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.449+0000 7f06b3fff700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 0x7f06980612d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f06a0009130 tx=0x7f06a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.453+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06a804abf0 con 0x7f06b40bd8c0 2023-08-22T00:07:19.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.609+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06b4047480 con 0x7f069805ee10 2023-08-22T00:07:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.621+0000 7f06b0ff9700 1 -- 172.21.15.98:0/3965575970 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361527 (secure 0 0 0) 0x7f06b4047480 con 0x7f069805ee10 2023-08-22T00:07:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:19.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 msgr2=0x7f06980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 0x7f06980612d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f06a0009130 tx=0x7f06a0017000).stop 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 msgr2=0x7f06b4148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f06a800c510 tx=0x7f06a8007c60).stop 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 shutdown_connections 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f069805ee10 0x7f06980612d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06b4154200 0x7f06b4147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b40bd8c0 0x7f06b4148360 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 --2- 172.21.15.98:0/3965575970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06b4153e20 0x7f06b40ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 >> 172.21.15.98:0/3965575970 conn(0x7f06b40c3980 msgr2=0x7f06b4066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:19.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 shutdown_connections 2023-08-22T00:07:19.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.624+0000 7f06badab700 1 -- 172.21.15.98:0/3965575970 wait complete. 2023-08-22T00:07:19.630 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:07:19.637 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-08-22T00:07:18.046547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380388,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594332,"statfs":{"total":773094113280,"available":770656595968,"internally_reserved":0,"allocated":3706880,"data_stored":1657102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3968,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-12,"num_write_kb":-9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.210620"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684675+0000","last_change":"2023-08-22T00:07:15.684675+0000","last_active":"2023-08-22T00:07:15.684675+0000","last_peered":"2023-08-22T00:07:15.684675+0000","last_clean":"2023-08-22T00:07:15.684675+0000","last_became_active":"2023-08-22T00:07:15.684334+0000","last_became_peered":"2023-08-22T00:07:15.684334+0000","last_unstale":"2023-08-22T00:07:15.684675+0000","last_undegraded":"2023-08-22T00:07:15.684675+0000","last_fullsized":"2023-08-22T00:07:15.684675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"40'3","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.681859+0000","last_change":"2023-08-22T00:07:15.305621+0000","last_active":"2023-08-22T00:07:15.681859+0000","last_peered":"2023-08-22T00:07:15.681859+0000","last_clean":"2023-08-22T00:07:15.681859+0000","last_became_active":"2023-08-22T00:07:15.305184+0000","last_became_peered":"2023-08-22T00:07:15.305184+0000","last_unstale":"2023-08-22T00:07:15.681859+0000","last_undegraded":"2023-08-22T00:07:15.681859+0000","last_fullsized":"2023-08-22T00:07:15.681859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684661+0000","last_change":"2023-08-22T00:07:15.684661+0000","last_active":"2023-08-22T00:07:15.684661+0000","last_peered":"2023-08-22T00:07:15.684661+0000","last_clean":"2023-08-22T00:07:15.684661+0000","last_became_active":"2023-08-22T00:07:15.684198+0000","last_became_peered":"2023-08-22T00:07:15.684198+0000","last_unstale":"2023-08-22T00:07:15.684661+0000","last_undegraded":"2023-08-22T00:07:15.684661+0000","last_fullsized":"2023-08-22T00:07:15.684661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305436+0000","last_change":"2023-08-22T00:07:15.300410+0000","last_active":"2023-08-22T00:07:15.305436+0000","last_peered":"2023-08-22T00:07:15.305436+0000","last_clean":"2023-08-22T00:07:15.305436+0000","last_became_active":"2023-08-22T00:07:15.300129+0000","last_became_peered":"2023-08-22T00:07:15.300129+0000","last_unstale":"2023-08-22T00:07:15.305436+0000","last_undegraded":"2023-08-22T00:07:15.305436+0000","last_fullsized":"2023-08-22T00:07:15.305436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682445+0000","last_change":"2023-08-22T00:07:15.682445+0000","last_active":"2023-08-22T00:07:15.682445+0000","last_peered":"2023-08-22T00:07:15.682445+0000","last_clean":"2023-08-22T00:07:15.682445+0000","last_became_active":"2023-08-22T00:07:15.682201+0000","last_became_peered":"2023-08-22T00:07:15.682201+0000","last_unstale":"2023-08-22T00:07:15.682445+0000","last_undegraded":"2023-08-22T00:07:15.682445+0000","last_fullsized":"2023-08-22T00:07:15.682445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.314759+0000","last_change":"2023-08-22T00:07:15.310600+0000","last_active":"2023-08-22T00:07:15.314759+0000","last_peered":"2023-08-22T00:07:15.314759+0000","last_clean":"2023-08-22T00:07:15.314759+0000","last_became_active":"2023-08-22T00:07:15.310129+0000","last_became_peered":"2023-08-22T00:07:15.310129+0000","last_unstale":"2023-08-22T00:07:15.314759+0000","last_undegraded":"2023-08-22T00:07:15.314759+0000","last_fullsized":"2023-08-22T00:07:15.314759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.674072+0000","last_change":"2023-08-22T00:07:15.674072+0000","last_active":"2023-08-22T00:07:15.674072+0000","last_peered":"2023-08-22T00:07:15.674072+0000","last_clean":"2023-08-22T00:07:15.674072+0000","last_became_active":"2023-08-22T00:07:15.673764+0000","last_became_peered":"2023-08-22T00:07:15.673764+0000","last_unstale":"2023-08-22T00:07:15.674072+0000","last_undegraded":"2023-08-22T00:07:15.674072+0000","last_fullsized":"2023-08-22T00:07:15.674072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677741+0000","last_change":"2023-08-22T00:07:15.307731+0000","last_active":"2023-08-22T00:07:15.677741+0000","last_peered":"2023-08-22T00:07:15.677741+0000","last_clean":"2023-08-22T00:07:15.677741+0000","last_became_active":"2023-08-22T00:07:15.307484+0000","last_became_peered":"2023-08-22T00:07:15.307484+0000","last_unstale":"2023-08-22T00:07:15.677741+0000","last_undegraded":"2023-08-22T00:07:15.677741+0000","last_fullsized":"2023-08-22T00:07:15.677741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683956+0000","last_change":"2023-08-22T00:07:15.683956+0000","last_active":"2023-08-22T00:07:15.683956+0000","last_peered":"2023-08-22T00:07:15.683956+0000","last_clean":"2023-08-22T00:07:15.683956+0000","last_became_active":"2023-08-22T00:07:15.683693+0000","last_became_peered":"2023-08-22T00:07:15.683693+0000","last_unstale":"2023-08-22T00:07:15.683956+0000","last_undegraded":"2023-08-22T00:07:15.683956+0000","last_fullsized":"2023-08-22T00:07:15.683956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.664902+0000","last_change":"2023-08-22T00:07:15.308084+0000","last_active":"2023-08-22T00:07:15.664902+0000","last_peered":"2023-08-22T00:07:15.664902+0000","last_clean":"2023-08-22T00:07:15.664902+0000","last_became_active":"2023-08-22T00:07:15.307793+0000","last_became_peered":"2023-08-22T00:07:15.307793+0000","last_unstale":"2023-08-22T00:07:15.664902+0000","last_undegraded":"2023-08-22T00:07:15.664902+0000","last_fullsized":"2023-08-22T00:07:15.664902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687034+0000","last_change":"2023-08-22T00:07:15.687034+0000","last_active":"2023-08-22T00:07:15.687034+0000","last_peered":"2023-08-22T00:07:15.687034+0000","last_clean":"2023-08-22T00:07:15.687034+0000","last_became_active":"2023-08-22T00:07:15.686718+0000","last_became_peered":"2023-08-22T00:07:15.686718+0000","last_unstale":"2023-08-22T00:07:15.687034+0000","last_undegraded":"2023-08-22T00:07:15.687034+0000","last_fullsized":"2023-08-22T00:07:15.687034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.676596+0000","last_change":"2023-08-22T00:07:15.306181+0000","last_active":"2023-08-22T00:07:15.676596+0000","last_peered":"2023-08-22T00:07:15.676596+0000","last_clean":"2023-08-22T00:07:15.676596+0000","last_became_active":"2023-08-22T00:07:15.305933+0000","last_became_peered":"2023-08-22T00:07:15.305933+0000","last_unstale":"2023-08-22T00:07:15.676596+0000","last_undegraded":"2023-08-22T00:07:15.676596+0000","last_fullsized":"2023-08-22T00:07:15.676596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683956+0000","last_change":"2023-08-22T00:07:15.683956+0000","last_active":"2023-08-22T00:07:15.683956+0000","last_peered":"2023-08-22T00:07:15.683956+0000","last_clean":"2023-08-22T00:07:15.683956+0000","last_became_active":"2023-08-22T00:07:15.683699+0000","last_became_peered":"2023-08-22T00:07:15.683699+0000","last_unstale":"2023-08-22T00:07:15.683956+0000","last_undegraded":"2023-08-22T00:07:15.683956+0000","last_fullsized":"2023-08-22T00:07:15.683956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.316097+0000","last_change":"2023-08-22T00:07:15.315526+0000","last_active":"2023-08-22T00:07:15.316097+0000","last_peered":"2023-08-22T00:07:15.316097+0000","last_clean":"2023-08-22T00:07:15.316097+0000","last_became_active":"2023-08-22T00:07:15.314144+0000","last_became_peered":"2023-08-22T00:07:15.314144+0000","last_unstale":"2023-08-22T00:07:15.316097+0000","last_undegraded":"2023-08-22T00:07:15.316097+0000","last_fullsized":"2023-08-22T00:07:15.316097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684775+0000","last_change":"2023-08-22T00:07:15.684775+0000","last_active":"2023-08-22T00:07:15.684775+0000","last_peered":"2023-08-22T00:07:15.684775+0000","last_clean":"2023-08-22T00:07:15.684775+0000","last_became_active":"2023-08-22T00:07:15.682814+0000","last_became_peered":"2023-08-22T00:07:15.682814+0000","last_unstale":"2023-08-22T00:07:15.684775+0000","last_undegraded":"2023-08-22T00:07:15.684775+0000","last_fullsized":"2023-08-22T00:07:15.684775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311505+0000","last_change":"2023-08-22T00:07:15.304730+0000","last_active":"2023-08-22T00:07:15.311505+0000","last_peered":"2023-08-22T00:07:15.311505+0000","last_clean":"2023-08-22T00:07:15.311505+0000","last_became_active":"2023-08-22T00:07:15.304482+0000","last_became_peered":"2023-08-22T00:07:15.304482+0000","last_unstale":"2023-08-22T00:07:15.311505+0000","last_undegraded":"2023-08-22T00:07:15.311505+0000","last_fullsized":"2023-08-22T00:07:15.311505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683496+0000","last_change":"2023-08-22T00:07:15.683496+0000","last_active":"2023-08-22T00:07:15.683496+0000","last_peered":"2023-08-22T00:07:15.683496+0000","last_clean":"2023-08-22T00:07:15.683496+0000","last_became_active":"2023-08-22T00:07:15.683146+0000","last_became_peered":"2023-08-22T00:07:15.683146+0000","last_unstale":"2023-08-22T00:07:15.683496+0000","last_undegraded":"2023-08-22T00:07:15.683496+0000","last_fullsized":"2023-08-22T00:07:15.683496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311876+0000","last_change":"2023-08-22T00:07:15.310010+0000","last_active":"2023-08-22T00:07:15.311876+0000","last_peered":"2023-08-22T00:07:15.311876+0000","last_clean":"2023-08-22T00:07:15.311876+0000","last_became_active":"2023-08-22T00:07:15.309705+0000","last_became_peered":"2023-08-22T00:07:15.309705+0000","last_unstale":"2023-08-22T00:07:15.311876+0000","last_undegraded":"2023-08-22T00:07:15.311876+0000","last_fullsized":"2023-08-22T00:07:15.311876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687703+0000","last_change":"2023-08-22T00:07:15.687703+0000","last_active":"2023-08-22T00:07:15.687703+0000","last_peered":"2023-08-22T00:07:15.687703+0000","last_clean":"2023-08-22T00:07:15.687703+0000","last_became_active":"2023-08-22T00:07:15.682780+0000","last_became_peered":"2023-08-22T00:07:15.682780+0000","last_unstale":"2023-08-22T00:07:15.687703+0000","last_undegraded":"2023-08-22T00:07:15.687703+0000","last_fullsized":"2023-08-22T00:07:15.687703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.312134+0000","last_change":"2023-08-22T00:07:15.306017+0000","last_active":"2023-08-22T00:07:15.312134+0000","last_peered":"2023-08-22T00:07:15.312134+0000","last_clean":"2023-08-22T00:07:15.312134+0000","last_became_active":"2023-08-22T00:07:15.305733+0000","last_became_peered":"2023-08-22T00:07:15.305733+0000","last_unstale":"2023-08-22T00:07:15.312134+0000","last_undegraded":"2023-08-22T00:07:15.312134+0000","last_fullsized":"2023-08-22T00:07:15.312134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683703+0000","last_change":"2023-08-22T00:07:15.683703+0000","last_active":"2023-08-22T00:07:15.683703+0000","last_peered":"2023-08-22T00:07:15.683703+0000","last_clean":"2023-08-22T00:07:15.683703+0000","last_became_active":"2023-08-22T00:07:15.683419+0000","last_became_peered":"2023-08-22T00:07:15.683419+0000","last_unstale":"2023-08-22T00:07:15.683703+0000","last_undegraded":"2023-08-22T00:07:15.683703+0000","last_fullsized":"2023-08-22T00:07:15.683703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315520+0000","last_change":"2023-08-22T00:07:15.309608+0000","last_active":"2023-08-22T00:07:15.315520+0000","last_peered":"2023-08-22T00:07:15.315520+0000","last_clean":"2023-08-22T00:07:15.315520+0000","last_became_active":"2023-08-22T00:07:15.309321+0000","last_became_peered":"2023-08-22T00:07:15.309321+0000","last_unstale":"2023-08-22T00:07:15.315520+0000","last_undegraded":"2023-08-22T00:07:15.315520+0000","last_fullsized":"2023-08-22T00:07:15.315520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686061+0000","last_change":"2023-08-22T00:07:15.686061+0000","last_active":"2023-08-22T00:07:15.686061+0000","last_peered":"2023-08-22T00:07:15.686061+0000","last_clean":"2023-08-22T00:07:15.686061+0000","last_became_active":"2023-08-22T00:07:15.685794+0000","last_became_peered":"2023-08-22T00:07:15.685794+0000","last_unstale":"2023-08-22T00:07:15.686061+0000","last_undegraded":"2023-08-22T00:07:15.686061+0000","last_fullsized":"2023-08-22T00:07:15.686061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.692160+0000","last_change":"2023-08-22T00:07:15.308598+0000","last_active":"2023-08-22T00:07:15.692160+0000","last_peered":"2023-08-22T00:07:15.692160+0000","last_clean":"2023-08-22T00:07:15.692160+0000","last_became_active":"2023-08-22T00:07:15.308349+0000","last_became_peered":"2023-08-22T00:07:15.308349+0000","last_unstale":"2023-08-22T00:07:15.692160+0000","last_undegraded":"2023-08-22T00:07:15.692160+0000","last_fullsized":"2023-08-22T00:07:15.692160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680295+0000","last_change":"2023-08-22T00:07:15.680295+0000","last_active":"2023-08-22T00:07:15.680295+0000","last_peered":"2023-08-22T00:07:15.680295+0000","last_clean":"2023-08-22T00:07:15.680295+0000","last_became_active":"2023-08-22T00:07:15.680034+0000","last_became_peered":"2023-08-22T00:07:15.680034+0000","last_unstale":"2023-08-22T00:07:15.680295+0000","last_undegraded":"2023-08-22T00:07:15.680295+0000","last_fullsized":"2023-08-22T00:07:15.680295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.672804+0000","last_change":"2023-08-22T00:07:15.314044+0000","last_active":"2023-08-22T00:07:15.672804+0000","last_peered":"2023-08-22T00:07:15.672804+0000","last_clean":"2023-08-22T00:07:15.672804+0000","last_became_active":"2023-08-22T00:07:15.312548+0000","last_became_peered":"2023-08-22T00:07:15.312548+0000","last_unstale":"2023-08-22T00:07:15.672804+0000","last_undegraded":"2023-08-22T00:07:15.672804+0000","last_fullsized":"2023-08-22T00:07:15.672804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686993+0000","last_change":"2023-08-22T00:07:15.686993+0000","last_active":"2023-08-22T00:07:15.686993+0000","last_peered":"2023-08-22T00:07:15.686993+0000","last_clean":"2023-08-22T00:07:15.686993+0000","last_became_active":"2023-08-22T00:07:15.686736+0000","last_became_peered":"2023-08-22T00:07:15.686736+0000","last_unstale":"2023-08-22T00:07:15.686993+0000","last_undegraded":"2023-08-22T00:07:15.686993+0000","last_fullsized":"2023-08-22T00:07:15.686993+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308992+0000","last_change":"2023-08-22T00:07:15.302885+0000","last_active":"2023-08-22T00:07:15.308992+0000","last_peered":"2023-08-22T00:07:15.308992+0000","last_clean":"2023-08-22T00:07:15.308992+0000","last_became_active":"2023-08-22T00:07:15.302592+0000","last_became_peered":"2023-08-22T00:07:15.302592+0000","last_unstale":"2023-08-22T00:07:15.308992+0000","last_undegraded":"2023-08-22T00:07:15.308992+0000","last_fullsized":"2023-08-22T00:07:15.308992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682517+0000","last_change":"2023-08-22T00:07:15.682517+0000","last_active":"2023-08-22T00:07:15.682517+0000","last_peered":"2023-08-22T00:07:15.682517+0000","last_clean":"2023-08-22T00:07:15.682517+0000","last_became_active":"2023-08-22T00:07:15.681506+0000","last_became_peered":"2023-08-22T00:07:15.681506+0000","last_unstale":"2023-08-22T00:07:15.682517+0000","last_undegraded":"2023-08-22T00:07:15.682517+0000","last_fullsized":"2023-08-22T00:07:15.682517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.314677+0000","last_change":"2023-08-22T00:07:15.312480+0000","last_active":"2023-08-22T00:07:15.314677+0000","last_peered":"2023-08-22T00:07:15.314677+0000","last_clean":"2023-08-22T00:07:15.314677+0000","last_became_active":"2023-08-22T00:07:15.311732+0000","last_became_peered":"2023-08-22T00:07:15.311732+0000","last_unstale":"2023-08-22T00:07:15.314677+0000","last_undegraded":"2023-08-22T00:07:15.314677+0000","last_fullsized":"2023-08-22T00:07:15.314677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679085+0000","last_change":"2023-08-22T00:07:15.679085+0000","last_active":"2023-08-22T00:07:15.679085+0000","last_peered":"2023-08-22T00:07:15.679085+0000","last_clean":"2023-08-22T00:07:15.679085+0000","last_became_active":"2023-08-22T00:07:15.678808+0000","last_became_peered":"2023-08-22T00:07:15.678808+0000","last_unstale":"2023-08-22T00:07:15.679085+0000","last_undegraded":"2023-08-22T00:07:15.679085+0000","last_fullsized":"2023-08-22T00:07:15.679085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689999+0000","last_change":"2023-08-22T00:07:15.305884+0000","last_active":"2023-08-22T00:07:15.689999+0000","last_peered":"2023-08-22T00:07:15.689999+0000","last_clean":"2023-08-22T00:07:15.689999+0000","last_became_active":"2023-08-22T00:07:15.305610+0000","last_became_peered":"2023-08-22T00:07:15.305610+0000","last_unstale":"2023-08-22T00:07:15.689999+0000","last_undegraded":"2023-08-22T00:07:15.689999+0000","last_fullsized":"2023-08-22T00:07:15.689999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686960+0000","last_change":"2023-08-22T00:07:15.686960+0000","last_active":"2023-08-22T00:07:15.686960+0000","last_peered":"2023-08-22T00:07:15.686960+0000","last_clean":"2023-08-22T00:07:15.686960+0000","last_became_active":"2023-08-22T00:07:15.686501+0000","last_became_peered":"2023-08-22T00:07:15.686501+0000","last_unstale":"2023-08-22T00:07:15.686960+0000","last_undegraded":"2023-08-22T00:07:15.686960+0000","last_fullsized":"2023-08-22T00:07:15.686960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313850+0000","last_change":"2023-08-22T00:07:15.313334+0000","last_active":"2023-08-22T00:07:15.313850+0000","last_peered":"2023-08-22T00:07:15.313850+0000","last_clean":"2023-08-22T00:07:15.313850+0000","last_became_active":"2023-08-22T00:07:15.313017+0000","last_became_peered":"2023-08-22T00:07:15.313017+0000","last_unstale":"2023-08-22T00:07:15.313850+0000","last_undegraded":"2023-08-22T00:07:15.313850+0000","last_fullsized":"2023-08-22T00:07:15.313850+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675499+0000","last_change":"2023-08-22T00:07:15.675499+0000","last_active":"2023-08-22T00:07:15.675499+0000","last_peered":"2023-08-22T00:07:15.675499+0000","last_clean":"2023-08-22T00:07:15.675499+0000","last_became_active":"2023-08-22T00:07:15.675196+0000","last_became_peered":"2023-08-22T00:07:15.675196+0000","last_unstale":"2023-08-22T00:07:15.675499+0000","last_undegraded":"2023-08-22T00:07:15.675499+0000","last_fullsized":"2023-08-22T00:07:15.675499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310103+0000","last_change":"2023-08-22T00:07:15.307644+0000","last_active":"2023-08-22T00:07:15.310103+0000","last_peered":"2023-08-22T00:07:15.310103+0000","last_clean":"2023-08-22T00:07:15.310103+0000","last_became_active":"2023-08-22T00:07:15.307335+0000","last_became_peered":"2023-08-22T00:07:15.307335+0000","last_unstale":"2023-08-22T00:07:15.310103+0000","last_undegraded":"2023-08-22T00:07:15.310103+0000","last_fullsized":"2023-08-22T00:07:15.310103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687592+0000","last_change":"2023-08-22T00:07:15.687592+0000","last_active":"2023-08-22T00:07:15.687592+0000","last_peered":"2023-08-22T00:07:15.687592+0000","last_clean":"2023-08-22T00:07:15.687592+0000","last_became_active":"2023-08-22T00:07:15.682783+0000","last_became_peered":"2023-08-22T00:07:15.682783+0000","last_unstale":"2023-08-22T00:07:15.687592+0000","last_undegraded":"2023-08-22T00:07:15.687592+0000","last_fullsized":"2023-08-22T00:07:15.687592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.665114+0000","last_change":"2023-08-22T00:07:15.296965+0000","last_active":"2023-08-22T00:07:15.665114+0000","last_peered":"2023-08-22T00:07:15.665114+0000","last_clean":"2023-08-22T00:07:15.665114+0000","last_became_active":"2023-08-22T00:07:15.296693+0000","last_became_peered":"2023-08-22T00:07:15.296693+0000","last_unstale":"2023-08-22T00:07:15.665114+0000","last_undegraded":"2023-08-22T00:07:15.665114+0000","last_fullsized":"2023-08-22T00:07:15.665114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686629+0000","last_change":"2023-08-22T00:07:15.686629+0000","last_active":"2023-08-22T00:07:15.686629+0000","last_peered":"2023-08-22T00:07:15.686629+0000","last_clean":"2023-08-22T00:07:15.686629+0000","last_became_active":"2023-08-22T00:07:15.685428+0000","last_became_peered":"2023-08-22T00:07:15.685428+0000","last_unstale":"2023-08-22T00:07:15.686629+0000","last_undegraded":"2023-08-22T00:07:15.686629+0000","last_fullsized":"2023-08-22T00:07:15.686629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310136+0000","last_change":"2023-08-22T00:07:15.308106+0000","last_active":"2023-08-22T00:07:15.310136+0000","last_peered":"2023-08-22T00:07:15.310136+0000","last_clean":"2023-08-22T00:07:15.310136+0000","last_became_active":"2023-08-22T00:07:15.307831+0000","last_became_peered":"2023-08-22T00:07:15.307831+0000","last_unstale":"2023-08-22T00:07:15.310136+0000","last_undegraded":"2023-08-22T00:07:15.310136+0000","last_fullsized":"2023-08-22T00:07:15.310136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679296+0000","last_change":"2023-08-22T00:07:15.679296+0000","last_active":"2023-08-22T00:07:15.679296+0000","last_peered":"2023-08-22T00:07:15.679296+0000","last_clean":"2023-08-22T00:07:15.679296+0000","last_became_active":"2023-08-22T00:07:15.678964+0000","last_became_peered":"2023-08-22T00:07:15.678964+0000","last_unstale":"2023-08-22T00:07:15.679296+0000","last_undegraded":"2023-08-22T00:07:15.679296+0000","last_fullsized":"2023-08-22T00:07:15.679296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.672952+0000","last_change":"2023-08-22T00:07:15.311755+0000","last_active":"2023-08-22T00:07:15.672952+0000","last_peered":"2023-08-22T00:07:15.672952+0000","last_clean":"2023-08-22T00:07:15.672952+0000","last_became_active":"2023-08-22T00:07:15.309523+0000","last_became_peered":"2023-08-22T00:07:15.309523+0000","last_unstale":"2023-08-22T00:07:15.672952+0000","last_undegraded":"2023-08-22T00:07:15.672952+0000","last_fullsized":"2023-08-22T00:07:15.672952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684365+0000","last_change":"2023-08-22T00:07:15.684365+0000","last_active":"2023-08-22T00:07:15.684365+0000","last_peered":"2023-08-22T00:07:15.684365+0000","last_clean":"2023-08-22T00:07:15.684365+0000","last_became_active":"2023-08-22T00:07:15.683344+0000","last_became_peered":"2023-08-22T00:07:15.683344+0000","last_unstale":"2023-08-22T00:07:15.684365+0000","last_undegraded":"2023-08-22T00:07:15.684365+0000","last_fullsized":"2023-08-22T00:07:15.684365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308972+0000","last_change":"2023-08-22T00:07:15.301110+0000","last_active":"2023-08-22T00:07:15.308972+0000","last_peered":"2023-08-22T00:07:15.308972+0000","last_clean":"2023-08-22T00:07:15.308972+0000","last_became_active":"2023-08-22T00:07:15.300813+0000","last_became_peered":"2023-08-22T00:07:15.300813+0000","last_unstale":"2023-08-22T00:07:15.308972+0000","last_undegraded":"2023-08-22T00:07:15.308972+0000","last_fullsized":"2023-08-22T00:07:15.308972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684252+0000","last_change":"2023-08-22T00:07:15.684252+0000","last_active":"2023-08-22T00:07:15.684252+0000","last_peered":"2023-08-22T00:07:15.684252+0000","last_clean":"2023-08-22T00:07:15.684252+0000","last_became_active":"2023-08-22T00:07:15.683840+0000","last_became_peered":"2023-08-22T00:07:15.683840+0000","last_unstale":"2023-08-22T00:07:15.684252+0000","last_undegraded":"2023-08-22T00:07:15.684252+0000","last_fullsized":"2023-08-22T00:07:15.684252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310661+0000","last_change":"2023-08-22T00:07:15.308815+0000","last_active":"2023-08-22T00:07:15.310661+0000","last_peered":"2023-08-22T00:07:15.310661+0000","last_clean":"2023-08-22T00:07:15.310661+0000","last_became_active":"2023-08-22T00:07:15.308523+0000","last_became_peered":"2023-08-22T00:07:15.308523+0000","last_unstale":"2023-08-22T00:07:15.310661+0000","last_undegraded":"2023-08-22T00:07:15.310661+0000","last_fullsized":"2023-08-22T00:07:15.310661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679887+0000","last_change":"2023-08-22T00:07:15.679887+0000","last_active":"2023-08-22T00:07:15.679887+0000","last_peered":"2023-08-22T00:07:15.679887+0000","last_clean":"2023-08-22T00:07:15.679887+0000","last_became_active":"2023-08-22T00:07:15.679426+0000","last_became_peered":"2023-08-22T00:07:15.679426+0000","last_unstale":"2023-08-22T00:07:15.679887+0000","last_undegraded":"2023-08-22T00:07:15.679887+0000","last_fullsized":"2023-08-22T00:07:15.679887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303358+0000","last_change":"2023-08-22T00:07:15.298812+0000","last_active":"2023-08-22T00:07:15.303358+0000","last_peered":"2023-08-22T00:07:15.303358+0000","last_clean":"2023-08-22T00:07:15.303358+0000","last_became_active":"2023-08-22T00:07:15.298542+0000","last_became_peered":"2023-08-22T00:07:15.298542+0000","last_unstale":"2023-08-22T00:07:15.303358+0000","last_undegraded":"2023-08-22T00:07:15.303358+0000","last_fullsized":"2023-08-22T00:07:15.303358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686823+0000","last_change":"2023-08-22T00:07:15.686823+0000","last_active":"2023-08-22T00:07:15.686823+0000","last_peered":"2023-08-22T00:07:15.686823+0000","last_clean":"2023-08-22T00:07:15.686823+0000","last_became_active":"2023-08-22T00:07:15.686561+0000","last_became_peered":"2023-08-22T00:07:15.686561+0000","last_unstale":"2023-08-22T00:07:15.686823+0000","last_undegraded":"2023-08-22T00:07:15.686823+0000","last_fullsized":"2023-08-22T00:07:15.686823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308349+0000","last_change":"2023-08-22T00:07:15.303806+0000","last_active":"2023-08-22T00:07:15.308349+0000","last_peered":"2023-08-22T00:07:15.308349+0000","last_clean":"2023-08-22T00:07:15.308349+0000","last_became_active":"2023-08-22T00:07:15.303393+0000","last_became_peered":"2023-08-22T00:07:15.303393+0000","last_unstale":"2023-08-22T00:07:15.308349+0000","last_undegraded":"2023-08-22T00:07:15.308349+0000","last_fullsized":"2023-08-22T00:07:15.308349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682049+0000","last_change":"2023-08-22T00:07:15.682049+0000","last_active":"2023-08-22T00:07:15.682049+0000","last_peered":"2023-08-22T00:07:15.682049+0000","last_clean":"2023-08-22T00:07:15.682049+0000","last_became_active":"2023-08-22T00:07:15.681774+0000","last_became_peered":"2023-08-22T00:07:15.681774+0000","last_unstale":"2023-08-22T00:07:15.682049+0000","last_undegraded":"2023-08-22T00:07:15.682049+0000","last_fullsized":"2023-08-22T00:07:15.682049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308204+0000","last_change":"2023-08-22T00:07:15.306539+0000","last_active":"2023-08-22T00:07:15.308204+0000","last_peered":"2023-08-22T00:07:15.308204+0000","last_clean":"2023-08-22T00:07:15.308204+0000","last_became_active":"2023-08-22T00:07:15.306329+0000","last_became_peered":"2023-08-22T00:07:15.306329+0000","last_unstale":"2023-08-22T00:07:15.308204+0000","last_undegraded":"2023-08-22T00:07:15.308204+0000","last_fullsized":"2023-08-22T00:07:15.308204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689536+0000","last_change":"2023-08-22T00:07:15.689536+0000","last_active":"2023-08-22T00:07:15.689536+0000","last_peered":"2023-08-22T00:07:15.689536+0000","last_clean":"2023-08-22T00:07:15.689536+0000","last_became_active":"2023-08-22T00:07:15.689221+0000","last_became_peered":"2023-08-22T00:07:15.689221+0000","last_unstale":"2023-08-22T00:07:15.689536+0000","last_undegraded":"2023-08-22T00:07:15.689536+0000","last_fullsized":"2023-08-22T00:07:15.689536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307597+0000","last_change":"2023-08-22T00:07:15.300782+0000","last_active":"2023-08-22T00:07:15.307597+0000","last_peered":"2023-08-22T00:07:15.307597+0000","last_clean":"2023-08-22T00:07:15.307597+0000","last_became_active":"2023-08-22T00:07:15.300507+0000","last_became_peered":"2023-08-22T00:07:15.300507+0000","last_unstale":"2023-08-22T00:07:15.307597+0000","last_undegraded":"2023-08-22T00:07:15.307597+0000","last_fullsized":"2023-08-22T00:07:15.307597+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679004+0000","last_change":"2023-08-22T00:07:15.679004+0000","last_active":"2023-08-22T00:07:15.679004+0000","last_peered":"2023-08-22T00:07:15.679004+0000","last_clean":"2023-08-22T00:07:15.679004+0000","last_became_active":"2023-08-22T00:07:15.678703+0000","last_became_peered":"2023-08-22T00:07:15.678703+0000","last_unstale":"2023-08-22T00:07:15.679004+0000","last_undegraded":"2023-08-22T00:07:15.679004+0000","last_fullsized":"2023-08-22T00:07:15.679004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315909+0000","last_change":"2023-08-22T00:07:15.314919+0000","last_active":"2023-08-22T00:07:15.315909+0000","last_peered":"2023-08-22T00:07:15.315909+0000","last_clean":"2023-08-22T00:07:15.315909+0000","last_became_active":"2023-08-22T00:07:15.314547+0000","last_became_peered":"2023-08-22T00:07:15.314547+0000","last_unstale":"2023-08-22T00:07:15.315909+0000","last_undegraded":"2023-08-22T00:07:15.315909+0000","last_fullsized":"2023-08-22T00:07:15.315909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.674600+0000","last_change":"2023-08-22T00:07:15.674600+0000","last_active":"2023-08-22T00:07:15.674600+0000","last_peered":"2023-08-22T00:07:15.674600+0000","last_clean":"2023-08-22T00:07:15.674600+0000","last_became_active":"2023-08-22T00:07:15.673495+0000","last_became_peered":"2023-08-22T00:07:15.673495+0000","last_unstale":"2023-08-22T00:07:15.674600+0000","last_undegraded":"2023-08-22T00:07:15.674600+0000","last_fullsized":"2023-08-22T00:07:15.674600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305410+0000","last_change":"2023-08-22T00:07:15.298846+0000","last_active":"2023-08-22T00:07:15.305410+0000","last_peered":"2023-08-22T00:07:15.305410+0000","last_clean":"2023-08-22T00:07:15.305410+0000","last_became_active":"2023-08-22T00:07:15.298583+0000","last_became_peered":"2023-08-22T00:07:15.298583+0000","last_unstale":"2023-08-22T00:07:15.305410+0000","last_undegraded":"2023-08-22T00:07:15.305410+0000","last_fullsized":"2023-08-22T00:07:15.305410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682025+0000","last_change":"2023-08-22T00:07:15.682025+0000","last_active":"2023-08-22T00:07:15.682025+0000","last_peered":"2023-08-22T00:07:15.682025+0000","last_clean":"2023-08-22T00:07:15.682025+0000","last_became_active":"2023-08-22T00:07:15.681652+0000","last_became_peered":"2023-08-22T00:07:15.681652+0000","last_unstale":"2023-08-22T00:07:15.682025+0000","last_undegraded":"2023-08-22T00:07:15.682025+0000","last_fullsized":"2023-08-22T00:07:15.682025+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.308798+0000","last_change":"2023-08-22T00:07:15.305802+0000","last_active":"2023-08-22T00:07:15.308798+0000","last_peered":"2023-08-22T00:07:15.308798+0000","last_clean":"2023-08-22T00:07:15.308798+0000","last_became_active":"2023-08-22T00:07:15.305526+0000","last_became_peered":"2023-08-22T00:07:15.305526+0000","last_unstale":"2023-08-22T00:07:15.308798+0000","last_undegraded":"2023-08-22T00:07:15.308798+0000","last_fullsized":"2023-08-22T00:07:15.308798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680701+0000","last_change":"2023-08-22T00:07:15.680701+0000","last_active":"2023-08-22T00:07:15.680701+0000","last_peered":"2023-08-22T00:07:15.680701+0000","last_clean":"2023-08-22T00:07:15.680701+0000","last_became_active":"2023-08-22T00:07:15.680443+0000","last_became_peered":"2023-08-22T00:07:15.680443+0000","last_unstale":"2023-08-22T00:07:15.680701+0000","last_undegraded":"2023-08-22T00:07:15.680701+0000","last_fullsized":"2023-08-22T00:07:15.680701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310699+0000","last_change":"2023-08-22T00:07:15.308866+0000","last_active":"2023-08-22T00:07:15.310699+0000","last_peered":"2023-08-22T00:07:15.310699+0000","last_clean":"2023-08-22T00:07:15.310699+0000","last_became_active":"2023-08-22T00:07:15.308534+0000","last_became_peered":"2023-08-22T00:07:15.308534+0000","last_unstale":"2023-08-22T00:07:15.310699+0000","last_undegraded":"2023-08-22T00:07:15.310699+0000","last_fullsized":"2023-08-22T00:07:15.310699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688386+0000","last_change":"2023-08-22T00:07:15.688386+0000","last_active":"2023-08-22T00:07:15.688386+0000","last_peered":"2023-08-22T00:07:15.688386+0000","last_clean":"2023-08-22T00:07:15.688386+0000","last_became_active":"2023-08-22T00:07:15.688120+0000","last_became_peered":"2023-08-22T00:07:15.688120+0000","last_unstale":"2023-08-22T00:07:15.688386+0000","last_undegraded":"2023-08-22T00:07:15.688386+0000","last_fullsized":"2023-08-22T00:07:15.688386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303392+0000","last_change":"2023-08-22T00:07:15.300528+0000","last_active":"2023-08-22T00:07:15.303392+0000","last_peered":"2023-08-22T00:07:15.303392+0000","last_clean":"2023-08-22T00:07:15.303392+0000","last_became_active":"2023-08-22T00:07:15.300225+0000","last_became_peered":"2023-08-22T00:07:15.300225+0000","last_unstale":"2023-08-22T00:07:15.303392+0000","last_undegraded":"2023-08-22T00:07:15.303392+0000","last_fullsized":"2023-08-22T00:07:15.303392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686077+0000","last_change":"2023-08-22T00:07:15.686077+0000","last_active":"2023-08-22T00:07:15.686077+0000","last_peered":"2023-08-22T00:07:15.686077+0000","last_clean":"2023-08-22T00:07:15.686077+0000","last_became_active":"2023-08-22T00:07:15.685867+0000","last_became_peered":"2023-08-22T00:07:15.685867+0000","last_unstale":"2023-08-22T00:07:15.686077+0000","last_undegraded":"2023-08-22T00:07:15.686077+0000","last_fullsized":"2023-08-22T00:07:15.686077+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.669484+0000","last_change":"2023-08-22T00:07:15.303281+0000","last_active":"2023-08-22T00:07:15.669484+0000","last_peered":"2023-08-22T00:07:15.669484+0000","last_clean":"2023-08-22T00:07:15.669484+0000","last_became_active":"2023-08-22T00:07:15.302998+0000","last_became_peered":"2023-08-22T00:07:15.302998+0000","last_unstale":"2023-08-22T00:07:15.669484+0000","last_undegraded":"2023-08-22T00:07:15.669484+0000","last_fullsized":"2023-08-22T00:07:15.669484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.669916+0000","last_change":"2023-08-22T00:07:15.669916+0000","last_active":"2023-08-22T00:07:15.669916+0000","last_peered":"2023-08-22T00:07:15.669916+0000","last_clean":"2023-08-22T00:07:15.669916+0000","last_became_active":"2023-08-22T00:07:15.669633+0000","last_became_peered":"2023-08-22T00:07:15.669633+0000","last_unstale":"2023-08-22T00:07:15.669916+0000","last_undegraded":"2023-08-22T00:07:15.669916+0000","last_fullsized":"2023-08-22T00:07:15.669916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.666580+0000","last_change":"2023-08-22T00:07:15.298717+0000","last_active":"2023-08-22T00:07:15.666580+0000","last_peered":"2023-08-22T00:07:15.666580+0000","last_clean":"2023-08-22T00:07:15.666580+0000","last_became_active":"2023-08-22T00:07:15.298424+0000","last_became_peered":"2023-08-22T00:07:15.298424+0000","last_unstale":"2023-08-22T00:07:15.666580+0000","last_undegraded":"2023-08-22T00:07:15.666580+0000","last_fullsized":"2023-08-22T00:07:15.666580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688351+0000","last_change":"2023-08-22T00:07:15.688351+0000","last_active":"2023-08-22T00:07:15.688351+0000","last_peered":"2023-08-22T00:07:15.688351+0000","last_clean":"2023-08-22T00:07:15.688351+0000","last_became_active":"2023-08-22T00:07:15.688042+0000","last_became_peered":"2023-08-22T00:07:15.688042+0000","last_unstale":"2023-08-22T00:07:15.688351+0000","last_undegraded":"2023-08-22T00:07:15.688351+0000","last_fullsized":"2023-08-22T00:07:15.688351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.691779+0000","last_change":"2023-08-22T00:07:15.311044+0000","last_active":"2023-08-22T00:07:15.691779+0000","last_peered":"2023-08-22T00:07:15.691779+0000","last_clean":"2023-08-22T00:07:15.691779+0000","last_became_active":"2023-08-22T00:07:15.310652+0000","last_became_peered":"2023-08-22T00:07:15.310652+0000","last_unstale":"2023-08-22T00:07:15.691779+0000","last_undegraded":"2023-08-22T00:07:15.691779+0000","last_fullsized":"2023-08-22T00:07:15.691779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683517+0000","last_change":"2023-08-22T00:07:15.683517+0000","last_active":"2023-08-22T00:07:15.683517+0000","last_peered":"2023-08-22T00:07:15.683517+0000","last_clean":"2023-08-22T00:07:15.683517+0000","last_became_active":"2023-08-22T00:07:15.683185+0000","last_became_peered":"2023-08-22T00:07:15.683185+0000","last_unstale":"2023-08-22T00:07:15.683517+0000","last_undegraded":"2023-08-22T00:07:15.683517+0000","last_fullsized":"2023-08-22T00:07:15.683517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313445+0000","last_change":"2023-08-22T00:07:15.312490+0000","last_active":"2023-08-22T00:07:15.313445+0000","last_peered":"2023-08-22T00:07:15.313445+0000","last_clean":"2023-08-22T00:07:15.313445+0000","last_became_active":"2023-08-22T00:07:15.312185+0000","last_became_peered":"2023-08-22T00:07:15.312185+0000","last_unstale":"2023-08-22T00:07:15.313445+0000","last_undegraded":"2023-08-22T00:07:15.313445+0000","last_fullsized":"2023-08-22T00:07:15.313445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.668009+0000","last_change":"2023-08-22T00:07:15.668009+0000","last_active":"2023-08-22T00:07:15.668009+0000","last_peered":"2023-08-22T00:07:15.668009+0000","last_clean":"2023-08-22T00:07:15.668009+0000","last_became_active":"2023-08-22T00:07:15.667714+0000","last_became_peered":"2023-08-22T00:07:15.667714+0000","last_unstale":"2023-08-22T00:07:15.668009+0000","last_undegraded":"2023-08-22T00:07:15.668009+0000","last_fullsized":"2023-08-22T00:07:15.668009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310299+0000","last_change":"2023-08-22T00:07:15.300223+0000","last_active":"2023-08-22T00:07:15.310299+0000","last_peered":"2023-08-22T00:07:15.310299+0000","last_clean":"2023-08-22T00:07:15.310299+0000","last_became_active":"2023-08-22T00:07:15.299956+0000","last_became_peered":"2023-08-22T00:07:15.299956+0000","last_unstale":"2023-08-22T00:07:15.310299+0000","last_undegraded":"2023-08-22T00:07:15.310299+0000","last_fullsized":"2023-08-22T00:07:15.310299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682518+0000","last_change":"2023-08-22T00:07:15.682518+0000","last_active":"2023-08-22T00:07:15.682518+0000","last_peered":"2023-08-22T00:07:15.682518+0000","last_clean":"2023-08-22T00:07:15.682518+0000","last_became_active":"2023-08-22T00:07:15.682085+0000","last_became_peered":"2023-08-22T00:07:15.682085+0000","last_unstale":"2023-08-22T00:07:15.682518+0000","last_undegraded":"2023-08-22T00:07:15.682518+0000","last_fullsized":"2023-08-22T00:07:15.682518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.309009+0000","last_change":"2023-08-22T00:07:15.306373+0000","last_active":"2023-08-22T00:07:15.309009+0000","last_peered":"2023-08-22T00:07:15.309009+0000","last_clean":"2023-08-22T00:07:15.309009+0000","last_became_active":"2023-08-22T00:07:15.306085+0000","last_became_peered":"2023-08-22T00:07:15.306085+0000","last_unstale":"2023-08-22T00:07:15.309009+0000","last_undegraded":"2023-08-22T00:07:15.309009+0000","last_fullsized":"2023-08-22T00:07:15.309009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.681570+0000","last_change":"2023-08-22T00:07:15.681570+0000","last_active":"2023-08-22T00:07:15.681570+0000","last_peered":"2023-08-22T00:07:15.681570+0000","last_clean":"2023-08-22T00:07:15.681570+0000","last_became_active":"2023-08-22T00:07:15.681271+0000","last_became_peered":"2023-08-22T00:07:15.681271+0000","last_unstale":"2023-08-22T00:07:15.681570+0000","last_undegraded":"2023-08-22T00:07:15.681570+0000","last_fullsized":"2023-08-22T00:07:15.681570+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.312570+0000","last_change":"2023-08-22T00:07:15.309737+0000","last_active":"2023-08-22T00:07:15.312570+0000","last_peered":"2023-08-22T00:07:15.312570+0000","last_clean":"2023-08-22T00:07:15.312570+0000","last_became_active":"2023-08-22T00:07:15.309462+0000","last_became_peered":"2023-08-22T00:07:15.309462+0000","last_unstale":"2023-08-22T00:07:15.312570+0000","last_undegraded":"2023-08-22T00:07:15.312570+0000","last_fullsized":"2023-08-22T00:07:15.312570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.679698+0000","last_change":"2023-08-22T00:07:15.679698+0000","last_active":"2023-08-22T00:07:15.679698+0000","last_peered":"2023-08-22T00:07:15.679698+0000","last_clean":"2023-08-22T00:07:15.679698+0000","last_became_active":"2023-08-22T00:07:15.679121+0000","last_became_peered":"2023-08-22T00:07:15.679121+0000","last_unstale":"2023-08-22T00:07:15.679698+0000","last_undegraded":"2023-08-22T00:07:15.679698+0000","last_fullsized":"2023-08-22T00:07:15.679698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.306695+0000","last_change":"2023-08-22T00:07:15.302715+0000","last_active":"2023-08-22T00:07:15.306695+0000","last_peered":"2023-08-22T00:07:15.306695+0000","last_clean":"2023-08-22T00:07:15.306695+0000","last_became_active":"2023-08-22T00:07:15.302438+0000","last_became_peered":"2023-08-22T00:07:15.302438+0000","last_unstale":"2023-08-22T00:07:15.306695+0000","last_undegraded":"2023-08-22T00:07:15.306695+0000","last_fullsized":"2023-08-22T00:07:15.306695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686764+0000","last_change":"2023-08-22T00:07:15.686764+0000","last_active":"2023-08-22T00:07:15.686764+0000","last_peered":"2023-08-22T00:07:15.686764+0000","last_clean":"2023-08-22T00:07:15.686764+0000","last_became_active":"2023-08-22T00:07:15.686133+0000","last_became_peered":"2023-08-22T00:07:15.686133+0000","last_unstale":"2023-08-22T00:07:15.686764+0000","last_undegraded":"2023-08-22T00:07:15.686764+0000","last_fullsized":"2023-08-22T00:07:15.686764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.309922+0000","last_change":"2023-08-22T00:07:15.301165+0000","last_active":"2023-08-22T00:07:15.309922+0000","last_peered":"2023-08-22T00:07:15.309922+0000","last_clean":"2023-08-22T00:07:15.309922+0000","last_became_active":"2023-08-22T00:07:15.300828+0000","last_became_peered":"2023-08-22T00:07:15.300828+0000","last_unstale":"2023-08-22T00:07:15.309922+0000","last_undegraded":"2023-08-22T00:07:15.309922+0000","last_fullsized":"2023-08-22T00:07:15.309922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.690415+0000","last_change":"2023-08-22T00:07:15.690415+0000","last_active":"2023-08-22T00:07:15.690415+0000","last_peered":"2023-08-22T00:07:15.690415+0000","last_clean":"2023-08-22T00:07:15.690415+0000","last_became_active":"2023-08-22T00:07:15.690059+0000","last_became_peered":"2023-08-22T00:07:15.690059+0000","last_unstale":"2023-08-22T00:07:15.690415+0000","last_undegraded":"2023-08-22T00:07:15.690415+0000","last_fullsized":"2023-08-22T00:07:15.690415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307692+0000","last_change":"2023-08-22T00:07:15.304428+0000","last_active":"2023-08-22T00:07:15.307692+0000","last_peered":"2023-08-22T00:07:15.307692+0000","last_clean":"2023-08-22T00:07:15.307692+0000","last_became_active":"2023-08-22T00:07:15.304166+0000","last_became_peered":"2023-08-22T00:07:15.304166+0000","last_unstale":"2023-08-22T00:07:15.307692+0000","last_undegraded":"2023-08-22T00:07:15.307692+0000","last_fullsized":"2023-08-22T00:07:15.307692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.690042+0000","last_change":"2023-08-22T00:07:15.690042+0000","last_active":"2023-08-22T00:07:15.690042+0000","last_peered":"2023-08-22T00:07:15.690042+0000","last_clean":"2023-08-22T00:07:15.690042+0000","last_became_active":"2023-08-22T00:07:15.689765+0000","last_became_peered":"2023-08-22T00:07:15.689765+0000","last_unstale":"2023-08-22T00:07:15.690042+0000","last_undegraded":"2023-08-22T00:07:15.690042+0000","last_fullsized":"2023-08-22T00:07:15.690042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.685652+0000","last_change":"2023-08-22T00:07:15.307829+0000","last_active":"2023-08-22T00:07:15.685652+0000","last_peered":"2023-08-22T00:07:15.685652+0000","last_clean":"2023-08-22T00:07:15.685652+0000","last_became_active":"2023-08-22T00:07:15.307544+0000","last_became_peered":"2023-08-22T00:07:15.307544+0000","last_unstale":"2023-08-22T00:07:15.685652+0000","last_undegraded":"2023-08-22T00:07:15.685652+0000","last_fullsized":"2023-08-22T00:07:15.685652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686163+0000","last_change":"2023-08-22T00:07:15.686163+0000","last_active":"2023-08-22T00:07:15.686163+0000","last_peered":"2023-08-22T00:07:15.686163+0000","last_clean":"2023-08-22T00:07:15.686163+0000","last_became_active":"2023-08-22T00:07:15.684715+0000","last_became_peered":"2023-08-22T00:07:15.684715+0000","last_unstale":"2023-08-22T00:07:15.686163+0000","last_undegraded":"2023-08-22T00:07:15.686163+0000","last_fullsized":"2023-08-22T00:07:15.686163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677907+0000","last_change":"2023-08-22T00:07:15.307685+0000","last_active":"2023-08-22T00:07:15.677907+0000","last_peered":"2023-08-22T00:07:15.677907+0000","last_clean":"2023-08-22T00:07:15.677907+0000","last_became_active":"2023-08-22T00:07:15.307425+0000","last_became_peered":"2023-08-22T00:07:15.307425+0000","last_unstale":"2023-08-22T00:07:15.677907+0000","last_undegraded":"2023-08-22T00:07:15.677907+0000","last_fullsized":"2023-08-22T00:07:15.677907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684878+0000","last_change":"2023-08-22T00:07:15.684878+0000","last_active":"2023-08-22T00:07:15.684878+0000","last_peered":"2023-08-22T00:07:15.684878+0000","last_clean":"2023-08-22T00:07:15.684878+0000","last_became_active":"2023-08-22T00:07:15.681908+0000","last_became_peered":"2023-08-22T00:07:15.681908+0000","last_unstale":"2023-08-22T00:07:15.684878+0000","last_undegraded":"2023-08-22T00:07:15.684878+0000","last_fullsized":"2023-08-22T00:07:15.684878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675420+0000","last_change":"2023-08-22T00:07:15.308300+0000","last_active":"2023-08-22T00:07:15.675420+0000","last_peered":"2023-08-22T00:07:15.675420+0000","last_clean":"2023-08-22T00:07:15.675420+0000","last_became_active":"2023-08-22T00:07:15.305253+0000","last_became_peered":"2023-08-22T00:07:15.305253+0000","last_unstale":"2023-08-22T00:07:15.675420+0000","last_undegraded":"2023-08-22T00:07:15.675420+0000","last_fullsized":"2023-08-22T00:07:15.675420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686702+0000","last_change":"2023-08-22T00:07:15.686702+0000","last_active":"2023-08-22T00:07:15.686702+0000","last_peered":"2023-08-22T00:07:15.686702+0000","last_clean":"2023-08-22T00:07:15.686702+0000","last_became_active":"2023-08-22T00:07:15.686446+0000","last_became_peered":"2023-08-22T00:07:15.686446+0000","last_unstale":"2023-08-22T00:07:15.686702+0000","last_undegraded":"2023-08-22T00:07:15.686702+0000","last_fullsized":"2023-08-22T00:07:15.686702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303426+0000","last_change":"2023-08-22T00:07:15.301608+0000","last_active":"2023-08-22T00:07:15.303426+0000","last_peered":"2023-08-22T00:07:15.303426+0000","last_clean":"2023-08-22T00:07:15.303426+0000","last_became_active":"2023-08-22T00:07:15.301338+0000","last_became_peered":"2023-08-22T00:07:15.301338+0000","last_unstale":"2023-08-22T00:07:15.303426+0000","last_undegraded":"2023-08-22T00:07:15.303426+0000","last_fullsized":"2023-08-22T00:07:15.303426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688840+0000","last_change":"2023-08-22T00:07:15.688840+0000","last_active":"2023-08-22T00:07:15.688840+0000","last_peered":"2023-08-22T00:07:15.688840+0000","last_clean":"2023-08-22T00:07:15.688840+0000","last_became_active":"2023-08-22T00:07:15.688602+0000","last_became_peered":"2023-08-22T00:07:15.688602+0000","last_unstale":"2023-08-22T00:07:15.688840+0000","last_undegraded":"2023-08-22T00:07:15.688840+0000","last_fullsized":"2023-08-22T00:07:15.688840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.313132+0000","last_change":"2023-08-22T00:07:15.311000+0000","last_active":"2023-08-22T00:07:15.313132+0000","last_peered":"2023-08-22T00:07:15.313132+0000","last_clean":"2023-08-22T00:07:15.313132+0000","last_became_active":"2023-08-22T00:07:15.310714+0000","last_became_peered":"2023-08-22T00:07:15.310714+0000","last_unstale":"2023-08-22T00:07:15.313132+0000","last_undegraded":"2023-08-22T00:07:15.313132+0000","last_fullsized":"2023-08-22T00:07:15.313132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686010+0000","last_change":"2023-08-22T00:07:15.686010+0000","last_active":"2023-08-22T00:07:15.686010+0000","last_peered":"2023-08-22T00:07:15.686010+0000","last_clean":"2023-08-22T00:07:15.686010+0000","last_became_active":"2023-08-22T00:07:15.682584+0000","last_became_peered":"2023-08-22T00:07:15.682584+0000","last_unstale":"2023-08-22T00:07:15.686010+0000","last_undegraded":"2023-08-22T00:07:15.686010+0000","last_fullsized":"2023-08-22T00:07:15.686010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'4","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.692003+0000","last_change":"2023-08-22T00:07:15.310429+0000","last_active":"2023-08-22T00:07:15.692003+0000","last_peered":"2023-08-22T00:07:15.692003+0000","last_clean":"2023-08-22T00:07:15.692003+0000","last_became_active":"2023-08-22T00:07:15.310119+0000","last_became_peered":"2023-08-22T00:07:15.310119+0000","last_unstale":"2023-08-22T00:07:15.692003+0000","last_undegraded":"2023-08-22T00:07:15.692003+0000","last_fullsized":"2023-08-22T00:07:15.692003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.677716+0000","last_change":"2023-08-22T00:07:15.677716+0000","last_active":"2023-08-22T00:07:15.677716+0000","last_peered":"2023-08-22T00:07:15.677716+0000","last_clean":"2023-08-22T00:07:15.677716+0000","last_became_active":"2023-08-22T00:07:15.677414+0000","last_became_peered":"2023-08-22T00:07:15.677414+0000","last_unstale":"2023-08-22T00:07:15.677716+0000","last_undegraded":"2023-08-22T00:07:15.677716+0000","last_fullsized":"2023-08-22T00:07:15.677716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.665730+0000","last_change":"2023-08-22T00:07:15.302237+0000","last_active":"2023-08-22T00:07:15.665730+0000","last_peered":"2023-08-22T00:07:15.665730+0000","last_clean":"2023-08-22T00:07:15.665730+0000","last_became_active":"2023-08-22T00:07:15.301967+0000","last_became_peered":"2023-08-22T00:07:15.301967+0000","last_unstale":"2023-08-22T00:07:15.665730+0000","last_undegraded":"2023-08-22T00:07:15.665730+0000","last_fullsized":"2023-08-22T00:07:15.665730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688320+0000","last_change":"2023-08-22T00:07:15.688320+0000","last_active":"2023-08-22T00:07:15.688320+0000","last_peered":"2023-08-22T00:07:15.688320+0000","last_clean":"2023-08-22T00:07:15.688320+0000","last_became_active":"2023-08-22T00:07:15.687947+0000","last_became_peered":"2023-08-22T00:07:15.687947+0000","last_unstale":"2023-08-22T00:07:15.688320+0000","last_undegraded":"2023-08-22T00:07:15.688320+0000","last_fullsized":"2023-08-22T00:07:15.688320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683326+0000","last_change":"2023-08-22T00:07:15.297679+0000","last_active":"2023-08-22T00:07:15.683326+0000","last_peered":"2023-08-22T00:07:15.683326+0000","last_clean":"2023-08-22T00:07:15.683326+0000","last_became_active":"2023-08-22T00:07:15.297375+0000","last_became_peered":"2023-08-22T00:07:15.297375+0000","last_unstale":"2023-08-22T00:07:15.683326+0000","last_undegraded":"2023-08-22T00:07:15.683326+0000","last_fullsized":"2023-08-22T00:07:15.683326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683394+0000","last_change":"2023-08-22T00:07:15.683394+0000","last_active":"2023-08-22T00:07:15.683394+0000","last_peered":"2023-08-22T00:07:15.683394+0000","last_clean":"2023-08-22T00:07:15.683394+0000","last_became_active":"2023-08-22T00:07:15.683122+0000","last_became_peered":"2023-08-22T00:07:15.683122+0000","last_unstale":"2023-08-22T00:07:15.683394+0000","last_undegraded":"2023-08-22T00:07:15.683394+0000","last_fullsized":"2023-08-22T00:07:15.683394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315534+0000","last_change":"2023-08-22T00:07:15.314296+0000","last_active":"2023-08-22T00:07:15.315534+0000","last_peered":"2023-08-22T00:07:15.315534+0000","last_clean":"2023-08-22T00:07:15.315534+0000","last_became_active":"2023-08-22T00:07:15.310027+0000","last_became_peered":"2023-08-22T00:07:15.310027+0000","last_unstale":"2023-08-22T00:07:15.315534+0000","last_undegraded":"2023-08-22T00:07:15.315534+0000","last_fullsized":"2023-08-22T00:07:15.315534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686727+0000","last_change":"2023-08-22T00:07:15.686727+0000","last_active":"2023-08-22T00:07:15.686727+0000","last_peered":"2023-08-22T00:07:15.686727+0000","last_clean":"2023-08-22T00:07:15.686727+0000","last_became_active":"2023-08-22T00:07:15.685781+0000","last_became_peered":"2023-08-22T00:07:15.685781+0000","last_unstale":"2023-08-22T00:07:15.686727+0000","last_undegraded":"2023-08-22T00:07:15.686727+0000","last_fullsized":"2023-08-22T00:07:15.686727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305355+0000","last_change":"2023-08-22T00:07:15.298620+0000","last_active":"2023-08-22T00:07:15.305355+0000","last_peered":"2023-08-22T00:07:15.305355+0000","last_clean":"2023-08-22T00:07:15.305355+0000","last_became_active":"2023-08-22T00:07:15.298350+0000","last_became_peered":"2023-08-22T00:07:15.298350+0000","last_unstale":"2023-08-22T00:07:15.305355+0000","last_undegraded":"2023-08-22T00:07:15.305355+0000","last_fullsized":"2023-08-22T00:07:15.305355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688959+0000","last_change":"2023-08-22T00:07:15.688959+0000","last_active":"2023-08-22T00:07:15.688959+0000","last_peered":"2023-08-22T00:07:15.688959+0000","last_clean":"2023-08-22T00:07:15.688959+0000","last_became_active":"2023-08-22T00:07:15.688739+0000","last_became_peered":"2023-08-22T00:07:15.688739+0000","last_unstale":"2023-08-22T00:07:15.688959+0000","last_undegraded":"2023-08-22T00:07:15.688959+0000","last_fullsized":"2023-08-22T00:07:15.688959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'1","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.675505+0000","last_change":"2023-08-22T00:07:15.298073+0000","last_active":"2023-08-22T00:07:15.675505+0000","last_peered":"2023-08-22T00:07:15.675505+0000","last_clean":"2023-08-22T00:07:15.675505+0000","last_became_active":"2023-08-22T00:07:15.297813+0000","last_became_peered":"2023-08-22T00:07:15.297813+0000","last_unstale":"2023-08-22T00:07:15.675505+0000","last_undegraded":"2023-08-22T00:07:15.675505+0000","last_fullsized":"2023-08-22T00:07:15.675505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.693182+0000","last_change":"2023-08-22T00:07:15.693182+0000","last_active":"2023-08-22T00:07:15.693182+0000","last_peered":"2023-08-22T00:07:15.693182+0000","last_clean":"2023-08-22T00:07:15.693182+0000","last_became_active":"2023-08-22T00:07:15.692922+0000","last_became_peered":"2023-08-22T00:07:15.692922+0000","last_unstale":"2023-08-22T00:07:15.693182+0000","last_undegraded":"2023-08-22T00:07:15.693182+0000","last_fullsized":"2023-08-22T00:07:15.693182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.315015+0000","last_change":"2023-08-22T00:07:15.314117+0000","last_active":"2023-08-22T00:07:15.315015+0000","last_peered":"2023-08-22T00:07:15.315015+0000","last_clean":"2023-08-22T00:07:15.315015+0000","last_became_active":"2023-08-22T00:07:15.312318+0000","last_became_peered":"2023-08-22T00:07:15.312318+0000","last_unstale":"2023-08-22T00:07:15.315015+0000","last_undegraded":"2023-08-22T00:07:15.315015+0000","last_fullsized":"2023-08-22T00:07:15.315015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684045+0000","last_change":"2023-08-22T00:07:15.684045+0000","last_active":"2023-08-22T00:07:15.684045+0000","last_peered":"2023-08-22T00:07:15.684045+0000","last_clean":"2023-08-22T00:07:15.684045+0000","last_became_active":"2023-08-22T00:07:15.683783+0000","last_became_peered":"2023-08-22T00:07:15.683783+0000","last_unstale":"2023-08-22T00:07:15.684045+0000","last_undegraded":"2023-08-22T00:07:15.684045+0000","last_fullsized":"2023-08-22T00:07:15.684045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307668+0000","last_change":"2023-08-22T00:07:15.304333+0000","last_active":"2023-08-22T00:07:15.307668+0000","last_peered":"2023-08-22T00:07:15.307668+0000","last_clean":"2023-08-22T00:07:15.307668+0000","last_became_active":"2023-08-22T00:07:15.304075+0000","last_became_peered":"2023-08-22T00:07:15.304075+0000","last_unstale":"2023-08-22T00:07:15.307668+0000","last_undegraded":"2023-08-22T00:07:15.307668+0000","last_fullsized":"2023-08-22T00:07:15.307668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682341+0000","last_change":"2023-08-22T00:07:15.682341+0000","last_active":"2023-08-22T00:07:15.682341+0000","last_peered":"2023-08-22T00:07:15.682341+0000","last_clean":"2023-08-22T00:07:15.682341+0000","last_became_active":"2023-08-22T00:07:15.682058+0000","last_became_peered":"2023-08-22T00:07:15.682058+0000","last_unstale":"2023-08-22T00:07:15.682341+0000","last_undegraded":"2023-08-22T00:07:15.682341+0000","last_fullsized":"2023-08-22T00:07:15.682341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.303315+0000","last_change":"2023-08-22T00:07:15.300904+0000","last_active":"2023-08-22T00:07:15.303315+0000","last_peered":"2023-08-22T00:07:15.303315+0000","last_clean":"2023-08-22T00:07:15.303315+0000","last_became_active":"2023-08-22T00:07:15.300623+0000","last_became_peered":"2023-08-22T00:07:15.300623+0000","last_unstale":"2023-08-22T00:07:15.303315+0000","last_undegraded":"2023-08-22T00:07:15.303315+0000","last_fullsized":"2023-08-22T00:07:15.303315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.683186+0000","last_change":"2023-08-22T00:07:15.683186+0000","last_active":"2023-08-22T00:07:15.683186+0000","last_peered":"2023-08-22T00:07:15.683186+0000","last_clean":"2023-08-22T00:07:15.683186+0000","last_became_active":"2023-08-22T00:07:15.682905+0000","last_became_peered":"2023-08-22T00:07:15.682905+0000","last_unstale":"2023-08-22T00:07:15.683186+0000","last_undegraded":"2023-08-22T00:07:15.683186+0000","last_fullsized":"2023-08-22T00:07:15.683186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310316+0000","last_change":"2023-08-22T00:07:15.307872+0000","last_active":"2023-08-22T00:07:15.310316+0000","last_peered":"2023-08-22T00:07:15.310316+0000","last_clean":"2023-08-22T00:07:15.310316+0000","last_became_active":"2023-08-22T00:07:15.307527+0000","last_became_peered":"2023-08-22T00:07:15.307527+0000","last_unstale":"2023-08-22T00:07:15.310316+0000","last_undegraded":"2023-08-22T00:07:15.310316+0000","last_fullsized":"2023-08-22T00:07:15.310316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.296589+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:07:15.296589+0000","last_peered":"2023-08-22T00:07:15.296589+0000","last_clean":"2023-08-22T00:07:15.296589+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:07:15.296589+0000","last_undegraded":"2023-08-22T00:07:15.296589+0000","last_fullsized":"2023-08-22T00:07:15.296589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.689410+0000","last_change":"2023-08-22T00:07:15.689410+0000","last_active":"2023-08-22T00:07:15.689410+0000","last_peered":"2023-08-22T00:07:15.689410+0000","last_clean":"2023-08-22T00:07:15.689410+0000","last_became_active":"2023-08-22T00:07:15.689234+0000","last_became_peered":"2023-08-22T00:07:15.689234+0000","last_unstale":"2023-08-22T00:07:15.689410+0000","last_undegraded":"2023-08-22T00:07:15.689410+0000","last_fullsized":"2023-08-22T00:07:15.689410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.306922+0000","last_change":"2023-08-22T00:07:15.299922+0000","last_active":"2023-08-22T00:07:15.306922+0000","last_peered":"2023-08-22T00:07:15.306922+0000","last_clean":"2023-08-22T00:07:15.306922+0000","last_became_active":"2023-08-22T00:07:15.299635+0000","last_became_peered":"2023-08-22T00:07:15.299635+0000","last_unstale":"2023-08-22T00:07:15.306922+0000","last_undegraded":"2023-08-22T00:07:15.306922+0000","last_fullsized":"2023-08-22T00:07:15.306922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.291580+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:07:15.291580+0000","last_peered":"2023-08-22T00:07:15.291580+0000","last_clean":"2023-08-22T00:07:15.291580+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:07:15.291580+0000","last_undegraded":"2023-08-22T00:07:15.291580+0000","last_fullsized":"2023-08-22T00:07:15.291580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.684600+0000","last_change":"2023-08-22T00:07:15.684600+0000","last_active":"2023-08-22T00:07:15.684600+0000","last_peered":"2023-08-22T00:07:15.684600+0000","last_clean":"2023-08-22T00:07:15.684600+0000","last_became_active":"2023-08-22T00:07:15.684302+0000","last_became_peered":"2023-08-22T00:07:15.684302+0000","last_unstale":"2023-08-22T00:07:15.684600+0000","last_undegraded":"2023-08-22T00:07:15.684600+0000","last_fullsized":"2023-08-22T00:07:15.684600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.299307+0000","last_change":"2023-08-22T00:07:15.297277+0000","last_active":"2023-08-22T00:07:15.299307+0000","last_peered":"2023-08-22T00:07:15.299307+0000","last_clean":"2023-08-22T00:07:15.299307+0000","last_became_active":"2023-08-22T00:07:15.297006+0000","last_became_peered":"2023-08-22T00:07:15.297006+0000","last_unstale":"2023-08-22T00:07:15.299307+0000","last_undegraded":"2023-08-22T00:07:15.299307+0000","last_fullsized":"2023-08-22T00:07:15.299307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.294222+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:07:15.294222+0000","last_peered":"2023-08-22T00:07:15.294222+0000","last_clean":"2023-08-22T00:07:15.294222+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:07:15.294222+0000","last_undegraded":"2023-08-22T00:07:15.294222+0000","last_fullsized":"2023-08-22T00:07:15.294222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.688587+0000","last_change":"2023-08-22T00:07:15.688587+0000","last_active":"2023-08-22T00:07:15.688587+0000","last_peered":"2023-08-22T00:07:15.688587+0000","last_clean":"2023-08-22T00:07:15.688587+0000","last_became_active":"2023-08-22T00:07:15.688303+0000","last_became_peered":"2023-08-22T00:07:15.688303+0000","last_unstale":"2023-08-22T00:07:15.688587+0000","last_undegraded":"2023-08-22T00:07:15.688587+0000","last_fullsized":"2023-08-22T00:07:15.688587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307942+0000","last_change":"2023-08-22T00:07:15.306391+0000","last_active":"2023-08-22T00:07:15.307942+0000","last_peered":"2023-08-22T00:07:15.307942+0000","last_clean":"2023-08-22T00:07:15.307942+0000","last_became_active":"2023-08-22T00:07:15.306112+0000","last_became_peered":"2023-08-22T00:07:15.306112+0000","last_unstale":"2023-08-22T00:07:15.307942+0000","last_undegraded":"2023-08-22T00:07:15.307942+0000","last_fullsized":"2023-08-22T00:07:15.307942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.292790+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:07:15.292790+0000","last_peered":"2023-08-22T00:07:15.292790+0000","last_clean":"2023-08-22T00:07:15.292790+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:07:15.292790+0000","last_undegraded":"2023-08-22T00:07:15.292790+0000","last_fullsized":"2023-08-22T00:07:15.292790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686645+0000","last_change":"2023-08-22T00:07:15.686645+0000","last_active":"2023-08-22T00:07:15.686645+0000","last_peered":"2023-08-22T00:07:15.686645+0000","last_clean":"2023-08-22T00:07:15.686645+0000","last_became_active":"2023-08-22T00:07:15.686389+0000","last_became_peered":"2023-08-22T00:07:15.686389+0000","last_unstale":"2023-08-22T00:07:15.686645+0000","last_undegraded":"2023-08-22T00:07:15.686645+0000","last_fullsized":"2023-08-22T00:07:15.686645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.686424+0000","last_change":"2023-08-22T00:07:15.314568+0000","last_active":"2023-08-22T00:07:15.686424+0000","last_peered":"2023-08-22T00:07:15.686424+0000","last_clean":"2023-08-22T00:07:15.686424+0000","last_became_active":"2023-08-22T00:07:15.314134+0000","last_became_peered":"2023-08-22T00:07:15.314134+0000","last_unstale":"2023-08-22T00:07:15.686424+0000","last_undegraded":"2023-08-22T00:07:15.686424+0000","last_fullsized":"2023-08-22T00:07:15.686424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.292701+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:07:15.292701+0000","last_peered":"2023-08-22T00:07:15.292701+0000","last_clean":"2023-08-22T00:07:15.292701+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:07:15.292701+0000","last_undegraded":"2023-08-22T00:07:15.292701+0000","last_fullsized":"2023-08-22T00:07:15.292701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305951+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:07:15.305951+0000","last_peered":"2023-08-22T00:07:15.305951+0000","last_clean":"2023-08-22T00:07:15.305951+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:07:15.305951+0000","last_undegraded":"2023-08-22T00:07:15.305951+0000","last_fullsized":"2023-08-22T00:07:15.305951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.682006+0000","last_change":"2023-08-22T00:07:15.682006+0000","last_active":"2023-08-22T00:07:15.682006+0000","last_peered":"2023-08-22T00:07:15.682006+0000","last_clean":"2023-08-22T00:07:15.682006+0000","last_became_active":"2023-08-22T00:07:15.681762+0000","last_became_peered":"2023-08-22T00:07:15.681762+0000","last_unstale":"2023-08-22T00:07:15.682006+0000","last_undegraded":"2023-08-22T00:07:15.682006+0000","last_fullsized":"2023-08-22T00:07:15.682006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.310343+0000","last_change":"2023-08-22T00:07:15.307885+0000","last_active":"2023-08-22T00:07:15.310343+0000","last_peered":"2023-08-22T00:07:15.310343+0000","last_clean":"2023-08-22T00:07:15.310343+0000","last_became_active":"2023-08-22T00:07:15.307606+0000","last_became_peered":"2023-08-22T00:07:15.307606+0000","last_unstale":"2023-08-22T00:07:15.310343+0000","last_undegraded":"2023-08-22T00:07:15.310343+0000","last_fullsized":"2023-08-22T00:07:15.310343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.290890+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:07:15.290890+0000","last_peered":"2023-08-22T00:07:15.290890+0000","last_clean":"2023-08-22T00:07:15.290890+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:07:15.290890+0000","last_undegraded":"2023-08-22T00:07:15.290890+0000","last_fullsized":"2023-08-22T00:07:15.290890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.687515+0000","last_change":"2023-08-22T00:07:15.687515+0000","last_active":"2023-08-22T00:07:15.687515+0000","last_peered":"2023-08-22T00:07:15.687515+0000","last_clean":"2023-08-22T00:07:15.687515+0000","last_became_active":"2023-08-22T00:07:15.687190+0000","last_became_peered":"2023-08-22T00:07:15.687190+0000","last_unstale":"2023-08-22T00:07:15.687515+0000","last_undegraded":"2023-08-22T00:07:15.687515+0000","last_fullsized":"2023-08-22T00:07:15.687515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.311217+0000","last_change":"2023-08-22T00:07:15.302238+0000","last_active":"2023-08-22T00:07:15.311217+0000","last_peered":"2023-08-22T00:07:15.311217+0000","last_clean":"2023-08-22T00:07:15.311217+0000","last_became_active":"2023-08-22T00:07:15.301970+0000","last_became_peered":"2023-08-22T00:07:15.301970+0000","last_unstale":"2023-08-22T00:07:15.311217+0000","last_undegraded":"2023-08-22T00:07:15.311217+0000","last_fullsized":"2023-08-22T00:07:15.311217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.305326+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:07:15.305326+0000","last_peered":"2023-08-22T00:07:15.305326+0000","last_clean":"2023-08-22T00:07:15.305326+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:07:15.305326+0000","last_undegraded":"2023-08-22T00:07:15.305326+0000","last_fullsized":"2023-08-22T00:07:15.305326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.680281+0000","last_change":"2023-08-22T00:07:15.680281+0000","last_active":"2023-08-22T00:07:15.680281+0000","last_peered":"2023-08-22T00:07:15.680281+0000","last_clean":"2023-08-22T00:07:15.680281+0000","last_became_active":"2023-08-22T00:07:15.679806+0000","last_became_peered":"2023-08-22T00:07:15.679806+0000","last_unstale":"2023-08-22T00:07:15.680281+0000","last_undegraded":"2023-08-22T00:07:15.680281+0000","last_fullsized":"2023-08-22T00:07:15.680281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:15.280638+0000","last_clean_scrub_stamp":"2023-08-22T00:07:15.280638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.307702+0000","last_change":"2023-08-22T00:07:15.304066+0000","last_active":"2023-08-22T00:07:15.307702+0000","last_peered":"2023-08-22T00:07:15.307702+0000","last_clean":"2023-08-22T00:07:15.307702+0000","last_became_active":"2023-08-22T00:07:15.303800+0000","last_became_peered":"2023-08-22T00:07:15.303800+0000","last_unstale":"2023-08-22T00:07:15.307702+0000","last_undegraded":"2023-08-22T00:07:15.307702+0000","last_fullsized":"2023-08-22T00:07:15.307702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:07:14.276247+0000","last_clean_scrub_stamp":"2023-08-22T00:07:14.276247+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-22T00:07:15.289993+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:07:15.289993+0000","last_peered":"2023-08-22T00:07:15.289993+0000","last_clean":"2023-08-22T00:07:15.289993+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:07:15.289993+0000","last_undegraded":"2023-08-22T00:07:15.289993+0000","last_fullsized":"2023-08-22T00:07:15.289993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":209628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.499}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":438272,"data_stored":194974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.504},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.622},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":209608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.33400000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.254}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.434}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39600000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.379}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":211018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.36799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":450560,"data_stored":202006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.215}]},{"osd":1,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44500000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":210148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.315}]},{"osd":1,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.29299999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33100000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":11.163,"5min":11.163,"15min":11.163},"last":0.433}]},{"osd":7,"last update":"Tue Aug 22 00:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.502},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":471040,"data_stored":210182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.371}]},{"osd":1,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:07:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":462848,"data_stored":209538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.50700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.498},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.374}]},{"osd":6,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:07:19.647 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:07:19.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:07:19.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.798+0000 7f3d669fc700 1 Processor -- start 2023-08-22T00:07:19.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.798+0000 7f3d669fc700 1 -- start start 2023-08-22T00:07:19.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d669fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d600675f0 0x7f3d600a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d669fc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d601525d0 con 0x7f3d6014fd90 2023-08-22T00:07:19.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d669fc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d60152b80 con 0x7f3d600c39d0 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d669fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d60067bd0 con 0x7f3d600675f0 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3d6014fd90 0x7f3d60153010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55484/0 (socket says 172.21.15.98:55484) 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5ffff700 1 -- 172.21.15.98:0/1429651393 learned_addr learned my addr 172.21.15.98:0/1429651393 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5f7fe700 1 --2- 172.21.15.98:0/1429651393 >> v2:172.21.15.118:3300/0 conn(0x7f3d600675f0 0x7f3d600a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611499402 0 0) 0x7f3d48001110 con 0x7f3d6014fd90 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4c0033f0 con 0x7f3d6014fd90 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5f7fe700 1 -- 172.21.15.98:0/1429651393 >> v1:172.21.15.118:6789/0 conn(0x7f3d600c39d0 legacy=0x7f3d600c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427712490 0 0) 0x7f3d4c0033f0 con 0x7f3d6014fd90 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5f7fe700 1 -- 172.21.15.98:0/1429651393 >> v1:172.21.15.98:6789/0 conn(0x7f3d6014fd90 legacy=0x7f3d60153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.799+0000 7f3d5f7fe700 1 -- 172.21.15.98:0/1429651393 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60067eb0 con 0x7f3d600675f0 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d5f7fe700 1 --2- 172.21.15.98:0/1429651393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600675f0 0x7f3d600a7c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3d50009760 tx=0x7f3d50009060).ready entity=mon.1 client_cookie=fc16aebcf9fd0e59 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48001600 con 0x7f3d600675f0 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d500090d0 con 0x7f3d600675f0 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d5effd700 1 -- 172.21.15.98:0/1429651393 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50012620 con 0x7f3d600675f0 2023-08-22T00:07:19.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 -- 172.21.15.98:0/1429651393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600675f0 msgr2=0x7f3d600a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 --2- 172.21.15.98:0/1429651393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600675f0 0x7f3d600a7c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3d50009760 tx=0x7f3d50009060).stop 2023-08-22T00:07:19.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 -- 172.21.15.98:0/1429651393 shutdown_connections 2023-08-22T00:07:19.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 --2- 172.21.15.98:0/1429651393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600675f0 0x7f3d600a7c10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 -- 172.21.15.98:0/1429651393 >> 172.21.15.98:0/1429651393 conn(0x7f3d600c8950 msgr2=0x7f3d600c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:19.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 -- 172.21.15.98:0/1429651393 shutdown_connections 2023-08-22T00:07:19.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.800+0000 7f3d669fc700 1 -- 172.21.15.98:0/1429651393 wait complete. 2023-08-22T00:07:19.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.801+0000 7f3d669fc700 1 Processor -- start 2023-08-22T00:07:19.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.801+0000 7f3d669fc700 1 -- start start 2023-08-22T00:07:19.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d600675f0 0x7f3d6014ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600c39d0 0x7f3d600c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600ad760 con 0x7f3d6014fd90 2023-08-22T00:07:19.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600ace00 con 0x7f3d600c39d0 2023-08-22T00:07:19.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d669fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014d320 con 0x7f3d600675f0 2023-08-22T00:07:19.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d64f99700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d64f99700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60820/0 (socket says 172.21.15.98:60820) 2023-08-22T00:07:19.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d64f99700 1 -- 172.21.15.98:0/256755036 learned_addr learned my addr 172.21.15.98:0/256755036 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:19.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d5ffff700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d600675f0 0x7f3d6014ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.802+0000 7f3d5f7fe700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600c39d0 0x7f3d600c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 -- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d600675f0 msgr2=0x7f3d6014ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d600675f0 0x7f3d6014ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 -- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600c39d0 msgr2=0x7f3d600c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600c39d0 0x7f3d600c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 -- 172.21.15.98:0/256755036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500092a0 con 0x7f3d6014fd90 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d64f99700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3d5800c7a0 tx=0x7f3d580015f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58010510 con 0x7f3d6014fd90 2023-08-22T00:07:19.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58010670 con 0x7f3d6014fd90 2023-08-22T00:07:19.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d600c3070 con 0x7f3d6014fd90 2023-08-22T00:07:19.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58010a30 con 0x7f3d6014fd90 2023-08-22T00:07:19.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.803+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600ad380 con 0x7f3d6014fd90 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.804+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600ad8a0 con 0x7f3d6014fd90 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.804+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3d5801b400 con 0x7f3d6014fd90 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.805+0000 7f3d57fff700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 0x7f3d400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.805+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3d58079cc0 con 0x7f3d6014fd90 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.805+0000 7f3d5ffff700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 0x7f3d400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:19.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.805+0000 7f3d5ffff700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 0x7f3d400612d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3d48004d40 tx=0x7f3d48000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:19.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:19.809+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d600ad8a0 con 0x7f3d6014fd90 2023-08-22T00:07:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.032+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3d600ad8a0 con 0x7f3d6014fd90 2023-08-22T00:07:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.035+0000 7f3d57fff700 1 -- 172.21.15.98:0/256755036 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3d600ad8a0 con 0x7f3d6014fd90 2023-08-22T00:07:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 msgr2=0x7f3d400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 0x7f3d400612d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3d48004d40 tx=0x7f3d48000bc0).stop 2023-08-22T00:07:20.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 msgr2=0x7f3d60161db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3d5800c7a0 tx=0x7f3d580015f0).stop 2023-08-22T00:07:20.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 shutdown_connections 2023-08-22T00:07:20.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d4005ee10 0x7f3d400612d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d600675f0 0x7f3d6014ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d6014fd90 0x7f3d60161db0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 --2- 172.21.15.98:0/256755036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d600c39d0 0x7f3d600c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 >> 172.21.15.98:0/256755036 conn(0x7f3d600c8950 msgr2=0x7f3d60150200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 shutdown_connections 2023-08-22T00:07:20.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.037+0000 7f3d669fc700 1 -- 172.21.15.98:0/256755036 wait complete. 2023-08-22T00:07:20.042 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:07:20.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:07:20.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.166+0000 7f3da19e9700 1 Processor -- start 2023-08-22T00:07:20.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 -- start start 2023-08-22T00:07:20.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d9c153f40 0x7f3d9c157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9c0a8410 con 0x7f3d9c153b60 2023-08-22T00:07:20.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c0a8cb0 con 0x7f3d9c153f40 2023-08-22T00:07:20.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.167+0000 7f3da19e9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c1586a0 con 0x7f3d9c0a9140 2023-08-22T00:07:20.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:57180/0 (socket says 172.21.15.98:57180) 2023-08-22T00:07:20.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d9c153f40 0x7f3d9c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9b7fe700 1 -- 172.21.15.98:0/843400438 learned_addr learned my addr 172.21.15.98:0/843400438 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 -- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 msgr2=0x7f3d9c157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 -- 172.21.15.98:0/843400438 >> v1:172.21.15.118:6789/0 conn(0x7f3d9c153b60 legacy=0x7f3d9c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 -- 172.21.15.98:0/843400438 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0a8660 con 0x7f3d9c153f40 2023-08-22T00:07:20.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9b7fe700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:20.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d9a7fc700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c153f40 0x7f3d9c157930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3d90009760 tx=0x7f3d90009060).ready entity=mon.1 client_cookie=a218ad8cfbf40538 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d99ffb700 1 -- 172.21.15.98:0/843400438 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000f510 con 0x7f3d9c153f40 2023-08-22T00:07:20.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d99ffb700 1 -- 172.21.15.98:0/843400438 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000f670 con 0x7f3d9c153f40 2023-08-22T00:07:20.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.168+0000 7f3d99ffb700 1 -- 172.21.15.98:0/843400438 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000f9f0 con 0x7f3d9c153f40 2023-08-22T00:07:20.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 -- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c153f40 msgr2=0x7f3d9c157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c153f40 0x7f3d9c157930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3d90009760 tx=0x7f3d90009060).stop 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 -- 172.21.15.98:0/843400438 shutdown_connections 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c0a9140 0x7f3d9c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 --2- 172.21.15.98:0/843400438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c153f40 0x7f3d9c157930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 -- 172.21.15.98:0/843400438 >> 172.21.15.98:0/843400438 conn(0x7f3d9c0c5dc0 msgr2=0x7f3d9c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 -- 172.21.15.98:0/843400438 shutdown_connections 2023-08-22T00:07:20.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.169+0000 7f3da19e9700 1 -- 172.21.15.98:0/843400438 wait complete. 2023-08-22T00:07:20.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.170+0000 7f3da19e9700 1 Processor -- start 2023-08-22T00:07:20.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.170+0000 7f3da19e9700 1 -- start start 2023-08-22T00:07:20.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c0a9140 0x7f3d9c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c153b60 0x7f3d9c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c067d50 con 0x7f3d9c153f40 2023-08-22T00:07:20.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c168100 con 0x7f3d9c0a9140 2023-08-22T00:07:20.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3da19e9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c067aa0 con 0x7f3d9c153b60 2023-08-22T00:07:20.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60832/0 (socket says 172.21.15.98:60832) 2023-08-22T00:07:20.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 -- 172.21.15.98:0/1919795082 learned_addr learned my addr 172.21.15.98:0/1919795082 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9a7fc700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c153b60 0x7f3d9c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9affd700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c0a9140 0x7f3d9c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 -- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c153b60 msgr2=0x7f3d9c0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c153b60 0x7f3d9c0675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 -- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c0a9140 msgr2=0x7f3d9c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c0a9140 0x7f3d9c156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.171+0000 7f3d9b7fe700 1 -- 172.21.15.98:0/1919795082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009ae0 con 0x7f3d9c153f40 2023-08-22T00:07:20.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3d9b7fe700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3d9400c0c0 tx=0x7f3d9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400c9f0 con 0x7f3d9c153f40 2023-08-22T00:07:20.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400f040 con 0x7f3d9c153f40 2023-08-22T00:07:20.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d900092a0 con 0x7f3d9c153f40 2023-08-22T00:07:20.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400cd60 con 0x7f3d9c153f40 2023-08-22T00:07:20.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.172+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c167ab0 con 0x7f3d9c153f40 2023-08-22T00:07:20.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.173+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9c0c4b90 con 0x7f3d9c153f40 2023-08-22T00:07:20.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.173+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3d94014670 con 0x7f3d9c153f40 2023-08-22T00:07:20.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.173+0000 7f3d82ffd700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 0x7f3d880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.173+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3d94079e50 con 0x7f3d9c153f40 2023-08-22T00:07:20.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.173+0000 7f3d9affd700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 0x7f3d880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.174+0000 7f3d9affd700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 0x7f3d880612d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3d8c003900 tx=0x7f3d8c007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.177+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d9404a8f0 con 0x7f3d9c153f40 2023-08-22T00:07:20.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.380+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d9c168290 con 0x7f3d9c153f40 2023-08-22T00:07:20.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.380+0000 7f3d82ffd700 1 -- 172.21.15.98:0/1919795082 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f3d9404b210 con 0x7f3d9c153f40 2023-08-22T00:07:20.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:07:20.384 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:07:20.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 msgr2=0x7f3d880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 0x7f3d880612d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3d8c003900 tx=0x7f3d8c007d40).stop 2023-08-22T00:07:20.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 msgr2=0x7f3d9c14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3d9400c0c0 tx=0x7f3d9400b040).stop 2023-08-22T00:07:20.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 shutdown_connections 2023-08-22T00:07:20.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d9c153f40 0x7f3d9c14ffb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d9c0a9140 0x7f3d9c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3d8805ee10 0x7f3d880612d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 --2- 172.21.15.98:0/1919795082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d9c153b60 0x7f3d9c0675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 >> 172.21.15.98:0/1919795082 conn(0x7f3d9c0c5dc0 msgr2=0x7f3d9c0c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 shutdown_connections 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.382+0000 7f3da19e9700 1 -- 172.21.15.98:0/1919795082 wait complete. 2023-08-22T00:07:20.388 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:07:20.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:07:15.659023+0000', 'modified': '2023-08-22T00:07:18.293098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5139}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5139': {'gid': 5139, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/3020491745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 3020491745}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 3020491745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:07:20.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:07:20.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-22T00:07:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.918+0000 7f77376c5700 1 Processor -- start 2023-08-22T00:07:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.918+0000 7f77376c5700 1 -- start start 2023-08-22T00:07:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f77376c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f77300c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f77376c5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7730153f80 0x7f77300a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f77376c5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77300aa3f0 con 0x7f7730063010 2023-08-22T00:07:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f77376c5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7730063490 con 0x7f7730153f80 2023-08-22T00:07:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f77376c5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77300bfe30 con 0x7f77300c5b70 2023-08-22T00:07:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7730153f80 0x7f77300a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735461700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f77300c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7730153f80 0x7f77300a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40540/0 (socket says 172.21.15.98:40540) 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 -- 172.21.15.98:0/1312382420 learned_addr learned my addr 172.21.15.98:0/1312382420 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7734c60700 1 --1- 172.21.15.98:0/1312382420 >> v1:172.21.15.118:6789/0 conn(0x7f7730063010 0x7f7730153870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:42278/0 (socket says 172.21.15.98:42278) 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 -- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 msgr2=0x7f77300c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f77300c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 -- 172.21.15.98:0/1312382420 >> v1:172.21.15.118:6789/0 conn(0x7f7730063010 legacy=0x7f7730153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735c62700 1 -- 172.21.15.98:0/1312382420 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300636a0 con 0x7f7730153f80 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.919+0000 7f7735461700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f77300c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f7735c62700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730153f80 0x7f77300a9f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7728009f20 tx=0x7f7728009840).ready entity=mon.1 client_cookie=bc38b8abeee833fa server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f7727fff700 1 -- 172.21.15.98:0/1312382420 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800e070 con 0x7f7730153f80 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f7727fff700 1 -- 172.21.15.98:0/1312382420 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800b9d0 con 0x7f7730153f80 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f7727fff700 1 -- 172.21.15.98:0/1312382420 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bd50 con 0x7f7730153f80 2023-08-22T00:07:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 -- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730153f80 msgr2=0x7f77300a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730153f80 0x7f77300a9f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7728009f20 tx=0x7f7728009840).stop 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 -- 172.21.15.98:0/1312382420 shutdown_connections 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730153f80 0x7f77300a9f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 --2- 172.21.15.98:0/1312382420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f77300c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 -- 172.21.15.98:0/1312382420 >> 172.21.15.98:0/1312382420 conn(0x7f77300cb610 msgr2=0x7f77300c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 -- 172.21.15.98:0/1312382420 shutdown_connections 2023-08-22T00:07:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.920+0000 7f77376c5700 1 -- 172.21.15.98:0/1312382420 wait complete. 2023-08-22T00:07:20.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.921+0000 7f77376c5700 1 Processor -- start 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.921+0000 7f77376c5700 1 -- start start 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730063010 0x7f773014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f7730163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773014f6b0 con 0x7f7730153f80 2023-08-22T00:07:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77300aeee0 con 0x7f7730063010 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f77376c5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77300c25b0 con 0x7f77300c5b70 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f7735c62700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.922+0000 7f7735c62700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56584/0 (socket says 172.21.15.98:56584) 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 -- 172.21.15.98:0/3712404178 learned_addr learned my addr 172.21.15.98:0/3712404178 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735461700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730063010 0x7f773014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7734c60700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f7730163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 -- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 msgr2=0x7f7730163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f7730163dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 -- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730063010 msgr2=0x7f773014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730063010 0x7f773014f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 -- 172.21.15.98:0/3712404178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0092a0 con 0x7f7730153f80 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f7735c62700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f773006a8e0 tx=0x7f77300c6b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f77257fa700 1 -- 172.21.15.98:0/3712404178 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bd50 con 0x7f7730153f80 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f77257fa700 1 -- 172.21.15.98:0/3712404178 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77280092e0 con 0x7f7730153f80 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f77257fa700 1 -- 172.21.15.98:0/3712404178 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772801d6b0 con 0x7f7730153f80 2023-08-22T00:07:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7728009ae0 con 0x7f7730153f80 2023-08-22T00:07:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.923+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77300af130 con 0x7f7730153f80 2023-08-22T00:07:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.924+0000 7f77257fa700 1 -- 172.21.15.98:0/3712404178 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7728003040 con 0x7f7730153f80 2023-08-22T00:07:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.925+0000 7f77257fa700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 0x7f77140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.925+0000 7f77257fa700 1 -- 172.21.15.98:0/3712404178 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f772807b140 con 0x7f7730153f80 2023-08-22T00:07:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.925+0000 7f7735461700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 0x7f77140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.925+0000 7f7735461700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 0x7f77140612d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f772c009dc0 tx=0x7f772c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 Processor -- start 2023-08-22T00:07:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 -- start start 2023-08-22T00:07:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c312c0 0x555b24c316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 0x555b24c2cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24b6ddb0 con 0x555b24c79f60 2023-08-22T00:07:20.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24b83030 con 0x555b24c2caf0 2023-08-22T00:07:20.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.927+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b24b83170 con 0x555b24c312c0 2023-08-22T00:07:20.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56592/0 (socket says 172.21.15.98:56592) 2023-08-22T00:07:20.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 -- 172.21.15.98:0/2648010144 learned_addr learned my addr 172.21.15.98:0/2648010144 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7735461700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c312c0 0x555b24c316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7735c62700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 0x555b24c2cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 -- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c312c0 msgr2=0x555b24c316a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c312c0 0x555b24c316a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 -- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 msgr2=0x555b24c2cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 0x555b24c2cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 -- 172.21.15.98:0/2648010144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b24b55b00 con 0x555b24c79f60 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7735c62700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 0x555b24c2cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f7734c60700 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f7720007570 tx=0x7f7720007d30).ready entity=mon.0 client_cookie=3a6d2e1cc228ea9d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f771a7fc700 1 -- 172.21.15.98:0/2648010144 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720007190 con 0x555b24c79f60 2023-08-22T00:07:20.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f771a7fc700 1 -- 172.21.15.98:0/2648010144 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200114c0 con 0x555b24c79f60 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.928+0000 7f771a7fc700 1 -- 172.21.15.98:0/2648010144 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720011840 con 0x555b24c79f60 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- 172.21.15.98:0/2648010144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 msgr2=0x555b24c2c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f7720007570 tx=0x7f7720007d30).stop 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- 172.21.15.98:0/2648010144 shutdown_connections 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c312c0 0x555b24c316a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c2caf0 0x555b24c2cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 --2- 172.21.15.98:0/2648010144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c79f60 0x555b24c2c600 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- 172.21.15.98:0/2648010144 >> 172.21.15.98:0/2648010144 conn(0x555b24a9b940 msgr2=0x555b24c7a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- 172.21.15.98:0/2648010144 shutdown_connections 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- 172.21.15.98:0/2648010144 wait complete. 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.929+0000 7f7749079b80 1 -- start start 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 Processor -- start 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c312c0 0x555b24c5eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 0x555b24c5f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24b833f0 con 0x555b24c2caf0 2023-08-22T00:07:20.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24b4e920 con 0x555b24c312c0 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b24c88a50 con 0x555b24c79f60 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.930+0000 7f7749079b80 10 client.0 ll_register_callbacks cb 0x555b24b23ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56604/0 (socket says 172.21.15.98:56604) 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 -- 172.21.15.98:0/1120182641 learned_addr learned my addr 172.21.15.98:0/1120182641 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7734c60700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c312c0 0x555b24c5eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735c62700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 0x555b24c5f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 -- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 msgr2=0x555b24c5f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 0x555b24c5f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 -- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c312c0 msgr2=0x555b24c5eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c312c0 0x555b24c5eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 -- 172.21.15.98:0/1120182641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77300aa3f0 con 0x555b24c2caf0 2023-08-22T00:07:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735c62700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 0x555b24c5f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7735461700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f772c014970 tx=0x7f772c017000).ready entity=mon.0 client_cookie=2497d855c798f20c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:07:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c014e00 con 0x555b24c2caf0 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f772c013830 con 0x555b24c2caf0 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b24c2baa0 con 0x555b24c2caf0 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f772c013c00 con 0x555b24c2caf0 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 10 client.5316 fetch_fsmap learned FSMap version 16 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555b24b7bf70 con 0x555b24c2caf0 2023-08-22T00:07:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b24c2baa0 con 0x555b24c2caf0 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f772c029440 con 0x555b24c2caf0 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 10 client.5316 fetch_fsmap finished waiting for FSMap version 16 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 10 client.5316 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 20 client.5316 populate_metadata read hostname 'smithi098' 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.931+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c89a50 0x555b24c7eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f7749079b80 4 client.5316 mds_command: new command op to 5139 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:07:20.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 --> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b249ebef0 con 0x555b24c89a50 2023-08-22T00:07:20.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f7734c60700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c89a50 0x555b24c7eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f770f7fe700 10 client.5316 ms_handle_connect on v2:172.21.15.98:6834/3020491745 2023-08-22T00:07:20.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f7734c60700 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c89a50 0x555b24c7eaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8810967dd1d00fe3 server_cookie=712d113ac6db30b in_seq=0 out_seq=0 2023-08-22T00:07:20.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f770f7fe700 1 -- 172.21.15.98:0/1120182641 <== mds.0 v2:172.21.15.98:6834/3020491745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555b249ebef0 con 0x555b24c89a50 2023-08-22T00:07:20.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.932+0000 7f770f7fe700 10 client.5316 handle_command_reply: tid=0 2023-08-22T00:07:20.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 client.5316 shutdown 2023-08-22T00:07:20.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 msgr2=0x555b24c5c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f772c014970 tx=0x7f772c017000).stop 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 shutdown_connections 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c89a50 0x555b24c7eaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c79f60 0x555b24c5f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c2caf0 0x555b24c5c610 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f770f7fe700 0 client.5316 ms_handle_reset on v2:172.21.15.98:6834/3020491745 2023-08-22T00:07:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 --2- 172.21.15.98:0/1120182641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c312c0 0x555b24c5eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 >> 172.21.15.98:0/1120182641 conn(0x555b24a9b940 msgr2=0x555b24c316a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 shutdown_connections 2023-08-22T00:07:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 1 -- 172.21.15.98:0/1120182641 wait complete. 2023-08-22T00:07:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.933+0000 7f7749079b80 20 client.5316 trim_cache size 0 max 16384 2023-08-22T00:07:20.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.949+0000 7f7749079b80 1 Processor -- start 2023-08-22T00:07:20.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.949+0000 7f7749079b80 1 -- start start 2023-08-22T00:07:20.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24c7e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c90630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24c5f9c0 con 0x555b24c312c0 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24c7f380 con 0x555b24c79f60 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b24c89e90 con 0x555b24c2caf0 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56616/0 (socket says 172.21.15.98:56616) 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 -- 172.21.15.98:0/2321109811 learned_addr learned my addr 172.21.15.98:0/2321109811 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7735c62700 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c90630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7735461700 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24c7e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 -- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 msgr2=0x555b24c7e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24c7e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 -- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 msgr2=0x555b24c90630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c90630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 -- 172.21.15.98:0/2321109811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b24b77580 con 0x555b24c312c0 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f7734c60700 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7720004d20 tx=0x7f7720026280).ready entity=mon.0 client_cookie=6df05909450b109d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f771affd700 1 -- 172.21.15.98:0/2321109811 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720026070 con 0x555b24c312c0 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f771affd700 1 -- 172.21.15.98:0/2321109811 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720000cd0 con 0x555b24c312c0 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.950+0000 7f771affd700 1 -- 172.21.15.98:0/2321109811 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720011630 con 0x555b24c312c0 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- 172.21.15.98:0/2321109811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 msgr2=0x555b24c7ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7720004d20 tx=0x7f7720026280).stop 2023-08-22T00:07:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- 172.21.15.98:0/2321109811 shutdown_connections 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24c7e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c90630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 --2- 172.21.15.98:0/2321109811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24c7ee90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- 172.21.15.98:0/2321109811 >> 172.21.15.98:0/2321109811 conn(0x555b24a9b940 msgr2=0x555b24c316a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- 172.21.15.98:0/2321109811 shutdown_connections 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- 172.21.15.98:0/2321109811 wait complete. 2023-08-22T00:07:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.951+0000 7f7749079b80 1 -- start start 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 Processor -- start 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24cdb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c7e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24c90f00 con 0x555b24c312c0 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b24c99ab0 con 0x555b24c79f60 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b24c997d0 con 0x555b24c2caf0 2023-08-22T00:07:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7749079b80 10 client.0 ll_register_callbacks cb 0x555b24b23ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.952+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56626/0 (socket says 172.21.15.98:56626) 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 -- 172.21.15.98:0/2318202239 learned_addr learned my addr 172.21.15.98:0/2318202239 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7735461700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24cdb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7735c62700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c7e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 -- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 msgr2=0x555b24cdb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24cdb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 -- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 msgr2=0x555b24c7e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c7e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 -- 172.21.15.98:0/2318202239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b24b55b00 con 0x555b24c312c0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7734c60700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f7720007540 tx=0x7f7720026000).ready entity=mon.0 client_cookie=9685754ccd9cb533 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772002e070 con 0x555b24c312c0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7720014db0 con 0x555b24c312c0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77200114c0 con 0x555b24c312c0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7720004d20 con 0x555b24c312c0 2023-08-22T00:07:20.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 10 client.5322 fetch_fsmap learned FSMap version 16 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555b24b772d0 con 0x555b24c312c0 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200114c0 con 0x555b24c312c0 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7720012070 con 0x555b24c312c0 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 10 client.5322 fetch_fsmap finished waiting for FSMap version 16 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 20 client.5322 populate_metadata read hostname 'smithi098' 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c86020 0x555b24c86400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 4 client.5322 mds_command: new command op to 5139 tid=0[{"prefix": "status"}] 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.953+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 --> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555b24a21040 con 0x555b24c86020 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7735461700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c86020 0x555b24c86400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f770f7fe700 10 client.5322 ms_handle_connect on v2:172.21.15.98:6834/3020491745 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7735461700 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c86020 0x555b24c86400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=74e4d98d657c0b8d server_cookie=e39c368bbb14e26e in_seq=0 out_seq=0 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f770f7fe700 1 -- 172.21.15.98:0/2318202239 <== mds.0 v2:172.21.15.98:6834/3020491745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555b24a21040 con 0x555b24c86020 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f770f7fe700 10 client.5322 handle_command_reply: tid=0 2023-08-22T00:07:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 client.5322 shutdown 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 msgr2=0x555b24cdb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f7720007540 tx=0x7f7720026000).stop 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 shutdown_connections 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:6834/3020491745,v1:172.21.15.98:6837/3020491745] conn(0x555b24c86020 0x555b24c86400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b24c2caf0 0x555b24cdb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b24c79f60 0x555b24c7e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f770f7fe700 0 client.5322 ms_handle_reset on v2:172.21.15.98:6834/3020491745 2023-08-22T00:07:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 --2- 172.21.15.98:0/2318202239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b24c312c0 0x555b24cdb9a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 >> 172.21.15.98:0/2318202239 conn(0x555b24a9b940 msgr2=0x555b24c7b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 shutdown_connections 2023-08-22T00:07:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 1 -- 172.21.15.98:0/2318202239 wait complete. 2023-08-22T00:07:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.954+0000 7f7749079b80 20 client.5322 trim_cache size 0 max 16384 2023-08-22T00:07:20.986 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 5139, 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 5.2946963460000003, 2023-08-22T00:07:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 16, 2023-08-22T00:07:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 41, 2023-08-22T00:07:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 41, 2023-08-22T00:07:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 12.533763468 2023-08-22T00:07:20.988 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:07:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 msgr2=0x7f77140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 0x7f77140612d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f772c009dc0 tx=0x7f772c009060).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 msgr2=0x7f77300afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f773006a8e0 tx=0x7f77300c6b00).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 shutdown_connections 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7730153f80 0x7f77300afd20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7730063010 0x7f773014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f771405ee10 0x7f77140612d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 --2- 172.21.15.98:0/3712404178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77300c5b70 0x7f7730163dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 >> 172.21.15.98:0/3712404178 conn(0x7f77300cb610 msgr2=0x7f7730153640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 shutdown_connections 2023-08-22T00:07:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:20.955+0000 7f77376c5700 1 -- 172.21.15.98:0/3712404178 wait complete. 2023-08-22T00:07:20.992 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:07:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 Processor -- start 2023-08-22T00:07:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 -- start start 2023-08-22T00:07:21.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff324064180 0x7ff3240be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff3240be710 0x7ff3240c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3240c6290 con 0x7ff3240a7d40 2023-08-22T00:07:21.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240657c0 con 0x7ff3240be710 2023-08-22T00:07:21.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.096+0000 7ff32a4bb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff324065330 con 0x7ff324064180 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff3240be710 0x7ff3240c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff3240be710 0x7ff3240c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56638/0 (socket says 172.21.15.98:56638) 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 -- 172.21.15.98:0/464339360 learned_addr learned my addr 172.21.15.98:0/464339360 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff3237fe700 1 --2- 172.21.15.98:0/464339360 >> v2:172.21.15.118:3300/0 conn(0x7ff324064180 0x7ff3240be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 -- 172.21.15.98:0/464339360 >> v2:172.21.15.118:3300/0 conn(0x7ff324064180 msgr2=0x7ff3240be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 --2- 172.21.15.98:0/464339360 >> v2:172.21.15.118:3300/0 conn(0x7ff324064180 0x7ff3240be220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 -- 172.21.15.98:0/464339360 >> v1:172.21.15.118:6789/0 conn(0x7ff3240a7d40 legacy=0x7ff3240c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 -- 172.21.15.98:0/464339360 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240beb40 con 0x7ff3240be710 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff328a58700 1 --2- 172.21.15.98:0/464339360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3240be710 0x7ff3240c2f10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff3240635d0 tx=0x7ff31c009840).ready entity=mon.0 client_cookie=fcd3ed02078e5e0d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff322ffd700 1 -- 172.21.15.98:0/464339360 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00e070 con 0x7ff3240be710 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff322ffd700 1 -- 172.21.15.98:0/464339360 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c00ba50 con 0x7ff3240be710 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.097+0000 7ff322ffd700 1 -- 172.21.15.98:0/464339360 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00bdd0 con 0x7ff3240be710 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 -- 172.21.15.98:0/464339360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3240be710 msgr2=0x7ff3240c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/464339360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3240be710 0x7ff3240c2f10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff3240635d0 tx=0x7ff31c009840).stop 2023-08-22T00:07:21.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 -- 172.21.15.98:0/464339360 shutdown_connections 2023-08-22T00:07:21.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/464339360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3240be710 0x7ff3240c2f10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/464339360 >> v2:172.21.15.118:3300/0 conn(0x7ff324064180 0x7ff3240be220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 -- 172.21.15.98:0/464339360 >> 172.21.15.98:0/464339360 conn(0x7ff3240826b0 msgr2=0x7ff324091f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:21.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 -- 172.21.15.98:0/464339360 shutdown_connections 2023-08-22T00:07:21.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.098+0000 7ff32a4bb700 1 -- 172.21.15.98:0/464339360 wait complete. 2023-08-22T00:07:21.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.099+0000 7ff32a4bb700 1 Processor -- start 2023-08-22T00:07:21.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.099+0000 7ff32a4bb700 1 -- start start 2023-08-22T00:07:21.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3240a7d40 0x7ff324163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 0x7ff324164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324157190 con 0x7ff324064180 2023-08-22T00:07:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324156b40 con 0x7ff3240a7d40 2023-08-22T00:07:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff324155d30 con 0x7ff3240be710 2023-08-22T00:07:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56652/0 (socket says 172.21.15.98:56652) 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 -- 172.21.15.98:0/4171720877 learned_addr learned my addr 172.21.15.98:0/4171720877 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff328a58700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 0x7ff324164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff3237fe700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3240a7d40 0x7ff324163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 -- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 msgr2=0x7ff324164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 0x7ff324164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 -- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3240a7d40 msgr2=0x7ff324163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3240a7d40 0x7ff324163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 -- 172.21.15.98:0/4171720877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c009ae0 con 0x7ff324064180 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff328a58700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 0x7ff324164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff323fff700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff31400c4f0 tx=0x7ff314007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314007020 con 0x7ff324064180 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314001e90 con 0x7ff324064180 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324156db0 con 0x7ff324064180 2023-08-22T00:07:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3140073b0 con 0x7ff324064180 2023-08-22T00:07:21.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.100+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff324155950 con 0x7ff324064180 2023-08-22T00:07:21.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.101+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324047480 con 0x7ff324064180 2023-08-22T00:07:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.102+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff3140068b0 con 0x7ff324064180 2023-08-22T00:07:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.102+0000 7ff31bfff700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 0x7ff3040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.102+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff3140797c0 con 0x7ff324064180 2023-08-22T00:07:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.102+0000 7ff3237fe700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 0x7ff3040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.102+0000 7ff3237fe700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 0x7ff3040612d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff30c006fd0 tx=0x7ff30c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.106+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff31404aad0 con 0x7ff324064180 2023-08-22T00:07:21.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.308+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff324152b30 con 0x7ff324064180 2023-08-22T00:07:21.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.308+0000 7ff31bfff700 1 -- 172.21.15.98:0/4171720877 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff31404e0f0 con 0x7ff324064180 2023-08-22T00:07:21.310 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:07:21.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 msgr2=0x7ff3040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 0x7ff3040612d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff30c006fd0 tx=0x7ff30c008040).stop 2023-08-22T00:07:21.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 msgr2=0x7ff3241545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:21.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff31400c4f0 tx=0x7ff314007e00).stop 2023-08-22T00:07:21.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 shutdown_connections 2023-08-22T00:07:21.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff30405ee10 0x7ff3040612d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3240be710 0x7ff324164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff324064180 0x7ff3241545b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 --2- 172.21.15.98:0/4171720877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3240a7d40 0x7ff324163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:21.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 >> 172.21.15.98:0/4171720877 conn(0x7ff3240826b0 msgr2=0x7ff3240a64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:21.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 shutdown_connections 2023-08-22T00:07:21.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:21.310+0000 7ff32a4bb700 1 -- 172.21.15.98:0/4171720877 wait complete. 2023-08-22T00:07:21.323 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:07:21.324 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:07:21.324 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:07:21.325 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:07:21.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:21.325 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:07:21.325 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:07:21.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:07:21.326 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:07:21.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.327 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:07:21.347 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:07:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:07:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:07:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:07:21.349 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:07:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:07:21.350 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:07:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42464sec preferred_lft 42464sec 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:07:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.352 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:07:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:07:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:07:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:07:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.354 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:07:21.414 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:07:21.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.417 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:07:21.478 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:07:21.479 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:07:21.479 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:07:21.479 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:07:21.479 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:07:21.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.480 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:07:21.480 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:07:21.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:07:21.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:07:21.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:07:21.482 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:07:21.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.585 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:07:21.604 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:07:21.604 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:07:21.605 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:07:21.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:07:21.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:07:21.672 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:07:21.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:21.673 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:21.731 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:07:21.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:07:21.810 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:07:21.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:07:21.881 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:07:21.882 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:07:21.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:21.884 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:07:21.941 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:07:21.942 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:21.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:07:22.017 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:07:22.017 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:07:22.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:07:22.066+0000 7f4153bfd3c0 -1 init, newargv = 0x562231e3cea0 newargc=15 2023-08-22T00:07:22.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[132173]: starting ceph client 2023-08-22T00:07:22.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[132173]: starting fuse 2023-08-22T00:07:22.085 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:07:22.086 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:07:22.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:22.089 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:07:22.147 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:07:22.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:07:22.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:07:22.148 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:07:22.149 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:07:22.149 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:07:22.149 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:07:22.150 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:07:22.150 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:07:22.150 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:07:22.151 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:07:22.151 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:07:22.151 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:07:22.151 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:07:22.152 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:07:22.152 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:07:22.152 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:07:22.153 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:07:22.153 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:07:22.154 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:07:22.154 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:07:22.154 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:07:22.155 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:07:22.155 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:07:22.155 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:07:22.156 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:07:22.156 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:07:22.156 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:07:22.157 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:07:22.270 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.132173.asok 2023-08-22T00:07:22.453 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.132173.asok 2023-08-22T00:07:22.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:22.454 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.132173.asok status 2023-08-22T00:07:22.605 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:07:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:07:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "132173", 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 5334, 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 5334 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1893056324 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:07:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1893056324 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.5334 192.168.0.1:0/1893056324", 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/1893056324", 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 16, 2023-08-22T00:07:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 41, 2023-08-22T00:07:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:07:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:07:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:07:22.610 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:07:22.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:22.615 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:07:22.616 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:22.634 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:07:22.635 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:22.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:22.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:07:22.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:07:22.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.859+0000 7faac4fbe700 1 Processor -- start 2023-08-22T00:07:22.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.859+0000 7faac4fbe700 1 -- start start 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faac4fbe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 0x7faac0154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faac4fbe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faac00be430 0x7faac00c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faac4fbe700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac01554f0 con 0x7faac0154a80 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faac4fbe700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac0154f30 con 0x7faac00be430 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faac4fbe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0155210 con 0x7faac014e5d0 2023-08-22T00:07:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faac00be430 0x7faac00c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faac00be430 0x7faac00c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56662/0 (socket says 172.21.15.98:56662) 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 -- 172.21.15.98:0/1111234773 learned_addr learned my addr 172.21.15.98:0/1111234773 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabdd9b700 1 --1- 172.21.15.98:0/1111234773 >> v1:172.21.15.98:6789/0 conn(0x7faac0154a80 0x7faac0063f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46666/0 (socket says 172.21.15.98:46666) 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabe59c700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 0x7faac0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 -- 172.21.15.98:0/1111234773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 msgr2=0x7faac0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 0x7faac0154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 -- 172.21.15.98:0/1111234773 >> v1:172.21.15.98:6789/0 conn(0x7faac0154a80 legacy=0x7faac0063f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 -- 172.21.15.98:0/1111234773 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00bc7f0 con 0x7faac00be430 2023-08-22T00:07:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabe59c700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 0x7faac0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabed9d700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac00be430 0x7faac00c32d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faab8009f20 tx=0x7faab8009840).ready entity=mon.0 client_cookie=ee5401c46133d6e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabd59a700 1 -- 172.21.15.98:0/1111234773 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800e070 con 0x7faac00be430 2023-08-22T00:07:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabd59a700 1 -- 172.21.15.98:0/1111234773 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab800ba80 con 0x7faac00be430 2023-08-22T00:07:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.860+0000 7faabd59a700 1 -- 172.21.15.98:0/1111234773 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800be00 con 0x7faac00be430 2023-08-22T00:07:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 -- 172.21.15.98:0/1111234773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac00be430 msgr2=0x7faac00c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac00be430 0x7faac00c32d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faab8009f20 tx=0x7faab8009840).stop 2023-08-22T00:07:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 -- 172.21.15.98:0/1111234773 shutdown_connections 2023-08-22T00:07:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac00be430 0x7faac00c32d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 --2- 172.21.15.98:0/1111234773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac014e5d0 0x7faac0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 -- 172.21.15.98:0/1111234773 >> 172.21.15.98:0/1111234773 conn(0x7faac00c4290 msgr2=0x7faac00c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 -- 172.21.15.98:0/1111234773 shutdown_connections 2023-08-22T00:07:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.861+0000 7faac4fbe700 1 -- 172.21.15.98:0/1111234773 wait complete. 2023-08-22T00:07:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.862+0000 7faac4fbe700 1 Processor -- start 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.862+0000 7faac4fbe700 1 -- start start 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faac00be430 0x7faac0143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac0154a80 0x7faac00abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aca40 con 0x7faac014e5d0 2023-08-22T00:07:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00acd20 con 0x7faac00be430 2023-08-22T00:07:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faac4fbe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00ad000 con 0x7faac0154a80 2023-08-22T00:07:22.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56676/0 (socket says 172.21.15.98:56676) 2023-08-22T00:07:22.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 -- 172.21.15.98:0/854166691 learned_addr learned my addr 172.21.15.98:0/854166691 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:22.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabed9d700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac0154a80 0x7faac00abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabe59c700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faac00be430 0x7faac0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 -- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac0154a80 msgr2=0x7faac00abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:22.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac0154a80 0x7faac00abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:22.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 -- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faac00be430 msgr2=0x7faac0143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:22.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faac00be430 0x7faac0143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:22.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.863+0000 7faabdd9b700 1 -- 172.21.15.98:0/854166691 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8009ae0 con 0x7faac014e5d0 2023-08-22T00:07:22.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faabdd9b700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7faac00c5300 tx=0x7faab4007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40072e0 con 0x7faac014e5d0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4007440 con 0x7faac014e5d0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac00ad2e0 con 0x7faac014e5d0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40058f0 con 0x7faac014e5d0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.864+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac00a9e10 con 0x7faac014e5d0 2023-08-22T00:07:22.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.865+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0069110 con 0x7faac014e5d0 2023-08-22T00:07:22.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.865+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7faab4005ce0 con 0x7faac014e5d0 2023-08-22T00:07:22.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.865+0000 7faaae7fc700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 0x7faaa00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:22.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.865+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7faab4079720 con 0x7faac014e5d0 2023-08-22T00:07:22.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.865+0000 7faabe59c700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 0x7faaa00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:22.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.866+0000 7faabe59c700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 0x7faaa00612d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faab000aa70 tx=0x7faab0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:22.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:22.869+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faab404aa30 con 0x7faac014e5d0 2023-08-22T00:07:23.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.055+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faac00bcad0 con 0x7faaa005ee10 2023-08-22T00:07:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.056+0000 7faaae7fc700 1 -- 172.21.15.98:0/854166691 <== mgr.4107 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7faac00bcad0 con 0x7faaa005ee10 2023-08-22T00:07:23.059 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:07:23.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:07:23.060 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:07:23.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:07:23.061 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:07:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 msgr2=0x7faaa00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 0x7faaa00612d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faab000aa70 tx=0x7faab0008040).stop 2023-08-22T00:07:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 msgr2=0x7faac00a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7faac00c5300 tx=0x7faab4007d30).stop 2023-08-22T00:07:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 shutdown_connections 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faaa005ee10 0x7faaa00612d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faac0154a80 0x7faac00abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faac00be430 0x7faac0143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 --2- 172.21.15.98:0/854166691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac014e5d0 0x7faac00a60b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 >> 172.21.15.98:0/854166691 conn(0x7faac00c4290 msgr2=0x7faac00646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 shutdown_connections 2023-08-22T00:07:23.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.058+0000 7faac4fbe700 1 -- 172.21.15.98:0/854166691 wait complete. 2023-08-22T00:07:23.071 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:07:23.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.188+0000 7fdaf8b3e700 1 Processor -- start 2023-08-22T00:07:23.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.188+0000 7fdaf8b3e700 1 -- start start 2023-08-22T00:07:23.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.189+0000 7fdaf8b3e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdaf40bea40 0x7fdaf40bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.189+0000 7fdaf8b3e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdaf4153f10 0x7fdaf4068910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.189+0000 7fdaf8b3e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40c3f00 con 0x7fdaf40c4390 2023-08-22T00:07:23.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.189+0000 7fdaf8b3e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40c47f0 con 0x7fdaf4153f10 2023-08-22T00:07:23.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.189+0000 7fdaf8b3e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40c32f0 con 0x7fdaf40bea40 2023-08-22T00:07:23.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdaf4153f10 0x7fdaf4068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdaf4153f10 0x7fdaf4068910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56680/0 (socket says 172.21.15.98:56680) 2023-08-22T00:07:23.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/2912209170 learned_addr learned my addr 172.21.15.98:0/2912209170 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:23.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf259c700 1 --2- 172.21.15.98:0/2912209170 >> v2:172.21.15.118:3300/0 conn(0x7fdaf40bea40 0x7fdaf40bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/2912209170 >> v2:172.21.15.118:3300/0 conn(0x7fdaf40bea40 msgr2=0x7fdaf40bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:23.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 --2- 172.21.15.98:0/2912209170 >> v2:172.21.15.118:3300/0 conn(0x7fdaf40bea40 0x7fdaf40bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/2912209170 >> v1:172.21.15.118:6789/0 conn(0x7fdaf40c4390 legacy=0x7fdaf4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:23.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/2912209170 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40c35d0 con 0x7fdaf4153f10 2023-08-22T00:07:23.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf2d9d700 1 --2- 172.21.15.98:0/2912209170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf4068910 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdaf40c8820 tx=0x7fdaec009840).ready entity=mon.0 client_cookie=3c2961af90f40de3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:23.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf159a700 1 -- 172.21.15.98:0/2912209170 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00e070 con 0x7fdaf4153f10 2023-08-22T00:07:23.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf159a700 1 -- 172.21.15.98:0/2912209170 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00ba10 con 0x7fdaf4153f10 2023-08-22T00:07:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.190+0000 7fdaf159a700 1 -- 172.21.15.98:0/2912209170 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00bd90 con 0x7fdaf4153f10 2023-08-22T00:07:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/2912209170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 msgr2=0x7fdaf4068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/2912209170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf4068910 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdaf40c8820 tx=0x7fdaec009840).stop 2023-08-22T00:07:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/2912209170 shutdown_connections 2023-08-22T00:07:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/2912209170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf4068910 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/2912209170 >> v2:172.21.15.118:3300/0 conn(0x7fdaf40bea40 0x7fdaf40bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/2912209170 >> 172.21.15.98:0/2912209170 conn(0x7fdaf40c5e80 msgr2=0x7fdaf40661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/2912209170 shutdown_connections 2023-08-22T00:07:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.191+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/2912209170 wait complete. 2023-08-22T00:07:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.192+0000 7fdaf8b3e700 1 Processor -- start 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.192+0000 7fdaf8b3e700 1 -- start start 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf40bea40 0x7fdaf4155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf40c4390 0x7fdaf40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40ac890 con 0x7fdaf4153f10 2023-08-22T00:07:23.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40acae0 con 0x7fdaf40bea40 2023-08-22T00:07:23.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40acdc0 con 0x7fdaf40c4390 2023-08-22T00:07:23.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56692/0 (socket says 172.21.15.98:56692) 2023-08-22T00:07:23.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/1949792836 learned_addr learned my addr 172.21.15.98:0/1949792836 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf259c700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf40bea40 0x7fdaf4155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf1d9b700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf40c4390 0x7fdaf40ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf40c4390 msgr2=0x7fdaf40ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf40c4390 0x7fdaf40ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf40bea40 msgr2=0x7fdaf4155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf40bea40 0x7fdaf4155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 -- 172.21.15.98:0/1949792836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec009ae0 con 0x7fdaf4153f10 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf2d9d700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdaec009930 tx=0x7fdaec009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0092e0 con 0x7fdaf4153f10 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec007080 con 0x7fdaf4153f10 2023-08-22T00:07:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec01e6c0 con 0x7fdaf4153f10 2023-08-22T00:07:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40ad0a0 con 0x7fdaf4153f10 2023-08-22T00:07:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.193+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40ae280 con 0x7fdaf4153f10 2023-08-22T00:07:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.194+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf406a2f0 con 0x7fdaf4153f10 2023-08-22T00:07:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.195+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdaec003040 con 0x7fdaf4153f10 2023-08-22T00:07:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.195+0000 7fdaea7fc700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 0x7fdad40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.195+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdaec07b490 con 0x7fdaf4153f10 2023-08-22T00:07:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.195+0000 7fdaf259c700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 0x7fdad40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.195+0000 7fdaf259c700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 0x7fdad40612d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fdae400bb20 tx=0x7fdae4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:23.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.199+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdaec04c7a0 con 0x7fdaf4153f10 2023-08-22T00:07:23.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:23.408+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fdaf40c38b0 con 0x7fdaf4153f10 2023-08-22T00:07:24.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.316+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7fdaec079100 con 0x7fdaf4153f10 2023-08-22T00:07:24.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.317+0000 7fdaea7fc700 1 -- 172.21.15.98:0/1949792836 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7fdaec043270 con 0x7fdaf4153f10 2023-08-22T00:07:24.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.319+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 msgr2=0x7fdad40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.319+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 0x7fdad40612d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fdae400bb20 tx=0x7fdae4008040).stop 2023-08-22T00:07:24.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.319+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 msgr2=0x7fdaf40add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.319+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdaec009930 tx=0x7fdaec009840).stop 2023-08-22T00:07:24.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 shutdown_connections 2023-08-22T00:07:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaf4153f10 0x7fdaf40add90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf40bea40 0x7fdaf4155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdad405ee10 0x7fdad40612d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 --2- 172.21.15.98:0/1949792836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf40c4390 0x7fdaf40ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 >> 172.21.15.98:0/1949792836 conn(0x7fdaf40c5e80 msgr2=0x7fdaf4152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 shutdown_connections 2023-08-22T00:07:24.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.320+0000 7fdaf8b3e700 1 -- 172.21.15.98:0/1949792836 wait complete. 2023-08-22T00:07:24.335 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:07:24.454 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:24.453+0000 7fbe95595680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:07:24.463 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:24.461+0000 7fb27b2de680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:07:24.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.463+0000 7f52e74fc700 1 Processor -- start 2023-08-22T00:07:24.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.463+0000 7f52e74fc700 1 -- start start 2023-08-22T00:07:24.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f52e0154e90 0x7f52e00640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0155270 0x7f52e00645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52e00a6740 0x7f52e00a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e01560a0 con 0x7f52e00a6740 2023-08-22T00:07:24.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e00a70c0 con 0x7f52e0154e90 2023-08-22T00:07:24.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e74fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0155770 con 0x7f52e0155270 2023-08-22T00:07:24.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52e00a6740 0x7f52e00a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52e00a6740 0x7f52e00a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56710/0 (socket says 172.21.15.98:56710) 2023-08-22T00:07:24.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 -- 172.21.15.98:0/3688484323 learned_addr learned my addr 172.21.15.98:0/3688484323 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:24.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e4a97700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0155270 0x7f52e00645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5298700 1 --2- 172.21.15.98:0/3688484323 >> v2:172.21.15.118:3300/0 conn(0x7f52e0154e90 0x7f52e00640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 -- 172.21.15.98:0/3688484323 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0155270 msgr2=0x7f52e00645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:24.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0155270 0x7f52e00645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 -- 172.21.15.98:0/3688484323 >> v2:172.21.15.118:3300/0 conn(0x7f52e0154e90 msgr2=0x7f52e00640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:24.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 --2- 172.21.15.98:0/3688484323 >> v2:172.21.15.118:3300/0 conn(0x7f52e0154e90 0x7f52e00640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 -- 172.21.15.98:0/3688484323 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0155a50 con 0x7f52e00a6740 2023-08-22T00:07:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.464+0000 7f52e5a99700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e00a6bd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f52e006b600 tx=0x7f52d8009840).ready entity=mon.0 client_cookie=17f5ec71c515092f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52d7fff700 1 -- 172.21.15.98:0/3688484323 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d800e070 con 0x7f52e00a6740 2023-08-22T00:07:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52d7fff700 1 -- 172.21.15.98:0/3688484323 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800b970 con 0x7f52e00a6740 2023-08-22T00:07:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52d7fff700 1 -- 172.21.15.98:0/3688484323 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d800bcf0 con 0x7f52e00a6740 2023-08-22T00:07:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 -- 172.21.15.98:0/3688484323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 msgr2=0x7f52e00a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e00a6bd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f52e006b600 tx=0x7f52d8009840).stop 2023-08-22T00:07:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 -- 172.21.15.98:0/3688484323 shutdown_connections 2023-08-22T00:07:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e00a6bd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 --2- 172.21.15.98:0/3688484323 >> v2:172.21.15.118:3300/0 conn(0x7f52e0154e90 0x7f52e00640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 --2- 172.21.15.98:0/3688484323 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0155270 0x7f52e00645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 -- 172.21.15.98:0/3688484323 >> 172.21.15.98:0/3688484323 conn(0x7f52e00c7800 msgr2=0x7f52e00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 -- 172.21.15.98:0/3688484323 shutdown_connections 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.465+0000 7f52e74fc700 1 -- 172.21.15.98:0/3688484323 wait complete. 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.466+0000 7f52e74fc700 1 Processor -- start 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.466+0000 7f52e74fc700 1 -- start start 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 0x7f52e00a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 0x7f52e00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00c5990 con 0x7f52e00a6740 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00a4220 con 0x7f52e00a3dc0 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e74fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00c5360 con 0x7f52e0154e90 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.467+0000 7f52e5298700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56724/0 (socket says 172.21.15.98:56724) 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 -- 172.21.15.98:0/2152866870 learned_addr learned my addr 172.21.15.98:0/2152866870 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e4a97700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 0x7f52e00a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5a99700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 0x7f52e00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 -- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 msgr2=0x7f52e00a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 0x7f52e00a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 -- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 msgr2=0x7f52e00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 0x7f52e00a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 -- 172.21.15.98:0/2152866870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8009ae0 con 0x7f52e00a6740 2023-08-22T00:07:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e4a97700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 0x7f52e00a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5a99700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 0x7f52e00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e5298700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f52dc00e930 tx=0x7f52dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012600 con 0x7f52e00a6740 2023-08-22T00:07:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc012760 con 0x7f52e00a6740 2023-08-22T00:07:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e00a6160 con 0x7f52e00a6740 2023-08-22T00:07:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012ae0 con 0x7f52e00a6740 2023-08-22T00:07:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.468+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e00c56a0 con 0x7f52e00a6740 2023-08-22T00:07:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.469+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e01458f0 con 0x7f52e00a6740 2023-08-22T00:07:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.470+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f52dc01b400 con 0x7f52e00a6740 2023-08-22T00:07:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.470+0000 7f52d57fa700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 0x7f52c4061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.470+0000 7f52e4a97700 1 -- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 msgr2=0x7f52c4061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.470+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f52dc07a400 con 0x7f52e00a6740 2023-08-22T00:07:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.470+0000 7f52e4a97700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 0x7f52c4061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:07:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.474+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52dc04b6b0 con 0x7f52e00a6740 2023-08-22T00:07:24.519 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:24.517+0000 7fbe95595680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:07:24.529 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:24.527+0000 7fb27b2de680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:07:24.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.643+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f52e0155d30 con 0x7f52e00a6740 2023-08-22T00:07:24.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.648+0000 7f52d57fa700 1 -- 172.21.15.98:0/2152866870 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52dc04ecd0 con 0x7f52e00a6740 2023-08-22T00:07:24.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.649+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 msgr2=0x7f52c4061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:07:24.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.649+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 0x7f52c4061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.649+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 msgr2=0x7f52e0145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.649+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f52dc00e930 tx=0x7f52dc009060).stop 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 shutdown_connections 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52e00a3dc0 0x7f52e00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52e00a6740 0x7f52e0145340 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f52c405ee60 0x7f52c4061320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 --2- 172.21.15.98:0/2152866870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52e0154e90 0x7f52e00a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 >> 172.21.15.98:0/2152866870 conn(0x7f52e00c7800 msgr2=0x7f52e014e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 shutdown_connections 2023-08-22T00:07:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.650+0000 7f52e74fc700 1 -- 172.21.15.98:0/2152866870 wait complete. 2023-08-22T00:07:24.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:24.663 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:07:24.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:24.689 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-08-22T00:07:24.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-08-22T00:07:24.790 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:24.789+0000 7fbe95595680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:07:24.822 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:24.820+0000 7fb27b2de680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:07:24.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.920+0000 7f45833e0700 1 Processor -- start 2023-08-22T00:07:24.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.920+0000 7f45833e0700 1 -- start start 2023-08-22T00:07:24.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f45833e0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f457c153c30 0x7f457c0a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f45833e0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c0c38d0 con 0x7f457c0c3360 2023-08-22T00:07:24.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f45833e0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c0c3bb0 con 0x7f457c154010 2023-08-22T00:07:24.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f45833e0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c0aad70 con 0x7f457c153c30 2023-08-22T00:07:24.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f458117c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f457c153c30 0x7f457c0a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f458197d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f457c0c3360 0x7f457c068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46688/0 (socket says 172.21.15.98:46688) 2023-08-22T00:07:24.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.921+0000 7f458197d700 1 -- 172.21.15.98:0/3041587663 learned_addr learned my addr 172.21.15.98:0/3041587663 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:24.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f458117c700 1 -- 172.21.15.98:0/3041587663 >> v1:172.21.15.118:6789/0 conn(0x7f457c154010 legacy=0x7f457c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f458117c700 1 -- 172.21.15.98:0/3041587663 >> v1:172.21.15.98:6789/0 conn(0x7f457c0c3360 legacy=0x7f457c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f458117c700 1 -- 172.21.15.98:0/3041587663 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0c3e90 con 0x7f457c153c30 2023-08-22T00:07:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f4573fff700 1 -- 172.21.15.98:0/3041587663 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666352990 0 0) 0x7f457c0c38d0 con 0x7f457c0c3360 2023-08-22T00:07:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f458117c700 1 --2- 172.21.15.98:0/3041587663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c153c30 0x7f457c0a8df0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f4578009760 tx=0x7f4578009060).ready entity=mon.0 client_cookie=5bfab6cb62045e45 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f4573fff700 1 -- 172.21.15.98:0/3041587663 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800b580 con 0x7f457c153c30 2023-08-22T00:07:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f4573fff700 1 -- 172.21.15.98:0/3041587663 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800b6e0 con 0x7f457c153c30 2023-08-22T00:07:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f4573fff700 1 -- 172.21.15.98:0/3041587663 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800ba60 con 0x7f457c153c30 2023-08-22T00:07:24.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f45833e0700 1 -- 172.21.15.98:0/3041587663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c153c30 msgr2=0x7f457c0a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.922+0000 7f45833e0700 1 --2- 172.21.15.98:0/3041587663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c153c30 0x7f457c0a8df0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f4578009760 tx=0x7f4578009060).stop 2023-08-22T00:07:24.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.923+0000 7f45833e0700 1 -- 172.21.15.98:0/3041587663 shutdown_connections 2023-08-22T00:07:24.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.923+0000 7f45833e0700 1 --2- 172.21.15.98:0/3041587663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c153c30 0x7f457c0a8df0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.923+0000 7f45833e0700 1 -- 172.21.15.98:0/3041587663 >> 172.21.15.98:0/3041587663 conn(0x7f457c0c5dd0 msgr2=0x7f457c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:24.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.923+0000 7f45833e0700 1 -- 172.21.15.98:0/3041587663 shutdown_connections 2023-08-22T00:07:24.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.923+0000 7f45833e0700 1 -- 172.21.15.98:0/3041587663 wait complete. 2023-08-22T00:07:24.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.924+0000 7f45833e0700 1 Processor -- start 2023-08-22T00:07:24.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.924+0000 7f45833e0700 1 -- start start 2023-08-22T00:07:24.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f457c153c30 0x7f457c0c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f457c154010 0x7f457c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c08c0 con 0x7f457c0c3360 2023-08-22T00:07:24.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0bfcf0 con 0x7f457c153c30 2023-08-22T00:07:24.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45833e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0bff90 con 0x7f457c154010 2023-08-22T00:07:24.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56740/0 (socket says 172.21.15.98:56740) 2023-08-22T00:07:24.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 -- 172.21.15.98:0/1613776656 learned_addr learned my addr 172.21.15.98:0/1613776656 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:24.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458197d700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f457c154010 0x7f457c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f457c153c30 0x7f457c0c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:24.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f457c154010 msgr2=0x7f457c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f457c154010 0x7f457c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f457c153c30 msgr2=0x7f457c0c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:24.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f457c153c30 0x7f457c0c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:24.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780092a0 con 0x7f457c0c3360 2023-08-22T00:07:24.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f458117c700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4578009eb0 tx=0x7f4578017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:24.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.925+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800b850 con 0x7f457c0c3360 2023-08-22T00:07:24.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.926+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800b9b0 con 0x7f457c0c3360 2023-08-22T00:07:24.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.926+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c0c0270 con 0x7f457c0c3360 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.926+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457801b640 con 0x7f457c0c3360 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.926+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c159380 con 0x7f457c0c3360 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.927+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c0c0710 con 0x7f457c0c3360 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.927+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f457801ba70 con 0x7f457c0c3360 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.927+0000 7f45717fa700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.927+0000 7f458097b700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.928+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f457807bb00 con 0x7f457c0c3360 2023-08-22T00:07:24.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.928+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:07:24.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:24.932+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f457804ce10 con 0x7f457c0c3360 2023-08-22T00:07:25.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:25.126+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f457c0c0a00 con 0x7f456005ee60 2023-08-22T00:07:25.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:25.129+0000 7f458097b700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:25.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:25.129+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:07:25.398 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:25.394+0000 7fbe95595680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:07:25.445 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:25.443+0000 7fb27b2de680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:07:25.466 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:25.465+0000 7fbe95595680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:07:25.516 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:25.514+0000 7fb27b2de680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:07:25.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:25.530+0000 7f458097b700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:25.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:25.530+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:07:25.651 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:25.650+0000 7fbe95595680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:07:25.701 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:25.699+0000 7fb27b2de680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:07:26.068 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.067+0000 7fbe95595680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:07:26.119 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.115+0000 7fb27b2de680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:07:26.171 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.170+0000 7fbe95595680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:07:26.221 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.218+0000 7fb27b2de680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:07:26.320 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.319+0000 7fbe95595680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:07:26.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:26.331+0000 7f458097b700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:26.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:26.331+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:07:26.373 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.371+0000 7fb27b2de680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:07:26.402 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.393+0000 7fbe95595680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:07:26.446 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.444+0000 7fb27b2de680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:07:26.460 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.459+0000 7fbe95595680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:07:26.521 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.511+0000 7fb27b2de680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:07:26.712 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.711+0000 7fbe95595680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:07:26.767 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.763+0000 7fb27b2de680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:07:26.892 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:26.891+0000 7fbe95595680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:07:26.947 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:26.945+0000 7fb27b2de680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:07:27.536 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.532+0000 7fbe95595680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:07:27.591 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:27.590+0000 7fb27b2de680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:07:27.600 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.600+0000 7fbe95595680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:07:27.659 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:27.658+0000 7fb27b2de680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:07:27.673 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.672+0000 7fbe95595680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:07:27.733 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:27.732+0000 7fb27b2de680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:07:27.816 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.815+0000 7fbe95595680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:07:27.882 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:27.877+0000 7fb27b2de680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:07:27.886 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.884+0000 7fbe95595680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:07:27.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:27.932+0000 7f458097b700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:07:27.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:27.932+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:07:27.948 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:27.946+0000 7fb27b2de680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:07:27.999 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:27.997+0000 7fbe95595680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:07:28.060 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.059+0000 7fb27b2de680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:07:28.104 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:28.103+0000 7fbe95595680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:07:28.168 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.165+0000 7fb27b2de680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:07:28.389 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:28.389+0000 7fbe95595680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:07:28.456 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.454+0000 7fb27b2de680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:07:28.459 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:07:28.458+0000 7fbe95595680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:07:28.526 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.525+0000 7fb27b2de680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:07:28.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:28.527+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 6) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f457801bd20 con 0x7f457c0c3360 2023-08-22T00:07:28.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:28.544+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 7) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f4578079af0 con 0x7f457c0c3360 2023-08-22T00:07:28.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:28.544+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f4560061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:07:28.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:28.544+0000 7f45717fa700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f4560061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:28.608 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f5587700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f5587700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f5587700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f5587700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f5587700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f7d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.610 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f7d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.610 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f7d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.610 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f7d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:28.610 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:07:28.607+0000 7fb1f7d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:07:29.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.547+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f4578075f80 con 0x7f457c0c3360 2023-08-22T00:07:29.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.548+0000 7f45717fa700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f45600612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.548+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f456002eea0 con 0x7f456005ee60 2023-08-22T00:07:29.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.548+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f45600612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.551+0000 7f458097b700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f45600612a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f457c0c8660 tx=0x7f456c007d40).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:29.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.579+0000 7f45717fa700 1 -- 172.21.15.98:0/1613776656 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f456002eea0 con 0x7f456005ee60 2023-08-22T00:07:29.585 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir0 2023-08-22T00:07:29.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.581+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 msgr2=0x7f45600612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.581+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f45600612a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f457c0c8660 tx=0x7f456c007d40).stop 2023-08-22T00:07:29.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.581+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 msgr2=0x7f457c0c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.581+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4578009eb0 tx=0x7f4578017000).stop 2023-08-22T00:07:29.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.581+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 shutdown_connections 2023-08-22T00:07:29.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f456005ee60 0x7f45600612a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f457c154010 0x7f457c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f457c0c3360 0x7f457c0c0d50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 --2- 172.21.15.98:0/1613776656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f457c153c30 0x7f457c0c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 >> 172.21.15.98:0/1613776656 conn(0x7f457c0c5dd0 msgr2=0x7f457c0c4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:29.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 shutdown_connections 2023-08-22T00:07:29.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.582+0000 7f45833e0700 1 -- 172.21.15.98:0/1613776656 wait complete. 2023-08-22T00:07:29.599 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-08-22T00:07:29.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:29.600 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-08-22T00:07:29.665 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-08-22T00:07:29.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.830+0000 7ff5132bd700 1 Processor -- start 2023-08-22T00:07:29.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.830+0000 7ff5132bd700 1 -- start start 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff5132bd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff50c064a60 0x7ff50c065530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff5132bd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0aa190 con 0x7ff50c151100 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff5132bd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0bdfe0 con 0x7ff50c151bf0 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff5132bd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0645d0 con 0x7ff50c064a60 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff511059700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff50c151100 0x7ff50c1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46702/0 (socket says 172.21.15.98:46702) 2023-08-22T00:07:29.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff51185a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff50c064a60 0x7ff50c065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff511059700 1 -- 172.21.15.98:0/3107942308 learned_addr learned my addr 172.21.15.98:0/3107942308 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff51185a700 1 -- 172.21.15.98:0/3107942308 >> v1:172.21.15.118:6789/0 conn(0x7ff50c151bf0 legacy=0x7ff50c0bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff51185a700 1 -- 172.21.15.98:0/3107942308 >> v1:172.21.15.98:6789/0 conn(0x7ff50c151100 legacy=0x7ff50c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff503fff700 1 -- 172.21.15.98:0/3107942308 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058588405 0 0) 0x7ff50c0aa190 con 0x7ff50c151100 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff51185a700 1 -- 172.21.15.98:0/3107942308 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c065a20 con 0x7ff50c064a60 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff51185a700 1 --2- 172.21.15.98:0/3107942308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c065530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7ff504009e60 tx=0x7ff504009780).ready entity=mon.0 client_cookie=82a64921db7f99bd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff503fff700 1 -- 172.21.15.98:0/3107942308 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400e070 con 0x7ff50c064a60 2023-08-22T00:07:29.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff503fff700 1 -- 172.21.15.98:0/3107942308 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400bbf0 con 0x7ff50c064a60 2023-08-22T00:07:29.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.831+0000 7ff503fff700 1 -- 172.21.15.98:0/3107942308 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504012410 con 0x7ff50c064a60 2023-08-22T00:07:29.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 -- 172.21.15.98:0/3107942308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 msgr2=0x7ff50c065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 --2- 172.21.15.98:0/3107942308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c065530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7ff504009e60 tx=0x7ff504009780).stop 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 -- 172.21.15.98:0/3107942308 shutdown_connections 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 --2- 172.21.15.98:0/3107942308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c065530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 -- 172.21.15.98:0/3107942308 >> 172.21.15.98:0/3107942308 conn(0x7ff50c06a910 msgr2=0x7ff50c065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 -- 172.21.15.98:0/3107942308 shutdown_connections 2023-08-22T00:07:29.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.832+0000 7ff5132bd700 1 -- 172.21.15.98:0/3107942308 wait complete. 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.833+0000 7ff5132bd700 1 Processor -- start 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.833+0000 7ff5132bd700 1 -- start start 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff50c151100 0x7ff50c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff50c151bf0 0x7ff50c161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0be8f0 con 0x7ff50c064a60 2023-08-22T00:07:29.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c161b80 con 0x7ff50c151bf0 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff5132bd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c154bb0 con 0x7ff50c151100 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56856/0 (socket says 172.21.15.98:56856) 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 -- 172.21.15.98:0/4246635835 learned_addr learned my addr 172.21.15.98:0/4246635835 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff510858700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff50c151100 0x7ff50c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff51185a700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff50c151bf0 0x7ff50c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 -- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff50c151100 msgr2=0x7ff50c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff50c151100 0x7ff50c15ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 -- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff50c151bf0 msgr2=0x7ff50c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff50c151bf0 0x7ff50c161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 -- 172.21.15.98:0/4246635835 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009a20 con 0x7ff50c064a60 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.834+0000 7ff511059700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff4fc00c4e0 tx=0x7ff4fc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:29.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.835+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0072e0 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.835+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc007440 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.835+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c154e90 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.835+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0057a0 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.835+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c160f20 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.836+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c0be730 con 0x7ff50c064a60 2023-08-22T00:07:29.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.836+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff4fc005bd0 con 0x7ff50c064a60 2023-08-22T00:07:29.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.836+0000 7ff5017fa700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 0x7ff4f0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:29.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.836+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7ff4fc079850 con 0x7ff50c064a60 2023-08-22T00:07:29.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.836+0000 7ff510858700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 0x7ff4f0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:29.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.837+0000 7ff510858700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 0x7ff4f0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff50c0bfec0 tx=0x7ff508008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:29.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:29.840+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff50c0be730 con 0x7ff50c064a60 2023-08-22T00:07:30.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.025+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff50c0bea30 con 0x7ff4f005ed40 2023-08-22T00:07:30.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.029+0000 7ff5017fa700 1 -- 172.21.15.98:0/4246635835 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff508013430 con 0x7ff4f005ed40 2023-08-22T00:07:30.031 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir1 2023-08-22T00:07:30.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 msgr2=0x7ff4f0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 0x7ff4f0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff50c0bfec0 tx=0x7ff508008040).stop 2023-08-22T00:07:30.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 msgr2=0x7ff50c1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff4fc00c4e0 tx=0x7ff4fc007c70).stop 2023-08-22T00:07:30.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 shutdown_connections 2023-08-22T00:07:30.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff50c151bf0 0x7ff50c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff50c064a60 0x7ff50c1545d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4f005ed40 0x7ff4f0061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 --2- 172.21.15.98:0/4246635835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff50c151100 0x7ff50c15ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 >> 172.21.15.98:0/4246635835 conn(0x7ff50c06a910 msgr2=0x7ff50c14f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 shutdown_connections 2023-08-22T00:07:30.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.031+0000 7ff5132bd700 1 -- 172.21.15.98:0/4246635835 wait complete. 2023-08-22T00:07:30.044 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-08-22T00:07:30.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:30.045 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-08-22T00:07:30.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-08-22T00:07:30.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.227+0000 7f944db34700 1 Processor -- start 2023-08-22T00:07:30.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 -- start start 2023-08-22T00:07:30.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 0x7f9448151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f94480c5550 0x7f9448065eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9448066a20 con 0x7f94480c59d0 2023-08-22T00:07:30.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9448066d00 con 0x7f94480c5550 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.228+0000 7f944db34700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480c4a70 con 0x7f94481518e0 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f94480c5550 0x7f9448065eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9447fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f94480c59d0 0x7f9448063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55238/0 (socket says 172.21.15.98:55238) 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9447fff700 1 -- 172.21.15.98:0/2291495213 learned_addr learned my addr 172.21.15.98:0/2291495213 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94477fe700 1 --2- 172.21.15.98:0/2291495213 >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 0x7f9448151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 -- 172.21.15.98:0/2291495213 >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 msgr2=0x7f9448151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:30.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 --2- 172.21.15.98:0/2291495213 >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 0x7f9448151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94467fc700 1 -- 172.21.15.98:0/2291495213 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387450581 0 0) 0x7f9448066a20 con 0x7f94480c59d0 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 -- 172.21.15.98:0/2291495213 >> v1:172.21.15.98:6789/0 conn(0x7f94480c59d0 legacy=0x7f9448063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 -- 172.21.15.98:0/2291495213 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480c4d50 con 0x7f94480c5550 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94477fe700 1 --2- 172.21.15.98:0/2291495213 >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 0x7f9448151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f9446ffd700 1 --2- 172.21.15.98:0/2291495213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94480c5550 0x7f9448065eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f944806ad70 tx=0x7f9438009060).ready entity=mon.0 client_cookie=31e34874b9c7874b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94467fc700 1 -- 172.21.15.98:0/2291495213 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800b580 con 0x7f94480c5550 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94467fc700 1 -- 172.21.15.98:0/2291495213 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b6e0 con 0x7f94480c5550 2023-08-22T00:07:30.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.229+0000 7f94467fc700 1 -- 172.21.15.98:0/2291495213 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800ba60 con 0x7f94480c5550 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 -- 172.21.15.98:0/2291495213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94480c5550 msgr2=0x7f9448065eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 --2- 172.21.15.98:0/2291495213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94480c5550 0x7f9448065eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f944806ad70 tx=0x7f9438009060).stop 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 -- 172.21.15.98:0/2291495213 shutdown_connections 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 --2- 172.21.15.98:0/2291495213 >> v2:172.21.15.118:3300/0 conn(0x7f94481518e0 0x7f9448151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 --2- 172.21.15.98:0/2291495213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94480c5550 0x7f9448065eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 -- 172.21.15.98:0/2291495213 >> 172.21.15.98:0/2291495213 conn(0x7f94480c4470 msgr2=0x7f94480695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:30.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 -- 172.21.15.98:0/2291495213 shutdown_connections 2023-08-22T00:07:30.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.230+0000 7f944db34700 1 -- 172.21.15.98:0/2291495213 wait complete. 2023-08-22T00:07:30.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.231+0000 7f944db34700 1 Processor -- start 2023-08-22T00:07:30.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.231+0000 7f944db34700 1 -- start start 2023-08-22T00:07:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 0x7f944814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 0x7f94480c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ac020 con 0x7f94481518e0 2023-08-22T00:07:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ab410 con 0x7f94480c5550 2023-08-22T00:07:30.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ab6f0 con 0x7f94480c59d0 2023-08-22T00:07:30.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46534/0 (socket says 172.21.15.98:46534) 2023-08-22T00:07:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 -- 172.21.15.98:0/2466957888 learned_addr learned my addr 172.21.15.98:0/2466957888 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f94477fe700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 0x7f944814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9446ffd700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 0x7f94480c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 -- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 msgr2=0x7f94480c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 0x7f94480c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 -- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 msgr2=0x7f944814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 0x7f944814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 -- 172.21.15.98:0/2466957888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380092a0 con 0x7f94481518e0 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f94477fe700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 0x7f944814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9446ffd700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 0x7f94480c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f9447fff700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f944000c7e0 tx=0x7f9440007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440005d30 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440005e90 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480ab9d0 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440007320 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.232+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94480ab0e0 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.233+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94480ac1d0 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.234+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f9440007710 con 0x7f94481518e0 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.234+0000 7f942f7fe700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 0x7f9434061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.234+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f9440079e70 con 0x7f94481518e0 2023-08-22T00:07:30.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.234+0000 7f94477fe700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 0x7f9434061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.234+0000 7f94477fe700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 0x7f9434061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f943c006d80 tx=0x7f943c008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.238+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94480ac1d0 con 0x7f94481518e0 2023-08-22T00:07:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.425+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9448047480 con 0x7f943405ed40 2023-08-22T00:07:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.429+0000 7f942f7fe700 1 -- 172.21.15.98:0/2466957888 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9448047480 con 0x7f943405ed40 2023-08-22T00:07:30.434 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir2 2023-08-22T00:07:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.430+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 msgr2=0x7f9434061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.430+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 0x7f9434061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f943c006d80 tx=0x7f943c008040).stop 2023-08-22T00:07:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 msgr2=0x7f9448062c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f944000c7e0 tx=0x7f9440007f90).stop 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 shutdown_connections 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94481518e0 0x7f9448062c10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94480c5550 0x7f944814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f943405ed40 0x7f9434061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 --2- 172.21.15.98:0/2466957888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94480c59d0 0x7f94480c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 >> 172.21.15.98:0/2466957888 conn(0x7f94480c4470 msgr2=0x7f94480c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 shutdown_connections 2023-08-22T00:07:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.431+0000 7f944db34700 1 -- 172.21.15.98:0/2466957888 wait complete. 2023-08-22T00:07:30.462 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-08-22T00:07:30.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:30.463 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-08-22T00:07:30.490 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-08-22T00:07:30.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 Processor -- start 2023-08-22T00:07:30.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 -- start start 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc414e360 0x7f3dc41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3dc40c5ce0 0x7f3dc4063e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3dc40675b0 0x7f3dc4067a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40c6160 con 0x7f3dc40675b0 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc4067f50 con 0x7f3dc40c5ce0 2023-08-22T00:07:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.650+0000 7f3dc9137700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c6580 con 0x7f3dc414e360 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3dc40675b0 0x7f3dc4067a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3dc40675b0 0x7f3dc4067a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46548/0 (socket says 172.21.15.98:46548) 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 -- 172.21.15.98:0/3815412401 learned_addr learned my addr 172.21.15.98:0/3815412401 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc259c700 1 --2- 172.21.15.98:0/3815412401 >> v2:172.21.15.118:3300/0 conn(0x7f3dc40c5ce0 0x7f3dc4063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc2d9d700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc414e360 0x7f3dc41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 -- 172.21.15.98:0/3815412401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc414e360 msgr2=0x7f3dc41541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc414e360 0x7f3dc41541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 -- 172.21.15.98:0/3815412401 >> v2:172.21.15.118:3300/0 conn(0x7f3dc40c5ce0 msgr2=0x7f3dc4063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 --2- 172.21.15.98:0/3815412401 >> v2:172.21.15.118:3300/0 conn(0x7f3dc40c5ce0 0x7f3dc4063e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 -- 172.21.15.98:0/3815412401 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc414e740 con 0x7f3dc40675b0 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc359e700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc40675b0 0x7f3dc4067a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3dc4062a90 tx=0x7f3dbc009840).ready entity=mon.0 client_cookie=c85ebe23e6b2c06d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc1d9b700 1 -- 172.21.15.98:0/3815412401 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00e070 con 0x7f3dc40675b0 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc1d9b700 1 -- 172.21.15.98:0/3815412401 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc00ba50 con 0x7f3dc40675b0 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.651+0000 7f3dc1d9b700 1 -- 172.21.15.98:0/3815412401 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00bdd0 con 0x7f3dc40675b0 2023-08-22T00:07:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 -- 172.21.15.98:0/3815412401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc40675b0 msgr2=0x7f3dc4067a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc40675b0 0x7f3dc4067a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3dc4062a90 tx=0x7f3dbc009840).stop 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 -- 172.21.15.98:0/3815412401 shutdown_connections 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc414e360 0x7f3dc41541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 --2- 172.21.15.98:0/3815412401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc40675b0 0x7f3dc4067a60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 --2- 172.21.15.98:0/3815412401 >> v2:172.21.15.118:3300/0 conn(0x7f3dc40c5ce0 0x7f3dc4063e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 -- 172.21.15.98:0/3815412401 >> 172.21.15.98:0/3815412401 conn(0x7f3dc4066a70 msgr2=0x7f3dc40c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 -- 172.21.15.98:0/3815412401 shutdown_connections 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.652+0000 7f3dc9137700 1 -- 172.21.15.98:0/3815412401 wait complete. 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.653+0000 7f3dc9137700 1 Processor -- start 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.653+0000 7f3dc9137700 1 -- start start 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc40675b0 0x7f3dc40a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 0x7f3dc414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40a4ed0 con 0x7f3dc414e360 2023-08-22T00:07:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ab800 con 0x7f3dc40675b0 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ab520 con 0x7f3dc40c5ce0 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46552/0 (socket says 172.21.15.98:46552) 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 -- 172.21.15.98:0/1306662163 learned_addr learned my addr 172.21.15.98:0/1306662163 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc2d9d700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc40675b0 0x7f3dc40a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc259c700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 0x7f3dc414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 -- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 msgr2=0x7f3dc414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 0x7f3dc414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 -- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc40675b0 msgr2=0x7f3dc40a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc40675b0 0x7f3dc40a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 -- 172.21.15.98:0/1306662163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009ae0 con 0x7f3dc414e360 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc259c700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 0x7f3dc414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc359e700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f3dbc009fd0 tx=0x7f3dbc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00bdd0 con 0x7f3dc414e360 2023-08-22T00:07:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0092e0 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc40a4880 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.654+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc01d6b0 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.655+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc414cc00 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.656+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40a5040 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.656+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f3dbc003040 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.657+0000 7f3dbaffd700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 0x7f3da4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.657+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f3dbc07b740 con 0x7f3dc414e360 2023-08-22T00:07:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.657+0000 7f3dc2d9d700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 0x7f3da4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.657+0000 7f3dc2d9d700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 0x7f3da4061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3db400bbc0 tx=0x7f3db4008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:30.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.660+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3dbc04cb70 con 0x7f3dc414e360 2023-08-22T00:07:30.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.843+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc40a4700 con 0x7f3da405ed40 2023-08-22T00:07:30.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.848+0000 7f3dbaffd700 1 -- 172.21.15.98:0/1306662163 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3db400b800 con 0x7f3da405ed40 2023-08-22T00:07:30.854 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir3 2023-08-22T00:07:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.849+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 msgr2=0x7f3da4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.849+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 0x7f3da4061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3db400bbc0 tx=0x7f3db4008040).stop 2023-08-22T00:07:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 msgr2=0x7f3dc4152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f3dbc009fd0 tx=0x7f3dbc009840).stop 2023-08-22T00:07:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 shutdown_connections 2023-08-22T00:07:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc414e360 0x7f3dc4152fb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc40675b0 0x7f3dc40a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3da405ed40 0x7f3da4061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 --2- 172.21.15.98:0/1306662163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc40c5ce0 0x7f3dc414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:30.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 >> 172.21.15.98:0/1306662163 conn(0x7f3dc4066a70 msgr2=0x7f3dc4155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:30.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 shutdown_connections 2023-08-22T00:07:30.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:30.850+0000 7f3dc9137700 1 -- 172.21.15.98:0/1306662163 wait complete. 2023-08-22T00:07:30.863 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-08-22T00:07:30.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:30.864 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-08-22T00:07:30.892 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-08-22T00:07:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.052+0000 7fb9cde84700 1 Processor -- start 2023-08-22T00:07:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.052+0000 7fb9cde84700 1 -- start start 2023-08-22T00:07:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9cde84700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9c80c5a30 0x7fb9c80a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9cde84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9cde84700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80a8b20 con 0x7fb9c8153d40 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9cde84700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80c4630 con 0x7fb9c80c5a30 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9cde84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80a9330 con 0x7fb9c80c2e80 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9c80c5a30 0x7fb9c80a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9c80c5a30 0x7fb9c80a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53290/0 (socket says 172.21.15.98:53290) 2023-08-22T00:07:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/2330764880 learned_addr learned my addr 172.21.15.98:0/2330764880 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c77fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb9c8153d40 0x7fb9c80aab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:36636/0 (socket says 172.21.15.98:36636) 2023-08-22T00:07:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 msgr2=0x7fb9c80c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 --2- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/2330764880 >> v1:172.21.15.118:6789/0 conn(0x7fb9c8153d40 legacy=0x7fb9c80aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/2330764880 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80c61a0 con 0x7fb9c80c5a30 2023-08-22T00:07:31.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c67fc700 1 -- 172.21.15.98:0/2330764880 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297824725 0 0) 0x7fb9c80a8b20 con 0x7fb9c8153d40 2023-08-22T00:07:31.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.053+0000 7fb9c6ffd700 1 --2- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80c5a30 0x7fb9c80a8e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb9b8006fd0 tx=0x7fb9b80090f0).ready entity=mon.1 client_cookie=2d0124db9831ab69 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9c67fc700 1 -- 172.21.15.98:0/2330764880 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800b580 con 0x7fb9c80c5a30 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9c67fc700 1 -- 172.21.15.98:0/2330764880 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800b6e0 con 0x7fb9c80c5a30 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9c67fc700 1 -- 172.21.15.98:0/2330764880 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800ba60 con 0x7fb9c80c5a30 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 -- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80c5a30 msgr2=0x7fb9c80a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 --2- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80c5a30 0x7fb9c80a8e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb9b8006fd0 tx=0x7fb9b80090f0).stop 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 -- 172.21.15.98:0/2330764880 shutdown_connections 2023-08-22T00:07:31.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 --2- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 --2- 172.21.15.98:0/2330764880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80c5a30 0x7fb9c80a8e40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 -- 172.21.15.98:0/2330764880 >> 172.21.15.98:0/2330764880 conn(0x7fb9c80c9320 msgr2=0x7fb9c80c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:31.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 -- 172.21.15.98:0/2330764880 shutdown_connections 2023-08-22T00:07:31.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.054+0000 7fb9cde84700 1 -- 172.21.15.98:0/2330764880 wait complete. 2023-08-22T00:07:31.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.055+0000 7fb9cde84700 1 Processor -- start 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.055+0000 7fb9cde84700 1 -- start start 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80a7560 0x7fb9c80abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80a3d20 con 0x7fb9c8153d40 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80a5fd0 con 0x7fb9c80a7560 2023-08-22T00:07:31.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9cde84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80a62b0 con 0x7fb9c80c2e80 2023-08-22T00:07:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9c6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9c77fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9c6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46560/0 (socket says 172.21.15.98:46560) 2023-08-22T00:07:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/1817741812 learned_addr learned my addr 172.21.15.98:0/1817741812 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.056+0000 7fb9c7fff700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80a7560 0x7fb9c80abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 msgr2=0x7fb9c80a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80a7560 msgr2=0x7fb9c80abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80a7560 0x7fb9c80abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 -- 172.21.15.98:0/1817741812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8009370 con 0x7fb9c8153d40 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9c6ffd700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fb9c80630b0 tx=0x7fb9b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8000bc0 con 0x7fb9c8153d40 2023-08-22T00:07:31.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800b850 con 0x7fb9c8153d40 2023-08-22T00:07:31.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c80a6590 con 0x7fb9c8153d40 2023-08-22T00:07:31.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8000d20 con 0x7fb9c8153d40 2023-08-22T00:07:31.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.057+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80a6b50 con 0x7fb9c8153d40 2023-08-22T00:07:31.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.058+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c80a6d70 con 0x7fb9c8153d40 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.058+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fb9b801cad0 con 0x7fb9c8153d40 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.058+0000 7fb9af7fe700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 0x7fb9b4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.059+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fb9b807bbd0 con 0x7fb9c8153d40 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.059+0000 7fb9c77fe700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 0x7fb9b4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.059+0000 7fb9c77fe700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 0x7fb9b4061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb9bc007fd0 tx=0x7fb9bc007d70).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.063+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9b804cfa0 con 0x7fb9c8153d40 2023-08-22T00:07:31.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.246+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9c8047480 con 0x7fb9b405ed40 2023-08-22T00:07:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.249+0000 7fb9af7fe700 1 -- 172.21.15.98:0/1817741812 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb9c8047480 con 0x7fb9b405ed40 2023-08-22T00:07:31.252 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir4 2023-08-22T00:07:31.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 msgr2=0x7fb9b4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 0x7fb9b4061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb9bc007fd0 tx=0x7fb9bc007d70).stop 2023-08-22T00:07:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 msgr2=0x7fb9c80a7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fb9c80630b0 tx=0x7fb9b8017000).stop 2023-08-22T00:07:31.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 shutdown_connections 2023-08-22T00:07:31.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9b405ed40 0x7fb9b4061200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9c80c2e80 0x7fb9c80a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c80a7560 0x7fb9c80abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 --2- 172.21.15.98:0/1817741812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c8153d40 0x7fb9c80a7070 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 >> 172.21.15.98:0/1817741812 conn(0x7fb9c80c9320 msgr2=0x7fb9c8152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 shutdown_connections 2023-08-22T00:07:31.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.251+0000 7fb9cde84700 1 -- 172.21.15.98:0/1817741812 wait complete. 2023-08-22T00:07:31.269 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-08-22T00:07:31.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:31.271 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-08-22T00:07:31.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-08-22T00:07:31.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.457+0000 7f46eac93700 1 Processor -- start 2023-08-22T00:07:31.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.457+0000 7f46eac93700 1 -- start start 2023-08-22T00:07:31.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.458+0000 7f46eac93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46e414e360 0x7f46e41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.458+0000 7f46eac93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.458+0000 7f46eac93700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40c6580 con 0x7f46e40c5ce0 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.458+0000 7f46eac93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e40c6190 con 0x7f46e414e360 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.458+0000 7f46eac93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40645a0 con 0x7f46e40675b0 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46e414e360 0x7f46e41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e9230700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e3fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f46e40c5ce0 0x7f46e4063e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:36638/0 (socket says 172.21.15.98:36638) 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46e414e360 0x7f46e41541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53316/0 (socket says 172.21.15.98:53316) 2023-08-22T00:07:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e9230700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:34840/0 (socket says 172.21.15.98:34840) 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e3fff700 1 -- 172.21.15.98:0/872080798 learned_addr learned my addr 172.21.15.98:0/872080798 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 -- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 msgr2=0x7f46e4067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 -- 172.21.15.98:0/872080798 >> v1:172.21.15.118:6789/0 conn(0x7f46e40c5ce0 legacy=0x7f46e4063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e37fe700 1 -- 172.21.15.98:0/872080798 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040836787 0 0) 0x7f46e40c6580 con 0x7f46e40c5ce0 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 -- 172.21.15.98:0/872080798 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4067f30 con 0x7f46e414e360 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e9230700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:31.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e8a2f700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e41541d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f46d8009760 tx=0x7f46d8009060).ready entity=mon.1 client_cookie=57148e4a30c2a0f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e37fe700 1 -- 172.21.15.98:0/872080798 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800f510 con 0x7f46e414e360 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e37fe700 1 -- 172.21.15.98:0/872080798 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800f670 con 0x7f46e414e360 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.459+0000 7f46e37fe700 1 -- 172.21.15.98:0/872080798 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800f9f0 con 0x7f46e414e360 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 -- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 msgr2=0x7f46e41541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e41541d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f46d8009760 tx=0x7f46d8009060).stop 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 -- 172.21.15.98:0/872080798 shutdown_connections 2023-08-22T00:07:31.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e4067a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 --2- 172.21.15.98:0/872080798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e41541d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 -- 172.21.15.98:0/872080798 >> 172.21.15.98:0/872080798 conn(0x7f46e4066a70 msgr2=0x7f46e40c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 -- 172.21.15.98:0/872080798 shutdown_connections 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.460+0000 7f46eac93700 1 -- 172.21.15.98:0/872080798 wait complete. 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.461+0000 7f46eac93700 1 Processor -- start 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.461+0000 7f46eac93700 1 -- start start 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e40a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e40a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4164330 con 0x7f46e40c5ce0 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4164610 con 0x7f46e414e360 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46eac93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e41648f0 con 0x7f46e40675b0 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46568/0 (socket says 172.21.15.98:46568) 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 -- 172.21.15.98:0/1807496289 learned_addr learned my addr 172.21.15.98:0/1807496289 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:31.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e9230700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e40a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e8a2f700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e40a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 -- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 msgr2=0x7f46e40a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e40a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 -- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 msgr2=0x7f46e40a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e40a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 -- 172.21.15.98:0/1807496289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009a20 con 0x7f46e40c5ce0 2023-08-22T00:07:31.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.462+0000 7f46e3fff700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f46d000c4e0 tx=0x7f46d0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.463+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d00072e0 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.463+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0007440 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.463+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d80092a0 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.463+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d00057a0 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.463+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e40a6650 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.464+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e4158750 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.464+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f46d0005bd0 con 0x7f46e40c5ce0 2023-08-22T00:07:31.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.464+0000 7f46e0ff9700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 0x7f46c80611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.464+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f46d00796a0 con 0x7f46e40c5ce0 2023-08-22T00:07:31.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.464+0000 7f46e8a2f700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 0x7f46c80611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.465+0000 7f46e8a2f700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 0x7f46c80611d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f46e4130820 tx=0x7f46d8017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.469+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46e4158750 con 0x7f46e40c5ce0 2023-08-22T00:07:31.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.561+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f46d0077430 con 0x7f46e40c5ce0 2023-08-22T00:07:31.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.657+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e4158750 con 0x7f46c805ed10 2023-08-22T00:07:31.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.661+0000 7f46e0ff9700 1 -- 172.21.15.98:0/1807496289 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f46e4158750 con 0x7f46c805ed10 2023-08-22T00:07:31.663 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir5 2023-08-22T00:07:31.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 msgr2=0x7f46c80611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 0x7f46c80611d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f46e4130820 tx=0x7f46d8017000).stop 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 msgr2=0x7f46e413c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f46d000c4e0 tx=0x7f46d0007c70).stop 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 shutdown_connections 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f46c805ed10 0x7f46c80611d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e40675b0 0x7f46e40a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46e414e360 0x7f46e40a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 --2- 172.21.15.98:0/1807496289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e40c5ce0 0x7f46e413c200 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 >> 172.21.15.98:0/1807496289 conn(0x7f46e4066a70 msgr2=0x7f46e4063e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:31.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 shutdown_connections 2023-08-22T00:07:31.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.663+0000 7f46eac93700 1 -- 172.21.15.98:0/1807496289 wait complete. 2023-08-22T00:07:31.678 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-08-22T00:07:31.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:31.679 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-08-22T00:07:31.704 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-08-22T00:07:31.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.875+0000 7f4f02e53700 1 Processor -- start 2023-08-22T00:07:31.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.875+0000 7f4f02e53700 1 -- start start 2023-08-22T00:07:31.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f02e53700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4efc0c1610 0x7f4efc0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f02e53700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0c7f60 con 0x7f4efc0c1230 2023-08-22T00:07:31.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f02e53700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc157dd0 con 0x7f4efc158260 2023-08-22T00:07:31.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f02e53700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc155610 con 0x7f4efc0c1610 2023-08-22T00:07:31.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f00bef700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4efc0c1230 0x7f4efc154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55250/0 (socket says 172.21.15.98:55250) 2023-08-22T00:07:31.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.876+0000 7f4f00bef700 1 -- 172.21.15.98:0/705182563 learned_addr learned my addr 172.21.15.98:0/705182563 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:31.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349297387 0 0) 0x7f4efc0c7f60 con 0x7f4efc0c1230 2023-08-22T00:07:31.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eec0033f0 con 0x7f4efc0c1230 2023-08-22T00:07:31.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efbfff700 1 --2- 172.21.15.98:0/705182563 >> v2:172.21.15.118:3300/0 conn(0x7f4efc0c1610 0x7f4efc0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208493100 0 0) 0x7f4eec0033f0 con 0x7f4efc0c1230 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 >> v2:172.21.15.118:3300/0 conn(0x7f4efc0c1610 msgr2=0x7f4efc0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 --2- 172.21.15.98:0/705182563 >> v2:172.21.15.118:3300/0 conn(0x7f4efc0c1610 0x7f4efc0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 >> v1:172.21.15.118:6789/0 conn(0x7f4efc158260 legacy=0x7f4efc0c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc154d70 con 0x7f4efc0c1230 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4ef0001470 con 0x7f4efc0c1230 2023-08-22T00:07:31.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 >> v1:172.21.15.98:6789/0 conn(0x7f4efc0c1230 legacy=0x7f4efc154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 0x7f4eec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec004690 0x7f4eec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec005000 0x7f4eec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc155610 con 0x7f4eec0038e0 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec00beb0 con 0x7f4eec004690 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec00c070 con 0x7f4eec005000 2023-08-22T00:07:31.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 0x7f4eec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4efbfff700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec004690 0x7f4eec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f013f0700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec005000 0x7f4eec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 -- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec005000 msgr2=0x7f4eec00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:31.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec005000 0x7f4eec00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 -- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec004690 msgr2=0x7f4eec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec004690 0x7f4eec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f00bef700 1 -- 172.21.15.98:0/705182563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0033f0 con 0x7f4eec0038e0 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.877+0000 7f4f013f0700 1 -- 172.21.15.98:0/705182563 reap_dead start 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f00bef700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 0x7f4eec003d00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f4ef000c190 tx=0x7f4ef0001e50).ready entity=mon.0 client_cookie=c60773c58e68e335 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0007a20 con 0x7f4eec0038e0 2023-08-22T00:07:31.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000ca80 con 0x7f4eec0038e0 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4efb7fe700 1 -- 172.21.15.98:0/705182563 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000ce00 con 0x7f4eec0038e0 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 -- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 msgr2=0x7f4eec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 0x7f4eec003d00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f4ef000c190 tx=0x7f4ef0001e50).stop 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 -- 172.21.15.98:0/705182563 shutdown_connections 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 --2- 172.21.15.98:0/705182563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eec0038e0 0x7f4eec003d00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 -- 172.21.15.98:0/705182563 >> 172.21.15.98:0/705182563 conn(0x7f4efc0645e0 msgr2=0x7f4efc0649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:31.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 -- 172.21.15.98:0/705182563 shutdown_connections 2023-08-22T00:07:31.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.878+0000 7f4f02e53700 1 -- 172.21.15.98:0/705182563 wait complete. 2023-08-22T00:07:31.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.879+0000 7f4f02e53700 1 Processor -- start 2023-08-22T00:07:31.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 -- start start 2023-08-22T00:07:31.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec0038e0 0x7f4efc1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 0x7f4efc0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0c6170 con 0x7f4efc1440c0 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0adb60 con 0x7f4eec0038e0 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f02e53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0ade40 con 0x7f4efc146ea0 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.880+0000 7f4f013f0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46574/0 (socket says 172.21.15.98:46574) 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 -- 172.21.15.98:0/3506992427 learned_addr learned my addr 172.21.15.98:0/3506992427 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:31.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f00bef700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec0038e0 0x7f4efc1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4efbfff700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 0x7f4efc0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 -- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 msgr2=0x7f4efc0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 0x7f4efc0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 -- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec0038e0 msgr2=0x7f4efc1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec0038e0 0x7f4efc1469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 -- 172.21.15.98:0/3506992427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0ae120 con 0x7f4efc1440c0 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4efbfff700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 0x7f4efc0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:31.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f013f0700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4efc065640 tx=0x7f4ef4007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400c580 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef400c700 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc0ae400 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400cac0 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.881+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc0aec50 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.882+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc047480 con 0x7f4efc1440c0 2023-08-22T00:07:31.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.882+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f4ef40133e0 con 0x7f4efc1440c0 2023-08-22T00:07:31.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.883+0000 7f4ef8ff9700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 0x7f4ee00614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:31.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.883+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f4ef4079d40 con 0x7f4efc1440c0 2023-08-22T00:07:31.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.883+0000 7f4f00bef700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 0x7f4ee00614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:31.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.883+0000 7f4f00bef700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 0x7f4ee00614a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ef0001ed0 tx=0x7f4ef0015000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:31.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:31.887+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ef404ad40 con 0x7f4efc1440c0 2023-08-22T00:07:32.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.071+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4efc0aa360 con 0x7f4ee005efe0 2023-08-22T00:07:32.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.075+0000 7f4ef8ff9700 1 -- 172.21.15.98:0/3506992427 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4efc0aa360 con 0x7f4ee005efe0 2023-08-22T00:07:32.079 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir6 2023-08-22T00:07:32.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 msgr2=0x7f4ee00614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 0x7f4ee00614a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ef0001ed0 tx=0x7f4ef0015000).stop 2023-08-22T00:07:32.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 msgr2=0x7f4efc0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4efc065640 tx=0x7f4ef4007f30).stop 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 shutdown_connections 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.077+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4efc1440c0 0x7f4efc0c5c80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec0038e0 0x7f4efc1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ee005efe0 0x7f4ee00614a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 --2- 172.21.15.98:0/3506992427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4efc146ea0 0x7f4efc0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 >> 172.21.15.98:0/3506992427 conn(0x7f4efc0645e0 msgr2=0x7f4efc0c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:32.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 shutdown_connections 2023-08-22T00:07:32.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.078+0000 7f4f02e53700 1 -- 172.21.15.98:0/3506992427 wait complete. 2023-08-22T00:07:32.091 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-08-22T00:07:32.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:32.092 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-08-22T00:07:32.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-08-22T00:07:32.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.277+0000 7f565d77a700 1 Processor -- start 2023-08-22T00:07:32.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.277+0000 7f565d77a700 1 -- start start 2023-08-22T00:07:32.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f565d77a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 0x7f56580c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f565d77a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f565d77a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5658155360 con 0x7f5658157fe0 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f565d77a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5658157b50 con 0x7f5658153ae0 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f565d77a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c6390 con 0x7f56580bfd80 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f56567fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.278+0000 7f5656ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 0x7f56580c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:34878/0 (socket says 172.21.15.98:34878) 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 -- 172.21.15.98:0/471512024 learned_addr learned my addr 172.21.15.98:0/471512024 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 -- 172.21.15.98:0/471512024 >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 msgr2=0x7f56580c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 --2- 172.21.15.98:0/471512024 >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 0x7f56580c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 -- 172.21.15.98:0/471512024 >> v1:172.21.15.118:6789/0 conn(0x7f5658157fe0 legacy=0x7f56580645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 -- 172.21.15.98:0/471512024 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658154ac0 con 0x7f56580bfd80 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f5656ffd700 1 --2- 172.21.15.98:0/471512024 >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 0x7f56580c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:32.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f56567fc700 1 --2- 172.21.15.98:0/471512024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5648006fd0 tx=0x7f56480090f0).ready entity=mon.2 client_cookie=19b13ae49e5e9134 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f5655ffb700 1 -- 172.21.15.98:0/471512024 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800b580 con 0x7f56580bfd80 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f5655ffb700 1 -- 172.21.15.98:0/471512024 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800b6e0 con 0x7f56580bfd80 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.279+0000 7f5655ffb700 1 -- 172.21.15.98:0/471512024 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800ba60 con 0x7f56580bfd80 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 -- 172.21.15.98:0/471512024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 msgr2=0x7f56580c0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 --2- 172.21.15.98:0/471512024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5648006fd0 tx=0x7f56480090f0).stop 2023-08-22T00:07:32.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 -- 172.21.15.98:0/471512024 shutdown_connections 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 --2- 172.21.15.98:0/471512024 >> v2:172.21.15.118:3300/0 conn(0x7f5658153ae0 0x7f56580c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 --2- 172.21.15.98:0/471512024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580c0200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 -- 172.21.15.98:0/471512024 >> 172.21.15.98:0/471512024 conn(0x7f56580caa50 msgr2=0x7f56580cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 -- 172.21.15.98:0/471512024 shutdown_connections 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.280+0000 7f565d77a700 1 -- 172.21.15.98:0/471512024 wait complete. 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.281+0000 7f565d77a700 1 Processor -- start 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 -- start start 2023-08-22T00:07:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5658157fe0 0x7f565814d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581561f0 con 0x7f5658153ae0 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658152740 con 0x7f5658157fe0 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.282+0000 7f565d77a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56581569c0 con 0x7f56580bfd80 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46584/0 (socket says 172.21.15.98:46584) 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 -- 172.21.15.98:0/2700029083 learned_addr learned my addr 172.21.15.98:0/2700029083 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f5656ffd700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56577fe700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5658157fe0 0x7f565814d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 -- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 msgr2=0x7f56580a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 -- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5658157fe0 msgr2=0x7f565814d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5658157fe0 0x7f565814d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 -- 172.21.15.98:0/2700029083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0092a0 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f56567fc700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f5648009ea0 tx=0x7f5648017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648000bc0 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800b850 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5648009370 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648000d20 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.283+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56581566e0 con 0x7f5658153ae0 2023-08-22T00:07:32.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.284+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658047480 con 0x7f5658153ae0 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.285+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f564801b8b0 con 0x7f5658153ae0 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.285+0000 7f563effd700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 0x7f56440614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.285+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f564807b920 con 0x7f5658153ae0 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.285+0000 7f5656ffd700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 0x7f56440614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.285+0000 7f5656ffd700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 0x7f56440614d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f564c009da0 tx=0x7f564c009060).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.289+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f564804c980 con 0x7f5658153ae0 2023-08-22T00:07:32.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.474+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f56580bfb60 con 0x7f564405f010 2023-08-22T00:07:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.478+0000 7f563effd700 1 -- 172.21.15.98:0/2700029083 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f56580bfb60 con 0x7f564405f010 2023-08-22T00:07:32.492 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir7 2023-08-22T00:07:32.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 msgr2=0x7f56440614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 0x7f56440614d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f564c009da0 tx=0x7f564c009060).stop 2023-08-22T00:07:32.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 msgr2=0x7f56580ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f5648009ea0 tx=0x7f5648017000).stop 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 shutdown_connections 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f564405f010 0x7f56440614d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56580bfd80 0x7f56580a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5658157fe0 0x7f565814d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 --2- 172.21.15.98:0/2700029083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5658153ae0 0x7f56580ada00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 >> 172.21.15.98:0/2700029083 conn(0x7f56580caa50 msgr2=0x7f56580c0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 shutdown_connections 2023-08-22T00:07:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.480+0000 7f565d77a700 1 -- 172.21.15.98:0/2700029083 wait complete. 2023-08-22T00:07:32.498 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-08-22T00:07:32.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:32.499 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-08-22T00:07:32.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-08-22T00:07:32.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 Processor -- start 2023-08-22T00:07:32.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 -- start start 2023-08-22T00:07:32.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b0068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 0x7f18b0066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f18b00673e0 0x7f18b00be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00a86f0 con 0x7f18b00673e0 2023-08-22T00:07:32.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00a8c70 con 0x7f18b0069210 2023-08-22T00:07:32.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.688+0000 7f18b5b0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0068210 con 0x7f18b0154f60 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f18b00673e0 0x7f18b00be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f18b00673e0 0x7f18b00be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46590/0 (socket says 172.21.15.98:46590) 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 -- 172.21.15.98:0/2436637640 learned_addr learned my addr 172.21.15.98:0/2436637640 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18aeffd700 1 --2- 172.21.15.98:0/2436637640 >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 0x7f18b0066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18af7fe700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b0068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 -- 172.21.15.98:0/2436637640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 msgr2=0x7f18b0068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b0068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 -- 172.21.15.98:0/2436637640 >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 msgr2=0x7f18b0066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 --2- 172.21.15.98:0/2436637640 >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 0x7f18b0066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 -- 172.21.15.98:0/2436637640 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0069690 con 0x7f18b00673e0 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18aeffd700 1 --2- 172.21.15.98:0/2436637640 >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 0x7f18b0066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18affff700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b00673e0 0x7f18b00be7d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f18b006a770 tx=0x7f18a8009840).ready entity=mon.0 client_cookie=abd3d66091f216d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18ae7fc700 1 -- 172.21.15.98:0/2436637640 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800e070 con 0x7f18b00673e0 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18ae7fc700 1 -- 172.21.15.98:0/2436637640 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800ba50 con 0x7f18b00673e0 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.689+0000 7f18ae7fc700 1 -- 172.21.15.98:0/2436637640 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800bdd0 con 0x7f18b00673e0 2023-08-22T00:07:32.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 -- 172.21.15.98:0/2436637640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b00673e0 msgr2=0x7f18b00be7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b00673e0 0x7f18b00be7d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f18b006a770 tx=0x7f18a8009840).stop 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 -- 172.21.15.98:0/2436637640 shutdown_connections 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b0068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/2436637640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b00673e0 0x7f18b00be7d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/2436637640 >> v2:172.21.15.118:3300/0 conn(0x7f18b0069210 0x7f18b0066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 -- 172.21.15.98:0/2436637640 >> 172.21.15.98:0/2436637640 conn(0x7f18b00c5dd0 msgr2=0x7f18b0068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:32.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 -- 172.21.15.98:0/2436637640 shutdown_connections 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.690+0000 7f18b5b0b700 1 -- 172.21.15.98:0/2436637640 wait complete. 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.691+0000 7f18b5b0b700 1 Processor -- start 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.691+0000 7f18b5b0b700 1 -- start start 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 0x7f18b00ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00ac9c0 con 0x7f18b0069210 2023-08-22T00:07:32.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00abdb0 con 0x7f18b00673e0 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00ac090 con 0x7f18b0154f60 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46594/0 (socket says 172.21.15.98:46594) 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 -- 172.21.15.98:0/3673626300 learned_addr learned my addr 172.21.15.98:0/3673626300 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18af7fe700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 0x7f18b00ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18affff700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 -- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 msgr2=0x7f18b00c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b00c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 -- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 msgr2=0x7f18b00ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 0x7f18b00ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 -- 172.21.15.98:0/3673626300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009ae0 con 0x7f18b0069210 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18af7fe700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 0x7f18b00ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18affff700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18aeffd700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f18a000d860 tx=0x7f18a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011590 con 0x7f18b0069210 2023-08-22T00:07:32.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00116f0 con 0x7f18b0069210 2023-08-22T00:07:32.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011a70 con 0x7f18b0069210 2023-08-22T00:07:32.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.692+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b00ac370 con 0x7f18b0069210 2023-08-22T00:07:32.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.693+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b00ad340 con 0x7f18b0069210 2023-08-22T00:07:32.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.694+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0047480 con 0x7f18b0069210 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.694+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f18a001c460 con 0x7f18b0069210 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.694+0000 7f18a77fe700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 0x7f18900614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.694+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f18a007a170 con 0x7f18b0069210 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.694+0000 7f18af7fe700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 0x7f18900614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.695+0000 7f18af7fe700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 0x7f18900614d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1898006fd0 tx=0x7f1898008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:32.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.698+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18a004b170 con 0x7f18b0069210 2023-08-22T00:07:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.884+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18b00c3aa0 con 0x7f189005f010 2023-08-22T00:07:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.889+0000 7f18a77fe700 1 -- 172.21.15.98:0/3673626300 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f18b00c3aa0 con 0x7f189005f010 2023-08-22T00:07:32.895 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir8 2023-08-22T00:07:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 msgr2=0x7f18900614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 0x7f18900614d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1898006fd0 tx=0x7f1898008040).stop 2023-08-22T00:07:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 msgr2=0x7f18b00ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f18a000d860 tx=0x7f18a0008040).stop 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 shutdown_connections 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f189005f010 0x7f18900614d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18b0154f60 0x7f18b00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b00673e0 0x7f18b00ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 --2- 172.21.15.98:0/3673626300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18b0069210 0x7f18b00ace50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 >> 172.21.15.98:0/3673626300 conn(0x7f18b00c5dd0 msgr2=0x7f18b00beb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 shutdown_connections 2023-08-22T00:07:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:32.890+0000 7f18b5b0b700 1 -- 172.21.15.98:0/3673626300 wait complete. 2023-08-22T00:07:32.904 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-08-22T00:07:32.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:07:32.906 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-08-22T00:07:32.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-08-22T00:07:33.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.093+0000 7f2dcc060700 1 Processor -- start 2023-08-22T00:07:33.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.093+0000 7f2dcc060700 1 -- start start 2023-08-22T00:07:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.094+0000 7f2dcc060700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 0x7f2dc40c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.094+0000 7f2dcc060700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.094+0000 7f2dcc060700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc4157dd0 con 0x7f2dc4158260 2023-08-22T00:07:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.094+0000 7f2dcc060700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc4155610 con 0x7f2dc40c7a70 2023-08-22T00:07:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.094+0000 7f2dcc060700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c7ef0 con 0x7f2dc40c1230 2023-08-22T00:07:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 0x7f2dc40c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc95fb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc95fb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53398/0 (socket says 172.21.15.98:53398) 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc95fb700 1 -- 172.21.15.98:0/1616164934 learned_addr learned my addr 172.21.15.98:0/1616164934 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/1616164934 >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 msgr2=0x7f2dc4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 --2- 172.21.15.98:0/1616164934 >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/1616164934 >> v1:172.21.15.118:6789/0 conn(0x7f2dc4158260 legacy=0x7f2dc40c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/1616164934 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4154d70 con 0x7f2dc40c1230 2023-08-22T00:07:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc95fb700 1 --2- 172.21.15.98:0/1616164934 >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc9dfc700 1 --2- 172.21.15.98:0/1616164934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 0x7f2dc40c1610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2db4009760 tx=0x7f2db4009060).ready entity=mon.2 client_cookie=e48003040e8fa7ad server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc8dfa700 1 -- 172.21.15.98:0/1616164934 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400f510 con 0x7f2dc40c1230 2023-08-22T00:07:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc8dfa700 1 -- 172.21.15.98:0/1616164934 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db400f670 con 0x7f2dc40c1230 2023-08-22T00:07:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.095+0000 7f2dc8dfa700 1 -- 172.21.15.98:0/1616164934 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400f9f0 con 0x7f2dc40c1230 2023-08-22T00:07:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 -- 172.21.15.98:0/1616164934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 msgr2=0x7f2dc40c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 --2- 172.21.15.98:0/1616164934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 0x7f2dc40c1610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2db4009760 tx=0x7f2db4009060).stop 2023-08-22T00:07:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 -- 172.21.15.98:0/1616164934 shutdown_connections 2023-08-22T00:07:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 --2- 172.21.15.98:0/1616164934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc40c1230 0x7f2dc40c1610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 --2- 172.21.15.98:0/1616164934 >> v2:172.21.15.118:3300/0 conn(0x7f2dc40c7a70 0x7f2dc4154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 -- 172.21.15.98:0/1616164934 >> 172.21.15.98:0/1616164934 conn(0x7f2dc40645e0 msgr2=0x7f2dc40649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 -- 172.21.15.98:0/1616164934 shutdown_connections 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.096+0000 7f2dcc060700 1 -- 172.21.15.98:0/1616164934 wait complete. 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.097+0000 7f2dcc060700 1 Processor -- start 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.097+0000 7f2dcc060700 1 -- start start 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 0x7f2dc4151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc4158260 0x7f2dc40c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c46a0 con 0x7f2dc40c1230 2023-08-22T00:07:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c3110 con 0x7f2dc40c7a70 2023-08-22T00:07:33.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dcc060700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c33f0 con 0x7f2dc4158260 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46608/0 (socket says 172.21.15.98:46608) 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/4026395937 learned_addr learned my addr 172.21.15.98:0/4026395937 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dca5fd700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc4158260 0x7f2dc40c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc95fb700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 0x7f2dc4151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc4158260 msgr2=0x7f2dc40c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc4158260 0x7f2dc40c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 msgr2=0x7f2dc4151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 0x7f2dc4151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 -- 172.21.15.98:0/4026395937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009370 con 0x7f2dc40c1230 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc95fb700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 0x7f2dc4151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.098+0000 7f2dc9dfc700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2dc40c81b0 tx=0x7f2db4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.099+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400f7e0 con 0x7f2dc40c1230 2023-08-22T00:07:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.099+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db400f940 con 0x7f2dc40c1230 2023-08-22T00:07:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.099+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db40092a0 con 0x7f2dc40c1230 2023-08-22T00:07:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.099+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db401b660 con 0x7f2dc40c1230 2023-08-22T00:07:33.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.099+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40c39b0 con 0x7f2dc40c1230 2023-08-22T00:07:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.100+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc4047480 con 0x7f2dc40c1230 2023-08-22T00:07:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.100+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f2db401ba10 con 0x7f2dc40c1230 2023-08-22T00:07:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.100+0000 7f2db9ffb700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 0x7f2da80614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.100+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f2db407bde0 con 0x7f2dc40c1230 2023-08-22T00:07:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.101+0000 7f2dc95fb700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 0x7f2da80614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.101+0000 7f2dc95fb700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 0x7f2da80614d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2dc40a19b0 tx=0x7f2dc0008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.105+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2db404ce40 con 0x7f2dc40c1230 2023-08-22T00:07:33.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.290+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc40c3fc0 con 0x7f2da805f010 2023-08-22T00:07:33.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.294+0000 7f2db9ffb700 1 -- 172.21.15.98:0/4026395937 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2dc40c3fc0 con 0x7f2da805f010 2023-08-22T00:07:33.296 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/dir9 2023-08-22T00:07:33.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 msgr2=0x7f2da80614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 0x7f2da80614d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2dc40a19b0 tx=0x7f2dc0008040).stop 2023-08-22T00:07:33.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 msgr2=0x7f2dc40c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2dc40c81b0 tx=0x7f2db4017000).stop 2023-08-22T00:07:33.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 shutdown_connections 2023-08-22T00:07:33.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2da805f010 0x7f2da80614d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dc4158260 0x7f2dc40c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc40c1230 0x7f2dc40c2b30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 --2- 172.21.15.98:0/4026395937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dc40c7a70 0x7f2dc4151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 >> 172.21.15.98:0/4026395937 conn(0x7f2dc40645e0 msgr2=0x7f2dc40c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 shutdown_connections 2023-08-22T00:07:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.296+0000 7f2dcc060700 1 -- 172.21.15.98:0/4026395937 wait complete. 2023-08-22T00:07:33.310 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-08-22T00:07:33.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-22T00:07:33.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.435+0000 7f0b08c0d700 1 Processor -- start 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.435+0000 7f0b08c0d700 1 -- start start 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b04064610 0x7f0b041555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b040649f0 0x7f0b040c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0b040c3d80 0x7f0b040675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040c2cd0 con 0x7f0b040c3d80 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b04151ff0 con 0x7f0b040649f0 2023-08-22T00:07:33.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b08c0d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040c2150 con 0x7f0b04064610 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0b040c3d80 0x7f0b040675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0b040c3d80 0x7f0b040675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46618/0 (socket says 172.21.15.98:46618) 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 -- 172.21.15.98:0/4183982826 learned_addr learned my addr 172.21.15.98:0/4183982826 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b0259c700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b04064610 0x7f0b041555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b01d9b700 1 --2- 172.21.15.98:0/4183982826 >> v2:172.21.15.118:3300/0 conn(0x7f0b040649f0 0x7f0b040c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 -- 172.21.15.98:0/4183982826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b04064610 msgr2=0x7f0b041555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b04064610 0x7f0b041555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 -- 172.21.15.98:0/4183982826 >> v2:172.21.15.118:3300/0 conn(0x7f0b040649f0 msgr2=0x7f0b040c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:33.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/4183982826 >> v2:172.21.15.118:3300/0 conn(0x7f0b040649f0 0x7f0b040c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 -- 172.21.15.98:0/4183982826 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040c2430 con 0x7f0b040c3d80 2023-08-22T00:07:33.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.436+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b040675b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f0b04069930 tx=0x7f0afc009840).ready entity=mon.0 client_cookie=cbac270af7c14b96 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b0159a700 1 -- 172.21.15.98:0/4183982826 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00e070 con 0x7f0b040c3d80 2023-08-22T00:07:33.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b0159a700 1 -- 172.21.15.98:0/4183982826 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc00ba50 con 0x7f0b040c3d80 2023-08-22T00:07:33.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b0159a700 1 -- 172.21.15.98:0/4183982826 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00bdd0 con 0x7f0b040c3d80 2023-08-22T00:07:33.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 -- 172.21.15.98:0/4183982826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 msgr2=0x7f0b040675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b040675b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f0b04069930 tx=0x7f0afc009840).stop 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 -- 172.21.15.98:0/4183982826 shutdown_connections 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b04064610 0x7f0b041555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/4183982826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b040675b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/4183982826 >> v2:172.21.15.118:3300/0 conn(0x7f0b040649f0 0x7f0b040c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 -- 172.21.15.98:0/4183982826 >> 172.21.15.98:0/4183982826 conn(0x7f0b04066a70 msgr2=0x7f0b040c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 -- 172.21.15.98:0/4183982826 shutdown_connections 2023-08-22T00:07:33.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.437+0000 7f0b08c0d700 1 -- 172.21.15.98:0/4183982826 wait complete. 2023-08-22T00:07:33.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.438+0000 7f0b08c0d700 1 Processor -- start 2023-08-22T00:07:33.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.438+0000 7f0b08c0d700 1 -- start start 2023-08-22T00:07:33.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04064610 0x7f0b04156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b040649f0 0x7f0b04156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040ac500 con 0x7f0b040c3d80 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040ac7e0 con 0x7f0b04064610 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b08c0d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040acac0 con 0x7f0b040649f0 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b01d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b040649f0 0x7f0b04156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46628/0 (socket says 172.21.15.98:46628) 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b0259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04064610 0x7f0b04156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 -- 172.21.15.98:0/67430310 learned_addr learned my addr 172.21.15.98:0/67430310 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 -- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b040649f0 msgr2=0x7f0b04156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b040649f0 0x7f0b04156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 -- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04064610 msgr2=0x7f0b04156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.439+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04064610 0x7f0b04156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0b02d9d700 1 -- 172.21.15.98:0/67430310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc009ae0 con 0x7f0b040c3d80 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0b02d9d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f0b04062af0 tx=0x7f0afc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc013e60 con 0x7f0b040c3d80 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc0092e0 con 0x7f0b040c3d80 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b040acda0 con 0x7f0b040c3d80 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc007860 con 0x7f0b040c3d80 2023-08-22T00:07:33.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.440+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b040ac2a0 con 0x7f0b040c3d80 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.441+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b04155f60 con 0x7f0b040c3d80 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.441+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f0afc003040 con 0x7f0b040c3d80 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.442+0000 7f0af27fc700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 0x7f0ae40614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.442+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f0afc07bfb0 con 0x7f0b040c3d80 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.442+0000 7f0b0259c700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 0x7f0ae40614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.442+0000 7f0b0259c700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 0x7f0ae40614d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0af400bb10 tx=0x7f0af4008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.446+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0afc04cf00 con 0x7f0b040c3d80 2023-08-22T00:07:33.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.633+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b04157530 con 0x7f0ae405f010 2023-08-22T00:07:33.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.638+0000 7f0af27fc700 1 -- 172.21.15.98:0/67430310 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0b04157530 con 0x7f0ae405f010 2023-08-22T00:07:33.640 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-08-22T00:07:33.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 msgr2=0x7f0ae40614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 0x7f0ae40614d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0af400bb10 tx=0x7f0af4008040).stop 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 msgr2=0x7f0b04156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f0b04062af0 tx=0x7f0afc009840).stop 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 shutdown_connections 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b040c3d80 0x7f0b04156c20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04064610 0x7f0b04156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0ae405f010 0x7f0ae40614d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 --2- 172.21.15.98:0/67430310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b040649f0 0x7f0b04156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 >> 172.21.15.98:0/67430310 conn(0x7f0b04066a70 msgr2=0x7f0b04062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 shutdown_connections 2023-08-22T00:07:33.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.640+0000 7f0b08c0d700 1 -- 172.21.15.98:0/67430310 wait complete. 2023-08-22T00:07:33.653 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-08-22T00:07:33.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-22T00:07:33.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.774+0000 7f214a9a1700 1 Processor -- start 2023-08-22T00:07:33.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.774+0000 7f214a9a1700 1 -- start start 2023-08-22T00:07:33.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f214a9a1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21440645b0 0x7f2144150940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f214a9a1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2144150e30 0x7f21440669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f214a9a1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21441505b0 con 0x7f21440c33e0 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f214a9a1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21440c37c0 con 0x7f2144150e30 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f214a9a1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21441516b0 con 0x7f21440645b0 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2144150e30 0x7f21440669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2143fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f21440c33e0 0x7f2144063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55258/0 (socket says 172.21.15.98:55258) 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2143fff700 1 -- 172.21.15.98:0/2792629792 learned_addr learned my addr 172.21.15.98:0/2792629792 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:33.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 --2- 172.21.15.98:0/2792629792 >> v2:172.21.15.98:3300/0 conn(0x7f2144150e30 0x7f21440669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46634/0 (socket says 172.21.15.98:46634) 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f21437fe700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21440645b0 0x7f2144150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 -- 172.21.15.98:0/2792629792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21440645b0 msgr2=0x7f2144150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21440645b0 0x7f2144150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 -- 172.21.15.98:0/2792629792 >> v1:172.21.15.98:6789/0 conn(0x7f21440c33e0 legacy=0x7f2144063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 -- 172.21.15.98:0/2792629792 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144153dd0 con 0x7f2144150e30 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2142ffd700 1 -- 172.21.15.98:0/2792629792 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894473784 0 0) 0x7f21441505b0 con 0x7f21440c33e0 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.775+0000 7f2148f3e700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2144150e30 0x7f21440669d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f213c009e60 tx=0x7f213c009780).ready entity=mon.0 client_cookie=170c59b9fb7f494 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f2142ffd700 1 -- 172.21.15.98:0/2792629792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00e070 con 0x7f2144150e30 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f2142ffd700 1 -- 172.21.15.98:0/2792629792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00bc30 con 0x7f2144150e30 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f2142ffd700 1 -- 172.21.15.98:0/2792629792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c012410 con 0x7f2144150e30 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 -- 172.21.15.98:0/2792629792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2144150e30 msgr2=0x7f21440669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2144150e30 0x7f21440669d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f213c009e60 tx=0x7f213c009780).stop 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 -- 172.21.15.98:0/2792629792 shutdown_connections 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2144150e30 0x7f21440669d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 --2- 172.21.15.98:0/2792629792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21440645b0 0x7f2144150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 -- 172.21.15.98:0/2792629792 >> 172.21.15.98:0/2792629792 conn(0x7f21440c4470 msgr2=0x7f21440695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 -- 172.21.15.98:0/2792629792 shutdown_connections 2023-08-22T00:07:33.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.776+0000 7f214a9a1700 1 -- 172.21.15.98:0/2792629792 wait complete. 2023-08-22T00:07:33.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.777+0000 7f214a9a1700 1 Processor -- start 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 -- start start 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21440645b0 0x7f21440942b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2144150e30 0x7f2144152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440a80f0 con 0x7f21440c33e0 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440a83d0 con 0x7f21440645b0 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f214a9a1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440a86b0 con 0x7f2144150e30 2023-08-22T00:07:33.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f21437fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f21437fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46644/0 (socket says 172.21.15.98:46644) 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.778+0000 7f21437fe700 1 -- 172.21.15.98:0/1001524895 learned_addr learned my addr 172.21.15.98:0/1001524895 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f2148f3e700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2144150e30 0x7f2144152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f2143fff700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21440645b0 0x7f21440942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 -- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2144150e30 msgr2=0x7f2144152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2144150e30 0x7f2144152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 -- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21440645b0 msgr2=0x7f21440942b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21440645b0 0x7f21440942b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 -- 172.21.15.98:0/1001524895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c009a20 con 0x7f21440c33e0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f21437fe700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f213400d860 tx=0x7f2134008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134011590 con 0x7f21440c33e0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21340116f0 con 0x7f21440c33e0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440a8990 con 0x7f21440c33e0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134011a70 con 0x7f21440c33e0 2023-08-22T00:07:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.779+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440a9680 con 0x7f21440c33e0 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.780+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2144047480 con 0x7f21440c33e0 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.780+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f2134012420 con 0x7f21440c33e0 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.781+0000 7f212bfff700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 0x7f21300614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.781+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f2134079c80 con 0x7f21440c33e0 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.781+0000 7f2143fff700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 0x7f21300614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:33.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.781+0000 7f2143fff700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 0x7f21300614d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f21380011e0 tx=0x7f2138007b90).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:33.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.785+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f213404ac80 con 0x7f21440c33e0 2023-08-22T00:07:33.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.971+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21440c2460 con 0x7f213005f010 2023-08-22T00:07:33.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.975+0000 7f212bfff700 1 -- 172.21.15.98:0/1001524895 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f21440c2460 con 0x7f213005f010 2023-08-22T00:07:33.978 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-08-22T00:07:33.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 msgr2=0x7f21300614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 0x7f21300614d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f21380011e0 tx=0x7f2138007b90).stop 2023-08-22T00:07:33.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 msgr2=0x7f21440a9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:33.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f213400d860 tx=0x7f2134008040).stop 2023-08-22T00:07:33.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 shutdown_connections 2023-08-22T00:07:33.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f213005f010 0x7f21300614d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2144150e30 0x7f2144152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21440645b0 0x7f21440942b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 --2- 172.21.15.98:0/1001524895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21440c33e0 0x7f21440a9190 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:33.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 >> 172.21.15.98:0/1001524895 conn(0x7f21440c4470 msgr2=0x7f2144066990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:33.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 shutdown_connections 2023-08-22T00:07:33.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:33.977+0000 7f214a9a1700 1 -- 172.21.15.98:0/1001524895 wait complete. 2023-08-22T00:07:33.994 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-08-22T00:07:33.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-22T00:07:34.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.117+0000 7f537fac7700 1 Processor -- start 2023-08-22T00:07:34.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.117+0000 7f537fac7700 1 -- start start 2023-08-22T00:07:34.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537fac7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f537814e360 0x7f53781541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537fac7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f53780c5ce0 0x7f5378063e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537fac7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53780c6580 con 0x7f53780675b0 2023-08-22T00:07:34.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537fac7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53780c6160 con 0x7f53780c5ce0 2023-08-22T00:07:34.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537fac7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537814e740 con 0x7f537814e360 2023-08-22T00:07:34.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537d062700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f53780c5ce0 0x7f5378063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537e064700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f53780675b0 0x7f53780c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55262/0 (socket says 172.21.15.98:55262) 2023-08-22T00:07:34.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.118+0000 7f537e064700 1 -- 172.21.15.98:0/3890781725 learned_addr learned my addr 172.21.15.98:0/3890781725 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:07:34.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d863700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f537814e360 0x7f53781541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d062700 1 -- 172.21.15.98:0/3890781725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f537814e360 msgr2=0x7f53781541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:34.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d062700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f537814e360 0x7f53781541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d062700 1 -- 172.21.15.98:0/3890781725 >> v1:172.21.15.98:6789/0 conn(0x7f53780675b0 legacy=0x7f53780c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537c861700 1 -- 172.21.15.98:0/3890781725 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081478760 0 0) 0x7f53780c6580 con 0x7f53780675b0 2023-08-22T00:07:34.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d062700 1 -- 172.21.15.98:0/3890781725 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53780c3270 con 0x7f53780c5ce0 2023-08-22T00:07:34.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537d062700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780c5ce0 0x7f5378063e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5368009760 tx=0x7f5368009060).ready entity=mon.0 client_cookie=98cde56107e75952 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537c861700 1 -- 172.21.15.98:0/3890781725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800f510 con 0x7f53780c5ce0 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537c861700 1 -- 172.21.15.98:0/3890781725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800f670 con 0x7f53780c5ce0 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537c861700 1 -- 172.21.15.98:0/3890781725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800f9f0 con 0x7f53780c5ce0 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537fac7700 1 -- 172.21.15.98:0/3890781725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780c5ce0 msgr2=0x7f5378063e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537fac7700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780c5ce0 0x7f5378063e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5368009760 tx=0x7f5368009060).stop 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.119+0000 7f537fac7700 1 -- 172.21.15.98:0/3890781725 shutdown_connections 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.120+0000 7f537fac7700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f537814e360 0x7f53781541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.120+0000 7f537fac7700 1 --2- 172.21.15.98:0/3890781725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780c5ce0 0x7f5378063e90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.120+0000 7f537fac7700 1 -- 172.21.15.98:0/3890781725 >> 172.21.15.98:0/3890781725 conn(0x7f5378066a70 msgr2=0x7f53780c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.120+0000 7f537fac7700 1 -- 172.21.15.98:0/3890781725 shutdown_connections 2023-08-22T00:07:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.120+0000 7f537fac7700 1 -- 172.21.15.98:0/3890781725 wait complete. 2023-08-22T00:07:34.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 Processor -- start 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 -- start start 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53780c5ce0 0x7f537813aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f537814e360 0x7f5378065010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53780a6100 con 0x7f53780675b0 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378163d00 con 0x7f537814e360 2023-08-22T00:07:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.121+0000 7f537fac7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5378151080 con 0x7f53780c5ce0 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46672/0 (socket says 172.21.15.98:46672) 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 -- 172.21.15.98:0/1379449440 learned_addr learned my addr 172.21.15.98:0/1379449440 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 -- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53780c5ce0 msgr2=0x7f537813aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53780c5ce0 0x7f537813aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 -- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f537814e360 msgr2=0x7f5378065010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f537814e360 0x7f5378065010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 -- 172.21.15.98:0/1379449440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680092a0 con 0x7f53780675b0 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537d863700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f537400e900 tx=0x7f5374009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400c640 con 0x7f53780675b0 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400c7a0 con 0x7f53780675b0 2023-08-22T00:07:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400cb20 con 0x7f53780675b0 2023-08-22T00:07:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5378163fb0 con 0x7f53780675b0 2023-08-22T00:07:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.122+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5378164570 con 0x7f53780675b0 2023-08-22T00:07:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.123+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5378151350 con 0x7f53780675b0 2023-08-22T00:07:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.123+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f537401b400 con 0x7f53780675b0 2023-08-22T00:07:34.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.124+0000 7f536dffb700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 0x7f535c0614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.124+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f537407a760 con 0x7f53780675b0 2023-08-22T00:07:34.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.124+0000 7f537d062700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 0x7f535c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.124+0000 7f537d062700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 0x7f535c0614d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5368009760 tx=0x7f5368017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.128+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f537404b760 con 0x7f53780675b0 2023-08-22T00:07:34.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.314+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5378047480 con 0x7f535c05f010 2023-08-22T00:07:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.318+0000 7f536dffb700 1 -- 172.21.15.98:0/1379449440 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5378047480 con 0x7f535c05f010 2023-08-22T00:07:34.320 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-08-22T00:07:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 msgr2=0x7f535c0614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 0x7f535c0614d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5368009760 tx=0x7f5368017000).stop 2023-08-22T00:07:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 msgr2=0x7f5378150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f537400e900 tx=0x7f5374009060).stop 2023-08-22T00:07:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 shutdown_connections 2023-08-22T00:07:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f537814e360 0x7f5378065010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53780675b0 0x7f5378150b90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f535c05f010 0x7f535c0614d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 --2- 172.21.15.98:0/1379449440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53780c5ce0 0x7f537813aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:34.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 >> 172.21.15.98:0/1379449440 conn(0x7f5378066a70 msgr2=0x7f5378156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:34.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 shutdown_connections 2023-08-22T00:07:34.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.320+0000 7f537fac7700 1 -- 172.21.15.98:0/1379449440 wait complete. 2023-08-22T00:07:34.334 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-08-22T00:07:34.335 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-22T00:07:34.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.459+0000 7f3b9dec9700 1 Processor -- start 2023-08-22T00:07:34.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.459+0000 7f3b9dec9700 1 -- start start 2023-08-22T00:07:34.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b9dec9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b980645b0 0x7f3b98150940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b9dec9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b981505b0 con 0x7f3b980c33e0 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b9dec9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980c37c0 con 0x7f3b98150e30 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b9dec9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b981516b0 con 0x7f3b980645b0 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b96ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b980645b0 0x7f3b98150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b96ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b980645b0 0x7f3b98150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46684/0 (socket says 172.21.15.98:46684) 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b96ffd700 1 -- 172.21.15.98:0/1568430320 learned_addr learned my addr 172.21.15.98:0/1568430320 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.460+0000 7f3b977fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3b980c33e0 0x7f3b98063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55274/0 (socket says 172.21.15.98:55274) 2023-08-22T00:07:34.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b96ffd700 1 -- 172.21.15.98:0/1568430320 >> v1:172.21.15.118:6789/0 conn(0x7f3b98150e30 legacy=0x7f3b980669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b96ffd700 1 -- 172.21.15.98:0/1568430320 >> v1:172.21.15.98:6789/0 conn(0x7f3b980c33e0 legacy=0x7f3b98063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b967fc700 1 -- 172.21.15.98:0/1568430320 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667990893 0 0) 0x7f3b981505b0 con 0x7f3b980c33e0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b96ffd700 1 -- 172.21.15.98:0/1568430320 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98153dd0 con 0x7f3b980645b0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b96ffd700 1 --2- 172.21.15.98:0/1568430320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b980645b0 0x7f3b98150940 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3b80006fd0 tx=0x7f3b800090f0).ready entity=mon.0 client_cookie=f175b879097107ca server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b967fc700 1 -- 172.21.15.98:0/1568430320 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000b600 con 0x7f3b980645b0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b967fc700 1 -- 172.21.15.98:0/1568430320 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000b760 con 0x7f3b980645b0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b967fc700 1 -- 172.21.15.98:0/1568430320 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000bae0 con 0x7f3b980645b0 2023-08-22T00:07:34.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 -- 172.21.15.98:0/1568430320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b980645b0 msgr2=0x7f3b98150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/1568430320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b980645b0 0x7f3b98150940 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3b80006fd0 tx=0x7f3b800090f0).stop 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 -- 172.21.15.98:0/1568430320 shutdown_connections 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/1568430320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b980645b0 0x7f3b98150940 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 -- 172.21.15.98:0/1568430320 >> 172.21.15.98:0/1568430320 conn(0x7f3b980c4470 msgr2=0x7f3b980695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 -- 172.21.15.98:0/1568430320 shutdown_connections 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.461+0000 7f3b9dec9700 1 -- 172.21.15.98:0/1568430320 wait complete. 2023-08-22T00:07:34.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 Processor -- start 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 -- start start 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b980645b0 0x7f3b980aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b980c33e0 0x7f3b9814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980a7700 con 0x7f3b98150e30 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9814ef60 con 0x7f3b980645b0 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b9dec9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980abdd0 con 0x7f3b980c33e0 2023-08-22T00:07:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b97fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b97fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46696/0 (socket says 172.21.15.98:46696) 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.463+0000 7f3b97fff700 1 -- 172.21.15.98:0/3710864309 learned_addr learned my addr 172.21.15.98:0/3710864309 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b977fe700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b980645b0 0x7f3b980aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b96ffd700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b980c33e0 0x7f3b9814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 -- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b980c33e0 msgr2=0x7f3b9814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b980c33e0 0x7f3b9814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 -- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b980645b0 msgr2=0x7f3b980aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b980645b0 0x7f3b980aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 -- 172.21.15.98:0/3710864309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80009370 con 0x7f3b98150e30 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b97fff700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f3b9000c440 tx=0x7f3b90007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900123f0 con 0x7f3b98150e30 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90012550 con 0x7f3b98150e30 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980ac0a0 con 0x7f3b98150e30 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900128d0 con 0x7f3b98150e30 2023-08-22T00:07:34.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.464+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980ac660 con 0x7f3b98150e30 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.465+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b980a74d0 con 0x7f3b98150e30 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.465+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f3b90012cc0 con 0x7f3b98150e30 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.466+0000 7f3b8f7fe700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 0x7f3b780614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.466+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f3b90079780 con 0x7f3b98150e30 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.466+0000 7f3b977fe700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 0x7f3b780614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.466+0000 7f3b977fe700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 0x7f3b780614d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3b88001560 tx=0x7f3b88007f30).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.470+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b900478f0 con 0x7f3b98150e30 2023-08-22T00:07:34.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.660+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b980c6d50 con 0x7f3b7805f010 2023-08-22T00:07:34.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.664+0000 7f3b8f7fe700 1 -- 172.21.15.98:0/3710864309 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3b980c6d50 con 0x7f3b7805f010 2023-08-22T00:07:34.666 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-08-22T00:07:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 msgr2=0x7f3b780614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 0x7f3b780614d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3b88001560 tx=0x7f3b88007f30).stop 2023-08-22T00:07:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 msgr2=0x7f3b980ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f3b9000c440 tx=0x7f3b90007dd0).stop 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 shutdown_connections 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b98150e30 0x7f3b980ab8e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b980645b0 0x7f3b980aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3b7805f010 0x7f3b780614d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 --2- 172.21.15.98:0/3710864309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b980c33e0 0x7f3b9814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 >> 172.21.15.98:0/3710864309 conn(0x7f3b980c4470 msgr2=0x7f3b980bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 shutdown_connections 2023-08-22T00:07:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.667+0000 7f3b9dec9700 1 -- 172.21.15.98:0/3710864309 wait complete. 2023-08-22T00:07:34.680 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-08-22T00:07:34.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-22T00:07:34.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.799+0000 7fbe4fb97700 1 Processor -- start 2023-08-22T00:07:34.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.799+0000 7fbe4fb97700 1 -- start start 2023-08-22T00:07:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4fb97700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 0x7fbe480c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4fb97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4fb97700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe48062600 con 0x7fbe480a5910 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4fb97700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe48062f10 con 0x7fbe48154830 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4fb97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4814ac50 con 0x7fbe48153c80 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4e134700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4d132700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 0x7fbe480c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4e134700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:34980/0 (socket says 172.21.15.98:34980) 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4e134700 1 -- 172.21.15.98:0/3568736607 learned_addr learned my addr 172.21.15.98:0/3568736607 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.800+0000 7fbe4d933700 1 --1- 172.21.15.98:0/3568736607 >> v1:172.21.15.118:6789/0 conn(0x7fbe480a5910 0x7fbe480c4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:36678/0 (socket says 172.21.15.98:36678) 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4c931700 1 -- 172.21.15.98:0/3568736607 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836738121 0 0) 0x7fbe48062600 con 0x7fbe480a5910 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4c931700 1 -- 172.21.15.98:0/3568736607 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe340033f0 con 0x7fbe480a5910 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4e134700 1 -- 172.21.15.98:0/3568736607 >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 msgr2=0x7fbe480c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4e134700 1 --2- 172.21.15.98:0/3568736607 >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 0x7fbe480c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4e134700 1 -- 172.21.15.98:0/3568736607 >> v1:172.21.15.118:6789/0 conn(0x7fbe480a5910 legacy=0x7fbe480c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4e134700 1 -- 172.21.15.98:0/3568736607 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe481545e0 con 0x7fbe48153c80 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4d132700 1 --2- 172.21.15.98:0/3568736607 >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 0x7fbe480c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4e134700 1 --2- 172.21.15.98:0/3568736607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe40009f20 tx=0x7fbe40009840).ready entity=mon.2 client_cookie=80e4448f11134e17 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4c931700 1 -- 172.21.15.98:0/3568736607 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000e070 con 0x7fbe48153c80 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4c931700 1 -- 172.21.15.98:0/3568736607 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4000b970 con 0x7fbe48153c80 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4c931700 1 -- 172.21.15.98:0/3568736607 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000bcf0 con 0x7fbe48153c80 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4fb97700 1 -- 172.21.15.98:0/3568736607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 msgr2=0x7fbe481540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.801+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/3568736607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe40009f20 tx=0x7fbe40009840).stop 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 -- 172.21.15.98:0/3568736607 shutdown_connections 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/3568736607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe48153c80 0x7fbe481540f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/3568736607 >> v2:172.21.15.118:3300/0 conn(0x7fbe48154830 0x7fbe480c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 -- 172.21.15.98:0/3568736607 >> 172.21.15.98:0/3568736607 conn(0x7fbe480c7170 msgr2=0x7fbe480c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 -- 172.21.15.98:0/3568736607 shutdown_connections 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.802+0000 7fbe4fb97700 1 -- 172.21.15.98:0/3568736607 wait complete. 2023-08-22T00:07:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.803+0000 7fbe4fb97700 1 Processor -- start 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.803+0000 7fbe4fb97700 1 -- start start 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe480a5910 0x7fbe48140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe48154830 0x7fbe48143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481417a0 con 0x7fbe48153c80 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480be6d0 con 0x7fbe48154830 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4fb97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480bdac0 con 0x7fbe480a5910 2023-08-22T00:07:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4d132700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4d132700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46708/0 (socket says 172.21.15.98:46708) 2023-08-22T00:07:34.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4d132700 1 -- 172.21.15.98:0/2841550885 learned_addr learned my addr 172.21.15.98:0/2841550885 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:34.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4d933700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe480a5910 0x7fbe48140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.804+0000 7fbe4e134700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe48154830 0x7fbe48143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 -- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe480a5910 msgr2=0x7fbe48140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe480a5910 0x7fbe48140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 -- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe48154830 msgr2=0x7fbe48143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe48154830 0x7fbe48143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 -- 172.21.15.98:0/2841550885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440092a0 con 0x7fbe48153c80 2023-08-22T00:07:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4d132700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbe4400e980 tx=0x7fbe44009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44012600 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44012760 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40009ae0 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44012ae0 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.805+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480be080 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.806+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe480be860 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.807+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fbe44025480 con 0x7fbe48153c80 2023-08-22T00:07:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.807+0000 7fbe3dffb700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 0x7fbe2c061500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.807+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fbe4407ac10 con 0x7fbe48153c80 2023-08-22T00:07:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.807+0000 7fbe4d933700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 0x7fbe2c061500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.808+0000 7fbe4d933700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 0x7fbe2c061500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbe38007670 tx=0x7fbe38000bc0).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.811+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe4404bb90 con 0x7fbe48153c80 2023-08-22T00:07:34.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.995+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe480bc850 con 0x7fbe2c05f040 2023-08-22T00:07:35.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:34.999+0000 7fbe3dffb700 1 -- 172.21.15.98:0/2841550885 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbe480bc850 con 0x7fbe2c05f040 2023-08-22T00:07:35.001 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-08-22T00:07:35.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 msgr2=0x7fbe2c061500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 0x7fbe2c061500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbe38007670 tx=0x7fbe38000bc0).stop 2023-08-22T00:07:35.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 msgr2=0x7fbe481412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbe4400e980 tx=0x7fbe44009060).stop 2023-08-22T00:07:35.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 shutdown_connections 2023-08-22T00:07:35.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbe2c05f040 0x7fbe2c061500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe480a5910 0x7fbe48140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe48154830 0x7fbe48143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 --2- 172.21.15.98:0/2841550885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe48153c80 0x7fbe481412b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 >> 172.21.15.98:0/2841550885 conn(0x7fbe480c7170 msgr2=0x7fbe48143f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.001+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 shutdown_connections 2023-08-22T00:07:35.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.002+0000 7fbe4fb97700 1 -- 172.21.15.98:0/2841550885 wait complete. 2023-08-22T00:07:35.020 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-08-22T00:07:35.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-22T00:07:35.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.143+0000 7fc757d7c700 1 Processor -- start 2023-08-22T00:07:35.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.143+0000 7fc757d7c700 1 -- start start 2023-08-22T00:07:35.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc757d7c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc75014af10 0x7fc7500c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc757d7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7500bd7c0 0x7fc7500bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc757d7c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500c3ab0 con 0x7fc7500c4430 2023-08-22T00:07:35.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc757d7c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500be160 con 0x7fc75014af10 2023-08-22T00:07:35.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc757d7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500a9270 con 0x7fc7500bd7c0 2023-08-22T00:07:35.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc75014af10 0x7fc7500c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc75014af10 0x7fc7500c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46714/0 (socket says 172.21.15.98:46714) 2023-08-22T00:07:35.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 -- 172.21.15.98:0/1271907890 learned_addr learned my addr 172.21.15.98:0/1271907890 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 -- 172.21.15.98:0/1271907890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7500bd7c0 msgr2=0x7fc7500bdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:35.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 --2- 172.21.15.98:0/1271907890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7500bd7c0 0x7fc7500bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 -- 172.21.15.98:0/1271907890 >> v1:172.21.15.118:6789/0 conn(0x7fc7500c4430 legacy=0x7fc7500aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 -- 172.21.15.98:0/1271907890 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500a9550 con 0x7fc75014af10 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc755b18700 1 --2- 172.21.15.98:0/1271907890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc75014af10 0x7fc7500c3f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c0090f0).ready entity=mon.0 client_cookie=40e505aff41dbc64 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc754b16700 1 -- 172.21.15.98:0/1271907890 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00b600 con 0x7fc75014af10 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc754b16700 1 -- 172.21.15.98:0/1271907890 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00b760 con 0x7fc75014af10 2023-08-22T00:07:35.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.144+0000 7fc754b16700 1 -- 172.21.15.98:0/1271907890 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00bae0 con 0x7fc75014af10 2023-08-22T00:07:35.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 -- 172.21.15.98:0/1271907890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc75014af10 msgr2=0x7fc7500c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 --2- 172.21.15.98:0/1271907890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc75014af10 0x7fc7500c3f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c0090f0).stop 2023-08-22T00:07:35.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 -- 172.21.15.98:0/1271907890 shutdown_connections 2023-08-22T00:07:35.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 --2- 172.21.15.98:0/1271907890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7500bd7c0 0x7fc7500bdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:07:35.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 --2- 172.21.15.98:0/1271907890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc75014af10 0x7fc7500c3f40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 -- 172.21.15.98:0/1271907890 >> 172.21.15.98:0/1271907890 conn(0x7fc7500c5300 msgr2=0x7fc7500c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 -- 172.21.15.98:0/1271907890 shutdown_connections 2023-08-22T00:07:35.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.145+0000 7fc757d7c700 1 -- 172.21.15.98:0/1271907890 wait complete. 2023-08-22T00:07:35.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.146+0000 7fc757d7c700 1 Processor -- start 2023-08-22T00:07:35.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 -- start start 2023-08-22T00:07:35.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 0x7fc750167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc75014af10 0x7fc750164c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750168290 con 0x7fc7500c4430 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750168570 con 0x7fc7500bd7c0 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.147+0000 7fc757d7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc750168850 con 0x7fc75014af10 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46726/0 (socket says 172.21.15.98:46726) 2023-08-22T00:07:35.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 -- 172.21.15.98:0/960742039 learned_addr learned my addr 172.21.15.98:0/960742039 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755b18700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 0x7fc750167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 -- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc75014af10 msgr2=0x7fc750164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc756319700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc75014af10 0x7fc750164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc75014af10 0x7fc750164c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 -- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 msgr2=0x7fc750167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 0x7fc750167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 -- 172.21.15.98:0/960742039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c009370 con 0x7fc7500c4430 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755b18700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 0x7fc750167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:35.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc755317700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fc74000b490 tx=0x7fc740009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740012410 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7400125b0 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740012970 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc750164750 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.148+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc750167f50 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.149+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750168a10 con 0x7fc7500c4430 2023-08-22T00:07:35.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.149+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fc740012d20 con 0x7fc7500c4430 2023-08-22T00:07:35.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.150+0000 7fc745ffb700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 0x7fc7340614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.150+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fc74007a130 con 0x7fc7500c4430 2023-08-22T00:07:35.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.150+0000 7fc755b18700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 0x7fc7340614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.150+0000 7fc755b18700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 0x7fc7340614d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.154+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc74004b190 con 0x7fc7500c4430 2023-08-22T00:07:35.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.340+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7500681c0 con 0x7fc73405f010 2023-08-22T00:07:35.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.344+0000 7fc745ffb700 1 -- 172.21.15.98:0/960742039 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc7500681c0 con 0x7fc73405f010 2023-08-22T00:07:35.346 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-08-22T00:07:35.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 msgr2=0x7fc7340614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 0x7fc7340614d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c017000).stop 2023-08-22T00:07:35.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 msgr2=0x7fc750149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fc74000b490 tx=0x7fc740009060).stop 2023-08-22T00:07:35.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 shutdown_connections 2023-08-22T00:07:35.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc73405f010 0x7fc7340614d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc75014af10 0x7fc750164c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7500bd7c0 0x7fc750167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 --2- 172.21.15.98:0/960742039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7500c4430 0x7fc750149f00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 >> 172.21.15.98:0/960742039 conn(0x7fc7500c5300 msgr2=0x7fc7500c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 shutdown_connections 2023-08-22T00:07:35.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.346+0000 7fc757d7c700 1 -- 172.21.15.98:0/960742039 wait complete. 2023-08-22T00:07:35.361 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-08-22T00:07:35.361 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-22T00:07:35.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.482+0000 7fceb7de7700 1 Processor -- start 2023-08-22T00:07:35.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.482+0000 7fceb7de7700 1 -- start start 2023-08-22T00:07:35.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb7de7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fceb0151100 0x7fceb0064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb7de7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb0065530 0x7fceb01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb7de7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb0064f50 con 0x7fceb01519d0 2023-08-22T00:07:35.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb7de7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00aa190 con 0x7fceb0151100 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb7de7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00bdfe0 con 0x7fceb0065530 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb5b83700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fceb0151100 0x7fceb0064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb5b83700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fceb0151100 0x7fceb0064a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46732/0 (socket says 172.21.15.98:46732) 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.483+0000 7fceb5b83700 1 -- 172.21.15.98:0/2956627184 learned_addr learned my addr 172.21.15.98:0/2956627184 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5382700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb0065530 0x7fceb01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5b83700 1 -- 172.21.15.98:0/2956627184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb0065530 msgr2=0x7fceb01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:35.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5b83700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb0065530 0x7fceb01514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5b83700 1 -- 172.21.15.98:0/2956627184 >> v1:172.21.15.118:6789/0 conn(0x7fceb01519d0 legacy=0x7fceb00bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5b83700 1 -- 172.21.15.98:0/2956627184 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00645d0 con 0x7fceb0151100 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb5b83700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb0064a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fcea0006fd0 tx=0x7fcea00090f0).ready entity=mon.0 client_cookie=3a7d2a9e74fe2c9c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb4b81700 1 -- 172.21.15.98:0/2956627184 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000b580 con 0x7fceb0151100 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb4b81700 1 -- 172.21.15.98:0/2956627184 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000b6e0 con 0x7fceb0151100 2023-08-22T00:07:35.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.484+0000 7fceb4b81700 1 -- 172.21.15.98:0/2956627184 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000ba60 con 0x7fceb0151100 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 -- 172.21.15.98:0/2956627184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 msgr2=0x7fceb0064a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb0064a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fcea0006fd0 tx=0x7fcea00090f0).stop 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 -- 172.21.15.98:0/2956627184 shutdown_connections 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb0064a60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 --2- 172.21.15.98:0/2956627184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb0065530 0x7fceb01514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 -- 172.21.15.98:0/2956627184 >> 172.21.15.98:0/2956627184 conn(0x7fceb006a910 msgr2=0x7fceb0065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 -- 172.21.15.98:0/2956627184 shutdown_connections 2023-08-22T00:07:35.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.485+0000 7fceb7de7700 1 -- 172.21.15.98:0/2956627184 wait complete. 2023-08-22T00:07:35.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 Processor -- start 2023-08-22T00:07:35.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 -- start start 2023-08-22T00:07:35.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 0x7fceb0137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 0x7fceb0144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00c5f60 con 0x7fceb0151100 2023-08-22T00:07:35.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.486+0000 7fceb7de7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00bfa10 con 0x7fceb0065530 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb7de7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00c61e0 con 0x7fceb01519d0 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46736/0 (socket says 172.21.15.98:46736) 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 -- 172.21.15.98:0/1380475416 learned_addr learned my addr 172.21.15.98:0/1380475416 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5b83700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 0x7fceb0137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 -- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 msgr2=0x7fceb0144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb6384700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 0x7fceb0144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 0x7fceb0144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 -- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 msgr2=0x7fceb0137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 0x7fceb0137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 -- 172.21.15.98:0/1380475416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009370 con 0x7fceb0151100 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5b83700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 0x7fceb0137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb6384700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 0x7fceb0144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb5382700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fceac00e950 tx=0x7fceac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00c850 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00c9b0 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00c1110 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00cd30 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.487+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb00c0e00 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.488+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb00c1630 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.489+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fceac012600 con 0x7fceb0151100 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.489+0000 7fcea5ffb700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 0x7fce940614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.489+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fceac07a950 con 0x7fceb0151100 2023-08-22T00:07:35.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.489+0000 7fceb5b83700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 0x7fce940614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.489+0000 7fceb5b83700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 0x7fce940614d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcea0009130 tx=0x7fcea0017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.493+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fceb00c1630 con 0x7fceb0151100 2023-08-22T00:07:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.679+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fceb00c1630 con 0x7fce9405f010 2023-08-22T00:07:35.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.683+0000 7fcea5ffb700 1 -- 172.21.15.98:0/1380475416 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fceb00c1630 con 0x7fce9405f010 2023-08-22T00:07:35.689 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-08-22T00:07:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 msgr2=0x7fce940614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 0x7fce940614d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcea0009130 tx=0x7fcea0017000).stop 2023-08-22T00:07:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 msgr2=0x7fceb01444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fceac00e950 tx=0x7fceac009060).stop 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 shutdown_connections 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce9405f010 0x7fce940614d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb01519d0 0x7fceb0144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb0065530 0x7fceb0137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 --2- 172.21.15.98:0/1380475416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb0151100 0x7fceb01444a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 >> 172.21.15.98:0/1380475416 conn(0x7fceb006a910 msgr2=0x7fceb00c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 shutdown_connections 2023-08-22T00:07:35.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.685+0000 7fceb7de7700 1 -- 172.21.15.98:0/1380475416 wait complete. 2023-08-22T00:07:35.700 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-08-22T00:07:35.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-22T00:07:35.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.821+0000 7ffb66cbe700 1 Processor -- start 2023-08-22T00:07:35.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.821+0000 7ffb66cbe700 1 -- start start 2023-08-22T00:07:35.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb66cbe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffb60153ae0 0x7ffb600c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb66cbe700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60155360 con 0x7ffb600c0200 2023-08-22T00:07:35.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb66cbe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb600c0670 con 0x7ffb600bfd80 2023-08-22T00:07:35.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb66cbe700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb60157b50 con 0x7ffb60153ae0 2023-08-22T00:07:35.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffb60153ae0 0x7ffb600c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffb60153ae0 0x7ffb600c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46738/0 (socket says 172.21.15.98:46738) 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 -- 172.21.15.98:0/692639978 learned_addr learned my addr 172.21.15.98:0/692639978 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb6525b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ffb600c0200 0x7ffb600645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55280/0 (socket says 172.21.15.98:55280) 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 -- 172.21.15.98:0/692639978 >> v1:172.21.15.118:6789/0 conn(0x7ffb600bfd80 legacy=0x7ffb60157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 -- 172.21.15.98:0/692639978 >> v1:172.21.15.98:6789/0 conn(0x7ffb600c0200 legacy=0x7ffb600645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb64a5a700 1 -- 172.21.15.98:0/692639978 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb600c6390 con 0x7ffb60153ae0 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.822+0000 7ffb5f7fe700 1 -- 172.21.15.98:0/692639978 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266393632 0 0) 0x7ffb58001490 con 0x7ffb600c0200 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb64a5a700 1 --2- 172.21.15.98:0/692639978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60153ae0 0x7ffb600c5ea0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffb54006fd0 tx=0x7ffb540090f0).ready entity=mon.0 client_cookie=78af451913078843 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb5f7fe700 1 -- 172.21.15.98:0/692639978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400b600 con 0x7ffb60153ae0 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb5f7fe700 1 -- 172.21.15.98:0/692639978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400b760 con 0x7ffb60153ae0 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb5f7fe700 1 -- 172.21.15.98:0/692639978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400bae0 con 0x7ffb60153ae0 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 -- 172.21.15.98:0/692639978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60153ae0 msgr2=0x7ffb600c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/692639978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60153ae0 0x7ffb600c5ea0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffb54006fd0 tx=0x7ffb540090f0).stop 2023-08-22T00:07:35.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 -- 172.21.15.98:0/692639978 shutdown_connections 2023-08-22T00:07:35.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/692639978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60153ae0 0x7ffb600c5ea0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 -- 172.21.15.98:0/692639978 >> 172.21.15.98:0/692639978 conn(0x7ffb600caa50 msgr2=0x7ffb600cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:35.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 -- 172.21.15.98:0/692639978 shutdown_connections 2023-08-22T00:07:35.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.823+0000 7ffb66cbe700 1 -- 172.21.15.98:0/692639978 wait complete. 2023-08-22T00:07:35.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.824+0000 7ffb66cbe700 1 Processor -- start 2023-08-22T00:07:35.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 -- start start 2023-08-22T00:07:35.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb600bfd80 0x7ffb601506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb60153ae0 0x7ffb600c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c3cd0 con 0x7ffb600c0200 2023-08-22T00:07:35.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60158b60 con 0x7ffb600bfd80 2023-08-22T00:07:35.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb66cbe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c30c0 con 0x7ffb60153ae0 2023-08-22T00:07:35.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46748/0 (socket says 172.21.15.98:46748) 2023-08-22T00:07:35.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb5ffff700 1 -- 172.21.15.98:0/2117945887 learned_addr learned my addr 172.21.15.98:0/2117945887 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:35.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb64a5a700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb600bfd80 0x7ffb601506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.825+0000 7ffb6525b700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb60153ae0 0x7ffb600c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 -- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb60153ae0 msgr2=0x7ffb600c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb60153ae0 0x7ffb600c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 -- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb600bfd80 msgr2=0x7ffb601506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb600bfd80 0x7ffb601506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 -- 172.21.15.98:0/2117945887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009370 con 0x7ffb600c0200 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5ffff700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7ffb4c00c4c0 tx=0x7ffb4c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00ce70 con 0x7ffb600c0200 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c001e90 con 0x7ffb600c0200 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb600c33a0 con 0x7ffb600c0200 2023-08-22T00:07:35.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c007250 con 0x7ffb600c0200 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.826+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb600c3960 con 0x7ffb600c0200 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.827+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb600c3e80 con 0x7ffb600c0200 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.827+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7ffb4c0066a0 con 0x7ffb600c0200 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.828+0000 7ffb5cff9700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 0x7ffb440614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.828+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7ffb4c0799c0 con 0x7ffb600c0200 2023-08-22T00:07:35.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.828+0000 7ffb64a5a700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 0x7ffb440614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:35.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.828+0000 7ffb64a5a700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 0x7ffb440614d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ffb54009130 tx=0x7ffb54017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:35.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:35.832+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffb600c3e80 con 0x7ffb600c0200 2023-08-22T00:07:36.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.019+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb600c0670 con 0x7ffb4405f010 2023-08-22T00:07:36.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.024+0000 7ffb5cff9700 1 -- 172.21.15.98:0/2117945887 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ffb600c0670 con 0x7ffb4405f010 2023-08-22T00:07:36.025 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-08-22T00:07:36.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 msgr2=0x7ffb440614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 0x7ffb440614d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ffb54009130 tx=0x7ffb54017000).stop 2023-08-22T00:07:36.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 msgr2=0x7ffb600c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7ffb4c00c4c0 tx=0x7ffb4c007e00).stop 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 shutdown_connections 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffb4405f010 0x7ffb440614d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.025+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb60153ae0 0x7ffb600c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.026+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb600bfd80 0x7ffb601506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.026+0000 7ffb66cbe700 1 --2- 172.21.15.98:0/2117945887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb600c0200 0x7ffb600c4160 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.026+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 >> 172.21.15.98:0/2117945887 conn(0x7ffb600caa50 msgr2=0x7ffb600a9970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:36.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.026+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 shutdown_connections 2023-08-22T00:07:36.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.026+0000 7ffb66cbe700 1 -- 172.21.15.98:0/2117945887 wait complete. 2023-08-22T00:07:36.039 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-08-22T00:07:36.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-22T00:07:36.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.161+0000 7f3cc40d2700 1 Processor -- start 2023-08-22T00:07:36.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.162+0000 7f3cc40d2700 1 -- start start 2023-08-22T00:07:36.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.162+0000 7f3cc40d2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3cbc153c30 0x7f3cbc0a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.162+0000 7f3cc40d2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc0c38d0 con 0x7f3cbc0c3360 2023-08-22T00:07:36.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.162+0000 7f3cc40d2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc0c3bb0 con 0x7f3cbc154010 2023-08-22T00:07:36.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.162+0000 7f3cc40d2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0aad70 con 0x7f3cbc153c30 2023-08-22T00:07:36.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3cbc153c30 0x7f3cbc0a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3cbc153c30 0x7f3cbc0a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46750/0 (socket says 172.21.15.98:46750) 2023-08-22T00:07:36.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/2153116019 learned_addr learned my addr 172.21.15.98:0/2153116019 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:36.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc266f700 1 --1- 172.21.15.98:0/2153116019 >> v1:172.21.15.98:6789/0 conn(0x7f3cbc0c3360 0x7f3cbc068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55296/0 (socket says 172.21.15.98:55296) 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/2153116019 >> v1:172.21.15.118:6789/0 conn(0x7f3cbc154010 legacy=0x7f3cbc0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/2153116019 >> v1:172.21.15.98:6789/0 conn(0x7f3cbc0c3360 legacy=0x7f3cbc068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/2153116019 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0c3e90 con 0x7f3cbc153c30 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc0e6c700 1 -- 172.21.15.98:0/2153116019 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477734514 0 0) 0x7f3cbc0c38d0 con 0x7f3cbc0c3360 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc1e6e700 1 --2- 172.21.15.98:0/2153116019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0a8df0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f3cac006fd0 tx=0x7f3cac0090f0).ready entity=mon.0 client_cookie=45db1f615267034a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc0e6c700 1 -- 172.21.15.98:0/2153116019 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00b600 con 0x7f3cbc153c30 2023-08-22T00:07:36.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc0e6c700 1 -- 172.21.15.98:0/2153116019 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00b760 con 0x7f3cbc153c30 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.163+0000 7f3cc0e6c700 1 -- 172.21.15.98:0/2153116019 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00bae0 con 0x7f3cbc153c30 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 -- 172.21.15.98:0/2153116019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc153c30 msgr2=0x7f3cbc0a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/2153116019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0a8df0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f3cac006fd0 tx=0x7f3cac0090f0).stop 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 -- 172.21.15.98:0/2153116019 shutdown_connections 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/2153116019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0a8df0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 -- 172.21.15.98:0/2153116019 >> 172.21.15.98:0/2153116019 conn(0x7f3cbc0c5dd0 msgr2=0x7f3cbc068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:36.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 -- 172.21.15.98:0/2153116019 shutdown_connections 2023-08-22T00:07:36.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.164+0000 7f3cc40d2700 1 -- 172.21.15.98:0/2153116019 wait complete. 2023-08-22T00:07:36.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.165+0000 7f3cc40d2700 1 Processor -- start 2023-08-22T00:07:36.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.165+0000 7f3cc40d2700 1 -- start start 2023-08-22T00:07:36.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 0x7f3cbc0bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c2270 con 0x7f3cbc0c3360 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c2550 con 0x7f3cbc153c30 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c2830 con 0x7f3cbc154010 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46754/0 (socket says 172.21.15.98:46754) 2023-08-22T00:07:36.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/1511246657 learned_addr learned my addr 172.21.15.98:0/1511246657 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc166d700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc266f700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 0x7f3cbc0bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 msgr2=0x7f3cbc0bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 0x7f3cbc0bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 msgr2=0x7f3cbc0c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 -- 172.21.15.98:0/1511246657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009370 con 0x7f3cbc0c3360 2023-08-22T00:07:36.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc166d700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc266f700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 0x7f3cbc0bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc1e6e700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3cbc046e10 tx=0x7f3cac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00bae0 con 0x7f3cbc0c3360 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac000d10 con 0x7f3cbc0c3360 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc0c2b10 con 0x7f3cbc0c3360 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac01c650 con 0x7f3cbc0c3360 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.166+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc13cee0 con 0x7f3cbc0c3360 2023-08-22T00:07:36.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.167+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc047480 con 0x7f3cbc0c3360 2023-08-22T00:07:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.168+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f3cac01ca40 con 0x7f3cbc0c3360 2023-08-22T00:07:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.168+0000 7f3cb1ffb700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 0x7f3ca00614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.168+0000 7f3cc166d700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 0x7f3ca00614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.168+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f3cac07c190 con 0x7f3cbc0c3360 2023-08-22T00:07:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.169+0000 7f3cc166d700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 0x7f3ca00614d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3cbc157dc0 tx=0x7f3cb8009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.172+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cac04d1f0 con 0x7f3cbc0c3360 2023-08-22T00:07:36.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.359+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cbc0c4170 con 0x7f3ca005f010 2023-08-22T00:07:36.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.363+0000 7f3cb1ffb700 1 -- 172.21.15.98:0/1511246657 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3cbc0c4170 con 0x7f3ca005f010 2023-08-22T00:07:36.365 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-08-22T00:07:36.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 msgr2=0x7f3ca00614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 0x7f3ca00614d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3cbc157dc0 tx=0x7f3cb8009040).stop 2023-08-22T00:07:36.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 msgr2=0x7f3cbc13c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3cbc046e10 tx=0x7f3cac017000).stop 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 shutdown_connections 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3ca005f010 0x7f3ca00614d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cbc154010 0x7f3cbc0bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc13c9f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 --2- 172.21.15.98:0/1511246657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cbc153c30 0x7f3cbc0c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 >> 172.21.15.98:0/1511246657 conn(0x7f3cbc0c5dd0 msgr2=0x7f3cbc0c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 shutdown_connections 2023-08-22T00:07:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.365+0000 7f3cc40d2700 1 -- 172.21.15.98:0/1511246657 wait complete. 2023-08-22T00:07:36.379 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-08-22T00:07:36.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-22T00:07:36.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.508+0000 7f9f44173700 1 Processor -- start 2023-08-22T00:07:36.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.508+0000 7f9f44173700 1 -- start start 2023-08-22T00:07:36.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f44173700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f3c153d40 0x7f9f3c0a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f44173700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f44173700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0a8b20 con 0x7f9f3c0c5a30 2023-08-22T00:07:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f44173700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c0c4630 con 0x7f9f3c153d40 2023-08-22T00:07:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f44173700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0a9330 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f41f0f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f3c153d40 0x7f9f3c0a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f42710700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f42710700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:35044/0 (socket says 172.21.15.98:35044) 2023-08-22T00:07:36.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f41f0f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f3c153d40 0x7f9f3c0a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53524/0 (socket says 172.21.15.98:53524) 2023-08-22T00:07:36.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.509+0000 7f9f42710700 1 -- 172.21.15.98:0/1248773079 learned_addr learned my addr 172.21.15.98:0/1248773079 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f41f0f700 1 -- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 msgr2=0x7f9f3c0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:07:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f41f0f700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f41f0f700 1 -- 172.21.15.98:0/1248773079 >> v1:172.21.15.118:6789/0 conn(0x7f9f3c0c5a30 legacy=0x7f9f3c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f40f0d700 1 -- 172.21.15.98:0/1248773079 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358273656 0 0) 0x7f9f3c0a8b20 con 0x7f9f3c0c5a30 2023-08-22T00:07:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f41f0f700 1 -- 172.21.15.98:0/1248773079 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0c61a0 con 0x7f9f3c153d40 2023-08-22T00:07:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f42710700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:07:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f41f0f700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c153d40 0x7f9f3c0a8e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9f30009760 tx=0x7f9f30009060).ready entity=mon.1 client_cookie=8fe123154c0a83d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f40f0d700 1 -- 172.21.15.98:0/1248773079 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000f510 con 0x7f9f3c153d40 2023-08-22T00:07:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f40f0d700 1 -- 172.21.15.98:0/1248773079 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000f670 con 0x7f9f3c153d40 2023-08-22T00:07:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f40f0d700 1 -- 172.21.15.98:0/1248773079 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000f9f0 con 0x7f9f3c153d40 2023-08-22T00:07:36.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 -- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c153d40 msgr2=0x7f9f3c0a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c153d40 0x7f9f3c0a8e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9f30009760 tx=0x7f9f30009060).stop 2023-08-22T00:07:36.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 -- 172.21.15.98:0/1248773079 shutdown_connections 2023-08-22T00:07:36.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c0c2e80 0x7f9f3c0c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 --2- 172.21.15.98:0/1248773079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c153d40 0x7f9f3c0a8e40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.510+0000 7f9f44173700 1 -- 172.21.15.98:0/1248773079 >> 172.21.15.98:0/1248773079 conn(0x7f9f3c0c9320 msgr2=0x7f9f3c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:36.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.511+0000 7f9f44173700 1 -- 172.21.15.98:0/1248773079 shutdown_connections 2023-08-22T00:07:36.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.511+0000 7f9f44173700 1 -- 172.21.15.98:0/1248773079 wait complete. 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 Processor -- start 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 -- start start 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c153d40 0x7f9f3c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c063fe0 0x7f9f3c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0669f0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0660c0 con 0x7f9f3c063fe0 2023-08-22T00:07:36.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.512+0000 7f9f44173700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0663a0 con 0x7f9f3c153d40 2023-08-22T00:07:36.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46770/0 (socket says 172.21.15.98:46770) 2023-08-22T00:07:36.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 -- 172.21.15.98:0/4140889797 learned_addr learned my addr 172.21.15.98:0/4140889797 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:07:36.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f42710700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c063fe0 0x7f9f3c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f4170e700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c153d40 0x7f9f3c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 -- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c153d40 msgr2=0x7f9f3c140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c153d40 0x7f9f3c140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 -- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c063fe0 msgr2=0x7f9f3c0ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c063fe0 0x7f9f3c0ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 -- 172.21.15.98:0/4140889797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34009ae0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f41f0f700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9f30009e00 tx=0x7f9f30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000fe80 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300092a0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000f7e0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3001b670 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.513+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c1409f0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.514+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c066840 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.515+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f9f3001bae0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.515+0000 7f9f2dffb700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 0x7f9f200614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:07:36.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.515+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f9f3007b9f0 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.515+0000 7f9f4170e700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 0x7f9f200614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:07:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.515+0000 7f9f4170e700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 0x7f9f200614d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9f38007fd0 tx=0x7f9f38007bb0).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:07:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.519+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f3007de60 con 0x7f9f3c0c2e80 2023-08-22T00:07:36.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.710+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f3c066b30 con 0x7f9f2005f010 2023-08-22T00:07:36.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.714+0000 7f9f2dffb700 1 -- 172.21.15.98:0/4140889797 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9f38003600 con 0x7f9f2005f010 2023-08-22T00:07:36.717 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-08-22T00:07:36.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 msgr2=0x7f9f200614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 0x7f9f200614d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9f38007fd0 tx=0x7f9f38007bb0).stop 2023-08-22T00:07:36.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 msgr2=0x7f9f3c155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9f30009e00 tx=0x7f9f30017000).stop 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 shutdown_connections 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c063fe0 0x7f9f3c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3c0c2e80 0x7f9f3c155720 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f2005f010 0x7f9f200614d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 --2- 172.21.15.98:0/4140889797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f3c153d40 0x7f9f3c140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:07:36.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 >> 172.21.15.98:0/4140889797 conn(0x7f9f3c0c9320 msgr2=0x7f9f3c1526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:07:36.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 shutdown_connections 2023-08-22T00:07:36.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:07:36.716+0000 7f9f44173700 1 -- 172.21.15.98:0/4140889797 wait complete. 2023-08-22T00:07:36.731 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-08-22T00:07:47.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:07:47.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:08:00.005 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:08:00.004+0000 7fb1e6d6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:08:00.006 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:08:00.004+0000 7fb1e6d6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:08:00.006 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:08:00.004+0000 7fb1e6d6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:08:00.006 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:08:00.004+0000 7fb1e6d6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:08:00.007 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:08:00.004+0000 7fb1e6d6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:08:17.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:08:17.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:08:47.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:08:47.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:09:17.244 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:09:17.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:09:47.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:09:47.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:10:17.446 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:10:17.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:10:47.534 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:10:47.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:11:17.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:11:17.625 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:11:47.722 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:11:47.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:12:17.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:12:17.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:12:47.870 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:12:47.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:13:17.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:13:17.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:13:48.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:13:48.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:14:18.118 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:14:18.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:14:48.214 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:14:48.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:15:18.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:15:18.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:15:48.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:15:48.413 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:16:18.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:16:18.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:16:48.635 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:16:48.640 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:17:18.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:17:19.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:17:49.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:17:49.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:18:18.732 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-22T00:18:18.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 Processor -- start 2023-08-22T00:18:18.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 -- start start 2023-08-22T00:18:18.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f485c0c5a30 0x7f485c0a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:18.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0a8b20 con 0x7f485c153d40 2023-08-22T00:18:18.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0a9330 con 0x7f485c0c2e80 2023-08-22T00:18:18.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.867+0000 7f48613f5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0c4630 con 0x7f485c0c5a30 2023-08-22T00:18:18.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f485c0c5a30 0x7f485c0a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:18.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f485c0c5a30 0x7f485c0a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:51980/0 (socket says 172.21.15.98:51980) 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 -- 172.21.15.98:0/619176666 learned_addr learned my addr 172.21.15.98:0/619176666 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 -- 172.21.15.98:0/619176666 >> v1:172.21.15.118:6789/0 conn(0x7f485c0c2e80 legacy=0x7f485c0be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 -- 172.21.15.98:0/619176666 >> v1:172.21.15.98:6789/0 conn(0x7f485c153d40 legacy=0x7f485c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f4859ffb700 1 -- 172.21.15.98:0/619176666 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616782499 0 0) 0x7f485c0a8b20 con 0x7f485c153d40 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 -- 172.21.15.98:0/619176666 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0c61a0 con 0x7f485c0c5a30 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.868+0000 7f485a7fc700 1 --2- 172.21.15.98:0/619176666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0c5a30 0x7f485c0a8e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4844006fd0 tx=0x7f48440090f0).ready entity=mon.1 client_cookie=fecab78762873b28 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f4859ffb700 1 -- 172.21.15.98:0/619176666 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400b600 con 0x7f485c0c5a30 2023-08-22T00:18:18.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f4859ffb700 1 -- 172.21.15.98:0/619176666 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400b760 con 0x7f485c0c5a30 2023-08-22T00:18:18.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f4859ffb700 1 -- 172.21.15.98:0/619176666 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400bae0 con 0x7f485c0c5a30 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 -- 172.21.15.98:0/619176666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0c5a30 msgr2=0x7f485c0a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 --2- 172.21.15.98:0/619176666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0c5a30 0x7f485c0a8e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4844006fd0 tx=0x7f48440090f0).stop 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 -- 172.21.15.98:0/619176666 shutdown_connections 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 --2- 172.21.15.98:0/619176666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0c5a30 0x7f485c0a8e40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 -- 172.21.15.98:0/619176666 >> 172.21.15.98:0/619176666 conn(0x7f485c0c9320 msgr2=0x7f485c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:18.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 -- 172.21.15.98:0/619176666 shutdown_connections 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.869+0000 7f48613f5700 1 -- 172.21.15.98:0/619176666 wait complete. 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 Processor -- start 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 -- start start 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0c2e80 0x7f485c167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c1649e0 0x7f485c164e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:18.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c168990 con 0x7f485c153d40 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c165f80 con 0x7f485c1649e0 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.871+0000 7f48613f5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c165c50 con 0x7f485c0c2e80 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40870/0 (socket says 172.21.15.98:40870) 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 -- 172.21.15.98:0/828300100 learned_addr learned my addr 172.21.15.98:0/828300100 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:18.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485affd700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0c2e80 0x7f485c167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485b7fe700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c1649e0 0x7f485c164e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 -- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0c2e80 msgr2=0x7f485c167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0c2e80 0x7f485c167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 -- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c1649e0 msgr2=0x7f485c164e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c1649e0 0x7f485c164e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 -- 172.21.15.98:0/828300100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009370 con 0x7f485c153d40 2023-08-22T00:18:18.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f485a7fc700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f485c0630b0 tx=0x7f4844017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:18.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400b8d0 con 0x7f485c153d40 2023-08-22T00:18:18.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400ba30 con 0x7f485c153d40 2023-08-22T00:18:18.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0c12b0 con 0x7f485c153d40 2023-08-22T00:18:18.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484401c650 con 0x7f485c153d40 2023-08-22T00:18:18.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.872+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c0c1870 con 0x7f485c153d40 2023-08-22T00:18:18.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.873+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0adcd0 con 0x7f485c153d40 2023-08-22T00:18:18.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.873+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f484401ca40 con 0x7f485c153d40 2023-08-22T00:18:18.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.874+0000 7f4852ffd700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 0x7f483c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:18.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.874+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f484407c040 con 0x7f485c153d40 2023-08-22T00:18:18.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.874+0000 7f485affd700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 0x7f483c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:18.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.874+0000 7f485affd700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 0x7f483c061440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f484c003870 tx=0x7f484c007d20).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:18.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:18.878+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f484404d0d0 con 0x7f485c153d40 2023-08-22T00:18:19.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.065+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f485c06a920 con 0x7f483c05ef80 2023-08-22T00:18:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.069+0000 7f4852ffd700 1 -- 172.21.15.98:0/828300100 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f485c06a920 con 0x7f483c05ef80 2023-08-22T00:18:19.071 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-08-22T00:18:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 msgr2=0x7f483c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 0x7f483c061440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f484c003870 tx=0x7f484c007d20).stop 2023-08-22T00:18:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 msgr2=0x7f485c1684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f485c0630b0 tx=0x7f4844017000).stop 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 shutdown_connections 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f483c05ef80 0x7f483c061440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0c2e80 0x7f485c167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c1649e0 0x7f485c164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 --2- 172.21.15.98:0/828300100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f485c153d40 0x7f485c1684a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 >> 172.21.15.98:0/828300100 conn(0x7f485c0c9320 msgr2=0x7f485c0c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 shutdown_connections 2023-08-22T00:18:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.071+0000 7f48613f5700 1 -- 172.21.15.98:0/828300100 wait complete. 2023-08-22T00:18:19.084 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-08-22T00:18:19.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-22T00:18:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.206+0000 7f35ca11f700 1 Processor -- start 2023-08-22T00:18:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.206+0000 7f35ca11f700 1 -- start start 2023-08-22T00:18:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35ca11f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35c40a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35ca11f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35c4151e40 0x7f35c40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35ca11f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40c4bd0 con 0x7f35c40c4720 2023-08-22T00:18:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35ca11f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40bd650 con 0x7f35c4151e40 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35ca11f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40639a0 con 0x7f35c4151a60 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c3fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f35c40c4720 0x7f35c40bc8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39528/0 (socket says 172.21.15.98:39528) 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c3fff700 1 -- 172.21.15.98:0/3885415471 learned_addr learned my addr 172.21.15.98:0/3885415471 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/3885415471 >> v2:172.21.15.118:3300/0 conn(0x7f35c4151e40 0x7f35c40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c37fe700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35c40a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936636212 0 0) 0x7f35bc001490 con 0x7f35c40c4720 2023-08-22T00:18:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ac0033f0 con 0x7f35c40c4720 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320376601 0 0) 0x7f35ac0033f0 con 0x7f35c40c4720 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 msgr2=0x7f35c40a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35c40a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 >> v2:172.21.15.118:3300/0 conn(0x7f35c4151e40 msgr2=0x7f35c40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 --2- 172.21.15.98:0/3885415471 >> v2:172.21.15.118:3300/0 conn(0x7f35c4151e40 0x7f35c40c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4063070 con 0x7f35c40c4720 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.207+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f35bc001980 con 0x7f35c40c4720 2023-08-22T00:18:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 >> v1:172.21.15.98:6789/0 conn(0x7f35c40c4720 legacy=0x7f35c40bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35ac0038e0 0x7f35ac003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40bd650 con 0x7f35ac004690 2023-08-22T00:18:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40639a0 con 0x7f35ac0038e0 2023-08-22T00:18:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac00b8e0 con 0x7f35c4151a60 2023-08-22T00:18:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c37fe700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35ac0038e0 0x7f35ac003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c3fff700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 -- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 msgr2=0x7f35ac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35ac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 -- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35ac0038e0 msgr2=0x7f35ac003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35ac0038e0 0x7f35ac003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 -- 172.21.15.98:0/3885415471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0033f0 con 0x7f35ac004690 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c3fff700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c4151a60 0x7f35ac005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35ac004b10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f35c40be150 tx=0x7f35b4009060).ready entity=mon.0 client_cookie=fdc855bfdfcddff4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4009e90 con 0x7f35ac004690 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4009430 con 0x7f35ac004690 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.208+0000 7f35c27fc700 1 -- 172.21.15.98:0/3885415471 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400e820 con 0x7f35ac004690 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 -- 172.21.15.98:0/3885415471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 msgr2=0x7f35ac004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 --2- 172.21.15.98:0/3885415471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35ac004b10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f35c40be150 tx=0x7f35b4009060).stop 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35c3fff700 1 -- 172.21.15.98:0/3885415471 reap_dead start 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 -- 172.21.15.98:0/3885415471 shutdown_connections 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 -- 172.21.15.98:0/3885415471 >> 172.21.15.98:0/3885415471 conn(0x7f35c406a910 msgr2=0x7f35c4065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 -- 172.21.15.98:0/3885415471 shutdown_connections 2023-08-22T00:18:19.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.209+0000 7f35ca11f700 1 -- 172.21.15.98:0/3885415471 wait complete. 2023-08-22T00:18:19.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.210+0000 7f35ca11f700 1 Processor -- start 2023-08-22T00:18:19.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.210+0000 7f35ca11f700 1 -- start start 2023-08-22T00:18:19.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35c40c14c0 0x7f35c40bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c40bf6f0 0x7f35c40abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41625f0 con 0x7f35ac004690 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40bfbb0 con 0x7f35c40c14c0 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40bfe90 con 0x7f35c40bf6f0 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40890/0 (socket says 172.21.15.98:40890) 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 -- 172.21.15.98:0/2728310464 learned_addr learned my addr 172.21.15.98:0/2728310464 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c3fff700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c40bf6f0 0x7f35c40abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35c40c14c0 0x7f35c40bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 -- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c40bf6f0 msgr2=0x7f35c40abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c40bf6f0 0x7f35c40abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 -- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35c40c14c0 msgr2=0x7f35c40bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35c40c14c0 0x7f35c40bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 -- 172.21.15.98:0/2728310464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40c0170 con 0x7f35ac004690 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35c37fe700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f35b80119f0 tx=0x7f35b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800f790 con 0x7f35ac004690 2023-08-22T00:18:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800f8f0 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c41620a0 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.211+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800fc70 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.212+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40ac640 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.212+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c41628d0 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.213+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f35b8014650 con 0x7f35ac004690 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.213+0000 7f35ab7fe700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 0x7f35b0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.213+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f35b807ad50 con 0x7f35ac004690 2023-08-22T00:18:19.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.213+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 0x7f35b0061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.214+0000 7f35c2ffd700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 0x7f35b0061440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f35c4069870 tx=0x7f35b401a000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.217+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35b804bde0 con 0x7f35ac004690 2023-08-22T00:18:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.408+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c40ac8c0 con 0x7f35b005ef80 2023-08-22T00:18:19.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.412+0000 7f35ab7fe700 1 -- 172.21.15.98:0/2728310464 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f35c40ac8c0 con 0x7f35b005ef80 2023-08-22T00:18:19.413 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 msgr2=0x7f35b0061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 0x7f35b0061440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f35c4069870 tx=0x7f35b401a000).stop 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 msgr2=0x7f35c4161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f35b80119f0 tx=0x7f35b8009060).stop 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 shutdown_connections 2023-08-22T00:18:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35b005ef80 0x7f35b0061440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35c40bf6f0 0x7f35c40abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35ac004690 0x7f35c4161bb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.413+0000 7f35ca11f700 1 --2- 172.21.15.98:0/2728310464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35c40c14c0 0x7f35c40bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.414+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 >> 172.21.15.98:0/2728310464 conn(0x7f35c406a910 msgr2=0x7f35c40a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.414+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 shutdown_connections 2023-08-22T00:18:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.414+0000 7f35ca11f700 1 -- 172.21.15.98:0/2728310464 wait complete. 2023-08-22T00:18:19.426 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-08-22T00:18:19.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-22T00:18:19.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.546+0000 7f938b4dc700 1 Processor -- start 2023-08-22T00:18:19.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 -- start start 2023-08-22T00:18:19.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9384151cc0 0x7f9384065eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9384063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840667e0 con 0x7f93841518e0 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840c5c60 con 0x7f9384151cc0 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.547+0000 7f938b4dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384066a20 con 0x7f93840663a0 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9389278700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f93841518e0 0x7f93840c5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39532/0 (socket says 172.21.15.98:39532) 2023-08-22T00:18:19.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9389278700 1 -- 172.21.15.98:0/2850253729 learned_addr learned my addr 172.21.15.98:0/2850253729 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9388a77700 1 --2- 172.21.15.98:0/2850253729 >> v2:172.21.15.118:3300/0 conn(0x7f9384151cc0 0x7f9384065eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9389a79700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9384063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471210493 0 0) 0x7f9374001110 con 0x7f93841518e0 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93700033f0 con 0x7f93841518e0 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803192523 0 0) 0x7f93700033f0 con 0x7f93841518e0 2023-08-22T00:18:19.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 msgr2=0x7f9384063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9384063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 >> v2:172.21.15.118:3300/0 conn(0x7f9384151cc0 msgr2=0x7f9384065eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 --2- 172.21.15.98:0/2850253729 >> v2:172.21.15.118:3300/0 conn(0x7f9384151cc0 0x7f9384065eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384066d00 con 0x7f93841518e0 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9374001600 con 0x7f93841518e0 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 >> v1:172.21.15.98:6789/0 conn(0x7f93841518e0 legacy=0x7f93840c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93700038e0 0x7f9370003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9370004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9370005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c5c60 con 0x7f9370004b80 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384066a20 con 0x7f93700038e0 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937000b8e0 con 0x7f93840663a0 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9389a79700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9370005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9389278700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93700038e0 0x7f9370003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.548+0000 7f9388a77700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9370004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 -- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 msgr2=0x7f9370004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93840663a0 0x7f9370004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 -- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93700038e0 msgr2=0x7f9370003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93700038e0 0x7f9370003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 -- 172.21.15.98:0/2850253729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700033f0 con 0x7f9370004b80 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9370005000 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f937c00e210 tx=0x7f937c00b040).ready entity=mon.0 client_cookie=97be25eeaa62ab48 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c009ac0 con 0x7f9370004b80 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00f040 con 0x7f9370004b80 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f937bfff700 1 -- 172.21.15.98:0/2850253729 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00ecd0 con 0x7f9370004b80 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 -- 172.21.15.98:0/2850253729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 msgr2=0x7f9370005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 --2- 172.21.15.98:0/2850253729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9370005000 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f937c00e210 tx=0x7f937c00b040).stop 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f9389a79700 1 -- 172.21.15.98:0/2850253729 reap_dead start 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 -- 172.21.15.98:0/2850253729 shutdown_connections 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 -- 172.21.15.98:0/2850253729 >> 172.21.15.98:0/2850253729 conn(0x7f93840c4470 msgr2=0x7f93840695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 -- 172.21.15.98:0/2850253729 shutdown_connections 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.549+0000 7f938b4dc700 1 -- 172.21.15.98:0/2850253729 wait complete. 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 Processor -- start 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 -- start start 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9384154930 0x7f93840acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9384152190 0x7f938414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384154db0 con 0x7f9370004b80 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93841628b0 con 0x7f9384154930 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.551+0000 7f938b4dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840acff0 con 0x7f9384152190 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40908/0 (socket says 172.21.15.98:40908) 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 -- 172.21.15.98:0/3551034081 learned_addr learned my addr 172.21.15.98:0/3551034081 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:19.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9388a77700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9384154930 0x7f93840acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 -- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9384152190 msgr2=0x7f938414edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9384152190 0x7f938414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 -- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9384154930 msgr2=0x7f93840acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9384154930 0x7f93840acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 -- 172.21.15.98:0/3551034081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384154fa0 con 0x7f9370004b80 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f9389278700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9374000fd0 tx=0x7f9374007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374004e20 con 0x7f9370004b80 2023-08-22T00:18:19.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400f840 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384155280 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400fbc0 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.552+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9384162540 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.553+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384064e40 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.554+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f937401d3b0 con 0x7f9370004b80 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.554+0000 7f93797fa700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 0x7f9368061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.554+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f9374079f90 con 0x7f9370004b80 2023-08-22T00:18:19.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.554+0000 7f9388a77700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 0x7f9368061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.555+0000 7f9388a77700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 0x7f9368061440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9380006d80 tx=0x7f9380008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.558+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f937404b130 con 0x7f9370004b80 2023-08-22T00:18:19.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.751+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f93840667e0 con 0x7f936805ef80 2023-08-22T00:18:19.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.755+0000 7f93797fa700 1 -- 172.21.15.98:0/3551034081 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f93840667e0 con 0x7f936805ef80 2023-08-22T00:18:19.757 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-08-22T00:18:19.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 msgr2=0x7f9368061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 0x7f9368061440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9380006d80 tx=0x7f9380008040).stop 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 msgr2=0x7f9384162d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9374000fd0 tx=0x7f9374007900).stop 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 shutdown_connections 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936805ef80 0x7f9368061440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9384152190 0x7f938414edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:19.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9370004b80 0x7f9384162d40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 --2- 172.21.15.98:0/3551034081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9384154930 0x7f93840acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 >> 172.21.15.98:0/3551034081 conn(0x7f93840c4470 msgr2=0x7f9384155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 shutdown_connections 2023-08-22T00:18:19.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.757+0000 7f938b4dc700 1 -- 172.21.15.98:0/3551034081 wait complete. 2023-08-22T00:18:19.770 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-08-22T00:18:19.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-22T00:18:19.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.891+0000 7fb9f1b3f700 1 Processor -- start 2023-08-22T00:18:19.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.891+0000 7fb9f1b3f700 1 -- start start 2023-08-22T00:18:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 0x7fb9ec064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 0x7fb9ec1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec064f50 con 0x7fb9ec1519d0 2023-08-22T00:18:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec0aa190 con 0x7fb9ec065530 2023-08-22T00:18:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9f1b3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0bdfe0 con 0x7fb9ec151100 2023-08-22T00:18:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40912/0 (socket says 172.21.15.98:40912) 2023-08-22T00:18:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 -- 172.21.15.98:0/3681082750 learned_addr learned my addr 172.21.15.98:0/3681082750 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9eb7fe700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 0x7fb9ec064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/3681082750 >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 0x7fb9ec1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 -- 172.21.15.98:0/3681082750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 msgr2=0x7fb9ec064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 0x7fb9ec064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 -- 172.21.15.98:0/3681082750 >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 msgr2=0x7fb9ec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 --2- 172.21.15.98:0/3681082750 >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 0x7fb9ec1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9ebfff700 1 -- 172.21.15.98:0/3681082750 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0645d0 con 0x7fb9ec1519d0 2023-08-22T00:18:19.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/3681082750 >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 0x7fb9ec1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:19.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.892+0000 7fb9eb7fe700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 0x7fb9ec064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:19.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9ebfff700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fb9ec046e10 tx=0x7fb9e400ba50).ready entity=mon.0 client_cookie=31dc5fdeaec34842 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9ea7fc700 1 -- 172.21.15.98:0/3681082750 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4010070 con 0x7fb9ec1519d0 2023-08-22T00:18:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9ea7fc700 1 -- 172.21.15.98:0/3681082750 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e400de90 con 0x7fb9ec1519d0 2023-08-22T00:18:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9ea7fc700 1 -- 172.21.15.98:0/3681082750 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400b2e0 con 0x7fb9ec1519d0 2023-08-22T00:18:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/3681082750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec1519d0 msgr2=0x7fb9ec0bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fb9ec046e10 tx=0x7fb9e400ba50).stop 2023-08-22T00:18:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/3681082750 shutdown_connections 2023-08-22T00:18:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec151100 0x7fb9ec064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/3681082750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec1519d0 0x7fb9ec0bc6f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/3681082750 >> v2:172.21.15.118:3300/0 conn(0x7fb9ec065530 0x7fb9ec1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/3681082750 >> 172.21.15.98:0/3681082750 conn(0x7fb9ec06a910 msgr2=0x7fb9ec065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/3681082750 shutdown_connections 2023-08-22T00:18:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.893+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/3681082750 wait complete. 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.894+0000 7fb9f1b3f700 1 Processor -- start 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 -- start start 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 0x7fb9ec1637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 0x7fb9ec163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec14c460 con 0x7fb9ec065530 2023-08-22T00:18:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec14b850 con 0x7fb9ec151100 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9f1b3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec14bb30 con 0x7fb9ec1519d0 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40914/0 (socket says 172.21.15.98:40914) 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.895+0000 7fb9eb7fe700 1 -- 172.21.15.98:0/586402808 learned_addr learned my addr 172.21.15.98:0/586402808 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9ebfff700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 0x7fb9ec163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 0x7fb9ec1637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 -- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 msgr2=0x7fb9ec163cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 0x7fb9ec163cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 -- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 msgr2=0x7fb9ec1637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 0x7fb9ec1637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 -- 172.21.15.98:0/586402808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e400bcf0 con 0x7fb9ec065530 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9ebfff700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 0x7fb9ec163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 0x7fb9ec1637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9eb7fe700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb9e000d860 tx=0x7fb9e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00125f0 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0012750 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec14be10 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0012ad0 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.896+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec0c56c0 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.897+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec14c740 con 0x7fb9ec065530 2023-08-22T00:18:19.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.897+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fb9e0013480 con 0x7fb9ec065530 2023-08-22T00:18:19.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.898+0000 7fb9d37fe700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 0x7fb9d8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:19.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.898+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fb9e007a040 con 0x7fb9ec065530 2023-08-22T00:18:19.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.898+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 0x7fb9d8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:19.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.898+0000 7fb9eaffd700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 0x7fb9d8061440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb9ec1509c0 tx=0x7fb9dc008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:19.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:19.902+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9e004b070 con 0x7fb9ec065530 2023-08-22T00:18:19.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:18:19.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:18:20.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.092+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9ec14c5a0 con 0x7fb9d805ef80 2023-08-22T00:18:20.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.096+0000 7fb9d37fe700 1 -- 172.21.15.98:0/586402808 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb9dc00f770 con 0x7fb9d805ef80 2023-08-22T00:18:20.098 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-08-22T00:18:20.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 msgr2=0x7fb9d8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 0x7fb9d8061440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb9ec1509c0 tx=0x7fb9dc008040).stop 2023-08-22T00:18:20.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 msgr2=0x7fb9ec14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb9e000d860 tx=0x7fb9e0008040).stop 2023-08-22T00:18:20.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 shutdown_connections 2023-08-22T00:18:20.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb9d805ef80 0x7fb9d8061440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9ec1519d0 0x7fb9ec163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ec065530 0x7fb9ec14ae70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 --2- 172.21.15.98:0/586402808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ec151100 0x7fb9ec1637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 >> 172.21.15.98:0/586402808 conn(0x7fb9ec06a910 msgr2=0x7fb9ec062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 shutdown_connections 2023-08-22T00:18:20.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.098+0000 7fb9f1b3f700 1 -- 172.21.15.98:0/586402808 wait complete. 2023-08-22T00:18:20.111 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-08-22T00:18:20.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-22T00:18:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.231+0000 7fb784710700 1 Processor -- start 2023-08-22T00:18:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.231+0000 7fb784710700 1 -- start start 2023-08-22T00:18:20.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb784710700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb77c067880 0x7fb77c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb784710700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb77c065640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb784710700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c065d20 con 0x7fb77c0c34f0 2023-08-22T00:18:20.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb784710700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c065b30 con 0x7fb77c067880 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb784710700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c151ec0 con 0x7fb77c0645b0 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb781cab700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb77c0c34f0 0x7fb77c063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50654/0 (socket says 172.21.15.98:50654) 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb781cab700 1 -- 172.21.15.98:0/1164311014 learned_addr learned my addr 172.21.15.98:0/1164311014 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020135611 0 0) 0x7fb77c065d20 con 0x7fb77c0c34f0 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb782cad700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb77c065640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7680033f0 con 0x7fb77c0c34f0 2023-08-22T00:18:20.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7824ac700 1 --2- 172.21.15.98:0/1164311014 >> v2:172.21.15.118:3300/0 conn(0x7fb77c067880 0x7fb77c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779312480 0 0) 0x7fb7680033f0 con 0x7fb77c0c34f0 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 msgr2=0x7fb77c065640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb77c065640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 >> v2:172.21.15.118:3300/0 conn(0x7fb77c067880 msgr2=0x7fb77c067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 --2- 172.21.15.98:0/1164311014 >> v2:172.21.15.118:3300/0 conn(0x7fb77c067880 0x7fb77c067c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c151a30 con 0x7fb77c0c34f0 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb76c001470 con 0x7fb77c0c34f0 2023-08-22T00:18:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 >> v1:172.21.15.98:6789/0 conn(0x7fb77c0c34f0 legacy=0x7fb77c063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb768003910 0x7fb768003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb768004690 0x7fb768004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.232+0000 7fb7814aa700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb768005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c151ec0 con 0x7fb768003910 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76800b8e0 con 0x7fb768004690 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76800ba20 con 0x7fb77c0645b0 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb768003910 0x7fb768003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb781cab700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb768004690 0x7fb768004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb782cad700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb768005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 -- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 msgr2=0x7fb768005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb77c0645b0 0x7fb768005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 -- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb768004690 msgr2=0x7fb768004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb768004690 0x7fb768004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 -- 172.21.15.98:0/1164311014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680033f0 con 0x7fb768003910 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7824ac700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb768003910 0x7fb768003d30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fb778009a80 tx=0x7fb778009060).ready entity=mon.0 client_cookie=fb72c08a67b65b98 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778009430 con 0x7fb768003910 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800e640 con 0x7fb768003910 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.233+0000 7fb7814aa700 1 -- 172.21.15.98:0/1164311014 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800e9c0 con 0x7fb768003910 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 -- 172.21.15.98:0/1164311014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb768003910 msgr2=0x7fb768003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 --2- 172.21.15.98:0/1164311014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb768003910 0x7fb768003d30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fb778009a80 tx=0x7fb778009060).stop 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb782cad700 1 -- 172.21.15.98:0/1164311014 reap_dead start 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 -- 172.21.15.98:0/1164311014 shutdown_connections 2023-08-22T00:18:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 -- 172.21.15.98:0/1164311014 >> 172.21.15.98:0/1164311014 conn(0x7fb77c0c4470 msgr2=0x7fb77c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 -- 172.21.15.98:0/1164311014 shutdown_connections 2023-08-22T00:18:20.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.234+0000 7fb784710700 1 -- 172.21.15.98:0/1164311014 wait complete. 2023-08-22T00:18:20.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 Processor -- start 2023-08-22T00:18:20.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 -- start start 2023-08-22T00:18:20.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb768003910 0x7fb77c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb77c063a70 0x7fb77c063ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0ab800 con 0x7fb77c14ba10 2023-08-22T00:18:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0643e0 con 0x7fb77c063a70 2023-08-22T00:18:20.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.235+0000 7fb784710700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0aabf0 con 0x7fb768003910 2023-08-22T00:18:20.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45996/0 (socket says 172.21.15.98:45996) 2023-08-22T00:18:20.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 -- 172.21.15.98:0/2770729214 learned_addr learned my addr 172.21.15.98:0/2770729214 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:20.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb7824ac700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb768003910 0x7fb77c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb781cab700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb77c063a70 0x7fb77c063ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 -- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb768003910 msgr2=0x7fb77c14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb768003910 0x7fb77c14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 -- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb77c063a70 msgr2=0x7fb77c063ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb77c063a70 0x7fb77c063ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 -- 172.21.15.98:0/2770729214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0aaed0 con 0x7fb77c14ba10 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb782cad700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fb77c067030 tx=0x7fb77400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400e040 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400f040 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400fd70 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c0ab1b0 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.236+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c14e670 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.237+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c0ab970 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.237+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fb774015660 con 0x7fb77c14ba10 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.238+0000 7fb7727fc700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 0x7fb760061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.238+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fb77407acb0 con 0x7fb77c14ba10 2023-08-22T00:18:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.238+0000 7fb7824ac700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 0x7fb760061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.238+0000 7fb7824ac700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 0x7fb760061440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb778009a80 tx=0x7fb77801a000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.242+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb77404bd40 con 0x7fb77c14ba10 2023-08-22T00:18:20.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.431+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb77c047480 con 0x7fb76005ef80 2023-08-22T00:18:20.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.435+0000 7fb7727fc700 1 -- 172.21.15.98:0/2770729214 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb77c047480 con 0x7fb76005ef80 2023-08-22T00:18:20.437 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-08-22T00:18:20.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 msgr2=0x7fb760061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 0x7fb760061440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb778009a80 tx=0x7fb77801a000).stop 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 msgr2=0x7fb77c14be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fb77c067030 tx=0x7fb77400b040).stop 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 shutdown_connections 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb76005ef80 0x7fb760061440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb768003910 0x7fb77c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb77c14ba10 0x7fb77c14be50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 --2- 172.21.15.98:0/2770729214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb77c063a70 0x7fb77c063ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 >> 172.21.15.98:0/2770729214 conn(0x7fb77c0c4470 msgr2=0x7fb77c14eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 shutdown_connections 2023-08-22T00:18:20.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.437+0000 7fb784710700 1 -- 172.21.15.98:0/2770729214 wait complete. 2023-08-22T00:18:20.450 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-08-22T00:18:20.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-22T00:18:20.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.569+0000 7f5148d55700 1 Processor -- start 2023-08-22T00:18:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.569+0000 7f5148d55700 1 -- start start 2023-08-22T00:18:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.570+0000 7f5148d55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 0x7f51440c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.570+0000 7f5148d55700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51440c4e60 0x7f5144068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.570+0000 7f5148d55700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440c38d0 con 0x7f5144153c30 2023-08-22T00:18:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.570+0000 7f5148d55700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440aad70 con 0x7f51440c4e60 2023-08-22T00:18:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.570+0000 7f5148d55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c3bb0 con 0x7f5144154010 2023-08-22T00:18:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5141d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 0x7f51440c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51440c4e60 0x7f5144068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f514259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5144153c30 0x7f51440a8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:35892/0 (socket says 172.21.15.98:35892) 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f514259c700 1 -- 172.21.15.98:0/2739676677 learned_addr learned my addr 172.21.15.98:0/2739676677 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 -- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 msgr2=0x7f51440c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 0x7f51440c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 -- 172.21.15.98:0/2739676677 >> v1:172.21.15.118:6789/0 conn(0x7f5144153c30 legacy=0x7f51440a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 -- 172.21.15.98:0/2739676677 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440c3e90 con 0x7f51440c4e60 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5141d9b700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 0x7f51440c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f5142d9d700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144068d20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f513c009e60 tx=0x7f513c009780).ready entity=mon.1 client_cookie=2e174ca1bef37dc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f514159a700 1 -- 172.21.15.98:0/2739676677 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00e070 con 0x7f51440c4e60 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f514159a700 1 -- 172.21.15.98:0/2739676677 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00bb60 con 0x7f51440c4e60 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.571+0000 7f514159a700 1 -- 172.21.15.98:0/2739676677 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c012410 con 0x7f51440c4e60 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 -- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 msgr2=0x7f5144068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144068d20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f513c009e60 tx=0x7f513c009780).stop 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 -- 172.21.15.98:0/2739676677 shutdown_connections 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144068d20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 --2- 172.21.15.98:0/2739676677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144154010 0x7f51440c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 -- 172.21.15.98:0/2739676677 >> 172.21.15.98:0/2739676677 conn(0x7f51440c5dd0 msgr2=0x7f5144068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 -- 172.21.15.98:0/2739676677 shutdown_connections 2023-08-22T00:18:20.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.572+0000 7f5148d55700 1 -- 172.21.15.98:0/2739676677 wait complete. 2023-08-22T00:18:20.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.573+0000 7f5148d55700 1 Processor -- start 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.573+0000 7f5148d55700 1 -- start start 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144153c30 0x7f51441502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144156a20 con 0x7f5144154010 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144155e10 con 0x7f51440c4e60 2023-08-22T00:18:20.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51441560f0 con 0x7f5144153c30 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46002/0 (socket says 172.21.15.98:46002) 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 -- 172.21.15.98:0/4081771879 learned_addr learned my addr 172.21.15.98:0/4081771879 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5141d9b700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144153c30 0x7f51441502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f514259c700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 -- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144153c30 msgr2=0x7f51441502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144153c30 0x7f51441502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 -- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 msgr2=0x7f5144156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 -- 172.21.15.98:0/4081771879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380092a0 con 0x7f5144154010 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5142d9d700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f513c00b6c0 tx=0x7f513c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c01d630 con 0x7f5144154010 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c01d790 con 0x7f5144154010 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.574+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c009a20 con 0x7f5144154010 2023-08-22T00:18:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.575+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c01db50 con 0x7f5144154010 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.575+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144156730 con 0x7f5144154010 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.575+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51440c4a80 con 0x7f5144154010 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.576+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f513c003040 con 0x7f5144154010 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.576+0000 7f51327fc700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 0x7f5124061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.576+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f513c07c2d0 con 0x7f5144154010 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.576+0000 7f514259c700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 0x7f5124061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.576+0000 7f514259c700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 0x7f5124061440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5134000c00 tx=0x7f5134009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.580+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f513c04d360 con 0x7f5144154010 2023-08-22T00:18:20.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.769+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5144047480 con 0x7f512405ef80 2023-08-22T00:18:20.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.773+0000 7f51327fc700 1 -- 172.21.15.98:0/4081771879 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5144047480 con 0x7f512405ef80 2023-08-22T00:18:20.775 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-08-22T00:18:20.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 msgr2=0x7f5124061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 0x7f5124061440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5134000c00 tx=0x7f5134009040).stop 2023-08-22T00:18:20.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 msgr2=0x7f51440c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f513c00b6c0 tx=0x7f513c009780).stop 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 shutdown_connections 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5144154010 0x7f51440c1a70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51440c4e60 0x7f5144156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f512405ef80 0x7f5124061440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 --2- 172.21.15.98:0/4081771879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5144153c30 0x7f51441502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 >> 172.21.15.98:0/4081771879 conn(0x7f51440c5dd0 msgr2=0x7f51440c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 shutdown_connections 2023-08-22T00:18:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.775+0000 7f5148d55700 1 -- 172.21.15.98:0/4081771879 wait complete. 2023-08-22T00:18:20.788 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-08-22T00:18:20.788 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-22T00:18:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.908+0000 7f9dcc155700 1 Processor -- start 2023-08-22T00:18:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.909+0000 7f9dcc155700 1 -- start start 2023-08-22T00:18:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dcc155700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9dc4064060 0x7f9dc4064440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dcc155700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dc40c5c20 0x7f9dc40c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dcc155700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc406a880 con 0x7f9dc40c2d60 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dcc155700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40c31d0 con 0x7f9dc40c5c20 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dcc155700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40c33e0 con 0x7f9dc4064060 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dc40c5c20 0x7f9dc40c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dca6f2700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9dc40c2d60 0x7f9dc4153820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50666/0 (socket says 172.21.15.98:50666) 2023-08-22T00:18:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dca6f2700 1 -- 172.21.15.98:0/945071551 learned_addr learned my addr 172.21.15.98:0/945071551 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc9ef1700 1 --2- 172.21.15.98:0/945071551 >> v2:172.21.15.118:3300/0 conn(0x7f9dc4064060 0x7f9dc4064440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 -- 172.21.15.98:0/945071551 >> v2:172.21.15.118:3300/0 conn(0x7f9dc4064060 msgr2=0x7f9dc4064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 --2- 172.21.15.98:0/945071551 >> v2:172.21.15.118:3300/0 conn(0x7f9dc4064060 0x7f9dc4064440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 -- 172.21.15.98:0/945071551 >> v1:172.21.15.98:6789/0 conn(0x7f9dc40c2d60 legacy=0x7f9dc4153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc8eef700 1 -- 172.21.15.98:0/945071551 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429889325 0 0) 0x7f9dc406a880 con 0x7f9dc40c2d60 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 -- 172.21.15.98:0/945071551 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40c36c0 con 0x7f9dc40c5c20 2023-08-22T00:18:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc96f0700 1 --2- 172.21.15.98:0/945071551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc40c5c20 0x7f9dc40c2870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9dc406ad40 tx=0x7f9dc0009060).ready entity=mon.0 client_cookie=765a8d1a8c64a4c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc8eef700 1 -- 172.21.15.98:0/945071551 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000f510 con 0x7f9dc40c5c20 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc8eef700 1 -- 172.21.15.98:0/945071551 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000f670 con 0x7f9dc40c5c20 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.910+0000 7f9dc8eef700 1 -- 172.21.15.98:0/945071551 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000f9f0 con 0x7f9dc40c5c20 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 -- 172.21.15.98:0/945071551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc40c5c20 msgr2=0x7f9dc40c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 --2- 172.21.15.98:0/945071551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc40c5c20 0x7f9dc40c2870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9dc406ad40 tx=0x7f9dc0009060).stop 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 -- 172.21.15.98:0/945071551 shutdown_connections 2023-08-22T00:18:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 --2- 172.21.15.98:0/945071551 >> v2:172.21.15.118:3300/0 conn(0x7f9dc4064060 0x7f9dc4064440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 --2- 172.21.15.98:0/945071551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc40c5c20 0x7f9dc40c2870 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 -- 172.21.15.98:0/945071551 >> 172.21.15.98:0/945071551 conn(0x7f9dc40c4470 msgr2=0x7f9dc40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:20.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 -- 172.21.15.98:0/945071551 shutdown_connections 2023-08-22T00:18:20.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.911+0000 7f9dcc155700 1 -- 172.21.15.98:0/945071551 wait complete. 2023-08-22T00:18:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.912+0000 7f9dcc155700 1 Processor -- start 2023-08-22T00:18:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.912+0000 7f9dcc155700 1 -- start start 2023-08-22T00:18:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40c2d60 0x7f9dc40a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc40c5c20 0x7f9dc4167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40a67e0 con 0x7f9dc4064060 2023-08-22T00:18:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc414f690 con 0x7f9dc40c5c20 2023-08-22T00:18:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dcc155700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40bfd60 con 0x7f9dc40c2d60 2023-08-22T00:18:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46020/0 (socket says 172.21.15.98:46020) 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 -- 172.21.15.98:0/2603266158 learned_addr learned my addr 172.21.15.98:0/2603266158 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc96f0700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40c2d60 0x7f9dc40a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dca6f2700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc40c5c20 0x7f9dc4167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 -- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40c2d60 msgr2=0x7f9dc40a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40c2d60 0x7f9dc40a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 -- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc40c5c20 msgr2=0x7f9dc4167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc40c5c20 0x7f9dc4167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 -- 172.21.15.98:0/2603266158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00092a0 con 0x7f9dc4064060 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.913+0000 7f9dc9ef1700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9db400e900 tx=0x7f9db4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.914+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400c5e0 con 0x7f9dc4064060 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.914+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400c740 con 0x7f9dc4064060 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.914+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc414ea80 con 0x7f9dc4064060 2023-08-22T00:18:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.914+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400cac0 con 0x7f9dc4064060 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.914+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc414f040 con 0x7f9dc4064060 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.915+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4047480 con 0x7f9dc4064060 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.915+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f9db401b400 con 0x7f9dc4064060 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.915+0000 7f9db9ffb700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 0x7f9da8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.916+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f9db407a6f0 con 0x7f9dc4064060 2023-08-22T00:18:20.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.916+0000 7f9dc96f0700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 0x7f9da8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.916+0000 7f9dc96f0700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 0x7f9da8061440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9dc40a49d0 tx=0x7f9dc0017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:20.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:20.920+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9db404b720 con 0x7f9dc4064060 2023-08-22T00:18:21.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.107+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dc414f7d0 con 0x7f9da805ef80 2023-08-22T00:18:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.110+0000 7f9db9ffb700 1 -- 172.21.15.98:0/2603266158 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9dc000f7e0 con 0x7f9da805ef80 2023-08-22T00:18:21.112 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-08-22T00:18:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 msgr2=0x7f9da8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 0x7f9da8061440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9dc40a49d0 tx=0x7f9dc0017000).stop 2023-08-22T00:18:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 msgr2=0x7f9dc40bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9db400e900 tx=0x7f9db4009060).stop 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 shutdown_connections 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc40c5c20 0x7f9dc4167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4064060 0x7f9dc40bf870 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9da805ef80 0x7f9da8061440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 --2- 172.21.15.98:0/2603266158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40c2d60 0x7f9dc40a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 >> 172.21.15.98:0/2603266158 conn(0x7f9dc40c4470 msgr2=0x7f9dc4066810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 shutdown_connections 2023-08-22T00:18:21.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.112+0000 7f9dcc155700 1 -- 172.21.15.98:0/2603266158 wait complete. 2023-08-22T00:18:21.125 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-08-22T00:18:21.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-22T00:18:21.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.245+0000 7fbbdb716700 1 Processor -- start 2023-08-22T00:18:21.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.245+0000 7fbbdb716700 1 -- start start 2023-08-22T00:18:21.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbbd4153a40 0x7fbbd40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd4066c00 0x7fbbd4062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd40c5460 0x7fbbd4063080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd4066770 con 0x7fbbd4066c00 2023-08-22T00:18:21.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40c4f40 con 0x7fbbd4153a40 2023-08-22T00:18:21.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbdb716700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40c59e0 con 0x7fbbd40c5460 2023-08-22T00:18:21.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd4066c00 0x7fbbd4062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd4066c00 0x7fbbd4062b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46028/0 (socket says 172.21.15.98:46028) 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/791997809 learned_addr learned my addr 172.21.15.98:0/791997809 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd9cb3700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd40c5460 0x7fbbd4063080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd94b2700 1 --2- 172.21.15.98:0/791997809 >> v2:172.21.15.118:3300/0 conn(0x7fbbd4153a40 0x7fbbd40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/791997809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd40c5460 msgr2=0x7fbbd4063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd40c5460 0x7fbbd4063080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/791997809 >> v2:172.21.15.118:3300/0 conn(0x7fbbd4153a40 msgr2=0x7fbbd40c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/791997809 >> v2:172.21.15.118:3300/0 conn(0x7fbbd4153a40 0x7fbbd40c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/791997809 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4065e80 con 0x7fbbd4066c00 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd4066c00 0x7fbbd4062b90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbbd40692a0 tx=0x7fbbc40090f0).ready entity=mon.0 client_cookie=9c4a9ec4dcd31fce server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbcbfff700 1 -- 172.21.15.98:0/791997809 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400b600 con 0x7fbbd4066c00 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbcbfff700 1 -- 172.21.15.98:0/791997809 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400b760 con 0x7fbbd4066c00 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.246+0000 7fbbcbfff700 1 -- 172.21.15.98:0/791997809 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400bae0 con 0x7fbbd4066c00 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 -- 172.21.15.98:0/791997809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd4066c00 msgr2=0x7fbbd4062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd4066c00 0x7fbbd4062b90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbbd40692a0 tx=0x7fbbc40090f0).stop 2023-08-22T00:18:21.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 -- 172.21.15.98:0/791997809 shutdown_connections 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd40c5460 0x7fbbd4063080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 --2- 172.21.15.98:0/791997809 >> v2:172.21.15.118:3300/0 conn(0x7fbbd4153a40 0x7fbbd40c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 --2- 172.21.15.98:0/791997809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd4066c00 0x7fbbd4062b90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 -- 172.21.15.98:0/791997809 >> 172.21.15.98:0/791997809 conn(0x7fbbd40c3990 msgr2=0x7fbbd40c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 -- 172.21.15.98:0/791997809 shutdown_connections 2023-08-22T00:18:21.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.247+0000 7fbbdb716700 1 -- 172.21.15.98:0/791997809 wait complete. 2023-08-22T00:18:21.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.248+0000 7fbbdb716700 1 Processor -- start 2023-08-22T00:18:21.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.248+0000 7fbbdb716700 1 -- start start 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd4066c00 0x7fbbd4140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd4153a40 0x7fbbd40a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4164ec0 con 0x7fbbd40c5460 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40c1bb0 con 0x7fbbd4066c00 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbdb716700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4164900 con 0x7fbbd4153a40 2023-08-22T00:18:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbd8cb1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbd8cb1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46044/0 (socket says 172.21.15.98:46044) 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/2305505520 learned_addr learned my addr 172.21.15.98:0/2305505520 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbd94b2700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd4066c00 0x7fbbd4140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.249+0000 7fbbd9cb3700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd4153a40 0x7fbbd40a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd4153a40 msgr2=0x7fbbd40a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd4153a40 0x7fbbd40a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd4066c00 msgr2=0x7fbbd4140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd4066c00 0x7fbbd4140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 -- 172.21.15.98:0/2305505520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4009370 con 0x7fbbd40c5460 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.250+0000 7fbbd8cb1700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fbbc4009130 tx=0x7fbbc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.251+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400bea0 con 0x7fbbd40c5460 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.251+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400b8d0 con 0x7fbbd40c5460 2023-08-22T00:18:21.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.251+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd4164be0 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.251+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc401c650 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.251+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd4140d00 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40c1630 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fbbc401c9c0 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbc97fa700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 0x7fbbb8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fbbc407b930 con 0x7fbbd40c5460 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbd94b2700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 0x7fbbb8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.253+0000 7fbbd94b2700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 0x7fbbb8061440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbbd000ba80 tx=0x7fbbd0008040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.257+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbbd40c1630 con 0x7fbbd40c5460 2023-08-22T00:18:21.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.444+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbd40c1630 con 0x7fbbb805ef80 2023-08-22T00:18:21.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.449+0000 7fbbc97fa700 1 -- 172.21.15.98:0/2305505520 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbbd40c1630 con 0x7fbbb805ef80 2023-08-22T00:18:21.450 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-08-22T00:18:21.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 msgr2=0x7fbbb8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 0x7fbbb8061440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbbd000ba80 tx=0x7fbbd0008040).stop 2023-08-22T00:18:21.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 msgr2=0x7fbbd4163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fbbc4009130 tx=0x7fbbc4017000).stop 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 shutdown_connections 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbb805ef80 0x7fbbb8061440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd4153a40 0x7fbbd40a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd4066c00 0x7fbbd4140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 --2- 172.21.15.98:0/2305505520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd40c5460 0x7fbbd4163f70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 >> 172.21.15.98:0/2305505520 conn(0x7fbbd40c3990 msgr2=0x7fbbd40bd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 shutdown_connections 2023-08-22T00:18:21.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.451+0000 7fbbdb716700 1 -- 172.21.15.98:0/2305505520 wait complete. 2023-08-22T00:18:21.464 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-08-22T00:18:21.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-22T00:18:21.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.583+0000 7fe6b2036700 1 Processor -- start 2023-08-22T00:18:21.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.583+0000 7fe6b2036700 1 -- start start 2023-08-22T00:18:21.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6b2036700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe6ac153c80 0x7fe6ac1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6b2036700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac062600 con 0x7fe6ac154830 2023-08-22T00:18:21.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6b2036700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac1545e0 con 0x7fe6ac0a5910 2023-08-22T00:18:21.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6b2036700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac062f10 con 0x7fe6ac153c80 2023-08-22T00:18:21.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6aaffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe6ac154830 0x7fe6ac0c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50680/0 (socket says 172.21.15.98:50680) 2023-08-22T00:18:21.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.584+0000 7fe6aaffd700 1 -- 172.21.15.98:0/3319121954 learned_addr learned my addr 172.21.15.98:0/3319121954 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6abfff700 1 --2- 172.21.15.98:0/3319121954 >> v2:172.21.15.118:3300/0 conn(0x7fe6ac153c80 0x7fe6ac1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583183753 0 0) 0x7fe6ac062600 con 0x7fe6ac154830 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6980033f0 con 0x7fe6ac154830 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265434107 0 0) 0x7fe6980033f0 con 0x7fe6ac154830 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 >> v2:172.21.15.118:3300/0 conn(0x7fe6ac153c80 msgr2=0x7fe6ac1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 --2- 172.21.15.98:0/3319121954 >> v2:172.21.15.118:3300/0 conn(0x7fe6ac153c80 0x7fe6ac1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 >> v1:172.21.15.118:6789/0 conn(0x7fe6ac0a5910 legacy=0x7fe6ac0c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0c2d30 con 0x7fe6ac154830 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe69c001470 con 0x7fe6ac154830 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 >> v1:172.21.15.98:6789/0 conn(0x7fe6ac154830 legacy=0x7fe6ac0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 0x7fe698003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe698004690 0x7fe698004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe698005000 0x7fe69800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac062f10 con 0x7fe6980038e0 2023-08-22T00:18:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69800beb0 con 0x7fe698004690 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69800c070 con 0x7fe698005000 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 0x7fe698003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6aaffd700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe698004690 0x7fe698004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6abfff700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe698005000 0x7fe69800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 -- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe698005000 msgr2=0x7fe69800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe698005000 0x7fe69800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 -- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe698004690 msgr2=0x7fe698004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe698004690 0x7fe698004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6ab7fe700 1 -- 172.21.15.98:0/3319121954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6980033f0 con 0x7fe6980038e0 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.585+0000 7fe6abfff700 1 -- 172.21.15.98:0/3319121954 reap_dead start 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 0x7fe698003d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fe694001760 tx=0x7fe694007bb0).ready entity=mon.0 client_cookie=286184e89334116d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694007020 con 0x7fe6980038e0 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694007180 con 0x7fe6980038e0 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6aa7fc700 1 -- 172.21.15.98:0/3319121954 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694007520 con 0x7fe6980038e0 2023-08-22T00:18:21.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 -- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 msgr2=0x7fe698003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 0x7fe698003d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fe694001760 tx=0x7fe694007bb0).stop 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 -- 172.21.15.98:0/3319121954 shutdown_connections 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 --2- 172.21.15.98:0/3319121954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6980038e0 0x7fe698003d00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 -- 172.21.15.98:0/3319121954 >> 172.21.15.98:0/3319121954 conn(0x7fe6ac0c7170 msgr2=0x7fe6ac0c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 -- 172.21.15.98:0/3319121954 shutdown_connections 2023-08-22T00:18:21.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.586+0000 7fe6b2036700 1 -- 172.21.15.98:0/3319121954 wait complete. 2023-08-22T00:18:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 Processor -- start 2023-08-22T00:18:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 -- start start 2023-08-22T00:18:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 0x7fe6ac150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6ac151430 0x7fe6ac0a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0ab8d0 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0a5f70 con 0x7fe6ac151430 2023-08-22T00:18:21.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6b2036700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac151b90 con 0x7fe6980038e0 2023-08-22T00:18:21.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46074/0 (socket says 172.21.15.98:46074) 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.588+0000 7fe6abfff700 1 -- 172.21.15.98:0/1886142940 learned_addr learned my addr 172.21.15.98:0/1886142940 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6aaffd700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6ac151430 0x7fe6ac0a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 0x7fe6ac150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 -- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 msgr2=0x7fe6ac150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 0x7fe6ac150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 -- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6ac151430 msgr2=0x7fe6ac0a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6ac151430 0x7fe6ac0a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 -- 172.21.15.98:0/1886142940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac151e70 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 0x7fe6ac150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6abfff700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe6ac066ff0 tx=0x7fe6a400c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400f070 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4010040 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac152150 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4007c80 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.589+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac1518b0 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.590+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac0a63e0 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.590+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fe6a4016650 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.591+0000 7fe6a37fe700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 0x7fe68c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.591+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fe6a407a390 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.591+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 0x7fe68c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.591+0000 7fe6ab7fe700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 0x7fe68c061440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe694001540 tx=0x7fe694016000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.595+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6a404b4d0 con 0x7fe6ac0a6bd0 2023-08-22T00:18:21.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.782+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6ac047480 con 0x7fe68c05ef80 2023-08-22T00:18:21.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.787+0000 7fe6a37fe700 1 -- 172.21.15.98:0/1886142940 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe6ac047480 con 0x7fe68c05ef80 2023-08-22T00:18:21.789 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-08-22T00:18:21.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 msgr2=0x7fe68c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 0x7fe68c061440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe694001540 tx=0x7fe694016000).stop 2023-08-22T00:18:21.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 msgr2=0x7fe6ac0a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe6ac066ff0 tx=0x7fe6a400c040).stop 2023-08-22T00:18:21.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 shutdown_connections 2023-08-22T00:18:21.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe68c05ef80 0x7fe68c061440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6980038e0 0x7fe6ac150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6ac0a6bd0 0x7fe6ac0a7030 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 --2- 172.21.15.98:0/1886142940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6ac151430 0x7fe6ac0a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 >> 172.21.15.98:0/1886142940 conn(0x7fe6ac0c7170 msgr2=0x7fe6ac068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 shutdown_connections 2023-08-22T00:18:21.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.789+0000 7fe6b2036700 1 -- 172.21.15.98:0/1886142940 wait complete. 2023-08-22T00:18:21.801 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-08-22T00:18:21.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-22T00:18:21.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.921+0000 7fda35796700 1 Processor -- start 2023-08-22T00:18:21.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.921+0000 7fda35796700 1 -- start start 2023-08-22T00:18:21.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda35796700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda3014af10 0x7fda300c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda35796700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fda300c4430 0x7fda300aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda35796700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300c3ab0 con 0x7fda300aaff0 2023-08-22T00:18:21.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda35796700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda300a9270 con 0x7fda300c4430 2023-08-22T00:18:21.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda35796700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300a9550 con 0x7fda3014af10 2023-08-22T00:18:21.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fda300c4430 0x7fda300aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fda300c4430 0x7fda300aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46076/0 (socket says 172.21.15.98:46076) 2023-08-22T00:18:21.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 -- 172.21.15.98:0/1772244746 learned_addr learned my addr 172.21.15.98:0/1772244746 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:21.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2effd700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda3014af10 0x7fda300c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 -- 172.21.15.98:0/1772244746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda3014af10 msgr2=0x7fda300c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda3014af10 0x7fda300c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 -- 172.21.15.98:0/1772244746 >> v1:172.21.15.118:6789/0 conn(0x7fda300aaff0 legacy=0x7fda300bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 -- 172.21.15.98:0/1772244746 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300c3460 con 0x7fda300c4430 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.922+0000 7fda2e7fc700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300c4430 0x7fda300aab00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fda20006fd0 tx=0x7fda200090f0).ready entity=mon.0 client_cookie=f255189f98368750 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda2dffb700 1 -- 172.21.15.98:0/1772244746 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000b600 con 0x7fda300c4430 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda2dffb700 1 -- 172.21.15.98:0/1772244746 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2000b760 con 0x7fda300c4430 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda2dffb700 1 -- 172.21.15.98:0/1772244746 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000bae0 con 0x7fda300c4430 2023-08-22T00:18:21.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 -- 172.21.15.98:0/1772244746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300c4430 msgr2=0x7fda300aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300c4430 0x7fda300aab00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fda20006fd0 tx=0x7fda200090f0).stop 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 -- 172.21.15.98:0/1772244746 shutdown_connections 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda3014af10 0x7fda300c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 --2- 172.21.15.98:0/1772244746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300c4430 0x7fda300aab00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 -- 172.21.15.98:0/1772244746 >> 172.21.15.98:0/1772244746 conn(0x7fda300c5300 msgr2=0x7fda300c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 -- 172.21.15.98:0/1772244746 shutdown_connections 2023-08-22T00:18:21.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.923+0000 7fda35796700 1 -- 172.21.15.98:0/1772244746 wait complete. 2023-08-22T00:18:21.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.924+0000 7fda35796700 1 Processor -- start 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.924+0000 7fda35796700 1 -- start start 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda300c4430 0x7fda300ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda3014af10 0x7fda3014bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300acc30 con 0x7fda300aaff0 2023-08-22T00:18:21.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300ac020 con 0x7fda3014af10 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda35796700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300ac300 con 0x7fda300c4430 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46086/0 (socket says 172.21.15.98:46086) 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda2effd700 1 -- 172.21.15.98:0/2239758577 learned_addr learned my addr 172.21.15.98:0/2239758577 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda2f7fe700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda3014af10 0x7fda3014bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.925+0000 7fda2e7fc700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda300c4430 0x7fda300ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 -- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda300c4430 msgr2=0x7fda300ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda300c4430 0x7fda300ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 -- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda3014af10 msgr2=0x7fda3014bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda3014af10 0x7fda3014bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 -- 172.21.15.98:0/2239758577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009370 con 0x7fda300aaff0 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda2effd700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fda2400d860 tx=0x7fda24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011590 con 0x7fda300aaff0 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240116f0 con 0x7fda300aaff0 2023-08-22T00:18:21.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011a70 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda300ac5e0 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.926+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda30148aa0 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.927+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda30047480 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.927+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fda24012420 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.927+0000 7fda16ffd700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 0x7fda1c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.927+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fda24079c20 con 0x7fda300aaff0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.928+0000 7fda2e7fc700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 0x7fda1c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:21.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.928+0000 7fda2e7fc700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 0x7fda1c061440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fda30062fd0 tx=0x7fda20017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:21.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:21.932+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda2404ac50 con 0x7fda300aaff0 2023-08-22T00:18:22.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.119+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fda300acd70 con 0x7fda1c05ef80 2023-08-22T00:18:22.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.123+0000 7fda16ffd700 1 -- 172.21.15.98:0/2239758577 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fda20006bb0 con 0x7fda1c05ef80 2023-08-22T00:18:22.124 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-08-22T00:18:22.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 msgr2=0x7fda1c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 0x7fda1c061440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fda30062fd0 tx=0x7fda20017000).stop 2023-08-22T00:18:22.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 msgr2=0x7fda301485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fda2400d860 tx=0x7fda24008040).stop 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 shutdown_connections 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda3014af10 0x7fda3014bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda300aaff0 0x7fda301485b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fda1c05ef80 0x7fda1c061440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 --2- 172.21.15.98:0/2239758577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda300c4430 0x7fda300ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.124+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 >> 172.21.15.98:0/2239758577 conn(0x7fda300c5300 msgr2=0x7fda300c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.125+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 shutdown_connections 2023-08-22T00:18:22.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.125+0000 7fda35796700 1 -- 172.21.15.98:0/2239758577 wait complete. 2023-08-22T00:18:22.137 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-08-22T00:18:22.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:22.139 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-22T00:18:22.162 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:22.164 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:22.164 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:22.164 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:22.164 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:22.166 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:22.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-08-22T00:18:22.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.321+0000 7f9b01d7c700 1 Processor -- start 2023-08-22T00:18:22.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.321+0000 7f9b01d7c700 1 -- start start 2023-08-22T00:18:22.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9b01d7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc151100 0x7f9afc064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9b01d7c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9afc151bf0 0x7f9afc0bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9b01d7c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc064f50 con 0x7f9afc065530 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9b01d7c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0aa190 con 0x7f9afc151bf0 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9b01d7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0bdfe0 con 0x7f9afc151100 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9afc151bf0 0x7f9afc0bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afaffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9afc065530 0x7f9afc1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50696/0 (socket says 172.21.15.98:50696) 2023-08-22T00:18:22.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afaffd700 1 -- 172.21.15.98:0/1782120150 learned_addr learned my addr 172.21.15.98:0/1782120150 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afb7fe700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc151100 0x7f9afc064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 -- 172.21.15.98:0/1782120150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc151100 msgr2=0x7f9afc064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc151100 0x7f9afc064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 -- 172.21.15.98:0/1782120150 >> v1:172.21.15.98:6789/0 conn(0x7f9afc065530 legacy=0x7f9afc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afa7fc700 1 -- 172.21.15.98:0/1782120150 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050833713 0 0) 0x7f9aec001110 con 0x7f9afc065530 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 -- 172.21.15.98:0/1782120150 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0645d0 con 0x7f9afc151bf0 2023-08-22T00:18:22.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.322+0000 7f9afbfff700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151bf0 0x7f9afc0bc6f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9af400d0d0 tx=0x7f9af400b990).ready entity=mon.0 client_cookie=eefffaaa13477c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9afa7fc700 1 -- 172.21.15.98:0/1782120150 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4010070 con 0x7f9afc151bf0 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9afa7fc700 1 -- 172.21.15.98:0/1782120150 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af400b2e0 con 0x7f9afc151bf0 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9afa7fc700 1 -- 172.21.15.98:0/1782120150 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400dd40 con 0x7f9afc151bf0 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1782120150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151bf0 msgr2=0x7f9afc0bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151bf0 0x7f9afc0bc6f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9af400d0d0 tx=0x7f9af400b990).stop 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1782120150 shutdown_connections 2023-08-22T00:18:22.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151bf0 0x7f9afc0bc6f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1782120150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc151100 0x7f9afc064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1782120150 >> 172.21.15.98:0/1782120150 conn(0x7f9afc06a910 msgr2=0x7f9afc065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1782120150 shutdown_connections 2023-08-22T00:18:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.323+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1782120150 wait complete. 2023-08-22T00:18:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.324+0000 7f9b01d7c700 1 Processor -- start 2023-08-22T00:18:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.324+0000 7f9b01d7c700 1 -- start start 2023-08-22T00:18:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc065530 0x7f9afc0c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9afc151bf0 0x7f9afc164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0c1240 con 0x7f9afc151100 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0c0a70 con 0x7f9afc151bf0 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9b01d7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14ff70 con 0x7f9afc065530 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9afaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9afaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46108/0 (socket says 172.21.15.98:46108) 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.325+0000 7f9afaffd700 1 -- 172.21.15.98:0/1282861666 learned_addr learned my addr 172.21.15.98:0/1282861666 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 -- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc065530 msgr2=0x7f9afc0c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc065530 0x7f9afc0c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 -- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9afc151bf0 msgr2=0x7f9afc164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afbfff700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9afc151bf0 0x7f9afc164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9afc151bf0 0x7f9afc164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 -- 172.21.15.98:0/1282861666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af400bc30 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9afaffd700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9aec00c4e0 tx=0x7f9aec007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0072e0 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec007440 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc164200 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0057a0 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.326+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc0c0c80 con 0x7f9afc151100 2023-08-22T00:18:22.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.327+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc047480 con 0x7f9afc151100 2023-08-22T00:18:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.327+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f9aec005b90 con 0x7f9afc151100 2023-08-22T00:18:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.327+0000 7f9ae37fe700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 0x7f9ae8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.328+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f9aec0799c0 con 0x7f9afc151100 2023-08-22T00:18:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.328+0000 7f9afb7fe700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 0x7f9ae8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.328+0000 7f9afb7fe700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 0x7f9ae8061440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9afc150310 tx=0x7f9af0009060).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.332+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9aec04aa50 con 0x7f9afc151100 2023-08-22T00:18:22.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.517+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9afc064f50 con 0x7f9ae805ef80 2023-08-22T00:18:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.519+0000 7f9ae37fe700 1 -- 172.21.15.98:0/1282861666 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9afc064f50 con 0x7f9ae805ef80 2023-08-22T00:18:22.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:22.520 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:29", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 msgr2=0x7f9ae8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 0x7f9ae8061440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9afc150310 tx=0x7f9af0009060).stop 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 msgr2=0x7f9afc14fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9aec00c4e0 tx=0x7f9aec007ab0).stop 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 shutdown_connections 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ae805ef80 0x7f9ae8061440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9afc065530 0x7f9afc0c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9afc151bf0 0x7f9afc164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 --2- 172.21.15.98:0/1282861666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9afc151100 0x7f9afc14fa80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 >> 172.21.15.98:0/1282861666 conn(0x7f9afc06a910 msgr2=0x7f9afc0a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 shutdown_connections 2023-08-22T00:18:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.520+0000 7f9b01d7c700 1 -- 172.21.15.98:0/1282861666 wait complete. 2023-08-22T00:18:22.533 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:29", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:22.533 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:29', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:22.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:22.534 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-22T00:18:22.556 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:22.559 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:22.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-08-22T00:18:22.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.715+0000 7f3f6fbb6700 1 Processor -- start 2023-08-22T00:18:22.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.715+0000 7f3f6fbb6700 1 -- start start 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6fbb6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3f68064440 0x7f3f680c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6fbb6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f680c2d60 0x7f3f68153820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6fbb6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6806a880 con 0x7f3f68064060 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6fbb6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680c6330 con 0x7f3f680c2d60 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6fbb6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680c31d0 con 0x7f3f68064440 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6e153700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f680c2d60 0x7f3f68153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6e153700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f680c2d60 0x7f3f68153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46116/0 (socket says 172.21.15.98:46116) 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.716+0000 7f3f6e153700 1 -- 172.21.15.98:0/1482134849 learned_addr learned my addr 172.21.15.98:0/1482134849 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6d151700 1 --2- 172.21.15.98:0/1482134849 >> v2:172.21.15.118:3300/0 conn(0x7f3f68064440 0x7f3f680c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6e153700 1 -- 172.21.15.98:0/1482134849 >> v2:172.21.15.118:3300/0 conn(0x7f3f68064440 msgr2=0x7f3f680c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6e153700 1 --2- 172.21.15.98:0/1482134849 >> v2:172.21.15.118:3300/0 conn(0x7f3f68064440 0x7f3f680c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6e153700 1 -- 172.21.15.98:0/1482134849 >> v1:172.21.15.118:6789/0 conn(0x7f3f68064060 legacy=0x7f3f680c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6e153700 1 -- 172.21.15.98:0/1482134849 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680c33e0 con 0x7f3f680c2d60 2023-08-22T00:18:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6e153700 1 --2- 172.21.15.98:0/1482134849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68153820 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3f680c6e70 tx=0x7f3f60009840).ready entity=mon.0 client_cookie=b01918ccbef4926f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6c950700 1 -- 172.21.15.98:0/1482134849 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000e070 con 0x7f3f680c2d60 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6c950700 1 -- 172.21.15.98:0/1482134849 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6000ba10 con 0x7f3f680c2d60 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6c950700 1 -- 172.21.15.98:0/1482134849 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000bd90 con 0x7f3f680c2d60 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/1482134849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 msgr2=0x7f3f68153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/1482134849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68153820 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3f680c6e70 tx=0x7f3f60009840).stop 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/1482134849 shutdown_connections 2023-08-22T00:18:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/1482134849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68153820 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.717+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/1482134849 >> v2:172.21.15.118:3300/0 conn(0x7f3f68064440 0x7f3f680c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.718+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/1482134849 >> 172.21.15.98:0/1482134849 conn(0x7f3f680c4470 msgr2=0x7f3f680695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:22.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.718+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/1482134849 shutdown_connections 2023-08-22T00:18:22.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.718+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/1482134849 wait complete. 2023-08-22T00:18:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 Processor -- start 2023-08-22T00:18:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 -- start start 2023-08-22T00:18:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f68064060 0x7f3f68146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 0x7f3f680bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680c0af0 con 0x7f3f680c2d60 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6814e330 con 0x7f3f68064440 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.719+0000 7f3f6fbb6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680c0810 con 0x7f3f68064060 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46126/0 (socket says 172.21.15.98:46126) 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 -- 172.21.15.98:0/3969228289 learned_addr learned my addr 172.21.15.98:0/3969228289 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6d952700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f68064060 0x7f3f68146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6d151700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 0x7f3f680bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 -- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f68064060 msgr2=0x7f3f68146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f68064060 0x7f3f68146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 -- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 msgr2=0x7f3f680bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 0x7f3f680bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 -- 172.21.15.98:0/3969228289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60009ae0 con 0x7f3f680c2d60 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6d151700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 0x7f3f680bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:22.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6e153700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3f60009540 tx=0x7f3f60009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f60013e90 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6001d470 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6814dce0 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6001d810 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.720+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f68152800 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.721+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6814db40 con 0x7f3f680c2d60 2023-08-22T00:18:22.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.722+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f3f6001dc00 con 0x7f3f680c2d60 2023-08-22T00:18:22.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.722+0000 7f3f5dffb700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 0x7f3f4c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:22.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.722+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f3f6007c2d0 con 0x7f3f680c2d60 2023-08-22T00:18:22.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.722+0000 7f3f6d952700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 0x7f3f4c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:22.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.722+0000 7f3f6d952700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 0x7f3f4c061440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3f580036e0 tx=0x7f3f58009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:22.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.726+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f6814db40 con 0x7f3f680c2d60 2023-08-22T00:18:22.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.911+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f6814db40 con 0x7f3f4c05ef80 2023-08-22T00:18:22.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.912+0000 7f3f5dffb700 1 -- 172.21.15.98:0/3969228289 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3f6814db40 con 0x7f3f4c05ef80 2023-08-22T00:18:22.913 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:22.914 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:22.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 msgr2=0x7f3f4c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 0x7f3f4c061440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3f580036e0 tx=0x7f3f58009040).stop 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 msgr2=0x7f3f68062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3f60009540 tx=0x7f3f60009840).stop 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 shutdown_connections 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f4c05ef80 0x7f3f4c061440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f68064060 0x7f3f68146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f680c2d60 0x7f3f68062600 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 --2- 172.21.15.98:0/3969228289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f68064440 0x7f3f680bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:22.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 >> 172.21.15.98:0/3969228289 conn(0x7f3f680c4470 msgr2=0x7f3f68149a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:22.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 shutdown_connections 2023-08-22T00:18:22.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:22.914+0000 7f3f6fbb6700 1 -- 172.21.15.98:0/3969228289 wait complete. 2023-08-22T00:18:22.927 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:22.927 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:30', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:22.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:22.928 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-22T00:18:22.951 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:22.951 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:22.951 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:22.951 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:22.951 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:22.952 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:22.953 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:22.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-08-22T00:18:23.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.109+0000 7fd0abb16700 1 Processor -- start 2023-08-22T00:18:23.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.109+0000 7fd0abb16700 1 -- start start 2023-08-22T00:18:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0abb16700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0a40a5910 0x7fd0a4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0abb16700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a4062600 con 0x7fd0a4153c80 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0abb16700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40c2d30 con 0x7fd0a40c4260 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0abb16700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a4062f10 con 0x7fd0a40a5910 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0a40a5910 0x7fd0a4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0a40a5910 0x7fd0a4154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46136/0 (socket says 172.21.15.98:46136) 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 -- 172.21.15.98:0/1934491942 learned_addr learned my addr 172.21.15.98:0/1934491942 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0aa0b3700 1 --1- 172.21.15.98:0/1934491942 >> v1:172.21.15.98:6789/0 conn(0x7fd0a4153c80 0x7fd0a4063330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50706/0 (socket says 172.21.15.98:50706) 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 -- 172.21.15.98:0/1934491942 >> v1:172.21.15.118:6789/0 conn(0x7fd0a40c4260 legacy=0x7fd0a40c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 -- 172.21.15.98:0/1934491942 >> v1:172.21.15.98:6789/0 conn(0x7fd0a4153c80 legacy=0x7fd0a4063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 -- 172.21.15.98:0/1934491942 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4062850 con 0x7fd0a40a5910 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a88b0700 1 -- 172.21.15.98:0/1934491942 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431922560 0 0) 0x7fd0a4062600 con 0x7fd0a4153c80 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a98b2700 1 --2- 172.21.15.98:0/1934491942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40a5910 0x7fd0a4154830 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fd0a0006fd0 tx=0x7fd0a00090f0).ready entity=mon.0 client_cookie=2fbbb399592a2b22 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.110+0000 7fd0a88b0700 1 -- 172.21.15.98:0/1934491942 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000b600 con 0x7fd0a40a5910 2023-08-22T00:18:23.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0a88b0700 1 -- 172.21.15.98:0/1934491942 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a000b760 con 0x7fd0a40a5910 2023-08-22T00:18:23.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0a88b0700 1 -- 172.21.15.98:0/1934491942 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000bae0 con 0x7fd0a40a5910 2023-08-22T00:18:23.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 -- 172.21.15.98:0/1934491942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40a5910 msgr2=0x7fd0a4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 --2- 172.21.15.98:0/1934491942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40a5910 0x7fd0a4154830 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fd0a0006fd0 tx=0x7fd0a00090f0).stop 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 -- 172.21.15.98:0/1934491942 shutdown_connections 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 --2- 172.21.15.98:0/1934491942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40a5910 0x7fd0a4154830 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 -- 172.21.15.98:0/1934491942 >> 172.21.15.98:0/1934491942 conn(0x7fd0a40c7170 msgr2=0x7fd0a40c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 -- 172.21.15.98:0/1934491942 shutdown_connections 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.111+0000 7fd0abb16700 1 -- 172.21.15.98:0/1934491942 wait complete. 2023-08-22T00:18:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.112+0000 7fd0abb16700 1 Processor -- start 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.112+0000 7fd0abb16700 1 -- start start 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a40a5910 0x7fd0a4161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a40c4260 0x7fd0a4149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40be510 con 0x7fd0a4153c80 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40bd900 con 0x7fd0a40a5910 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0abb16700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40bdbe0 con 0x7fd0a40c4260 2023-08-22T00:18:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46144/0 (socket says 172.21.15.98:46144) 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 -- 172.21.15.98:0/3451854235 learned_addr learned my addr 172.21.15.98:0/3451854235 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0a98b2700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a40a5910 0x7fd0a4161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0a90b1700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a40c4260 0x7fd0a4149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 -- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a40c4260 msgr2=0x7fd0a4149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a40c4260 0x7fd0a4149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 -- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a40a5910 msgr2=0x7fd0a4161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a40a5910 0x7fd0a4161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.113+0000 7fd0aa0b3700 1 -- 172.21.15.98:0/3451854235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0009370 con 0x7fd0a4153c80 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd0aa0b3700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd09c00c730 tx=0x7fd09c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c005c70 con 0x7fd0a4153c80 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c005dd0 con 0x7fd0a4153c80 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40bdec0 con 0x7fd0a4153c80 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c007300 con 0x7fd0a4153c80 2023-08-22T00:18:23.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.114+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40bcff0 con 0x7fd0a4153c80 2023-08-22T00:18:23.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.115+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4047480 con 0x7fd0a4153c80 2023-08-22T00:18:23.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.115+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fd09c0076b0 con 0x7fd0a4153c80 2023-08-22T00:18:23.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.116+0000 7fd099ffb700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 0x7fd088061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.116+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fd09c079cd0 con 0x7fd0a4153c80 2023-08-22T00:18:23.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.116+0000 7fd0a98b2700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 0x7fd088061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.116+0000 7fd0a98b2700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 0x7fd088061440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd0a0009130 tx=0x7fd0a0017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.120+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd09c04aca0 con 0x7fd0a4153c80 2023-08-22T00:18:23.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.305+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0a40bd210 con 0x7fd08805ef80 2023-08-22T00:18:23.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.306+0000 7fd099ffb700 1 -- 172.21.15.98:0/3451854235 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd0a40bd210 con 0x7fd08805ef80 2023-08-22T00:18:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:23.307 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:23.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 msgr2=0x7fd088061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 0x7fd088061440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd0a0009130 tx=0x7fd0a0017000).stop 2023-08-22T00:18:23.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 msgr2=0x7fd0a40bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd09c00c730 tx=0x7fd09c001520).stop 2023-08-22T00:18:23.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 shutdown_connections 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a4153c80 0x7fd0a40bf410 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a40a5910 0x7fd0a4161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd08805ef80 0x7fd088061440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 --2- 172.21.15.98:0/3451854235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a40c4260 0x7fd0a4149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 >> 172.21.15.98:0/3451854235 conn(0x7fd0a40c7170 msgr2=0x7fd0a41540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 shutdown_connections 2023-08-22T00:18:23.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.308+0000 7fd0abb16700 1 -- 172.21.15.98:0/3451854235 wait complete. 2023-08-22T00:18:23.321 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:23.322 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:30', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:23.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:23.323 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-22T00:18:23.346 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:23.346 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:23.348 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:23.348 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:23.348 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:23.348 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:23.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-08-22T00:18:23.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.504+0000 7ff50646c700 1 Processor -- start 2023-08-22T00:18:23.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.504+0000 7ff50646c700 1 -- start start 2023-08-22T00:18:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff50646c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff500067cc0 0x7ff5000c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff50646c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000c6580 con 0x7ff5001541d0 2023-08-22T00:18:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff50646c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50014e740 con 0x7ff50014e360 2023-08-22T00:18:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff50646c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000645a0 con 0x7ff500067cc0 2023-08-22T00:18:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff4ff7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff5001541d0 0x7ff5000675b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50710/0 (socket says 172.21.15.98:50710) 2023-08-22T00:18:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.505+0000 7ff4ff7fe700 1 -- 172.21.15.98:0/3454336086 learned_addr learned my addr 172.21.15.98:0/3454336086 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff504a09700 1 --2- 172.21.15.98:0/3454336086 >> v2:172.21.15.118:3300/0 conn(0x7ff500067cc0 0x7ff5000c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883173279 0 0) 0x7ff5000c6580 con 0x7ff5001541d0 2023-08-22T00:18:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e80033f0 con 0x7ff5001541d0 2023-08-22T00:18:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202638104 0 0) 0x7ff50014e740 con 0x7ff50014e360 2023-08-22T00:18:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5000c6580 con 0x7ff50014e360 2023-08-22T00:18:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 544814245 0 0) 0x7ff4e80033f0 con 0x7ff5001541d0 2023-08-22T00:18:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 >> v2:172.21.15.118:3300/0 conn(0x7ff500067cc0 msgr2=0x7ff5000c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:23.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 --2- 172.21.15.98:0/3454336086 >> v2:172.21.15.118:3300/0 conn(0x7ff500067cc0 0x7ff5000c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 >> v1:172.21.15.118:6789/0 conn(0x7ff50014e360 legacy=0x7ff500063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000c3270 con 0x7ff5001541d0 2023-08-22T00:18:23.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff4f0001470 con 0x7ff5001541d0 2023-08-22T00:18:23.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 >> v1:172.21.15.98:6789/0 conn(0x7ff5001541d0 legacy=0x7ff5000675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 0x7ff4e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8004690 0x7ff4e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e8005000 0x7ff4e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000645a0 con 0x7ff4e8003a70 2023-08-22T00:18:23.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e800be80 con 0x7ff4e8004690 2023-08-22T00:18:23.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e800c040 con 0x7ff4e8005000 2023-08-22T00:18:23.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 0x7ff4e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4ff7fe700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8004690 0x7ff4e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff504a09700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e8005000 0x7ff4e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 -- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e8005000 msgr2=0x7ff4e800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e8005000 0x7ff4e800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 -- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8004690 msgr2=0x7ff4e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8004690 0x7ff4e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 -- 172.21.15.98:0/3454336086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80033f0 con 0x7ff4e8003a70 2023-08-22T00:18:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff504a09700 1 -- 172.21.15.98:0/3454336086 reap_dead start 2023-08-22T00:18:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4ff7fe700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8004690 0x7ff4e8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.506+0000 7ff4fffff700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 0x7ff4e8003e70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff4f4001860 tx=0x7ff4f4007bb0).ready entity=mon.0 client_cookie=b32afe164a75bafa server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4007020 con 0x7ff4e8003a70 2023-08-22T00:18:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4007180 con 0x7ff4e8003a70 2023-08-22T00:18:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff4feffd700 1 -- 172.21.15.98:0/3454336086 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4007500 con 0x7ff4e8003a70 2023-08-22T00:18:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 -- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 msgr2=0x7ff4e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 0x7ff4e8003e70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff4f4001860 tx=0x7ff4f4007bb0).stop 2023-08-22T00:18:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 -- 172.21.15.98:0/3454336086 shutdown_connections 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 --2- 172.21.15.98:0/3454336086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8003a70 0x7ff4e8003e70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 -- 172.21.15.98:0/3454336086 >> 172.21.15.98:0/3454336086 conn(0x7ff500066a70 msgr2=0x7ff5000c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 -- 172.21.15.98:0/3454336086 shutdown_connections 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.507+0000 7ff50646c700 1 -- 172.21.15.98:0/3454336086 wait complete. 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.508+0000 7ff50646c700 1 Processor -- start 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.508+0000 7ff50646c700 1 -- start start 2023-08-22T00:18:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8003a70 0x7ff50014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff500158e70 0x7ff500157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50014b9a0 con 0x7ff500166fe0 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001678e0 con 0x7ff4e8003a70 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff50646c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500167bc0 con 0x7ff500158e70 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff504a09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff504a09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46172/0 (socket says 172.21.15.98:46172) 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff504a09700 1 -- 172.21.15.98:0/1681684813 learned_addr learned my addr 172.21.15.98:0/1681684813 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff4fffff700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8003a70 0x7ff50014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.509+0000 7ff4ff7fe700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff500158e70 0x7ff500157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 -- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff500158e70 msgr2=0x7ff500157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff500158e70 0x7ff500157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 -- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8003a70 msgr2=0x7ff50014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8003a70 0x7ff50014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 -- 172.21.15.98:0/1681684813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500157750 con 0x7ff500166fe0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff504a09700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff50005fc70 tx=0x7ff4f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800e070 con 0x7ff500166fe0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8011b80 con 0x7ff500166fe0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8016450 con 0x7ff500166fe0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff500157a30 con 0x7ff500166fe0 2023-08-22T00:18:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.510+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500167460 con 0x7ff500166fe0 2023-08-22T00:18:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.511+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7ff4f801f3b0 con 0x7ff500166fe0 2023-08-22T00:18:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.511+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500047480 con 0x7ff500166fe0 2023-08-22T00:18:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.511+0000 7ff4e7fff700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 0x7ff4ec061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.512+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7ff4f807a6e0 con 0x7ff500166fe0 2023-08-22T00:18:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.512+0000 7ff4fffff700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 0x7ff4ec061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.512+0000 7ff4fffff700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 0x7ff4ec061440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff4f4007cc0 tx=0x7ff4f4015000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.516+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4f804b7c0 con 0x7ff500166fe0 2023-08-22T00:18:23.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.699+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5001547e0 con 0x7ff4ec05ef80 2023-08-22T00:18:23.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.700+0000 7ff4e7fff700 1 -- 172.21.15.98:0/1681684813 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff5001547e0 con 0x7ff4ec05ef80 2023-08-22T00:18:23.702 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:23.702 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 msgr2=0x7ff4ec061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 0x7ff4ec061440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff4f4007cc0 tx=0x7ff4f4015000).stop 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 msgr2=0x7ff5000bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff50005fc70 tx=0x7ff4f800b040).stop 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 shutdown_connections 2023-08-22T00:18:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff500166fe0 0x7ff5000bd6a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8003a70 0x7ff50014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff4ec05ef80 0x7ff4ec061440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 --2- 172.21.15.98:0/1681684813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff500158e70 0x7ff500157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.702+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 >> 172.21.15.98:0/1681684813 conn(0x7ff500066a70 msgr2=0x7ff50014d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.703+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 shutdown_connections 2023-08-22T00:18:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.703+0000 7ff50646c700 1 -- 172.21.15.98:0/1681684813 wait complete. 2023-08-22T00:18:23.715 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:30", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:23.715 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:30', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:23.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:23.716 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-22T00:18:23.738 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:23.738 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:23.740 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:23.740 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:23.740 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:23.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-08-22T00:18:23.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.896+0000 7ff3a7b1f700 1 Processor -- start 2023-08-22T00:18:23.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.897+0000 7ff3a7b1f700 1 -- start start 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a7b1f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3a00643d0 0x7ff3a0150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a7b1f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00c37b0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a7b1f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a0151150 con 0x7ff3a0150670 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a7b1f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a0150f40 con 0x7ff3a00643d0 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a50ba700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff3a00c4b00 0x7ff3a0063cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50722/0 (socket says 172.21.15.98:50722) 2023-08-22T00:18:23.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a50ba700 1 -- 172.21.15.98:0/2452377370 learned_addr learned my addr 172.21.15.98:0/2452377370 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a60bc700 1 --2- 172.21.15.98:0/2452377370 >> v2:172.21.15.118:3300/0 conn(0x7ff3a00643d0 0x7ff3a0150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148292142 0 0) 0x7ff3a00c37b0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38c0033f0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618109004 0 0) 0x7ff3a0151150 con 0x7ff3a0150670 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a00c37b0 con 0x7ff3a0150670 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 857454201 0 0) 0x7ff38c0033f0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a60bc700 1 -- 172.21.15.98:0/2452377370 >> v1:172.21.15.118:6789/0 conn(0x7ff3a0150670 legacy=0x7ff3a0065c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a60bc700 1 -- 172.21.15.98:0/2452377370 >> v1:172.21.15.98:6789/0 conn(0x7ff3a00c4b00 legacy=0x7ff3a0063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a60bc700 1 -- 172.21.15.98:0/2452377370 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0151430 con 0x7ff3a00643d0 2023-08-22T00:18:23.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.898+0000 7ff3a60bc700 1 --2- 172.21.15.98:0/2452377370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0150a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff398009e60 tx=0x7ff398009780).ready entity=mon.1 client_cookie=16cb83083ae192fe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800e070 con 0x7ff3a00643d0 2023-08-22T00:18:23.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800b7a0 con 0x7ff3a00643d0 2023-08-22T00:18:23.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a48b9700 1 -- 172.21.15.98:0/2452377370 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c001470 con 0x7ff3a00643d0 2023-08-22T00:18:23.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/2452377370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 msgr2=0x7ff3a0150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/2452377370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0150a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff398009e60 tx=0x7ff398009780).stop 2023-08-22T00:18:23.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/2452377370 shutdown_connections 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/2452377370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0150a50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/2452377370 >> 172.21.15.98:0/2452377370 conn(0x7ff3a00c4470 msgr2=0x7ff3a0065560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/2452377370 shutdown_connections 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.899+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/2452377370 wait complete. 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.900+0000 7ff3a7b1f700 1 Processor -- start 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.900+0000 7ff3a7b1f700 1 -- start start 2023-08-22T00:18:23.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a0150670 0x7ff3a0154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0155a20 con 0x7ff3a00c4b00 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0154e10 con 0x7ff3a00643d0 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a7b1f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01550f0 con 0x7ff3a0150670 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a50ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a50ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46186/0 (socket says 172.21.15.98:46186) 2023-08-22T00:18:23.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a50ba700 1 -- 172.21.15.98:0/1054413761 learned_addr learned my addr 172.21.15.98:0/1054413761 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:23.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a60bc700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a0150670 0x7ff3a0154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.901+0000 7ff3a58bb700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 -- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a0150670 msgr2=0x7ff3a0154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a0150670 0x7ff3a0154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 -- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 msgr2=0x7ff3a0155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 -- 172.21.15.98:0/1054413761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009a20 con 0x7ff3a00c4b00 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a50ba700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff39c00c740 tx=0x7ff39c001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c007320 con 0x7ff3a00c4b00 2023-08-22T00:18:23.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c007480 con 0x7ff3a00c4b00 2023-08-22T00:18:23.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a01553d0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0059d0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.902+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a01563a0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.903+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a0155bd0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.903+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7ff39c013410 con 0x7ff3a00c4b00 2023-08-22T00:18:23.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.904+0000 7ff395ffb700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 0x7ff384061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:23.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.904+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7ff39c07a3f0 con 0x7ff3a00c4b00 2023-08-22T00:18:23.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.904+0000 7ff3a58bb700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 0x7ff384061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:23.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.904+0000 7ff3a58bb700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 0x7ff384061440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff390003660 tx=0x7ff390009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:23.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:23.908+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3a0155bd0 con 0x7ff3a00c4b00 2023-08-22T00:18:24.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.091+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3a014dee0 con 0x7ff38405ef80 2023-08-22T00:18:24.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.092+0000 7ff395ffb700 1 -- 172.21.15.98:0/1054413761 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff3a014dee0 con 0x7ff38405ef80 2023-08-22T00:18:24.093 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:24.093 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:31", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 msgr2=0x7ff384061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 0x7ff384061440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff390003660 tx=0x7ff390009040).stop 2023-08-22T00:18:24.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 msgr2=0x7ff3a014e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff39c00c740 tx=0x7ff39c001a00).stop 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 shutdown_connections 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff38405ef80 0x7ff384061440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3a0150670 0x7ff3a0154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3a00643d0 0x7ff3a0155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 --2- 172.21.15.98:0/1054413761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a00c4b00 0x7ff3a014e640 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 >> 172.21.15.98:0/1054413761 conn(0x7ff3a00c4470 msgr2=0x7ff3a0148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:24.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 shutdown_connections 2023-08-22T00:18:24.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.094+0000 7ff3a7b1f700 1 -- 172.21.15.98:0/1054413761 wait complete. 2023-08-22T00:18:24.106 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:31", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.107 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:31', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:24.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:24.108 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-22T00:18:24.130 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:24.130 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:24.131 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:24.132 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:24.132 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:24.132 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:24.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-08-22T00:18:24.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.288+0000 7efee2069700 1 Processor -- start 2023-08-22T00:18:24.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.288+0000 7efee2069700 1 -- start start 2023-08-22T00:18:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.289+0000 7efee2069700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efedc151100 0x7efedc064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efee2069700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc064f50 con 0x7efedc151bf0 2023-08-22T00:18:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efee2069700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc0aa190 con 0x7efedc065530 2023-08-22T00:18:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efee2069700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc0bdfe0 con 0x7efedc151100 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efedc151100 0x7efedc064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedbfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efedc151bf0 0x7efedc0bc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50730/0 (socket says 172.21.15.98:50730) 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efedc151100 0x7efedc064a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46196/0 (socket says 172.21.15.98:46196) 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedbfff700 1 -- 172.21.15.98:0/1218338505 learned_addr learned my addr 172.21.15.98:0/1218338505 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 -- 172.21.15.98:0/1218338505 >> v1:172.21.15.118:6789/0 conn(0x7efedc065530 legacy=0x7efedc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 -- 172.21.15.98:0/1218338505 >> v1:172.21.15.98:6789/0 conn(0x7efedc151bf0 legacy=0x7efedc0bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 -- 172.21.15.98:0/1218338505 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc0645d0 con 0x7efedc151100 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efeda7fc700 1 -- 172.21.15.98:0/1218338505 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706339543 0 0) 0x7efed4001490 con 0x7efedc151bf0 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efedb7fe700 1 --2- 172.21.15.98:0/1218338505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc151100 0x7efedc064a60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7efec4009760 tx=0x7efec4009060).ready entity=mon.0 client_cookie=9145fab24d862fa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efeda7fc700 1 -- 172.21.15.98:0/1218338505 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400b520 con 0x7efedc151100 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efeda7fc700 1 -- 172.21.15.98:0/1218338505 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400b680 con 0x7efedc151100 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.290+0000 7efeda7fc700 1 -- 172.21.15.98:0/1218338505 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400ba00 con 0x7efedc151100 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 -- 172.21.15.98:0/1218338505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc151100 msgr2=0x7efedc064a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 --2- 172.21.15.98:0/1218338505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc151100 0x7efedc064a60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7efec4009760 tx=0x7efec4009060).stop 2023-08-22T00:18:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 -- 172.21.15.98:0/1218338505 shutdown_connections 2023-08-22T00:18:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 --2- 172.21.15.98:0/1218338505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc151100 0x7efedc064a60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 -- 172.21.15.98:0/1218338505 >> 172.21.15.98:0/1218338505 conn(0x7efedc06a910 msgr2=0x7efedc065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 -- 172.21.15.98:0/1218338505 shutdown_connections 2023-08-22T00:18:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.291+0000 7efee2069700 1 -- 172.21.15.98:0/1218338505 wait complete. 2023-08-22T00:18:24.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.292+0000 7efee2069700 1 Processor -- start 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.292+0000 7efee2069700 1 -- start start 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc151100 0x7efedc0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc151bf0 0x7efedc152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1633c0 con 0x7efedc065530 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0beba0 con 0x7efedc151100 2023-08-22T00:18:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efee2069700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc163180 con 0x7efedc151bf0 2023-08-22T00:18:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46210/0 (socket says 172.21.15.98:46210) 2023-08-22T00:18:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 -- 172.21.15.98:0/170742498 learned_addr learned my addr 172.21.15.98:0/170742498 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedbfff700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc151bf0 0x7efedc152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedaffd700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc151100 0x7efedc0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 -- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc151bf0 msgr2=0x7efedc152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc151bf0 0x7efedc152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 -- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc151100 msgr2=0x7efedc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc151100 0x7efedc0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 -- 172.21.15.98:0/170742498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40092a0 con 0x7efedc065530 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.293+0000 7efedb7fe700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7efec4006d70 tx=0x7efec4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.294+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400b7f0 con 0x7efedc065530 2023-08-22T00:18:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.294+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400b950 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.294+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc165cc0 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.294+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec401b620 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.294+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc166280 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.295+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc047480 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.295+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7efec401ba10 con 0x7efedc065530 2023-08-22T00:18:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.295+0000 7efed37fe700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 0x7efebc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.295+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7efec407bfa0 con 0x7efedc065530 2023-08-22T00:18:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.295+0000 7efedaffd700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 0x7efebc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.296+0000 7efedaffd700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 0x7efebc061440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efecc0036e0 tx=0x7efecc009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.299+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efec404d0f0 con 0x7efedc065530 2023-08-22T00:18:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.486+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efedc06b3e0 con 0x7efebc05ef80 2023-08-22T00:18:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.487+0000 7efed37fe700 1 -- 172.21.15.98:0/170742498 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7efedc06b3e0 con 0x7efebc05ef80 2023-08-22T00:18:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:24.490 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:31", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 msgr2=0x7efebc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 0x7efebc061440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efecc0036e0 tx=0x7efecc009040).stop 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 msgr2=0x7efedc162c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7efec4006d70 tx=0x7efec4017000).stop 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 shutdown_connections 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efebc05ef80 0x7efebc061440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc151bf0 0x7efedc152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efedc065530 0x7efedc162c90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 --2- 172.21.15.98:0/170742498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc151100 0x7efedc0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 >> 172.21.15.98:0/170742498 conn(0x7efedc06a910 msgr2=0x7efedc146120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 shutdown_connections 2023-08-22T00:18:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.489+0000 7efee2069700 1 -- 172.21.15.98:0/170742498 wait complete. 2023-08-22T00:18:24.502 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:31", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.502 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:31', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:24.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:24.503 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-22T00:18:24.525 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:24.525 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:24.527 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:24.527 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:24.527 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:24.527 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-08-22T00:18:24.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 Processor -- start 2023-08-22T00:18:24.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 -- start start 2023-08-22T00:18:24.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b540c5460 0x7f9b540632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b54066770 con 0x7f9b54153a40 2023-08-22T00:18:24.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540c4f40 con 0x7f9b540c5460 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.685+0000 7f9b59404700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c59e0 con 0x7f9b54066c00 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b540c5460 0x7f9b540632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b52ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9b54153a40 0x7f9b54062b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50742/0 (socket says 172.21.15.98:50742) 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b52ffd700 1 -- 172.21.15.98:0/864676880 learned_addr learned my addr 172.21.15.98:0/864676880 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b527fc700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 -- 172.21.15.98:0/864676880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 msgr2=0x7f9b540c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:24.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 -- 172.21.15.98:0/864676880 >> v1:172.21.15.98:6789/0 conn(0x7f9b54153a40 legacy=0x7f9b54062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 -- 172.21.15.98:0/864676880 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54065e80 con 0x7f9b540c5460 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b51ffb700 1 -- 172.21.15.98:0/864676880 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482693907 0 0) 0x7f9b54066770 con 0x7f9b54153a40 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b527fc700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b537fe700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b540c5460 0x7f9b540632a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f9b4c009e60 tx=0x7f9b4c009780).ready entity=mon.0 client_cookie=5f21e86fd9bfe88e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b51ffb700 1 -- 172.21.15.98:0/864676880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00e070 con 0x7f9b540c5460 2023-08-22T00:18:24.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b51ffb700 1 -- 172.21.15.98:0/864676880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00bc30 con 0x7f9b540c5460 2023-08-22T00:18:24.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.686+0000 7f9b51ffb700 1 -- 172.21.15.98:0/864676880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c012410 con 0x7f9b540c5460 2023-08-22T00:18:24.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 -- 172.21.15.98:0/864676880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b540c5460 msgr2=0x7f9b540632a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b540c5460 0x7f9b540632a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f9b4c009e60 tx=0x7f9b4c009780).stop 2023-08-22T00:18:24.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 -- 172.21.15.98:0/864676880 shutdown_connections 2023-08-22T00:18:24.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b540c5460 0x7f9b540632a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 --2- 172.21.15.98:0/864676880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 -- 172.21.15.98:0/864676880 >> 172.21.15.98:0/864676880 conn(0x7f9b540c3990 msgr2=0x7f9b540c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:24.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 -- 172.21.15.98:0/864676880 shutdown_connections 2023-08-22T00:18:24.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.687+0000 7f9b59404700 1 -- 172.21.15.98:0/864676880 wait complete. 2023-08-22T00:18:24.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.688+0000 7f9b59404700 1 Processor -- start 2023-08-22T00:18:24.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.688+0000 7f9b59404700 1 -- start start 2023-08-22T00:18:24.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b540c5460 0x7f9b540c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54158ea0 con 0x7f9b54153a40 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54153230 con 0x7f9b540c5460 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c1bd0 con 0x7f9b54066c00 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46216/0 (socket says 172.21.15.98:46216) 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 -- 172.21.15.98:0/2518818475 learned_addr learned my addr 172.21.15.98:0/2518818475 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b52ffd700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b527fc700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b540c5460 0x7f9b540c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 -- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 msgr2=0x7f9b540c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 -- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b540c5460 msgr2=0x7f9b540c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b540c5460 0x7f9b540c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 -- 172.21.15.98:0/2518818475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c009a20 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b537fe700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f9b540683c0 tx=0x7f9b4c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01c660 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c01c7c0 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b540c1eb0 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01cb80 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.689+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540c2470 con 0x7f9b54153a40 2023-08-22T00:18:24.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.690+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b54047480 con 0x7f9b54153a40 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.691+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f9b4c003040 con 0x7f9b54153a40 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.691+0000 7f9b3affd700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 0x7f9b40061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.691+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f9b4c07c1d0 con 0x7f9b54153a40 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.691+0000 7f9b52ffd700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 0x7f9b40061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.691+0000 7f9b52ffd700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 0x7f9b40061440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9b4400c7d0 tx=0x7f9b44009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:24.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.695+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b4c04d260 con 0x7f9b54153a40 2023-08-22T00:18:24.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.879+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b54066120 con 0x7f9b4005ef80 2023-08-22T00:18:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.881+0000 7f9b3affd700 1 -- 172.21.15.98:0/2518818475 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9b54066120 con 0x7f9b4005ef80 2023-08-22T00:18:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:24.883 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 msgr2=0x7f9b40061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 0x7f9b40061440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9b4400c7d0 tx=0x7f9b44009040).stop 2023-08-22T00:18:24.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 msgr2=0x7f9b54141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:24.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f9b540683c0 tx=0x7f9b4c009780).stop 2023-08-22T00:18:24.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 shutdown_connections 2023-08-22T00:18:24.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4005ef80 0x7f9b40061440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b54066c00 0x7f9b540c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b54153a40 0x7f9b54141920 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 --2- 172.21.15.98:0/2518818475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b540c5460 0x7f9b540c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:24.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 >> 172.21.15.98:0/2518818475 conn(0x7f9b540c3990 msgr2=0x7f9b54154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:24.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 shutdown_connections 2023-08-22T00:18:24.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:24.883+0000 7f9b59404700 1 -- 172.21.15.98:0/2518818475 wait complete. 2023-08-22T00:18:24.896 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:24.896 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:32', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:24.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:24.897 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-22T00:18:24.919 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:24.919 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:24.919 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:24.921 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:24.921 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:24.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-08-22T00:18:25.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.077+0000 7fe0927f1700 1 Processor -- start 2023-08-22T00:18:25.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.077+0000 7fe0927f1700 1 -- start start 2023-08-22T00:18:25.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.077+0000 7fe0927f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 0x7fe08c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe0927f1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0bbd90 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe0927f1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0636f0 con 0x7fe08c062950 2023-08-22T00:18:25.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe0927f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c063f90 con 0x7fe08c155d70 2023-08-22T00:18:25.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe08c0a8ab0 0x7fe08c155660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50748/0 (socket says 172.21.15.98:50748) 2023-08-22T00:18:25.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08bfff700 1 -- 172.21.15.98:0/1244608199 learned_addr learned my addr 172.21.15.98:0/1244608199 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:25.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08b7fe700 1 --2- 172.21.15.98:0/1244608199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 0x7fe08c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438316483 0 0) 0x7fe08c0bbd90 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0740033f0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742776130 0 0) 0x7fe08c0636f0 con 0x7fe08c062950 2023-08-22T00:18:25.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c0bbd90 con 0x7fe08c062950 2023-08-22T00:18:25.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1244608199 >> v1:172.21.15.118:6789/0 conn(0x7fe08c062950 legacy=0x7fe08c062e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2513139464 0 0) 0x7fe0740033f0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1244608199 >> v1:172.21.15.98:6789/0 conn(0x7fe08c0a8ab0 legacy=0x7fe08c155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1244608199 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0639d0 con 0x7fe08c155d70 2023-08-22T00:18:25.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.078+0000 7fe08b7fe700 1 --2- 172.21.15.98:0/1244608199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 0x7fe08c0a8e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe07c009790 tx=0x7fe07c009060).ready entity=mon.2 client_cookie=522e90f015a21045 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080001470 con 0x7fe08c155d70 2023-08-22T00:18:25.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c011400 con 0x7fe08c155d70 2023-08-22T00:18:25.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe08affd700 1 -- 172.21.15.98:0/1244608199 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011780 con 0x7fe08c155d70 2023-08-22T00:18:25.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 -- 172.21.15.98:0/1244608199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 msgr2=0x7fe08c0a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1244608199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 0x7fe08c0a8e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe07c009790 tx=0x7fe07c009060).stop 2023-08-22T00:18:25.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 -- 172.21.15.98:0/1244608199 shutdown_connections 2023-08-22T00:18:25.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1244608199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c155d70 0x7fe08c0a8e90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 -- 172.21.15.98:0/1244608199 >> 172.21.15.98:0/1244608199 conn(0x7fe08c0c7170 msgr2=0x7fe08c0c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:25.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 -- 172.21.15.98:0/1244608199 shutdown_connections 2023-08-22T00:18:25.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.079+0000 7fe0927f1700 1 -- 172.21.15.98:0/1244608199 wait complete. 2023-08-22T00:18:25.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.080+0000 7fe0927f1700 1 Processor -- start 2023-08-22T00:18:25.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.080+0000 7fe0927f1700 1 -- start start 2023-08-22T00:18:25.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c062950 0x7fe08c13e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe08c155d70 0x7fe08c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c063510 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0bf210 con 0x7fe08c155d70 2023-08-22T00:18:25.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe0927f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0bf4f0 con 0x7fe08c062950 2023-08-22T00:18:25.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe08b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe08b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46230/0 (socket says 172.21.15.98:46230) 2023-08-22T00:18:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1408581370 learned_addr learned my addr 172.21.15.98:0/1408581370 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe08bfff700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c062950 0x7fe08c13e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.081+0000 7fe090d8e700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe08c155d70 0x7fe08c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c062950 msgr2=0x7fe08c13e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c062950 0x7fe08c13e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe08c155d70 msgr2=0x7fe08c0be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe08c155d70 0x7fe08c0be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 -- 172.21.15.98:0/1408581370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0092a0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe08b7fe700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fe07c010000 tx=0x7fe07c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c010740 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c0108c0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c010c80 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c0bf7d0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.082+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c0bfd90 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.083+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c0c0470 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.083+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fe07c01d640 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.084+0000 7fe073fff700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 0x7fe078061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.084+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fe07c07b720 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.084+0000 7fe08bfff700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 0x7fe078061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.084+0000 7fe08bfff700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 0x7fe078061440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe0800015a0 tx=0x7fe080000bc0).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.088+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe07c04c7b0 con 0x7fe08c0a8ab0 2023-08-22T00:18:25.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.272+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe08c047480 con 0x7fe07805ef80 2023-08-22T00:18:25.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.273+0000 7fe073fff700 1 -- 172.21.15.98:0/1408581370 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe08c047480 con 0x7fe07805ef80 2023-08-22T00:18:25.274 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:25.275 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:25.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 msgr2=0x7fe078061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 0x7fe078061440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe0800015a0 tx=0x7fe080000bc0).stop 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 msgr2=0x7fe08c0be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fe07c010000 tx=0x7fe07c016000).stop 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 shutdown_connections 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe07805ef80 0x7fe078061440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe08c062950 0x7fe08c13e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe08c155d70 0x7fe08c0be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 --2- 172.21.15.98:0/1408581370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe08c0a8ab0 0x7fe08c0be4a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 >> 172.21.15.98:0/1408581370 conn(0x7fe08c0c7170 msgr2=0x7fe08c0a6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:25.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 shutdown_connections 2023-08-22T00:18:25.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.275+0000 7fe0927f1700 1 -- 172.21.15.98:0/1408581370 wait complete. 2023-08-22T00:18:25.287 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:25.288 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:32', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:25.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:25.288 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:25.312 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:25.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-08-22T00:18:25.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 Processor -- start 2023-08-22T00:18:25.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 -- start start 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f75b0153ae0 0x7f75b00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75b00bfd80 0x7f75b00c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b0155360 con 0x7f75b0157fe0 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b0157b50 con 0x7f75b0153ae0 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.469+0000 7f75b693d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b00c6390 con 0x7f75b00bfd80 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f75b0153ae0 0x7f75b00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f75b0153ae0 0x7f75b00c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46244/0 (socket says 172.21.15.98:46244) 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 -- 172.21.15.98:0/1770024530 learned_addr learned my addr 172.21.15.98:0/1770024530 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75af7fe700 1 --2- 172.21.15.98:0/1770024530 >> v2:172.21.15.118:3300/0 conn(0x7f75b00bfd80 0x7f75b00c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 -- 172.21.15.98:0/1770024530 >> v2:172.21.15.118:3300/0 conn(0x7f75b00bfd80 msgr2=0x7f75b00c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 --2- 172.21.15.98:0/1770024530 >> v2:172.21.15.118:3300/0 conn(0x7f75b00bfd80 0x7f75b00c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 -- 172.21.15.98:0/1770024530 >> v1:172.21.15.118:6789/0 conn(0x7f75b0157fe0 legacy=0x7f75b00645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 -- 172.21.15.98:0/1770024530 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0154ac0 con 0x7f75b0153ae0 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75affff700 1 --2- 172.21.15.98:0/1770024530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b00c5ea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f75b0157880 tx=0x7f75a00090f0).ready entity=mon.0 client_cookie=a5024af8df098bc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75aeffd700 1 -- 172.21.15.98:0/1770024530 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000b600 con 0x7f75b0153ae0 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75aeffd700 1 -- 172.21.15.98:0/1770024530 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a000b760 con 0x7f75b0153ae0 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.470+0000 7f75aeffd700 1 -- 172.21.15.98:0/1770024530 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000bae0 con 0x7f75b0153ae0 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 -- 172.21.15.98:0/1770024530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 msgr2=0x7f75b00c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 --2- 172.21.15.98:0/1770024530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b00c5ea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f75b0157880 tx=0x7f75a00090f0).stop 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 -- 172.21.15.98:0/1770024530 shutdown_connections 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 --2- 172.21.15.98:0/1770024530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b00c5ea0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 --2- 172.21.15.98:0/1770024530 >> v2:172.21.15.118:3300/0 conn(0x7f75b00bfd80 0x7f75b00c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 -- 172.21.15.98:0/1770024530 >> 172.21.15.98:0/1770024530 conn(0x7f75b00caa50 msgr2=0x7f75b00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:25.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 -- 172.21.15.98:0/1770024530 shutdown_connections 2023-08-22T00:18:25.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.471+0000 7f75b693d700 1 -- 172.21.15.98:0/1770024530 wait complete. 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.472+0000 7f75b693d700 1 Processor -- start 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.472+0000 7f75b693d700 1 -- start start 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b00bfd80 0x7f75b00b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b0157fe0 0x7f75b0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00af9c0 con 0x7f75b0153ae0 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0164d60 con 0x7f75b0157fe0 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00afbd0 con 0x7f75b00bfd80 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46252/0 (socket says 172.21.15.98:46252) 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 -- 172.21.15.98:0/4186911128 learned_addr learned my addr 172.21.15.98:0/4186911128 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b4eda700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b0157fe0 0x7f75b0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75affff700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b00bfd80 0x7f75b00b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 -- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b00bfd80 msgr2=0x7f75b00b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b00bfd80 0x7f75b00b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 -- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b0157fe0 msgr2=0x7f75b0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b0157fe0 0x7f75b0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 -- 172.21.15.98:0/4186911128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009370 con 0x7f75b0153ae0 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75af7fe700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f75a400d890 tx=0x7f75a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4011590 con 0x7f75b0153ae0 2023-08-22T00:18:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a40116f0 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4011a70 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.473+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b00afeb0 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.474+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b014f920 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.474+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b0047480 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.475+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f75a4012420 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.475+0000 7f7597fff700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 0x7f759c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.475+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f75a4079bb0 con 0x7f75b0153ae0 2023-08-22T00:18:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.475+0000 7f75affff700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 0x7f759c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.475+0000 7f75affff700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 0x7f759c061440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f75a0009130 tx=0x7f75a0017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.479+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75a404abe0 con 0x7f75b0153ae0 2023-08-22T00:18:25.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.663+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75b00bfb60 con 0x7f759c05ef80 2023-08-22T00:18:25.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.665+0000 7f7597fff700 1 -- 172.21.15.98:0/4186911128 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f75b00bfb60 con 0x7f759c05ef80 2023-08-22T00:18:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:25.666 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 msgr2=0x7f759c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 0x7f759c061440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f75a0009130 tx=0x7f75a0017000).stop 2023-08-22T00:18:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 msgr2=0x7f75b014f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f75a400d890 tx=0x7f75a4008040).stop 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 shutdown_connections 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f759c05ef80 0x7f759c061440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b00bfd80 0x7f75b00b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b0157fe0 0x7f75b0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 --2- 172.21.15.98:0/4186911128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75b0153ae0 0x7f75b014f430 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.666+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 >> 172.21.15.98:0/4186911128 conn(0x7f75b00caa50 msgr2=0x7f75b0156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:25.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.667+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 shutdown_connections 2023-08-22T00:18:25.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.667+0000 7f75b693d700 1 -- 172.21.15.98:0/4186911128 wait complete. 2023-08-22T00:18:25.679 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:32", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:25.679 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:32', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:25.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:25.680 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-22T00:18:25.704 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:25.705 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:25.705 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:25.706 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:25.706 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:25.706 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:25.706 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:25.707 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:25.707 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:25.707 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:25.707 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:25.707 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_08_00_UTC', 'scheduled-2023-08-22-00_09_00_UTC', 'scheduled-2023-08-22-00_10_00_UTC', 'scheduled-2023-08-22-00_11_00_UTC', 'scheduled-2023-08-22-00_12_00_UTC', 'scheduled-2023-08-22-00_13_00_UTC', 'scheduled-2023-08-22-00_14_00_UTC', 'scheduled-2023-08-22-00_15_00_UTC', 'scheduled-2023-08-22-00_16_00_UTC', 'scheduled-2023-08-22-00_17_00_UTC', 'scheduled-2023-08-22-00_18_00_UTC'] 2023-08-22T00:18:25.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-08-22T00:18:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.861+0000 7fbdd503c700 1 Processor -- start 2023-08-22T00:18:25.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.861+0000 7fbdd503c700 1 -- start start 2023-08-22T00:18:25.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdd503c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbdd00c5a30 0x7fbdd00a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdd503c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00a8b20 con 0x7fbdd00c2e80 2023-08-22T00:18:25.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdd503c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00a9330 con 0x7fbdd0153d40 2023-08-22T00:18:25.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdd503c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00c4630 con 0x7fbdd00c5a30 2023-08-22T00:18:25.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdce59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbdd00c5a30 0x7fbdd00a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdcf59e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbdd00c2e80 0x7fbdd00be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50756/0 (socket says 172.21.15.98:50756) 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdcf59e700 1 -- 172.21.15.98:0/17936845 learned_addr learned my addr 172.21.15.98:0/17936845 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.862+0000 7fbdce59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbdd00c5a30 0x7fbdd00a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46256/0 (socket says 172.21.15.98:46256) 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdce59c700 1 -- 172.21.15.98:0/17936845 >> v1:172.21.15.118:6789/0 conn(0x7fbdd0153d40 legacy=0x7fbdd00aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdce59c700 1 -- 172.21.15.98:0/17936845 >> v1:172.21.15.98:6789/0 conn(0x7fbdd00c2e80 legacy=0x7fbdd00be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdcdd9b700 1 -- 172.21.15.98:0/17936845 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485526901 0 0) 0x7fbdd00a8b20 con 0x7fbdd00c2e80 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdce59c700 1 -- 172.21.15.98:0/17936845 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00c61a0 con 0x7fbdd00c5a30 2023-08-22T00:18:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdce59c700 1 --2- 172.21.15.98:0/17936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd00c5a30 0x7fbdd00a8e40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fbdc0009760 tx=0x7fbdc0009060).ready entity=mon.0 client_cookie=8e50a3e0672d9deb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdcdd9b700 1 -- 172.21.15.98:0/17936845 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000b580 con 0x7fbdd00c5a30 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdcdd9b700 1 -- 172.21.15.98:0/17936845 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc000b6e0 con 0x7fbdd00c5a30 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdcdd9b700 1 -- 172.21.15.98:0/17936845 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000ba60 con 0x7fbdd00c5a30 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 -- 172.21.15.98:0/17936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd00c5a30 msgr2=0x7fbdd00a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 --2- 172.21.15.98:0/17936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd00c5a30 0x7fbdd00a8e40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fbdc0009760 tx=0x7fbdc0009060).stop 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 -- 172.21.15.98:0/17936845 shutdown_connections 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 --2- 172.21.15.98:0/17936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd00c5a30 0x7fbdd00a8e40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 -- 172.21.15.98:0/17936845 >> 172.21.15.98:0/17936845 conn(0x7fbdd00c9320 msgr2=0x7fbdd00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 -- 172.21.15.98:0/17936845 shutdown_connections 2023-08-22T00:18:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.863+0000 7fbdd503c700 1 -- 172.21.15.98:0/17936845 wait complete. 2023-08-22T00:18:25.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.865+0000 7fbdd503c700 1 Processor -- start 2023-08-22T00:18:25.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.865+0000 7fbdd503c700 1 -- start start 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.865+0000 7fbdd503c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 0x7fbdd0154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 0x7fbdd00ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00a3d70 con 0x7fbdd0153d40 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01568d0 con 0x7fbdd00c2e80 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0155cc0 con 0x7fbdd01403c0 2023-08-22T00:18:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46272/0 (socket says 172.21.15.98:46272) 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 -- 172.21.15.98:0/3795378338 learned_addr learned my addr 172.21.15.98:0/3795378338 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdcf59e700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 0x7fbdd00ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdced9d700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 0x7fbdd0154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 -- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 msgr2=0x7fbdd00ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 0x7fbdd00ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 -- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 msgr2=0x7fbdd0154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 0x7fbdd0154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 -- 172.21.15.98:0/3795378338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00092a0 con 0x7fbdd0153d40 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdced9d700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 0x7fbdd0154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdcf59e700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 0x7fbdd00ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdce59c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbdc000b340 tx=0x7fbdc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000ba60 con 0x7fbdd0153d40 2023-08-22T00:18:25.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0000c90 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0155fa0 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc001b640 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.866+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0156560 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.867+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0156a40 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.868+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fbdc001ba30 con 0x7fbdd0153d40 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.868+0000 7fbdc6ffd700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 0x7fbdb0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.868+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fbdc007bf60 con 0x7fbdd0153d40 2023-08-22T00:18:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.868+0000 7fbdced9d700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 0x7fbdb0061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.868+0000 7fbdced9d700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 0x7fbdb0061440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbdb8001670 tx=0x7fbdb8009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:25.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:25.872+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbdc00aa8f0 con 0x7fbdd0153d40 2023-08-22T00:18:26.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.057+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdd0047480 con 0x7fbdb005ef80 2023-08-22T00:18:26.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.058+0000 7fbdc6ffd700 1 -- 172.21.15.98:0/3795378338 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fbdd0047480 con 0x7fbdb005ef80 2023-08-22T00:18:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:26.060 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:33", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.060+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 msgr2=0x7fbdb0061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.060+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 0x7fbdb0061440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbdb8001670 tx=0x7fbdb8009040).stop 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.060+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 msgr2=0x7fbdd013fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.060+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbdc000b340 tx=0x7fbdc0017000).stop 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 shutdown_connections 2023-08-22T00:18:26.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbdb005ef80 0x7fbdb0061440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdd01403c0 0x7fbdd00ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdd00c2e80 0x7fbdd0154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 --2- 172.21.15.98:0/3795378338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd0153d40 0x7fbdd013fed0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 >> 172.21.15.98:0/3795378338 conn(0x7fbdd00c9320 msgr2=0x7fbdd0152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 shutdown_connections 2023-08-22T00:18:26.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.061+0000 7fbdd503c700 1 -- 172.21.15.98:0/3795378338 wait complete. 2023-08-22T00:18:26.074 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:07:33", "first": "2023-08-22T00:08:00", "last": "2023-08-22T00:18:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-22T00:18:26.074 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:07:33', 'first': '2023-08-22T00:08:00', 'last': '2023-08-22T00:18:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-22T00:18:26.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-08-22T00:18:26.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.195+0000 7f0e76833700 1 Processor -- start 2023-08-22T00:18:26.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.195+0000 7f0e76833700 1 -- start start 2023-08-22T00:18:26.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e76833700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e7014e360 0x7f0e701541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e76833700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e700675b0 0x7f0e70067a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e76833700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e70067f50 con 0x7f0e700c5ce0 2023-08-22T00:18:26.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e76833700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700645a0 con 0x7f0e700675b0 2023-08-22T00:18:26.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e76833700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700c6160 con 0x7f0e7014e360 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e74dd0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e700675b0 0x7f0e70067a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e74dd0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e700675b0 0x7f0e70067a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46276/0 (socket says 172.21.15.98:46276) 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e74dd0700 1 -- 172.21.15.98:0/3746846746 learned_addr learned my addr 172.21.15.98:0/3746846746 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.196+0000 7f0e6ffff700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e7014e360 0x7f0e701541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e74dd0700 1 -- 172.21.15.98:0/3746846746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e7014e360 msgr2=0x7f0e701541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e74dd0700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e7014e360 0x7f0e701541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e74dd0700 1 -- 172.21.15.98:0/3746846746 >> v1:172.21.15.118:6789/0 conn(0x7f0e700c5ce0 legacy=0x7f0e70063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e74dd0700 1 -- 172.21.15.98:0/3746846746 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700c6580 con 0x7f0e700675b0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e6effd700 1 -- 172.21.15.98:0/3746846746 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833757583 0 0) 0x7f0e58001110 con 0x7f0e700c5ce0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e74dd0700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e70067a60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f0e68009f20 tx=0x7f0e68009840).ready entity=mon.0 client_cookie=883aa04c60fbd2e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e6effd700 1 -- 172.21.15.98:0/3746846746 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800e070 con 0x7f0e700675b0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e6effd700 1 -- 172.21.15.98:0/3746846746 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800b9d0 con 0x7f0e700675b0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e6effd700 1 -- 172.21.15.98:0/3746846746 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800bd50 con 0x7f0e700675b0 2023-08-22T00:18:26.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 -- 172.21.15.98:0/3746846746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 msgr2=0x7f0e70067a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e70067a60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f0e68009f20 tx=0x7f0e68009840).stop 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 -- 172.21.15.98:0/3746846746 shutdown_connections 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e70067a60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 --2- 172.21.15.98:0/3746846746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e7014e360 0x7f0e701541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 -- 172.21.15.98:0/3746846746 >> 172.21.15.98:0/3746846746 conn(0x7f0e70066a70 msgr2=0x7f0e700c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 -- 172.21.15.98:0/3746846746 shutdown_connections 2023-08-22T00:18:26.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.197+0000 7f0e76833700 1 -- 172.21.15.98:0/3746846746 wait complete. 2023-08-22T00:18:26.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.199+0000 7f0e76833700 1 Processor -- start 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.199+0000 7f0e76833700 1 -- start start 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.199+0000 7f0e76833700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e700c5ce0 0x7f0e700c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 0x7f0e7014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7014b4a0 con 0x7f0e700675b0 2023-08-22T00:18:26.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700aa150 con 0x7f0e7014e360 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700aba60 con 0x7f0e700c5ce0 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46278/0 (socket says 172.21.15.98:46278) 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 -- 172.21.15.98:0/3038868211 learned_addr learned my addr 172.21.15.98:0/3038868211 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e74dd0700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 0x7f0e7014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6f7fe700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e700c5ce0 0x7f0e700c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 -- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e700c5ce0 msgr2=0x7f0e700c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e700c5ce0 0x7f0e700c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 -- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 msgr2=0x7f0e7014a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 0x7f0e7014a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 -- 172.21.15.98:0/3038868211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68009ae0 con 0x7f0e700675b0 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e74dd0700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 0x7f0e7014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e6ffff700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f0e6000e900 tx=0x7f0e60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000c640 con 0x7f0e700675b0 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000c7a0 con 0x7f0e700675b0 2023-08-22T00:18:26.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000cb20 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e700abd40 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.200+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700ab610 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.201+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e700ac1e0 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.202+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f0e6001b400 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.202+0000 7f0e67fff700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 0x7f0e50061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.202+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f0e6007a6b0 con 0x7f0e700675b0 2023-08-22T00:18:26.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.202+0000 7f0e6f7fe700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 0x7f0e50061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:26.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.202+0000 7f0e6f7fe700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 0x7f0e50061440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0e58001370 tx=0x7f0e58009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:26.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.206+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e6004b6e0 con 0x7f0e700675b0 2023-08-22T00:18:26.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.395+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e70047480 con 0x7f0e5005ef80 2023-08-22T00:18:26.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.399+0000 7f0e67fff700 1 -- 172.21.15.98:0/3038868211 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f0e70047480 con 0x7f0e5005ef80 2023-08-22T00:18:26.401 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-08-22T00:18:26.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 msgr2=0x7f0e50061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 0x7f0e50061440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0e58001370 tx=0x7f0e58009040).stop 2023-08-22T00:18:26.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 msgr2=0x7f0e700ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:26.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f0e6000e900 tx=0x7f0e60009060).stop 2023-08-22T00:18:26.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 shutdown_connections 2023-08-22T00:18:26.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e7014e360 0x7f0e7014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e700675b0 0x7f0e700ab120 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e5005ef80 0x7f0e50061440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.400+0000 7f0e76833700 1 --2- 172.21.15.98:0/3038868211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e700c5ce0 0x7f0e700c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:26.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.401+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 >> 172.21.15.98:0/3038868211 conn(0x7f0e70066a70 msgr2=0x7f0e700655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:26.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.401+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 shutdown_connections 2023-08-22T00:18:26.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:26.401+0000 7f0e76833700 1 -- 172.21.15.98:0/3038868211 wait complete. 2023-08-22T00:18:26.413 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-08-22T00:18:26.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.414 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-22T00:18:26.437 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:26.437 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:26.438 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:26.439 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:26.439 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:26.439 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:26.439 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:26.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.440 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:26.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:26.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.504 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:26.568 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:26.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.569 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:26.641 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:26.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.642 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:26.709 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:26.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.709 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:26.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:26.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.776 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:26.840 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:26.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.841 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:26.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:26.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.906 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:26.969 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:26.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:26.970 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:27.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:27.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.035 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:27.101 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:27.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.102 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:27.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.167 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-08-22T00:18:27.230 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-08-22T00:18:27.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.392+0000 7f1c72ca7700 1 Processor -- start 2023-08-22T00:18:27.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.392+0000 7f1c72ca7700 1 -- start start 2023-08-22T00:18:27.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c72ca7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 0x7f1c6c0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c72ca7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1c6c153c80 0x7f1c6c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c72ca7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c062600 con 0x7f1c6c0a5910 2023-08-22T00:18:27.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c72ca7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c062f10 con 0x7f1c6c153c80 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c72ca7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c14ac50 con 0x7f1c6c154830 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1c6c153c80 0x7f1c6c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c70a43700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1c6c0a5910 0x7f1c6c0c4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50768/0 (socket says 172.21.15.98:50768) 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c70a43700 1 -- 172.21.15.98:0/2416306969 learned_addr learned my addr 172.21.15.98:0/2416306969 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6bfff700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 0x7f1c6c0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 -- 172.21.15.98:0/2416306969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 msgr2=0x7f1c6c0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 0x7f1c6c0c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6b7fe700 1 -- 172.21.15.98:0/2416306969 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815277741 0 0) 0x7f1c6c062600 con 0x7f1c6c0a5910 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 -- 172.21.15.98:0/2416306969 >> v1:172.21.15.98:6789/0 conn(0x7f1c6c0a5910 legacy=0x7f1c6c0c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 -- 172.21.15.98:0/2416306969 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c1545e0 con 0x7f1c6c153c80 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6bfff700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 0x7f1c6c0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:27.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c71244700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c153c80 0x7f1c6c1540f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f1c6400af70 tx=0x7f1c6400a890).ready entity=mon.0 client_cookie=865d61a89ff9c993 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:27.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6b7fe700 1 -- 172.21.15.98:0/2416306969 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400f070 con 0x7f1c6c153c80 2023-08-22T00:18:27.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6b7fe700 1 -- 172.21.15.98:0/2416306969 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400a2e0 con 0x7f1c6c153c80 2023-08-22T00:18:27.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.393+0000 7f1c6b7fe700 1 -- 172.21.15.98:0/2416306969 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400cce0 con 0x7f1c6c153c80 2023-08-22T00:18:27.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 -- 172.21.15.98:0/2416306969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c153c80 msgr2=0x7f1c6c1540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c153c80 0x7f1c6c1540f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f1c6400af70 tx=0x7f1c6400a890).stop 2023-08-22T00:18:27.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 -- 172.21.15.98:0/2416306969 shutdown_connections 2023-08-22T00:18:27.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c153c80 0x7f1c6c1540f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/2416306969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c154830 0x7f1c6c0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 -- 172.21.15.98:0/2416306969 >> 172.21.15.98:0/2416306969 conn(0x7f1c6c0c7170 msgr2=0x7f1c6c0c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:27.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 -- 172.21.15.98:0/2416306969 shutdown_connections 2023-08-22T00:18:27.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.394+0000 7f1c72ca7700 1 -- 172.21.15.98:0/2416306969 wait complete. 2023-08-22T00:18:27.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.395+0000 7f1c72ca7700 1 Processor -- start 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.395+0000 7f1c72ca7700 1 -- start start 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 0x7f1c6c0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c6c153c80 0x7f1c6c147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a9610 con 0x7f1c6c154830 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0aa470 con 0x7f1c6c153c80 2023-08-22T00:18:27.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c72ca7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a9860 con 0x7f1c6c0a5910 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46306/0 (socket says 172.21.15.98:46306) 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 -- 172.21.15.98:0/595488511 learned_addr learned my addr 172.21.15.98:0/595488511 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c70a43700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 0x7f1c6c0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c6bfff700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c6c153c80 0x7f1c6c147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 -- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 msgr2=0x7f1c6c0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 0x7f1c6c0aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 -- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c6c153c80 msgr2=0x7f1c6c147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c6c153c80 0x7f1c6c147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 -- 172.21.15.98:0/595488511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6400ab30 con 0x7f1c6c154830 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c70a43700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 0x7f1c6c0aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.396+0000 7f1c71244700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1c6400c770 tx=0x7f1c6c062e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.397+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64014420 con 0x7f1c6c154830 2023-08-22T00:18:27.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.397+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c64014580 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.397+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64014940 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.397+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0a9b40 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.397+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0aa100 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.398+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c0aa600 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.398+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f1c64014cf0 con 0x7f1c6c154830 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.398+0000 7f1c68ff9700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 0x7f1c50061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.398+0000 7f1c70a43700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 0x7f1c50061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:27.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.398+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f1c6407c310 con 0x7f1c6c154830 2023-08-22T00:18:27.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.399+0000 7f1c70a43700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 0x7f1c50061440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1c60001710 tx=0x7f1c60009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:27.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.403+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c6404d3a0 con 0x7f1c6c154830 2023-08-22T00:18:27.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.591+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c6c047480 con 0x7f1c5005ef80 2023-08-22T00:18:27.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.595+0000 7f1c68ff9700 1 -- 172.21.15.98:0/595488511 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f1c6c047480 con 0x7f1c5005ef80 2023-08-22T00:18:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-08-22T00:18:27.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 msgr2=0x7f1c50061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 0x7f1c50061440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1c60001710 tx=0x7f1c60009040).stop 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 msgr2=0x7f1c6c0ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1c6400c770 tx=0x7f1c6c062e10).stop 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 shutdown_connections 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1c5005ef80 0x7f1c50061440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c6c0a5910 0x7f1c6c0aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c6c154830 0x7f1c6c0ac050 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 --2- 172.21.15.98:0/595488511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c6c153c80 0x7f1c6c147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:27.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 >> 172.21.15.98:0/595488511 conn(0x7f1c6c0c7170 msgr2=0x7f1c6c068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:27.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 shutdown_connections 2023-08-22T00:18:27.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:27.597+0000 7f1c72ca7700 1 -- 172.21.15.98:0/595488511 wait complete. 2023-08-22T00:18:27.610 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-08-22T00:18:27.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.611 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-22T00:18:27.640 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:27.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:27.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:27.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:27.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:27.642 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:27.643 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:27.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.643 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:27.713 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:27.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.714 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:27.779 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:27.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.780 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:27.845 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:27.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.846 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:27.911 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:27.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.912 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:27.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:27.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:27.978 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:28.044 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:28.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.045 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:28.109 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:28.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.110 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:28.177 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:28.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.178 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:28.243 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:28.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.244 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:28.310 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:28.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.310 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:28.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.376 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-08-22T00:18:28.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-08-22T00:18:28.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.596+0000 7f424da94700 1 Processor -- start 2023-08-22T00:18:28.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.596+0000 7f424da94700 1 -- start start 2023-08-22T00:18:28.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f424da94700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4248153f60 0x7f42480bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f424da94700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4248067b60 0x7f4248063f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f424da94700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4248155390 con 0x7f42480bd870 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f424da94700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4248155670 con 0x7f4248067b60 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f424da94700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480bc8a0 con 0x7f4248153f60 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f4247fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4248067b60 0x7f4248063f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f4246ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f42480bd870 0x7f4248067450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50780/0 (socket says 172.21.15.98:50780) 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.597+0000 7f4246ffd700 1 -- 172.21.15.98:0/2549392176 learned_addr learned my addr 172.21.15.98:0/2549392176 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f4247fff700 1 -- 172.21.15.98:0/2549392176 >> v2:172.21.15.118:3300/0 conn(0x7f4248153f60 msgr2=0x7f42480bd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f4247fff700 1 --2- 172.21.15.98:0/2549392176 >> v2:172.21.15.118:3300/0 conn(0x7f4248153f60 0x7f42480bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f4247fff700 1 -- 172.21.15.98:0/2549392176 >> v1:172.21.15.98:6789/0 conn(0x7f42480bd870 legacy=0x7f4248067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f4247fff700 1 -- 172.21.15.98:0/2549392176 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480bcb80 con 0x7f4248067b60 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f42467fc700 1 -- 172.21.15.98:0/2549392176 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989356230 0 0) 0x7f4248155390 con 0x7f42480bd870 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f4247fff700 1 --2- 172.21.15.98:0/2549392176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f4248063f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f42480c76b0 tx=0x7f4240009780).ready entity=mon.0 client_cookie=9693f9ce3f9d4731 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f42467fc700 1 -- 172.21.15.98:0/2549392176 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000e070 con 0x7f4248067b60 2023-08-22T00:18:28.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f42467fc700 1 -- 172.21.15.98:0/2549392176 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000bc30 con 0x7f4248067b60 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f42467fc700 1 -- 172.21.15.98:0/2549392176 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240012410 con 0x7f4248067b60 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 -- 172.21.15.98:0/2549392176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 msgr2=0x7f4248063f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 --2- 172.21.15.98:0/2549392176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f4248063f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f42480c76b0 tx=0x7f4240009780).stop 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 -- 172.21.15.98:0/2549392176 shutdown_connections 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 --2- 172.21.15.98:0/2549392176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f4248063f60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 --2- 172.21.15.98:0/2549392176 >> v2:172.21.15.118:3300/0 conn(0x7f4248153f60 0x7f42480bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 -- 172.21.15.98:0/2549392176 >> 172.21.15.98:0/2549392176 conn(0x7f42480c8270 msgr2=0x7f42480c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 -- 172.21.15.98:0/2549392176 shutdown_connections 2023-08-22T00:18:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.598+0000 7f424da94700 1 -- 172.21.15.98:0/2549392176 wait complete. 2023-08-22T00:18:28.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 Processor -- start 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 -- start start 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42480bd870 0x7f42481672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248153f60 0x7f4248156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480abba0 con 0x7f4248067b60 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480ab870 con 0x7f4248153f60 2023-08-22T00:18:28.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.600+0000 7f424da94700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248167bb0 con 0x7f42480bd870 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46312/0 (socket says 172.21.15.98:46312) 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 -- 172.21.15.98:0/507489719 learned_addr learned my addr 172.21.15.98:0/507489719 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 -- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42480bd870 msgr2=0x7f42481672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42480bd870 0x7f42481672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 -- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248153f60 msgr2=0x7f4248156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248153f60 0x7f4248156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 -- 172.21.15.98:0/507489719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009a20 con 0x7f4248067b60 2023-08-22T00:18:28.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f42477fe700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f423c00b490 tx=0x7f423c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:28.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c002320 con 0x7f4248067b60 2023-08-22T00:18:28.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c002480 con 0x7f4248067b60 2023-08-22T00:18:28.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4248167e90 con 0x7f4248067b60 2023-08-22T00:18:28.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c002840 con 0x7f4248067b60 2023-08-22T00:18:28.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.601+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424814e9f0 con 0x7f4248067b60 2023-08-22T00:18:28.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.602+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248047480 con 0x7f4248067b60 2023-08-22T00:18:28.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.602+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f423c002bf0 con 0x7f4248067b60 2023-08-22T00:18:28.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.603+0000 7f422f7fe700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 0x7f4234061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:28.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.603+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f423c07a0b0 con 0x7f4248067b60 2023-08-22T00:18:28.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.603+0000 7f4246ffd700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 0x7f4234061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:28.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.603+0000 7f4246ffd700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 0x7f4234061410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f42380011e0 tx=0x7f4238007850).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:28.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.607+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f423c04b140 con 0x7f4248067b60 2023-08-22T00:18:28.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.795+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f42480abce0 con 0x7f423405ef50 2023-08-22T00:18:28.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.799+0000 7f422f7fe700 1 -- 172.21.15.98:0/507489719 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f4238007110 con 0x7f423405ef50 2023-08-22T00:18:28.800 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.800+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 msgr2=0x7f4234061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.800+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 0x7f4234061410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f42380011e0 tx=0x7f4238007850).stop 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 msgr2=0x7f424814e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f423c00b490 tx=0x7f423c009060).stop 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 shutdown_connections 2023-08-22T00:18:28.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248153f60 0x7f4248156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4248067b60 0x7f424814e500 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f423405ef50 0x7f4234061410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 --2- 172.21.15.98:0/507489719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42480bd870 0x7f42481672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 >> 172.21.15.98:0/507489719 conn(0x7f42480c8270 msgr2=0x7f42480bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 shutdown_connections 2023-08-22T00:18:28.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:28.801+0000 7f424da94700 1 -- 172.21.15.98:0/507489719 wait complete. 2023-08-22T00:18:28.813 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-08-22T00:18:28.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.814 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-22T00:18:28.837 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:28.837 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:28.837 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:28.837 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:28.837 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:28.838 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:28.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.839 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:28.907 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:28.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.908 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:28.973 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:28.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:28.974 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:29.040 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:29.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.040 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:29.108 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:29.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.109 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:29.175 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:29.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.176 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:29.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:29.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.242 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:29.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:29.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.308 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:29.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:29.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.386 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:29.452 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:29.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.453 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:29.520 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:29.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.521 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:29.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:29.586 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-08-22T00:18:29.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-08-22T00:18:29.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.811+0000 7f82f64c0700 1 Processor -- start 2023-08-22T00:18:29.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.811+0000 7f82f64c0700 1 -- start start 2023-08-22T00:18:29.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.812+0000 7f82f64c0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82f0153ae0 0x7f82f00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.812+0000 7f82f64c0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82f00c0200 0x7f82f00645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.812+0000 7f82f64c0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f0155360 con 0x7f82f00bfd80 2023-08-22T00:18:29.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.812+0000 7f82f64c0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00c0670 con 0x7f82f0153ae0 2023-08-22T00:18:29.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.812+0000 7f82f64c0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f0157b50 con 0x7f82f00c0200 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82f0153ae0 0x7f82f00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82f0153ae0 0x7f82f00c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46322/0 (socket says 172.21.15.98:46322) 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 -- 172.21.15.98:0/4131473154 learned_addr learned my addr 172.21.15.98:0/4131473154 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82f4a5d700 1 --2- 172.21.15.98:0/4131473154 >> v2:172.21.15.118:3300/0 conn(0x7f82f00c0200 0x7f82f00645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 -- 172.21.15.98:0/4131473154 >> v2:172.21.15.118:3300/0 conn(0x7f82f00c0200 msgr2=0x7f82f00645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:29.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 --2- 172.21.15.98:0/4131473154 >> v2:172.21.15.118:3300/0 conn(0x7f82f00c0200 0x7f82f00645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 -- 172.21.15.98:0/4131473154 >> v1:172.21.15.118:6789/0 conn(0x7f82f00bfd80 legacy=0x7f82f0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 -- 172.21.15.98:0/4131473154 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00c6390 con 0x7f82f0153ae0 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82effff700 1 --2- 172.21.15.98:0/4131473154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f0153ae0 0x7f82f00c5ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f82f00c5250 tx=0x7f82e00090f0).ready entity=mon.0 client_cookie=214e42a22cb8ce4a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82eeffd700 1 -- 172.21.15.98:0/4131473154 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000b600 con 0x7f82f0153ae0 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82eeffd700 1 -- 172.21.15.98:0/4131473154 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b760 con 0x7f82f0153ae0 2023-08-22T00:18:29.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.813+0000 7f82eeffd700 1 -- 172.21.15.98:0/4131473154 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bae0 con 0x7f82f0153ae0 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 -- 172.21.15.98:0/4131473154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f0153ae0 msgr2=0x7f82f00c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 --2- 172.21.15.98:0/4131473154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f0153ae0 0x7f82f00c5ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f82f00c5250 tx=0x7f82e00090f0).stop 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 -- 172.21.15.98:0/4131473154 shutdown_connections 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 --2- 172.21.15.98:0/4131473154 >> v2:172.21.15.118:3300/0 conn(0x7f82f00c0200 0x7f82f00645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 --2- 172.21.15.98:0/4131473154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f0153ae0 0x7f82f00c5ea0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 -- 172.21.15.98:0/4131473154 >> 172.21.15.98:0/4131473154 conn(0x7f82f00caa50 msgr2=0x7f82f00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:29.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 -- 172.21.15.98:0/4131473154 shutdown_connections 2023-08-22T00:18:29.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.814+0000 7f82f64c0700 1 -- 172.21.15.98:0/4131473154 wait complete. 2023-08-22T00:18:29.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.815+0000 7f82f64c0700 1 Processor -- start 2023-08-22T00:18:29.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.815+0000 7f82f64c0700 1 -- start start 2023-08-22T00:18:29.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82f00bfd80 0x7f82f00c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82f0153ae0 0x7f82f01676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f013ee10 con 0x7f82f00c0200 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c3580 con 0x7f82f00bfd80 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f64c0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c3860 con 0x7f82f0153ae0 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46326/0 (socket says 172.21.15.98:46326) 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 -- 172.21.15.98:0/765881980 learned_addr learned my addr 172.21.15.98:0/765881980 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82effff700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82f00bfd80 0x7f82f00c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82f4a5d700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82f0153ae0 0x7f82f01676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 -- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82f0153ae0 msgr2=0x7f82f01676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82f0153ae0 0x7f82f01676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 -- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82f00bfd80 msgr2=0x7f82f00c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:29.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82f00bfd80 0x7f82f00c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 -- 172.21.15.98:0/765881980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009370 con 0x7f82f00c0200 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.816+0000 7f82ef7fe700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f82e400c4c0 tx=0x7f82e4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.817+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e400ce70 con 0x7f82f00c0200 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.817+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e4001e90 con 0x7f82f00c0200 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.817+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00c3b40 con 0x7f82f00c0200 2023-08-22T00:18:29.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.817+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4007250 con 0x7f82f00c0200 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.817+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00c4100 con 0x7f82f00c0200 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.818+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f00c42f0 con 0x7f82f00c0200 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.818+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f82e40066a0 con 0x7f82f00c0200 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.818+0000 7f82d7fff700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 0x7f82dc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.818+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7429+0+0 (secure 0 0 0) 0x7f82e4079c80 con 0x7f82f00c0200 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.818+0000 7f82effff700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 0x7f82dc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:29.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.819+0000 7f82effff700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 0x7f82dc061440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f82e0009130 tx=0x7f82e0017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:29.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:29.822+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82e404aa50 con 0x7f82f00c0200 2023-08-22T00:18:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.009+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f82f0155360 con 0x7f82dc05ef80 2023-08-22T00:18:30.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.012+0000 7f82d7fff700 1 -- 172.21.15.98:0/765881980 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f82f0155360 con 0x7f82dc05ef80 2023-08-22T00:18:30.014 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-08-22T00:18:30.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 msgr2=0x7f82dc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:30.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 0x7f82dc061440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f82e0009130 tx=0x7f82e0017000).stop 2023-08-22T00:18:30.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 msgr2=0x7f82f00c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:30.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f82e400c4c0 tx=0x7f82e4007e00).stop 2023-08-22T00:18:30.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 shutdown_connections 2023-08-22T00:18:30.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f82dc05ef80 0x7f82dc061440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:30.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82f0153ae0 0x7f82f01676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:30.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82f00bfd80 0x7f82f00c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:30.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 --2- 172.21.15.98:0/765881980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f00c0200 0x7f82f00c2fb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:30.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 >> 172.21.15.98:0/765881980 conn(0x7f82f00caa50 msgr2=0x7f82f01563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:30.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 shutdown_connections 2023-08-22T00:18:30.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:30.014+0000 7f82f64c0700 1 -- 172.21.15.98:0/765881980 wait complete. 2023-08-22T00:18:30.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-08-22T00:18:30.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.028 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-22T00:18:30.065 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:30.065 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:30.065 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:30.065 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:30.066 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:30.067 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:30.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.068 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:30.160 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:30.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.161 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:30.190 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:30.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.191 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:30.261 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:30.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.262 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:30.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:30.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.326 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:30.403 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:30.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.404 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:30.469 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:30.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.470 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:30.535 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:30.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.536 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:30.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:30.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.602 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:30.666 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:30.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.667 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:30.732 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:30.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.733 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:30.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:30.800 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-08-22T00:18:30.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-08-22T00:18:31.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 Processor -- start 2023-08-22T00:18:31.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 -- start start 2023-08-22T00:18:31.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17ec151a60 0x7f17ec0a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 0x7f17ec0bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0bd650 con 0x7f17ec151e40 2023-08-22T00:18:31.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0639a0 con 0x7f17ec151a60 2023-08-22T00:18:31.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.021+0000 7f17f1d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec063070 con 0x7f17ec0c4940 2023-08-22T00:18:31.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17ebfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 0x7f17ec0bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17ec151a60 0x7f17ec0a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eaffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f17ec151e40 0x7f17ec0c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:50600/0 (socket says 172.21.15.98:50600) 2023-08-22T00:18:31.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eaffd700 1 -- 172.21.15.98:0/1136170679 learned_addr learned my addr 172.21.15.98:0/1136170679 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:31.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 msgr2=0x7f17ec0bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:31.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 0x7f17ec0bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17ea7fc700 1 -- 172.21.15.98:0/1136170679 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207937544 0 0) 0x7f17ec0bd650 con 0x7f17ec151e40 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1136170679 >> v1:172.21.15.118:6789/0 conn(0x7f17ec151e40 legacy=0x7f17ec0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1136170679 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec063350 con 0x7f17ec151a60 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17ebfff700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 0x7f17ec0bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.022+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec151a60 0x7f17ec0a7850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f17dc009760 tx=0x7f17dc009060).ready entity=mon.1 client_cookie=6690cbffbe4067ce server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:31.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17ea7fc700 1 -- 172.21.15.98:0/1136170679 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00f510 con 0x7f17ec151a60 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17ea7fc700 1 -- 172.21.15.98:0/1136170679 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00f670 con 0x7f17ec151a60 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17ea7fc700 1 -- 172.21.15.98:0/1136170679 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00f9f0 con 0x7f17ec151a60 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec151a60 msgr2=0x7f17ec0a7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec151a60 0x7f17ec0a7850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f17dc009760 tx=0x7f17dc009060).stop 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1136170679 shutdown_connections 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec0c4940 0x7f17ec0bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1136170679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec151a60 0x7f17ec0a7850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1136170679 >> 172.21.15.98:0/1136170679 conn(0x7f17ec06a910 msgr2=0x7f17ec065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:31.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1136170679 shutdown_connections 2023-08-22T00:18:31.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.023+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1136170679 wait complete. 2023-08-22T00:18:31.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.024+0000 7f17f1d9d700 1 Processor -- start 2023-08-22T00:18:31.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.024+0000 7f17f1d9d700 1 -- start start 2023-08-22T00:18:31.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 0x7f17ec0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 0x7f17ec0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c1f50 con 0x7f17ec151a60 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0a62c0 con 0x7f17ec0c4940 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17f1d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0a5a20 con 0x7f17ec151e40 2023-08-22T00:18:31.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17eaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17ebfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 0x7f17ec0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17eaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54214/0 (socket says 172.21.15.98:54214) 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17eaffd700 1 -- 172.21.15.98:0/1519406328 learned_addr learned my addr 172.21.15.98:0/1519406328 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.025+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 0x7f17ec0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 -- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 msgr2=0x7f17ec0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 0x7f17ec0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 -- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 msgr2=0x7f17ec0a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 -- 172.21.15.98:0/1519406328 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009a20 con 0x7f17ec151e40 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 0x7f17ec0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17eaffd700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17ebfff700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 0x7f17ec0c7750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f17e4009e40 tx=0x7f17e400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400caa0 con 0x7f17ec151e40 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400f040 con 0x7f17ec151e40 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400ce10 con 0x7f17ec151e40 2023-08-22T00:18:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc0092a0 con 0x7f17ec151e40 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.026+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec0a5fe0 con 0x7f17ec151e40 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.027+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec0c20c0 con 0x7f17ec151e40 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.027+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f17e4013610 con 0x7f17ec151e40 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.027+0000 7f17d37fe700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 0x7f17d8061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.028+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f17e407ac20 con 0x7f17ec151e40 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.028+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 0x7f17d8061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:31.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.028+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 0x7f17d8061410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f17dc009760 tx=0x7f17dc017000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:31.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.032+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17ec0c20c0 con 0x7f17ec151e40 2023-08-22T00:18:31.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.243+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f17ec0c20c0 con 0x7f17d805ef50 2023-08-22T00:18:31.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.247+0000 7f17d37fe700 1 -- 172.21.15.98:0/1519406328 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f17ec0c20c0 con 0x7f17d805ef50 2023-08-22T00:18:31.248 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-08-22T00:18:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 msgr2=0x7f17d8061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 0x7f17d8061410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f17dc009760 tx=0x7f17dc017000).stop 2023-08-22T00:18:31.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 msgr2=0x7f17ec0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 0x7f17ec0c7750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f17e4009e40 tx=0x7f17e400b040).stop 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 shutdown_connections 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17d805ef50 0x7f17d8061410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17ec151e40 0x7f17ec0c7750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17ec0c4940 0x7f17ec0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 --2- 172.21.15.98:0/1519406328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17ec151a60 0x7f17ec0a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:31.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 >> 172.21.15.98:0/1519406328 conn(0x7f17ec06a910 msgr2=0x7f17ec0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:31.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 shutdown_connections 2023-08-22T00:18:31.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:31.249+0000 7f17f1d9d700 1 -- 172.21.15.98:0/1519406328 wait complete. 2023-08-22T00:18:31.262 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-08-22T00:18:31.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.263 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-22T00:18:31.289 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:31.290 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:31.291 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:31.291 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:31.291 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:31.291 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:31.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:31.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.292 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:31.358 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:31.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.358 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:31.433 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:31.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.434 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:31.510 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:31.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.511 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:31.576 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:31.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.577 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:31.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:31.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.642 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:31.707 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:31.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.708 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:31.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:31.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.773 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:31.838 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:31.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.838 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:31.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:31.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.903 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:31.972 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:31.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:31.974 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:32.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.038 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-08-22T00:18:32.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-08-22T00:18:32.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.260+0000 7efd2d04e700 1 Processor -- start 2023-08-22T00:18:32.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.260+0000 7efd2d04e700 1 -- start start 2023-08-22T00:18:32.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2d04e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efd28065490 0x7efd280c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:32.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2d04e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd28064050 con 0x7efd280c46b0 2023-08-22T00:18:32.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2d04e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd28151dd0 con 0x7efd281519f0 2023-08-22T00:18:32.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2d04e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd280bd6e0 con 0x7efd28065490 2023-08-22T00:18:32.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2759e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efd280c46b0 0x7efd2815d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48946/0 (socket says 172.21.15.98:48946) 2023-08-22T00:18:32.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2759e700 1 -- 172.21.15.98:0/1636697855 learned_addr learned my addr 172.21.15.98:0/1636697855 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:32.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2659c700 1 --2- 172.21.15.98:0/1636697855 >> v2:172.21.15.118:3300/0 conn(0x7efd28065490 0x7efd280c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:32.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015103508 0 0) 0x7efd28064050 con 0x7efd280c46b0 2023-08-22T00:18:32.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd100033f0 con 0x7efd280c46b0 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416596820 0 0) 0x7efd28151dd0 con 0x7efd281519f0 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd28064050 con 0x7efd281519f0 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2659c700 1 -- 172.21.15.98:0/1636697855 >> v1:172.21.15.118:6789/0 conn(0x7efd281519f0 legacy=0x7efd280be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137815878 0 0) 0x7efd100033f0 con 0x7efd280c46b0 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2659c700 1 -- 172.21.15.98:0/1636697855 >> v1:172.21.15.98:6789/0 conn(0x7efd280c46b0 legacy=0x7efd2815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2659c700 1 -- 172.21.15.98:0/1636697855 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280bcad0 con 0x7efd28065490 2023-08-22T00:18:32.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.261+0000 7efd2659c700 1 --2- 172.21.15.98:0/1636697855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd28065490 0x7efd280c41c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7efd1c009760 tx=0x7efd1c009060).ready entity=mon.1 client_cookie=e7d32f321435fa62 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:32.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200017f0 con 0x7efd28065490 2023-08-22T00:18:32.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c011400 con 0x7efd28065490 2023-08-22T00:18:32.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd25d9b700 1 -- 172.21.15.98:0/1636697855 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c011780 con 0x7efd28065490 2023-08-22T00:18:32.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 -- 172.21.15.98:0/1636697855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd28065490 msgr2=0x7efd280c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1636697855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd28065490 0x7efd280c41c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7efd1c009760 tx=0x7efd1c009060).stop 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 -- 172.21.15.98:0/1636697855 shutdown_connections 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1636697855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd28065490 0x7efd280c41c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 -- 172.21.15.98:0/1636697855 >> 172.21.15.98:0/1636697855 conn(0x7efd2806a910 msgr2=0x7efd28065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 -- 172.21.15.98:0/1636697855 shutdown_connections 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.262+0000 7efd2d04e700 1 -- 172.21.15.98:0/1636697855 wait complete. 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.263+0000 7efd2d04e700 1 Processor -- start 2023-08-22T00:18:32.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.263+0000 7efd2d04e700 1 -- start start 2023-08-22T00:18:32.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:32.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd280c46b0 0x7efd280a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:32.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd281519f0 0x7efd281677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:32.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280ace40 con 0x7efd28065490 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280ad7c0 con 0x7efd281519f0 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2d04e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280ac510 con 0x7efd280c46b0 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd26d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd26d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54226/0 (socket says 172.21.15.98:54226) 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd26d9d700 1 -- 172.21.15.98:0/1662061127 learned_addr learned my addr 172.21.15.98:0/1662061127 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2659c700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd280c46b0 0x7efd280a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.264+0000 7efd2759e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd281519f0 0x7efd281677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:32.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 -- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd280c46b0 msgr2=0x7efd280a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd280c46b0 0x7efd280a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 -- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd281519f0 msgr2=0x7efd281677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd281519f0 0x7efd281677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 -- 172.21.15.98:0/1662061127 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0092a0 con 0x7efd28065490 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd26d9d700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7efd1800c470 tx=0x7efd18007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18012400 con 0x7efd28065490 2023-08-22T00:18:32.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd18012560 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18012920 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd280ac7f0 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.265+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280ac1c0 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.266+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd28047480 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.266+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7efd1801b3b0 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.267+0000 7efd0effd700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 0x7efd14061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.267+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7429+0+0 (secure 0 0 0) 0x7efd18079d20 con 0x7efd28065490 2023-08-22T00:18:32.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.267+0000 7efd2659c700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 0x7efd14061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:32.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.267+0000 7efd2659c700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 0x7efd14061440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efd280a59b0 tx=0x7efd1c016000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:32.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.271+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd1804aa90 con 0x7efd28065490 2023-08-22T00:18:32.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.466+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd280aa2a0 con 0x7efd1405ef80 2023-08-22T00:18:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.470+0000 7efd0effd700 1 -- 172.21.15.98:0/1662061127 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7efd280aa2a0 con 0x7efd1405ef80 2023-08-22T00:18:32.472 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-08-22T00:18:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 msgr2=0x7efd14061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 0x7efd14061440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efd280a59b0 tx=0x7efd1c016000).stop 2023-08-22T00:18:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 msgr2=0x7efd280ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7efd1800c470 tx=0x7efd18007c90).stop 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 shutdown_connections 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd281519f0 0x7efd281677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd28065490 0x7efd280ad2d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd1405ef80 0x7efd14061440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 --2- 172.21.15.98:0/1662061127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd280c46b0 0x7efd280a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 >> 172.21.15.98:0/1662061127 conn(0x7efd2806a910 msgr2=0x7efd280c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.473+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 shutdown_connections 2023-08-22T00:18:32.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:32.474+0000 7efd2d04e700 1 -- 172.21.15.98:0/1662061127 wait complete. 2023-08-22T00:18:32.490 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-08-22T00:18:32.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.491 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-22T00:18:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:32.518 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:32.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.519 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:32.585 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:32.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.586 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:32.650 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:32.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.651 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:32.718 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:32.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.719 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:32.783 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:32.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.784 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:32.849 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:32.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.850 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:32.915 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:32.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.916 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:32.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:32.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:32.981 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:33.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:33.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.050 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:33.115 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:33.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.115 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:33.180 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:33.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.181 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:33.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.247 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-08-22T00:18:33.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-08-22T00:18:33.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.493+0000 7f503ac21700 1 Processor -- start 2023-08-22T00:18:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.493+0000 7f503ac21700 1 -- start start 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f503ac21700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5034154010 0x7f50340c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f503ac21700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340c38d0 con 0x7f50340c4e60 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f503ac21700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340c3bb0 con 0x7f5034153c30 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f503ac21700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340aad70 con 0x7f5034154010 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f50391be700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f50340c4e60 0x7f5034068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48962/0 (socket says 172.21.15.98:48962) 2023-08-22T00:18:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f50391be700 1 -- 172.21.15.98:0/3693273450 learned_addr learned my addr 172.21.15.98:0/3693273450 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f5033fff700 1 --2- 172.21.15.98:0/3693273450 >> v2:172.21.15.118:3300/0 conn(0x7f5034154010 0x7f50340c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.494+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886016144 0 0) 0x7f50340c38d0 con 0x7f50340c4e60 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f501c0033f0 con 0x7f50340c4e60 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286342334 0 0) 0x7f50340c3bb0 con 0x7f5034153c30 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50340c38d0 con 0x7f5034153c30 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 559669718 0 0) 0x7f501c0033f0 con 0x7f50340c4e60 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 >> v2:172.21.15.118:3300/0 conn(0x7f5034154010 msgr2=0x7f50340c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 --2- 172.21.15.98:0/3693273450 >> v2:172.21.15.118:3300/0 conn(0x7f5034154010 0x7f50340c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 >> v1:172.21.15.118:6789/0 conn(0x7f5034153c30 legacy=0x7f50340a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c3e90 con 0x7f50340c4e60 2023-08-22T00:18:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f5024001470 con 0x7f50340c4e60 2023-08-22T00:18:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 >> v1:172.21.15.98:6789/0 conn(0x7f50340c4e60 legacy=0x7f5034068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f501c003a70 0x7f501c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 0x7f501c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c005000 0x7f501c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340aad70 con 0x7f501c004690 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c00bf60 con 0x7f501c005000 2023-08-22T00:18:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c00c0d0 con 0x7f501c003a70 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 0x7f501c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50391be700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c005000 0x7f501c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50389bd700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f501c003a70 0x7f501c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 -- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f501c003a70 msgr2=0x7f501c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f501c003a70 0x7f501c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 -- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c005000 msgr2=0x7f501c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c005000 0x7f501c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f50391be700 1 -- 172.21.15.98:0/3693273450 reap_dead start 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 -- 172.21.15.98:0/3693273450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0033f0 con 0x7f501c004690 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.495+0000 7f5033fff700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 0x7f501c004b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f5028009a60 tx=0x7f5028009060).ready entity=mon.0 client_cookie=e5a2abcb9ef28902 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028009ea0 con 0x7f501c004690 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5028009430 con 0x7f501c004690 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f50337fe700 1 -- 172.21.15.98:0/3693273450 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800e870 con 0x7f501c004690 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 -- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 msgr2=0x7f501c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 0x7f501c004b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f5028009a60 tx=0x7f5028009060).stop 2023-08-22T00:18:33.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 -- 172.21.15.98:0/3693273450 shutdown_connections 2023-08-22T00:18:33.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 --2- 172.21.15.98:0/3693273450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f501c004690 0x7f501c004b10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 -- 172.21.15.98:0/3693273450 >> 172.21.15.98:0/3693273450 conn(0x7f50340c5dd0 msgr2=0x7f5034068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:33.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 -- 172.21.15.98:0/3693273450 shutdown_connections 2023-08-22T00:18:33.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.496+0000 7f503ac21700 1 -- 172.21.15.98:0/3693273450 wait complete. 2023-08-22T00:18:33.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.497+0000 7f503ac21700 1 Processor -- start 2023-08-22T00:18:33.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 -- start start 2023-08-22T00:18:33.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004690 0x7f5034158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5034166e90 0x7f5034167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5034155bf0 con 0x7f50340c12a0 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341558c0 con 0x7f501c004690 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f503ac21700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5034167800 con 0x7f5034166e90 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f5033fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f5033fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54236/0 (socket says 172.21.15.98:54236) 2023-08-22T00:18:33.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.498+0000 7f5033fff700 1 -- 172.21.15.98:0/2355294276 learned_addr learned my addr 172.21.15.98:0/2355294276 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f50391be700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5034166e90 0x7f5034167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f50389bd700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004690 0x7f5034158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 -- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5034166e90 msgr2=0x7f5034167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5034166e90 0x7f5034167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 -- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004690 msgr2=0x7f5034158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004690 0x7f5034158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 -- 172.21.15.98:0/2355294276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c1a30 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5033fff700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f501c0045c0 tx=0x7f502801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801b900 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502801ba80 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340c1d10 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801be40 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.499+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340c1720 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.500+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340c2230 con 0x7f50340c12a0 2023-08-22T00:18:33.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.500+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f502802e440 con 0x7f50340c12a0 2023-08-22T00:18:33.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.501+0000 7f5030ff9700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 0x7f5020061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:33.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.501+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7477+0+0 (secure 0 0 0) 0x7f502807bd20 con 0x7f50340c12a0 2023-08-22T00:18:33.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.501+0000 7f50389bd700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 0x7f5020061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:33.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.501+0000 7f50389bd700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 0x7f5020061440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f502c001460 tx=0x7f502c007f30).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:33.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.505+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50340c2230 con 0x7f50340c12a0 2023-08-22T00:18:33.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.705+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5034155d30 con 0x7f502005ef80 2023-08-22T00:18:33.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.712+0000 7f5030ff9700 1 -- 172.21.15.98:0/2355294276 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5034155d30 con 0x7f502005ef80 2023-08-22T00:18:33.713 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-08-22T00:18:33.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.713+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 msgr2=0x7f5020061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.713+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 0x7f5020061440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f502c001460 tx=0x7f502c007f30).stop 2023-08-22T00:18:33.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.713+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 msgr2=0x7f50341505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.713+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f501c0045c0 tx=0x7f502801a000).stop 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 shutdown_connections 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f502005ef80 0x7f5020061440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5034166e90 0x7f5034167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004690 0x7f5034158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 --2- 172.21.15.98:0/2355294276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50340c12a0 0x7f50341505e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:33.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 >> 172.21.15.98:0/2355294276 conn(0x7f50340c5dd0 msgr2=0x7f50340c79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:33.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 shutdown_connections 2023-08-22T00:18:33.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:33.714+0000 7f503ac21700 1 -- 172.21.15.98:0/2355294276 wait complete. 2023-08-22T00:18:33.727 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-08-22T00:18:33.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.727 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-22T00:18:33.751 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:33.751 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:33.752 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:33.753 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:33.753 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:33.753 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:33.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:33.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.754 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:33.818 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:33.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.819 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:33.883 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:33.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.884 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:33.953 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:33.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:33.954 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:34.020 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:34.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.020 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:34.086 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:34.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.087 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:34.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:34.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.152 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:34.218 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:34.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.219 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:34.284 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:34.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.285 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:34.350 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:34.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.351 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:34.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:34.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.437 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:34.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.509 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-08-22T00:18:34.530 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-08-22T00:18:34.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.690+0000 7f8e7b59e700 1 Processor -- start 2023-08-22T00:18:34.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.690+0000 7f8e7b59e700 1 -- start start 2023-08-22T00:18:34.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c14ac40 0x7f8e7c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e7c0c5b80 0x7f8e7c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c0665c0 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c0c62f0 con 0x7f8e7c0c5b80 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c063da0 con 0x7f8e7c14ac40 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54242/0 (socket says 172.21.15.98:54242) 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/3035891607 learned_addr learned my addr 172.21.15.98:0/3035891607 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7a59c700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c14ac40 0x7f8e7c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e79d9b700 1 --2- 172.21.15.98:0/3035891607 >> v2:172.21.15.118:3300/0 conn(0x7f8e7c0c5b80 0x7f8e7c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/3035891607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c14ac40 msgr2=0x7f8e7c14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:34.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c14ac40 0x7f8e7c14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/3035891607 >> v2:172.21.15.118:3300/0 conn(0x7f8e7c0c5b80 msgr2=0x7f8e7c1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/3035891607 >> v2:172.21.15.118:3300/0 conn(0x7f8e7c0c5b80 0x7f8e7c1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.691+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/3035891607 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c151dd0 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8e7c0c4080 tx=0x7f8e74009840).ready entity=mon.0 client_cookie=6375d9788e5b3499 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7959a700 1 -- 172.21.15.98:0/3035891607 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400e070 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7959a700 1 -- 172.21.15.98:0/3035891607 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400b970 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7959a700 1 -- 172.21.15.98:0/3035891607 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400bcf0 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 -- 172.21.15.98:0/3035891607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c0c4ca0 msgr2=0x7f8e7c0c2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:34.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8e7c0c4080 tx=0x7f8e74009840).stop 2023-08-22T00:18:34.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 -- 172.21.15.98:0/3035891607 shutdown_connections 2023-08-22T00:18:34.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c14ac40 0x7f8e7c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/3035891607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c0c4ca0 0x7f8e7c0c2280 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/3035891607 >> v2:172.21.15.118:3300/0 conn(0x7f8e7c0c5b80 0x7f8e7c1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 -- 172.21.15.98:0/3035891607 >> 172.21.15.98:0/3035891607 conn(0x7f8e7c0c7090 msgr2=0x7f8e7c0c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 -- 172.21.15.98:0/3035891607 shutdown_connections 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.692+0000 7f8e7b59e700 1 -- 172.21.15.98:0/3035891607 wait complete. 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.693+0000 7f8e7b59e700 1 Processor -- start 2023-08-22T00:18:34.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.693+0000 7f8e7b59e700 1 -- start start 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c0c4ca0 0x7f8e7c13af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e7c14ac40 0x7f8e7c0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0ac500 con 0x7f8e7c14b610 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0ab8f0 con 0x7f8e7c14ac40 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0abbd0 con 0x7f8e7c0c4ca0 2023-08-22T00:18:34.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54252/0 (socket says 172.21.15.98:54252) 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/1121743159 learned_addr learned my addr 172.21.15.98:0/1121743159 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e7a59c700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c0c4ca0 0x7f8e7c13af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.694+0000 7f8e79d9b700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e7c14ac40 0x7f8e7c0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c0c4ca0 msgr2=0x7f8e7c13af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c0c4ca0 0x7f8e7c13af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e7c14ac40 msgr2=0x7f8e7c0aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:34.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e7c14ac40 0x7f8e7c0aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 -- 172.21.15.98:0/1121743159 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74009ae0 con 0x7f8e7c14b610 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7ad9d700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8e7c068710 tx=0x7f8e7c066700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400bee0 con 0x7f8e7c14b610 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e740092e0 con 0x7f8e7c14b610 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c0abeb0 con 0x7f8e7c14b610 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7401e6c0 con 0x7f8e7c14b610 2023-08-22T00:18:34.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.695+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c13b480 con 0x7f8e7c14b610 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.696+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c154200 con 0x7f8e7c14b610 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.696+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f8e74003040 con 0x7f8e7c14b610 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.697+0000 7f8e6a7fc700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 0x7f8e5c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.697+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7493+0+0 (secure 0 0 0) 0x7f8e7407b950 con 0x7f8e7c14b610 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.697+0000 7f8e7a59c700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 0x7f8e5c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:34.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.697+0000 7f8e7a59c700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 0x7f8e5c061440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e70009b90 tx=0x7f8e70009060).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:34.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.701+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e7404c6d0 con 0x7f8e7c14b610 2023-08-22T00:18:34.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.886+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e7c0c6010 con 0x7f8e5c05ef80 2023-08-22T00:18:34.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.890+0000 7f8e6a7fc700 1 -- 172.21.15.98:0/1121743159 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8e7c0c6010 con 0x7f8e5c05ef80 2023-08-22T00:18:34.892 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-08-22T00:18:34.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 msgr2=0x7f8e5c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 0x7f8e5c061440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e70009b90 tx=0x7f8e70009060).stop 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 msgr2=0x7f8e7c153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8e7c068710 tx=0x7f8e7c066700).stop 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 shutdown_connections 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e5c05ef80 0x7f8e5c061440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7c0c4ca0 0x7f8e7c13af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7c14b610 0x7f8e7c153310 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 --2- 172.21.15.98:0/1121743159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e7c14ac40 0x7f8e7c0aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:34.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 >> 172.21.15.98:0/1121743159 conn(0x7f8e7c0c7090 msgr2=0x7f8e7c068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:34.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 shutdown_connections 2023-08-22T00:18:34.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:34.892+0000 7f8e7b59e700 1 -- 172.21.15.98:0/1121743159 wait complete. 2023-08-22T00:18:34.905 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-08-22T00:18:34.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.905 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-22T00:18:34.932 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:34.933 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:34.934 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:34.934 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:34.934 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:34.934 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:34.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:34.935 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:35.000 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:35.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.001 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:35.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:35.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.066 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:35.135 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:35.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.136 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:35.204 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:35.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.205 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:35.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:35.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.272 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:35.338 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:35.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.339 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:35.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:35.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.430 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:35.468 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:35.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.470 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:35.536 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:35.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.537 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:35.604 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:35.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.605 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:35.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:35.671 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-08-22T00:18:35.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-08-22T00:18:35.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.894+0000 7f205ac1d700 1 Processor -- start 2023-08-22T00:18:35.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.894+0000 7f205ac1d700 1 -- start start 2023-08-22T00:18:35.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f205ac1d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2054064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f205ac1d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2054064f50 con 0x7f2054151bf0 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f205ac1d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540aa190 con 0x7f2054065530 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f205ac1d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540bdfe0 con 0x7f2054151100 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f20591ba700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2054151bf0 0x7f20540bc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48966/0 (socket says 172.21.15.98:48966) 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.895+0000 7f20591ba700 1 -- 172.21.15.98:0/3918692921 learned_addr learned my addr 172.21.15.98:0/3918692921 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:35.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20589b9700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2054064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087925877 0 0) 0x7f204c001490 con 0x7f2054151bf0 2023-08-22T00:18:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20440033f0 con 0x7f2054151bf0 2023-08-22T00:18:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853444722 0 0) 0x7f20440033f0 con 0x7f2054151bf0 2023-08-22T00:18:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 msgr2=0x7f2054064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2054064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 >> v1:172.21.15.118:6789/0 conn(0x7f2054065530 legacy=0x7f20541514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540645d0 con 0x7f2054151bf0 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f204c001980 con 0x7f2054151bf0 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 >> v1:172.21.15.98:6789/0 conn(0x7f2054151bf0 legacy=0x7f20540bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2044003910 0x7f2044003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f2044004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2044005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540bdfe0 con 0x7f2044004690 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204400b910 con 0x7f2044003910 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204400bad0 con 0x7f2054151100 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f2044004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20589b9700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2044003910 0x7f2044003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20591ba700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2044005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 -- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 msgr2=0x7f2044005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2054151100 0x7f2044005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 -- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2044003910 msgr2=0x7f2044003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2044003910 0x7f2044003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f2053fff700 1 -- 172.21.15.98:0/3918692921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440033f0 con 0x7f2044004690 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.896+0000 7f20589b9700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2044003910 0x7f2044003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f2053fff700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f2044004b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2040001700 tx=0x7f2040007bb0).ready entity=mon.0 client_cookie=598b3d55a2a41f4f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040007020 con 0x7f2044004690 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040007180 con 0x7f2044004690 2023-08-22T00:18:35.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f20537fe700 1 -- 172.21.15.98:0/3918692921 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040007500 con 0x7f2044004690 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 -- 172.21.15.98:0/3918692921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 msgr2=0x7f2044004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 --2- 172.21.15.98:0/3918692921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f2044004b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2040001700 tx=0x7f2040007bb0).stop 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f20591ba700 1 -- 172.21.15.98:0/3918692921 reap_dead start 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 -- 172.21.15.98:0/3918692921 shutdown_connections 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 -- 172.21.15.98:0/3918692921 >> 172.21.15.98:0/3918692921 conn(0x7f205406a910 msgr2=0x7f2054065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 -- 172.21.15.98:0/3918692921 shutdown_connections 2023-08-22T00:18:35.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.897+0000 7f205ac1d700 1 -- 172.21.15.98:0/3918692921 wait complete. 2023-08-22T00:18:35.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.898+0000 7f205ac1d700 1 Processor -- start 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 -- start start 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 0x7f20540c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20540a9ba0 0x7f20540c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540c12d0 con 0x7f2044004690 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540a85d0 con 0x7f20540a8110 2023-08-22T00:18:35.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f205ac1d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540a88b0 con 0x7f20540a9ba0 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f20589b9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f20589b9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54274/0 (socket says 172.21.15.98:54274) 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.899+0000 7f20589b9700 1 -- 172.21.15.98:0/1860501740 learned_addr learned my addr 172.21.15.98:0/1860501740 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20591ba700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20540a9ba0 0x7f20540c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f2053fff700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 0x7f20540c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 -- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20540a9ba0 msgr2=0x7f20540c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:35.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20540a9ba0 0x7f20540c0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 -- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 msgr2=0x7f20540c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 0x7f20540c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 -- 172.21.15.98:0/1860501740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540a8b90 con 0x7f2044004690 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f2053fff700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 0x7f20540c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f20589b9700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f2048011d40 tx=0x7f2048009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800fb50 con 0x7f2044004690 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204800fcb0 con 0x7f2044004690 2023-08-22T00:18:35.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540abbf0 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048014440 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.900+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540ab890 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.901+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054047480 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.901+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f2048014a80 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.902+0000 7f2050ff9700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 0x7f2038061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.902+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7461+0+0 (secure 0 0 0) 0x7f204807b410 con 0x7f2044004690 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.902+0000 7f2053fff700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 0x7f2038061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:35.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.902+0000 7f2053fff700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 0x7f2038061440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f20541526e0 tx=0x7f2040016000).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:35.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:35.906+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f204804c1c0 con 0x7f2044004690 2023-08-22T00:18:36.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.091+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f20540c06d0 con 0x7f203805ef80 2023-08-22T00:18:36.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.095+0000 7f2050ff9700 1 -- 172.21.15.98:0/1860501740 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f20540c06d0 con 0x7f203805ef80 2023-08-22T00:18:36.096 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.096+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 msgr2=0x7f2038061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.096+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 0x7f2038061440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f20541526e0 tx=0x7f2040016000).stop 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.096+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 msgr2=0x7f20540a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.096+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f2048011d40 tx=0x7f2048009060).stop 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 shutdown_connections 2023-08-22T00:18:36.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f203805ef80 0x7f2038061440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20540a9ba0 0x7f20540c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2044004690 0x7f20540a7c20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 --2- 172.21.15.98:0/1860501740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20540a8110 0x7f20540c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 >> 172.21.15.98:0/1860501740 conn(0x7f205406a910 msgr2=0x7f205414e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 shutdown_connections 2023-08-22T00:18:36.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:36.097+0000 7f205ac1d700 1 -- 172.21.15.98:0/1860501740 wait complete. 2023-08-22T00:18:36.109 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-08-22T00:18:36.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.110 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-22T00:18:36.136 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:36.136 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:36.137 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:36.138 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:36.138 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:36.138 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:36.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.139 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:36.203 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:36.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.204 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:36.289 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:36.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.290 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:36.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:36.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.320 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:36.387 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:36.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.388 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:36.454 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:36.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.455 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:36.519 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:36.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.520 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:36.585 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:36.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.586 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:36.678 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:36.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.680 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:36.710 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:36.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.711 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:36.776 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:36.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.777 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:36.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:36.842 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-08-22T00:18:36.903 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-08-22T00:18:37.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.063+0000 7f167764f700 1 Processor -- start 2023-08-22T00:18:37.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.063+0000 7f167764f700 1 -- start start 2023-08-22T00:18:37.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f167764f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700aa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f167764f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16700aad10 0x7f16700c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f167764f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700c46d0 con 0x7f1670153da0 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f167764f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700c3ac0 con 0x7f16700aad10 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f167764f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700c3da0 con 0x7f1670155060 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16700aad10 0x7f16700c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f16753eb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1670153da0 0x7f16700c32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:50644/0 (socket says 172.21.15.98:50644) 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1674bea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f16753eb700 1 -- 172.21.15.98:0/2984071176 learned_addr learned my addr 172.21.15.98:0/2984071176 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:37.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 -- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 msgr2=0x7f16700aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:37.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 -- 172.21.15.98:0/2984071176 >> v1:172.21.15.118:6789/0 conn(0x7f1670153da0 legacy=0x7f16700c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 -- 172.21.15.98:0/2984071176 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700c4080 con 0x7f16700aad10 2023-08-22T00:18:37.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1674bea700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.064+0000 7f1675bec700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700c63f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f1668009e60 tx=0x7f1668009780).ready entity=mon.1 client_cookie=41e8bc9325c705b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f1667fff700 1 -- 172.21.15.98:0/2984071176 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800e070 con 0x7f16700aad10 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f1667fff700 1 -- 172.21.15.98:0/2984071176 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166800bb60 con 0x7f16700aad10 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f1667fff700 1 -- 172.21.15.98:0/2984071176 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668012410 con 0x7f16700aad10 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 -- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 msgr2=0x7f16700c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700c63f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f1668009e60 tx=0x7f1668009780).stop 2023-08-22T00:18:37.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 -- 172.21.15.98:0/2984071176 shutdown_connections 2023-08-22T00:18:37.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700c63f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 --2- 172.21.15.98:0/2984071176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 -- 172.21.15.98:0/2984071176 >> 172.21.15.98:0/2984071176 conn(0x7f16700c5330 msgr2=0x7f16700c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:37.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 -- 172.21.15.98:0/2984071176 shutdown_connections 2023-08-22T00:18:37.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.065+0000 7f167764f700 1 -- 172.21.15.98:0/2984071176 wait complete. 2023-08-22T00:18:37.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.067+0000 7f167764f700 1 Processor -- start 2023-08-22T00:18:37.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.067+0000 7f167764f700 1 -- start start 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670167d40 con 0x7f1670153da0 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700c2e30 con 0x7f16700aad10 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f167764f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1670167130 con 0x7f1670155060 2023-08-22T00:18:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54282/0 (socket says 172.21.15.98:54282) 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 -- 172.21.15.98:0/3947801834 learned_addr learned my addr 172.21.15.98:0/3947801834 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f16753eb700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1675bec700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 -- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 msgr2=0x7f16700c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 -- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 msgr2=0x7f16700bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1674bea700 1 -- 172.21.15.98:0/3947801834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600092a0 con 0x7f1670153da0 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f1675bec700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.068+0000 7f16753eb700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f1674bea700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f166000e980 tx=0x7f1660009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000c850 con 0x7f1670153da0 2023-08-22T00:18:37.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000c9b0 con 0x7f1670153da0 2023-08-22T00:18:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1668009a20 con 0x7f1670153da0 2023-08-22T00:18:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000cd30 con 0x7f1670153da0 2023-08-22T00:18:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.069+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16701676f0 con 0x7f1670153da0 2023-08-22T00:18:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.070+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1670047480 con 0x7f1670153da0 2023-08-22T00:18:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.070+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f1660012600 con 0x7f1670153da0 2023-08-22T00:18:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.070+0000 7f16657fa700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 0x7f1654061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.071+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7745+0+0 (secure 0 0 0) 0x7f166007ac50 con 0x7f1670153da0 2023-08-22T00:18:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.071+0000 7f16753eb700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 0x7f1654061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.071+0000 7f16753eb700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 0x7f1654061440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f166c0057a0 tx=0x7f166c009040).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.075+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f166004b8e0 con 0x7f1670153da0 2023-08-22T00:18:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.259+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1670167e80 con 0x7f165405ef80 2023-08-22T00:18:37.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.268+0000 7f16657fa700 1 -- 172.21.15.98:0/3947801834 <== mgr.4850 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f166c007e20 con 0x7f165405ef80 2023-08-22T00:18:37.273 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-08-22T00:18:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 msgr2=0x7f1654061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 0x7f1654061440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f166c0057a0 tx=0x7f166c009040).stop 2023-08-22T00:18:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 msgr2=0x7f16700c2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f166000e980 tx=0x7f1660009060).stop 2023-08-22T00:18:37.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 shutdown_connections 2023-08-22T00:18:37.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f165405ef80 0x7f1654061440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1670155060 0x7f16700c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16700aad10 0x7f16700bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 --2- 172.21.15.98:0/3947801834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1670153da0 0x7f16700c2450 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.273+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 >> 172.21.15.98:0/3947801834 conn(0x7f16700c5330 msgr2=0x7f1670153360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.274+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 shutdown_connections 2023-08-22T00:18:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:37.274+0000 7f167764f700 1 -- 172.21.15.98:0/3947801834 wait complete. 2023-08-22T00:18:37.291 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-08-22T00:18:37.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.292 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-22T00:18:37.318 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:37.318 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:37.319 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:37.319 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:37.319 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:37.320 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:37.320 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:37.320 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:37.321 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:37.321 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:37.321 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:37.321 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_08_00_UTC 2023-08-22T00:18:37.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.322 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_08_00_UTC) 2023-08-22T00:18:37.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_09_00_UTC 2023-08-22T00:18:37.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.386 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_09_00_UTC) 2023-08-22T00:18:37.451 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_10_00_UTC 2023-08-22T00:18:37.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.452 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_10_00_UTC) 2023-08-22T00:18:37.517 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_11_00_UTC 2023-08-22T00:18:37.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.518 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_11_00_UTC) 2023-08-22T00:18:37.584 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_12_00_UTC 2023-08-22T00:18:37.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.585 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_12_00_UTC) 2023-08-22T00:18:37.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_13_00_UTC 2023-08-22T00:18:37.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.650 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_13_00_UTC) 2023-08-22T00:18:37.733 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_14_00_UTC 2023-08-22T00:18:37.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.734 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_14_00_UTC) 2023-08-22T00:18:37.766 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_15_00_UTC 2023-08-22T00:18:37.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.767 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_15_00_UTC) 2023-08-22T00:18:37.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_16_00_UTC 2023-08-22T00:18:37.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.833 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_16_00_UTC) 2023-08-22T00:18:37.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_17_00_UTC 2023-08-22T00:18:37.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.898 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_17_00_UTC) 2023-08-22T00:18:37.963 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_18_00_UTC 2023-08-22T00:18:37.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:37.965 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-22-00_18_00_UTC) 2023-08-22T00:18:38.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:18:38.030 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-08-22T00:18:38.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:18:38.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.249+0000 7f1f5d7d6700 1 Processor -- start 2023-08-22T00:18:38.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.249+0000 7f1f5d7d6700 1 -- start start 2023-08-22T00:18:38.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f5d7d6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1f580ad420 0x7f1f581548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f5d7d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 0x7f1f58063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f5d7d6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f580c6270 con 0x7f1f580ad040 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f5d7d6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f580c9040 con 0x7f1f580ad420 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f5d7d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58063500 con 0x7f1f580c5df0 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f567fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1f580ad420 0x7f1f581548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f56ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1f580ad040 0x7f1f581541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48972/0 (socket says 172.21.15.98:48972) 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f56ffd700 1 -- 172.21.15.98:0/2255278964 learned_addr learned my addr 172.21.15.98:0/2255278964 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:38.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f55ffb700 1 -- 172.21.15.98:0/2255278964 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056013419 0 0) 0x7f1f48001110 con 0x7f1f580ad040 2023-08-22T00:18:38.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.250+0000 7f1f55ffb700 1 -- 172.21.15.98:0/2255278964 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f400033f0 con 0x7f1f580ad040 2023-08-22T00:18:38.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f577fe700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 0x7f1f58063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f567fc700 1 -- 172.21.15.98:0/2255278964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 msgr2=0x7f1f58063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:38.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f567fc700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 0x7f1f58063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:38.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f567fc700 1 -- 172.21.15.98:0/2255278964 >> v1:172.21.15.98:6789/0 conn(0x7f1f580ad040 legacy=0x7f1f581541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f567fc700 1 -- 172.21.15.98:0/2255278964 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58063fb0 con 0x7f1f580ad420 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f577fe700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 0x7f1f58063010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f567fc700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f581548f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1f4c009760 tx=0x7f1f4c009060).ready entity=mon.0 client_cookie=f45aefe7ab109c33 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f55ffb700 1 -- 172.21.15.98:0/2255278964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0090d0 con 0x7f1f580ad420 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f55ffb700 1 -- 172.21.15.98:0/2255278964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00f510 con 0x7f1f580ad420 2023-08-22T00:18:38.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f55ffb700 1 -- 172.21.15.98:0/2255278964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00f890 con 0x7f1f580ad420 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/2255278964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 msgr2=0x7f1f581548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f581548f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1f4c009760 tx=0x7f1f4c009060).stop 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/2255278964 shutdown_connections 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580c5df0 0x7f1f58063010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/2255278964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f581548f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/2255278964 >> 172.21.15.98:0/2255278964 conn(0x7f1f580cb600 msgr2=0x7f1f580c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:38.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/2255278964 shutdown_connections 2023-08-22T00:18:38.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.251+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/2255278964 wait complete. 2023-08-22T00:18:38.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.253+0000 7f1f5d7d6700 1 Processor -- start 2023-08-22T00:18:38.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.253+0000 7f1f5d7d6700 1 -- start start 2023-08-22T00:18:38.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580ad040 0x7f1f5814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f580c5df0 0x7f1f58164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5814c8e0 con 0x7f1f580ad420 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58164fc0 con 0x7f1f580c5df0 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f5d7d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5814cad0 con 0x7f1f580ad040 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f567fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f567fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54304/0 (socket says 172.21.15.98:54304) 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f567fc700 1 -- 172.21.15.98:0/1930203211 learned_addr learned my addr 172.21.15.98:0/1930203211 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f56ffd700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580ad040 0x7f1f5814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f577fe700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f580c5df0 0x7f1f58164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f567fc700 1 -- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580ad040 msgr2=0x7f1f5814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.254+0000 7f1f567fc700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580ad040 0x7f1f5814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.255+0000 7f1f567fc700 1 -- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f580c5df0 msgr2=0x7f1f58164ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.255+0000 7f1f567fc700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f580c5df0 0x7f1f58164ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.255+0000 7f1f567fc700 1 -- 172.21.15.98:0/1930203211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0092a0 con 0x7f1f580ad420 2023-08-22T00:18:38.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.255+0000 7f1f567fc700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1f58065710 tx=0x7f1f4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:38.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.259+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00f890 con 0x7f1f580ad420 2023-08-22T00:18:38.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.260+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c000d10 con 0x7f1f580ad420 2023-08-22T00:18:38.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.260+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5814cdb0 con 0x7f1f580ad420 2023-08-22T00:18:38.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.260+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00fe80 con 0x7f1f580ad420 2023-08-22T00:18:38.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.260+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5814d370 con 0x7f1f580ad420 2023-08-22T00:18:38.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.261+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f58083670 con 0x7f1f580ad420 2023-08-22T00:18:38.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.261+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f1f4c01b620 con 0x7f1f580ad420 2023-08-22T00:18:38.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.262+0000 7f1f3effd700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 0x7f1f44061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:38.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.262+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7477+0+0 (secure 0 0 0) 0x7f1f4c07be00 con 0x7f1f580ad420 2023-08-22T00:18:38.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.262+0000 7f1f56ffd700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 0x7f1f44061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:38.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.263+0000 7f1f56ffd700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 0x7f1f44061490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1f48001270 tx=0x7f1f48000bc0).ready entity=mgr.4850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:38.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.269+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f4c04cc60 con 0x7f1f580ad420 2023-08-22T00:18:38.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:38.494+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1f58046c20 con 0x7f1f580ad420 2023-08-22T00:18:39.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.427+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f1f4c0795c0 con 0x7f1f580ad420 2023-08-22T00:18:39.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.428+0000 7f1f3effd700 1 -- 172.21.15.98:0/1930203211 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v12) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1f4c0757d0 con 0x7f1f580ad420 2023-08-22T00:18:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 msgr2=0x7f1f44061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 0x7f1f44061490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1f48001270 tx=0x7f1f48000bc0).stop 2023-08-22T00:18:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 msgr2=0x7f1f5814c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:39.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1f58065710 tx=0x7f1f4c017000).stop 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 shutdown_connections 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1f4405efd0 0x7f1f44061490 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0x7f1f48001270 tx=0x7f1f48000bc0).stop 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f580ad040 0x7f1f5814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f580c5df0 0x7f1f58164ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 --2- 172.21.15.98:0/1930203211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f580ad420 0x7f1f5814c3f0 secure :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0x7f1f58065710 tx=0x7f1f4c017000).stop 2023-08-22T00:18:39.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.431+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 >> 172.21.15.98:0/1930203211 conn(0x7f1f580cb600 msgr2=0x7f1f580aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:39.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.433+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 shutdown_connections 2023-08-22T00:18:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:39.446+0000 7f1f5d7d6700 1 -- 172.21.15.98:0/1930203211 wait complete. 2023-08-22T00:18:39.474 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:18:39.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:18:39.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:18:39.574 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:18:39.575 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:18:39.575 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:18:39.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:18:39.585 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:39.583+0000 7f6445870680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:18:39.599 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:39.598+0000 7ffa23211680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:18:39.615 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[132173]: fuse finished with error 0 and tester_r 0 2023-08-22T00:18:39.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:18:39.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:18:39.617 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:18:39.648 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:39.647+0000 7f6445870680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:18:39.669 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:39.664+0000 7ffa23211680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:18:39.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:18:39.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:18:39.786 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:18:39.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:18:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:18:39.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:18:39.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:18:39.806 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:18:39.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:18:39.843 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:18:39.843 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:18:39.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:18:39.844 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:18:39.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:18:39.863 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:18:39.864 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:39.925 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:39.924+0000 7f6445870680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:18:39.947 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:39.946+0000 7ffa23211680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:18:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.001+0000 7fd83f907700 1 Processor -- start 2023-08-22T00:18:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.001+0000 7fd83f907700 1 -- start start 2023-08-22T00:18:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83f907700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd83814c350 0x7fd838152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83f907700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd8380c3e50 0x7fd8381556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83f907700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd838153080 con 0x7fd83814bf70 2023-08-22T00:18:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83f907700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd838066510 con 0x7fd8380c3e50 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83f907700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8380667b0 con 0x7fd83814c350 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83d6a3700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd83814bf70 0x7fd8380c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48978/0 (socket says 172.21.15.98:48978) 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83d6a3700 1 -- 172.21.15.98:0/3982858744 learned_addr learned my addr 172.21.15.98:0/3982858744 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83dea4700 1 --2- 172.21.15.98:0/3982858744 >> v2:172.21.15.98:3300/0 conn(0x7fd8380c3e50 0x7fd8381556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83cea2700 1 --2- 172.21.15.98:0/3982858744 >> v2:172.21.15.118:3300/0 conn(0x7fd83814c350 0x7fd838152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83dea4700 1 -- 172.21.15.98:0/3982858744 >> v2:172.21.15.118:3300/0 conn(0x7fd83814c350 msgr2=0x7fd838152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83dea4700 1 --2- 172.21.15.98:0/3982858744 >> v2:172.21.15.118:3300/0 conn(0x7fd83814c350 0x7fd838152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83dea4700 1 -- 172.21.15.98:0/3982858744 >> v1:172.21.15.98:6789/0 conn(0x7fd83814bf70 legacy=0x7fd8380c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd82ffff700 1 -- 172.21.15.98:0/3982858744 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539542366 0 0) 0x7fd838153080 con 0x7fd83814bf70 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.002+0000 7fd83dea4700 1 -- 172.21.15.98:0/3982858744 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838155ba0 con 0x7fd8380c3e50 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83dea4700 1 --2- 172.21.15.98:0/3982858744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd8381556b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fd8380c2df0 tx=0x7fd830009780).ready entity=mon.0 client_cookie=a065e9c48417d205 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd82ffff700 1 -- 172.21.15.98:0/3982858744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000e070 con 0x7fd8380c3e50 2023-08-22T00:18:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd82ffff700 1 -- 172.21.15.98:0/3982858744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000bb60 con 0x7fd8380c3e50 2023-08-22T00:18:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd82ffff700 1 -- 172.21.15.98:0/3982858744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830012410 con 0x7fd8380c3e50 2023-08-22T00:18:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 -- 172.21.15.98:0/3982858744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 msgr2=0x7fd8381556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 --2- 172.21.15.98:0/3982858744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd8381556b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fd8380c2df0 tx=0x7fd830009780).stop 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 -- 172.21.15.98:0/3982858744 shutdown_connections 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 --2- 172.21.15.98:0/3982858744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd8381556b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 --2- 172.21.15.98:0/3982858744 >> v2:172.21.15.118:3300/0 conn(0x7fd83814c350 0x7fd838152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 -- 172.21.15.98:0/3982858744 >> 172.21.15.98:0/3982858744 conn(0x7fd8380c5dc0 msgr2=0x7fd838068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 -- 172.21.15.98:0/3982858744 shutdown_connections 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.003+0000 7fd83f907700 1 -- 172.21.15.98:0/3982858744 wait complete. 2023-08-22T00:18:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.005+0000 7fd83f907700 1 Processor -- start 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.005+0000 7fd83f907700 1 -- start start 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd83814bf70 0x7fd838064f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83814c350 0x7fd8381532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838064a70 con 0x7fd8380c3e50 2023-08-22T00:18:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838064140 con 0x7fd83814c350 2023-08-22T00:18:40.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd838064420 con 0x7fd83814bf70 2023-08-22T00:18:40.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54356/0 (socket says 172.21.15.98:54356) 2023-08-22T00:18:40.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 -- 172.21.15.98:0/393731531 learned_addr learned my addr 172.21.15.98:0/393731531 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:40.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83cea2700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd83814bf70 0x7fd838064f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83dea4700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83814c350 0x7fd8381532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd83814bf70 msgr2=0x7fd838064f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd83814bf70 0x7fd838064f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83814c350 msgr2=0x7fd8381532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83814c350 0x7fd8381532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 -- 172.21.15.98:0/393731531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009a20 con 0x7fd8380c3e50 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83d6a3700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fd83400c4e0 tx=0x7fd834007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400ce90 con 0x7fd8380c3e50 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8340072e0 con 0x7fd8380c3e50 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838064700 con 0x7fd8380c3e50 2023-08-22T00:18:40.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834007660 con 0x7fd8380c3e50 2023-08-22T00:18:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.006+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8380653f0 con 0x7fd8380c3e50 2023-08-22T00:18:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.007+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8380656d0 con 0x7fd8380c3e50 2023-08-22T00:18:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.008+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fd8340059b0 con 0x7fd8380c3e50 2023-08-22T00:18:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.008+0000 7fd82d7fa700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 0x7fd81c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.008+0000 7fd83cea2700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 msgr2=0x7fd81c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:40.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.008+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7493+0+0 (secure 0 0 0) 0x7fd834079d50 con 0x7fd8380c3e50 2023-08-22T00:18:40.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.008+0000 7fd83cea2700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 0x7fd81c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:40.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.012+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd83404aae0 con 0x7fd8380c3e50 2023-08-22T00:18:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.209+0000 7fd83cea2700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 msgr2=0x7fd81c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.209+0000 7fd83cea2700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 0x7fd81c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:18:40.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.224+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd838047480 con 0x7fd8380c3e50 2023-08-22T00:18:40.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.225+0000 7fd82d7fa700 1 -- 172.21.15.98:0/393731531 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7fd834018020 con 0x7fd8380c3e50 2023-08-22T00:18:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:40.226 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:18:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 msgr2=0x7fd81c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 0x7fd81c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 msgr2=0x7fd838149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fd83400c4e0 tx=0x7fd834007c70).stop 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 shutdown_connections 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83814c350 0x7fd8381532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8380c3e50 0x7fd838149300 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd81c05ef30 0x7fd81c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 --2- 172.21.15.98:0/393731531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd83814bf70 0x7fd838064f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 >> 172.21.15.98:0/393731531 conn(0x7fd8380c5dc0 msgr2=0x7fd83814a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 shutdown_connections 2023-08-22T00:18:40.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.227+0000 7fd83f907700 1 -- 172.21.15.98:0/393731531 wait complete. 2023-08-22T00:18:40.230 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:18:40.241 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:40.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.368+0000 7f80779ee700 1 Processor -- start 2023-08-22T00:18:40.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.368+0000 7f80779ee700 1 -- start start 2023-08-22T00:18:40.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.369+0000 7f80779ee700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8070155480 0x7f80701558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.369+0000 7f80779ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f8070155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.369+0000 7f80779ee700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070066420 con 0x7f80701550a0 2023-08-22T00:18:40.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f80779ee700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80701562b0 con 0x7f8070155480 2023-08-22T00:18:40.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f80779ee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8070064360 con 0x7f80700a4680 2023-08-22T00:18:40.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f807578a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f80701550a0 0x7f8070063b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45154/0 (socket says 172.21.15.98:45154) 2023-08-22T00:18:40.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f807578a700 1 -- 172.21.15.98:0/1391199189 learned_addr learned my addr 172.21.15.98:0/1391199189 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:40.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 --2- 172.21.15.98:0/1391199189 >> v2:172.21.15.118:3300/0 conn(0x7f8070155480 0x7f80701558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8075f8b700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f8070155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8067fff700 1 -- 172.21.15.98:0/1391199189 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015465905 0 0) 0x7f8070066420 con 0x7f80701550a0 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8067fff700 1 -- 172.21.15.98:0/1391199189 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f805c0033f0 con 0x7f80701550a0 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 -- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 msgr2=0x7f8070155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f8070155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 -- 172.21.15.98:0/1391199189 >> v1:172.21.15.98:6789/0 conn(0x7f80701550a0 legacy=0x7f8070063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 -- 172.21.15.98:0/1391199189 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070064640 con 0x7f8070155480 2023-08-22T00:18:40.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8074f89700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8070155480 0x7f80701558d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8060009760 tx=0x7f8060009060).ready entity=mon.1 client_cookie=713f418f9ad71e63 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8067fff700 1 -- 172.21.15.98:0/1391199189 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000d4a0 con 0x7f8070155480 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8067fff700 1 -- 172.21.15.98:0/1391199189 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000d600 con 0x7f8070155480 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.370+0000 7f8067fff700 1 -- 172.21.15.98:0/1391199189 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000d980 con 0x7f8070155480 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 -- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8070155480 msgr2=0x7f80701558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8070155480 0x7f80701558d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8060009760 tx=0x7f8060009060).stop 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 -- 172.21.15.98:0/1391199189 shutdown_connections 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f8070155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 --2- 172.21.15.98:0/1391199189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8070155480 0x7f80701558d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 -- 172.21.15.98:0/1391199189 >> 172.21.15.98:0/1391199189 conn(0x7f80700c7770 msgr2=0x7f80700c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 -- 172.21.15.98:0/1391199189 shutdown_connections 2023-08-22T00:18:40.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.371+0000 7f80779ee700 1 -- 172.21.15.98:0/1391199189 wait complete. 2023-08-22T00:18:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.372+0000 7f80779ee700 1 Processor -- start 2023-08-22T00:18:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.372+0000 7f80779ee700 1 -- start start 2023-08-22T00:18:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f807014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80701550a0 0x7f8070066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070067170 con 0x7f8070155480 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700a4f00 con 0x7f80701550a0 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f80779ee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8070158810 con 0x7f80700a4680 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.373+0000 7f8075f8b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41108/0 (socket says 172.21.15.98:41108) 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 -- 172.21.15.98:0/4049640288 learned_addr learned my addr 172.21.15.98:0/4049640288 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:40.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f807578a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f807014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8074f89700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80701550a0 0x7f8070066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 -- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 msgr2=0x7f807014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f807014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 -- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80701550a0 msgr2=0x7f8070066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80701550a0 0x7f8070066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 -- 172.21.15.98:0/4049640288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600092a0 con 0x7f8070155480 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f8075f8b700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f8068009ef0 tx=0x7f806800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800cb70 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800f040 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80700a5150 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068013400 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.374+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80700a5710 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.375+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80700a5900 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.375+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f80680137b0 con 0x7f8070155480 2023-08-22T00:18:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.376+0000 7f80657fa700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 0x7f80540613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.376+0000 7f807578a700 1 -- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 msgr2=0x7f80540613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:40.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.376+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f806807acd0 con 0x7f8070155480 2023-08-22T00:18:40.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.376+0000 7f807578a700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 0x7f80540613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:40.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.380+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f806804bb00 con 0x7f8070155480 2023-08-22T00:18:40.549 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:40.546+0000 7f6445870680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:18:40.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.556+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8070047480 con 0x7f8070155480 2023-08-22T00:18:40.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.558+0000 7f80657fa700 1 -- 172.21.15.98:0/4049640288 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18580 (secure 0 0 0) 0x7f806804f120 con 0x7f8070155480 2023-08-22T00:18:40.562 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:40.562 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":56,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:40.257962+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":56,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]},{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:6832/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/3866194044":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/1133946166":"2023-08-23T00:07:28.539754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":3,"length":1},{"begin":6,"length":1},{"begin":9,"length":2},{"begin":13,"length":1},{"begin":16,"length":1},{"begin":19,"length":2},{"begin":23,"length":1},{"begin":26,"length":1},{"begin":29,"length":2},{"begin":34,"length":1},{"begin":37,"length":1},{"begin":40,"length":2},{"begin":44,"length":1},{"begin":47,"length":1},{"begin":50,"length":2},{"begin":54,"length":1},{"begin":57,"length":1},{"begin":60,"length":2},{"begin":64,"length":1},{"begin":67,"length":1},{"begin":70,"length":2},{"begin":74,"length":1},{"begin":77,"length":1},{"begin":80,"length":2},{"begin":84,"length":1},{"begin":87,"length":1},{"begin":90,"length":2},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":100,"length":2},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":177,"length":45}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:40.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.560+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 msgr2=0x7f80540613c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:40.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.560+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 0x7f80540613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.560+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 msgr2=0x7f8070066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.560+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f8068009ef0 tx=0x7f806800b040).stop 2023-08-22T00:18:40.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 shutdown_connections 2023-08-22T00:18:40.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f805405ef00 0x7f80540613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f80700a4680 0x7f807014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8070155480 0x7f8070066c80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 --2- 172.21.15.98:0/4049640288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80701550a0 0x7f8070066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 >> 172.21.15.98:0/4049640288 conn(0x7f80700c7770 msgr2=0x7f80700c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 shutdown_connections 2023-08-22T00:18:40.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.561+0000 7f80779ee700 1 -- 172.21.15.98:0/4049640288 wait complete. 2023-08-22T00:18:40.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:07:13.683089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:07:14.624350+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 221, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:18:40.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:18:40.602 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:40.600+0000 7ffa23211680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:18:40.619 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:40.617+0000 7f6445870680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:18:40.675 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:40.674+0000 7ffa23211680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:18:40.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.712+0000 7ff1ebb9d700 1 Processor -- start 2023-08-22T00:18:40.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.712+0000 7ff1ebb9d700 1 -- start start 2023-08-22T00:18:40.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ebb9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1e4157ab0 0x7ff1e4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ebb9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 0x7ff1e40acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ebb9d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e41541c0 con 0x7ff1e4062600 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ebb9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40ca860 con 0x7ff1e4157ab0 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ebb9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4063fc0 con 0x7ff1e4063b10 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1e9138700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff1e4062600 0x7ff1e40ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45156/0 (socket says 172.21.15.98:45156) 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1e9138700 1 -- 172.21.15.98:0/3083728677 learned_addr learned my addr 172.21.15.98:0/3083728677 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/3083728677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 0x7ff1e40acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1e9939700 1 --2- 172.21.15.98:0/3083728677 >> v2:172.21.15.118:3300/0 conn(0x7ff1e4157ab0 0x7ff1e4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1e8937700 1 -- 172.21.15.98:0/3083728677 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247597193 0 0) 0x7ff1e41541c0 con 0x7ff1e4062600 2023-08-22T00:18:40.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1e8937700 1 -- 172.21.15.98:0/3083728677 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d00033f0 con 0x7ff1e4062600 2023-08-22T00:18:40.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ea13a700 1 -- 172.21.15.98:0/3083728677 >> v2:172.21.15.118:3300/0 conn(0x7ff1e4157ab0 msgr2=0x7ff1e4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:40.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/3083728677 >> v2:172.21.15.118:3300/0 conn(0x7ff1e4157ab0 0x7ff1e4157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ea13a700 1 -- 172.21.15.98:0/3083728677 >> v1:172.21.15.98:6789/0 conn(0x7ff1e4062600 legacy=0x7ff1e40ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.713+0000 7ff1ea13a700 1 -- 172.21.15.98:0/3083728677 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4062a90 con 0x7ff1e4063b10 2023-08-22T00:18:40.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/3083728677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 0x7ff1e40acbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff1dc009e60 tx=0x7ff1dc009780).ready entity=mon.2 client_cookie=5b5b0e0f80856349 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1e8937700 1 -- 172.21.15.98:0/3083728677 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00e070 con 0x7ff1e4063b10 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1e8937700 1 -- 172.21.15.98:0/3083728677 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00bab0 con 0x7ff1e4063b10 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1e8937700 1 -- 172.21.15.98:0/3083728677 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00be30 con 0x7ff1e4063b10 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/3083728677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 msgr2=0x7ff1e40acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/3083728677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 0x7ff1e40acbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff1dc009e60 tx=0x7ff1dc009780).stop 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/3083728677 shutdown_connections 2023-08-22T00:18:40.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/3083728677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4063b10 0x7ff1e40acbf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/3083728677 >> v2:172.21.15.118:3300/0 conn(0x7ff1e4157ab0 0x7ff1e4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/3083728677 >> 172.21.15.98:0/3083728677 conn(0x7ff1e40cb600 msgr2=0x7ff1e40c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/3083728677 shutdown_connections 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.714+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/3083728677 wait complete. 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.715+0000 7ff1ebb9d700 1 Processor -- start 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 -- start start 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1e4063b10 0x7ff1e4147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 0x7ff1e4154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b08b0 con 0x7ff1e4154880 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40ae660 con 0x7ff1e4063b10 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ebb9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40ae940 con 0x7ff1e4157ab0 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ea13a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ea13a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41122/0 (socket says 172.21.15.98:41122) 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1ea13a700 1 -- 172.21.15.98:0/2652120843 learned_addr learned my addr 172.21.15.98:0/2652120843 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1e9138700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 0x7ff1e4154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.716+0000 7ff1e9939700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1e4063b10 0x7ff1e4147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 -- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 msgr2=0x7ff1e4154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 0x7ff1e4154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 -- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1e4063b10 msgr2=0x7ff1e4147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1e4063b10 0x7ff1e4147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 -- 172.21.15.98:0/2652120843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc009a20 con 0x7ff1e4154880 2023-08-22T00:18:40.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1e9138700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 0x7ff1e4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ea13a700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7ff1dc00b610 tx=0x7ff1dc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc013e70 con 0x7ff1e4154880 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc01d630 con 0x7ff1e4154880 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40aec20 con 0x7ff1e4154880 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc01d9f0 con 0x7ff1e4154880 2023-08-22T00:18:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.717+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40af1e0 con 0x7ff1e4154880 2023-08-22T00:18:40.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.718+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e4083670 con 0x7ff1e4154880 2023-08-22T00:18:40.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.719+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ff1dc003040 con 0x7ff1e4154880 2023-08-22T00:18:40.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.719+0000 7ff1d9ffb700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 0x7ff1c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:40.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.719+0000 7ff1e9939700 1 -- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 msgr2=0x7ff1c80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:40.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.719+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7ff1dc07c1f0 con 0x7ff1e4154880 2023-08-22T00:18:40.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.719+0000 7ff1e9939700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 0x7ff1c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:40.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.726+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1dc04d020 con 0x7ff1e4154880 2023-08-22T00:18:40.806 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:40.805+0000 7f6445870680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:18:40.871 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:40.870+0000 7ffa23211680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:18:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.897+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff1e40ae3f0 con 0x7ff1e4154880 2023-08-22T00:18:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.897+0000 7ff1d9ffb700 1 -- 172.21.15.98:0/2652120843 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff1dc050640 con 0x7ff1e4154880 2023-08-22T00:18:40.899 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.899+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 msgr2=0x7ff1c80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.899+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 0x7ff1c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.899+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 msgr2=0x7ff1e40adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.899+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7ff1dc00b610 tx=0x7ff1dc009780).stop 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 shutdown_connections 2023-08-22T00:18:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e4154880 0x7ff1e40adae0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1e4063b10 0x7ff1e4147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1c805ef30 0x7ff1c80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 --2- 172.21.15.98:0/2652120843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1e4157ab0 0x7ff1e4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 >> 172.21.15.98:0/2652120843 conn(0x7ff1e40cb600 msgr2=0x7ff1e40c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 shutdown_connections 2023-08-22T00:18:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:40.900+0000 7ff1ebb9d700 1 -- 172.21.15.98:0/2652120843 wait complete. 2023-08-22T00:18:40.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:18:41.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 Processor -- start 2023-08-22T00:18:41.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 -- start start 2023-08-22T00:18:41.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f569014b250 0x7f56900c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f56900c39f0 0x7f5690154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5690151e80 con 0x7f569014ae70 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5690066b90 con 0x7f56900c39f0 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.074+0000 7f5696621700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5690065560 con 0x7f569014b250 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f56900c39f0 0x7f5690154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f56900c39f0 0x7f5690154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41132/0 (socket says 172.21.15.98:41132) 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 -- 172.21.15.98:0/3358246300 learned_addr learned my addr 172.21.15.98:0/3358246300 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:41.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f568f7fe700 1 --2- 172.21.15.98:0/3358246300 >> v2:172.21.15.118:3300/0 conn(0x7f569014b250 0x7f56900c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 -- 172.21.15.98:0/3358246300 >> v2:172.21.15.118:3300/0 conn(0x7f569014b250 msgr2=0x7f56900c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 --2- 172.21.15.98:0/3358246300 >> v2:172.21.15.118:3300/0 conn(0x7f569014b250 0x7f56900c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 -- 172.21.15.98:0/3358246300 >> v1:172.21.15.98:6789/0 conn(0x7f569014ae70 legacy=0x7f56900c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f568effd700 1 -- 172.21.15.98:0/3358246300 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126453870 0 0) 0x7f5690151e80 con 0x7f569014ae70 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 -- 172.21.15.98:0/3358246300 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900c7590 con 0x7f56900c39f0 2023-08-22T00:18:41.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f5694bbe700 1 --2- 172.21.15.98:0/3358246300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f5690154730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f56900ad9b0 tx=0x7f568800ba50).ready entity=mon.0 client_cookie=6511d38d566a3f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f568effd700 1 -- 172.21.15.98:0/3358246300 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688010070 con 0x7f56900c39f0 2023-08-22T00:18:41.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f568effd700 1 -- 172.21.15.98:0/3358246300 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800dde0 con 0x7f56900c39f0 2023-08-22T00:18:41.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.075+0000 7f568effd700 1 -- 172.21.15.98:0/3358246300 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800b2e0 con 0x7f56900c39f0 2023-08-22T00:18:41.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 -- 172.21.15.98:0/3358246300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 msgr2=0x7f5690154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 --2- 172.21.15.98:0/3358246300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f5690154730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f56900ad9b0 tx=0x7f568800ba50).stop 2023-08-22T00:18:41.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 -- 172.21.15.98:0/3358246300 shutdown_connections 2023-08-22T00:18:41.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 --2- 172.21.15.98:0/3358246300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f5690154730 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 --2- 172.21.15.98:0/3358246300 >> v2:172.21.15.118:3300/0 conn(0x7f569014b250 0x7f56900c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 -- 172.21.15.98:0/3358246300 >> 172.21.15.98:0/3358246300 conn(0x7f56900c7800 msgr2=0x7f56900c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 -- 172.21.15.98:0/3358246300 shutdown_connections 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.076+0000 7f5696621700 1 -- 172.21.15.98:0/3358246300 wait complete. 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.077+0000 7f5696621700 1 Processor -- start 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.077+0000 7f5696621700 1 -- start start 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569014ae70 0x7f5690153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569014b250 0x7f5690153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690164280 con 0x7f56900c39f0 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690153b10 con 0x7f569014b250 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5696621700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5690163fa0 con 0x7f569014ae70 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f568ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f568ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41136/0 (socket says 172.21.15.98:41136) 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f568ffff700 1 -- 172.21.15.98:0/2122027984 learned_addr learned my addr 172.21.15.98:0/2122027984 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:41.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f5694bbe700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569014b250 0x7f5690153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.078+0000 7f568f7fe700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569014ae70 0x7f5690153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 -- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569014ae70 msgr2=0x7f5690153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569014ae70 0x7f5690153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 -- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569014b250 msgr2=0x7f5690153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569014b250 0x7f5690153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 -- 172.21.15.98:0/2122027984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568800bcf0 con 0x7f56900c39f0 2023-08-22T00:18:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f568ffff700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5680001eb0 tx=0x7f5680007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568000ce60 con 0x7f56900c39f0 2023-08-22T00:18:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568000f470 con 0x7f56900c39f0 2023-08-22T00:18:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568000f810 con 0x7f56900c39f0 2023-08-22T00:18:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56900aa8e0 con 0x7f56900c39f0 2023-08-22T00:18:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.079+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56900aaea0 con 0x7f56900c39f0 2023-08-22T00:18:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f568000fb80 con 0x7f56900c39f0 2023-08-22T00:18:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f5677fff700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 0x7f567c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5690069220 con 0x7f56900c39f0 2023-08-22T00:18:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f568f7fe700 1 -- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 msgr2=0x7f567c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f5680079900 con 0x7f56900c39f0 2023-08-22T00:18:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.081+0000 7f568f7fe700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 0x7f567c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.085+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f568004e160 con 0x7f56900c39f0 2023-08-22T00:18:41.228 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.227+0000 7f6445870680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:18:41.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.254+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5690150fb0 con 0x7f56900c39f0 2023-08-22T00:18:41.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.255+0000 7f5677fff700 1 -- 172.21.15.98:0/2122027984 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f568004dd50 con 0x7f56900c39f0 2023-08-22T00:18:41.257 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:18:41.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 msgr2=0x7f567c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:41.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 0x7f567c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 msgr2=0x7f56901492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5680001eb0 tx=0x7f5680007c70).stop 2023-08-22T00:18:41.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 shutdown_connections 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569014b250 0x7f5690153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56900c39f0 0x7f56901492f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f567c05ef30 0x7f567c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 --2- 172.21.15.98:0/2122027984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569014ae70 0x7f5690153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 >> 172.21.15.98:0/2122027984 conn(0x7f56900c7800 msgr2=0x7f569014a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 shutdown_connections 2023-08-22T00:18:41.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.257+0000 7f5696621700 1 -- 172.21.15.98:0/2122027984 wait complete. 2023-08-22T00:18:41.270 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:18:41.311 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.310+0000 7ffa23211680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:18:41.333 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.332+0000 7f6445870680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:18:41.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.391+0000 7fe418690700 1 Processor -- start 2023-08-22T00:18:41.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.391+0000 7fe418690700 1 -- start start 2023-08-22T00:18:41.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.392+0000 7fe418690700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe410063fa0 0x7fe4100c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.392+0000 7fe418690700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe410151390 con 0x7fe4100c15c0 2023-08-22T00:18:41.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe418690700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe410064450 con 0x7fe41014b130 2023-08-22T00:18:41.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe418690700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe410151110 con 0x7fe410063fa0 2023-08-22T00:18:41.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe410063fa0 0x7fe4100c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe410063fa0 0x7fe4100c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41146/0 (socket says 172.21.15.98:41146) 2023-08-22T00:18:41.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 -- 172.21.15.98:0/4173419390 learned_addr learned my addr 172.21.15.98:0/4173419390 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 -- 172.21.15.98:0/4173419390 >> v1:172.21.15.118:6789/0 conn(0x7fe41014b130 legacy=0x7fe410151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 -- 172.21.15.98:0/4173419390 >> v1:172.21.15.98:6789/0 conn(0x7fe4100c15c0 legacy=0x7fe410065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 -- 172.21.15.98:0/4173419390 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100c6610 con 0x7fe410063fa0 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe416c2d700 1 --2- 172.21.15.98:0/4173419390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe4100c4b20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe408009f20 tx=0x7fe408009840).ready entity=mon.0 client_cookie=47d2e1722c53d139 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe41542a700 1 -- 172.21.15.98:0/4173419390 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800e070 con 0x7fe410063fa0 2023-08-22T00:18:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe41542a700 1 -- 172.21.15.98:0/4173419390 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800ba80 con 0x7fe410063fa0 2023-08-22T00:18:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.393+0000 7fe41542a700 1 -- 172.21.15.98:0/4173419390 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800be00 con 0x7fe410063fa0 2023-08-22T00:18:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 -- 172.21.15.98:0/4173419390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 msgr2=0x7fe4100c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 --2- 172.21.15.98:0/4173419390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe4100c4b20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe408009f20 tx=0x7fe408009840).stop 2023-08-22T00:18:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 -- 172.21.15.98:0/4173419390 shutdown_connections 2023-08-22T00:18:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 --2- 172.21.15.98:0/4173419390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe4100c4b20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 -- 172.21.15.98:0/4173419390 >> 172.21.15.98:0/4173419390 conn(0x7fe4100c3a60 msgr2=0x7fe4100c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 -- 172.21.15.98:0/4173419390 shutdown_connections 2023-08-22T00:18:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.394+0000 7fe418690700 1 -- 172.21.15.98:0/4173419390 wait complete. 2023-08-22T00:18:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.395+0000 7fe418690700 1 Processor -- start 2023-08-22T00:18:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.395+0000 7fe418690700 1 -- start start 2023-08-22T00:18:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4100c15c0 0x7fe41014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe41014b130 0x7fe410143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100c0f40 con 0x7fe410063fa0 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100be060 con 0x7fe4100c15c0 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100be900 con 0x7fe41014b130 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41162/0 (socket says 172.21.15.98:41162) 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 -- 172.21.15.98:0/3750073135 learned_addr learned my addr 172.21.15.98:0/3750073135 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe416c2d700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe41014b130 0x7fe410143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe415c2b700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4100c15c0 0x7fe41014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 -- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe41014b130 msgr2=0x7fe410143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe41014b130 0x7fe410143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 -- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4100c15c0 msgr2=0x7fe41014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4100c15c0 0x7fe41014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 -- 172.21.15.98:0/3750073135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009ae0 con 0x7fe410063fa0 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe41642c700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe40c00c440 tx=0x7fe40c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c007020 con 0x7fe410063fa0 2023-08-22T00:18:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c007180 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41014c410 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.396+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c007520 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.397+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4100be2b0 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe410068970 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe40c0068b0 con 0x7fe410063fa0 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe4067fc700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 0x7fe3f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe415c2b700 1 -- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 msgr2=0x7fe3f40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7fe40c079720 con 0x7fe410063fa0 2023-08-22T00:18:41.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.398+0000 7fe415c2b700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 0x7fe3f40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:41.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.406+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe40c0478f0 con 0x7fe410063fa0 2023-08-22T00:18:41.425 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.423+0000 7ffa23211680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:18:41.487 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.486+0000 7f6445870680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:18:41.561 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.560+0000 7f6445870680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:18:41.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.574+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4100c68f0 con 0x7fe410063fa0 2023-08-22T00:18:41.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.574+0000 7fe4067fc700 1 -- 172.21.15.98:0/3750073135 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe40c04a550 con 0x7fe410063fa0 2023-08-22T00:18:41.576 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:18:41.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 msgr2=0x7fe3f40613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:41.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 0x7fe3f40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 msgr2=0x7fe41014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe40c00c440 tx=0x7fe40c007e00).stop 2023-08-22T00:18:41.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 shutdown_connections 2023-08-22T00:18:41.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe3f405ef30 0x7fe3f40613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe41014b130 0x7fe410143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe410063fa0 0x7fe41014dd00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 --2- 172.21.15.98:0/3750073135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4100c15c0 0x7fe41014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 >> 172.21.15.98:0/3750073135 conn(0x7fe4100c3a60 msgr2=0x7fe410157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 shutdown_connections 2023-08-22T00:18:41.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.576+0000 7fe418690700 1 -- 172.21.15.98:0/3750073135 wait complete. 2023-08-22T00:18:41.583 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.582+0000 7ffa23211680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:18:41.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:18:41.629 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.627+0000 7f6445870680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:18:41.661 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.660+0000 7ffa23211680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:18:41.732 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.731+0000 7ffa23211680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:18:41.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.750+0000 7f706665a700 1 Processor -- start 2023-08-22T00:18:41.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.750+0000 7f706665a700 1 -- start start 2023-08-22T00:18:41.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f706665a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 0x7f7060157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f706665a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7060063d20 con 0x7f7060153e90 2023-08-22T00:18:41.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f706665a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70600c8d30 con 0x7f7060157a80 2023-08-22T00:18:41.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f706665a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600aad70 con 0x7f70600aa920 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f705f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7060153e90 0x7f7060062600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45196/0 (socket says 172.21.15.98:45196) 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f705f7fe700 1 -- 172.21.15.98:0/3885993657 learned_addr learned my addr 172.21.15.98:0/3885993657 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f7064bf7700 1 --2- 172.21.15.98:0/3885993657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 0x7f7060157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475171722 0 0) 0x7f7060063d20 con 0x7f7060153e90 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.751+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70480033f0 con 0x7f7060153e90 2023-08-22T00:18:41.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154226542 0 0) 0x7f70600c8d30 con 0x7f7060157a80 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7060063d20 con 0x7f7060157a80 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f7064bf7700 1 -- 172.21.15.98:0/3885993657 >> v1:172.21.15.118:6789/0 conn(0x7f7060157a80 legacy=0x7f7060153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f7064bf7700 1 -- 172.21.15.98:0/3885993657 >> v1:172.21.15.98:6789/0 conn(0x7f7060153e90 legacy=0x7f7060062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283429820 0 0) 0x7f70480033f0 con 0x7f7060153e90 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f7064bf7700 1 -- 172.21.15.98:0/3885993657 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600c9010 con 0x7f70600aa920 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f7064bf7700 1 --2- 172.21.15.98:0/3885993657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 0x7f7060157e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7058009e90 tx=0x7f7058009780).ready entity=mon.2 client_cookie=6fb7875bb552adc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800e070 con 0x7f70600aa920 2023-08-22T00:18:41.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705800bab0 con 0x7f70600aa920 2023-08-22T00:18:41.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.752+0000 7f705effd700 1 -- 172.21.15.98:0/3885993657 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800be30 con 0x7f70600aa920 2023-08-22T00:18:41.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 -- 172.21.15.98:0/3885993657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 msgr2=0x7f7060157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 --2- 172.21.15.98:0/3885993657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 0x7f7060157e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7058009e90 tx=0x7f7058009780).stop 2023-08-22T00:18:41.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 -- 172.21.15.98:0/3885993657 shutdown_connections 2023-08-22T00:18:41.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 --2- 172.21.15.98:0/3885993657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70600aa920 0x7f7060157e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 -- 172.21.15.98:0/3885993657 >> 172.21.15.98:0/3885993657 conn(0x7f70600cb5f0 msgr2=0x7f70600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 -- 172.21.15.98:0/3885993657 shutdown_connections 2023-08-22T00:18:41.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.753+0000 7f706665a700 1 -- 172.21.15.98:0/3885993657 wait complete. 2023-08-22T00:18:41.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.754+0000 7f706665a700 1 Processor -- start 2023-08-22T00:18:41.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.754+0000 7f706665a700 1 -- start start 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7060153e90 0x7f70601543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7060157a80 0x7f70600ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7060142ba0 con 0x7f70600aa920 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600af6b0 con 0x7f7060157a80 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70601557e0 con 0x7f7060153e90 2023-08-22T00:18:41.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41178/0 (socket says 172.21.15.98:41178) 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 -- 172.21.15.98:0/1380404585 learned_addr learned my addr 172.21.15.98:0/1380404585 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705f7fe700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7060153e90 0x7f70601543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f7064bf7700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7060157a80 0x7f70600ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 -- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7060153e90 msgr2=0x7f70601543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7060153e90 0x7f70601543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 -- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7060157a80 msgr2=0x7f70600ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7060157a80 0x7f70600ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 -- 172.21.15.98:0/1380404585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058009a20 con 0x7f70600aa920 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f705ffff700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f705000c440 tx=0x7f7050007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012400 con 0x7f70600aa920 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050012560 con 0x7f70600aa920 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7060155a80 con 0x7f70600aa920 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012920 con 0x7f70600aa920 2023-08-22T00:18:41.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.755+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7060156040 con 0x7f70600aa920 2023-08-22T00:18:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.756+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600af480 con 0x7f70600aa920 2023-08-22T00:18:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.757+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f705001b3b0 con 0x7f70600aa920 2023-08-22T00:18:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.757+0000 7f7047fff700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 0x7f704c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.757+0000 7f705f7fe700 1 -- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 msgr2=0x7f704c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.757+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f7050079bd0 con 0x7f70600aa920 2023-08-22T00:18:41.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.757+0000 7f705f7fe700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 0x7f704c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:41.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.761+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70600af480 con 0x7f70600aa920 2023-08-22T00:18:41.884 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:41.883+0000 7f6445870680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:18:41.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.929+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70600af480 con 0x7f70600aa920 2023-08-22T00:18:41.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.930+0000 7f7047fff700 1 -- 172.21.15.98:0/1380404585 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70600af480 con 0x7f70600aa920 2023-08-22T00:18:41.931 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:18:41.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 msgr2=0x7f704c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:41.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 0x7f704c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 msgr2=0x7f70601426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:41.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f705000c440 tx=0x7f7050007c90).stop 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 shutdown_connections 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7060157a80 0x7f70600ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70600aa920 0x7f70601426b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f704c05ef30 0x7f704c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 --2- 172.21.15.98:0/1380404585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7060153e90 0x7f70601543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 >> 172.21.15.98:0/1380404585 conn(0x7f70600cb5f0 msgr2=0x7f706014e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 shutdown_connections 2023-08-22T00:18:41.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:41.932+0000 7f706665a700 1 -- 172.21.15.98:0/1380404585 wait complete. 2023-08-22T00:18:41.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:41.998 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:41.997+0000 7ffa23211680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:18:42.064 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:42.064+0000 7f6445870680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:18:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.103+0000 7f876807b700 1 Processor -- start 2023-08-22T00:18:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.103+0000 7f876807b700 1 -- start start 2023-08-22T00:18:42.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f876807b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f876015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f876807b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600bde70 con 0x7f87600bc940 2023-08-22T00:18:42.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f876807b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600bd9e0 con 0x7f8760064290 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f876807b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600bcdd0 con 0x7f8760154330 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8765616700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f87600bc940 0x7f8760153c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45212/0 (socket says 172.21.15.98:45212) 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8765616700 1 -- 172.21.15.98:0/1021312831 learned_addr learned my addr 172.21.15.98:0/1021312831 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8766618700 1 --2- 172.21.15.98:0/1021312831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f876015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807942397 0 0) 0x7f8750001110 con 0x7f87600bc940 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c0033f0 con 0x7f87600bc940 2023-08-22T00:18:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008755292 0 0) 0x7f87600bd9e0 con 0x7f8760064290 2023-08-22T00:18:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.104+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8750001110 con 0x7f8760064290 2023-08-22T00:18:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8766618700 1 -- 172.21.15.98:0/1021312831 >> v1:172.21.15.118:6789/0 conn(0x7f8760064290 legacy=0x7f87600c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8766618700 1 -- 172.21.15.98:0/1021312831 >> v1:172.21.15.98:6789/0 conn(0x7f87600bc940 legacy=0x7f8760153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8766618700 1 -- 172.21.15.98:0/1021312831 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600bd0b0 con 0x7f8760154330 2023-08-22T00:18:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8766618700 1 --2- 172.21.15.98:0/1021312831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f876015afc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8758009e90 tx=0x7f8758009780).ready entity=mon.2 client_cookie=673b6d3dc015be69 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800e070 con 0x7f8760154330 2023-08-22T00:18:42.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800bab0 con 0x7f8760154330 2023-08-22T00:18:42.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f8764e15700 1 -- 172.21.15.98:0/1021312831 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800be30 con 0x7f8760154330 2023-08-22T00:18:42.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.105+0000 7f876807b700 1 -- 172.21.15.98:0/1021312831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 msgr2=0x7f876015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 --2- 172.21.15.98:0/1021312831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f876015afc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8758009e90 tx=0x7f8758009780).stop 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 -- 172.21.15.98:0/1021312831 shutdown_connections 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 --2- 172.21.15.98:0/1021312831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f876015afc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 -- 172.21.15.98:0/1021312831 >> 172.21.15.98:0/1021312831 conn(0x7f87600c3990 msgr2=0x7f87600c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 -- 172.21.15.98:0/1021312831 shutdown_connections 2023-08-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.106+0000 7f876807b700 1 -- 172.21.15.98:0/1021312831 wait complete. 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.107+0000 7f876807b700 1 Processor -- start 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.107+0000 7f876807b700 1 -- start start 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f87600aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 0x7f8760152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600ab040 con 0x7f8760064290 2023-08-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600ab8e0 con 0x7f87600abd70 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f876807b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600a9660 con 0x7f8760154330 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765616700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f87600aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41188/0 (socket says 172.21.15.98:41188) 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8766618700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 0x7f8760152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 -- 172.21.15.98:0/469151904 learned_addr learned my addr 172.21.15.98:0/469151904 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 msgr2=0x7f87600aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f87600aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 msgr2=0x7f8760152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 0x7f8760152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 -- 172.21.15.98:0/469151904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009a20 con 0x7f8760064290 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8766618700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 0x7f8760152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8765e17700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f875c00c4c0 tx=0x7f875c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.108+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00ce30 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.109+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87600aadd0 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.109+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00f470 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.109+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00f810 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.109+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87600ab290 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8760047480 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f875c00fbc0 con 0x7f8760064290 2023-08-22T00:18:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f8755ffb700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 0x7f87440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f8765616700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 msgr2=0x7f87440613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:42.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f875c079970 con 0x7f8760064290 2023-08-22T00:18:42.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.110+0000 7f8765616700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 0x7f87440613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:42.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.117+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f875c04a7a0 con 0x7f8760064290 2023-08-22T00:18:42.192 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:42.191+0000 7ffa23211680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:18:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.311+0000 7f8765616700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 msgr2=0x7f87440613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.311+0000 7f8765616700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 0x7f87440613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:18:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.329+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87600bd390 con 0x7f8760064290 2023-08-22T00:18:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.329+0000 7f8755ffb700 1 -- 172.21.15.98:0/469151904 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f875c04ddc0 con 0x7f8760064290 2023-08-22T00:18:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:42.331 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 msgr2=0x7f87440613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 0x7f87440613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 msgr2=0x7f87600a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f875c00c4c0 tx=0x7f875c007c90).stop 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 shutdown_connections 2023-08-22T00:18:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87600abd70 0x7f8760152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8760064290 0x7f87600a9170 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f874405ef30 0x7f87440613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 --2- 172.21.15.98:0/469151904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8760154330 0x7f87600aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 >> 172.21.15.98:0/469151904 conn(0x7f87600c3990 msgr2=0x7f876014bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 shutdown_connections 2023-08-22T00:18:42.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.331+0000 7f876807b700 1 -- 172.21.15.98:0/469151904 wait complete. 2023-08-22T00:18:42.335 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:18:42.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:42.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.503+0000 7ff01a522700 1 Processor -- start 2023-08-22T00:18:42.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.503+0000 7ff01a522700 1 -- start start 2023-08-22T00:18:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff01a522700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff014150c50 0x7ff0140c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff01a522700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff014151030 0x7ff014151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff01a522700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0140645b0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff01a522700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff014063fa0 con 0x7ff014151030 2023-08-22T00:18:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff01a522700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff014151f30 con 0x7ff014150c50 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff018abf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff014151030 0x7ff014151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff018abf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff014151030 0x7ff014151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41192/0 (socket says 172.21.15.98:41192) 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff018abf700 1 -- 172.21.15.98:0/3710866279 learned_addr learned my addr 172.21.15.98:0/3710866279 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.504+0000 7ff013fff700 1 --2- 172.21.15.98:0/3710866279 >> v2:172.21.15.118:3300/0 conn(0x7ff014150c50 0x7ff0140c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff018abf700 1 -- 172.21.15.98:0/3710866279 >> v2:172.21.15.118:3300/0 conn(0x7ff014150c50 msgr2=0x7ff0140c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff018abf700 1 --2- 172.21.15.98:0/3710866279 >> v2:172.21.15.118:3300/0 conn(0x7ff014150c50 0x7ff0140c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff018abf700 1 -- 172.21.15.98:0/3710866279 >> v1:172.21.15.118:6789/0 conn(0x7ff0140bc6d0 legacy=0x7ff0140c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff012ffd700 1 -- 172.21.15.98:0/3710866279 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210496597 0 0) 0x7ff0140645b0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff018abf700 1 -- 172.21.15.98:0/3710866279 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014152210 con 0x7ff014151030 2023-08-22T00:18:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff018abf700 1 --2- 172.21.15.98:0/3710866279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff014151030 0x7ff014151470 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff0140c5540 tx=0x7ff00c009840).ready entity=mon.0 client_cookie=a8efa205f530a236 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff012ffd700 1 -- 172.21.15.98:0/3710866279 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00e070 con 0x7ff014151030 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff012ffd700 1 -- 172.21.15.98:0/3710866279 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00ba20 con 0x7ff014151030 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff012ffd700 1 -- 172.21.15.98:0/3710866279 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00bda0 con 0x7ff014151030 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff01a522700 1 -- 172.21.15.98:0/3710866279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff014151030 msgr2=0x7ff014151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.505+0000 7ff01a522700 1 --2- 172.21.15.98:0/3710866279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff014151030 0x7ff014151470 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff0140c5540 tx=0x7ff00c009840).stop 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 -- 172.21.15.98:0/3710866279 shutdown_connections 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 --2- 172.21.15.98:0/3710866279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff014151030 0x7ff014151470 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 --2- 172.21.15.98:0/3710866279 >> v2:172.21.15.118:3300/0 conn(0x7ff014150c50 0x7ff0140c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 -- 172.21.15.98:0/3710866279 >> 172.21.15.98:0/3710866279 conn(0x7ff0140c7770 msgr2=0x7ff0140c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 -- 172.21.15.98:0/3710866279 shutdown_connections 2023-08-22T00:18:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.506+0000 7ff01a522700 1 -- 172.21.15.98:0/3710866279 wait complete. 2023-08-22T00:18:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.507+0000 7ff01a522700 1 Processor -- start 2023-08-22T00:18:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.507+0000 7ff01a522700 1 -- start start 2023-08-22T00:18:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff014150c50 0x7ff0141443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff014151030 0x7ff0140a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140aae70 con 0x7ff0140bc6d0 2023-08-22T00:18:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140aab90 con 0x7ff014151030 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140acf90 con 0x7ff014150c50 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41194/0 (socket says 172.21.15.98:41194) 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 -- 172.21.15.98:0/2361508521 learned_addr learned my addr 172.21.15.98:0/2361508521 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff0137fe700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff014150c50 0x7ff0141443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff018abf700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff014151030 0x7ff0140a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 -- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff014150c50 msgr2=0x7ff0141443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff014150c50 0x7ff0141443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 -- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff014151030 msgr2=0x7ff0140a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff014151030 0x7ff0140a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 -- 172.21.15.98:0/2361508521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c009ae0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff013fff700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff00400e930 tx=0x7ff004009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004012600 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004012760 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004012ae0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0140ad270 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.508+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141448c0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.509+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0140ad710 con 0x7ff0140bc6d0 2023-08-22T00:18:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.510+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ff00401b400 con 0x7ff0140bc6d0 2023-08-22T00:18:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.510+0000 7feffbfff700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 0x7ff0000613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.510+0000 7ff0137fe700 1 -- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 msgr2=0x7ff0000613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.510+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7ff00407a8b0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.510+0000 7ff0137fe700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 0x7ff0000613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.515+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff00404b680 con 0x7ff0140bc6d0 2023-08-22T00:18:42.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.683+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff014047480 con 0x7ff0140bc6d0 2023-08-22T00:18:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.684+0000 7feffbfff700 1 -- 172.21.15.98:0/2361508521 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18580 (secure 0 0 0) 0x7ff00404eca0 con 0x7ff0140bc6d0 2023-08-22T00:18:42.686 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:42.686 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":56,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:40.257962+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":56,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]},{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:6832/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/3866194044":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/1133946166":"2023-08-23T00:07:28.539754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":3,"length":1},{"begin":6,"length":1},{"begin":9,"length":2},{"begin":13,"length":1},{"begin":16,"length":1},{"begin":19,"length":2},{"begin":23,"length":1},{"begin":26,"length":1},{"begin":29,"length":2},{"begin":34,"length":1},{"begin":37,"length":1},{"begin":40,"length":2},{"begin":44,"length":1},{"begin":47,"length":1},{"begin":50,"length":2},{"begin":54,"length":1},{"begin":57,"length":1},{"begin":60,"length":2},{"begin":64,"length":1},{"begin":67,"length":1},{"begin":70,"length":2},{"begin":74,"length":1},{"begin":77,"length":1},{"begin":80,"length":2},{"begin":84,"length":1},{"begin":87,"length":1},{"begin":90,"length":2},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":100,"length":2},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":177,"length":45}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:42.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 msgr2=0x7ff0000613c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:42.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 0x7ff0000613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:42.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 msgr2=0x7ff0140a66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff00400e930 tx=0x7ff004009060).stop 2023-08-22T00:18:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 shutdown_connections 2023-08-22T00:18:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff014151030 0x7ff0140a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0140bc6d0 0x7ff0140a66c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff00005ef00 0x7ff0000613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 --2- 172.21.15.98:0/2361508521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff014150c50 0x7ff0141443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 >> 172.21.15.98:0/2361508521 conn(0x7ff0140c7770 msgr2=0x7ff014150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 shutdown_connections 2023-08-22T00:18:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.686+0000 7ff01a522700 1 -- 172.21.15.98:0/2361508521 wait complete. 2023-08-22T00:18:42.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:18:42.702 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:42.713 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:42.712+0000 7f6445870680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:18:42.780 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:42.780+0000 7f6445870680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:18:42.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.824+0000 7fb911d6a700 1 Processor -- start 2023-08-22T00:18:42.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.825+0000 7fb911d6a700 1 -- start start 2023-08-22T00:18:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.825+0000 7fb911d6a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 0x7fb90c0c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.825+0000 7fb911d6a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0bd3b0 con 0x7fb90c0a89a0 2023-08-22T00:18:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.825+0000 7fb911d6a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c154830 con 0x7fb90c0bcd60 2023-08-22T00:18:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.825+0000 7fb911d6a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c154b10 con 0x7fb90c155310 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb90c0a89a0 0x7fb90c0c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45218/0 (socket says 172.21.15.98:45218) 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90b7fe700 1 -- 172.21.15.98:0/3139328808 learned_addr learned my addr 172.21.15.98:0/3139328808 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90affd700 1 --2- 172.21.15.98:0/3139328808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 0x7fb90c0c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829838184 0 0) 0x7fb90c0bd3b0 con 0x7fb90c0a89a0 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f40033f0 con 0x7fb90c0a89a0 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783820614 0 0) 0x7fb90c154830 con 0x7fb90c0bcd60 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb90c0bd3b0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90affd700 1 -- 172.21.15.98:0/3139328808 >> v1:172.21.15.118:6789/0 conn(0x7fb90c0bcd60 legacy=0x7fb90c0c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90affd700 1 -- 172.21.15.98:0/3139328808 >> v1:172.21.15.98:6789/0 conn(0x7fb90c0a89a0 legacy=0x7fb90c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90affd700 1 -- 172.21.15.98:0/3139328808 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c154df0 con 0x7fb90c155310 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90affd700 1 --2- 172.21.15.98:0/3139328808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 0x7fb90c0c2be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb9000097c0 tx=0x7fb900009060).ready entity=mon.2 client_cookie=529d4d9e6031e6a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000d4a0 con 0x7fb90c155310 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90000d600 con 0x7fb90c155310 2023-08-22T00:18:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.826+0000 7fb90a7fc700 1 -- 172.21.15.98:0/3139328808 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000d980 con 0x7fb90c155310 2023-08-22T00:18:42.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 -- 172.21.15.98:0/3139328808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 msgr2=0x7fb90c0c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 --2- 172.21.15.98:0/3139328808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 0x7fb90c0c2be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb9000097c0 tx=0x7fb900009060).stop 2023-08-22T00:18:42.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 -- 172.21.15.98:0/3139328808 shutdown_connections 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 --2- 172.21.15.98:0/3139328808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c155310 0x7fb90c0c2be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 -- 172.21.15.98:0/3139328808 >> 172.21.15.98:0/3139328808 conn(0x7fb90c0c7140 msgr2=0x7fb90c0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 -- 172.21.15.98:0/3139328808 shutdown_connections 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.827+0000 7fb911d6a700 1 -- 172.21.15.98:0/3139328808 wait complete. 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.829+0000 7fb911d6a700 1 Processor -- start 2023-08-22T00:18:42.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.829+0000 7fb911d6a700 1 -- start start 2023-08-22T00:18:42.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb90c0a89a0 0x7fb90c0c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 0x7fb90c0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c165f30 con 0x7fb90c0ac200 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0ac6f0 con 0x7fb90c0a89a0 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb911d6a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c165600 con 0x7fb90c0bcd60 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41196/0 (socket says 172.21.15.98:41196) 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 0x7fb90c0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90bfff700 1 -- 172.21.15.98:0/2958643505 learned_addr learned my addr 172.21.15.98:0/2958643505 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90b7fe700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb90c0a89a0 0x7fb90c0c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb90c0a89a0 msgr2=0x7fb90c0c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb90c0a89a0 0x7fb90c0c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 msgr2=0x7fb90c065320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 -- 172.21.15.98:0/2958643505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000092a0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90bfff700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.831+0000 7fb90affd700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 0x7fb90c0abd10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb900013000 tx=0x7fb900016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.832+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900021070 con 0x7fb90c0bcd60 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.832+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90000dcf0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.832+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c1658e0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.832+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000de60 con 0x7fb90c0bcd60 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.832+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c1663c0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c047480 con 0x7fb90c0bcd60 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fb900026410 con 0x7fb90c0bcd60 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb8f37fe700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 0x7fb8f80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb90b7fe700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 msgr2=0x7fb8f80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7fb90007af60 con 0x7fb90c0bcd60 2023-08-22T00:18:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.833+0000 7fb90b7fe700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 0x7fb8f80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:42.838+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9000a98f0 con 0x7fb90c0bcd60 2023-08-22T00:18:42.855 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:42.855+0000 7f6445870680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:18:42.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:42.876+0000 7ffa23211680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:18:42.948 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:42.946+0000 7ffa23211680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:18:43.000 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:42.999+0000 7f6445870680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:18:43.024 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.023+0000 7ffa23211680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:18:43.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.034+0000 7fb90b7fe700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 msgr2=0x7fb8f80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:43.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.034+0000 7fb90b7fe700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 0x7fb8f80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:18:43.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.045+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb90c166070 con 0x7fb90c0bcd60 2023-08-22T00:18:43.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.045+0000 7fb8f37fe700 1 -- 172.21.15.98:0/2958643505 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7fb90004bd30 con 0x7fb90c0bcd60 2023-08-22T00:18:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:43.047 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:18:43.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 msgr2=0x7fb8f80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 0x7fb8f80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 msgr2=0x7fb90c0abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 0x7fb90c0abd10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb900013000 tx=0x7fb900016000).stop 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 shutdown_connections 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb90c0ac200 0x7fb90c065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb90c0a89a0 0x7fb90c0c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8f805ef30 0x7fb8f80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 --2- 172.21.15.98:0/2958643505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb90c0bcd60 0x7fb90c0abd10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 >> 172.21.15.98:0/2958643505 conn(0x7fb90c0c7140 msgr2=0x7fb90c0c51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 shutdown_connections 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.047+0000 7fb911d6a700 1 -- 172.21.15.98:0/2958643505 wait complete. 2023-08-22T00:18:43.051 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:18:43.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:43.069 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:43.068+0000 7f6445870680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:18:43.180 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.179+0000 7ffa23211680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:18:43.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.179+0000 7f7986568700 1 Processor -- start 2023-08-22T00:18:43.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 -- start start 2023-08-22T00:18:43.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980151cd0 0x7f79800a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7980063ce0 0x7f79801558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7980064930 con 0x7f7980064160 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79800a4c00 con 0x7f7980063ce0 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.180+0000 7f7986568700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980064650 con 0x7f7980151cd0 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7980063ce0 0x7f79801558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7980063ce0 0x7f79801558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41198/0 (socket says 172.21.15.98:41198) 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 -- 172.21.15.98:0/865458013 learned_addr learned my addr 172.21.15.98:0/865458013 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797ffff700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980151cd0 0x7f79800a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 -- 172.21.15.98:0/865458013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980151cd0 msgr2=0x7f79800a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980151cd0 0x7f79800a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 -- 172.21.15.98:0/865458013 >> v1:172.21.15.98:6789/0 conn(0x7f7980064160 legacy=0x7f7980066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 -- 172.21.15.98:0/865458013 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980066040 con 0x7f7980063ce0 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797f7fe700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980063ce0 0x7f79801558d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7974006fd0 tx=0x7f79740090f0).ready entity=mon.0 client_cookie=9e711b43ada81bb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797effd700 1 -- 172.21.15.98:0/865458013 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400b580 con 0x7f7980063ce0 2023-08-22T00:18:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797effd700 1 -- 172.21.15.98:0/865458013 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400b6e0 con 0x7f7980063ce0 2023-08-22T00:18:43.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.181+0000 7f797effd700 1 -- 172.21.15.98:0/865458013 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400ba60 con 0x7f7980063ce0 2023-08-22T00:18:43.186 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:43.181+0000 7f6445870680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:18:43.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 -- 172.21.15.98:0/865458013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980063ce0 msgr2=0x7f79801558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980063ce0 0x7f79801558d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7974006fd0 tx=0x7f79740090f0).stop 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 -- 172.21.15.98:0/865458013 shutdown_connections 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980151cd0 0x7f79800a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 --2- 172.21.15.98:0/865458013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980063ce0 0x7f79801558d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 -- 172.21.15.98:0/865458013 >> 172.21.15.98:0/865458013 conn(0x7f79800c7770 msgr2=0x7f79800c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 -- 172.21.15.98:0/865458013 shutdown_connections 2023-08-22T00:18:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.182+0000 7f7986568700 1 -- 172.21.15.98:0/865458013 wait complete. 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.183+0000 7f7986568700 1 Processor -- start 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.183+0000 7f7986568700 1 -- start start 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980063ce0 0x7f79800bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7980064160 0x7f79800ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800ad630 con 0x7f7980151cd0 2023-08-22T00:18:43.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c01a0 con 0x7f7980064160 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7986568700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800ac7a0 con 0x7f7980063ce0 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41212/0 (socket says 172.21.15.98:41212) 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 -- 172.21.15.98:0/7586918 learned_addr learned my addr 172.21.15.98:0/7586918 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f797ffff700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980063ce0 0x7f79800bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f797f7fe700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7980064160 0x7f79800ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980063ce0 msgr2=0x7f79800bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980063ce0 0x7f79800bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7980064160 msgr2=0x7f79800ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7980064160 0x7f79800ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 -- 172.21.15.98:0/7586918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009370 con 0x7f7980151cd0 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.184+0000 7f7984b05700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f797800c790 tx=0x7f79780015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.185+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800e4a0 con 0x7f7980151cd0 2023-08-22T00:18:43.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.185+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800e600 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.185+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980166910 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.185+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800e980 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.185+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79800acd00 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.186+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79800ad7a0 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.186+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f797801b3b0 con 0x7f7980151cd0 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.186+0000 7f7967fff700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 0x7f796c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.186+0000 7f797ffff700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 msgr2=0x7f796c0613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:43.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.187+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f7978079aa0 con 0x7f7980151cd0 2023-08-22T00:18:43.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.187+0000 7f797ffff700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 0x7f796c0613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:43.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.191+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79780488f0 con 0x7f7980151cd0 2023-08-22T00:18:43.255 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.254+0000 7ffa23211680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:18:43.291 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:43.290+0000 7f6445870680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:18:43.374 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.373+0000 7ffa23211680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:18:43.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.388+0000 7f797ffff700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 msgr2=0x7f796c0613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:43.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.388+0000 7f797ffff700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 0x7f796c0613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:18:43.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.404+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7980047480 con 0x7f7980151cd0 2023-08-22T00:18:43.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.405+0000 7f7967fff700 1 -- 172.21.15.98:0/7586918 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f797804a920 con 0x7f7980151cd0 2023-08-22T00:18:43.406 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:43.407 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:07:15.659023+0000","modified":"2023-08-22T00:07:18.293098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/3020491745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3020491745},{"type":"v1","addr":"172.21.15.98:6837","nonce":3020491745}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-22T00:18:43.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 msgr2=0x7f796c0613c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:43.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 0x7f796c0613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 msgr2=0x7f7980166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f797800c790 tx=0x7f79780015e0).stop 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 shutdown_connections 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f796c05ef00 0x7f796c0613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980063ce0 0x7f79800bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7980151cd0 0x7f7980166420 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 --2- 172.21.15.98:0/7586918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7980064160 0x7f79800ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 >> 172.21.15.98:0/7586918 conn(0x7f79800c7770 msgr2=0x7f79800c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 shutdown_connections 2023-08-22T00:18:43.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.407+0000 7f7986568700 1 -- 172.21.15.98:0/7586918 wait complete. 2023-08-22T00:18:43.410 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2023-08-22T00:18:43.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:43.492 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.491+0000 7ffa23211680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:18:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.539+0000 7f92c911b700 1 Processor -- start 2023-08-22T00:18:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.539+0000 7f92c911b700 1 -- start start 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c4068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92c4153f40 0x7f92c4069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f92c40a9140 0x7f92c4157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c4069720 con 0x7f92c40a9140 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40a8410 con 0x7f92c4153f40 2023-08-22T00:18:43.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c911b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40a8cb0 con 0x7f92c4153b60 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f92c40a9140 0x7f92c4157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f92c40a9140 0x7f92c4157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41228/0 (socket says 172.21.15.98:41228) 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 -- 172.21.15.98:0/2995346585 learned_addr learned my addr 172.21.15.98:0/2995346585 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c2d9d700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c4068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c259c700 1 --2- 172.21.15.98:0/2995346585 >> v2:172.21.15.118:3300/0 conn(0x7f92c4153f40 0x7f92c4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 -- 172.21.15.98:0/2995346585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 msgr2=0x7f92c4068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c4068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 -- 172.21.15.98:0/2995346585 >> v2:172.21.15.118:3300/0 conn(0x7f92c4153f40 msgr2=0x7f92c4069230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 --2- 172.21.15.98:0/2995346585 >> v2:172.21.15.118:3300/0 conn(0x7f92c4153f40 0x7f92c4069230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 -- 172.21.15.98:0/2995346585 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c41586a0 con 0x7f92c40a9140 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.540+0000 7f92c359e700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c4157930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f92bc009f20 tx=0x7f92bc009840).ready entity=mon.0 client_cookie=21049931e5b941f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c1d9b700 1 -- 172.21.15.98:0/2995346585 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00e070 con 0x7f92c40a9140 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c1d9b700 1 -- 172.21.15.98:0/2995346585 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00b930 con 0x7f92c40a9140 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c1d9b700 1 -- 172.21.15.98:0/2995346585 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00bcb0 con 0x7f92c40a9140 2023-08-22T00:18:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 -- 172.21.15.98:0/2995346585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 msgr2=0x7f92c4157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c4157930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f92bc009f20 tx=0x7f92bc009840).stop 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 -- 172.21.15.98:0/2995346585 shutdown_connections 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c4068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 --2- 172.21.15.98:0/2995346585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c4157930 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 --2- 172.21.15.98:0/2995346585 >> v2:172.21.15.118:3300/0 conn(0x7f92c4153f40 0x7f92c4069230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 -- 172.21.15.98:0/2995346585 >> 172.21.15.98:0/2995346585 conn(0x7f92c40c5dc0 msgr2=0x7f92c4068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 -- 172.21.15.98:0/2995346585 shutdown_connections 2023-08-22T00:18:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.541+0000 7f92c911b700 1 -- 172.21.15.98:0/2995346585 wait complete. 2023-08-22T00:18:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 Processor -- start 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 -- start start 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c41674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c4153f40 0x7f92c41679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4167ed0 con 0x7f92c40a9140 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40c03d0 con 0x7f92c4153f40 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.543+0000 7f92c911b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4163f40 con 0x7f92c4153b60 2023-08-22T00:18:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41232/0 (socket says 172.21.15.98:41232) 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 -- 172.21.15.98:0/4007726276 learned_addr learned my addr 172.21.15.98:0/4007726276 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c259c700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c41674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c359e700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c4153f40 0x7f92c41679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 -- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 msgr2=0x7f92c41674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c41674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 -- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c4153f40 msgr2=0x7f92c41679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c4153f40 0x7f92c41679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 -- 172.21.15.98:0/4007726276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009ae0 con 0x7f92c40a9140 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c2d9d700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f92b400e950 tx=0x7f92b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4009530 con 0x7f92c40a9140 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4012600 con 0x7f92c40a9140 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40bfaa0 con 0x7f92c40a9140 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4012980 con 0x7f92c40a9140 2023-08-22T00:18:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.544+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40c0060 con 0x7f92c40a9140 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.545+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4047480 con 0x7f92c40a9140 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.545+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f92b4012d30 con 0x7f92c40a9140 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.546+0000 7f92aaffd700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 0x7f92b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.546+0000 7f92c259c700 1 -- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 msgr2=0x7f92b00613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.546+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f92b407a930 con 0x7f92c40a9140 2023-08-22T00:18:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.546+0000 7f92c259c700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 0x7f92b00613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.550+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f92b404b760 con 0x7f92c40a9140 2023-08-22T00:18:43.584 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:43.583+0000 7f6445870680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:18:43.654 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:18:43.653+0000 7f6445870680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:18:43.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.721+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c40a8660 con 0x7f92c40a9140 2023-08-22T00:18:43.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.722+0000 7f92aaffd700 1 -- 172.21.15.98:0/4007726276 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18580 (secure 0 0 0) 0x7f92b404ed80 con 0x7f92c40a9140 2023-08-22T00:18:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:43.724 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":56,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:40.257962+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:07:13.683089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-22T00:07:14.624350+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":56,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]},{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:6832/118203":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/3866194044":"2023-08-23T00:07:28.539754+0000","172.21.15.98:0/1133946166":"2023-08-23T00:07:28.539754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":3,"length":1},{"begin":6,"length":1},{"begin":9,"length":2},{"begin":13,"length":1},{"begin":16,"length":1},{"begin":19,"length":2},{"begin":23,"length":1},{"begin":26,"length":1},{"begin":29,"length":2},{"begin":34,"length":1},{"begin":37,"length":1},{"begin":40,"length":2},{"begin":44,"length":1},{"begin":47,"length":1},{"begin":50,"length":2},{"begin":54,"length":1},{"begin":57,"length":1},{"begin":60,"length":2},{"begin":64,"length":1},{"begin":67,"length":1},{"begin":70,"length":2},{"begin":74,"length":1},{"begin":77,"length":1},{"begin":80,"length":2},{"begin":84,"length":1},{"begin":87,"length":1},{"begin":90,"length":2},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":100,"length":2},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":177,"length":45}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 msgr2=0x7f92b00613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 0x7f92b00613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 msgr2=0x7f92c414a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f92b400e950 tx=0x7f92b4009060).stop 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 shutdown_connections 2023-08-22T00:18:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c4153f40 0x7f92c41679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c40a9140 0x7f92c414a8a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f92b005ef30 0x7f92b00613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 --2- 172.21.15.98:0/4007726276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c4153b60 0x7f92c41674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.724+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 >> 172.21.15.98:0/4007726276 conn(0x7f92c40c5dc0 msgr2=0x7f92c4150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.725+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 shutdown_connections 2023-08-22T00:18:43.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.725+0000 7f92c911b700 1 -- 172.21.15.98:0/4007726276 wait complete. 2023-08-22T00:18:43.739 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:18:43.802 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.801+0000 7ffa23211680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:18:43.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.858+0000 7f8846269700 1 Processor -- start 2023-08-22T00:18:43.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.858+0000 7f8846269700 1 -- start start 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8846269700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8840067c60 0x7f8840064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8846269700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8840154b30 con 0x7f88400a6e60 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8846269700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8840066820 con 0x7f88400a6a80 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8846269700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88401547e0 con 0x7f8840067c60 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8840067c60 0x7f8840064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8840067c60 0x7f8840064fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41234/0 (socket says 172.21.15.98:41234) 2023-08-22T00:18:43.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 -- 172.21.15.98:0/3961705410 learned_addr learned my addr 172.21.15.98:0/3961705410 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 -- 172.21.15.98:0/3961705410 >> v1:172.21.15.118:6789/0 conn(0x7f88400a6a80 legacy=0x7f8840066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 -- 172.21.15.98:0/3961705410 >> v1:172.21.15.98:6789/0 conn(0x7f88400a6e60 legacy=0x7f8840154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 -- 172.21.15.98:0/3961705410 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88401556d0 con 0x7f8840067c60 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.859+0000 7f8844806700 1 --2- 172.21.15.98:0/3961705410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840064fb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f8838009f20 tx=0x7f8838009840).ready entity=mon.0 client_cookie=6e8bb9f3f48d562b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f883effd700 1 -- 172.21.15.98:0/3961705410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800e070 con 0x7f8840067c60 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f883effd700 1 -- 172.21.15.98:0/3961705410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800ba40 con 0x7f8840067c60 2023-08-22T00:18:43.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f883effd700 1 -- 172.21.15.98:0/3961705410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800bdc0 con 0x7f8840067c60 2023-08-22T00:18:43.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 -- 172.21.15.98:0/3961705410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 msgr2=0x7f8840064fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 --2- 172.21.15.98:0/3961705410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840064fb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f8838009f20 tx=0x7f8838009840).stop 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 -- 172.21.15.98:0/3961705410 shutdown_connections 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 --2- 172.21.15.98:0/3961705410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840064fb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 -- 172.21.15.98:0/3961705410 >> 172.21.15.98:0/3961705410 conn(0x7f88400c42e0 msgr2=0x7f88400c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 -- 172.21.15.98:0/3961705410 shutdown_connections 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.860+0000 7f8846269700 1 -- 172.21.15.98:0/3961705410 wait complete. 2023-08-22T00:18:43.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.861+0000 7f8846269700 1 Processor -- start 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 -- start start 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 0x7f88400a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 0x7f8840062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400aa7f0 con 0x7f8840067c60 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400a93b0 con 0x7f88400a6a80 2023-08-22T00:18:43.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f8846269700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400a9690 con 0x7f88400a6e60 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.862+0000 7f883ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41240/0 (socket says 172.21.15.98:41240) 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 -- 172.21.15.98:0/1594366857 learned_addr learned my addr 172.21.15.98:0/1594366857 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883f7fe700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 0x7f88400a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8844806700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 0x7f8840062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 -- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 msgr2=0x7f8840062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 0x7f8840062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 -- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 msgr2=0x7f88400a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 0x7f88400a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 -- 172.21.15.98:0/1594366857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009ae0 con 0x7f8840067c60 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883f7fe700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 0x7f88400a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8844806700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 0x7f8840062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f883ffff700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f883000c440 tx=0x7f8830007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000f470 con 0x7f8840067c60 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000f5f0 con 0x7f8840067c60 2023-08-22T00:18:43.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000f9b0 con 0x7f8840067c60 2023-08-22T00:18:43.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88400a9970 con 0x7f8840067c60 2023-08-22T00:18:43.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.863+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88400bf1e0 con 0x7f8840067c60 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.864+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840069460 con 0x7f8840067c60 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.864+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f8830012400 con 0x7f8840067c60 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.865+0000 7f8827fff700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 0x7f882c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.865+0000 7f883f7fe700 1 -- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 msgr2=0x7f882c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.865+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7333+0+0 (secure 0 0 0) 0x7f88300799c0 con 0x7f8840067c60 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.865+0000 7f883f7fe700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 0x7f882c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:18:43.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.869+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88300488f0 con 0x7f8840067c60 2023-08-22T00:18:43.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.876+0000 7ffa23211680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:18:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.895+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 13) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f8830077150 con 0x7f8840067c60 2023-08-22T00:18:43.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.896+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 msgr2=0x7f882c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:18:43.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:43.896+0000 7f8827fff700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 0x7f882c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a5ccb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a5ccb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a5ccb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a5ccb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a5ccb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.960 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a2cc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.961 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a2cc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.961 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a2cc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.961 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a2cc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:43.961 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:18:43.958+0000 7ff9a2cc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:18:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.096+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8840068260 con 0x7f8840067c60 2023-08-22T00:18:44.892 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:18:44.891+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:18:44.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.895+0000 7f8827fff700 1 -- 172.21.15.98:0/1594366857 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8830021070 con 0x7f8840067c60 2023-08-22T00:18:44.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 msgr2=0x7f8840161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:44.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f883000c440 tx=0x7f8830007de0).stop 2023-08-22T00:18:44.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 shutdown_connections 2023-08-22T00:18:44.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f882c05ef30 0x7f882c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88400a6e60 0x7f8840062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8840067c60 0x7f8840161e70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 --2- 172.21.15.98:0/1594366857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88400a6a80 0x7f88400a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 >> 172.21.15.98:0/1594366857 conn(0x7f88400c42e0 msgr2=0x7f88400a4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.898+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 shutdown_connections 2023-08-22T00:18:44.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:44.899+0000 7f8846269700 1 -- 172.21.15.98:0/1594366857 wait complete. 2023-08-22T00:18:44.906 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:18:44.920 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:18:44.937 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:18:45.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.041+0000 7f8482da0700 1 Processor -- start 2023-08-22T00:18:45.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.041+0000 7f8482da0700 1 -- start start 2023-08-22T00:18:45.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f8482da0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f847c155080 0x7f847c063400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f8482da0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 0x7f847c0c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f8482da0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c158900 con 0x7f847c153c90 2023-08-22T00:18:45.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f8482da0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847c157cf0 con 0x7f847c155080 2023-08-22T00:18:45.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f8482da0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847c157fd0 con 0x7f847c0c5ca0 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f847c155080 0x7f847c063400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f847c155080 0x7f847c063400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41364/0 (socket says 172.21.15.98:41364) 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 -- 172.21.15.98:0/2810292096 learned_addr learned my addr 172.21.15.98:0/2810292096 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f848133d700 1 --2- 172.21.15.98:0/2810292096 >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 0x7f847c0c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 -- 172.21.15.98:0/2810292096 >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 msgr2=0x7f847c0c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:45.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 --2- 172.21.15.98:0/2810292096 >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 0x7f847c0c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.042+0000 7f847bfff700 1 -- 172.21.15.98:0/2810292096 >> v1:172.21.15.118:6789/0 conn(0x7f847c153c90 legacy=0x7f847c0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f847bfff700 1 -- 172.21.15.98:0/2810292096 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c1582b0 con 0x7f847c155080 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f848133d700 1 --2- 172.21.15.98:0/2810292096 >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 0x7f847c0c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f847bfff700 1 --2- 172.21.15.98:0/2810292096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c155080 0x7f847c063400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f847c0696c0 tx=0x7f84680090f0).ready entity=mon.0 client_cookie=676e398f4d5282ac server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f847b7fe700 1 -- 172.21.15.98:0/2810292096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800b5a0 con 0x7f847c155080 2023-08-22T00:18:45.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f847b7fe700 1 -- 172.21.15.98:0/2810292096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800b700 con 0x7f847c155080 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f847b7fe700 1 -- 172.21.15.98:0/2810292096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800ba80 con 0x7f847c155080 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 -- 172.21.15.98:0/2810292096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c155080 msgr2=0x7f847c063400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 --2- 172.21.15.98:0/2810292096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c155080 0x7f847c063400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f847c0696c0 tx=0x7f84680090f0).stop 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 -- 172.21.15.98:0/2810292096 shutdown_connections 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 --2- 172.21.15.98:0/2810292096 >> v2:172.21.15.118:3300/0 conn(0x7f847c0c5ca0 0x7f847c0c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 --2- 172.21.15.98:0/2810292096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c155080 0x7f847c063400 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 -- 172.21.15.98:0/2810292096 >> 172.21.15.98:0/2810292096 conn(0x7f847c0c3a60 msgr2=0x7f847c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:45.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 -- 172.21.15.98:0/2810292096 shutdown_connections 2023-08-22T00:18:45.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.043+0000 7f8482da0700 1 -- 172.21.15.98:0/2810292096 wait complete. 2023-08-22T00:18:45.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.044+0000 7f8482da0700 1 Processor -- start 2023-08-22T00:18:45.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 -- start start 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f847c0c5ca0 0x7f847c164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f847c155080 0x7f847c0a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0be060 con 0x7f847c153c90 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c168b40 con 0x7f847c155080 2023-08-22T00:18:45.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f8482da0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c164be0 con 0x7f847c0c5ca0 2023-08-22T00:18:45.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.045+0000 7f847bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41366/0 (socket says 172.21.15.98:41366) 2023-08-22T00:18:45.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 -- 172.21.15.98:0/2847897075 learned_addr learned my addr 172.21.15.98:0/2847897075 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:45.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 -- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f847c0c5ca0 msgr2=0x7f847c164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:45.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8480b3c700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f847c0c5ca0 0x7f847c164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f848133d700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f847c155080 0x7f847c0a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f847c0c5ca0 0x7f847c164640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 -- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f847c155080 msgr2=0x7f847c0a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f847c155080 0x7f847c0a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 -- 172.21.15.98:0/2847897075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009370 con 0x7f847c153c90 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f847bfff700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f8468009130 tx=0x7f8468015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800ba80 con 0x7f847c153c90 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846801c420 con 0x7f847c153c90 2023-08-22T00:18:45.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c164ec0 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846801c7e0 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.046+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847c165480 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.047+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c068970 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.047+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f846801cb50 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.048+0000 7f8478ff9700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 0x7f84600611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.048+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7547+0+0 (secure 0 0 0) 0x7f846807bdf0 con 0x7f847c153c90 2023-08-22T00:18:45.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.048+0000 7f8480b3c700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 0x7f84600611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:45.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.048+0000 7f8480b3c700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 0x7f84600611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f847c0c6de0 tx=0x7f8470009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:45.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.052+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f846804cfd0 con 0x7f847c153c90 2023-08-22T00:18:45.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.253+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f847c158590 con 0x7f847c153c90 2023-08-22T00:18:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.903+0000 7f8478ff9700 1 -- 172.21.15.98:0/2847897075 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84680505f0 con 0x7f847c153c90 2023-08-22T00:18:45.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 msgr2=0x7f84600611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:45.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 0x7f84600611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f847c0c6de0 tx=0x7f8470009040).stop 2023-08-22T00:18:45.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 msgr2=0x7f847c168650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f8468009130 tx=0x7f8468015000).stop 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 shutdown_connections 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f846005ecf0 0x7f84600611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f847c0c5ca0 0x7f847c164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f847c155080 0x7f847c0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 --2- 172.21.15.98:0/2847897075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f847c153c90 0x7f847c168650 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:45.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 >> 172.21.15.98:0/2847897075 conn(0x7f847c0c3a60 msgr2=0x7f847c0c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:45.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 shutdown_connections 2023-08-22T00:18:45.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:45.906+0000 7f8482da0700 1 -- 172.21.15.98:0/2847897075 wait complete. 2023-08-22T00:18:45.922 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:18:46.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.087+0000 7fc6bc52b700 1 Processor -- start 2023-08-22T00:18:46.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.087+0000 7fc6bc52b700 1 -- start start 2023-08-22T00:18:46.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6bc52b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc6b4064060 0x7fc6b4064440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6bc52b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b406a880 con 0x7fc6b40c5c20 2023-08-22T00:18:46.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6bc52b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40c33e0 con 0x7fc6b4153820 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6bc52b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40c36c0 con 0x7fc6b4064060 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b9ac6700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc6b40c5c20 0x7fc6b40c2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45244/0 (socket says 172.21.15.98:45244) 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b9ac6700 1 -- 172.21.15.98:0/2927389097 learned_addr learned my addr 172.21.15.98:0/2927389097 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/2927389097 >> v2:172.21.15.118:3300/0 conn(0x7fc6b4064060 0x7fc6b4064440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165600838 0 0) 0x7fc6b406a880 con 0x7fc6b40c5c20 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a00033f0 con 0x7fc6b40c5c20 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945961340 0 0) 0x7fc6a00033f0 con 0x7fc6b40c5c20 2023-08-22T00:18:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 >> v2:172.21.15.118:3300/0 conn(0x7fc6b4064060 msgr2=0x7fc6b4064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 --2- 172.21.15.98:0/2927389097 >> v2:172.21.15.118:3300/0 conn(0x7fc6b4064060 0x7fc6b4064440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 >> v1:172.21.15.118:6789/0 conn(0x7fc6b4153820 legacy=0x7fc6b4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40c5140 con 0x7fc6b40c5c20 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc6b0001470 con 0x7fc6b40c5c20 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 >> v1:172.21.15.98:6789/0 conn(0x7fc6b40c5c20 legacy=0x7fc6b40c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 0x7fc6a0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a0004690 0x7fc6a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0005000 0x7fc6a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c36c0 con 0x7fc6a00038e0 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a000bf60 con 0x7fc6a0004690 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a000c0f0 con 0x7fc6a0005000 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.088+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 0x7fc6a0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6b9ac6700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a0004690 0x7fc6a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 -- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0005000 msgr2=0x7fc6a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6baac8700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0005000 0x7fc6a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0005000 0x7fc6a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 -- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a0004690 msgr2=0x7fc6a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a0004690 0x7fc6a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 -- 172.21.15.98:0/2927389097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a00033f0 con 0x7fc6a00038e0 2023-08-22T00:18:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6baac8700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0005000 0x7fc6a000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6baac8700 1 -- 172.21.15.98:0/2927389097 reap_dead start 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 0x7fc6a0003d00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fc6a4009a60 tx=0x7fc6a4009060).ready entity=mon.0 client_cookie=53d698408bf260bd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4009ea0 con 0x7fc6a00038e0 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4009430 con 0x7fc6a00038e0 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6b92c5700 1 -- 172.21.15.98:0/2927389097 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400e870 con 0x7fc6a00038e0 2023-08-22T00:18:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6bc52b700 1 -- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 msgr2=0x7fc6a0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.089+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 0x7fc6a0003d00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fc6a4009a60 tx=0x7fc6a4009060).stop 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.090+0000 7fc6bc52b700 1 -- 172.21.15.98:0/2927389097 shutdown_connections 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.090+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/2927389097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a00038e0 0x7fc6a0003d00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.090+0000 7fc6bc52b700 1 -- 172.21.15.98:0/2927389097 >> 172.21.15.98:0/2927389097 conn(0x7fc6b40c4470 msgr2=0x7fc6b40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.090+0000 7fc6bc52b700 1 -- 172.21.15.98:0/2927389097 shutdown_connections 2023-08-22T00:18:46.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.090+0000 7fc6bc52b700 1 -- 172.21.15.98:0/2927389097 wait complete. 2023-08-22T00:18:46.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 Processor -- start 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 -- start start 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00038e0 0x7fc6b40a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6b41485c0 0x7fc6b40bce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40beea0 con 0x7fc6b413fa10 2023-08-22T00:18:46.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40bdfb0 con 0x7fc6a00038e0 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.091+0000 7fc6bc52b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40be290 con 0x7fc6b41485c0 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41380/0 (socket says 172.21.15.98:41380) 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 -- 172.21.15.98:0/1587478376 learned_addr learned my addr 172.21.15.98:0/1587478376 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6baac8700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6b41485c0 0x7fc6b40bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00038e0 0x7fc6b40a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 -- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6b41485c0 msgr2=0x7fc6b40bce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:46.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6b41485c0 0x7fc6b40bce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 -- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00038e0 msgr2=0x7fc6b40a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00038e0 0x7fc6b40a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 -- 172.21.15.98:0/1587478376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40be570 con 0x7fc6b413fa10 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6b9ac6700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fc6b00015a0 tx=0x7fc6b0001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000f610 con 0x7fc6b413fa10 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000f770 con 0x7fc6b413fa10 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b40be850 con 0x7fc6b413fa10 2023-08-22T00:18:46.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000fb10 con 0x7fc6b413fa10 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.092+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b413fe90 con 0x7fc6b413fa10 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.093+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b4047480 con 0x7fc6b413fa10 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.094+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fc6b001c360 con 0x7fc6b413fa10 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.094+0000 7fc6aa7fc700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 0x7fc698061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.094+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7547+0+0 (secure 0 0 0) 0x7fc6b0079fe0 con 0x7fc6b413fa10 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.094+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 0x7fc698061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.095+0000 7fc6ba2c7700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 0x7fc698061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6a4006d50 tx=0x7fc6a401a000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.098+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6b004b090 con 0x7fc6b413fa10 2023-08-22T00:18:46.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.259+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6b40c5420 con 0x7fc6b413fa10 2023-08-22T00:18:46.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:46.908+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc6b00779a0 con 0x7fc6b413fa10 2023-08-22T00:18:47.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.260+0000 7fc6aa7fc700 1 -- 172.21.15.98:0/1587478376 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc6b00748b0 con 0x7fc6b413fa10 2023-08-22T00:18:47.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 msgr2=0x7fc698061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 0x7fc698061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6a4006d50 tx=0x7fc6a401a000).stop 2023-08-22T00:18:47.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 msgr2=0x7fc6b41480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fc6b00015a0 tx=0x7fc6b0001e50).stop 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 shutdown_connections 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc69805ecc0 0x7fc698061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6b41485c0 0x7fc6b40bce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00038e0 0x7fc6b40a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 --2- 172.21.15.98:0/1587478376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b413fa10 0x7fc6b41480d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 >> 172.21.15.98:0/1587478376 conn(0x7fc6b40c4470 msgr2=0x7fc6b41490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:47.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 shutdown_connections 2023-08-22T00:18:47.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.264+0000 7fc6bc52b700 1 -- 172.21.15.98:0/1587478376 wait complete. 2023-08-22T00:18:47.267 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:18:47.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:18:47.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.415+0000 7f88c5a27700 1 Processor -- start 2023-08-22T00:18:47.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.415+0000 7f88c5a27700 1 -- start start 2023-08-22T00:18:47.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88c5a27700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88c0153c80 0x7f88c01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:47.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88c5a27700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c0062600 con 0x7f88c0154830 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88c5a27700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c01545e0 con 0x7f88c00a5910 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88c5a27700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c0062f10 con 0x7f88c0153c80 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88c0153c80 0x7f88c01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88be7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f88c0154830 0x7f88c00c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45250/0 (socket says 172.21.15.98:45250) 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88be7fc700 1 -- 172.21.15.98:0/833268308 learned_addr learned my addr 172.21.15.98:0/833268308 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bf7fe700 1 -- 172.21.15.98:0/833268308 >> v1:172.21.15.118:6789/0 conn(0x7f88c00a5910 legacy=0x7f88c00c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bf7fe700 1 -- 172.21.15.98:0/833268308 >> v1:172.21.15.98:6789/0 conn(0x7f88c0154830 legacy=0x7f88c00c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bf7fe700 1 -- 172.21.15.98:0/833268308 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c2d30 con 0x7f88c0153c80 2023-08-22T00:18:47.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bf7fe700 1 --2- 172.21.15.98:0/833268308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c01540f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f88b8009e60 tx=0x7f88b8009780).ready entity=mon.0 client_cookie=529804a62a53a54d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bdffb700 1 -- 172.21.15.98:0/833268308 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800bc30 con 0x7f88c0153c80 2023-08-22T00:18:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bdffb700 1 -- 172.21.15.98:0/833268308 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800bd90 con 0x7f88c0153c80 2023-08-22T00:18:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.416+0000 7f88bdffb700 1 -- 172.21.15.98:0/833268308 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8011630 con 0x7f88c0153c80 2023-08-22T00:18:47.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 -- 172.21.15.98:0/833268308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 msgr2=0x7f88c01540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 --2- 172.21.15.98:0/833268308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c01540f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f88b8009e60 tx=0x7f88b8009780).stop 2023-08-22T00:18:47.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 -- 172.21.15.98:0/833268308 shutdown_connections 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 --2- 172.21.15.98:0/833268308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c01540f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 -- 172.21.15.98:0/833268308 >> 172.21.15.98:0/833268308 conn(0x7f88c00c7170 msgr2=0x7f88c00c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 -- 172.21.15.98:0/833268308 shutdown_connections 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.417+0000 7f88c5a27700 1 -- 172.21.15.98:0/833268308 wait complete. 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.418+0000 7f88c5a27700 1 Processor -- start 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.418+0000 7f88c5a27700 1 -- start start 2023-08-22T00:18:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 0x7f88c01498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 0x7f88c00c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00aaf40 con 0x7f88c0153c80 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00bdfe0 con 0x7f88c0154830 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88c5a27700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00aba10 con 0x7f88c00a5910 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41402/0 (socket says 172.21.15.98:41402) 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 -- 172.21.15.98:0/1161364069 learned_addr learned my addr 172.21.15.98:0/1161364069 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88bf7fe700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 0x7f88c00c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88beffd700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 0x7f88c01498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 -- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 msgr2=0x7f88c01498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 0x7f88c01498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 -- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 msgr2=0x7f88c00c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 0x7f88c00c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 -- 172.21.15.98:0/1161364069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009a20 con 0x7f88c0153c80 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88bf7fe700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 0x7f88c00c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88beffd700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 0x7f88c01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88be7fc700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f88b400c410 tx=0x7f88b4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.419+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40072e0 con 0x7f88c0153c80 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.420+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b4007440 con 0x7f88c0153c80 2023-08-22T00:18:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.420+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c00ab190 con 0x7f88c0153c80 2023-08-22T00:18:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.420+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40057a0 con 0x7f88c0153c80 2023-08-22T00:18:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.420+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c00bdc70 con 0x7f88c0153c80 2023-08-22T00:18:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.421+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c00be150 con 0x7f88c0153c80 2023-08-22T00:18:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.421+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f88b4005b10 con 0x7f88c0153c80 2023-08-22T00:18:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.421+0000 7f88a6ffd700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 0x7f88ac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.421+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f88b4079730 con 0x7f88c0153c80 2023-08-22T00:18:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.421+0000 7f88beffd700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 0x7f88ac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.422+0000 7f88beffd700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 0x7f88ac0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f88b00026f0 tx=0x7f88b0009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.425+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88b404a890 con 0x7f88c0153c80 2023-08-22T00:18:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:47.589+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88c0047480 con 0x7f88c0153c80 2023-08-22T00:18:48.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.435+0000 7f88a6ffd700 1 -- 172.21.15.98:0/1161364069 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 169+0+0 (secure 0 0 0) 0x7f88b404deb0 con 0x7f88c0153c80 2023-08-22T00:18:48.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.438+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 msgr2=0x7f88ac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.438+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 0x7f88ac0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f88b00026f0 tx=0x7f88b0009040).stop 2023-08-22T00:18:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.438+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 msgr2=0x7f88c00be470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.438+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f88b400c410 tx=0x7f88b4007e10).stop 2023-08-22T00:18:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 shutdown_connections 2023-08-22T00:18:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ef30 0x7f88ac0613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c00a5910 0x7f88c01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c0154830 0x7f88c00c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 --2- 172.21.15.98:0/1161364069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c0153c80 0x7f88c00be470 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 >> 172.21.15.98:0/1161364069 conn(0x7f88c00c7170 msgr2=0x7f88c00c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 shutdown_connections 2023-08-22T00:18:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.439+0000 7f88c5a27700 1 -- 172.21.15.98:0/1161364069 wait complete. 2023-08-22T00:18:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:18:48.455 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:18:48.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.577+0000 7fc375e95700 1 Processor -- start 2023-08-22T00:18:48.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.577+0000 7fc375e95700 1 -- start start 2023-08-22T00:18:48.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.577+0000 7fc375e95700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3700635a0 0x7fc3700c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.577+0000 7fc375e95700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 0x7fc370065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.577+0000 7fc375e95700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc370063f90 con 0x7fc3701505e0 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc375e95700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3700656f0 con 0x7fc3700635a0 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc375e95700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3701509c0 con 0x7fc3700c2400 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3700635a0 0x7fc3700c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3700635a0 0x7fc3700c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41406/0 (socket says 172.21.15.98:41406) 2023-08-22T00:18:48.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 -- 172.21.15.98:0/2076194580 learned_addr learned my addr 172.21.15.98:0/2076194580 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36ffff700 1 --2- 172.21.15.98:0/2076194580 >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 0x7fc370065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 -- 172.21.15.98:0/2076194580 >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 msgr2=0x7fc370065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 --2- 172.21.15.98:0/2076194580 >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 0x7fc370065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 -- 172.21.15.98:0/2076194580 >> v1:172.21.15.118:6789/0 conn(0x7fc3701505e0 legacy=0x7fc370062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 -- 172.21.15.98:0/2076194580 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700650c0 con 0x7fc3700635a0 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36ffff700 1 --2- 172.21.15.98:0/2076194580 >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 0x7fc370065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36effd700 1 --2- 172.21.15.98:0/2076194580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3700635a0 0x7fc3700c1f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc370068da0 tx=0x7fc36400a2b0).ready entity=mon.0 client_cookie=a5786f3275b9b305 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36e7fc700 1 -- 172.21.15.98:0/2076194580 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400c940 con 0x7fc3700635a0 2023-08-22T00:18:48.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36e7fc700 1 -- 172.21.15.98:0/2076194580 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400caa0 con 0x7fc3700635a0 2023-08-22T00:18:48.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.578+0000 7fc36e7fc700 1 -- 172.21.15.98:0/2076194580 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400ce20 con 0x7fc3700635a0 2023-08-22T00:18:48.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 -- 172.21.15.98:0/2076194580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3700635a0 msgr2=0x7fc3700c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 --2- 172.21.15.98:0/2076194580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3700635a0 0x7fc3700c1f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc370068da0 tx=0x7fc36400a2b0).stop 2023-08-22T00:18:48.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 -- 172.21.15.98:0/2076194580 shutdown_connections 2023-08-22T00:18:48.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 --2- 172.21.15.98:0/2076194580 >> v2:172.21.15.118:3300/0 conn(0x7fc3700c2400 0x7fc370065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 --2- 172.21.15.98:0/2076194580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3700635a0 0x7fc3700c1f10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 -- 172.21.15.98:0/2076194580 >> 172.21.15.98:0/2076194580 conn(0x7fc3700c31d0 msgr2=0x7fc3700c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:48.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 -- 172.21.15.98:0/2076194580 shutdown_connections 2023-08-22T00:18:48.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.579+0000 7fc375e95700 1 -- 172.21.15.98:0/2076194580 wait complete. 2023-08-22T00:18:48.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.580+0000 7fc375e95700 1 Processor -- start 2023-08-22T00:18:48.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.580+0000 7fc375e95700 1 -- start start 2023-08-22T00:18:48.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3700635a0 0x7fc370152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3700c2400 0x7fc3700bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc370150cf0 con 0x7fc3701505e0 2023-08-22T00:18:48.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc370156610 con 0x7fc3700c2400 2023-08-22T00:18:48.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc375e95700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701568f0 con 0x7fc3700635a0 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41412/0 (socket says 172.21.15.98:41412) 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 -- 172.21.15.98:0/1838845916 learned_addr learned my addr 172.21.15.98:0/1838845916 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36effd700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3700c2400 0x7fc3700bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36f7fe700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3700635a0 0x7fc370152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 -- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3700635a0 msgr2=0x7fc370152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3700635a0 0x7fc370152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 -- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3700c2400 msgr2=0x7fc3700bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3700c2400 0x7fc3700bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 -- 172.21.15.98:0/1838845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36400a510 con 0x7fc3701505e0 2023-08-22T00:18:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.581+0000 7fc36ffff700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fc36800d180 tx=0x7fc368009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.582+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800dcc0 con 0x7fc3701505e0 2023-08-22T00:18:48.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.582+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36800f040 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.582+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc370156bd0 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.582+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368013620 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.582+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc370153270 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.583+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc370150e60 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.583+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc368013a10 con 0x7fc3701505e0 2023-08-22T00:18:48.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.583+0000 7fc3577fe700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 0x7fc35c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.584+0000 7fc36f7fe700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 0x7fc35c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.584+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7fc36807a510 con 0x7fc3701505e0 2023-08-22T00:18:48.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.584+0000 7fc36f7fe700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 0x7fc35c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc360003870 tx=0x7fc360007d40).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.588+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc36804b7e0 con 0x7fc3701505e0 2023-08-22T00:18:48.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.749+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc3700c2bf0 con 0x7fc3701505e0 2023-08-22T00:18:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.753+0000 7fc3577fe700 1 -- 172.21.15.98:0/1838845916 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v4) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc36804ee00 con 0x7fc3701505e0 2023-08-22T00:18:48.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 msgr2=0x7fc35c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 0x7fc35c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc360003870 tx=0x7fc360007d40).stop 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 msgr2=0x7fc3700bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fc36800d180 tx=0x7fc368009a50).stop 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 shutdown_connections 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc35c05ef30 0x7fc35c0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3700635a0 0x7fc370152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3701505e0 0x7fc3700bf130 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 --2- 172.21.15.98:0/1838845916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3700c2400 0x7fc3700bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 >> 172.21.15.98:0/1838845916 conn(0x7fc3700c31d0 msgr2=0x7fc370066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 shutdown_connections 2023-08-22T00:18:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.755+0000 7fc375e95700 1 -- 172.21.15.98:0/1838845916 wait complete. 2023-08-22T00:18:48.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:18:48.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 Processor -- start 2023-08-22T00:18:48.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 -- start start 2023-08-22T00:18:48.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 0x7f68d40c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68d40c3230 0x7f68d4064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d4158970 con 0x7f68d4064600 2023-08-22T00:18:48.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d4064ab0 con 0x7f68d40c3230 2023-08-22T00:18:48.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.891+0000 7f68dacff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d40c28b0 con 0x7f68d4153dd0 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68d40c3230 0x7f68d4064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d929c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f68d4064600 0x7f68d4066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45262/0 (socket says 172.21.15.98:45262) 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d929c700 1 -- 172.21.15.98:0/954665225 learned_addr learned my addr 172.21.15.98:0/954665225 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 -- 172.21.15.98:0/954665225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 msgr2=0x7f68d40c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 0x7f68d40c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d37fe700 1 -- 172.21.15.98:0/954665225 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806916592 0 0) 0x7f68d4158970 con 0x7f68d4064600 2023-08-22T00:18:48.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 0x7f68d40c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 -- 172.21.15.98:0/954665225 >> v1:172.21.15.98:6789/0 conn(0x7f68d4064600 legacy=0x7f68d4066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 -- 172.21.15.98:0/954665225 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4158690 con 0x7f68d40c3230 2023-08-22T00:18:48.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 0x7f68d40c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:48.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d3fff700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40c3230 0x7f68d4064110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f68c0009760 tx=0x7f68c0009060).ready entity=mon.0 client_cookie=886b760a6c79d603 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d37fe700 1 -- 172.21.15.98:0/954665225 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000b580 con 0x7f68d40c3230 2023-08-22T00:18:48.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d37fe700 1 -- 172.21.15.98:0/954665225 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c000b6e0 con 0x7f68d40c3230 2023-08-22T00:18:48.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.892+0000 7f68d37fe700 1 -- 172.21.15.98:0/954665225 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000ba60 con 0x7f68d40c3230 2023-08-22T00:18:48.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 -- 172.21.15.98:0/954665225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40c3230 msgr2=0x7f68d4064110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40c3230 0x7f68d4064110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f68c0009760 tx=0x7f68c0009060).stop 2023-08-22T00:18:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 -- 172.21.15.98:0/954665225 shutdown_connections 2023-08-22T00:18:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d4153dd0 0x7f68d40c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 --2- 172.21.15.98:0/954665225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40c3230 0x7f68d4064110 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 -- 172.21.15.98:0/954665225 >> 172.21.15.98:0/954665225 conn(0x7f68d40c7820 msgr2=0x7f68d40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:48.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 -- 172.21.15.98:0/954665225 shutdown_connections 2023-08-22T00:18:48.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.893+0000 7f68dacff700 1 -- 172.21.15.98:0/954665225 wait complete. 2023-08-22T00:18:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.894+0000 7f68dacff700 1 Processor -- start 2023-08-22T00:18:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.894+0000 7f68dacff700 1 -- start start 2023-08-22T00:18:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 0x7f68d40a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d40c3230 0x7f68d414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d414d3a0 con 0x7f68d4153dd0 2023-08-22T00:18:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d40a82f0 con 0x7f68d4064600 2023-08-22T00:18:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d40a76e0 con 0x7f68d40c3230 2023-08-22T00:18:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41432/0 (socket says 172.21.15.98:41432) 2023-08-22T00:18:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 -- 172.21.15.98:0/2938757655 learned_addr learned my addr 172.21.15.98:0/2938757655 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d3fff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d40c3230 0x7f68d414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 0x7f68d40a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 -- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d40c3230 msgr2=0x7f68d414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d40c3230 0x7f68d414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 -- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 msgr2=0x7f68d40a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 0x7f68d40a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 -- 172.21.15.98:0/2938757655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00092a0 con 0x7f68d4153dd0 2023-08-22T00:18:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 0x7f68d40a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d929c700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f68cc00c7e0 tx=0x7f68cc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc005d30 con 0x7f68d4153dd0 2023-08-22T00:18:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc005e90 con 0x7f68d4153dd0 2023-08-22T00:18:48.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d40a79c0 con 0x7f68d4153dd0 2023-08-22T00:18:48.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc007320 con 0x7f68d4153dd0 2023-08-22T00:18:48.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.895+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d40a7f80 con 0x7f68d4153dd0 2023-08-22T00:18:48.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.896+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d40bf890 con 0x7f68d4153dd0 2023-08-22T00:18:48.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.897+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f68cc007710 con 0x7f68d4153dd0 2023-08-22T00:18:48.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.898+0000 7f68d0ff9700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 0x7f68b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:48.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.898+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 0x7f68b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:48.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.898+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7f68cc07a4e0 con 0x7f68d4153dd0 2023-08-22T00:18:48.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.898+0000 7f68d8a9b700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 0x7f68b80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f68c8006fd0 tx=0x7f68c8008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:48.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:48.901+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68cc04b8d0 con 0x7f68d4153dd0 2023-08-22T00:18:49.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.064+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f68d40bf890 con 0x7f68d4153dd0 2023-08-22T00:18:49.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.067+0000 7f68d0ff9700 1 -- 172.21.15.98:0/2938757655 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v5) v1 ==== 120+0+0 (secure 0 0 0) 0x7f68d40bf890 con 0x7f68d4153dd0 2023-08-22T00:18:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 msgr2=0x7f68b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 0x7f68b80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f68c8006fd0 tx=0x7f68c8008040).stop 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 msgr2=0x7f68d40650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f68cc00c7e0 tx=0x7f68cc007f90).stop 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 shutdown_connections 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d4153dd0 0x7f68d40650c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d4064600 0x7f68d40a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f68b805ef30 0x7f68b80613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 --2- 172.21.15.98:0/2938757655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68d40c3230 0x7f68d414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 >> 172.21.15.98:0/2938757655 conn(0x7f68d40c7820 msgr2=0x7f68d40c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 shutdown_connections 2023-08-22T00:18:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.069+0000 7f68dacff700 1 -- 172.21.15.98:0/2938757655 wait complete. 2023-08-22T00:18:49.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-22T00:18:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.199+0000 7fb2e2ca0700 1 Processor -- start 2023-08-22T00:18:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.199+0000 7fb2e2ca0700 1 -- start start 2023-08-22T00:18:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e2ca0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb2dc0a6e50 0x7fb2dc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e2ca0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc158bf0 con 0x7fb2dc066400 2023-08-22T00:18:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e2ca0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc157d90 con 0x7fb2dc151d60 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e2ca0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc066830 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2dbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb2dc0a6e50 0x7fb2dc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e123d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb2dc066400 0x7fb2dc0643c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45272/0 (socket says 172.21.15.98:45272) 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.200+0000 7fb2e123d700 1 -- 172.21.15.98:0/30935355 learned_addr learned my addr 172.21.15.98:0/30935355 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2dbfff700 1 -- 172.21.15.98:0/30935355 >> v1:172.21.15.118:6789/0 conn(0x7fb2dc151d60 legacy=0x7fb2dc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2dbfff700 1 -- 172.21.15.98:0/30935355 >> v1:172.21.15.98:6789/0 conn(0x7fb2dc066400 legacy=0x7fb2dc0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2dbfff700 1 -- 172.21.15.98:0/30935355 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc157fe0 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2db7fe700 1 -- 172.21.15.98:0/30935355 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940939044 0 0) 0x7fb2dc158bf0 con 0x7fb2dc066400 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2dbfff700 1 --2- 172.21.15.98:0/30935355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc065f10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fb2c8009760 tx=0x7fb2c8009060).ready entity=mon.0 client_cookie=bb811aa5c3f77382 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2db7fe700 1 -- 172.21.15.98:0/30935355 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800b580 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2db7fe700 1 -- 172.21.15.98:0/30935355 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800b6e0 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2db7fe700 1 -- 172.21.15.98:0/30935355 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ba60 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/30935355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc0a6e50 msgr2=0x7fb2dc065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/30935355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc065f10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fb2c8009760 tx=0x7fb2c8009060).stop 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/30935355 shutdown_connections 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/30935355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc065f10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/30935355 >> 172.21.15.98:0/30935355 conn(0x7fb2dc06a980 msgr2=0x7fb2dc0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/30935355 shutdown_connections 2023-08-22T00:18:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.201+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/30935355 wait complete. 2023-08-22T00:18:49.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 Processor -- start 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 -- start start 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2dc066400 0x7fb2dc0a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc14bad0 con 0x7fb2dc151d60 2023-08-22T00:18:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0a5a90 con 0x7fb2dc0a6e50 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.203+0000 7fb2e2ca0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0a4e80 con 0x7fb2dc066400 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41456/0 (socket says 172.21.15.98:41456) 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 -- 172.21.15.98:0/2274450505 learned_addr learned my addr 172.21.15.98:0/2274450505 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2dbfff700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e0a3c700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2dc066400 0x7fb2dc0a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 -- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2dc066400 msgr2=0x7fb2dc0a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2dc066400 0x7fb2dc0a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 -- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc0a6e50 msgr2=0x7fb2dc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 -- 172.21.15.98:0/2274450505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c80092a0 con 0x7fb2dc151d60 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e123d700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb2d400c7e0 tx=0x7fb2d4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4005d30 con 0x7fb2dc151d60 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4005e90 con 0x7fb2dc151d60 2023-08-22T00:18:49.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc0a5160 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4007320 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.204+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc0a5720 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.205+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc047480 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.205+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb2d40076d0 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.206+0000 7fb2d8ff9700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 0x7fb2c00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.206+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7fb2d4079ed0 con 0x7fb2dc151d60 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.206+0000 7fb2e0a3c700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 0x7fb2c00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.206+0000 7fb2e0a3c700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 0x7fb2c00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb2dc0a63c0 tx=0x7fb2d0009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.210+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2d404b200 con 0x7fb2dc151d60 2023-08-22T00:18:49.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.431+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fb2dc1582c0 con 0x7fb2dc151d60 2023-08-22T00:18:49.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.436+0000 7fb2d8ff9700 1 -- 172.21.15.98:0/2274450505 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v450) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb2d404e820 con 0x7fb2dc151d60 2023-08-22T00:18:49.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 msgr2=0x7fb2c00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 0x7fb2c00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb2dc0a63c0 tx=0x7fb2d0009040).stop 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 msgr2=0x7fb2dc165200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb2d400c7e0 tx=0x7fb2d4007f90).stop 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 shutdown_connections 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2c005ef30 0x7fb2c00613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2dc066400 0x7fb2dc0a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2dc151d60 0x7fb2dc165200 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 --2- 172.21.15.98:0/2274450505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc0a6e50 0x7fb2dc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 >> 172.21.15.98:0/2274450505 conn(0x7fb2dc06a980 msgr2=0x7fb2dc0c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 shutdown_connections 2023-08-22T00:18:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.438+0000 7fb2e2ca0700 1 -- 172.21.15.98:0/2274450505 wait complete. 2023-08-22T00:18:49.451 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-08-22T00:18:49.451 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-08-22T00:18:49.452 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:18:49.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-22T00:18:49.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.567+0000 7f6786d20700 1 Processor -- start 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.567+0000 7f6786d20700 1 -- start start 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6786d20700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6780150040 0x7f6780150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6786d20700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 0x7f67800c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6786d20700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800c2220 con 0x7f6780153f10 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6786d20700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800c5bd0 con 0x7f6780150040 2023-08-22T00:18:49.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6786d20700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800c1ef0 con 0x7f67800c26b0 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6784abc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6780150040 0x7f6780150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f677ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6780153f10 0x7f67800c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:45278/0 (socket says 172.21.15.98:45278) 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f677ffff700 1 -- 172.21.15.98:0/801487081 learned_addr learned my addr 172.21.15.98:0/801487081 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f67852bd700 1 --2- 172.21.15.98:0/801487081 >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 0x7f67800c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f677f7fe700 1 -- 172.21.15.98:0/801487081 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9052699 0 0) 0x7f67800c2220 con 0x7f6780153f10 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f677f7fe700 1 -- 172.21.15.98:0/801487081 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67700033f0 con 0x7f6780153f10 2023-08-22T00:18:49.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6784abc700 1 -- 172.21.15.98:0/801487081 >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 msgr2=0x7f67800c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6784abc700 1 --2- 172.21.15.98:0/801487081 >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 0x7f67800c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6784abc700 1 -- 172.21.15.98:0/801487081 >> v1:172.21.15.98:6789/0 conn(0x7f6780153f10 legacy=0x7f67800c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f6784abc700 1 -- 172.21.15.98:0/801487081 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800c5e30 con 0x7f6780150040 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.568+0000 7f67852bd700 1 --2- 172.21.15.98:0/801487081 >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 0x7f67800c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6784abc700 1 --2- 172.21.15.98:0/801487081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780150420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f67800c4cd0 tx=0x7f6774009060).ready entity=mon.0 client_cookie=436cda143111983 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f677f7fe700 1 -- 172.21.15.98:0/801487081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400f510 con 0x7f6780150040 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f677f7fe700 1 -- 172.21.15.98:0/801487081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400f670 con 0x7f6780150040 2023-08-22T00:18:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f677f7fe700 1 -- 172.21.15.98:0/801487081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400f9f0 con 0x7f6780150040 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 -- 172.21.15.98:0/801487081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 msgr2=0x7f6780150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 --2- 172.21.15.98:0/801487081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780150420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f67800c4cd0 tx=0x7f6774009060).stop 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 -- 172.21.15.98:0/801487081 shutdown_connections 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 --2- 172.21.15.98:0/801487081 >> v2:172.21.15.118:3300/0 conn(0x7f67800c26b0 0x7f67800c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 --2- 172.21.15.98:0/801487081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780150420 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 -- 172.21.15.98:0/801487081 >> 172.21.15.98:0/801487081 conn(0x7f67800c7140 msgr2=0x7f67800c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 -- 172.21.15.98:0/801487081 shutdown_connections 2023-08-22T00:18:49.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.569+0000 7f6786d20700 1 -- 172.21.15.98:0/801487081 wait complete. 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.570+0000 7f6786d20700 1 Processor -- start 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 -- start start 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 0x7f6780146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 0x7f6780148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780144820 con 0x7f6780150040 2023-08-22T00:18:49.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780144dd0 con 0x7f67800c26b0 2023-08-22T00:18:49.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f6786d20700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780145020 con 0x7f6780153f10 2023-08-22T00:18:49.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f677ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f677ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41470/0 (socket says 172.21.15.98:41470) 2023-08-22T00:18:49.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.571+0000 7f677ffff700 1 -- 172.21.15.98:0/635945249 learned_addr learned my addr 172.21.15.98:0/635945249 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f67852bd700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 0x7f6780148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f6784abc700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 0x7f6780146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 -- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 msgr2=0x7f6780148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 0x7f6780148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 -- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 msgr2=0x7f6780146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:49.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 0x7f6780146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 -- 172.21.15.98:0/635945249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740092a0 con 0x7f6780150040 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f67852bd700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 0x7f6780148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f6784abc700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 0x7f6780146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677ffff700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f676c00c420 tx=0x7f676c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0072e0 con 0x7f6780150040 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c007440 con 0x7f6780150040 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0057a0 con 0x7f6780150040 2023-08-22T00:18:49.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780145300 con 0x7f6780150040 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.572+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67801458c0 con 0x7f6780150040 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.573+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6780047480 con 0x7f6780150040 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.573+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f676c005bd0 con 0x7f6780150040 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.574+0000 7f677cff9700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 0x7f67640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.574+0000 7f6784abc700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 0x7f67640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.574+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7f676c079670 con 0x7f6780150040 2023-08-22T00:18:49.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.574+0000 7f6784abc700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 0x7f67640613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6780164850 tx=0x7f6774017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:49.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.578+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f676c04a9a0 con 0x7f6780150040 2023-08-22T00:18:49.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:49.803+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f67800c45b0 con 0x7f6780150040 2023-08-22T00:18:50.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:18:50.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:18:50.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.440+0000 7f677cff9700 1 -- 172.21.15.98:0/635945249 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v451) v1 ==== 157+0+0 (secure 0 0 0) 0x7f676c04dfc0 con 0x7f6780150040 2023-08-22T00:18:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 msgr2=0x7f67640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 0x7f67640613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6780164850 tx=0x7f6774017000).stop 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 msgr2=0x7f6780145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f676c00c420 tx=0x7f676c007c80).stop 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 shutdown_connections 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f676405ef30 0x7f67640613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6780153f10 0x7f6780148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67800c26b0 0x7f6780146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 --2- 172.21.15.98:0/635945249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6780150040 0x7f6780145de0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 >> 172.21.15.98:0/635945249 conn(0x7f67800c7140 msgr2=0x7f6780068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:50.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 shutdown_connections 2023-08-22T00:18:50.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.442+0000 7f6786d20700 1 -- 172.21.15.98:0/635945249 wait complete. 2023-08-22T00:18:50.455 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:18:50.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.573+0000 7f406d705700 1 Processor -- start 2023-08-22T00:18:50.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.573+0000 7f406d705700 1 -- start start 2023-08-22T00:18:50.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f406d705700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680a8ac0 0x7f40680a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f406d705700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40680bd260 0x7f40680c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f406d705700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680bd640 con 0x7f40680bb770 2023-08-22T00:18:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f406d705700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4068155380 con 0x7f40680bd260 2023-08-22T00:18:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f406d705700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4068155620 con 0x7f40680a8ac0 2023-08-22T00:18:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f40667fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40680bd260 0x7f40680c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.574+0000 7f40677fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f40680bb770 0x7f40680bbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55984/0 (socket says 172.21.15.98:55984) 2023-08-22T00:18:50.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40677fe700 1 -- 172.21.15.98:0/4235028301 learned_addr learned my addr 172.21.15.98:0/4235028301 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:50.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f40680bd260 0x7f40680c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39388/0 (socket says 172.21.15.98:39388) 2023-08-22T00:18:50.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f4066ffd700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680a8ac0 0x7f40680a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 -- 172.21.15.98:0/4235028301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680a8ac0 msgr2=0x7f40680a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:50.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680a8ac0 0x7f40680a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 -- 172.21.15.98:0/4235028301 >> v1:172.21.15.98:6789/0 conn(0x7f40680bb770 legacy=0x7f40680bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 -- 172.21.15.98:0/4235028301 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680c12c0 con 0x7f40680bd260 2023-08-22T00:18:50.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f40667fc700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680bd260 0x7f40680c0dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f4058009760 tx=0x7f4058009060).ready entity=mon.0 client_cookie=e11fece0e9751373 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f4065ffb700 1 -- 172.21.15.98:0/4235028301 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800b580 con 0x7f40680bd260 2023-08-22T00:18:50.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f4065ffb700 1 -- 172.21.15.98:0/4235028301 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800b6e0 con 0x7f40680bd260 2023-08-22T00:18:50.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f4065ffb700 1 -- 172.21.15.98:0/4235028301 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800ba60 con 0x7f40680bd260 2023-08-22T00:18:50.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f406d705700 1 -- 172.21.15.98:0/4235028301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680bd260 msgr2=0x7f40680c0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.575+0000 7f406d705700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680bd260 0x7f40680c0dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f4058009760 tx=0x7f4058009060).stop 2023-08-22T00:18:50.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 -- 172.21.15.98:0/4235028301 shutdown_connections 2023-08-22T00:18:50.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680a8ac0 0x7f40680a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 --2- 172.21.15.98:0/4235028301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680bd260 0x7f40680c0dd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 -- 172.21.15.98:0/4235028301 >> 172.21.15.98:0/4235028301 conn(0x7f40680c31d0 msgr2=0x7f40680c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:50.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 -- 172.21.15.98:0/4235028301 shutdown_connections 2023-08-22T00:18:50.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.576+0000 7f406d705700 1 -- 172.21.15.98:0/4235028301 wait complete. 2023-08-22T00:18:50.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.577+0000 7f406d705700 1 Processor -- start 2023-08-22T00:18:50.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.577+0000 7f406d705700 1 -- start start 2023-08-22T00:18:50.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 0x7f4068068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 0x7f40680c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068145970 con 0x7f40680a8ac0 2023-08-22T00:18:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068144da0 con 0x7f40680bb770 2023-08-22T00:18:50.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4068145040 con 0x7f40680bd260 2023-08-22T00:18:50.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39392/0 (socket says 172.21.15.98:39392) 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 -- 172.21.15.98:0/3468987521 learned_addr learned my addr 172.21.15.98:0/3468987521 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f40677fe700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 0x7f40680c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f40667fc700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 0x7f4068068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 -- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 msgr2=0x7f40680c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 0x7f40680c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 -- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 msgr2=0x7f4068068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 0x7f4068068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 -- 172.21.15.98:0/3468987521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580092a0 con 0x7f40680a8ac0 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f40677fe700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 0x7f40680c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f40667fc700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 0x7f4068068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f4066ffd700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f405c00d890 tx=0x7f405c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0125f0 con 0x7f40680a8ac0 2023-08-22T00:18:50.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c012750 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4068145320 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c012ad0 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.578+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40681396e0 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.579+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40680c2ae0 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.579+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f405c013480 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.580+0000 7f404effd700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 0x7f40540613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.580+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7f405c079da0 con 0x7f40680a8ac0 2023-08-22T00:18:50.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.580+0000 7f40667fc700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 0x7f40540613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.580+0000 7f40667fc700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 0x7f40540613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f40680c0f50 tx=0x7f4058017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.584+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f405c04b070 con 0x7f40680a8ac0 2023-08-22T00:18:50.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.746+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4068145c50 con 0x7f40680a8ac0 2023-08-22T00:18:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.750+0000 7f404effd700 1 -- 172.21.15.98:0/3468987521 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f405c04e690 con 0x7f40680a8ac0 2023-08-22T00:18:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.751+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 msgr2=0x7f40540613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.751+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 0x7f40540613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f40680c0f50 tx=0x7f4058017000).stop 2023-08-22T00:18:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.751+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 msgr2=0x7f4068140a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.751+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f405c00d890 tx=0x7f405c008040).stop 2023-08-22T00:18:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 shutdown_connections 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f405405ef00 0x7f40540613c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40680bd260 0x7f40680c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40680a8ac0 0x7f4068140a60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 --2- 172.21.15.98:0/3468987521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40680bb770 0x7f4068068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 >> 172.21.15.98:0/3468987521 conn(0x7f40680c31d0 msgr2=0x7f406814f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 shutdown_connections 2023-08-22T00:18:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.752+0000 7f406d705700 1 -- 172.21.15.98:0/3468987521 wait complete. 2023-08-22T00:18:50.765 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:18:50.766 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:18:50.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:18:50.853 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:18:50.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:18:50.855 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:50.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.971+0000 7f5808836700 1 Processor -- start 2023-08-22T00:18:50.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.971+0000 7f5808836700 1 -- start start 2023-08-22T00:18:50.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5808836700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 0x7f58040bc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5808836700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5804155ea0 0x7f5804062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5808836700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58040c4ec0 con 0x7f58040bc500 2023-08-22T00:18:50.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5808836700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5804063a80 con 0x7f5804155ea0 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5808836700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5804063d60 con 0x7f58041519e0 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f580259c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 0x7f58040bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5802d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5804155ea0 0x7f5804062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5801d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f58040bc500 0x7f5804155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:60920/0 (socket says 172.21.15.98:60920) 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.972+0000 7f5801d9b700 1 -- 172.21.15.98:0/2089222792 learned_addr learned my addr 172.21.15.98:0/2089222792 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5802d9d700 1 -- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 msgr2=0x7f58040bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:50.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5802d9d700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 0x7f58040bc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5802d9d700 1 -- 172.21.15.98:0/2089222792 >> v1:172.21.15.118:6789/0 conn(0x7f58040bc500 legacy=0x7f5804155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5802d9d700 1 -- 172.21.15.98:0/2089222792 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040c4b50 con 0x7f5804155ea0 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f580159a700 1 -- 172.21.15.98:0/2089222792 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377483675 0 0) 0x7f58040c4ec0 con 0x7f58040bc500 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f580259c700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 0x7f58040bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5802d9d700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5804155ea0 0x7f5804062600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f57fc009e60 tx=0x7f57fc009780).ready entity=mon.1 client_cookie=274ca4dd14856a7e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f580159a700 1 -- 172.21.15.98:0/2089222792 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00e070 con 0x7f5804155ea0 2023-08-22T00:18:50.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f580159a700 1 -- 172.21.15.98:0/2089222792 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00bb60 con 0x7f5804155ea0 2023-08-22T00:18:50.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f580159a700 1 -- 172.21.15.98:0/2089222792 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc012410 con 0x7f5804155ea0 2023-08-22T00:18:50.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 -- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5804155ea0 msgr2=0x7f5804062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5804155ea0 0x7f5804062600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f57fc009e60 tx=0x7f57fc009780).stop 2023-08-22T00:18:50.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 -- 172.21.15.98:0/2089222792 shutdown_connections 2023-08-22T00:18:50.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5804155ea0 0x7f5804062600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 --2- 172.21.15.98:0/2089222792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58041519e0 0x7f58040bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 -- 172.21.15.98:0/2089222792 >> 172.21.15.98:0/2089222792 conn(0x7f58040c7140 msgr2=0x7f58040c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.973+0000 7f5808836700 1 -- 172.21.15.98:0/2089222792 shutdown_connections 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.974+0000 7f5808836700 1 -- 172.21.15.98:0/2089222792 wait complete. 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 Processor -- start 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 -- start start 2023-08-22T00:18:50.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58041519e0 0x7f5804154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5804155ea0 0x7f58040aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040ab030 con 0x7f58040bc500 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040abe80 con 0x7f58041519e0 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f5808836700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5804153570 con 0x7f5804155ea0 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f580259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f580259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39400/0 (socket says 172.21.15.98:39400) 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.975+0000 7f580259c700 1 -- 172.21.15.98:0/2904976208 learned_addr learned my addr 172.21.15.98:0/2904976208 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f5801d9b700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58041519e0 0x7f5804154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f5802d9d700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5804155ea0 0x7f58040aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 -- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5804155ea0 msgr2=0x7f58040aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5804155ea0 0x7f58040aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 -- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58041519e0 msgr2=0x7f5804154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58041519e0 0x7f5804154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 -- 172.21.15.98:0/2904976208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40092a0 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f580259c700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f57f400ea50 tx=0x7f57f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400ee90 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f400c7f0 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc009a20 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400cb70 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.976+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58040ab550 con 0x7f58040bc500 2023-08-22T00:18:50.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.977+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5804047480 con 0x7f58040bc500 2023-08-22T00:18:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.977+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f57f401b400 con 0x7f58040bc500 2023-08-22T00:18:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.978+0000 7f57f27fc700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 0x7f57e40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.978+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6052+0+0 (secure 0 0 0) 0x7f57f407a470 con 0x7f58040bc500 2023-08-22T00:18:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.978+0000 7f5801d9b700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 0x7f57e40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.978+0000 7f5801d9b700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 0x7f57e40613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f57f80011e0 tx=0x7f57f8007bb0).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:50.982+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57f404b7f0 con 0x7f58040bc500 2023-08-22T00:18:51.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.182+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58040ac160 con 0x7f58040bc500 2023-08-22T00:18:51.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.182+0000 7f57f27fc700 1 -- 172.21.15.98:0/2904976208 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f57f404ee10 con 0x7f58040bc500 2023-08-22T00:18:51.185 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:51.185 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1795837006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1795837006},{"type":"v1","addr":"172.21.15.118:6834","nonce":1795837006}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3146905971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3146905971},{"type":"v1","addr":"172.21.15.118:6835","nonce":3146905971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3619543235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3619543235},{"type":"v1","addr":"172.21.15.98:6836","nonce":3619543235}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3324352899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3324352899},{"type":"v1","addr":"172.21.15.98:6837","nonce":3324352899}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-08-22T00:18:51.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 msgr2=0x7f57e40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 0x7f57e40613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f57f80011e0 tx=0x7f57f8007bb0).stop 2023-08-22T00:18:51.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 msgr2=0x7f58040ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f57f400ea50 tx=0x7f57f4009060).stop 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 shutdown_connections 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f57e405ef30 0x7f57e40613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5804155ea0 0x7f58040aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58040bc500 0x7f58040ac310 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 --2- 172.21.15.98:0/2904976208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58041519e0 0x7f5804154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 >> 172.21.15.98:0/2904976208 conn(0x7f58040c7140 msgr2=0x7f580414d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:51.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 shutdown_connections 2023-08-22T00:18:51.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.184+0000 7f5808836700 1 -- 172.21.15.98:0/2904976208 wait complete. 2023-08-22T00:18:51.188 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 18 2023-08-22T00:18:51.197 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:18:51.197 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:18:51.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:18:51.198 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:18:51.198 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:18:51.198 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:18:51.199 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:18:51.199 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:18:51.199 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:18:51.199 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:18:51.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:18:51.200 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:18:51.200 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:18:51.200 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:18:51.200 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:18:51.201 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:18:51.207 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:18:51.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:18:51.210 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:18:51.210 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:18:51.214 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:18:51.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:18:51.216 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:18:51.216 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:18:51.249 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:18:51.249 DEBUG:teuthology.parallel:result is None 2023-08-22T00:18:51.250 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:18:51.250 DEBUG:teuthology.parallel:result is None 2023-08-22T00:18:51.257 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:18:51.257 DEBUG:teuthology.parallel:result is None 2023-08-22T00:18:51.258 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:18:51.258 DEBUG:teuthology.parallel:result is None 2023-08-22T00:18:51.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:18:51.325 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:18:51.326 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:18:51.326 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:18:51.325+0000 7f7a686cf700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2023-08-22T00:18:51.341 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:18:51.341 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:18:51.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.388+0000 7fad26435700 1 Processor -- start 2023-08-22T00:18:51.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.388+0000 7fad26435700 1 -- start start 2023-08-22T00:18:51.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad26435700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad20153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad26435700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fad200c6210 0x7fad200a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad26435700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200c1800 con 0x7fad200a9ad0 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad26435700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200aa440 con 0x7fad200c6210 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad26435700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200c0bf0 con 0x7fad20153a60 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fad200c6210 0x7fad200a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fad200c6210 0x7fad200a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39446/0 (socket says 172.21.15.98:39446) 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 -- 172.21.15.98:0/1823165675 learned_addr learned my addr 172.21.15.98:0/1823165675 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad1ffff700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad20153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 -- 172.21.15.98:0/1823165675 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 msgr2=0x7fad20153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad20153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 -- 172.21.15.98:0/1823165675 >> v1:172.21.15.118:6789/0 conn(0x7fad200a9ad0 legacy=0x7fad200c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 -- 172.21.15.98:0/1823165675 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200c0ed0 con 0x7fad200c6210 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.389+0000 7fad249d2700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200a9f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fad18009f20 tx=0x7fad18009840).ready entity=mon.0 client_cookie=72d44ac1d3a0a01c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad1effd700 1 -- 172.21.15.98:0/1823165675 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800e070 con 0x7fad200c6210 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad1effd700 1 -- 172.21.15.98:0/1823165675 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800b9d0 con 0x7fad200c6210 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad1effd700 1 -- 172.21.15.98:0/1823165675 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800bd50 con 0x7fad200c6210 2023-08-22T00:18:51.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 -- 172.21.15.98:0/1823165675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 msgr2=0x7fad200a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200a9f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fad18009f20 tx=0x7fad18009840).stop 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 -- 172.21.15.98:0/1823165675 shutdown_connections 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200a9f50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 --2- 172.21.15.98:0/1823165675 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad20153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 -- 172.21.15.98:0/1823165675 >> 172.21.15.98:0/1823165675 conn(0x7fad200650f0 msgr2=0x7fad200cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 -- 172.21.15.98:0/1823165675 shutdown_connections 2023-08-22T00:18:51.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.390+0000 7fad26435700 1 -- 172.21.15.98:0/1823165675 wait complete. 2023-08-22T00:18:51.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.391+0000 7fad26435700 1 Processor -- start 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.391+0000 7fad26435700 1 -- start start 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad200a9ad0 0x7fad201440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad200c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2014b6f0 con 0x7fad200c6210 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b04a0 con 0x7fad200a9ad0 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad26435700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b0780 con 0x7fad20153a60 2023-08-22T00:18:51.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39452/0 (socket says 172.21.15.98:39452) 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1f7fe700 1 -- 172.21.15.98:0/3784058584 learned_addr learned my addr 172.21.15.98:0/3784058584 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1ffff700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad200a9ad0 0x7fad201440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad249d2700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad200c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1f7fe700 1 -- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 msgr2=0x7fad200c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.392+0000 7fad1f7fe700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad200c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad1f7fe700 1 -- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad200a9ad0 msgr2=0x7fad201440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad1f7fe700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad200a9ad0 0x7fad201440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad1f7fe700 1 -- 172.21.15.98:0/3784058584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009ae0 con 0x7fad200c6210 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad1f7fe700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fad1000c4c0 tx=0x7fad10007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000ce10 con 0x7fad200c6210 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10007020 con 0x7fad200c6210 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200b0a60 con 0x7fad200c6210 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100073c0 con 0x7fad200c6210 2023-08-22T00:18:51.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.393+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200aefc0 con 0x7fad200c6210 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.394+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad200c11b0 con 0x7fad200c6210 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.394+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fad100068b0 con 0x7fad200c6210 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.394+0000 7fad07fff700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 0x7fad0c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.395+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6052+0+0 (secure 0 0 0) 0x7fad10079300 con 0x7fad200c6210 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.395+0000 7fad1ffff700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 0x7fad0c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:51.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.395+0000 7fad1ffff700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 0x7fad0c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fad20167280 tx=0x7fad14009060).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:51.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.399+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad100478f0 con 0x7fad200c6210 2023-08-22T00:18:51.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:51.574+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fad20046c20 con 0x7fad200c6210 2023-08-22T00:18:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.447+0000 7fad07fff700 1 -- 172.21.15.98:0/3784058584 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7fad1004a570 con 0x7fad200c6210 2023-08-22T00:18:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 msgr2=0x7fad0c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 0x7fad0c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fad20167280 tx=0x7fad14009060).stop 2023-08-22T00:18:52.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 msgr2=0x7fad200aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fad1000c4c0 tx=0x7fad10007dd0).stop 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 shutdown_connections 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fad0c05ef30 0x7fad0c0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad20153a60 0x7fad200c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad200a9ad0 0x7fad201440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 --2- 172.21.15.98:0/3784058584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad200c6210 0x7fad200aead0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 >> 172.21.15.98:0/3784058584 conn(0x7fad200650f0 msgr2=0x7fad2014e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:52.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 shutdown_connections 2023-08-22T00:18:52.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.450+0000 7fad26435700 1 -- 172.21.15.98:0/3784058584 wait complete. 2023-08-22T00:18:52.453 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:18:52.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:18:52.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.587+0000 7f7c415b2700 1 Processor -- start 2023-08-22T00:18:52.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.587+0000 7f7c415b2700 1 -- start start 2023-08-22T00:18:52.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c415b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c3c1550e0 0x7f7c3c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c415b2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0bd750 con 0x7f7c3c153cf0 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c415b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0a7030 con 0x7f7c3c066400 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c415b2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c2010 con 0x7f7c3c1550e0 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c3a7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c3c1550e0 0x7f7c3c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c3affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7c3c153cf0 0x7f7c3c1584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56010/0 (socket says 172.21.15.98:56010) 2023-08-22T00:18:52.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.588+0000 7f7c3affd700 1 -- 172.21.15.98:0/3808311264 learned_addr learned my addr 172.21.15.98:0/3808311264 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c3a7fc700 1 -- 172.21.15.98:0/3808311264 >> v1:172.21.15.118:6789/0 conn(0x7f7c3c066400 legacy=0x7f7c3c0bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c3a7fc700 1 -- 172.21.15.98:0/3808311264 >> v1:172.21.15.98:6789/0 conn(0x7f7c3c153cf0 legacy=0x7f7c3c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c3a7fc700 1 -- 172.21.15.98:0/3808311264 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0a6d50 con 0x7f7c3c1550e0 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c39ffb700 1 -- 172.21.15.98:0/3808311264 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235601697 0 0) 0x7f7c3c0bd750 con 0x7f7c3c153cf0 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c3a7fc700 1 --2- 172.21.15.98:0/3808311264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c1550e0 0x7f7c3c065f10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7c2c009790 tx=0x7f7c2c009060).ready entity=mon.0 client_cookie=c9bdad046060b03a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c39ffb700 1 -- 172.21.15.98:0/3808311264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00b520 con 0x7f7c3c1550e0 2023-08-22T00:18:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c39ffb700 1 -- 172.21.15.98:0/3808311264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00b680 con 0x7f7c3c1550e0 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c39ffb700 1 -- 172.21.15.98:0/3808311264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ba00 con 0x7f7c3c1550e0 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c415b2700 1 -- 172.21.15.98:0/3808311264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c1550e0 msgr2=0x7f7c3c065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.589+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3808311264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c1550e0 0x7f7c3c065f10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7c2c009790 tx=0x7f7c2c009060).stop 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.590+0000 7f7c415b2700 1 -- 172.21.15.98:0/3808311264 shutdown_connections 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.590+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3808311264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c1550e0 0x7f7c3c065f10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.590+0000 7f7c415b2700 1 -- 172.21.15.98:0/3808311264 >> 172.21.15.98:0/3808311264 conn(0x7f7c3c0c7770 msgr2=0x7f7c3c0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.590+0000 7f7c415b2700 1 -- 172.21.15.98:0/3808311264 shutdown_connections 2023-08-22T00:18:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.590+0000 7f7c415b2700 1 -- 172.21.15.98:0/3808311264 wait complete. 2023-08-22T00:18:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.591+0000 7f7c415b2700 1 Processor -- start 2023-08-22T00:18:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.591+0000 7f7c415b2700 1 -- start start 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 0x7f7c3c0c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c3c1550e0 0x7f7c3c0be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c0960 con 0x7f7c3c066400 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c0be0 con 0x7f7c3c153cf0 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c415b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c0ec0 con 0x7f7c3c1550e0 2023-08-22T00:18:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39466/0 (socket says 172.21.15.98:39466) 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c3affd700 1 -- 172.21.15.98:0/3406833300 learned_addr learned my addr 172.21.15.98:0/3406833300 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.592+0000 7f7c3a7fc700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 0x7f7c3c0c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 -- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c3c1550e0 msgr2=0x7f7c3c0be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3b7fe700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c3c1550e0 0x7f7c3c0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c3c1550e0 0x7f7c3c0be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 -- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 msgr2=0x7f7c3c0c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 0x7f7c3c0c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 -- 172.21.15.98:0/3406833300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0092a0 con 0x7f7c3c066400 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3a7fc700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 0x7f7c3c0c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c3affd700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f7c2400c4e0 tx=0x7f7c24007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240072e0 con 0x7f7c3c066400 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24007440 con 0x7f7c3c066400 2023-08-22T00:18:52.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0c11a0 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240057a0 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.593+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c0bed00 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.594+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c047480 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.594+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7c24005bd0 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.595+0000 7f7c32ffd700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 0x7f7c1c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.595+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7c24079730 con 0x7f7c3c066400 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.595+0000 7f7c3a7fc700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 0x7f7c1c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.595+0000 7f7c3a7fc700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 0x7f7c1c0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7c2c009760 tx=0x7f7c2c015000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.599+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c2404ac10 con 0x7f7c3c066400 2023-08-22T00:18:52.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.819+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c3c0bd100 con 0x7f7c3c066400 2023-08-22T00:18:52.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.820+0000 7f7c32ffd700 1 -- 172.21.15.98:0/3406833300 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7c2404e230 con 0x7f7c3c066400 2023-08-22T00:18:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:52.821 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:18:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:18:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:18:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:18:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:18:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:18:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:18:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:18:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:18:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:18:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:18:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:18:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:18:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:18:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:18:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:18:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:18:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:18:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:18:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:18:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:18:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:18:52.851 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:18:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 msgr2=0x7f7c1c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 0x7f7c1c0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7c2c009760 tx=0x7f7c2c015000).stop 2023-08-22T00:18:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 msgr2=0x7f7c3c164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f7c2400c4e0 tx=0x7f7c24007c70).stop 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 shutdown_connections 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7c1c05ef30 0x7f7c1c0613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c3c1550e0 0x7f7c3c0be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c3c066400 0x7f7c3c164fb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 --2- 172.21.15.98:0/3406833300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c3c153cf0 0x7f7c3c0c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 >> 172.21.15.98:0/3406833300 conn(0x7f7c3c0c7770 msgr2=0x7f7c3c0a6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.821+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 shutdown_connections 2023-08-22T00:18:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.822+0000 7f7c415b2700 1 -- 172.21.15.98:0/3406833300 wait complete. 2023-08-22T00:18:52.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:52.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.970+0000 7f0bedf27700 1 Processor -- start 2023-08-22T00:18:52.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.970+0000 7f0bedf27700 1 -- start start 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0bedf27700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0bedf27700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0bedf27700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be80c2220 con 0x7f0be8150040 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0bedf27700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be80c5bd0 con 0x7f0be8153f10 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0bedf27700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80c1ef0 con 0x7f0be80c26b0 2023-08-22T00:18:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:43080/0 (socket says 172.21.15.98:43080) 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:47524/0 (socket says 172.21.15.98:47524) 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be6ffd700 1 -- 172.21.15.98:0/468501745 learned_addr learned my addr 172.21.15.98:0/468501745 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be77fe700 1 --1- 172.21.15.98:0/468501745 >> v1:172.21.15.118:6789/0 conn(0x7f0be8150040 0x7f0be80c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:60962/0 (socket says 172.21.15.98:60962) 2023-08-22T00:18:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 -- 172.21.15.98:0/468501745 >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 msgr2=0x7f0be8150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:52.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 --2- 172.21.15.98:0/468501745 >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 -- 172.21.15.98:0/468501745 >> v1:172.21.15.118:6789/0 conn(0x7f0be8150040 legacy=0x7f0be80c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 -- 172.21.15.98:0/468501745 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be80c5e30 con 0x7f0be80c26b0 2023-08-22T00:18:52.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be67fc700 1 -- 172.21.15.98:0/468501745 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686585511 0 0) 0x7f0be80c2220 con 0x7f0be8150040 2023-08-22T00:18:52.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be6ffd700 1 --2- 172.21.15.98:0/468501745 >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.971+0000 7f0be7fff700 1 --2- 172.21.15.98:0/468501745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0be000d0d0 tx=0x7f0be000b990).ready entity=mon.2 client_cookie=6076013644bca6cc server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0be67fc700 1 -- 172.21.15.98:0/468501745 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0010070 con 0x7f0be80c26b0 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0be67fc700 1 -- 172.21.15.98:0/468501745 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be000b2e0 con 0x7f0be80c26b0 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0be67fc700 1 -- 172.21.15.98:0/468501745 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be000dd40 con 0x7f0be80c26b0 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 -- 172.21.15.98:0/468501745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 msgr2=0x7f0be80c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 --2- 172.21.15.98:0/468501745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0be000d0d0 tx=0x7f0be000b990).stop 2023-08-22T00:18:52.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 -- 172.21.15.98:0/468501745 shutdown_connections 2023-08-22T00:18:52.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 --2- 172.21.15.98:0/468501745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be80c26b0 0x7f0be80c2b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 --2- 172.21.15.98:0/468501745 >> v2:172.21.15.118:3300/0 conn(0x7f0be8153f10 0x7f0be8150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 -- 172.21.15.98:0/468501745 >> 172.21.15.98:0/468501745 conn(0x7f0be80c7140 msgr2=0x7f0be80c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:52.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 -- 172.21.15.98:0/468501745 shutdown_connections 2023-08-22T00:18:52.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.972+0000 7f0bedf27700 1 -- 172.21.15.98:0/468501745 wait complete. 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.973+0000 7f0bedf27700 1 Processor -- start 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 -- start start 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0be8150040 0x7f0be8150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be8153f10 0x7f0be8065520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81613f0 con 0x7f0be80c26b0 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8152eb0 con 0x7f0be8150040 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0bedf27700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8153190 con 0x7f0be8153f10 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0be77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0be77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39472/0 (socket says 172.21.15.98:39472) 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.974+0000 7f0be77fe700 1 -- 172.21.15.98:0/4182630800 learned_addr learned my addr 172.21.15.98:0/4182630800 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be7fff700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be8153f10 0x7f0be8065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be6ffd700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0be8150040 0x7f0be8150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 -- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be8153f10 msgr2=0x7f0be8065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be8153f10 0x7f0be8065520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 -- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0be8150040 msgr2=0x7f0be8150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0be8150040 0x7f0be8150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 -- 172.21.15.98:0/4182630800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc009370 con 0x7f0be80c26b0 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0be77fe700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f0bd800c560 tx=0x7f0bd8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80072e0 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8007440 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be000bc30 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8005930 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.975+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be8160d80 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.976+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8047480 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.976+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0bd8005d20 con 0x7f0be80c26b0 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.977+0000 7f0bcf7fe700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 0x7f0bd40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.977+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f0bd80794b0 con 0x7f0be80c26b0 2023-08-22T00:18:52.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.977+0000 7f0be6ffd700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 0x7f0bd40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:52.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.977+0000 7f0be6ffd700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 0x7f0bd40613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0be8150ad0 tx=0x7f0bdc0090f0).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:52.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:52.981+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0bd804a990 con 0x7f0be80c26b0 2023-08-22T00:18:53.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.145+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0be80c6110 con 0x7f0be80c26b0 2023-08-22T00:18:53.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.146+0000 7f0bcf7fe700 1 -- 172.21.15.98:0/4182630800 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+14044 (secure 0 0 0) 0x7f0bd804dfb0 con 0x7f0be80c26b0 2023-08-22T00:18:53.148 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:53.148 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":67,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:52.441703+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:53.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 msgr2=0x7f0bd40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 0x7f0bd40613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0be8150ad0 tx=0x7f0bdc0090f0).stop 2023-08-22T00:18:53.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 msgr2=0x7f0be814c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f0bd800c560 tx=0x7f0bd8007c90).stop 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 shutdown_connections 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0bd405ef30 0x7f0bd40613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0be8153f10 0x7f0be8065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0be80c26b0 0x7f0be814c6f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 --2- 172.21.15.98:0/4182630800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0be8150040 0x7f0be8150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 >> 172.21.15.98:0/4182630800 conn(0x7f0be80c7140 msgr2=0x7f0be80bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 shutdown_connections 2023-08-22T00:18:53.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.148+0000 7f0bedf27700 1 -- 172.21.15.98:0/4182630800 wait complete. 2023-08-22T00:18:53.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:18:53.162 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:18:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.278+0000 7f448b1cc700 1 Processor -- start 2023-08-22T00:18:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 -- start start 2023-08-22T00:18:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4484064320 0x7f44840c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44840bcf30 con 0x7f4484063ea0 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4484154550 con 0x7f4484064320 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.279+0000 7f448b1cc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484158b00 con 0x7f4484154170 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4484064320 0x7f44840c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4488f68700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4484064320 0x7f44840c1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:43104/0 (socket says 172.21.15.98:43104) 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4488f68700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:47538/0 (socket says 172.21.15.98:47538) 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 -- 172.21.15.98:0/3014295761 learned_addr learned my addr 172.21.15.98:0/3014295761 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4483fff700 1 --1- 172.21.15.98:0/3014295761 >> v1:172.21.15.118:6789/0 conn(0x7f4484063ea0 0x7f44840c15e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:60976/0 (socket says 172.21.15.98:60976) 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 -- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 msgr2=0x7f4484158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 -- 172.21.15.98:0/3014295761 >> v1:172.21.15.118:6789/0 conn(0x7f4484063ea0 legacy=0x7f44840c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 -- 172.21.15.98:0/3014295761 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840676b0 con 0x7f4484064320 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4488f68700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f44837fe700 1 -- 172.21.15.98:0/3014295761 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813011703 0 0) 0x7f44840bcf30 con 0x7f4484063ea0 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f4489769700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484064320 0x7f44840c1cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f447c009f20 tx=0x7f447c009840).ready entity=mon.1 client_cookie=349f23a5253e75f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.280+0000 7f44837fe700 1 -- 172.21.15.98:0/3014295761 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00e070 con 0x7f4484064320 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f44837fe700 1 -- 172.21.15.98:0/3014295761 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00b9d0 con 0x7f4484064320 2023-08-22T00:18:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f44837fe700 1 -- 172.21.15.98:0/3014295761 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00bd50 con 0x7f4484064320 2023-08-22T00:18:53.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 -- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484064320 msgr2=0x7f44840c1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484064320 0x7f44840c1cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f447c009f20 tx=0x7f447c009840).stop 2023-08-22T00:18:53.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 -- 172.21.15.98:0/3014295761 shutdown_connections 2023-08-22T00:18:53.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484064320 0x7f44840c1cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3014295761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484154170 0x7f4484158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 -- 172.21.15.98:0/3014295761 >> 172.21.15.98:0/3014295761 conn(0x7f4484069680 msgr2=0x7f4484069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 -- 172.21.15.98:0/3014295761 shutdown_connections 2023-08-22T00:18:53.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.281+0000 7f448b1cc700 1 -- 172.21.15.98:0/3014295761 wait complete. 2023-08-22T00:18:53.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.282+0000 7f448b1cc700 1 Processor -- start 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.282+0000 7f448b1cc700 1 -- start start 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484063ea0 0x7f44840a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484064320 0x7f4484143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484144210 con 0x7f4484154170 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840a8270 con 0x7f4484063ea0 2023-08-22T00:18:53.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f448b1cc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840a7cb0 con 0x7f4484064320 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39484/0 (socket says 172.21.15.98:39484) 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 -- 172.21.15.98:0/3158395860 learned_addr learned my addr 172.21.15.98:0/3158395860 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4483fff700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484064320 0x7f4484143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4488f68700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484063ea0 0x7f44840a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 -- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484064320 msgr2=0x7f4484143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484064320 0x7f4484143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 -- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484063ea0 msgr2=0x7f44840a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484063ea0 0x7f44840a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.283+0000 7f4489769700 1 -- 172.21.15.98:0/3158395860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780092a0 con 0x7f4484154170 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f4489769700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f447c003370 tx=0x7f447c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c009500 con 0x7f4484154170 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0092e0 con 0x7f4484154170 2023-08-22T00:18:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c009ae0 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c01d660 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.284+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44840a4a20 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.285+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484068600 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.285+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f447c01da50 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.285+0000 7f4480ff9700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 0x7f44680613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.285+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f447c07b7f0 con 0x7f4484154170 2023-08-22T00:18:53.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.285+0000 7f4488f68700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 0x7f44680613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.286+0000 7f4488f68700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 0x7f44680613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4478009dc0 tx=0x7f4478009060).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.289+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f447c04cd90 con 0x7f4484154170 2023-08-22T00:18:53.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.450+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4484046c20 con 0x7f4484154170 2023-08-22T00:18:53.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.451+0000 7f4480ff9700 1 -- 172.21.15.98:0/3158395860 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7f447c0503b0 con 0x7f4484154170 2023-08-22T00:18:53.453 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:18:53.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 msgr2=0x7f44680613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 0x7f44680613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4478009dc0 tx=0x7f4478009060).stop 2023-08-22T00:18:53.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 msgr2=0x7f44840c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f447c003370 tx=0x7f447c009840).stop 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 shutdown_connections 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4484154170 0x7f44840c5240 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484063ea0 0x7f44840a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446805ef30 0x7f44680613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 --2- 172.21.15.98:0/3158395860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4484064320 0x7f4484143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 >> 172.21.15.98:0/3158395860 conn(0x7f4484069680 msgr2=0x7f44840678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 shutdown_connections 2023-08-22T00:18:53.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.453+0000 7f448b1cc700 1 -- 172.21.15.98:0/3158395860 wait complete. 2023-08-22T00:18:53.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:18:53.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.584+0000 7faf0e678700 1 Processor -- start 2023-08-22T00:18:53.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 -- start start 2023-08-22T00:18:53.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faf080688b0 0x7faf08152190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faf08066cd0 0x7faf080be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080c33b0 con 0x7faf08152680 2023-08-22T00:18:53.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf08153160 con 0x7faf080688b0 2023-08-22T00:18:53.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.585+0000 7faf0e678700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf08152ba0 con 0x7faf08066cd0 2023-08-22T00:18:53.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faf080688b0 0x7faf08152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faf080688b0 0x7faf08152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39498/0 (socket says 172.21.15.98:39498) 2023-08-22T00:18:53.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 -- 172.21.15.98:0/3750637295 learned_addr learned my addr 172.21.15.98:0/3750637295 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf0cc15700 1 --1- 172.21.15.98:0/3750637295 >> v1:172.21.15.98:6789/0 conn(0x7faf08152680 0x7faf08155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56022/0 (socket says 172.21.15.98:56022) 2023-08-22T00:18:53.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf077fe700 1 --2- 172.21.15.98:0/3750637295 >> v2:172.21.15.118:3300/0 conn(0x7faf08066cd0 0x7faf080be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 -- 172.21.15.98:0/3750637295 >> v2:172.21.15.118:3300/0 conn(0x7faf08066cd0 msgr2=0x7faf080be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:53.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 --2- 172.21.15.98:0/3750637295 >> v2:172.21.15.118:3300/0 conn(0x7faf08066cd0 0x7faf080be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 -- 172.21.15.98:0/3750637295 >> v1:172.21.15.98:6789/0 conn(0x7faf08152680 legacy=0x7faf08155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 -- 172.21.15.98:0/3750637295 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08152e80 con 0x7faf080688b0 2023-08-22T00:18:53.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf07fff700 1 --2- 172.21.15.98:0/3750637295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf080688b0 0x7faf08152190 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7faf08069c60 tx=0x7faef00090f0).ready entity=mon.0 client_cookie=124ccdd71788d992 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf06ffd700 1 -- 172.21.15.98:0/3750637295 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000b600 con 0x7faf080688b0 2023-08-22T00:18:53.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf06ffd700 1 -- 172.21.15.98:0/3750637295 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000b760 con 0x7faf080688b0 2023-08-22T00:18:53.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.586+0000 7faf06ffd700 1 -- 172.21.15.98:0/3750637295 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000bb00 con 0x7faf080688b0 2023-08-22T00:18:53.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 -- 172.21.15.98:0/3750637295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf080688b0 msgr2=0x7faf08152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 --2- 172.21.15.98:0/3750637295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf080688b0 0x7faf08152190 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7faf08069c60 tx=0x7faef00090f0).stop 2023-08-22T00:18:53.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 -- 172.21.15.98:0/3750637295 shutdown_connections 2023-08-22T00:18:53.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 --2- 172.21.15.98:0/3750637295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf080688b0 0x7faf08152190 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 --2- 172.21.15.98:0/3750637295 >> v2:172.21.15.118:3300/0 conn(0x7faf08066cd0 0x7faf080be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 -- 172.21.15.98:0/3750637295 >> 172.21.15.98:0/3750637295 conn(0x7faf080c5e80 msgr2=0x7faf080661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 -- 172.21.15.98:0/3750637295 shutdown_connections 2023-08-22T00:18:53.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.587+0000 7faf0e678700 1 -- 172.21.15.98:0/3750637295 wait complete. 2023-08-22T00:18:53.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.588+0000 7faf0e678700 1 Processor -- start 2023-08-22T00:18:53.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.588+0000 7faf0e678700 1 -- start start 2023-08-22T00:18:53.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf08066cd0 0x7faf080ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf080688b0 0x7faf080ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080ac150 con 0x7faf08152680 2023-08-22T00:18:53.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08154b80 con 0x7faf08066cd0 2023-08-22T00:18:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf08154e20 con 0x7faf080688b0 2023-08-22T00:18:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39510/0 (socket says 172.21.15.98:39510) 2023-08-22T00:18:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 -- 172.21.15.98:0/1509169052 learned_addr learned my addr 172.21.15.98:0/1509169052 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf077fe700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf080688b0 0x7faf080ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf07fff700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf08066cd0 0x7faf080ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 -- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf080688b0 msgr2=0x7faf080ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf080688b0 0x7faf080ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 -- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf08066cd0 msgr2=0x7faf080ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf08066cd0 0x7faf080ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 -- 172.21.15.98:0/1509169052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009370 con 0x7faf08152680 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0cc15700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7faf0000c7c0 tx=0x7faf00001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00005c70 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00005dd0 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00007320 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf08155100 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.589+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf081556c0 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.590+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0806a2f0 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.591+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7faf00007710 con 0x7faf08152680 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.592+0000 7faefffff700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 0x7faee80613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.592+0000 7faf07fff700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 0x7faee80613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.592+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7faf0007a360 con 0x7faf08152680 2023-08-22T00:18:53.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.592+0000 7faf07fff700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 0x7faee80613c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7faef0009fd0 tx=0x7faef0017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.595+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf0004b880 con 0x7faf08152680 2023-08-22T00:18:53.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.757+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf080c3040 con 0x7faf08152680 2023-08-22T00:18:53.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.758+0000 7faefffff700 1 -- 172.21.15.98:0/1509169052 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf0004eea0 con 0x7faf08152680 2023-08-22T00:18:53.759 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:18:53.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 msgr2=0x7faee80613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 0x7faee80613c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7faef0009fd0 tx=0x7faef0017000).stop 2023-08-22T00:18:53.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 msgr2=0x7faf081443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7faf0000c7c0 tx=0x7faf00001510).stop 2023-08-22T00:18:53.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 shutdown_connections 2023-08-22T00:18:53.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf08152680 0x7faf081443a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf08066cd0 0x7faf080ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faee805ef00 0x7faee80613c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 --2- 172.21.15.98:0/1509169052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf080688b0 0x7faf080ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 >> 172.21.15.98:0/1509169052 conn(0x7faf080c5e80 msgr2=0x7faf08150740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 shutdown_connections 2023-08-22T00:18:53.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.760+0000 7faf0e678700 1 -- 172.21.15.98:0/1509169052 wait complete. 2023-08-22T00:18:53.773 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:18:53.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.887+0000 7f9958875700 1 Processor -- start 2023-08-22T00:18:53.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.887+0000 7f9958875700 1 -- start start 2023-08-22T00:18:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f995414e0d0 0x7f995414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 0x7f9954154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954155260 con 0x7f995414e0d0 2023-08-22T00:18:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99540bf9e0 con 0x7f99541544f0 2023-08-22T00:18:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.888+0000 7f9958875700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540bfcc0 con 0x7f99540c5a90 2023-08-22T00:18:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f995414e0d0 0x7f995414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f995414e0d0 0x7f995414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39526/0 (socket says 172.21.15.98:39526) 2023-08-22T00:18:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 -- 172.21.15.98:0/1514298175 learned_addr learned my addr 172.21.15.98:0/1514298175 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f9952d9d700 1 --2- 172.21.15.98:0/1514298175 >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 0x7f9954154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f9951d9b700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 -- 172.21.15.98:0/1514298175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 msgr2=0x7f99540c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 -- 172.21.15.98:0/1514298175 >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 msgr2=0x7f9954154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 --2- 172.21.15.98:0/1514298175 >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 0x7f9954154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 -- 172.21.15.98:0/1514298175 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540bffa0 con 0x7f995414e0d0 2023-08-22T00:18:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f9952d9d700 1 --2- 172.21.15.98:0/1514298175 >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 0x7f9954154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995259c700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f995414e0d0 0x7f995414e4b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f99540c6ba0 tx=0x7f99440090f0).ready entity=mon.0 client_cookie=39443921f6f5a7de server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995159a700 1 -- 172.21.15.98:0/1514298175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400b600 con 0x7f995414e0d0 2023-08-22T00:18:53.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995159a700 1 -- 172.21.15.98:0/1514298175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400b760 con 0x7f995414e0d0 2023-08-22T00:18:53.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.889+0000 7f995159a700 1 -- 172.21.15.98:0/1514298175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400bae0 con 0x7f995414e0d0 2023-08-22T00:18:53.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 -- 172.21.15.98:0/1514298175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f995414e0d0 msgr2=0x7f995414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f995414e0d0 0x7f995414e4b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f99540c6ba0 tx=0x7f99440090f0).stop 2023-08-22T00:18:53.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 -- 172.21.15.98:0/1514298175 shutdown_connections 2023-08-22T00:18:53.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 --2- 172.21.15.98:0/1514298175 >> v2:172.21.15.118:3300/0 conn(0x7f99541544f0 0x7f9954154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f995414e0d0 0x7f995414e4b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 --2- 172.21.15.98:0/1514298175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 -- 172.21.15.98:0/1514298175 >> 172.21.15.98:0/1514298175 conn(0x7f99540caa80 msgr2=0x7f99540cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:53.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 -- 172.21.15.98:0/1514298175 shutdown_connections 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.890+0000 7f9958875700 1 -- 172.21.15.98:0/1514298175 wait complete. 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.891+0000 7f9958875700 1 Processor -- start 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.891+0000 7f9958875700 1 -- start start 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f995414e0d0 0x7f99540aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540b0140 con 0x7f99541544f0 2023-08-22T00:18:53.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540af4c0 con 0x7f995414e0d0 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540af7a0 con 0x7f99540c5a90 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39540/0 (socket says 172.21.15.98:39540) 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 -- 172.21.15.98:0/2476928792 learned_addr learned my addr 172.21.15.98:0/2476928792 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f995259c700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9951d9b700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f995414e0d0 0x7f99540aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 -- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 msgr2=0x7f99540c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 -- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f995414e0d0 msgr2=0x7f99540aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f995414e0d0 0x7f99540aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 -- 172.21.15.98:0/2476928792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944009370 con 0x7f99541544f0 2023-08-22T00:18:53.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9952d9d700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f994c00a380 tx=0x7f994c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00ae10 con 0x7f99541544f0 2023-08-22T00:18:53.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00d650 con 0x7f99541544f0 2023-08-22T00:18:53.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540afa80 con 0x7f99541544f0 2023-08-22T00:18:53.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00d9d0 con 0x7f99541544f0 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.892+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99540c3da0 con 0x7f99541544f0 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.893+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540b0280 con 0x7f99541544f0 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.894+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f994c013070 con 0x7f99541544f0 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.894+0000 7f99427fc700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 0x7f99340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.894+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f994c07a550 con 0x7f99541544f0 2023-08-22T00:18:53.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.894+0000 7f995259c700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 0x7f99340613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:53.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.894+0000 7f995259c700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 0x7f99340613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9944009130 tx=0x7f9944017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:53.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:53.898+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f994c04ba30 con 0x7f99541544f0 2023-08-22T00:18:54.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.062+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9954047480 con 0x7f99541544f0 2023-08-22T00:18:54.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.063+0000 7f99427fc700 1 -- 172.21.15.98:0/2476928792 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+143 (secure 0 0 0) 0x7f994c01b090 con 0x7f99541544f0 2023-08-22T00:18:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:54.064 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:18:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:18:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:18:54.066 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 msgr2=0x7f99340613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 0x7f99340613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9944009130 tx=0x7f9944017000).stop 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 msgr2=0x7f99540aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f994c00a380 tx=0x7f994c007900).stop 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 shutdown_connections 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f993405ef30 0x7f99340613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99540c5a90 0x7f99540c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99541544f0 0x7f99540aeef0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 --2- 172.21.15.98:0/2476928792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f995414e0d0 0x7f99540aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 >> 172.21.15.98:0/2476928792 conn(0x7f99540caa80 msgr2=0x7f99540c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 shutdown_connections 2023-08-22T00:18:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.064+0000 7f9958875700 1 -- 172.21.15.98:0/2476928792 wait complete. 2023-08-22T00:18:54.077 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:18:54.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:18:54.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.197+0000 7fa88a675700 1 Processor -- start 2023-08-22T00:18:54.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.197+0000 7fa88a675700 1 -- start start 2023-08-22T00:18:54.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa88a675700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8840645b0 0x7fa884150940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa88a675700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa884150e30 0x7fa8840669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa88a675700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8841505b0 con 0x7fa8840c33e0 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa88a675700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840c37c0 con 0x7fa884150e30 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa88a675700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841516b0 con 0x7fa8840645b0 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa888c12700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa884150e30 0x7fa8840669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa883fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa8840c33e0 0x7fa884063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56028/0 (socket says 172.21.15.98:56028) 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa883fff700 1 -- 172.21.15.98:0/1402354521 learned_addr learned my addr 172.21.15.98:0/1402354521 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa8837fe700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8840645b0 0x7fa884150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa888c12700 1 -- 172.21.15.98:0/1402354521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8840645b0 msgr2=0x7fa884150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa888c12700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8840645b0 0x7fa884150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa882ffd700 1 -- 172.21.15.98:0/1402354521 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82652545 0 0) 0x7fa8841505b0 con 0x7fa8840c33e0 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa888c12700 1 -- 172.21.15.98:0/1402354521 >> v1:172.21.15.98:6789/0 conn(0x7fa8840c33e0 legacy=0x7fa884063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.198+0000 7fa888c12700 1 -- 172.21.15.98:0/1402354521 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884153dd0 con 0x7fa884150e30 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa888c12700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884150e30 0x7fa8840669d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fa87c009e60 tx=0x7fa87c009780).ready entity=mon.0 client_cookie=b2a13a01a34c4d5a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa882ffd700 1 -- 172.21.15.98:0/1402354521 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00e070 con 0x7fa884150e30 2023-08-22T00:18:54.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa882ffd700 1 -- 172.21.15.98:0/1402354521 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00bc30 con 0x7fa884150e30 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa882ffd700 1 -- 172.21.15.98:0/1402354521 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c012410 con 0x7fa884150e30 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 -- 172.21.15.98:0/1402354521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884150e30 msgr2=0x7fa8840669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884150e30 0x7fa8840669d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fa87c009e60 tx=0x7fa87c009780).stop 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 -- 172.21.15.98:0/1402354521 shutdown_connections 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884150e30 0x7fa8840669d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 --2- 172.21.15.98:0/1402354521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8840645b0 0x7fa884150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 -- 172.21.15.98:0/1402354521 >> 172.21.15.98:0/1402354521 conn(0x7fa8840c4470 msgr2=0x7fa8840695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 -- 172.21.15.98:0/1402354521 shutdown_connections 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.199+0000 7fa88a675700 1 -- 172.21.15.98:0/1402354521 wait complete. 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.200+0000 7fa88a675700 1 Processor -- start 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 -- start start 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8840c33e0 0x7fa88414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa884150e30 0x7fa8840a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840a8690 con 0x7fa8840645b0 2023-08-22T00:18:54.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840a8370 con 0x7fa8840c33e0 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa88a675700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840c1fd0 con 0x7fa884150e30 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa883fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa883fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39572/0 (socket says 172.21.15.98:39572) 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.201+0000 7fa883fff700 1 -- 172.21.15.98:0/2969173678 learned_addr learned my addr 172.21.15.98:0/2969173678 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa8837fe700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8840c33e0 0x7fa88414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa888c12700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa884150e30 0x7fa8840a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 -- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa884150e30 msgr2=0x7fa8840a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa884150e30 0x7fa8840a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 -- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8840c33e0 msgr2=0x7fa88414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8840c33e0 0x7fa88414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 -- 172.21.15.98:0/2969173678 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009a20 con 0x7fa8840645b0 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa883fff700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa87400c4e0 tx=0x7fa874007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740072e0 con 0x7fa8840645b0 2023-08-22T00:18:54.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874007440 con 0x7fa8840645b0 2023-08-22T00:18:54.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840c22b0 con 0x7fa8840645b0 2023-08-22T00:18:54.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740057a0 con 0x7fa8840645b0 2023-08-22T00:18:54.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.202+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88414fad0 con 0x7fa8840645b0 2023-08-22T00:18:54.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.203+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8840a8970 con 0x7fa8840645b0 2023-08-22T00:18:54.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.204+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa874005bd0 con 0x7fa8840645b0 2023-08-22T00:18:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.204+0000 7fa86bfff700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 0x7fa8700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.204+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fa874079dc0 con 0x7fa8840645b0 2023-08-22T00:18:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.204+0000 7fa8837fe700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 0x7fa8700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.205+0000 7fa8837fe700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 0x7fa8700613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa8840a5b60 tx=0x7fa878008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.208+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa87404b2e0 con 0x7fa8840645b0 2023-08-22T00:18:54.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.368+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fa8840a84e0 con 0x7fa8840645b0 2023-08-22T00:18:54.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.455+0000 7fa86bfff700 1 -- 172.21.15.98:0/2969173678 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa87404e900 con 0x7fa8840645b0 2023-08-22T00:18:54.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.458+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 msgr2=0x7fa8700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.458+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 0x7fa8700613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa8840a5b60 tx=0x7fa878008040).stop 2023-08-22T00:18:54.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.458+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 msgr2=0x7fa8840bdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.458+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa87400c4e0 tx=0x7fa874007c70).stop 2023-08-22T00:18:54.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 shutdown_connections 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa87005ef30 0x7fa8700613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa884150e30 0x7fa8840a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8840645b0 0x7fa8840bdfb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 --2- 172.21.15.98:0/2969173678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8840c33e0 0x7fa88414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.459+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 >> 172.21.15.98:0/2969173678 conn(0x7fa8840c4470 msgr2=0x7fa884069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.461+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 shutdown_connections 2023-08-22T00:18:54.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.461+0000 7fa88a675700 1 -- 172.21.15.98:0/2969173678 wait complete. 2023-08-22T00:18:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:18:54.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:18:54.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.599+0000 7f71e4b7f700 1 Processor -- start 2023-08-22T00:18:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.599+0000 7f71e4b7f700 1 -- start start 2023-08-22T00:18:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71e4b7f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71e0066150 0x7f71e0066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71e4b7f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71e00c5360 0x7f71e00c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71e4b7f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00c69b0 con 0x7f71e0157890 2023-08-22T00:18:54.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71e4b7f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e01542c0 con 0x7f71e00c5360 2023-08-22T00:18:54.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71e4b7f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e00c57f0 con 0x7f71e0066150 2023-08-22T00:18:54.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71ddd9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71e00c5360 0x7f71e00c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71ddd9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71e00c5360 0x7f71e00c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39584/0 (socket says 172.21.15.98:39584) 2023-08-22T00:18:54.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.600+0000 7f71ddd9b700 1 -- 172.21.15.98:0/1260963755 learned_addr learned my addr 172.21.15.98:0/1260963755 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:54.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71de59c700 1 --2- 172.21.15.98:0/1260963755 >> v2:172.21.15.118:3300/0 conn(0x7f71e0066150 0x7f71e0066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71ddd9b700 1 -- 172.21.15.98:0/1260963755 >> v2:172.21.15.118:3300/0 conn(0x7f71e0066150 msgr2=0x7f71e0066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71ddd9b700 1 --2- 172.21.15.98:0/1260963755 >> v2:172.21.15.118:3300/0 conn(0x7f71e0066150 0x7f71e0066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71ddd9b700 1 -- 172.21.15.98:0/1260963755 >> v1:172.21.15.118:6789/0 conn(0x7f71e0157890 legacy=0x7f71e00c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71ddd9b700 1 -- 172.21.15.98:0/1260963755 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00c5ad0 con 0x7f71e00c5360 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71ddd9b700 1 --2- 172.21.15.98:0/1260963755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e00c5360 0x7f71e00c6fb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f71e006b600 tx=0x7f71d00090f0).ready entity=mon.0 client_cookie=afe9bf74768cb6cf server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71dd59a700 1 -- 172.21.15.98:0/1260963755 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000b5a0 con 0x7f71e00c5360 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71dd59a700 1 -- 172.21.15.98:0/1260963755 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000b700 con 0x7f71e00c5360 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71dd59a700 1 -- 172.21.15.98:0/1260963755 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000ba80 con 0x7f71e00c5360 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.601+0000 7f71e4b7f700 1 -- 172.21.15.98:0/1260963755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e00c5360 msgr2=0x7f71e00c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/1260963755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e00c5360 0x7f71e00c6fb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f71e006b600 tx=0x7f71d00090f0).stop 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 -- 172.21.15.98:0/1260963755 shutdown_connections 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/1260963755 >> v2:172.21.15.118:3300/0 conn(0x7f71e0066150 0x7f71e0066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/1260963755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e00c5360 0x7f71e00c6fb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 -- 172.21.15.98:0/1260963755 >> 172.21.15.98:0/1260963755 conn(0x7f71e00c7800 msgr2=0x7f71e00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:54.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 -- 172.21.15.98:0/1260963755 shutdown_connections 2023-08-22T00:18:54.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.602+0000 7f71e4b7f700 1 -- 172.21.15.98:0/1260963755 wait complete. 2023-08-22T00:18:54.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 Processor -- start 2023-08-22T00:18:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 -- start start 2023-08-22T00:18:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0066150 0x7f71e00a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 0x7f71e014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00a4e60 con 0x7f71e01497c0 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00a42a0 con 0x7f71e0157890 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.603+0000 7f71e4b7f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00a4530 con 0x7f71e0066150 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39598/0 (socket says 172.21.15.98:39598) 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 -- 172.21.15.98:0/3799938092 learned_addr learned my addr 172.21.15.98:0/3799938092 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ddd9b700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 0x7f71e014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71de59c700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0066150 0x7f71e00a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 -- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0066150 msgr2=0x7f71e00a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0066150 0x7f71e00a52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 -- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 msgr2=0x7f71e014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 0x7f71e014ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:54.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 -- 172.21.15.98:0/3799938092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009370 con 0x7f71e01497c0 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ddd9b700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 0x7f71e014ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ded9d700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f71d800b810 tx=0x7f71d8009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800d600 con 0x7f71e01497c0 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d800d780 con 0x7f71e01497c0 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00a4810 con 0x7f71e01497c0 2023-08-22T00:18:54.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800db40 con 0x7f71e01497c0 2023-08-22T00:18:54.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.604+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e014f440 con 0x7f71e01497c0 2023-08-22T00:18:54.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.605+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0069220 con 0x7f71e01497c0 2023-08-22T00:18:54.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.606+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f71d8019460 con 0x7f71e01497c0 2023-08-22T00:18:54.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.606+0000 7f71ce7fc700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 0x7f71c00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:54.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.606+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f71d807a020 con 0x7f71e01497c0 2023-08-22T00:18:54.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.606+0000 7f71de59c700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 0x7f71c00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:54.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.606+0000 7f71de59c700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 0x7f71c00613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f71d4006fd0 tx=0x7f71d4008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:54.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.610+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71d804b330 con 0x7f71e01497c0 2023-08-22T00:18:54.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:54.771+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71e00a4fa0 con 0x7f71e01497c0 2023-08-22T00:18:55.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.459+0000 7f71ce7fc700 1 -- 172.21.15.98:0/3799938092 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71d804e950 con 0x7f71e01497c0 2023-08-22T00:18:55.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.471+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 msgr2=0x7f71c00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.471+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 0x7f71c00613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f71d4006fd0 tx=0x7f71d4008040).stop 2023-08-22T00:18:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.471+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 msgr2=0x7f71e0148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.471+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f71d800b810 tx=0x7f71d8009290).stop 2023-08-22T00:18:55.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 shutdown_connections 2023-08-22T00:18:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71c005ef30 0x7f71c00613f0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7f71d4006fd0 tx=0x7f71d4008040).stop 2023-08-22T00:18:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0066150 0x7f71e00a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71e01497c0 0x7f71e0148ff0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 --2- 172.21.15.98:0/3799938092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0157890 0x7f71e014ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.473+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 >> 172.21.15.98:0/3799938092 conn(0x7f71e00c7800 msgr2=0x7f71e0063f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.474+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 shutdown_connections 2023-08-22T00:18:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.474+0000 7f71e4b7f700 1 -- 172.21.15.98:0/3799938092 wait complete. 2023-08-22T00:18:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:18:55.498 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:18:55.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.617+0000 7f5caba44700 1 Processor -- start 2023-08-22T00:18:55.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 -- start start 2023-08-22T00:18:55.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157a80 0x7f5ca40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5ca4153e90 0x7f5ca4062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40c8d30 con 0x7f5ca4157e60 2023-08-22T00:18:55.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40c9010 con 0x7f5ca4153e90 2023-08-22T00:18:55.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.618+0000 7f5caba44700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c92f0 con 0x7f5ca4157a80 2023-08-22T00:18:55.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5ca4153e90 0x7f5ca4062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca8fdf700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5ca4157e60 0x7f5ca4153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56032/0 (socket says 172.21.15.98:56032) 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca8fdf700 1 -- 172.21.15.98:0/2133256495 learned_addr learned my addr 172.21.15.98:0/2133256495 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 -- 172.21.15.98:0/2133256495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157a80 msgr2=0x7f5ca40aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 --2- 172.21.15.98:0/2133256495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157a80 0x7f5ca40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 -- 172.21.15.98:0/2133256495 >> v1:172.21.15.98:6789/0 conn(0x7f5ca4157e60 legacy=0x7f5ca4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5c9bfff700 1 -- 172.21.15.98:0/2133256495 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823355523 0 0) 0x7f5ca40c8d30 con 0x7f5ca4157e60 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 -- 172.21.15.98:0/2133256495 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40c95d0 con 0x7f5ca4153e90 2023-08-22T00:18:55.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5ca9fe1700 1 --2- 172.21.15.98:0/2133256495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4153e90 0x7f5ca4062600 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f5c9c009e60 tx=0x7f5c9c009780).ready entity=mon.0 client_cookie=9ce39fb8d48a42f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5c9bfff700 1 -- 172.21.15.98:0/2133256495 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00e070 con 0x7f5ca4153e90 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5c9bfff700 1 -- 172.21.15.98:0/2133256495 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00bc30 con 0x7f5ca4153e90 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.619+0000 7f5c9bfff700 1 -- 172.21.15.98:0/2133256495 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c012410 con 0x7f5ca4153e90 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 -- 172.21.15.98:0/2133256495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4153e90 msgr2=0x7f5ca4062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 --2- 172.21.15.98:0/2133256495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4153e90 0x7f5ca4062600 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f5c9c009e60 tx=0x7f5c9c009780).stop 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 -- 172.21.15.98:0/2133256495 shutdown_connections 2023-08-22T00:18:55.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 --2- 172.21.15.98:0/2133256495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4153e90 0x7f5ca4062600 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 --2- 172.21.15.98:0/2133256495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157a80 0x7f5ca40aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 -- 172.21.15.98:0/2133256495 >> 172.21.15.98:0/2133256495 conn(0x7f5ca40cb5f0 msgr2=0x7f5ca40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 -- 172.21.15.98:0/2133256495 shutdown_connections 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.620+0000 7f5caba44700 1 -- 172.21.15.98:0/2133256495 wait complete. 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.621+0000 7f5caba44700 1 Processor -- start 2023-08-22T00:18:55.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.621+0000 7f5caba44700 1 -- start start 2023-08-22T00:18:55.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca4153e90 0x7f5ca4164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157e60 0x7f5ca4167240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4164c20 con 0x7f5ca4157a80 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4163c70 con 0x7f5ca4153e90 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.622+0000 7f5caba44700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4167d00 con 0x7f5ca4157e60 2023-08-22T00:18:55.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39630/0 (socket says 172.21.15.98:39630) 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 -- 172.21.15.98:0/1922089051 learned_addr learned my addr 172.21.15.98:0/1922089051 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca97e0700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca4153e90 0x7f5ca4164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca9fe1700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157e60 0x7f5ca4167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 -- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157e60 msgr2=0x7f5ca4167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157e60 0x7f5ca4167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 -- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca4153e90 msgr2=0x7f5ca4164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca4153e90 0x7f5ca4164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 -- 172.21.15.98:0/1922089051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009a20 con 0x7f5ca4157a80 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5ca8fdf700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f5c9400c490 tx=0x7f5c94007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940070d0 con 0x7f5ca4157a80 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94007230 con 0x7f5ca4157a80 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940075d0 con 0x7f5ca4157a80 2023-08-22T00:18:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca4167fe0 con 0x7f5ca4157a80 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.623+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4164210 con 0x7f5ca4157a80 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.624+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4083630 con 0x7f5ca4157a80 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.625+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5c94005bc0 con 0x7f5ca4157a80 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.625+0000 7f5c997fa700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 0x7f5c880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.625+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f5c94079ee0 con 0x7f5ca4157a80 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.625+0000 7f5ca97e0700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 0x7f5c880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.626+0000 7f5ca97e0700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 0x7f5c880613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5ca0006fd0 tx=0x7f5ca0009060).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.629+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c9404b190 con 0x7f5ca4157a80 2023-08-22T00:18:55.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.831+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5ca4046c20 con 0x7f5ca4157a80 2023-08-22T00:18:55.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.841+0000 7f5c997fa700 1 -- 172.21.15.98:0/1922089051 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c940520c0 con 0x7f5ca4157a80 2023-08-22T00:18:55.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.847+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 msgr2=0x7f5c880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.847+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 0x7f5c880613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5ca0006fd0 tx=0x7f5ca0009060).stop 2023-08-22T00:18:55.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.847+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 msgr2=0x7f5ca40c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.847+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f5c9400c490 tx=0x7f5c94007e60).stop 2023-08-22T00:18:55.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 shutdown_connections 2023-08-22T00:18:55.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c8805ef30 0x7f5c880613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca4157e60 0x7f5ca4167240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca4153e90 0x7f5ca4164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 --2- 172.21.15.98:0/1922089051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca4157a80 0x7f5ca40c37d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.850+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 >> 172.21.15.98:0/1922089051 conn(0x7f5ca40cb5f0 msgr2=0x7f5ca4062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:55.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.852+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 shutdown_connections 2023-08-22T00:18:55.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.853+0000 7f5caba44700 1 -- 172.21.15.98:0/1922089051 wait complete. 2023-08-22T00:18:55.869 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 8 and data pool 9 2023-08-22T00:18:55.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:55.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.993+0000 7f85590df700 1 Processor -- start 2023-08-22T00:18:55.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.993+0000 7f85590df700 1 -- start start 2023-08-22T00:18:55.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f85590df700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85540c64a0 0x7f8554154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f85590df700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540c4fb0 con 0x7f85540c2030 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f85590df700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540bcfc0 con 0x7f8554154260 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f85590df700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855414e7b0 con 0x7f85540c64a0 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f855259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85540c64a0 0x7f8554154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f855259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f85540c64a0 0x7f8554154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39632/0 (socket says 172.21.15.98:39632) 2023-08-22T00:18:55.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f855359e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f85540c2030 0x7f855415d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56044/0 (socket says 172.21.15.98:56044) 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.994+0000 7f855259c700 1 -- 172.21.15.98:0/2748068487 learned_addr learned my addr 172.21.15.98:0/2748068487 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f855259c700 1 -- 172.21.15.98:0/2748068487 >> v1:172.21.15.118:6789/0 conn(0x7f8554154260 legacy=0x7f8554154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f855259c700 1 -- 172.21.15.98:0/2748068487 >> v1:172.21.15.98:6789/0 conn(0x7f85540c2030 legacy=0x7f855415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f855259c700 1 -- 172.21.15.98:0/2748068487 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540bd2a0 con 0x7f85540c64a0 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f855259c700 1 --2- 172.21.15.98:0/2748068487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85540c64a0 0x7f8554154d50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8544006fd0 tx=0x7f85440090f0).ready entity=mon.0 client_cookie=a5b58fd7cf1991f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f8551d9b700 1 -- 172.21.15.98:0/2748068487 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400f510 con 0x7f85540c64a0 2023-08-22T00:18:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f8551d9b700 1 -- 172.21.15.98:0/2748068487 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400f670 con 0x7f85540c64a0 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f8551d9b700 1 -- 172.21.15.98:0/2748068487 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400f9f0 con 0x7f85540c64a0 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 -- 172.21.15.98:0/2748068487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85540c64a0 msgr2=0x7f8554154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 --2- 172.21.15.98:0/2748068487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85540c64a0 0x7f8554154d50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8544006fd0 tx=0x7f85440090f0).stop 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 -- 172.21.15.98:0/2748068487 shutdown_connections 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 --2- 172.21.15.98:0/2748068487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85540c64a0 0x7f8554154d50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 -- 172.21.15.98:0/2748068487 >> 172.21.15.98:0/2748068487 conn(0x7f85540c3980 msgr2=0x7f85540c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 -- 172.21.15.98:0/2748068487 shutdown_connections 2023-08-22T00:18:55.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.995+0000 7f85590df700 1 -- 172.21.15.98:0/2748068487 wait complete. 2023-08-22T00:18:56.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 Processor -- start 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 -- start start 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85540c2030 0x7f855414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 0x7f8554152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554152a30 con 0x7f8554154260 2023-08-22T00:18:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541686a0 con 0x7f85540c2030 2023-08-22T00:18:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f85590df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554151e20 con 0x7f85540c64a0 2023-08-22T00:18:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f855359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f855359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39634/0 (socket says 172.21.15.98:39634) 2023-08-22T00:18:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.997+0000 7f855359e700 1 -- 172.21.15.98:0/2720510697 learned_addr learned my addr 172.21.15.98:0/2720510697 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855259c700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 0x7f8554152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f8552d9d700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85540c2030 0x7f855414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 -- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 msgr2=0x7f8554152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 0x7f8554152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 -- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85540c2030 msgr2=0x7f855414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85540c2030 0x7f855414ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 -- 172.21.15.98:0/2720510697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009370 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855259c700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 0x7f8554152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f855359e700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f854c00c930 tx=0x7f854c0016f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c005c70 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c005dd0 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554152100 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c007320 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.998+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541526c0 con 0x7f8554154260 2023-08-22T00:18:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.999+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554152ba0 con 0x7f8554154260 2023-08-22T00:18:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:55.999+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f854c007710 con 0x7f8554154260 2023-08-22T00:18:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.000+0000 7f853affd700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 0x7f85400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.000+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f854c07a350 con 0x7f8554154260 2023-08-22T00:18:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.000+0000 7f8552d9d700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 0x7f85400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.000+0000 7f8552d9d700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 0x7f85400613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f85480015e0 tx=0x7f8548009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.004+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f854c04b480 con 0x7f8554154260 2023-08-22T00:18:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.166+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8554047480 con 0x7f8554154260 2023-08-22T00:18:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.167+0000 7f853affd700 1 -- 172.21.15.98:0/2720510697 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17273 (secure 0 0 0) 0x7f854c04eaa0 con 0x7f8554154260 2023-08-22T00:18:56.169 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:56.170 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":70,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:55.833331+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 msgr2=0x7f85400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 0x7f85400613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f85480015e0 tx=0x7f8548009040).stop 2023-08-22T00:18:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 msgr2=0x7f85541533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f854c00c930 tx=0x7f854c0016f0).stop 2023-08-22T00:18:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 shutdown_connections 2023-08-22T00:18:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8554154260 0x7f85541533b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85540c2030 0x7f855414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f854005ef30 0x7f85400613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 --2- 172.21.15.98:0/2720510697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85540c64a0 0x7f8554152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 >> 172.21.15.98:0/2720510697 conn(0x7f85540c3980 msgr2=0x7f85541563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 shutdown_connections 2023-08-22T00:18:56.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.169+0000 7f85590df700 1 -- 172.21.15.98:0/2720510697 wait complete. 2023-08-22T00:18:56.183 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:56.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.300+0000 7f956303f700 1 Processor -- start 2023-08-22T00:18:56.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.300+0000 7f956303f700 1 -- start start 2023-08-22T00:18:56.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f956303f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f955c1519e0 0x7f955c0bc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f956303f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955c0c4ec0 con 0x7f955c155ea0 2023-08-22T00:18:56.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f956303f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955c063a80 con 0x7f955c0bc500 2023-08-22T00:18:56.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f956303f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c063d60 con 0x7f955c1519e0 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f95615dc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f955c155ea0 0x7f955c062600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56052/0 (socket says 172.21.15.98:56052) 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f95615dc700 1 -- 172.21.15.98:0/1413716562 learned_addr learned my addr 172.21.15.98:0/1413716562 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f9560ddb700 1 --2- 172.21.15.98:0/1413716562 >> v2:172.21.15.118:3300/0 conn(0x7f955c1519e0 0x7f955c0bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f955b7fe700 1 -- 172.21.15.98:0/1413716562 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109588342 0 0) 0x7f955c0c4ec0 con 0x7f955c155ea0 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.301+0000 7f955b7fe700 1 -- 172.21.15.98:0/1413716562 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c0033f0 con 0x7f955c155ea0 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f9560ddb700 1 -- 172.21.15.98:0/1413716562 >> v1:172.21.15.118:6789/0 conn(0x7f955c0bc500 legacy=0x7f955c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f9560ddb700 1 -- 172.21.15.98:0/1413716562 >> v1:172.21.15.98:6789/0 conn(0x7f955c155ea0 legacy=0x7f955c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f9560ddb700 1 -- 172.21.15.98:0/1413716562 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0c4b50 con 0x7f955c1519e0 2023-08-22T00:18:56.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f9560ddb700 1 --2- 172.21.15.98:0/1413716562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c1519e0 0x7f955c0bc010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9550009760 tx=0x7f9550009060).ready entity=mon.1 client_cookie=6fd16767fa73d701 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f955b7fe700 1 -- 172.21.15.98:0/1413716562 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500090d0 con 0x7f955c1519e0 2023-08-22T00:18:56.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f955b7fe700 1 -- 172.21.15.98:0/1413716562 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955000f510 con 0x7f955c1519e0 2023-08-22T00:18:56.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f955b7fe700 1 -- 172.21.15.98:0/1413716562 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000f890 con 0x7f955c1519e0 2023-08-22T00:18:56.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f956303f700 1 -- 172.21.15.98:0/1413716562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c1519e0 msgr2=0x7f955c0bc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.302+0000 7f956303f700 1 --2- 172.21.15.98:0/1413716562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c1519e0 0x7f955c0bc010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9550009760 tx=0x7f9550009060).stop 2023-08-22T00:18:56.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.303+0000 7f956303f700 1 -- 172.21.15.98:0/1413716562 shutdown_connections 2023-08-22T00:18:56.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.303+0000 7f956303f700 1 --2- 172.21.15.98:0/1413716562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c1519e0 0x7f955c0bc010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.303+0000 7f956303f700 1 -- 172.21.15.98:0/1413716562 >> 172.21.15.98:0/1413716562 conn(0x7f955c0c7140 msgr2=0x7f955c0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:56.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.303+0000 7f956303f700 1 -- 172.21.15.98:0/1413716562 shutdown_connections 2023-08-22T00:18:56.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.303+0000 7f956303f700 1 -- 172.21.15.98:0/1413716562 wait complete. 2023-08-22T00:18:56.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.304+0000 7f956303f700 1 Processor -- start 2023-08-22T00:18:56.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.304+0000 7f956303f700 1 -- start start 2023-08-22T00:18:56.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 0x7f955c0c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c155ea0 0x7f955c0abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0a9600 con 0x7f955c1519e0 2023-08-22T00:18:56.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c165da0 con 0x7f955c0bc500 2023-08-22T00:18:56.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c166080 con 0x7f955c155ea0 2023-08-22T00:18:56.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39644/0 (socket says 172.21.15.98:39644) 2023-08-22T00:18:56.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 -- 172.21.15.98:0/3841489051 learned_addr learned my addr 172.21.15.98:0/3841489051 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:56.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f9560ddb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 0x7f955c0c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f95615dc700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c155ea0 0x7f955c0abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 -- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c155ea0 msgr2=0x7f955c0abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c155ea0 0x7f955c0abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 -- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 msgr2=0x7f955c0c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 0x7f955c0c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 -- 172.21.15.98:0/3841489051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500092a0 con 0x7f955c1519e0 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f9560ddb700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 0x7f955c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f955bfff700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f954800c440 tx=0x7f9548007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548012400 con 0x7f955c1519e0 2023-08-22T00:18:56.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548012560 con 0x7f955c1519e0 2023-08-22T00:18:56.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c166360 con 0x7f955c1519e0 2023-08-22T00:18:56.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548012900 con 0x7f955c1519e0 2023-08-22T00:18:56.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.305+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c165a80 con 0x7f955c1519e0 2023-08-22T00:18:56.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c047480 con 0x7f955c1519e0 2023-08-22T00:18:56.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f954801b3b0 con 0x7f955c1519e0 2023-08-22T00:18:56.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f9558ff9700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 0x7f95400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9548079450 con 0x7f955c1519e0 2023-08-22T00:18:56.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f9560ddb700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 0x7f95400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.307+0000 7f9560ddb700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 0x7f95400613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9550009760 tx=0x7f9550017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.311+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95480488f0 con 0x7f955c1519e0 2023-08-22T00:18:56.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.474+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955c0a6750 con 0x7f955c1519e0 2023-08-22T00:18:56.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.475+0000 7f9558ff9700 1 -- 172.21.15.98:0/3841489051 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17273 (secure 0 0 0) 0x7f9548017020 con 0x7f955c1519e0 2023-08-22T00:18:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:56.477 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":70,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:55.833331+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 msgr2=0x7f95400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 0x7f95400613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9550009760 tx=0x7f9550017000).stop 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 msgr2=0x7f955c165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f954800c440 tx=0x7f9548007dc0).stop 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 shutdown_connections 2023-08-22T00:18:56.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f954005ef30 0x7f95400613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c155ea0 0x7f955c0abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0bc500 0x7f955c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 --2- 172.21.15.98:0/3841489051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f955c1519e0 0x7f955c165590 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 >> 172.21.15.98:0/3841489051 conn(0x7f955c0c7140 msgr2=0x7f955c14d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:56.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 shutdown_connections 2023-08-22T00:18:56.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.477+0000 7f956303f700 1 -- 172.21.15.98:0/3841489051 wait complete. 2023-08-22T00:18:56.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:18:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.609+0000 7f13b525a700 1 Processor -- start 2023-08-22T00:18:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.609+0000 7f13b525a700 1 -- start start 2023-08-22T00:18:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13b525a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f13b00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13b525a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b0064280 con 0x7f13b01579e0 2023-08-22T00:18:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13b525a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b00c4c20 con 0x7f13b0063000 2023-08-22T00:18:56.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13b525a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0063490 con 0x7f13b00c5750 2023-08-22T00:18:56.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13ae59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f13b01579e0 0x7f13b00c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56056/0 (socket says 172.21.15.98:56056) 2023-08-22T00:18:56.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13ae59c700 1 -- 172.21.15.98:0/189903253 learned_addr learned my addr 172.21.15.98:0/189903253 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:56.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13aed9d700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f13b00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464437861 0 0) 0x7f13b0064280 con 0x7f13b01579e0 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13980033f0 con 0x7f13b01579e0 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148752723 0 0) 0x7f13b00c4c20 con 0x7f13b0063000 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b0064280 con 0x7f13b0063000 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883011490 0 0) 0x7f13980033f0 con 0x7f13b01579e0 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 msgr2=0x7f13b00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f13b00c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 >> v1:172.21.15.118:6789/0 conn(0x7f13b0063000 legacy=0x7f13b0154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0063670 con 0x7f13b01579e0 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f13a0001470 con 0x7f13b01579e0 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 >> v1:172.21.15.98:6789/0 conn(0x7f13b01579e0 legacy=0x7f13b00c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1398003aa0 0x7f1398003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.610+0000 7f13add9b700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f1398004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398004b80 0x7f1398005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0063490 con 0x7f1398003aa0 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139800b910 con 0x7f1398004b80 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139800bad0 con 0x7f13b00c5750 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1398003aa0 0x7f1398003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13ae59c700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f1398004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13af59e700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398004b80 0x7f1398005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 -- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 msgr2=0x7f1398004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00c5750 0x7f1398004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 -- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398004b80 msgr2=0x7f1398005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398004b80 0x7f1398005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 -- 172.21.15.98:0/189903253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980033f0 con 0x7f1398003aa0 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13aed9d700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1398003aa0 0x7f1398003ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f13a4009a60 tx=0x7f13a4009060).ready entity=mon.0 client_cookie=bcd065dc3860161b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4009ea0 con 0x7f1398003aa0 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4009430 con 0x7f1398003aa0 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13add9b700 1 -- 172.21.15.98:0/189903253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400e870 con 0x7f1398003aa0 2023-08-22T00:18:56.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13b525a700 1 -- 172.21.15.98:0/189903253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1398003aa0 msgr2=0x7f1398003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.611+0000 7f13b525a700 1 --2- 172.21.15.98:0/189903253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1398003aa0 0x7f1398003ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f13a4009a60 tx=0x7f13a4009060).stop 2023-08-22T00:18:56.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.612+0000 7f13af59e700 1 -- 172.21.15.98:0/189903253 reap_dead start 2023-08-22T00:18:56.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.612+0000 7f13b525a700 1 -- 172.21.15.98:0/189903253 shutdown_connections 2023-08-22T00:18:56.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.612+0000 7f13b525a700 1 -- 172.21.15.98:0/189903253 >> 172.21.15.98:0/189903253 conn(0x7f13b00c3a60 msgr2=0x7f13b00c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:56.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.612+0000 7f13b525a700 1 -- 172.21.15.98:0/189903253 shutdown_connections 2023-08-22T00:18:56.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.612+0000 7f13b525a700 1 -- 172.21.15.98:0/189903253 wait complete. 2023-08-22T00:18:56.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.613+0000 7f13b525a700 1 Processor -- start 2023-08-22T00:18:56.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.613+0000 7f13b525a700 1 -- start start 2023-08-22T00:18:56.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398003aa0 0x7f13b01459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00ab760 0x7f13b00abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00a9f70 con 0x7f13b00c0260 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00aaaf0 con 0x7f1398003aa0 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00ac0d0 con 0x7f13b00ab760 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39666/0 (socket says 172.21.15.98:39666) 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 -- 172.21.15.98:0/2438076805 learned_addr learned my addr 172.21.15.98:0/2438076805 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:56.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13ae59c700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00ab760 0x7f13b00abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13aed9d700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398003aa0 0x7f13b01459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 -- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00ab760 msgr2=0x7f13b00abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00ab760 0x7f13b00abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 -- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398003aa0 msgr2=0x7f13b01459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398003aa0 0x7f13b01459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 -- 172.21.15.98:0/2438076805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00aaf80 con 0x7f13b00c0260 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13af59e700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f13b0069350 tx=0x7f13a8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80019c0 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a8001b20 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8001ea0 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b00aa1c0 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.614+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00aa780 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.615+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00a9b30 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.616+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f13a80032e0 con 0x7f13b00c0260 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.616+0000 7f1396ffd700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 0x7f139c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:56.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.616+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f13a8079480 con 0x7f13b00c0260 2023-08-22T00:18:56.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.616+0000 7f13aed9d700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 0x7f139c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:56.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.616+0000 7f13aed9d700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 0x7f139c0613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13b0152550 tx=0x7f13a401a000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:56.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.620+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13a804a610 con 0x7f13b00c0260 2023-08-22T00:18:56.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:56.819+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f13b00aac30 con 0x7f13b00c0260 2023-08-22T00:18:57.267 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-08-22T00:18:57.266+0000 7fe4105a6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:18:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.473+0000 7f1396ffd700 1 -- 172.21.15.98:0/2438076805 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f13a801c020 con 0x7f13b00c0260 2023-08-22T00:18:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.475+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 msgr2=0x7f139c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.475+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 0x7f139c0613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13b0152550 tx=0x7f13a401a000).stop 2023-08-22T00:18:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.475+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 msgr2=0x7f13b00c06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.475+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f13b0069350 tx=0x7f13a8009040).stop 2023-08-22T00:18:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 shutdown_connections 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13b00c0260 0x7f13b00c06c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1398003aa0 0x7f13b01459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f139c05ef30 0x7f139c0613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 --2- 172.21.15.98:0/2438076805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00ab760 0x7f13b00abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 >> 172.21.15.98:0/2438076805 conn(0x7f13b00c3a60 msgr2=0x7f13b01511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 shutdown_connections 2023-08-22T00:18:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.476+0000 7f13b525a700 1 -- 172.21.15.98:0/2438076805 wait complete. 2023-08-22T00:18:57.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:18:57.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.619+0000 7f9fb54df700 1 Processor -- start 2023-08-22T00:18:57.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.619+0000 7f9fb54df700 1 -- start start 2023-08-22T00:18:57.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fb54df700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb0067d00 0x7f9fb0155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fb54df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb00641b0 0x7f9fb00c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fb54df700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb00654a0 con 0x7f9fb014e720 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fb54df700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb0064920 con 0x7f9fb0067d00 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fb54df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0064c00 con 0x7f9fb00641b0 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fae7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb0067d00 0x7f9fb0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fae7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb0067d00 0x7f9fb0155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39680/0 (socket says 172.21.15.98:39680) 2023-08-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9faeffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9fb014e720 0x7f9fb00675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56066/0 (socket says 172.21.15.98:56066) 2023-08-22T00:18:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.620+0000 7f9fae7fc700 1 -- 172.21.15.98:0/4153871996 learned_addr learned my addr 172.21.15.98:0/4153871996 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9faf7fe700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb00641b0 0x7f9fb00c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fae7fc700 1 -- 172.21.15.98:0/4153871996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb00641b0 msgr2=0x7f9fb00c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fae7fc700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb00641b0 0x7f9fb00c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fae7fc700 1 -- 172.21.15.98:0/4153871996 >> v1:172.21.15.98:6789/0 conn(0x7f9fb014e720 legacy=0x7f9fb00675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fae7fc700 1 -- 172.21.15.98:0/4153871996 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0064ee0 con 0x7f9fb0067d00 2023-08-22T00:18:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fadffb700 1 -- 172.21.15.98:0/4153871996 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407488853 0 0) 0x7f9fb00654a0 con 0x7f9fb014e720 2023-08-22T00:18:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fae7fc700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb0067d00 0x7f9fb0155290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f9fa0006fd0 tx=0x7f9fa00090f0).ready entity=mon.0 client_cookie=ffdfb1196e4d99d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fadffb700 1 -- 172.21.15.98:0/4153871996 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000b600 con 0x7f9fb0067d00 2023-08-22T00:18:57.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fadffb700 1 -- 172.21.15.98:0/4153871996 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000b760 con 0x7f9fb0067d00 2023-08-22T00:18:57.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fadffb700 1 -- 172.21.15.98:0/4153871996 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000bae0 con 0x7f9fb0067d00 2023-08-22T00:18:57.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 -- 172.21.15.98:0/4153871996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb0067d00 msgr2=0x7f9fb0155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb0067d00 0x7f9fb0155290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f9fa0006fd0 tx=0x7f9fa00090f0).stop 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 -- 172.21.15.98:0/4153871996 shutdown_connections 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb00641b0 0x7f9fb00c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 --2- 172.21.15.98:0/4153871996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb0067d00 0x7f9fb0155290 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 -- 172.21.15.98:0/4153871996 >> 172.21.15.98:0/4153871996 conn(0x7f9fb00c8950 msgr2=0x7f9fb00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 -- 172.21.15.98:0/4153871996 shutdown_connections 2023-08-22T00:18:57.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.621+0000 7f9fb54df700 1 -- 172.21.15.98:0/4153871996 wait complete. 2023-08-22T00:18:57.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.623+0000 7f9fb54df700 1 Processor -- start 2023-08-22T00:18:57.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.623+0000 7f9fb54df700 1 -- start start 2023-08-22T00:18:57.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb0067d00 0x7f9fb00be400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb014e720 0x7f9fb01671f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00c1300 con 0x7f9fb00641b0 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00c15e0 con 0x7f9fb014e720 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fb54df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00c18c0 con 0x7f9fb0067d00 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39696/0 (socket says 172.21.15.98:39696) 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 -- 172.21.15.98:0/3399138554 learned_addr learned my addr 172.21.15.98:0/3399138554 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9fae7fc700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb0067d00 0x7f9fb00be400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faf7fe700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb014e720 0x7f9fb01671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 -- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb0067d00 msgr2=0x7f9fb00be400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb0067d00 0x7f9fb00be400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 -- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb014e720 msgr2=0x7f9fb01671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb014e720 0x7f9fb01671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.624+0000 7f9faeffd700 1 -- 172.21.15.98:0/3399138554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0009370 con 0x7f9fb00641b0 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9faeffd700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f9f9800c560 tx=0x7f9f98007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980072e0 con 0x7f9fb00641b0 2023-08-22T00:18:57.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f98007440 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb00c1ba0 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980058f0 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.625+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb00c0fb0 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.626+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb00c1440 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.626+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9f98005ce0 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.626+0000 7f9fa6ffd700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 0x7f9f900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.627+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f98079960 con 0x7f9fb00641b0 2023-08-22T00:18:57.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.627+0000 7f9fae7fc700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 0x7f9f900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:57.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.627+0000 7f9fae7fc700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 0x7f9f900613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9fa0006fd0 tx=0x7f9fa0017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:57.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.631+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fb00c1440 con 0x7f9fb00641b0 2023-08-22T00:18:57.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:57.835+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9fb00c1440 con 0x7f9fb00641b0 2023-08-22T00:18:58.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.478+0000 7f9fa6ffd700 1 -- 172.21.15.98:0/3399138554 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9fb00c1440 con 0x7f9fb00641b0 2023-08-22T00:18:58.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 msgr2=0x7f9f900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 0x7f9f900613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9fa0006fd0 tx=0x7f9fa0017000).stop 2023-08-22T00:18:58.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 msgr2=0x7f9fb00abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f9f9800c560 tx=0x7f9f98007c90).stop 2023-08-22T00:18:58.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 shutdown_connections 2023-08-22T00:18:58.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb014e720 0x7f9fb01671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb00641b0 0x7f9fb00abf60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9005ef30 0x7f9f900613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 --2- 172.21.15.98:0/3399138554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb0067d00 0x7f9fb00be400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 >> 172.21.15.98:0/3399138554 conn(0x7f9fb00c8950 msgr2=0x7f9fb0066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:58.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 shutdown_connections 2023-08-22T00:18:58.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.480+0000 7f9fb54df700 1 -- 172.21.15.98:0/3399138554 wait complete. 2023-08-22T00:18:58.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:18:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.619+0000 7ff080ee3700 1 Processor -- start 2023-08-22T00:18:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.619+0000 7ff080ee3700 1 -- start start 2023-08-22T00:18:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff080ee3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff07c0a6e50 0x7ff07c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff080ee3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c158bf0 con 0x7ff07c151d60 2023-08-22T00:18:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff080ee3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c157d90 con 0x7ff07c066400 2023-08-22T00:18:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff080ee3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c066830 con 0x7ff07c0a6e50 2023-08-22T00:18:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff079d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff07c0a6e50 0x7ff07c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff07a59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff07c151d60 0x7ff07c155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56076/0 (socket says 172.21.15.98:56076) 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.620+0000 7ff07a59c700 1 -- 172.21.15.98:0/619607234 learned_addr learned my addr 172.21.15.98:0/619607234 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff079d9b700 1 -- 172.21.15.98:0/619607234 >> v1:172.21.15.118:6789/0 conn(0x7ff07c066400 legacy=0x7ff07c0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff079d9b700 1 -- 172.21.15.98:0/619607234 >> v1:172.21.15.98:6789/0 conn(0x7ff07c151d60 legacy=0x7ff07c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff079d9b700 1 -- 172.21.15.98:0/619607234 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c157fe0 con 0x7ff07c0a6e50 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff07959a700 1 -- 172.21.15.98:0/619607234 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169148350 0 0) 0x7ff07c158bf0 con 0x7ff07c151d60 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff079d9b700 1 --2- 172.21.15.98:0/619607234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c0a6e50 0x7ff07c065f10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff06c009760 tx=0x7ff06c009060).ready entity=mon.0 client_cookie=3f6ac2eef69d6a6f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff07959a700 1 -- 172.21.15.98:0/619607234 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00b520 con 0x7ff07c0a6e50 2023-08-22T00:18:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff07959a700 1 -- 172.21.15.98:0/619607234 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00b680 con 0x7ff07c0a6e50 2023-08-22T00:18:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff07959a700 1 -- 172.21.15.98:0/619607234 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00ba00 con 0x7ff07c0a6e50 2023-08-22T00:18:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff080ee3700 1 -- 172.21.15.98:0/619607234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c0a6e50 msgr2=0x7ff07c065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.621+0000 7ff080ee3700 1 --2- 172.21.15.98:0/619607234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c0a6e50 0x7ff07c065f10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff06c009760 tx=0x7ff06c009060).stop 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.622+0000 7ff080ee3700 1 -- 172.21.15.98:0/619607234 shutdown_connections 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.622+0000 7ff080ee3700 1 --2- 172.21.15.98:0/619607234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c0a6e50 0x7ff07c065f10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.622+0000 7ff080ee3700 1 -- 172.21.15.98:0/619607234 >> 172.21.15.98:0/619607234 conn(0x7ff07c06a980 msgr2=0x7ff07c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.622+0000 7ff080ee3700 1 -- 172.21.15.98:0/619607234 shutdown_connections 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.622+0000 7ff080ee3700 1 -- 172.21.15.98:0/619607234 wait complete. 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 Processor -- start 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 -- start start 2023-08-22T00:18:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff07c066400 0x7ff07c0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff07c0a6e50 0x7ff07c0a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c14b1d0 con 0x7ff07c151d60 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0a38d0 con 0x7ff07c066400 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.623+0000 7ff080ee3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c14b640 con 0x7ff07c0a6e50 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39724/0 (socket says 172.21.15.98:39724) 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 -- 172.21.15.98:0/2511981853 learned_addr learned my addr 172.21.15.98:0/2511981853 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff079d9b700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff07c0a6e50 0x7ff07c0a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07a59c700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff07c066400 0x7ff07c0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 -- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff07c0a6e50 msgr2=0x7ff07c0a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff07c0a6e50 0x7ff07c0a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 -- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff07c066400 msgr2=0x7ff07c0ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff07c066400 0x7ff07c0ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 -- 172.21.15.98:0/2511981853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0092a0 con 0x7ff07c151d60 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff07ad9d700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7ff07400b7e0 tx=0x7ff074009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400d620 con 0x7ff07c151d60 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400d7c0 con 0x7ff07c151d60 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c0a3e00 con 0x7ff07c151d60 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400db80 con 0x7ff07c151d60 2023-08-22T00:18:58.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.624+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0a43c0 con 0x7ff07c151d60 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.625+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c047480 con 0x7ff07c151d60 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.625+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff07400f480 con 0x7ff07c151d60 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.626+0000 7ff06a7fc700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 0x7ff05c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.626+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff07407a340 con 0x7ff07c151d60 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.626+0000 7ff07a59c700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 0x7ff05c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.626+0000 7ff07a59c700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 0x7ff05c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff07000c7d0 tx=0x7ff070009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.630+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff07404b470 con 0x7ff07c151d60 2023-08-22T00:18:58.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.830+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff07c1582c0 con 0x7ff07c151d60 2023-08-22T00:18:58.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.830+0000 7ff06a7fc700 1 -- 172.21.15.98:0/2511981853 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7ff07404ea90 con 0x7ff07c151d60 2023-08-22T00:18:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:58.832 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:18:58.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 msgr2=0x7ff05c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 0x7ff05c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff07000c7d0 tx=0x7ff070009040).stop 2023-08-22T00:18:58.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 msgr2=0x7ff07c0c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7ff07400b7e0 tx=0x7ff074009310).stop 2023-08-22T00:18:58.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 shutdown_connections 2023-08-22T00:18:58.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff07c151d60 0x7ff07c0c7200 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff07c066400 0x7ff07c0ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff05c05ef30 0x7ff05c0613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 --2- 172.21.15.98:0/2511981853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff07c0a6e50 0x7ff07c0a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 >> 172.21.15.98:0/2511981853 conn(0x7ff07c06a980 msgr2=0x7ff07c14c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:58.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 shutdown_connections 2023-08-22T00:18:58.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.832+0000 7ff080ee3700 1 -- 172.21.15.98:0/2511981853 wait complete. 2023-08-22T00:18:58.837 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:18:58.845 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:18:58.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.960+0000 7f9826bc2700 1 Processor -- start 2023-08-22T00:18:58.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 -- start start 2023-08-22T00:18:58.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9820155a80 0x7f9820155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98200bd860 0x7f98200bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 0x7f982014c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200be5d0 con 0x7f9820155a80 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200be8b0 con 0x7f982014bd20 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.961+0000 7f9826bc2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200beb90 con 0x7f98200bd860 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9820155a80 0x7f9820155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9820155a80 0x7f9820155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39736/0 (socket says 172.21.15.98:39736) 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 -- 172.21.15.98:0/3474162274 learned_addr learned my addr 172.21.15.98:0/3474162274 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:58.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982515f700 1 --2- 172.21.15.98:0/3474162274 >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 0x7f982014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f981ffff700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98200bd860 0x7f98200bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 -- 172.21.15.98:0/3474162274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98200bd860 msgr2=0x7f98200bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98200bd860 0x7f98200bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 -- 172.21.15.98:0/3474162274 >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 msgr2=0x7f982014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 --2- 172.21.15.98:0/3474162274 >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 0x7f982014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 -- 172.21.15.98:0/3474162274 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200bee70 con 0x7f9820155a80 2023-08-22T00:18:58.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982515f700 1 --2- 172.21.15.98:0/3474162274 >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 0x7f982014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f982495e700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f9820155e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f98200bf700 tx=0x7f98140090f0).ready entity=mon.0 client_cookie=abb6dbeb35679041 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f981f7fe700 1 -- 172.21.15.98:0/3474162274 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400b520 con 0x7f9820155a80 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f981f7fe700 1 -- 172.21.15.98:0/3474162274 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400b680 con 0x7f9820155a80 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.962+0000 7f981f7fe700 1 -- 172.21.15.98:0/3474162274 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400ba00 con 0x7f9820155a80 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 -- 172.21.15.98:0/3474162274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 msgr2=0x7f9820155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f9820155e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f98200bf700 tx=0x7f98140090f0).stop 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 -- 172.21.15.98:0/3474162274 shutdown_connections 2023-08-22T00:18:58.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 --2- 172.21.15.98:0/3474162274 >> v2:172.21.15.118:3300/0 conn(0x7f982014bd20 0x7f982014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f9820155e60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 --2- 172.21.15.98:0/3474162274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98200bd860 0x7f98200bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 -- 172.21.15.98:0/3474162274 >> 172.21.15.98:0/3474162274 conn(0x7f98200c5330 msgr2=0x7f98200c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:58.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 -- 172.21.15.98:0/3474162274 shutdown_connections 2023-08-22T00:18:58.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.963+0000 7f9826bc2700 1 -- 172.21.15.98:0/3474162274 wait complete. 2023-08-22T00:18:58.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.964+0000 7f9826bc2700 1 Processor -- start 2023-08-22T00:18:58.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.964+0000 7f9826bc2700 1 -- start start 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98200bd860 0x7f98200ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f982014bd20 0x7f98200ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820152740 con 0x7f9820155a80 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200ac220 con 0x7f98200bd860 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200c0fb0 con 0x7f982014bd20 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39740/0 (socket says 172.21.15.98:39740) 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 -- 172.21.15.98:0/2956505664 learned_addr learned my addr 172.21.15.98:0/2956505664 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982495e700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98200bd860 0x7f98200ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f981ffff700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f982014bd20 0x7f98200ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 -- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f982014bd20 msgr2=0x7f98200ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f982014bd20 0x7f98200ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 -- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98200bd860 msgr2=0x7f98200ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:58.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98200bd860 0x7f98200ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 -- 172.21.15.98:0/2956505664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814009370 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f982515f700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f981800d180 tx=0x7f9818009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800dcc0 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800f040 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818013600 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.965+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98200c1290 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.966+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98200c1850 con 0x7f9820155a80 2023-08-22T00:18:58.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.967+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9820047480 con 0x7f9820155a80 2023-08-22T00:18:58.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.967+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f98180139f0 con 0x7f9820155a80 2023-08-22T00:18:58.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.967+0000 7f981cff9700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 0x7f98040613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:58.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.967+0000 7f982495e700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 0x7f98040613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:58.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.967+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f981807a780 con 0x7f9820155a80 2023-08-22T00:18:58.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.968+0000 7f982495e700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 0x7f98040613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9814009130 tx=0x7f9814017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:58.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:58.971+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f981804b8b0 con 0x7f9820155a80 2023-08-22T00:18:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.132+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9820152880 con 0x7f9820155a80 2023-08-22T00:18:59.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.133+0000 7f981cff9700 1 -- 172.21.15.98:0/2956505664 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+17260 (secure 0 0 0) 0x7f981804eed0 con 0x7f9820155a80 2023-08-22T00:18:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:59.134 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":71,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:18:56.835621+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 msgr2=0x7f98040613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 0x7f98040613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9814009130 tx=0x7f9814017000).stop 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 msgr2=0x7f98200abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f981800d180 tx=0x7f9818009a50).stop 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 shutdown_connections 2023-08-22T00:18:59.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9820155a80 0x7f98200abd30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98200bd860 0x7f98200ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f980405ef30 0x7f98040613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 --2- 172.21.15.98:0/2956505664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f982014bd20 0x7f98200ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 >> 172.21.15.98:0/2956505664 conn(0x7f98200c5330 msgr2=0x7f98200aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 shutdown_connections 2023-08-22T00:18:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.135+0000 7f9826bc2700 1 -- 172.21.15.98:0/2956505664 wait complete. 2023-08-22T00:18:59.148 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:18:59.149 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:18:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.265+0000 7f5b18ad8700 1 Processor -- start 2023-08-22T00:18:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.265+0000 7f5b18ad8700 1 -- start start 2023-08-22T00:18:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b18ad8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b14150420 0x7f5b14062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b18ad8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b140c2220 con 0x7f5b14153f10 2023-08-22T00:18:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b18ad8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b140c5bd0 con 0x7f5b14150040 2023-08-22T00:18:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b18ad8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b140c1ef0 con 0x7f5b14150420 2023-08-22T00:18:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b12d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b14150420 0x7f5b14062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b11d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5b14153f10 0x7f5b140c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56088/0 (socket says 172.21.15.98:56088) 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.266+0000 7f5b11d9b700 1 -- 172.21.15.98:0/3871547098 learned_addr learned my addr 172.21.15.98:0/3871547098 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b12d9d700 1 -- 172.21.15.98:0/3871547098 >> v1:172.21.15.118:6789/0 conn(0x7f5b14150040 legacy=0x7f5b140c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b12d9d700 1 -- 172.21.15.98:0/3871547098 >> v1:172.21.15.98:6789/0 conn(0x7f5b14153f10 legacy=0x7f5b140c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b1159a700 1 -- 172.21.15.98:0/3871547098 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818818660 0 0) 0x7f5b140c2220 con 0x7f5b14153f10 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b12d9d700 1 -- 172.21.15.98:0/3871547098 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140c5e30 con 0x7f5b14150420 2023-08-22T00:18:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b12d9d700 1 --2- 172.21.15.98:0/3871547098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14150420 0x7f5b14062600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f5b0c00af70 tx=0x7f5b0c00a890).ready entity=mon.0 client_cookie=747ec9668db76ade server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b1159a700 1 -- 172.21.15.98:0/3871547098 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00f070 con 0x7f5b14150420 2023-08-22T00:18:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b1159a700 1 -- 172.21.15.98:0/3871547098 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00a2e0 con 0x7f5b14150420 2023-08-22T00:18:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b1159a700 1 -- 172.21.15.98:0/3871547098 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00cca0 con 0x7f5b14150420 2023-08-22T00:18:59.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b18ad8700 1 -- 172.21.15.98:0/3871547098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14150420 msgr2=0x7f5b14062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/3871547098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14150420 0x7f5b14062600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f5b0c00af70 tx=0x7f5b0c00a890).stop 2023-08-22T00:18:59.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b18ad8700 1 -- 172.21.15.98:0/3871547098 shutdown_connections 2023-08-22T00:18:59.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/3871547098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14150420 0x7f5b14062600 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.267+0000 7f5b18ad8700 1 -- 172.21.15.98:0/3871547098 >> 172.21.15.98:0/3871547098 conn(0x7f5b140c7140 msgr2=0x7f5b140c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.268+0000 7f5b18ad8700 1 -- 172.21.15.98:0/3871547098 shutdown_connections 2023-08-22T00:18:59.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.268+0000 7f5b18ad8700 1 -- 172.21.15.98:0/3871547098 wait complete. 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 Processor -- start 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 -- start start 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 0x7f5b140aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b14150420 0x7f5b14152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140ab240 con 0x7f5b14153f10 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14152660 con 0x7f5b14150040 2023-08-22T00:18:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b18ad8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141678b0 con 0x7f5b14150420 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b12d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b12d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39762/0 (socket says 172.21.15.98:39762) 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.269+0000 7f5b12d9d700 1 -- 172.21.15.98:0/141470516 learned_addr learned my addr 172.21.15.98:0/141470516 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b1259c700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 0x7f5b140aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b11d9b700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b14150420 0x7f5b14152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 -- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b14150420 msgr2=0x7f5b14152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b14150420 0x7f5b14152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 -- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 msgr2=0x7f5b140aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 0x7f5b140aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 -- 172.21.15.98:0/141470516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c00ab30 con 0x7f5b14153f10 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b1259c700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 0x7f5b140aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b12d9d700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5b0c00c770 tx=0x7f5b0c00a890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c014420 con 0x7f5b14153f10 2023-08-22T00:18:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c014580 con 0x7f5b14153f10 2023-08-22T00:18:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b14167b90 con 0x7f5b14153f10 2023-08-22T00:18:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c014920 con 0x7f5b14153f10 2023-08-22T00:18:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.270+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14168150 con 0x7f5b14153f10 2023-08-22T00:18:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.271+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14047480 con 0x7f5b14153f10 2023-08-22T00:18:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.271+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5b0c014cd0 con 0x7f5b14153f10 2023-08-22T00:18:59.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.272+0000 7f5b027fc700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 0x7f5af40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.272+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5b0c07bff0 con 0x7f5b14153f10 2023-08-22T00:18:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.272+0000 7f5b1259c700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 0x7f5af40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.272+0000 7f5b1259c700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 0x7f5af40613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5b04002780 tx=0x7f5b04009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.276+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b0c04d180 con 0x7f5b14153f10 2023-08-22T00:18:59.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.433+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b14047480 con 0x7f5af405ef30 2023-08-22T00:18:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.443+0000 7f5b027fc700 1 -- 172.21.15.98:0/141470516 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352881 (secure 0 0 0) 0x7f5b14047480 con 0x7f5af405ef30 2023-08-22T00:18:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 msgr2=0x7f5af40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 0x7f5af40613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5b04002780 tx=0x7f5b04009040).stop 2023-08-22T00:18:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 msgr2=0x7f5b14143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5b0c00c770 tx=0x7f5b0c00a890).stop 2023-08-22T00:18:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 shutdown_connections 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b14153f10 0x7f5b14143fe0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b14150040 0x7f5b140aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5af405ef30 0x7f5af40613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 --2- 172.21.15.98:0/141470516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b14150420 0x7f5b14152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 >> 172.21.15.98:0/141470516 conn(0x7f5b140c7140 msgr2=0x7f5b140c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 shutdown_connections 2023-08-22T00:18:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.447+0000 7f5b18ad8700 1 -- 172.21.15.98:0/141470516 wait complete. 2023-08-22T00:18:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:18:59.463 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:18:57.906123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415856,"kb_used_data":6320,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752558864,"statfs":{"total":773094113280,"available":770620276736,"internally_reserved":0,"allocated":6471680,"data_stored":3339136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13309452,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-732,"num_write_kb":-13903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.348229"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463434+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462351+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460765+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460485+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458478+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463650+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460229+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461063+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.465835+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461748+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.464291+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461007+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461935+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460043+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459720+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457782+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461403+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460656+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463044+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.464023+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459259+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459706+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460455+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459858+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462536+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460286+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462646+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459407+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462024+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457654+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459816+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462970+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457503+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460652+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460811+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460454+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457526+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461057+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458758+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462552+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460448+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463070+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459412+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459447+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462480+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462726+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457507+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462830+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459376+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459818+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448443+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:18:52.448443+0000","last_peered":"2023-08-22T00:18:52.448443+0000","last_clean":"2023-08-22T00:18:52.448443+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:18:52.448443+0000","last_undegraded":"2023-08-22T00:18:52.448443+0000","last_fullsized":"2023-08-22T00:18:52.448443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462083+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:18:53.109582+0000","last_peered":"2023-08-22T00:18:53.109582+0000","last_clean":"2023-08-22T00:18:53.109582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:18:53.109582+0000","last_undegraded":"2023-08-22T00:18:53.109582+0000","last_fullsized":"2023-08-22T00:18:53.109582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460637+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109119+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:18:53.109119+0000","last_peered":"2023-08-22T00:18:53.109119+0000","last_clean":"2023-08-22T00:18:53.109119+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:18:53.109119+0000","last_undegraded":"2023-08-22T00:18:53.109119+0000","last_fullsized":"2023-08-22T00:18:53.109119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458233+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109585+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:18:53.109585+0000","last_peered":"2023-08-22T00:18:53.109585+0000","last_clean":"2023-08-22T00:18:53.109585+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:18:53.109585+0000","last_undegraded":"2023-08-22T00:18:53.109585+0000","last_fullsized":"2023-08-22T00:18:53.109585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109594+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:18:53.109594+0000","last_peered":"2023-08-22T00:18:53.109594+0000","last_clean":"2023-08-22T00:18:53.109594+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:18:53.109594+0000","last_undegraded":"2023-08-22T00:18:53.109594+0000","last_fullsized":"2023-08-22T00:18:53.109594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463289+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109581+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:18:53.109581+0000","last_peered":"2023-08-22T00:18:53.109581+0000","last_clean":"2023-08-22T00:18:53.109581+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:18:53.109581+0000","last_undegraded":"2023-08-22T00:18:53.109581+0000","last_fullsized":"2023-08-22T00:18:53.109581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460659+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109596+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:18:53.109596+0000","last_peered":"2023-08-22T00:18:53.109596+0000","last_clean":"2023-08-22T00:18:53.109596+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:18:53.109596+0000","last_undegraded":"2023-08-22T00:18:53.109596+0000","last_fullsized":"2023-08-22T00:18:53.109596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459371+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448357+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:18:52.448357+0000","last_peered":"2023-08-22T00:18:52.448357+0000","last_clean":"2023-08-22T00:18:52.448357+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:18:52.448357+0000","last_undegraded":"2023-08-22T00:18:52.448357+0000","last_fullsized":"2023-08-22T00:18:52.448357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462148+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448300+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:18:52.448300+0000","last_peered":"2023-08-22T00:18:52.448300+0000","last_clean":"2023-08-22T00:18:52.448300+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:18:52.448300+0000","last_undegraded":"2023-08-22T00:18:52.448300+0000","last_fullsized":"2023-08-22T00:18:52.448300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.627},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.72599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.71099999999999997,"15min":0.751},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.74399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.95399999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.72699999999999998,"15min":0.78300000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.84099999999999997},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.83899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.98199999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.30399999999999999},"max":{"1min":0.67500000000000004,"5min":0.77700000000000002,"15min":1.1339999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.34200000000000003},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.34699999999999998},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":1.0109999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":1.073},"last":0.498}]},{"osd":4,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.76800000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32200000000000001},"max":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.94399999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":1.03},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.99299999999999999},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.374},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.184},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.255}]},{"osd":2,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23499999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.696},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.442,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.246},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.311}]},{"osd":4,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.27000000000000002},"max":{"1min":0.86399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.40500000000000003,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.441,"15min":0.318},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2150000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.61099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65900000000000003,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.34499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38800000000000001,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.623,"15min":0.64900000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.221},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.621,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.749,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.92500000000000004,"15min":1.0149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.873,"15min":0.89200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.42099999999999999,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.247},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64800000000000002},"last":0.312},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.66900000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.251},"max":{"1min":0.622,"5min":0.622,"15min":0.71199999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42499999999999999,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.64800000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.91500000000000004,"15min":1.0580000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.88700000000000001,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.434,"5min":0.434,"15min":0.379},"max":{"1min":0.88600000000000001,"5min":0.998,"15min":0.998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40600000000000003},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.42399999999999999},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.98599999999999999},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"last":0.318},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.20799999999999999},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40899999999999997,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.185},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.308,"15min":0.24199999999999999},"max":{"1min":0.59699999999999998,"5min":0.60099999999999998,"15min":0.63600000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45500000000000002,"15min":0.433},"min":{"1min":0.314,"5min":0.314,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.63700000000000001,"15min":0.66600000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46600000000000003,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.69199999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.33800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":0.90900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.76300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95999999999999996,"15min":11.163},"last":0.437}]},{"osd":7,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.32000000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.77300000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.76400000000000001,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.72699999999999998},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.85899999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.85199999999999998},"last":0.34300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.94599999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":0.873},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.313},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":0.748,"15min":0.84599999999999997},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":0.77200000000000002,"15min":0.92000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.95999999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.92800000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.88},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.71399999999999997},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.74299999999999999,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.77900000000000003},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:18:59.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:18:59.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 Processor -- start 2023-08-22T00:18:59.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 -- start start 2023-08-22T00:18:59.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb994155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9940a6e50 0x7fb994065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb994158bf0 con 0x7fb994066400 2023-08-22T00:18:59.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb994157d90 con 0x7fb9940a6e50 2023-08-22T00:18:59.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.618+0000 7fb99b1fb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb994066830 con 0x7fb994151d60 2023-08-22T00:18:59.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb999798700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb994066400 0x7fb9940bc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:56096/0 (socket says 172.21.15.98:56096) 2023-08-22T00:18:59.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb999798700 1 -- 172.21.15.98:0/2388105137 learned_addr learned my addr 172.21.15.98:0/2388105137 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:59.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189786153 0 0) 0x7fb994158bf0 con 0x7fb994066400 2023-08-22T00:18:59.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9840033f0 con 0x7fb994066400 2023-08-22T00:18:59.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb993fff700 1 --2- 172.21.15.98:0/2388105137 >> v2:172.21.15.118:3300/0 conn(0x7fb9940a6e50 0x7fb994065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb998f97700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb994155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918731391 0 0) 0x7fb9840033f0 con 0x7fb994066400 2023-08-22T00:18:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 msgr2=0x7fb994155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb994155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 >> v2:172.21.15.118:3300/0 conn(0x7fb9940a6e50 msgr2=0x7fb994065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 --2- 172.21.15.98:0/2388105137 >> v2:172.21.15.118:3300/0 conn(0x7fb9940a6e50 0x7fb994065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994157fe0 con 0x7fb994066400 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb98c0017f0 con 0x7fb994066400 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 >> v1:172.21.15.98:6789/0 conn(0x7fb994066400 legacy=0x7fb9940bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9840038e0 0x7fb984003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb984004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb984004b80 0x7fb984005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994157d90 con 0x7fb9840038e0 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994066830 con 0x7fb984004b80 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98400b8e0 con 0x7fb994151d60 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.619+0000 7fb998f97700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9840038e0 0x7fb984003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb993fff700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb984004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb999798700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb984004b80 0x7fb984005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 -- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 msgr2=0x7fb984004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb994151d60 0x7fb984004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 -- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb984004b80 msgr2=0x7fb984005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb984004b80 0x7fb984005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 -- 172.21.15.98:0/2388105137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840033f0 con 0x7fb9840038e0 2023-08-22T00:18:59.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb998f97700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9840038e0 0x7fb984003d00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fb988009a60 tx=0x7fb988009060).ready entity=mon.0 client_cookie=5890e24abdaf2c20 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988009ea0 con 0x7fb9840038e0 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988009430 con 0x7fb9840038e0 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb9937fe700 1 -- 172.21.15.98:0/2388105137 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800e870 con 0x7fb9840038e0 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2388105137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9840038e0 msgr2=0x7fb984003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2388105137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9840038e0 0x7fb984003d00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fb988009a60 tx=0x7fb988009060).stop 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb999798700 1 -- 172.21.15.98:0/2388105137 reap_dead start 2023-08-22T00:18:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2388105137 shutdown_connections 2023-08-22T00:18:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2388105137 >> 172.21.15.98:0/2388105137 conn(0x7fb99406a980 msgr2=0x7fb9940c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2388105137 shutdown_connections 2023-08-22T00:18:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.620+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2388105137 wait complete. 2023-08-22T00:18:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.622+0000 7fb99b1fb700 1 Processor -- start 2023-08-22T00:18:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.622+0000 7fb99b1fb700 1 -- start start 2023-08-22T00:18:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9840038e0 0x7fb9940aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb99413c4f0 0x7fb9940a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99413c970 con 0x7fb9940c75b0 2023-08-22T00:18:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940c7f20 con 0x7fb9840038e0 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb99b1fb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940a4110 con 0x7fb99413c4f0 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb998f97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9840038e0 0x7fb9940aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39782/0 (socket says 172.21.15.98:39782) 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 -- 172.21.15.98:0/2602069440 learned_addr learned my addr 172.21.15.98:0/2602069440 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb993fff700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb99413c4f0 0x7fb9940a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 -- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb99413c4f0 msgr2=0x7fb9940a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb99413c4f0 0x7fb9940a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 -- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9840038e0 msgr2=0x7fb9940aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9840038e0 0x7fb9940aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.623+0000 7fb999798700 1 -- 172.21.15.98:0/2602069440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940aadd0 con 0x7fb9940c75b0 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb999798700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb9940c52a0 tx=0x7fb98c0014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c007e40 con 0x7fb9940c75b0 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0079e0 con 0x7fb9940c75b0 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9940ab0b0 con 0x7fb9940c75b0 2023-08-22T00:18:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00ea80 con 0x7fb9940c75b0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.624+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9940ab670 con 0x7fb9940c75b0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.625+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb98c014430 con 0x7fb9940c75b0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.625+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb994047480 con 0x7fb9940c75b0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.625+0000 7fb990ff9700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 0x7fb9780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.625+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb98c07a120 con 0x7fb9940c75b0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.625+0000 7fb998f97700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 0x7fb9780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.626+0000 7fb998f97700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 0x7fb9780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb988006d50 tx=0x7fb98801a000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.630+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb98c04b250 con 0x7fb9940c75b0 2023-08-22T00:18:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.787+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9941582c0 con 0x7fb97805ef30 2023-08-22T00:18:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.796+0000 7fb990ff9700 1 -- 172.21.15.98:0/2602069440 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352881 (secure 0 0 0) 0x7fb9941582c0 con 0x7fb97805ef30 2023-08-22T00:18:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:18:59.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 msgr2=0x7fb9780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 0x7fb9780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb988006d50 tx=0x7fb98801a000).stop 2023-08-22T00:18:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 msgr2=0x7fb9940c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb9940c52a0 tx=0x7fb98c0014e0).stop 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 shutdown_connections 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9940c75b0 0x7fb9940c7a30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9840038e0 0x7fb9940aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb97805ef30 0x7fb9780613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 --2- 172.21.15.98:0/2602069440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb99413c4f0 0x7fb9940a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.799+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 >> 172.21.15.98:0/2602069440 conn(0x7fb99406a980 msgr2=0x7fb99414b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.800+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 shutdown_connections 2023-08-22T00:18:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.800+0000 7fb99b1fb700 1 -- 172.21.15.98:0/2602069440 wait complete. 2023-08-22T00:18:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:18:59.814 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:18:57.906123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415856,"kb_used_data":6320,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752558864,"statfs":{"total":773094113280,"available":770620276736,"internally_reserved":0,"allocated":6471680,"data_stored":3339136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13309452,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-732,"num_write_kb":-13903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.348229"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463434+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462351+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460765+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460485+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458478+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463650+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460229+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461063+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.465835+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461748+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.464291+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461007+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461935+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460043+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459720+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457782+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461403+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460656+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463044+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.464023+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459259+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459706+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460455+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459858+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462536+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460286+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462646+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459407+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462024+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457654+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459816+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462970+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457503+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460652+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460811+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460454+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457526+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461057+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458758+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462552+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460448+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463070+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459412+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459447+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462480+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462726+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457507+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462830+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459376+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459818+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448443+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:18:52.448443+0000","last_peered":"2023-08-22T00:18:52.448443+0000","last_clean":"2023-08-22T00:18:52.448443+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:18:52.448443+0000","last_undegraded":"2023-08-22T00:18:52.448443+0000","last_fullsized":"2023-08-22T00:18:52.448443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462083+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:18:53.109582+0000","last_peered":"2023-08-22T00:18:53.109582+0000","last_clean":"2023-08-22T00:18:53.109582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:18:53.109582+0000","last_undegraded":"2023-08-22T00:18:53.109582+0000","last_fullsized":"2023-08-22T00:18:53.109582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460637+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109119+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:18:53.109119+0000","last_peered":"2023-08-22T00:18:53.109119+0000","last_clean":"2023-08-22T00:18:53.109119+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:18:53.109119+0000","last_undegraded":"2023-08-22T00:18:53.109119+0000","last_fullsized":"2023-08-22T00:18:53.109119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458233+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109585+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:18:53.109585+0000","last_peered":"2023-08-22T00:18:53.109585+0000","last_clean":"2023-08-22T00:18:53.109585+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:18:53.109585+0000","last_undegraded":"2023-08-22T00:18:53.109585+0000","last_fullsized":"2023-08-22T00:18:53.109585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109594+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:18:53.109594+0000","last_peered":"2023-08-22T00:18:53.109594+0000","last_clean":"2023-08-22T00:18:53.109594+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:18:53.109594+0000","last_undegraded":"2023-08-22T00:18:53.109594+0000","last_fullsized":"2023-08-22T00:18:53.109594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463289+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109581+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:18:53.109581+0000","last_peered":"2023-08-22T00:18:53.109581+0000","last_clean":"2023-08-22T00:18:53.109581+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:18:53.109581+0000","last_undegraded":"2023-08-22T00:18:53.109581+0000","last_fullsized":"2023-08-22T00:18:53.109581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460659+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109596+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:18:53.109596+0000","last_peered":"2023-08-22T00:18:53.109596+0000","last_clean":"2023-08-22T00:18:53.109596+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:18:53.109596+0000","last_undegraded":"2023-08-22T00:18:53.109596+0000","last_fullsized":"2023-08-22T00:18:53.109596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459371+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448357+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:18:52.448357+0000","last_peered":"2023-08-22T00:18:52.448357+0000","last_clean":"2023-08-22T00:18:52.448357+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:18:52.448357+0000","last_undegraded":"2023-08-22T00:18:52.448357+0000","last_fullsized":"2023-08-22T00:18:52.448357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462148+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448300+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:18:52.448300+0000","last_peered":"2023-08-22T00:18:52.448300+0000","last_clean":"2023-08-22T00:18:52.448300+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:18:52.448300+0000","last_undegraded":"2023-08-22T00:18:52.448300+0000","last_fullsized":"2023-08-22T00:18:52.448300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.627},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.72599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.71099999999999997,"15min":0.751},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.74399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.95399999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.72699999999999998,"15min":0.78300000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.84099999999999997},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.83899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.98199999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.30399999999999999},"max":{"1min":0.67500000000000004,"5min":0.77700000000000002,"15min":1.1339999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.34200000000000003},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.34699999999999998},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":1.0109999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":1.073},"last":0.498}]},{"osd":4,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.76800000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32200000000000001},"max":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.94399999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":1.03},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.99299999999999999},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.374},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.184},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.255}]},{"osd":2,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23499999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.696},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.442,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.246},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.311}]},{"osd":4,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.27000000000000002},"max":{"1min":0.86399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.40500000000000003,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.441,"15min":0.318},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2150000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.61099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65900000000000003,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.34499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38800000000000001,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.623,"15min":0.64900000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.221},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.621,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.749,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.92500000000000004,"15min":1.0149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.873,"15min":0.89200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.42099999999999999,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.247},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64800000000000002},"last":0.312},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.66900000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.251},"max":{"1min":0.622,"5min":0.622,"15min":0.71199999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42499999999999999,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.64800000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.91500000000000004,"15min":1.0580000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.88700000000000001,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.434,"5min":0.434,"15min":0.379},"max":{"1min":0.88600000000000001,"5min":0.998,"15min":0.998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40600000000000003},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.42399999999999999},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.98599999999999999},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"last":0.318},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.20799999999999999},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40899999999999997,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.185},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.308,"15min":0.24199999999999999},"max":{"1min":0.59699999999999998,"5min":0.60099999999999998,"15min":0.63600000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45500000000000002,"15min":0.433},"min":{"1min":0.314,"5min":0.314,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.63700000000000001,"15min":0.66600000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46600000000000003,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.69199999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.33800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":0.90900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.76300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95999999999999996,"15min":11.163},"last":0.437}]},{"osd":7,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.32000000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.77300000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.76400000000000001,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.72699999999999998},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.85899999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.85199999999999998},"last":0.34300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.94599999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":0.873},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.313},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":0.748,"15min":0.84599999999999997},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":0.77200000000000002,"15min":0.92000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.95999999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.92800000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.88},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.71399999999999997},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.74299999999999999,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.77900000000000003},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:18:59.825 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:18:59.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.970+0000 7f05a81e3700 1 Processor -- start 2023-08-22T00:18:59.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.970+0000 7f05a81e3700 1 -- start start 2023-08-22T00:18:59.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a81e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 0x7f05a01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a81e3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05a0065f10 0x7f05a0066370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a81e3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a00bd750 con 0x7f05a00bdbe0 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a81e3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00a7030 con 0x7f05a0065f10 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a81e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00c2010 con 0x7f05a0153cf0 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a5f7f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 0x7f05a01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a577e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05a0065f10 0x7f05a0066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a6780700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f05a00bdbe0 0x7f05a00c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:32794/0 (socket says 172.21.15.98:32794) 2023-08-22T00:18:59.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.971+0000 7f05a6780700 1 -- 172.21.15.98:0/3859150028 learned_addr learned my addr 172.21.15.98:0/3859150028 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a577e700 1 -- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 msgr2=0x7f05a01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a577e700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 0x7f05a01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a577e700 1 -- 172.21.15.98:0/3859150028 >> v1:172.21.15.118:6789/0 conn(0x7f05a00bdbe0 legacy=0x7f05a00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a4f7d700 1 -- 172.21.15.98:0/3859150028 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547938236 0 0) 0x7f05a00bd750 con 0x7f05a00bdbe0 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a577e700 1 -- 172.21.15.98:0/3859150028 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00a6d50 con 0x7f05a0065f10 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a5f7f700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 0x7f05a01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a577e700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a0065f10 0x7f05a0066370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f059c009760 tx=0x7f059c009060).ready entity=mon.1 client_cookie=b99bd4b164e51b63 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a4f7d700 1 -- 172.21.15.98:0/3859150028 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f510 con 0x7f05a0065f10 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a4f7d700 1 -- 172.21.15.98:0/3859150028 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c00f670 con 0x7f05a0065f10 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.972+0000 7f05a4f7d700 1 -- 172.21.15.98:0/3859150028 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f9f0 con 0x7f05a0065f10 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 -- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a0065f10 msgr2=0x7f05a0066370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a0065f10 0x7f05a0066370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f059c009760 tx=0x7f059c009060).stop 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 -- 172.21.15.98:0/3859150028 shutdown_connections 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0153cf0 0x7f05a01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 --2- 172.21.15.98:0/3859150028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a0065f10 0x7f05a0066370 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 -- 172.21.15.98:0/3859150028 >> 172.21.15.98:0/3859150028 conn(0x7f05a00c7770 msgr2=0x7f05a00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:18:59.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 -- 172.21.15.98:0/3859150028 shutdown_connections 2023-08-22T00:18:59.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.973+0000 7f05a81e3700 1 -- 172.21.15.98:0/3859150028 wait complete. 2023-08-22T00:18:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.974+0000 7f05a81e3700 1 Processor -- start 2023-08-22T00:18:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.974+0000 7f05a81e3700 1 -- start start 2023-08-22T00:18:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0065f10 0x7f05a014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a00bdbe0 0x7f05a00be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00c10e0 con 0x7f05a0153cf0 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00c1570 con 0x7f05a00bdbe0 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00c07b0 con 0x7f05a0065f10 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39790/0 (socket says 172.21.15.98:39790) 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 -- 172.21.15.98:0/679068444 learned_addr learned my addr 172.21.15.98:0/679068444 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:18:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a5f7f700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0065f10 0x7f05a014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a577e700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a00bdbe0 0x7f05a00be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 -- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0065f10 msgr2=0x7f05a014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0065f10 0x7f05a014e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 -- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a00bdbe0 msgr2=0x7f05a00be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a00bdbe0 0x7f05a00be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:18:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 -- 172.21.15.98:0/679068444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900092a0 con 0x7f05a0153cf0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a6780700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f059800c7e0 tx=0x7f0598007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598005d30 con 0x7f05a0153cf0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0598005e90 con 0x7f05a0153cf0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598007320 con 0x7f05a0153cf0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.975+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0092a0 con 0x7f05a0153cf0 2023-08-22T00:18:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.976+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00c0d70 con 0x7f05a0153cf0 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a00c1250 con 0x7f05a0153cf0 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0598007710 con 0x7f05a0153cf0 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f0595ffb700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 0x7f05840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f059807a200 con 0x7f05a0153cf0 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f05a5f7f700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 0x7f05840613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:18:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.977+0000 7f05a5f7f700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 0x7f05840613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0590009270 tx=0x7f0590008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:18:59.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:18:59.981+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f059804b390 con 0x7f05a0153cf0 2023-08-22T00:19:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.138+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05a0047480 con 0x7f058405ef30 2023-08-22T00:19:00.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.147+0000 7f0595ffb700 1 -- 172.21.15.98:0/679068444 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353925 (secure 0 0 0) 0x7f05a0047480 con 0x7f058405ef30 2023-08-22T00:19:00.152 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 msgr2=0x7f05840613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 0x7f05840613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0590009270 tx=0x7f0590008040).stop 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 msgr2=0x7f05a00c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f059800c7e0 tx=0x7f0598007f90).stop 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 shutdown_connections 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f058405ef30 0x7f05840613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05a0065f10 0x7f05a014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05a0153cf0 0x7f05a00c59b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 --2- 172.21.15.98:0/679068444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a00bdbe0 0x7f05a00be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 >> 172.21.15.98:0/679068444 conn(0x7f05a00c7770 msgr2=0x7f05a00a56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 shutdown_connections 2023-08-22T00:19:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.150+0000 7f05a81e3700 1 -- 172.21.15.98:0/679068444 wait complete. 2023-08-22T00:19:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:19:00.164 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:18:59.906437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415912,"kb_used_data":6376,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752558808,"statfs":{"total":773094113280,"available":770620219392,"internally_reserved":0,"allocated":6529024,"data_stored":3367975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13309452,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-732,"num_write_kb":-13903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.348229"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"70'3","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865328+0000","last_change":"2023-08-22T00:18:55.478293+0000","last_active":"2023-08-22T00:18:55.865328+0000","last_peered":"2023-08-22T00:18:55.865328+0000","last_clean":"2023-08-22T00:18:55.865328+0000","last_became_active":"2023-08-22T00:18:55.477997+0000","last_became_peered":"2023-08-22T00:18:55.477997+0000","last_unstale":"2023-08-22T00:18:55.865328+0000","last_undegraded":"2023-08-22T00:18:55.865328+0000","last_fullsized":"2023-08-22T00:18:55.865328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462351+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460765+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460485+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458478+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863473+0000","last_change":"2023-08-22T00:18:55.474895+0000","last_active":"2023-08-22T00:18:55.863473+0000","last_peered":"2023-08-22T00:18:55.863473+0000","last_clean":"2023-08-22T00:18:55.863473+0000","last_became_active":"2023-08-22T00:18:55.474621+0000","last_became_peered":"2023-08-22T00:18:55.474621+0000","last_unstale":"2023-08-22T00:18:55.863473+0000","last_undegraded":"2023-08-22T00:18:55.863473+0000","last_fullsized":"2023-08-22T00:18:55.863473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460229+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864190+0000","last_change":"2023-08-22T00:18:55.857870+0000","last_active":"2023-08-22T00:18:55.864190+0000","last_peered":"2023-08-22T00:18:55.864190+0000","last_clean":"2023-08-22T00:18:55.864190+0000","last_became_active":"2023-08-22T00:18:55.857596+0000","last_became_peered":"2023-08-22T00:18:55.857596+0000","last_unstale":"2023-08-22T00:18:55.864190+0000","last_undegraded":"2023-08-22T00:18:55.864190+0000","last_fullsized":"2023-08-22T00:18:55.864190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461063+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851201+0000","last_change":"2023-08-22T00:18:55.484392+0000","last_active":"2023-08-22T00:18:55.851201+0000","last_peered":"2023-08-22T00:18:55.851201+0000","last_clean":"2023-08-22T00:18:55.851201+0000","last_became_active":"2023-08-22T00:18:55.484083+0000","last_became_peered":"2023-08-22T00:18:55.484083+0000","last_unstale":"2023-08-22T00:18:55.851201+0000","last_undegraded":"2023-08-22T00:18:55.851201+0000","last_fullsized":"2023-08-22T00:18:55.851201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863575+0000","last_change":"2023-08-22T00:18:55.855585+0000","last_active":"2023-08-22T00:18:55.863575+0000","last_peered":"2023-08-22T00:18:55.863575+0000","last_clean":"2023-08-22T00:18:55.863575+0000","last_became_active":"2023-08-22T00:18:55.854046+0000","last_became_peered":"2023-08-22T00:18:55.854046+0000","last_unstale":"2023-08-22T00:18:55.863575+0000","last_undegraded":"2023-08-22T00:18:55.863575+0000","last_fullsized":"2023-08-22T00:18:55.863575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864434+0000","last_change":"2023-08-22T00:18:55.484540+0000","last_active":"2023-08-22T00:18:55.864434+0000","last_peered":"2023-08-22T00:18:55.864434+0000","last_clean":"2023-08-22T00:18:55.864434+0000","last_became_active":"2023-08-22T00:18:55.484283+0000","last_became_peered":"2023-08-22T00:18:55.484283+0000","last_unstale":"2023-08-22T00:18:55.864434+0000","last_undegraded":"2023-08-22T00:18:55.864434+0000","last_fullsized":"2023-08-22T00:18:55.864434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461748+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864202+0000","last_change":"2023-08-22T00:18:55.472850+0000","last_active":"2023-08-22T00:18:55.864202+0000","last_peered":"2023-08-22T00:18:55.864202+0000","last_clean":"2023-08-22T00:18:55.864202+0000","last_became_active":"2023-08-22T00:18:55.472579+0000","last_became_peered":"2023-08-22T00:18:55.472579+0000","last_unstale":"2023-08-22T00:18:55.864202+0000","last_undegraded":"2023-08-22T00:18:55.864202+0000","last_fullsized":"2023-08-22T00:18:55.864202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461007+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461935+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460043+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459720+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457782+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461403+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460656+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463044+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853202+0000","last_change":"2023-08-22T00:18:55.485810+0000","last_active":"2023-08-22T00:18:55.853202+0000","last_peered":"2023-08-22T00:18:55.853202+0000","last_clean":"2023-08-22T00:18:55.853202+0000","last_became_active":"2023-08-22T00:18:55.485540+0000","last_became_peered":"2023-08-22T00:18:55.485540+0000","last_unstale":"2023-08-22T00:18:55.853202+0000","last_undegraded":"2023-08-22T00:18:55.853202+0000","last_fullsized":"2023-08-22T00:18:55.853202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459259+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459706+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460455+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459858+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462536+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460286+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865380+0000","last_change":"2023-08-22T00:18:55.862330+0000","last_active":"2023-08-22T00:18:55.865380+0000","last_peered":"2023-08-22T00:18:55.865380+0000","last_clean":"2023-08-22T00:18:55.865380+0000","last_became_active":"2023-08-22T00:18:55.861438+0000","last_became_peered":"2023-08-22T00:18:55.861438+0000","last_unstale":"2023-08-22T00:18:55.865380+0000","last_undegraded":"2023-08-22T00:18:55.865380+0000","last_fullsized":"2023-08-22T00:18:55.865380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462646+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459407+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462024+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457654+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459816+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462970+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457503+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460652+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460811+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864493+0000","last_change":"2023-08-22T00:18:55.859603+0000","last_active":"2023-08-22T00:18:55.864493+0000","last_peered":"2023-08-22T00:18:55.864493+0000","last_clean":"2023-08-22T00:18:55.864493+0000","last_became_active":"2023-08-22T00:18:55.859326+0000","last_became_peered":"2023-08-22T00:18:55.859326+0000","last_unstale":"2023-08-22T00:18:55.864493+0000","last_undegraded":"2023-08-22T00:18:55.864493+0000","last_fullsized":"2023-08-22T00:18:55.864493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460454+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457526+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461057+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458758+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462552+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460448+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866850+0000","last_change":"2023-08-22T00:18:55.473900+0000","last_active":"2023-08-22T00:18:55.866850+0000","last_peered":"2023-08-22T00:18:55.866850+0000","last_clean":"2023-08-22T00:18:55.866850+0000","last_became_active":"2023-08-22T00:18:55.473631+0000","last_became_peered":"2023-08-22T00:18:55.473631+0000","last_unstale":"2023-08-22T00:18:55.866850+0000","last_undegraded":"2023-08-22T00:18:55.866850+0000","last_fullsized":"2023-08-22T00:18:55.866850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459412+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864510+0000","last_change":"2023-08-22T00:18:55.860057+0000","last_active":"2023-08-22T00:18:55.864510+0000","last_peered":"2023-08-22T00:18:55.864510+0000","last_clean":"2023-08-22T00:18:55.864510+0000","last_became_active":"2023-08-22T00:18:55.859781+0000","last_became_peered":"2023-08-22T00:18:55.859781+0000","last_unstale":"2023-08-22T00:18:55.864510+0000","last_undegraded":"2023-08-22T00:18:55.864510+0000","last_fullsized":"2023-08-22T00:18:55.864510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459447+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462480+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851041+0000","last_change":"2023-08-22T00:18:55.478235+0000","last_active":"2023-08-22T00:18:55.851041+0000","last_peered":"2023-08-22T00:18:55.851041+0000","last_clean":"2023-08-22T00:18:55.851041+0000","last_became_active":"2023-08-22T00:18:55.477967+0000","last_became_peered":"2023-08-22T00:18:55.477967+0000","last_unstale":"2023-08-22T00:18:55.851041+0000","last_undegraded":"2023-08-22T00:18:55.851041+0000","last_fullsized":"2023-08-22T00:18:55.851041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457507+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864239+0000","last_change":"2023-08-22T00:18:55.857835+0000","last_active":"2023-08-22T00:18:55.864239+0000","last_peered":"2023-08-22T00:18:55.864239+0000","last_clean":"2023-08-22T00:18:55.864239+0000","last_became_active":"2023-08-22T00:18:55.857582+0000","last_became_peered":"2023-08-22T00:18:55.857582+0000","last_unstale":"2023-08-22T00:18:55.864239+0000","last_undegraded":"2023-08-22T00:18:55.864239+0000","last_fullsized":"2023-08-22T00:18:55.864239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851476+0000","last_change":"2023-08-22T00:18:55.476426+0000","last_active":"2023-08-22T00:18:55.851476+0000","last_peered":"2023-08-22T00:18:55.851476+0000","last_clean":"2023-08-22T00:18:55.851476+0000","last_became_active":"2023-08-22T00:18:55.476148+0000","last_became_peered":"2023-08-22T00:18:55.476148+0000","last_unstale":"2023-08-22T00:18:55.851476+0000","last_undegraded":"2023-08-22T00:18:55.851476+0000","last_fullsized":"2023-08-22T00:18:55.851476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459376+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459818+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853965+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:18:55.853965+0000","last_peered":"2023-08-22T00:18:55.853965+0000","last_clean":"2023-08-22T00:18:55.853965+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:18:55.853965+0000","last_undegraded":"2023-08-22T00:18:55.853965+0000","last_fullsized":"2023-08-22T00:18:55.853965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462083+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:18:53.109582+0000","last_peered":"2023-08-22T00:18:53.109582+0000","last_clean":"2023-08-22T00:18:53.109582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:18:53.109582+0000","last_undegraded":"2023-08-22T00:18:53.109582+0000","last_fullsized":"2023-08-22T00:18:53.109582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460637+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109119+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:18:53.109119+0000","last_peered":"2023-08-22T00:18:53.109119+0000","last_clean":"2023-08-22T00:18:53.109119+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:18:53.109119+0000","last_undegraded":"2023-08-22T00:18:53.109119+0000","last_fullsized":"2023-08-22T00:18:53.109119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458233+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109585+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:18:53.109585+0000","last_peered":"2023-08-22T00:18:53.109585+0000","last_clean":"2023-08-22T00:18:53.109585+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:18:53.109585+0000","last_undegraded":"2023-08-22T00:18:53.109585+0000","last_fullsized":"2023-08-22T00:18:53.109585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109594+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:18:53.109594+0000","last_peered":"2023-08-22T00:18:53.109594+0000","last_clean":"2023-08-22T00:18:53.109594+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:18:53.109594+0000","last_undegraded":"2023-08-22T00:18:53.109594+0000","last_fullsized":"2023-08-22T00:18:53.109594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853547+0000","last_change":"2023-08-22T00:18:55.480708+0000","last_active":"2023-08-22T00:18:55.853547+0000","last_peered":"2023-08-22T00:18:55.853547+0000","last_clean":"2023-08-22T00:18:55.853547+0000","last_became_active":"2023-08-22T00:18:55.480419+0000","last_became_peered":"2023-08-22T00:18:55.480419+0000","last_unstale":"2023-08-22T00:18:55.853547+0000","last_undegraded":"2023-08-22T00:18:55.853547+0000","last_fullsized":"2023-08-22T00:18:55.853547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109581+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:18:53.109581+0000","last_peered":"2023-08-22T00:18:53.109581+0000","last_clean":"2023-08-22T00:18:53.109581+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:18:53.109581+0000","last_undegraded":"2023-08-22T00:18:53.109581+0000","last_fullsized":"2023-08-22T00:18:53.109581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460659+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109596+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:18:53.109596+0000","last_peered":"2023-08-22T00:18:53.109596+0000","last_clean":"2023-08-22T00:18:53.109596+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:18:53.109596+0000","last_undegraded":"2023-08-22T00:18:53.109596+0000","last_fullsized":"2023-08-22T00:18:53.109596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459371+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851299+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:18:55.851299+0000","last_peered":"2023-08-22T00:18:55.851299+0000","last_clean":"2023-08-22T00:18:55.851299+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:18:55.851299+0000","last_undegraded":"2023-08-22T00:18:55.851299+0000","last_fullsized":"2023-08-22T00:18:55.851299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462148+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448300+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:18:52.448300+0000","last_peered":"2023-08-22T00:18:52.448300+0000","last_clean":"2023-08-22T00:18:52.448300+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:18:52.448300+0000","last_undegraded":"2023-08-22T00:18:52.448300+0000","last_fullsized":"2023-08-22T00:18:52.448300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.627},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.72599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.71099999999999997,"15min":0.751},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.74399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.95399999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.72699999999999998,"15min":0.78300000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.84099999999999997},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.83899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.98199999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.30399999999999999},"max":{"1min":0.67500000000000004,"5min":0.77700000000000002,"15min":1.1339999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.34200000000000003},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.34699999999999998},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":1.0109999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":1.073},"last":0.498}]},{"osd":4,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.76800000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32200000000000001},"max":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.94399999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":1.03},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.99299999999999999},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":860160,"data_stored":442944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.374},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.184},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.193},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23499999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.696},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.442,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.246},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.22}]},{"osd":4,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.27000000000000002},"max":{"1min":0.86399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.40500000000000003,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.441,"15min":0.318},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2150000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65900000000000003,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.34499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.45900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38800000000000001,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.623,"15min":0.64900000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.221},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.621,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.749,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.92500000000000004,"15min":1.0149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.873,"15min":0.89200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.42099999999999999,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.247},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64800000000000002},"last":0.312},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.66900000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.251},"max":{"1min":0.622,"5min":0.622,"15min":0.71199999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42499999999999999,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.64800000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.91500000000000004,"15min":1.0580000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.88700000000000001,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.434,"5min":0.434,"15min":0.379},"max":{"1min":0.88600000000000001,"5min":0.998,"15min":0.998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40600000000000003},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.42399999999999999},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.98599999999999999},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"last":0.318},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.20799999999999999},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40899999999999997,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.185},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.308,"15min":0.24199999999999999},"max":{"1min":0.59699999999999998,"5min":0.60099999999999998,"15min":0.63600000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45500000000000002,"15min":0.433},"min":{"1min":0.314,"5min":0.314,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.63700000000000001,"15min":0.66600000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46600000000000003,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.69199999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.33800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":0.90900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.76300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95999999999999996,"15min":11.163},"last":0.437}]},{"osd":7,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.32000000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.77300000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.76400000000000001,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.72699999999999998},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.85899999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.85199999999999998},"last":0.34300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.94599999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":0.873},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.313},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":0.748,"15min":0.84599999999999997},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":0.77200000000000002,"15min":0.92000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.95999999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.92800000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.88},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.71399999999999997},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.74299999999999999,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.77900000000000003},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:19:00.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-08-22T00:19:00.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-08-22T00:19:00.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-08-22T00:19:00.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462351+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-08-22T00:19:00.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-08-22T00:19:00.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460765+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-08-22T00:19:00.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-08-22T00:19:00.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460485+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-08-22T00:19:00.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-08-22T00:19:00.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.458478+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:19:00.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-08-22T00:19:00.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-08-22T00:19:00.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-08-22T00:19:00.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460229+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-08-22T00:19:00.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-08-22T00:19:00.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461763+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-08-22T00:19:00.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461063+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-08-22T00:19:00.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-08-22T00:19:00.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-08-22T00:19:00.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457559+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:19:00.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-08-22T00:19:00.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461559+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-08-22T00:19:00.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-08-22T00:19:00.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-08-22T00:19:00.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461748+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-08-22T00:19:00.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-08-22T00:19:00.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461278+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-08-22T00:19:00.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-08-22T00:19:00.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-08-22T00:19:00.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461007+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-08-22T00:19:00.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-08-22T00:19:00.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461935+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-08-22T00:19:00.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-08-22T00:19:00.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460043+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-08-22T00:19:00.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-08-22T00:19:00.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459720+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-08-22T00:19:00.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-08-22T00:19:00.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457782+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-08-22T00:19:00.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-08-22T00:19:00.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461403+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-08-22T00:19:00.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-08-22T00:19:00.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457559+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:19:00.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-08-22T00:19:00.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-08-22T00:19:00.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461278+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-08-22T00:19:00.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-08-22T00:19:00.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460656+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-08-22T00:19:00.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-08-22T00:19:00.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.463044+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-08-22T00:19:00.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-08-22T00:19:00.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-08-22T00:19:00.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459259+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-08-22T00:19:00.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-08-22T00:19:00.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459706+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-08-22T00:19:00.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-08-22T00:19:00.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460455+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-08-22T00:19:00.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-08-22T00:19:00.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459858+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-08-22T00:19:00.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-08-22T00:19:00.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462536+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-08-22T00:19:00.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-08-22T00:19:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460286+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-08-22T00:19:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462646+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-08-22T00:19:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-08-22T00:19:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459407+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-08-22T00:19:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-08-22T00:19:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462024+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-08-22T00:19:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-08-22T00:19:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457654+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:19:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-08-22T00:19:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-08-22T00:19:00.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459816+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-08-22T00:19:00.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-08-22T00:19:00.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462970+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-08-22T00:19:00.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-08-22T00:19:00.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457503+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:19:00.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-08-22T00:19:00.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-08-22T00:19:00.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460652+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-08-22T00:19:00.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-08-22T00:19:00.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460811+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-08-22T00:19:00.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460454+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-08-22T00:19:00.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-08-22T00:19:00.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457526+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:19:00.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-08-22T00:19:00.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-08-22T00:19:00.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.461057+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-08-22T00:19:00.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-08-22T00:19:00.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.458758+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-08-22T00:19:00.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-08-22T00:19:00.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462552+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-08-22T00:19:00.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-08-22T00:19:00.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460448+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:19:00.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-08-22T00:19:00.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-08-22T00:19:00.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-08-22T00:19:00.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459412+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-08-22T00:19:00.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459447+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-08-22T00:19:00.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-08-22T00:19:00.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462480+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-08-22T00:19:00.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-08-22T00:19:00.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-08-22T00:19:00.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.457507+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:19:00.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-08-22T00:19:00.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-08-22T00:19:00.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459376+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-08-22T00:19:00.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-08-22T00:19:00.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459818+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-08-22T00:19:00.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-08-22T00:19:00.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462083+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-08-22T00:19:00.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-08-22T00:19:00.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460637+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-08-22T00:19:00.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-08-22T00:19:00.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.458233+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:19:00.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-08-22T00:19:00.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-08-22T00:19:00.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-08-22T00:19:00.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.460659+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:19:00.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-08-22T00:19:00.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-08-22T00:19:00.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.459371+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:19:00.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-08-22T00:19:00.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:18:55.454623+0000', 'last_change': '2023-08-22T00:18:55.454623+0000', 'last_active': '2023-08-22T00:18:55.454623+0000', 'last_peered': '2023-08-22T00:18:55.454623+0000', 'last_clean': '2023-08-22T00:18:55.454623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:55.454623+0000', 'last_undegraded': '2023-08-22T00:18:55.454623+0000', 'last_fullsized': '2023-08-22T00:18:55.454623+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:55.454623+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:19:00.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-08-22T00:19:00.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:18:54.447873+0000', 'last_change': '2023-08-22T00:18:54.462148+0000', 'last_active': '2023-08-22T00:18:54.447873+0000', 'last_peered': '2023-08-22T00:18:54.447873+0000', 'last_clean': '2023-08-22T00:18:54.447873+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:18:54.447873+0000', 'last_undegraded': '2023-08-22T00:18:54.447873+0000', 'last_fullsized': '2023-08-22T00:18:54.447873+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'last_clean_scrub_stamp': '2023-08-22T00:18:54.447873+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:19:00.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:19:00.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.433+0000 7f7898fc3700 1 Processor -- start 2023-08-22T00:19:00.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.433+0000 7f7898fc3700 1 -- start start 2023-08-22T00:19:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7898fc3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7894153cf0 0x7f78941584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7898fc3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7894065f10 0x7f7894066370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7898fc3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940bd750 con 0x7f78940bdbe0 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7898fc3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940a7030 con 0x7f7894153cf0 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7898fc3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940c2010 con 0x7f7894065f10 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7894153cf0 0x7f78941584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7894153cf0 0x7f78941584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44554/0 (socket says 172.21.15.98:44554) 2023-08-22T00:19:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 -- 172.21.15.98:0/3239684496 learned_addr learned my addr 172.21.15.98:0/3239684496 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f7891d9b700 1 --2- 172.21.15.98:0/3239684496 >> v2:172.21.15.118:3300/0 conn(0x7f7894065f10 0x7f7894066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 -- 172.21.15.98:0/3239684496 >> v2:172.21.15.118:3300/0 conn(0x7f7894065f10 msgr2=0x7f7894066370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 --2- 172.21.15.98:0/3239684496 >> v2:172.21.15.118:3300/0 conn(0x7f7894065f10 0x7f7894066370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 -- 172.21.15.98:0/3239684496 >> v1:172.21.15.98:6789/0 conn(0x7f78940bdbe0 legacy=0x7f78940c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 -- 172.21.15.98:0/3239684496 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940a6d50 con 0x7f7894153cf0 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789159a700 1 -- 172.21.15.98:0/3239684496 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922659893 0 0) 0x7f78940bd750 con 0x7f78940bdbe0 2023-08-22T00:19:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789259c700 1 --2- 172.21.15.98:0/3239684496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894153cf0 0x7f78941584e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f7894069d60 tx=0x7f78840090f0).ready entity=mon.0 client_cookie=419a53deef8863b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.434+0000 7f789159a700 1 -- 172.21.15.98:0/3239684496 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400b600 con 0x7f7894153cf0 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f789159a700 1 -- 172.21.15.98:0/3239684496 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400b760 con 0x7f7894153cf0 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f789159a700 1 -- 172.21.15.98:0/3239684496 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400bae0 con 0x7f7894153cf0 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 -- 172.21.15.98:0/3239684496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894153cf0 msgr2=0x7f78941584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3239684496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894153cf0 0x7f78941584e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f7894069d60 tx=0x7f78840090f0).stop 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 -- 172.21.15.98:0/3239684496 shutdown_connections 2023-08-22T00:19:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3239684496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894153cf0 0x7f78941584e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3239684496 >> v2:172.21.15.118:3300/0 conn(0x7f7894065f10 0x7f7894066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 -- 172.21.15.98:0/3239684496 >> 172.21.15.98:0/3239684496 conn(0x7f78940c7770 msgr2=0x7f78940c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 -- 172.21.15.98:0/3239684496 shutdown_connections 2023-08-22T00:19:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.435+0000 7f7898fc3700 1 -- 172.21.15.98:0/3239684496 wait complete. 2023-08-22T00:19:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.436+0000 7f7898fc3700 1 Processor -- start 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.436+0000 7f7898fc3700 1 -- start start 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 0x7f78940ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 0x7f78940a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c01e0 con 0x7f7894065f10 2023-08-22T00:19:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c1020 con 0x7f7894153cf0 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7898fc3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c0410 con 0x7f78940bdbe0 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44556/0 (socket says 172.21.15.98:44556) 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 -- 172.21.15.98:0/3982037304 learned_addr learned my addr 172.21.15.98:0/3982037304 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7891d9b700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 0x7f78940ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7892d9d700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 0x7f78940a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 -- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 msgr2=0x7f78940ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 0x7f78940ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 -- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 msgr2=0x7f78940a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 0x7f78940a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f789259c700 1 -- 172.21.15.98:0/3982037304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009370 con 0x7f7894065f10 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7892d9d700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 0x7f78940a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.437+0000 7f7891d9b700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 0x7f78940ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f789259c700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f7884009130 tx=0x7f7884017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400b8d0 con 0x7f7894065f10 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400ba30 con 0x7f7894065f10 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788401b660 con 0x7f7894065f10 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940c06f0 con 0x7f7894065f10 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.438+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78940c0cb0 con 0x7f7894065f10 2023-08-22T00:19:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.439+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7894047480 con 0x7f7894065f10 2023-08-22T00:19:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.439+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f788401ba10 con 0x7f7894065f10 2023-08-22T00:19:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.439+0000 7f78827fc700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 0x7f78740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.439+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f788407bb30 con 0x7f7894065f10 2023-08-22T00:19:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.439+0000 7f7891d9b700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 0x7f78740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.440+0000 7f7891d9b700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 0x7f78740613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7894067ca0 tx=0x7f7888008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.444+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f788404cc00 con 0x7f7894065f10 2023-08-22T00:19:00.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.670+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f78940bd100 con 0x7f7894065f10 2023-08-22T00:19:00.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.670+0000 7f78827fc700 1 -- 172.21.15.98:0/3982037304 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1111 (secure 0 0 0) 0x7f7884050220 con 0x7f7894065f10 2023-08-22T00:19:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:00.672 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":789,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":71,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":58},{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":25}],"num_pgs":137,"num_pools":4,"num_objects":6,"data_bytes":554,"bytes_used":2473893888,"bytes_avail":770620219392,"bytes_total":773094113280,"unknown_pgs_ratio":0.42335766553878784,"inactive_pgs_ratio":0.39416059851646423},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5955}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-08-22T00:08:30.568566+0000","services":{}},"progress_events":{}} 2023-08-22T00:19:00.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 msgr2=0x7f78740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 0x7f78740613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7894067ca0 tx=0x7f7888008040).stop 2023-08-22T00:19:00.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 msgr2=0x7f78940c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f7884009130 tx=0x7f7884017000).stop 2023-08-22T00:19:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 shutdown_connections 2023-08-22T00:19:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7894153cf0 0x7f78940a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7894065f10 0x7f78940c14b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f787405ef30 0x7f78740613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 --2- 172.21.15.98:0/3982037304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78940bdbe0 0x7f78940ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 >> 172.21.15.98:0/3982037304 conn(0x7f78940c7770 msgr2=0x7f7894066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 shutdown_connections 2023-08-22T00:19:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.672+0000 7f7898fc3700 1 -- 172.21.15.98:0/3982037304 wait complete. 2023-08-22T00:19:00.685 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:19:00.686 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:19:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.800+0000 7f46598d0700 1 Processor -- start 2023-08-22T00:19:00.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.800+0000 7f46598d0700 1 -- start start 2023-08-22T00:19:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46598d0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f4654157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46598d0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46541583a0 0x7f46540bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46598d0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540c6a80 con 0x7f4654157ad0 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46598d0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540c2150 con 0x7f46541583a0 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46598d0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540c5e70 con 0x7f46540a4db0 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4652ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4654157ad0 0x7f46540c1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52722/0 (socket says 172.21.15.98:52722) 2023-08-22T00:19:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4652ffd700 1 -- 172.21.15.98:0/1091955715 learned_addr learned my addr 172.21.15.98:0/1091955715 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275636413 0 0) 0x7f46540c6a80 con 0x7f4654157ad0 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46537fe700 1 --2- 172.21.15.98:0/1091955715 >> v2:172.21.15.118:3300/0 conn(0x7f46541583a0 0x7f46540bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463c0033f0 con 0x7f4654157ad0 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f46527fc700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f4654157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198045374 0 0) 0x7f463c0033f0 con 0x7f4654157ad0 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 msgr2=0x7f4654157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f4654157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 >> v2:172.21.15.118:3300/0 conn(0x7f46541583a0 msgr2=0x7f46540bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 --2- 172.21.15.98:0/1091955715 >> v2:172.21.15.118:3300/0 conn(0x7f46541583a0 0x7f46540bbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540c6150 con 0x7f4654157ad0 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4648001470 con 0x7f4654157ad0 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 >> v1:172.21.15.98:6789/0 conn(0x7f4654157ad0 legacy=0x7f46540c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f463c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f463c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c004b80 0x7f463c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540c2150 con 0x7f463c0038e0 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540c5e70 con 0x7f463c004b80 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.801+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00b8e0 con 0x7f46540a4db0 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f463c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f46527fc700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f463c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f46537fe700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c004b80 0x7f463c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 -- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 msgr2=0x7f463c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540a4db0 0x7f463c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 -- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c004b80 msgr2=0x7f463c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c004b80 0x7f463c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 -- 172.21.15.98:0/1091955715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0033f0 con 0x7f463c0038e0 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f46537fe700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c004b80 0x7f463c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4652ffd700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f463c003d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f464800c210 tx=0x7f46540c69f0).ready entity=mon.0 client_cookie=a7d20df9ffe1b199 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648007a60 con 0x7f463c0038e0 2023-08-22T00:19:00.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800cae0 con 0x7f463c0038e0 2023-08-22T00:19:00.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f4651ffb700 1 -- 172.21.15.98:0/1091955715 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800ce60 con 0x7f463c0038e0 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f46598d0700 1 -- 172.21.15.98:0/1091955715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 msgr2=0x7f463c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.802+0000 7f46598d0700 1 --2- 172.21.15.98:0/1091955715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f463c003d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f464800c210 tx=0x7f46540c69f0).stop 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.803+0000 7f46537fe700 1 -- 172.21.15.98:0/1091955715 reap_dead start 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.803+0000 7f46598d0700 1 -- 172.21.15.98:0/1091955715 shutdown_connections 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.803+0000 7f46598d0700 1 -- 172.21.15.98:0/1091955715 >> 172.21.15.98:0/1091955715 conn(0x7f46540c3990 msgr2=0x7f46540c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:00.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.803+0000 7f46598d0700 1 -- 172.21.15.98:0/1091955715 shutdown_connections 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.803+0000 7f46598d0700 1 -- 172.21.15.98:0/1091955715 wait complete. 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.804+0000 7f46598d0700 1 Processor -- start 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.804+0000 7f46598d0700 1 -- start start 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46541407e0 0x7f46540abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540ac380 0x7f4654167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540ac800 con 0x7f463c0038e0 2023-08-22T00:19:00.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540a68b0 con 0x7f46541407e0 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540a6b90 con 0x7f46540ac380 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44574/0 (socket says 172.21.15.98:44574) 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 -- 172.21.15.98:0/594441445 learned_addr learned my addr 172.21.15.98:0/594441445 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46527fc700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46541407e0 0x7f46540abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46537fe700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540ac380 0x7f4654167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 -- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540ac380 msgr2=0x7f4654167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540ac380 0x7f4654167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 -- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46541407e0 msgr2=0x7f46540abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46541407e0 0x7f46540abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 -- 172.21.15.98:0/594441445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540a6e70 con 0x7f463c0038e0 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f4652ffd700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f464800c800 tx=0x7f4648015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648001a10 con 0x7f463c0038e0 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4648007640 con 0x7f463c0038e0 2023-08-22T00:19:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46540a7150 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480048c0 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.805+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654167db0 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.806+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4654047480 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.806+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4648004c30 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.807+0000 7f463affd700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 0x7f46400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.807+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f464807af10 con 0x7f463c0038e0 2023-08-22T00:19:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.807+0000 7f46527fc700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 0x7f46400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.807+0000 7f46527fc700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 0x7f46400613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f46540656f0 tx=0x7f4644008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.811+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f464804c0a0 con 0x7f463c0038e0 2023-08-22T00:19:00.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.968+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46540c6430 con 0x7f464005ef30 2023-08-22T00:19:00.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.978+0000 7f463affd700 1 -- 172.21.15.98:0/594441445 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353925 (secure 0 0 0) 0x7f46540c6430 con 0x7f464005ef30 2023-08-22T00:19:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 msgr2=0x7f46400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 0x7f46400613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f46540656f0 tx=0x7f4644008040).stop 2023-08-22T00:19:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 msgr2=0x7f46541402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f464800c800 tx=0x7f4648015000).stop 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 shutdown_connections 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f464005ef30 0x7f46400613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46540ac380 0x7f4654167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463c0038e0 0x7f46541402f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 --2- 172.21.15.98:0/594441445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46541407e0 0x7f46540abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:00.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 >> 172.21.15.98:0/594441445 conn(0x7f46540c3990 msgr2=0x7f46540661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:00.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 shutdown_connections 2023-08-22T00:19:00.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:00.981+0000 7f46598d0700 1 -- 172.21.15.98:0/594441445 wait complete. 2023-08-22T00:19:00.989 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:19:00.994 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:18:59.906437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415912,"kb_used_data":6376,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752558808,"statfs":{"total":773094113280,"available":770620219392,"internally_reserved":0,"allocated":6529024,"data_stored":3367975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13309452,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-732,"num_write_kb":-13903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.348229"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"70'3","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865328+0000","last_change":"2023-08-22T00:18:55.478293+0000","last_active":"2023-08-22T00:18:55.865328+0000","last_peered":"2023-08-22T00:18:55.865328+0000","last_clean":"2023-08-22T00:18:55.865328+0000","last_became_active":"2023-08-22T00:18:55.477997+0000","last_became_peered":"2023-08-22T00:18:55.477997+0000","last_unstale":"2023-08-22T00:18:55.865328+0000","last_undegraded":"2023-08-22T00:18:55.865328+0000","last_fullsized":"2023-08-22T00:18:55.865328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462351+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460765+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460485+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458478+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863473+0000","last_change":"2023-08-22T00:18:55.474895+0000","last_active":"2023-08-22T00:18:55.863473+0000","last_peered":"2023-08-22T00:18:55.863473+0000","last_clean":"2023-08-22T00:18:55.863473+0000","last_became_active":"2023-08-22T00:18:55.474621+0000","last_became_peered":"2023-08-22T00:18:55.474621+0000","last_unstale":"2023-08-22T00:18:55.863473+0000","last_undegraded":"2023-08-22T00:18:55.863473+0000","last_fullsized":"2023-08-22T00:18:55.863473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460229+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461763+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864190+0000","last_change":"2023-08-22T00:18:55.857870+0000","last_active":"2023-08-22T00:18:55.864190+0000","last_peered":"2023-08-22T00:18:55.864190+0000","last_clean":"2023-08-22T00:18:55.864190+0000","last_became_active":"2023-08-22T00:18:55.857596+0000","last_became_peered":"2023-08-22T00:18:55.857596+0000","last_unstale":"2023-08-22T00:18:55.864190+0000","last_undegraded":"2023-08-22T00:18:55.864190+0000","last_fullsized":"2023-08-22T00:18:55.864190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461063+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851201+0000","last_change":"2023-08-22T00:18:55.484392+0000","last_active":"2023-08-22T00:18:55.851201+0000","last_peered":"2023-08-22T00:18:55.851201+0000","last_clean":"2023-08-22T00:18:55.851201+0000","last_became_active":"2023-08-22T00:18:55.484083+0000","last_became_peered":"2023-08-22T00:18:55.484083+0000","last_unstale":"2023-08-22T00:18:55.851201+0000","last_undegraded":"2023-08-22T00:18:55.851201+0000","last_fullsized":"2023-08-22T00:18:55.851201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863575+0000","last_change":"2023-08-22T00:18:55.855585+0000","last_active":"2023-08-22T00:18:55.863575+0000","last_peered":"2023-08-22T00:18:55.863575+0000","last_clean":"2023-08-22T00:18:55.863575+0000","last_became_active":"2023-08-22T00:18:55.854046+0000","last_became_peered":"2023-08-22T00:18:55.854046+0000","last_unstale":"2023-08-22T00:18:55.863575+0000","last_undegraded":"2023-08-22T00:18:55.863575+0000","last_fullsized":"2023-08-22T00:18:55.863575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864434+0000","last_change":"2023-08-22T00:18:55.484540+0000","last_active":"2023-08-22T00:18:55.864434+0000","last_peered":"2023-08-22T00:18:55.864434+0000","last_clean":"2023-08-22T00:18:55.864434+0000","last_became_active":"2023-08-22T00:18:55.484283+0000","last_became_peered":"2023-08-22T00:18:55.484283+0000","last_unstale":"2023-08-22T00:18:55.864434+0000","last_undegraded":"2023-08-22T00:18:55.864434+0000","last_fullsized":"2023-08-22T00:18:55.864434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461748+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864202+0000","last_change":"2023-08-22T00:18:55.472850+0000","last_active":"2023-08-22T00:18:55.864202+0000","last_peered":"2023-08-22T00:18:55.864202+0000","last_clean":"2023-08-22T00:18:55.864202+0000","last_became_active":"2023-08-22T00:18:55.472579+0000","last_became_peered":"2023-08-22T00:18:55.472579+0000","last_unstale":"2023-08-22T00:18:55.864202+0000","last_undegraded":"2023-08-22T00:18:55.864202+0000","last_fullsized":"2023-08-22T00:18:55.864202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461007+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461935+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460043+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459720+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457782+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461403+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457559+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461278+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460656+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.463044+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853202+0000","last_change":"2023-08-22T00:18:55.485810+0000","last_active":"2023-08-22T00:18:55.853202+0000","last_peered":"2023-08-22T00:18:55.853202+0000","last_clean":"2023-08-22T00:18:55.853202+0000","last_became_active":"2023-08-22T00:18:55.485540+0000","last_became_peered":"2023-08-22T00:18:55.485540+0000","last_unstale":"2023-08-22T00:18:55.853202+0000","last_undegraded":"2023-08-22T00:18:55.853202+0000","last_fullsized":"2023-08-22T00:18:55.853202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459259+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459706+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460455+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459858+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462536+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460286+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865380+0000","last_change":"2023-08-22T00:18:55.862330+0000","last_active":"2023-08-22T00:18:55.865380+0000","last_peered":"2023-08-22T00:18:55.865380+0000","last_clean":"2023-08-22T00:18:55.865380+0000","last_became_active":"2023-08-22T00:18:55.861438+0000","last_became_peered":"2023-08-22T00:18:55.861438+0000","last_unstale":"2023-08-22T00:18:55.865380+0000","last_undegraded":"2023-08-22T00:18:55.865380+0000","last_fullsized":"2023-08-22T00:18:55.865380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462646+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459407+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462024+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457654+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459816+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462970+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457503+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460652+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460811+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864493+0000","last_change":"2023-08-22T00:18:55.859603+0000","last_active":"2023-08-22T00:18:55.864493+0000","last_peered":"2023-08-22T00:18:55.864493+0000","last_clean":"2023-08-22T00:18:55.864493+0000","last_became_active":"2023-08-22T00:18:55.859326+0000","last_became_peered":"2023-08-22T00:18:55.859326+0000","last_unstale":"2023-08-22T00:18:55.864493+0000","last_undegraded":"2023-08-22T00:18:55.864493+0000","last_fullsized":"2023-08-22T00:18:55.864493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460454+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457526+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.461057+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458758+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462552+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460448+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866850+0000","last_change":"2023-08-22T00:18:55.473900+0000","last_active":"2023-08-22T00:18:55.866850+0000","last_peered":"2023-08-22T00:18:55.866850+0000","last_clean":"2023-08-22T00:18:55.866850+0000","last_became_active":"2023-08-22T00:18:55.473631+0000","last_became_peered":"2023-08-22T00:18:55.473631+0000","last_unstale":"2023-08-22T00:18:55.866850+0000","last_undegraded":"2023-08-22T00:18:55.866850+0000","last_fullsized":"2023-08-22T00:18:55.866850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459412+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864510+0000","last_change":"2023-08-22T00:18:55.860057+0000","last_active":"2023-08-22T00:18:55.864510+0000","last_peered":"2023-08-22T00:18:55.864510+0000","last_clean":"2023-08-22T00:18:55.864510+0000","last_became_active":"2023-08-22T00:18:55.859781+0000","last_became_peered":"2023-08-22T00:18:55.859781+0000","last_unstale":"2023-08-22T00:18:55.864510+0000","last_undegraded":"2023-08-22T00:18:55.864510+0000","last_fullsized":"2023-08-22T00:18:55.864510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459447+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462480+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851041+0000","last_change":"2023-08-22T00:18:55.478235+0000","last_active":"2023-08-22T00:18:55.851041+0000","last_peered":"2023-08-22T00:18:55.851041+0000","last_clean":"2023-08-22T00:18:55.851041+0000","last_became_active":"2023-08-22T00:18:55.477967+0000","last_became_peered":"2023-08-22T00:18:55.477967+0000","last_unstale":"2023-08-22T00:18:55.851041+0000","last_undegraded":"2023-08-22T00:18:55.851041+0000","last_fullsized":"2023-08-22T00:18:55.851041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.457507+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864239+0000","last_change":"2023-08-22T00:18:55.857835+0000","last_active":"2023-08-22T00:18:55.864239+0000","last_peered":"2023-08-22T00:18:55.864239+0000","last_clean":"2023-08-22T00:18:55.864239+0000","last_became_active":"2023-08-22T00:18:55.857582+0000","last_became_peered":"2023-08-22T00:18:55.857582+0000","last_unstale":"2023-08-22T00:18:55.864239+0000","last_undegraded":"2023-08-22T00:18:55.864239+0000","last_fullsized":"2023-08-22T00:18:55.864239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851476+0000","last_change":"2023-08-22T00:18:55.476426+0000","last_active":"2023-08-22T00:18:55.851476+0000","last_peered":"2023-08-22T00:18:55.851476+0000","last_clean":"2023-08-22T00:18:55.851476+0000","last_became_active":"2023-08-22T00:18:55.476148+0000","last_became_peered":"2023-08-22T00:18:55.476148+0000","last_unstale":"2023-08-22T00:18:55.851476+0000","last_undegraded":"2023-08-22T00:18:55.851476+0000","last_fullsized":"2023-08-22T00:18:55.851476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459376+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459818+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853965+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:18:55.853965+0000","last_peered":"2023-08-22T00:18:55.853965+0000","last_clean":"2023-08-22T00:18:55.853965+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:18:55.853965+0000","last_undegraded":"2023-08-22T00:18:55.853965+0000","last_fullsized":"2023-08-22T00:18:55.853965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462083+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:18:53.109582+0000","last_peered":"2023-08-22T00:18:53.109582+0000","last_clean":"2023-08-22T00:18:53.109582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:18:53.109582+0000","last_undegraded":"2023-08-22T00:18:53.109582+0000","last_fullsized":"2023-08-22T00:18:53.109582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460637+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109119+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:18:53.109119+0000","last_peered":"2023-08-22T00:18:53.109119+0000","last_clean":"2023-08-22T00:18:53.109119+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:18:53.109119+0000","last_undegraded":"2023-08-22T00:18:53.109119+0000","last_fullsized":"2023-08-22T00:18:53.109119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.458233+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109585+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:18:53.109585+0000","last_peered":"2023-08-22T00:18:53.109585+0000","last_clean":"2023-08-22T00:18:53.109585+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:18:53.109585+0000","last_undegraded":"2023-08-22T00:18:53.109585+0000","last_fullsized":"2023-08-22T00:18:53.109585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109594+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:18:53.109594+0000","last_peered":"2023-08-22T00:18:53.109594+0000","last_clean":"2023-08-22T00:18:53.109594+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:18:53.109594+0000","last_undegraded":"2023-08-22T00:18:53.109594+0000","last_fullsized":"2023-08-22T00:18:53.109594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853547+0000","last_change":"2023-08-22T00:18:55.480708+0000","last_active":"2023-08-22T00:18:55.853547+0000","last_peered":"2023-08-22T00:18:55.853547+0000","last_clean":"2023-08-22T00:18:55.853547+0000","last_became_active":"2023-08-22T00:18:55.480419+0000","last_became_peered":"2023-08-22T00:18:55.480419+0000","last_unstale":"2023-08-22T00:18:55.853547+0000","last_undegraded":"2023-08-22T00:18:55.853547+0000","last_fullsized":"2023-08-22T00:18:55.853547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109581+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:18:53.109581+0000","last_peered":"2023-08-22T00:18:53.109581+0000","last_clean":"2023-08-22T00:18:53.109581+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:18:53.109581+0000","last_undegraded":"2023-08-22T00:18:53.109581+0000","last_fullsized":"2023-08-22T00:18:53.109581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.460659+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:53.109596+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:18:53.109596+0000","last_peered":"2023-08-22T00:18:53.109596+0000","last_clean":"2023-08-22T00:18:53.109596+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:18:53.109596+0000","last_undegraded":"2023-08-22T00:18:53.109596+0000","last_fullsized":"2023-08-22T00:18:53.109596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.459371+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851299+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:18:55.851299+0000","last_peered":"2023-08-22T00:18:55.851299+0000","last_clean":"2023-08-22T00:18:55.851299+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:18:55.851299+0000","last_undegraded":"2023-08-22T00:18:55.851299+0000","last_fullsized":"2023-08-22T00:18:55.851299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:18:55.454623+0000","last_change":"2023-08-22T00:18:55.454623+0000","last_active":"2023-08-22T00:18:55.454623+0000","last_peered":"2023-08-22T00:18:55.454623+0000","last_clean":"2023-08-22T00:18:55.454623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:55.454623+0000","last_undegraded":"2023-08-22T00:18:55.454623+0000","last_fullsized":"2023-08-22T00:18:55.454623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:18:54.447873+0000","last_change":"2023-08-22T00:18:54.462148+0000","last_active":"2023-08-22T00:18:54.447873+0000","last_peered":"2023-08-22T00:18:54.447873+0000","last_clean":"2023-08-22T00:18:54.447873+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:18:54.447873+0000","last_undegraded":"2023-08-22T00:18:54.447873+0000","last_fullsized":"2023-08-22T00:18:54.447873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-22T00:18:52.448300+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:18:52.448300+0000","last_peered":"2023-08-22T00:18:52.448300+0000","last_clean":"2023-08-22T00:18:52.448300+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:18:52.448300+0000","last_undegraded":"2023-08-22T00:18:52.448300+0000","last_fullsized":"2023-08-22T00:18:52.448300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.627},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.72599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.71099999999999997,"15min":0.751},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.74399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.95399999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.72699999999999998,"15min":0.78300000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.84099999999999997},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.83899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.98199999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.30399999999999999},"max":{"1min":0.67500000000000004,"5min":0.77700000000000002,"15min":1.1339999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.34200000000000003},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.34699999999999998},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":1.0109999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":1.073},"last":0.498}]},{"osd":4,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.76800000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32200000000000001},"max":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.94399999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":1.03},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.99299999999999999},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":860160,"data_stored":442944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.374},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.184},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.193},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23499999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.696},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.442,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.246},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.22}]},{"osd":4,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.27000000000000002},"max":{"1min":0.86399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.40500000000000003,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.441,"15min":0.318},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2150000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65900000000000003,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.34499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.45900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38800000000000001,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.623,"15min":0.64900000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.221},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.621,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.749,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.92500000000000004,"15min":1.0149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.873,"15min":0.89200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.42099999999999999,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.247},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64800000000000002},"last":0.312},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.66900000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.251},"max":{"1min":0.622,"5min":0.622,"15min":0.71199999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42499999999999999,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.64800000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.91500000000000004,"15min":1.0580000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.88700000000000001,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.434,"5min":0.434,"15min":0.379},"max":{"1min":0.88600000000000001,"5min":0.998,"15min":0.998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40600000000000003},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.42399999999999999},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.98599999999999999},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"last":0.318},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.20799999999999999},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40899999999999997,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.185},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.308,"15min":0.24199999999999999},"max":{"1min":0.59699999999999998,"5min":0.60099999999999998,"15min":0.63600000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45500000000000002,"15min":0.433},"min":{"1min":0.314,"5min":0.314,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.63700000000000001,"15min":0.66600000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46600000000000003,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.69199999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.33800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":0.90900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.76300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95999999999999996,"15min":11.163},"last":0.437}]},{"osd":7,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.32000000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":815104,"data_stored":420679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.77300000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.76400000000000001,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.72699999999999998},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.85899999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.85199999999999998},"last":0.34300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":802816,"data_stored":414105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.94599999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":0.873},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.313},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":0.748,"15min":0.84599999999999997},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":0.77200000000000002,"15min":0.92000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.95999999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.92800000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.88},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.71399999999999997},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.74299999999999999,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.77900000000000003},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:19:04.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:19:04.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.132+0000 7f9cb5c0c700 1 Processor -- start 2023-08-22T00:19:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.132+0000 7f9cb5c0c700 1 -- start start 2023-08-22T00:19:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 0x7f9cb0150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cb0153f10 0x7f9cb00c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00c2220 con 0x7f9cb0153f10 2023-08-22T00:19:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00c1ef0 con 0x7f9cb0150040 2023-08-22T00:19:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cb5c0c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00c5e30 con 0x7f9cb00c59b0 2023-08-22T00:19:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cb0153f10 0x7f9cb00c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cb0153f10 0x7f9cb00c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44590/0 (socket says 172.21.15.98:44590) 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 -- 172.21.15.98:0/1399330847 learned_addr learned my addr 172.21.15.98:0/1399330847 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caf7fe700 1 --2- 172.21.15.98:0/1399330847 >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 0x7f9cb0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caffff700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 -- 172.21.15.98:0/1399330847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 msgr2=0x7f9cb00c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 -- 172.21.15.98:0/1399330847 >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 msgr2=0x7f9cb0150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 --2- 172.21.15.98:0/1399330847 >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 0x7f9cb0150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 -- 172.21.15.98:0/1399330847 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00c6110 con 0x7f9cb0153f10 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caf7fe700 1 --2- 172.21.15.98:0/1399330847 >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 0x7f9cb0150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9caeffd700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb00c54c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f9cb0067f40 tx=0x7f9ca40090f0).ready entity=mon.0 client_cookie=155a64b7edab9cbe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cae7fc700 1 -- 172.21.15.98:0/1399330847 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400b600 con 0x7f9cb0153f10 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cae7fc700 1 -- 172.21.15.98:0/1399330847 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400b760 con 0x7f9cb0153f10 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.133+0000 7f9cae7fc700 1 -- 172.21.15.98:0/1399330847 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400bae0 con 0x7f9cb0153f10 2023-08-22T00:19:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1399330847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 msgr2=0x7f9cb00c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb00c54c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f9cb0067f40 tx=0x7f9ca40090f0).stop 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1399330847 shutdown_connections 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1399330847 >> v2:172.21.15.118:3300/0 conn(0x7f9cb0150040 0x7f9cb0150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1399330847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb00c54c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1399330847 >> 172.21.15.98:0/1399330847 conn(0x7f9cb00c7140 msgr2=0x7f9cb00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1399330847 shutdown_connections 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.134+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1399330847 wait complete. 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.135+0000 7f9cb5c0c700 1 Processor -- start 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.135+0000 7f9cb5c0c700 1 -- start start 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb0150040 0x7f9cb0152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00bf0e0 con 0x7f9cb0153f10 2023-08-22T00:19:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0146bb0 con 0x7f9cb0150040 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9cb5c0c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00be840 con 0x7f9cb00c59b0 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9caffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9caffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44596/0 (socket says 172.21.15.98:44596) 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9caffff700 1 -- 172.21.15.98:0/1609063162 learned_addr learned my addr 172.21.15.98:0/1609063162 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9caf7fe700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.136+0000 7f9caeffd700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb0150040 0x7f9cb0152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 -- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 msgr2=0x7f9cb00a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 -- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb0150040 msgr2=0x7f9cb0152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb0150040 0x7f9cb0152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 -- 172.21.15.98:0/1609063162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009370 con 0x7f9cb0153f10 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9caffff700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9ca8007ef0 tx=0x7f9ca8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800eb30 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca800ec90 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8014610 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb00beb20 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.137+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb00a97c0 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.138+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb00a9620 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.138+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9ca8014a40 con 0x7f9cb0153f10 2023-08-22T00:19:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.138+0000 7f9c977fe700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 0x7f9c9c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.139+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9ca807a490 con 0x7f9cb0153f10 2023-08-22T00:19:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.139+0000 7f9caf7fe700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 0x7f9c9c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.139+0000 7f9caf7fe700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 0x7f9c9c0613c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9ca000abd0 tx=0x7f9ca0008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.143+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9cb00a9620 con 0x7f9cb0153f10 2023-08-22T00:19:04.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.301+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cb00a9620 con 0x7f9c9c05ef00 2023-08-22T00:19:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.311+0000 7f9c977fe700 1 -- 172.21.15.98:0/1609063162 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361317 (secure 0 0 0) 0x7f9cb00a9620 con 0x7f9c9c05ef00 2023-08-22T00:19:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 msgr2=0x7f9c9c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 0x7f9c9c0613c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9ca000abd0 tx=0x7f9ca0008040).stop 2023-08-22T00:19:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 msgr2=0x7f9cb0151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9ca8007ef0 tx=0x7f9ca8009840).stop 2023-08-22T00:19:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 shutdown_connections 2023-08-22T00:19:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c9c05ef00 0x7f9c9c0613c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cb00c59b0 0x7f9cb00a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb0153f10 0x7f9cb0151b00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 --2- 172.21.15.98:0/1609063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb0150040 0x7f9cb0152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 >> 172.21.15.98:0/1609063162 conn(0x7f9cb00c7140 msgr2=0x7f9cb0062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 shutdown_connections 2023-08-22T00:19:04.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.314+0000 7f9cb5c0c700 1 -- 172.21.15.98:0/1609063162 wait complete. 2023-08-22T00:19:04.324 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:19:04.328 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-22T00:19:03.907589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2416256,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752558464,"statfs":{"total":773094113280,"available":770619867136,"internally_reserved":0,"allocated":6881280,"data_stored":3543012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13307700,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-702,"num_write_kb":-13896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.349380"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866092+0000","last_change":"2023-08-22T00:18:55.854740+0000","last_active":"2023-08-22T00:18:55.866092+0000","last_peered":"2023-08-22T00:18:55.866092+0000","last_clean":"2023-08-22T00:18:55.866092+0000","last_became_active":"2023-08-22T00:18:55.854500+0000","last_became_peered":"2023-08-22T00:18:55.854500+0000","last_unstale":"2023-08-22T00:18:55.866092+0000","last_undegraded":"2023-08-22T00:18:55.866092+0000","last_fullsized":"2023-08-22T00:18:55.866092+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"70'3","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865328+0000","last_change":"2023-08-22T00:18:55.478293+0000","last_active":"2023-08-22T00:18:55.865328+0000","last_peered":"2023-08-22T00:18:55.865328+0000","last_clean":"2023-08-22T00:18:55.865328+0000","last_became_active":"2023-08-22T00:18:55.477997+0000","last_became_peered":"2023-08-22T00:18:55.477997+0000","last_unstale":"2023-08-22T00:18:55.865328+0000","last_undegraded":"2023-08-22T00:18:55.865328+0000","last_fullsized":"2023-08-22T00:18:55.865328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.856435+0000","last_change":"2023-08-22T00:18:55.853335+0000","last_active":"2023-08-22T00:18:55.856435+0000","last_peered":"2023-08-22T00:18:55.856435+0000","last_clean":"2023-08-22T00:18:55.856435+0000","last_became_active":"2023-08-22T00:18:55.853066+0000","last_became_peered":"2023-08-22T00:18:55.853066+0000","last_unstale":"2023-08-22T00:18:55.856435+0000","last_undegraded":"2023-08-22T00:18:55.856435+0000","last_fullsized":"2023-08-22T00:18:55.856435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.849533+0000","last_change":"2023-08-22T00:18:55.480186+0000","last_active":"2023-08-22T00:18:55.849533+0000","last_peered":"2023-08-22T00:18:55.849533+0000","last_clean":"2023-08-22T00:18:55.849533+0000","last_became_active":"2023-08-22T00:18:55.479531+0000","last_became_peered":"2023-08-22T00:18:55.479531+0000","last_unstale":"2023-08-22T00:18:55.849533+0000","last_undegraded":"2023-08-22T00:18:55.849533+0000","last_fullsized":"2023-08-22T00:18:55.849533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861315+0000","last_change":"2023-08-22T00:18:55.859430+0000","last_active":"2023-08-22T00:18:55.861315+0000","last_peered":"2023-08-22T00:18:55.861315+0000","last_clean":"2023-08-22T00:18:55.861315+0000","last_became_active":"2023-08-22T00:18:55.856878+0000","last_became_peered":"2023-08-22T00:18:55.856878+0000","last_unstale":"2023-08-22T00:18:55.861315+0000","last_undegraded":"2023-08-22T00:18:55.861315+0000","last_fullsized":"2023-08-22T00:18:55.861315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841913+0000","last_change":"2023-08-22T00:18:55.489573+0000","last_active":"2023-08-22T00:18:55.841913+0000","last_peered":"2023-08-22T00:18:55.841913+0000","last_clean":"2023-08-22T00:18:55.841913+0000","last_became_active":"2023-08-22T00:18:55.489325+0000","last_became_peered":"2023-08-22T00:18:55.489325+0000","last_unstale":"2023-08-22T00:18:55.841913+0000","last_undegraded":"2023-08-22T00:18:55.841913+0000","last_fullsized":"2023-08-22T00:18:55.841913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865055+0000","last_change":"2023-08-22T00:18:55.863867+0000","last_active":"2023-08-22T00:18:55.865055+0000","last_peered":"2023-08-22T00:18:55.865055+0000","last_clean":"2023-08-22T00:18:55.865055+0000","last_became_active":"2023-08-22T00:18:55.863572+0000","last_became_peered":"2023-08-22T00:18:55.863572+0000","last_unstale":"2023-08-22T00:18:55.865055+0000","last_undegraded":"2023-08-22T00:18:55.865055+0000","last_fullsized":"2023-08-22T00:18:55.865055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3c","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.856036+0000","last_change":"2023-08-22T00:18:55.478044+0000","last_active":"2023-08-22T00:18:55.856036+0000","last_peered":"2023-08-22T00:18:55.856036+0000","last_clean":"2023-08-22T00:18:55.856036+0000","last_became_active":"2023-08-22T00:18:55.477727+0000","last_became_peered":"2023-08-22T00:18:55.477727+0000","last_unstale":"2023-08-22T00:18:55.856036+0000","last_undegraded":"2023-08-22T00:18:55.856036+0000","last_fullsized":"2023-08-22T00:18:55.856036+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863267+0000","last_change":"2023-08-22T00:18:55.855742+0000","last_active":"2023-08-22T00:18:55.863267+0000","last_peered":"2023-08-22T00:18:55.863267+0000","last_clean":"2023-08-22T00:18:55.863267+0000","last_became_active":"2023-08-22T00:18:55.855470+0000","last_became_peered":"2023-08-22T00:18:55.855470+0000","last_unstale":"2023-08-22T00:18:55.863267+0000","last_undegraded":"2023-08-22T00:18:55.863267+0000","last_fullsized":"2023-08-22T00:18:55.863267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857706+0000","last_change":"2023-08-22T00:18:55.481059+0000","last_active":"2023-08-22T00:18:55.857706+0000","last_peered":"2023-08-22T00:18:55.857706+0000","last_clean":"2023-08-22T00:18:55.857706+0000","last_became_active":"2023-08-22T00:18:55.476557+0000","last_became_peered":"2023-08-22T00:18:55.476557+0000","last_unstale":"2023-08-22T00:18:55.857706+0000","last_undegraded":"2023-08-22T00:18:55.857706+0000","last_fullsized":"2023-08-22T00:18:55.857706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863430+0000","last_change":"2023-08-22T00:18:55.856754+0000","last_active":"2023-08-22T00:18:55.863430+0000","last_peered":"2023-08-22T00:18:55.863430+0000","last_clean":"2023-08-22T00:18:55.863430+0000","last_became_active":"2023-08-22T00:18:55.856477+0000","last_became_peered":"2023-08-22T00:18:55.856477+0000","last_unstale":"2023-08-22T00:18:55.863430+0000","last_undegraded":"2023-08-22T00:18:55.863430+0000","last_fullsized":"2023-08-22T00:18:55.863430+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863473+0000","last_change":"2023-08-22T00:18:55.474895+0000","last_active":"2023-08-22T00:18:55.863473+0000","last_peered":"2023-08-22T00:18:55.863473+0000","last_clean":"2023-08-22T00:18:55.863473+0000","last_became_active":"2023-08-22T00:18:55.474621+0000","last_became_peered":"2023-08-22T00:18:55.474621+0000","last_unstale":"2023-08-22T00:18:55.863473+0000","last_undegraded":"2023-08-22T00:18:55.863473+0000","last_fullsized":"2023-08-22T00:18:55.863473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866728+0000","last_change":"2023-08-22T00:18:55.859354+0000","last_active":"2023-08-22T00:18:55.866728+0000","last_peered":"2023-08-22T00:18:55.866728+0000","last_clean":"2023-08-22T00:18:55.866728+0000","last_became_active":"2023-08-22T00:18:55.859104+0000","last_became_peered":"2023-08-22T00:18:55.859104+0000","last_unstale":"2023-08-22T00:18:55.866728+0000","last_undegraded":"2023-08-22T00:18:55.866728+0000","last_fullsized":"2023-08-22T00:18:55.866728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.839758+0000","last_change":"2023-08-22T00:18:55.484703+0000","last_active":"2023-08-22T00:18:55.839758+0000","last_peered":"2023-08-22T00:18:55.839758+0000","last_clean":"2023-08-22T00:18:55.839758+0000","last_became_active":"2023-08-22T00:18:55.484435+0000","last_became_peered":"2023-08-22T00:18:55.484435+0000","last_unstale":"2023-08-22T00:18:55.839758+0000","last_undegraded":"2023-08-22T00:18:55.839758+0000","last_fullsized":"2023-08-22T00:18:55.839758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861433+0000","last_change":"2023-08-22T00:18:55.853222+0000","last_active":"2023-08-22T00:18:55.861433+0000","last_peered":"2023-08-22T00:18:55.861433+0000","last_clean":"2023-08-22T00:18:55.861433+0000","last_became_active":"2023-08-22T00:18:55.852913+0000","last_became_peered":"2023-08-22T00:18:55.852913+0000","last_unstale":"2023-08-22T00:18:55.861433+0000","last_undegraded":"2023-08-22T00:18:55.861433+0000","last_fullsized":"2023-08-22T00:18:55.861433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.846398+0000","last_change":"2023-08-22T00:18:55.476452+0000","last_active":"2023-08-22T00:18:55.846398+0000","last_peered":"2023-08-22T00:18:55.846398+0000","last_clean":"2023-08-22T00:18:55.846398+0000","last_became_active":"2023-08-22T00:18:55.476103+0000","last_became_peered":"2023-08-22T00:18:55.476103+0000","last_unstale":"2023-08-22T00:18:55.846398+0000","last_undegraded":"2023-08-22T00:18:55.846398+0000","last_fullsized":"2023-08-22T00:18:55.846398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864190+0000","last_change":"2023-08-22T00:18:55.857870+0000","last_active":"2023-08-22T00:18:55.864190+0000","last_peered":"2023-08-22T00:18:55.864190+0000","last_clean":"2023-08-22T00:18:55.864190+0000","last_became_active":"2023-08-22T00:18:55.857596+0000","last_became_peered":"2023-08-22T00:18:55.857596+0000","last_unstale":"2023-08-22T00:18:55.864190+0000","last_undegraded":"2023-08-22T00:18:55.864190+0000","last_fullsized":"2023-08-22T00:18:55.864190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844374+0000","last_change":"2023-08-22T00:18:55.476467+0000","last_active":"2023-08-22T00:18:55.844374+0000","last_peered":"2023-08-22T00:18:55.844374+0000","last_clean":"2023-08-22T00:18:55.844374+0000","last_became_active":"2023-08-22T00:18:55.476200+0000","last_became_peered":"2023-08-22T00:18:55.476200+0000","last_unstale":"2023-08-22T00:18:55.844374+0000","last_undegraded":"2023-08-22T00:18:55.844374+0000","last_fullsized":"2023-08-22T00:18:55.844374+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.858594+0000","last_change":"2023-08-22T00:18:55.851437+0000","last_active":"2023-08-22T00:18:55.858594+0000","last_peered":"2023-08-22T00:18:55.858594+0000","last_clean":"2023-08-22T00:18:55.858594+0000","last_became_active":"2023-08-22T00:18:55.851030+0000","last_became_peered":"2023-08-22T00:18:55.851030+0000","last_unstale":"2023-08-22T00:18:55.858594+0000","last_undegraded":"2023-08-22T00:18:55.858594+0000","last_fullsized":"2023-08-22T00:18:55.858594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851201+0000","last_change":"2023-08-22T00:18:55.484392+0000","last_active":"2023-08-22T00:18:55.851201+0000","last_peered":"2023-08-22T00:18:55.851201+0000","last_clean":"2023-08-22T00:18:55.851201+0000","last_became_active":"2023-08-22T00:18:55.484083+0000","last_became_peered":"2023-08-22T00:18:55.484083+0000","last_unstale":"2023-08-22T00:18:55.851201+0000","last_undegraded":"2023-08-22T00:18:55.851201+0000","last_fullsized":"2023-08-22T00:18:55.851201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857046+0000","last_change":"2023-08-22T00:18:55.853115+0000","last_active":"2023-08-22T00:18:55.857046+0000","last_peered":"2023-08-22T00:18:55.857046+0000","last_clean":"2023-08-22T00:18:55.857046+0000","last_became_active":"2023-08-22T00:18:55.852655+0000","last_became_peered":"2023-08-22T00:18:55.852655+0000","last_unstale":"2023-08-22T00:18:55.857046+0000","last_undegraded":"2023-08-22T00:18:55.857046+0000","last_fullsized":"2023-08-22T00:18:55.857046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.847032+0000","last_change":"2023-08-22T00:18:55.482924+0000","last_active":"2023-08-22T00:18:55.847032+0000","last_peered":"2023-08-22T00:18:55.847032+0000","last_clean":"2023-08-22T00:18:55.847032+0000","last_became_active":"2023-08-22T00:18:55.482674+0000","last_became_peered":"2023-08-22T00:18:55.482674+0000","last_unstale":"2023-08-22T00:18:55.847032+0000","last_undegraded":"2023-08-22T00:18:55.847032+0000","last_fullsized":"2023-08-22T00:18:55.847032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863575+0000","last_change":"2023-08-22T00:18:55.855585+0000","last_active":"2023-08-22T00:18:55.863575+0000","last_peered":"2023-08-22T00:18:55.863575+0000","last_clean":"2023-08-22T00:18:55.863575+0000","last_became_active":"2023-08-22T00:18:55.854046+0000","last_became_peered":"2023-08-22T00:18:55.854046+0000","last_unstale":"2023-08-22T00:18:55.863575+0000","last_undegraded":"2023-08-22T00:18:55.863575+0000","last_fullsized":"2023-08-22T00:18:55.863575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.34","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.867705+0000","last_change":"2023-08-22T00:18:55.474309+0000","last_active":"2023-08-22T00:18:55.867705+0000","last_peered":"2023-08-22T00:18:55.867705+0000","last_clean":"2023-08-22T00:18:55.867705+0000","last_became_active":"2023-08-22T00:18:55.473446+0000","last_became_peered":"2023-08-22T00:18:55.473446+0000","last_unstale":"2023-08-22T00:18:55.867705+0000","last_undegraded":"2023-08-22T00:18:55.867705+0000","last_fullsized":"2023-08-22T00:18:55.867705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861184+0000","last_change":"2023-08-22T00:18:55.854112+0000","last_active":"2023-08-22T00:18:55.861184+0000","last_peered":"2023-08-22T00:18:55.861184+0000","last_clean":"2023-08-22T00:18:55.861184+0000","last_became_active":"2023-08-22T00:18:55.853855+0000","last_became_peered":"2023-08-22T00:18:55.853855+0000","last_unstale":"2023-08-22T00:18:55.861184+0000","last_undegraded":"2023-08-22T00:18:55.861184+0000","last_fullsized":"2023-08-22T00:18:55.861184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864434+0000","last_change":"2023-08-22T00:18:55.484540+0000","last_active":"2023-08-22T00:18:55.864434+0000","last_peered":"2023-08-22T00:18:55.864434+0000","last_clean":"2023-08-22T00:18:55.864434+0000","last_became_active":"2023-08-22T00:18:55.484283+0000","last_became_peered":"2023-08-22T00:18:55.484283+0000","last_unstale":"2023-08-22T00:18:55.864434+0000","last_undegraded":"2023-08-22T00:18:55.864434+0000","last_fullsized":"2023-08-22T00:18:55.864434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.860449+0000","last_change":"2023-08-22T00:18:55.856196+0000","last_active":"2023-08-22T00:18:55.860449+0000","last_peered":"2023-08-22T00:18:55.860449+0000","last_clean":"2023-08-22T00:18:55.860449+0000","last_became_active":"2023-08-22T00:18:55.855921+0000","last_became_peered":"2023-08-22T00:18:55.855921+0000","last_unstale":"2023-08-22T00:18:55.860449+0000","last_undegraded":"2023-08-22T00:18:55.860449+0000","last_fullsized":"2023-08-22T00:18:55.860449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.839990+0000","last_change":"2023-08-22T00:18:55.487369+0000","last_active":"2023-08-22T00:18:55.839990+0000","last_peered":"2023-08-22T00:18:55.839990+0000","last_clean":"2023-08-22T00:18:55.839990+0000","last_became_active":"2023-08-22T00:18:55.487128+0000","last_became_peered":"2023-08-22T00:18:55.487128+0000","last_unstale":"2023-08-22T00:18:55.839990+0000","last_undegraded":"2023-08-22T00:18:55.839990+0000","last_fullsized":"2023-08-22T00:18:55.839990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.856201+0000","last_change":"2023-08-22T00:18:55.848675+0000","last_active":"2023-08-22T00:18:55.856201+0000","last_peered":"2023-08-22T00:18:55.856201+0000","last_clean":"2023-08-22T00:18:55.856201+0000","last_became_active":"2023-08-22T00:18:55.848415+0000","last_became_peered":"2023-08-22T00:18:55.848415+0000","last_unstale":"2023-08-22T00:18:55.856201+0000","last_undegraded":"2023-08-22T00:18:55.856201+0000","last_fullsized":"2023-08-22T00:18:55.856201+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.847939+0000","last_change":"2023-08-22T00:18:55.474569+0000","last_active":"2023-08-22T00:18:55.847939+0000","last_peered":"2023-08-22T00:18:55.847939+0000","last_clean":"2023-08-22T00:18:55.847939+0000","last_became_active":"2023-08-22T00:18:55.474294+0000","last_became_peered":"2023-08-22T00:18:55.474294+0000","last_unstale":"2023-08-22T00:18:55.847939+0000","last_undegraded":"2023-08-22T00:18:55.847939+0000","last_fullsized":"2023-08-22T00:18:55.847939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861412+0000","last_change":"2023-08-22T00:18:55.852610+0000","last_active":"2023-08-22T00:18:55.861412+0000","last_peered":"2023-08-22T00:18:55.861412+0000","last_clean":"2023-08-22T00:18:55.861412+0000","last_became_active":"2023-08-22T00:18:55.852330+0000","last_became_peered":"2023-08-22T00:18:55.852330+0000","last_unstale":"2023-08-22T00:18:55.861412+0000","last_undegraded":"2023-08-22T00:18:55.861412+0000","last_fullsized":"2023-08-22T00:18:55.861412+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.30","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864202+0000","last_change":"2023-08-22T00:18:55.472850+0000","last_active":"2023-08-22T00:18:55.864202+0000","last_peered":"2023-08-22T00:18:55.864202+0000","last_clean":"2023-08-22T00:18:55.864202+0000","last_became_active":"2023-08-22T00:18:55.472579+0000","last_became_peered":"2023-08-22T00:18:55.472579+0000","last_unstale":"2023-08-22T00:18:55.864202+0000","last_undegraded":"2023-08-22T00:18:55.864202+0000","last_fullsized":"2023-08-22T00:18:55.864202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865408+0000","last_change":"2023-08-22T00:18:55.864461+0000","last_active":"2023-08-22T00:18:55.865408+0000","last_peered":"2023-08-22T00:18:55.865408+0000","last_clean":"2023-08-22T00:18:55.865408+0000","last_became_active":"2023-08-22T00:18:55.864165+0000","last_became_peered":"2023-08-22T00:18:55.864165+0000","last_unstale":"2023-08-22T00:18:55.865408+0000","last_undegraded":"2023-08-22T00:18:55.865408+0000","last_fullsized":"2023-08-22T00:18:55.865408+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.842834+0000","last_change":"2023-08-22T00:18:55.482109+0000","last_active":"2023-08-22T00:18:55.842834+0000","last_peered":"2023-08-22T00:18:55.842834+0000","last_clean":"2023-08-22T00:18:55.842834+0000","last_became_active":"2023-08-22T00:18:55.481859+0000","last_became_peered":"2023-08-22T00:18:55.481859+0000","last_unstale":"2023-08-22T00:18:55.842834+0000","last_undegraded":"2023-08-22T00:18:55.842834+0000","last_fullsized":"2023-08-22T00:18:55.842834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.867145+0000","last_change":"2023-08-22T00:18:55.866280+0000","last_active":"2023-08-22T00:18:55.867145+0000","last_peered":"2023-08-22T00:18:55.867145+0000","last_clean":"2023-08-22T00:18:55.867145+0000","last_became_active":"2023-08-22T00:18:55.866043+0000","last_became_peered":"2023-08-22T00:18:55.866043+0000","last_unstale":"2023-08-22T00:18:55.867145+0000","last_undegraded":"2023-08-22T00:18:55.867145+0000","last_fullsized":"2023-08-22T00:18:55.867145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.849651+0000","last_change":"2023-08-22T00:18:55.480483+0000","last_active":"2023-08-22T00:18:55.849651+0000","last_peered":"2023-08-22T00:18:55.849651+0000","last_clean":"2023-08-22T00:18:55.849651+0000","last_became_active":"2023-08-22T00:18:55.479913+0000","last_became_peered":"2023-08-22T00:18:55.479913+0000","last_unstale":"2023-08-22T00:18:55.849651+0000","last_undegraded":"2023-08-22T00:18:55.849651+0000","last_fullsized":"2023-08-22T00:18:55.849651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.867167+0000","last_change":"2023-08-22T00:18:55.866422+0000","last_active":"2023-08-22T00:18:55.867167+0000","last_peered":"2023-08-22T00:18:55.867167+0000","last_clean":"2023-08-22T00:18:55.867167+0000","last_became_active":"2023-08-22T00:18:55.865558+0000","last_became_peered":"2023-08-22T00:18:55.865558+0000","last_unstale":"2023-08-22T00:18:55.867167+0000","last_undegraded":"2023-08-22T00:18:55.867167+0000","last_fullsized":"2023-08-22T00:18:55.867167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2d","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.862460+0000","last_change":"2023-08-22T00:18:55.480805+0000","last_active":"2023-08-22T00:18:55.862460+0000","last_peered":"2023-08-22T00:18:55.862460+0000","last_clean":"2023-08-22T00:18:55.862460+0000","last_became_active":"2023-08-22T00:18:55.477098+0000","last_became_peered":"2023-08-22T00:18:55.477098+0000","last_unstale":"2023-08-22T00:18:55.862460+0000","last_undegraded":"2023-08-22T00:18:55.862460+0000","last_fullsized":"2023-08-22T00:18:55.862460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.856303+0000","last_change":"2023-08-22T00:18:55.853727+0000","last_active":"2023-08-22T00:18:55.856303+0000","last_peered":"2023-08-22T00:18:55.856303+0000","last_clean":"2023-08-22T00:18:55.856303+0000","last_became_active":"2023-08-22T00:18:55.853475+0000","last_became_peered":"2023-08-22T00:18:55.853475+0000","last_unstale":"2023-08-22T00:18:55.856303+0000","last_undegraded":"2023-08-22T00:18:55.856303+0000","last_fullsized":"2023-08-22T00:18:55.856303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841375+0000","last_change":"2023-08-22T00:18:55.465661+0000","last_active":"2023-08-22T00:18:55.841375+0000","last_peered":"2023-08-22T00:18:55.841375+0000","last_clean":"2023-08-22T00:18:55.841375+0000","last_became_active":"2023-08-22T00:18:55.465374+0000","last_became_peered":"2023-08-22T00:18:55.465374+0000","last_unstale":"2023-08-22T00:18:55.841375+0000","last_undegraded":"2023-08-22T00:18:55.841375+0000","last_fullsized":"2023-08-22T00:18:55.841375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866263+0000","last_change":"2023-08-22T00:18:55.857934+0000","last_active":"2023-08-22T00:18:55.866263+0000","last_peered":"2023-08-22T00:18:55.866263+0000","last_clean":"2023-08-22T00:18:55.866263+0000","last_became_active":"2023-08-22T00:18:55.857689+0000","last_became_peered":"2023-08-22T00:18:55.857689+0000","last_unstale":"2023-08-22T00:18:55.866263+0000","last_undegraded":"2023-08-22T00:18:55.866263+0000","last_fullsized":"2023-08-22T00:18:55.866263+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.862120+0000","last_change":"2023-08-22T00:18:55.475128+0000","last_active":"2023-08-22T00:18:55.862120+0000","last_peered":"2023-08-22T00:18:55.862120+0000","last_clean":"2023-08-22T00:18:55.862120+0000","last_became_active":"2023-08-22T00:18:55.474848+0000","last_became_peered":"2023-08-22T00:18:55.474848+0000","last_unstale":"2023-08-22T00:18:55.862120+0000","last_undegraded":"2023-08-22T00:18:55.862120+0000","last_fullsized":"2023-08-22T00:18:55.862120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864131+0000","last_change":"2023-08-22T00:18:55.862600+0000","last_active":"2023-08-22T00:18:55.864131+0000","last_peered":"2023-08-22T00:18:55.864131+0000","last_clean":"2023-08-22T00:18:55.864131+0000","last_became_active":"2023-08-22T00:18:55.861671+0000","last_became_peered":"2023-08-22T00:18:55.861671+0000","last_unstale":"2023-08-22T00:18:55.864131+0000","last_undegraded":"2023-08-22T00:18:55.864131+0000","last_fullsized":"2023-08-22T00:18:55.864131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848213+0000","last_change":"2023-08-22T00:18:55.482633+0000","last_active":"2023-08-22T00:18:55.848213+0000","last_peered":"2023-08-22T00:18:55.848213+0000","last_clean":"2023-08-22T00:18:55.848213+0000","last_became_active":"2023-08-22T00:18:55.482355+0000","last_became_peered":"2023-08-22T00:18:55.482355+0000","last_unstale":"2023-08-22T00:18:55.848213+0000","last_undegraded":"2023-08-22T00:18:55.848213+0000","last_fullsized":"2023-08-22T00:18:55.848213+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.860354+0000","last_change":"2023-08-22T00:18:55.855409+0000","last_active":"2023-08-22T00:18:55.860354+0000","last_peered":"2023-08-22T00:18:55.860354+0000","last_clean":"2023-08-22T00:18:55.860354+0000","last_became_active":"2023-08-22T00:18:55.855131+0000","last_became_peered":"2023-08-22T00:18:55.855131+0000","last_unstale":"2023-08-22T00:18:55.860354+0000","last_undegraded":"2023-08-22T00:18:55.860354+0000","last_fullsized":"2023-08-22T00:18:55.860354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848064+0000","last_change":"2023-08-22T00:18:55.470457+0000","last_active":"2023-08-22T00:18:55.848064+0000","last_peered":"2023-08-22T00:18:55.848064+0000","last_clean":"2023-08-22T00:18:55.848064+0000","last_became_active":"2023-08-22T00:18:55.468897+0000","last_became_peered":"2023-08-22T00:18:55.468897+0000","last_unstale":"2023-08-22T00:18:55.848064+0000","last_undegraded":"2023-08-22T00:18:55.848064+0000","last_fullsized":"2023-08-22T00:18:55.848064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857218+0000","last_change":"2023-08-22T00:18:55.853925+0000","last_active":"2023-08-22T00:18:55.857218+0000","last_peered":"2023-08-22T00:18:55.857218+0000","last_clean":"2023-08-22T00:18:55.857218+0000","last_became_active":"2023-08-22T00:18:55.853441+0000","last_became_peered":"2023-08-22T00:18:55.853441+0000","last_unstale":"2023-08-22T00:18:55.857218+0000","last_undegraded":"2023-08-22T00:18:55.857218+0000","last_fullsized":"2023-08-22T00:18:55.857218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.840302+0000","last_change":"2023-08-22T00:18:55.471710+0000","last_active":"2023-08-22T00:18:55.840302+0000","last_peered":"2023-08-22T00:18:55.840302+0000","last_clean":"2023-08-22T00:18:55.840302+0000","last_became_active":"2023-08-22T00:18:55.471412+0000","last_became_peered":"2023-08-22T00:18:55.471412+0000","last_unstale":"2023-08-22T00:18:55.840302+0000","last_undegraded":"2023-08-22T00:18:55.840302+0000","last_fullsized":"2023-08-22T00:18:55.840302+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861985+0000","last_change":"2023-08-22T00:18:55.860818+0000","last_active":"2023-08-22T00:18:55.861985+0000","last_peered":"2023-08-22T00:18:55.861985+0000","last_clean":"2023-08-22T00:18:55.861985+0000","last_became_active":"2023-08-22T00:18:55.860563+0000","last_became_peered":"2023-08-22T00:18:55.860563+0000","last_unstale":"2023-08-22T00:18:55.861985+0000","last_undegraded":"2023-08-22T00:18:55.861985+0000","last_fullsized":"2023-08-22T00:18:55.861985+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.842940+0000","last_change":"2023-08-22T00:18:55.479683+0000","last_active":"2023-08-22T00:18:55.842940+0000","last_peered":"2023-08-22T00:18:55.842940+0000","last_clean":"2023-08-22T00:18:55.842940+0000","last_became_active":"2023-08-22T00:18:55.479408+0000","last_became_peered":"2023-08-22T00:18:55.479408+0000","last_unstale":"2023-08-22T00:18:55.842940+0000","last_undegraded":"2023-08-22T00:18:55.842940+0000","last_fullsized":"2023-08-22T00:18:55.842940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863930+0000","last_change":"2023-08-22T00:18:55.862546+0000","last_active":"2023-08-22T00:18:55.863930+0000","last_peered":"2023-08-22T00:18:55.863930+0000","last_clean":"2023-08-22T00:18:55.863930+0000","last_became_active":"2023-08-22T00:18:55.862114+0000","last_became_peered":"2023-08-22T00:18:55.862114+0000","last_unstale":"2023-08-22T00:18:55.863930+0000","last_undegraded":"2023-08-22T00:18:55.863930+0000","last_fullsized":"2023-08-22T00:18:55.863930+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.26","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:56.349127+0000","last_change":"2023-08-22T00:18:55.488392+0000","last_active":"2023-08-22T00:18:56.349127+0000","last_peered":"2023-08-22T00:18:56.349127+0000","last_clean":"2023-08-22T00:18:56.349127+0000","last_became_active":"2023-08-22T00:18:55.485737+0000","last_became_peered":"2023-08-22T00:18:55.485737+0000","last_unstale":"2023-08-22T00:18:56.349127+0000","last_undegraded":"2023-08-22T00:18:56.349127+0000","last_fullsized":"2023-08-22T00:18:56.349127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863456+0000","last_change":"2023-08-22T00:18:55.856841+0000","last_active":"2023-08-22T00:18:55.863456+0000","last_peered":"2023-08-22T00:18:55.863456+0000","last_clean":"2023-08-22T00:18:55.863456+0000","last_became_active":"2023-08-22T00:18:55.856579+0000","last_became_peered":"2023-08-22T00:18:55.856579+0000","last_unstale":"2023-08-22T00:18:55.863456+0000","last_undegraded":"2023-08-22T00:18:55.863456+0000","last_fullsized":"2023-08-22T00:18:55.863456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853202+0000","last_change":"2023-08-22T00:18:55.485810+0000","last_active":"2023-08-22T00:18:55.853202+0000","last_peered":"2023-08-22T00:18:55.853202+0000","last_clean":"2023-08-22T00:18:55.853202+0000","last_became_active":"2023-08-22T00:18:55.485540+0000","last_became_peered":"2023-08-22T00:18:55.485540+0000","last_unstale":"2023-08-22T00:18:55.853202+0000","last_undegraded":"2023-08-22T00:18:55.853202+0000","last_fullsized":"2023-08-22T00:18:55.853202+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863299+0000","last_change":"2023-08-22T00:18:55.856040+0000","last_active":"2023-08-22T00:18:55.863299+0000","last_peered":"2023-08-22T00:18:55.863299+0000","last_clean":"2023-08-22T00:18:55.863299+0000","last_became_active":"2023-08-22T00:18:55.855289+0000","last_became_peered":"2023-08-22T00:18:55.855289+0000","last_unstale":"2023-08-22T00:18:55.863299+0000","last_undegraded":"2023-08-22T00:18:55.863299+0000","last_fullsized":"2023-08-22T00:18:55.863299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841811+0000","last_change":"2023-08-22T00:18:55.469389+0000","last_active":"2023-08-22T00:18:55.841811+0000","last_peered":"2023-08-22T00:18:55.841811+0000","last_clean":"2023-08-22T00:18:55.841811+0000","last_became_active":"2023-08-22T00:18:55.469080+0000","last_became_peered":"2023-08-22T00:18:55.469080+0000","last_unstale":"2023-08-22T00:18:55.841811+0000","last_undegraded":"2023-08-22T00:18:55.841811+0000","last_fullsized":"2023-08-22T00:18:55.841811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863657+0000","last_change":"2023-08-22T00:18:55.862275+0000","last_active":"2023-08-22T00:18:55.863657+0000","last_peered":"2023-08-22T00:18:55.863657+0000","last_clean":"2023-08-22T00:18:55.863657+0000","last_became_active":"2023-08-22T00:18:55.861964+0000","last_became_peered":"2023-08-22T00:18:55.861964+0000","last_unstale":"2023-08-22T00:18:55.863657+0000","last_undegraded":"2023-08-22T00:18:55.863657+0000","last_fullsized":"2023-08-22T00:18:55.863657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.839989+0000","last_change":"2023-08-22T00:18:55.477457+0000","last_active":"2023-08-22T00:18:55.839989+0000","last_peered":"2023-08-22T00:18:55.839989+0000","last_clean":"2023-08-22T00:18:55.839989+0000","last_became_active":"2023-08-22T00:18:55.477165+0000","last_became_peered":"2023-08-22T00:18:55.477165+0000","last_unstale":"2023-08-22T00:18:55.839989+0000","last_undegraded":"2023-08-22T00:18:55.839989+0000","last_fullsized":"2023-08-22T00:18:55.839989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866578+0000","last_change":"2023-08-22T00:18:55.858709+0000","last_active":"2023-08-22T00:18:55.866578+0000","last_peered":"2023-08-22T00:18:55.866578+0000","last_clean":"2023-08-22T00:18:55.866578+0000","last_became_active":"2023-08-22T00:18:55.858368+0000","last_became_peered":"2023-08-22T00:18:55.858368+0000","last_unstale":"2023-08-22T00:18:55.866578+0000","last_undegraded":"2023-08-22T00:18:55.866578+0000","last_fullsized":"2023-08-22T00:18:55.866578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848796+0000","last_change":"2023-08-22T00:18:55.478656+0000","last_active":"2023-08-22T00:18:55.848796+0000","last_peered":"2023-08-22T00:18:55.848796+0000","last_clean":"2023-08-22T00:18:55.848796+0000","last_became_active":"2023-08-22T00:18:55.478369+0000","last_became_peered":"2023-08-22T00:18:55.478369+0000","last_unstale":"2023-08-22T00:18:55.848796+0000","last_undegraded":"2023-08-22T00:18:55.848796+0000","last_fullsized":"2023-08-22T00:18:55.848796+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863084+0000","last_change":"2023-08-22T00:18:55.858957+0000","last_active":"2023-08-22T00:18:55.863084+0000","last_peered":"2023-08-22T00:18:55.863084+0000","last_clean":"2023-08-22T00:18:55.863084+0000","last_became_active":"2023-08-22T00:18:55.856033+0000","last_became_peered":"2023-08-22T00:18:55.856033+0000","last_unstale":"2023-08-22T00:18:55.863084+0000","last_undegraded":"2023-08-22T00:18:55.863084+0000","last_fullsized":"2023-08-22T00:18:55.863084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.839853+0000","last_change":"2023-08-22T00:18:55.484648+0000","last_active":"2023-08-22T00:18:55.839853+0000","last_peered":"2023-08-22T00:18:55.839853+0000","last_clean":"2023-08-22T00:18:55.839853+0000","last_became_active":"2023-08-22T00:18:55.484380+0000","last_became_peered":"2023-08-22T00:18:55.484380+0000","last_unstale":"2023-08-22T00:18:55.839853+0000","last_undegraded":"2023-08-22T00:18:55.839853+0000","last_fullsized":"2023-08-22T00:18:55.839853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863492+0000","last_change":"2023-08-22T00:18:55.858059+0000","last_active":"2023-08-22T00:18:55.863492+0000","last_peered":"2023-08-22T00:18:55.863492+0000","last_clean":"2023-08-22T00:18:55.863492+0000","last_became_active":"2023-08-22T00:18:55.857821+0000","last_became_peered":"2023-08-22T00:18:55.857821+0000","last_unstale":"2023-08-22T00:18:55.863492+0000","last_undegraded":"2023-08-22T00:18:55.863492+0000","last_fullsized":"2023-08-22T00:18:55.863492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844218+0000","last_change":"2023-08-22T00:18:55.476644+0000","last_active":"2023-08-22T00:18:55.844218+0000","last_peered":"2023-08-22T00:18:55.844218+0000","last_clean":"2023-08-22T00:18:55.844218+0000","last_became_active":"2023-08-22T00:18:55.476390+0000","last_became_peered":"2023-08-22T00:18:55.476390+0000","last_unstale":"2023-08-22T00:18:55.844218+0000","last_undegraded":"2023-08-22T00:18:55.844218+0000","last_fullsized":"2023-08-22T00:18:55.844218+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.862240+0000","last_change":"2023-08-22T00:18:55.850992+0000","last_active":"2023-08-22T00:18:55.862240+0000","last_peered":"2023-08-22T00:18:55.862240+0000","last_clean":"2023-08-22T00:18:55.862240+0000","last_became_active":"2023-08-22T00:18:55.850731+0000","last_became_peered":"2023-08-22T00:18:55.850731+0000","last_unstale":"2023-08-22T00:18:55.862240+0000","last_undegraded":"2023-08-22T00:18:55.862240+0000","last_fullsized":"2023-08-22T00:18:55.862240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.859618+0000","last_change":"2023-08-22T00:18:55.481887+0000","last_active":"2023-08-22T00:18:55.859618+0000","last_peered":"2023-08-22T00:18:55.859618+0000","last_clean":"2023-08-22T00:18:55.859618+0000","last_became_active":"2023-08-22T00:18:55.481635+0000","last_became_peered":"2023-08-22T00:18:55.481635+0000","last_unstale":"2023-08-22T00:18:55.859618+0000","last_undegraded":"2023-08-22T00:18:55.859618+0000","last_fullsized":"2023-08-22T00:18:55.859618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865380+0000","last_change":"2023-08-22T00:18:55.862330+0000","last_active":"2023-08-22T00:18:55.865380+0000","last_peered":"2023-08-22T00:18:55.865380+0000","last_clean":"2023-08-22T00:18:55.865380+0000","last_became_active":"2023-08-22T00:18:55.861438+0000","last_became_peered":"2023-08-22T00:18:55.861438+0000","last_unstale":"2023-08-22T00:18:55.865380+0000","last_undegraded":"2023-08-22T00:18:55.865380+0000","last_fullsized":"2023-08-22T00:18:55.865380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.850995+0000","last_change":"2023-08-22T00:18:55.481485+0000","last_active":"2023-08-22T00:18:55.850995+0000","last_peered":"2023-08-22T00:18:55.850995+0000","last_clean":"2023-08-22T00:18:55.850995+0000","last_became_active":"2023-08-22T00:18:55.481110+0000","last_became_peered":"2023-08-22T00:18:55.481110+0000","last_unstale":"2023-08-22T00:18:55.850995+0000","last_undegraded":"2023-08-22T00:18:55.850995+0000","last_fullsized":"2023-08-22T00:18:55.850995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863393+0000","last_change":"2023-08-22T00:18:55.861905+0000","last_active":"2023-08-22T00:18:55.863393+0000","last_peered":"2023-08-22T00:18:55.863393+0000","last_clean":"2023-08-22T00:18:55.863393+0000","last_became_active":"2023-08-22T00:18:55.861310+0000","last_became_peered":"2023-08-22T00:18:55.861310+0000","last_unstale":"2023-08-22T00:18:55.863393+0000","last_undegraded":"2023-08-22T00:18:55.863393+0000","last_fullsized":"2023-08-22T00:18:55.863393+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.860153+0000","last_change":"2023-08-22T00:18:55.481117+0000","last_active":"2023-08-22T00:18:55.860153+0000","last_peered":"2023-08-22T00:18:55.860153+0000","last_clean":"2023-08-22T00:18:55.860153+0000","last_became_active":"2023-08-22T00:18:55.480847+0000","last_became_peered":"2023-08-22T00:18:55.480847+0000","last_unstale":"2023-08-22T00:18:55.860153+0000","last_undegraded":"2023-08-22T00:18:55.860153+0000","last_fullsized":"2023-08-22T00:18:55.860153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863318+0000","last_change":"2023-08-22T00:18:55.856187+0000","last_active":"2023-08-22T00:18:55.863318+0000","last_peered":"2023-08-22T00:18:55.863318+0000","last_clean":"2023-08-22T00:18:55.863318+0000","last_became_active":"2023-08-22T00:18:55.855570+0000","last_became_peered":"2023-08-22T00:18:55.855570+0000","last_unstale":"2023-08-22T00:18:55.863318+0000","last_undegraded":"2023-08-22T00:18:55.863318+0000","last_fullsized":"2023-08-22T00:18:55.863318+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.845411+0000","last_change":"2023-08-22T00:18:55.482429+0000","last_active":"2023-08-22T00:18:55.845411+0000","last_peered":"2023-08-22T00:18:55.845411+0000","last_clean":"2023-08-22T00:18:55.845411+0000","last_became_active":"2023-08-22T00:18:55.481752+0000","last_became_peered":"2023-08-22T00:18:55.481752+0000","last_unstale":"2023-08-22T00:18:55.845411+0000","last_undegraded":"2023-08-22T00:18:55.845411+0000","last_fullsized":"2023-08-22T00:18:55.845411+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866067+0000","last_change":"2023-08-22T00:18:55.855898+0000","last_active":"2023-08-22T00:18:55.866067+0000","last_peered":"2023-08-22T00:18:55.866067+0000","last_clean":"2023-08-22T00:18:55.866067+0000","last_became_active":"2023-08-22T00:18:55.855698+0000","last_became_peered":"2023-08-22T00:18:55.855698+0000","last_unstale":"2023-08-22T00:18:55.866067+0000","last_undegraded":"2023-08-22T00:18:55.866067+0000","last_fullsized":"2023-08-22T00:18:55.866067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.839245+0000","last_change":"2023-08-22T00:18:55.471284+0000","last_active":"2023-08-22T00:18:55.839245+0000","last_peered":"2023-08-22T00:18:55.839245+0000","last_clean":"2023-08-22T00:18:55.839245+0000","last_became_active":"2023-08-22T00:18:55.470992+0000","last_became_peered":"2023-08-22T00:18:55.470992+0000","last_unstale":"2023-08-22T00:18:55.839245+0000","last_undegraded":"2023-08-22T00:18:55.839245+0000","last_fullsized":"2023-08-22T00:18:55.839245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866558+0000","last_change":"2023-08-22T00:18:55.856907+0000","last_active":"2023-08-22T00:18:55.866558+0000","last_peered":"2023-08-22T00:18:55.866558+0000","last_clean":"2023-08-22T00:18:55.866558+0000","last_became_active":"2023-08-22T00:18:55.856644+0000","last_became_peered":"2023-08-22T00:18:55.856644+0000","last_unstale":"2023-08-22T00:18:55.866558+0000","last_undegraded":"2023-08-22T00:18:55.866558+0000","last_fullsized":"2023-08-22T00:18:55.866558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.840132+0000","last_change":"2023-08-22T00:18:55.477743+0000","last_active":"2023-08-22T00:18:55.840132+0000","last_peered":"2023-08-22T00:18:55.840132+0000","last_clean":"2023-08-22T00:18:55.840132+0000","last_became_active":"2023-08-22T00:18:55.477325+0000","last_became_peered":"2023-08-22T00:18:55.477325+0000","last_unstale":"2023-08-22T00:18:55.840132+0000","last_undegraded":"2023-08-22T00:18:55.840132+0000","last_fullsized":"2023-08-22T00:18:55.840132+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.860320+0000","last_change":"2023-08-22T00:18:55.853632+0000","last_active":"2023-08-22T00:18:55.860320+0000","last_peered":"2023-08-22T00:18:55.860320+0000","last_clean":"2023-08-22T00:18:55.860320+0000","last_became_active":"2023-08-22T00:18:55.853387+0000","last_became_peered":"2023-08-22T00:18:55.853387+0000","last_unstale":"2023-08-22T00:18:55.860320+0000","last_undegraded":"2023-08-22T00:18:55.860320+0000","last_fullsized":"2023-08-22T00:18:55.860320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844524+0000","last_change":"2023-08-22T00:18:55.477982+0000","last_active":"2023-08-22T00:18:55.844524+0000","last_peered":"2023-08-22T00:18:55.844524+0000","last_clean":"2023-08-22T00:18:55.844524+0000","last_became_active":"2023-08-22T00:18:55.477708+0000","last_became_peered":"2023-08-22T00:18:55.477708+0000","last_unstale":"2023-08-22T00:18:55.844524+0000","last_undegraded":"2023-08-22T00:18:55.844524+0000","last_fullsized":"2023-08-22T00:18:55.844524+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.867141+0000","last_change":"2023-08-22T00:18:55.866255+0000","last_active":"2023-08-22T00:18:55.867141+0000","last_peered":"2023-08-22T00:18:55.867141+0000","last_clean":"2023-08-22T00:18:55.867141+0000","last_became_active":"2023-08-22T00:18:55.865816+0000","last_became_peered":"2023-08-22T00:18:55.865816+0000","last_unstale":"2023-08-22T00:18:55.867141+0000","last_undegraded":"2023-08-22T00:18:55.867141+0000","last_fullsized":"2023-08-22T00:18:55.867141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.840627+0000","last_change":"2023-08-22T00:18:55.473952+0000","last_active":"2023-08-22T00:18:55.840627+0000","last_peered":"2023-08-22T00:18:55.840627+0000","last_clean":"2023-08-22T00:18:55.840627+0000","last_became_active":"2023-08-22T00:18:55.473679+0000","last_became_peered":"2023-08-22T00:18:55.473679+0000","last_unstale":"2023-08-22T00:18:55.840627+0000","last_undegraded":"2023-08-22T00:18:55.840627+0000","last_fullsized":"2023-08-22T00:18:55.840627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861507+0000","last_change":"2023-08-22T00:18:55.854744+0000","last_active":"2023-08-22T00:18:55.861507+0000","last_peered":"2023-08-22T00:18:55.861507+0000","last_clean":"2023-08-22T00:18:55.861507+0000","last_became_active":"2023-08-22T00:18:55.854462+0000","last_became_peered":"2023-08-22T00:18:55.854462+0000","last_unstale":"2023-08-22T00:18:55.861507+0000","last_undegraded":"2023-08-22T00:18:55.861507+0000","last_fullsized":"2023-08-22T00:18:55.861507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.849504+0000","last_change":"2023-08-22T00:18:55.477806+0000","last_active":"2023-08-22T00:18:55.849504+0000","last_peered":"2023-08-22T00:18:55.849504+0000","last_clean":"2023-08-22T00:18:55.849504+0000","last_became_active":"2023-08-22T00:18:55.477506+0000","last_became_peered":"2023-08-22T00:18:55.477506+0000","last_unstale":"2023-08-22T00:18:55.849504+0000","last_undegraded":"2023-08-22T00:18:55.849504+0000","last_fullsized":"2023-08-22T00:18:55.849504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.872915+0000","last_change":"2023-08-22T00:18:55.872277+0000","last_active":"2023-08-22T00:18:55.872915+0000","last_peered":"2023-08-22T00:18:55.872915+0000","last_clean":"2023-08-22T00:18:55.872915+0000","last_became_active":"2023-08-22T00:18:55.872009+0000","last_became_peered":"2023-08-22T00:18:55.872009+0000","last_unstale":"2023-08-22T00:18:55.872915+0000","last_undegraded":"2023-08-22T00:18:55.872915+0000","last_fullsized":"2023-08-22T00:18:55.872915+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.845051+0000","last_change":"2023-08-22T00:18:55.488214+0000","last_active":"2023-08-22T00:18:55.845051+0000","last_peered":"2023-08-22T00:18:55.845051+0000","last_clean":"2023-08-22T00:18:55.845051+0000","last_became_active":"2023-08-22T00:18:55.485421+0000","last_became_peered":"2023-08-22T00:18:55.485421+0000","last_unstale":"2023-08-22T00:18:55.845051+0000","last_undegraded":"2023-08-22T00:18:55.845051+0000","last_fullsized":"2023-08-22T00:18:55.845051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864493+0000","last_change":"2023-08-22T00:18:55.859603+0000","last_active":"2023-08-22T00:18:55.864493+0000","last_peered":"2023-08-22T00:18:55.864493+0000","last_clean":"2023-08-22T00:18:55.864493+0000","last_became_active":"2023-08-22T00:18:55.859326+0000","last_became_peered":"2023-08-22T00:18:55.859326+0000","last_unstale":"2023-08-22T00:18:55.864493+0000","last_undegraded":"2023-08-22T00:18:55.864493+0000","last_fullsized":"2023-08-22T00:18:55.864493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"70'3","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.872432+0000","last_change":"2023-08-22T00:18:55.480300+0000","last_active":"2023-08-22T00:18:55.872432+0000","last_peered":"2023-08-22T00:18:55.872432+0000","last_clean":"2023-08-22T00:18:55.872432+0000","last_became_active":"2023-08-22T00:18:55.480038+0000","last_became_peered":"2023-08-22T00:18:55.480038+0000","last_unstale":"2023-08-22T00:18:55.872432+0000","last_undegraded":"2023-08-22T00:18:55.872432+0000","last_fullsized":"2023-08-22T00:18:55.872432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.872917+0000","last_change":"2023-08-22T00:18:55.872269+0000","last_active":"2023-08-22T00:18:55.872917+0000","last_peered":"2023-08-22T00:18:55.872917+0000","last_clean":"2023-08-22T00:18:55.872917+0000","last_became_active":"2023-08-22T00:18:55.872039+0000","last_became_peered":"2023-08-22T00:18:55.872039+0000","last_unstale":"2023-08-22T00:18:55.872917+0000","last_undegraded":"2023-08-22T00:18:55.872917+0000","last_fullsized":"2023-08-22T00:18:55.872917+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.865074+0000","last_change":"2023-08-22T00:18:55.475835+0000","last_active":"2023-08-22T00:18:55.865074+0000","last_peered":"2023-08-22T00:18:55.865074+0000","last_clean":"2023-08-22T00:18:55.865074+0000","last_became_active":"2023-08-22T00:18:55.475552+0000","last_became_peered":"2023-08-22T00:18:55.475552+0000","last_unstale":"2023-08-22T00:18:55.865074+0000","last_undegraded":"2023-08-22T00:18:55.865074+0000","last_fullsized":"2023-08-22T00:18:55.865074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861624+0000","last_change":"2023-08-22T00:18:55.859854+0000","last_active":"2023-08-22T00:18:55.861624+0000","last_peered":"2023-08-22T00:18:55.861624+0000","last_clean":"2023-08-22T00:18:55.861624+0000","last_became_active":"2023-08-22T00:18:55.859509+0000","last_became_peered":"2023-08-22T00:18:55.859509+0000","last_unstale":"2023-08-22T00:18:55.861624+0000","last_undegraded":"2023-08-22T00:18:55.861624+0000","last_fullsized":"2023-08-22T00:18:55.861624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.856934+0000","last_change":"2023-08-22T00:18:55.488541+0000","last_active":"2023-08-22T00:18:55.856934+0000","last_peered":"2023-08-22T00:18:55.856934+0000","last_clean":"2023-08-22T00:18:55.856934+0000","last_became_active":"2023-08-22T00:18:55.488225+0000","last_became_peered":"2023-08-22T00:18:55.488225+0000","last_unstale":"2023-08-22T00:18:55.856934+0000","last_undegraded":"2023-08-22T00:18:55.856934+0000","last_fullsized":"2023-08-22T00:18:55.856934+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864151+0000","last_change":"2023-08-22T00:18:55.862688+0000","last_active":"2023-08-22T00:18:55.864151+0000","last_peered":"2023-08-22T00:18:55.864151+0000","last_clean":"2023-08-22T00:18:55.864151+0000","last_became_active":"2023-08-22T00:18:55.862295+0000","last_became_peered":"2023-08-22T00:18:55.862295+0000","last_unstale":"2023-08-22T00:18:55.864151+0000","last_undegraded":"2023-08-22T00:18:55.864151+0000","last_fullsized":"2023-08-22T00:18:55.864151+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841287+0000","last_change":"2023-08-22T00:18:55.474772+0000","last_active":"2023-08-22T00:18:55.841287+0000","last_peered":"2023-08-22T00:18:55.841287+0000","last_clean":"2023-08-22T00:18:55.841287+0000","last_became_active":"2023-08-22T00:18:55.474470+0000","last_became_peered":"2023-08-22T00:18:55.474470+0000","last_unstale":"2023-08-22T00:18:55.841287+0000","last_undegraded":"2023-08-22T00:18:55.841287+0000","last_fullsized":"2023-08-22T00:18:55.841287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861569+0000","last_change":"2023-08-22T00:18:55.854845+0000","last_active":"2023-08-22T00:18:55.861569+0000","last_peered":"2023-08-22T00:18:55.861569+0000","last_clean":"2023-08-22T00:18:55.861569+0000","last_became_active":"2023-08-22T00:18:55.851687+0000","last_became_peered":"2023-08-22T00:18:55.851687+0000","last_unstale":"2023-08-22T00:18:55.861569+0000","last_undegraded":"2023-08-22T00:18:55.861569+0000","last_fullsized":"2023-08-22T00:18:55.861569+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844616+0000","last_change":"2023-08-22T00:18:55.481656+0000","last_active":"2023-08-22T00:18:55.844616+0000","last_peered":"2023-08-22T00:18:55.844616+0000","last_clean":"2023-08-22T00:18:55.844616+0000","last_became_active":"2023-08-22T00:18:55.481275+0000","last_became_peered":"2023-08-22T00:18:55.481275+0000","last_unstale":"2023-08-22T00:18:55.844616+0000","last_undegraded":"2023-08-22T00:18:55.844616+0000","last_fullsized":"2023-08-22T00:18:55.844616+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857240+0000","last_change":"2023-08-22T00:18:55.854065+0000","last_active":"2023-08-22T00:18:55.857240+0000","last_peered":"2023-08-22T00:18:55.857240+0000","last_clean":"2023-08-22T00:18:55.857240+0000","last_became_active":"2023-08-22T00:18:55.853802+0000","last_became_peered":"2023-08-22T00:18:55.853802+0000","last_unstale":"2023-08-22T00:18:55.857240+0000","last_undegraded":"2023-08-22T00:18:55.857240+0000","last_fullsized":"2023-08-22T00:18:55.857240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.860798+0000","last_change":"2023-08-22T00:18:55.479233+0000","last_active":"2023-08-22T00:18:55.860798+0000","last_peered":"2023-08-22T00:18:55.860798+0000","last_clean":"2023-08-22T00:18:55.860798+0000","last_became_active":"2023-08-22T00:18:55.478969+0000","last_became_peered":"2023-08-22T00:18:55.478969+0000","last_unstale":"2023-08-22T00:18:55.860798+0000","last_undegraded":"2023-08-22T00:18:55.860798+0000","last_fullsized":"2023-08-22T00:18:55.860798+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861541+0000","last_change":"2023-08-22T00:18:55.856599+0000","last_active":"2023-08-22T00:18:55.861541+0000","last_peered":"2023-08-22T00:18:55.861541+0000","last_clean":"2023-08-22T00:18:55.861541+0000","last_became_active":"2023-08-22T00:18:55.856261+0000","last_became_peered":"2023-08-22T00:18:55.856261+0000","last_unstale":"2023-08-22T00:18:55.861541+0000","last_undegraded":"2023-08-22T00:18:55.861541+0000","last_fullsized":"2023-08-22T00:18:55.861541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866850+0000","last_change":"2023-08-22T00:18:55.473900+0000","last_active":"2023-08-22T00:18:55.866850+0000","last_peered":"2023-08-22T00:18:55.866850+0000","last_clean":"2023-08-22T00:18:55.866850+0000","last_became_active":"2023-08-22T00:18:55.473631+0000","last_became_peered":"2023-08-22T00:18:55.473631+0000","last_unstale":"2023-08-22T00:18:55.866850+0000","last_undegraded":"2023-08-22T00:18:55.866850+0000","last_fullsized":"2023-08-22T00:18:55.866850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857575+0000","last_change":"2023-08-22T00:18:55.855901+0000","last_active":"2023-08-22T00:18:55.857575+0000","last_peered":"2023-08-22T00:18:55.857575+0000","last_clean":"2023-08-22T00:18:55.857575+0000","last_became_active":"2023-08-22T00:18:55.855455+0000","last_became_peered":"2023-08-22T00:18:55.855455+0000","last_unstale":"2023-08-22T00:18:55.857575+0000","last_undegraded":"2023-08-22T00:18:55.857575+0000","last_fullsized":"2023-08-22T00:18:55.857575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841853+0000","last_change":"2023-08-22T00:18:55.476802+0000","last_active":"2023-08-22T00:18:55.841853+0000","last_peered":"2023-08-22T00:18:55.841853+0000","last_clean":"2023-08-22T00:18:55.841853+0000","last_became_active":"2023-08-22T00:18:55.476510+0000","last_became_peered":"2023-08-22T00:18:55.476510+0000","last_unstale":"2023-08-22T00:18:55.841853+0000","last_undegraded":"2023-08-22T00:18:55.841853+0000","last_fullsized":"2023-08-22T00:18:55.841853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864510+0000","last_change":"2023-08-22T00:18:55.860057+0000","last_active":"2023-08-22T00:18:55.864510+0000","last_peered":"2023-08-22T00:18:55.864510+0000","last_clean":"2023-08-22T00:18:55.864510+0000","last_became_active":"2023-08-22T00:18:55.859781+0000","last_became_peered":"2023-08-22T00:18:55.859781+0000","last_unstale":"2023-08-22T00:18:55.864510+0000","last_undegraded":"2023-08-22T00:18:55.864510+0000","last_fullsized":"2023-08-22T00:18:55.864510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.842026+0000","last_change":"2023-08-22T00:18:55.466978+0000","last_active":"2023-08-22T00:18:55.842026+0000","last_peered":"2023-08-22T00:18:55.842026+0000","last_clean":"2023-08-22T00:18:55.842026+0000","last_became_active":"2023-08-22T00:18:55.466705+0000","last_became_peered":"2023-08-22T00:18:55.466705+0000","last_unstale":"2023-08-22T00:18:55.842026+0000","last_undegraded":"2023-08-22T00:18:55.842026+0000","last_fullsized":"2023-08-22T00:18:55.842026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.863335+0000","last_change":"2023-08-22T00:18:55.859868+0000","last_active":"2023-08-22T00:18:55.863335+0000","last_peered":"2023-08-22T00:18:55.863335+0000","last_clean":"2023-08-22T00:18:55.863335+0000","last_became_active":"2023-08-22T00:18:55.855836+0000","last_became_peered":"2023-08-22T00:18:55.855836+0000","last_unstale":"2023-08-22T00:18:55.863335+0000","last_undegraded":"2023-08-22T00:18:55.863335+0000","last_fullsized":"2023-08-22T00:18:55.863335+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.845317+0000","last_change":"2023-08-22T00:18:55.482618+0000","last_active":"2023-08-22T00:18:55.845317+0000","last_peered":"2023-08-22T00:18:55.845317+0000","last_clean":"2023-08-22T00:18:55.845317+0000","last_became_active":"2023-08-22T00:18:55.482137+0000","last_became_peered":"2023-08-22T00:18:55.482137+0000","last_unstale":"2023-08-22T00:18:55.845317+0000","last_undegraded":"2023-08-22T00:18:55.845317+0000","last_fullsized":"2023-08-22T00:18:55.845317+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866693+0000","last_change":"2023-08-22T00:18:55.859598+0000","last_active":"2023-08-22T00:18:55.866693+0000","last_peered":"2023-08-22T00:18:55.866693+0000","last_clean":"2023-08-22T00:18:55.866693+0000","last_became_active":"2023-08-22T00:18:55.859331+0000","last_became_peered":"2023-08-22T00:18:55.859331+0000","last_unstale":"2023-08-22T00:18:55.866693+0000","last_undegraded":"2023-08-22T00:18:55.866693+0000","last_fullsized":"2023-08-22T00:18:55.866693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851041+0000","last_change":"2023-08-22T00:18:55.478235+0000","last_active":"2023-08-22T00:18:55.851041+0000","last_peered":"2023-08-22T00:18:55.851041+0000","last_clean":"2023-08-22T00:18:55.851041+0000","last_became_active":"2023-08-22T00:18:55.477967+0000","last_became_peered":"2023-08-22T00:18:55.477967+0000","last_unstale":"2023-08-22T00:18:55.851041+0000","last_undegraded":"2023-08-22T00:18:55.851041+0000","last_fullsized":"2023-08-22T00:18:55.851041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.857270+0000","last_change":"2023-08-22T00:18:55.855370+0000","last_active":"2023-08-22T00:18:55.857270+0000","last_peered":"2023-08-22T00:18:55.857270+0000","last_clean":"2023-08-22T00:18:55.857270+0000","last_became_active":"2023-08-22T00:18:55.855134+0000","last_became_peered":"2023-08-22T00:18:55.855134+0000","last_unstale":"2023-08-22T00:18:55.857270+0000","last_undegraded":"2023-08-22T00:18:55.857270+0000","last_fullsized":"2023-08-22T00:18:55.857270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.838904+0000","last_change":"2023-08-22T00:18:55.481980+0000","last_active":"2023-08-22T00:18:55.838904+0000","last_peered":"2023-08-22T00:18:55.838904+0000","last_clean":"2023-08-22T00:18:55.838904+0000","last_became_active":"2023-08-22T00:18:55.475593+0000","last_became_peered":"2023-08-22T00:18:55.475593+0000","last_unstale":"2023-08-22T00:18:55.838904+0000","last_undegraded":"2023-08-22T00:18:55.838904+0000","last_fullsized":"2023-08-22T00:18:55.838904+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864239+0000","last_change":"2023-08-22T00:18:55.857835+0000","last_active":"2023-08-22T00:18:55.864239+0000","last_peered":"2023-08-22T00:18:55.864239+0000","last_clean":"2023-08-22T00:18:55.864239+0000","last_became_active":"2023-08-22T00:18:55.857582+0000","last_became_peered":"2023-08-22T00:18:55.857582+0000","last_unstale":"2023-08-22T00:18:55.864239+0000","last_undegraded":"2023-08-22T00:18:55.864239+0000","last_fullsized":"2023-08-22T00:18:55.864239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851476+0000","last_change":"2023-08-22T00:18:55.476426+0000","last_active":"2023-08-22T00:18:55.851476+0000","last_peered":"2023-08-22T00:18:55.851476+0000","last_clean":"2023-08-22T00:18:55.851476+0000","last_became_active":"2023-08-22T00:18:55.476148+0000","last_became_peered":"2023-08-22T00:18:55.476148+0000","last_unstale":"2023-08-22T00:18:55.851476+0000","last_undegraded":"2023-08-22T00:18:55.851476+0000","last_fullsized":"2023-08-22T00:18:55.851476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866663+0000","last_change":"2023-08-22T00:18:55.858624+0000","last_active":"2023-08-22T00:18:55.866663+0000","last_peered":"2023-08-22T00:18:55.866663+0000","last_clean":"2023-08-22T00:18:55.866663+0000","last_became_active":"2023-08-22T00:18:55.858232+0000","last_became_peered":"2023-08-22T00:18:55.858232+0000","last_unstale":"2023-08-22T00:18:55.866663+0000","last_undegraded":"2023-08-22T00:18:55.866663+0000","last_fullsized":"2023-08-22T00:18:55.866663+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.846488+0000","last_change":"2023-08-22T00:18:55.484462+0000","last_active":"2023-08-22T00:18:55.846488+0000","last_peered":"2023-08-22T00:18:55.846488+0000","last_clean":"2023-08-22T00:18:55.846488+0000","last_became_active":"2023-08-22T00:18:55.484020+0000","last_became_peered":"2023-08-22T00:18:55.484020+0000","last_unstale":"2023-08-22T00:18:55.846488+0000","last_undegraded":"2023-08-22T00:18:55.846488+0000","last_fullsized":"2023-08-22T00:18:55.846488+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866170+0000","last_change":"2023-08-22T00:18:55.863556+0000","last_active":"2023-08-22T00:18:55.866170+0000","last_peered":"2023-08-22T00:18:55.866170+0000","last_clean":"2023-08-22T00:18:55.866170+0000","last_became_active":"2023-08-22T00:18:55.863286+0000","last_became_peered":"2023-08-22T00:18:55.863286+0000","last_unstale":"2023-08-22T00:18:55.866170+0000","last_undegraded":"2023-08-22T00:18:55.866170+0000","last_fullsized":"2023-08-22T00:18:55.866170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.855858+0000","last_change":"2023-08-22T00:18:55.488181+0000","last_active":"2023-08-22T00:18:55.855858+0000","last_peered":"2023-08-22T00:18:55.855858+0000","last_clean":"2023-08-22T00:18:55.855858+0000","last_became_active":"2023-08-22T00:18:55.487911+0000","last_became_peered":"2023-08-22T00:18:55.487911+0000","last_unstale":"2023-08-22T00:18:55.855858+0000","last_undegraded":"2023-08-22T00:18:55.855858+0000","last_fullsized":"2023-08-22T00:18:55.855858+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853965+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:18:55.853965+0000","last_peered":"2023-08-22T00:18:55.853965+0000","last_clean":"2023-08-22T00:18:55.853965+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:18:55.853965+0000","last_undegraded":"2023-08-22T00:18:55.853965+0000","last_fullsized":"2023-08-22T00:18:55.853965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.855835+0000","last_change":"2023-08-22T00:18:55.847129+0000","last_active":"2023-08-22T00:18:55.855835+0000","last_peered":"2023-08-22T00:18:55.855835+0000","last_clean":"2023-08-22T00:18:55.855835+0000","last_became_active":"2023-08-22T00:18:55.846872+0000","last_became_peered":"2023-08-22T00:18:55.846872+0000","last_unstale":"2023-08-22T00:18:55.855835+0000","last_undegraded":"2023-08-22T00:18:55.855835+0000","last_fullsized":"2023-08-22T00:18:55.855835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844322+0000","last_change":"2023-08-22T00:18:55.476580+0000","last_active":"2023-08-22T00:18:55.844322+0000","last_peered":"2023-08-22T00:18:55.844322+0000","last_clean":"2023-08-22T00:18:55.844322+0000","last_became_active":"2023-08-22T00:18:55.476082+0000","last_became_peered":"2023-08-22T00:18:55.476082+0000","last_unstale":"2023-08-22T00:18:55.844322+0000","last_undegraded":"2023-08-22T00:18:55.844322+0000","last_fullsized":"2023-08-22T00:18:55.844322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844865+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:18:55.844865+0000","last_peered":"2023-08-22T00:18:55.844865+0000","last_clean":"2023-08-22T00:18:55.844865+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:18:55.844865+0000","last_undegraded":"2023-08-22T00:18:55.844865+0000","last_fullsized":"2023-08-22T00:18:55.844865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.861606+0000","last_change":"2023-08-22T00:18:55.859653+0000","last_active":"2023-08-22T00:18:55.861606+0000","last_peered":"2023-08-22T00:18:55.861606+0000","last_clean":"2023-08-22T00:18:55.861606+0000","last_became_active":"2023-08-22T00:18:55.859301+0000","last_became_peered":"2023-08-22T00:18:55.859301+0000","last_unstale":"2023-08-22T00:18:55.861606+0000","last_undegraded":"2023-08-22T00:18:55.861606+0000","last_fullsized":"2023-08-22T00:18:55.861606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.858897+0000","last_change":"2023-08-22T00:18:55.484853+0000","last_active":"2023-08-22T00:18:55.858897+0000","last_peered":"2023-08-22T00:18:55.858897+0000","last_clean":"2023-08-22T00:18:55.858897+0000","last_became_active":"2023-08-22T00:18:55.484594+0000","last_became_peered":"2023-08-22T00:18:55.484594+0000","last_unstale":"2023-08-22T00:18:55.858897+0000","last_undegraded":"2023-08-22T00:18:55.858897+0000","last_fullsized":"2023-08-22T00:18:55.858897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848142+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:18:55.848142+0000","last_peered":"2023-08-22T00:18:55.848142+0000","last_clean":"2023-08-22T00:18:55.848142+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:18:55.848142+0000","last_undegraded":"2023-08-22T00:18:55.848142+0000","last_fullsized":"2023-08-22T00:18:55.848142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866746+0000","last_change":"2023-08-22T00:18:55.865767+0000","last_active":"2023-08-22T00:18:55.866746+0000","last_peered":"2023-08-22T00:18:55.866746+0000","last_clean":"2023-08-22T00:18:55.866746+0000","last_became_active":"2023-08-22T00:18:55.865472+0000","last_became_peered":"2023-08-22T00:18:55.865472+0000","last_unstale":"2023-08-22T00:18:55.866746+0000","last_undegraded":"2023-08-22T00:18:55.866746+0000","last_fullsized":"2023-08-22T00:18:55.866746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841411+0000","last_change":"2023-08-22T00:18:55.478739+0000","last_active":"2023-08-22T00:18:55.841411+0000","last_peered":"2023-08-22T00:18:55.841411+0000","last_clean":"2023-08-22T00:18:55.841411+0000","last_became_active":"2023-08-22T00:18:55.478446+0000","last_became_peered":"2023-08-22T00:18:55.478446+0000","last_unstale":"2023-08-22T00:18:55.841411+0000","last_undegraded":"2023-08-22T00:18:55.841411+0000","last_fullsized":"2023-08-22T00:18:55.841411+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.844971+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:18:55.844971+0000","last_peered":"2023-08-22T00:18:55.844971+0000","last_clean":"2023-08-22T00:18:55.844971+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:18:55.844971+0000","last_undegraded":"2023-08-22T00:18:55.844971+0000","last_fullsized":"2023-08-22T00:18:55.844971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848570+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:18:55.848570+0000","last_peered":"2023-08-22T00:18:55.848570+0000","last_clean":"2023-08-22T00:18:55.848570+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:18:55.848570+0000","last_undegraded":"2023-08-22T00:18:55.848570+0000","last_fullsized":"2023-08-22T00:18:55.848570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.862321+0000","last_change":"2023-08-22T00:18:55.851644+0000","last_active":"2023-08-22T00:18:55.862321+0000","last_peered":"2023-08-22T00:18:55.862321+0000","last_clean":"2023-08-22T00:18:55.862321+0000","last_became_active":"2023-08-22T00:18:55.851399+0000","last_became_peered":"2023-08-22T00:18:55.851399+0000","last_unstale":"2023-08-22T00:18:55.862321+0000","last_undegraded":"2023-08-22T00:18:55.862321+0000","last_fullsized":"2023-08-22T00:18:55.862321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.853547+0000","last_change":"2023-08-22T00:18:55.480708+0000","last_active":"2023-08-22T00:18:55.853547+0000","last_peered":"2023-08-22T00:18:55.853547+0000","last_clean":"2023-08-22T00:18:55.853547+0000","last_became_active":"2023-08-22T00:18:55.480419+0000","last_became_peered":"2023-08-22T00:18:55.480419+0000","last_unstale":"2023-08-22T00:18:55.853547+0000","last_undegraded":"2023-08-22T00:18:55.853547+0000","last_fullsized":"2023-08-22T00:18:55.853547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.848493+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:18:55.848493+0000","last_peered":"2023-08-22T00:18:55.848493+0000","last_clean":"2023-08-22T00:18:55.848493+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:18:55.848493+0000","last_undegraded":"2023-08-22T00:18:55.848493+0000","last_fullsized":"2023-08-22T00:18:55.848493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.864368+0000","last_change":"2023-08-22T00:18:55.862573+0000","last_active":"2023-08-22T00:18:55.864368+0000","last_peered":"2023-08-22T00:18:55.864368+0000","last_clean":"2023-08-22T00:18:55.864368+0000","last_became_active":"2023-08-22T00:18:55.862264+0000","last_became_peered":"2023-08-22T00:18:55.862264+0000","last_unstale":"2023-08-22T00:18:55.864368+0000","last_undegraded":"2023-08-22T00:18:55.864368+0000","last_fullsized":"2023-08-22T00:18:55.864368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.858408+0000","last_change":"2023-08-22T00:18:55.485440+0000","last_active":"2023-08-22T00:18:55.858408+0000","last_peered":"2023-08-22T00:18:55.858408+0000","last_clean":"2023-08-22T00:18:55.858408+0000","last_became_active":"2023-08-22T00:18:55.485186+0000","last_became_peered":"2023-08-22T00:18:55.485186+0000","last_unstale":"2023-08-22T00:18:55.858408+0000","last_undegraded":"2023-08-22T00:18:55.858408+0000","last_fullsized":"2023-08-22T00:18:55.858408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.849902+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:18:55.849902+0000","last_peered":"2023-08-22T00:18:55.849902+0000","last_clean":"2023-08-22T00:18:55.849902+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:18:55.849902+0000","last_undegraded":"2023-08-22T00:18:55.849902+0000","last_fullsized":"2023-08-22T00:18:55.849902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.872897+0000","last_change":"2023-08-22T00:18:55.872226+0000","last_active":"2023-08-22T00:18:55.872897+0000","last_peered":"2023-08-22T00:18:55.872897+0000","last_clean":"2023-08-22T00:18:55.872897+0000","last_became_active":"2023-08-22T00:18:55.871947+0000","last_became_peered":"2023-08-22T00:18:55.871947+0000","last_unstale":"2023-08-22T00:18:55.872897+0000","last_undegraded":"2023-08-22T00:18:55.872897+0000","last_fullsized":"2023-08-22T00:18:55.872897+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841839+0000","last_change":"2023-08-22T00:18:55.479392+0000","last_active":"2023-08-22T00:18:55.841839+0000","last_peered":"2023-08-22T00:18:55.841839+0000","last_clean":"2023-08-22T00:18:55.841839+0000","last_became_active":"2023-08-22T00:18:55.479118+0000","last_became_peered":"2023-08-22T00:18:55.479118+0000","last_unstale":"2023-08-22T00:18:55.841839+0000","last_undegraded":"2023-08-22T00:18:55.841839+0000","last_fullsized":"2023-08-22T00:18:55.841839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.851299+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:18:55.851299+0000","last_peered":"2023-08-22T00:18:55.851299+0000","last_clean":"2023-08-22T00:18:55.851299+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:18:55.851299+0000","last_undegraded":"2023-08-22T00:18:55.851299+0000","last_fullsized":"2023-08-22T00:18:55.851299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.866798+0000","last_change":"2023-08-22T00:18:55.864622+0000","last_active":"2023-08-22T00:18:55.866798+0000","last_peered":"2023-08-22T00:18:55.866798+0000","last_clean":"2023-08-22T00:18:55.866798+0000","last_became_active":"2023-08-22T00:18:55.864341+0000","last_became_peered":"2023-08-22T00:18:55.864341+0000","last_unstale":"2023-08-22T00:18:55.866798+0000","last_undegraded":"2023-08-22T00:18:55.866798+0000","last_fullsized":"2023-08-22T00:18:55.866798+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:55.454623+0000","last_clean_scrub_stamp":"2023-08-22T00:18:55.454623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.845163+0000","last_change":"2023-08-22T00:18:55.481539+0000","last_active":"2023-08-22T00:18:55.845163+0000","last_peered":"2023-08-22T00:18:55.845163+0000","last_clean":"2023-08-22T00:18:55.845163+0000","last_became_active":"2023-08-22T00:18:55.481234+0000","last_became_peered":"2023-08-22T00:18:55.481234+0000","last_unstale":"2023-08-22T00:18:55.845163+0000","last_undegraded":"2023-08-22T00:18:55.845163+0000","last_fullsized":"2023-08-22T00:18:55.845163+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:18:54.447873+0000","last_clean_scrub_stamp":"2023-08-22T00:18:54.447873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-22T00:18:55.841844+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:18:55.841844+0000","last_peered":"2023-08-22T00:18:55.841844+0000","last_clean":"2023-08-22T00:18:55.841844+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:18:55.841844+0000","last_undegraded":"2023-08-22T00:18:55.841844+0000","last_fullsized":"2023-08-22T00:18:55.841844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302028,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":856064,"data_stored":442390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.81200000000000006},"last":0.495}]},{"osd":4,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.72599999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.71099999999999997,"15min":0.751},"last":0.434}]},{"osd":5,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.74399999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.95399999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.72699999999999998,"15min":0.78300000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.84099999999999997},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065716,"statfs":{"total":96636764160,"available":96323293184,"internally_reserved":0,"allocated":856064,"data_stored":443192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.88800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.83899999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.98199999999999998},"last":0.35199999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.30399999999999999},"max":{"1min":0.67500000000000004,"5min":0.77700000000000002,"15min":1.1339999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.34200000000000003},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.34699999999999998},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":1.0109999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":1.073},"last":0.48099999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76800000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.76800000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32200000000000001},"max":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.94399999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":1.03},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.99299999999999999},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":860160,"data_stored":442944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.374},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.184},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.193},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23499999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.696},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.442,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.246},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.22}]},{"osd":4,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.27000000000000002},"max":{"1min":0.86399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.40500000000000003,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.441,"15min":0.318},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2150000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:18:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65900000000000003,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.34499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.45900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302036,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":864256,"data_stored":443014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38800000000000001,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.623,"15min":0.64900000000000002},"last":0.307}]},{"osd":2,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.221},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"last":0.25},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.621,"15min":0.64100000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.317}]},{"osd":4,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.749,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.438}]},{"osd":6,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.92500000000000004,"15min":1.0149999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.873,"15min":0.89200000000000002},"last":0.42599999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":860160,"data_stored":442356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.42099999999999999,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.28000000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.247},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64800000000000002},"last":0.316},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.66900000000000004},"last":0.36399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.251},"max":{"1min":0.622,"5min":0.622,"15min":0.71199999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42499999999999999,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.64800000000000002},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.91500000000000004,"15min":1.0580000000000001},"last":0.622},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":1.0169999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.88700000000000001,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.48799999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.434,"5min":0.434,"15min":0.379},"max":{"1min":0.88600000000000001,"5min":0.998,"15min":0.998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40600000000000003},"max":{"1min":0.84499999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68400000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.42399999999999999},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.98599999999999999},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":864256,"data_stored":443248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23599999999999999,"5min":0.23000000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.20799999999999999},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.26900000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40899999999999997,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.185},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.308,"15min":0.24199999999999999},"max":{"1min":0.59699999999999998,"5min":0.60099999999999998,"15min":0.63600000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45500000000000002,"15min":0.433},"min":{"1min":0.314,"5min":0.314,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.63700000000000001,"15min":0.66600000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46600000000000003,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.69199999999999995},"last":0.35599999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.33800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":0.90900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.76300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95999999999999996,"15min":11.163},"last":0.46500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.498},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.32000000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302036,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":864256,"data_stored":443014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.77600000000000002},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.77300000000000002},"last":0.372}]},{"osd":2,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.746},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.76400000000000001,"15min":0.78700000000000003},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.443},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.5},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.72699999999999998},"last":0.48599999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":0.85899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.85199999999999998},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302028,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":856064,"data_stored":442854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.94599999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":0.873},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.313},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.89400000000000002},"last":0.503},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":0.748,"15min":0.84599999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":0.77200000000000002,"15min":0.92000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.95999999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.92800000000000005},"last":0.437},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.88},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.71399999999999997},"last":0.59099999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.74299999999999999,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79400000000000004},"last":0.55600000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.77900000000000003},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:19:04.341 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:19:04.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:19:04.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.489+0000 7fa1a64cc700 1 Processor -- start 2023-08-22T00:19:04.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.489+0000 7fa1a64cc700 1 -- start start 2023-08-22T00:19:04.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a64cc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa1a01508b0 0x7fa1a0150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a64cc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1a01550a0 0x7fa1a00c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a64cc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a00654c0 con 0x7fa1a00c3d90 2023-08-22T00:19:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a64cc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a00be6e0 con 0x7fa1a01550a0 2023-08-22T00:19:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a64cc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a00be120 con 0x7fa1a01508b0 2023-08-22T00:19:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa19f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1a01550a0 0x7fa1a00c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a4a69700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa1a00c3d90 0x7fa1a00a6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52728/0 (socket says 172.21.15.98:52728) 2023-08-22T00:19:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa19f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1a01550a0 0x7fa1a00c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44608/0 (socket says 172.21.15.98:44608) 2023-08-22T00:19:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.490+0000 7fa1a4a69700 1 -- 172.21.15.98:0/3302220559 learned_addr learned my addr 172.21.15.98:0/3302220559 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19ffff700 1 --2- 172.21.15.98:0/3302220559 >> v2:172.21.15.118:3300/0 conn(0x7fa1a01508b0 0x7fa1a0150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19f7fe700 1 -- 172.21.15.98:0/3302220559 >> v2:172.21.15.118:3300/0 conn(0x7fa1a01508b0 msgr2=0x7fa1a0150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19f7fe700 1 --2- 172.21.15.98:0/3302220559 >> v2:172.21.15.118:3300/0 conn(0x7fa1a01508b0 0x7fa1a0150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19f7fe700 1 -- 172.21.15.98:0/3302220559 >> v1:172.21.15.98:6789/0 conn(0x7fa1a00c3d90 legacy=0x7fa1a00a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19f7fe700 1 -- 172.21.15.98:0/3302220559 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00be400 con 0x7fa1a01550a0 2023-08-22T00:19:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19f7fe700 1 --2- 172.21.15.98:0/3302220559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01550a0 0x7fa1a00c38a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fa1a00c5330 tx=0x7fa194009060).ready entity=mon.0 client_cookie=bbb02d39e8148e7a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19effd700 1 -- 172.21.15.98:0/3302220559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940090d0 con 0x7fa1a01550a0 2023-08-22T00:19:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19effd700 1 -- 172.21.15.98:0/3302220559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19400f510 con 0x7fa1a01550a0 2023-08-22T00:19:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.491+0000 7fa19effd700 1 -- 172.21.15.98:0/3302220559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400f890 con 0x7fa1a01550a0 2023-08-22T00:19:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 -- 172.21.15.98:0/3302220559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01550a0 msgr2=0x7fa1a00c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/3302220559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01550a0 0x7fa1a00c38a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fa1a00c5330 tx=0x7fa194009060).stop 2023-08-22T00:19:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 -- 172.21.15.98:0/3302220559 shutdown_connections 2023-08-22T00:19:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/3302220559 >> v2:172.21.15.118:3300/0 conn(0x7fa1a01508b0 0x7fa1a0150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/3302220559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01550a0 0x7fa1a00c38a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 -- 172.21.15.98:0/3302220559 >> 172.21.15.98:0/3302220559 conn(0x7fa1a00c7820 msgr2=0x7fa1a00c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:04.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 -- 172.21.15.98:0/3302220559 shutdown_connections 2023-08-22T00:19:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.492+0000 7fa1a64cc700 1 -- 172.21.15.98:0/3302220559 wait complete. 2023-08-22T00:19:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.493+0000 7fa1a64cc700 1 Processor -- start 2023-08-22T00:19:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.493+0000 7fa1a64cc700 1 -- start start 2023-08-22T00:19:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1a00c3d90 0x7fa1a014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01550a0 0x7fa1a0162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a014f230 con 0x7fa1a01508b0 2023-08-22T00:19:04.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a014f510 con 0x7fa1a01550a0 2023-08-22T00:19:04.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a64cc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a014f7f0 con 0x7fa1a00c3d90 2023-08-22T00:19:04.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44624/0 (socket says 172.21.15.98:44624) 2023-08-22T00:19:04.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 -- 172.21.15.98:0/2427943278 learned_addr learned my addr 172.21.15.98:0/2427943278 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:04.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19ffff700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1a00c3d90 0x7fa1a014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa1a4a69700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01550a0 0x7fa1a0162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 -- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1a00c3d90 msgr2=0x7fa1a014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1a00c3d90 0x7fa1a014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 -- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01550a0 msgr2=0x7fa1a0162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.494+0000 7fa19f7fe700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01550a0 0x7fa1a0162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa19f7fe700 1 -- 172.21.15.98:0/2427943278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940092a0 con 0x7fa1a01508b0 2023-08-22T00:19:04.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa19f7fe700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa194009dd0 tx=0x7fa194017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194006970 con 0x7fa1a01508b0 2023-08-22T00:19:04.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19400f680 con 0x7fa1a01508b0 2023-08-22T00:19:04.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a014fad0 con 0x7fa1a01508b0 2023-08-22T00:19:04.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400fea0 con 0x7fa1a01508b0 2023-08-22T00:19:04.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.495+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a00bf540 con 0x7fa1a01508b0 2023-08-22T00:19:04.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.496+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a00691b0 con 0x7fa1a01508b0 2023-08-22T00:19:04.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.496+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa19401b620 con 0x7fa1a01508b0 2023-08-22T00:19:04.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.496+0000 7fa187fff700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 0x7fa18c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.497+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa19407b490 con 0x7fa1a01508b0 2023-08-22T00:19:04.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.497+0000 7fa19ffff700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 0x7fa18c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.497+0000 7fa19ffff700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 0x7fa18c0613c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa190009c30 tx=0x7fa190009060).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.501+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa19404c620 con 0x7fa1a01508b0 2023-08-22T00:19:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.726+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa1a01548a0 con 0x7fa1a01508b0 2023-08-22T00:19:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.732+0000 7fa187fff700 1 -- 172.21.15.98:0/2427943278 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa19404fc40 con 0x7fa1a01508b0 2023-08-22T00:19:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 msgr2=0x7fa18c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 0x7fa18c0613c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa190009c30 tx=0x7fa190009060).stop 2023-08-22T00:19:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 msgr2=0x7fa1a0161da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa194009dd0 tx=0x7fa194017000).stop 2023-08-22T00:19:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 shutdown_connections 2023-08-22T00:19:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa18c05ef00 0x7fa18c0613c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1a00c3d90 0x7fa1a014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01550a0 0x7fa1a0162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 --2- 172.21.15.98:0/2427943278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1a01508b0 0x7fa1a0161da0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 >> 172.21.15.98:0/2427943278 conn(0x7fa1a00c7820 msgr2=0x7fa1a00a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:04.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 shutdown_connections 2023-08-22T00:19:04.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.734+0000 7fa1a64cc700 1 -- 172.21.15.98:0/2427943278 wait complete. 2023-08-22T00:19:04.741 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:19:04.748 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:19:04.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.863+0000 7fc603bdc700 1 Processor -- start 2023-08-22T00:19:04.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.863+0000 7fc603bdc700 1 -- start start 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc5fc150e40 0x7fc5fc0c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc0bd870 0x7fc5fc0a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 0x7fc5fc0663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc0bd3e0 con 0x7fc5fc150e40 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc066890 con 0x7fc5fc065f10 2023-08-22T00:19:04.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc603bdc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0bd0c0 con 0x7fc5fc0bd870 2023-08-22T00:19:04.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc5fc150e40 0x7fc5fc0c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc5fc150e40 0x7fc5fc0c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44628/0 (socket says 172.21.15.98:44628) 2023-08-22T00:19:04.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 -- 172.21.15.98:0/3975734378 learned_addr learned my addr 172.21.15.98:0/3975734378 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:04.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc602179700 1 --2- 172.21.15.98:0/3975734378 >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 0x7fc5fc0663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601177700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc0bd870 0x7fc5fc0a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 -- 172.21.15.98:0/3975734378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc0bd870 msgr2=0x7fc5fc0a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:04.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc0bd870 0x7fc5fc0a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 -- 172.21.15.98:0/3975734378 >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 msgr2=0x7fc5fc0663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:04.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 --2- 172.21.15.98:0/3975734378 >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 0x7fc5fc0663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 -- 172.21.15.98:0/3975734378 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0c3bb0 con 0x7fc5fc150e40 2023-08-22T00:19:04.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc602179700 1 --2- 172.21.15.98:0/3975734378 >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 0x7fc5fc0663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:04.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.864+0000 7fc601978700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc150e40 0x7fc5fc0c2050 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fc5fc0c7740 tx=0x7fc5f80090f0).ready entity=mon.0 client_cookie=5e3be1d861e27957 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc600976700 1 -- 172.21.15.98:0/3975734378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800b600 con 0x7fc5fc150e40 2023-08-22T00:19:04.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc600976700 1 -- 172.21.15.98:0/3975734378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800b760 con 0x7fc5fc150e40 2023-08-22T00:19:04.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc600976700 1 -- 172.21.15.98:0/3975734378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800bb00 con 0x7fc5fc150e40 2023-08-22T00:19:04.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 -- 172.21.15.98:0/3975734378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc150e40 msgr2=0x7fc5fc0c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc150e40 0x7fc5fc0c2050 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fc5fc0c7740 tx=0x7fc5f80090f0).stop 2023-08-22T00:19:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 -- 172.21.15.98:0/3975734378 shutdown_connections 2023-08-22T00:19:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 --2- 172.21.15.98:0/3975734378 >> v2:172.21.15.118:3300/0 conn(0x7fc5fc065f10 0x7fc5fc0663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc150e40 0x7fc5fc0c2050 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 --2- 172.21.15.98:0/3975734378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc0bd870 0x7fc5fc0a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 -- 172.21.15.98:0/3975734378 >> 172.21.15.98:0/3975734378 conn(0x7fc5fc06a980 msgr2=0x7fc5fc0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 -- 172.21.15.98:0/3975734378 shutdown_connections 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.865+0000 7fc603bdc700 1 -- 172.21.15.98:0/3975734378 wait complete. 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.866+0000 7fc603bdc700 1 Processor -- start 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.866+0000 7fc603bdc700 1 -- start start 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5fc065f10 0x7fc5fc14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc150e40 0x7fc5fc14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc14b760 con 0x7fc5fc0bd870 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1608c0 con 0x7fc5fc065f10 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc603bdc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc14b130 con 0x7fc5fc150e40 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44644/0 (socket says 172.21.15.98:44644) 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 -- 172.21.15.98:0/824084085 learned_addr learned my addr 172.21.15.98:0/824084085 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601978700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5fc065f10 0x7fc5fc14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc602179700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc150e40 0x7fc5fc14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 -- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc150e40 msgr2=0x7fc5fc14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc150e40 0x7fc5fc14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 -- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5fc065f10 msgr2=0x7fc5fc14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5fc065f10 0x7fc5fc14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.867+0000 7fc601177700 1 -- 172.21.15.98:0/824084085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009370 con 0x7fc5fc0bd870 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc601177700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fc5ec00d890 tx=0x7fc5ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011590 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0116f0 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011a70 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc160620 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.868+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc1522f0 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.869+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc152480 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.869+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc5ec012420 con 0x7fc5fc0bd870 2023-08-22T00:19:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.869+0000 7fc5f1ffb700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 0x7fc5e00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.869+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc5ec079b10 con 0x7fc5fc0bd870 2023-08-22T00:19:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.869+0000 7fc601978700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 0x7fc5e00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.870+0000 7fc601978700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 0x7fc5e00613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc5f800b3c0 tx=0x7fc5f8017000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:04.873+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5ec04ac40 con 0x7fc5fc0bd870 2023-08-22T00:19:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.077+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5fc047480 con 0x7fc5fc0bd870 2023-08-22T00:19:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.077+0000 7fc5f1ffb700 1 -- 172.21.15.98:0/824084085 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fc5ec04e260 con 0x7fc5fc0bd870 2023-08-22T00:19:05.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:05.079 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:19:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 msgr2=0x7fc5e00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 0x7fc5e00613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc5f800b3c0 tx=0x7fc5f8017000).stop 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 msgr2=0x7fc5fc160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fc5ec00d890 tx=0x7fc5ec008040).stop 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 shutdown_connections 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc5e005ef30 0x7fc5e00613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5fc150e40 0x7fc5fc14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5fc065f10 0x7fc5fc14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 --2- 172.21.15.98:0/824084085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5fc0bd870 0x7fc5fc160130 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 >> 172.21.15.98:0/824084085 conn(0x7fc5fc06a980 msgr2=0x7fc5fc154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 shutdown_connections 2023-08-22T00:19:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.079+0000 7fc603bdc700 1 -- 172.21.15.98:0/824084085 wait complete. 2023-08-22T00:19:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:19:05.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:18:55.833699+0000', 'modified': '2023-08-22T00:18:58.473441+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5955': {'gid': 5955, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/2107366711', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 2107366711}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2107366711}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:19:05.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:19:05.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-22T00:19:05.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.619+0000 7f81ac24b700 1 Processor -- start 2023-08-22T00:19:05.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.619+0000 7f81ac24b700 1 -- start start 2023-08-22T00:19:05.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81ac24b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81ac24b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81ac24b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40a4d90 con 0x7f81a40c2a20 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81ac24b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40c1910 con 0x7f81a4153f70 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81ac24b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40c2e50 con 0x7f81a4153b90 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a97e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:49826/0 (socket says 172.21.15.98:49826) 2023-08-22T00:19:05.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a97e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:52752/0 (socket says 172.21.15.98:52752) 2023-08-22T00:19:05.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2819835464 learned_addr learned my addr 172.21.15.98:0/2819835464 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a8fe5700 1 -- 172.21.15.98:0/2819835464 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115852417 0 0) 0x7f81a40a4d90 con 0x7f81a40c2a20 2023-08-22T00:19:05.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a8fe5700 1 -- 172.21.15.98:0/2819835464 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81900033f0 con 0x7f81a40c2a20 2023-08-22T00:19:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2819835464 >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 msgr2=0x7f81a40c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/2819835464 >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2819835464 >> v1:172.21.15.118:6789/0 conn(0x7f81a40c2a20 legacy=0x7f81a4063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2819835464 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40654c0 con 0x7f81a4153b90 2023-08-22T00:19:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.620+0000 7f81a97e6700 1 --2- 172.21.15.98:0/2819835464 >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:19:05.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/2819835464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8198006fd0 tx=0x7f81980090f0).ready entity=mon.2 client_cookie=d949fc522b8496b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81a8fe5700 1 -- 172.21.15.98:0/2819835464 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800f510 con 0x7f81a4153b90 2023-08-22T00:19:05.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81a8fe5700 1 -- 172.21.15.98:0/2819835464 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f670 con 0x7f81a4153b90 2023-08-22T00:19:05.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81a8fe5700 1 -- 172.21.15.98:0/2819835464 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800f9f0 con 0x7f81a4153b90 2023-08-22T00:19:05.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 -- 172.21.15.98:0/2819835464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 msgr2=0x7f81a40a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2819835464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8198006fd0 tx=0x7f81980090f0).stop 2023-08-22T00:19:05.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 -- 172.21.15.98:0/2819835464 shutdown_connections 2023-08-22T00:19:05.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2819835464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a4153b90 0x7f81a40a48a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2819835464 >> v2:172.21.15.118:3300/0 conn(0x7f81a4153f70 0x7f81a40c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 -- 172.21.15.98:0/2819835464 >> 172.21.15.98:0/2819835464 conn(0x7f81a4069630 msgr2=0x7f81a4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 -- 172.21.15.98:0/2819835464 shutdown_connections 2023-08-22T00:19:05.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.621+0000 7f81ac24b700 1 -- 172.21.15.98:0/2819835464 wait complete. 2023-08-22T00:19:05.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.622+0000 7f81ac24b700 1 Processor -- start 2023-08-22T00:19:05.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.622+0000 7f81ac24b700 1 -- start start 2023-08-22T00:19:05.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a4153b90 0x7f81a40bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a40c0470 0x7f81a4154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4156870 con 0x7f81a40c2a20 2023-08-22T00:19:05.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4155580 con 0x7f81a4153b90 2023-08-22T00:19:05.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81ac24b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41563e0 con 0x7f81a40c0470 2023-08-22T00:19:05.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44660/0 (socket says 172.21.15.98:44660) 2023-08-22T00:19:05.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2626406573 learned_addr learned my addr 172.21.15.98:0/2626406573 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81a97e6700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a4153b90 0x7f81a40bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.623+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a40c0470 0x7f81a4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a40c0470 msgr2=0x7f81a4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a40c0470 0x7f81a4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a4153b90 msgr2=0x7f81a40bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a4153b90 0x7f81a40bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 -- 172.21.15.98:0/2626406573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00092a0 con 0x7f81a40c2a20 2023-08-22T00:19:05.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f819800f510 tx=0x7f8198017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f8195ffb700 1 -- 172.21.15.98:0/2626406573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198000be0 con 0x7f81a40c2a20 2023-08-22T00:19:05.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f8195ffb700 1 -- 172.21.15.98:0/2626406573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f7e0 con 0x7f81a40c2a20 2023-08-22T00:19:05.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8198009370 con 0x7f81a40c2a20 2023-08-22T00:19:05.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f8195ffb700 1 -- 172.21.15.98:0/2626406573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198023640 con 0x7f81a40c2a20 2023-08-22T00:19:05.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.624+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4155ab0 con 0x7f81a40c2a20 2023-08-22T00:19:05.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.626+0000 7f8195ffb700 1 -- 172.21.15.98:0/2626406573 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f81980239b0 con 0x7f81a40c2a20 2023-08-22T00:19:05.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.626+0000 7f8195ffb700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 0x7f81880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.626+0000 7f8195ffb700 1 -- 172.21.15.98:0/2626406573 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f819807ba80 con 0x7f81a40c2a20 2023-08-22T00:19:05.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.626+0000 7f81a97e6700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 0x7f81880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.627+0000 7f81a97e6700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 0x7f81880613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f81a40950f0 tx=0x7f81a0009060).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.628+0000 7f81bdbffb80 1 Processor -- start 2023-08-22T00:19:05.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.628+0000 7f81bdbffb80 1 -- start start 2023-08-22T00:19:05.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cb9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cb9ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cae0db0 con 0x563b6cba42c0 2023-08-22T00:19:05.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6caf6030 con 0x563b6cbecf60 2023-08-22T00:19:05.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b6caf6170 con 0x563b6cb9faf0 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44668/0 (socket says 172.21.15.98:44668) 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 -- 172.21.15.98:0/1749112014 learned_addr learned my addr 172.21.15.98:0/1749112014 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cb9ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a97e6700 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cb9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 -- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 msgr2=0x563b6cb9ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cb9ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 -- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 msgr2=0x563b6cb9f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cb9f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.629+0000 7f81a9fe7700 1 -- 172.21.15.98:0/1749112014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b6cac8b00 con 0x563b6cba42c0 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f8198006ac0 tx=0x7f819807b040).ready entity=mon.0 client_cookie=b41b764a1d7ad553 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f818effd700 1 -- 172.21.15.98:0/1749112014 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980507b0 con 0x563b6cba42c0 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f818effd700 1 -- 172.21.15.98:0/1749112014 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f950 con 0x563b6cba42c0 2023-08-22T00:19:05.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f818effd700 1 -- 172.21.15.98:0/1749112014 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819804ebb0 con 0x563b6cba42c0 2023-08-22T00:19:05.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1749112014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 msgr2=0x563b6cba46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f8198006ac0 tx=0x7f819807b040).stop 2023-08-22T00:19:05.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1749112014 shutdown_connections 2023-08-22T00:19:05.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cb9ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1749112014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cb9f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1749112014 >> 172.21.15.98:0/1749112014 conn(0x563b6ca0e940 msgr2=0x563b6cbed3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1749112014 shutdown_connections 2023-08-22T00:19:05.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.630+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1749112014 wait complete. 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.631+0000 7f81bdbffb80 1 -- start start 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.631+0000 7f81bdbffb80 1 Processor -- start 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cbd0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cbd2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6caf63f0 con 0x563b6cba42c0 2023-08-22T00:19:05.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cac1920 con 0x563b6cbecf60 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b6cbc9730 con 0x563b6cb9faf0 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81bdbffb80 10 client.0 ll_register_callbacks cb 0x563b6ca96ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44674/0 (socket says 172.21.15.98:44674) 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 -- 172.21.15.98:0/1298016887 learned_addr learned my addr 172.21.15.98:0/1298016887 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cbd0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cbd2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 -- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 msgr2=0x563b6cbd0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cbd0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 -- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 msgr2=0x563b6cbd2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cbd2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 -- 172.21.15.98:0/1298016887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4155ab0 con 0x563b6cba42c0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f81a97e6700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f81a00147d0 tx=0x7f81a0017000).ready entity=mon.0 client_cookie=b22999844997f1be server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.632+0000 7f8183fff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0020510 con 0x563b6cba42c0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f81a0020670 con 0x563b6cba42c0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b6cb9eaa0 con 0x563b6cba42c0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81a0020a90 con 0x563b6cba42c0 2023-08-22T00:19:05.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 10 client.6120 fetch_fsmap learned FSMap version 23 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x563b6caeef70 con 0x563b6cba42c0 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b6cb9eaa0 con 0x563b6cba42c0 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f81a0020bf0 con 0x563b6cba42c0 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 10 client.6120 fetch_fsmap finished waiting for FSMap version 23 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 10 client.6120 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:19:05.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 20 client.6120 populate_metadata read hostname 'smithi098' 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cbe8bf0 0x563b6cbe8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 4 client.6120 mds_command: new command op to 5955 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 --> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b6c95eef0 con 0x563b6cbe8bf0 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.633+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cbe8bf0 0x563b6cbe8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f8183fff700 10 client.6120 ms_handle_connect on v2:172.21.15.118:6833/2107366711 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cbe8bf0 0x563b6cbe8fd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4d767ff087ba6313 server_cookie=1cb439db05b42966 in_seq=0 out_seq=0 2023-08-22T00:19:05.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f8183fff700 1 -- 172.21.15.98:0/1298016887 <== mds.0 v2:172.21.15.118:6833/2107366711 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x563b6c95eef0 con 0x563b6cbe8bf0 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f8183fff700 10 client.6120 handle_command_reply: tid=0 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 client.6120 shutdown 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 msgr2=0x563b6cbd26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f81a00147d0 tx=0x7f81a0017000).stop 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 shutdown_connections 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cbe8bf0 0x563b6cbe8fd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cb9faf0 0x563b6cbd0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f8183fff700 0 client.6120 ms_handle_reset on v2:172.21.15.118:6833/2107366711 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cbecf60 0x563b6cbd2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/1298016887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbd26e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.634+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 >> 172.21.15.98:0/1298016887 conn(0x563b6ca0e940 msgr2=0x563b6cba2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.635+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 shutdown_connections 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.635+0000 7f81bdbffb80 1 -- 172.21.15.98:0/1298016887 wait complete. 2023-08-22T00:19:05.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.635+0000 7f81bdbffb80 20 client.6120 trim_cache size 0 max 16384 2023-08-22T00:19:05.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.651+0000 7f81bdbffb80 1 Processor -- start 2023-08-22T00:19:05.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.651+0000 7f81bdbffb80 1 -- start start 2023-08-22T00:19:05.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cba0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cbecf60 0x563b6cbcd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cbd1f60 con 0x563b6cba42c0 2023-08-22T00:19:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cbe9940 con 0x563b6cb9faf0 2023-08-22T00:19:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b6cbc94e0 con 0x563b6cbecf60 2023-08-22T00:19:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44684/0 (socket says 172.21.15.98:44684) 2023-08-22T00:19:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 -- 172.21.15.98:0/3971584326 learned_addr learned my addr 172.21.15.98:0/3971584326 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cbecf60 0x563b6cbcd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cba0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 -- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cbecf60 msgr2=0x563b6cbcd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cbecf60 0x563b6cbcd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 -- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 msgr2=0x563b6cba0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cba0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 -- 172.21.15.98:0/3971584326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b6caea580 con 0x563b6cba42c0 2023-08-22T00:19:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cba0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f81a97e6700 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f81a0006890 tx=0x7f81a0027000).ready entity=mon.0 client_cookie=a6b961678e70d6a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f818f7fe700 1 -- 172.21.15.98:0/3971584326 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0038070 con 0x563b6cba42c0 2023-08-22T00:19:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f818f7fe700 1 -- 172.21.15.98:0/3971584326 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0014dc0 con 0x563b6cba42c0 2023-08-22T00:19:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.652+0000 7f818f7fe700 1 -- 172.21.15.98:0/3971584326 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0020720 con 0x563b6cba42c0 2023-08-22T00:19:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3971584326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 msgr2=0x563b6cbccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f81a0006890 tx=0x7f81a0027000).stop 2023-08-22T00:19:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3971584326 shutdown_connections 2023-08-22T00:19:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cbecf60 0x563b6cbcd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cba0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3971584326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cba42c0 0x563b6cbccbe0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3971584326 >> 172.21.15.98:0/3971584326 conn(0x563b6ca0e940 msgr2=0x563b6cbed340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3971584326 shutdown_connections 2023-08-22T00:19:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3971584326 wait complete. 2023-08-22T00:19:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.653+0000 7f81bdbffb80 1 -- start start 2023-08-22T00:19:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 Processor -- start 2023-08-22T00:19:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cc01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cba5080 con 0x563b6cbecf60 2023-08-22T00:19:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6cc4fc40 con 0x563b6cb9faf0 2023-08-22T00:19:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b6cc027a0 con 0x563b6cba42c0 2023-08-22T00:19:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.654+0000 7f81bdbffb80 10 client.0 ll_register_callbacks cb 0x563b6ca96ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:19:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44688/0 (socket says 172.21.15.98:44688) 2023-08-22T00:19:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 -- 172.21.15.98:0/3781210271 learned_addr learned my addr 172.21.15.98:0/3781210271 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81a97e6700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cc01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 -- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cba42c0 msgr2=0x563b6cba46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 -- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 msgr2=0x563b6cc01e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:05.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cc01e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 -- 172.21.15.98:0/3781210271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b6caeef70 con 0x563b6cbecf60 2023-08-22T00:19:05.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81aa7e8700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f819c016af0 tx=0x7f819c007ef0).ready entity=mon.0 client_cookie=915ca42cecccdca8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f8183fff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:19:05.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c01b070 con 0x563b6cbecf60 2023-08-22T00:19:05.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f819c0157b0 con 0x563b6cbecf60 2023-08-22T00:19:05.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f819800f950 con 0x563b6cbecf60 2023-08-22T00:19:05.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819c003e00 con 0x563b6cbecf60 2023-08-22T00:19:05.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81bdbffb80 10 client.6126 fetch_fsmap learned FSMap version 23 2023-08-22T00:19:05.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x563b6caea2d0 con 0x563b6cbecf60 2023-08-22T00:19:05.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.655+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f950 con 0x563b6cbecf60 2023-08-22T00:19:05.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f819c015b80 con 0x563b6cbecf60 2023-08-22T00:19:05.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 10 client.6126 fetch_fsmap finished waiting for FSMap version 23 2023-08-22T00:19:05.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 10 client.6126 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:19:05.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 20 client.6126 populate_metadata read hostname 'smithi098' 2023-08-22T00:19:05.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cc4ed10 0x563b6cc4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 4 client.6126 mds_command: new command op to 5955 tid=0[{"prefix": "status"}] 2023-08-22T00:19:05.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 --> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563b6c994040 con 0x563b6cc4ed10 2023-08-22T00:19:05.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cc4ed10 0x563b6cc4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f8183fff700 10 client.6126 ms_handle_connect on v2:172.21.15.118:6833/2107366711 2023-08-22T00:19:05.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81a9fe7700 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cc4ed10 0x563b6cc4f0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=842d886181f5a3cf server_cookie=592faed5ae416df1 in_seq=0 out_seq=0 2023-08-22T00:19:05.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f8183fff700 1 -- 172.21.15.98:0/3781210271 <== mds.0 v2:172.21.15.118:6833/2107366711 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563b6c994040 con 0x563b6cc4ed10 2023-08-22T00:19:05.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f8183fff700 10 client.6126 handle_command_reply: tid=0 2023-08-22T00:19:05.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 client.6126 shutdown 2023-08-22T00:19:05.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 msgr2=0x563b6cba4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f819c016af0 tx=0x7f819c007ef0).stop 2023-08-22T00:19:05.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 shutdown_connections 2023-08-22T00:19:05.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:6833/2107366711,v1:172.21.15.118:6835/2107366711] conn(0x563b6cc4ed10 0x563b6cc4f0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b6cbecf60 0x563b6cba4b90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b6cb9faf0 0x563b6cc01e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f8183fff700 0 client.6126 ms_handle_reset on v2:172.21.15.118:6833/2107366711 2023-08-22T00:19:05.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 --2- 172.21.15.98:0/3781210271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563b6cba42c0 0x563b6cba46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.656+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 >> 172.21.15.98:0/3781210271 conn(0x563b6ca0e940 msgr2=0x563b6cbd1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 shutdown_connections 2023-08-22T00:19:05.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81bdbffb80 1 -- 172.21.15.98:0/3781210271 wait complete. 2023-08-22T00:19:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81bdbffb80 20 client.6126 trim_cache size 0 max 16384 2023-08-22T00:19:05.695 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:19:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:19:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 5955, 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.8217907619999991, 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2023-08-22T00:19:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 71, 2023-08-22T00:19:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 71, 2023-08-22T00:19:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.314653611000001 2023-08-22T00:19:05.698 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:19:05.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 msgr2=0x7f81880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 0x7f81880613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f81a40950f0 tx=0x7f81a0009060).stop 2023-08-22T00:19:05.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 msgr2=0x7f81a41489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f819800f510 tx=0x7f8198017000).stop 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 shutdown_connections 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f818805ef30 0x7f81880613f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a40c0470 0x7f81a4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81a40c2a20 0x7f81a41489a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 --2- 172.21.15.98:0/2626406573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a4153b90 0x7f81a40bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 >> 172.21.15.98:0/2626406573 conn(0x7f81a4069630 msgr2=0x7f81a40bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 shutdown_connections 2023-08-22T00:19:05.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.657+0000 7f81ac24b700 1 -- 172.21.15.98:0/2626406573 wait complete. 2023-08-22T00:19:05.701 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:19:05.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.805+0000 7fb8c67b5700 1 Processor -- start 2023-08-22T00:19:05.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.805+0000 7fb8c67b5700 1 -- start start 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c67b5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb8c0157560 0x7fb8c00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c67b5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00c8350 con 0x7fb8c00c72c0 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c67b5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00c7740 con 0x7fb8c00caba0 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c67b5700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00c7a20 con 0x7fb8c0157560 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8bf7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb8c00c72c0 0x7fb8c0156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52732/0 (socket says 172.21.15.98:52732) 2023-08-22T00:19:05.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8bf7fe700 1 -- 172.21.15.98:0/1556219001 learned_addr learned my addr 172.21.15.98:0/1556219001 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c4d52700 1 --2- 172.21.15.98:0/1556219001 >> v2:172.21.15.98:3300/0 conn(0x7fb8c0157560 0x7fb8c00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8beffd700 1 -- 172.21.15.98:0/1556219001 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682803371 0 0) 0x7fb8c00c8350 con 0x7fb8c00c72c0 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8beffd700 1 -- 172.21.15.98:0/1556219001 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac0033f0 con 0x7fb8c00c72c0 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c4d52700 1 -- 172.21.15.98:0/1556219001 >> v1:172.21.15.118:6789/0 conn(0x7fb8c00caba0 legacy=0x7fb8c00a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c4d52700 1 -- 172.21.15.98:0/1556219001 >> v1:172.21.15.98:6789/0 conn(0x7fb8c00c72c0 legacy=0x7fb8c0156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.806+0000 7fb8c4d52700 1 -- 172.21.15.98:0/1556219001 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00c7d00 con 0x7fb8c0157560 2023-08-22T00:19:05.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c4d52700 1 --2- 172.21.15.98:0/1556219001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c00caf80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb8b8009e60 tx=0x7fb8b8009780).ready entity=mon.0 client_cookie=c97db9de9477f4fc server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8beffd700 1 -- 172.21.15.98:0/1556219001 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800e070 con 0x7fb8c0157560 2023-08-22T00:19:05.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8beffd700 1 -- 172.21.15.98:0/1556219001 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800bb60 con 0x7fb8c0157560 2023-08-22T00:19:05.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8beffd700 1 -- 172.21.15.98:0/1556219001 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8012410 con 0x7fb8c0157560 2023-08-22T00:19:05.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 -- 172.21.15.98:0/1556219001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 msgr2=0x7fb8c00caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/1556219001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c00caf80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb8b8009e60 tx=0x7fb8b8009780).stop 2023-08-22T00:19:05.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 -- 172.21.15.98:0/1556219001 shutdown_connections 2023-08-22T00:19:05.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/1556219001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c00caf80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 -- 172.21.15.98:0/1556219001 >> 172.21.15.98:0/1556219001 conn(0x7fb8c0082ac0 msgr2=0x7fb8c0069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 -- 172.21.15.98:0/1556219001 shutdown_connections 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.807+0000 7fb8c67b5700 1 -- 172.21.15.98:0/1556219001 wait complete. 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.808+0000 7fb8c67b5700 1 Processor -- start 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 -- start start 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 0x7fb8c01468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c00caba0 0x7fb8c0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c015a580 con 0x7fb8c0157560 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0146de0 con 0x7fb8c00caba0 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c67b5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00aff10 con 0x7fb8c00c72c0 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c4d52700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c4d52700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44698/0 (socket says 172.21.15.98:44698) 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.809+0000 7fb8c4d52700 1 -- 172.21.15.98:0/740837186 learned_addr learned my addr 172.21.15.98:0/740837186 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8bf7fe700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c00caba0 0x7fb8c0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8bffff700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 0x7fb8c01468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 -- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 msgr2=0x7fb8c01468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 0x7fb8c01468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 -- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c00caba0 msgr2=0x7fb8c0159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c00caba0 0x7fb8c0159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 -- 172.21.15.98:0/740837186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009a20 con 0x7fb8c0157560 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8bffff700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 0x7fb8c01468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:05.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c4d52700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb8b80094d0 tx=0x7fb8b8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b801d630 con 0x7fb8c0157560 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b801d790 con 0x7fb8c0157560 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00b01f0 con 0x7fb8c0157560 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b801db30 con 0x7fb8c0157560 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.810+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00c1cf0 con 0x7fb8c0157560 2023-08-22T00:19:05.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.811+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c00c2060 con 0x7fb8c0157560 2023-08-22T00:19:05.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.811+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb8b80083a0 con 0x7fb8c0157560 2023-08-22T00:19:05.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.812+0000 7fb8b7fff700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 0x7fb8a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:05.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.812+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb8b807c140 con 0x7fb8c0157560 2023-08-22T00:19:05.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.812+0000 7fb8bffff700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 0x7fb8a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:05.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.812+0000 7fb8bffff700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 0x7fb8a00613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb8b0001760 tx=0x7fb8b0009040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:05.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:05.816+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8b804d2f0 con 0x7fb8c0157560 2023-08-22T00:19:06.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.016+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8c00b0710 con 0x7fb8c0157560 2023-08-22T00:19:06.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.016+0000 7fb8b7fff700 1 -- 172.21.15.98:0/740837186 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb8c00b0710 con 0x7fb8c0157560 2023-08-22T00:19:06.018 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:19:06.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 msgr2=0x7fb8a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 0x7fb8a00613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb8b0001760 tx=0x7fb8b0009040).stop 2023-08-22T00:19:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 msgr2=0x7fb8c015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb8b80094d0 tx=0x7fb8b8009780).stop 2023-08-22T00:19:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 shutdown_connections 2023-08-22T00:19:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb8a005ef30 0x7fb8a00613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c00c72c0 0x7fb8c01468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c0157560 0x7fb8c015a090 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 --2- 172.21.15.98:0/740837186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c00caba0 0x7fb8c0159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 >> 172.21.15.98:0/740837186 conn(0x7fb8c0082ac0 msgr2=0x7fb8c0069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 shutdown_connections 2023-08-22T00:19:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:06.018+0000 7fb8c67b5700 1 -- 172.21.15.98:0/740837186 wait complete. 2023-08-22T00:19:06.030 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:19:06.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:19:06.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:19:06.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:19:06.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:06.032 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:19:06.032 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:19:06.032 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:19:06.033 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:19:06.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.033 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:19:06.053 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:19:06.053 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:19:06.054 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:19:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41760sec preferred_lft 41760sec 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.056 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:19:06.057 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:19:06.058 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:19:06.058 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:19:06.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.058 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:19:06.119 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:19:06.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.120 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:19:06.181 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:19:06.181 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:19:06.182 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:19:06.182 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:19:06.182 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:19:06.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.183 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:19:06.183 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:19:06.183 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:19:06.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:19:06.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:19:06.184 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:19:06.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.286 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:19:06.307 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:19:06.308 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:19:06.308 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:19:06.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:19:06.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:19:06.374 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:19:06.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:06.376 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:06.433 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:19:06.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:19:06.501 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:19:06.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:19:06.568 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:19:06.569 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:19:06.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:06.570 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:19:06.628 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:19:06.629 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:06.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:19:06.697 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:19:06.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:19:06.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:19:06.750+0000 7fc203a513c0 -1 init, newargv = 0x55b0e2effb50 newargc=15 2023-08-22T00:19:06.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[142418]: starting ceph client 2023-08-22T00:19:06.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[142418]: starting fuse 2023-08-22T00:19:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:19:06.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:19:06.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:06.768 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:19:06.826 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:19:06.827 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:19:06.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:19:06.827 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:19:06.828 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:19:06.828 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:19:06.828 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:19:06.829 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:19:06.829 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:19:06.829 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:19:06.830 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:19:06.830 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:19:06.830 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:19:06.831 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:19:06.831 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:19:06.831 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:19:06.831 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:19:06.832 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:19:06.832 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:19:06.832 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:19:06.833 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:19:06.833 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:19:06.833 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:19:06.834 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:19:06.834 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:19:06.834 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:19:06.835 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:19:06.835 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:19:06.835 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:19:06.950 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.142418.asok 2023-08-22T00:19:07.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.142418.asok 2023-08-22T00:19:07.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:07.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.142418.asok status 2023-08-22T00:19:07.282 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:19:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:19:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:19:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:19:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:19:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:19:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:19:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "142418", 2023-08-22T00:19:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:19:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:19:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:19:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:19:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 6141, 2023-08-22T00:19:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:19:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:19:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:19:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 6141 2023-08-22T00:19:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:19:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:19:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:19:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:19:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2209054410 2023-08-22T00:19:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:19:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:19:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:19:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:19:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:19:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2209054410 2023-08-22T00:19:07.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:19:07.291 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.6141 192.168.0.1:0/2209054410", 2023-08-22T00:19:07.291 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/2209054410", 2023-08-22T00:19:07.292 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:19:07.292 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 23, 2023-08-22T00:19:07.292 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 71, 2023-08-22T00:19:07.293 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:19:07.293 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:19:07.293 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:19:07.293 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:19:07.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:07.296 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:19:07.299 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:07.318 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:19:07.319 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:07.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:07.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:19:07.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:19:07.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.542+0000 7fcf8c798700 1 Processor -- start 2023-08-22T00:19:07.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.542+0000 7fcf8c798700 1 -- start start 2023-08-22T00:19:07.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf8c798700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf84151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf8c798700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf840645b0 0x7fcf840a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf8c798700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840bbef0 con 0x7fcf840bcf90 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf8c798700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840bc1d0 con 0x7fcf840645b0 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf8c798700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840bc4b0 con 0x7fcf84151890 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf89d33700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcf840bcf90 0x7fcf84063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52740/0 (socket says 172.21.15.98:52740) 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.543+0000 7fcf89d33700 1 -- 172.21.15.98:0/1508089174 learned_addr learned my addr 172.21.15.98:0/1508089174 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:07.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf84151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8ad35700 1 --2- 172.21.15.98:0/1508089174 >> v2:172.21.15.118:3300/0 conn(0x7fcf840645b0 0x7fcf840a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326803476 0 0) 0x7fcf840bbef0 con 0x7fcf840bcf90 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf700033f0 con 0x7fcf840bcf90 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033365485 0 0) 0x7fcf700033f0 con 0x7fcf840bcf90 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 msgr2=0x7fcf84151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf84151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 >> v2:172.21.15.118:3300/0 conn(0x7fcf840645b0 msgr2=0x7fcf840a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 --2- 172.21.15.98:0/1508089174 >> v2:172.21.15.118:3300/0 conn(0x7fcf840645b0 0x7fcf840a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840bc790 con 0x7fcf840bcf90 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fcf80001470 con 0x7fcf840bcf90 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 >> v1:172.21.15.98:6789/0 conn(0x7fcf840bcf90 legacy=0x7fcf84063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf700038e0 0x7fcf70003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf70004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf70005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840bc1d0 con 0x7fcf70004690 2023-08-22T00:19:07.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840bc4b0 con 0x7fcf700038e0 2023-08-22T00:19:07.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7000b8e0 con 0x7fcf84151890 2023-08-22T00:19:07.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf70004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf700038e0 0x7fcf70003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8ad35700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf70005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 -- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 msgr2=0x7fcf70005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf70005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 -- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf700038e0 msgr2=0x7fcf70003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf700038e0 0x7fcf70003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 -- 172.21.15.98:0/1508089174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700033f0 con 0x7fcf70004690 2023-08-22T00:19:07.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8ad35700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf84151890 0x7fcf70005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf700038e0 0x7fcf70003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.544+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf70004b10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fcf84069650 tx=0x7fcf80001e90).ready entity=mon.0 client_cookie=eb2d696ab815bba7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80007a60 con 0x7fcf70004690 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000ca80 con 0x7fcf70004690 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf89532700 1 -- 172.21.15.98:0/1508089174 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000ce00 con 0x7fcf70004690 2023-08-22T00:19:07.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 -- 172.21.15.98:0/1508089174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 msgr2=0x7fcf70004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1508089174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf70004b10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fcf84069650 tx=0x7fcf80001e90).stop 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8ad35700 1 -- 172.21.15.98:0/1508089174 reap_dead start 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 -- 172.21.15.98:0/1508089174 shutdown_connections 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 -- 172.21.15.98:0/1508089174 >> 172.21.15.98:0/1508089174 conn(0x7fcf84069680 msgr2=0x7fcf84069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 -- 172.21.15.98:0/1508089174 shutdown_connections 2023-08-22T00:19:07.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.545+0000 7fcf8c798700 1 -- 172.21.15.98:0/1508089174 wait complete. 2023-08-22T00:19:07.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.546+0000 7fcf8c798700 1 Processor -- start 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.546+0000 7fcf8c798700 1 -- start start 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf84153f50 0x7fcf84164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf841652c0 0x7fcf840a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84155240 con 0x7fcf70004690 2023-08-22T00:19:07.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8414e1f0 con 0x7fcf84153f50 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8c798700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84163170 con 0x7fcf841652c0 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44718/0 (socket says 172.21.15.98:44718) 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 -- 172.21.15.98:0/1472056224 learned_addr learned my addr 172.21.15.98:0/1472056224 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8ad35700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf841652c0 0x7fcf840a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf84153f50 0x7fcf84164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 -- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf841652c0 msgr2=0x7fcf840a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf841652c0 0x7fcf840a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 -- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf84153f50 msgr2=0x7fcf84164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf84153f50 0x7fcf84164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.547+0000 7fcf8a534700 1 -- 172.21.15.98:0/1472056224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf841546c0 con 0x7fcf70004690 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf8a534700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcf74011910 tx=0x7fcf74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74013620 con 0x7fcf70004690 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74013780 con 0x7fcf70004690 2023-08-22T00:19:07.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf841549a0 con 0x7fcf70004690 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74013b00 con 0x7fcf70004690 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.548+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84154f60 con 0x7fcf70004690 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.549+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf84068320 con 0x7fcf70004690 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.549+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcf74015480 con 0x7fcf70004690 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.550+0000 7fcf7a7fc700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 0x7fcf680613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.550+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcf7407a7d0 con 0x7fcf70004690 2023-08-22T00:19:07.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.550+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 0x7fcf680613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.550+0000 7fcf89d33700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 0x7fcf680613c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf80001ed0 tx=0x7fcf80015000).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.554+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf7404b840 con 0x7fcf70004690 2023-08-22T00:19:07.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.738+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf84163360 con 0x7fcf6805ef00 2023-08-22T00:19:07.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.739+0000 7fcf7a7fc700 1 -- 172.21.15.98:0/1472056224 <== mgr.5748 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcf84163360 con 0x7fcf6805ef00 2023-08-22T00:19:07.741 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:19:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:19:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:19:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:19:07.742 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:19:07.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 msgr2=0x7fcf680613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 0x7fcf680613c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf80001ed0 tx=0x7fcf80015000).stop 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 msgr2=0x7fcf84162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcf74011910 tx=0x7fcf74008040).stop 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 shutdown_connections 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf6805ef00 0x7fcf680613c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf841652c0 0x7fcf840a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf70004690 0x7fcf84162c80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 --2- 172.21.15.98:0/1472056224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf84153f50 0x7fcf84164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 >> 172.21.15.98:0/1472056224 conn(0x7fcf84069680 msgr2=0x7fcf8414e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:07.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 shutdown_connections 2023-08-22T00:19:07.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.741+0000 7fcf8c798700 1 -- 172.21.15.98:0/1472056224 wait complete. 2023-08-22T00:19:07.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:19:07.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.870+0000 7f5fb6546700 1 Processor -- start 2023-08-22T00:19:07.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.870+0000 7f5fb6546700 1 -- start start 2023-08-22T00:19:07.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb6546700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5fb00c2620 0x7f5fb015b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb6546700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb0063f90 con 0x7f5fb00635a0 2023-08-22T00:19:07.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb6546700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00656f0 con 0x7f5fb01505e0 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb6546700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb01509c0 con 0x7f5fb00c2620 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5fb00c2620 0x7f5fb015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5faf7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5fb00635a0 0x7f5fb00c1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52752/0 (socket says 172.21.15.98:52752) 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5fb00c2620 0x7f5fb015b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44722/0 (socket says 172.21.15.98:44722) 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5faf7fe700 1 -- 172.21.15.98:0/4103702495 learned_addr learned my addr 172.21.15.98:0/4103702495 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 -- 172.21.15.98:0/4103702495 >> v1:172.21.15.118:6789/0 conn(0x7f5fb01505e0 legacy=0x7f5fb0062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:07.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 -- 172.21.15.98:0/4103702495 >> v1:172.21.15.98:6789/0 conn(0x7f5fb00635a0 legacy=0x7f5fb00c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 -- 172.21.15.98:0/4103702495 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00650c0 con 0x7f5fb00c2620 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5faeffd700 1 -- 172.21.15.98:0/4103702495 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217959372 0 0) 0x7f5fb0063f90 con 0x7f5fb00635a0 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5fb4ae3700 1 --2- 172.21.15.98:0/4103702495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb015b100 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f5fa800af70 tx=0x7f5fa800a890).ready entity=mon.0 client_cookie=e06b450f435c5bab server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.871+0000 7f5faeffd700 1 -- 172.21.15.98:0/4103702495 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800f070 con 0x7f5fb00c2620 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5faeffd700 1 -- 172.21.15.98:0/4103702495 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800a2e0 con 0x7f5fb00c2620 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5faeffd700 1 -- 172.21.15.98:0/4103702495 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800cca0 con 0x7f5fb00c2620 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 -- 172.21.15.98:0/4103702495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 msgr2=0x7f5fb015b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 --2- 172.21.15.98:0/4103702495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb015b100 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f5fa800af70 tx=0x7f5fa800a890).stop 2023-08-22T00:19:07.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 -- 172.21.15.98:0/4103702495 shutdown_connections 2023-08-22T00:19:07.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 --2- 172.21.15.98:0/4103702495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb015b100 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 -- 172.21.15.98:0/4103702495 >> 172.21.15.98:0/4103702495 conn(0x7f5fb00c31d0 msgr2=0x7f5fb00c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:07.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 -- 172.21.15.98:0/4103702495 shutdown_connections 2023-08-22T00:19:07.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.872+0000 7f5fb6546700 1 -- 172.21.15.98:0/4103702495 wait complete. 2023-08-22T00:19:07.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.873+0000 7f5fb6546700 1 Processor -- start 2023-08-22T00:19:07.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.873+0000 7f5fb6546700 1 -- start start 2023-08-22T00:19:07.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 0x7f5fb01670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 0x7f5fb0065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0166000 con 0x7f5fb00c2620 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01662e0 con 0x7f5fb00635a0 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb6546700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01665c0 con 0x7f5fb01505e0 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44724/0 (socket says 172.21.15.98:44724) 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 -- 172.21.15.98:0/3420848895 learned_addr learned my addr 172.21.15.98:0/3420848895 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb4ae3700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 0x7f5fb0065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faffff700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 0x7f5fb01670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 -- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 msgr2=0x7f5fb0065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 0x7f5fb0065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 -- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 msgr2=0x7f5fb01670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 0x7f5fb01670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faf7fe700 1 -- 172.21.15.98:0/3420848895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa800ab30 con 0x7f5fb00c2620 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5faffff700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 0x7f5fb01670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.874+0000 7f5fb4ae3700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 0x7f5fb0065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5faf7fe700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f5fa000c490 tx=0x7f5fa0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00072e0 con 0x7f5fb00c2620 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0007440 con 0x7f5fb00c2620 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb01668a0 con 0x7f5fb00c2620 2023-08-22T00:19:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00057a0 con 0x7f5fb00c2620 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.875+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00c03c0 con 0x7f5fb00c2620 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.876+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00c05e0 con 0x7f5fb00c2620 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.876+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5fa0005bd0 con 0x7f5fb00c2620 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.876+0000 7f5f97fff700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 0x7f5f9c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.877+0000 7f5faffff700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 0x7f5f9c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.877+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5fa00799b0 con 0x7f5fb00c2620 2023-08-22T00:19:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.877+0000 7f5faffff700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 0x7f5f9c0613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5fa4006fd0 tx=0x7f5fa4008040).ready entity=mgr.5748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:07.881+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fa004ab40 con 0x7f5fb00c2620 2023-08-22T00:19:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.085+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5fb0046c20 con 0x7f5fb00c2620 2023-08-22T00:19:08.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.510+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 16) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f5fa00774a0 con 0x7f5fb00c2620 2023-08-22T00:19:08.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.512+0000 7f5f97fff700 1 -- 172.21.15.98:0/3420848895 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v16) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5fa001da30 con 0x7f5fb00c2620 2023-08-22T00:19:08.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.514+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 msgr2=0x7f5f9c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 0x7f5f9c0613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5fa4006fd0 tx=0x7f5fa4008040).stop 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 msgr2=0x7f5fb00bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f5fa000c490 tx=0x7f5fa0007e60).stop 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 shutdown_connections 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f9c05ef30 0x7f5f9c0613f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fb01505e0 0x7f5fb0065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fb00635a0 0x7f5fb01670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 --2- 172.21.15.98:0/3420848895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb00c2620 0x7f5fb00bfed0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 >> 172.21.15.98:0/3420848895 conn(0x7f5fb00c31d0 msgr2=0x7f5fb00c4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:08.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 shutdown_connections 2023-08-22T00:19:08.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.515+0000 7f5fb6546700 1 -- 172.21.15.98:0/3420848895 wait complete. 2023-08-22T00:19:08.532 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:19:08.650 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:08.649+0000 7f3fd62ab680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:19:08.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 Processor -- start 2023-08-22T00:19:08.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 -- start start 2023-08-22T00:19:08.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f289414fd90 0x7f28940675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2894153010 0x7f28940a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 0x7f28940c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28941525d0 con 0x7f2894153010 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940c4370 con 0x7f28940c39d0 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.656+0000 7f289a2dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2894152b80 con 0x7f289414fd90 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2894153010 0x7f28940a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2894153010 0x7f28940a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44746/0 (socket says 172.21.15.98:44746) 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 -- 172.21.15.98:0/1149927559 learned_addr learned my addr 172.21.15.98:0/1149927559 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:08.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f289887a700 1 --2- 172.21.15.98:0/1149927559 >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 0x7f28940c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f2893fff700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f289414fd90 0x7f28940675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 -- 172.21.15.98:0/1149927559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f289414fd90 msgr2=0x7f28940675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f289414fd90 0x7f28940675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 -- 172.21.15.98:0/1149927559 >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 msgr2=0x7f28940c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 --2- 172.21.15.98:0/1149927559 >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 0x7f28940c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 -- 172.21.15.98:0/1149927559 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894067bd0 con 0x7f2894153010 2023-08-22T00:19:08.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f289887a700 1 --2- 172.21.15.98:0/1149927559 >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 0x7f28940c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f28937fe700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2894153010 0x7f28940a7c10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f28940aeb00 tx=0x7f28880090f0).ready entity=mon.0 client_cookie=e9f45a14aabe498a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f2892ffd700 1 -- 172.21.15.98:0/1149927559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800f510 con 0x7f2894153010 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f2892ffd700 1 -- 172.21.15.98:0/1149927559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800f670 con 0x7f2894153010 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.657+0000 7f2892ffd700 1 -- 172.21.15.98:0/1149927559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800fa10 con 0x7f2894153010 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 -- 172.21.15.98:0/1149927559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2894153010 msgr2=0x7f28940a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2894153010 0x7f28940a7c10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f28940aeb00 tx=0x7f28880090f0).stop 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 -- 172.21.15.98:0/1149927559 shutdown_connections 2023-08-22T00:19:08.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f289414fd90 0x7f28940675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 --2- 172.21.15.98:0/1149927559 >> v2:172.21.15.118:3300/0 conn(0x7f28940c39d0 0x7f28940c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 --2- 172.21.15.98:0/1149927559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2894153010 0x7f28940a7c10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 -- 172.21.15.98:0/1149927559 >> 172.21.15.98:0/1149927559 conn(0x7f28940c8950 msgr2=0x7f28940c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 -- 172.21.15.98:0/1149927559 shutdown_connections 2023-08-22T00:19:08.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.658+0000 7f289a2dd700 1 -- 172.21.15.98:0/1149927559 wait complete. 2023-08-22T00:19:08.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.659+0000 7f289a2dd700 1 Processor -- start 2023-08-22T00:19:08.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.659+0000 7f289a2dd700 1 -- start start 2023-08-22T00:19:08.664 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f4d01853680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:19:08.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 0x7f2894158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 0x7f28940c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940ad8e0 con 0x7f289414fd90 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289414bc90 con 0x7f2894153010 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289a2dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28941591e0 con 0x7f28940c39d0 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44760/0 (socket says 172.21.15.98:44760) 2023-08-22T00:19:08.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 -- 172.21.15.98:0/3070699388 learned_addr learned my addr 172.21.15.98:0/3070699388 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289887a700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 0x7f28940c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f2893fff700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 0x7f2894158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 -- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 msgr2=0x7f2894158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 0x7f2894158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 -- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 msgr2=0x7f28940c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 0x7f28940c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f28937fe700 1 -- 172.21.15.98:0/3070699388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009a20 con 0x7f289414fd90 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f2893fff700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 0x7f2894158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.660+0000 7f289887a700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 0x7f28940c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f28937fe700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f289405efb0 tx=0x7f2888017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888006950 con 0x7f289414fd90 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2888009370 con 0x7f289414fd90 2023-08-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888000bc0 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800f7e0 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.661+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28940ad290 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.662+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28940ada50 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.663+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f2888022020 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.663+0000 7f287bfff700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.663+0000 7f2893fff700 1 -- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 msgr2=0x7f2880061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.663+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f288807bdc0 con 0x7f289414fd90 2023-08-22T00:19:08.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.663+0000 7f2893fff700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:19:08.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.670+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f288804cf10 con 0x7f289414fd90 2023-08-22T00:19:08.713 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:08.713+0000 7f3fd62ab680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:19:08.730 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:08.728+0000 7f4d01853680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:19:08.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.838+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2894067eb0 con 0x7f289414fd90 2023-08-22T00:19:08.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.842+0000 7f287bfff700 1 -- 172.21.15.98:0/3070699388 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f288802a030 con 0x7f289414fd90 2023-08-22T00:19:08.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 msgr2=0x7f2880061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 msgr2=0x7f28941625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f289405efb0 tx=0x7f2888017000).stop 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 shutdown_connections 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:19:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28940c39d0 0x7f2894158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2894153010 0x7f28940c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 --2- 172.21.15.98:0/3070699388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289414fd90 0x7f28941625f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 >> 172.21.15.98:0/3070699388 conn(0x7f28940c8950 msgr2=0x7f28940c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 shutdown_connections 2023-08-22T00:19:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:08.845+0000 7f289a2dd700 1 -- 172.21.15.98:0/3070699388 wait complete. 2023-08-22T00:19:08.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:08.859 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:19:08.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-22T00:19:08.987 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:08.987+0000 7f3fd62ab680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:19:09.017 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:09.016+0000 7f4d01853680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:19:09.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.045+0000 7fc9a5938700 1 Processor -- start 2023-08-22T00:19:09.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.045+0000 7fc9a5938700 1 -- start start 2023-08-22T00:19:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc9a5938700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9a00645e0 0x7fc9a0064a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc9a5938700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a0155360 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc9a5938700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a0157b50 con 0x7fc9a0153ae0 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc9a5938700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a0064f40 con 0x7fc9a00645e0 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc99e7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc9a00c5ea0 0x7fc9a0157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52762/0 (socket says 172.21.15.98:52762) 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc99e7fc700 1 -- 172.21.15.98:0/3547956570 learned_addr learned my addr 172.21.15.98:0/3547956570 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.046+0000 7fc99f7fe700 1 --2- 172.21.15.98:0/3547956570 >> v2:172.21.15.118:3300/0 conn(0x7fc9a00645e0 0x7fc9a0064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879816596 0 0) 0x7fc994001110 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9880033f0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99f7fe700 1 -- 172.21.15.98:0/3547956570 >> v1:172.21.15.118:6789/0 conn(0x7fc9a0153ae0 legacy=0x7fc9a00bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523521064 0 0) 0x7fc9a0157b50 con 0x7fc9a0153ae0 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99f7fe700 1 -- 172.21.15.98:0/3547956570 >> v1:172.21.15.98:6789/0 conn(0x7fc9a00c5ea0 legacy=0x7fc9a0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99f7fe700 1 -- 172.21.15.98:0/3547956570 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00c6320 con 0x7fc9a00645e0 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99f7fe700 1 --2- 172.21.15.98:0/3547956570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a00645e0 0x7fc9a0064a50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc998009e60 tx=0x7fc998009780).ready entity=mon.1 client_cookie=b8f095b2922867fd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800e070 con 0x7fc9a00645e0 2023-08-22T00:19:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99800bb60 con 0x7fc9a00645e0 2023-08-22T00:19:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.047+0000 7fc99dffb700 1 -- 172.21.15.98:0/3547956570 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800bee0 con 0x7fc9a00645e0 2023-08-22T00:19:09.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 -- 172.21.15.98:0/3547956570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a00645e0 msgr2=0x7fc9a0064a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 --2- 172.21.15.98:0/3547956570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a00645e0 0x7fc9a0064a50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc998009e60 tx=0x7fc998009780).stop 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 -- 172.21.15.98:0/3547956570 shutdown_connections 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 --2- 172.21.15.98:0/3547956570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a00645e0 0x7fc9a0064a50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 -- 172.21.15.98:0/3547956570 >> 172.21.15.98:0/3547956570 conn(0x7fc9a00caa50 msgr2=0x7fc9a00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 -- 172.21.15.98:0/3547956570 shutdown_connections 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.048+0000 7fc9a5938700 1 -- 172.21.15.98:0/3547956570 wait complete. 2023-08-22T00:19:09.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.049+0000 7fc9a5938700 1 Processor -- start 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.049+0000 7fc9a5938700 1 -- start start 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 0x7fc9a00c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a0153ae0 0x7fc9a00acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0164d40 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0164a60 con 0x7fc9a0153ae0 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00c2c60 con 0x7fc9a00645e0 2023-08-22T00:19:09.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:09.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44770/0 (socket says 172.21.15.98:44770) 2023-08-22T00:19:09.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 -- 172.21.15.98:0/4122304694 learned_addr learned my addr 172.21.15.98:0/4122304694 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:09.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99f7fe700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a0153ae0 0x7fc9a00acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:09.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 0x7fc9a00c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 msgr2=0x7fc9a00c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 0x7fc9a00c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a0153ae0 msgr2=0x7fc9a00acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a0153ae0 0x7fc9a00acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009a20 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 0x7fc9a00c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:09.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc99e7fc700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc99400c4a0 tx=0x7fc994007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940072e0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994007440 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940057a0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a00c2f40 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.050+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00acfe0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fc994005b50 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a00c2ac0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc986ffd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc99effd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc994079620 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.052+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:19:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.056+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9a00c2ac0 con 0x7fc9a00c5ea0 2023-08-22T00:19:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.253+0000 7fc99effd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.253+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:19:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.277+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9a0155360 con 0x7fc98c05ef80 2023-08-22T00:19:09.596 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:09.594+0000 7f3fd62ab680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:19:09.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.654+0000 7fc99effd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:09.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:09.654+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:19:09.655 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:09.654+0000 7f4d01853680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:19:09.666 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:09.665+0000 7f3fd62ab680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:19:09.727 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:09.726+0000 7f4d01853680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:19:09.850 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:09.849+0000 7f3fd62ab680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:19:09.913 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:09.912+0000 7f4d01853680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:19:10.265 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.264+0000 7f3fd62ab680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:19:10.332 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.331+0000 7f4d01853680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:19:10.366 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.365+0000 7f3fd62ab680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:19:10.435 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.434+0000 7f4d01853680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:19:10.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:10.455+0000 7fc99effd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:10.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:10.455+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:19:10.517 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.516+0000 7f3fd62ab680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:19:10.588 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.587+0000 7f4d01853680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:19:10.591 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.590+0000 7f3fd62ab680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:19:10.658 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.658+0000 7f3fd62ab680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:19:10.662 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.661+0000 7f4d01853680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:19:10.731 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.730+0000 7f4d01853680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:19:10.911 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:10.910+0000 7f3fd62ab680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:19:10.996 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:10.986+0000 7f4d01853680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:19:11.091 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:11.090+0000 7f3fd62ab680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:19:11.169 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:11.168+0000 7f4d01853680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:19:11.739 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:11.737+0000 7f3fd62ab680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:19:11.807 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:11.806+0000 7f3fd62ab680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:19:11.821 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:11.820+0000 7f4d01853680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:19:11.883 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:11.882+0000 7f3fd62ab680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:19:11.895 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:11.892+0000 7f4d01853680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:19:11.969 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:11.967+0000 7f4d01853680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:19:12.028 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.027+0000 7f3fd62ab680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:19:12.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.056+0000 7fc99effd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:19:12.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.056+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:19:12.098 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.096+0000 7f3fd62ab680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:19:12.115 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.114+0000 7f4d01853680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:19:12.186 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.184+0000 7f4d01853680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:19:12.211 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.210+0000 7f3fd62ab680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:19:12.299 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.298+0000 7f4d01853680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:19:12.318 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.316+0000 7f3fd62ab680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:19:12.406 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.405+0000 7f4d01853680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:19:12.606 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.604+0000 7f3fd62ab680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:19:12.676 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:19:12.674+0000 7f3fd62ab680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:19:12.693 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.692+0000 7f4d01853680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:19:12.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.745+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 17) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fc994077110 con 0x7fc9a00c5ea0 2023-08-22T00:19:12.765 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.764+0000 7f4d01853680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:19:12.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.787+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 18) v1 ==== 75113+0+0 (secure 0 0 0) 0x7fc9940470b0 con 0x7fc9a00c5ea0 2023-08-22T00:19:12.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.788+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:19:12.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:12.788+0000 7fc986ffd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:19:12.852 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7eb02700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7eb02700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7eb02700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7eb02700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7eb02700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7bafc700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7bafc700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.853 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7bafc700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.854 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7bafc700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:12.854 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:19:12.851+0000 7f4c7bafc700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:19:13.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.790+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 19) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fc994077920 con 0x7fc9a00c5ea0 2023-08-22T00:19:13.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.790+0000 7fc986ffd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.790+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9a0155360 con 0x7fc98c05ef80 2023-08-22T00:19:13.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.792+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.794+0000 7fc99effd700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c0613c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc990007fd0 tx=0x7fc990009040).ready entity=mgr.5354 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:13.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.804+0000 7fc986ffd700 1 -- 172.21.15.98:0/4122304694 <== mgr.5354 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc9a0155360 con 0x7fc98c05ef80 2023-08-22T00:19:13.805 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:19:13.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 msgr2=0x7fc98c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:13.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c0613c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc990007fd0 tx=0x7fc990009040).stop 2023-08-22T00:19:13.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 msgr2=0x7fc9a00b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:13.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc99400c4a0 tx=0x7fc994007ab0).stop 2023-08-22T00:19:13.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 shutdown_connections 2023-08-22T00:19:13.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc98c05ef80 0x7fc98c0613c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a00645e0 0x7fc9a00c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a0153ae0 0x7fc9a00acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 --2- 172.21.15.98:0/4122304694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a00c5ea0 0x7fc9a00b0670 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 >> 172.21.15.98:0/4122304694 conn(0x7fc9a00caa50 msgr2=0x7fc9a01566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 shutdown_connections 2023-08-22T00:19:13.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.806+0000 7fc9a5938700 1 -- 172.21.15.98:0/4122304694 wait complete. 2023-08-22T00:19:13.820 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:19:13.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-08-22T00:19:13.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.942+0000 7f0082aa1700 1 Processor -- start 2023-08-22T00:19:13.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.942+0000 7f0082aa1700 1 -- start start 2023-08-22T00:19:13.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c150750 0x7f007c150b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 0x7f007c0c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007c0c3900 0x7f007c065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0bc6d0 con 0x7f007c0c3900 2023-08-22T00:19:13.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0bcf70 con 0x7f007c065690 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f0082aa1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c3dd0 con 0x7f007c150750 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f008103e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007c0c3900 0x7f007c065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f008103e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007c0c3900 0x7f007c065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33196/0 (socket says 172.21.15.98:33196) 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.943+0000 7f008103e700 1 -- 172.21.15.98:0/1410337175 learned_addr learned my addr 172.21.15.98:0/1410337175 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f007bfff700 1 --2- 172.21.15.98:0/1410337175 >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 0x7f007c0c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008083d700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c150750 0x7f007c150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 -- 172.21.15.98:0/1410337175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c150750 msgr2=0x7f007c150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:13.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c150750 0x7f007c150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 -- 172.21.15.98:0/1410337175 >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 msgr2=0x7f007c0c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:13.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 --2- 172.21.15.98:0/1410337175 >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 0x7f007c0c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 -- 172.21.15.98:0/1410337175 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0bc920 con 0x7f007c0c3900 2023-08-22T00:19:13.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f007bfff700 1 --2- 172.21.15.98:0/1410337175 >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 0x7f007c0c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f008103e700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c0c3900 0x7f007c065fa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f007c0c5220 tx=0x7f0074009840).ready entity=mon.0 client_cookie=4426548d5059e442 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f007b7fe700 1 -- 172.21.15.98:0/1410337175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400e070 con 0x7f007c0c3900 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f007b7fe700 1 -- 172.21.15.98:0/1410337175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400ba50 con 0x7f007c0c3900 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f007b7fe700 1 -- 172.21.15.98:0/1410337175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400bdd0 con 0x7f007c0c3900 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 -- 172.21.15.98:0/1410337175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c0c3900 msgr2=0x7f007c065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c0c3900 0x7f007c065fa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f007c0c5220 tx=0x7f0074009840).stop 2023-08-22T00:19:13.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 -- 172.21.15.98:0/1410337175 shutdown_connections 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c150750 0x7f007c150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 --2- 172.21.15.98:0/1410337175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c0c3900 0x7f007c065fa0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 --2- 172.21.15.98:0/1410337175 >> v2:172.21.15.118:3300/0 conn(0x7f007c065690 0x7f007c0c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.944+0000 7f0082aa1700 1 -- 172.21.15.98:0/1410337175 >> 172.21.15.98:0/1410337175 conn(0x7f007c06a930 msgr2=0x7f007c0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.945+0000 7f0082aa1700 1 -- 172.21.15.98:0/1410337175 shutdown_connections 2023-08-22T00:19:13.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.945+0000 7f0082aa1700 1 -- 172.21.15.98:0/1410337175 wait complete. 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.946+0000 7f0082aa1700 1 Processor -- start 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.946+0000 7f0082aa1700 1 -- start start 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c065690 0x7f007c0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007c0c3900 0x7f007c0c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c69a0 con 0x7f007c150750 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c5d90 con 0x7f007c0c3900 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c6070 con 0x7f007c065690 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33212/0 (socket says 172.21.15.98:33212) 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 -- 172.21.15.98:0/17818352 learned_addr learned my addr 172.21.15.98:0/17818352 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008083d700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c065690 0x7f007c0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 -- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c065690 msgr2=0x7f007c0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:13.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c065690 0x7f007c0ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f007bfff700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007c0c3900 0x7f007c0c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 -- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007c0c3900 msgr2=0x7f007c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007c0c3900 0x7f007c0c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 -- 172.21.15.98:0/17818352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009ae0 con 0x7f007c150750 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f008103e700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f007c0c5280 tx=0x7f0074009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074013e60 con 0x7f007c150750 2023-08-22T00:19:13.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074009500 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c0c6350 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074019870 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.947+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c0c5a70 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.948+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c047480 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.948+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f0074003040 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.949+0000 7f0078ff9700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 0x7f0060061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.949+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f007407d840 con 0x7f007c150750 2023-08-22T00:19:13.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.949+0000 7f008083d700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 0x7f0060061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:13.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.949+0000 7f008083d700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 0x7f0060061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0070006fd0 tx=0x7f0070008040).ready entity=mgr.5354 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:13.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:13.953+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f007404ec20 con 0x7f007c150750 2023-08-22T00:19:14.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.136+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f007c0c6ae0 con 0x7f006005ed40 2023-08-22T00:19:14.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.140+0000 7f0078ff9700 1 -- 172.21.15.98:0/17818352 <== mgr.5354 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f007c0c6ae0 con 0x7f006005ed40 2023-08-22T00:19:14.142 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:19:14.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 msgr2=0x7f0060061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 0x7f0060061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0070006fd0 tx=0x7f0070008040).stop 2023-08-22T00:19:14.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 msgr2=0x7f007c149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f007c0c5280 tx=0x7f0074009840).stop 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 shutdown_connections 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f006005ed40 0x7f0060061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007c065690 0x7f007c0ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007c150750 0x7f007c149030 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 --2- 172.21.15.98:0/17818352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007c0c3900 0x7f007c0c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 >> 172.21.15.98:0/17818352 conn(0x7f007c06a930 msgr2=0x7f007c153ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:14.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 shutdown_connections 2023-08-22T00:19:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.142+0000 7f0082aa1700 1 -- 172.21.15.98:0/17818352 wait complete. 2023-08-22T00:19:14.155 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:19:14.155 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-22-00_20_00 in ~46s... 2023-08-22T00:19:14.156 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-22-00_21_00 in ~106s... 2023-08-22T00:19:14.156 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-08-22T00:19:14.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-22T00:19:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.274+0000 7f1a0c142700 1 Processor -- start 2023-08-22T00:19:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.274+0000 7f1a0c142700 1 -- start start 2023-08-22T00:19:14.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a0c142700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1a04151a60 0x7f1a040a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a0c142700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a04151e40 0x7f1a040c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a0c142700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040bd650 con 0x7f1a040c4720 2023-08-22T00:19:14.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a0c142700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a040639a0 con 0x7f1a04151a60 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a0c142700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a040c4b90 con 0x7f1a04151e40 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1a04151a60 0x7f1a040a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1a04151a60 0x7f1a040a7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33224/0 (socket says 172.21.15.98:33224) 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 -- 172.21.15.98:0/1286089221 learned_addr learned my addr 172.21.15.98:0/1286089221 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 -- 172.21.15.98:0/1286089221 >> v2:172.21.15.118:3300/0 conn(0x7f1a04151e40 msgr2=0x7f1a040c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 --2- 172.21.15.98:0/1286089221 >> v2:172.21.15.118:3300/0 conn(0x7f1a04151e40 0x7f1a040c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 -- 172.21.15.98:0/1286089221 >> v1:172.21.15.118:6789/0 conn(0x7f1a040c4720 legacy=0x7f1a040bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:19:14.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.275+0000 7f1a09ede700 1 -- 172.21.15.98:0/1286089221 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04063070 con 0x7f1a04151a60 2023-08-22T00:19:14.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a09ede700 1 --2- 172.21.15.98:0/1286089221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a04151a60 0x7f1a040a7850 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f1a040c52a0 tx=0x7f19f40090f0).ready entity=mon.0 client_cookie=47974cfd1e23082a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:14.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a08edc700 1 -- 172.21.15.98:0/1286089221 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400b5a0 con 0x7f1a04151a60 2023-08-22T00:19:14.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a08edc700 1 -- 172.21.15.98:0/1286089221 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400b700 con 0x7f1a04151a60 2023-08-22T00:19:14.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a08edc700 1 -- 172.21.15.98:0/1286089221 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400ba80 con 0x7f1a04151a60 2023-08-22T00:19:14.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 -- 172.21.15.98:0/1286089221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a04151a60 msgr2=0x7f1a040a7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 --2- 172.21.15.98:0/1286089221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a04151a60 0x7f1a040a7850 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f1a040c52a0 tx=0x7f19f40090f0).stop 2023-08-22T00:19:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 -- 172.21.15.98:0/1286089221 shutdown_connections 2023-08-22T00:19:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 --2- 172.21.15.98:0/1286089221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a04151a60 0x7f1a040a7850 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 --2- 172.21.15.98:0/1286089221 >> v2:172.21.15.118:3300/0 conn(0x7f1a04151e40 0x7f1a040c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:19:14.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 -- 172.21.15.98:0/1286089221 >> 172.21.15.98:0/1286089221 conn(0x7f1a0406a910 msgr2=0x7f1a04065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 -- 172.21.15.98:0/1286089221 shutdown_connections 2023-08-22T00:19:14.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.276+0000 7f1a0c142700 1 -- 172.21.15.98:0/1286089221 wait complete. 2023-08-22T00:19:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.277+0000 7f1a0c142700 1 Processor -- start 2023-08-22T00:19:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.277+0000 7f1a0c142700 1 -- start start 2023-08-22T00:19:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a04151a60 0x7f1a0414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 0x7f1a041493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040a38d0 con 0x7f1a040c4720 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040a4170 con 0x7f1a04151e40 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0c142700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0414bc40 con 0x7f1a04151a60 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a09ede700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a09ede700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33230/0 (socket says 172.21.15.98:33230) 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a09ede700 1 -- 172.21.15.98:0/3541653809 learned_addr learned my addr 172.21.15.98:0/3541653809 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:19:14.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a096dd700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a04151a60 0x7f1a0414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.278+0000 7f1a0a6df700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 0x7f1a041493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 -- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a04151a60 msgr2=0x7f1a0414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a04151a60 0x7f1a0414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 -- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 msgr2=0x7f1a041493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 0x7f1a041493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 -- 172.21.15.98:0/3541653809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009370 con 0x7f1a040c4720 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a0a6df700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 0x7f1a041493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:19:14.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a09ede700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f1a04046e10 tx=0x7f19f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400b870 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400b9d0 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a040a3b20 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f401c650 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.279+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0414b950 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.280+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a04047480 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.280+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f19f401ca40 con 0x7f1a040c4720 2023-08-22T00:19:14.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.281+0000 7f19f9ffb700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 0x7f19e8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:19:14.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.281+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f19f407bc40 con 0x7f1a040c4720 2023-08-22T00:19:14.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.281+0000 7f1a096dd700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 0x7f19e8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:19:14.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.281+0000 7f1a096dd700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 0x7f19e8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1a040c8310 tx=0x7f1a00009060).ready entity=mgr.5354 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:19:14.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.285+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19f404d020 con 0x7f1a040c4720 2023-08-22T00:19:14.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.470+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a0406b3e0 con 0x7f19e805ed40 2023-08-22T00:19:14.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.472+0000 7f19f9ffb700 1 -- 172.21.15.98:0/3541653809 <== mgr.5354 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f1a0406b3e0 con 0x7f19e805ed40 2023-08-22T00:19:14.473 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:19:14.473 INFO:teuthology.orchestra.run.smithi098.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-22T00:19:14.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 msgr2=0x7f19e8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 0x7f19e8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1a040c8310 tx=0x7f1a00009060).stop 2023-08-22T00:19:14.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 msgr2=0x7f1a04154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:19:14.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f1a04046e10 tx=0x7f19f4015000).stop 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 shutdown_connections 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a04151e40 0x7f1a041493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a040c4720 0x7f1a04154380 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19e805ed40 0x7f19e8061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 --2- 172.21.15.98:0/3541653809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a04151a60 0x7f1a0414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 >> 172.21.15.98:0/3541653809 conn(0x7f1a0406a910 msgr2=0x7f1a040a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:19:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 shutdown_connections 2023-08-22T00:19:14.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:19:14.474+0000 7f1a0c142700 1 -- 172.21.15.98:0/3541653809 wait complete. 2023-08-22T00:19:14.487 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-22T00:19:14.487 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-08-22T00:19:14.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:14.488 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:15.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:15.514 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:16.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:16.542 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:17.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:17.572 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:18.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:18.603 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:19.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:19.633 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:20.151 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:19:20.155 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:19:20.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:20.663 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:21.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:21.693 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:22.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:22.724 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:23.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:23.757 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:24.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:24.789 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:25.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:25.822 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:26.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:26.852 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:27.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:27.883 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:28.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:28.913 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:29.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:29.944 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:30.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:30.979 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:32.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:32.014 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:33.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:33.046 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:34.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:34.076 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:35.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:35.109 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:36.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:36.138 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:37.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:37.168 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:38.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:38.199 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:39.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:39.229 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:40.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:40.260 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:41.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:41.290 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:42.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:42.318 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:43.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:43.348 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:44.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:44.377 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:45.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:45.407 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:46.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:46.436 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:47.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:47.469 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:48.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:48.498 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:49.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:49.527 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:50.257 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:19:50.261 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:19:50.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:50.556 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:51.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:51.585 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:52.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:52.614 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:53.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:53.642 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:54.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:54.671 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:55.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:55.701 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:56.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:56.730 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:57.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:57.761 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:58.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:58.790 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:19:59.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:19:59.819 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:00.146 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:20:00.145+0000 7f4c6e2e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:20:00.146 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:20:00.145+0000 7f4c6e2e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:20:00.146 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:20:00.145+0000 7f4c6e2e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:20:00.147 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:20:00.145+0000 7f4c6e2e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:20:00.147 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:20:00.145+0000 7f4c6e2e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:20:00.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:00.849 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:00.876 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:00.877 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-22-00_20_00_UTC'] 2023-08-22T00:20:00.877 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692663554.155737, now = 1692663600.8773704, timo = 46 2023-08-22T00:20:01.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:01.880 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:01.907 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:02.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:02.909 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:02.938 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:03.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:03.940 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:03.968 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:04.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:04.970 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:04.998 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:05.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:06.000 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:06.033 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:07.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:07.035 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:07.062 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:08.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:08.064 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:08.091 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:09.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:09.094 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:09.121 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:10.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:10.123 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:10.151 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:11.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:11.153 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:11.181 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:12.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:12.183 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:12.211 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:13.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:13.213 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:13.242 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:14.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:14.243 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:14.271 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:15.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:15.273 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:15.301 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:16.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:16.305 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:16.334 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:17.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:17.336 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:17.363 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:18.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:18.365 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:18.395 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:19.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:19.397 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:19.425 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:20.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:20:20.332 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:20:20.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:20.428 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:20.453 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:21.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:21.455 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:21.483 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:22.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:22.487 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:22.515 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:23.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:23.517 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:23.544 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:24.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:24.546 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:24.573 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:25.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:25.575 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:25.602 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:26.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:26.603 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:26.631 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:27.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:27.633 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:27.661 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:28.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:28.663 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:28.690 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:29.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:29.692 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:29.720 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:30.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:30.722 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:30.749 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:31.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:31.751 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:31.779 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:32.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:32.781 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:32.810 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:33.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:33.812 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:33.841 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:34.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:34.844 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:34.872 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:35.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:35.875 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:35.903 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:36.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:36.904 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:36.932 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:37.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:37.934 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:37.962 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:38.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:38.964 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:38.993 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:39.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:39.995 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:40.022 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:41.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:41.025 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:41.052 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:42.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:42.054 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:42.083 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:43.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:43.085 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:43.115 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:44.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:44.117 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:44.154 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:45.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:45.156 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:45.184 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:46.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:46.186 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:46.215 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:47.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:47.217 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:48.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:48.247 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:48.277 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:49.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:49.279 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:49.307 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:50.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:50.308 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:50.336 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:50.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:20:50.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:20:51.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:51.338 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:51.365 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:52.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:52.367 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:52.395 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:53.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:53.397 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:53.426 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:54.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:54.429 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:54.461 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:55.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:55.462 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:55.490 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:56.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:56.492 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:56.521 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:57.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:57.522 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:57.550 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:58.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:58.552 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:58.580 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:20:59.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:20:59.582 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:20:59.609 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:21:00.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:00.611 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:21:00.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:21:00.641 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_21_00_UTC 2023-08-22T00:21:00.642 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-22-00_21_00_UTC'] 2023-08-22T00:21:00.642 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692663554.155737, now = 1692663660.6426804, timo = 106 2023-08-22T00:21:01.645 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-22T00:21:01.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.777+0000 7f084d5b0700 1 Processor -- start 2023-08-22T00:21:01.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.777+0000 7f084d5b0700 1 -- start start 2023-08-22T00:21:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f084d5b0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0848063d20 0x7f08480c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f084d5b0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0848066370 0x7f08480667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f084d5b0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08480c20a0 con 0x7f0848153b90 2023-08-22T00:21:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f084d5b0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08480c6430 con 0x7f0848066370 2023-08-22T00:21:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f084d5b0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08480c1490 con 0x7f0848063d20 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0848066370 0x7f08480667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0848066370 0x7f08480667c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37930/0 (socket says 172.21.15.98:37930) 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 -- 172.21.15.98:0/823613072 learned_addr learned my addr 172.21.15.98:0/823613072 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f0846ffd700 1 --1- 172.21.15.98:0/823613072 >> v1:172.21.15.98:6789/0 conn(0x7f0848153b90 0x7f0848063610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52512/0 (socket says 172.21.15.98:52512) 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08467fc700 1 --2- 172.21.15.98:0/823613072 >> v2:172.21.15.118:3300/0 conn(0x7f0848063d20 0x7f08480c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 -- 172.21.15.98:0/823613072 >> v2:172.21.15.118:3300/0 conn(0x7f0848063d20 msgr2=0x7f08480c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 --2- 172.21.15.98:0/823613072 >> v2:172.21.15.118:3300/0 conn(0x7f0848063d20 0x7f08480c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 -- 172.21.15.98:0/823613072 >> v1:172.21.15.98:6789/0 conn(0x7f0848153b90 legacy=0x7f0848063610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f08477fe700 1 -- 172.21.15.98:0/823613072 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480c1770 con 0x7f0848066370 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.778+0000 7f0845ffb700 1 -- 172.21.15.98:0/823613072 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190930402 0 0) 0x7f08480c20a0 con 0x7f0848153b90 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f08477fe700 1 --2- 172.21.15.98:0/823613072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848066370 0x7f08480667c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0848068710 tx=0x7f0840009840).ready entity=mon.0 client_cookie=df4bb939cbafae4d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f0845ffb700 1 -- 172.21.15.98:0/823613072 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000e070 con 0x7f0848066370 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f0845ffb700 1 -- 172.21.15.98:0/823613072 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000ba50 con 0x7f0848066370 2023-08-22T00:21:01.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f0845ffb700 1 -- 172.21.15.98:0/823613072 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000bdd0 con 0x7f0848066370 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 -- 172.21.15.98:0/823613072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848066370 msgr2=0x7f08480667c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 --2- 172.21.15.98:0/823613072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848066370 0x7f08480667c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0848068710 tx=0x7f0840009840).stop 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 -- 172.21.15.98:0/823613072 shutdown_connections 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 --2- 172.21.15.98:0/823613072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848066370 0x7f08480667c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 --2- 172.21.15.98:0/823613072 >> v2:172.21.15.118:3300/0 conn(0x7f0848063d20 0x7f08480c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 -- 172.21.15.98:0/823613072 >> 172.21.15.98:0/823613072 conn(0x7f0848069110 msgr2=0x7f0848069520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:01.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 -- 172.21.15.98:0/823613072 shutdown_connections 2023-08-22T00:21:01.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.779+0000 7f084d5b0700 1 -- 172.21.15.98:0/823613072 wait complete. 2023-08-22T00:21:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 Processor -- start 2023-08-22T00:21:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 -- start start 2023-08-22T00:21:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0848066370 0x7f08480a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 0x7f0848151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480ab5b0 con 0x7f0848063d20 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480a8ca0 con 0x7f0848153b90 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f084d5b0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480a8f80 con 0x7f0848066370 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f0846ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f0846ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37942/0 (socket says 172.21.15.98:37942) 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.781+0000 7f0846ffd700 1 -- 172.21.15.98:0/2311868973 learned_addr learned my addr 172.21.15.98:0/2311868973 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f08477fe700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 0x7f0848151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f08467fc700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0848066370 0x7f08480a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 -- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0848066370 msgr2=0x7f08480a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0848066370 0x7f08480a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 -- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 msgr2=0x7f0848151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 0x7f0848151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 -- 172.21.15.98:0/2311868973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840009ae0 con 0x7f0848063d20 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f08477fe700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 0x7f0848151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:01.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f0846ffd700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f083c00c490 tx=0x7f083c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0072e0 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c007440 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08480ab240 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0058a0 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.782+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08480aaf30 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.783+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f083c005c90 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.783+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08480a9140 con 0x7f0848063d20 2023-08-22T00:21:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.784+0000 7f082effd700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 0x7f0834061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.784+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f083c0799e0 con 0x7f0848063d20 2023-08-22T00:21:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.784+0000 7f08467fc700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 0x7f0834061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:01.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.784+0000 7f08467fc700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 0x7f0834061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0838006fd0 tx=0x7f0838008040).ready entity=mgr.5354 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:01.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.788+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f083c04aaf0 con 0x7f0848063d20 2023-08-22T00:21:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.971+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f08480ab6f0 con 0x7f083405ef80 2023-08-22T00:21:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.975+0000 7f082effd700 1 -- 172.21.15.98:0/2311868973 <== mgr.5354 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0838009570 con 0x7f083405ef80 2023-08-22T00:21:01.977 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path snap_test_dir1 2023-08-22T00:21:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.976+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 msgr2=0x7f0834061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 0x7f0834061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0838006fd0 tx=0x7f0838008040).stop 2023-08-22T00:21:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 msgr2=0x7f084814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f083c00c490 tx=0x7f083c007dc0).stop 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 shutdown_connections 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0848153b90 0x7f0848151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0848063d20 0x7f084814e7c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f083405ef80 0x7f0834061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 --2- 172.21.15.98:0/2311868973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0848066370 0x7f08480a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 >> 172.21.15.98:0/2311868973 conn(0x7f0848069110 msgr2=0x7f08480c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:01.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 shutdown_connections 2023-08-22T00:21:01.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:01.977+0000 7f084d5b0700 1 -- 172.21.15.98:0/2311868973 wait complete. 2023-08-22T00:21:01.991 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-22T00:21:01.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:01.992 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:21:02.017 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:21:02.017 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_21_00_UTC 2023-08-22T00:21:02.018 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-22-00_20_00_UTC 2023-08-22T00:21:02.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:02.018 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-22-00_20_00_UTC) 2023-08-22T00:21:02.083 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-22-00_21_00_UTC 2023-08-22T00:21:02.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:02.084 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-22-00_21_00_UTC) 2023-08-22T00:21:02.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:02.148 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:21:02.210 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:21:02.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.366+0000 7f3236f0c700 1 Processor -- start 2023-08-22T00:21:02.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.366+0000 7f3236f0c700 1 -- start start 2023-08-22T00:21:02.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3236f0c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32300654d0 0x7f32300c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3236f0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f32301542a0 0x7f3230065f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3236f0c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3230154730 con 0x7f32300658b0 2023-08-22T00:21:02.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3236f0c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3230154a10 con 0x7f32301542a0 2023-08-22T00:21:02.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3236f0c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3230154cf0 con 0x7f32300654d0 2023-08-22T00:21:02.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f32301542a0 0x7f3230065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f32300658b0 0x7f32300c6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52520/0 (socket says 172.21.15.98:52520) 2023-08-22T00:21:02.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322ffff700 1 -- 172.21.15.98:0/2789648513 learned_addr learned my addr 172.21.15.98:0/2789648513 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:02.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f3234ca8700 1 --2- 172.21.15.98:0/2789648513 >> v2:172.21.15.118:3300/0 conn(0x7f32300654d0 0x7f32300c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 -- 172.21.15.98:0/2789648513 >> v2:172.21.15.118:3300/0 conn(0x7f32300654d0 msgr2=0x7f32300c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 --2- 172.21.15.98:0/2789648513 >> v2:172.21.15.118:3300/0 conn(0x7f32300654d0 0x7f32300c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 -- 172.21.15.98:0/2789648513 >> v1:172.21.15.98:6789/0 conn(0x7f32300658b0 legacy=0x7f32300c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322f7fe700 1 -- 172.21.15.98:0/2789648513 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129601044 0 0) 0x7f3230154730 con 0x7f32300658b0 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 -- 172.21.15.98:0/2789648513 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230154fd0 con 0x7f32301542a0 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f32354a9700 1 --2- 172.21.15.98:0/2789648513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32301542a0 0x7f3230065f90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f32300696c0 tx=0x7f3228009780).ready entity=mon.0 client_cookie=a8e3505ea3d8513e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:02.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322f7fe700 1 -- 172.21.15.98:0/2789648513 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800e070 con 0x7f32301542a0 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322f7fe700 1 -- 172.21.15.98:0/2789648513 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800bc30 con 0x7f32301542a0 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.367+0000 7f322f7fe700 1 -- 172.21.15.98:0/2789648513 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228012410 con 0x7f32301542a0 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 -- 172.21.15.98:0/2789648513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32301542a0 msgr2=0x7f3230065f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 --2- 172.21.15.98:0/2789648513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32301542a0 0x7f3230065f90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f32300696c0 tx=0x7f3228009780).stop 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 -- 172.21.15.98:0/2789648513 shutdown_connections 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 --2- 172.21.15.98:0/2789648513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32301542a0 0x7f3230065f90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 --2- 172.21.15.98:0/2789648513 >> v2:172.21.15.118:3300/0 conn(0x7f32300654d0 0x7f32300c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 -- 172.21.15.98:0/2789648513 >> 172.21.15.98:0/2789648513 conn(0x7f32300c7800 msgr2=0x7f32300c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 -- 172.21.15.98:0/2789648513 shutdown_connections 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.368+0000 7f3236f0c700 1 -- 172.21.15.98:0/2789648513 wait complete. 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.369+0000 7f3236f0c700 1 Processor -- start 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.369+0000 7f3236f0c700 1 -- start start 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32300658b0 0x7f3230160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 0x7f32300a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32300a5f40 con 0x7f32300654d0 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32300c0390 con 0x7f32300658b0 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3236f0c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32300c0630 con 0x7f32300be8a0 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3234ca8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3234ca8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37958/0 (socket says 172.21.15.98:37958) 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3234ca8700 1 -- 172.21.15.98:0/4219912095 learned_addr learned my addr 172.21.15.98:0/4219912095 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:02.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f322ffff700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32300658b0 0x7f3230160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f32354a9700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 0x7f32300a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3234ca8700 1 -- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 msgr2=0x7f32300a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.370+0000 7f3234ca8700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 0x7f32300a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3234ca8700 1 -- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32300658b0 msgr2=0x7f3230160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3234ca8700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32300658b0 0x7f3230160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3234ca8700 1 -- 172.21.15.98:0/4219912095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009a20 con 0x7f32300654d0 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f32354a9700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 0x7f32300a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:02.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3234ca8700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f322400d890 tx=0x7f3224008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240125f0 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224012750 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32300a6710 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224012ad0 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.371+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32300a6150 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.372+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230069220 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.372+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f3224013480 con 0x7f32300654d0 2023-08-22T00:21:02.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.372+0000 7f322cff9700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 0x7f3214061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:02.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.372+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f322407a030 con 0x7f32300654d0 2023-08-22T00:21:02.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.372+0000 7f322ffff700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 0x7f3214061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:02.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.373+0000 7f322ffff700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 0x7f3214061440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f32300a58c0 tx=0x7f321c007bb0).ready entity=mgr.5354 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:02.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.377+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f322404b020 con 0x7f32300654d0 2023-08-22T00:21:02.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:02.582+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f32300c3c50 con 0x7f32300654d0 2023-08-22T00:21:03.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.527+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f32240779e0 con 0x7f32300654d0 2023-08-22T00:21:03.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.529+0000 7f322cff9700 1 -- 172.21.15.98:0/4219912095 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v23) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3224072380 con 0x7f32300654d0 2023-08-22T00:21:03.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 msgr2=0x7f3214061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:03.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 0x7f3214061440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f32300a58c0 tx=0x7f321c007bb0).stop 2023-08-22T00:21:03.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 msgr2=0x7f32301643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:03.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f322400d890 tx=0x7f3224008040).stop 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 shutdown_connections 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f321405ef80 0x7f3214061440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32300be8a0 0x7f32300a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32300654d0 0x7f32301643b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 --2- 172.21.15.98:0/4219912095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32300658b0 0x7f3230160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:03.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 >> 172.21.15.98:0/4219912095 conn(0x7f32300c7800 msgr2=0x7f3230152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:03.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 shutdown_connections 2023-08-22T00:21:03.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:03.531+0000 7f3236f0c700 1 -- 172.21.15.98:0/4219912095 wait complete. 2023-08-22T00:21:03.545 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:21:03.546 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:03.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:03.626 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:21:03.626 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:21:03.627 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:21:03.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:03.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[142418]: fuse finished with error 0 and tester_r 0 2023-08-22T00:21:03.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:21:03.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:03.664 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:21:03.672 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:03.672+0000 7fb8a6ce2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:03.674 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:03.673+0000 7fecb4d65680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:03.734 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:03.734+0000 7fb8a6ce2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:03.739 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:03.738+0000 7fecb4d65680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:03.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:21:03.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:03.802 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:21:03.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:03.820 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:21:03.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:21:03.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:03.821 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:21:03.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:03.860 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:21:03.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:21:03.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:03.861 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:21:03.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:03.880 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:21:03.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:04.016 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:04.016+0000 7fb8a6ce2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:04.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.017+0000 7f967936d700 1 Processor -- start 2023-08-22T00:21:04.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.017+0000 7f967936d700 1 -- start start 2023-08-22T00:21:04.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f967936d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9674153b60 0x7f9674068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f967936d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 0x7f9674158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f967936d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96740a8410 con 0x7f9674153f40 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f967936d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740a8cb0 con 0x7f9674153b60 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f967936d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96741586a0 con 0x7f96740a9140 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f96727fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9674153f40 0x7f9674157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52526/0 (socket says 172.21.15.98:52526) 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f96727fc700 1 -- 172.21.15.98:0/93054118 learned_addr learned my addr 172.21.15.98:0/93054118 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 --2- 172.21.15.98:0/93054118 >> v2:172.21.15.118:3300/0 conn(0x7f9674153b60 0x7f9674068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f96737fe700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 0x7f9674158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9671ffb700 1 -- 172.21.15.98:0/93054118 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89854058 0 0) 0x7f96740a8410 con 0x7f9674153f40 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9671ffb700 1 -- 172.21.15.98:0/93054118 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f965c0033f0 con 0x7f9674153f40 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 -- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 msgr2=0x7f9674158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 0x7f9674158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 -- 172.21.15.98:0/93054118 >> v1:172.21.15.98:6789/0 conn(0x7f9674153f40 legacy=0x7f9674157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 -- 172.21.15.98:0/93054118 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740a8660 con 0x7f9674153b60 2023-08-22T00:21:04.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f96737fe700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 0x7f9674158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.018+0000 7f9672ffd700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9674153b60 0x7f9674068d40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9664009760 tx=0x7f9664009060).ready entity=mon.1 client_cookie=9514f7bb52d6f32a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f9671ffb700 1 -- 172.21.15.98:0/93054118 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400d4a0 con 0x7f9674153b60 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f9671ffb700 1 -- 172.21.15.98:0/93054118 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400d600 con 0x7f9674153b60 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f9671ffb700 1 -- 172.21.15.98:0/93054118 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400d980 con 0x7f9674153b60 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 -- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9674153b60 msgr2=0x7f9674068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9674153b60 0x7f9674068d40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9664009760 tx=0x7f9664009060).stop 2023-08-22T00:21:04.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 -- 172.21.15.98:0/93054118 shutdown_connections 2023-08-22T00:21:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96740a9140 0x7f9674158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 --2- 172.21.15.98:0/93054118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9674153b60 0x7f9674068d40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 -- 172.21.15.98:0/93054118 >> 172.21.15.98:0/93054118 conn(0x7f96740c5dc0 msgr2=0x7f9674068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 -- 172.21.15.98:0/93054118 shutdown_connections 2023-08-22T00:21:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.019+0000 7f967936d700 1 -- 172.21.15.98:0/93054118 wait complete. 2023-08-22T00:21:04.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.020+0000 7f967936d700 1 Processor -- start 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 -- start start 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96740a9140 0x7f96740bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9674153f40 0x7f9674150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740677c0 con 0x7f96740c1d50 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674165240 con 0x7f96740a9140 2023-08-22T00:21:04.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f967936d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9674154ae0 con 0x7f9674153f40 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f96737fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f96737fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37982/0 (socket says 172.21.15.98:37982) 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f96737fe700 1 -- 172.21.15.98:0/2174363158 learned_addr learned my addr 172.21.15.98:0/2174363158 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f9672ffd700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96740a9140 0x7f96740bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.021+0000 7f96727fc700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9674153f40 0x7f9674150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9674153f40 msgr2=0x7f9674150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9674153f40 0x7f9674150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96740a9140 msgr2=0x7f96740bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96740a9140 0x7f96740bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 -- 172.21.15.98:0/2174363158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c009a20 con 0x7f96740c1d50 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f96737fe700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f966c009fc0 tx=0x7f966c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00cbd0 con 0x7f96740c1d50 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c00f040 con 0x7f96740c1d50 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c013400 con 0x7f96740c1d50 2023-08-22T00:21:04.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96640092a0 con 0x7f96740c1d50 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.022+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9674164f60 con 0x7f96740c1d50 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.023+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96740c2b20 con 0x7f96740c1d50 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.023+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f966c0137b0 con 0x7f96740c1d50 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.024+0000 7f965affd700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 0x7f9660061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.024+0000 7f9672ffd700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 msgr2=0x7f9660061420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.024+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f966c07ab80 con 0x7f96740c1d50 2023-08-22T00:21:04.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.024+0000 7f9672ffd700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 0x7f9660061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:04.031 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:04.025+0000 7fecb4d65680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:04.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.028+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f966c04bbd0 con 0x7f96740c1d50 2023-08-22T00:21:04.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.225+0000 7f9672ffd700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 msgr2=0x7f9660061420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.225+0000 7f9672ffd700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 0x7f9660061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:04.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.234+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9674154c20 con 0x7f96740c1d50 2023-08-22T00:21:04.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.234+0000 7f965affd700 1 -- 172.21.15.98:0/2174363158 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f966c04f1f0 con 0x7f96740c1d50 2023-08-22T00:21:04.236 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:04.236 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 msgr2=0x7f9660061420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 0x7f9660061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 msgr2=0x7f96740c2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f966c009fc0 tx=0x7f966c00b040).stop 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 shutdown_connections 2023-08-22T00:21:04.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96740c1d50 0x7f96740c2190 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96740a9140 0x7f96740bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f966005ef60 0x7f9660061420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 --2- 172.21.15.98:0/2174363158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9674153f40 0x7f9674150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 >> 172.21.15.98:0/2174363158 conn(0x7f96740c5dc0 msgr2=0x7f9674151290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 shutdown_connections 2023-08-22T00:21:04.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.236+0000 7f967936d700 1 -- 172.21.15.98:0/2174363158 wait complete. 2023-08-22T00:21:04.242 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:21:04.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:04.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.368+0000 7fe258d7f700 1 Processor -- start 2023-08-22T00:21:04.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 -- start start 2023-08-22T00:21:04.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2541550e0 0x7fe254065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe254066400 0x7fe2540bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540bd750 con 0x7fe254153cf0 2023-08-22T00:21:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540a7030 con 0x7fe2541550e0 2023-08-22T00:21:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.369+0000 7fe258d7f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c2010 con 0x7fe254066400 2023-08-22T00:21:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2541550e0 0x7fe254065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25259c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe254153cf0 0x7fe2541584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52530/0 (socket says 172.21.15.98:52530) 2023-08-22T00:21:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2541550e0 0x7fe254065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37992/0 (socket says 172.21.15.98:37992) 2023-08-22T00:21:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25259c700 1 -- 172.21.15.98:0/255103273 learned_addr learned my addr 172.21.15.98:0/255103273 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe252d9d700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe254066400 0x7fe2540bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 -- 172.21.15.98:0/255103273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe254066400 msgr2=0x7fe2540bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe254066400 0x7fe2540bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 -- 172.21.15.98:0/255103273 >> v1:172.21.15.98:6789/0 conn(0x7fe254153cf0 legacy=0x7fe2541584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 -- 172.21.15.98:0/255103273 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540a6d50 con 0x7fe2541550e0 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25159a700 1 -- 172.21.15.98:0/255103273 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245457439 0 0) 0x7fe2540bd750 con 0x7fe254153cf0 2023-08-22T00:21:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe251d9b700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2541550e0 0x7fe254065f10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fe248009760 tx=0x7fe248009060).ready entity=mon.0 client_cookie=aff32544485d94f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25159a700 1 -- 172.21.15.98:0/255103273 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800f510 con 0x7fe2541550e0 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25159a700 1 -- 172.21.15.98:0/255103273 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800f670 con 0x7fe2541550e0 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.370+0000 7fe25159a700 1 -- 172.21.15.98:0/255103273 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800f9f0 con 0x7fe2541550e0 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 -- 172.21.15.98:0/255103273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2541550e0 msgr2=0x7fe254065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2541550e0 0x7fe254065f10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fe248009760 tx=0x7fe248009060).stop 2023-08-22T00:21:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 -- 172.21.15.98:0/255103273 shutdown_connections 2023-08-22T00:21:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe254066400 0x7fe2540bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 --2- 172.21.15.98:0/255103273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2541550e0 0x7fe254065f10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 -- 172.21.15.98:0/255103273 >> 172.21.15.98:0/255103273 conn(0x7fe2540c7770 msgr2=0x7fe2540c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 -- 172.21.15.98:0/255103273 shutdown_connections 2023-08-22T00:21:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.371+0000 7fe258d7f700 1 -- 172.21.15.98:0/255103273 wait complete. 2023-08-22T00:21:04.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.372+0000 7fe258d7f700 1 Processor -- start 2023-08-22T00:21:04.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.372+0000 7fe258d7f700 1 -- start start 2023-08-22T00:21:04.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe254153cf0 0x7fe25414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2541550e0 0x7fe2540c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540bf9c0 con 0x7fe254066400 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540bfca0 con 0x7fe254153cf0 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe258d7f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540bff80 con 0x7fe2541550e0 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38008/0 (socket says 172.21.15.98:38008) 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 -- 172.21.15.98:0/4268606121 learned_addr learned my addr 172.21.15.98:0/4268606121 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe252d9d700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2541550e0 0x7fe2540c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe251d9b700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe254153cf0 0x7fe25414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 -- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2541550e0 msgr2=0x7fe2540c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2541550e0 0x7fe2540c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 -- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe254153cf0 msgr2=0x7fe25414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe254153cf0 0x7fe25414c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 -- 172.21.15.98:0/4268606121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480092a0 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.373+0000 7fe25259c700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe24400c4e0 tx=0x7fe244007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.374+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400ce90 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.374+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2440072e0 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.374+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe254063d70 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.374+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244007660 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.374+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25414d690 con 0x7fe254066400 2023-08-22T00:21:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.375+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254064210 con 0x7fe254066400 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.375+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe2440059b0 con 0x7fe254066400 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.375+0000 7fe2427fc700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 0x7fe2340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.375+0000 7fe251d9b700 1 -- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 msgr2=0x7fe2340613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.376+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fe244079a90 con 0x7fe254066400 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.376+0000 7fe251d9b700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 0x7fe2340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.380+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe24404aae0 con 0x7fe254066400 2023-08-22T00:21:04.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.552+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe254067e60 con 0x7fe254066400 2023-08-22T00:21:04.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.553+0000 7fe2427fc700 1 -- 172.21.15.98:0/4268606121 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17724 (secure 0 0 0) 0x7fe244018020 con 0x7fe254066400 2023-08-22T00:21:04.555 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:04.555 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":74,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:20:14.371320+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1380914503":"2023-08-23T00:19:12.779667+0000","172.21.15.98:6833/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1895897780":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/2661281862":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/3063201580":"2023-08-23T00:19:12.779667+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:04.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 msgr2=0x7fe2340613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 0x7fe2340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 msgr2=0x7fe25414d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe24400c4e0 tx=0x7fe244007c70).stop 2023-08-22T00:21:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 shutdown_connections 2023-08-22T00:21:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe23405ef30 0x7fe2340613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2541550e0 0x7fe2540c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe254066400 0x7fe25414d1a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 --2- 172.21.15.98:0/4268606121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe254153cf0 0x7fe25414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 >> 172.21.15.98:0/4268606121 conn(0x7fe2540c7770 msgr2=0x7fe254152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 shutdown_connections 2023-08-22T00:21:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.555+0000 7fe258d7f700 1 -- 172.21.15.98:0/4268606121 wait complete. 2023-08-22T00:21:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:18:54.392343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:18:54.795027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:21:04.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:21:04.629 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:04.628+0000 7fb8a6ce2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:04.667 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:04.666+0000 7fecb4d65680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:04.700 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:04.699+0000 7fb8a6ce2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:04.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.714+0000 7ff5a7cbd700 1 Processor -- start 2023-08-22T00:21:04.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.715+0000 7ff5a7cbd700 1 -- start start 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.715+0000 7ff5a7cbd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5a0064180 0x7ff5a00c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.715+0000 7ff5a7cbd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00c3d60 con 0x7ff5a0151e10 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a7cbd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00c3150 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a7cbd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a00c3430 con 0x7ff5a0064180 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a5a59700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff5a0151e10 0x7ff5a00a95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52544/0 (socket says 172.21.15.98:52544) 2023-08-22T00:21:04.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a5a59700 1 -- 172.21.15.98:0/1101727457 learned_addr learned my addr 172.21.15.98:0/1101727457 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a625a700 1 --2- 172.21.15.98:0/1101727457 >> v2:172.21.15.118:3300/0 conn(0x7ff5a0064180 0x7ff5a00c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544056446 0 0) 0x7ff5a00c3d60 con 0x7ff5a0151e10 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c0033f0 con 0x7ff5a0151e10 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668641144 0 0) 0x7ff5a00c3150 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a00c3d60 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a625a700 1 -- 172.21.15.98:0/1101727457 >> v1:172.21.15.118:6789/0 conn(0x7ff5a00a9cf0 legacy=0x7ff5a00c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a625a700 1 -- 172.21.15.98:0/1101727457 >> v1:172.21.15.98:6789/0 conn(0x7ff5a0151e10 legacy=0x7ff5a00a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 431993304 0 0) 0x7ff58c0033f0 con 0x7ff5a0151e10 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a625a700 1 -- 172.21.15.98:0/1101727457 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00c3710 con 0x7ff5a0064180 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a625a700 1 --2- 172.21.15.98:0/1101727457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a00c2b70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff598009e60 tx=0x7ff598009780).ready entity=mon.1 client_cookie=c9252fe12c4358da server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800e070 con 0x7ff5a0064180 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800bab0 con 0x7ff5a0064180 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.716+0000 7ff5a4a57700 1 -- 172.21.15.98:0/1101727457 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800be30 con 0x7ff5a0064180 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1101727457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 msgr2=0x7ff5a00c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1101727457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a00c2b70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff598009e60 tx=0x7ff598009780).stop 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1101727457 shutdown_connections 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1101727457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a00c2b70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1101727457 >> 172.21.15.98:0/1101727457 conn(0x7ff5a00c7820 msgr2=0x7ff5a00c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1101727457 shutdown_connections 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.717+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1101727457 wait complete. 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.718+0000 7ff5a7cbd700 1 Processor -- start 2023-08-22T00:21:04.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.718+0000 7ff5a7cbd700 1 -- start start 2023-08-22T00:21:04.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5a0151e10 0x7ff5a01545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0153d00 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0153870 con 0x7ff5a0064180 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a7cbd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0152c60 con 0x7ff5a0151e10 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5a59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38024/0 (socket says 172.21.15.98:38024) 2023-08-22T00:21:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 -- 172.21.15.98:0/1254061058 learned_addr learned my addr 172.21.15.98:0/1254061058 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a625a700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5a0151e10 0x7ff5a01545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 -- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5a0151e10 msgr2=0x7ff5a01545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5a0151e10 0x7ff5a01545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 -- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 msgr2=0x7ff5a014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a014d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 -- 172.21.15.98:0/1254061058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598009a20 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5a59700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.719+0000 7ff5a5258700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7ff59000c420 tx=0x7ff590007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.720+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590012400 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.720+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590012560 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.720+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0152f40 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.720+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590012920 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.720+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a00abce0 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.721+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0153a00 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.721+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ff59001b3b0 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.722+0000 7ff595ffb700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 0x7ff5840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.722+0000 7ff5a5a59700 1 -- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 msgr2=0x7ff5840613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.722+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7ff590079a00 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.722+0000 7ff5a5a59700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 0x7ff5840613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:04.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.726+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff59004a9f0 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.742 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:04.741+0000 7fecb4d65680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:04.886 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:04.886+0000 7fb8a6ce2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.891+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff5a0153130 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.891+0000 7ff595ffb700 1 -- 172.21.15.98:0/1254061058 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff59004e010 con 0x7ff5a00a9cf0 2023-08-22T00:21:04.893 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:21:04.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 msgr2=0x7ff5840613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 0x7ff5840613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 msgr2=0x7ff5a0152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7ff59000c420 tx=0x7ff590007c60).stop 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 shutdown_connections 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff58405ef30 0x7ff5840613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5a0151e10 0x7ff5a01545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0064180 0x7ff5a014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 --2- 172.21.15.98:0/1254061058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5a00a9cf0 0x7ff5a0152280 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:04.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 >> 172.21.15.98:0/1254061058 conn(0x7ff5a00c7820 msgr2=0x7ff5a0065430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:04.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 shutdown_connections 2023-08-22T00:21:04.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:04.893+0000 7ff5a7cbd700 1 -- 172.21.15.98:0/1254061058 wait complete. 2023-08-22T00:21:04.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:21:04.936 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:04.933+0000 7fecb4d65680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:05.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.027+0000 7f5d249ea700 1 Processor -- start 2023-08-22T00:21:05.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.027+0000 7f5d249ea700 1 -- start start 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d249ea700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5d2014fd90 0x7f5d200675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d249ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 0x7f5d200c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d249ea700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d201525d0 con 0x7f5d20153010 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d249ea700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d20152b80 con 0x7f5d2014fd90 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d249ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200c4330 con 0x7f5d200c39d0 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1dd9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5d20153010 0x7f5d200a7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52554/0 (socket says 172.21.15.98:52554) 2023-08-22T00:21:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1dd9b700 1 -- 172.21.15.98:0/2652060319 learned_addr learned my addr 172.21.15.98:0/2652060319 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 --2- 172.21.15.98:0/2652060319 >> v2:172.21.15.118:3300/0 conn(0x7f5d2014fd90 0x7f5d200675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1ed9d700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 0x7f5d200c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1d59a700 1 -- 172.21.15.98:0/2652060319 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544991867 0 0) 0x7f5d14001110 con 0x7f5d20153010 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1d59a700 1 -- 172.21.15.98:0/2652060319 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d080033f0 con 0x7f5d20153010 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 -- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 msgr2=0x7f5d200c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:05.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 0x7f5d200c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 -- 172.21.15.98:0/2652060319 >> v1:172.21.15.98:6789/0 conn(0x7f5d20153010 legacy=0x7f5d200a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 -- 172.21.15.98:0/2652060319 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20067bd0 con 0x7f5d2014fd90 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1ed9d700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 0x7f5d200c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.029+0000 7f5d1e59c700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2014fd90 0x7f5d200675f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5d10009760 tx=0x7f5d10009060).ready entity=mon.1 client_cookie=c4829f5da5524396 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d1d59a700 1 -- 172.21.15.98:0/2652060319 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000d4a0 con 0x7f5d2014fd90 2023-08-22T00:21:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d1d59a700 1 -- 172.21.15.98:0/2652060319 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1000d600 con 0x7f5d2014fd90 2023-08-22T00:21:05.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d1d59a700 1 -- 172.21.15.98:0/2652060319 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000d980 con 0x7f5d2014fd90 2023-08-22T00:21:05.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 -- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2014fd90 msgr2=0x7f5d200675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2014fd90 0x7f5d200675f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5d10009760 tx=0x7f5d10009060).stop 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 -- 172.21.15.98:0/2652060319 shutdown_connections 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d200c39d0 0x7f5d200c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 --2- 172.21.15.98:0/2652060319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2014fd90 0x7f5d200675f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 -- 172.21.15.98:0/2652060319 >> 172.21.15.98:0/2652060319 conn(0x7f5d200c8950 msgr2=0x7f5d200c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 -- 172.21.15.98:0/2652060319 shutdown_connections 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.030+0000 7f5d249ea700 1 -- 172.21.15.98:0/2652060319 wait complete. 2023-08-22T00:21:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.032+0000 7f5d249ea700 1 Processor -- start 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.032+0000 7f5d249ea700 1 -- start start 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d200c39d0 0x7f5d200c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2014fd90 0x7f5d2014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20137fe0 con 0x7f5d20153010 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20138ff0 con 0x7f5d200c39d0 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.033+0000 7f5d249ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d201383e0 con 0x7f5d2014fd90 2023-08-22T00:21:05.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38038/0 (socket says 172.21.15.98:38038) 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 -- 172.21.15.98:0/1613605760 learned_addr learned my addr 172.21.15.98:0/1613605760 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1dd9b700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2014fd90 0x7f5d2014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1e59c700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d200c39d0 0x7f5d200c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 -- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2014fd90 msgr2=0x7f5d2014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2014fd90 0x7f5d2014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 -- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d200c39d0 msgr2=0x7f5d200c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d200c39d0 0x7f5d200c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 -- 172.21.15.98:0/1613605760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d18009a20 con 0x7f5d20153010 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d1ed9d700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f5d18009fc0 tx=0x7f5d1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800cbd0 con 0x7f5d20153010 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800f040 con 0x7f5d20153010 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d100092a0 con 0x7f5d20153010 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18013400 con 0x7f5d20153010 2023-08-22T00:21:05.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.034+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d20138c80 con 0x7f5d20153010 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d20069d50 con 0x7f5d20153010 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f5d180137f0 con 0x7f5d20153010 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d0e7fc700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 0x7f5d000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d1e59c700 1 -- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 msgr2=0x7f5d000613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f5d1807abf0 con 0x7f5d20153010 2023-08-22T00:21:05.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.036+0000 7f5d1e59c700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 0x7f5d000613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:05.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.044+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d18081080 con 0x7f5d20153010 2023-08-22T00:21:05.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.211+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d20067eb0 con 0x7f5d20153010 2023-08-22T00:21:05.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.212+0000 7f5d0e7fc700 1 -- 172.21.15.98:0/1613605760 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d1804bc40 con 0x7f5d20153010 2023-08-22T00:21:05.213 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:21:05.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.213+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 msgr2=0x7f5d000613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:05.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 0x7f5d000613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 msgr2=0x7f5d200a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f5d18009fc0 tx=0x7f5d1800b040).stop 2023-08-22T00:21:05.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 shutdown_connections 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d20153010 0x7f5d200a8b70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d200c39d0 0x7f5d200c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5d0005ef30 0x7f5d000613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 --2- 172.21.15.98:0/1613605760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2014fd90 0x7f5d2014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 >> 172.21.15.98:0/1613605760 conn(0x7f5d200c8950 msgr2=0x7f5d2014b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 shutdown_connections 2023-08-22T00:21:05.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.214+0000 7f5d249ea700 1 -- 172.21.15.98:0/1613605760 wait complete. 2023-08-22T00:21:05.227 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:21:05.308 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.307+0000 7fb8a6ce2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:05.382 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:05.380+0000 7fecb4d65680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:05.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.387+0000 7f5e9425c700 1 Processor -- start 2023-08-22T00:21:05.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.387+0000 7f5e9425c700 1 -- start start 2023-08-22T00:21:05.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.388+0000 7f5e9425c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5e8c157a80 0x7f5e8c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.388+0000 7f5e9425c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 0x7f5e8c153780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.388+0000 7f5e9425c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0c8d30 con 0x7f5e8c153c70 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.388+0000 7f5e9425c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c9010 con 0x7f5e8c157a80 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.388+0000 7f5e9425c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c92f0 con 0x7f5e8c157e60 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e927f9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5e8c153c70 0x7f5e8c0c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52570/0 (socket says 172.21.15.98:52570) 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e927f9700 1 -- 172.21.15.98:0/4249995929 learned_addr learned my addr 172.21.15.98:0/4249995929 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 --2- 172.21.15.98:0/4249995929 >> v2:172.21.15.118:3300/0 conn(0x7f5e8c157a80 0x7f5e8c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e917f7700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 0x7f5e8c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e90ff6700 1 -- 172.21.15.98:0/4249995929 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301147249 0 0) 0x7f5e8c0c8d30 con 0x7f5e8c153c70 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e90ff6700 1 -- 172.21.15.98:0/4249995929 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e780033f0 con 0x7f5e8c153c70 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 -- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 msgr2=0x7f5e8c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 0x7f5e8c153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 -- 172.21.15.98:0/4249995929 >> v1:172.21.15.98:6789/0 conn(0x7f5e8c153c70 legacy=0x7f5e8c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 -- 172.21.15.98:0/4249995929 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0c95d0 con 0x7f5e8c157a80 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e917f7700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 0x7f5e8c153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e91ff8700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0aa920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5e88009760 tx=0x7f5e88009060).ready entity=mon.1 client_cookie=e3be112d17beb9c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e90ff6700 1 -- 172.21.15.98:0/4249995929 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800d4a0 con 0x7f5e8c157a80 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e90ff6700 1 -- 172.21.15.98:0/4249995929 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800d600 con 0x7f5e8c157a80 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.389+0000 7f5e90ff6700 1 -- 172.21.15.98:0/4249995929 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800d980 con 0x7f5e8c157a80 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 -- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157a80 msgr2=0x7f5e8c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0aa920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5e88009760 tx=0x7f5e88009060).stop 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 -- 172.21.15.98:0/4249995929 shutdown_connections 2023-08-22T00:21:05.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0aa920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4249995929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c157e60 0x7f5e8c153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 -- 172.21.15.98:0/4249995929 >> 172.21.15.98:0/4249995929 conn(0x7f5e8c0cb5f0 msgr2=0x7f5e8c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 -- 172.21.15.98:0/4249995929 shutdown_connections 2023-08-22T00:21:05.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.390+0000 7f5e9425c700 1 -- 172.21.15.98:0/4249995929 wait complete. 2023-08-22T00:21:05.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.392+0000 7f5e9425c700 1 Processor -- start 2023-08-22T00:21:05.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.392+0000 7f5e9425c700 1 -- start start 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c153c70 0x7f5e8c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157e60 0x7f5e8c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c46f0 con 0x7f5e8c157a80 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c154860 con 0x7f5e8c157e60 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c154b40 con 0x7f5e8c153c70 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38050/0 (socket says 172.21.15.98:38050) 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 -- 172.21.15.98:0/4183225170 learned_addr learned my addr 172.21.15.98:0/4183225170 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e91ff8700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c153c70 0x7f5e8c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e927f9700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157e60 0x7f5e8c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 -- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c153c70 msgr2=0x7f5e8c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c153c70 0x7f5e8c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 -- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157e60 msgr2=0x7f5e8c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157e60 0x7f5e8c0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 -- 172.21.15.98:0/4183225170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0092a0 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e917f7700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f5e7c00e980 tx=0x7f5e7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c012600 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c012760 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e880092a0 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.393+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c012ae0 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.394+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c155100 con 0x7f5e8c157a80 2023-08-22T00:21:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.395+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c083630 con 0x7f5e8c157a80 2023-08-22T00:21:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.395+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f5e7c01b400 con 0x7f5e8c157a80 2023-08-22T00:21:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.395+0000 7f5e81ffb700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 0x7f5e700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.396+0000 7f5e91ff8700 1 -- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 msgr2=0x7f5e700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.396+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f5e7c07a6e0 con 0x7f5e8c157a80 2023-08-22T00:21:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.396+0000 7f5e91ff8700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 0x7f5e700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:05.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.399+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e7c04b6d0 con 0x7f5e8c157a80 2023-08-22T00:21:05.413 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.412+0000 7fb8a6ce2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:05.494 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:05.491+0000 7fecb4d65680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:05.565 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.564+0000 7fb8a6ce2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:05.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.566+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e8c046c20 con 0x7f5e8c157a80 2023-08-22T00:21:05.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.567+0000 7f5e81ffb700 1 -- 172.21.15.98:0/4183225170 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e7c04ecf0 con 0x7f5e8c157a80 2023-08-22T00:21:05.568 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:21:05.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 msgr2=0x7f5e700613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:05.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 0x7f5e700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 msgr2=0x7f5e8c0c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f5e7c00e980 tx=0x7f5e7c009060).stop 2023-08-22T00:21:05.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 shutdown_connections 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e7005ef30 0x7f5e700613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e8c153c70 0x7f5e8c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8c157e60 0x7f5e8c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 --2- 172.21.15.98:0/4183225170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8c157a80 0x7f5e8c0c3d10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 >> 172.21.15.98:0/4183225170 conn(0x7f5e8c0cb5f0 msgr2=0x7f5e8c0c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 shutdown_connections 2023-08-22T00:21:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.569+0000 7f5e9425c700 1 -- 172.21.15.98:0/4183225170 wait complete. 2023-08-22T00:21:05.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:21:05.639 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.639+0000 7fb8a6ce2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:05.654 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:05.652+0000 7fecb4d65680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:05.706 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.705+0000 7fb8a6ce2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:05.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.707+0000 7fbc7d4f1700 1 Processor -- start 2023-08-22T00:21:05.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.707+0000 7fbc7d4f1700 1 -- start start 2023-08-22T00:21:05.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc7d4f1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc781579e0 0x7fbc780c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc7d4f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc7d4f1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc78064280 con 0x7fbc780c5750 2023-08-22T00:21:05.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc7d4f1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780c1850 con 0x7fbc781579e0 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc7d4f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780c4c20 con 0x7fbc78063000 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc781579e0 0x7fbc780c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc76ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbc780c5750 0x7fbc780c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52580/0 (socket says 172.21.15.98:52580) 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc76ffd700 1 -- 172.21.15.98:0/935917519 learned_addr learned my addr 172.21.15.98:0/935917519 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc781579e0 0x7fbc780c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38066/0 (socket says 172.21.15.98:38066) 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc777fe700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 -- 172.21.15.98:0/935917519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 msgr2=0x7fbc78154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 -- 172.21.15.98:0/935917519 >> v1:172.21.15.98:6789/0 conn(0x7fbc780c5750 legacy=0x7fbc780c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 -- 172.21.15.98:0/935917519 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78063670 con 0x7fbc781579e0 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc75ffb700 1 -- 172.21.15.98:0/935917519 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554654073 0 0) 0x7fbc78064280 con 0x7fbc780c5750 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.708+0000 7fbc767fc700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc781579e0 0x7fbc780c5b30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fbc6c009760 tx=0x7fbc6c009060).ready entity=mon.0 client_cookie=4adba4a788c0a24d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc75ffb700 1 -- 172.21.15.98:0/935917519 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f510 con 0x7fbc781579e0 2023-08-22T00:21:05.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc75ffb700 1 -- 172.21.15.98:0/935917519 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f670 con 0x7fbc781579e0 2023-08-22T00:21:05.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc75ffb700 1 -- 172.21.15.98:0/935917519 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f9f0 con 0x7fbc781579e0 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/935917519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc781579e0 msgr2=0x7fbc780c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc781579e0 0x7fbc780c5b30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fbc6c009760 tx=0x7fbc6c009060).stop 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/935917519 shutdown_connections 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/935917519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc781579e0 0x7fbc780c5b30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/935917519 >> 172.21.15.98:0/935917519 conn(0x7fbc780c3a60 msgr2=0x7fbc780c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/935917519 shutdown_connections 2023-08-22T00:21:05.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.709+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/935917519 wait complete. 2023-08-22T00:21:05.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.710+0000 7fbc7d4f1700 1 Processor -- start 2023-08-22T00:21:05.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 -- start start 2023-08-22T00:21:05.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 0x7fbc780a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78150440 con 0x7fbc780c5750 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780a9810 con 0x7fbc781579e0 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc7d4f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78153930 con 0x7fbc78063000 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38076/0 (socket says 172.21.15.98:38076) 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc767fc700 1 -- 172.21.15.98:0/387218335 learned_addr learned my addr 172.21.15.98:0/387218335 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc76ffd700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.711+0000 7fbc777fe700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 0x7fbc780a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 -- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 msgr2=0x7fbc78164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78164fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 -- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 msgr2=0x7fbc780a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 0x7fbc780a9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 -- 172.21.15.98:0/387218335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0092a0 con 0x7fbc780c5750 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc777fe700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 0x7fbc780a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc767fc700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fbc780675f0 tx=0x7fbc6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f7e0 con 0x7fbc780c5750 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f940 con 0x7fbc780c5750 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c01b660 con 0x7fbc780c5750 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc78153c10 con 0x7fbc780c5750 2023-08-22T00:21:05.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.712+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc781541d0 con 0x7fbc780c5750 2023-08-22T00:21:05.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.713+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc78068970 con 0x7fbc780c5750 2023-08-22T00:21:05.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.714+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fbc6c01ba50 con 0x7fbc780c5750 2023-08-22T00:21:05.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.714+0000 7fbc5effd700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 0x7fbc640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:05.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.714+0000 7fbc76ffd700 1 -- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 msgr2=0x7fbc640613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:05.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.714+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fbc6c07bf30 con 0x7fbc780c5750 2023-08-22T00:21:05.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.714+0000 7fbc76ffd700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 0x7fbc640613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:05.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.718+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc6c0a48f0 con 0x7fbc780c5750 2023-08-22T00:21:05.733 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:05.732+0000 7fecb4d65680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:05.803 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:05.802+0000 7fecb4d65680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:05.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.884+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc780c6d00 con 0x7fbc780c5750 2023-08-22T00:21:05.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.885+0000 7fbc5effd700 1 -- 172.21.15.98:0/387218335 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc6c029020 con 0x7fbc780c5750 2023-08-22T00:21:05.887 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:21:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 msgr2=0x7fbc640613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 0x7fbc640613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 msgr2=0x7fbc781549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fbc780675f0 tx=0x7fbc6c017000).stop 2023-08-22T00:21:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 shutdown_connections 2023-08-22T00:21:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc6405ef30 0x7fbc640613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc78063000 0x7fbc78164fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc781579e0 0x7fbc780a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 --2- 172.21.15.98:0/387218335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc780c5750 0x7fbc781549d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:05.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 >> 172.21.15.98:0/387218335 conn(0x7fbc780c3a60 msgr2=0x7fbc78065a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 shutdown_connections 2023-08-22T00:21:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:05.887+0000 7fbc7d4f1700 1 -- 172.21.15.98:0/387218335 wait complete. 2023-08-22T00:21:05.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:05.961 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:05.960+0000 7fb8a6ce2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:06.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.019+0000 7fe608ef1700 1 Processor -- start 2023-08-22T00:21:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.019+0000 7fe608ef1700 1 -- start start 2023-08-22T00:21:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe608ef1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6040a61b0 0x7fe604150f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe608ef1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a6590 0x7fe6040bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe608ef1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe604151e40 con 0x7fe604151400 2023-08-22T00:21:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe608ef1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6040c4f80 con 0x7fe6040a61b0 2023-08-22T00:21:06.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe608ef1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe604151880 con 0x7fe6040a6590 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe60259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6040a61b0 0x7fe604150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe60259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6040a61b0 0x7fe604150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38082/0 (socket says 172.21.15.98:38082) 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe60259c700 1 -- 172.21.15.98:0/4285333216 learned_addr learned my addr 172.21.15.98:0/4285333216 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.020+0000 7fe601d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe604151400 0x7fe6040c5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52586/0 (socket says 172.21.15.98:52586) 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe602d9d700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a6590 0x7fe6040bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60159a700 1 -- 172.21.15.98:0/4285333216 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933178948 0 0) 0x7fe604151e40 con 0x7fe604151400 2023-08-22T00:21:06.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60259c700 1 -- 172.21.15.98:0/4285333216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a6590 msgr2=0x7fe6040bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:06.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60259c700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a6590 0x7fe6040bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60259c700 1 -- 172.21.15.98:0/4285333216 >> v1:172.21.15.98:6789/0 conn(0x7fe604151400 legacy=0x7fe6040c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60259c700 1 -- 172.21.15.98:0/4285333216 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604151b60 con 0x7fe6040a61b0 2023-08-22T00:21:06.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.021+0000 7fe60259c700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040a61b0 0x7fe604150f10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fe5f8006fd0 tx=0x7fe5f800b3b0).ready entity=mon.0 client_cookie=92f8efc25ea83806 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe60159a700 1 -- 172.21.15.98:0/4285333216 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800da70 con 0x7fe6040a61b0 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe60159a700 1 -- 172.21.15.98:0/4285333216 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800dbd0 con 0x7fe6040a61b0 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe60159a700 1 -- 172.21.15.98:0/4285333216 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8010470 con 0x7fe6040a61b0 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 -- 172.21.15.98:0/4285333216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040a61b0 msgr2=0x7fe604150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040a61b0 0x7fe604150f10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fe5f8006fd0 tx=0x7fe5f800b3b0).stop 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 -- 172.21.15.98:0/4285333216 shutdown_connections 2023-08-22T00:21:06.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a6590 0x7fe6040bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 --2- 172.21.15.98:0/4285333216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040a61b0 0x7fe604150f10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 -- 172.21.15.98:0/4285333216 >> 172.21.15.98:0/4285333216 conn(0x7fe6040c3980 msgr2=0x7fe6040c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 -- 172.21.15.98:0/4285333216 shutdown_connections 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.022+0000 7fe608ef1700 1 -- 172.21.15.98:0/4285333216 wait complete. 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.023+0000 7fe608ef1700 1 Processor -- start 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.023+0000 7fe608ef1700 1 -- start start 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a61b0 0x7fe604066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6040a6590 0x7fe604147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040ac790 con 0x7fe604151400 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040abb80 con 0x7fe6040a6590 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe608ef1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040abe60 con 0x7fe6040a61b0 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe602d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe602d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38096/0 (socket says 172.21.15.98:38096) 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe602d9d700 1 -- 172.21.15.98:0/3472027399 learned_addr learned my addr 172.21.15.98:0/3472027399 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:06.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe60259c700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a61b0 0x7fe604066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.024+0000 7fe601d9b700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6040a6590 0x7fe604147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a61b0 msgr2=0x7fe604066710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a61b0 0x7fe604066710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6040a6590 msgr2=0x7fe604147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6040a6590 0x7fe604147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 -- 172.21.15.98:0/3472027399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f800b610 con 0x7fe604151400 2023-08-22T00:21:06.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe602d9d700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fe5fc009ef0 tx=0x7fe5fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00cb70 con 0x7fe604151400 2023-08-22T00:21:06.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00f040 con 0x7fe604151400 2023-08-22T00:21:06.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc013400 con 0x7fe604151400 2023-08-22T00:21:06.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6040ac140 con 0x7fe604151400 2023-08-22T00:21:06.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.025+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6041480f0 con 0x7fe604151400 2023-08-22T00:21:06.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.026+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe604047480 con 0x7fe604151400 2023-08-22T00:21:06.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.026+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe5fc0137b0 con 0x7fe604151400 2023-08-22T00:21:06.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.027+0000 7fe5f27fc700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 0x7fe5e40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.027+0000 7fe60259c700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 msgr2=0x7fe5e40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:06.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.027+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fe5fc07aab0 con 0x7fe604151400 2023-08-22T00:21:06.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.027+0000 7fe60259c700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 0x7fe5e40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:06.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.031+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5fc04bb00 con 0x7fe604151400 2023-08-22T00:21:06.077 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:06.076+0000 7fecb4d65680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:06.144 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:06.144+0000 7fb8a6ce2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:06.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.228+0000 7fe60259c700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 msgr2=0x7fe5e40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:06.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.228+0000 7fe60259c700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 0x7fe5e40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:06.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.243+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6040c4c10 con 0x7fe604151400 2023-08-22T00:21:06.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.243+0000 7fe5f27fc700 1 -- 172.21.15.98:0/3472027399 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe5fc07ae60 con 0x7fe604151400 2023-08-22T00:21:06.245 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:06.245 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:21:06.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 msgr2=0x7fe5e40613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 0x7fe5e40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 msgr2=0x7fe6040a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fe5fc009ef0 tx=0x7fe5fc00b040).stop 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 shutdown_connections 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe5e405ef30 0x7fe5e40613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6040a61b0 0x7fe604066710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604151400 0x7fe6040a6e30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 --2- 172.21.15.98:0/3472027399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6040a6590 0x7fe604147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 >> 172.21.15.98:0/3472027399 conn(0x7fe6040c3980 msgr2=0x7fe604152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 shutdown_connections 2023-08-22T00:21:06.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.245+0000 7fe608ef1700 1 -- 172.21.15.98:0/3472027399 wait complete. 2023-08-22T00:21:06.248 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:21:06.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:06.268 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:06.267+0000 7fecb4d65680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:06.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.376+0000 7f7dea012700 1 Processor -- start 2023-08-22T00:21:06.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.377+0000 7f7dea012700 1 -- start start 2023-08-22T00:21:06.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.377+0000 7f7dea012700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7de40bc6d0 0x7f7de40c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.377+0000 7f7dea012700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40645b0 con 0x7f7de4151030 2023-08-22T00:21:06.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.377+0000 7f7dea012700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de4063fa0 con 0x7f7de4150c50 2023-08-22T00:21:06.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.377+0000 7f7dea012700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de4151f30 con 0x7f7de40bc6d0 2023-08-22T00:21:06.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de3fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7de4151030 0x7f7de4151470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52592/0 (socket says 172.21.15.98:52592) 2023-08-22T00:21:06.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de3fff700 1 -- 172.21.15.98:0/3782308914 learned_addr learned my addr 172.21.15.98:0/3782308914 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de2ffd700 1 --2- 172.21.15.98:0/3782308914 >> v2:172.21.15.118:3300/0 conn(0x7f7de40bc6d0 0x7f7de40c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de27fc700 1 -- 172.21.15.98:0/3782308914 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231713466 0 0) 0x7f7de40645b0 con 0x7f7de4151030 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de27fc700 1 -- 172.21.15.98:0/3782308914 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd00033f0 con 0x7f7de4151030 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de2ffd700 1 -- 172.21.15.98:0/3782308914 >> v1:172.21.15.118:6789/0 conn(0x7f7de4150c50 legacy=0x7f7de40c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de2ffd700 1 -- 172.21.15.98:0/3782308914 >> v1:172.21.15.98:6789/0 conn(0x7f7de4151030 legacy=0x7f7de4151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de2ffd700 1 -- 172.21.15.98:0/3782308914 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4152210 con 0x7f7de40bc6d0 2023-08-22T00:21:06.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de2ffd700 1 --2- 172.21.15.98:0/3782308914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de40bc6d0 0x7f7de40c3bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc009060).ready entity=mon.1 client_cookie=163f7af56a4583f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de27fc700 1 -- 172.21.15.98:0/3782308914 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00f510 con 0x7f7de40bc6d0 2023-08-22T00:21:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de27fc700 1 -- 172.21.15.98:0/3782308914 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00f670 con 0x7f7de40bc6d0 2023-08-22T00:21:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.378+0000 7f7de27fc700 1 -- 172.21.15.98:0/3782308914 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00f9f0 con 0x7f7de40bc6d0 2023-08-22T00:21:06.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 -- 172.21.15.98:0/3782308914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de40bc6d0 msgr2=0x7f7de40c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 --2- 172.21.15.98:0/3782308914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de40bc6d0 0x7f7de40c3bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc009060).stop 2023-08-22T00:21:06.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 -- 172.21.15.98:0/3782308914 shutdown_connections 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 --2- 172.21.15.98:0/3782308914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de40bc6d0 0x7f7de40c3bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 -- 172.21.15.98:0/3782308914 >> 172.21.15.98:0/3782308914 conn(0x7f7de40c7770 msgr2=0x7f7de40c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 -- 172.21.15.98:0/3782308914 shutdown_connections 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.379+0000 7f7dea012700 1 -- 172.21.15.98:0/3782308914 wait complete. 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.381+0000 7f7dea012700 1 Processor -- start 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.381+0000 7f7dea012700 1 -- start start 2023-08-22T00:21:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7de40bc6d0 0x7f7de414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 0x7f7de40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40c4ec0 con 0x7f7de4151030 2023-08-22T00:21:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40abed0 con 0x7f7de4150c50 2023-08-22T00:21:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414ee90 con 0x7f7de40bc6d0 2023-08-22T00:21:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38112/0 (socket says 172.21.15.98:38112) 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 -- 172.21.15.98:0/4056734129 learned_addr learned my addr 172.21.15.98:0/4056734129 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de2ffd700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 0x7f7de40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de37fe700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7de40bc6d0 0x7f7de414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 -- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7de40bc6d0 msgr2=0x7f7de414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7de40bc6d0 0x7f7de414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 -- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 msgr2=0x7f7de40c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 0x7f7de40c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 -- 172.21.15.98:0/4056734129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0092a0 con 0x7f7de4151030 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de2ffd700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 0x7f7de40c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7de3fff700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f7dd4007fd0 tx=0x7f7dd4001640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4005d30 con 0x7f7de4151030 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de40bf2a0 con 0x7f7de4151030 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4005e90 con 0x7f7de4151030 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400c810 con 0x7f7de4151030 2023-08-22T00:21:06.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.382+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de40bf860 con 0x7f7de4151030 2023-08-22T00:21:06.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de40abca0 con 0x7f7de4151030 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f7dd400cbc0 con 0x7f7de4151030 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7ddb7fe700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 0x7f7dc40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7de37fe700 1 -- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 msgr2=0x7f7dc40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f7dd407c770 con 0x7f7de4151030 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.384+0000 7f7de37fe700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 0x7f7dc40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.388+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7de40abca0 con 0x7f7de4151030 2023-08-22T00:21:06.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.558+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de40abca0 con 0x7f7de4151030 2023-08-22T00:21:06.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.559+0000 7f7ddb7fe700 1 -- 172.21.15.98:0/4056734129 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17724 (secure 0 0 0) 0x7f7de40abca0 con 0x7f7de4151030 2023-08-22T00:21:06.561 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:06.562 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":74,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:20:14.371320+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1380914503":"2023-08-23T00:19:12.779667+0000","172.21.15.98:6833/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1895897780":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/2661281862":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/3063201580":"2023-08-23T00:19:12.779667+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.560+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 msgr2=0x7f7dc40613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.560+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 0x7f7dc40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.560+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 msgr2=0x7f7de40c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.560+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f7dd4007fd0 tx=0x7f7dd4001640).stop 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 shutdown_connections 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7dc405ef30 0x7f7dc40613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7de40bc6d0 0x7f7de414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7de4151030 0x7f7de40c49d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 --2- 172.21.15.98:0/4056734129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de4150c50 0x7f7de40c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 >> 172.21.15.98:0/4056734129 conn(0x7f7de40c7770 msgr2=0x7f7de40c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 shutdown_connections 2023-08-22T00:21:06.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.561+0000 7f7dea012700 1 -- 172.21.15.98:0/4056734129 wait complete. 2023-08-22T00:21:06.574 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:21:06.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.731+0000 7fd3eac85700 1 Processor -- start 2023-08-22T00:21:06.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.731+0000 7fd3eac85700 1 -- start start 2023-08-22T00:21:06.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3eac85700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3e414c350 0x7fd3e4152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3eac85700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd3e40c3e50 0x7fd3e41556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3eac85700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e4153080 con 0x7fd3e414bf70 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3eac85700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e4066510 con 0x7fd3e414c350 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3eac85700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40667b0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3e414c350 0x7fd3e4152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3e414c350 0x7fd3e4152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38118/0 (socket says 172.21.15.98:38118) 2023-08-22T00:21:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e8a21700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd3e414bf70 0x7fd3e40c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52604/0 (socket says 172.21.15.98:52604) 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 -- 172.21.15.98:0/3921812305 learned_addr learned my addr 172.21.15.98:0/3921812305 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e9222700 1 --2- 172.21.15.98:0/3921812305 >> v2:172.21.15.118:3300/0 conn(0x7fd3e40c3e50 0x7fd3e41556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 -- 172.21.15.98:0/3921812305 >> v2:172.21.15.118:3300/0 conn(0x7fd3e40c3e50 msgr2=0x7fd3e41556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 --2- 172.21.15.98:0/3921812305 >> v2:172.21.15.118:3300/0 conn(0x7fd3e40c3e50 0x7fd3e41556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 -- 172.21.15.98:0/3921812305 >> v1:172.21.15.98:6789/0 conn(0x7fd3e414bf70 legacy=0x7fd3e40c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e37fe700 1 -- 172.21.15.98:0/3921812305 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438672532 0 0) 0x7fd3e4153080 con 0x7fd3e414bf70 2023-08-22T00:21:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.732+0000 7fd3e3fff700 1 -- 172.21.15.98:0/3921812305 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4155ba0 con 0x7fd3e414c350 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3e3fff700 1 --2- 172.21.15.98:0/3921812305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e414c350 0x7fd3e4152b90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd3e40a8280 tx=0x7fd3d00090f0).ready entity=mon.0 client_cookie=8ca4b540705ec1f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3e37fe700 1 -- 172.21.15.98:0/3921812305 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000b520 con 0x7fd3e414c350 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3e37fe700 1 -- 172.21.15.98:0/3921812305 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d000b680 con 0x7fd3e414c350 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3e37fe700 1 -- 172.21.15.98:0/3921812305 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000ba00 con 0x7fd3e414c350 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 -- 172.21.15.98:0/3921812305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e414c350 msgr2=0x7fd3e4152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 --2- 172.21.15.98:0/3921812305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e414c350 0x7fd3e4152b90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd3e40a8280 tx=0x7fd3d00090f0).stop 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 -- 172.21.15.98:0/3921812305 shutdown_connections 2023-08-22T00:21:06.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 --2- 172.21.15.98:0/3921812305 >> v2:172.21.15.118:3300/0 conn(0x7fd3e40c3e50 0x7fd3e41556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 --2- 172.21.15.98:0/3921812305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e414c350 0x7fd3e4152b90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 -- 172.21.15.98:0/3921812305 >> 172.21.15.98:0/3921812305 conn(0x7fd3e40c5dc0 msgr2=0x7fd3e4068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 -- 172.21.15.98:0/3921812305 shutdown_connections 2023-08-22T00:21:06.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.733+0000 7fd3eac85700 1 -- 172.21.15.98:0/3921812305 wait complete. 2023-08-22T00:21:06.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.734+0000 7fd3eac85700 1 Processor -- start 2023-08-22T00:21:06.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 -- start start 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e414bf70 0x7fd3e4064c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e414c350 0x7fd3e41648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4065560 con 0x7fd3e40c3e50 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4065840 con 0x7fd3e414c350 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.735+0000 7fd3eac85700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4065b20 con 0x7fd3e414bf70 2023-08-22T00:21:06.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38130/0 (socket says 172.21.15.98:38130) 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 -- 172.21.15.98:0/2712547462 learned_addr learned my addr 172.21.15.98:0/2712547462 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e9222700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e414c350 0x7fd3e41648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e3fff700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e414bf70 0x7fd3e4064c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e414bf70 msgr2=0x7fd3e4064c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e414bf70 0x7fd3e4064c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e414c350 msgr2=0x7fd3e41648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e414c350 0x7fd3e41648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 -- 172.21.15.98:0/2712547462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009370 con 0x7fd3e40c3e50 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e8a21700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd3d800c560 tx=0x7fd3d8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80072e0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8007440 con 0x7fd3e40c3e50 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e4065e00 con 0x7fd3e40c3e50 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80058f0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.736+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e4065170 con 0x7fd3e40c3e50 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.737+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e4047480 con 0x7fd3e40c3e50 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.738+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fd3d8005ce0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.738+0000 7fd3e0ff9700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 0x7fd3c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.738+0000 7fd3e3fff700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 msgr2=0x7fd3c80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.738+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fd3d8079ac0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.738+0000 7fd3e3fff700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 0x7fd3c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:06.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.743+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3d804ab10 con 0x7fd3e40c3e50 2023-08-22T00:21:06.793 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:06.792+0000 7fb8a6ce2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:06.862 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:06.861+0000 7fb8a6ce2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:06.936 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:06.936+0000 7fb8a6ce2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.939+0000 7fd3e3fff700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 msgr2=0x7fd3c80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.939+0000 7fd3e3fff700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 0x7fd3c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:06.952 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:06.951+0000 7fecb4d65680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:06.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.953+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3e41651c0 con 0x7fd3e40c3e50 2023-08-22T00:21:06.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.953+0000 7fd3e0ff9700 1 -- 172.21.15.98:0/2712547462 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fd3d8018070 con 0x7fd3e40c3e50 2023-08-22T00:21:06.956 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:06.956 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:21:06.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 msgr2=0x7fd3c80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 0x7fd3c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 msgr2=0x7fd3e40a87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd3d800c560 tx=0x7fd3d8007c90).stop 2023-08-22T00:21:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 shutdown_connections 2023-08-22T00:21:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e414c350 0x7fd3e41648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3e40c3e50 0x7fd3e40a87e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd3c805ef30 0x7fd3c80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 --2- 172.21.15.98:0/2712547462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e414bf70 0x7fd3e4064c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 >> 172.21.15.98:0/2712547462 conn(0x7fd3e40c5dc0 msgr2=0x7fd3e40c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 shutdown_connections 2023-08-22T00:21:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:06.957+0000 7fd3eac85700 1 -- 172.21.15.98:0/2712547462 wait complete. 2023-08-22T00:21:06.963 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:21:06.974 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:07.036 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.035+0000 7fecb4d65680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:07.083 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.082+0000 7fb8a6ce2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:07.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.093+0000 7fb1f506f700 1 Processor -- start 2023-08-22T00:21:07.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.093+0000 7fb1f506f700 1 -- start start 2023-08-22T00:21:07.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1f506f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f00c61a0 0x7fb1f014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1f506f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f01544f0 0x7fb1f01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1f506f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f0155260 con 0x7fb1f014e0d0 2023-08-22T00:21:07.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1f506f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00c17b0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1f506f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00bf9e0 con 0x7fb1f01544f0 2023-08-22T00:21:07.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f00c61a0 0x7fb1f014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f00c61a0 0x7fb1f014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38138/0 (socket says 172.21.15.98:38138) 2023-08-22T00:21:07.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1376673886 learned_addr learned my addr 172.21.15.98:0/1376673886 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:07.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ef59e700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f01544f0 0x7fb1f01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1376673886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f01544f0 msgr2=0x7fb1f01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:07.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f01544f0 0x7fb1f01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1376673886 >> v1:172.21.15.118:6789/0 conn(0x7fb1f014e0d0 legacy=0x7fb1f00c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1edd9b700 1 -- 172.21.15.98:0/1376673886 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101393660 0 0) 0x7fb1f0155260 con 0x7fb1f014e0d0 2023-08-22T00:21:07.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1376673886 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00bfcc0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1ee59c700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f00c61a0 0x7fb1f014e4b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fb1e4006fd0 tx=0x7fb1e40090f0).ready entity=mon.0 client_cookie=c5b27c237b21267 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1edd9b700 1 -- 172.21.15.98:0/1376673886 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400b580 con 0x7fb1f00c61a0 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1edd9b700 1 -- 172.21.15.98:0/1376673886 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400b6e0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.094+0000 7fb1edd9b700 1 -- 172.21.15.98:0/1376673886 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400ba60 con 0x7fb1f00c61a0 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 -- 172.21.15.98:0/1376673886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f00c61a0 msgr2=0x7fb1f014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f00c61a0 0x7fb1f014e4b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fb1e4006fd0 tx=0x7fb1e40090f0).stop 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 -- 172.21.15.98:0/1376673886 shutdown_connections 2023-08-22T00:21:07.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f01544f0 0x7fb1f01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1376673886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f00c61a0 0x7fb1f014e4b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 -- 172.21.15.98:0/1376673886 >> 172.21.15.98:0/1376673886 conn(0x7fb1f00caa80 msgr2=0x7fb1f00cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 -- 172.21.15.98:0/1376673886 shutdown_connections 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.095+0000 7fb1f506f700 1 -- 172.21.15.98:0/1376673886 wait complete. 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.096+0000 7fb1f506f700 1 Processor -- start 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.096+0000 7fb1f506f700 1 -- start start 2023-08-22T00:21:07.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 0x7fb1f0144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 0x7fb1f00c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00ca3f0 con 0x7fb1f01544f0 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0144a00 con 0x7fb1f014e0d0 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1f506f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01505d0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1ef59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 0x7fb1f00c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1ee59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 0x7fb1f0144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1ee59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:56552/0 (socket says 172.21.15.98:56552) 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1358208733 learned_addr learned my addr 172.21.15.98:0/1358208733 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1ef59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 0x7fb1f00c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38148/0 (socket says 172.21.15.98:38148) 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 msgr2=0x7fb1f00c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 msgr2=0x7fb1f00c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 0x7fb1f00c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.097+0000 7fb1eed9d700 1 -- 172.21.15.98:0/1358208733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009370 con 0x7fb1f00c61a0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1ee59c700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1eed9d700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 0x7fb1f0144510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb1e000c3f0 tx=0x7fb1e0007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0012400 con 0x7fb1f00c61a0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0012580 con 0x7fb1f00c61a0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f014f9c0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0012940 con 0x7fb1f00c61a0 2023-08-22T00:21:07.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.098+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f014ff80 con 0x7fb1f00c61a0 2023-08-22T00:21:07.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.099+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f0047480 con 0x7fb1f00c61a0 2023-08-22T00:21:07.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.099+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fb1e0012cb0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.100+0000 7fb1d6ffd700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 0x7fb1dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.100+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 msgr2=0x7fb1dc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:07.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.100+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fb1e00795e0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.100+0000 7fb1ee59c700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 0x7fb1dc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:07.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.108+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1e00488f0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.116 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.115+0000 7fecb4d65680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:07.157 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.157+0000 7fb8a6ce2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:07.269 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.268+0000 7fecb4d65680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:07.271 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.270+0000 7fb8a6ce2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:07.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.301+0000 7fb1ee59c700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 msgr2=0x7fb1dc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:07.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.301+0000 7fb1ee59c700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 0x7fb1dc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:07.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.323+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f00aa210 con 0x7fb1f00c61a0 2023-08-22T00:21:07.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.324+0000 7fb1d6ffd700 1 -- 172.21.15.98:0/1358208733 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fb1e004a6e0 con 0x7fb1f00c61a0 2023-08-22T00:21:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:07.325 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:18:55.833699+0000","modified":"2023-08-22T00:18:58.473441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5955":{"gid":5955,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2107366711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2107366711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2107366711}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-22T00:21:07.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 msgr2=0x7fb1dc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:07.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 0x7fb1dc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:07.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 msgr2=0x7fb1f0144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 0x7fb1f0144510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb1e000c3f0 tx=0x7fb1e0007bd0).stop 2023-08-22T00:21:07.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 shutdown_connections 2023-08-22T00:21:07.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1dc05ef30 0x7fb1dc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:07.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f00c61a0 0x7fb1f0144510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f01544f0 0x7fb1f00c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 --2- 172.21.15.98:0/1358208733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f014e0d0 0x7fb1f00c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 >> 172.21.15.98:0/1358208733 conn(0x7fb1f00caa80 msgr2=0x7fb1f014d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:07.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 shutdown_connections 2023-08-22T00:21:07.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.326+0000 7fb1f506f700 1 -- 172.21.15.98:0/1358208733 wait complete. 2023-08-22T00:21:07.334 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2023-08-22T00:21:07.340 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:07.350 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.349+0000 7fecb4d65680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:07.385 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.385+0000 7fb8a6ce2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:07.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.461+0000 7ff593e6f700 1 Processor -- start 2023-08-22T00:21:07.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.461+0000 7ff593e6f700 1 -- start start 2023-08-22T00:21:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.462+0000 7ff593e6f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c151d60 0x7ff58c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.462+0000 7ff593e6f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff58c066620 0x7ff58c0643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.462+0000 7ff593e6f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c158bf0 con 0x7ff58c0a6e50 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.462+0000 7ff593e6f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c157d90 con 0x7ff58c066620 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.462+0000 7ff593e6f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c157fe0 con 0x7ff58c151d60 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff58c066620 0x7ff58c0643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff58c066620 0x7ff58c0643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38150/0 (socket says 172.21.15.98:38150) 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 -- 172.21.15.98:0/321018573 learned_addr learned my addr 172.21.15.98:0/321018573 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff591c0b700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c151d60 0x7ff58c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 -- 172.21.15.98:0/321018573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c151d60 msgr2=0x7ff58c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:07.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c151d60 0x7ff58c155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 -- 172.21.15.98:0/321018573 >> v1:172.21.15.118:6789/0 conn(0x7ff58c0a6e50 legacy=0x7ff58c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 -- 172.21.15.98:0/321018573 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c1582c0 con 0x7ff58c066620 2023-08-22T00:21:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff59240c700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0643c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7ff584009f20 tx=0x7ff584009840).ready entity=mon.0 client_cookie=8abab30da399810 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff590c09700 1 -- 172.21.15.98:0/321018573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400e070 con 0x7ff58c066620 2023-08-22T00:21:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff590c09700 1 -- 172.21.15.98:0/321018573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400b9d0 con 0x7ff58c066620 2023-08-22T00:21:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.463+0000 7ff590c09700 1 -- 172.21.15.98:0/321018573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400bd50 con 0x7ff58c066620 2023-08-22T00:21:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 -- 172.21.15.98:0/321018573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 msgr2=0x7ff58c0643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0643c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7ff584009f20 tx=0x7ff584009840).stop 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 -- 172.21.15.98:0/321018573 shutdown_connections 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0643c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 --2- 172.21.15.98:0/321018573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c151d60 0x7ff58c155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 -- 172.21.15.98:0/321018573 >> 172.21.15.98:0/321018573 conn(0x7ff58c06a980 msgr2=0x7ff58c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 -- 172.21.15.98:0/321018573 shutdown_connections 2023-08-22T00:21:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.464+0000 7ff593e6f700 1 -- 172.21.15.98:0/321018573 wait complete. 2023-08-22T00:21:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.465+0000 7ff593e6f700 1 Processor -- start 2023-08-22T00:21:07.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.465+0000 7ff593e6f700 1 -- start start 2023-08-22T00:21:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c0a6e50 0x7ff58c13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff58c151d60 0x7ff58c0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0a38d0 con 0x7ff58c066620 2023-08-22T00:21:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0a3e90 con 0x7ff58c151d60 2023-08-22T00:21:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0a8230 con 0x7ff58c0a6e50 2023-08-22T00:21:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38162/0 (socket says 172.21.15.98:38162) 2023-08-22T00:21:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 -- 172.21.15.98:0/2077764321 learned_addr learned my addr 172.21.15.98:0/2077764321 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff59140a700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c0a6e50 0x7ff58c13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff59240c700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff58c151d60 0x7ff58c0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 -- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c0a6e50 msgr2=0x7ff58c13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c0a6e50 0x7ff58c13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 -- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff58c151d60 msgr2=0x7ff58c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff58c151d60 0x7ff58c0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 -- 172.21.15.98:0/2077764321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009ae0 con 0x7ff58c066620 2023-08-22T00:21:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff591c0b700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7ff58800e900 tx=0x7ff588009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880093b0 con 0x7ff58c066620 2023-08-22T00:21:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588012600 con 0x7ff58c066620 2023-08-22T00:21:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588012980 con 0x7ff58c066620 2023-08-22T00:21:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.466+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0ac360 con 0x7ff58c066620 2023-08-22T00:21:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.467+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0a3b20 con 0x7ff58c066620 2023-08-22T00:21:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c047480 con 0x7ff58c066620 2023-08-22T00:21:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ff588012d30 con 0x7ff58c066620 2023-08-22T00:21:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff581ffb700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 0x7ff5700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff59140a700 1 -- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 msgr2=0x7ff5700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff58807a500 con 0x7ff58c066620 2023-08-22T00:21:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.468+0000 7ff59140a700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 0x7ff5700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:07.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.472+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff58804b520 con 0x7ff58c066620 2023-08-22T00:21:07.480 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.476+0000 7fecb4d65680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:07.591 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.590+0000 7fecb4d65680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:07.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.645+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff58c1585a0 con 0x7ff58c066620 2023-08-22T00:21:07.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.646+0000 7ff581ffb700 1 -- 172.21.15.98:0/2077764321 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+17832 (secure 0 0 0) 0x7ff58804eb40 con 0x7ff58c066620 2023-08-22T00:21:07.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:07.649 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:07.285859+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:18:54.392343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-08-22T00:18:54.795027+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":75,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1380914503":"2023-08-23T00:19:12.779667+0000","172.21.15.98:6833/118203":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/1895897780":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/2661281862":"2023-08-23T00:19:12.779667+0000","172.21.15.98:0/3063201580":"2023-08-23T00:19:12.779667+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:07.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 msgr2=0x7ff5700613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:07.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 0x7ff5700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:07.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 msgr2=0x7ff58c0a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7ff58800e900 tx=0x7ff588009060).stop 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 shutdown_connections 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff58c151d60 0x7ff58c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff58c066620 0x7ff58c0a7d40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff57005ef30 0x7ff5700613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:07.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.648+0000 7ff593e6f700 1 --2- 172.21.15.98:0/2077764321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff58c0a6e50 0x7ff58c13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.649+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 >> 172.21.15.98:0/2077764321 conn(0x7ff58c06a980 msgr2=0x7ff58c0643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:07.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.649+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 shutdown_connections 2023-08-22T00:21:07.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.649+0000 7ff593e6f700 1 -- 172.21.15.98:0/2077764321 wait complete. 2023-08-22T00:21:07.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:21:07.679 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.678+0000 7fb8a6ce2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:07.749 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:07.748+0000 7fb8a6ce2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:07.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.825+0000 7f476c8c0700 1 Processor -- start 2023-08-22T00:21:07.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.825+0000 7f476c8c0700 1 -- start start 2023-08-22T00:21:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f476c8c0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f47680a6e60 0x7f4768067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f476c8c0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4768154b30 con 0x7f4768154fc0 2023-08-22T00:21:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f476c8c0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4768066820 con 0x7f47680a6a80 2023-08-22T00:21:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f476c8c0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47681547e0 con 0x7f47680a6e60 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f4765d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f47680a6e60 0x7f4768067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f4766d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4768154fc0 0x7f4768064fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52616/0 (socket says 172.21.15.98:52616) 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.826+0000 7f4766d9d700 1 -- 172.21.15.98:0/1365044726 learned_addr learned my addr 172.21.15.98:0/1365044726 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f4765d9b700 1 -- 172.21.15.98:0/1365044726 >> v1:172.21.15.118:6789/0 conn(0x7f47680a6a80 legacy=0x7f4768066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f4765d9b700 1 -- 172.21.15.98:0/1365044726 >> v1:172.21.15.98:6789/0 conn(0x7f4768154fc0 legacy=0x7f4768064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f4765d9b700 1 -- 172.21.15.98:0/1365044726 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768068260 con 0x7f47680a6e60 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f476559a700 1 -- 172.21.15.98:0/1365044726 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747012832 0 0) 0x7f4768154b30 con 0x7f4768154fc0 2023-08-22T00:21:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f4765d9b700 1 --2- 172.21.15.98:0/1365044726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47680a6e60 0x7f4768067c60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f475c009760 tx=0x7f475c009060).ready entity=mon.0 client_cookie=cd46f6f726e72b73 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f476559a700 1 -- 172.21.15.98:0/1365044726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00b520 con 0x7f47680a6e60 2023-08-22T00:21:07.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f476559a700 1 -- 172.21.15.98:0/1365044726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00b680 con 0x7f47680a6e60 2023-08-22T00:21:07.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.827+0000 7f476559a700 1 -- 172.21.15.98:0/1365044726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ba00 con 0x7f47680a6e60 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 -- 172.21.15.98:0/1365044726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47680a6e60 msgr2=0x7f4768067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1365044726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47680a6e60 0x7f4768067c60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f475c009760 tx=0x7f475c009060).stop 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 -- 172.21.15.98:0/1365044726 shutdown_connections 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1365044726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47680a6e60 0x7f4768067c60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 -- 172.21.15.98:0/1365044726 >> 172.21.15.98:0/1365044726 conn(0x7f47680c42e0 msgr2=0x7f47680c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:07.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 -- 172.21.15.98:0/1365044726 shutdown_connections 2023-08-22T00:21:07.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.828+0000 7f476c8c0700 1 -- 172.21.15.98:0/1365044726 wait complete. 2023-08-22T00:21:07.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.830+0000 7f476c8c0700 1 Processor -- start 2023-08-22T00:21:07.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.830+0000 7f476c8c0700 1 -- start start 2023-08-22T00:21:07.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47680a6a80 0x7f47680c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47680a6e60 0x7f4768153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680a8930 con 0x7f4768154fc0 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680a9060 con 0x7f47680a6a80 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476c8c0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680a9340 con 0x7f47680a6e60 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38180/0 (socket says 172.21.15.98:38180) 2023-08-22T00:21:07.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 -- 172.21.15.98:0/1477903201 learned_addr learned my addr 172.21.15.98:0/1477903201 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f476659c700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47680a6a80 0x7f47680c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4765d9b700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47680a6e60 0x7f4768153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 -- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47680a6e60 msgr2=0x7f4768153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47680a6e60 0x7f4768153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 -- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47680a6a80 msgr2=0x7f47680c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47680a6a80 0x7f47680c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 -- 172.21.15.98:0/1477903201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0092a0 con 0x7f4768154fc0 2023-08-22T00:21:07.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.831+0000 7f4766d9d700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f476000c730 tx=0x7f4760001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:07.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.832+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760005d30 con 0x7f4768154fc0 2023-08-22T00:21:07.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.832+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4760005e90 con 0x7f4768154fc0 2023-08-22T00:21:07.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.832+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760007300 con 0x7f4768154fc0 2023-08-22T00:21:07.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.832+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47680a9620 con 0x7f4768154fc0 2023-08-22T00:21:07.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.832+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680a9be0 con 0x7f4768154fc0 2023-08-22T00:21:07.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.833+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f47600076b0 con 0x7f4768154fc0 2023-08-22T00:21:07.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.833+0000 7f47567fc700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 0x7f47480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:07.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.833+0000 7f476659c700 1 -- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 msgr2=0x7f47480613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:07.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.833+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4760079c30 con 0x7f4768154fc0 2023-08-22T00:21:07.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.833+0000 7f476659c700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 0x7f47480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:07.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.834+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4768069460 con 0x7f4768154fc0 2023-08-22T00:21:07.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:07.838+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f476004ac50 con 0x7f4768154fc0 2023-08-22T00:21:07.917 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.915+0000 7fecb4d65680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:07.994 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:07.993+0000 7fecb4d65680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:08.015+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 24) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f47600775b0 con 0x7f4768154fc0 2023-08-22T00:21:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:08.016+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 msgr2=0x7f47480613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:08.016+0000 7f47567fc700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 0x7f47480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:08.073 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.072+0000 7fec3781f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.073 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.072+0000 7fec3781f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.073 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.072+0000 7fec3781f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.074 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.072+0000 7fec3781f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.074 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.072+0000 7fec3781f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.075 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.074+0000 7fec34819700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.075 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.074+0000 7fec34819700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.075 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.074+0000 7fec34819700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.075 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.074+0000 7fec34819700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.075 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:08.074+0000 7fec34819700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:08.085+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4768068540 con 0x7f4768154fc0 2023-08-22T00:21:09.009 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:21:09.008+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:21:09.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.011+0000 7f47567fc700 1 -- 172.21.15.98:0/1477903201 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4760021fc0 con 0x7f4768154fc0 2023-08-22T00:21:09.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 msgr2=0x7f47680bfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:09.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f476000c730 tx=0x7f4760001520).stop 2023-08-22T00:21:09.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 shutdown_connections 2023-08-22T00:21:09.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4768154fc0 0x7f47680bfe70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47680a6a80 0x7f47680c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f474805ef30 0x7f47480613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 --2- 172.21.15.98:0/1477903201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47680a6e60 0x7f4768153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 >> 172.21.15.98:0/1477903201 conn(0x7f47680c42e0 msgr2=0x7f47680c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 shutdown_connections 2023-08-22T00:21:09.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.014+0000 7f476c8c0700 1 -- 172.21.15.98:0/1477903201 wait complete. 2023-08-22T00:21:09.018 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:21:09.034 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:21:09.050 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:21:09.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.155+0000 7f17a97fc700 1 Processor -- start 2023-08-22T00:21:09.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.155+0000 7f17a97fc700 1 -- start start 2023-08-22T00:21:09.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a97fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17a40ad420 0x7f17a41548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a97fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f17a40c5df0 0x7f17a4063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a97fc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a4063fb0 con 0x7f17a40ad040 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a97fc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40c9040 con 0x7f17a40c5df0 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a97fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40c62a0 con 0x7f17a40ad420 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f17a40c5df0 0x7f17a4063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f17a40c5df0 0x7f17a4063010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38290/0 (socket says 172.21.15.98:38290) 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a37fe700 1 -- 172.21.15.98:0/1787186396 learned_addr learned my addr 172.21.15.98:0/1787186396 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:09.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.156+0000 7f17a27fc700 1 --2- 172.21.15.98:0/1787186396 >> v2:172.21.15.118:3300/0 conn(0x7f17a40ad420 0x7f17a41548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a37fe700 1 -- 172.21.15.98:0/1787186396 >> v2:172.21.15.118:3300/0 conn(0x7f17a40ad420 msgr2=0x7f17a41548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:09.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a37fe700 1 --2- 172.21.15.98:0/1787186396 >> v2:172.21.15.118:3300/0 conn(0x7f17a40ad420 0x7f17a41548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a37fe700 1 -- 172.21.15.98:0/1787186396 >> v1:172.21.15.118:6789/0 conn(0x7f17a40ad040 legacy=0x7f17a41541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:09.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a37fe700 1 -- 172.21.15.98:0/1787186396 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4063710 con 0x7f17a40c5df0 2023-08-22T00:21:09.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a37fe700 1 --2- 172.21.15.98:0/1787186396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40c5df0 0x7f17a4063010 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f17a40c50c0 tx=0x7f179c009840).ready entity=mon.0 client_cookie=b3f426edf481d093 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:09.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a1ffb700 1 -- 172.21.15.98:0/1787186396 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00e070 con 0x7f17a40c5df0 2023-08-22T00:21:09.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a1ffb700 1 -- 172.21.15.98:0/1787186396 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00ba20 con 0x7f17a40c5df0 2023-08-22T00:21:09.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a1ffb700 1 -- 172.21.15.98:0/1787186396 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00bda0 con 0x7f17a40c5df0 2023-08-22T00:21:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 -- 172.21.15.98:0/1787186396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40c5df0 msgr2=0x7f17a4063010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 --2- 172.21.15.98:0/1787186396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40c5df0 0x7f17a4063010 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f17a40c50c0 tx=0x7f179c009840).stop 2023-08-22T00:21:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 -- 172.21.15.98:0/1787186396 shutdown_connections 2023-08-22T00:21:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 --2- 172.21.15.98:0/1787186396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40c5df0 0x7f17a4063010 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 --2- 172.21.15.98:0/1787186396 >> v2:172.21.15.118:3300/0 conn(0x7f17a40ad420 0x7f17a41548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 -- 172.21.15.98:0/1787186396 >> 172.21.15.98:0/1787186396 conn(0x7f17a40cb600 msgr2=0x7f17a40c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:09.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 -- 172.21.15.98:0/1787186396 shutdown_connections 2023-08-22T00:21:09.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.157+0000 7f17a97fc700 1 -- 172.21.15.98:0/1787186396 wait complete. 2023-08-22T00:21:09.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 Processor -- start 2023-08-22T00:21:09.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 -- start start 2023-08-22T00:21:09.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17a40ad420 0x7f17a40b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17a40c5df0 0x7f17a41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40b00b0 con 0x7f17a40ad040 2023-08-22T00:21:09.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40a3190 con 0x7f17a40c5df0 2023-08-22T00:21:09.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.159+0000 7f17a97fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40af1c0 con 0x7f17a40ad420 2023-08-22T00:21:09.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38296/0 (socket says 172.21.15.98:38296) 2023-08-22T00:21:09.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 -- 172.21.15.98:0/130888279 learned_addr learned my addr 172.21.15.98:0/130888279 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:09.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a37fe700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17a40c5df0 0x7f17a41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a27fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17a40ad420 0x7f17a40b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 -- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17a40ad420 msgr2=0x7f17a40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:09.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17a40ad420 0x7f17a40b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 -- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17a40c5df0 msgr2=0x7f17a41520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:09.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17a40c5df0 0x7f17a41520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:09.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 -- 172.21.15.98:0/130888279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c009ae0 con 0x7f17a40ad040 2023-08-22T00:21:09.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a2ffd700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f179800c4c0 tx=0x7f1798007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:09.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800ce70 con 0x7f17a40ad040 2023-08-22T00:21:09.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798001e90 con 0x7f17a40ad040 2023-08-22T00:21:09.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007250 con 0x7f17a40ad040 2023-08-22T00:21:09.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a40af4a0 con 0x7f17a40ad040 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.160+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a40afa60 con 0x7f17a40ad040 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.161+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a4083670 con 0x7f17a40ad040 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.161+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f17980066a0 con 0x7f17a40ad040 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.162+0000 7f178affd700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 0x7f17900611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.162+0000 7f17a27fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 0x7f17900611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:09.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.162+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7076+0+0 (secure 0 0 0) 0x7f17980797c0 con 0x7f17a40ad040 2023-08-22T00:21:09.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.162+0000 7f17a27fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 0x7f17900611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f17a40c06e0 tx=0x7f1794009060).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:09.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.166+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f179804aa40 con 0x7f17a40ad040 2023-08-22T00:21:09.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:09.367+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17a4046c20 con 0x7f17a40ad040 2023-08-22T00:21:10.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.019+0000 7f178affd700 1 -- 172.21.15.98:0/130888279 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f179804e060 con 0x7f17a40ad040 2023-08-22T00:21:10.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.021+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 msgr2=0x7f17900611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.021+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 0x7f17900611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f17a40c06e0 tx=0x7f1794009060).stop 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.021+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 msgr2=0x7f17a40a2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.021+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f179800c4c0 tx=0x7f1798007e00).stop 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 shutdown_connections 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17a40c5df0 0x7f17a41520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17a40ad040 0x7f17a40a2ca0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f179005ecf0 0x7f17900611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 --2- 172.21.15.98:0/130888279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17a40ad420 0x7f17a40b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 >> 172.21.15.98:0/130888279 conn(0x7f17a40cb600 msgr2=0x7f17a40c1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:10.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 shutdown_connections 2023-08-22T00:21:10.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.022+0000 7f17a97fc700 1 -- 172.21.15.98:0/130888279 wait complete. 2023-08-22T00:21:10.037 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:21:10.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.160+0000 7f9d9511e700 1 Processor -- start 2023-08-22T00:21:10.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.160+0000 7f9d9511e700 1 -- start start 2023-08-22T00:21:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d9511e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 0x7f9d900c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d9511e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9d900c2d60 0x7f9d90153820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d9511e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9006a880 con 0x7f9d90064060 2023-08-22T00:21:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d9511e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c6330 con 0x7f9d900c2d60 2023-08-22T00:21:10.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d9511e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c31d0 con 0x7f9d90064440 2023-08-22T00:21:10.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9d900c2d60 0x7f9d90153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9d900c2d60 0x7f9d90153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38306/0 (socket says 172.21.15.98:38306) 2023-08-22T00:21:10.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 -- 172.21.15.98:0/1719569619 learned_addr learned my addr 172.21.15.98:0/1719569619 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:10.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 -- 172.21.15.98:0/1719569619 >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 msgr2=0x7f9d900c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:10.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8e59c700 1 --2- 172.21.15.98:0/1719569619 >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 0x7f9d900c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 --2- 172.21.15.98:0/1719569619 >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 0x7f9d900c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 -- 172.21.15.98:0/1719569619 >> v1:172.21.15.118:6789/0 conn(0x7f9d90064060 legacy=0x7f9d900c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8f59e700 1 -- 172.21.15.98:0/1719569619 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900c33e0 con 0x7f9d900c2d60 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.161+0000 7f9d8e59c700 1 --2- 172.21.15.98:0/1719569619 >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 0x7f9d900c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d8f59e700 1 --2- 172.21.15.98:0/1719569619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900c2d60 0x7f9d90153820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9d900c6e70 tx=0x7f9d88009840).ready entity=mon.0 client_cookie=f6dd67f9283889fb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d8dd9b700 1 -- 172.21.15.98:0/1719569619 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e070 con 0x7f9d900c2d60 2023-08-22T00:21:10.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d8dd9b700 1 -- 172.21.15.98:0/1719569619 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800ba10 con 0x7f9d900c2d60 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d8dd9b700 1 -- 172.21.15.98:0/1719569619 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800bd90 con 0x7f9d900c2d60 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 -- 172.21.15.98:0/1719569619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900c2d60 msgr2=0x7f9d90153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 --2- 172.21.15.98:0/1719569619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900c2d60 0x7f9d90153820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9d900c6e70 tx=0x7f9d88009840).stop 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 -- 172.21.15.98:0/1719569619 shutdown_connections 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 --2- 172.21.15.98:0/1719569619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900c2d60 0x7f9d90153820 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 --2- 172.21.15.98:0/1719569619 >> v2:172.21.15.118:3300/0 conn(0x7f9d90064440 0x7f9d900c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 -- 172.21.15.98:0/1719569619 >> 172.21.15.98:0/1719569619 conn(0x7f9d900c4470 msgr2=0x7f9d900695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:10.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 -- 172.21.15.98:0/1719569619 shutdown_connections 2023-08-22T00:21:10.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.162+0000 7f9d9511e700 1 -- 172.21.15.98:0/1719569619 wait complete. 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.163+0000 7f9d9511e700 1 Processor -- start 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 -- start start 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90064060 0x7f9d900aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900c2d60 0x7f9d90143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900be050 con 0x7f9d90064440 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900be330 con 0x7f9d900c2d60 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d9511e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900be610 con 0x7f9d90064060 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d8e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d8e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38308/0 (socket says 172.21.15.98:38308) 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.164+0000 7f9d8e59c700 1 -- 172.21.15.98:0/2697073995 learned_addr learned my addr 172.21.15.98:0/2697073995 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8f59e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900c2d60 0x7f9d90143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8ed9d700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90064060 0x7f9d900aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 -- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90064060 msgr2=0x7f9d900aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90064060 0x7f9d900aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 -- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900c2d60 msgr2=0x7f9d90143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900c2d60 0x7f9d90143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 -- 172.21.15.98:0/2697073995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009ae0 con 0x7f9d90064440 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d8e59c700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f9d8000c880 tx=0x7f9d80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80010580 con 0x7f9d90064440 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d800106e0 con 0x7f9d90064440 2023-08-22T00:21:10.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d900be8f0 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80010a60 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.165+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d90153050 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.166+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900bed90 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.166+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f9d8001b460 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.167+0000 7f9d76ffd700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 0x7f9d7c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.167+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7076+0+0 (secure 0 0 0) 0x7f9d80079fd0 con 0x7f9d90064440 2023-08-22T00:21:10.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.167+0000 7f9d8ed9d700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 0x7f9d7c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:10.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.167+0000 7f9d8ed9d700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 0x7f9d7c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9d84007fd0 tx=0x7f9d84009040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:10.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.171+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d8004b1f0 con 0x7f9d90064440 2023-08-22T00:21:10.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:10.332+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9d900bef40 con 0x7f9d90064440 2023-08-22T00:21:11.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.031+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9d80077bb0 con 0x7f9d90064440 2023-08-22T00:21:11.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.031+0000 7f9d76ffd700 1 -- 172.21.15.98:0/2697073995 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9d80072a00 con 0x7f9d90064440 2023-08-22T00:21:11.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 msgr2=0x7f9d7c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 0x7f9d7c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9d84007fd0 tx=0x7f9d84009040).stop 2023-08-22T00:21:11.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 msgr2=0x7f9d90152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f9d8000c880 tx=0x7f9d80008040).stop 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 shutdown_connections 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9d7c05ecf0 0x7f9d7c0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90064060 0x7f9d900aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900c2d60 0x7f9d90143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 --2- 172.21.15.98:0/2697073995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90064440 0x7f9d90152b60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 >> 172.21.15.98:0/2697073995 conn(0x7f9d900c4470 msgr2=0x7f9d900bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:11.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 shutdown_connections 2023-08-22T00:21:11.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.034+0000 7f9d9511e700 1 -- 172.21.15.98:0/2697073995 wait complete. 2023-08-22T00:21:11.038 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:21:11.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:21:11.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.175+0000 7f3e09676700 1 Processor -- start 2023-08-22T00:21:11.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.175+0000 7f3e09676700 1 -- start start 2023-08-22T00:21:11.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e09676700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e04153a40 0x7f3e040c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e09676700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3e04062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e09676700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04066770 con 0x7f3e040c5460 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e09676700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e040c4f40 con 0x7f3e04153a40 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e09676700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c59e0 con 0x7f3e04066c00 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e037fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3e040c5460 0x7f3e04063080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53556/0 (socket says 172.21.15.98:53556) 2023-08-22T00:21:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e037fe700 1 -- 172.21.15.98:0/1847293009 learned_addr learned my addr 172.21.15.98:0/1847293009 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.176+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> v2:172.21.15.118:3300/0 conn(0x7f3e04153a40 0x7f3e040c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e027fc700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3e04062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901164391 0 0) 0x7f3e04066770 con 0x7f3e040c5460 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec0033f0 con 0x7f3e040c5460 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496039042 0 0) 0x7f3dec0033f0 con 0x7f3e040c5460 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 msgr2=0x7f3e04062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3e04062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 >> v2:172.21.15.118:3300/0 conn(0x7f3e04153a40 msgr2=0x7f3e040c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 --2- 172.21.15.98:0/1847293009 >> v2:172.21.15.118:3300/0 conn(0x7f3e04153a40 0x7f3e040c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04065e80 con 0x7f3e040c5460 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3dfc0017f0 con 0x7f3e040c5460 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> v2:172.21.15.118:3300/0 conn(0x7f3e04153a40 0x7f3e040c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 >> v1:172.21.15.98:6789/0 conn(0x7f3e040c5460 legacy=0x7f3e04063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dec0038e0 0x7f3dec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3dec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dec004b80 0x7f3dec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c4f40 con 0x7f3dec0038e0 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c59e0 con 0x7f3dec004b80 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00b8e0 con 0x7f3e04066c00 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dec0038e0 0x7f3dec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e027fc700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3dec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e037fe700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dec004b80 0x7f3dec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 -- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 msgr2=0x7f3dec004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e04066c00 0x7f3dec004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 -- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dec004b80 msgr2=0x7f3dec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dec004b80 0x7f3dec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 -- 172.21.15.98:0/1847293009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0033f0 con 0x7f3dec0038e0 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.177+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dec0038e0 0x7f3dec003d00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f3df8009c70 tx=0x7f3df8009060).ready entity=mon.0 client_cookie=9fa96ffedb4c4c07 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80095c0 con 0x7f3dec0038e0 2023-08-22T00:21:11.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df800e6f0 con 0x7f3dec0038e0 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e01ffb700 1 -- 172.21.15.98:0/1847293009 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df800ea70 con 0x7f3dec0038e0 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 -- 172.21.15.98:0/1847293009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dec0038e0 msgr2=0x7f3dec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 --2- 172.21.15.98:0/1847293009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dec0038e0 0x7f3dec003d00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f3df8009c70 tx=0x7f3df8009060).stop 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e037fe700 1 -- 172.21.15.98:0/1847293009 reap_dead start 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 -- 172.21.15.98:0/1847293009 shutdown_connections 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 -- 172.21.15.98:0/1847293009 >> 172.21.15.98:0/1847293009 conn(0x7f3e040c3990 msgr2=0x7f3e040c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:11.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 -- 172.21.15.98:0/1847293009 shutdown_connections 2023-08-22T00:21:11.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.178+0000 7f3e09676700 1 -- 172.21.15.98:0/1847293009 wait complete. 2023-08-22T00:21:11.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.179+0000 7f3e09676700 1 Processor -- start 2023-08-22T00:21:11.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 -- start start 2023-08-22T00:21:11.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dec0038e0 0x7f3e040bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e04158a10 0x7f3e0414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c0a10 con 0x7f3e040c0260 2023-08-22T00:21:11.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c0730 con 0x7f3e04158a10 2023-08-22T00:21:11.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e09676700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040a3fc0 con 0x7f3dec0038e0 2023-08-22T00:21:11.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37072/0 (socket says 172.21.15.98:37072) 2023-08-22T00:21:11.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e037fe700 1 -- 172.21.15.98:0/3742777892 learned_addr learned my addr 172.21.15.98:0/3742777892 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:11.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.180+0000 7f3e027fc700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e04158a10 0x7f3e0414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dec0038e0 0x7f3e040bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 -- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dec0038e0 msgr2=0x7f3e040bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dec0038e0 0x7f3e040bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 -- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e04158a10 msgr2=0x7f3e0414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:11.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e04158a10 0x7f3e0414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:11.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 -- 172.21.15.98:0/3742777892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040a42a0 con 0x7f3e040c0260 2023-08-22T00:21:11.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e037fe700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f3dfc001350 tx=0x7f3dfc007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:11.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0079e0 con 0x7f3e040c0260 2023-08-22T00:21:11.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00e830 con 0x7f3e040c0260 2023-08-22T00:21:11.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e040a4580 con 0x7f3e040c0260 2023-08-22T00:21:11.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00ebf0 con 0x7f3e040c0260 2023-08-22T00:21:11.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.181+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0414fc70 con 0x7f3e040c0260 2023-08-22T00:21:11.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.182+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e040a3e20 con 0x7f3e040c0260 2023-08-22T00:21:11.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.182+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3dfc014430 con 0x7f3e040c0260 2023-08-22T00:21:11.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.183+0000 7f3deaffd700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 0x7f3df00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:11.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.183+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6580+0+0 (secure 0 0 0) 0x7f3dfc079db0 con 0x7f3e040c0260 2023-08-22T00:21:11.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.183+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 0x7f3df00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:11.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.183+0000 7f3e02ffd700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 0x7f3df00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3df8006d50 tx=0x7f3df801a000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:11.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.187+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3dfc0498f0 con 0x7f3e040c0260 2023-08-22T00:21:11.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:11.356+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e04047480 con 0x7f3e040c0260 2023-08-22T00:21:12.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.296+0000 7f3deaffd700 1 -- 172.21.15.98:0/3742777892 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3e040a3e20 con 0x7f3e040c0260 2023-08-22T00:21:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 msgr2=0x7f3df00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 0x7f3df00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3df8006d50 tx=0x7f3df801a000).stop 2023-08-22T00:21:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 msgr2=0x7f3e04151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f3dfc001350 tx=0x7f3dfc007eb0).stop 2023-08-22T00:21:12.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 shutdown_connections 2023-08-22T00:21:12.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3df005ef30 0x7f3df00613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dec0038e0 0x7f3e040bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e040c0260 0x7f3e04151610 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 --2- 172.21.15.98:0/3742777892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e04158a10 0x7f3e0414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 >> 172.21.15.98:0/3742777892 conn(0x7f3e040c3990 msgr2=0x7f3e040bbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 shutdown_connections 2023-08-22T00:21:12.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.300+0000 7f3e09676700 1 -- 172.21.15.98:0/3742777892 wait complete. 2023-08-22T00:21:12.306 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:21:12.319 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:21:12.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.446+0000 7f7d0fbb8700 1 Processor -- start 2023-08-22T00:21:12.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 -- start start 2023-08-22T00:21:12.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7d080c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d081548f0 0x7f7d08063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d08063fb0 con 0x7f7d080ad420 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d080c9040 con 0x7f7d081548f0 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0fbb8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08063500 con 0x7f7d080ad040 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.447+0000 7f7d0d153700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7d080ad420 0x7f7d081541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53564/0 (socket says 172.21.15.98:53564) 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0d153700 1 -- 172.21.15.98:0/3285677116 learned_addr learned my addr 172.21.15.98:0/3285677116 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 --2- 172.21.15.98:0/3285677116 >> v2:172.21.15.118:3300/0 conn(0x7f7d081548f0 0x7f7d08063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0d954700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7d080c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202305969 0 0) 0x7f7d08063fb0 con 0x7f7d080ad420 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf40033f0 con 0x7f7d080ad420 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407169299 0 0) 0x7f7cf40033f0 con 0x7f7d080ad420 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 msgr2=0x7f7d080c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7d080c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 >> v2:172.21.15.118:3300/0 conn(0x7f7d081548f0 msgr2=0x7f7d08063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 --2- 172.21.15.98:0/3285677116 >> v2:172.21.15.118:3300/0 conn(0x7f7d081548f0 0x7f7d08063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08063710 con 0x7f7d080ad420 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7d04001470 con 0x7f7d080ad420 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 >> v1:172.21.15.98:6789/0 conn(0x7f7d080ad420 legacy=0x7f7d081541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf40038e0 0x7f7cf4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7cf4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7cf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c9040 con 0x7f7cf4004b80 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08063500 con 0x7f7cf40038e0 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf400b8e0 con 0x7f7d080ad040 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7cf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0d954700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf40038e0 0x7f7cf4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0d153700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7cf4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 -- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 msgr2=0x7f7cf4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7cf4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 -- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf40038e0 msgr2=0x7f7cf4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf40038e0 0x7f7cf4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0e155700 1 -- 172.21.15.98:0/3285677116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40033f0 con 0x7f7cf4004b80 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.448+0000 7f7d0d153700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d080ad040 0x7f7cf4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0e155700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7cf4005000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f7d0000e210 tx=0x7f7d0000b040).ready entity=mon.0 client_cookie=13f5b76781e1508b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00009ac0 con 0x7f7cf4004b80 2023-08-22T00:21:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000f040 con 0x7f7cf4004b80 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0c952700 1 -- 172.21.15.98:0/3285677116 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000ecd0 con 0x7f7cf4004b80 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/3285677116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 msgr2=0x7f7cf4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/3285677116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7cf4005000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f7d0000e210 tx=0x7f7d0000b040).stop 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0e155700 1 -- 172.21.15.98:0/3285677116 reap_dead start 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/3285677116 shutdown_connections 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/3285677116 >> 172.21.15.98:0/3285677116 conn(0x7f7d080cb600 msgr2=0x7f7d080c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/3285677116 shutdown_connections 2023-08-22T00:21:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.449+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/3285677116 wait complete. 2023-08-22T00:21:12.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.450+0000 7f7d0fbb8700 1 Processor -- start 2023-08-22T00:21:12.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.450+0000 7f7d0fbb8700 1 -- start start 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d08163d90 0x7f7d08153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d080c9390 0x7f7d080c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c4e70 con 0x7f7cf4004b80 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08153500 con 0x7f7d080c9390 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0fbb8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c9ce0 con 0x7f7d08163d90 2023-08-22T00:21:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0d954700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0d954700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37090/0 (socket says 172.21.15.98:37090) 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0d954700 1 -- 172.21.15.98:0/661369876 learned_addr learned my addr 172.21.15.98:0/661369876 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0d153700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d08163d90 0x7f7d08153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.451+0000 7f7d0e155700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d080c9390 0x7f7d080c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 -- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d08163d90 msgr2=0x7f7d08153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d08163d90 0x7f7d08153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 -- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d080c9390 msgr2=0x7f7d080c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d080c9390 0x7f7d080c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 -- 172.21.15.98:0/661369876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d081539d0 con 0x7f7cf4004b80 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0d954700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7cf80119c0 tx=0x7f7cf8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800f700 con 0x7f7cf4004b80 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800f860 con 0x7f7cf4004b80 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d08164270 con 0x7f7cf4004b80 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800fc20 con 0x7f7cf4004b80 2023-08-22T00:21:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.452+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d08164830 con 0x7f7cf4004b80 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.453+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08083670 con 0x7f7cf4004b80 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.453+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7cf800fd80 con 0x7f7cf4004b80 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.453+0000 7f7cfdffb700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 0x7f7cec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.454+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f7cf807ab30 con 0x7f7cf4004b80 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.454+0000 7f7d0d153700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 0x7f7cec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.454+0000 7f7d0d153700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 0x7f7cec0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7d080650f0 tx=0x7f7d04007040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.458+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cf804be10 con 0x7f7cf4004b80 2023-08-22T00:21:12.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.623+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7d080aef50 con 0x7f7cf4004b80 2023-08-22T00:21:12.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.626+0000 7f7cfdffb700 1 -- 172.21.15.98:0/661369876 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7cf804f430 con 0x7f7cf4004b80 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 msgr2=0x7f7cec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 0x7f7cec0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7d080650f0 tx=0x7f7d04007040).stop 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 msgr2=0x7f7d080c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7cf80119c0 tx=0x7f7cf8009060).stop 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 shutdown_connections 2023-08-22T00:21:12.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d080c9390 0x7f7d080c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf4004b80 0x7f7d080c4980 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cec05ef30 0x7f7cec0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 --2- 172.21.15.98:0/661369876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d08163d90 0x7f7d08153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 >> 172.21.15.98:0/661369876 conn(0x7f7d080cb600 msgr2=0x7f7d080ac6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 shutdown_connections 2023-08-22T00:21:12.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.628+0000 7f7d0fbb8700 1 -- 172.21.15.98:0/661369876 wait complete. 2023-08-22T00:21:12.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:21:12.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.758+0000 7fe12180f700 1 Processor -- start 2023-08-22T00:21:12.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.758+0000 7fe12180f700 1 -- start start 2023-08-22T00:21:12.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe12180f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe11c0bea40 0x7fe11c0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe12180f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0c3f00 con 0x7fe11c153f10 2023-08-22T00:21:12.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe12180f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0c32f0 con 0x7fe11c0c4390 2023-08-22T00:21:12.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe12180f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0c47f0 con 0x7fe11c0bea40 2023-08-22T00:21:12.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe11b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe11c153f10 0x7fe11c068910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53580/0 (socket says 172.21.15.98:53580) 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.759+0000 7fe11b7fe700 1 -- 172.21.15.98:0/3714806462 learned_addr learned my addr 172.21.15.98:0/3714806462 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe11affd700 1 --2- 172.21.15.98:0/3714806462 >> v2:172.21.15.118:3300/0 conn(0x7fe11c0bea40 0x7fe11c0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255174931 0 0) 0x7fe11c0c3f00 con 0x7fe11c153f10 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1040033f0 con 0x7fe11c153f10 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe11affd700 1 -- 172.21.15.98:0/3714806462 >> v1:172.21.15.118:6789/0 conn(0x7fe11c0c4390 legacy=0x7fe11c153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726120081 0 0) 0x7fe11c0c32f0 con 0x7fe11c0c4390 2023-08-22T00:21:12.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe11affd700 1 -- 172.21.15.98:0/3714806462 >> v1:172.21.15.98:6789/0 conn(0x7fe11c153f10 legacy=0x7fe11c068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe11affd700 1 -- 172.21.15.98:0/3714806462 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0c35d0 con 0x7fe11c0bea40 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe11affd700 1 --2- 172.21.15.98:0/3714806462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c0bee20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe10c009760 tx=0x7fe10c009060).ready entity=mon.1 client_cookie=14d92d09a8d33848 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0090d0 con 0x7fe11c0bea40 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00f510 con 0x7fe11c0bea40 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.760+0000 7fe119ffb700 1 -- 172.21.15.98:0/3714806462 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00f890 con 0x7fe11c0bea40 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 -- 172.21.15.98:0/3714806462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 msgr2=0x7fe11c0bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 --2- 172.21.15.98:0/3714806462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c0bee20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe10c009760 tx=0x7fe10c009060).stop 2023-08-22T00:21:12.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 -- 172.21.15.98:0/3714806462 shutdown_connections 2023-08-22T00:21:12.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 --2- 172.21.15.98:0/3714806462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c0bee20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 -- 172.21.15.98:0/3714806462 >> 172.21.15.98:0/3714806462 conn(0x7fe11c0c5e80 msgr2=0x7fe11c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:12.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 -- 172.21.15.98:0/3714806462 shutdown_connections 2023-08-22T00:21:12.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.761+0000 7fe12180f700 1 -- 172.21.15.98:0/3714806462 wait complete. 2023-08-22T00:21:12.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.762+0000 7fe12180f700 1 Processor -- start 2023-08-22T00:21:12.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.762+0000 7fe12180f700 1 -- start start 2023-08-22T00:21:12.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c13dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe11c153f10 0x7fe11c065120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c13e390 con 0x7fe11c0c4390 2023-08-22T00:21:12.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0ae890 con 0x7fe11c0bea40 2023-08-22T00:21:12.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.763+0000 7fe12180f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0add10 con 0x7fe11c153f10 2023-08-22T00:21:12.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37098/0 (socket says 172.21.15.98:37098) 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 -- 172.21.15.98:0/596187899 learned_addr learned my addr 172.21.15.98:0/596187899 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11affd700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c13dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11b7fe700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe11c153f10 0x7fe11c065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 -- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe11c153f10 msgr2=0x7fe11c065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe11c153f10 0x7fe11c065120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 -- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 msgr2=0x7fe11c13dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c13dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 -- 172.21.15.98:0/596187899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0092a0 con 0x7fe11c0c4390 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11affd700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c13dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe11a7fc700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fe110001eb0 tx=0x7fe110007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f470 con 0x7fe11c0c4390 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000f5f0 con 0x7fe11c0c4390 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0adff0 con 0x7fe11c0c4390 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f9b0 con 0x7fe11c0c4390 2023-08-22T00:21:12.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.764+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0ae5b0 con 0x7fe11c0c4390 2023-08-22T00:21:12.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.765+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c06a2f0 con 0x7fe11c0c4390 2023-08-22T00:21:12.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.766+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe11000fd20 con 0x7fe11c0c4390 2023-08-22T00:21:12.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.766+0000 7fe102ffd700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 0x7fe1080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:12.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.766+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7fe110079730 con 0x7fe11c0c4390 2023-08-22T00:21:12.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.766+0000 7fe11affd700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 0x7fe1080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:12.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.766+0000 7fe11affd700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 0x7fe1080613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe10c009760 tx=0x7fe10c017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:12.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.770+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe11004aa10 con 0x7fe11c0c4390 2023-08-22T00:21:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.931+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe11c0c38b0 con 0x7fe11c0c4390 2023-08-22T00:21:12.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.934+0000 7fe102ffd700 1 -- 172.21.15.98:0/596187899 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v9) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe11004e030 con 0x7fe11c0c4390 2023-08-22T00:21:12.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 msgr2=0x7fe1080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 0x7fe1080613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe10c009760 tx=0x7fe10c017000).stop 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 msgr2=0x7fe11c150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fe110001eb0 tx=0x7fe110007c70).stop 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 shutdown_connections 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe10805ef30 0x7fe1080613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe11c153f10 0x7fe11c065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe11c0bea40 0x7fe11c13dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 --2- 172.21.15.98:0/596187899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe11c0c4390 0x7fe11c150950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:12.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.936+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 >> 172.21.15.98:0/596187899 conn(0x7fe11c0c5e80 msgr2=0x7fe11c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:12.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.937+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 shutdown_connections 2023-08-22T00:21:12.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:12.937+0000 7fe12180f700 1 -- 172.21.15.98:0/596187899 wait complete. 2023-08-22T00:21:12.950 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-22T00:21:13.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.067+0000 7f87072f8700 1 Processor -- start 2023-08-22T00:21:13.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.067+0000 7f87072f8700 1 -- start start 2023-08-22T00:21:13.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a61b0 0x7f8700150f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8700151400 0x7f87000c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87000a6590 0x7f87000bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8700151e40 con 0x7f8700151400 2023-08-22T00:21:13.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000c4f80 con 0x7f87000a6590 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f87072f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8700151880 con 0x7f87000a61b0 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f8704893700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8700151400 0x7f87000c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f8704893700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8700151400 0x7f87000c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37100/0 (socket says 172.21.15.98:37100) 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.068+0000 7f8704893700 1 -- 172.21.15.98:0/314425872 learned_addr learned my addr 172.21.15.98:0/314425872 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8705094700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a61b0 0x7f8700150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8705895700 1 --2- 172.21.15.98:0/314425872 >> v2:172.21.15.118:3300/0 conn(0x7f87000a6590 0x7f87000bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 -- 172.21.15.98:0/314425872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a61b0 msgr2=0x7f8700150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a61b0 0x7f8700150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 -- 172.21.15.98:0/314425872 >> v2:172.21.15.118:3300/0 conn(0x7f87000a6590 msgr2=0x7f87000bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 --2- 172.21.15.98:0/314425872 >> v2:172.21.15.118:3300/0 conn(0x7f87000a6590 0x7f87000bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 -- 172.21.15.98:0/314425872 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700151b60 con 0x7f8700151400 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f8704893700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f87000c5410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f87000c2700 tx=0x7f86fc00b3b0).ready entity=mon.0 client_cookie=9bd3e752faa2c260 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:13.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f86f7fff700 1 -- 172.21.15.98:0/314425872 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00db10 con 0x7f8700151400 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f86f7fff700 1 -- 172.21.15.98:0/314425872 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00dc70 con 0x7f8700151400 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f86f7fff700 1 -- 172.21.15.98:0/314425872 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc010470 con 0x7f8700151400 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 -- 172.21.15.98:0/314425872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 msgr2=0x7f87000c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f87000c5410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f87000c2700 tx=0x7f86fc00b3b0).stop 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 -- 172.21.15.98:0/314425872 shutdown_connections 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a61b0 0x7f8700150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 --2- 172.21.15.98:0/314425872 >> v2:172.21.15.118:3300/0 conn(0x7f87000a6590 0x7f87000bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 --2- 172.21.15.98:0/314425872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f87000c5410 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.069+0000 7f87072f8700 1 -- 172.21.15.98:0/314425872 >> 172.21.15.98:0/314425872 conn(0x7f87000c3980 msgr2=0x7f87000c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:13.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.070+0000 7f87072f8700 1 -- 172.21.15.98:0/314425872 shutdown_connections 2023-08-22T00:21:13.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.070+0000 7f87072f8700 1 -- 172.21.15.98:0/314425872 wait complete. 2023-08-22T00:21:13.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.071+0000 7f87072f8700 1 Processor -- start 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.071+0000 7f87072f8700 1 -- start start 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87000a61b0 0x7f8700147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 0x7f8700164210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700148160 con 0x7f8700151400 2023-08-22T00:21:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700164cb0 con 0x7f87000a61b0 2023-08-22T00:21:13.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8700164f90 con 0x7f87000a6590 2023-08-22T00:21:13.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37112/0 (socket says 172.21.15.98:37112) 2023-08-22T00:21:13.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 -- 172.21.15.98:0/2728116508 learned_addr learned my addr 172.21.15.98:0/2728116508 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:13.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705094700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87000a61b0 0x7f8700147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8704893700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 0x7f8700164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 -- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 msgr2=0x7f8700164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 0x7f8700164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 -- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87000a61b0 msgr2=0x7f8700147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87000a61b0 0x7f8700147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 -- 172.21.15.98:0/2728116508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc00b610 con 0x7f8700151400 2023-08-22T00:21:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8704893700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 0x7f8700164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f8705895700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f86f8007f30 tx=0x7f86f80098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800ecf0 con 0x7f8700151400 2023-08-22T00:21:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800ee50 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700148660 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8014610 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.072+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87000a9320 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.073+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87001484c0 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.074+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f86f80149c0 con 0x7f8700151400 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.074+0000 7f86f57fa700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 0x7f86e40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:13.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.074+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f86f807a5d0 con 0x7f8700151400 2023-08-22T00:21:13.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.074+0000 7f8705094700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 0x7f86e40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:13.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.074+0000 7f8705094700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 0x7f86e40613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f86f000bb20 tx=0x7f86f0008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:13.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.078+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87001484c0 con 0x7f8700151400 2023-08-22T00:21:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:13.305+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f87001484c0 con 0x7f8700151400 2023-08-22T00:21:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.303+0000 7f86f57fa700 1 -- 172.21.15.98:0/2728116508 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v541) v1 ==== 154+0+0 (secure 0 0 0) 0x7f87001484c0 con 0x7f8700151400 2023-08-22T00:21:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 msgr2=0x7f86e40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 0x7f86e40613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f86f000bb20 tx=0x7f86f0008040).stop 2023-08-22T00:21:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 msgr2=0x7f8700164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f86f8007f30 tx=0x7f86f80098e0).stop 2023-08-22T00:21:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 shutdown_connections 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700151400 0x7f8700164700 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87000a61b0 0x7f8700147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86e405ef30 0x7f86e40613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 --2- 172.21.15.98:0/2728116508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87000a6590 0x7f8700164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 >> 172.21.15.98:0/2728116508 conn(0x7f87000c3980 msgr2=0x7f87000667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.306+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 shutdown_connections 2023-08-22T00:21:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.307+0000 7f87072f8700 1 -- 172.21.15.98:0/2728116508 wait complete. 2023-08-22T00:21:14.322 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-08-22T00:21:14.322 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-08-22T00:21:14.323 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:21:14.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-22T00:21:14.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.445+0000 7f51547c9700 1 Processor -- start 2023-08-22T00:21:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.445+0000 7f51547c9700 1 -- start start 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f51547c9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 0x7f514c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f51547c9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f514c0c3e50 0x7f514c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f51547c9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c153080 con 0x7f514c14c350 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f51547c9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c066510 con 0x7f514c0c3e50 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f51547c9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0667b0 con 0x7f514c14bf70 2023-08-22T00:21:14.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f5152d66700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f514c0c3e50 0x7f514c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f5151d64700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f514c14c350 0x7f514c0c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53594/0 (socket says 172.21.15.98:53594) 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.446+0000 7f5151d64700 1 -- 172.21.15.98:0/1976220734 learned_addr learned my addr 172.21.15.98:0/1976220734 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152565700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 0x7f514c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152d66700 1 -- 172.21.15.98:0/1976220734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 msgr2=0x7f514c152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152d66700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 0x7f514c152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152d66700 1 -- 172.21.15.98:0/1976220734 >> v1:172.21.15.98:6789/0 conn(0x7f514c14c350 legacy=0x7f514c0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152d66700 1 -- 172.21.15.98:0/1976220734 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c155ba0 con 0x7f514c0c3e50 2023-08-22T00:21:14.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5151563700 1 -- 172.21.15.98:0/1976220734 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011891309 0 0) 0x7f514c153080 con 0x7f514c14c350 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152565700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 0x7f514c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5152d66700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c1556b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f513c009e60 tx=0x7f513c009780).ready entity=mon.0 client_cookie=577399a66f0bfdee server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5151563700 1 -- 172.21.15.98:0/1976220734 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00e070 con 0x7f514c0c3e50 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5151563700 1 -- 172.21.15.98:0/1976220734 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00bc30 con 0x7f514c0c3e50 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f5151563700 1 -- 172.21.15.98:0/1976220734 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c012410 con 0x7f514c0c3e50 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f51547c9700 1 -- 172.21.15.98:0/1976220734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 msgr2=0x7f514c1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f51547c9700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c1556b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f513c009e60 tx=0x7f513c009780).stop 2023-08-22T00:21:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f51547c9700 1 -- 172.21.15.98:0/1976220734 shutdown_connections 2023-08-22T00:21:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f51547c9700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c1556b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.447+0000 7f51547c9700 1 --2- 172.21.15.98:0/1976220734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14bf70 0x7f514c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.448+0000 7f51547c9700 1 -- 172.21.15.98:0/1976220734 >> 172.21.15.98:0/1976220734 conn(0x7f514c0c5dc0 msgr2=0x7f514c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.448+0000 7f51547c9700 1 -- 172.21.15.98:0/1976220734 shutdown_connections 2023-08-22T00:21:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.448+0000 7f51547c9700 1 -- 172.21.15.98:0/1976220734 wait complete. 2023-08-22T00:21:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 Processor -- start 2023-08-22T00:21:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 -- start start 2023-08-22T00:21:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 0x7f514c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14c350 0x7f514c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c14f190 con 0x7f514c0c3e50 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c14f370 con 0x7f514c14bf70 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.449+0000 7f51547c9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0ab990 con 0x7f514c14c350 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37126/0 (socket says 172.21.15.98:37126) 2023-08-22T00:21:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 -- 172.21.15.98:0/1941958397 learned_addr learned my addr 172.21.15.98:0/1941958397 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5151d64700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 0x7f514c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 -- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14c350 msgr2=0x7f514c14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14c350 0x7f514c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 -- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 msgr2=0x7f514c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 0x7f514c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 -- 172.21.15.98:0/1941958397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009a20 con 0x7f514c0c3e50 2023-08-22T00:21:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5151d64700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 0x7f514c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f5152565700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f514400c880 tx=0x7f5144008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144010580 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51440106e0 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c0abc70 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144010a60 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.450+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c065cb0 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.451+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0ac190 con 0x7f514c0c3e50 2023-08-22T00:21:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.451+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f514401b460 con 0x7f514c0c3e50 2023-08-22T00:21:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.452+0000 7f514a7fc700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 0x7f51380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.452+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f514407a030 con 0x7f514c0c3e50 2023-08-22T00:21:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.452+0000 7f5151d64700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 0x7f51380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.452+0000 7f5151d64700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 0x7f51380613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f514c0ae3e0 tx=0x7f5140009040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.456+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f514c0ac190 con 0x7f514c0c3e50 2023-08-22T00:21:14.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:14.678+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f514c0ac190 con 0x7f514c0c3e50 2023-08-22T00:21:15.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.306+0000 7f514a7fc700 1 -- 172.21.15.98:0/1941958397 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v542) v1 ==== 159+0+0 (secure 0 0 0) 0x7f514c0ac190 con 0x7f514c0c3e50 2023-08-22T00:21:15.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 msgr2=0x7f51380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 0x7f51380613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f514c0ae3e0 tx=0x7f5140009040).stop 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 msgr2=0x7f514c0a7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f514400c880 tx=0x7f5144008040).stop 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 shutdown_connections 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f513805ef30 0x7f51380613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f514c14c350 0x7f514c14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f514c0c3e50 0x7f514c0a7380 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 --2- 172.21.15.98:0/1941958397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f514c14bf70 0x7f514c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 >> 172.21.15.98:0/1941958397 conn(0x7f514c0c5dc0 msgr2=0x7f514c151260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 shutdown_connections 2023-08-22T00:21:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.308+0000 7f51547c9700 1 -- 172.21.15.98:0/1941958397 wait complete. 2023-08-22T00:21:15.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:21:15.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.446+0000 7f339f42e700 1 Processor -- start 2023-08-22T00:21:15.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 -- start start 2023-08-22T00:21:15.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 0x7f3398062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3398157880 0x7f3398157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33981581c0 con 0x7f33980acfa0 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33981541c0 con 0x7f3398157880 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.447+0000 7f339f42e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398062be0 con 0x7f3398063c80 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3398157880 0x7f3398157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d1ca700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f33980acfa0 0x7f33980ca270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53600/0 (socket says 172.21.15.98:53600) 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3398157880 0x7f3398157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37134/0 (socket says 172.21.15.98:37134) 2023-08-22T00:21:15.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d1ca700 1 -- 172.21.15.98:0/4166336404 learned_addr learned my addr 172.21.15.98:0/4166336404 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339c9c9700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 0x7f3398062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 -- 172.21.15.98:0/4166336404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 msgr2=0x7f3398062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 0x7f3398062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 -- 172.21.15.98:0/4166336404 >> v1:172.21.15.98:6789/0 conn(0x7f33980acfa0 legacy=0x7f33980ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f338ffff700 1 -- 172.21.15.98:0/4166336404 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488084364 0 0) 0x7f33981581c0 con 0x7f33980acfa0 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 -- 172.21.15.98:0/4166336404 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398062ec0 con 0x7f3398157880 2023-08-22T00:21:15.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339c9c9700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 0x7f3398062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f339d9cb700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398157880 0x7f3398157cd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3390009e60 tx=0x7f3390009780).ready entity=mon.0 client_cookie=50bbce1f70c8628 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f338ffff700 1 -- 172.21.15.98:0/4166336404 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000e070 con 0x7f3398157880 2023-08-22T00:21:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f338ffff700 1 -- 172.21.15.98:0/4166336404 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339000bc30 con 0x7f3398157880 2023-08-22T00:21:15.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.448+0000 7f338ffff700 1 -- 172.21.15.98:0/4166336404 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390012410 con 0x7f3398157880 2023-08-22T00:21:15.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 -- 172.21.15.98:0/4166336404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398157880 msgr2=0x7f3398157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398157880 0x7f3398157cd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3390009e60 tx=0x7f3390009780).stop 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 -- 172.21.15.98:0/4166336404 shutdown_connections 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398157880 0x7f3398157cd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 --2- 172.21.15.98:0/4166336404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398063c80 0x7f3398062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 -- 172.21.15.98:0/4166336404 >> 172.21.15.98:0/4166336404 conn(0x7f33980cb5e0 msgr2=0x7f33980c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 -- 172.21.15.98:0/4166336404 shutdown_connections 2023-08-22T00:21:15.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.449+0000 7f339f42e700 1 -- 172.21.15.98:0/4166336404 wait complete. 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.450+0000 7f339f42e700 1 Processor -- start 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.450+0000 7f339f42e700 1 -- start start 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33980acfa0 0x7f3398166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398157880 0x7f3398158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980aea80 con 0x7f3398063c80 2023-08-22T00:21:15.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398154300 con 0x7f33980acfa0 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339f42e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33981545e0 con 0x7f3398157880 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37146/0 (socket says 172.21.15.98:37146) 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 -- 172.21.15.98:0/1777323978 learned_addr learned my addr 172.21.15.98:0/1777323978 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d9cb700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398157880 0x7f3398158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339c9c9700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33980acfa0 0x7f3398166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 -- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398157880 msgr2=0x7f3398158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398157880 0x7f3398158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 -- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33980acfa0 msgr2=0x7f3398166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33980acfa0 0x7f3398166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 -- 172.21.15.98:0/1777323978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009a20 con 0x7f3398063c80 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f339d1ca700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f338800c4c0 tx=0x7f3388007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.451+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880072e0 con 0x7f3398063c80 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.452+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388007440 con 0x7f3398063c80 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.452+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33981676e0 con 0x7f3398063c80 2023-08-22T00:21:15.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.452+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880057a0 con 0x7f3398063c80 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.452+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398167d20 con 0x7f3398063c80 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.453+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398083350 con 0x7f3398063c80 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.453+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3388005bd0 con 0x7f3398063c80 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.453+0000 7f338d7fa700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 0x7f337c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.453+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f3388079880 con 0x7f3398063c80 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.453+0000 7f339c9c9700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 0x7f337c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.454+0000 7f339c9c9700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 0x7f337c0613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f33980ac0d0 tx=0x7f3394008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.457+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f338804ab60 con 0x7f3398063c80 2023-08-22T00:21:15.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.619+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f33980631a0 con 0x7f3398063c80 2023-08-22T00:21:15.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.624+0000 7f338d7fa700 1 -- 172.21.15.98:0/1777323978 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3388018070 con 0x7f3398063c80 2023-08-22T00:21:15.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 msgr2=0x7f337c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 0x7f337c0613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f33980ac0d0 tx=0x7f3394008040).stop 2023-08-22T00:21:15.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 msgr2=0x7f33980ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f338800c4c0 tx=0x7f3388007c10).stop 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 shutdown_connections 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f337c05ef30 0x7f337c0613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3398157880 0x7f3398158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3398063c80 0x7f33980ae590 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 --2- 172.21.15.98:0/1777323978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33980acfa0 0x7f3398166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 >> 172.21.15.98:0/1777323978 conn(0x7f33980cb5e0 msgr2=0x7f33980c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:15.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 shutdown_connections 2023-08-22T00:21:15.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.626+0000 7f339f42e700 1 -- 172.21.15.98:0/1777323978 wait complete. 2023-08-22T00:21:15.639 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:21:15.640 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:15.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:15.724 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:21:15.725 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:21:15.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:15.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 Processor -- start 2023-08-22T00:21:15.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 -- start start 2023-08-22T00:21:15.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 0x7ff70c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff70c151400 0x7ff70c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c151e40 con 0x7ff70c0a6590 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c0c4f80 con 0x7ff70c151400 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.843+0000 7ff71290a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c151880 con 0x7ff70c0a61b0 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff70c151400 0x7ff70c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff70c151400 0x7ff70c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37154/0 (socket says 172.21.15.98:37154) 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 -- 172.21.15.98:0/1695357938 learned_addr learned my addr 172.21.15.98:0/1695357938 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:15.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70bfff700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 0x7ff70c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 -- 172.21.15.98:0/1695357938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 msgr2=0x7ff70c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 0x7ff70c150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 -- 172.21.15.98:0/1695357938 >> v1:172.21.15.118:6789/0 conn(0x7ff70c0a6590 legacy=0x7ff70c0bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 -- 172.21.15.98:0/1695357938 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c151b60 con 0x7ff70c151400 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70bfff700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 0x7ff70c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:15.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70b7fe700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c151400 0x7ff70c0c5410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff6fc006fd0 tx=0x7ff6fc0090f0).ready entity=mon.0 client_cookie=cbd66b4224e128a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70affd700 1 -- 172.21.15.98:0/1695357938 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00b600 con 0x7ff70c151400 2023-08-22T00:21:15.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70affd700 1 -- 172.21.15.98:0/1695357938 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00b760 con 0x7ff70c151400 2023-08-22T00:21:15.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.844+0000 7ff70affd700 1 -- 172.21.15.98:0/1695357938 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00bae0 con 0x7ff70c151400 2023-08-22T00:21:15.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 -- 172.21.15.98:0/1695357938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c151400 msgr2=0x7ff70c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c151400 0x7ff70c0c5410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff6fc006fd0 tx=0x7ff6fc0090f0).stop 2023-08-22T00:21:15.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 -- 172.21.15.98:0/1695357938 shutdown_connections 2023-08-22T00:21:15.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a61b0 0x7ff70c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 --2- 172.21.15.98:0/1695357938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c151400 0x7ff70c0c5410 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 -- 172.21.15.98:0/1695357938 >> 172.21.15.98:0/1695357938 conn(0x7ff70c0c3980 msgr2=0x7ff70c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:15.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 -- 172.21.15.98:0/1695357938 shutdown_connections 2023-08-22T00:21:15.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.845+0000 7ff71290a700 1 -- 172.21.15.98:0/1695357938 wait complete. 2023-08-22T00:21:15.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.846+0000 7ff71290a700 1 Processor -- start 2023-08-22T00:21:15.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.846+0000 7ff71290a700 1 -- start start 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a6590 0x7ff70c0a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70c151400 0x7ff70c13d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0a4290 con 0x7ff70c0a61b0 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0a5090 con 0x7ff70c151400 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0a4480 con 0x7ff70c0a6590 2023-08-22T00:21:15.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37158/0 (socket says 172.21.15.98:37158) 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 -- 172.21.15.98:0/1891434748 learned_addr learned my addr 172.21.15.98:0/1891434748 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70b7fe700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a6590 0x7ff70c0a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff710ea7700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70c151400 0x7ff70c13d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 -- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a6590 msgr2=0x7ff70c0a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a6590 0x7ff70c0a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 -- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70c151400 msgr2=0x7ff70c13d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:15.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70c151400 0x7ff70c13d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:15.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 -- 172.21.15.98:0/1891434748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009370 con 0x7ff70c0a61b0 2023-08-22T00:21:15.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff70bfff700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff6f400c880 tx=0x7ff6f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4010580 con 0x7ff70c0a61b0 2023-08-22T00:21:15.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40106e0 con 0x7ff70c0a61b0 2023-08-22T00:21:15.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.847+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c0a4760 con 0x7ff70c0a61b0 2023-08-22T00:21:15.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.848+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4010a60 con 0x7ff70c0a61b0 2023-08-22T00:21:15.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.848+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c0a4d20 con 0x7ff70c0a61b0 2023-08-22T00:21:15.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c0c4030 con 0x7ff70c0a61b0 2023-08-22T00:21:15.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff6f401b460 con 0x7ff70c0a61b0 2023-08-22T00:21:15.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff703fff700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 0x7ff6ec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:15.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6138+0+0 (secure 0 0 0) 0x7ff6f407a000 con 0x7ff70c0a61b0 2023-08-22T00:21:15.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff70b7fe700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 0x7ff6ec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:15.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.849+0000 7ff70b7fe700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 0x7ff6ec0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff6fc006fd0 tx=0x7ff6fc017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:15.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:15.853+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6f404b280 con 0x7ff70c0a61b0 2023-08-22T00:21:16.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.053+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff70c047480 con 0x7ff70c0a61b0 2023-08-22T00:21:16.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.054+0000 7ff703fff700 1 -- 172.21.15.98:0/1891434748 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff6f404e8a0 con 0x7ff70c0a61b0 2023-08-22T00:21:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:16.056 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2096207191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2096207191},{"type":"v1","addr":"172.21.15.118:6835","nonce":2096207191}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2687653737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2687653737},{"type":"v1","addr":"172.21.15.98:6837","nonce":2687653737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5940,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/707752335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":707752335},{"type":"v1","addr":"172.21.15.98:6836","nonce":707752335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1615066862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1615066862},{"type":"v1","addr":"172.21.15.118:6834","nonce":1615066862}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-08-22T00:21:16.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 msgr2=0x7ff6ec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 0x7ff6ec0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff6fc006fd0 tx=0x7ff6fc017000).stop 2023-08-22T00:21:16.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 msgr2=0x7ff70c141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff6f400c880 tx=0x7ff6f4008040).stop 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 shutdown_connections 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70c151400 0x7ff70c13d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff70c0a61b0 0x7ff70c141af0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff6ec05ef30 0x7ff6ec0613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 --2- 172.21.15.98:0/1891434748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff70c0a6590 0x7ff70c0a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 >> 172.21.15.98:0/1891434748 conn(0x7ff70c0c3980 msgr2=0x7ff70c066790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:16.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 shutdown_connections 2023-08-22T00:21:16.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.056+0000 7ff71290a700 1 -- 172.21.15.98:0/1891434748 wait complete. 2023-08-22T00:21:16.059 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 25 2023-08-22T00:21:16.069 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:21:16.070 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:21:16.070 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:21:16.070 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:16.070 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:21:16.071 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:21:16.071 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:21:16.071 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:16.072 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:21:16.072 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:21:16.073 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:21:16.073 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:16.073 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:21:16.074 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:21:16.074 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:21:16.074 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:16.078 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:21:16.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:21:16.080 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:21:16.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:21:16.083 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:21:16.084 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:21:16.085 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:21:16.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:21:16.122 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:21:16.122 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:16.123 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:21:16.124 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:16.127 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:21:16.128 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:16.129 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:21:16.129 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:16.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:21:16.197 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:21:16.198 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:21:16.213 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:21:16.214 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:21:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.255+0000 7f622346b700 1 Processor -- start 2023-08-22T00:21:16.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.255+0000 7f622346b700 1 -- start start 2023-08-22T00:21:16.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f622346b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f621c1518d0 0x7f621c0bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f622346b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c0bd0c0 con 0x7f621c1556e0 2023-08-22T00:21:16.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f622346b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c0bc4b0 con 0x7f621c151cb0 2023-08-22T00:21:16.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f622346b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c0bc790 con 0x7f621c1518d0 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f6221a08700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f621c1556e0 0x7f621c065850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53630/0 (socket says 172.21.15.98:53630) 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.256+0000 7f6221a08700 1 -- 172.21.15.98:0/3195831425 learned_addr learned my addr 172.21.15.98:0/3195831425 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830131709 0 0) 0x7f621c0bd0c0 con 0x7f621c1556e0 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62080033f0 con 0x7f621c1556e0 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221207700 1 --2- 172.21.15.98:0/3195831425 >> v2:172.21.15.118:3300/0 conn(0x7f621c1518d0 0x7f621c0bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3425975765 0 0) 0x7f62080033f0 con 0x7f621c1556e0 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 >> v2:172.21.15.118:3300/0 conn(0x7f621c1518d0 msgr2=0x7f621c0bbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 --2- 172.21.15.98:0/3195831425 >> v2:172.21.15.118:3300/0 conn(0x7f621c1518d0 0x7f621c0bbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 >> v1:172.21.15.118:6789/0 conn(0x7f621c151cb0 legacy=0x7f621c0bd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0bca70 con 0x7f621c1556e0 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f62180017f0 con 0x7f621c1556e0 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 >> v1:172.21.15.98:6789/0 conn(0x7f621c1556e0 legacy=0x7f621c065850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62080038e0 0x7f6208003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6208004690 0x7f6208004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f620800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0bc790 con 0x7f6208005000 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620800bf60 con 0x7f6208004690 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620800c0f0 con 0x7f62080038e0 2023-08-22T00:21:16.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f620800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6220a06700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6208004690 0x7f6208004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221207700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62080038e0 0x7f6208003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 -- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62080038e0 msgr2=0x7f6208003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:16.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62080038e0 0x7f6208003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 -- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6208004690 msgr2=0x7f6208004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6208004690 0x7f6208004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 -- 172.21.15.98:0/3195831425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080033f0 con 0x7f6208005000 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221207700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62080038e0 0x7f6208003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 -- 172.21.15.98:0/3195831425 reap_dead start 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6221a08700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f620800b8e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f621800c480 tx=0x7f621800c790).ready entity=mon.0 client_cookie=e44424975a6f94ed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:16.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218002030 con 0x7f6208005000 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621800ce20 con 0x7f6208005000 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.257+0000 7f6213fff700 1 -- 172.21.15.98:0/3195831425 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218005d30 con 0x7f6208005000 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 -- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 msgr2=0x7f620800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f620800b8e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f621800c480 tx=0x7f621800c790).stop 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 -- 172.21.15.98:0/3195831425 shutdown_connections 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 --2- 172.21.15.98:0/3195831425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f620800b8e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 -- 172.21.15.98:0/3195831425 >> 172.21.15.98:0/3195831425 conn(0x7f621c069630 msgr2=0x7f621c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:16.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 -- 172.21.15.98:0/3195831425 shutdown_connections 2023-08-22T00:21:16.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.258+0000 7f622346b700 1 -- 172.21.15.98:0/3195831425 wait complete. 2023-08-22T00:21:16.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.259+0000 7f622346b700 1 Processor -- start 2023-08-22T00:21:16.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.259+0000 7f622346b700 1 -- start start 2023-08-22T00:21:16.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f621c0be6c0 0x7f621c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c154160 0x7f621c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0bfad0 con 0x7f6208005000 2023-08-22T00:21:16.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0beec0 con 0x7f621c154160 2023-08-22T00:21:16.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f622346b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0bf1a0 con 0x7f621c0be6c0 2023-08-22T00:21:16.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37188/0 (socket says 172.21.15.98:37188) 2023-08-22T00:21:16.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 -- 172.21.15.98:0/3223100879 learned_addr learned my addr 172.21.15.98:0/3223100879 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:16.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221a08700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c154160 0x7f621c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6220a06700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f621c0be6c0 0x7f621c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 -- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f621c0be6c0 msgr2=0x7f621c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f621c0be6c0 0x7f621c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 -- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c154160 msgr2=0x7f621c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c154160 0x7f621c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.260+0000 7f6221207700 1 -- 172.21.15.98:0/3223100879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0bf480 con 0x7f6208005000 2023-08-22T00:21:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f6221207700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f62140115c0 tx=0x7f6214008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140145f0 con 0x7f6208005000 2023-08-22T00:21:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214014750 con 0x7f6208005000 2023-08-22T00:21:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0bf760 con 0x7f6208005000 2023-08-22T00:21:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214014ad0 con 0x7f6208005000 2023-08-22T00:21:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.261+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c154ad0 con 0x7f6208005000 2023-08-22T00:21:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.262+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c0c1610 con 0x7f6208005000 2023-08-22T00:21:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.262+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6214015480 con 0x7f6208005000 2023-08-22T00:21:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.262+0000 7f62117fa700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 0x7f62000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.263+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f621407a570 con 0x7f6208005000 2023-08-22T00:21:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.263+0000 7f6220a06700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 0x7f62000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.263+0000 7f6220a06700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 0x7f62000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f621c095010 tx=0x7f620c007bb0).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.267+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f621404b7f0 con 0x7f6208005000 2023-08-22T00:21:16.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-08-22T00:21:16.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-08-22T00:21:16.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-08-22T00:21:16.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:16.442+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f621c0bcd50 con 0x7f6208005000 2023-08-22T00:21:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.313+0000 7f62117fa700 1 -- 172.21.15.98:0/3223100879 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f621404ee10 con 0x7f6208005000 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 msgr2=0x7f62000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 0x7f62000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f621c095010 tx=0x7f620c007bb0).stop 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 msgr2=0x7f621c0be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f62140115c0 tx=0x7f6214008040).stop 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 shutdown_connections 2023-08-22T00:21:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c154160 0x7f621c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6208005000 0x7f621c0be1d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f620005ef30 0x7f62000613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 --2- 172.21.15.98:0/3223100879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f621c0be6c0 0x7f621c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 >> 172.21.15.98:0/3223100879 conn(0x7f621c069630 msgr2=0x7f621c065af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 shutdown_connections 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.315+0000 7f622346b700 1 -- 172.21.15.98:0/3223100879 wait complete. 2023-08-22T00:21:17.319 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:21:17.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:21:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.450+0000 7f1a3c428700 1 Processor -- start 2023-08-22T00:21:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.450+0000 7f1a3c428700 1 -- start start 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.451+0000 7f1a3c428700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a341550e0 0x7f1a34065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3c428700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a340bd750 con 0x7f1a34066400 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3c428700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a340a7030 con 0x7f1a34153cf0 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3c428700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a340c2010 con 0x7f1a341550e0 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3a9c5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1a34066400 0x7f1a340bdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53640/0 (socket says 172.21.15.98:53640) 2023-08-22T00:21:17.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3a9c5700 1 -- 172.21.15.98:0/1991739620 learned_addr learned my addr 172.21.15.98:0/1991739620 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151030803 0 0) 0x7f1a340bd750 con 0x7f1a34066400 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a200033f0 con 0x7f1a34066400 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a399c3700 1 --2- 172.21.15.98:0/1991739620 >> v2:172.21.15.118:3300/0 conn(0x7f1a341550e0 0x7f1a34065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937551651 0 0) 0x7f1a200033f0 con 0x7f1a34066400 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 >> v2:172.21.15.118:3300/0 conn(0x7f1a341550e0 msgr2=0x7f1a34065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 --2- 172.21.15.98:0/1991739620 >> v2:172.21.15.118:3300/0 conn(0x7f1a341550e0 0x7f1a34065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 >> v1:172.21.15.118:6789/0 conn(0x7f1a34153cf0 legacy=0x7f1a341584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340a6d50 con 0x7f1a34066400 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f1a2c0017f0 con 0x7f1a34066400 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 >> v1:172.21.15.98:6789/0 conn(0x7f1a34066400 legacy=0x7f1a340bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a200038e0 0x7f1a20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 0x7f1a20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a20005000 0x7f1a2000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340c2010 con 0x7f1a20005000 2023-08-22T00:21:17.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2000beb0 con 0x7f1a20004690 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2000c070 con 0x7f1a200038e0 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a399c3700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 0x7f1a20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3a9c5700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a20005000 0x7f1a2000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.452+0000 7f1a3a1c4700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a200038e0 0x7f1a20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 -- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a200038e0 msgr2=0x7f1a20003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a200038e0 0x7f1a20003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 -- 172.21.15.98:0/1991739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a20005000 msgr2=0x7f1a2000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a20005000 0x7f1a2000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 -- 172.21.15.98:0/1991739620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200033f0 con 0x7f1a20004690 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a3a9c5700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a20005000 0x7f1a2000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a3a9c5700 1 -- 172.21.15.98:0/1991739620 reap_dead start 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a399c3700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 0x7f1a20004b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1a30009a60 tx=0x7f1a30009060).ready entity=mon.1 client_cookie=5c7d606b6496470b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30009ea0 con 0x7f1a20004690 2023-08-22T00:21:17.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30009430 con 0x7f1a20004690 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a391c2700 1 -- 172.21.15.98:0/1991739620 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000e870 con 0x7f1a20004690 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.453+0000 7f1a3c428700 1 -- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 msgr2=0x7f1a20004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 0x7f1a20004b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1a30009a60 tx=0x7f1a30009060).stop 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 -- 172.21.15.98:0/1991739620 shutdown_connections 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 --2- 172.21.15.98:0/1991739620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20004690 0x7f1a20004b10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 -- 172.21.15.98:0/1991739620 >> 172.21.15.98:0/1991739620 conn(0x7f1a340c7770 msgr2=0x7f1a340c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:17.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 -- 172.21.15.98:0/1991739620 shutdown_connections 2023-08-22T00:21:17.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.454+0000 7f1a3c428700 1 -- 172.21.15.98:0/1991739620 wait complete. 2023-08-22T00:21:17.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.455+0000 7f1a3c428700 1 Processor -- start 2023-08-22T00:21:17.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.455+0000 7f1a3c428700 1 -- start start 2023-08-22T00:21:17.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a20004690 0x7f1a3414e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 0x7f1a340a7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34155c00 con 0x7f1a340aa720 2023-08-22T00:21:17.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34156a60 con 0x7f1a340a7300 2023-08-22T00:21:17.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34155e50 con 0x7f1a20004690 2023-08-22T00:21:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37210/0 (socket says 172.21.15.98:37210) 2023-08-22T00:21:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 -- 172.21.15.98:0/3790482841 learned_addr learned my addr 172.21.15.98:0/3790482841 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3a9c5700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 0x7f1a340a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3a1c4700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a20004690 0x7f1a3414e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 -- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a20004690 msgr2=0x7f1a3414e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a20004690 0x7f1a3414e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 -- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 msgr2=0x7f1a340a7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 0x7f1a340a7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 -- 172.21.15.98:0/3790482841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34156130 con 0x7f1a340aa720 2023-08-22T00:21:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3a9c5700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 0x7f1a340a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a399c3700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f1a3000e4b0 tx=0x7f1a3001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3001bb50 con 0x7f1a340aa720 2023-08-22T00:21:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3001bcb0 con 0x7f1a340aa720 2023-08-22T00:21:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a34156410 con 0x7f1a340aa720 2023-08-22T00:21:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.456+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30024640 con 0x7f1a340aa720 2023-08-22T00:21:17.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.457+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a340c6570 con 0x7f1a340aa720 2023-08-22T00:21:17.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a341568b0 con 0x7f1a340aa720 2023-08-22T00:21:17.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1a300123f0 con 0x7f1a340aa720 2023-08-22T00:21:17.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a2a7fc700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 0x7f1a180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1a3007b3c0 con 0x7f1a340aa720 2023-08-22T00:21:17.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a3a1c4700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 0x7f1a180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.458+0000 7f1a3a1c4700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 0x7f1a180613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1a24000f60 tx=0x7f1a24009040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.462+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a3004c840 con 0x7f1a340aa720 2023-08-22T00:21:17.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.684+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1a34047480 con 0x7f1a340aa720 2023-08-22T00:21:17.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.684+0000 7f1a2a7fc700 1 -- 172.21.15.98:0/3790482841 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1a30029090 con 0x7f1a340aa720 2023-08-22T00:21:17.686 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:17.686 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:21:17.686 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:21:17.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.688 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:17.689 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:17.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:21:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.693 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:21:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.695 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.698 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:21:17.699 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.700 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:21:17.703 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.704 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:21:17.705 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:17.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.708 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:21:17.709 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:17.710 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:17.712 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:21:17.712 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:21:17.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 msgr2=0x7f1a180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 0x7f1a180613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1a24000f60 tx=0x7f1a24009040).stop 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 msgr2=0x7f1a340aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f1a3000e4b0 tx=0x7f1a3001a000).stop 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 shutdown_connections 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1a1805ef30 0x7f1a180613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a20004690 0x7f1a3414e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a340a7300 0x7f1a340a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 --2- 172.21.15.98:0/3790482841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a340aa720 0x7f1a340aaba0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 >> 172.21.15.98:0/3790482841 conn(0x7f1a340c7770 msgr2=0x7f1a340a44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:17.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 shutdown_connections 2023-08-22T00:21:17.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.686+0000 7f1a3c428700 1 -- 172.21.15.98:0/3790482841 wait complete. 2023-08-22T00:21:17.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.830+0000 7f2df9c4e700 1 Processor -- start 2023-08-22T00:21:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 -- start start 2023-08-22T00:21:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2df4065f10 0x7f2df40663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40bd3e0 con 0x7f2df4150e40 2023-08-22T00:21:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df4066890 con 0x7f2df4065f10 2023-08-22T00:21:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.831+0000 7f2df9c4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40bd0c0 con 0x7f2df40bd870 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2df4065f10 0x7f2df40663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:45554/0 (socket says 172.21.15.98:45554) 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2df4065f10 0x7f2df40663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:55908/0 (socket says 172.21.15.98:55908) 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df2ffd700 1 -- 172.21.15.98:0/3740761275 learned_addr learned my addr 172.21.15.98:0/3740761275 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df37fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2df4150e40 0x7f2df40a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56690/0 (socket says 172.21.15.98:56690) 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 -- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 msgr2=0x7f2df40c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 -- 172.21.15.98:0/3740761275 >> v1:172.21.15.118:6789/0 conn(0x7f2df4150e40 legacy=0x7f2df40a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 -- 172.21.15.98:0/3740761275 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40c3bb0 con 0x7f2df4065f10 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df27fc700 1 -- 172.21.15.98:0/3740761275 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158979944 0 0) 0x7f2df40bd3e0 con 0x7f2df4150e40 2023-08-22T00:21:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df2ffd700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df3fff700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df4065f10 0x7f2df40663a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2dec009e60 tx=0x7f2dec009780).ready entity=mon.1 client_cookie=4df469331a7cd84d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df27fc700 1 -- 172.21.15.98:0/3740761275 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00e070 con 0x7f2df4065f10 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df27fc700 1 -- 172.21.15.98:0/3740761275 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00bb60 con 0x7f2df4065f10 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.832+0000 7f2df27fc700 1 -- 172.21.15.98:0/3740761275 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec012410 con 0x7f2df4065f10 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 -- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df4065f10 msgr2=0x7f2df40663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df4065f10 0x7f2df40663a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2dec009e60 tx=0x7f2dec009780).stop 2023-08-22T00:21:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 -- 172.21.15.98:0/3740761275 shutdown_connections 2023-08-22T00:21:17.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df4065f10 0x7f2df40663a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/3740761275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df40bd870 0x7f2df40c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 -- 172.21.15.98:0/3740761275 >> 172.21.15.98:0/3740761275 conn(0x7f2df406a980 msgr2=0x7f2df40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:17.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 -- 172.21.15.98:0/3740761275 shutdown_connections 2023-08-22T00:21:17.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.833+0000 7f2df9c4e700 1 -- 172.21.15.98:0/3740761275 wait complete. 2023-08-22T00:21:17.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.834+0000 7f2df9c4e700 1 Processor -- start 2023-08-22T00:21:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.834+0000 7f2df9c4e700 1 -- start start 2023-08-22T00:21:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df4065f10 0x7f2df40ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df40bd870 0x7f2df41633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40bea10 con 0x7f2df4150e40 2023-08-22T00:21:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40abac0 con 0x7f2df40bd870 2023-08-22T00:21:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df9c4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40abda0 con 0x7f2df4065f10 2023-08-22T00:21:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37216/0 (socket says 172.21.15.98:37216) 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 -- 172.21.15.98:0/347550984 learned_addr learned my addr 172.21.15.98:0/347550984 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df2ffd700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df40bd870 0x7f2df41633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df37fe700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df4065f10 0x7f2df40ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 -- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df4065f10 msgr2=0x7f2df40ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df4065f10 0x7f2df40ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 -- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df40bd870 msgr2=0x7f2df41633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df40bd870 0x7f2df41633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 -- 172.21.15.98:0/347550984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de400b610 con 0x7f2df4150e40 2023-08-22T00:21:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.835+0000 7f2df3fff700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f2dec00b6c0 tx=0x7f2df40be6d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.836+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec012410 con 0x7f2df4150e40 2023-08-22T00:21:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.836+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec01d630 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.836+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec009a20 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.836+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec01d9f0 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.836+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df40ac360 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.837+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4047480 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.837+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2dec027460 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.837+0000 7f2ddb7fe700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 0x7f2de00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.837+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2dec07bb90 con 0x7f2df4150e40 2023-08-22T00:21:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.837+0000 7f2df37fe700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 0x7f2de00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:17.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.838+0000 7f2df37fe700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 0x7f2de00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2de8007fd0 tx=0x7f2de8007d70).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:17.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:17.841+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2dec04d0d0 con 0x7f2df4150e40 2023-08-22T00:21:18.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.004+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df40beb50 con 0x7f2df4150e40 2023-08-22T00:21:18.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.005+0000 7f2ddb7fe700 1 -- 172.21.15.98:0/347550984 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+14044 (secure 0 0 0) 0x7f2dec0506f0 con 0x7f2df4150e40 2023-08-22T00:21:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:18.007 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":86,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:17.308496+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 msgr2=0x7f2de00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 0x7f2de00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2de8007fd0 tx=0x7f2de8007d70).stop 2023-08-22T00:21:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 msgr2=0x7f2df41638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f2dec00b6c0 tx=0x7f2df40be6d0).stop 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 shutdown_connections 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2de005ef30 0x7f2de00613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df4065f10 0x7f2df40ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2df4150e40 0x7f2df41638e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 --2- 172.21.15.98:0/347550984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df40bd870 0x7f2df41633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 >> 172.21.15.98:0/347550984 conn(0x7f2df406a980 msgr2=0x7f2df40c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 shutdown_connections 2023-08-22T00:21:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.007+0000 7f2df9c4e700 1 -- 172.21.15.98:0/347550984 wait complete. 2023-08-22T00:21:18.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:21:18.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:21:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.140+0000 7f9b65fa3700 1 Processor -- start 2023-08-22T00:21:18.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.140+0000 7f9b65fa3700 1 -- start start 2023-08-22T00:21:18.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b65fa3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b60066150 0x7f9b60066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b65fa3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b600c69b0 con 0x7f9b60157890 2023-08-22T00:21:18.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b65fa3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b601542c0 con 0x7f9b600c5360 2023-08-22T00:21:18.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b65fa3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600c57f0 con 0x7f9b60066150 2023-08-22T00:21:18.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b60066150 0x7f9b60066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9b60157890 0x7f9b600c33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53656/0 (socket says 172.21.15.98:53656) 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5ffff700 1 -- 172.21.15.98:0/804853897 learned_addr learned my addr 172.21.15.98:0/804853897 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5f7fe700 1 -- 172.21.15.98:0/804853897 >> v1:172.21.15.118:6789/0 conn(0x7f9b600c5360 legacy=0x7f9b600c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5f7fe700 1 -- 172.21.15.98:0/804853897 >> v1:172.21.15.98:6789/0 conn(0x7f9b60157890 legacy=0x7f9b600c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5f7fe700 1 -- 172.21.15.98:0/804853897 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600c5ad0 con 0x7f9b60066150 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5e7fc700 1 -- 172.21.15.98:0/804853897 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079789157 0 0) 0x7f9b600c69b0 con 0x7f9b60157890 2023-08-22T00:21:18.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5f7fe700 1 --2- 172.21.15.98:0/804853897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b60066150 0x7f9b60066530 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f9b50009760 tx=0x7f9b50009060).ready entity=mon.0 client_cookie=8916e6c0d8b58d4e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5e7fc700 1 -- 172.21.15.98:0/804853897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000b580 con 0x7f9b60066150 2023-08-22T00:21:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5e7fc700 1 -- 172.21.15.98:0/804853897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000b6e0 con 0x7f9b60066150 2023-08-22T00:21:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.141+0000 7f9b5e7fc700 1 -- 172.21.15.98:0/804853897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000ba60 con 0x7f9b60066150 2023-08-22T00:21:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 -- 172.21.15.98:0/804853897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b60066150 msgr2=0x7f9b60066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/804853897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b60066150 0x7f9b60066530 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f9b50009760 tx=0x7f9b50009060).stop 2023-08-22T00:21:18.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 -- 172.21.15.98:0/804853897 shutdown_connections 2023-08-22T00:21:18.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/804853897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b60066150 0x7f9b60066530 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 -- 172.21.15.98:0/804853897 >> 172.21.15.98:0/804853897 conn(0x7f9b600c7800 msgr2=0x7f9b600c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 -- 172.21.15.98:0/804853897 shutdown_connections 2023-08-22T00:21:18.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.142+0000 7f9b65fa3700 1 -- 172.21.15.98:0/804853897 wait complete. 2023-08-22T00:21:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.143+0000 7f9b65fa3700 1 Processor -- start 2023-08-22T00:21:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.143+0000 7f9b65fa3700 1 -- start start 2023-08-22T00:21:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b60066150 0x7f9b60155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b60157890 0x7f9b60164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60155960 con 0x7f9b600ad410 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014ce70 con 0x7f9b60157890 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b65fa3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60156780 con 0x7f9b60066150 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37226/0 (socket says 172.21.15.98:37226) 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 -- 172.21.15.98:0/729594479 learned_addr learned my addr 172.21.15.98:0/729594479 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5f7fe700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b60066150 0x7f9b60155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5effd700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b60157890 0x7f9b60164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 -- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b60066150 msgr2=0x7f9b60155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b60066150 0x7f9b60155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 -- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b60157890 msgr2=0x7f9b60164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b60157890 0x7f9b60164db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 -- 172.21.15.98:0/729594479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500092a0 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.144+0000 7f9b5ffff700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f9b5800c840 tx=0x7f9b580014f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.145+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58005d30 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.145+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b58005e90 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.145+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b601652a0 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.145+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58007320 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.145+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b60155e50 con 0x7f9b600ad410 2023-08-22T00:21:18.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.146+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60069220 con 0x7f9b600ad410 2023-08-22T00:21:18.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.146+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9b58007750 con 0x7f9b600ad410 2023-08-22T00:21:18.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.146+0000 7f9b477fe700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 0x7f9b4c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.146+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9b58079d50 con 0x7f9b600ad410 2023-08-22T00:21:18.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.146+0000 7f9b5f7fe700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 0x7f9b4c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.147+0000 7f9b5f7fe700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 0x7f9b4c0613c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b5000b340 tx=0x7f9b50017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.150+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b5804b230 con 0x7f9b600ad410 2023-08-22T00:21:18.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.312+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9b600c5db0 con 0x7f9b600ad410 2023-08-22T00:21:18.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.312+0000 7f9b477fe700 1 -- 172.21.15.98:0/729594479 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9b5804e850 con 0x7f9b600ad410 2023-08-22T00:21:18.314 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:21:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 msgr2=0x7f9b4c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 0x7f9b4c0613c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b5000b340 tx=0x7f9b50017000).stop 2023-08-22T00:21:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 msgr2=0x7f9b60154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f9b5800c840 tx=0x7f9b580014f0).stop 2023-08-22T00:21:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 shutdown_connections 2023-08-22T00:21:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b4c05ef00 0x7f9b4c0613c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b60066150 0x7f9b60155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b600ad410 0x7f9b60154680 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 --2- 172.21.15.98:0/729594479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b60157890 0x7f9b60164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 >> 172.21.15.98:0/729594479 conn(0x7f9b600c7800 msgr2=0x7f9b600bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 shutdown_connections 2023-08-22T00:21:18.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.314+0000 7f9b65fa3700 1 -- 172.21.15.98:0/729594479 wait complete. 2023-08-22T00:21:18.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:21:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.446+0000 7fbb5c9aa700 1 Processor -- start 2023-08-22T00:21:18.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.446+0000 7fbb5c9aa700 1 -- start start 2023-08-22T00:21:18.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.447+0000 7fbb5c9aa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb581579e0 0x7fbb580c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.447+0000 7fbb5c9aa700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb58063000 0x7fbb58154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.447+0000 7fbb5c9aa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb58064280 con 0x7fbb580c5750 2023-08-22T00:21:18.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.447+0000 7fbb5c9aa700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580c1850 con 0x7fbb58063000 2023-08-22T00:21:18.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.447+0000 7fbb5c9aa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58063470 con 0x7fbb581579e0 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb58063000 0x7fbb58154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb58063000 0x7fbb58154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37236/0 (socket says 172.21.15.98:37236) 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 -- 172.21.15.98:0/288050654 learned_addr learned my addr 172.21.15.98:0/288050654 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb55d9b700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb581579e0 0x7fbb580c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 -- 172.21.15.98:0/288050654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb581579e0 msgr2=0x7fbb580c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb581579e0 0x7fbb580c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 -- 172.21.15.98:0/288050654 >> v1:172.21.15.118:6789/0 conn(0x7fbb580c5750 legacy=0x7fbb580c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 -- 172.21.15.98:0/288050654 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580c4c20 con 0x7fbb58063000 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb56d9d700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb58154a60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fbb50009f50 tx=0x7fbb50009840).ready entity=mon.0 client_cookie=dbb862f15df1a02d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb5559a700 1 -- 172.21.15.98:0/288050654 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000e070 con 0x7fbb58063000 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb5559a700 1 -- 172.21.15.98:0/288050654 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5000ba30 con 0x7fbb58063000 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.448+0000 7fbb5559a700 1 -- 172.21.15.98:0/288050654 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000bdb0 con 0x7fbb58063000 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/288050654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 msgr2=0x7fbb58154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb58154a60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fbb50009f50 tx=0x7fbb50009840).stop 2023-08-22T00:21:18.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/288050654 shutdown_connections 2023-08-22T00:21:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb58154a60 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/288050654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb581579e0 0x7fbb580c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/288050654 >> 172.21.15.98:0/288050654 conn(0x7fbb580c3a60 msgr2=0x7fbb580c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/288050654 shutdown_connections 2023-08-22T00:21:18.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.449+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/288050654 wait complete. 2023-08-22T00:21:18.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.450+0000 7fbb5c9aa700 1 Processor -- start 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.450+0000 7fbb5c9aa700 1 -- start start 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb580c5750 0x7fbb580bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb581579e0 0x7fbb580bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58155ab0 con 0x7fbb58063000 2023-08-22T00:21:18.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c0800 con 0x7fbb581579e0 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5c9aa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58155d70 con 0x7fbb580c5750 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37244/0 (socket says 172.21.15.98:37244) 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.451+0000 7fbb5659c700 1 -- 172.21.15.98:0/1386599110 learned_addr learned my addr 172.21.15.98:0/1386599110 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb56d9d700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb581579e0 0x7fbb580bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 -- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb580c5750 msgr2=0x7fbb580bf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb55d9b700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb580c5750 0x7fbb580bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb580c5750 0x7fbb580bf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 -- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb581579e0 msgr2=0x7fbb580bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb581579e0 0x7fbb580bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 -- 172.21.15.98:0/1386599110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009ae0 con 0x7fbb58063000 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5659c700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fbb4000c470 tx=0x7fbb40007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000f470 con 0x7fbb58063000 2023-08-22T00:21:18.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4000f5f0 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58153ab0 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000f9b0 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.452+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb580c0240 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.453+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58068970 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.453+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbb40012400 con 0x7fbb58063000 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.453+0000 7fbb4e7fc700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 0x7fbb380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.453+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fbb400792e0 con 0x7fbb58063000 2023-08-22T00:21:18.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.454+0000 7fbb55d9b700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 0x7fbb380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.454+0000 7fbb55d9b700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 0x7fbb380613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbb48006fd0 tx=0x7fbb48008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.458+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb400488f0 con 0x7fbb58063000 2023-08-22T00:21:18.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.619+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb58063670 con 0x7fbb58063000 2023-08-22T00:21:18.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.619+0000 7fbb4e7fc700 1 -- 172.21.15.98:0/1386599110 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb4004a810 con 0x7fbb58063000 2023-08-22T00:21:18.621 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 msgr2=0x7fbb380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 0x7fbb380613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbb48006fd0 tx=0x7fbb48008040).stop 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 msgr2=0x7fbb5814eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fbb4000c470 tx=0x7fbb40007de0).stop 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 shutdown_connections 2023-08-22T00:21:18.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb581579e0 0x7fbb580bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb58063000 0x7fbb5814eb40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbb3805ef30 0x7fbb380613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 --2- 172.21.15.98:0/1386599110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb580c5750 0x7fbb580bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 >> 172.21.15.98:0/1386599110 conn(0x7fbb580c3a60 msgr2=0x7fbb580c2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 shutdown_connections 2023-08-22T00:21:18.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.621+0000 7fbb5c9aa700 1 -- 172.21.15.98:0/1386599110 wait complete. 2023-08-22T00:21:18.634 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:21:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.749+0000 7f7b65183700 1 Processor -- start 2023-08-22T00:21:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.749+0000 7f7b65183700 1 -- start start 2023-08-22T00:21:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b65183700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b60068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b65183700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600a8410 con 0x7f7b60153f40 2023-08-22T00:21:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b65183700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600a8cb0 con 0x7f7b600a9140 2023-08-22T00:21:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b65183700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601586a0 con 0x7f7b60153b60 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5e59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7b60153f40 0x7f7b60157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53670/0 (socket says 172.21.15.98:53670) 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5e59c700 1 -- 172.21.15.98:0/1549595157 learned_addr learned my addr 172.21.15.98:0/1549595157 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b60068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394554537 0 0) 0x7f7b600a8410 con 0x7f7b60153f40 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b480033f0 con 0x7f7b60153f40 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182029973 0 0) 0x7f7b480033f0 con 0x7f7b60153f40 2023-08-22T00:21:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 msgr2=0x7f7b60068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b60068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 >> v1:172.21.15.118:6789/0 conn(0x7f7b600a9140 legacy=0x7f7b600c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600a8660 con 0x7f7b60153f40 2023-08-22T00:21:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7b50001470 con 0x7f7b60153f40 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 >> v1:172.21.15.98:6789/0 conn(0x7f7b60153f40 legacy=0x7f7b60157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b48003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b48004690 0x7f7b48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.750+0000 7f7b5dd9b700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601586a0 con 0x7f7b48003910 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4800b910 con 0x7f7b48004690 2023-08-22T00:21:18.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4800bad0 con 0x7f7b60153b60 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b48003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5e59c700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b48004690 0x7f7b48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5f59e700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 msgr2=0x7f7b48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b48004690 msgr2=0x7f7b48004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:18.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b48004690 0x7f7b48004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/1549595157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480033f0 con 0x7f7b48003910 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5f59e700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60153b60 0x7f7b48005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b48003d30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7b54009a80 tx=0x7f7b54009060).ready entity=mon.0 client_cookie=f72db96a591ce7f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54009430 con 0x7f7b48003910 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400e640 con 0x7f7b48003910 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b5dd9b700 1 -- 172.21.15.98:0/1549595157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400e9c0 con 0x7f7b48003910 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.751+0000 7f7b65183700 1 -- 172.21.15.98:0/1549595157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 msgr2=0x7f7b48003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b65183700 1 --2- 172.21.15.98:0/1549595157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b48003d30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7b54009a80 tx=0x7f7b54009060).stop 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b5f59e700 1 -- 172.21.15.98:0/1549595157 reap_dead start 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b65183700 1 -- 172.21.15.98:0/1549595157 shutdown_connections 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b65183700 1 -- 172.21.15.98:0/1549595157 >> 172.21.15.98:0/1549595157 conn(0x7f7b600c5dc0 msgr2=0x7f7b60068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b65183700 1 -- 172.21.15.98:0/1549595157 shutdown_connections 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.752+0000 7f7b65183700 1 -- 172.21.15.98:0/1549595157 wait complete. 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.753+0000 7f7b65183700 1 Processor -- start 2023-08-22T00:21:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.753+0000 7f7b65183700 1 -- start start 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60164f80 0x7f7b600aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600aae50 0x7f7b60166850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60142bf0 con 0x7f7b48003910 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601663c0 con 0x7f7b600aae50 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600ab2d0 con 0x7f7b60164f80 2023-08-22T00:21:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37258/0 (socket says 172.21.15.98:37258) 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/3381200689 learned_addr learned my addr 172.21.15.98:0/3381200689 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60164f80 msgr2=0x7f7b600aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60164f80 0x7f7b600aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600aae50 msgr2=0x7f7b60166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600aae50 0x7f7b60166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 -- 172.21.15.98:0/3381200689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60165760 con 0x7f7b48003910 2023-08-22T00:21:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b5ed9d700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7b5400e4b0 tx=0x7f7b5401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400ed30 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400eeb0 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5401b450 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b60165a90 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.754+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b60166050 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.755+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b60047480 con 0x7f7b48003910 2023-08-22T00:21:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.755+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7b5401b800 con 0x7f7b48003910 2023-08-22T00:21:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.756+0000 7f7b46ffd700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 0x7f7b4c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.756+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7b5407b810 con 0x7f7b48003910 2023-08-22T00:21:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.756+0000 7f7b5e59c700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 0x7f7b4c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.756+0000 7f7b5e59c700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 0x7f7b4c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7b500010e0 tx=0x7f7b50001e90).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.760+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b5404cd40 con 0x7f7b48003910 2023-08-22T00:21:18.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.921+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b600a8940 con 0x7f7b48003910 2023-08-22T00:21:18.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.921+0000 7f7b46ffd700 1 -- 172.21.15.98:0/3381200689 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7b5402b020 con 0x7f7b48003910 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:21:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:21:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:21:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:18.924 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:21:18.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 msgr2=0x7f7b4c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 0x7f7b4c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7b500010e0 tx=0x7f7b50001e90).stop 2023-08-22T00:21:18.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 msgr2=0x7f7b60155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:18.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7b5400e4b0 tx=0x7f7b5401a000).stop 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 shutdown_connections 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600aae50 0x7f7b60166850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b48003910 0x7f7b60155fe0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b4c05ef30 0x7f7b4c0613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 --2- 172.21.15.98:0/3381200689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60164f80 0x7f7b600aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 >> 172.21.15.98:0/3381200689 conn(0x7f7b600c5dc0 msgr2=0x7f7b600ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 shutdown_connections 2023-08-22T00:21:18.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:18.923+0000 7f7b65183700 1 -- 172.21.15.98:0/3381200689 wait complete. 2023-08-22T00:21:18.937 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:21:18.938 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:21:19.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.058+0000 7fd0ccf86700 1 Processor -- start 2023-08-22T00:21:19.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.058+0000 7fd0ccf86700 1 -- start start 2023-08-22T00:21:19.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0ccf86700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0c815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0ccf86700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c8064050 con 0x7fd0c8065490 2023-08-22T00:21:19.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0ccf86700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c8151dd0 con 0x7fd0c81519f0 2023-08-22T00:21:19.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0ccf86700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80bd6e0 con 0x7fd0c80c48d0 2023-08-22T00:21:19.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0c5d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd0c8065490 0x7fd0c80c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53686/0 (socket says 172.21.15.98:53686) 2023-08-22T00:21:19.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.059+0000 7fd0c5d9b700 1 -- 172.21.15.98:0/3835326431 learned_addr learned my addr 172.21.15.98:0/3835326431 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:19.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0c815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710126666 0 0) 0x7fd0c8064050 con 0x7fd0c8065490 2023-08-22T00:21:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b40033f0 con 0x7fd0c8065490 2023-08-22T00:21:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923958835 0 0) 0x7fd0b40033f0 con 0x7fd0c8065490 2023-08-22T00:21:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 msgr2=0x7fd0c815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0c815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 >> v1:172.21.15.118:6789/0 conn(0x7fd0c81519f0 legacy=0x7fd0c80be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80bcad0 con 0x7fd0c8065490 2023-08-22T00:21:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd0b0001470 con 0x7fd0c8065490 2023-08-22T00:21:19.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 >> v1:172.21.15.98:6789/0 conn(0x7fd0c8065490 legacy=0x7fd0c80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4003910 0x7fd0b4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0b4004b80 0x7fd0b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80bd6e0 con 0x7fd0b4004b80 2023-08-22T00:21:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b400b8e0 con 0x7fd0b4003910 2023-08-22T00:21:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b400baa0 con 0x7fd0c80c48d0 2023-08-22T00:21:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0b4004b80 0x7fd0b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c5d9b700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c659c700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4003910 0x7fd0b4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 msgr2=0x7fd0b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80c48d0 0x7fd0b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4003910 msgr2=0x7fd0b4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4003910 0x7fd0b4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3835326431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40033f0 con 0x7fd0b4004b80 2023-08-22T00:21:19.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c659c700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4003910 0x7fd0b4003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:19.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.060+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0b4004b80 0x7fd0b4005000 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fd0c80c1d20 tx=0x7fd0b8009060).ready entity=mon.0 client_cookie=3a3e26d9a3d9880f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8009e90 con 0x7fd0b4004b80 2023-08-22T00:21:19.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8009430 con 0x7fd0b4004b80 2023-08-22T00:21:19.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0c559a700 1 -- 172.21.15.98:0/3835326431 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800e850 con 0x7fd0b4004b80 2023-08-22T00:21:19.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3835326431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0b4004b80 msgr2=0x7fd0b4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3835326431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0b4004b80 0x7fd0b4005000 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fd0c80c1d20 tx=0x7fd0b8009060).stop 2023-08-22T00:21:19.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3835326431 reap_dead start 2023-08-22T00:21:19.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3835326431 shutdown_connections 2023-08-22T00:21:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3835326431 >> 172.21.15.98:0/3835326431 conn(0x7fd0c806a910 msgr2=0x7fd0c8065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3835326431 shutdown_connections 2023-08-22T00:21:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.061+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3835326431 wait complete. 2023-08-22T00:21:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.062+0000 7fd0ccf86700 1 Processor -- start 2023-08-22T00:21:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.062+0000 7fd0ccf86700 1 -- start start 2023-08-22T00:21:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4004b80 0x7fd0c80bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80bf320 0x7fd0c80c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8136bd0 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ab560 con 0x7fd0b4004b80 2023-08-22T00:21:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0ccf86700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ab840 con 0x7fd0c80bf320 2023-08-22T00:21:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37270/0 (socket says 172.21.15.98:37270) 2023-08-22T00:21:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3332074303 learned_addr learned my addr 172.21.15.98:0/3332074303 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c659c700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4004b80 0x7fd0c80bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c5d9b700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80bf320 0x7fd0c80c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80bf320 msgr2=0x7fd0c80c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80bf320 0x7fd0c80c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4004b80 msgr2=0x7fd0c80bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4004b80 0x7fd0c80bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.063+0000 7fd0c6d9d700 1 -- 172.21.15.98:0/3332074303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80abb20 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0c6d9d700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fd0b8001eb0 tx=0x7fd0b801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801d820 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b801d980 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801dd40 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c80abe00 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.064+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c80c1470 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.065+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c80ac320 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.065+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd0b8026650 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.065+0000 7fd0be7fc700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 0x7fd0a80613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.065+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd0b807af60 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.066+0000 7fd0c659c700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 0x7fd0a80613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.066+0000 7fd0c659c700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 0x7fd0a80613c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd0c0000f80 tx=0x7fd0c000c040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.070+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0c80ac320 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.230+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd0c80ac320 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.325+0000 7fd0be7fc700 1 -- 172.21.15.98:0/3332074303 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd0c80ac320 con 0x7fd0c80c0ff0 2023-08-22T00:21:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.328+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 msgr2=0x7fd0a80613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.328+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 0x7fd0a80613c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd0c0000f80 tx=0x7fd0c000c040).stop 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.328+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 msgr2=0x7fd0c8138d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.328+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fd0b8001eb0 tx=0x7fd0b801a000).stop 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 shutdown_connections 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c80c0ff0 0x7fd0c8138d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b4004b80 0x7fd0c80bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd0a805ef00 0x7fd0a80613c0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7fd0c0000f80 tx=0x7fd0c000c040).stop 2023-08-22T00:21:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 --2- 172.21.15.98:0/3332074303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0c80bf320 0x7fd0c80c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.329+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 >> 172.21.15.98:0/3332074303 conn(0x7fd0c806a910 msgr2=0x7fd0c80c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.330+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 shutdown_connections 2023-08-22T00:21:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.330+0000 7fd0ccf86700 1 -- 172.21.15.98:0/3332074303 wait complete. 2023-08-22T00:21:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:21:19.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:21:19.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.467+0000 7f89aacc9700 1 Processor -- start 2023-08-22T00:21:19.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.467+0000 7f89aacc9700 1 -- start start 2023-08-22T00:21:19.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89aacc9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89a4153dd0 0x7f89a40c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89aacc9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f89a4064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89aacc9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a4064a90 con 0x7f89a4064600 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89aacc9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a4158970 con 0x7f89a4153dd0 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89aacc9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40c28b0 con 0x7f89a40c3230 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a9266700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f89a4064600 0x7f89a4066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53694/0 (socket says 172.21.15.98:53694) 2023-08-22T00:21:19.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a9266700 1 -- 172.21.15.98:0/3368928778 learned_addr learned my addr 172.21.15.98:0/3368928778 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a3fff700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f89a4064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3368928778 >> v2:172.21.15.118:3300/0 conn(0x7f89a4153dd0 0x7f89a40c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287112410 0 0) 0x7f899c001490 con 0x7f89a4064600 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89940033f0 con 0x7f89a4064600 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125774265 0 0) 0x7f89940033f0 con 0x7f89a4064600 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 msgr2=0x7f89a4064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f89a4064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 >> v2:172.21.15.118:3300/0 conn(0x7f89a4153dd0 msgr2=0x7f89a40c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 --2- 172.21.15.98:0/3368928778 >> v2:172.21.15.118:3300/0 conn(0x7f89a4153dd0 0x7f89a40c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4158690 con 0x7f89a4064600 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f899c001980 con 0x7f89a4064600 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 >> v1:172.21.15.98:6789/0 conn(0x7f89a4064600 legacy=0x7f89a4066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f8994003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8994004690 0x7f8994004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f8994005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4158970 con 0x7f89940038e0 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40c28b0 con 0x7f8994004690 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899400b8e0 con 0x7f89a40c3230 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.468+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f8994003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a3fff700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8994004690 0x7f8994004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a9266700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f8994005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 -- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 msgr2=0x7f8994005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f8994005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 -- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8994004690 msgr2=0x7f8994004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8994004690 0x7f8994004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 -- 172.21.15.98:0/3368928778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940033f0 con 0x7f89940038e0 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a9266700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c3230 0x7f8994005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f8994003d00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f8998009a80 tx=0x7f8998009060).ready entity=mon.0 client_cookie=c730d8ad9302c776 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998009430 con 0x7f89940038e0 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800e640 con 0x7f89940038e0 2023-08-22T00:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a37fe700 1 -- 172.21.15.98:0/3368928778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800e9c0 con 0x7f89940038e0 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89aacc9700 1 -- 172.21.15.98:0/3368928778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 msgr2=0x7f8994003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3368928778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f8994003d00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f8998009a80 tx=0x7f8998009060).stop 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89a9266700 1 -- 172.21.15.98:0/3368928778 reap_dead start 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89aacc9700 1 -- 172.21.15.98:0/3368928778 shutdown_connections 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.469+0000 7f89aacc9700 1 -- 172.21.15.98:0/3368928778 >> 172.21.15.98:0/3368928778 conn(0x7f89a40c7820 msgr2=0x7f89a40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.470+0000 7f89aacc9700 1 -- 172.21.15.98:0/3368928778 shutdown_connections 2023-08-22T00:21:19.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.470+0000 7f89aacc9700 1 -- 172.21.15.98:0/3368928778 wait complete. 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.471+0000 7f89aacc9700 1 Processor -- start 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.471+0000 7f89aacc9700 1 -- start start 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40a8060 0x7f89a4156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40a9b50 0x7f89a40a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40a59f0 con 0x7f89940038e0 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4157060 con 0x7f89a40a9b50 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40a5be0 con 0x7f89a40a8060 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37284/0 (socket says 172.21.15.98:37284) 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 -- 172.21.15.98:0/3715980548 learned_addr learned my addr 172.21.15.98:0/3715980548 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a3fff700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40a8060 0x7f89a4156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a9266700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40a9b50 0x7f89a40a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 -- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40a8060 msgr2=0x7f89a4156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40a8060 0x7f89a4156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 -- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40a9b50 msgr2=0x7f89a40a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40a9b50 0x7f89a40a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 -- 172.21.15.98:0/3715980548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40a5ec0 con 0x7f89940038e0 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a8a65700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f89980030b0 tx=0x7f899801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800ed30 con 0x7f89940038e0 2023-08-22T00:21:19.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800eeb0 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4154330 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998026440 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.472+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a40a9fd0 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.473+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a41547d0 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.474+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f899802f440 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.474+0000 7f89a0ff9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 0x7f89880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.474+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f899807bbb0 con 0x7f89940038e0 2023-08-22T00:21:19.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.474+0000 7f89a3fff700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 0x7f89880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:19.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.475+0000 7f89a3fff700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 0x7f89880613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f89a4168b10 tx=0x7f8990008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:19.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.478+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f899804cec0 con 0x7f89940038e0 2023-08-22T00:21:19.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:19.638+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f89a40aa1c0 con 0x7f89940038e0 2023-08-22T00:21:20.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.329+0000 7f89a0ff9700 1 -- 172.21.15.98:0/3715980548 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7f89980160d0 con 0x7f89940038e0 2023-08-22T00:21:20.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.336+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 msgr2=0x7f89880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.336+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 0x7f89880613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f89a4168b10 tx=0x7f8990008040).stop 2023-08-22T00:21:20.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.336+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 msgr2=0x7f89a40a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.336+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f89980030b0 tx=0x7f899801a000).stop 2023-08-22T00:21:20.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 shutdown_connections 2023-08-22T00:21:20.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40a9b50 0x7f89a40a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89940038e0 0x7f89a40a5500 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f898805ef30 0x7f89880613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 --2- 172.21.15.98:0/3715980548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40a8060 0x7f89a4156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.337+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 >> 172.21.15.98:0/3715980548 conn(0x7f89a40c7820 msgr2=0x7f89a40c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:20.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.340+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 shutdown_connections 2023-08-22T00:21:20.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.341+0000 7f89aacc9700 1 -- 172.21.15.98:0/3715980548 wait complete. 2023-08-22T00:21:20.355 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:21:20.367 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:21:20.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.488+0000 7f382e1a0700 1 Processor -- start 2023-08-22T00:21:20.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.488+0000 7f382e1a0700 1 -- start start 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.488+0000 7f382e1a0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38281505e0 0x7f3828062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.488+0000 7f382e1a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f382e1a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3828063f90 con 0x7f3828063380 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f382e1a0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38280656f0 con 0x7f38281505e0 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f382e1a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280637e0 con 0x7f38280c2620 2023-08-22T00:21:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38281505e0 0x7f3828062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38281505e0 0x7f3828062e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53188/0 (socket says 172.21.15.98:53188) 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 -- 172.21.15.98:0/755523104 learned_addr learned my addr 172.21.15.98:0/755523104 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f3827fff700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 -- 172.21.15.98:0/755523104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 msgr2=0x7f3828065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 -- 172.21.15.98:0/755523104 >> v1:172.21.15.118:6789/0 conn(0x7f3828063380 legacy=0x7f38280c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 -- 172.21.15.98:0/755523104 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38281509c0 con 0x7f38281505e0 2023-08-22T00:21:20.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38277fe700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828062e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f3818006fd0 tx=0x7f38180090f0).ready entity=mon.0 client_cookie=4117c10378a39d3b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38267fc700 1 -- 172.21.15.98:0/755523104 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800b600 con 0x7f38281505e0 2023-08-22T00:21:20.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38267fc700 1 -- 172.21.15.98:0/755523104 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800b760 con 0x7f38281505e0 2023-08-22T00:21:20.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.489+0000 7f38267fc700 1 -- 172.21.15.98:0/755523104 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800bae0 con 0x7f38281505e0 2023-08-22T00:21:20.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 -- 172.21.15.98:0/755523104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 msgr2=0x7f3828062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828062e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f3818006fd0 tx=0x7f38180090f0).stop 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 -- 172.21.15.98:0/755523104 shutdown_connections 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 --2- 172.21.15.98:0/755523104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828062e90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 -- 172.21.15.98:0/755523104 >> 172.21.15.98:0/755523104 conn(0x7f38280c31d0 msgr2=0x7f38280c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 -- 172.21.15.98:0/755523104 shutdown_connections 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.490+0000 7f382e1a0700 1 -- 172.21.15.98:0/755523104 wait complete. 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.491+0000 7f382e1a0700 1 Processor -- start 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.491+0000 7f382e1a0700 1 -- start start 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3828063380 0x7f3828165ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3828148530 con 0x7f38281505e0 2023-08-22T00:21:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3828165450 con 0x7f3828063380 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f382e1a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3828165b60 con 0x7f38280c2620 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53196/0 (socket says 172.21.15.98:53196) 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 -- 172.21.15.98:0/4107064536 learned_addr learned my addr 172.21.15.98:0/4107064536 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f38277fe700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3828063380 0x7f3828165ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3826ffd700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 -- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 msgr2=0x7f3828164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 -- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3828063380 msgr2=0x7f3828165ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3828063380 0x7f3828165ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 -- 172.21.15.98:0/4107064536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009370 con 0x7f38281505e0 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.492+0000 7f3827fff700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f3820007f20 tx=0x7f3820009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.493+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000eb90 con 0x7f38281505e0 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.493+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382000ecf0 con 0x7f38281505e0 2023-08-22T00:21:20.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.493+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3828164e90 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.493+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820014630 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.493+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38281657f0 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.494+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828165d10 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.494+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f382001d3b0 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.494+0000 7f380f7fe700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 0x7f38140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.494+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f382007a2b0 con 0x7f38281505e0 2023-08-22T00:21:20.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.494+0000 7f38277fe700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 0x7f38140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.495+0000 7f38277fe700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 0x7f38140613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3818009130 tx=0x7f3818017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.499+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3828165d10 con 0x7f38281505e0 2023-08-22T00:21:20.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:21:20.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:21:20.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.705+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3828165cd0 con 0x7f38281505e0 2023-08-22T00:21:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.711+0000 7f380f7fe700 1 -- 172.21.15.98:0/4107064536 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v27) v1 ==== 174+0+0 (secure 0 0 0) 0x7f382004ec40 con 0x7f38281505e0 2023-08-22T00:21:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.716+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 msgr2=0x7f38140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.716+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 0x7f38140613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3818009130 tx=0x7f3818017000).stop 2023-08-22T00:21:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.716+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 msgr2=0x7f3828140f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.716+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f3820007f20 tx=0x7f3820009860).stop 2023-08-22T00:21:20.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 shutdown_connections 2023-08-22T00:21:20.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38281505e0 0x7f3828140f20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3828063380 0x7f3828165ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f381405ef30 0x7f38140613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 --2- 172.21.15.98:0/4107064536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38280c2620 0x7f3828164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.719+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 >> 172.21.15.98:0/4107064536 conn(0x7f38280c31d0 msgr2=0x7f3828066420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:20.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.720+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 shutdown_connections 2023-08-22T00:21:20.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.721+0000 7f382e1a0700 1 -- 172.21.15.98:0/4107064536 wait complete. 2023-08-22T00:21:20.726 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 10 and data pool 11 2023-08-22T00:21:20.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:20.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 Processor -- start 2023-08-22T00:21:20.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 -- start start 2023-08-22T00:21:20.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 0x7f46400c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f46400bd870 0x7f46400a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46400bd3e0 con 0x7f4640065f10 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46400bd0c0 con 0x7f46400bd870 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.858+0000 7f4646f8d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46400c3bb0 con 0x7f4640150e40 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f46400bd870 0x7f46400a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f464552a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4640065f10 0x7f4640066340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39742/0 (socket says 172.21.15.98:39742) 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f464552a700 1 -- 172.21.15.98:0/3071855297 learned_addr learned my addr 172.21.15.98:0/3071855297 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:20.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f4644d29700 1 --2- 172.21.15.98:0/3071855297 >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 0x7f46400c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 -- 172.21.15.98:0/3071855297 >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 msgr2=0x7f46400c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 --2- 172.21.15.98:0/3071855297 >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 0x7f46400c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 -- 172.21.15.98:0/3071855297 >> v1:172.21.15.98:6789/0 conn(0x7f4640065f10 legacy=0x7f4640066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 -- 172.21.15.98:0/3071855297 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400c3e90 con 0x7f46400bd870 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463f7fe700 1 -- 172.21.15.98:0/3071855297 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225322003 0 0) 0x7f46400bd3e0 con 0x7f4640065f10 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f4644d29700 1 --2- 172.21.15.98:0/3071855297 >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 0x7f46400c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:20.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463ffff700 1 --2- 172.21.15.98:0/3071855297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a6950 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f46400c52a0 tx=0x7f462c009060).ready entity=mon.0 client_cookie=e2784ef78733347b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463f7fe700 1 -- 172.21.15.98:0/3071855297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0090d0 con 0x7f46400bd870 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463f7fe700 1 -- 172.21.15.98:0/3071855297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00b580 con 0x7f46400bd870 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.859+0000 7f463f7fe700 1 -- 172.21.15.98:0/3071855297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00b900 con 0x7f46400bd870 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 -- 172.21.15.98:0/3071855297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 msgr2=0x7f46400a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 --2- 172.21.15.98:0/3071855297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a6950 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f46400c52a0 tx=0x7f462c009060).stop 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 -- 172.21.15.98:0/3071855297 shutdown_connections 2023-08-22T00:21:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 --2- 172.21.15.98:0/3071855297 >> v2:172.21.15.118:3300/0 conn(0x7f4640150e40 0x7f46400c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 --2- 172.21.15.98:0/3071855297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a6950 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 -- 172.21.15.98:0/3071855297 >> 172.21.15.98:0/3071855297 conn(0x7f464006a980 msgr2=0x7f46400c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:20.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 -- 172.21.15.98:0/3071855297 shutdown_connections 2023-08-22T00:21:20.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.860+0000 7f4646f8d700 1 -- 172.21.15.98:0/3071855297 wait complete. 2023-08-22T00:21:20.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.861+0000 7f4646f8d700 1 Processor -- start 2023-08-22T00:21:20.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.861+0000 7f4646f8d700 1 -- start start 2023-08-22T00:21:20.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 0x7f46401648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4640150e40 0x7f4640064b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46400a6420 con 0x7f46400bd870 2023-08-22T00:21:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640164de0 con 0x7f4640150e40 2023-08-22T00:21:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46400a5810 con 0x7f4640065f10 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53214/0 (socket says 172.21.15.98:53214) 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 -- 172.21.15.98:0/2489767893 learned_addr learned my addr 172.21.15.98:0/2489767893 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f464552a700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4640150e40 0x7f4640064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4644d29700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 0x7f46401648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 -- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 msgr2=0x7f46401648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 0x7f46401648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 -- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4640150e40 msgr2=0x7f4640064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4640150e40 0x7f4640064b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 -- 172.21.15.98:0/2489767893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0092a0 con 0x7f46400bd870 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4644d29700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 0x7f46401648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463ffff700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f46400c8800 tx=0x7f462c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00b900 con 0x7f46400bd870 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c006910 con 0x7f46400bd870 2023-08-22T00:21:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46400a5af0 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.862+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00bed0 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.863+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46400a60b0 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.864+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4640047480 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.864+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f462c01b620 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.864+0000 7f463cff9700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 0x7f46240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.864+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f462c07bbd0 con 0x7f46400bd870 2023-08-22T00:21:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.864+0000 7f4644d29700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 0x7f46240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:20.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.865+0000 7f4644d29700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 0x7f46240613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f4634008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:20.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:20.868+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f462c050790 con 0x7f46400bd870 2023-08-22T00:21:21.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.031+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46400c3810 con 0x7f46400bd870 2023-08-22T00:21:21.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.032+0000 7f463cff9700 1 -- 172.21.15.98:0/2489767893 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+17276 (secure 0 0 0) 0x7f462c029020 con 0x7f46400bd870 2023-08-22T00:21:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:21.033 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":89,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:20.707024+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:21.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 msgr2=0x7f46240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 0x7f46240613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f4634008040).stop 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 msgr2=0x7f46400a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f46400c8800 tx=0x7f462c017000).stop 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 shutdown_connections 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f462405ef30 0x7f46240613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4640065f10 0x7f46401648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4640150e40 0x7f4640064b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 --2- 172.21.15.98:0/2489767893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46400bd870 0x7f46400a68b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 >> 172.21.15.98:0/2489767893 conn(0x7f464006a980 msgr2=0x7f46400c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:21.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 shutdown_connections 2023-08-22T00:21:21.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.033+0000 7f4646f8d700 1 -- 172.21.15.98:0/2489767893 wait complete. 2023-08-22T00:21:21.047 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:21.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.162+0000 7fdf63b6b700 1 Processor -- start 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.162+0000 7fdf63b6b700 1 -- start start 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 0x7fdf5c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 0x7fdf5c154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c155260 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0bf9e0 con 0x7fdf5c1544f0 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf63b6b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0bfcc0 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53224/0 (socket says 172.21.15.98:53224) 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 -- 172.21.15.98:0/1724350493 learned_addr learned my addr 172.21.15.98:0/1724350493 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf62108700 1 --2- 172.21.15.98:0/1724350493 >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 0x7fdf5c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 -- 172.21.15.98:0/1724350493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 msgr2=0x7fdf5c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61907700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 0x7fdf5c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 0x7fdf5c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 -- 172.21.15.98:0/1724350493 >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 msgr2=0x7fdf5c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:21.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 --2- 172.21.15.98:0/1724350493 >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 0x7fdf5c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 -- 172.21.15.98:0/1724350493 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0bffa0 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf62108700 1 --2- 172.21.15.98:0/1724350493 >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 0x7fdf5c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:21.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61907700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 0x7fdf5c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:21.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf61106700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fdf5c0c6bd0 tx=0x7fdf580090f0).ready entity=mon.0 client_cookie=29ac60abc14c621e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf60905700 1 -- 172.21.15.98:0/1724350493 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800b600 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf60905700 1 -- 172.21.15.98:0/1724350493 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800b760 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.163+0000 7fdf60905700 1 -- 172.21.15.98:0/1724350493 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800bae0 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 -- 172.21.15.98:0/1724350493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c0c5a90 msgr2=0x7fdf5c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fdf5c0c6bd0 tx=0x7fdf580090f0).stop 2023-08-22T00:21:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 -- 172.21.15.98:0/1724350493 shutdown_connections 2023-08-22T00:21:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c14e0d0 0x7fdf5c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/1724350493 >> v2:172.21.15.118:3300/0 conn(0x7fdf5c1544f0 0x7fdf5c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/1724350493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c0c5a90 0x7fdf5c0c5f10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 -- 172.21.15.98:0/1724350493 >> 172.21.15.98:0/1724350493 conn(0x7fdf5c0caa80 msgr2=0x7fdf5c0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:21.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 -- 172.21.15.98:0/1724350493 shutdown_connections 2023-08-22T00:21:21.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.164+0000 7fdf63b6b700 1 -- 172.21.15.98:0/1724350493 wait complete. 2023-08-22T00:21:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.165+0000 7fdf63b6b700 1 Processor -- start 2023-08-22T00:21:21.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.165+0000 7fdf63b6b700 1 -- start start 2023-08-22T00:21:21.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c0c5a90 0x7fdf5c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 0x7fdf5c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c165200 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c1645e0 con 0x7fdf5c1544f0 2023-08-22T00:21:21.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf63b6b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0c37e0 con 0x7fdf5c0c5a90 2023-08-22T00:21:21.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.166+0000 7fdf61106700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53228/0 (socket says 172.21.15.98:53228) 2023-08-22T00:21:21.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 -- 172.21.15.98:0/3490696935 learned_addr learned my addr 172.21.15.98:0/3490696935 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 -- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c0c5a90 msgr2=0x7fdf5c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf62108700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 0x7fdf5c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61907700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c0c5a90 0x7fdf5c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c0c5a90 0x7fdf5c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 -- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 msgr2=0x7fdf5c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 0x7fdf5c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 -- 172.21.15.98:0/3490696935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58009370 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf62108700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 0x7fdf5c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf61106700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fdf58009130 tx=0x7fdf58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800bae0 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf58000c90 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5801c670 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c0c3220 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.167+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c164e90 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.168+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c165370 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.169+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdf5801ca20 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.169+0000 7fdf51ffb700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 0x7fdf400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.169+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdf5807ba10 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.169+0000 7fdf61907700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 0x7fdf400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.169+0000 7fdf61907700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 0x7fdf400613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdf4c0088c0 tx=0x7fdf4c008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.173+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf580505d0 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.336+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf5c047480 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.337+0000 7fdf51ffb700 1 -- 172.21.15.98:0/3490696935 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+17276 (secure 0 0 0) 0x7fdf58020020 con 0x7fdf5c14e0d0 2023-08-22T00:21:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:21.338 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":89,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:20.707024+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:21.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 msgr2=0x7fdf400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 0x7fdf400613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdf4c0088c0 tx=0x7fdf4c008040).stop 2023-08-22T00:21:21.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 msgr2=0x7fdf5c163c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fdf58009130 tx=0x7fdf58017000).stop 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 shutdown_connections 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdf4005ef30 0x7fdf400613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf5c0c5a90 0x7fdf5c0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf5c1544f0 0x7fdf5c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 --2- 172.21.15.98:0/3490696935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c14e0d0 0x7fdf5c163c00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 >> 172.21.15.98:0/3490696935 conn(0x7fdf5c0caa80 msgr2=0x7fdf5c1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:21.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 shutdown_connections 2023-08-22T00:21:21.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.339+0000 7fdf63b6b700 1 -- 172.21.15.98:0/3490696935 wait complete. 2023-08-22T00:21:21.352 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:21:21.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.470+0000 7f9fed8c8700 1 Processor -- start 2023-08-22T00:21:21.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.471+0000 7f9fed8c8700 1 -- start start 2023-08-22T00:21:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.471+0000 7f9fed8c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9fe8153dd0 0x7f9fe80c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.471+0000 7f9fed8c8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe8158970 con 0x7f9fe8064820 2023-08-22T00:21:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.471+0000 7f9fed8c8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80c28b0 con 0x7f9fe80c3230 2023-08-22T00:21:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.471+0000 7f9fed8c8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe8158690 con 0x7f9fe8153dd0 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9fe8064820 0x7f9fe8066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39746/0 (socket says 172.21.15.98:39746) 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe77fe700 1 -- 172.21.15.98:0/859367996 learned_addr learned my addr 172.21.15.98:0/859367996 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32975410 0 0) 0x7f9fe8158970 con 0x7f9fe8064820 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd00033f0 con 0x7f9fe8064820 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/859367996 >> v2:172.21.15.118:3300/0 conn(0x7f9fe8153dd0 0x7f9fe80c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128384877 0 0) 0x7f9fd00033f0 con 0x7f9fe8064820 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 >> v2:172.21.15.118:3300/0 conn(0x7f9fe8153dd0 msgr2=0x7f9fe80c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 --2- 172.21.15.98:0/859367996 >> v2:172.21.15.118:3300/0 conn(0x7f9fe8153dd0 0x7f9fe80c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 >> v1:172.21.15.118:6789/0 conn(0x7f9fe80c3230 legacy=0x7f9fe8064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80c2260 con 0x7f9fe8064820 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9fe00017f0 con 0x7f9fe8064820 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 >> v1:172.21.15.98:6789/0 conn(0x7f9fe8064820 legacy=0x7f9fe8066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 0x7f9fd0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fd0004690 0x7f9fd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0005000 0x7f9fd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8158690 con 0x7f9fd00038e0 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd000bf60 con 0x7f9fd0005000 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd000c0f0 con 0x7f9fd0004690 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 0x7f9fd0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe67fc700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fd0004690 0x7f9fd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe77fe700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0005000 0x7f9fd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe6ffd700 1 -- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fd0004690 msgr2=0x7f9fd0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.472+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fd0004690 0x7f9fd0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe6ffd700 1 -- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0005000 msgr2=0x7f9fd000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0005000 0x7f9fd000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe6ffd700 1 -- 172.21.15.98:0/859367996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd00033f0 con 0x7f9fd00038e0 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe77fe700 1 -- 172.21.15.98:0/859367996 reap_dead start 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 0x7f9fd0003d00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f9fdc009a80 tx=0x7f9fdc009060).ready entity=mon.0 client_cookie=2de4b6094d46ffd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc009430 con 0x7f9fd00038e0 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00e640 con 0x7f9fd00038e0 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fe5ffb700 1 -- 172.21.15.98:0/859367996 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00e9c0 con 0x7f9fd00038e0 2023-08-22T00:21:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 -- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 msgr2=0x7f9fd0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 0x7f9fd0003d00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f9fdc009a80 tx=0x7f9fdc009060).stop 2023-08-22T00:21:21.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 -- 172.21.15.98:0/859367996 shutdown_connections 2023-08-22T00:21:21.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/859367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fd00038e0 0x7f9fd0003d00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 -- 172.21.15.98:0/859367996 >> 172.21.15.98:0/859367996 conn(0x7f9fe80c7820 msgr2=0x7f9fe80c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:21.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 -- 172.21.15.98:0/859367996 shutdown_connections 2023-08-22T00:21:21.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.473+0000 7f9fed8c8700 1 -- 172.21.15.98:0/859367996 wait complete. 2023-08-22T00:21:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 Processor -- start 2023-08-22T00:21:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 -- start start 2023-08-22T00:21:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd00038e0 0x7f9fe814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fe8156de0 0x7f9fe80c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80bf900 con 0x7f9fe8155b60 2023-08-22T00:21:21.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80bfb80 con 0x7f9fd00038e0 2023-08-22T00:21:21.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fed8c8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80bfe40 con 0x7f9fe8156de0 2023-08-22T00:21:21.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.475+0000 7f9fe77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53240/0 (socket says 172.21.15.98:53240) 2023-08-22T00:21:21.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 -- 172.21.15.98:0/2651850388 learned_addr learned my addr 172.21.15.98:0/2651850388 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:21.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe67fc700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fe8156de0 0x7f9fe80c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd00038e0 0x7f9fe814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 -- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fe8156de0 msgr2=0x7f9fe80c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fe8156de0 0x7f9fe80c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 -- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd00038e0 msgr2=0x7f9fe814d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:21.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd00038e0 0x7f9fe814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:21.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 -- 172.21.15.98:0/2651850388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80c0120 con 0x7f9fe8155b60 2023-08-22T00:21:21.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fe77fe700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f9fe8066e90 tx=0x7f9fe00017b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00079e0 con 0x7f9fe8155b60 2023-08-22T00:21:21.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000e830 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80c0400 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000ebf0 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.476+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe814d900 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.477+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80c3d60 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.477+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9fe0014430 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.478+0000 7f9fceffd700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 0x7f9fd40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.478+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9fe0079f00 con 0x7f9fe8155b60 2023-08-22T00:21:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.478+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 0x7f9fd40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:21.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.478+0000 7f9fe6ffd700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 0x7f9fd40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9fdc006d50 tx=0x7f9fdc01a000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:21.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.482+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fe00498f0 con 0x7f9fe8155b60 2023-08-22T00:21:21.634 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:21:21.633+0000 7f249c437700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:21:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:21.685+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9fe80c50f0 con 0x7f9fe8155b60 2023-08-22T00:21:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.335+0000 7f9fceffd700 1 -- 172.21.15.98:0/2651850388 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9fe004ea60 con 0x7f9fe8155b60 2023-08-22T00:21:22.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 msgr2=0x7f9fd40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 0x7f9fd40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9fdc006d50 tx=0x7f9fdc01a000).stop 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 msgr2=0x7f9fe80ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f9fe8066e90 tx=0x7f9fe00017b0).stop 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 shutdown_connections 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fe8155b60 0x7f9fe80ac7e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd00038e0 0x7f9fe814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fd405ef30 0x7f9fd40613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 --2- 172.21.15.98:0/2651850388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fe8156de0 0x7f9fe80c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 >> 172.21.15.98:0/2651850388 conn(0x7f9fe80c7820 msgr2=0x7f9fe80c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:22.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 shutdown_connections 2023-08-22T00:21:22.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.338+0000 7f9fed8c8700 1 -- 172.21.15.98:0/2651850388 wait complete. 2023-08-22T00:21:22.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:21:22.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.477+0000 7fdea01f6700 1 Processor -- start 2023-08-22T00:21:22.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.477+0000 7fdea01f6700 1 -- start start 2023-08-22T00:21:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fdea01f6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 0x7fde980c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fdea01f6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fde980c7370 0x7fde980c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fdea01f6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde98151e80 con 0x7fde9814b250 2023-08-22T00:21:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fdea01f6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde98066b90 con 0x7fde980c7370 2023-08-22T00:21:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fdea01f6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde98065560 con 0x7fde9814ae70 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fde9d791700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fde980c7370 0x7fde980c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fde9e793700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fde9814b250 0x7fde980c39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39760/0 (socket says 172.21.15.98:39760) 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fde9e793700 1 -- 172.21.15.98:0/2886251903 learned_addr learned my addr 172.21.15.98:0/2886251903 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.478+0000 7fde9df92700 1 --2- 172.21.15.98:0/2886251903 >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 0x7fde980c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9d791700 1 -- 172.21.15.98:0/2886251903 >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 msgr2=0x7fde980c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9d791700 1 --2- 172.21.15.98:0/2886251903 >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 0x7fde980c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9d791700 1 -- 172.21.15.98:0/2886251903 >> v1:172.21.15.98:6789/0 conn(0x7fde9814b250 legacy=0x7fde980c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9d791700 1 -- 172.21.15.98:0/2886251903 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98150fb0 con 0x7fde980c7370 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9cf90700 1 -- 172.21.15.98:0/2886251903 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823161707 0 0) 0x7fde98151e80 con 0x7fde9814b250 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9df92700 1 --2- 172.21.15.98:0/2886251903 >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 0x7fde980c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9d791700 1 --2- 172.21.15.98:0/2886251903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980c3500 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fde980c5310 tx=0x7fde94009060).ready entity=mon.0 client_cookie=2b456d4388fbcfb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9cf90700 1 -- 172.21.15.98:0/2886251903 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400b580 con 0x7fde980c7370 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9cf90700 1 -- 172.21.15.98:0/2886251903 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9400b6e0 con 0x7fde980c7370 2023-08-22T00:21:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fde9cf90700 1 -- 172.21.15.98:0/2886251903 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400ba60 con 0x7fde980c7370 2023-08-22T00:21:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 -- 172.21.15.98:0/2886251903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 msgr2=0x7fde980c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 --2- 172.21.15.98:0/2886251903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980c3500 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fde980c5310 tx=0x7fde94009060).stop 2023-08-22T00:21:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 -- 172.21.15.98:0/2886251903 shutdown_connections 2023-08-22T00:21:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 --2- 172.21.15.98:0/2886251903 >> v2:172.21.15.118:3300/0 conn(0x7fde9814ae70 0x7fde980c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 --2- 172.21.15.98:0/2886251903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980c3500 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 -- 172.21.15.98:0/2886251903 >> 172.21.15.98:0/2886251903 conn(0x7fde980c7800 msgr2=0x7fde980c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 -- 172.21.15.98:0/2886251903 shutdown_connections 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.479+0000 7fdea01f6700 1 -- 172.21.15.98:0/2886251903 wait complete. 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.480+0000 7fdea01f6700 1 Processor -- start 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.480+0000 7fdea01f6700 1 -- start start 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 0x7fde9813ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 0x7fde98063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980aa280 con 0x7fde980c7370 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980a9670 con 0x7fde9814ae70 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fdea01f6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980a9950 con 0x7fde9814b250 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fde9df92700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fde9df92700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53254/0 (socket says 172.21.15.98:53254) 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fde9df92700 1 -- 172.21.15.98:0/3663300575 learned_addr learned my addr 172.21.15.98:0/3663300575 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fde9d791700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 0x7fde9813ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.481+0000 7fde9e793700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 0x7fde98063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 -- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 msgr2=0x7fde98063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 0x7fde98063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 -- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 msgr2=0x7fde9813ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 0x7fde9813ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 -- 172.21.15.98:0/3663300575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940092a0 con 0x7fde980c7370 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9e793700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 0x7fde98063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9d791700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 0x7fde9813ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:22.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde9df92700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fde8800c880 tx=0x7fde88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:22.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88010580 con 0x7fde980c7370 2023-08-22T00:21:22.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880106e0 con 0x7fde980c7370 2023-08-22T00:21:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88010a60 con 0x7fde980c7370 2023-08-22T00:21:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980a9c30 con 0x7fde980c7370 2023-08-22T00:21:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.482+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde980a9220 con 0x7fde980c7370 2023-08-22T00:21:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.483+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde980aad20 con 0x7fde980c7370 2023-08-22T00:21:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.483+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fde8801b460 con 0x7fde980c7370 2023-08-22T00:21:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.484+0000 7fde8dffb700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 0x7fde7c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.484+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fde8807a100 con 0x7fde980c7370 2023-08-22T00:21:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.484+0000 7fde9d791700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 0x7fde7c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.484+0000 7fde9d791700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 0x7fde7c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fde94009fd0 tx=0x7fde94017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.488+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde8804b230 con 0x7fde980c7370 2023-08-22T00:21:22.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:22.690+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde980a9410 con 0x7fde980c7370 2023-08-22T00:21:23.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-08-22T00:21:23.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-08-22T00:21:23.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-08-22T00:21:23.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.340+0000 7fde8dffb700 1 -- 172.21.15.98:0/3663300575 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde8804e850 con 0x7fde980c7370 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 msgr2=0x7fde7c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 0x7fde7c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fde94009fd0 tx=0x7fde94017000).stop 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 msgr2=0x7fde980a8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fde8800c880 tx=0x7fde88008040).stop 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 shutdown_connections 2023-08-22T00:21:23.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde7c05ef30 0x7fde7c0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde9814b250 0x7fde98063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde980c7370 0x7fde980a8d30 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 --2- 172.21.15.98:0/3663300575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde9814ae70 0x7fde9813ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 >> 172.21.15.98:0/3663300575 conn(0x7fde980c7800 msgr2=0x7fde980be140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 shutdown_connections 2023-08-22T00:21:23.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.343+0000 7fdea01f6700 1 -- 172.21.15.98:0/3663300575 wait complete. 2023-08-22T00:21:23.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:23.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.479+0000 7f10232e6700 1 Processor -- start 2023-08-22T00:21:23.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.479+0000 7f10232e6700 1 -- start start 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f10232e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f101c150040 0x7f101c150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f10232e6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f101c153f10 0x7f101c0c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f10232e6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c0c2220 con 0x7f101c0c59b0 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f10232e6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c0c1ef0 con 0x7f101c153f10 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f10232e6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c0c5e30 con 0x7f101c150040 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f101c153f10 0x7f101c0c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1021883700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f101c0c59b0 0x7f101c0c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39768/0 (socket says 172.21.15.98:39768) 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1021883700 1 -- 172.21.15.98:0/1839493561 learned_addr learned my addr 172.21.15.98:0/1839493561 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1021082700 1 --2- 172.21.15.98:0/1839493561 >> v2:172.21.15.118:3300/0 conn(0x7f101c150040 0x7f101c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 -- 172.21.15.98:0/1839493561 >> v2:172.21.15.118:3300/0 conn(0x7f101c150040 msgr2=0x7f101c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 --2- 172.21.15.98:0/1839493561 >> v2:172.21.15.118:3300/0 conn(0x7f101c150040 0x7f101c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 -- 172.21.15.98:0/1839493561 >> v1:172.21.15.98:6789/0 conn(0x7f101c0c59b0 legacy=0x7f101c0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 -- 172.21.15.98:0/1839493561 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0c6110 con 0x7f101c153f10 2023-08-22T00:21:23.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1013fff700 1 -- 172.21.15.98:0/1839493561 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361272756 0 0) 0x7f101c0c2220 con 0x7f101c0c59b0 2023-08-22T00:21:23.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1020881700 1 --2- 172.21.15.98:0/1839493561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c153f10 0x7f101c0c54c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f101c067f40 tx=0x7f100c00a200).ready entity=mon.0 client_cookie=142f57db0fa4cca9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.480+0000 7f1013fff700 1 -- 172.21.15.98:0/1839493561 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00ae70 con 0x7f101c153f10 2023-08-22T00:21:23.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f1013fff700 1 -- 172.21.15.98:0/1839493561 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00c970 con 0x7f101c153f10 2023-08-22T00:21:23.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f1013fff700 1 -- 172.21.15.98:0/1839493561 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00ccf0 con 0x7f101c153f10 2023-08-22T00:21:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 -- 172.21.15.98:0/1839493561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c153f10 msgr2=0x7f101c0c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 --2- 172.21.15.98:0/1839493561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c153f10 0x7f101c0c54c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f101c067f40 tx=0x7f100c00a200).stop 2023-08-22T00:21:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 -- 172.21.15.98:0/1839493561 shutdown_connections 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 --2- 172.21.15.98:0/1839493561 >> v2:172.21.15.118:3300/0 conn(0x7f101c150040 0x7f101c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 --2- 172.21.15.98:0/1839493561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c153f10 0x7f101c0c54c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 -- 172.21.15.98:0/1839493561 >> 172.21.15.98:0/1839493561 conn(0x7f101c0c7140 msgr2=0x7f101c0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 -- 172.21.15.98:0/1839493561 shutdown_connections 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.481+0000 7f10232e6700 1 -- 172.21.15.98:0/1839493561 wait complete. 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.482+0000 7f10232e6700 1 Processor -- start 2023-08-22T00:21:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.482+0000 7f10232e6700 1 -- start start 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f101c150040 0x7f101c0be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f101c153f10 0x7f101c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c148380 con 0x7f101c0c59b0 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c14d260 con 0x7f101c150040 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f10232e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c14d540 con 0x7f101c153f10 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f1021082700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f1021082700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53278/0 (socket says 172.21.15.98:53278) 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f1021082700 1 -- 172.21.15.98:0/3271552759 learned_addr learned my addr 172.21.15.98:0/3271552759 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f1020881700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f101c150040 0x7f101c0be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.483+0000 7f1021883700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f101c153f10 0x7f101c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 -- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f101c153f10 msgr2=0x7f101c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f101c153f10 0x7f101c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 -- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f101c150040 msgr2=0x7f101c0be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f101c150040 0x7f101c0be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 -- 172.21.15.98:0/3271552759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c00a440 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f1021082700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f101800d890 tx=0x7f1018008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180125f0 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018012750 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c14d820 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012ad0 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.484+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0bed20 con 0x7f101c0c59b0 2023-08-22T00:21:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.485+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c047480 con 0x7f101c0c59b0 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.485+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1018013480 con 0x7f101c0c59b0 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.486+0000 7f10117fa700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 0x7f10000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.486+0000 7f1020881700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 0x7f10000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.486+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1018079e10 con 0x7f101c0c59b0 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.486+0000 7f1020881700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 0x7f10000613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f101c069ed0 tx=0x7f100c00a200).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.490+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f101804af40 con 0x7f101c0c59b0 2023-08-22T00:21:23.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.690+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f101c0c63f0 con 0x7f101c0c59b0 2023-08-22T00:21:23.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.691+0000 7f10117fa700 1 -- 172.21.15.98:0/3271552759 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f101804e560 con 0x7f101c0c59b0 2023-08-22T00:21:23.692 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:23.692 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 msgr2=0x7f10000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 0x7f10000613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f101c069ed0 tx=0x7f100c00a200).stop 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 msgr2=0x7f101c147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f101800d890 tx=0x7f1018008040).stop 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 shutdown_connections 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f100005ef30 0x7f10000613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f101c153f10 0x7f101c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f101c0c59b0 0x7f101c147790 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 --2- 172.21.15.98:0/3271552759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f101c150040 0x7f101c0be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.692+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 >> 172.21.15.98:0/3271552759 conn(0x7f101c0c7140 msgr2=0x7f101c0bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.693+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 shutdown_connections 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.693+0000 7f10232e6700 1 -- 172.21.15.98:0/3271552759 wait complete. 2023-08-22T00:21:23.696 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:23.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:23.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.821+0000 7f77d09ca700 1 Processor -- start 2023-08-22T00:21:23.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.821+0000 7f77d09ca700 1 -- start start 2023-08-22T00:21:23.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77d09ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc14e0d0 0x7f77cc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77d09ca700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f77cc0c5a90 0x7f77cc0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77d09ca700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc155260 con 0x7f77cc1544f0 2023-08-22T00:21:23.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77d09ca700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc0c17b0 con 0x7f77cc0c5a90 2023-08-22T00:21:23.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77d09ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0bf9e0 con 0x7f77cc14e0d0 2023-08-22T00:21:23.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77cad9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f77cc1544f0 0x7f77cc154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39784/0 (socket says 172.21.15.98:39784) 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.822+0000 7f77c9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f77cc0c5a90 0x7f77cc0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77cad9d700 1 -- 172.21.15.98:0/2068519150 learned_addr learned my addr 172.21.15.98:0/2068519150 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77ca59c700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc14e0d0 0x7f77cc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c9d9b700 1 -- 172.21.15.98:0/2068519150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc14e0d0 msgr2=0x7f77cc14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c9d9b700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc14e0d0 0x7f77cc14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c9d9b700 1 -- 172.21.15.98:0/2068519150 >> v1:172.21.15.98:6789/0 conn(0x7f77cc1544f0 legacy=0x7f77cc154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c9d9b700 1 -- 172.21.15.98:0/2068519150 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0bfcc0 con 0x7f77cc0c5a90 2023-08-22T00:21:23.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c959a700 1 -- 172.21.15.98:0/2068519150 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801749769 0 0) 0x7f77cc155260 con 0x7f77cc1544f0 2023-08-22T00:21:23.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c9d9b700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc0c5a90 0x7f77cc0c5f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f77c0009760 tx=0x7f77c0009060).ready entity=mon.0 client_cookie=72494d918be39e08 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c959a700 1 -- 172.21.15.98:0/2068519150 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000f510 con 0x7f77cc0c5a90 2023-08-22T00:21:23.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c959a700 1 -- 172.21.15.98:0/2068519150 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000f670 con 0x7f77cc0c5a90 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77c959a700 1 -- 172.21.15.98:0/2068519150 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000f9f0 con 0x7f77cc0c5a90 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77d09ca700 1 -- 172.21.15.98:0/2068519150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc0c5a90 msgr2=0x7f77cc0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.823+0000 7f77d09ca700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc0c5a90 0x7f77cc0c5f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f77c0009760 tx=0x7f77c0009060).stop 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 -- 172.21.15.98:0/2068519150 shutdown_connections 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc14e0d0 0x7f77cc14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 --2- 172.21.15.98:0/2068519150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc0c5a90 0x7f77cc0c5f10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 -- 172.21.15.98:0/2068519150 >> 172.21.15.98:0/2068519150 conn(0x7f77cc0caa80 msgr2=0x7f77cc0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 -- 172.21.15.98:0/2068519150 shutdown_connections 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.824+0000 7f77d09ca700 1 -- 172.21.15.98:0/2068519150 wait complete. 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.825+0000 7f77d09ca700 1 Processor -- start 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.825+0000 7f77d09ca700 1 -- start start 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.825+0000 7f77d09ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 0x7f77cc1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.825+0000 7f77d09ca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.825+0000 7f77d09ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77cc1544f0 0x7f77cc0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77d09ca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0b02c0 con 0x7f77cc14e0d0 2023-08-22T00:21:23.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77d09ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc14f810 con 0x7f77cc1544f0 2023-08-22T00:21:23.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77d09ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0c35d0 con 0x7f77cc0c5a90 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53292/0 (socket says 172.21.15.98:53292) 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 -- 172.21.15.98:0/3201227511 learned_addr learned my addr 172.21.15.98:0/3201227511 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77cad9d700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77cc1544f0 0x7f77cc0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77ca59c700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 0x7f77cc1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 -- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 msgr2=0x7f77cc1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 0x7f77cc1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 -- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77cc1544f0 msgr2=0x7f77cc0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77cc1544f0 0x7f77cc0afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 -- 172.21.15.98:0/3201227511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00092a0 con 0x7f77cc14e0d0 2023-08-22T00:21:23.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77ca59c700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 0x7f77cc1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:23.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77c9d9b700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f77c0009e00 tx=0x7f77c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000f7e0 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000f980 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc0c2a50 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c001b690 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.826+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc0c3010 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.827+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc047480 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.828+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f77c001ba40 con 0x7f77cc14e0d0 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.828+0000 7f77ba7fc700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 0x7f77ac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:23.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.828+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f77c007c320 con 0x7f77cc14e0d0 2023-08-22T00:21:23.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.828+0000 7f77ca59c700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 0x7f77ac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:23.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.829+0000 7f77ca59c700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 0x7f77ac0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f77bc009b60 tx=0x7f77bc008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:23.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.832+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77c004d470 con 0x7f77cc14e0d0 2023-08-22T00:21:23.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.993+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77cc064ef0 con 0x7f77cc14e0d0 2023-08-22T00:21:23.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.994+0000 7f77ba7fc700 1 -- 172.21.15.98:0/3201227511 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+17263 (secure 0 0 0) 0x7f77c0050a90 con 0x7f77cc14e0d0 2023-08-22T00:21:23.995 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:23.995 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":90,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:21.708883+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:23.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 msgr2=0x7f77ac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 0x7f77ac0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f77bc009b60 tx=0x7f77bc008040).stop 2023-08-22T00:21:23.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 msgr2=0x7f77cc0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:23.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f77c0009e00 tx=0x7f77c0017000).stop 2023-08-22T00:21:23.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 shutdown_connections 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77ac05ef30 0x7f77ac0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77cc0c5a90 0x7f77cc1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77cc1544f0 0x7f77cc0afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 --2- 172.21.15.98:0/3201227511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77cc14e0d0 0x7f77cc0af8e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 >> 172.21.15.98:0/3201227511 conn(0x7f77cc0caa80 msgr2=0x7f77cc154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 shutdown_connections 2023-08-22T00:21:23.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:23.995+0000 7f77d09ca700 1 -- 172.21.15.98:0/3201227511 wait complete. 2023-08-22T00:21:24.009 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:21:24.009 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.126+0000 7fb5af150700 1 Processor -- start 2023-08-22T00:21:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.126+0000 7fb5af150700 1 -- start start 2023-08-22T00:21:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5af150700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5a80a89a0 0x7fb5a80bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5af150700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb5a8155310 0x7fb5a8063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5af150700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a8063f60 con 0x7fb5a80c24d0 2023-08-22T00:21:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5af150700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a80bd3b0 con 0x7fb5a8155310 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5af150700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a8154830 con 0x7fb5a80a89a0 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb5a8155310 0x7fb5a8063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb5a8155310 0x7fb5a8063a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53294/0 (socket says 172.21.15.98:53294) 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2684450220 learned_addr learned my addr 172.21.15.98:0/2684450220 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5aceec700 1 --2- 172.21.15.98:0/2684450220 >> v2:172.21.15.118:3300/0 conn(0x7fb5a80a89a0 0x7fb5a80bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2684450220 >> v2:172.21.15.118:3300/0 conn(0x7fb5a80a89a0 msgr2=0x7fb5a80bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.127+0000 7fb5a7fff700 1 --2- 172.21.15.98:0/2684450220 >> v2:172.21.15.118:3300/0 conn(0x7fb5a80a89a0 0x7fb5a80bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2684450220 >> v1:172.21.15.118:6789/0 conn(0x7fb5a80c24d0 legacy=0x7fb5a80c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2684450220 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8154b10 con 0x7fb5a8155310 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a7fff700 1 --2- 172.21.15.98:0/2684450220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a8155310 0x7fb5a8063a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fb5a8067f70 tx=0x7fb5940090f0).ready entity=mon.0 client_cookie=ecea3046d26a0ead server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a77fe700 1 -- 172.21.15.98:0/2684450220 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400b600 con 0x7fb5a8155310 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a77fe700 1 -- 172.21.15.98:0/2684450220 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400b760 con 0x7fb5a8155310 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5a77fe700 1 -- 172.21.15.98:0/2684450220 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400bae0 con 0x7fb5a8155310 2023-08-22T00:21:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 -- 172.21.15.98:0/2684450220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a8155310 msgr2=0x7fb5a8063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 --2- 172.21.15.98:0/2684450220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a8155310 0x7fb5a8063a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fb5a8067f70 tx=0x7fb5940090f0).stop 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 -- 172.21.15.98:0/2684450220 shutdown_connections 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 --2- 172.21.15.98:0/2684450220 >> v2:172.21.15.118:3300/0 conn(0x7fb5a80a89a0 0x7fb5a80bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 --2- 172.21.15.98:0/2684450220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a8155310 0x7fb5a8063a70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 -- 172.21.15.98:0/2684450220 >> 172.21.15.98:0/2684450220 conn(0x7fb5a80c7140 msgr2=0x7fb5a80c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 -- 172.21.15.98:0/2684450220 shutdown_connections 2023-08-22T00:21:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.128+0000 7fb5af150700 1 -- 172.21.15.98:0/2684450220 wait complete. 2023-08-22T00:21:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.129+0000 7fb5af150700 1 Processor -- start 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 -- start start 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5a80a89a0 0x7fb5a8162db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 0x7fb5a80a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80a7460 con 0x7fb5a80c24d0 2023-08-22T00:21:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80a7740 con 0x7fb5a8155310 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.130+0000 7fb5af150700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80a7a20 con 0x7fb5a80a89a0 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53300/0 (socket says 172.21.15.98:53300) 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2288246908 learned_addr learned my addr 172.21.15.98:0/2288246908 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5ad6ed700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 0x7fb5a80a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5aceec700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5a80a89a0 0x7fb5a8162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5a80a89a0 msgr2=0x7fb5a8162db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5a80a89a0 0x7fb5a8162db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 msgr2=0x7fb5a80a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 0x7fb5a80a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 -- 172.21.15.98:0/2288246908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594009370 con 0x7fb5a80c24d0 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5ad6ed700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 0x7fb5a80a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a7fff700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fb594009130 tx=0x7fb594017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400b8d0 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400ba30 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a80a7d00 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59401c670 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.131+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a815fe60 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.132+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a8047480 con 0x7fb5a80c24d0 2023-08-22T00:21:24.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.132+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb59401c9e0 con 0x7fb5a80c24d0 2023-08-22T00:21:24.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.133+0000 7fb5a4ff9700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 0x7fb58c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.133+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb59407bd10 con 0x7fb5a80c24d0 2023-08-22T00:21:24.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.133+0000 7fb5aceec700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 0x7fb58c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.133+0000 7fb5aceec700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 0x7fb58c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb59c006fd0 tx=0x7fb59c008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.137+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb59404cf50 con 0x7fb5a80c24d0 2023-08-22T00:21:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.298+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5a8154df0 con 0x7fb58c05ef30 2023-08-22T00:21:24.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.308+0000 7fb5a4ff9700 1 -- 172.21.15.98:0/2288246908 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353833 (secure 0 0 0) 0x7fb5a8154df0 con 0x7fb58c05ef30 2023-08-22T00:21:24.314 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:24.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 msgr2=0x7fb58c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 0x7fb58c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb59c006fd0 tx=0x7fb59c008040).stop 2023-08-22T00:21:24.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 msgr2=0x7fb5a80a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fb594009130 tx=0x7fb594017000).stop 2023-08-22T00:21:24.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 shutdown_connections 2023-08-22T00:21:24.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb58c05ef30 0x7fb58c0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5a80a89a0 0x7fb5a8162db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8155310 0x7fb5a80a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 --2- 172.21.15.98:0/2288246908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5a80c24d0 0x7fb5a80a6980 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.311+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 >> 172.21.15.98:0/2288246908 conn(0x7fb5a80c7140 msgr2=0x7fb5a80c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:24.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.312+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 shutdown_connections 2023-08-22T00:21:24.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.312+0000 7fb5af150700 1 -- 172.21.15.98:0/2288246908 wait complete. 2023-08-22T00:21:24.319 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:24.324 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:21:24.025155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421956,"kb_used_data":8324,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552764,"statfs":{"total":773094113280,"available":770614030336,"internally_reserved":0,"allocated":8523776,"data_stored":4454715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-84,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001191"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734389+0000","last_change":"2023-08-22T00:21:20.729378+0000","last_active":"2023-08-22T00:21:20.734389+0000","last_peered":"2023-08-22T00:21:20.734389+0000","last_clean":"2023-08-22T00:21:20.734389+0000","last_became_active":"2023-08-22T00:21:20.729042+0000","last_became_peered":"2023-08-22T00:21:20.729042+0000","last_unstale":"2023-08-22T00:21:20.734389+0000","last_undegraded":"2023-08-22T00:21:20.734389+0000","last_fullsized":"2023-08-22T00:21:20.734389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731933+0000","last_change":"2023-08-22T00:21:20.729611+0000","last_active":"2023-08-22T00:21:20.731933+0000","last_peered":"2023-08-22T00:21:20.731933+0000","last_clean":"2023-08-22T00:21:20.731933+0000","last_became_active":"2023-08-22T00:21:20.729410+0000","last_became_peered":"2023-08-22T00:21:20.729410+0000","last_unstale":"2023-08-22T00:21:20.731933+0000","last_undegraded":"2023-08-22T00:21:20.731933+0000","last_fullsized":"2023-08-22T00:21:20.731933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.727699+0000","last_change":"2023-08-22T00:21:20.349669+0000","last_active":"2023-08-22T00:21:20.727699+0000","last_peered":"2023-08-22T00:21:20.727699+0000","last_clean":"2023-08-22T00:21:20.727699+0000","last_became_active":"2023-08-22T00:21:20.349392+0000","last_became_peered":"2023-08-22T00:21:20.349392+0000","last_unstale":"2023-08-22T00:21:20.727699+0000","last_undegraded":"2023-08-22T00:21:20.727699+0000","last_fullsized":"2023-08-22T00:21:20.727699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719814+0000","last_change":"2023-08-22T00:21:20.353551+0000","last_active":"2023-08-22T00:21:20.719814+0000","last_peered":"2023-08-22T00:21:20.719814+0000","last_clean":"2023-08-22T00:21:20.719814+0000","last_became_active":"2023-08-22T00:21:20.353287+0000","last_became_peered":"2023-08-22T00:21:20.353287+0000","last_unstale":"2023-08-22T00:21:20.719814+0000","last_undegraded":"2023-08-22T00:21:20.719814+0000","last_fullsized":"2023-08-22T00:21:20.719814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737730+0000","last_change":"2023-08-22T00:21:20.732701+0000","last_active":"2023-08-22T00:21:20.737730+0000","last_peered":"2023-08-22T00:21:20.737730+0000","last_clean":"2023-08-22T00:21:20.737730+0000","last_became_active":"2023-08-22T00:21:20.732445+0000","last_became_peered":"2023-08-22T00:21:20.732445+0000","last_unstale":"2023-08-22T00:21:20.737730+0000","last_undegraded":"2023-08-22T00:21:20.737730+0000","last_fullsized":"2023-08-22T00:21:20.737730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738437+0000","last_change":"2023-08-22T00:21:20.735960+0000","last_active":"2023-08-22T00:21:20.738437+0000","last_peered":"2023-08-22T00:21:20.738437+0000","last_clean":"2023-08-22T00:21:20.738437+0000","last_became_active":"2023-08-22T00:21:20.735708+0000","last_became_peered":"2023-08-22T00:21:20.735708+0000","last_unstale":"2023-08-22T00:21:20.738437+0000","last_undegraded":"2023-08-22T00:21:20.738437+0000","last_fullsized":"2023-08-22T00:21:20.738437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723535+0000","last_change":"2023-08-22T00:21:20.719435+0000","last_active":"2023-08-22T00:21:20.723535+0000","last_peered":"2023-08-22T00:21:20.723535+0000","last_clean":"2023-08-22T00:21:20.723535+0000","last_became_active":"2023-08-22T00:21:20.719160+0000","last_became_peered":"2023-08-22T00:21:20.719160+0000","last_unstale":"2023-08-22T00:21:20.723535+0000","last_undegraded":"2023-08-22T00:21:20.723535+0000","last_fullsized":"2023-08-22T00:21:20.723535+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725612+0000","last_change":"2023-08-22T00:21:20.723936+0000","last_active":"2023-08-22T00:21:20.725612+0000","last_peered":"2023-08-22T00:21:20.725612+0000","last_clean":"2023-08-22T00:21:20.725612+0000","last_became_active":"2023-08-22T00:21:20.723659+0000","last_became_peered":"2023-08-22T00:21:20.723659+0000","last_unstale":"2023-08-22T00:21:20.725612+0000","last_undegraded":"2023-08-22T00:21:20.725612+0000","last_fullsized":"2023-08-22T00:21:20.725612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734053+0000","last_change":"2023-08-22T00:21:20.354035+0000","last_active":"2023-08-22T00:21:20.734053+0000","last_peered":"2023-08-22T00:21:20.734053+0000","last_clean":"2023-08-22T00:21:20.734053+0000","last_became_active":"2023-08-22T00:21:20.347594+0000","last_became_peered":"2023-08-22T00:21:20.347594+0000","last_unstale":"2023-08-22T00:21:20.734053+0000","last_undegraded":"2023-08-22T00:21:20.734053+0000","last_fullsized":"2023-08-22T00:21:20.734053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737714+0000","last_change":"2023-08-22T00:21:20.732440+0000","last_active":"2023-08-22T00:21:20.737714+0000","last_peered":"2023-08-22T00:21:20.737714+0000","last_clean":"2023-08-22T00:21:20.737714+0000","last_became_active":"2023-08-22T00:21:20.732193+0000","last_became_peered":"2023-08-22T00:21:20.732193+0000","last_unstale":"2023-08-22T00:21:20.737714+0000","last_undegraded":"2023-08-22T00:21:20.737714+0000","last_fullsized":"2023-08-22T00:21:20.737714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740678+0000","last_change":"2023-08-22T00:21:20.737637+0000","last_active":"2023-08-22T00:21:20.740678+0000","last_peered":"2023-08-22T00:21:20.740678+0000","last_clean":"2023-08-22T00:21:20.740678+0000","last_became_active":"2023-08-22T00:21:20.737290+0000","last_became_peered":"2023-08-22T00:21:20.737290+0000","last_unstale":"2023-08-22T00:21:20.740678+0000","last_undegraded":"2023-08-22T00:21:20.740678+0000","last_fullsized":"2023-08-22T00:21:20.740678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715845+0000","last_change":"2023-08-22T00:21:20.353429+0000","last_active":"2023-08-22T00:21:20.715845+0000","last_peered":"2023-08-22T00:21:20.715845+0000","last_clean":"2023-08-22T00:21:20.715845+0000","last_became_active":"2023-08-22T00:21:20.352807+0000","last_became_peered":"2023-08-22T00:21:20.352807+0000","last_unstale":"2023-08-22T00:21:20.715845+0000","last_undegraded":"2023-08-22T00:21:20.715845+0000","last_fullsized":"2023-08-22T00:21:20.715845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722249+0000","last_change":"2023-08-22T00:21:20.352985+0000","last_active":"2023-08-22T00:21:20.722249+0000","last_peered":"2023-08-22T00:21:20.722249+0000","last_clean":"2023-08-22T00:21:20.722249+0000","last_became_active":"2023-08-22T00:21:20.352503+0000","last_became_peered":"2023-08-22T00:21:20.352503+0000","last_unstale":"2023-08-22T00:21:20.722249+0000","last_undegraded":"2023-08-22T00:21:20.722249+0000","last_fullsized":"2023-08-22T00:21:20.722249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717337+0000","last_change":"2023-08-22T00:21:20.347511+0000","last_active":"2023-08-22T00:21:20.717337+0000","last_peered":"2023-08-22T00:21:20.717337+0000","last_clean":"2023-08-22T00:21:20.717337+0000","last_became_active":"2023-08-22T00:21:20.347226+0000","last_became_peered":"2023-08-22T00:21:20.347226+0000","last_unstale":"2023-08-22T00:21:20.717337+0000","last_undegraded":"2023-08-22T00:21:20.717337+0000","last_fullsized":"2023-08-22T00:21:20.717337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734372+0000","last_change":"2023-08-22T00:21:20.729252+0000","last_active":"2023-08-22T00:21:20.734372+0000","last_peered":"2023-08-22T00:21:20.734372+0000","last_clean":"2023-08-22T00:21:20.734372+0000","last_became_active":"2023-08-22T00:21:20.728832+0000","last_became_peered":"2023-08-22T00:21:20.728832+0000","last_unstale":"2023-08-22T00:21:20.734372+0000","last_undegraded":"2023-08-22T00:21:20.734372+0000","last_fullsized":"2023-08-22T00:21:20.734372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738622+0000","last_change":"2023-08-22T00:21:20.735506+0000","last_active":"2023-08-22T00:21:20.738622+0000","last_peered":"2023-08-22T00:21:20.738622+0000","last_clean":"2023-08-22T00:21:20.738622+0000","last_became_active":"2023-08-22T00:21:20.735252+0000","last_became_peered":"2023-08-22T00:21:20.735252+0000","last_unstale":"2023-08-22T00:21:20.738622+0000","last_undegraded":"2023-08-22T00:21:20.738622+0000","last_fullsized":"2023-08-22T00:21:20.738622+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710786+0000","last_change":"2023-08-22T00:21:20.355555+0000","last_active":"2023-08-22T00:21:20.710786+0000","last_peered":"2023-08-22T00:21:20.710786+0000","last_clean":"2023-08-22T00:21:20.710786+0000","last_became_active":"2023-08-22T00:21:20.355267+0000","last_became_peered":"2023-08-22T00:21:20.355267+0000","last_unstale":"2023-08-22T00:21:20.710786+0000","last_undegraded":"2023-08-22T00:21:20.710786+0000","last_fullsized":"2023-08-22T00:21:20.710786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737693+0000","last_change":"2023-08-22T00:21:20.731958+0000","last_active":"2023-08-22T00:21:20.737693+0000","last_peered":"2023-08-22T00:21:20.737693+0000","last_clean":"2023-08-22T00:21:20.737693+0000","last_became_active":"2023-08-22T00:21:20.731704+0000","last_became_peered":"2023-08-22T00:21:20.731704+0000","last_unstale":"2023-08-22T00:21:20.737693+0000","last_undegraded":"2023-08-22T00:21:20.737693+0000","last_fullsized":"2023-08-22T00:21:20.737693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725283+0000","last_change":"2023-08-22T00:21:20.358260+0000","last_active":"2023-08-22T00:21:20.725283+0000","last_peered":"2023-08-22T00:21:20.725283+0000","last_clean":"2023-08-22T00:21:20.725283+0000","last_became_active":"2023-08-22T00:21:20.357898+0000","last_became_peered":"2023-08-22T00:21:20.357898+0000","last_unstale":"2023-08-22T00:21:20.725283+0000","last_undegraded":"2023-08-22T00:21:20.725283+0000","last_fullsized":"2023-08-22T00:21:20.725283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.716664+0000","last_change":"2023-08-22T00:21:20.350690+0000","last_active":"2023-08-22T00:21:20.716664+0000","last_peered":"2023-08-22T00:21:20.716664+0000","last_clean":"2023-08-22T00:21:20.716664+0000","last_became_active":"2023-08-22T00:21:20.350397+0000","last_became_peered":"2023-08-22T00:21:20.350397+0000","last_unstale":"2023-08-22T00:21:20.716664+0000","last_undegraded":"2023-08-22T00:21:20.716664+0000","last_fullsized":"2023-08-22T00:21:20.716664+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735870+0000","last_change":"2023-08-22T00:21:20.727439+0000","last_active":"2023-08-22T00:21:20.735870+0000","last_peered":"2023-08-22T00:21:20.735870+0000","last_clean":"2023-08-22T00:21:20.735870+0000","last_became_active":"2023-08-22T00:21:20.727178+0000","last_became_peered":"2023-08-22T00:21:20.727178+0000","last_unstale":"2023-08-22T00:21:20.735870+0000","last_undegraded":"2023-08-22T00:21:20.735870+0000","last_fullsized":"2023-08-22T00:21:20.735870+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728423+0000","last_change":"2023-08-22T00:21:20.726789+0000","last_active":"2023-08-22T00:21:20.728423+0000","last_peered":"2023-08-22T00:21:20.728423+0000","last_clean":"2023-08-22T00:21:20.728423+0000","last_became_active":"2023-08-22T00:21:20.726517+0000","last_became_peered":"2023-08-22T00:21:20.726517+0000","last_unstale":"2023-08-22T00:21:20.728423+0000","last_undegraded":"2023-08-22T00:21:20.728423+0000","last_fullsized":"2023-08-22T00:21:20.728423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720006+0000","last_change":"2023-08-22T00:21:20.346312+0000","last_active":"2023-08-22T00:21:20.720006+0000","last_peered":"2023-08-22T00:21:20.720006+0000","last_clean":"2023-08-22T00:21:20.720006+0000","last_became_active":"2023-08-22T00:21:20.346053+0000","last_became_peered":"2023-08-22T00:21:20.346053+0000","last_unstale":"2023-08-22T00:21:20.720006+0000","last_undegraded":"2023-08-22T00:21:20.720006+0000","last_fullsized":"2023-08-22T00:21:20.720006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734806+0000","last_change":"2023-08-22T00:21:20.347608+0000","last_active":"2023-08-22T00:21:20.734806+0000","last_peered":"2023-08-22T00:21:20.734806+0000","last_clean":"2023-08-22T00:21:20.734806+0000","last_became_active":"2023-08-22T00:21:20.347316+0000","last_became_peered":"2023-08-22T00:21:20.347316+0000","last_unstale":"2023-08-22T00:21:20.734806+0000","last_undegraded":"2023-08-22T00:21:20.734806+0000","last_fullsized":"2023-08-22T00:21:20.734806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728160+0000","last_change":"2023-08-22T00:21:20.725340+0000","last_active":"2023-08-22T00:21:20.728160+0000","last_peered":"2023-08-22T00:21:20.728160+0000","last_clean":"2023-08-22T00:21:20.728160+0000","last_became_active":"2023-08-22T00:21:20.725088+0000","last_became_peered":"2023-08-22T00:21:20.725088+0000","last_unstale":"2023-08-22T00:21:20.728160+0000","last_undegraded":"2023-08-22T00:21:20.728160+0000","last_fullsized":"2023-08-22T00:21:20.728160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.718507+0000","last_change":"2023-08-22T00:21:20.717902+0000","last_active":"2023-08-22T00:21:20.718507+0000","last_peered":"2023-08-22T00:21:20.718507+0000","last_clean":"2023-08-22T00:21:20.718507+0000","last_became_active":"2023-08-22T00:21:20.717628+0000","last_became_peered":"2023-08-22T00:21:20.717628+0000","last_unstale":"2023-08-22T00:21:20.718507+0000","last_undegraded":"2023-08-22T00:21:20.718507+0000","last_fullsized":"2023-08-22T00:21:20.718507+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738471+0000","last_change":"2023-08-22T00:21:20.735867+0000","last_active":"2023-08-22T00:21:20.738471+0000","last_peered":"2023-08-22T00:21:20.738471+0000","last_clean":"2023-08-22T00:21:20.738471+0000","last_became_active":"2023-08-22T00:21:20.735608+0000","last_became_peered":"2023-08-22T00:21:20.735608+0000","last_unstale":"2023-08-22T00:21:20.738471+0000","last_undegraded":"2023-08-22T00:21:20.738471+0000","last_fullsized":"2023-08-22T00:21:20.738471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728268+0000","last_change":"2023-08-22T00:21:20.725833+0000","last_active":"2023-08-22T00:21:20.728268+0000","last_peered":"2023-08-22T00:21:20.728268+0000","last_clean":"2023-08-22T00:21:20.728268+0000","last_became_active":"2023-08-22T00:21:20.725382+0000","last_became_peered":"2023-08-22T00:21:20.725382+0000","last_unstale":"2023-08-22T00:21:20.728268+0000","last_undegraded":"2023-08-22T00:21:20.728268+0000","last_fullsized":"2023-08-22T00:21:20.728268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719761+0000","last_change":"2023-08-22T00:21:20.344702+0000","last_active":"2023-08-22T00:21:20.719761+0000","last_peered":"2023-08-22T00:21:20.719761+0000","last_clean":"2023-08-22T00:21:20.719761+0000","last_became_active":"2023-08-22T00:21:20.343945+0000","last_became_peered":"2023-08-22T00:21:20.343945+0000","last_unstale":"2023-08-22T00:21:20.719761+0000","last_undegraded":"2023-08-22T00:21:20.719761+0000","last_fullsized":"2023-08-22T00:21:20.719761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.711536+0000","last_change":"2023-08-22T00:21:20.343765+0000","last_active":"2023-08-22T00:21:20.711536+0000","last_peered":"2023-08-22T00:21:20.711536+0000","last_clean":"2023-08-22T00:21:20.711536+0000","last_became_active":"2023-08-22T00:21:20.343499+0000","last_became_peered":"2023-08-22T00:21:20.343499+0000","last_unstale":"2023-08-22T00:21:20.711536+0000","last_undegraded":"2023-08-22T00:21:20.711536+0000","last_fullsized":"2023-08-22T00:21:20.711536+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737756+0000","last_change":"2023-08-22T00:21:20.732191+0000","last_active":"2023-08-22T00:21:20.737756+0000","last_peered":"2023-08-22T00:21:20.737756+0000","last_clean":"2023-08-22T00:21:20.737756+0000","last_became_active":"2023-08-22T00:21:20.731502+0000","last_became_peered":"2023-08-22T00:21:20.731502+0000","last_unstale":"2023-08-22T00:21:20.737756+0000","last_undegraded":"2023-08-22T00:21:20.737756+0000","last_fullsized":"2023-08-22T00:21:20.737756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719518+0000","last_change":"2023-08-22T00:21:20.347336+0000","last_active":"2023-08-22T00:21:20.719518+0000","last_peered":"2023-08-22T00:21:20.719518+0000","last_clean":"2023-08-22T00:21:20.719518+0000","last_became_active":"2023-08-22T00:21:20.347061+0000","last_became_peered":"2023-08-22T00:21:20.347061+0000","last_unstale":"2023-08-22T00:21:20.719518+0000","last_undegraded":"2023-08-22T00:21:20.719518+0000","last_fullsized":"2023-08-22T00:21:20.719518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728141+0000","last_change":"2023-08-22T00:21:20.724613+0000","last_active":"2023-08-22T00:21:20.728141+0000","last_peered":"2023-08-22T00:21:20.728141+0000","last_clean":"2023-08-22T00:21:20.728141+0000","last_became_active":"2023-08-22T00:21:20.724352+0000","last_became_peered":"2023-08-22T00:21:20.724352+0000","last_unstale":"2023-08-22T00:21:20.728141+0000","last_undegraded":"2023-08-22T00:21:20.728141+0000","last_fullsized":"2023-08-22T00:21:20.728141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244277+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:16.244277+0000","last_peered":"2023-08-22T00:21:16.244277+0000","last_clean":"2023-08-22T00:21:16.244277+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:16.244277+0000","last_undegraded":"2023-08-22T00:21:16.244277+0000","last_fullsized":"2023-08-22T00:21:16.244277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734278+0000","last_change":"2023-08-22T00:21:20.728548+0000","last_active":"2023-08-22T00:21:20.734278+0000","last_peered":"2023-08-22T00:21:20.734278+0000","last_clean":"2023-08-22T00:21:20.734278+0000","last_became_active":"2023-08-22T00:21:20.728060+0000","last_became_peered":"2023-08-22T00:21:20.728060+0000","last_unstale":"2023-08-22T00:21:20.734278+0000","last_undegraded":"2023-08-22T00:21:20.734278+0000","last_fullsized":"2023-08-22T00:21:20.734278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:16.971582+0000","last_peered":"2023-08-22T00:21:16.971582+0000","last_clean":"2023-08-22T00:21:16.971582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:16.971582+0000","last_undegraded":"2023-08-22T00:21:16.971582+0000","last_fullsized":"2023-08-22T00:21:16.971582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735680+0000","last_change":"2023-08-22T00:21:20.733035+0000","last_active":"2023-08-22T00:21:20.735680+0000","last_peered":"2023-08-22T00:21:20.735680+0000","last_clean":"2023-08-22T00:21:20.735680+0000","last_became_active":"2023-08-22T00:21:20.732780+0000","last_became_peered":"2023-08-22T00:21:20.732780+0000","last_unstale":"2023-08-22T00:21:20.735680+0000","last_undegraded":"2023-08-22T00:21:20.735680+0000","last_fullsized":"2023-08-22T00:21:20.735680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719654+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:20.719654+0000","last_peered":"2023-08-22T00:21:20.719654+0000","last_clean":"2023-08-22T00:21:20.719654+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:20.719654+0000","last_undegraded":"2023-08-22T00:21:20.719654+0000","last_fullsized":"2023-08-22T00:21:20.719654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.744597+0000","last_change":"2023-08-22T00:21:20.739813+0000","last_active":"2023-08-22T00:21:20.744597+0000","last_peered":"2023-08-22T00:21:20.744597+0000","last_clean":"2023-08-22T00:21:20.744597+0000","last_became_active":"2023-08-22T00:21:20.739538+0000","last_became_peered":"2023-08-22T00:21:20.739538+0000","last_unstale":"2023-08-22T00:21:20.744597+0000","last_undegraded":"2023-08-22T00:21:20.744597+0000","last_fullsized":"2023-08-22T00:21:20.744597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971579+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:16.971579+0000","last_peered":"2023-08-22T00:21:16.971579+0000","last_clean":"2023-08-22T00:21:16.971579+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:16.971579+0000","last_undegraded":"2023-08-22T00:21:16.971579+0000","last_fullsized":"2023-08-22T00:21:16.971579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971284+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:16.971284+0000","last_peered":"2023-08-22T00:21:16.971284+0000","last_clean":"2023-08-22T00:21:16.971284+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:16.971284+0000","last_undegraded":"2023-08-22T00:21:16.971284+0000","last_fullsized":"2023-08-22T00:21:16.971284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734288+0000","last_change":"2023-08-22T00:21:20.727025+0000","last_active":"2023-08-22T00:21:20.734288+0000","last_peered":"2023-08-22T00:21:20.734288+0000","last_clean":"2023-08-22T00:21:20.734288+0000","last_became_active":"2023-08-22T00:21:20.726812+0000","last_became_peered":"2023-08-22T00:21:20.726812+0000","last_unstale":"2023-08-22T00:21:20.734288+0000","last_undegraded":"2023-08-22T00:21:20.734288+0000","last_fullsized":"2023-08-22T00:21:20.734288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710877+0000","last_change":"2023-08-22T00:21:20.348991+0000","last_active":"2023-08-22T00:21:20.710877+0000","last_peered":"2023-08-22T00:21:20.710877+0000","last_clean":"2023-08-22T00:21:20.710877+0000","last_became_active":"2023-08-22T00:21:20.348661+0000","last_became_peered":"2023-08-22T00:21:20.348661+0000","last_unstale":"2023-08-22T00:21:20.710877+0000","last_undegraded":"2023-08-22T00:21:20.710877+0000","last_fullsized":"2023-08-22T00:21:20.710877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971286+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:16.971286+0000","last_peered":"2023-08-22T00:21:16.971286+0000","last_clean":"2023-08-22T00:21:16.971286+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:16.971286+0000","last_undegraded":"2023-08-22T00:21:16.971286+0000","last_fullsized":"2023-08-22T00:21:16.971286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971288+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:16.971288+0000","last_peered":"2023-08-22T00:21:16.971288+0000","last_clean":"2023-08-22T00:21:16.971288+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:16.971288+0000","last_undegraded":"2023-08-22T00:21:16.971288+0000","last_fullsized":"2023-08-22T00:21:16.971288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244342+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:16.244342+0000","last_peered":"2023-08-22T00:21:16.244342+0000","last_clean":"2023-08-22T00:21:16.244342+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:16.244342+0000","last_undegraded":"2023-08-22T00:21:16.244342+0000","last_fullsized":"2023-08-22T00:21:16.244342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.239814+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:16.239814+0000","last_peered":"2023-08-22T00:21:16.239814+0000","last_clean":"2023-08-22T00:21:16.239814+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:16.239814+0000","last_undegraded":"2023-08-22T00:21:16.239814+0000","last_fullsized":"2023-08-22T00:21:16.239814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":30,"acting":30,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.441,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.36499999999999999,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.79600000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.48799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.46700000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.79100000000000004},"last":0.438}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.308},"max":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.751},"last":0.41399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.374},{"interface":"front","average":{"1min":0.495,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.748,"15min":0.95399999999999996},"last":0.56399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.84099999999999997},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065532,"statfs":{"total":96636764160,"available":96323104768,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.46400000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.751,"5min":0.755,"15min":0.99299999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.41199999999999998,"15min":0.29599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.751},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.073},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69399999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.753,"15min":0.94399999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.752,"15min":1.03},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39000000000000001,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.184},"max":{"1min":0.54900000000000004,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.374,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.501,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.57499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":1.117,"15min":1.3360000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.83199999999999996,"5min":2.298,"15min":2.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":2.992,"15min":2.992},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.78000000000000003,"5min":2.323,"15min":2.323},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.505,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.432,"15min":0.41899999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56000000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.443}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.84099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.38900000000000001},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":1.0149999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.26400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.20499999999999999},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":0.625,"5min":0.67900000000000005,"15min":0.71199999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"min":{"1min":0.32600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":1.0580000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.97899999999999998,"15min":1.0169999999999999},"last":0.441}]},{"osd":5,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":0.77800000000000002,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.95199999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":0.998,"15min":0.998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.89600000000000002,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":0.96499999999999997,"15min":1.0349999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.98599999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":574470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.314,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.32900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.63600000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.33100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.47799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.89500000000000002,"15min":11.163},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.77600000000000002},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.71699999999999997,"5min":0.753,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77300000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.78700000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.82299999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.75600000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.30199999999999999},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77800000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.85899999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.46500000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.873},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.313},"max":{"1min":0.72299999999999998,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67900000000000005,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.95999999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.88},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51700000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:24.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.480+0000 7f0c96a66700 1 Processor -- start 2023-08-22T00:21:24.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.480+0000 7f0c96a66700 1 -- start start 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c96a66700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c900c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c96a66700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0c900bc850 0x7f0c90154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c96a66700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900c4fb0 con 0x7f0c90154b30 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c96a66700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9014e7b0 con 0x7f0c900bc850 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c96a66700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900bcfc0 con 0x7f0c90154260 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c8ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0c900bc850 0x7f0c90154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c95003700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0c90154b30 0x7f0c900c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39788/0 (socket says 172.21.15.98:39788) 2023-08-22T00:21:24.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c95003700 1 -- 172.21.15.98:0/726339873 learned_addr learned my addr 172.21.15.98:0/726339873 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:24.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c94802700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c900c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.481+0000 7f0c8f7fe700 1 -- 172.21.15.98:0/726339873 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309517743 0 0) 0x7f0c900c4fb0 con 0x7f0c90154b30 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8f7fe700 1 -- 172.21.15.98:0/726339873 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c800033f0 con 0x7f0c90154b30 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8ffff700 1 -- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 msgr2=0x7f0c900c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8ffff700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c900c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8ffff700 1 -- 172.21.15.98:0/726339873 >> v1:172.21.15.98:6789/0 conn(0x7f0c90154b30 legacy=0x7f0c900c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8ffff700 1 -- 172.21.15.98:0/726339873 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900bd2a0 con 0x7f0c900bc850 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8ffff700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c90154640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f0c7c009760 tx=0x7f0c7c009060).ready entity=mon.1 client_cookie=f3149bbbcfaa03d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8f7fe700 1 -- 172.21.15.98:0/726339873 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00f510 con 0x7f0c900bc850 2023-08-22T00:21:24.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8f7fe700 1 -- 172.21.15.98:0/726339873 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00f670 con 0x7f0c900bc850 2023-08-22T00:21:24.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c8f7fe700 1 -- 172.21.15.98:0/726339873 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00f9f0 con 0x7f0c900bc850 2023-08-22T00:21:24.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c96a66700 1 -- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 msgr2=0x7f0c90154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.482+0000 7f0c96a66700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c90154640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f0c7c009760 tx=0x7f0c7c009060).stop 2023-08-22T00:21:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 -- 172.21.15.98:0/726339873 shutdown_connections 2023-08-22T00:21:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c900c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 --2- 172.21.15.98:0/726339873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c90154640 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 -- 172.21.15.98:0/726339873 >> 172.21.15.98:0/726339873 conn(0x7f0c900c3980 msgr2=0x7f0c900c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:24.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 -- 172.21.15.98:0/726339873 shutdown_connections 2023-08-22T00:21:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.483+0000 7f0c96a66700 1 -- 172.21.15.98:0/726339873 wait complete. 2023-08-22T00:21:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.484+0000 7f0c96a66700 1 Processor -- start 2023-08-22T00:21:24.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.484+0000 7f0c96a66700 1 -- start start 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c900aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c9014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900c0ae0 con 0x7f0c90154b30 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900aa5f0 con 0x7f0c900bc850 2023-08-22T00:21:24.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900629c0 con 0x7f0c90154260 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53306/0 (socket says 172.21.15.98:53306) 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 -- 172.21.15.98:0/536986610 learned_addr learned my addr 172.21.15.98:0/536986610 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c94802700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c900aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c8ffff700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c9014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 -- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 msgr2=0x7f0c9014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c9014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 -- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 msgr2=0x7f0c900aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c900aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 -- 172.21.15.98:0/536986610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0092a0 con 0x7f0c90154b30 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c95003700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f0c88005ad0 tx=0x7f0c880015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88005d30 con 0x7f0c90154b30 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88005e90 con 0x7f0c90154b30 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9014d210 con 0x7f0c90154b30 2023-08-22T00:21:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.485+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880072e0 con 0x7f0c90154b30 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.486+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c900a9fa0 con 0x7f0c90154b30 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.486+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c900aa760 con 0x7f0c90154b30 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.487+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0c880076d0 con 0x7f0c90154b30 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.487+0000 7f0c8cff9700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 0x7f0c740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.487+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0c880799a0 con 0x7f0c90154b30 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.487+0000 7f0c94802700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 0x7f0c740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.487+0000 7f0c94802700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 0x7f0c740613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0c84009c30 tx=0x7f0c84009060).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.491+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c8804aad0 con 0x7f0c90154b30 2023-08-22T00:21:24.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.648+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c90047480 con 0x7f0c7405ef30 2023-08-22T00:21:24.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.657+0000 7f0c8cff9700 1 -- 172.21.15.98:0/536986610 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353833 (secure 0 0 0) 0x7f0c90047480 con 0x7f0c7405ef30 2023-08-22T00:21:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:24.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 msgr2=0x7f0c740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 0x7f0c740613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0c84009c30 tx=0x7f0c84009060).stop 2023-08-22T00:21:24.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 msgr2=0x7f0c900bfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f0c88005ad0 tx=0x7f0c880015b0).stop 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 shutdown_connections 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c90154b30 0x7f0c900bfd60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c900bc850 0x7f0c900aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c7405ef30 0x7f0c740613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 --2- 172.21.15.98:0/536986610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c90154260 0x7f0c9014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 >> 172.21.15.98:0/536986610 conn(0x7f0c900c3980 msgr2=0x7f0c9014da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:24.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.660+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 shutdown_connections 2023-08-22T00:21:24.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.661+0000 7f0c96a66700 1 -- 172.21.15.98:0/536986610 wait complete. 2023-08-22T00:21:24.667 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:24.674 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:21:24.025155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421956,"kb_used_data":8324,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552764,"statfs":{"total":773094113280,"available":770614030336,"internally_reserved":0,"allocated":8523776,"data_stored":4454715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-84,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001191"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734389+0000","last_change":"2023-08-22T00:21:20.729378+0000","last_active":"2023-08-22T00:21:20.734389+0000","last_peered":"2023-08-22T00:21:20.734389+0000","last_clean":"2023-08-22T00:21:20.734389+0000","last_became_active":"2023-08-22T00:21:20.729042+0000","last_became_peered":"2023-08-22T00:21:20.729042+0000","last_unstale":"2023-08-22T00:21:20.734389+0000","last_undegraded":"2023-08-22T00:21:20.734389+0000","last_fullsized":"2023-08-22T00:21:20.734389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731933+0000","last_change":"2023-08-22T00:21:20.729611+0000","last_active":"2023-08-22T00:21:20.731933+0000","last_peered":"2023-08-22T00:21:20.731933+0000","last_clean":"2023-08-22T00:21:20.731933+0000","last_became_active":"2023-08-22T00:21:20.729410+0000","last_became_peered":"2023-08-22T00:21:20.729410+0000","last_unstale":"2023-08-22T00:21:20.731933+0000","last_undegraded":"2023-08-22T00:21:20.731933+0000","last_fullsized":"2023-08-22T00:21:20.731933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.727699+0000","last_change":"2023-08-22T00:21:20.349669+0000","last_active":"2023-08-22T00:21:20.727699+0000","last_peered":"2023-08-22T00:21:20.727699+0000","last_clean":"2023-08-22T00:21:20.727699+0000","last_became_active":"2023-08-22T00:21:20.349392+0000","last_became_peered":"2023-08-22T00:21:20.349392+0000","last_unstale":"2023-08-22T00:21:20.727699+0000","last_undegraded":"2023-08-22T00:21:20.727699+0000","last_fullsized":"2023-08-22T00:21:20.727699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719814+0000","last_change":"2023-08-22T00:21:20.353551+0000","last_active":"2023-08-22T00:21:20.719814+0000","last_peered":"2023-08-22T00:21:20.719814+0000","last_clean":"2023-08-22T00:21:20.719814+0000","last_became_active":"2023-08-22T00:21:20.353287+0000","last_became_peered":"2023-08-22T00:21:20.353287+0000","last_unstale":"2023-08-22T00:21:20.719814+0000","last_undegraded":"2023-08-22T00:21:20.719814+0000","last_fullsized":"2023-08-22T00:21:20.719814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737730+0000","last_change":"2023-08-22T00:21:20.732701+0000","last_active":"2023-08-22T00:21:20.737730+0000","last_peered":"2023-08-22T00:21:20.737730+0000","last_clean":"2023-08-22T00:21:20.737730+0000","last_became_active":"2023-08-22T00:21:20.732445+0000","last_became_peered":"2023-08-22T00:21:20.732445+0000","last_unstale":"2023-08-22T00:21:20.737730+0000","last_undegraded":"2023-08-22T00:21:20.737730+0000","last_fullsized":"2023-08-22T00:21:20.737730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738437+0000","last_change":"2023-08-22T00:21:20.735960+0000","last_active":"2023-08-22T00:21:20.738437+0000","last_peered":"2023-08-22T00:21:20.738437+0000","last_clean":"2023-08-22T00:21:20.738437+0000","last_became_active":"2023-08-22T00:21:20.735708+0000","last_became_peered":"2023-08-22T00:21:20.735708+0000","last_unstale":"2023-08-22T00:21:20.738437+0000","last_undegraded":"2023-08-22T00:21:20.738437+0000","last_fullsized":"2023-08-22T00:21:20.738437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723535+0000","last_change":"2023-08-22T00:21:20.719435+0000","last_active":"2023-08-22T00:21:20.723535+0000","last_peered":"2023-08-22T00:21:20.723535+0000","last_clean":"2023-08-22T00:21:20.723535+0000","last_became_active":"2023-08-22T00:21:20.719160+0000","last_became_peered":"2023-08-22T00:21:20.719160+0000","last_unstale":"2023-08-22T00:21:20.723535+0000","last_undegraded":"2023-08-22T00:21:20.723535+0000","last_fullsized":"2023-08-22T00:21:20.723535+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725612+0000","last_change":"2023-08-22T00:21:20.723936+0000","last_active":"2023-08-22T00:21:20.725612+0000","last_peered":"2023-08-22T00:21:20.725612+0000","last_clean":"2023-08-22T00:21:20.725612+0000","last_became_active":"2023-08-22T00:21:20.723659+0000","last_became_peered":"2023-08-22T00:21:20.723659+0000","last_unstale":"2023-08-22T00:21:20.725612+0000","last_undegraded":"2023-08-22T00:21:20.725612+0000","last_fullsized":"2023-08-22T00:21:20.725612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734053+0000","last_change":"2023-08-22T00:21:20.354035+0000","last_active":"2023-08-22T00:21:20.734053+0000","last_peered":"2023-08-22T00:21:20.734053+0000","last_clean":"2023-08-22T00:21:20.734053+0000","last_became_active":"2023-08-22T00:21:20.347594+0000","last_became_peered":"2023-08-22T00:21:20.347594+0000","last_unstale":"2023-08-22T00:21:20.734053+0000","last_undegraded":"2023-08-22T00:21:20.734053+0000","last_fullsized":"2023-08-22T00:21:20.734053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737714+0000","last_change":"2023-08-22T00:21:20.732440+0000","last_active":"2023-08-22T00:21:20.737714+0000","last_peered":"2023-08-22T00:21:20.737714+0000","last_clean":"2023-08-22T00:21:20.737714+0000","last_became_active":"2023-08-22T00:21:20.732193+0000","last_became_peered":"2023-08-22T00:21:20.732193+0000","last_unstale":"2023-08-22T00:21:20.737714+0000","last_undegraded":"2023-08-22T00:21:20.737714+0000","last_fullsized":"2023-08-22T00:21:20.737714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740678+0000","last_change":"2023-08-22T00:21:20.737637+0000","last_active":"2023-08-22T00:21:20.740678+0000","last_peered":"2023-08-22T00:21:20.740678+0000","last_clean":"2023-08-22T00:21:20.740678+0000","last_became_active":"2023-08-22T00:21:20.737290+0000","last_became_peered":"2023-08-22T00:21:20.737290+0000","last_unstale":"2023-08-22T00:21:20.740678+0000","last_undegraded":"2023-08-22T00:21:20.740678+0000","last_fullsized":"2023-08-22T00:21:20.740678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715845+0000","last_change":"2023-08-22T00:21:20.353429+0000","last_active":"2023-08-22T00:21:20.715845+0000","last_peered":"2023-08-22T00:21:20.715845+0000","last_clean":"2023-08-22T00:21:20.715845+0000","last_became_active":"2023-08-22T00:21:20.352807+0000","last_became_peered":"2023-08-22T00:21:20.352807+0000","last_unstale":"2023-08-22T00:21:20.715845+0000","last_undegraded":"2023-08-22T00:21:20.715845+0000","last_fullsized":"2023-08-22T00:21:20.715845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722249+0000","last_change":"2023-08-22T00:21:20.352985+0000","last_active":"2023-08-22T00:21:20.722249+0000","last_peered":"2023-08-22T00:21:20.722249+0000","last_clean":"2023-08-22T00:21:20.722249+0000","last_became_active":"2023-08-22T00:21:20.352503+0000","last_became_peered":"2023-08-22T00:21:20.352503+0000","last_unstale":"2023-08-22T00:21:20.722249+0000","last_undegraded":"2023-08-22T00:21:20.722249+0000","last_fullsized":"2023-08-22T00:21:20.722249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717337+0000","last_change":"2023-08-22T00:21:20.347511+0000","last_active":"2023-08-22T00:21:20.717337+0000","last_peered":"2023-08-22T00:21:20.717337+0000","last_clean":"2023-08-22T00:21:20.717337+0000","last_became_active":"2023-08-22T00:21:20.347226+0000","last_became_peered":"2023-08-22T00:21:20.347226+0000","last_unstale":"2023-08-22T00:21:20.717337+0000","last_undegraded":"2023-08-22T00:21:20.717337+0000","last_fullsized":"2023-08-22T00:21:20.717337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734372+0000","last_change":"2023-08-22T00:21:20.729252+0000","last_active":"2023-08-22T00:21:20.734372+0000","last_peered":"2023-08-22T00:21:20.734372+0000","last_clean":"2023-08-22T00:21:20.734372+0000","last_became_active":"2023-08-22T00:21:20.728832+0000","last_became_peered":"2023-08-22T00:21:20.728832+0000","last_unstale":"2023-08-22T00:21:20.734372+0000","last_undegraded":"2023-08-22T00:21:20.734372+0000","last_fullsized":"2023-08-22T00:21:20.734372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738622+0000","last_change":"2023-08-22T00:21:20.735506+0000","last_active":"2023-08-22T00:21:20.738622+0000","last_peered":"2023-08-22T00:21:20.738622+0000","last_clean":"2023-08-22T00:21:20.738622+0000","last_became_active":"2023-08-22T00:21:20.735252+0000","last_became_peered":"2023-08-22T00:21:20.735252+0000","last_unstale":"2023-08-22T00:21:20.738622+0000","last_undegraded":"2023-08-22T00:21:20.738622+0000","last_fullsized":"2023-08-22T00:21:20.738622+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710786+0000","last_change":"2023-08-22T00:21:20.355555+0000","last_active":"2023-08-22T00:21:20.710786+0000","last_peered":"2023-08-22T00:21:20.710786+0000","last_clean":"2023-08-22T00:21:20.710786+0000","last_became_active":"2023-08-22T00:21:20.355267+0000","last_became_peered":"2023-08-22T00:21:20.355267+0000","last_unstale":"2023-08-22T00:21:20.710786+0000","last_undegraded":"2023-08-22T00:21:20.710786+0000","last_fullsized":"2023-08-22T00:21:20.710786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737693+0000","last_change":"2023-08-22T00:21:20.731958+0000","last_active":"2023-08-22T00:21:20.737693+0000","last_peered":"2023-08-22T00:21:20.737693+0000","last_clean":"2023-08-22T00:21:20.737693+0000","last_became_active":"2023-08-22T00:21:20.731704+0000","last_became_peered":"2023-08-22T00:21:20.731704+0000","last_unstale":"2023-08-22T00:21:20.737693+0000","last_undegraded":"2023-08-22T00:21:20.737693+0000","last_fullsized":"2023-08-22T00:21:20.737693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725283+0000","last_change":"2023-08-22T00:21:20.358260+0000","last_active":"2023-08-22T00:21:20.725283+0000","last_peered":"2023-08-22T00:21:20.725283+0000","last_clean":"2023-08-22T00:21:20.725283+0000","last_became_active":"2023-08-22T00:21:20.357898+0000","last_became_peered":"2023-08-22T00:21:20.357898+0000","last_unstale":"2023-08-22T00:21:20.725283+0000","last_undegraded":"2023-08-22T00:21:20.725283+0000","last_fullsized":"2023-08-22T00:21:20.725283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.716664+0000","last_change":"2023-08-22T00:21:20.350690+0000","last_active":"2023-08-22T00:21:20.716664+0000","last_peered":"2023-08-22T00:21:20.716664+0000","last_clean":"2023-08-22T00:21:20.716664+0000","last_became_active":"2023-08-22T00:21:20.350397+0000","last_became_peered":"2023-08-22T00:21:20.350397+0000","last_unstale":"2023-08-22T00:21:20.716664+0000","last_undegraded":"2023-08-22T00:21:20.716664+0000","last_fullsized":"2023-08-22T00:21:20.716664+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735870+0000","last_change":"2023-08-22T00:21:20.727439+0000","last_active":"2023-08-22T00:21:20.735870+0000","last_peered":"2023-08-22T00:21:20.735870+0000","last_clean":"2023-08-22T00:21:20.735870+0000","last_became_active":"2023-08-22T00:21:20.727178+0000","last_became_peered":"2023-08-22T00:21:20.727178+0000","last_unstale":"2023-08-22T00:21:20.735870+0000","last_undegraded":"2023-08-22T00:21:20.735870+0000","last_fullsized":"2023-08-22T00:21:20.735870+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728423+0000","last_change":"2023-08-22T00:21:20.726789+0000","last_active":"2023-08-22T00:21:20.728423+0000","last_peered":"2023-08-22T00:21:20.728423+0000","last_clean":"2023-08-22T00:21:20.728423+0000","last_became_active":"2023-08-22T00:21:20.726517+0000","last_became_peered":"2023-08-22T00:21:20.726517+0000","last_unstale":"2023-08-22T00:21:20.728423+0000","last_undegraded":"2023-08-22T00:21:20.728423+0000","last_fullsized":"2023-08-22T00:21:20.728423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720006+0000","last_change":"2023-08-22T00:21:20.346312+0000","last_active":"2023-08-22T00:21:20.720006+0000","last_peered":"2023-08-22T00:21:20.720006+0000","last_clean":"2023-08-22T00:21:20.720006+0000","last_became_active":"2023-08-22T00:21:20.346053+0000","last_became_peered":"2023-08-22T00:21:20.346053+0000","last_unstale":"2023-08-22T00:21:20.720006+0000","last_undegraded":"2023-08-22T00:21:20.720006+0000","last_fullsized":"2023-08-22T00:21:20.720006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734806+0000","last_change":"2023-08-22T00:21:20.347608+0000","last_active":"2023-08-22T00:21:20.734806+0000","last_peered":"2023-08-22T00:21:20.734806+0000","last_clean":"2023-08-22T00:21:20.734806+0000","last_became_active":"2023-08-22T00:21:20.347316+0000","last_became_peered":"2023-08-22T00:21:20.347316+0000","last_unstale":"2023-08-22T00:21:20.734806+0000","last_undegraded":"2023-08-22T00:21:20.734806+0000","last_fullsized":"2023-08-22T00:21:20.734806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728160+0000","last_change":"2023-08-22T00:21:20.725340+0000","last_active":"2023-08-22T00:21:20.728160+0000","last_peered":"2023-08-22T00:21:20.728160+0000","last_clean":"2023-08-22T00:21:20.728160+0000","last_became_active":"2023-08-22T00:21:20.725088+0000","last_became_peered":"2023-08-22T00:21:20.725088+0000","last_unstale":"2023-08-22T00:21:20.728160+0000","last_undegraded":"2023-08-22T00:21:20.728160+0000","last_fullsized":"2023-08-22T00:21:20.728160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.718507+0000","last_change":"2023-08-22T00:21:20.717902+0000","last_active":"2023-08-22T00:21:20.718507+0000","last_peered":"2023-08-22T00:21:20.718507+0000","last_clean":"2023-08-22T00:21:20.718507+0000","last_became_active":"2023-08-22T00:21:20.717628+0000","last_became_peered":"2023-08-22T00:21:20.717628+0000","last_unstale":"2023-08-22T00:21:20.718507+0000","last_undegraded":"2023-08-22T00:21:20.718507+0000","last_fullsized":"2023-08-22T00:21:20.718507+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738471+0000","last_change":"2023-08-22T00:21:20.735867+0000","last_active":"2023-08-22T00:21:20.738471+0000","last_peered":"2023-08-22T00:21:20.738471+0000","last_clean":"2023-08-22T00:21:20.738471+0000","last_became_active":"2023-08-22T00:21:20.735608+0000","last_became_peered":"2023-08-22T00:21:20.735608+0000","last_unstale":"2023-08-22T00:21:20.738471+0000","last_undegraded":"2023-08-22T00:21:20.738471+0000","last_fullsized":"2023-08-22T00:21:20.738471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728268+0000","last_change":"2023-08-22T00:21:20.725833+0000","last_active":"2023-08-22T00:21:20.728268+0000","last_peered":"2023-08-22T00:21:20.728268+0000","last_clean":"2023-08-22T00:21:20.728268+0000","last_became_active":"2023-08-22T00:21:20.725382+0000","last_became_peered":"2023-08-22T00:21:20.725382+0000","last_unstale":"2023-08-22T00:21:20.728268+0000","last_undegraded":"2023-08-22T00:21:20.728268+0000","last_fullsized":"2023-08-22T00:21:20.728268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719761+0000","last_change":"2023-08-22T00:21:20.344702+0000","last_active":"2023-08-22T00:21:20.719761+0000","last_peered":"2023-08-22T00:21:20.719761+0000","last_clean":"2023-08-22T00:21:20.719761+0000","last_became_active":"2023-08-22T00:21:20.343945+0000","last_became_peered":"2023-08-22T00:21:20.343945+0000","last_unstale":"2023-08-22T00:21:20.719761+0000","last_undegraded":"2023-08-22T00:21:20.719761+0000","last_fullsized":"2023-08-22T00:21:20.719761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.711536+0000","last_change":"2023-08-22T00:21:20.343765+0000","last_active":"2023-08-22T00:21:20.711536+0000","last_peered":"2023-08-22T00:21:20.711536+0000","last_clean":"2023-08-22T00:21:20.711536+0000","last_became_active":"2023-08-22T00:21:20.343499+0000","last_became_peered":"2023-08-22T00:21:20.343499+0000","last_unstale":"2023-08-22T00:21:20.711536+0000","last_undegraded":"2023-08-22T00:21:20.711536+0000","last_fullsized":"2023-08-22T00:21:20.711536+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737756+0000","last_change":"2023-08-22T00:21:20.732191+0000","last_active":"2023-08-22T00:21:20.737756+0000","last_peered":"2023-08-22T00:21:20.737756+0000","last_clean":"2023-08-22T00:21:20.737756+0000","last_became_active":"2023-08-22T00:21:20.731502+0000","last_became_peered":"2023-08-22T00:21:20.731502+0000","last_unstale":"2023-08-22T00:21:20.737756+0000","last_undegraded":"2023-08-22T00:21:20.737756+0000","last_fullsized":"2023-08-22T00:21:20.737756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719518+0000","last_change":"2023-08-22T00:21:20.347336+0000","last_active":"2023-08-22T00:21:20.719518+0000","last_peered":"2023-08-22T00:21:20.719518+0000","last_clean":"2023-08-22T00:21:20.719518+0000","last_became_active":"2023-08-22T00:21:20.347061+0000","last_became_peered":"2023-08-22T00:21:20.347061+0000","last_unstale":"2023-08-22T00:21:20.719518+0000","last_undegraded":"2023-08-22T00:21:20.719518+0000","last_fullsized":"2023-08-22T00:21:20.719518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728141+0000","last_change":"2023-08-22T00:21:20.724613+0000","last_active":"2023-08-22T00:21:20.728141+0000","last_peered":"2023-08-22T00:21:20.728141+0000","last_clean":"2023-08-22T00:21:20.728141+0000","last_became_active":"2023-08-22T00:21:20.724352+0000","last_became_peered":"2023-08-22T00:21:20.724352+0000","last_unstale":"2023-08-22T00:21:20.728141+0000","last_undegraded":"2023-08-22T00:21:20.728141+0000","last_fullsized":"2023-08-22T00:21:20.728141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244277+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:16.244277+0000","last_peered":"2023-08-22T00:21:16.244277+0000","last_clean":"2023-08-22T00:21:16.244277+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:16.244277+0000","last_undegraded":"2023-08-22T00:21:16.244277+0000","last_fullsized":"2023-08-22T00:21:16.244277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734278+0000","last_change":"2023-08-22T00:21:20.728548+0000","last_active":"2023-08-22T00:21:20.734278+0000","last_peered":"2023-08-22T00:21:20.734278+0000","last_clean":"2023-08-22T00:21:20.734278+0000","last_became_active":"2023-08-22T00:21:20.728060+0000","last_became_peered":"2023-08-22T00:21:20.728060+0000","last_unstale":"2023-08-22T00:21:20.734278+0000","last_undegraded":"2023-08-22T00:21:20.734278+0000","last_fullsized":"2023-08-22T00:21:20.734278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:16.971582+0000","last_peered":"2023-08-22T00:21:16.971582+0000","last_clean":"2023-08-22T00:21:16.971582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:16.971582+0000","last_undegraded":"2023-08-22T00:21:16.971582+0000","last_fullsized":"2023-08-22T00:21:16.971582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735680+0000","last_change":"2023-08-22T00:21:20.733035+0000","last_active":"2023-08-22T00:21:20.735680+0000","last_peered":"2023-08-22T00:21:20.735680+0000","last_clean":"2023-08-22T00:21:20.735680+0000","last_became_active":"2023-08-22T00:21:20.732780+0000","last_became_peered":"2023-08-22T00:21:20.732780+0000","last_unstale":"2023-08-22T00:21:20.735680+0000","last_undegraded":"2023-08-22T00:21:20.735680+0000","last_fullsized":"2023-08-22T00:21:20.735680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719654+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:20.719654+0000","last_peered":"2023-08-22T00:21:20.719654+0000","last_clean":"2023-08-22T00:21:20.719654+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:20.719654+0000","last_undegraded":"2023-08-22T00:21:20.719654+0000","last_fullsized":"2023-08-22T00:21:20.719654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.744597+0000","last_change":"2023-08-22T00:21:20.739813+0000","last_active":"2023-08-22T00:21:20.744597+0000","last_peered":"2023-08-22T00:21:20.744597+0000","last_clean":"2023-08-22T00:21:20.744597+0000","last_became_active":"2023-08-22T00:21:20.739538+0000","last_became_peered":"2023-08-22T00:21:20.739538+0000","last_unstale":"2023-08-22T00:21:20.744597+0000","last_undegraded":"2023-08-22T00:21:20.744597+0000","last_fullsized":"2023-08-22T00:21:20.744597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971579+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:16.971579+0000","last_peered":"2023-08-22T00:21:16.971579+0000","last_clean":"2023-08-22T00:21:16.971579+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:16.971579+0000","last_undegraded":"2023-08-22T00:21:16.971579+0000","last_fullsized":"2023-08-22T00:21:16.971579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971284+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:16.971284+0000","last_peered":"2023-08-22T00:21:16.971284+0000","last_clean":"2023-08-22T00:21:16.971284+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:16.971284+0000","last_undegraded":"2023-08-22T00:21:16.971284+0000","last_fullsized":"2023-08-22T00:21:16.971284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734288+0000","last_change":"2023-08-22T00:21:20.727025+0000","last_active":"2023-08-22T00:21:20.734288+0000","last_peered":"2023-08-22T00:21:20.734288+0000","last_clean":"2023-08-22T00:21:20.734288+0000","last_became_active":"2023-08-22T00:21:20.726812+0000","last_became_peered":"2023-08-22T00:21:20.726812+0000","last_unstale":"2023-08-22T00:21:20.734288+0000","last_undegraded":"2023-08-22T00:21:20.734288+0000","last_fullsized":"2023-08-22T00:21:20.734288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710877+0000","last_change":"2023-08-22T00:21:20.348991+0000","last_active":"2023-08-22T00:21:20.710877+0000","last_peered":"2023-08-22T00:21:20.710877+0000","last_clean":"2023-08-22T00:21:20.710877+0000","last_became_active":"2023-08-22T00:21:20.348661+0000","last_became_peered":"2023-08-22T00:21:20.348661+0000","last_unstale":"2023-08-22T00:21:20.710877+0000","last_undegraded":"2023-08-22T00:21:20.710877+0000","last_fullsized":"2023-08-22T00:21:20.710877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971286+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:16.971286+0000","last_peered":"2023-08-22T00:21:16.971286+0000","last_clean":"2023-08-22T00:21:16.971286+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:16.971286+0000","last_undegraded":"2023-08-22T00:21:16.971286+0000","last_fullsized":"2023-08-22T00:21:16.971286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971288+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:16.971288+0000","last_peered":"2023-08-22T00:21:16.971288+0000","last_clean":"2023-08-22T00:21:16.971288+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:16.971288+0000","last_undegraded":"2023-08-22T00:21:16.971288+0000","last_fullsized":"2023-08-22T00:21:16.971288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244342+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:16.244342+0000","last_peered":"2023-08-22T00:21:16.244342+0000","last_clean":"2023-08-22T00:21:16.244342+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:16.244342+0000","last_undegraded":"2023-08-22T00:21:16.244342+0000","last_fullsized":"2023-08-22T00:21:16.244342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.239814+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:16.239814+0000","last_peered":"2023-08-22T00:21:16.239814+0000","last_clean":"2023-08-22T00:21:16.239814+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:16.239814+0000","last_undegraded":"2023-08-22T00:21:16.239814+0000","last_fullsized":"2023-08-22T00:21:16.239814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":30,"acting":30,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.441,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.36499999999999999,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.79600000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.48799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.46700000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.79100000000000004},"last":0.438}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.308},"max":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.751},"last":0.41399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.374},{"interface":"front","average":{"1min":0.495,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.748,"15min":0.95399999999999996},"last":0.56399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.84099999999999997},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065532,"statfs":{"total":96636764160,"available":96323104768,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.46400000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.751,"5min":0.755,"15min":0.99299999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.41199999999999998,"15min":0.29599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.751},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.073},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69399999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.753,"15min":0.94399999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.752,"15min":1.03},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39000000000000001,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.184},"max":{"1min":0.54900000000000004,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.374,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.501,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.57499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":1.117,"15min":1.3360000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.83199999999999996,"5min":2.298,"15min":2.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":2.992,"15min":2.992},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.78000000000000003,"5min":2.323,"15min":2.323},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.505,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.432,"15min":0.41899999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56000000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.443}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.84099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.38900000000000001},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":1.0149999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.26400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.20499999999999999},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":0.625,"5min":0.67900000000000005,"15min":0.71199999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"min":{"1min":0.32600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":1.0580000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.97899999999999998,"15min":1.0169999999999999},"last":0.441}]},{"osd":5,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":0.77800000000000002,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.95199999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":0.998,"15min":0.998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.89600000000000002,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":0.96499999999999997,"15min":1.0349999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.98599999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":574470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.314,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.32900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.63600000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.33100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.47799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.89500000000000002,"15min":11.163},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.77600000000000002},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.71699999999999997,"5min":0.753,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77300000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.78700000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.82299999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.75600000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.30199999999999999},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77800000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.85899999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.46500000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.873},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.313},"max":{"1min":0.72299999999999998,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67900000000000005,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.95999999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.88},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51700000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:24.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:24.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 Processor -- start 2023-08-22T00:21:24.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 -- start start 2023-08-22T00:21:24.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153f40 0x7f264c157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f264c0a9140 0x7f264c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c0a8410 con 0x7f264c153b60 2023-08-22T00:21:24.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c0a8cb0 con 0x7f264c0a9140 2023-08-22T00:21:24.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.829+0000 7f265153d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1586a0 con 0x7f264c153f40 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f264c0a9140 0x7f264c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f264c0a9140 0x7f264c157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53320/0 (socket says 172.21.15.98:53320) 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 -- 172.21.15.98:0/1504637773 learned_addr learned my addr 172.21.15.98:0/1504637773 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264a7fc700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153f40 0x7f264c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 -- 172.21.15.98:0/1504637773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153f40 msgr2=0x7f264c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153f40 0x7f264c157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 -- 172.21.15.98:0/1504637773 >> v1:172.21.15.118:6789/0 conn(0x7f264c153b60 legacy=0x7f264c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 -- 172.21.15.98:0/1504637773 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0a8660 con 0x7f264c0a9140 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f264b7fe700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c0a9140 0x7f264c157e20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f2644009f20 tx=0x7f2644009840).ready entity=mon.0 client_cookie=8fbdaf881da9b44c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f2649ffb700 1 -- 172.21.15.98:0/1504637773 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400e070 con 0x7f264c0a9140 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f2649ffb700 1 -- 172.21.15.98:0/1504637773 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400b9d0 con 0x7f264c0a9140 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.830+0000 7f2649ffb700 1 -- 172.21.15.98:0/1504637773 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400bd50 con 0x7f264c0a9140 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 -- 172.21.15.98:0/1504637773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c0a9140 msgr2=0x7f264c157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c0a9140 0x7f264c157e20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f2644009f20 tx=0x7f2644009840).stop 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 -- 172.21.15.98:0/1504637773 shutdown_connections 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c0a9140 0x7f264c157e20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 --2- 172.21.15.98:0/1504637773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153f40 0x7f264c157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 -- 172.21.15.98:0/1504637773 >> 172.21.15.98:0/1504637773 conn(0x7f264c0c5dc0 msgr2=0x7f264c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 -- 172.21.15.98:0/1504637773 shutdown_connections 2023-08-22T00:21:24.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.831+0000 7f265153d700 1 -- 172.21.15.98:0/1504637773 wait complete. 2023-08-22T00:21:24.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.832+0000 7f265153d700 1 Processor -- start 2023-08-22T00:21:24.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.832+0000 7f265153d700 1 -- start start 2023-08-22T00:21:24.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f264c0a9140 0x7f264c0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153b60 0x7f264c0bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c01e0 con 0x7f264c153f40 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c04c0 con 0x7f264c0a9140 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f265153d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c07a0 con 0x7f264c153b60 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53328/0 (socket says 172.21.15.98:53328) 2023-08-22T00:21:24.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 -- 172.21.15.98:0/1023180742 learned_addr learned my addr 172.21.15.98:0/1023180742 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264affd700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f264c0a9140 0x7f264c0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264a7fc700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153b60 0x7f264c0bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 -- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153b60 msgr2=0x7f264c0bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153b60 0x7f264c0bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 -- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f264c0a9140 msgr2=0x7f264c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f264c0a9140 0x7f264c0c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:24.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 -- 172.21.15.98:0/1023180742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009ae0 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f264b7fe700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f264400b610 tx=0x7f2644009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.833+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440092e0 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.834+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264401e470 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.834+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c0c0a80 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.834+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264401e830 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.834+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0bfdf0 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.835+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c047480 con 0x7f264c153f40 2023-08-22T00:21:24.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.835+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2644003040 con 0x7f264c153f40 2023-08-22T00:21:24.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.835+0000 7f2632ffd700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 0x7f26380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:24.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.835+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f264407b530 con 0x7f264c153f40 2023-08-22T00:21:24.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.835+0000 7f264affd700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 0x7f26380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:24.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.836+0000 7f264affd700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 0x7f26380613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f263c003900 tx=0x7f263c007d40).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:24.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.839+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f264404c770 con 0x7f264c153f40 2023-08-22T00:21:24.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:24.996+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f264c0a8940 con 0x7f263805ef30 2023-08-22T00:21:25.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.006+0000 7f2632ffd700 1 -- 172.21.15.98:0/1023180742 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353833 (secure 0 0 0) 0x7f264c0a8940 con 0x7f263805ef30 2023-08-22T00:21:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 msgr2=0x7f26380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 0x7f26380613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f263c003900 tx=0x7f263c007d40).stop 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 msgr2=0x7f264c164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f264400b610 tx=0x7f2644009840).stop 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 shutdown_connections 2023-08-22T00:21:25.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f264c153f40 0x7f264c164360 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f264c0a9140 0x7f264c0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f263805ef30 0x7f26380613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 --2- 172.21.15.98:0/1023180742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f264c153b60 0x7f264c0bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 >> 172.21.15.98:0/1023180742 conn(0x7f264c0c5dc0 msgr2=0x7f264c0c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 shutdown_connections 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.009+0000 7f265153d700 1 -- 172.21.15.98:0/1023180742 wait complete. 2023-08-22T00:21:25.014 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:25.022 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:21:24.025155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421956,"kb_used_data":8324,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552764,"statfs":{"total":773094113280,"available":770614030336,"internally_reserved":0,"allocated":8523776,"data_stored":4454715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-84,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001191"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734389+0000","last_change":"2023-08-22T00:21:20.729378+0000","last_active":"2023-08-22T00:21:20.734389+0000","last_peered":"2023-08-22T00:21:20.734389+0000","last_clean":"2023-08-22T00:21:20.734389+0000","last_became_active":"2023-08-22T00:21:20.729042+0000","last_became_peered":"2023-08-22T00:21:20.729042+0000","last_unstale":"2023-08-22T00:21:20.734389+0000","last_undegraded":"2023-08-22T00:21:20.734389+0000","last_fullsized":"2023-08-22T00:21:20.734389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731933+0000","last_change":"2023-08-22T00:21:20.729611+0000","last_active":"2023-08-22T00:21:20.731933+0000","last_peered":"2023-08-22T00:21:20.731933+0000","last_clean":"2023-08-22T00:21:20.731933+0000","last_became_active":"2023-08-22T00:21:20.729410+0000","last_became_peered":"2023-08-22T00:21:20.729410+0000","last_unstale":"2023-08-22T00:21:20.731933+0000","last_undegraded":"2023-08-22T00:21:20.731933+0000","last_fullsized":"2023-08-22T00:21:20.731933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.727699+0000","last_change":"2023-08-22T00:21:20.349669+0000","last_active":"2023-08-22T00:21:20.727699+0000","last_peered":"2023-08-22T00:21:20.727699+0000","last_clean":"2023-08-22T00:21:20.727699+0000","last_became_active":"2023-08-22T00:21:20.349392+0000","last_became_peered":"2023-08-22T00:21:20.349392+0000","last_unstale":"2023-08-22T00:21:20.727699+0000","last_undegraded":"2023-08-22T00:21:20.727699+0000","last_fullsized":"2023-08-22T00:21:20.727699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719814+0000","last_change":"2023-08-22T00:21:20.353551+0000","last_active":"2023-08-22T00:21:20.719814+0000","last_peered":"2023-08-22T00:21:20.719814+0000","last_clean":"2023-08-22T00:21:20.719814+0000","last_became_active":"2023-08-22T00:21:20.353287+0000","last_became_peered":"2023-08-22T00:21:20.353287+0000","last_unstale":"2023-08-22T00:21:20.719814+0000","last_undegraded":"2023-08-22T00:21:20.719814+0000","last_fullsized":"2023-08-22T00:21:20.719814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737730+0000","last_change":"2023-08-22T00:21:20.732701+0000","last_active":"2023-08-22T00:21:20.737730+0000","last_peered":"2023-08-22T00:21:20.737730+0000","last_clean":"2023-08-22T00:21:20.737730+0000","last_became_active":"2023-08-22T00:21:20.732445+0000","last_became_peered":"2023-08-22T00:21:20.732445+0000","last_unstale":"2023-08-22T00:21:20.737730+0000","last_undegraded":"2023-08-22T00:21:20.737730+0000","last_fullsized":"2023-08-22T00:21:20.737730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738437+0000","last_change":"2023-08-22T00:21:20.735960+0000","last_active":"2023-08-22T00:21:20.738437+0000","last_peered":"2023-08-22T00:21:20.738437+0000","last_clean":"2023-08-22T00:21:20.738437+0000","last_became_active":"2023-08-22T00:21:20.735708+0000","last_became_peered":"2023-08-22T00:21:20.735708+0000","last_unstale":"2023-08-22T00:21:20.738437+0000","last_undegraded":"2023-08-22T00:21:20.738437+0000","last_fullsized":"2023-08-22T00:21:20.738437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723535+0000","last_change":"2023-08-22T00:21:20.719435+0000","last_active":"2023-08-22T00:21:20.723535+0000","last_peered":"2023-08-22T00:21:20.723535+0000","last_clean":"2023-08-22T00:21:20.723535+0000","last_became_active":"2023-08-22T00:21:20.719160+0000","last_became_peered":"2023-08-22T00:21:20.719160+0000","last_unstale":"2023-08-22T00:21:20.723535+0000","last_undegraded":"2023-08-22T00:21:20.723535+0000","last_fullsized":"2023-08-22T00:21:20.723535+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725612+0000","last_change":"2023-08-22T00:21:20.723936+0000","last_active":"2023-08-22T00:21:20.725612+0000","last_peered":"2023-08-22T00:21:20.725612+0000","last_clean":"2023-08-22T00:21:20.725612+0000","last_became_active":"2023-08-22T00:21:20.723659+0000","last_became_peered":"2023-08-22T00:21:20.723659+0000","last_unstale":"2023-08-22T00:21:20.725612+0000","last_undegraded":"2023-08-22T00:21:20.725612+0000","last_fullsized":"2023-08-22T00:21:20.725612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734053+0000","last_change":"2023-08-22T00:21:20.354035+0000","last_active":"2023-08-22T00:21:20.734053+0000","last_peered":"2023-08-22T00:21:20.734053+0000","last_clean":"2023-08-22T00:21:20.734053+0000","last_became_active":"2023-08-22T00:21:20.347594+0000","last_became_peered":"2023-08-22T00:21:20.347594+0000","last_unstale":"2023-08-22T00:21:20.734053+0000","last_undegraded":"2023-08-22T00:21:20.734053+0000","last_fullsized":"2023-08-22T00:21:20.734053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737714+0000","last_change":"2023-08-22T00:21:20.732440+0000","last_active":"2023-08-22T00:21:20.737714+0000","last_peered":"2023-08-22T00:21:20.737714+0000","last_clean":"2023-08-22T00:21:20.737714+0000","last_became_active":"2023-08-22T00:21:20.732193+0000","last_became_peered":"2023-08-22T00:21:20.732193+0000","last_unstale":"2023-08-22T00:21:20.737714+0000","last_undegraded":"2023-08-22T00:21:20.737714+0000","last_fullsized":"2023-08-22T00:21:20.737714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740678+0000","last_change":"2023-08-22T00:21:20.737637+0000","last_active":"2023-08-22T00:21:20.740678+0000","last_peered":"2023-08-22T00:21:20.740678+0000","last_clean":"2023-08-22T00:21:20.740678+0000","last_became_active":"2023-08-22T00:21:20.737290+0000","last_became_peered":"2023-08-22T00:21:20.737290+0000","last_unstale":"2023-08-22T00:21:20.740678+0000","last_undegraded":"2023-08-22T00:21:20.740678+0000","last_fullsized":"2023-08-22T00:21:20.740678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715845+0000","last_change":"2023-08-22T00:21:20.353429+0000","last_active":"2023-08-22T00:21:20.715845+0000","last_peered":"2023-08-22T00:21:20.715845+0000","last_clean":"2023-08-22T00:21:20.715845+0000","last_became_active":"2023-08-22T00:21:20.352807+0000","last_became_peered":"2023-08-22T00:21:20.352807+0000","last_unstale":"2023-08-22T00:21:20.715845+0000","last_undegraded":"2023-08-22T00:21:20.715845+0000","last_fullsized":"2023-08-22T00:21:20.715845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722249+0000","last_change":"2023-08-22T00:21:20.352985+0000","last_active":"2023-08-22T00:21:20.722249+0000","last_peered":"2023-08-22T00:21:20.722249+0000","last_clean":"2023-08-22T00:21:20.722249+0000","last_became_active":"2023-08-22T00:21:20.352503+0000","last_became_peered":"2023-08-22T00:21:20.352503+0000","last_unstale":"2023-08-22T00:21:20.722249+0000","last_undegraded":"2023-08-22T00:21:20.722249+0000","last_fullsized":"2023-08-22T00:21:20.722249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717337+0000","last_change":"2023-08-22T00:21:20.347511+0000","last_active":"2023-08-22T00:21:20.717337+0000","last_peered":"2023-08-22T00:21:20.717337+0000","last_clean":"2023-08-22T00:21:20.717337+0000","last_became_active":"2023-08-22T00:21:20.347226+0000","last_became_peered":"2023-08-22T00:21:20.347226+0000","last_unstale":"2023-08-22T00:21:20.717337+0000","last_undegraded":"2023-08-22T00:21:20.717337+0000","last_fullsized":"2023-08-22T00:21:20.717337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734372+0000","last_change":"2023-08-22T00:21:20.729252+0000","last_active":"2023-08-22T00:21:20.734372+0000","last_peered":"2023-08-22T00:21:20.734372+0000","last_clean":"2023-08-22T00:21:20.734372+0000","last_became_active":"2023-08-22T00:21:20.728832+0000","last_became_peered":"2023-08-22T00:21:20.728832+0000","last_unstale":"2023-08-22T00:21:20.734372+0000","last_undegraded":"2023-08-22T00:21:20.734372+0000","last_fullsized":"2023-08-22T00:21:20.734372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738622+0000","last_change":"2023-08-22T00:21:20.735506+0000","last_active":"2023-08-22T00:21:20.738622+0000","last_peered":"2023-08-22T00:21:20.738622+0000","last_clean":"2023-08-22T00:21:20.738622+0000","last_became_active":"2023-08-22T00:21:20.735252+0000","last_became_peered":"2023-08-22T00:21:20.735252+0000","last_unstale":"2023-08-22T00:21:20.738622+0000","last_undegraded":"2023-08-22T00:21:20.738622+0000","last_fullsized":"2023-08-22T00:21:20.738622+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710786+0000","last_change":"2023-08-22T00:21:20.355555+0000","last_active":"2023-08-22T00:21:20.710786+0000","last_peered":"2023-08-22T00:21:20.710786+0000","last_clean":"2023-08-22T00:21:20.710786+0000","last_became_active":"2023-08-22T00:21:20.355267+0000","last_became_peered":"2023-08-22T00:21:20.355267+0000","last_unstale":"2023-08-22T00:21:20.710786+0000","last_undegraded":"2023-08-22T00:21:20.710786+0000","last_fullsized":"2023-08-22T00:21:20.710786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737693+0000","last_change":"2023-08-22T00:21:20.731958+0000","last_active":"2023-08-22T00:21:20.737693+0000","last_peered":"2023-08-22T00:21:20.737693+0000","last_clean":"2023-08-22T00:21:20.737693+0000","last_became_active":"2023-08-22T00:21:20.731704+0000","last_became_peered":"2023-08-22T00:21:20.731704+0000","last_unstale":"2023-08-22T00:21:20.737693+0000","last_undegraded":"2023-08-22T00:21:20.737693+0000","last_fullsized":"2023-08-22T00:21:20.737693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725283+0000","last_change":"2023-08-22T00:21:20.358260+0000","last_active":"2023-08-22T00:21:20.725283+0000","last_peered":"2023-08-22T00:21:20.725283+0000","last_clean":"2023-08-22T00:21:20.725283+0000","last_became_active":"2023-08-22T00:21:20.357898+0000","last_became_peered":"2023-08-22T00:21:20.357898+0000","last_unstale":"2023-08-22T00:21:20.725283+0000","last_undegraded":"2023-08-22T00:21:20.725283+0000","last_fullsized":"2023-08-22T00:21:20.725283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.716664+0000","last_change":"2023-08-22T00:21:20.350690+0000","last_active":"2023-08-22T00:21:20.716664+0000","last_peered":"2023-08-22T00:21:20.716664+0000","last_clean":"2023-08-22T00:21:20.716664+0000","last_became_active":"2023-08-22T00:21:20.350397+0000","last_became_peered":"2023-08-22T00:21:20.350397+0000","last_unstale":"2023-08-22T00:21:20.716664+0000","last_undegraded":"2023-08-22T00:21:20.716664+0000","last_fullsized":"2023-08-22T00:21:20.716664+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735870+0000","last_change":"2023-08-22T00:21:20.727439+0000","last_active":"2023-08-22T00:21:20.735870+0000","last_peered":"2023-08-22T00:21:20.735870+0000","last_clean":"2023-08-22T00:21:20.735870+0000","last_became_active":"2023-08-22T00:21:20.727178+0000","last_became_peered":"2023-08-22T00:21:20.727178+0000","last_unstale":"2023-08-22T00:21:20.735870+0000","last_undegraded":"2023-08-22T00:21:20.735870+0000","last_fullsized":"2023-08-22T00:21:20.735870+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728423+0000","last_change":"2023-08-22T00:21:20.726789+0000","last_active":"2023-08-22T00:21:20.728423+0000","last_peered":"2023-08-22T00:21:20.728423+0000","last_clean":"2023-08-22T00:21:20.728423+0000","last_became_active":"2023-08-22T00:21:20.726517+0000","last_became_peered":"2023-08-22T00:21:20.726517+0000","last_unstale":"2023-08-22T00:21:20.728423+0000","last_undegraded":"2023-08-22T00:21:20.728423+0000","last_fullsized":"2023-08-22T00:21:20.728423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720006+0000","last_change":"2023-08-22T00:21:20.346312+0000","last_active":"2023-08-22T00:21:20.720006+0000","last_peered":"2023-08-22T00:21:20.720006+0000","last_clean":"2023-08-22T00:21:20.720006+0000","last_became_active":"2023-08-22T00:21:20.346053+0000","last_became_peered":"2023-08-22T00:21:20.346053+0000","last_unstale":"2023-08-22T00:21:20.720006+0000","last_undegraded":"2023-08-22T00:21:20.720006+0000","last_fullsized":"2023-08-22T00:21:20.720006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734806+0000","last_change":"2023-08-22T00:21:20.347608+0000","last_active":"2023-08-22T00:21:20.734806+0000","last_peered":"2023-08-22T00:21:20.734806+0000","last_clean":"2023-08-22T00:21:20.734806+0000","last_became_active":"2023-08-22T00:21:20.347316+0000","last_became_peered":"2023-08-22T00:21:20.347316+0000","last_unstale":"2023-08-22T00:21:20.734806+0000","last_undegraded":"2023-08-22T00:21:20.734806+0000","last_fullsized":"2023-08-22T00:21:20.734806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728160+0000","last_change":"2023-08-22T00:21:20.725340+0000","last_active":"2023-08-22T00:21:20.728160+0000","last_peered":"2023-08-22T00:21:20.728160+0000","last_clean":"2023-08-22T00:21:20.728160+0000","last_became_active":"2023-08-22T00:21:20.725088+0000","last_became_peered":"2023-08-22T00:21:20.725088+0000","last_unstale":"2023-08-22T00:21:20.728160+0000","last_undegraded":"2023-08-22T00:21:20.728160+0000","last_fullsized":"2023-08-22T00:21:20.728160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.718507+0000","last_change":"2023-08-22T00:21:20.717902+0000","last_active":"2023-08-22T00:21:20.718507+0000","last_peered":"2023-08-22T00:21:20.718507+0000","last_clean":"2023-08-22T00:21:20.718507+0000","last_became_active":"2023-08-22T00:21:20.717628+0000","last_became_peered":"2023-08-22T00:21:20.717628+0000","last_unstale":"2023-08-22T00:21:20.718507+0000","last_undegraded":"2023-08-22T00:21:20.718507+0000","last_fullsized":"2023-08-22T00:21:20.718507+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738471+0000","last_change":"2023-08-22T00:21:20.735867+0000","last_active":"2023-08-22T00:21:20.738471+0000","last_peered":"2023-08-22T00:21:20.738471+0000","last_clean":"2023-08-22T00:21:20.738471+0000","last_became_active":"2023-08-22T00:21:20.735608+0000","last_became_peered":"2023-08-22T00:21:20.735608+0000","last_unstale":"2023-08-22T00:21:20.738471+0000","last_undegraded":"2023-08-22T00:21:20.738471+0000","last_fullsized":"2023-08-22T00:21:20.738471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728268+0000","last_change":"2023-08-22T00:21:20.725833+0000","last_active":"2023-08-22T00:21:20.728268+0000","last_peered":"2023-08-22T00:21:20.728268+0000","last_clean":"2023-08-22T00:21:20.728268+0000","last_became_active":"2023-08-22T00:21:20.725382+0000","last_became_peered":"2023-08-22T00:21:20.725382+0000","last_unstale":"2023-08-22T00:21:20.728268+0000","last_undegraded":"2023-08-22T00:21:20.728268+0000","last_fullsized":"2023-08-22T00:21:20.728268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719761+0000","last_change":"2023-08-22T00:21:20.344702+0000","last_active":"2023-08-22T00:21:20.719761+0000","last_peered":"2023-08-22T00:21:20.719761+0000","last_clean":"2023-08-22T00:21:20.719761+0000","last_became_active":"2023-08-22T00:21:20.343945+0000","last_became_peered":"2023-08-22T00:21:20.343945+0000","last_unstale":"2023-08-22T00:21:20.719761+0000","last_undegraded":"2023-08-22T00:21:20.719761+0000","last_fullsized":"2023-08-22T00:21:20.719761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.711536+0000","last_change":"2023-08-22T00:21:20.343765+0000","last_active":"2023-08-22T00:21:20.711536+0000","last_peered":"2023-08-22T00:21:20.711536+0000","last_clean":"2023-08-22T00:21:20.711536+0000","last_became_active":"2023-08-22T00:21:20.343499+0000","last_became_peered":"2023-08-22T00:21:20.343499+0000","last_unstale":"2023-08-22T00:21:20.711536+0000","last_undegraded":"2023-08-22T00:21:20.711536+0000","last_fullsized":"2023-08-22T00:21:20.711536+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737756+0000","last_change":"2023-08-22T00:21:20.732191+0000","last_active":"2023-08-22T00:21:20.737756+0000","last_peered":"2023-08-22T00:21:20.737756+0000","last_clean":"2023-08-22T00:21:20.737756+0000","last_became_active":"2023-08-22T00:21:20.731502+0000","last_became_peered":"2023-08-22T00:21:20.731502+0000","last_unstale":"2023-08-22T00:21:20.737756+0000","last_undegraded":"2023-08-22T00:21:20.737756+0000","last_fullsized":"2023-08-22T00:21:20.737756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719518+0000","last_change":"2023-08-22T00:21:20.347336+0000","last_active":"2023-08-22T00:21:20.719518+0000","last_peered":"2023-08-22T00:21:20.719518+0000","last_clean":"2023-08-22T00:21:20.719518+0000","last_became_active":"2023-08-22T00:21:20.347061+0000","last_became_peered":"2023-08-22T00:21:20.347061+0000","last_unstale":"2023-08-22T00:21:20.719518+0000","last_undegraded":"2023-08-22T00:21:20.719518+0000","last_fullsized":"2023-08-22T00:21:20.719518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728141+0000","last_change":"2023-08-22T00:21:20.724613+0000","last_active":"2023-08-22T00:21:20.728141+0000","last_peered":"2023-08-22T00:21:20.728141+0000","last_clean":"2023-08-22T00:21:20.728141+0000","last_became_active":"2023-08-22T00:21:20.724352+0000","last_became_peered":"2023-08-22T00:21:20.724352+0000","last_unstale":"2023-08-22T00:21:20.728141+0000","last_undegraded":"2023-08-22T00:21:20.728141+0000","last_fullsized":"2023-08-22T00:21:20.728141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244277+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:16.244277+0000","last_peered":"2023-08-22T00:21:16.244277+0000","last_clean":"2023-08-22T00:21:16.244277+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:16.244277+0000","last_undegraded":"2023-08-22T00:21:16.244277+0000","last_fullsized":"2023-08-22T00:21:16.244277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734278+0000","last_change":"2023-08-22T00:21:20.728548+0000","last_active":"2023-08-22T00:21:20.734278+0000","last_peered":"2023-08-22T00:21:20.734278+0000","last_clean":"2023-08-22T00:21:20.734278+0000","last_became_active":"2023-08-22T00:21:20.728060+0000","last_became_peered":"2023-08-22T00:21:20.728060+0000","last_unstale":"2023-08-22T00:21:20.734278+0000","last_undegraded":"2023-08-22T00:21:20.734278+0000","last_fullsized":"2023-08-22T00:21:20.734278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:16.971582+0000","last_peered":"2023-08-22T00:21:16.971582+0000","last_clean":"2023-08-22T00:21:16.971582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:16.971582+0000","last_undegraded":"2023-08-22T00:21:16.971582+0000","last_fullsized":"2023-08-22T00:21:16.971582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735680+0000","last_change":"2023-08-22T00:21:20.733035+0000","last_active":"2023-08-22T00:21:20.735680+0000","last_peered":"2023-08-22T00:21:20.735680+0000","last_clean":"2023-08-22T00:21:20.735680+0000","last_became_active":"2023-08-22T00:21:20.732780+0000","last_became_peered":"2023-08-22T00:21:20.732780+0000","last_unstale":"2023-08-22T00:21:20.735680+0000","last_undegraded":"2023-08-22T00:21:20.735680+0000","last_fullsized":"2023-08-22T00:21:20.735680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719654+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:20.719654+0000","last_peered":"2023-08-22T00:21:20.719654+0000","last_clean":"2023-08-22T00:21:20.719654+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:20.719654+0000","last_undegraded":"2023-08-22T00:21:20.719654+0000","last_fullsized":"2023-08-22T00:21:20.719654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.744597+0000","last_change":"2023-08-22T00:21:20.739813+0000","last_active":"2023-08-22T00:21:20.744597+0000","last_peered":"2023-08-22T00:21:20.744597+0000","last_clean":"2023-08-22T00:21:20.744597+0000","last_became_active":"2023-08-22T00:21:20.739538+0000","last_became_peered":"2023-08-22T00:21:20.739538+0000","last_unstale":"2023-08-22T00:21:20.744597+0000","last_undegraded":"2023-08-22T00:21:20.744597+0000","last_fullsized":"2023-08-22T00:21:20.744597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971579+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:16.971579+0000","last_peered":"2023-08-22T00:21:16.971579+0000","last_clean":"2023-08-22T00:21:16.971579+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:16.971579+0000","last_undegraded":"2023-08-22T00:21:16.971579+0000","last_fullsized":"2023-08-22T00:21:16.971579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971284+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:16.971284+0000","last_peered":"2023-08-22T00:21:16.971284+0000","last_clean":"2023-08-22T00:21:16.971284+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:16.971284+0000","last_undegraded":"2023-08-22T00:21:16.971284+0000","last_fullsized":"2023-08-22T00:21:16.971284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734288+0000","last_change":"2023-08-22T00:21:20.727025+0000","last_active":"2023-08-22T00:21:20.734288+0000","last_peered":"2023-08-22T00:21:20.734288+0000","last_clean":"2023-08-22T00:21:20.734288+0000","last_became_active":"2023-08-22T00:21:20.726812+0000","last_became_peered":"2023-08-22T00:21:20.726812+0000","last_unstale":"2023-08-22T00:21:20.734288+0000","last_undegraded":"2023-08-22T00:21:20.734288+0000","last_fullsized":"2023-08-22T00:21:20.734288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710877+0000","last_change":"2023-08-22T00:21:20.348991+0000","last_active":"2023-08-22T00:21:20.710877+0000","last_peered":"2023-08-22T00:21:20.710877+0000","last_clean":"2023-08-22T00:21:20.710877+0000","last_became_active":"2023-08-22T00:21:20.348661+0000","last_became_peered":"2023-08-22T00:21:20.348661+0000","last_unstale":"2023-08-22T00:21:20.710877+0000","last_undegraded":"2023-08-22T00:21:20.710877+0000","last_fullsized":"2023-08-22T00:21:20.710877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971286+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:16.971286+0000","last_peered":"2023-08-22T00:21:16.971286+0000","last_clean":"2023-08-22T00:21:16.971286+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:16.971286+0000","last_undegraded":"2023-08-22T00:21:16.971286+0000","last_fullsized":"2023-08-22T00:21:16.971286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971288+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:16.971288+0000","last_peered":"2023-08-22T00:21:16.971288+0000","last_clean":"2023-08-22T00:21:16.971288+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:16.971288+0000","last_undegraded":"2023-08-22T00:21:16.971288+0000","last_fullsized":"2023-08-22T00:21:16.971288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244342+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:16.244342+0000","last_peered":"2023-08-22T00:21:16.244342+0000","last_clean":"2023-08-22T00:21:16.244342+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:16.244342+0000","last_undegraded":"2023-08-22T00:21:16.244342+0000","last_fullsized":"2023-08-22T00:21:16.244342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.239814+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:16.239814+0000","last_peered":"2023-08-22T00:21:16.239814+0000","last_clean":"2023-08-22T00:21:16.239814+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:16.239814+0000","last_undegraded":"2023-08-22T00:21:16.239814+0000","last_fullsized":"2023-08-22T00:21:16.239814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":30,"acting":30,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.441,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.36499999999999999,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.79600000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.48799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.46700000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.79100000000000004},"last":0.438}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.308},"max":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.751},"last":0.41399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.374},{"interface":"front","average":{"1min":0.495,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.748,"15min":0.95399999999999996},"last":0.56399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.84099999999999997},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065532,"statfs":{"total":96636764160,"available":96323104768,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.46400000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.751,"5min":0.755,"15min":0.99299999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.41199999999999998,"15min":0.29599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.751},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.073},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69399999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.753,"15min":0.94399999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.752,"15min":1.03},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39000000000000001,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.184},"max":{"1min":0.54900000000000004,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.374,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.501,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.57499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":1.117,"15min":1.3360000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.83199999999999996,"5min":2.298,"15min":2.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":2.992,"15min":2.992},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.78000000000000003,"5min":2.323,"15min":2.323},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.505,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.432,"15min":0.41899999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56000000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.443}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.84099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.38900000000000001},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":1.0149999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.26400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.20499999999999999},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":0.625,"5min":0.67900000000000005,"15min":0.71199999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"min":{"1min":0.32600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":1.0580000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.97899999999999998,"15min":1.0169999999999999},"last":0.441}]},{"osd":5,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":0.77800000000000002,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.95199999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":0.998,"15min":0.998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.89600000000000002,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":0.96499999999999997,"15min":1.0349999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.98599999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":574470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.314,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.32900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.63600000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.33100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.47799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.89500000000000002,"15min":11.163},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.77600000000000002},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.71699999999999997,"5min":0.753,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77300000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.78700000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.82299999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.75600000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.30199999999999999},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77800000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.85899999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.46500000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.873},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.313},"max":{"1min":0.72299999999999998,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67900000000000005,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.95999999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.88},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51700000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:25.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-08-22T00:21:25.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-08-22T00:21:25.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-08-22T00:21:25.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-08-22T00:21:25.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-08-22T00:21:25.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-08-22T00:21:25.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-08-22T00:21:25.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-08-22T00:21:25.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-08-22T00:21:25.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-08-22T00:21:25.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-08-22T00:21:25.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-08-22T00:21:25.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-08-22T00:21:25.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-08-22T00:21:25.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-08-22T00:21:25.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-08-22T00:21:25.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-08-22T00:21:25.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-08-22T00:21:25.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-08-22T00:21:25.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-08-22T00:21:25.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-08-22T00:21:25.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-08-22T00:21:25.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-08-22T00:21:25.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-08-22T00:21:25.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-08-22T00:21:25.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-08-22T00:21:25.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-08-22T00:21:25.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-08-22T00:21:25.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-08-22T00:21:25.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-08-22T00:21:25.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-08-22T00:21:25.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-08-22T00:21:25.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-08-22T00:21:25.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-08-22T00:21:25.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-08-22T00:21:25.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-08-22T00:21:25.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-08-22T00:21:25.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-08-22T00:21:25.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-08-22T00:21:25.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-08-22T00:21:25.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-08-22T00:21:25.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-08-22T00:21:25.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-08-22T00:21:25.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-08-22T00:21:25.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-08-22T00:21:25.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-08-22T00:21:25.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-08-22T00:21:25.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-08-22T00:21:25.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-08-22T00:21:25.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-08-22T00:21:25.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-08-22T00:21:25.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-08-22T00:21:25.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-08-22T00:21:25.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-08-22T00:21:25.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-08-22T00:21:25.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-08-22T00:21:25.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-08-22T00:21:25.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-08-22T00:21:25.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-08-22T00:21:25.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-08-22T00:21:25.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-08-22T00:21:25.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-08-22T00:21:25.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-08-22T00:21:25.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-08-22T00:21:25.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-08-22T00:21:25.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-08-22T00:21:25.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-08-22T00:21:25.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-08-22T00:21:25.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-08-22T00:21:25.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-08-22T00:21:25.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-08-22T00:21:25.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-08-22T00:21:25.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-08-22T00:21:25.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-08-22T00:21:25.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-08-22T00:21:25.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-08-22T00:21:25.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-08-22T00:21:25.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-08-22T00:21:25.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-08-22T00:21:25.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-08-22T00:21:25.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-08-22T00:21:25.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-08-22T00:21:25.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-08-22T00:21:25.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-08-22T00:21:25.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-08-22T00:21:25.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-08-22T00:21:25.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-08-22T00:21:25.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-08-22T00:21:25.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-08-22T00:21:25.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:20.322833+0000', 'last_change': '2023-08-22T00:21:20.322833+0000', 'last_active': '2023-08-22T00:21:20.322833+0000', 'last_peered': '2023-08-22T00:21:20.322833+0000', 'last_clean': '2023-08-22T00:21:20.322833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:20.322833+0000', 'last_undegraded': '2023-08-22T00:21:20.322833+0000', 'last_fullsized': '2023-08-22T00:21:20.322833+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:20.322833+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-08-22T00:21:25.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:21:19.318036+0000', 'last_change': '2023-08-22T00:21:19.318036+0000', 'last_active': '2023-08-22T00:21:19.318036+0000', 'last_peered': '2023-08-22T00:21:19.318036+0000', 'last_clean': '2023-08-22T00:21:19.318036+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:21:19.318036+0000', 'last_undegraded': '2023-08-22T00:21:19.318036+0000', 'last_fullsized': '2023-08-22T00:21:19.318036+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'last_clean_scrub_stamp': '2023-08-22T00:21:19.318036+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:21:25.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:21:25.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.209+0000 7fbd7b8ce700 1 Processor -- start 2023-08-22T00:21:25.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.209+0000 7fbd7b8ce700 1 -- start start 2023-08-22T00:21:25.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 0x7fbd740c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 0x7fbd740a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbd74065f10 0x7fbd74066380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740bd3e0 con 0x7fbd74065f10 2023-08-22T00:21:25.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd74066870 con 0x7fbd740bd870 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7b8ce700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740bd0c0 con 0x7fbd74150e40 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbd74065f10 0x7fbd74066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbd74065f10 0x7fbd74066380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53338/0 (socket says 172.21.15.98:53338) 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 -- 172.21.15.98:0/1593131652 learned_addr learned my addr 172.21.15.98:0/1593131652 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd78e69700 1 --2- 172.21.15.98:0/1593131652 >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 0x7fbd740a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 0x7fbd740c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 -- 172.21.15.98:0/1593131652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 msgr2=0x7fbd740c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 0x7fbd740c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 -- 172.21.15.98:0/1593131652 >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 msgr2=0x7fbd740a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.210+0000 7fbd79e6b700 1 --2- 172.21.15.98:0/1593131652 >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 0x7fbd740a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd79e6b700 1 -- 172.21.15.98:0/1593131652 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740c3bb0 con 0x7fbd74065f10 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd78e69700 1 --2- 172.21.15.98:0/1593131652 >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 0x7fbd740a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 0x7fbd740c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd79e6b700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd74065f10 0x7fbd74066380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fbd74062df0 tx=0x7fbd6c009840).ready entity=mon.0 client_cookie=2ab6fde4fcd2424f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd6bfff700 1 -- 172.21.15.98:0/1593131652 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00e070 con 0x7fbd74065f10 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd6bfff700 1 -- 172.21.15.98:0/1593131652 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00ba50 con 0x7fbd74065f10 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd6bfff700 1 -- 172.21.15.98:0/1593131652 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00bdd0 con 0x7fbd74065f10 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1593131652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd74065f10 msgr2=0x7fbd74066380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd74065f10 0x7fbd74066380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fbd74062df0 tx=0x7fbd6c009840).stop 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1593131652 shutdown_connections 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74150e40 0x7fbd740c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1593131652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd74065f10 0x7fbd74066380 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1593131652 >> v2:172.21.15.118:3300/0 conn(0x7fbd740bd870 0x7fbd740a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1593131652 >> 172.21.15.98:0/1593131652 conn(0x7fbd7406a980 msgr2=0x7fbd740c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:25.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1593131652 shutdown_connections 2023-08-22T00:21:25.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.211+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1593131652 wait complete. 2023-08-22T00:21:25.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.212+0000 7fbd7b8ce700 1 Processor -- start 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 -- start start 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 0x7fbd7414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd74150e40 0x7fbd740a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740abf00 con 0x7fbd740bd870 2023-08-22T00:21:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740ab070 con 0x7fbd74150e40 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.213+0000 7fbd7b8ce700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740ab350 con 0x7fbd74065f10 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53344/0 (socket says 172.21.15.98:53344) 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 -- 172.21.15.98:0/1401259559 learned_addr learned my addr 172.21.15.98:0/1401259559 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd79e6b700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd74150e40 0x7fbd740a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 0x7fbd7414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 -- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 msgr2=0x7fbd7414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 0x7fbd7414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 -- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd74150e40 msgr2=0x7fbd740a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd74150e40 0x7fbd740a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 -- 172.21.15.98:0/1401259559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009ae0 con 0x7fbd740bd870 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 0x7fbd7414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd78e69700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fbd7000c850 tx=0x7fbd70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70010580 con 0x7fbd740bd870 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd700106e0 con 0x7fbd740bd870 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740ab630 con 0x7fbd740bd870 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70010a60 con 0x7fbd740bd870 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.214+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740aac10 con 0x7fbd740bd870 2023-08-22T00:21:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.215+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd740ac0b0 con 0x7fbd740bd870 2023-08-22T00:21:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.215+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbd7001b460 con 0x7fbd740bd870 2023-08-22T00:21:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.216+0000 7fbd697fa700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 0x7fbd580613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.216+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbd7007a0d0 con 0x7fbd740bd870 2023-08-22T00:21:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.216+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 0x7fbd580613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.216+0000 7fbd7966a700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 0x7fbd580613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fbd64006fd0 tx=0x7fbd64008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.220+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd7004b200 con 0x7fbd740bd870 2023-08-22T00:21:25.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.448+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbd74047480 con 0x7fbd740bd870 2023-08-22T00:21:25.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.448+0000 7fbd697fa700 1 -- 172.21.15.98:0/1401259559 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7fbd7004e820 con 0x7fbd740bd870 2023-08-22T00:21:25.450 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:25.451 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":934,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":90,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":90},{"state_name":"active+clean","count":47}],"num_pgs":137,"num_pools":4,"num_objects":4,"data_bytes":90,"bytes_used":2480082944,"bytes_avail":770614030336,"bytes_total":773094113280,"unknown_pgs_ratio":0.65693432092666626},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6441}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-22T00:20:14.810414+0000","services":{}},"progress_events":{}} 2023-08-22T00:21:25.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 msgr2=0x7fbd580613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 0x7fbd580613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fbd64006fd0 tx=0x7fbd64008040).stop 2023-08-22T00:21:25.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 msgr2=0x7fbd740aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fbd7000c850 tx=0x7fbd70008040).stop 2023-08-22T00:21:25.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 shutdown_connections 2023-08-22T00:21:25.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd5805ef30 0x7fbd580613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd74065f10 0x7fbd7414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd74150e40 0x7fbd740a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 --2- 172.21.15.98:0/1401259559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd740bd870 0x7fbd740aa720 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 >> 172.21.15.98:0/1401259559 conn(0x7fbd7406a980 msgr2=0x7fbd740a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:25.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 shutdown_connections 2023-08-22T00:21:25.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.450+0000 7fbd7b8ce700 1 -- 172.21.15.98:0/1401259559 wait complete. 2023-08-22T00:21:25.463 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:21:25.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:25.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.579+0000 7f2fb7177700 1 Processor -- start 2023-08-22T00:21:25.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.579+0000 7f2fb7177700 1 -- start start 2023-08-22T00:21:25.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.580+0000 7f2fb7177700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2fb0153f10 0x7f2fb0150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.580+0000 7f2fb7177700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2fb00c26b0 0x7f2fb00c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.580+0000 7f2fb7177700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00c2220 con 0x7f2fb0150040 2023-08-22T00:21:25.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.580+0000 7f2fb7177700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00c5bd0 con 0x7f2fb0153f10 2023-08-22T00:21:25.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.580+0000 7f2fb7177700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00c1ef0 con 0x7f2fb00c26b0 2023-08-22T00:21:25.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2fb0153f10 0x7f2fb0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2fb0153f10 0x7f2fb0150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53360/0 (socket says 172.21.15.98:53360) 2023-08-22T00:21:25.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 -- 172.21.15.98:0/1310726830 learned_addr learned my addr 172.21.15.98:0/1310726830 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:25.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2fb5714700 1 --2- 172.21.15.98:0/1310726830 >> v2:172.21.15.118:3300/0 conn(0x7f2fb00c26b0 0x7f2fb00c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 -- 172.21.15.98:0/1310726830 >> v2:172.21.15.118:3300/0 conn(0x7f2fb00c26b0 msgr2=0x7f2fb00c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:25.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 --2- 172.21.15.98:0/1310726830 >> v2:172.21.15.118:3300/0 conn(0x7f2fb00c26b0 0x7f2fb00c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 -- 172.21.15.98:0/1310726830 >> v1:172.21.15.118:6789/0 conn(0x7f2fb0150040 legacy=0x7f2fb00c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 -- 172.21.15.98:0/1310726830 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00c5e30 con 0x7f2fb0153f10 2023-08-22T00:21:25.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faffff700 1 --2- 172.21.15.98:0/1310726830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0153f10 0x7f2fb0150420 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f2fb00c4cd0 tx=0x7f2f9c00a2b0).ready entity=mon.0 client_cookie=a3c92eb5cb111628 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faf7fe700 1 -- 172.21.15.98:0/1310726830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00c940 con 0x7f2fb0153f10 2023-08-22T00:21:25.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faf7fe700 1 -- 172.21.15.98:0/1310726830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c00caa0 con 0x7f2fb0153f10 2023-08-22T00:21:25.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.581+0000 7f2faf7fe700 1 -- 172.21.15.98:0/1310726830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00ce20 con 0x7f2fb0153f10 2023-08-22T00:21:25.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 -- 172.21.15.98:0/1310726830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0153f10 msgr2=0x7f2fb0150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 --2- 172.21.15.98:0/1310726830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0153f10 0x7f2fb0150420 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f2fb00c4cd0 tx=0x7f2f9c00a2b0).stop 2023-08-22T00:21:25.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 -- 172.21.15.98:0/1310726830 shutdown_connections 2023-08-22T00:21:25.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 --2- 172.21.15.98:0/1310726830 >> v2:172.21.15.118:3300/0 conn(0x7f2fb00c26b0 0x7f2fb00c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 --2- 172.21.15.98:0/1310726830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0153f10 0x7f2fb0150420 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 -- 172.21.15.98:0/1310726830 >> 172.21.15.98:0/1310726830 conn(0x7f2fb00c7140 msgr2=0x7f2fb00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:25.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 -- 172.21.15.98:0/1310726830 shutdown_connections 2023-08-22T00:21:25.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.582+0000 7f2fb7177700 1 -- 172.21.15.98:0/1310726830 wait complete. 2023-08-22T00:21:25.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.583+0000 7f2fb7177700 1 Processor -- start 2023-08-22T00:21:25.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.583+0000 7f2fb7177700 1 -- start start 2023-08-22T00:21:25.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 0x7f2fb0150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 0x7f2fb014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00a6890 con 0x7f2fb0150040 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00bec70 con 0x7f2fb0153f10 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb7177700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00a6ae0 con 0x7f2fb00c26b0 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53368/0 (socket says 172.21.15.98:53368) 2023-08-22T00:21:25.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 -- 172.21.15.98:0/339716058 learned_addr learned my addr 172.21.15.98:0/339716058 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:25.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb5714700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 0x7f2fb014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb4f13700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 0x7f2fb0150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 -- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 msgr2=0x7f2fb0150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 0x7f2fb0150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 -- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 msgr2=0x7f2fb014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 0x7f2fb014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 -- 172.21.15.98:0/339716058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c00a510 con 0x7f2fb0150040 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb5714700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 0x7f2fb014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2fb4f13700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 0x7f2fb0150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2faffff700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f2fb00c4140 tx=0x7f2f9c00a2b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.584+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00ce20 con 0x7f2fb0150040 2023-08-22T00:21:25.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.585+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c023430 con 0x7f2fb0150040 2023-08-22T00:21:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.585+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00a6dc0 con 0x7f2fb0150040 2023-08-22T00:21:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.585+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0237d0 con 0x7f2fb0150040 2023-08-22T00:21:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.585+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb00be900 con 0x7f2fb0150040 2023-08-22T00:21:25.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.586+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0047480 con 0x7f2fb0150040 2023-08-22T00:21:25.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.586+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2f9c023bc0 con 0x7f2fb0150040 2023-08-22T00:21:25.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.586+0000 7f2facff9700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 0x7f2f940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.586+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2f9c07b910 con 0x7f2fb0150040 2023-08-22T00:21:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.586+0000 7f2fb4f13700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 0x7f2f940613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.587+0000 7f2fb4f13700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 0x7f2f940613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2fa4001680 tx=0x7f2fa4009040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.590+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f9c04caa0 con 0x7f2fb0150040 2023-08-22T00:21:25.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.745+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fb0154d70 con 0x7f2f9405ef30 2023-08-22T00:21:25.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.754+0000 7f2facff9700 1 -- 172.21.15.98:0/339716058 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353833 (secure 0 0 0) 0x7f2fb0154d70 con 0x7f2f9405ef30 2023-08-22T00:21:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:25.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 msgr2=0x7f2f940613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 0x7f2f940613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2fa4001680 tx=0x7f2fa4009040).stop 2023-08-22T00:21:25.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 msgr2=0x7f2fb00a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:25.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f2fb00c4140 tx=0x7f2f9c00a2b0).stop 2023-08-22T00:21:25.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 shutdown_connections 2023-08-22T00:21:25.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f9405ef30 0x7f2f940613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fb00c26b0 0x7f2fb0150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fb0153f10 0x7f2fb014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 --2- 172.21.15.98:0/339716058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fb0150040 0x7f2fb00a7ac0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.757+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 >> 172.21.15.98:0/339716058 conn(0x7f2fb00c7140 msgr2=0x7f2fb00ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.758+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 shutdown_connections 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:25.758+0000 7f2fb7177700 1 -- 172.21.15.98:0/339716058 wait complete. 2023-08-22T00:21:25.767 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:25.771 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:21:24.025155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421956,"kb_used_data":8324,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552764,"statfs":{"total":773094113280,"available":770614030336,"internally_reserved":0,"allocated":8523776,"data_stored":4454715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-84,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001191"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734389+0000","last_change":"2023-08-22T00:21:20.729378+0000","last_active":"2023-08-22T00:21:20.734389+0000","last_peered":"2023-08-22T00:21:20.734389+0000","last_clean":"2023-08-22T00:21:20.734389+0000","last_became_active":"2023-08-22T00:21:20.729042+0000","last_became_peered":"2023-08-22T00:21:20.729042+0000","last_unstale":"2023-08-22T00:21:20.734389+0000","last_undegraded":"2023-08-22T00:21:20.734389+0000","last_fullsized":"2023-08-22T00:21:20.734389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731933+0000","last_change":"2023-08-22T00:21:20.729611+0000","last_active":"2023-08-22T00:21:20.731933+0000","last_peered":"2023-08-22T00:21:20.731933+0000","last_clean":"2023-08-22T00:21:20.731933+0000","last_became_active":"2023-08-22T00:21:20.729410+0000","last_became_peered":"2023-08-22T00:21:20.729410+0000","last_unstale":"2023-08-22T00:21:20.731933+0000","last_undegraded":"2023-08-22T00:21:20.731933+0000","last_fullsized":"2023-08-22T00:21:20.731933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.727699+0000","last_change":"2023-08-22T00:21:20.349669+0000","last_active":"2023-08-22T00:21:20.727699+0000","last_peered":"2023-08-22T00:21:20.727699+0000","last_clean":"2023-08-22T00:21:20.727699+0000","last_became_active":"2023-08-22T00:21:20.349392+0000","last_became_peered":"2023-08-22T00:21:20.349392+0000","last_unstale":"2023-08-22T00:21:20.727699+0000","last_undegraded":"2023-08-22T00:21:20.727699+0000","last_fullsized":"2023-08-22T00:21:20.727699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719814+0000","last_change":"2023-08-22T00:21:20.353551+0000","last_active":"2023-08-22T00:21:20.719814+0000","last_peered":"2023-08-22T00:21:20.719814+0000","last_clean":"2023-08-22T00:21:20.719814+0000","last_became_active":"2023-08-22T00:21:20.353287+0000","last_became_peered":"2023-08-22T00:21:20.353287+0000","last_unstale":"2023-08-22T00:21:20.719814+0000","last_undegraded":"2023-08-22T00:21:20.719814+0000","last_fullsized":"2023-08-22T00:21:20.719814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737730+0000","last_change":"2023-08-22T00:21:20.732701+0000","last_active":"2023-08-22T00:21:20.737730+0000","last_peered":"2023-08-22T00:21:20.737730+0000","last_clean":"2023-08-22T00:21:20.737730+0000","last_became_active":"2023-08-22T00:21:20.732445+0000","last_became_peered":"2023-08-22T00:21:20.732445+0000","last_unstale":"2023-08-22T00:21:20.737730+0000","last_undegraded":"2023-08-22T00:21:20.737730+0000","last_fullsized":"2023-08-22T00:21:20.737730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738437+0000","last_change":"2023-08-22T00:21:20.735960+0000","last_active":"2023-08-22T00:21:20.738437+0000","last_peered":"2023-08-22T00:21:20.738437+0000","last_clean":"2023-08-22T00:21:20.738437+0000","last_became_active":"2023-08-22T00:21:20.735708+0000","last_became_peered":"2023-08-22T00:21:20.735708+0000","last_unstale":"2023-08-22T00:21:20.738437+0000","last_undegraded":"2023-08-22T00:21:20.738437+0000","last_fullsized":"2023-08-22T00:21:20.738437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723535+0000","last_change":"2023-08-22T00:21:20.719435+0000","last_active":"2023-08-22T00:21:20.723535+0000","last_peered":"2023-08-22T00:21:20.723535+0000","last_clean":"2023-08-22T00:21:20.723535+0000","last_became_active":"2023-08-22T00:21:20.719160+0000","last_became_peered":"2023-08-22T00:21:20.719160+0000","last_unstale":"2023-08-22T00:21:20.723535+0000","last_undegraded":"2023-08-22T00:21:20.723535+0000","last_fullsized":"2023-08-22T00:21:20.723535+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725612+0000","last_change":"2023-08-22T00:21:20.723936+0000","last_active":"2023-08-22T00:21:20.725612+0000","last_peered":"2023-08-22T00:21:20.725612+0000","last_clean":"2023-08-22T00:21:20.725612+0000","last_became_active":"2023-08-22T00:21:20.723659+0000","last_became_peered":"2023-08-22T00:21:20.723659+0000","last_unstale":"2023-08-22T00:21:20.725612+0000","last_undegraded":"2023-08-22T00:21:20.725612+0000","last_fullsized":"2023-08-22T00:21:20.725612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734053+0000","last_change":"2023-08-22T00:21:20.354035+0000","last_active":"2023-08-22T00:21:20.734053+0000","last_peered":"2023-08-22T00:21:20.734053+0000","last_clean":"2023-08-22T00:21:20.734053+0000","last_became_active":"2023-08-22T00:21:20.347594+0000","last_became_peered":"2023-08-22T00:21:20.347594+0000","last_unstale":"2023-08-22T00:21:20.734053+0000","last_undegraded":"2023-08-22T00:21:20.734053+0000","last_fullsized":"2023-08-22T00:21:20.734053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737714+0000","last_change":"2023-08-22T00:21:20.732440+0000","last_active":"2023-08-22T00:21:20.737714+0000","last_peered":"2023-08-22T00:21:20.737714+0000","last_clean":"2023-08-22T00:21:20.737714+0000","last_became_active":"2023-08-22T00:21:20.732193+0000","last_became_peered":"2023-08-22T00:21:20.732193+0000","last_unstale":"2023-08-22T00:21:20.737714+0000","last_undegraded":"2023-08-22T00:21:20.737714+0000","last_fullsized":"2023-08-22T00:21:20.737714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740678+0000","last_change":"2023-08-22T00:21:20.737637+0000","last_active":"2023-08-22T00:21:20.740678+0000","last_peered":"2023-08-22T00:21:20.740678+0000","last_clean":"2023-08-22T00:21:20.740678+0000","last_became_active":"2023-08-22T00:21:20.737290+0000","last_became_peered":"2023-08-22T00:21:20.737290+0000","last_unstale":"2023-08-22T00:21:20.740678+0000","last_undegraded":"2023-08-22T00:21:20.740678+0000","last_fullsized":"2023-08-22T00:21:20.740678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715845+0000","last_change":"2023-08-22T00:21:20.353429+0000","last_active":"2023-08-22T00:21:20.715845+0000","last_peered":"2023-08-22T00:21:20.715845+0000","last_clean":"2023-08-22T00:21:20.715845+0000","last_became_active":"2023-08-22T00:21:20.352807+0000","last_became_peered":"2023-08-22T00:21:20.352807+0000","last_unstale":"2023-08-22T00:21:20.715845+0000","last_undegraded":"2023-08-22T00:21:20.715845+0000","last_fullsized":"2023-08-22T00:21:20.715845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722249+0000","last_change":"2023-08-22T00:21:20.352985+0000","last_active":"2023-08-22T00:21:20.722249+0000","last_peered":"2023-08-22T00:21:20.722249+0000","last_clean":"2023-08-22T00:21:20.722249+0000","last_became_active":"2023-08-22T00:21:20.352503+0000","last_became_peered":"2023-08-22T00:21:20.352503+0000","last_unstale":"2023-08-22T00:21:20.722249+0000","last_undegraded":"2023-08-22T00:21:20.722249+0000","last_fullsized":"2023-08-22T00:21:20.722249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717337+0000","last_change":"2023-08-22T00:21:20.347511+0000","last_active":"2023-08-22T00:21:20.717337+0000","last_peered":"2023-08-22T00:21:20.717337+0000","last_clean":"2023-08-22T00:21:20.717337+0000","last_became_active":"2023-08-22T00:21:20.347226+0000","last_became_peered":"2023-08-22T00:21:20.347226+0000","last_unstale":"2023-08-22T00:21:20.717337+0000","last_undegraded":"2023-08-22T00:21:20.717337+0000","last_fullsized":"2023-08-22T00:21:20.717337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734372+0000","last_change":"2023-08-22T00:21:20.729252+0000","last_active":"2023-08-22T00:21:20.734372+0000","last_peered":"2023-08-22T00:21:20.734372+0000","last_clean":"2023-08-22T00:21:20.734372+0000","last_became_active":"2023-08-22T00:21:20.728832+0000","last_became_peered":"2023-08-22T00:21:20.728832+0000","last_unstale":"2023-08-22T00:21:20.734372+0000","last_undegraded":"2023-08-22T00:21:20.734372+0000","last_fullsized":"2023-08-22T00:21:20.734372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738622+0000","last_change":"2023-08-22T00:21:20.735506+0000","last_active":"2023-08-22T00:21:20.738622+0000","last_peered":"2023-08-22T00:21:20.738622+0000","last_clean":"2023-08-22T00:21:20.738622+0000","last_became_active":"2023-08-22T00:21:20.735252+0000","last_became_peered":"2023-08-22T00:21:20.735252+0000","last_unstale":"2023-08-22T00:21:20.738622+0000","last_undegraded":"2023-08-22T00:21:20.738622+0000","last_fullsized":"2023-08-22T00:21:20.738622+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710786+0000","last_change":"2023-08-22T00:21:20.355555+0000","last_active":"2023-08-22T00:21:20.710786+0000","last_peered":"2023-08-22T00:21:20.710786+0000","last_clean":"2023-08-22T00:21:20.710786+0000","last_became_active":"2023-08-22T00:21:20.355267+0000","last_became_peered":"2023-08-22T00:21:20.355267+0000","last_unstale":"2023-08-22T00:21:20.710786+0000","last_undegraded":"2023-08-22T00:21:20.710786+0000","last_fullsized":"2023-08-22T00:21:20.710786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737693+0000","last_change":"2023-08-22T00:21:20.731958+0000","last_active":"2023-08-22T00:21:20.737693+0000","last_peered":"2023-08-22T00:21:20.737693+0000","last_clean":"2023-08-22T00:21:20.737693+0000","last_became_active":"2023-08-22T00:21:20.731704+0000","last_became_peered":"2023-08-22T00:21:20.731704+0000","last_unstale":"2023-08-22T00:21:20.737693+0000","last_undegraded":"2023-08-22T00:21:20.737693+0000","last_fullsized":"2023-08-22T00:21:20.737693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725283+0000","last_change":"2023-08-22T00:21:20.358260+0000","last_active":"2023-08-22T00:21:20.725283+0000","last_peered":"2023-08-22T00:21:20.725283+0000","last_clean":"2023-08-22T00:21:20.725283+0000","last_became_active":"2023-08-22T00:21:20.357898+0000","last_became_peered":"2023-08-22T00:21:20.357898+0000","last_unstale":"2023-08-22T00:21:20.725283+0000","last_undegraded":"2023-08-22T00:21:20.725283+0000","last_fullsized":"2023-08-22T00:21:20.725283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.716664+0000","last_change":"2023-08-22T00:21:20.350690+0000","last_active":"2023-08-22T00:21:20.716664+0000","last_peered":"2023-08-22T00:21:20.716664+0000","last_clean":"2023-08-22T00:21:20.716664+0000","last_became_active":"2023-08-22T00:21:20.350397+0000","last_became_peered":"2023-08-22T00:21:20.350397+0000","last_unstale":"2023-08-22T00:21:20.716664+0000","last_undegraded":"2023-08-22T00:21:20.716664+0000","last_fullsized":"2023-08-22T00:21:20.716664+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735870+0000","last_change":"2023-08-22T00:21:20.727439+0000","last_active":"2023-08-22T00:21:20.735870+0000","last_peered":"2023-08-22T00:21:20.735870+0000","last_clean":"2023-08-22T00:21:20.735870+0000","last_became_active":"2023-08-22T00:21:20.727178+0000","last_became_peered":"2023-08-22T00:21:20.727178+0000","last_unstale":"2023-08-22T00:21:20.735870+0000","last_undegraded":"2023-08-22T00:21:20.735870+0000","last_fullsized":"2023-08-22T00:21:20.735870+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728423+0000","last_change":"2023-08-22T00:21:20.726789+0000","last_active":"2023-08-22T00:21:20.728423+0000","last_peered":"2023-08-22T00:21:20.728423+0000","last_clean":"2023-08-22T00:21:20.728423+0000","last_became_active":"2023-08-22T00:21:20.726517+0000","last_became_peered":"2023-08-22T00:21:20.726517+0000","last_unstale":"2023-08-22T00:21:20.728423+0000","last_undegraded":"2023-08-22T00:21:20.728423+0000","last_fullsized":"2023-08-22T00:21:20.728423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720006+0000","last_change":"2023-08-22T00:21:20.346312+0000","last_active":"2023-08-22T00:21:20.720006+0000","last_peered":"2023-08-22T00:21:20.720006+0000","last_clean":"2023-08-22T00:21:20.720006+0000","last_became_active":"2023-08-22T00:21:20.346053+0000","last_became_peered":"2023-08-22T00:21:20.346053+0000","last_unstale":"2023-08-22T00:21:20.720006+0000","last_undegraded":"2023-08-22T00:21:20.720006+0000","last_fullsized":"2023-08-22T00:21:20.720006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734806+0000","last_change":"2023-08-22T00:21:20.347608+0000","last_active":"2023-08-22T00:21:20.734806+0000","last_peered":"2023-08-22T00:21:20.734806+0000","last_clean":"2023-08-22T00:21:20.734806+0000","last_became_active":"2023-08-22T00:21:20.347316+0000","last_became_peered":"2023-08-22T00:21:20.347316+0000","last_unstale":"2023-08-22T00:21:20.734806+0000","last_undegraded":"2023-08-22T00:21:20.734806+0000","last_fullsized":"2023-08-22T00:21:20.734806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728160+0000","last_change":"2023-08-22T00:21:20.725340+0000","last_active":"2023-08-22T00:21:20.728160+0000","last_peered":"2023-08-22T00:21:20.728160+0000","last_clean":"2023-08-22T00:21:20.728160+0000","last_became_active":"2023-08-22T00:21:20.725088+0000","last_became_peered":"2023-08-22T00:21:20.725088+0000","last_unstale":"2023-08-22T00:21:20.728160+0000","last_undegraded":"2023-08-22T00:21:20.728160+0000","last_fullsized":"2023-08-22T00:21:20.728160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.718507+0000","last_change":"2023-08-22T00:21:20.717902+0000","last_active":"2023-08-22T00:21:20.718507+0000","last_peered":"2023-08-22T00:21:20.718507+0000","last_clean":"2023-08-22T00:21:20.718507+0000","last_became_active":"2023-08-22T00:21:20.717628+0000","last_became_peered":"2023-08-22T00:21:20.717628+0000","last_unstale":"2023-08-22T00:21:20.718507+0000","last_undegraded":"2023-08-22T00:21:20.718507+0000","last_fullsized":"2023-08-22T00:21:20.718507+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738471+0000","last_change":"2023-08-22T00:21:20.735867+0000","last_active":"2023-08-22T00:21:20.738471+0000","last_peered":"2023-08-22T00:21:20.738471+0000","last_clean":"2023-08-22T00:21:20.738471+0000","last_became_active":"2023-08-22T00:21:20.735608+0000","last_became_peered":"2023-08-22T00:21:20.735608+0000","last_unstale":"2023-08-22T00:21:20.738471+0000","last_undegraded":"2023-08-22T00:21:20.738471+0000","last_fullsized":"2023-08-22T00:21:20.738471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728268+0000","last_change":"2023-08-22T00:21:20.725833+0000","last_active":"2023-08-22T00:21:20.728268+0000","last_peered":"2023-08-22T00:21:20.728268+0000","last_clean":"2023-08-22T00:21:20.728268+0000","last_became_active":"2023-08-22T00:21:20.725382+0000","last_became_peered":"2023-08-22T00:21:20.725382+0000","last_unstale":"2023-08-22T00:21:20.728268+0000","last_undegraded":"2023-08-22T00:21:20.728268+0000","last_fullsized":"2023-08-22T00:21:20.728268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719761+0000","last_change":"2023-08-22T00:21:20.344702+0000","last_active":"2023-08-22T00:21:20.719761+0000","last_peered":"2023-08-22T00:21:20.719761+0000","last_clean":"2023-08-22T00:21:20.719761+0000","last_became_active":"2023-08-22T00:21:20.343945+0000","last_became_peered":"2023-08-22T00:21:20.343945+0000","last_unstale":"2023-08-22T00:21:20.719761+0000","last_undegraded":"2023-08-22T00:21:20.719761+0000","last_fullsized":"2023-08-22T00:21:20.719761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.711536+0000","last_change":"2023-08-22T00:21:20.343765+0000","last_active":"2023-08-22T00:21:20.711536+0000","last_peered":"2023-08-22T00:21:20.711536+0000","last_clean":"2023-08-22T00:21:20.711536+0000","last_became_active":"2023-08-22T00:21:20.343499+0000","last_became_peered":"2023-08-22T00:21:20.343499+0000","last_unstale":"2023-08-22T00:21:20.711536+0000","last_undegraded":"2023-08-22T00:21:20.711536+0000","last_fullsized":"2023-08-22T00:21:20.711536+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737756+0000","last_change":"2023-08-22T00:21:20.732191+0000","last_active":"2023-08-22T00:21:20.737756+0000","last_peered":"2023-08-22T00:21:20.737756+0000","last_clean":"2023-08-22T00:21:20.737756+0000","last_became_active":"2023-08-22T00:21:20.731502+0000","last_became_peered":"2023-08-22T00:21:20.731502+0000","last_unstale":"2023-08-22T00:21:20.737756+0000","last_undegraded":"2023-08-22T00:21:20.737756+0000","last_fullsized":"2023-08-22T00:21:20.737756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719518+0000","last_change":"2023-08-22T00:21:20.347336+0000","last_active":"2023-08-22T00:21:20.719518+0000","last_peered":"2023-08-22T00:21:20.719518+0000","last_clean":"2023-08-22T00:21:20.719518+0000","last_became_active":"2023-08-22T00:21:20.347061+0000","last_became_peered":"2023-08-22T00:21:20.347061+0000","last_unstale":"2023-08-22T00:21:20.719518+0000","last_undegraded":"2023-08-22T00:21:20.719518+0000","last_fullsized":"2023-08-22T00:21:20.719518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728141+0000","last_change":"2023-08-22T00:21:20.724613+0000","last_active":"2023-08-22T00:21:20.728141+0000","last_peered":"2023-08-22T00:21:20.728141+0000","last_clean":"2023-08-22T00:21:20.728141+0000","last_became_active":"2023-08-22T00:21:20.724352+0000","last_became_peered":"2023-08-22T00:21:20.724352+0000","last_unstale":"2023-08-22T00:21:20.728141+0000","last_undegraded":"2023-08-22T00:21:20.728141+0000","last_fullsized":"2023-08-22T00:21:20.728141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244277+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:16.244277+0000","last_peered":"2023-08-22T00:21:16.244277+0000","last_clean":"2023-08-22T00:21:16.244277+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:16.244277+0000","last_undegraded":"2023-08-22T00:21:16.244277+0000","last_fullsized":"2023-08-22T00:21:16.244277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734278+0000","last_change":"2023-08-22T00:21:20.728548+0000","last_active":"2023-08-22T00:21:20.734278+0000","last_peered":"2023-08-22T00:21:20.734278+0000","last_clean":"2023-08-22T00:21:20.734278+0000","last_became_active":"2023-08-22T00:21:20.728060+0000","last_became_peered":"2023-08-22T00:21:20.728060+0000","last_unstale":"2023-08-22T00:21:20.734278+0000","last_undegraded":"2023-08-22T00:21:20.734278+0000","last_fullsized":"2023-08-22T00:21:20.734278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971582+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:16.971582+0000","last_peered":"2023-08-22T00:21:16.971582+0000","last_clean":"2023-08-22T00:21:16.971582+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:16.971582+0000","last_undegraded":"2023-08-22T00:21:16.971582+0000","last_fullsized":"2023-08-22T00:21:16.971582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735680+0000","last_change":"2023-08-22T00:21:20.733035+0000","last_active":"2023-08-22T00:21:20.735680+0000","last_peered":"2023-08-22T00:21:20.735680+0000","last_clean":"2023-08-22T00:21:20.735680+0000","last_became_active":"2023-08-22T00:21:20.732780+0000","last_became_peered":"2023-08-22T00:21:20.732780+0000","last_unstale":"2023-08-22T00:21:20.735680+0000","last_undegraded":"2023-08-22T00:21:20.735680+0000","last_fullsized":"2023-08-22T00:21:20.735680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719654+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:20.719654+0000","last_peered":"2023-08-22T00:21:20.719654+0000","last_clean":"2023-08-22T00:21:20.719654+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:20.719654+0000","last_undegraded":"2023-08-22T00:21:20.719654+0000","last_fullsized":"2023-08-22T00:21:20.719654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.744597+0000","last_change":"2023-08-22T00:21:20.739813+0000","last_active":"2023-08-22T00:21:20.744597+0000","last_peered":"2023-08-22T00:21:20.744597+0000","last_clean":"2023-08-22T00:21:20.744597+0000","last_became_active":"2023-08-22T00:21:20.739538+0000","last_became_peered":"2023-08-22T00:21:20.739538+0000","last_unstale":"2023-08-22T00:21:20.744597+0000","last_undegraded":"2023-08-22T00:21:20.744597+0000","last_fullsized":"2023-08-22T00:21:20.744597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971579+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:16.971579+0000","last_peered":"2023-08-22T00:21:16.971579+0000","last_clean":"2023-08-22T00:21:16.971579+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:16.971579+0000","last_undegraded":"2023-08-22T00:21:16.971579+0000","last_fullsized":"2023-08-22T00:21:16.971579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971284+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:16.971284+0000","last_peered":"2023-08-22T00:21:16.971284+0000","last_clean":"2023-08-22T00:21:16.971284+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:16.971284+0000","last_undegraded":"2023-08-22T00:21:16.971284+0000","last_fullsized":"2023-08-22T00:21:16.971284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734288+0000","last_change":"2023-08-22T00:21:20.727025+0000","last_active":"2023-08-22T00:21:20.734288+0000","last_peered":"2023-08-22T00:21:20.734288+0000","last_clean":"2023-08-22T00:21:20.734288+0000","last_became_active":"2023-08-22T00:21:20.726812+0000","last_became_peered":"2023-08-22T00:21:20.726812+0000","last_unstale":"2023-08-22T00:21:20.734288+0000","last_undegraded":"2023-08-22T00:21:20.734288+0000","last_fullsized":"2023-08-22T00:21:20.734288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710877+0000","last_change":"2023-08-22T00:21:20.348991+0000","last_active":"2023-08-22T00:21:20.710877+0000","last_peered":"2023-08-22T00:21:20.710877+0000","last_clean":"2023-08-22T00:21:20.710877+0000","last_became_active":"2023-08-22T00:21:20.348661+0000","last_became_peered":"2023-08-22T00:21:20.348661+0000","last_unstale":"2023-08-22T00:21:20.710877+0000","last_undegraded":"2023-08-22T00:21:20.710877+0000","last_fullsized":"2023-08-22T00:21:20.710877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971286+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:16.971286+0000","last_peered":"2023-08-22T00:21:16.971286+0000","last_clean":"2023-08-22T00:21:16.971286+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:16.971286+0000","last_undegraded":"2023-08-22T00:21:16.971286+0000","last_fullsized":"2023-08-22T00:21:16.971286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.971288+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:16.971288+0000","last_peered":"2023-08-22T00:21:16.971288+0000","last_clean":"2023-08-22T00:21:16.971288+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:16.971288+0000","last_undegraded":"2023-08-22T00:21:16.971288+0000","last_fullsized":"2023-08-22T00:21:16.971288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.244342+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:16.244342+0000","last_peered":"2023-08-22T00:21:16.244342+0000","last_clean":"2023-08-22T00:21:16.244342+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:16.244342+0000","last_undegraded":"2023-08-22T00:21:16.244342+0000","last_fullsized":"2023-08-22T00:21:16.244342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:20.322833+0000","last_change":"2023-08-22T00:21:20.322833+0000","last_active":"2023-08-22T00:21:20.322833+0000","last_peered":"2023-08-22T00:21:20.322833+0000","last_clean":"2023-08-22T00:21:20.322833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:20.322833+0000","last_undegraded":"2023-08-22T00:21:20.322833+0000","last_fullsized":"2023-08-22T00:21:20.322833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:19.318036+0000","last_change":"2023-08-22T00:21:19.318036+0000","last_active":"2023-08-22T00:21:19.318036+0000","last_peered":"2023-08-22T00:21:19.318036+0000","last_clean":"2023-08-22T00:21:19.318036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:19.318036+0000","last_undegraded":"2023-08-22T00:21:19.318036+0000","last_fullsized":"2023-08-22T00:21:19.318036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-22T00:21:16.239814+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:16.239814+0000","last_peered":"2023-08-22T00:21:16.239814+0000","last_clean":"2023-08-22T00:21:16.239814+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:16.239814+0000","last_undegraded":"2023-08-22T00:21:16.239814+0000","last_fullsized":"2023-08-22T00:21:16.239814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":30,"acting":30,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.441,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.36499999999999999,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.79600000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.48799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.46700000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.79100000000000004},"last":0.438}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.308},"max":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.751},"last":0.41399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.374},{"interface":"front","average":{"1min":0.495,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.748,"15min":0.95399999999999996},"last":0.56399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.84099999999999997},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065532,"statfs":{"total":96636764160,"available":96323104768,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.46400000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.751,"5min":0.755,"15min":0.99299999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.41199999999999998,"15min":0.29599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.751},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.073},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69399999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.753,"15min":0.94399999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.752,"15min":1.03},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39000000000000001,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.184},"max":{"1min":0.54900000000000004,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.374,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.501,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.57499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":1.117,"15min":1.3360000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.83199999999999996,"5min":2.298,"15min":2.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":2.992,"15min":2.992},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.78000000000000003,"5min":2.323,"15min":2.323},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.505,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.432,"15min":0.41899999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56000000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.443}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.84099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.38900000000000001},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":1.0149999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.26400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.20499999999999999},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":0.625,"5min":0.67900000000000005,"15min":0.71199999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"min":{"1min":0.32600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":1.0580000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.97899999999999998,"15min":1.0169999999999999},"last":0.441}]},{"osd":5,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":0.77800000000000002,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.95199999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":0.998,"15min":0.998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.89600000000000002,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":0.96499999999999997,"15min":1.0349999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.98599999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":574470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.314,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.32900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.63600000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.33100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.47799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.89500000000000002,"15min":11.163},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.77600000000000002},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.71699999999999997,"5min":0.753,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77300000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.78700000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.82299999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.75600000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.30199999999999999},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77800000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.85899999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":1044480,"data_stored":546163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.46500000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.873},"last":0.41499999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.313},"max":{"1min":0.72299999999999998,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67900000000000005,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.95999999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.88},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51700000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:28.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:28.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.908+0000 7f79fde44700 1 Processor -- start 2023-08-22T00:21:28.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.908+0000 7f79fde44700 1 -- start start 2023-08-22T00:21:28.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79fde44700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79f80a6e50 0x7f79f8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79fde44700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f8158bf0 con 0x7f79f8151d60 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79fde44700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f8157d90 con 0x7f79f8066400 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79fde44700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f8066830 con 0x7f79f80a6e50 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79f6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79f80a6e50 0x7f79f8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79f77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f79f8151d60 0x7f79f8155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39796/0 (socket says 172.21.15.98:39796) 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.909+0000 7f79f77fe700 1 -- 172.21.15.98:0/173789442 learned_addr learned my addr 172.21.15.98:0/173789442 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f6ffd700 1 -- 172.21.15.98:0/173789442 >> v1:172.21.15.118:6789/0 conn(0x7f79f8066400 legacy=0x7f79f80643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f6ffd700 1 -- 172.21.15.98:0/173789442 >> v1:172.21.15.98:6789/0 conn(0x7f79f8151d60 legacy=0x7f79f8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f6ffd700 1 -- 172.21.15.98:0/173789442 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8157fe0 con 0x7f79f80a6e50 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f6ffd700 1 --2- 172.21.15.98:0/173789442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f80a6e50 0x7f79f8065f10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f79e8009760 tx=0x7f79e8009060).ready entity=mon.0 client_cookie=231820e5fdcfdbc8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f67fc700 1 -- 172.21.15.98:0/173789442 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800b520 con 0x7f79f80a6e50 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f67fc700 1 -- 172.21.15.98:0/173789442 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800b680 con 0x7f79f80a6e50 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79f67fc700 1 -- 172.21.15.98:0/173789442 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800ba00 con 0x7f79f80a6e50 2023-08-22T00:21:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 -- 172.21.15.98:0/173789442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f80a6e50 msgr2=0x7f79f8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 --2- 172.21.15.98:0/173789442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f80a6e50 0x7f79f8065f10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f79e8009760 tx=0x7f79e8009060).stop 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 -- 172.21.15.98:0/173789442 shutdown_connections 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 --2- 172.21.15.98:0/173789442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f80a6e50 0x7f79f8065f10 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 -- 172.21.15.98:0/173789442 >> 172.21.15.98:0/173789442 conn(0x7f79f806a980 msgr2=0x7f79f80c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 -- 172.21.15.98:0/173789442 shutdown_connections 2023-08-22T00:21:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.910+0000 7f79fde44700 1 -- 172.21.15.98:0/173789442 wait complete. 2023-08-22T00:21:28.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.912+0000 7f79fde44700 1 Processor -- start 2023-08-22T00:21:28.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.912+0000 7f79fde44700 1 -- start start 2023-08-22T00:21:28.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:28.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79f80a6e50 0x7f79f8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:28.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 0x7f79f8157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:28.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8168300 con 0x7f79f8066400 2023-08-22T00:21:28.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f81515a0 con 0x7f79f8151d60 2023-08-22T00:21:28.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8157530 con 0x7f79f80a6e50 2023-08-22T00:21:28.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:28.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53386/0 (socket says 172.21.15.98:53386) 2023-08-22T00:21:28.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 -- 172.21.15.98:0/3255707927 learned_addr learned my addr 172.21.15.98:0/3255707927 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:28.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f6ffd700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79f80a6e50 0x7f79f8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:28.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f7fff700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 0x7f79f8157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:28.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 -- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79f80a6e50 msgr2=0x7f79f8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:28.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79f80a6e50 0x7f79f8156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:28.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 -- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 msgr2=0x7f79f8157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:28.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 0x7f79f8157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:28.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 -- 172.21.15.98:0/3255707927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80092a0 con 0x7f79f8066400 2023-08-22T00:21:28.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f7fff700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 0x7f79f8157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:28.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79f77fe700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f79e0001eb0 tx=0x7f79e0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:28.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00072e0 con 0x7f79f8066400 2023-08-22T00:21:28.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0007440 con 0x7f79f8066400 2023-08-22T00:21:28.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f81684e0 con 0x7f79f8066400 2023-08-22T00:21:28.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00057a0 con 0x7f79f8066400 2023-08-22T00:21:28.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.913+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f8168aa0 con 0x7f79f8066400 2023-08-22T00:21:28.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.914+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f80a6570 con 0x7f79f8066400 2023-08-22T00:21:28.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.915+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f79e0005b10 con 0x7f79f8066400 2023-08-22T00:21:28.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.915+0000 7f79ef7fe700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 0x7f79d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:28.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.915+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79e0079950 con 0x7f79f8066400 2023-08-22T00:21:28.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.915+0000 7f79f6ffd700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 0x7f79d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:28.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.915+0000 7f79f6ffd700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 0x7f79d80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f79f8150f00 tx=0x7f79e8017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:28.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:28.919+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79e004aae0 con 0x7f79f8066400 2023-08-22T00:21:29.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.079+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79f8047480 con 0x7f79d805ef30 2023-08-22T00:21:29.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.089+0000 7f79ef7fe700 1 -- 172.21.15.98:0/3255707927 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361450 (secure 0 0 0) 0x7f79f8047480 con 0x7f79d805ef30 2023-08-22T00:21:29.095 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:29.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 msgr2=0x7f79d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 0x7f79d80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f79f8150f00 tx=0x7f79e8017000).stop 2023-08-22T00:21:29.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 msgr2=0x7f79f80a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f79e0001eb0 tx=0x7f79e0007e50).stop 2023-08-22T00:21:29.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 shutdown_connections 2023-08-22T00:21:29.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f8151d60 0x7f79f8157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79f8066400 0x7f79f80a5f70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f79d805ef30 0x7f79d80613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 --2- 172.21.15.98:0/3255707927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79f80a6e50 0x7f79f8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.092+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 >> 172.21.15.98:0/3255707927 conn(0x7f79f806a980 msgr2=0x7f79f8155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.093+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 shutdown_connections 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.093+0000 7f79fde44700 1 -- 172.21.15.98:0/3255707927 wait complete. 2023-08-22T00:21:29.101 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:29.105 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-22T00:21:28.026049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426336,"kb_used_data":8608,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752548384,"statfs":{"total":773094113280,"available":770609545216,"internally_reserved":0,"allocated":8814592,"data_stored":4599476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25068,"num_objects":-6,"num_object_clones":0,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002085"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737460+0000","last_change":"2023-08-22T00:21:20.722035+0000","last_active":"2023-08-22T00:21:20.737460+0000","last_peered":"2023-08-22T00:21:20.737460+0000","last_clean":"2023-08-22T00:21:20.737460+0000","last_became_active":"2023-08-22T00:21:20.721733+0000","last_became_peered":"2023-08-22T00:21:20.721733+0000","last_unstale":"2023-08-22T00:21:20.737460+0000","last_undegraded":"2023-08-22T00:21:20.737460+0000","last_fullsized":"2023-08-22T00:21:20.737460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.736951+0000","last_change":"2023-08-22T00:21:20.348242+0000","last_active":"2023-08-22T00:21:20.736951+0000","last_peered":"2023-08-22T00:21:20.736951+0000","last_clean":"2023-08-22T00:21:20.736951+0000","last_became_active":"2023-08-22T00:21:20.347969+0000","last_became_peered":"2023-08-22T00:21:20.347969+0000","last_unstale":"2023-08-22T00:21:20.736951+0000","last_undegraded":"2023-08-22T00:21:20.736951+0000","last_fullsized":"2023-08-22T00:21:20.736951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739316+0000","last_change":"2023-08-22T00:21:20.727836+0000","last_active":"2023-08-22T00:21:20.739316+0000","last_peered":"2023-08-22T00:21:20.739316+0000","last_clean":"2023-08-22T00:21:20.739316+0000","last_became_active":"2023-08-22T00:21:20.726952+0000","last_became_peered":"2023-08-22T00:21:20.726952+0000","last_unstale":"2023-08-22T00:21:20.739316+0000","last_undegraded":"2023-08-22T00:21:20.739316+0000","last_fullsized":"2023-08-22T00:21:20.739316+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719357+0000","last_change":"2023-08-22T00:21:20.346147+0000","last_active":"2023-08-22T00:21:20.719357+0000","last_peered":"2023-08-22T00:21:20.719357+0000","last_clean":"2023-08-22T00:21:20.719357+0000","last_became_active":"2023-08-22T00:21:20.345883+0000","last_became_peered":"2023-08-22T00:21:20.345883+0000","last_unstale":"2023-08-22T00:21:20.719357+0000","last_undegraded":"2023-08-22T00:21:20.719357+0000","last_fullsized":"2023-08-22T00:21:20.719357+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.733613+0000","last_change":"2023-08-22T00:21:20.729214+0000","last_active":"2023-08-22T00:21:20.733613+0000","last_peered":"2023-08-22T00:21:20.733613+0000","last_clean":"2023-08-22T00:21:20.733613+0000","last_became_active":"2023-08-22T00:21:20.728966+0000","last_became_peered":"2023-08-22T00:21:20.728966+0000","last_unstale":"2023-08-22T00:21:20.733613+0000","last_undegraded":"2023-08-22T00:21:20.733613+0000","last_fullsized":"2023-08-22T00:21:20.733613+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720471+0000","last_change":"2023-08-22T00:21:20.354821+0000","last_active":"2023-08-22T00:21:20.720471+0000","last_peered":"2023-08-22T00:21:20.720471+0000","last_clean":"2023-08-22T00:21:20.720471+0000","last_became_active":"2023-08-22T00:21:20.354523+0000","last_became_peered":"2023-08-22T00:21:20.354523+0000","last_unstale":"2023-08-22T00:21:20.720471+0000","last_undegraded":"2023-08-22T00:21:20.720471+0000","last_fullsized":"2023-08-22T00:21:20.720471+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734389+0000","last_change":"2023-08-22T00:21:20.729378+0000","last_active":"2023-08-22T00:21:20.734389+0000","last_peered":"2023-08-22T00:21:20.734389+0000","last_clean":"2023-08-22T00:21:20.734389+0000","last_became_active":"2023-08-22T00:21:20.729042+0000","last_became_peered":"2023-08-22T00:21:20.729042+0000","last_unstale":"2023-08-22T00:21:20.734389+0000","last_undegraded":"2023-08-22T00:21:20.734389+0000","last_fullsized":"2023-08-22T00:21:20.734389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.730530+0000","last_change":"2023-08-22T00:21:20.340808+0000","last_active":"2023-08-22T00:21:20.730530+0000","last_peered":"2023-08-22T00:21:20.730530+0000","last_clean":"2023-08-22T00:21:20.730530+0000","last_became_active":"2023-08-22T00:21:20.340460+0000","last_became_peered":"2023-08-22T00:21:20.340460+0000","last_unstale":"2023-08-22T00:21:20.730530+0000","last_undegraded":"2023-08-22T00:21:20.730530+0000","last_fullsized":"2023-08-22T00:21:20.730530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725434+0000","last_change":"2023-08-22T00:21:20.720299+0000","last_active":"2023-08-22T00:21:20.725434+0000","last_peered":"2023-08-22T00:21:20.725434+0000","last_clean":"2023-08-22T00:21:20.725434+0000","last_became_active":"2023-08-22T00:21:20.720025+0000","last_became_peered":"2023-08-22T00:21:20.720025+0000","last_unstale":"2023-08-22T00:21:20.725434+0000","last_undegraded":"2023-08-22T00:21:20.725434+0000","last_fullsized":"2023-08-22T00:21:20.725434+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3b","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725833+0000","last_change":"2023-08-22T00:21:20.343548+0000","last_active":"2023-08-22T00:21:20.725833+0000","last_peered":"2023-08-22T00:21:20.725833+0000","last_clean":"2023-08-22T00:21:20.725833+0000","last_became_active":"2023-08-22T00:21:20.343073+0000","last_became_peered":"2023-08-22T00:21:20.343073+0000","last_unstale":"2023-08-22T00:21:20.725833+0000","last_undegraded":"2023-08-22T00:21:20.725833+0000","last_fullsized":"2023-08-22T00:21:20.725833+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731933+0000","last_change":"2023-08-22T00:21:20.729611+0000","last_active":"2023-08-22T00:21:20.731933+0000","last_peered":"2023-08-22T00:21:20.731933+0000","last_clean":"2023-08-22T00:21:20.731933+0000","last_became_active":"2023-08-22T00:21:20.729410+0000","last_became_peered":"2023-08-22T00:21:20.729410+0000","last_unstale":"2023-08-22T00:21:20.731933+0000","last_undegraded":"2023-08-22T00:21:20.731933+0000","last_fullsized":"2023-08-22T00:21:20.731933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.727699+0000","last_change":"2023-08-22T00:21:20.349669+0000","last_active":"2023-08-22T00:21:20.727699+0000","last_peered":"2023-08-22T00:21:20.727699+0000","last_clean":"2023-08-22T00:21:20.727699+0000","last_became_active":"2023-08-22T00:21:20.349392+0000","last_became_peered":"2023-08-22T00:21:20.349392+0000","last_unstale":"2023-08-22T00:21:20.727699+0000","last_undegraded":"2023-08-22T00:21:20.727699+0000","last_fullsized":"2023-08-22T00:21:20.727699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739999+0000","last_change":"2023-08-22T00:21:20.732164+0000","last_active":"2023-08-22T00:21:20.739999+0000","last_peered":"2023-08-22T00:21:20.739999+0000","last_clean":"2023-08-22T00:21:20.739999+0000","last_became_active":"2023-08-22T00:21:20.731516+0000","last_became_peered":"2023-08-22T00:21:20.731516+0000","last_unstale":"2023-08-22T00:21:20.739999+0000","last_undegraded":"2023-08-22T00:21:20.739999+0000","last_fullsized":"2023-08-22T00:21:20.739999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719814+0000","last_change":"2023-08-22T00:21:20.353551+0000","last_active":"2023-08-22T00:21:20.719814+0000","last_peered":"2023-08-22T00:21:20.719814+0000","last_clean":"2023-08-22T00:21:20.719814+0000","last_became_active":"2023-08-22T00:21:20.353287+0000","last_became_peered":"2023-08-22T00:21:20.353287+0000","last_unstale":"2023-08-22T00:21:20.719814+0000","last_undegraded":"2023-08-22T00:21:20.719814+0000","last_fullsized":"2023-08-22T00:21:20.719814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738850+0000","last_change":"2023-08-22T00:21:20.736034+0000","last_active":"2023-08-22T00:21:20.738850+0000","last_peered":"2023-08-22T00:21:20.738850+0000","last_clean":"2023-08-22T00:21:20.738850+0000","last_became_active":"2023-08-22T00:21:20.735745+0000","last_became_peered":"2023-08-22T00:21:20.735745+0000","last_unstale":"2023-08-22T00:21:20.738850+0000","last_undegraded":"2023-08-22T00:21:20.738850+0000","last_fullsized":"2023-08-22T00:21:20.738850+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732766+0000","last_change":"2023-08-22T00:21:20.350314+0000","last_active":"2023-08-22T00:21:20.732766+0000","last_peered":"2023-08-22T00:21:20.732766+0000","last_clean":"2023-08-22T00:21:20.732766+0000","last_became_active":"2023-08-22T00:21:20.350012+0000","last_became_peered":"2023-08-22T00:21:20.350012+0000","last_unstale":"2023-08-22T00:21:20.732766+0000","last_undegraded":"2023-08-22T00:21:20.732766+0000","last_fullsized":"2023-08-22T00:21:20.732766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.730420+0000","last_change":"2023-08-22T00:21:20.725411+0000","last_active":"2023-08-22T00:21:20.730420+0000","last_peered":"2023-08-22T00:21:20.730420+0000","last_clean":"2023-08-22T00:21:20.730420+0000","last_became_active":"2023-08-22T00:21:20.725030+0000","last_became_peered":"2023-08-22T00:21:20.725030+0000","last_unstale":"2023-08-22T00:21:20.730420+0000","last_undegraded":"2023-08-22T00:21:20.730420+0000","last_fullsized":"2023-08-22T00:21:20.730420+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719954+0000","last_change":"2023-08-22T00:21:20.357969+0000","last_active":"2023-08-22T00:21:20.719954+0000","last_peered":"2023-08-22T00:21:20.719954+0000","last_clean":"2023-08-22T00:21:20.719954+0000","last_became_active":"2023-08-22T00:21:20.357687+0000","last_became_peered":"2023-08-22T00:21:20.357687+0000","last_unstale":"2023-08-22T00:21:20.719954+0000","last_undegraded":"2023-08-22T00:21:20.719954+0000","last_fullsized":"2023-08-22T00:21:20.719954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737730+0000","last_change":"2023-08-22T00:21:20.732701+0000","last_active":"2023-08-22T00:21:20.737730+0000","last_peered":"2023-08-22T00:21:20.737730+0000","last_clean":"2023-08-22T00:21:20.737730+0000","last_became_active":"2023-08-22T00:21:20.732445+0000","last_became_peered":"2023-08-22T00:21:20.732445+0000","last_unstale":"2023-08-22T00:21:20.737730+0000","last_undegraded":"2023-08-22T00:21:20.737730+0000","last_fullsized":"2023-08-22T00:21:20.737730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719548+0000","last_change":"2023-08-22T00:21:20.354754+0000","last_active":"2023-08-22T00:21:20.719548+0000","last_peered":"2023-08-22T00:21:20.719548+0000","last_clean":"2023-08-22T00:21:20.719548+0000","last_became_active":"2023-08-22T00:21:20.354481+0000","last_became_peered":"2023-08-22T00:21:20.354481+0000","last_unstale":"2023-08-22T00:21:20.719548+0000","last_undegraded":"2023-08-22T00:21:20.719548+0000","last_fullsized":"2023-08-22T00:21:20.719548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728689+0000","last_change":"2023-08-22T00:21:20.727170+0000","last_active":"2023-08-22T00:21:20.728689+0000","last_peered":"2023-08-22T00:21:20.728689+0000","last_clean":"2023-08-22T00:21:20.728689+0000","last_became_active":"2023-08-22T00:21:20.726604+0000","last_became_peered":"2023-08-22T00:21:20.726604+0000","last_unstale":"2023-08-22T00:21:20.728689+0000","last_undegraded":"2023-08-22T00:21:20.728689+0000","last_fullsized":"2023-08-22T00:21:20.728689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713874+0000","last_change":"2023-08-22T00:21:20.346237+0000","last_active":"2023-08-22T00:21:20.713874+0000","last_peered":"2023-08-22T00:21:20.713874+0000","last_clean":"2023-08-22T00:21:20.713874+0000","last_became_active":"2023-08-22T00:21:20.345643+0000","last_became_peered":"2023-08-22T00:21:20.345643+0000","last_unstale":"2023-08-22T00:21:20.713874+0000","last_undegraded":"2023-08-22T00:21:20.713874+0000","last_fullsized":"2023-08-22T00:21:20.713874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740218+0000","last_change":"2023-08-22T00:21:20.733210+0000","last_active":"2023-08-22T00:21:20.740218+0000","last_peered":"2023-08-22T00:21:20.740218+0000","last_clean":"2023-08-22T00:21:20.740218+0000","last_became_active":"2023-08-22T00:21:20.732944+0000","last_became_peered":"2023-08-22T00:21:20.732944+0000","last_unstale":"2023-08-22T00:21:20.740218+0000","last_undegraded":"2023-08-22T00:21:20.740218+0000","last_fullsized":"2023-08-22T00:21:20.740218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.34","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.743045+0000","last_change":"2023-08-22T00:21:20.350078+0000","last_active":"2023-08-22T00:21:20.743045+0000","last_peered":"2023-08-22T00:21:20.743045+0000","last_clean":"2023-08-22T00:21:20.743045+0000","last_became_active":"2023-08-22T00:21:20.349760+0000","last_became_peered":"2023-08-22T00:21:20.349760+0000","last_unstale":"2023-08-22T00:21:20.743045+0000","last_undegraded":"2023-08-22T00:21:20.743045+0000","last_fullsized":"2023-08-22T00:21:20.743045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738437+0000","last_change":"2023-08-22T00:21:20.735960+0000","last_active":"2023-08-22T00:21:20.738437+0000","last_peered":"2023-08-22T00:21:20.738437+0000","last_clean":"2023-08-22T00:21:20.738437+0000","last_became_active":"2023-08-22T00:21:20.735708+0000","last_became_peered":"2023-08-22T00:21:20.735708+0000","last_unstale":"2023-08-22T00:21:20.738437+0000","last_undegraded":"2023-08-22T00:21:20.738437+0000","last_fullsized":"2023-08-22T00:21:20.738437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739096+0000","last_change":"2023-08-22T00:21:20.348727+0000","last_active":"2023-08-22T00:21:20.739096+0000","last_peered":"2023-08-22T00:21:20.739096+0000","last_clean":"2023-08-22T00:21:20.739096+0000","last_became_active":"2023-08-22T00:21:20.348445+0000","last_became_peered":"2023-08-22T00:21:20.348445+0000","last_unstale":"2023-08-22T00:21:20.739096+0000","last_undegraded":"2023-08-22T00:21:20.739096+0000","last_fullsized":"2023-08-22T00:21:20.739096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723535+0000","last_change":"2023-08-22T00:21:20.719435+0000","last_active":"2023-08-22T00:21:20.723535+0000","last_peered":"2023-08-22T00:21:20.723535+0000","last_clean":"2023-08-22T00:21:20.723535+0000","last_became_active":"2023-08-22T00:21:20.719160+0000","last_became_peered":"2023-08-22T00:21:20.719160+0000","last_unstale":"2023-08-22T00:21:20.723535+0000","last_undegraded":"2023-08-22T00:21:20.723535+0000","last_fullsized":"2023-08-22T00:21:20.723535+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.723170+0000","last_change":"2023-08-22T00:21:20.354218+0000","last_active":"2023-08-22T00:21:20.723170+0000","last_peered":"2023-08-22T00:21:20.723170+0000","last_clean":"2023-08-22T00:21:20.723170+0000","last_became_active":"2023-08-22T00:21:20.353949+0000","last_became_peered":"2023-08-22T00:21:20.353949+0000","last_unstale":"2023-08-22T00:21:20.723170+0000","last_undegraded":"2023-08-22T00:21:20.723170+0000","last_fullsized":"2023-08-22T00:21:20.723170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.724691+0000","last_change":"2023-08-22T00:21:20.720975+0000","last_active":"2023-08-22T00:21:20.724691+0000","last_peered":"2023-08-22T00:21:20.724691+0000","last_clean":"2023-08-22T00:21:20.724691+0000","last_became_active":"2023-08-22T00:21:20.720679+0000","last_became_peered":"2023-08-22T00:21:20.720679+0000","last_unstale":"2023-08-22T00:21:20.724691+0000","last_undegraded":"2023-08-22T00:21:20.724691+0000","last_fullsized":"2023-08-22T00:21:20.724691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720235+0000","last_change":"2023-08-22T00:21:20.354154+0000","last_active":"2023-08-22T00:21:20.720235+0000","last_peered":"2023-08-22T00:21:20.720235+0000","last_clean":"2023-08-22T00:21:20.720235+0000","last_became_active":"2023-08-22T00:21:20.353869+0000","last_became_peered":"2023-08-22T00:21:20.353869+0000","last_unstale":"2023-08-22T00:21:20.720235+0000","last_undegraded":"2023-08-22T00:21:20.720235+0000","last_fullsized":"2023-08-22T00:21:20.720235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725612+0000","last_change":"2023-08-22T00:21:20.723936+0000","last_active":"2023-08-22T00:21:20.725612+0000","last_peered":"2023-08-22T00:21:20.725612+0000","last_clean":"2023-08-22T00:21:20.725612+0000","last_became_active":"2023-08-22T00:21:20.723659+0000","last_became_peered":"2023-08-22T00:21:20.723659+0000","last_unstale":"2023-08-22T00:21:20.725612+0000","last_undegraded":"2023-08-22T00:21:20.725612+0000","last_fullsized":"2023-08-22T00:21:20.725612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734053+0000","last_change":"2023-08-22T00:21:20.354035+0000","last_active":"2023-08-22T00:21:20.734053+0000","last_peered":"2023-08-22T00:21:20.734053+0000","last_clean":"2023-08-22T00:21:20.734053+0000","last_became_active":"2023-08-22T00:21:20.347594+0000","last_became_peered":"2023-08-22T00:21:20.347594+0000","last_unstale":"2023-08-22T00:21:20.734053+0000","last_undegraded":"2023-08-22T00:21:20.734053+0000","last_fullsized":"2023-08-22T00:21:20.734053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728533+0000","last_change":"2023-08-22T00:21:20.725701+0000","last_active":"2023-08-22T00:21:20.728533+0000","last_peered":"2023-08-22T00:21:20.728533+0000","last_clean":"2023-08-22T00:21:20.728533+0000","last_became_active":"2023-08-22T00:21:20.725307+0000","last_became_peered":"2023-08-22T00:21:20.725307+0000","last_unstale":"2023-08-22T00:21:20.728533+0000","last_undegraded":"2023-08-22T00:21:20.728533+0000","last_fullsized":"2023-08-22T00:21:20.728533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.714176+0000","last_change":"2023-08-22T00:21:20.344062+0000","last_active":"2023-08-22T00:21:20.714176+0000","last_peered":"2023-08-22T00:21:20.714176+0000","last_clean":"2023-08-22T00:21:20.714176+0000","last_became_active":"2023-08-22T00:21:20.343763+0000","last_became_peered":"2023-08-22T00:21:20.343763+0000","last_unstale":"2023-08-22T00:21:20.714176+0000","last_undegraded":"2023-08-22T00:21:20.714176+0000","last_fullsized":"2023-08-22T00:21:20.714176+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737714+0000","last_change":"2023-08-22T00:21:20.732440+0000","last_active":"2023-08-22T00:21:20.737714+0000","last_peered":"2023-08-22T00:21:20.737714+0000","last_clean":"2023-08-22T00:21:20.737714+0000","last_became_active":"2023-08-22T00:21:20.732193+0000","last_became_peered":"2023-08-22T00:21:20.732193+0000","last_unstale":"2023-08-22T00:21:20.737714+0000","last_undegraded":"2023-08-22T00:21:20.737714+0000","last_fullsized":"2023-08-22T00:21:20.737714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717928+0000","last_change":"2023-08-22T00:21:20.346953+0000","last_active":"2023-08-22T00:21:20.717928+0000","last_peered":"2023-08-22T00:21:20.717928+0000","last_clean":"2023-08-22T00:21:20.717928+0000","last_became_active":"2023-08-22T00:21:20.345398+0000","last_became_peered":"2023-08-22T00:21:20.345398+0000","last_unstale":"2023-08-22T00:21:20.717928+0000","last_undegraded":"2023-08-22T00:21:20.717928+0000","last_fullsized":"2023-08-22T00:21:20.717928+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740678+0000","last_change":"2023-08-22T00:21:20.737637+0000","last_active":"2023-08-22T00:21:20.740678+0000","last_peered":"2023-08-22T00:21:20.740678+0000","last_clean":"2023-08-22T00:21:20.740678+0000","last_became_active":"2023-08-22T00:21:20.737290+0000","last_became_peered":"2023-08-22T00:21:20.737290+0000","last_unstale":"2023-08-22T00:21:20.740678+0000","last_undegraded":"2023-08-22T00:21:20.740678+0000","last_fullsized":"2023-08-22T00:21:20.740678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737152+0000","last_change":"2023-08-22T00:21:20.353941+0000","last_active":"2023-08-22T00:21:20.737152+0000","last_peered":"2023-08-22T00:21:20.737152+0000","last_clean":"2023-08-22T00:21:20.737152+0000","last_became_active":"2023-08-22T00:21:20.353629+0000","last_became_peered":"2023-08-22T00:21:20.353629+0000","last_unstale":"2023-08-22T00:21:20.737152+0000","last_undegraded":"2023-08-22T00:21:20.737152+0000","last_fullsized":"2023-08-22T00:21:20.737152+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739554+0000","last_change":"2023-08-22T00:21:20.729839+0000","last_active":"2023-08-22T00:21:20.739554+0000","last_peered":"2023-08-22T00:21:20.739554+0000","last_clean":"2023-08-22T00:21:20.739554+0000","last_became_active":"2023-08-22T00:21:20.729548+0000","last_became_peered":"2023-08-22T00:21:20.729548+0000","last_unstale":"2023-08-22T00:21:20.739554+0000","last_undegraded":"2023-08-22T00:21:20.739554+0000","last_fullsized":"2023-08-22T00:21:20.739554+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715845+0000","last_change":"2023-08-22T00:21:20.353429+0000","last_active":"2023-08-22T00:21:20.715845+0000","last_peered":"2023-08-22T00:21:20.715845+0000","last_clean":"2023-08-22T00:21:20.715845+0000","last_became_active":"2023-08-22T00:21:20.352807+0000","last_became_peered":"2023-08-22T00:21:20.352807+0000","last_unstale":"2023-08-22T00:21:20.715845+0000","last_undegraded":"2023-08-22T00:21:20.715845+0000","last_fullsized":"2023-08-22T00:21:20.715845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732551+0000","last_change":"2023-08-22T00:21:20.727054+0000","last_active":"2023-08-22T00:21:20.732551+0000","last_peered":"2023-08-22T00:21:20.732551+0000","last_clean":"2023-08-22T00:21:20.732551+0000","last_became_active":"2023-08-22T00:21:20.726780+0000","last_became_peered":"2023-08-22T00:21:20.726780+0000","last_unstale":"2023-08-22T00:21:20.732551+0000","last_undegraded":"2023-08-22T00:21:20.732551+0000","last_fullsized":"2023-08-22T00:21:20.732551+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738055+0000","last_change":"2023-08-22T00:21:20.352961+0000","last_active":"2023-08-22T00:21:20.738055+0000","last_peered":"2023-08-22T00:21:20.738055+0000","last_clean":"2023-08-22T00:21:20.738055+0000","last_became_active":"2023-08-22T00:21:20.352702+0000","last_became_peered":"2023-08-22T00:21:20.352702+0000","last_unstale":"2023-08-22T00:21:20.738055+0000","last_undegraded":"2023-08-22T00:21:20.738055+0000","last_fullsized":"2023-08-22T00:21:20.738055+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728877+0000","last_change":"2023-08-22T00:21:20.724880+0000","last_active":"2023-08-22T00:21:20.728877+0000","last_peered":"2023-08-22T00:21:20.728877+0000","last_clean":"2023-08-22T00:21:20.728877+0000","last_became_active":"2023-08-22T00:21:20.724573+0000","last_became_peered":"2023-08-22T00:21:20.724573+0000","last_unstale":"2023-08-22T00:21:20.728877+0000","last_undegraded":"2023-08-22T00:21:20.728877+0000","last_fullsized":"2023-08-22T00:21:20.728877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722249+0000","last_change":"2023-08-22T00:21:20.352985+0000","last_active":"2023-08-22T00:21:20.722249+0000","last_peered":"2023-08-22T00:21:20.722249+0000","last_clean":"2023-08-22T00:21:20.722249+0000","last_became_active":"2023-08-22T00:21:20.352503+0000","last_became_peered":"2023-08-22T00:21:20.352503+0000","last_unstale":"2023-08-22T00:21:20.722249+0000","last_undegraded":"2023-08-22T00:21:20.722249+0000","last_fullsized":"2023-08-22T00:21:20.722249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.741075+0000","last_change":"2023-08-22T00:21:20.737944+0000","last_active":"2023-08-22T00:21:20.741075+0000","last_peered":"2023-08-22T00:21:20.741075+0000","last_clean":"2023-08-22T00:21:20.741075+0000","last_became_active":"2023-08-22T00:21:20.737603+0000","last_became_peered":"2023-08-22T00:21:20.737603+0000","last_unstale":"2023-08-22T00:21:20.741075+0000","last_undegraded":"2023-08-22T00:21:20.741075+0000","last_fullsized":"2023-08-22T00:21:20.741075+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717337+0000","last_change":"2023-08-22T00:21:20.347511+0000","last_active":"2023-08-22T00:21:20.717337+0000","last_peered":"2023-08-22T00:21:20.717337+0000","last_clean":"2023-08-22T00:21:20.717337+0000","last_became_active":"2023-08-22T00:21:20.347226+0000","last_became_peered":"2023-08-22T00:21:20.347226+0000","last_unstale":"2023-08-22T00:21:20.717337+0000","last_undegraded":"2023-08-22T00:21:20.717337+0000","last_fullsized":"2023-08-22T00:21:20.717337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740347+0000","last_change":"2023-08-22T00:21:20.736136+0000","last_active":"2023-08-22T00:21:20.740347+0000","last_peered":"2023-08-22T00:21:20.740347+0000","last_clean":"2023-08-22T00:21:20.740347+0000","last_became_active":"2023-08-22T00:21:20.735814+0000","last_became_peered":"2023-08-22T00:21:20.735814+0000","last_unstale":"2023-08-22T00:21:20.740347+0000","last_undegraded":"2023-08-22T00:21:20.740347+0000","last_fullsized":"2023-08-22T00:21:20.740347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717383+0000","last_change":"2023-08-22T00:21:20.353061+0000","last_active":"2023-08-22T00:21:20.717383+0000","last_peered":"2023-08-22T00:21:20.717383+0000","last_clean":"2023-08-22T00:21:20.717383+0000","last_became_active":"2023-08-22T00:21:20.352783+0000","last_became_peered":"2023-08-22T00:21:20.352783+0000","last_unstale":"2023-08-22T00:21:20.717383+0000","last_undegraded":"2023-08-22T00:21:20.717383+0000","last_fullsized":"2023-08-22T00:21:20.717383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.742063+0000","last_change":"2023-08-22T00:21:20.740932+0000","last_active":"2023-08-22T00:21:20.742063+0000","last_peered":"2023-08-22T00:21:20.742063+0000","last_clean":"2023-08-22T00:21:20.742063+0000","last_became_active":"2023-08-22T00:21:20.740624+0000","last_became_peered":"2023-08-22T00:21:20.740624+0000","last_unstale":"2023-08-22T00:21:20.742063+0000","last_undegraded":"2023-08-22T00:21:20.742063+0000","last_fullsized":"2023-08-22T00:21:20.742063+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.736820+0000","last_change":"2023-08-22T00:21:20.358674+0000","last_active":"2023-08-22T00:21:20.736820+0000","last_peered":"2023-08-22T00:21:20.736820+0000","last_clean":"2023-08-22T00:21:20.736820+0000","last_became_active":"2023-08-22T00:21:20.358418+0000","last_became_peered":"2023-08-22T00:21:20.358418+0000","last_unstale":"2023-08-22T00:21:20.736820+0000","last_undegraded":"2023-08-22T00:21:20.736820+0000","last_fullsized":"2023-08-22T00:21:20.736820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732011+0000","last_change":"2023-08-22T00:21:20.728263+0000","last_active":"2023-08-22T00:21:20.732011+0000","last_peered":"2023-08-22T00:21:20.732011+0000","last_clean":"2023-08-22T00:21:20.732011+0000","last_became_active":"2023-08-22T00:21:20.727578+0000","last_became_peered":"2023-08-22T00:21:20.727578+0000","last_unstale":"2023-08-22T00:21:20.732011+0000","last_undegraded":"2023-08-22T00:21:20.732011+0000","last_fullsized":"2023-08-22T00:21:20.732011+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.736159+0000","last_change":"2023-08-22T00:21:20.358256+0000","last_active":"2023-08-22T00:21:20.736159+0000","last_peered":"2023-08-22T00:21:20.736159+0000","last_clean":"2023-08-22T00:21:20.736159+0000","last_became_active":"2023-08-22T00:21:20.358028+0000","last_became_peered":"2023-08-22T00:21:20.358028+0000","last_unstale":"2023-08-22T00:21:20.736159+0000","last_undegraded":"2023-08-22T00:21:20.736159+0000","last_fullsized":"2023-08-22T00:21:20.736159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.730228+0000","last_change":"2023-08-22T00:21:20.725882+0000","last_active":"2023-08-22T00:21:20.730228+0000","last_peered":"2023-08-22T00:21:20.730228+0000","last_clean":"2023-08-22T00:21:20.730228+0000","last_became_active":"2023-08-22T00:21:20.725594+0000","last_became_peered":"2023-08-22T00:21:20.725594+0000","last_unstale":"2023-08-22T00:21:20.730228+0000","last_undegraded":"2023-08-22T00:21:20.730228+0000","last_fullsized":"2023-08-22T00:21:20.730228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713979+0000","last_change":"2023-08-22T00:21:20.346403+0000","last_active":"2023-08-22T00:21:20.713979+0000","last_peered":"2023-08-22T00:21:20.713979+0000","last_clean":"2023-08-22T00:21:20.713979+0000","last_became_active":"2023-08-22T00:21:20.345972+0000","last_became_peered":"2023-08-22T00:21:20.345972+0000","last_unstale":"2023-08-22T00:21:20.713979+0000","last_undegraded":"2023-08-22T00:21:20.713979+0000","last_fullsized":"2023-08-22T00:21:20.713979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734372+0000","last_change":"2023-08-22T00:21:20.729252+0000","last_active":"2023-08-22T00:21:20.734372+0000","last_peered":"2023-08-22T00:21:20.734372+0000","last_clean":"2023-08-22T00:21:20.734372+0000","last_became_active":"2023-08-22T00:21:20.728832+0000","last_became_peered":"2023-08-22T00:21:20.728832+0000","last_unstale":"2023-08-22T00:21:20.734372+0000","last_undegraded":"2023-08-22T00:21:20.734372+0000","last_fullsized":"2023-08-22T00:21:20.734372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720333+0000","last_change":"2023-08-22T00:21:20.349477+0000","last_active":"2023-08-22T00:21:20.720333+0000","last_peered":"2023-08-22T00:21:20.720333+0000","last_clean":"2023-08-22T00:21:20.720333+0000","last_became_active":"2023-08-22T00:21:20.349207+0000","last_became_peered":"2023-08-22T00:21:20.349207+0000","last_unstale":"2023-08-22T00:21:20.720333+0000","last_undegraded":"2023-08-22T00:21:20.720333+0000","last_fullsized":"2023-08-22T00:21:20.720333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.742055+0000","last_change":"2023-08-22T00:21:20.740968+0000","last_active":"2023-08-22T00:21:20.742055+0000","last_peered":"2023-08-22T00:21:20.742055+0000","last_clean":"2023-08-22T00:21:20.742055+0000","last_became_active":"2023-08-22T00:21:20.740562+0000","last_became_peered":"2023-08-22T00:21:20.740562+0000","last_unstale":"2023-08-22T00:21:20.742055+0000","last_undegraded":"2023-08-22T00:21:20.742055+0000","last_fullsized":"2023-08-22T00:21:20.742055+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.722171+0000","last_change":"2023-08-22T00:21:20.357600+0000","last_active":"2023-08-22T00:21:20.722171+0000","last_peered":"2023-08-22T00:21:20.722171+0000","last_clean":"2023-08-22T00:21:20.722171+0000","last_became_active":"2023-08-22T00:21:20.357329+0000","last_became_peered":"2023-08-22T00:21:20.357329+0000","last_unstale":"2023-08-22T00:21:20.722171+0000","last_undegraded":"2023-08-22T00:21:20.722171+0000","last_fullsized":"2023-08-22T00:21:20.722171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738622+0000","last_change":"2023-08-22T00:21:20.735506+0000","last_active":"2023-08-22T00:21:20.738622+0000","last_peered":"2023-08-22T00:21:20.738622+0000","last_clean":"2023-08-22T00:21:20.738622+0000","last_became_active":"2023-08-22T00:21:20.735252+0000","last_became_peered":"2023-08-22T00:21:20.735252+0000","last_unstale":"2023-08-22T00:21:20.738622+0000","last_undegraded":"2023-08-22T00:21:20.738622+0000","last_fullsized":"2023-08-22T00:21:20.738622+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.733009+0000","last_change":"2023-08-22T00:21:20.352786+0000","last_active":"2023-08-22T00:21:20.733009+0000","last_peered":"2023-08-22T00:21:20.733009+0000","last_clean":"2023-08-22T00:21:20.733009+0000","last_became_active":"2023-08-22T00:21:20.352504+0000","last_became_peered":"2023-08-22T00:21:20.352504+0000","last_unstale":"2023-08-22T00:21:20.733009+0000","last_undegraded":"2023-08-22T00:21:20.733009+0000","last_fullsized":"2023-08-22T00:21:20.733009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740019+0000","last_change":"2023-08-22T00:21:20.732413+0000","last_active":"2023-08-22T00:21:20.740019+0000","last_peered":"2023-08-22T00:21:20.740019+0000","last_clean":"2023-08-22T00:21:20.740019+0000","last_became_active":"2023-08-22T00:21:20.731889+0000","last_became_peered":"2023-08-22T00:21:20.731889+0000","last_unstale":"2023-08-22T00:21:20.740019+0000","last_undegraded":"2023-08-22T00:21:20.740019+0000","last_fullsized":"2023-08-22T00:21:20.740019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713456+0000","last_change":"2023-08-22T00:21:20.344291+0000","last_active":"2023-08-22T00:21:20.713456+0000","last_peered":"2023-08-22T00:21:20.713456+0000","last_clean":"2023-08-22T00:21:20.713456+0000","last_became_active":"2023-08-22T00:21:20.344031+0000","last_became_peered":"2023-08-22T00:21:20.344031+0000","last_unstale":"2023-08-22T00:21:20.713456+0000","last_undegraded":"2023-08-22T00:21:20.713456+0000","last_fullsized":"2023-08-22T00:21:20.713456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739793+0000","last_change":"2023-08-22T00:21:20.738552+0000","last_active":"2023-08-22T00:21:20.739793+0000","last_peered":"2023-08-22T00:21:20.739793+0000","last_clean":"2023-08-22T00:21:20.739793+0000","last_became_active":"2023-08-22T00:21:20.738275+0000","last_became_peered":"2023-08-22T00:21:20.738275+0000","last_unstale":"2023-08-22T00:21:20.739793+0000","last_undegraded":"2023-08-22T00:21:20.739793+0000","last_fullsized":"2023-08-22T00:21:20.739793+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710786+0000","last_change":"2023-08-22T00:21:20.355555+0000","last_active":"2023-08-22T00:21:20.710786+0000","last_peered":"2023-08-22T00:21:20.710786+0000","last_clean":"2023-08-22T00:21:20.710786+0000","last_became_active":"2023-08-22T00:21:20.355267+0000","last_became_peered":"2023-08-22T00:21:20.355267+0000","last_unstale":"2023-08-22T00:21:20.710786+0000","last_undegraded":"2023-08-22T00:21:20.710786+0000","last_fullsized":"2023-08-22T00:21:20.710786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739194+0000","last_change":"2023-08-22T00:21:20.727770+0000","last_active":"2023-08-22T00:21:20.739194+0000","last_peered":"2023-08-22T00:21:20.739194+0000","last_clean":"2023-08-22T00:21:20.739194+0000","last_became_active":"2023-08-22T00:21:20.727467+0000","last_became_peered":"2023-08-22T00:21:20.727467+0000","last_unstale":"2023-08-22T00:21:20.739194+0000","last_undegraded":"2023-08-22T00:21:20.739194+0000","last_fullsized":"2023-08-22T00:21:20.739194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.729974+0000","last_change":"2023-08-22T00:21:20.353575+0000","last_active":"2023-08-22T00:21:20.729974+0000","last_peered":"2023-08-22T00:21:20.729974+0000","last_clean":"2023-08-22T00:21:20.729974+0000","last_became_active":"2023-08-22T00:21:20.353264+0000","last_became_peered":"2023-08-22T00:21:20.353264+0000","last_unstale":"2023-08-22T00:21:20.729974+0000","last_undegraded":"2023-08-22T00:21:20.729974+0000","last_fullsized":"2023-08-22T00:21:20.729974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737693+0000","last_change":"2023-08-22T00:21:20.731958+0000","last_active":"2023-08-22T00:21:20.737693+0000","last_peered":"2023-08-22T00:21:20.737693+0000","last_clean":"2023-08-22T00:21:20.737693+0000","last_became_active":"2023-08-22T00:21:20.731704+0000","last_became_peered":"2023-08-22T00:21:20.731704+0000","last_unstale":"2023-08-22T00:21:20.737693+0000","last_undegraded":"2023-08-22T00:21:20.737693+0000","last_fullsized":"2023-08-22T00:21:20.737693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.725283+0000","last_change":"2023-08-22T00:21:20.358260+0000","last_active":"2023-08-22T00:21:20.725283+0000","last_peered":"2023-08-22T00:21:20.725283+0000","last_clean":"2023-08-22T00:21:20.725283+0000","last_became_active":"2023-08-22T00:21:20.357898+0000","last_became_peered":"2023-08-22T00:21:20.357898+0000","last_unstale":"2023-08-22T00:21:20.725283+0000","last_undegraded":"2023-08-22T00:21:20.725283+0000","last_fullsized":"2023-08-22T00:21:20.725283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739906+0000","last_change":"2023-08-22T00:21:20.728370+0000","last_active":"2023-08-22T00:21:20.739906+0000","last_peered":"2023-08-22T00:21:20.739906+0000","last_clean":"2023-08-22T00:21:20.739906+0000","last_became_active":"2023-08-22T00:21:20.728069+0000","last_became_peered":"2023-08-22T00:21:20.728069+0000","last_unstale":"2023-08-22T00:21:20.739906+0000","last_undegraded":"2023-08-22T00:21:20.739906+0000","last_fullsized":"2023-08-22T00:21:20.739906+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740016+0000","last_change":"2023-08-22T00:21:20.343141+0000","last_active":"2023-08-22T00:21:20.740016+0000","last_peered":"2023-08-22T00:21:20.740016+0000","last_clean":"2023-08-22T00:21:20.740016+0000","last_became_active":"2023-08-22T00:21:20.342639+0000","last_became_peered":"2023-08-22T00:21:20.342639+0000","last_unstale":"2023-08-22T00:21:20.740016+0000","last_undegraded":"2023-08-22T00:21:20.740016+0000","last_fullsized":"2023-08-22T00:21:20.740016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739177+0000","last_change":"2023-08-22T00:21:20.727325+0000","last_active":"2023-08-22T00:21:20.739177+0000","last_peered":"2023-08-22T00:21:20.739177+0000","last_clean":"2023-08-22T00:21:20.739177+0000","last_became_active":"2023-08-22T00:21:20.726982+0000","last_became_peered":"2023-08-22T00:21:20.726982+0000","last_unstale":"2023-08-22T00:21:20.739177+0000","last_undegraded":"2023-08-22T00:21:20.739177+0000","last_fullsized":"2023-08-22T00:21:20.739177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715570+0000","last_change":"2023-08-22T00:21:20.349798+0000","last_active":"2023-08-22T00:21:20.715570+0000","last_peered":"2023-08-22T00:21:20.715570+0000","last_clean":"2023-08-22T00:21:20.715570+0000","last_became_active":"2023-08-22T00:21:20.349526+0000","last_became_peered":"2023-08-22T00:21:20.349526+0000","last_unstale":"2023-08-22T00:21:20.715570+0000","last_undegraded":"2023-08-22T00:21:20.715570+0000","last_fullsized":"2023-08-22T00:21:20.715570+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739885+0000","last_change":"2023-08-22T00:21:20.738874+0000","last_active":"2023-08-22T00:21:20.739885+0000","last_peered":"2023-08-22T00:21:20.739885+0000","last_clean":"2023-08-22T00:21:20.739885+0000","last_became_active":"2023-08-22T00:21:20.738598+0000","last_became_peered":"2023-08-22T00:21:20.738598+0000","last_unstale":"2023-08-22T00:21:20.739885+0000","last_undegraded":"2023-08-22T00:21:20.739885+0000","last_fullsized":"2023-08-22T00:21:20.739885+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.716664+0000","last_change":"2023-08-22T00:21:20.350690+0000","last_active":"2023-08-22T00:21:20.716664+0000","last_peered":"2023-08-22T00:21:20.716664+0000","last_clean":"2023-08-22T00:21:20.716664+0000","last_became_active":"2023-08-22T00:21:20.350397+0000","last_became_peered":"2023-08-22T00:21:20.350397+0000","last_unstale":"2023-08-22T00:21:20.716664+0000","last_undegraded":"2023-08-22T00:21:20.716664+0000","last_fullsized":"2023-08-22T00:21:20.716664+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732020+0000","last_change":"2023-08-22T00:21:20.727917+0000","last_active":"2023-08-22T00:21:20.732020+0000","last_peered":"2023-08-22T00:21:20.732020+0000","last_clean":"2023-08-22T00:21:20.732020+0000","last_became_active":"2023-08-22T00:21:20.727693+0000","last_became_peered":"2023-08-22T00:21:20.727693+0000","last_unstale":"2023-08-22T00:21:20.732020+0000","last_undegraded":"2023-08-22T00:21:20.732020+0000","last_fullsized":"2023-08-22T00:21:20.732020+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713690+0000","last_change":"2023-08-22T00:21:20.341635+0000","last_active":"2023-08-22T00:21:20.713690+0000","last_peered":"2023-08-22T00:21:20.713690+0000","last_clean":"2023-08-22T00:21:20.713690+0000","last_became_active":"2023-08-22T00:21:20.341359+0000","last_became_peered":"2023-08-22T00:21:20.341359+0000","last_unstale":"2023-08-22T00:21:20.713690+0000","last_undegraded":"2023-08-22T00:21:20.713690+0000","last_fullsized":"2023-08-22T00:21:20.713690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735870+0000","last_change":"2023-08-22T00:21:20.727439+0000","last_active":"2023-08-22T00:21:20.735870+0000","last_peered":"2023-08-22T00:21:20.735870+0000","last_clean":"2023-08-22T00:21:20.735870+0000","last_became_active":"2023-08-22T00:21:20.727178+0000","last_became_peered":"2023-08-22T00:21:20.727178+0000","last_unstale":"2023-08-22T00:21:20.735870+0000","last_undegraded":"2023-08-22T00:21:20.735870+0000","last_fullsized":"2023-08-22T00:21:20.735870+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713821+0000","last_change":"2023-08-22T00:21:20.341035+0000","last_active":"2023-08-22T00:21:20.713821+0000","last_peered":"2023-08-22T00:21:20.713821+0000","last_clean":"2023-08-22T00:21:20.713821+0000","last_became_active":"2023-08-22T00:21:20.340758+0000","last_became_peered":"2023-08-22T00:21:20.340758+0000","last_unstale":"2023-08-22T00:21:20.713821+0000","last_undegraded":"2023-08-22T00:21:20.713821+0000","last_fullsized":"2023-08-22T00:21:20.713821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728423+0000","last_change":"2023-08-22T00:21:20.726789+0000","last_active":"2023-08-22T00:21:20.728423+0000","last_peered":"2023-08-22T00:21:20.728423+0000","last_clean":"2023-08-22T00:21:20.728423+0000","last_became_active":"2023-08-22T00:21:20.726517+0000","last_became_peered":"2023-08-22T00:21:20.726517+0000","last_unstale":"2023-08-22T00:21:20.728423+0000","last_undegraded":"2023-08-22T00:21:20.728423+0000","last_fullsized":"2023-08-22T00:21:20.728423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720006+0000","last_change":"2023-08-22T00:21:20.346312+0000","last_active":"2023-08-22T00:21:20.720006+0000","last_peered":"2023-08-22T00:21:20.720006+0000","last_clean":"2023-08-22T00:21:20.720006+0000","last_became_active":"2023-08-22T00:21:20.346053+0000","last_became_peered":"2023-08-22T00:21:20.346053+0000","last_unstale":"2023-08-22T00:21:20.720006+0000","last_undegraded":"2023-08-22T00:21:20.720006+0000","last_fullsized":"2023-08-22T00:21:20.720006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.742306+0000","last_change":"2023-08-22T00:21:20.741340+0000","last_active":"2023-08-22T00:21:20.742306+0000","last_peered":"2023-08-22T00:21:20.742306+0000","last_clean":"2023-08-22T00:21:20.742306+0000","last_became_active":"2023-08-22T00:21:20.740987+0000","last_became_peered":"2023-08-22T00:21:20.740987+0000","last_unstale":"2023-08-22T00:21:20.742306+0000","last_undegraded":"2023-08-22T00:21:20.742306+0000","last_fullsized":"2023-08-22T00:21:20.742306+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715901+0000","last_change":"2023-08-22T00:21:20.350325+0000","last_active":"2023-08-22T00:21:20.715901+0000","last_peered":"2023-08-22T00:21:20.715901+0000","last_clean":"2023-08-22T00:21:20.715901+0000","last_became_active":"2023-08-22T00:21:20.350066+0000","last_became_peered":"2023-08-22T00:21:20.350066+0000","last_unstale":"2023-08-22T00:21:20.715901+0000","last_undegraded":"2023-08-22T00:21:20.715901+0000","last_fullsized":"2023-08-22T00:21:20.715901+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739334+0000","last_change":"2023-08-22T00:21:20.728551+0000","last_active":"2023-08-22T00:21:20.739334+0000","last_peered":"2023-08-22T00:21:20.739334+0000","last_clean":"2023-08-22T00:21:20.739334+0000","last_became_active":"2023-08-22T00:21:20.728130+0000","last_became_peered":"2023-08-22T00:21:20.728130+0000","last_unstale":"2023-08-22T00:21:20.739334+0000","last_undegraded":"2023-08-22T00:21:20.739334+0000","last_fullsized":"2023-08-22T00:21:20.739334+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.714656+0000","last_change":"2023-08-22T00:21:20.352623+0000","last_active":"2023-08-22T00:21:20.714656+0000","last_peered":"2023-08-22T00:21:20.714656+0000","last_clean":"2023-08-22T00:21:20.714656+0000","last_became_active":"2023-08-22T00:21:20.352321+0000","last_became_peered":"2023-08-22T00:21:20.352321+0000","last_unstale":"2023-08-22T00:21:20.714656+0000","last_undegraded":"2023-08-22T00:21:20.714656+0000","last_fullsized":"2023-08-22T00:21:20.714656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.736992+0000","last_change":"2023-08-22T00:21:20.721892+0000","last_active":"2023-08-22T00:21:20.736992+0000","last_peered":"2023-08-22T00:21:20.736992+0000","last_clean":"2023-08-22T00:21:20.736992+0000","last_became_active":"2023-08-22T00:21:20.721588+0000","last_became_peered":"2023-08-22T00:21:20.721588+0000","last_unstale":"2023-08-22T00:21:20.736992+0000","last_undegraded":"2023-08-22T00:21:20.736992+0000","last_fullsized":"2023-08-22T00:21:20.736992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734806+0000","last_change":"2023-08-22T00:21:20.347608+0000","last_active":"2023-08-22T00:21:20.734806+0000","last_peered":"2023-08-22T00:21:20.734806+0000","last_clean":"2023-08-22T00:21:20.734806+0000","last_became_active":"2023-08-22T00:21:20.347316+0000","last_became_peered":"2023-08-22T00:21:20.347316+0000","last_unstale":"2023-08-22T00:21:20.734806+0000","last_undegraded":"2023-08-22T00:21:20.734806+0000","last_fullsized":"2023-08-22T00:21:20.734806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728160+0000","last_change":"2023-08-22T00:21:20.725340+0000","last_active":"2023-08-22T00:21:20.728160+0000","last_peered":"2023-08-22T00:21:20.728160+0000","last_clean":"2023-08-22T00:21:20.728160+0000","last_became_active":"2023-08-22T00:21:20.725088+0000","last_became_peered":"2023-08-22T00:21:20.725088+0000","last_unstale":"2023-08-22T00:21:20.728160+0000","last_undegraded":"2023-08-22T00:21:20.728160+0000","last_fullsized":"2023-08-22T00:21:20.728160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731715+0000","last_change":"2023-08-22T00:21:20.347290+0000","last_active":"2023-08-22T00:21:20.731715+0000","last_peered":"2023-08-22T00:21:20.731715+0000","last_clean":"2023-08-22T00:21:20.731715+0000","last_became_active":"2023-08-22T00:21:20.347018+0000","last_became_peered":"2023-08-22T00:21:20.347018+0000","last_unstale":"2023-08-22T00:21:20.731715+0000","last_undegraded":"2023-08-22T00:21:20.731715+0000","last_fullsized":"2023-08-22T00:21:20.731715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739997+0000","last_change":"2023-08-22T00:21:20.730359+0000","last_active":"2023-08-22T00:21:20.739997+0000","last_peered":"2023-08-22T00:21:20.739997+0000","last_clean":"2023-08-22T00:21:20.739997+0000","last_became_active":"2023-08-22T00:21:20.729249+0000","last_became_peered":"2023-08-22T00:21:20.729249+0000","last_unstale":"2023-08-22T00:21:20.739997+0000","last_undegraded":"2023-08-22T00:21:20.739997+0000","last_fullsized":"2023-08-22T00:21:20.739997+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.729239+0000","last_change":"2023-08-22T00:21:20.349958+0000","last_active":"2023-08-22T00:21:20.729239+0000","last_peered":"2023-08-22T00:21:20.729239+0000","last_clean":"2023-08-22T00:21:20.729239+0000","last_became_active":"2023-08-22T00:21:20.349605+0000","last_became_peered":"2023-08-22T00:21:20.349605+0000","last_unstale":"2023-08-22T00:21:20.729239+0000","last_undegraded":"2023-08-22T00:21:20.729239+0000","last_fullsized":"2023-08-22T00:21:20.729239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738705+0000","last_change":"2023-08-22T00:21:20.735357+0000","last_active":"2023-08-22T00:21:20.738705+0000","last_peered":"2023-08-22T00:21:20.738705+0000","last_clean":"2023-08-22T00:21:20.738705+0000","last_became_active":"2023-08-22T00:21:20.735076+0000","last_became_peered":"2023-08-22T00:21:20.735076+0000","last_unstale":"2023-08-22T00:21:20.738705+0000","last_undegraded":"2023-08-22T00:21:20.738705+0000","last_fullsized":"2023-08-22T00:21:20.738705+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713801+0000","last_change":"2023-08-22T00:21:20.353632+0000","last_active":"2023-08-22T00:21:20.713801+0000","last_peered":"2023-08-22T00:21:20.713801+0000","last_clean":"2023-08-22T00:21:20.713801+0000","last_became_active":"2023-08-22T00:21:20.353356+0000","last_became_peered":"2023-08-22T00:21:20.353356+0000","last_unstale":"2023-08-22T00:21:20.713801+0000","last_undegraded":"2023-08-22T00:21:20.713801+0000","last_fullsized":"2023-08-22T00:21:20.713801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.718507+0000","last_change":"2023-08-22T00:21:20.717902+0000","last_active":"2023-08-22T00:21:20.718507+0000","last_peered":"2023-08-22T00:21:20.718507+0000","last_clean":"2023-08-22T00:21:20.718507+0000","last_became_active":"2023-08-22T00:21:20.717628+0000","last_became_peered":"2023-08-22T00:21:20.717628+0000","last_unstale":"2023-08-22T00:21:20.718507+0000","last_undegraded":"2023-08-22T00:21:20.718507+0000","last_fullsized":"2023-08-22T00:21:20.718507+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732833+0000","last_change":"2023-08-22T00:21:20.348762+0000","last_active":"2023-08-22T00:21:20.732833+0000","last_peered":"2023-08-22T00:21:20.732833+0000","last_clean":"2023-08-22T00:21:20.732833+0000","last_became_active":"2023-08-22T00:21:20.348470+0000","last_became_peered":"2023-08-22T00:21:20.348470+0000","last_unstale":"2023-08-22T00:21:20.732833+0000","last_undegraded":"2023-08-22T00:21:20.732833+0000","last_fullsized":"2023-08-22T00:21:20.732833+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.738471+0000","last_change":"2023-08-22T00:21:20.735867+0000","last_active":"2023-08-22T00:21:20.738471+0000","last_peered":"2023-08-22T00:21:20.738471+0000","last_clean":"2023-08-22T00:21:20.738471+0000","last_became_active":"2023-08-22T00:21:20.735608+0000","last_became_peered":"2023-08-22T00:21:20.735608+0000","last_unstale":"2023-08-22T00:21:20.738471+0000","last_undegraded":"2023-08-22T00:21:20.738471+0000","last_fullsized":"2023-08-22T00:21:20.738471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739824+0000","last_change":"2023-08-22T00:21:20.349445+0000","last_active":"2023-08-22T00:21:20.739824+0000","last_peered":"2023-08-22T00:21:20.739824+0000","last_clean":"2023-08-22T00:21:20.739824+0000","last_became_active":"2023-08-22T00:21:20.349158+0000","last_became_peered":"2023-08-22T00:21:20.349158+0000","last_unstale":"2023-08-22T00:21:20.739824+0000","last_undegraded":"2023-08-22T00:21:20.739824+0000","last_fullsized":"2023-08-22T00:21:20.739824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728268+0000","last_change":"2023-08-22T00:21:20.725833+0000","last_active":"2023-08-22T00:21:20.728268+0000","last_peered":"2023-08-22T00:21:20.728268+0000","last_clean":"2023-08-22T00:21:20.728268+0000","last_became_active":"2023-08-22T00:21:20.725382+0000","last_became_peered":"2023-08-22T00:21:20.725382+0000","last_unstale":"2023-08-22T00:21:20.728268+0000","last_undegraded":"2023-08-22T00:21:20.728268+0000","last_fullsized":"2023-08-22T00:21:20.728268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732378+0000","last_change":"2023-08-22T00:21:20.349180+0000","last_active":"2023-08-22T00:21:20.732378+0000","last_peered":"2023-08-22T00:21:20.732378+0000","last_clean":"2023-08-22T00:21:20.732378+0000","last_became_active":"2023-08-22T00:21:20.348888+0000","last_became_peered":"2023-08-22T00:21:20.348888+0000","last_unstale":"2023-08-22T00:21:20.732378+0000","last_undegraded":"2023-08-22T00:21:20.732378+0000","last_fullsized":"2023-08-22T00:21:20.732378+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739047+0000","last_change":"2023-08-22T00:21:20.737405+0000","last_active":"2023-08-22T00:21:20.739047+0000","last_peered":"2023-08-22T00:21:20.739047+0000","last_clean":"2023-08-22T00:21:20.739047+0000","last_became_active":"2023-08-22T00:21:20.737094+0000","last_became_peered":"2023-08-22T00:21:20.737094+0000","last_unstale":"2023-08-22T00:21:20.739047+0000","last_undegraded":"2023-08-22T00:21:20.739047+0000","last_fullsized":"2023-08-22T00:21:20.739047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.736277+0000","last_change":"2023-08-22T00:21:20.352312+0000","last_active":"2023-08-22T00:21:20.736277+0000","last_peered":"2023-08-22T00:21:20.736277+0000","last_clean":"2023-08-22T00:21:20.736277+0000","last_became_active":"2023-08-22T00:21:20.351081+0000","last_became_peered":"2023-08-22T00:21:20.351081+0000","last_unstale":"2023-08-22T00:21:20.736277+0000","last_undegraded":"2023-08-22T00:21:20.736277+0000","last_fullsized":"2023-08-22T00:21:20.736277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739288+0000","last_change":"2023-08-22T00:21:20.728975+0000","last_active":"2023-08-22T00:21:20.739288+0000","last_peered":"2023-08-22T00:21:20.739288+0000","last_clean":"2023-08-22T00:21:20.739288+0000","last_became_active":"2023-08-22T00:21:20.728649+0000","last_became_peered":"2023-08-22T00:21:20.728649+0000","last_unstale":"2023-08-22T00:21:20.739288+0000","last_undegraded":"2023-08-22T00:21:20.739288+0000","last_fullsized":"2023-08-22T00:21:20.739288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719761+0000","last_change":"2023-08-22T00:21:20.344702+0000","last_active":"2023-08-22T00:21:20.719761+0000","last_peered":"2023-08-22T00:21:20.719761+0000","last_clean":"2023-08-22T00:21:20.719761+0000","last_became_active":"2023-08-22T00:21:20.343945+0000","last_became_peered":"2023-08-22T00:21:20.343945+0000","last_unstale":"2023-08-22T00:21:20.719761+0000","last_undegraded":"2023-08-22T00:21:20.719761+0000","last_fullsized":"2023-08-22T00:21:20.719761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740789+0000","last_change":"2023-08-22T00:21:20.738304+0000","last_active":"2023-08-22T00:21:20.740789+0000","last_peered":"2023-08-22T00:21:20.740789+0000","last_clean":"2023-08-22T00:21:20.740789+0000","last_became_active":"2023-08-22T00:21:20.737728+0000","last_became_peered":"2023-08-22T00:21:20.737728+0000","last_unstale":"2023-08-22T00:21:20.740789+0000","last_undegraded":"2023-08-22T00:21:20.740789+0000","last_fullsized":"2023-08-22T00:21:20.740789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.711536+0000","last_change":"2023-08-22T00:21:20.343765+0000","last_active":"2023-08-22T00:21:20.711536+0000","last_peered":"2023-08-22T00:21:20.711536+0000","last_clean":"2023-08-22T00:21:20.711536+0000","last_became_active":"2023-08-22T00:21:20.343499+0000","last_became_peered":"2023-08-22T00:21:20.343499+0000","last_unstale":"2023-08-22T00:21:20.711536+0000","last_undegraded":"2023-08-22T00:21:20.711536+0000","last_fullsized":"2023-08-22T00:21:20.711536+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737756+0000","last_change":"2023-08-22T00:21:20.732191+0000","last_active":"2023-08-22T00:21:20.737756+0000","last_peered":"2023-08-22T00:21:20.737756+0000","last_clean":"2023-08-22T00:21:20.737756+0000","last_became_active":"2023-08-22T00:21:20.731502+0000","last_became_peered":"2023-08-22T00:21:20.731502+0000","last_unstale":"2023-08-22T00:21:20.737756+0000","last_undegraded":"2023-08-22T00:21:20.737756+0000","last_fullsized":"2023-08-22T00:21:20.737756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719518+0000","last_change":"2023-08-22T00:21:20.347336+0000","last_active":"2023-08-22T00:21:20.719518+0000","last_peered":"2023-08-22T00:21:20.719518+0000","last_clean":"2023-08-22T00:21:20.719518+0000","last_became_active":"2023-08-22T00:21:20.347061+0000","last_became_peered":"2023-08-22T00:21:20.347061+0000","last_unstale":"2023-08-22T00:21:20.719518+0000","last_undegraded":"2023-08-22T00:21:20.719518+0000","last_fullsized":"2023-08-22T00:21:20.719518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739606+0000","last_change":"2023-08-22T00:21:20.731991+0000","last_active":"2023-08-22T00:21:20.739606+0000","last_peered":"2023-08-22T00:21:20.739606+0000","last_clean":"2023-08-22T00:21:20.739606+0000","last_became_active":"2023-08-22T00:21:20.730634+0000","last_became_peered":"2023-08-22T00:21:20.730634+0000","last_unstale":"2023-08-22T00:21:20.739606+0000","last_undegraded":"2023-08-22T00:21:20.739606+0000","last_fullsized":"2023-08-22T00:21:20.739606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713754+0000","last_change":"2023-08-22T00:21:20.342918+0000","last_active":"2023-08-22T00:21:20.713754+0000","last_peered":"2023-08-22T00:21:20.713754+0000","last_clean":"2023-08-22T00:21:20.713754+0000","last_became_active":"2023-08-22T00:21:20.342636+0000","last_became_peered":"2023-08-22T00:21:20.342636+0000","last_unstale":"2023-08-22T00:21:20.713754+0000","last_undegraded":"2023-08-22T00:21:20.713754+0000","last_fullsized":"2023-08-22T00:21:20.713754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.733422+0000","last_change":"2023-08-22T00:21:20.728079+0000","last_active":"2023-08-22T00:21:20.733422+0000","last_peered":"2023-08-22T00:21:20.733422+0000","last_clean":"2023-08-22T00:21:20.733422+0000","last_became_active":"2023-08-22T00:21:20.727852+0000","last_became_peered":"2023-08-22T00:21:20.727852+0000","last_unstale":"2023-08-22T00:21:20.733422+0000","last_undegraded":"2023-08-22T00:21:20.733422+0000","last_fullsized":"2023-08-22T00:21:20.733422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.714069+0000","last_change":"2023-08-22T00:21:20.349259+0000","last_active":"2023-08-22T00:21:20.714069+0000","last_peered":"2023-08-22T00:21:20.714069+0000","last_clean":"2023-08-22T00:21:20.714069+0000","last_became_active":"2023-08-22T00:21:20.348993+0000","last_became_peered":"2023-08-22T00:21:20.348993+0000","last_unstale":"2023-08-22T00:21:20.714069+0000","last_undegraded":"2023-08-22T00:21:20.714069+0000","last_fullsized":"2023-08-22T00:21:20.714069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740123+0000","last_change":"2023-08-22T00:21:20.731798+0000","last_active":"2023-08-22T00:21:20.740123+0000","last_peered":"2023-08-22T00:21:20.740123+0000","last_clean":"2023-08-22T00:21:20.740123+0000","last_became_active":"2023-08-22T00:21:20.731420+0000","last_became_peered":"2023-08-22T00:21:20.731420+0000","last_unstale":"2023-08-22T00:21:20.740123+0000","last_undegraded":"2023-08-22T00:21:20.740123+0000","last_fullsized":"2023-08-22T00:21:20.740123+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713925+0000","last_change":"2023-08-22T00:21:20.348234+0000","last_active":"2023-08-22T00:21:20.713925+0000","last_peered":"2023-08-22T00:21:20.713925+0000","last_clean":"2023-08-22T00:21:20.713925+0000","last_became_active":"2023-08-22T00:21:20.347961+0000","last_became_peered":"2023-08-22T00:21:20.347961+0000","last_unstale":"2023-08-22T00:21:20.713925+0000","last_undegraded":"2023-08-22T00:21:20.713925+0000","last_fullsized":"2023-08-22T00:21:20.713925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728141+0000","last_change":"2023-08-22T00:21:20.724613+0000","last_active":"2023-08-22T00:21:20.728141+0000","last_peered":"2023-08-22T00:21:20.728141+0000","last_clean":"2023-08-22T00:21:20.728141+0000","last_became_active":"2023-08-22T00:21:20.724352+0000","last_became_peered":"2023-08-22T00:21:20.724352+0000","last_unstale":"2023-08-22T00:21:20.728141+0000","last_undegraded":"2023-08-22T00:21:20.728141+0000","last_fullsized":"2023-08-22T00:21:20.728141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720198+0000","last_change":"2023-08-22T00:21:20.357018+0000","last_active":"2023-08-22T00:21:20.720198+0000","last_peered":"2023-08-22T00:21:20.720198+0000","last_clean":"2023-08-22T00:21:20.720198+0000","last_became_active":"2023-08-22T00:21:20.356759+0000","last_became_peered":"2023-08-22T00:21:20.356759+0000","last_unstale":"2023-08-22T00:21:20.720198+0000","last_undegraded":"2023-08-22T00:21:20.720198+0000","last_fullsized":"2023-08-22T00:21:20.720198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720498+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:20.720498+0000","last_peered":"2023-08-22T00:21:20.720498+0000","last_clean":"2023-08-22T00:21:20.720498+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:20.720498+0000","last_undegraded":"2023-08-22T00:21:20.720498+0000","last_fullsized":"2023-08-22T00:21:20.720498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734278+0000","last_change":"2023-08-22T00:21:20.728548+0000","last_active":"2023-08-22T00:21:20.734278+0000","last_peered":"2023-08-22T00:21:20.734278+0000","last_clean":"2023-08-22T00:21:20.734278+0000","last_became_active":"2023-08-22T00:21:20.728060+0000","last_became_peered":"2023-08-22T00:21:20.728060+0000","last_unstale":"2023-08-22T00:21:20.734278+0000","last_undegraded":"2023-08-22T00:21:20.734278+0000","last_fullsized":"2023-08-22T00:21:20.734278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.713956+0000","last_change":"2023-08-22T00:21:20.341245+0000","last_active":"2023-08-22T00:21:20.713956+0000","last_peered":"2023-08-22T00:21:20.713956+0000","last_clean":"2023-08-22T00:21:20.713956+0000","last_became_active":"2023-08-22T00:21:20.340518+0000","last_became_peered":"2023-08-22T00:21:20.340518+0000","last_unstale":"2023-08-22T00:21:20.713956+0000","last_undegraded":"2023-08-22T00:21:20.713956+0000","last_fullsized":"2023-08-22T00:21:20.713956+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.733094+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:20.733094+0000","last_peered":"2023-08-22T00:21:20.733094+0000","last_clean":"2023-08-22T00:21:20.733094+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:20.733094+0000","last_undegraded":"2023-08-22T00:21:20.733094+0000","last_fullsized":"2023-08-22T00:21:20.733094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.735680+0000","last_change":"2023-08-22T00:21:20.733035+0000","last_active":"2023-08-22T00:21:20.735680+0000","last_peered":"2023-08-22T00:21:20.735680+0000","last_clean":"2023-08-22T00:21:20.735680+0000","last_became_active":"2023-08-22T00:21:20.732780+0000","last_became_peered":"2023-08-22T00:21:20.732780+0000","last_unstale":"2023-08-22T00:21:20.735680+0000","last_undegraded":"2023-08-22T00:21:20.735680+0000","last_fullsized":"2023-08-22T00:21:20.735680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.732951+0000","last_change":"2023-08-22T00:21:20.358666+0000","last_active":"2023-08-22T00:21:20.732951+0000","last_peered":"2023-08-22T00:21:20.732951+0000","last_clean":"2023-08-22T00:21:20.732951+0000","last_became_active":"2023-08-22T00:21:20.358370+0000","last_became_peered":"2023-08-22T00:21:20.358370+0000","last_unstale":"2023-08-22T00:21:20.732951+0000","last_undegraded":"2023-08-22T00:21:20.732951+0000","last_fullsized":"2023-08-22T00:21:20.732951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719654+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:20.719654+0000","last_peered":"2023-08-22T00:21:20.719654+0000","last_clean":"2023-08-22T00:21:20.719654+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:20.719654+0000","last_undegraded":"2023-08-22T00:21:20.719654+0000","last_fullsized":"2023-08-22T00:21:20.719654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.744597+0000","last_change":"2023-08-22T00:21:20.739813+0000","last_active":"2023-08-22T00:21:20.744597+0000","last_peered":"2023-08-22T00:21:20.744597+0000","last_clean":"2023-08-22T00:21:20.744597+0000","last_became_active":"2023-08-22T00:21:20.739538+0000","last_became_peered":"2023-08-22T00:21:20.739538+0000","last_unstale":"2023-08-22T00:21:20.744597+0000","last_undegraded":"2023-08-22T00:21:20.744597+0000","last_fullsized":"2023-08-22T00:21:20.744597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.728675+0000","last_change":"2023-08-22T00:21:20.347959+0000","last_active":"2023-08-22T00:21:20.728675+0000","last_peered":"2023-08-22T00:21:20.728675+0000","last_clean":"2023-08-22T00:21:20.728675+0000","last_became_active":"2023-08-22T00:21:20.347670+0000","last_became_peered":"2023-08-22T00:21:20.347670+0000","last_unstale":"2023-08-22T00:21:20.728675+0000","last_undegraded":"2023-08-22T00:21:20.728675+0000","last_fullsized":"2023-08-22T00:21:20.728675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734109+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:20.734109+0000","last_peered":"2023-08-22T00:21:20.734109+0000","last_clean":"2023-08-22T00:21:20.734109+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:20.734109+0000","last_undegraded":"2023-08-22T00:21:20.734109+0000","last_fullsized":"2023-08-22T00:21:20.734109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720461+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:20.720461+0000","last_peered":"2023-08-22T00:21:20.720461+0000","last_clean":"2023-08-22T00:21:20.720461+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:20.720461+0000","last_undegraded":"2023-08-22T00:21:20.720461+0000","last_fullsized":"2023-08-22T00:21:20.720461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.734288+0000","last_change":"2023-08-22T00:21:20.727025+0000","last_active":"2023-08-22T00:21:20.734288+0000","last_peered":"2023-08-22T00:21:20.734288+0000","last_clean":"2023-08-22T00:21:20.734288+0000","last_became_active":"2023-08-22T00:21:20.726812+0000","last_became_peered":"2023-08-22T00:21:20.726812+0000","last_unstale":"2023-08-22T00:21:20.734288+0000","last_undegraded":"2023-08-22T00:21:20.734288+0000","last_fullsized":"2023-08-22T00:21:20.734288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.710877+0000","last_change":"2023-08-22T00:21:20.348991+0000","last_active":"2023-08-22T00:21:20.710877+0000","last_peered":"2023-08-22T00:21:20.710877+0000","last_clean":"2023-08-22T00:21:20.710877+0000","last_became_active":"2023-08-22T00:21:20.348661+0000","last_became_peered":"2023-08-22T00:21:20.348661+0000","last_unstale":"2023-08-22T00:21:20.710877+0000","last_undegraded":"2023-08-22T00:21:20.710877+0000","last_fullsized":"2023-08-22T00:21:20.710877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.717511+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:20.717511+0000","last_peered":"2023-08-22T00:21:20.717511+0000","last_clean":"2023-08-22T00:21:20.717511+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:20.717511+0000","last_undegraded":"2023-08-22T00:21:20.717511+0000","last_fullsized":"2023-08-22T00:21:20.717511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.731593+0000","last_change":"2023-08-22T00:21:20.727324+0000","last_active":"2023-08-22T00:21:20.731593+0000","last_peered":"2023-08-22T00:21:20.731593+0000","last_clean":"2023-08-22T00:21:20.731593+0000","last_became_active":"2023-08-22T00:21:20.726919+0000","last_became_peered":"2023-08-22T00:21:20.726919+0000","last_unstale":"2023-08-22T00:21:20.731593+0000","last_undegraded":"2023-08-22T00:21:20.731593+0000","last_fullsized":"2023-08-22T00:21:20.731593+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715157+0000","last_change":"2023-08-22T00:21:20.341428+0000","last_active":"2023-08-22T00:21:20.715157+0000","last_peered":"2023-08-22T00:21:20.715157+0000","last_clean":"2023-08-22T00:21:20.715157+0000","last_became_active":"2023-08-22T00:21:20.341125+0000","last_became_peered":"2023-08-22T00:21:20.341125+0000","last_unstale":"2023-08-22T00:21:20.715157+0000","last_undegraded":"2023-08-22T00:21:20.715157+0000","last_fullsized":"2023-08-22T00:21:20.715157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.720401+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:20.720401+0000","last_peered":"2023-08-22T00:21:20.720401+0000","last_clean":"2023-08-22T00:21:20.720401+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:20.720401+0000","last_undegraded":"2023-08-22T00:21:20.720401+0000","last_fullsized":"2023-08-22T00:21:20.720401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.739352+0000","last_change":"2023-08-22T00:21:20.729846+0000","last_active":"2023-08-22T00:21:20.739352+0000","last_peered":"2023-08-22T00:21:20.739352+0000","last_clean":"2023-08-22T00:21:20.739352+0000","last_became_active":"2023-08-22T00:21:20.729500+0000","last_became_peered":"2023-08-22T00:21:20.729500+0000","last_unstale":"2023-08-22T00:21:20.739352+0000","last_undegraded":"2023-08-22T00:21:20.739352+0000","last_fullsized":"2023-08-22T00:21:20.739352+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.740071+0000","last_change":"2023-08-22T00:21:20.341753+0000","last_active":"2023-08-22T00:21:20.740071+0000","last_peered":"2023-08-22T00:21:20.740071+0000","last_clean":"2023-08-22T00:21:20.740071+0000","last_became_active":"2023-08-22T00:21:20.341477+0000","last_became_peered":"2023-08-22T00:21:20.341477+0000","last_unstale":"2023-08-22T00:21:20.740071+0000","last_undegraded":"2023-08-22T00:21:20.740071+0000","last_fullsized":"2023-08-22T00:21:20.740071+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.719432+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:20.719432+0000","last_peered":"2023-08-22T00:21:20.719432+0000","last_clean":"2023-08-22T00:21:20.719432+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:20.719432+0000","last_undegraded":"2023-08-22T00:21:20.719432+0000","last_fullsized":"2023-08-22T00:21:20.719432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.730453+0000","last_change":"2023-08-22T00:21:20.726358+0000","last_active":"2023-08-22T00:21:20.730453+0000","last_peered":"2023-08-22T00:21:20.730453+0000","last_clean":"2023-08-22T00:21:20.730453+0000","last_became_active":"2023-08-22T00:21:20.726100+0000","last_became_peered":"2023-08-22T00:21:20.726100+0000","last_unstale":"2023-08-22T00:21:20.730453+0000","last_undegraded":"2023-08-22T00:21:20.730453+0000","last_fullsized":"2023-08-22T00:21:20.730453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:20.322833+0000","last_clean_scrub_stamp":"2023-08-22T00:21:20.322833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.737133+0000","last_change":"2023-08-22T00:21:20.348044+0000","last_active":"2023-08-22T00:21:20.737133+0000","last_peered":"2023-08-22T00:21:20.737133+0000","last_clean":"2023-08-22T00:21:20.737133+0000","last_became_active":"2023-08-22T00:21:20.347591+0000","last_became_peered":"2023-08-22T00:21:20.347591+0000","last_unstale":"2023-08-22T00:21:20.737133+0000","last_undegraded":"2023-08-22T00:21:20.737133+0000","last_fullsized":"2023-08-22T00:21:20.737133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:19.318036+0000","last_clean_scrub_stamp":"2023-08-22T00:21:19.318036+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-22T00:21:20.715488+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:20.715488+0000","last_peered":"2023-08-22T00:21:20.715488+0000","last_clean":"2023-08-22T00:21:20.715488+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:20.715488+0000","last_undegraded":"2023-08-22T00:21:20.715488+0000","last_fullsized":"2023-08-22T00:21:20.715488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":575284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.441,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.36499999999999999,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.48799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46899999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.46700000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.316},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.79100000000000004},"last":0.33800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.376},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.308},"max":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.751},"last":0.41099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.748,"15min":0.95399999999999996},"last":0.502}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.84099999999999997},"last":0.48099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065476,"statfs":{"total":96636764160,"available":96323047424,"internally_reserved":0,"allocated":1101824,"data_stored":574450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.46400000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.751,"5min":0.755,"15min":0.99299999999999999},"last":0.495}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.41199999999999998,"15min":0.29599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.502}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.1339999999999999},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.79000000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.073},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69399999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.39300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.753,"15min":0.94399999999999995},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.752,"15min":1.03},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":1110016,"data_stored":575590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39000000000000001,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.184},"max":{"1min":0.54900000000000004,"5min":2.504,"15min":2.504},"last":0.27900000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.374,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.501,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.309},{"interface":"front","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.32300000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.57499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.33200000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":1.117,"15min":1.3360000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.83199999999999996,"5min":2.298,"15min":2.298},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.71899999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.40699999999999997,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":2.992,"15min":2.992},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.78000000000000003,"5min":2.323,"15min":2.323},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.505,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.48999999999999999,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.432,"15min":0.41899999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56000000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.443}]},{"osd":5,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.84099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.93700000000000006},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.38900000000000001},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":1.0149999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:20:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":0.92100000000000004,"15min":0.98799999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.26400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.20499999999999999},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":0.625,"5min":0.67900000000000005,"15min":0.71199999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"min":{"1min":0.32600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":1.0580000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.97899999999999998,"15min":1.0169999999999999},"last":0.441}]},{"osd":5,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":0.77800000000000002,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.95199999999999996},"last":0.5}]},{"osd":6,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":0.998,"15min":0.998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.89600000000000002,"15min":0.97499999999999998},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":0.96499999999999997,"15min":1.0349999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.98599999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":1101824,"data_stored":574470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.314,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.32900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.63600000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.33100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.47799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81599999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.89500000000000002,"15min":11.163},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065484,"statfs":{"total":96636764160,"available":96323055616,"internally_reserved":0,"allocated":1093632,"data_stored":574358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.77600000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.71699999999999997,"5min":0.753,"15min":0.79800000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77300000000000002},"last":0.58599999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.78700000000000003},"last":0.624}]},{"osd":3,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.82299999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.75600000000000001},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55100000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.30199999999999999},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77800000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.85899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.52200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":1105920,"data_stored":575894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.46500000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.873},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.313},"max":{"1min":0.72299999999999998,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.497},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67900000000000005,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.95999999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.92800000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.88},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44}]},{"osd":6,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58299999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:29.114 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:21:29.115 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:21:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.267+0000 7f3183fad700 1 Processor -- start 2023-08-22T00:21:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 -- start start 2023-08-22T00:21:29.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c5750 0x7f317c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f317c1579e0 0x7f317c063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f317c0c2010 0x7f317c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0c1850 con 0x7f317c1579e0 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c064280 con 0x7f317c0c2010 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.268+0000 7f3183fad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0c4c20 con 0x7f317c0c5750 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f317c1579e0 0x7f317c063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f317c1579e0 0x7f317c063000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53388/0 (socket says 172.21.15.98:53388) 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 -- 172.21.15.98:0/73767384 learned_addr learned my addr 172.21.15.98:0/73767384 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f318254a700 1 --2- 172.21.15.98:0/73767384 >> v2:172.21.15.118:3300/0 conn(0x7f317c0c2010 0x7f317c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181d49700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c5750 0x7f317c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 -- 172.21.15.98:0/73767384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c5750 msgr2=0x7f317c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c5750 0x7f317c0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 -- 172.21.15.98:0/73767384 >> v2:172.21.15.118:3300/0 conn(0x7f317c0c2010 msgr2=0x7f317c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 --2- 172.21.15.98:0/73767384 >> v2:172.21.15.118:3300/0 conn(0x7f317c0c2010 0x7f317c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 -- 172.21.15.98:0/73767384 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c063670 con 0x7f317c1579e0 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3181548700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c1579e0 0x7f317c063000 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f317c062af0 tx=0x7f31780090f0).ready entity=mon.0 client_cookie=9be4892982424df2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3180d47700 1 -- 172.21.15.98:0/73767384 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800b600 con 0x7f317c1579e0 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3180d47700 1 -- 172.21.15.98:0/73767384 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800b760 con 0x7f317c1579e0 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.269+0000 7f3180d47700 1 -- 172.21.15.98:0/73767384 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800bae0 con 0x7f317c1579e0 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 -- 172.21.15.98:0/73767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c1579e0 msgr2=0x7f317c063000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c1579e0 0x7f317c063000 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f317c062af0 tx=0x7f31780090f0).stop 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 -- 172.21.15.98:0/73767384 shutdown_connections 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c5750 0x7f317c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 --2- 172.21.15.98:0/73767384 >> v2:172.21.15.118:3300/0 conn(0x7f317c0c2010 0x7f317c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 --2- 172.21.15.98:0/73767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c1579e0 0x7f317c063000 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 -- 172.21.15.98:0/73767384 >> 172.21.15.98:0/73767384 conn(0x7f317c0c3a60 msgr2=0x7f317c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 -- 172.21.15.98:0/73767384 shutdown_connections 2023-08-22T00:21:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.270+0000 7f3183fad700 1 -- 172.21.15.98:0/73767384 wait complete. 2023-08-22T00:21:29.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.271+0000 7f3183fad700 1 Processor -- start 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.271+0000 7f3183fad700 1 -- start start 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 0x7f317c0abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 0x7f317c0aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0ab990 con 0x7f317c0c5750 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0aad80 con 0x7f317c1579e0 2023-08-22T00:21:29.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0ab060 con 0x7f317c0c2010 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53392/0 (socket says 172.21.15.98:53392) 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 -- 172.21.15.98:0/283329440 learned_addr learned my addr 172.21.15.98:0/283329440 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181d49700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 0x7f317c0abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f318254a700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 0x7f317c0aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 -- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 msgr2=0x7f317c0abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 0x7f317c0abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 -- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 msgr2=0x7f317c0aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 0x7f317c0aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 -- 172.21.15.98:0/283329440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178009370 con 0x7f317c0c5750 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181d49700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 0x7f317c0abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f318254a700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 0x7f317c0aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3181548700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f3178009130 tx=0x7f3178017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800b8d0 con 0x7f317c0c5750 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800ba30 con 0x7f317c0c5750 2023-08-22T00:21:29.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c0ab340 con 0x7f317c0c5750 2023-08-22T00:21:29.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.272+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317801c670 con 0x7f317c0c5750 2023-08-22T00:21:29.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.273+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c0aaa30 con 0x7f317c0c5750 2023-08-22T00:21:29.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c0abb00 con 0x7f317c0c5750 2023-08-22T00:21:29.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f317801c9e0 con 0x7f317c0c5750 2023-08-22T00:21:29.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3171ffb700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 0x7f31600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f317807bc60 con 0x7f317c0c5750 2023-08-22T00:21:29.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3181d49700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 0x7f31600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.274+0000 7f3181d49700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 0x7f31600613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f316c00bb60 tx=0x7f316c008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.278+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f317804cdf0 con 0x7f317c0c5750 2023-08-22T00:21:29.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.501+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f317c063950 con 0x7f317c0c5750 2023-08-22T00:21:29.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.505+0000 7f3171ffb700 1 -- 172.21.15.98:0/283329440 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3178050410 con 0x7f317c0c5750 2023-08-22T00:21:29.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 msgr2=0x7f31600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 0x7f31600613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f316c00bb60 tx=0x7f316c008040).stop 2023-08-22T00:21:29.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 msgr2=0x7f317c0aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f3178009130 tx=0x7f3178017000).stop 2023-08-22T00:21:29.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 shutdown_connections 2023-08-22T00:21:29.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f316005ef30 0x7f31600613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f317c0c2010 0x7f317c0abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f317c1579e0 0x7f317c0aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 --2- 172.21.15.98:0/283329440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f317c0c5750 0x7f317c0aa050 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 >> 172.21.15.98:0/283329440 conn(0x7f317c0c3a60 msgr2=0x7f317c157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:29.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 shutdown_connections 2023-08-22T00:21:29.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.507+0000 7f3183fad700 1 -- 172.21.15.98:0/283329440 wait complete. 2023-08-22T00:21:29.512 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:21:29.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.635+0000 7f4fcab82700 1 Processor -- start 2023-08-22T00:21:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.635+0000 7f4fcab82700 1 -- start start 2023-08-22T00:21:29.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fcab82700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fc4153f10 0x7f4fc4150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fcab82700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4fc40c26b0 0x7f4fc40c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fcab82700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40c2220 con 0x7f4fc4150040 2023-08-22T00:21:29.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fcab82700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40c5bd0 con 0x7f4fc4153f10 2023-08-22T00:21:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fcab82700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40c1ef0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fc3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fc4153f10 0x7f4fc4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fc3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fc4153f10 0x7f4fc4150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53406/0 (socket says 172.21.15.98:53406) 2023-08-22T00:21:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fc3fff700 1 -- 172.21.15.98:0/2855314978 learned_addr learned my addr 172.21.15.98:0/2855314978 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.636+0000 7f4fc911f700 1 --2- 172.21.15.98:0/2855314978 >> v2:172.21.15.118:3300/0 conn(0x7f4fc40c26b0 0x7f4fc40c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc3fff700 1 -- 172.21.15.98:0/2855314978 >> v2:172.21.15.118:3300/0 conn(0x7f4fc40c26b0 msgr2=0x7f4fc40c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2855314978 >> v2:172.21.15.118:3300/0 conn(0x7f4fc40c26b0 0x7f4fc40c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc3fff700 1 -- 172.21.15.98:0/2855314978 >> v1:172.21.15.118:6789/0 conn(0x7f4fc4150040 legacy=0x7f4fc40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc3fff700 1 -- 172.21.15.98:0/2855314978 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40c5e30 con 0x7f4fc4153f10 2023-08-22T00:21:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2855314978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc4153f10 0x7f4fc4150420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f4fc40c4cd0 tx=0x7f4fb00090f0).ready entity=mon.0 client_cookie=8323a95227f639c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc37fe700 1 -- 172.21.15.98:0/2855314978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000b520 con 0x7f4fc4153f10 2023-08-22T00:21:29.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc37fe700 1 -- 172.21.15.98:0/2855314978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb000b680 con 0x7f4fc4153f10 2023-08-22T00:21:29.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fc37fe700 1 -- 172.21.15.98:0/2855314978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000ba00 con 0x7f4fc4153f10 2023-08-22T00:21:29.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 -- 172.21.15.98:0/2855314978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc4153f10 msgr2=0x7f4fc4150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2855314978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc4153f10 0x7f4fc4150420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f4fc40c4cd0 tx=0x7f4fb00090f0).stop 2023-08-22T00:21:29.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 -- 172.21.15.98:0/2855314978 shutdown_connections 2023-08-22T00:21:29.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2855314978 >> v2:172.21.15.118:3300/0 conn(0x7f4fc40c26b0 0x7f4fc40c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2855314978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc4153f10 0x7f4fc4150420 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 -- 172.21.15.98:0/2855314978 >> 172.21.15.98:0/2855314978 conn(0x7f4fc40c7140 msgr2=0x7f4fc40c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:29.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 -- 172.21.15.98:0/2855314978 shutdown_connections 2023-08-22T00:21:29.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.637+0000 7f4fcab82700 1 -- 172.21.15.98:0/2855314978 wait complete. 2023-08-22T00:21:29.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.638+0000 7f4fcab82700 1 Processor -- start 2023-08-22T00:21:29.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 -- start start 2023-08-22T00:21:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 0x7f4fc414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 0x7f4fc414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4151a40 con 0x7f4fc40c26b0 2023-08-22T00:21:29.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40aa9f0 con 0x7f4fc4153f10 2023-08-22T00:21:29.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.639+0000 7f4fcab82700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40aacd0 con 0x7f4fc4150040 2023-08-22T00:21:29.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53420/0 (socket says 172.21.15.98:53420) 2023-08-22T00:21:29.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 -- 172.21.15.98:0/2880891632 learned_addr learned my addr 172.21.15.98:0/2880891632 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:29.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc911f700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 0x7f4fc414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 0x7f4fc414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 -- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 msgr2=0x7f4fc414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 0x7f4fc414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 -- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 msgr2=0x7f4fc414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 0x7f4fc414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 -- 172.21.15.98:0/2880891632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009370 con 0x7f4fc40c26b0 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc911f700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 0x7f4fc414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 0x7f4fc414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc891e700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4fb800c4c0 tx=0x7f4fb8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8007020 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8001e90 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80073b0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc41513f0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.640+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc40aa6d0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.641+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc4047480 con 0x7f4fc40c26b0 2023-08-22T00:21:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.641+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4fb80068b0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.642+0000 7f4fc0ff9700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 0x7f4fa80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.642+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4fb8079b60 con 0x7f4fc40c26b0 2023-08-22T00:21:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.642+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 0x7f4fa80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.642+0000 7f4fc3fff700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 0x7f4fa80613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4fc40ac8a0 tx=0x7f4fb0017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.646+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fb804acf0 con 0x7f4fc40c26b0 2023-08-22T00:21:29.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.847+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fc4154d70 con 0x7f4fc40c26b0 2023-08-22T00:21:29.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.847+0000 7f4fc0ff9700 1 -- 172.21.15.98:0/2880891632 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f4fb804e310 con 0x7f4fc40c26b0 2023-08-22T00:21:29.849 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:29.850 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:29.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 msgr2=0x7f4fa80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 0x7f4fa80613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4fc40ac8a0 tx=0x7f4fb0017000).stop 2023-08-22T00:21:29.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 msgr2=0x7f4fc40aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:29.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4fb800c4c0 tx=0x7f4fb8007e00).stop 2023-08-22T00:21:29.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 shutdown_connections 2023-08-22T00:21:29.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc4153f10 0x7f4fc414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fc40c26b0 0x7f4fc40aa1e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fa805ef30 0x7f4fa80613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 --2- 172.21.15.98:0/2880891632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fc4150040 0x7f4fc414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 >> 172.21.15.98:0/2880891632 conn(0x7f4fc40c7140 msgr2=0x7f4fc40a58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 shutdown_connections 2023-08-22T00:21:29.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:29.849+0000 7f4fcab82700 1 -- 172.21.15.98:0/2880891632 wait complete. 2023-08-22T00:21:29.857 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:30.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:21:20.707368+0000', 'modified': '2023-08-22T00:21:23.335879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6441}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6441': {'gid': 6441, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6836/3477152775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 3477152775}, {'type': 'v1', 'addr': '172.21.15.98:6836', 'nonce': 3477152775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:21:30.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:21:30.266 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-22T00:21:30.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.385+0000 7fe2c7992700 1 Processor -- start 2023-08-22T00:21:30.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.385+0000 7fe2c7992700 1 -- start start 2023-08-22T00:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c7992700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2c014e5d0 0x7fe2c0154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c7992700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2c0154a80 0x7fe2c0063f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c7992700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c01554f0 con 0x7fe2c00be430 2023-08-22T00:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c7992700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c0154f30 con 0x7fe2c014e5d0 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c7992700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c0155210 con 0x7fe2c0154a80 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2c014e5d0 0x7fe2c0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe2c014e5d0 0x7fe2c0154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36270/0 (socket says 172.21.15.98:36270) 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 -- 172.21.15.98:0/1012444908 learned_addr learned my addr 172.21.15.98:0/1012444908 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/1012444908 >> v2:172.21.15.118:3300/0 conn(0x7fe2c0154a80 0x7fe2c0063f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 -- 172.21.15.98:0/1012444908 >> v2:172.21.15.118:3300/0 conn(0x7fe2c0154a80 msgr2=0x7fe2c0063f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 --2- 172.21.15.98:0/1012444908 >> v2:172.21.15.118:3300/0 conn(0x7fe2c0154a80 0x7fe2c0063f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 -- 172.21.15.98:0/1012444908 >> v1:172.21.15.118:6789/0 conn(0x7fe2c00be430 legacy=0x7fe2c00c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 -- 172.21.15.98:0/1012444908 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00bc7f0 con 0x7fe2c014e5d0 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2c572e700 1 --2- 172.21.15.98:0/1012444908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c0154590 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe2c0062960 tx=0x7fe2bc0090f0).ready entity=mon.0 client_cookie=746db4004ad40951 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2b7fff700 1 -- 172.21.15.98:0/1012444908 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00b5a0 con 0x7fe2c014e5d0 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2b7fff700 1 -- 172.21.15.98:0/1012444908 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00b700 con 0x7fe2c014e5d0 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.386+0000 7fe2b7fff700 1 -- 172.21.15.98:0/1012444908 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00ba80 con 0x7fe2c014e5d0 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 -- 172.21.15.98:0/1012444908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 msgr2=0x7fe2c0154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 --2- 172.21.15.98:0/1012444908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c0154590 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe2c0062960 tx=0x7fe2bc0090f0).stop 2023-08-22T00:21:30.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 -- 172.21.15.98:0/1012444908 shutdown_connections 2023-08-22T00:21:30.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 --2- 172.21.15.98:0/1012444908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c0154590 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 --2- 172.21.15.98:0/1012444908 >> v2:172.21.15.118:3300/0 conn(0x7fe2c0154a80 0x7fe2c0063f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 -- 172.21.15.98:0/1012444908 >> 172.21.15.98:0/1012444908 conn(0x7fe2c00c4290 msgr2=0x7fe2c00c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 -- 172.21.15.98:0/1012444908 shutdown_connections 2023-08-22T00:21:30.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.387+0000 7fe2c7992700 1 -- 172.21.15.98:0/1012444908 wait complete. 2023-08-22T00:21:30.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.388+0000 7fe2c7992700 1 Processor -- start 2023-08-22T00:21:30.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.388+0000 7fe2c7992700 1 -- start start 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2c00be430 0x7fe2c014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 0x7fe2c00a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c6d10 con 0x7fe2c014e5d0 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00aa110 con 0x7fe2c00be430 2023-08-22T00:21:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c7992700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c014aee0 con 0x7fe2c0154a80 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36286/0 (socket says 172.21.15.98:36286) 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/243981792 learned_addr learned my addr 172.21.15.98:0/243981792 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c572e700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2c00be430 0x7fe2c014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 0x7fe2c00a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 msgr2=0x7fe2c00a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 0x7fe2c00a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2c00be430 msgr2=0x7fe2c014a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2c00be430 0x7fe2c014a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/243981792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009370 con 0x7fe2c014e5d0 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.389+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 0x7fe2c00a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fe2b0006980 tx=0x7fe2b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2b57fa700 1 -- 172.21.15.98:0/243981792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0011590 con 0x7fe2c014e5d0 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2b57fa700 1 -- 172.21.15.98:0/243981792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00116f0 con 0x7fe2c014e5d0 2023-08-22T00:21:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00a4e40 con 0x7fe2c014e5d0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2b57fa700 1 -- 172.21.15.98:0/243981792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0011a70 con 0x7fe2c014e5d0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.390+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00c6470 con 0x7fe2c014e5d0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.391+0000 7fe2b57fa700 1 -- 172.21.15.98:0/243981792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe2b0012420 con 0x7fe2c014e5d0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.391+0000 7fe2b57fa700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 0x7fe2a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.391+0000 7fe2b57fa700 1 -- 172.21.15.98:0/243981792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe2b0079bf0 con 0x7fe2c014e5d0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.391+0000 7fe2c572e700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 0x7fe2a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.392+0000 7fe2c572e700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 0x7fe2a40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe2bc009130 tx=0x7fe2bc015000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 Processor -- start 2023-08-22T00:21:30.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 -- start start 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c07600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c07f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256b48db0 con 0x55a256c0c2c0 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256b5e030 con 0x55a256c54f60 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.394+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a256b5e170 con 0x55a256c07af0 2023-08-22T00:21:30.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36296/0 (socket says 172.21.15.98:36296) 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 -- 172.21.15.98:0/3006843332 learned_addr learned my addr 172.21.15.98:0/3006843332 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c07f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 -- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 msgr2=0x55a256c07f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c07f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 -- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 msgr2=0x55a256c07600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c07600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 -- 172.21.15.98:0/3006843332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a256b30b00 con 0x55a256c0c2c0 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fe2c00aa520 tx=0x7fe2bc020000).ready entity=mon.0 client_cookie=bbed365335613c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2aa7fc700 1 -- 172.21.15.98:0/3006843332 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc02a070 con 0x55a256c0c2c0 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2aa7fc700 1 -- 172.21.15.98:0/3006843332 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc01a5d0 con 0x55a256c0c2c0 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.395+0000 7fe2aa7fc700 1 -- 172.21.15.98:0/3006843332 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc020070 con 0x55a256c0c2c0 2023-08-22T00:21:30.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3006843332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 msgr2=0x55a256c0c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fe2c00aa520 tx=0x7fe2bc020000).stop 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3006843332 shutdown_connections 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0c6a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3006843332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c07600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3006843332 >> 172.21.15.98:0/3006843332 conn(0x55a256a76940 msgr2=0x55a256c553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3006843332 shutdown_connections 2023-08-22T00:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3006843332 wait complete. 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.396+0000 7fe2d9346b80 1 -- start start 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.397+0000 7fe2d9346b80 1 Processor -- start 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c0c2c0 0x55a256c63980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c63e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256b5e3f0 con 0x55a256c07af0 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256b29920 con 0x55a256c0c2c0 2023-08-22T00:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a256c4f2d0 con 0x55a256c54f60 2023-08-22T00:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 10 client.0 ll_register_callbacks cb 0x55a256afece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36298/0 (socket says 172.21.15.98:36298) 2023-08-22T00:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 -- 172.21.15.98:0/3070671504 learned_addr learned my addr 172.21.15.98:0/3070671504 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c0c2c0 0x55a256c63980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c63e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 -- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 msgr2=0x55a256c63e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c63e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 -- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c0c2c0 msgr2=0x55a256c63980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c0c2c0 0x55a256c63980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 -- 172.21.15.98:0/3070671504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00bc7f0 con 0x55a256c07af0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c63e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fe2bc006d00 tx=0x7fe2bc02a000).ready entity=mon.0 client_cookie=12cbeb92c87ea66d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe29f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc020040 con 0x55a256c07af0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe2bc02f670 con 0x55a256c07af0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.398+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a256c06aa0 con 0x55a256c07af0 2023-08-22T00:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2bc02fa40 con 0x55a256c07af0 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 10 client.6621 fetch_fsmap learned FSMap version 30 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55a256b56f70 con 0x55a256c07af0 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a256c06aa0 con 0x55a256c07af0 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe2bc02fba0 con 0x55a256c07af0 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 10 client.6621 fetch_fsmap finished waiting for FSMap version 30 2023-08-22T00:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 10 client.6621 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 20 client.6621 populate_metadata read hostname 'smithi098' 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c50c20 0x55a256c51000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 4 client.6621 mds_command: new command op to 6441 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 --> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2569c6ef0 con 0x55a256c50c20 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c50c20 0x55a256c51000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe29f7fe700 10 client.6621 ms_handle_connect on v2:172.21.15.98:6834/3477152775 2023-08-22T00:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.399+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c50c20 0x55a256c51000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e273913598ba1462 server_cookie=61b76fa01d26d0ba in_seq=0 out_seq=0 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3070671504 <== mds.0 v2:172.21.15.98:6834/3477152775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a2569c6ef0 con 0x55a256c50c20 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe29f7fe700 10 client.6621 handle_command_reply: tid=0 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 client.6621 shutdown 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 msgr2=0x55a256c62020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fe2bc006d00 tx=0x7fe2bc02a000).stop 2023-08-22T00:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 shutdown_connections 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c50c20 0x55a256c51000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c63e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c07af0 0x55a256c62020 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe29f7fe700 0 client.6621 ms_handle_reset on v2:172.21.15.98:6834/3477152775 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3070671504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c0c2c0 0x55a256c63980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 >> 172.21.15.98:0/3070671504 conn(0x55a256a76940 msgr2=0x55a256c0a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 shutdown_connections 2023-08-22T00:21:30.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3070671504 wait complete. 2023-08-22T00:21:30.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.400+0000 7fe2d9346b80 20 client.6621 trim_cache size 0 max 16384 2023-08-22T00:21:30.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.416+0000 7fe2d9346b80 1 Processor -- start 2023-08-22T00:21:30.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 -- start start 2023-08-22T00:21:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 0x55a256c373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c38380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256c4f850 con 0x55a256c0c2c0 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256c07890 con 0x55a256c07af0 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a256c036b0 con 0x55a256c54f60 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36302/0 (socket says 172.21.15.98:36302) 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.417+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3915654505 learned_addr learned my addr 172.21.15.98:0/3915654505 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 0x55a256c373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c38380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 msgr2=0x55a256c38380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c38380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 msgr2=0x55a256c373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 0x55a256c373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3915654505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a256b52580 con 0x55a256c0c2c0 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 0x55a256c373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fe2b004e620 tx=0x7fe2b001e040).ready entity=mon.0 client_cookie=20ed1c55da0a9649 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2aaffd700 1 -- 172.21.15.98:0/3915654505 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0059110 con 0x55a256c0c2c0 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2aaffd700 1 -- 172.21.15.98:0/3915654505 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b004ca60 con 0x55a256c0c2c0 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2aaffd700 1 -- 172.21.15.98:0/3915654505 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b004ccc0 con 0x55a256c0c2c0 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3915654505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 msgr2=0x55a256c0a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fe2b004e620 tx=0x7fe2b001e040).stop 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3915654505 shutdown_connections 2023-08-22T00:21:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c54f60 0x55a256c38380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c07af0 0x55a256c373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3915654505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c0a320 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3915654505 >> 172.21.15.98:0/3915654505 conn(0x55a256a76940 msgr2=0x55a256c55340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.418+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3915654505 shutdown_connections 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.419+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3915654505 wait complete. 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.419+0000 7fe2d9346b80 1 -- start start 2023-08-22T00:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.419+0000 7fe2d9346b80 1 Processor -- start 2023-08-22T00:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c38380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c51000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256c38d60 con 0x55a256c0c2c0 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a256cb6e00 con 0x55a256c54f60 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a256c60880 con 0x55a256c07af0 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2d9346b80 10 client.0 ll_register_callbacks cb 0x55a256afece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c5f2f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c51000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36314/0 (socket says 172.21.15.98:36314) 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3410509801 learned_addr learned my addr 172.21.15.98:0/3410509801 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c38380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 msgr2=0x55a256c38380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c38380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.420+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 msgr2=0x55a256c51000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c51000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2c4f2d700 1 -- 172.21.15.98:0/3410509801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00c6470 con 0x55a256c0c2c0 2023-08-22T00:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2c5f2f700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c51000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2c4f2d700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fe2b004e620 tx=0x7fe2b005d000).ready entity=mon.0 client_cookie=ca9c6e251d982603 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b004ccc0 con 0x55a256c0c2c0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe2b0077620 con 0x55a256c0c2c0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2bc01a5d0 con 0x55a256c0c2c0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b00777e0 con 0x55a256c0c2c0 2023-08-22T00:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 10 client.6627 fetch_fsmap learned FSMap version 30 2023-08-22T00:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55a256b522d0 con 0x55a256c0c2c0 2023-08-22T00:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc01a5d0 con 0x55a256c0c2c0 2023-08-22T00:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe2b0060070 con 0x55a256c0c2c0 2023-08-22T00:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 10 client.6627 fetch_fsmap finished waiting for FSMap version 30 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 10 client.6627 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 20 client.6627 populate_metadata read hostname 'smithi098' 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c08730 0x55a256c514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 4 client.6627 mds_command: new command op to 6441 tid=0[{"prefix": "status"}] 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 --> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a2569fc040 con 0x55a256c08730 2023-08-22T00:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.421+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c08730 0x55a256c514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe29f7fe700 10 client.6627 ms_handle_connect on v2:172.21.15.98:6834/3477152775 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2c572e700 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c08730 0x55a256c514f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=817e436f8b03dd1a server_cookie=5a7e1aabb01b1d24 in_seq=0 out_seq=0 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe29f7fe700 1 -- 172.21.15.98:0/3410509801 <== mds.0 v2:172.21.15.98:6834/3477152775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a2569fc040 con 0x55a256c08730 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe29f7fe700 10 client.6627 handle_command_reply: tid=0 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 client.6627 shutdown 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 msgr2=0x55a256c38870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fe2b004e620 tx=0x7fe2b005d000).stop 2023-08-22T00:21:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 shutdown_connections 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:6834/3477152775,v1:172.21.15.98:6836/3477152775] conn(0x55a256c08730 0x55a256c514f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a256c07af0 0x55a256c38380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe29f7fe700 0 client.6627 ms_handle_reset on v2:172.21.15.98:6834/3477152775 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a256c54f60 0x55a256c51000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 --2- 172.21.15.98:0/3410509801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a256c0c2c0 0x55a256c38870 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 >> 172.21.15.98:0/3410509801 conn(0x55a256a76940 msgr2=0x55a256c39630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 shutdown_connections 2023-08-22T00:21:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 1 -- 172.21.15.98:0/3410509801 wait complete. 2023-08-22T00:21:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.422+0000 7fe2d9346b80 20 client.6627 trim_cache size 0 max 16384 2023-08-22T00:21:30.435 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:21:30.435 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 6441, 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:21:30.436 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.7140828799999994, 2023-08-22T00:21:30.437 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 30, 2023-08-22T00:21:30.437 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 90, 2023-08-22T00:21:30.437 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 90, 2023-08-22T00:21:30.437 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.224403307999999 2023-08-22T00:21:30.437 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:21:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 msgr2=0x7fe2a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 0x7fe2a40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe2bc009130 tx=0x7fe2bc015000).stop 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 msgr2=0x7fe2c00a9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fe2b0006980 tx=0x7fe2b0008040).stop 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 shutdown_connections 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe2a405ef30 0x7fe2a40613f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2c0154a80 0x7fe2c00a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2c00be430 0x7fe2c014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 --2- 172.21.15.98:0/243981792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2c014e5d0 0x7fe2c00a9730 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 >> 172.21.15.98:0/243981792 conn(0x7fe2c00c4290 msgr2=0x7fe2c00c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 shutdown_connections 2023-08-22T00:21:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.423+0000 7fe2c7992700 1 -- 172.21.15.98:0/243981792 wait complete. 2023-08-22T00:21:30.440 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:21:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.546+0000 7fb793529700 1 Processor -- start 2023-08-22T00:21:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.546+0000 7fb793529700 1 -- start start 2023-08-22T00:21:30.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb793529700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb78c14e240 0x7fb78c0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb793529700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0c2200 con 0x7fb78c0c1b30 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb793529700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0c24e0 con 0x7fb78c065df0 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb793529700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c0c1fe0 con 0x7fb78c14e240 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb7912c5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb78c14e240 0x7fb78c0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb790ac4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb78c0c1b30 0x7fb78c0656e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49172/0 (socket says 172.21.15.98:49172) 2023-08-22T00:21:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb790ac4700 1 -- 172.21.15.98:0/1556908654 learned_addr learned my addr 172.21.15.98:0/1556908654 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb7912c5700 1 -- 172.21.15.98:0/1556908654 >> v1:172.21.15.118:6789/0 conn(0x7fb78c065df0 legacy=0x7fb78c0629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb7912c5700 1 -- 172.21.15.98:0/1556908654 >> v1:172.21.15.98:6789/0 conn(0x7fb78c0c1b30 legacy=0x7fb78c0656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb783fff700 1 -- 172.21.15.98:0/1556908654 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006037117 0 0) 0x7fb78c0c2200 con 0x7fb78c0c1b30 2023-08-22T00:21:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb7912c5700 1 -- 172.21.15.98:0/1556908654 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0c27c0 con 0x7fb78c14e240 2023-08-22T00:21:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb7912c5700 1 --2- 172.21.15.98:0/1556908654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0c1640 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fb788009760 tx=0x7fb788009060).ready entity=mon.0 client_cookie=c98f5b439f274b40 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb783fff700 1 -- 172.21.15.98:0/1556908654 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800b520 con 0x7fb78c14e240 2023-08-22T00:21:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb783fff700 1 -- 172.21.15.98:0/1556908654 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78800b680 con 0x7fb78c14e240 2023-08-22T00:21:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.547+0000 7fb783fff700 1 -- 172.21.15.98:0/1556908654 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800ba00 con 0x7fb78c14e240 2023-08-22T00:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 -- 172.21.15.98:0/1556908654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 msgr2=0x7fb78c0c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 --2- 172.21.15.98:0/1556908654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0c1640 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fb788009760 tx=0x7fb788009060).stop 2023-08-22T00:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 -- 172.21.15.98:0/1556908654 shutdown_connections 2023-08-22T00:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 --2- 172.21.15.98:0/1556908654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0c1640 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 -- 172.21.15.98:0/1556908654 >> 172.21.15.98:0/1556908654 conn(0x7fb78c0c3a30 msgr2=0x7fb78c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 -- 172.21.15.98:0/1556908654 shutdown_connections 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.548+0000 7fb793529700 1 -- 172.21.15.98:0/1556908654 wait complete. 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.549+0000 7fb793529700 1 Processor -- start 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.549+0000 7fb793529700 1 -- start start 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb78c065df0 0x7fb78c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb78c0c1b30 0x7fb78c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0bf020 con 0x7fb78c14e240 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0be4a0 con 0x7fb78c065df0 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb793529700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0be780 con 0x7fb78c0c1b30 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36324/0 (socket says 172.21.15.98:36324) 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 -- 172.21.15.98:0/667945417 learned_addr learned my addr 172.21.15.98:0/667945417 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb790ac4700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb78c0c1b30 0x7fb78c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb7912c5700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb78c065df0 0x7fb78c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 -- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb78c0c1b30 msgr2=0x7fb78c14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb78c0c1b30 0x7fb78c14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 -- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb78c065df0 msgr2=0x7fb78c14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb78c065df0 0x7fb78c14cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.550+0000 7fb791ac6700 1 -- 172.21.15.98:0/667945417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880092a0 con 0x7fb78c14e240 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb791ac6700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fb78400c810 tx=0x7fb784002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784010510 con 0x7fb78c14e240 2023-08-22T00:21:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784010690 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784010a50 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c0bea60 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.551+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c14d0b0 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.552+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c047480 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.552+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb784012440 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.552+0000 7fb7817fa700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 0x7fb7700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.552+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb784079ac0 con 0x7fb78c14e240 2023-08-22T00:21:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.552+0000 7fb7912c5700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 0x7fb7700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.553+0000 7fb7912c5700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 0x7fb7700613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb78800b2e0 tx=0x7fb788017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.556+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7840488f0 con 0x7fb78c14e240 2023-08-22T00:21:30.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.756+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb78c0c2aa0 con 0x7fb78c14e240 2023-08-22T00:21:30.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.756+0000 7fb7817fa700 1 -- 172.21.15.98:0/667945417 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb78404abe0 con 0x7fb78c14e240 2023-08-22T00:21:30.758 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:21:30.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 msgr2=0x7fb7700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 0x7fb7700613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb78800b2e0 tx=0x7fb788017000).stop 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 msgr2=0x7fb78c0bc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fb78400c810 tx=0x7fb784002560).stop 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 shutdown_connections 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb78c14e240 0x7fb78c0bc770 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb78c065df0 0x7fb78c14cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb77005ef30 0x7fb7700613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 --2- 172.21.15.98:0/667945417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb78c0c1b30 0x7fb78c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:30.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 >> 172.21.15.98:0/667945417 conn(0x7fb78c0c3a30 msgr2=0x7fb78c151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:30.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 shutdown_connections 2023-08-22T00:21:30.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:30.758+0000 7fb793529700 1 -- 172.21.15.98:0/667945417 wait complete. 2023-08-22T00:21:30.771 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:21:30.771 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:21:30.772 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:21:30.772 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:21:30.772 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:30.773 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:21:30.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:21:30.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:21:30.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:21:30.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:30.774 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:21:30.793 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:21:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:21:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:21:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:21:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:21:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:21:30.795 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:21:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:21:30.795 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:21:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41615sec preferred_lft 41615sec 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:21:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.797 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:21:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:21:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:21:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:21:30.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:30.798 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:21:30.859 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:21:30.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:30.861 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:21:30.921 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:21:30.921 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:21:30.921 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:21:30.922 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:21:30.922 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:21:30.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:30.922 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:21:30.923 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:21:30.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:21:30.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:21:30.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:21:30.924 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:21:31.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:31.026 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:21:31.045 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:21:31.045 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:21:31.045 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:21:31.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:31.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:21:31.112 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:21:31.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:31.113 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:31.171 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:21:31.171 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:21:31.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:21:31.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:21:31.305 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:21:31.307 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:21:31.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:31.309 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:21:31.367 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:21:31.367 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:31.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:21:31.437 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:21:31.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:21:31.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:21:31.491+0000 7faada50b3c0 -1 init, newargv = 0x5577994d4c30 newargc=15 2023-08-22T00:21:31.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[148776]: starting ceph client 2023-08-22T00:21:31.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[148776]: starting fuse 2023-08-22T00:21:31.505 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:21:31.506 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:21:31.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:31.508 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:21:31.565 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:21:31.566 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:21:31.566 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:21:31.567 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:21:31.567 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:21:31.567 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:21:31.568 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:21:31.568 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:21:31.568 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:21:31.569 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:21:31.569 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:21:31.569 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:21:31.570 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:21:31.570 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:21:31.570 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:21:31.570 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:21:31.571 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:21:31.571 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:21:31.571 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:21:31.572 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:21:31.572 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:21:31.572 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:21:31.573 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:21:31.573 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:21:31.573 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:21:31.573 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:21:31.574 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:21:31.574 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:21:31.574 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:21:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.148776.asok 2023-08-22T00:21:31.872 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.148776.asok 2023-08-22T00:21:31.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:31.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.148776.asok status 2023-08-22T00:21:32.023 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:21:32.024 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:21:32.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:21:32.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:21:32.025 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:21:32.025 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:21:32.025 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:21:32.025 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "148776", 2023-08-22T00:21:32.026 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:21:32.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:32.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:21:32.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:21:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 6642, 2023-08-22T00:21:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:21:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:21:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:21:32.028 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 6642 2023-08-22T00:21:32.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:32.028 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:21:32.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:21:32.029 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:21:32.029 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1344111500 2023-08-22T00:21:32.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:32.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:32.030 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:21:32.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:21:32.030 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:21:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1344111500 2023-08-22T00:21:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.6642 192.168.0.1:0/1344111500", 2023-08-22T00:21:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/1344111500", 2023-08-22T00:21:32.032 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:21:32.032 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 30, 2023-08-22T00:21:32.032 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 90, 2023-08-22T00:21:32.032 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:21:32.033 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:21:32.033 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:21:32.033 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:21:32.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:32.035 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:21:32.036 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:32.055 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:21:32.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:32.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:32.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:32.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:21:32.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.279+0000 7f19c97c6700 1 Processor -- start 2023-08-22T00:21:32.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.279+0000 7f19c97c6700 1 -- start start 2023-08-22T00:21:32.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c97c6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19c4151960 0x7f19c40c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c97c6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 0x7f19c4063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c97c6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40c2b40 con 0x7f19c4064390 2023-08-22T00:21:32.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c97c6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c4064820 con 0x7f19c4151960 2023-08-22T00:21:32.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c97c6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4151d40 con 0x7f19c4155050 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19c4151960 0x7f19c40c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c37fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f19c4064390 0x7f19c4157900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49188/0 (socket says 172.21.15.98:49188) 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19c4151960 0x7f19c40c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36326/0 (socket says 172.21.15.98:36326) 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.280+0000 7f19c37fe700 1 -- 172.21.15.98:0/1495070777 learned_addr learned my addr 172.21.15.98:0/1495070777 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c2ffd700 1 -- 172.21.15.98:0/1495070777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 msgr2=0x7f19c4063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:32.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c27fc700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 0x7f19c4063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c2ffd700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 0x7f19c4063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c2ffd700 1 -- 172.21.15.98:0/1495070777 >> v1:172.21.15.98:6789/0 conn(0x7f19c4064390 legacy=0x7f19c4157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c1ffb700 1 -- 172.21.15.98:0/1495070777 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969483770 0 0) 0x7f19c40c2b40 con 0x7f19c4064390 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c2ffd700 1 -- 172.21.15.98:0/1495070777 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40c1f30 con 0x7f19c4151960 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c27fc700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 0x7f19c4063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c2ffd700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c40c1630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f19b8009760 tx=0x7f19b8009060).ready entity=mon.0 client_cookie=5459026c6df995fb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c1ffb700 1 -- 172.21.15.98:0/1495070777 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800b580 con 0x7f19c4151960 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c1ffb700 1 -- 172.21.15.98:0/1495070777 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800b6e0 con 0x7f19c4151960 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c1ffb700 1 -- 172.21.15.98:0/1495070777 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800ba60 con 0x7f19c4151960 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c97c6700 1 -- 172.21.15.98:0/1495070777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 msgr2=0x7f19c40c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c97c6700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c40c1630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f19b8009760 tx=0x7f19b8009060).stop 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.281+0000 7f19c97c6700 1 -- 172.21.15.98:0/1495070777 shutdown_connections 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.282+0000 7f19c97c6700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c40c1630 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.282+0000 7f19c97c6700 1 --2- 172.21.15.98:0/1495070777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4155050 0x7f19c4063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.282+0000 7f19c97c6700 1 -- 172.21.15.98:0/1495070777 >> 172.21.15.98:0/1495070777 conn(0x7f19c4069680 msgr2=0x7f19c4069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:32.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.282+0000 7f19c97c6700 1 -- 172.21.15.98:0/1495070777 shutdown_connections 2023-08-22T00:21:32.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.282+0000 7f19c97c6700 1 -- 172.21.15.98:0/1495070777 wait complete. 2023-08-22T00:21:32.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.283+0000 7f19c97c6700 1 Processor -- start 2023-08-22T00:21:32.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.283+0000 7f19c97c6700 1 -- start start 2023-08-22T00:21:32.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4064390 0x7f19c40aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c4155050 0x7f19c40ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40a6e80 con 0x7f19c4151960 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40ab130 con 0x7f19c4155050 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4168130 con 0x7f19c4064390 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36340/0 (socket says 172.21.15.98:36340) 2023-08-22T00:21:32.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 -- 172.21.15.98:0/867279214 learned_addr learned my addr 172.21.15.98:0/867279214 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:32.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c37fe700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c4155050 0x7f19c40ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c2ffd700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4064390 0x7f19c40aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 -- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4064390 msgr2=0x7f19c40aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4064390 0x7f19c40aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 -- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c4155050 msgr2=0x7f19c40ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c4155050 0x7f19c40ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 -- 172.21.15.98:0/867279214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80092a0 con 0x7f19c4151960 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c27fc700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f19b400c670 tx=0x7f19b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4015070 con 0x7f19c4151960 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4010580 con 0x7f19c4151960 2023-08-22T00:21:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c4168410 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4010900 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.284+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c40a6b10 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.285+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4068320 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.285+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f19b4010d30 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.286+0000 7f19aaffd700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 0x7f19b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.286+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f19b4079c60 con 0x7f19c4151960 2023-08-22T00:21:32.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.286+0000 7f19c2ffd700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 0x7f19b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.286+0000 7f19c2ffd700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 0x7f19b00613f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f19b800b340 tx=0x7f19b8017000).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.290+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19b404adf0 con 0x7f19c4151960 2023-08-22T00:21:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.478+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f19c40c2210 con 0x7f19b005ef30 2023-08-22T00:21:32.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.479+0000 7f19aaffd700 1 -- 172.21.15.98:0/867279214 <== mgr.6255 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f19c40c2210 con 0x7f19b005ef30 2023-08-22T00:21:32.481 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:21:32.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:32.481 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:21:32.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:32.482 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 msgr2=0x7f19b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 0x7f19b00613f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f19b800b340 tx=0x7f19b8017000).stop 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 msgr2=0x7f19c4167850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f19b400c670 tx=0x7f19b4008040).stop 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 shutdown_connections 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f19b005ef30 0x7f19b00613f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c4064390 0x7f19c40aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c4155050 0x7f19c40ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 --2- 172.21.15.98:0/867279214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19c4151960 0x7f19c4167850 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 >> 172.21.15.98:0/867279214 conn(0x7f19c4069680 msgr2=0x7f19c40c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:32.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 shutdown_connections 2023-08-22T00:21:32.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.481+0000 7f19c97c6700 1 -- 172.21.15.98:0/867279214 wait complete. 2023-08-22T00:21:32.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:21:32.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.611+0000 7fe1b34b2700 1 Processor -- start 2023-08-22T00:21:32.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.611+0000 7fe1b34b2700 1 -- start start 2023-08-22T00:21:32.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1ac1507e0 0x7fe1ac065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac0c34c0 0x7fe1ac0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c2100 con 0x7fe1ac0c3940 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c7690 con 0x7fe1ac1507e0 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b34b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c40b0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36356/0 (socket says 172.21.15.98:36356) 2023-08-22T00:21:32.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 -- 172.21.15.98:0/4071113666 learned_addr learned my addr 172.21.15.98:0/4071113666 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:32.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b124e700 1 --2- 172.21.15.98:0/4071113666 >> v2:172.21.15.118:3300/0 conn(0x7fe1ac1507e0 0x7fe1ac065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b0a4d700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac0c34c0 0x7fe1ac0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 -- 172.21.15.98:0/4071113666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac0c34c0 msgr2=0x7fe1ac0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:32.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac0c34c0 0x7fe1ac0c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 -- 172.21.15.98:0/4071113666 >> v2:172.21.15.118:3300/0 conn(0x7fe1ac1507e0 msgr2=0x7fe1ac065730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:32.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 --2- 172.21.15.98:0/4071113666 >> v2:172.21.15.118:3300/0 conn(0x7fe1ac1507e0 0x7fe1ac065730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 -- 172.21.15.98:0/4071113666 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac066780 con 0x7fe1ac0c3940 2023-08-22T00:21:32.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.612+0000 7fe1b1a4f700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fe1ac0696c0 tx=0x7fe1a4009840).ready entity=mon.0 client_cookie=5df3a291d49f1b2c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1a3fff700 1 -- 172.21.15.98:0/4071113666 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400e070 con 0x7fe1ac0c3940 2023-08-22T00:21:32.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1a3fff700 1 -- 172.21.15.98:0/4071113666 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400ba40 con 0x7fe1ac0c3940 2023-08-22T00:21:32.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1a3fff700 1 -- 172.21.15.98:0/4071113666 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400bdc0 con 0x7fe1ac0c3940 2023-08-22T00:21:32.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 -- 172.21.15.98:0/4071113666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c3940 msgr2=0x7fe1ac0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fe1ac0696c0 tx=0x7fe1a4009840).stop 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 -- 172.21.15.98:0/4071113666 shutdown_connections 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c3940 0x7fe1ac0c71a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/4071113666 >> v2:172.21.15.118:3300/0 conn(0x7fe1ac1507e0 0x7fe1ac065730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/4071113666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac0c34c0 0x7fe1ac0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 -- 172.21.15.98:0/4071113666 >> 172.21.15.98:0/4071113666 conn(0x7fe1ac0c7800 msgr2=0x7fe1ac0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:32.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 -- 172.21.15.98:0/4071113666 shutdown_connections 2023-08-22T00:21:32.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.613+0000 7fe1b34b2700 1 -- 172.21.15.98:0/4071113666 wait complete. 2023-08-22T00:21:32.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.614+0000 7fe1b34b2700 1 Processor -- start 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.614+0000 7fe1b34b2700 1 -- start start 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac1507e0 0x7fe1ac162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0c1270 0x7fe1ac163300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac145870 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0ac2c0 con 0x7fe1ac0c1270 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b34b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac144df0 con 0x7fe1ac1507e0 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b124e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b124e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36364/0 (socket says 172.21.15.98:36364) 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b124e700 1 -- 172.21.15.98:0/479466588 learned_addr learned my addr 172.21.15.98:0/479466588 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b1a4f700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0c1270 0x7fe1ac163300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.615+0000 7fe1b0a4d700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac1507e0 0x7fe1ac162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 -- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac1507e0 msgr2=0x7fe1ac162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac1507e0 0x7fe1ac162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 -- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0c1270 msgr2=0x7fe1ac163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0c1270 0x7fe1ac163300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 -- 172.21.15.98:0/479466588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009ae0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b124e700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fe1a800d890 tx=0x7fe1a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8011590 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a80116f0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0ac7d0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8011a70 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.616+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac0654e0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.617+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac0acab0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.617+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe1a801c460 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.617+0000 7fe1a17fa700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.617+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe1a8079dc0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.617+0000 7fe1b0a4d700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.618+0000 7fe1b0a4d700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 0x7fe1900613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe1ac0acd90 tx=0x7fe19c008040).ready entity=mgr.6255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.622+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1a804aef0 con 0x7fe1ac0c34c0 2023-08-22T00:21:32.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:32.825+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe1ac0c3dd0 con 0x7fe1ac0c34c0 2023-08-22T00:21:33.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.513+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 27) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fe1a80778b0 con 0x7fe1ac0c34c0 2023-08-22T00:21:33.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.514+0000 7fe1a17fa700 1 -- 172.21.15.98:0/479466588 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v27) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe1a80721c0 con 0x7fe1ac0c34c0 2023-08-22T00:21:33.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 msgr2=0x7fe1900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 0x7fe1900613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe1ac0acd90 tx=0x7fe19c008040).stop 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 msgr2=0x7fe1ac144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fe1a800d890 tx=0x7fe1a8008040).stop 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 shutdown_connections 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0c1270 0x7fe1ac163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ac0c34c0 0x7fe1ac144f70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 --2- 172.21.15.98:0/479466588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ac1507e0 0x7fe1ac162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 >> 172.21.15.98:0/479466588 conn(0x7fe1ac0c7800 msgr2=0x7fe1ac0c7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:33.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 shutdown_connections 2023-08-22T00:21:33.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.517+0000 7fe1b34b2700 1 -- 172.21.15.98:0/479466588 wait complete. 2023-08-22T00:21:33.532 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:21:33.656 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:33.654+0000 7fd47e595680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:33.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.656+0000 7fdd5a5a8700 1 Processor -- start 2023-08-22T00:21:33.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.656+0000 7fdd5a5a8700 1 -- start start 2023-08-22T00:21:33.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd5414fd90 0x7fdd540675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdd54153010 0x7fdd540a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 0x7fdd540c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd541525d0 con 0x7fdd54153010 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540c4370 con 0x7fdd540c39d0 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd5a5a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54152b80 con 0x7fdd5414fd90 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdd54153010 0x7fdd540a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdd54153010 0x7fdd540a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36370/0 (socket says 172.21.15.98:36370) 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd537fe700 1 -- 172.21.15.98:0/2369381908 learned_addr learned my addr 172.21.15.98:0/2369381908 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:33.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd58b45700 1 --2- 172.21.15.98:0/2369381908 >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 0x7fdd540c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.657+0000 7fdd53fff700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd5414fd90 0x7fdd540675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 -- 172.21.15.98:0/2369381908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd5414fd90 msgr2=0x7fdd540675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd5414fd90 0x7fdd540675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 -- 172.21.15.98:0/2369381908 >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 msgr2=0x7fdd540c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 --2- 172.21.15.98:0/2369381908 >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 0x7fdd540c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 -- 172.21.15.98:0/2369381908 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54067bd0 con 0x7fdd54153010 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd58b45700 1 --2- 172.21.15.98:0/2369381908 >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 0x7fdd540c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:33.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd537fe700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd540a7c10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fdd540aeb00 tx=0x7fdd480090f0).ready entity=mon.0 client_cookie=2b56cea9f2dbfb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:33.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd52ffd700 1 -- 172.21.15.98:0/2369381908 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800f510 con 0x7fdd54153010 2023-08-22T00:21:33.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd52ffd700 1 -- 172.21.15.98:0/2369381908 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800f670 con 0x7fdd54153010 2023-08-22T00:21:33.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.658+0000 7fdd52ffd700 1 -- 172.21.15.98:0/2369381908 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800fa10 con 0x7fdd54153010 2023-08-22T00:21:33.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/2369381908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 msgr2=0x7fdd540a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd540a7c10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fdd540aeb00 tx=0x7fdd480090f0).stop 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/2369381908 shutdown_connections 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd5414fd90 0x7fdd540675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/2369381908 >> v2:172.21.15.118:3300/0 conn(0x7fdd540c39d0 0x7fdd540c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/2369381908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd540a7c10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/2369381908 >> 172.21.15.98:0/2369381908 conn(0x7fdd540c8950 msgr2=0x7fdd540c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/2369381908 shutdown_connections 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.659+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/2369381908 wait complete. 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.660+0000 7fdd5a5a8700 1 Processor -- start 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.660+0000 7fdd5a5a8700 1 -- start start 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd540c39d0 0x7fdd541677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 0x7fdd54164850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54064770 con 0x7fdd54153010 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54164d40 con 0x7fdd5414fd90 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd5a5a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5414bd00 con 0x7fdd540c39d0 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd58b45700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd58b45700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36382/0 (socket says 172.21.15.98:36382) 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd58b45700 1 -- 172.21.15.98:0/1520816405 learned_addr learned my addr 172.21.15.98:0/1520816405 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 0x7fdd54164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd53fff700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd540c39d0 0x7fdd541677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 -- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd540c39d0 msgr2=0x7fdd541677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd540c39d0 0x7fdd541677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 -- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 msgr2=0x7fdd5414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 -- 172.21.15.98:0/1520816405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009a20 con 0x7fdd5414fd90 2023-08-22T00:21:33.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd58b45700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:33.667 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:33.661+0000 7f3300dba680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd537fe700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 0x7fdd54164850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fdd48014000 tx=0x7fdd48017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48006d90 con 0x7fdd5414fd90 2023-08-22T00:21:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48006950 con 0x7fdd5414fd90 2023-08-22T00:21:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.661+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48000bc0 con 0x7fdd5414fd90 2023-08-22T00:21:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.662+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48009370 con 0x7fdd5414fd90 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.662+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54064120 con 0x7fdd5414fd90 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.662+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540648e0 con 0x7fdd5414fd90 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.663+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 27) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fdd48022020 con 0x7fdd5414fd90 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.663+0000 7fdd3bfff700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 0x7fdd40061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.663+0000 7fdd53fff700 1 -- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 msgr2=0x7fdd40061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.663+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdd4807b860 con 0x7fdd5414fd90 2023-08-22T00:21:33.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.663+0000 7fdd53fff700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 0x7fdd40061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:33.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.667+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd4804c930 con 0x7fdd5414fd90 2023-08-22T00:21:33.719 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:33.718+0000 7fd47e595680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:33.729 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:33.727+0000 7f3300dba680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:33.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.835+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdd54069d50 con 0x7fdd5414fd90 2023-08-22T00:21:33.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.841+0000 7fdd3bfff700 1 -- 172.21.15.98:0/1520816405 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdd4802a020 con 0x7fdd5414fd90 2023-08-22T00:21:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 msgr2=0x7fdd40061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 0x7fdd40061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 msgr2=0x7fdd54164850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 0x7fdd54164850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fdd48014000 tx=0x7fdd48017000).stop 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 shutdown_connections 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdd4005ef80 0x7fdd40061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:33.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd540c39d0 0x7fdd541677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd54153010 0x7fdd5414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 --2- 172.21.15.98:0/1520816405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd5414fd90 0x7fdd54164850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 >> 172.21.15.98:0/1520816405 conn(0x7fdd540c8950 msgr2=0x7fdd540c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 shutdown_connections 2023-08-22T00:21:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:33.843+0000 7fdd5a5a8700 1 -- 172.21.15.98:0/1520816405 wait complete. 2023-08-22T00:21:33.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:33.857 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:21:33.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-22T00:21:33.993 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:33.992+0000 7fd47e595680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:34.016 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:34.015+0000 7f3300dba680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:34.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.045+0000 7f216a595700 1 Processor -- start 2023-08-22T00:21:34.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.045+0000 7f216a595700 1 -- start start 2023-08-22T00:21:34.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f216a595700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f216a595700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f216a595700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2164064f50 con 0x7f2164065530 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f216a595700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21640aa190 con 0x7f2164151100 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f216a595700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640bdfe0 con 0x7f2164151bf0 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2163fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f21637fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2164065530 0x7f21641514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:51878/0 (socket says 172.21.15.98:51878) 2023-08-22T00:21:34.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2163fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38786/0 (socket says 172.21.15.98:38786) 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:44660/0 (socket says 172.21.15.98:44660) 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f21637fe700 1 -- 172.21.15.98:0/1143553842 learned_addr learned my addr 172.21.15.98:0/1143553842 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 -- 172.21.15.98:0/1143553842 >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 msgr2=0x7f2164064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 --2- 172.21.15.98:0/1143553842 >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 -- 172.21.15.98:0/1143553842 >> v1:172.21.15.118:6789/0 conn(0x7f2164065530 legacy=0x7f21641514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 -- 172.21.15.98:0/1143553842 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21640645d0 con 0x7f2164151bf0 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2163fff700 1 --2- 172.21.15.98:0/1143553842 >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:34.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.046+0000 7f2168b32700 1 --2- 172.21.15.98:0/1143553842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f215c009e60 tx=0x7f215c009780).ready entity=mon.2 client_cookie=1ecb9dbc18936f3b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f2162ffd700 1 -- 172.21.15.98:0/1143553842 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00e070 con 0x7f2164151bf0 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f2162ffd700 1 -- 172.21.15.98:0/1143553842 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c00bb60 con 0x7f2164151bf0 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f2162ffd700 1 -- 172.21.15.98:0/1143553842 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c012410 con 0x7f2164151bf0 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 -- 172.21.15.98:0/1143553842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 msgr2=0x7f21640bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 --2- 172.21.15.98:0/1143553842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f215c009e60 tx=0x7f215c009780).stop 2023-08-22T00:21:34.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 -- 172.21.15.98:0/1143553842 shutdown_connections 2023-08-22T00:21:34.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 --2- 172.21.15.98:0/1143553842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bc6f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:34.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 --2- 172.21.15.98:0/1143553842 >> v2:172.21.15.118:3300/0 conn(0x7f2164151100 0x7f2164064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:34.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 -- 172.21.15.98:0/1143553842 >> 172.21.15.98:0/1143553842 conn(0x7f216406a910 msgr2=0x7f2164065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:34.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 -- 172.21.15.98:0/1143553842 shutdown_connections 2023-08-22T00:21:34.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.047+0000 7f216a595700 1 -- 172.21.15.98:0/1143553842 wait complete. 2023-08-22T00:21:34.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.048+0000 7f216a595700 1 Processor -- start 2023-08-22T00:21:34.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.048+0000 7f216a595700 1 -- start start 2023-08-22T00:21:34.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2164065530 0x7f2164147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2164151100 0x7f216414cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164163d10 con 0x7f2164151100 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164164b30 con 0x7f2164065530 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f216a595700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c0260 con 0x7f2164151bf0 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f21637fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2164151100 0x7f216414cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:34.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f21637fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2164151100 0x7f216414cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36384/0 (socket says 172.21.15.98:36384) 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f21637fe700 1 -- 172.21.15.98:0/943834340 learned_addr learned my addr 172.21.15.98:0/943834340 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2164065530 0x7f2164147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.049+0000 7f2168b32700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 msgr2=0x7f21640bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2164151bf0 0x7f21640bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2164065530 msgr2=0x7f2164147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:34.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2164065530 0x7f2164147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540092a0 con 0x7f2164151100 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2164065530 0x7f2164147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f21637fe700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2164151100 0x7f216414cc10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f2158007fd0 tx=0x7f2158007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800ce10 con 0x7f2164151100 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f216a595700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c009a20 con 0x7f2164151100 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580072e0 con 0x7f2164151100 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158007660 con 0x7f2164151100 2023-08-22T00:21:34.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.050+0000 7f216a595700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2164164200 con 0x7f2164151100 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.051+0000 7f216a595700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21641672e0 con 0x7f2164151100 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.052+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 27) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f21580059b0 con 0x7f2164151100 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.052+0000 7f214bfff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.052+0000 7f2163fff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.052+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f21580796e0 con 0x7f2164151100 2023-08-22T00:21:34.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.052+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:34.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.056+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f215804a870 con 0x7f2164151100 2023-08-22T00:21:34.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.250+0000 7f216a595700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2164064f50 con 0x7f215005efb0 2023-08-22T00:21:34.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.253+0000 7f2163fff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:34.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.253+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:34.601 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:34.599+0000 7fd47e595680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:34.651 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:34.638+0000 7f3300dba680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:34.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.654+0000 7f2163fff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:34.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:34.654+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:21:34.673 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:34.671+0000 7fd47e595680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:34.711 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:34.709+0000 7f3300dba680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:34.857 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:34.855+0000 7fd47e595680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:34.896 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:34.895+0000 7f3300dba680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:35.274 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.273+0000 7fd47e595680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:35.317 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.316+0000 7f3300dba680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:35.376 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.375+0000 7fd47e595680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:35.421 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.420+0000 7f3300dba680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:35.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:35.455+0000 7f2163fff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:35.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:35.455+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:21:35.528 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.526+0000 7fd47e595680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:35.574 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.573+0000 7f3300dba680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:35.602 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.600+0000 7fd47e595680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:35.649 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.648+0000 7f3300dba680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:35.669 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.667+0000 7fd47e595680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:35.716 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.715+0000 7f3300dba680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:35.922 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:35.920+0000 7fd47e595680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:35.970 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:35.969+0000 7f3300dba680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:36.108 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:36.107+0000 7fd47e595680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:36.154 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:36.152+0000 7f3300dba680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:36.760 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:36.759+0000 7fd47e595680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:36.812 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:36.810+0000 7f3300dba680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:36.829 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:36.828+0000 7fd47e595680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:36.881 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:36.880+0000 7f3300dba680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:36.904 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:36.902+0000 7fd47e595680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:36.956 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:36.955+0000 7f3300dba680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:37.049 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.047+0000 7fd47e595680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:37.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.056+0000 7f2163fff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:37.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.056+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:21:37.104 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.103+0000 7f3300dba680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:37.118 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.117+0000 7fd47e595680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:37.175 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.174+0000 7f3300dba680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:37.232 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.230+0000 7fd47e595680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:37.290 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.289+0000 7f3300dba680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:37.339 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.337+0000 7fd47e595680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:37.398 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.397+0000 7f3300dba680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:37.626 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.624+0000 7fd47e595680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:37.689 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.688+0000 7f3300dba680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:37.696 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:37.694+0000 7fd47e595680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:37.762 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.761+0000 7f3300dba680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:37.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.763+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 28) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f2158005ce0 con 0x7f2164151100 2023-08-22T00:21:37.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.779+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 29) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f2158046b00 con 0x7f2164151100 2023-08-22T00:21:37.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.780+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 msgr2=0x7f2150061470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:37.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:37.780+0000 7f214bfff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f2150061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:37.843 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327b063700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.843 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327b063700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.844 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327b063700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.844 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327b063700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.844 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327b063700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.845 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327c866700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.845 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327c866700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.845 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327c866700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.846 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327c866700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:37.846 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:37.841+0000 7f327c866700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.783+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 30) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f21580779e0 con 0x7f2164151100 2023-08-22T00:21:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.784+0000 7f214bfff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f21500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:38.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.784+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2164064f50 con 0x7f215005efb0 2023-08-22T00:21:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.786+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f21500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:38.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.796+0000 7f2163fff700 1 --2- 172.21.15.98:0/943834340 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f215005efb0 0x7f21500613f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2154009b00 tx=0x7f2154009060).ready entity=mgr.6672 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:38.799 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:38.798+0000 7f32adb13700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-22T00:21:38.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.799+0000 7f214bfff700 1 -- 172.21.15.98:0/943834340 <== mgr.6672 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f2164064f50 con 0x7f215005efb0 2023-08-22T00:21:38.801 INFO:teuthology.orchestra.run.smithi098.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-22T00:21:38.805 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-22T00:21:38.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:21:38.806 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:21:38.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:21:38.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.990+0000 7f85ba993700 1 Processor -- start 2023-08-22T00:21:38.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.990+0000 7f85ba993700 1 -- start start 2023-08-22T00:21:38.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.990+0000 7f85ba993700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f85b4062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:38.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85ba993700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b4063f90 con 0x7f85b40c2620 2023-08-22T00:21:38.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85ba993700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40656f0 con 0x7f85b4063380 2023-08-22T00:21:38.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85ba993700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40637e0 con 0x7f85b41505e0 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b8f30700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f85b40c2620 0x7f85b4065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49206/0 (socket says 172.21.15.98:49206) 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b8f30700 1 -- 172.21.15.98:0/3914457384 learned_addr learned my addr 172.21.15.98:0/3914457384 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b3fff700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f85b4062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061674233 0 0) 0x7f85b4063f90 con 0x7f85b40c2620 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859c004500 con 0x7f85b40c2620 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861495821 0 0) 0x7f859c004500 con 0x7f85b40c2620 2023-08-22T00:21:38.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 msgr2=0x7f85b4062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f85b4062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 >> v1:172.21.15.118:6789/0 conn(0x7f85b4063380 legacy=0x7f85b40c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b41509c0 con 0x7f85b40c2620 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f85ac0017f0 con 0x7f85b40c2620 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 >> v1:172.21.15.98:6789/0 conn(0x7f85b40c2620 legacy=0x7f85b4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f859c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:38.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c004f50 0x7f859c0057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:38.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c005c90 0x7f859c006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:38.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40637e0 con 0x7f859c004f50 2023-08-22T00:21:38.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c00caa0 con 0x7f859c005c90 2023-08-22T00:21:38.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c00cc60 con 0x7f85b41505e0 2023-08-22T00:21:38.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b37fe700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c004f50 0x7f859c0057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:38.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b3fff700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f859c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:38.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.991+0000 7f85b8f30700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c005c90 0x7f859c006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:38.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 -- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 msgr2=0x7f859c004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:38.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b41505e0 0x7f859c004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 -- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c005c90 msgr2=0x7f859c006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:39.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c005c90 0x7f859c006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 -- 172.21.15.98:0/3914457384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c004500 con 0x7f859c004f50 2023-08-22T00:21:39.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b37fe700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c004f50 0x7f859c0057a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f85a8001700 tx=0x7f85a8007bb0).ready entity=mon.0 client_cookie=1eaa3a4b7909dd6e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:39.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007020 con 0x7f859c004f50 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8007180 con 0x7f859c004f50 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b2ffd700 1 -- 172.21.15.98:0/3914457384 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007500 con 0x7f859c004f50 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 -- 172.21.15.98:0/3914457384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c004f50 msgr2=0x7f859c0057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 --2- 172.21.15.98:0/3914457384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c004f50 0x7f859c0057a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f85a8001700 tx=0x7f85a8007bb0).stop 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85b8f30700 1 -- 172.21.15.98:0/3914457384 reap_dead start 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 -- 172.21.15.98:0/3914457384 shutdown_connections 2023-08-22T00:21:39.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 -- 172.21.15.98:0/3914457384 >> 172.21.15.98:0/3914457384 conn(0x7f85b40c31d0 msgr2=0x7f85b40c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:39.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 -- 172.21.15.98:0/3914457384 shutdown_connections 2023-08-22T00:21:39.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.992+0000 7f85ba993700 1 -- 172.21.15.98:0/3914457384 wait complete. 2023-08-22T00:21:39.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 Processor -- start 2023-08-22T00:21:39.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 -- start start 2023-08-22T00:21:39.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 0x7f85b40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 0x7f85b4066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40ab820 con 0x7f85b40aaeb0 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40aa310 con 0x7f859c004f50 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.994+0000 7f85ba993700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4066970 con 0x7f85b40ab330 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:39.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36500/0 (socket says 172.21.15.98:36500) 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 -- 172.21.15.98:0/384848312 learned_addr learned my addr 172.21.15.98:0/384848312 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b3fff700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 0x7f85b40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b8f30700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 0x7f85b4066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 -- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 msgr2=0x7f85b4066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 0x7f85b4066480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 -- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 msgr2=0x7f85b40aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:39.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 0x7f85b40aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 -- 172.21.15.98:0/384848312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40a9970 con 0x7f85b40aaeb0 2023-08-22T00:21:39.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b8f30700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 0x7f85b4066480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:39.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b3fff700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 0x7f85b40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:39.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85b37fe700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f859c006760 tx=0x7f85a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:39.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a801d440 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a801d5a0 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b40a9c50 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a801d960 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.995+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b4164670 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.996+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b40aa450 con 0x7f85b40aaeb0 2023-08-22T00:21:39.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.996+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 30) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f85a801dd10 con 0x7f85b40aaeb0 2023-08-22T00:21:39.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.997+0000 7f859bfff700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 0x7f85a00611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:39.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.997+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f85a807a950 con 0x7f85b40aaeb0 2023-08-22T00:21:39.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.997+0000 7f85b3fff700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 0x7f85a00611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:39.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:38.997+0000 7f85b3fff700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 0x7f85a00611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f85b40a8bf0 tx=0x7f85a4008040).ready entity=mgr.6672 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:39.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.001+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85b40aa450 con 0x7f85b40aaeb0 2023-08-22T00:21:39.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.204+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f85b40aa450 con 0x7f85b40aaeb0 2023-08-22T00:21:39.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.788+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 31) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f85a8078690 con 0x7f85b40aaeb0 2023-08-22T00:21:39.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.789+0000 7f859bfff700 1 -- 172.21.15.98:0/384848312 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v31) v1 ==== 93+0+0 (secure 0 0 0) 0x7f85a8041ce0 con 0x7f85b40aaeb0 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 msgr2=0x7f85a00611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 0x7f85a00611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f85b40a8bf0 tx=0x7f85a4008040).stop 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 msgr2=0x7f85b4065f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f859c006760 tx=0x7f85a8016000).stop 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 shutdown_connections 2023-08-22T00:21:39.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f85a005ed10 0x7f85a00611d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40ab330 0x7f85b4066480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f859c004f50 0x7f85b40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.791+0000 7f85ba993700 1 --2- 172.21.15.98:0/384848312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85b40aaeb0 0x7f85b4065f90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.792+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 >> 172.21.15.98:0/384848312 conn(0x7f85b40c31d0 msgr2=0x7f85b414e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.792+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 shutdown_connections 2023-08-22T00:21:39.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:39.792+0000 7f85ba993700 1 -- 172.21.15.98:0/384848312 wait complete. 2023-08-22T00:21:39.806 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:21:39.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:39.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:39.896 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:21:39.897 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:21:39.897 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:21:39.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:21:39.934 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:39.933+0000 7f3305d14680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:39.935 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:39.933+0000 7f5f25501680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:21:39.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[148776]: fuse finished with error 0 and tester_r 0 2023-08-22T00:21:39.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:21:39.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:39.937 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:21:39.997 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:39.996+0000 7f3305d14680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:40.000 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:39.999+0000 7f5f25501680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:21:40.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:21:40.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:40.095 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:21:40.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:40.113 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:21:40.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:21:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:40.114 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:21:40.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:40.152 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:21:40.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:21:40.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:21:40.153 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:21:40.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:21:40.172 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:21:40.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:40.276 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:40.275+0000 7f3305d14680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:40.282 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:40.281+0000 7f5f25501680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:21:40.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.310+0000 7fec7ac0b700 1 Processor -- start 2023-08-22T00:21:40.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.311+0000 7fec7ac0b700 1 -- start start 2023-08-22T00:21:40.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec7ac0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec74152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec7ac0b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec74153080 con 0x7fec740c3e50 2023-08-22T00:21:40.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec7ac0b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740667b0 con 0x7fec7414c350 2023-08-22T00:21:40.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec7ac0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec74066510 con 0x7fec7414bf70 2023-08-22T00:21:40.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec791a8700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fec740c3e50 0x7fec740aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48774/0 (socket says 172.21.15.98:48774) 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec791a8700 1 -- 172.21.15.98:0/3573490743 learned_addr learned my addr 172.21.15.98:0/3573490743 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec789a7700 1 --2- 172.21.15.98:0/3573490743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec74152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977245512 0 0) 0x7fec74153080 con 0x7fec740c3e50 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec640033f0 con 0x7fec740c3e50 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139492640 0 0) 0x7fec740667b0 con 0x7fec7414c350 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec74153080 con 0x7fec7414c350 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec789a7700 1 -- 172.21.15.98:0/3573490743 >> v1:172.21.15.118:6789/0 conn(0x7fec7414c350 legacy=0x7fec740c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec789a7700 1 -- 172.21.15.98:0/3573490743 >> v1:172.21.15.98:6789/0 conn(0x7fec740c3e50 legacy=0x7fec740aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec789a7700 1 -- 172.21.15.98:0/3573490743 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74155e00 con 0x7fec7414bf70 2023-08-22T00:21:40.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.312+0000 7fec789a7700 1 --2- 172.21.15.98:0/3573490743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec74152b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fec68009790 tx=0x7fec68009060).ready entity=mon.2 client_cookie=cac8afc5cff84015 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:40.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800f510 con 0x7fec7414bf70 2023-08-22T00:21:40.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800f670 con 0x7fec7414bf70 2023-08-22T00:21:40.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec737fe700 1 -- 172.21.15.98:0/3573490743 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800f9f0 con 0x7fec7414bf70 2023-08-22T00:21:40.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 -- 172.21.15.98:0/3573490743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 msgr2=0x7fec74152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/3573490743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec74152b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fec68009790 tx=0x7fec68009060).stop 2023-08-22T00:21:40.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 -- 172.21.15.98:0/3573490743 shutdown_connections 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/3573490743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec74152b90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 -- 172.21.15.98:0/3573490743 >> 172.21.15.98:0/3573490743 conn(0x7fec740c5dc0 msgr2=0x7fec74068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 -- 172.21.15.98:0/3573490743 shutdown_connections 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.313+0000 7fec7ac0b700 1 -- 172.21.15.98:0/3573490743 wait complete. 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.314+0000 7fec7ac0b700 1 Processor -- start 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 -- start start 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec740657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec7414c350 0x7fec740c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74168520 con 0x7fec740c3e50 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74167910 con 0x7fec7414c350 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec7ac0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec74167bf0 con 0x7fec7414bf70 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec789a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec789a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41666/0 (socket says 172.21.15.98:41666) 2023-08-22T00:21:40.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec73fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec740657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec791a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec7414c350 0x7fec740c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.315+0000 7fec789a7700 1 -- 172.21.15.98:0/4206206895 learned_addr learned my addr 172.21.15.98:0/4206206895 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 msgr2=0x7fec740657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec740657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec7414c350 msgr2=0x7fec740c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec7414c350 0x7fec740c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 -- 172.21.15.98:0/4206206895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680092a0 con 0x7fec740c3e50 2023-08-22T00:21:40.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec789a7700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fec7406a490 tx=0x7fec68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800fe80 con 0x7fec740c3e50 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800f7e0 con 0x7fec740c3e50 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74167ed0 con 0x7fec740c3e50 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6801b640 con 0x7fec740c3e50 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.316+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740a7630 con 0x7fec740c3e50 2023-08-22T00:21:40.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.317+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec74047480 con 0x7fec740c3e50 2023-08-22T00:21:40.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.318+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fec6801b9b0 con 0x7fec740c3e50 2023-08-22T00:21:40.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.318+0000 7fec70ff9700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 0x7fec58061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.318+0000 7fec73fff700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 msgr2=0x7fec58061180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:40.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.318+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fec6807b520 con 0x7fec740c3e50 2023-08-22T00:21:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.318+0000 7fec73fff700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 0x7fec58061180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.322+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec6804c900 con 0x7fec740c3e50 2023-08-22T00:21:40.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.519+0000 7fec73fff700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 msgr2=0x7fec58061180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:40.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.519+0000 7fec73fff700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 0x7fec58061180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.534+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec741560e0 con 0x7fec740c3e50 2023-08-22T00:21:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.535+0000 7fec70ff9700 1 -- 172.21.15.98:0/4206206895 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fec68029090 con 0x7fec740c3e50 2023-08-22T00:21:40.536 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:40.536 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 msgr2=0x7fec58061180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 0x7fec58061180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 msgr2=0x7fec740a7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fec7406a490 tx=0x7fec68017000).stop 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 shutdown_connections 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec7414c350 0x7fec740c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec740c3e50 0x7fec740a7140 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec5805ecc0 0x7fec58061180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 --2- 172.21.15.98:0/4206206895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec7414bf70 0x7fec740657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 >> 172.21.15.98:0/4206206895 conn(0x7fec740c5dc0 msgr2=0x7fec74067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 shutdown_connections 2023-08-22T00:21:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.537+0000 7fec7ac0b700 1 -- 172.21.15.98:0/4206206895 wait complete. 2023-08-22T00:21:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:40.551 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.668+0000 7fa7b2752700 1 Processor -- start 2023-08-22T00:21:40.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.668+0000 7fa7b2752700 1 -- start start 2023-08-22T00:21:40.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7b2752700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7b2752700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac158bf0 con 0x7fa7ac151d60 2023-08-22T00:21:40.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7b2752700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac157d90 con 0x7fa7ac066400 2023-08-22T00:21:40.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7b2752700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac066890 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7abfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa7ac151d60 0x7fa7ac155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48780/0 (socket says 172.21.15.98:48780) 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7abfff700 1 -- 172.21.15.98:0/258991754 learned_addr learned my addr 172.21.15.98:0/258991754 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7ab7fe700 1 --2- 172.21.15.98:0/258991754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523192544 0 0) 0x7fa7ac158bf0 con 0x7fa7ac151d60 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.669+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7980033f0 con 0x7fa7ac151d60 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350311773 0 0) 0x7fa7ac157d90 con 0x7fa7ac066400 2023-08-22T00:21:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ac158bf0 con 0x7fa7ac066400 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7ab7fe700 1 -- 172.21.15.98:0/258991754 >> v1:172.21.15.118:6789/0 conn(0x7fa7ac066400 legacy=0x7fa7ac0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7ab7fe700 1 -- 172.21.15.98:0/258991754 >> v1:172.21.15.98:6789/0 conn(0x7fa7ac151d60 legacy=0x7fa7ac155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7ab7fe700 1 -- 172.21.15.98:0/258991754 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac157fe0 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7ab7fe700 1 --2- 172.21.15.98:0/258991754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac065f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa794009790 tx=0x7fa794009060).ready entity=mon.2 client_cookie=96d5d459057b52fd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400f510 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79400f670 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7aaffd700 1 -- 172.21.15.98:0/258991754 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400f9f0 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7b2752700 1 -- 172.21.15.98:0/258991754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 msgr2=0x7fa7ac065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7b2752700 1 --2- 172.21.15.98:0/258991754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac065f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa794009790 tx=0x7fa794009060).stop 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7b2752700 1 -- 172.21.15.98:0/258991754 shutdown_connections 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7b2752700 1 --2- 172.21.15.98:0/258991754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac065f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.670+0000 7fa7b2752700 1 -- 172.21.15.98:0/258991754 >> 172.21.15.98:0/258991754 conn(0x7fa7ac06a980 msgr2=0x7fa7ac0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.671+0000 7fa7b2752700 1 -- 172.21.15.98:0/258991754 shutdown_connections 2023-08-22T00:21:40.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.671+0000 7fa7b2752700 1 -- 172.21.15.98:0/258991754 wait complete. 2023-08-22T00:21:40.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.672+0000 7fa7b2752700 1 Processor -- start 2023-08-22T00:21:40.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.672+0000 7fa7b2752700 1 -- start start 2023-08-22T00:21:40.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac0a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ac151d60 0x7fa7ac167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac14c000 con 0x7fa7ac066400 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0a66e0 con 0x7fa7ac151d60 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0aa150 con 0x7fa7ac0a6e50 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41680/0 (socket says 172.21.15.98:41680) 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 -- 172.21.15.98:0/1347064830 learned_addr learned my addr 172.21.15.98:0/1347064830 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7ab7fe700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac0a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b0cef700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ac151d60 0x7fa7ac167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 -- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 msgr2=0x7fa7ac0a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac0a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 -- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ac151d60 msgr2=0x7fa7ac167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ac151d60 0x7fa7ac167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 -- 172.21.15.98:0/1347064830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940092a0 con 0x7fa7ac066400 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7abfff700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fa79c00c560 tx=0x7fa79c007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00ce70 con 0x7fa7ac066400 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0072e0 con 0x7fa7ac066400 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac0a4530 con 0x7fa7ac066400 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c007660 con 0x7fa7ac066400 2023-08-22T00:21:40.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.673+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac0a4af0 con 0x7fa7ac066400 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.674+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac047480 con 0x7fa7ac066400 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.676+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fa79c0059b0 con 0x7fa7ac066400 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.676+0000 7fa7a3fff700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 0x7fa78c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.676+0000 7fa7ab7fe700 1 -- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 msgr2=0x7fa78c0611b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.676+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fa79c079900 con 0x7fa7ac066400 2023-08-22T00:21:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.676+0000 7fa7ab7fe700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 0x7fa78c0611b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:40.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.679+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa79c04e790 con 0x7fa7ac066400 2023-08-22T00:21:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.794+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fa79c0776c0 con 0x7fa7ac066400 2023-08-22T00:21:40.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.852+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7ac1582c0 con 0x7fa7ac066400 2023-08-22T00:21:40.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.853+0000 7fa7a3fff700 1 -- 172.21.15.98:0/1347064830 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17630 (secure 0 0 0) 0x7fa79c007e60 con 0x7fa7ac066400 2023-08-22T00:21:40.854 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:40.855 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":91,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:37.775003+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3987238629":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/2943466958":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6833/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6832/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/381978763":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/390340889":"2023-08-23T00:21:37.774961+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:40.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 msgr2=0x7fa78c0611b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:40.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 0x7fa78c0611b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:40.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 msgr2=0x7fa7ac0a61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fa79c00c560 tx=0x7fa79c007d20).stop 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 shutdown_connections 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ac151d60 0x7fa7ac167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7ac066400 0x7fa7ac0a61f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa78c05ecf0 0x7fa78c0611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 --2- 172.21.15.98:0/1347064830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7ac0a6e50 0x7fa7ac0a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:40.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 >> 172.21.15.98:0/1347064830 conn(0x7fa7ac06a980 msgr2=0x7fa7ac156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:40.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 shutdown_connections 2023-08-22T00:21:40.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:40.855+0000 7fa7b2752700 1 -- 172.21.15.98:0/1347064830 wait complete. 2023-08-22T00:21:40.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:21:19.254016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:21:19.662112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:21:40.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:21:40.889 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:40.888+0000 7f3305d14680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:40.928 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:40.927+0000 7f5f25501680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:21:40.961 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:40.960+0000 7f3305d14680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:41.002 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.001+0000 7f5f25501680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:21:41.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.025+0000 7f5b3df51700 1 Processor -- start 2023-08-22T00:21:41.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.025+0000 7f5b3df51700 1 -- start start 2023-08-22T00:21:41.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b3df51700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b38157ab0 0x7f5b38157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b3df51700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b38063b10 0x7f5b380acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b3df51700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b381541c0 con 0x7f5b38062600 2023-08-22T00:21:41.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b3df51700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380ca860 con 0x7f5b38063b10 2023-08-22T00:21:41.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b3df51700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38063fc0 con 0x7f5b38157ab0 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b37fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b38063b10 0x7f5b380acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b37fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b38063b10 0x7f5b380acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41694/0 (socket says 172.21.15.98:41694) 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b37fff700 1 -- 172.21.15.98:0/1016176962 learned_addr learned my addr 172.21.15.98:0/1016176962 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.026+0000 7f5b377fe700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b38157ab0 0x7f5b38157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b37fff700 1 -- 172.21.15.98:0/1016176962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b38157ab0 msgr2=0x7f5b38157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b37fff700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b38157ab0 0x7f5b38157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b37fff700 1 -- 172.21.15.98:0/1016176962 >> v1:172.21.15.118:6789/0 conn(0x7f5b38062600 legacy=0x7f5b380ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b37fff700 1 -- 172.21.15.98:0/1016176962 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38062a90 con 0x7f5b38063b10 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b37fff700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38063b10 0x7f5b380acbf0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f5b28009f20 tx=0x7f5b28009840).ready entity=mon.0 client_cookie=10487be0cc584465 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b367fc700 1 -- 172.21.15.98:0/1016176962 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800e070 con 0x7f5b38063b10 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b367fc700 1 -- 172.21.15.98:0/1016176962 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2800b9d0 con 0x7f5b38063b10 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.027+0000 7f5b367fc700 1 -- 172.21.15.98:0/1016176962 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800bd50 con 0x7f5b38063b10 2023-08-22T00:21:41.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 -- 172.21.15.98:0/1016176962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38063b10 msgr2=0x7f5b380acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38063b10 0x7f5b380acbf0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f5b28009f20 tx=0x7f5b28009840).stop 2023-08-22T00:21:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 -- 172.21.15.98:0/1016176962 shutdown_connections 2023-08-22T00:21:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38063b10 0x7f5b380acbf0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 --2- 172.21.15.98:0/1016176962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b38157ab0 0x7f5b38157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 -- 172.21.15.98:0/1016176962 >> 172.21.15.98:0/1016176962 conn(0x7f5b380cb600 msgr2=0x7f5b380c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 -- 172.21.15.98:0/1016176962 shutdown_connections 2023-08-22T00:21:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.028+0000 7f5b3df51700 1 -- 172.21.15.98:0/1016176962 wait complete. 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.029+0000 7f5b3df51700 1 Processor -- start 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.029+0000 7f5b3df51700 1 -- start start 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b38063b10 0x7f5b380b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b380af250 0x7f5b38154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380ade70 con 0x7f5b38157ab0 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380b02e0 con 0x7f5b38063b10 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380af6d0 con 0x7f5b380af250 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41698/0 (socket says 172.21.15.98:41698) 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 -- 172.21.15.98:0/2101811260 learned_addr learned my addr 172.21.15.98:0/2101811260 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b37fff700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b380af250 0x7f5b38154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b377fe700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b38063b10 0x7f5b380b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 -- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b380af250 msgr2=0x7f5b38154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b380af250 0x7f5b38154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 -- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b38063b10 msgr2=0x7f5b380b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b38063b10 0x7f5b380b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 -- 172.21.15.98:0/2101811260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009ae0 con 0x7f5b38157ab0 2023-08-22T00:21:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b36ffd700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f5b2c00c4f0 tx=0x7f5b2c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00ce00 con 0x7f5b38157ab0 2023-08-22T00:21:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c007020 con 0x7f5b38157ab0 2023-08-22T00:21:41.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b380af9b0 con 0x7f5b38157ab0 2023-08-22T00:21:41.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0073c0 con 0x7f5b38157ab0 2023-08-22T00:21:41.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.030+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b380aff70 con 0x7f5b38157ab0 2023-08-22T00:21:41.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.031+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b380b0470 con 0x7f5b38157ab0 2023-08-22T00:21:41.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.032+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5b2c0068b0 con 0x7f5b38157ab0 2023-08-22T00:21:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.032+0000 7f5b1f7fe700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 0x7f5b24061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.032+0000 7f5b377fe700 1 -- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 msgr2=0x7f5b24061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.032+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f5b2c0795e0 con 0x7f5b38157ab0 2023-08-22T00:21:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.032+0000 7f5b377fe700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 0x7f5b24061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.036+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b2c0478f0 con 0x7f5b38157ab0 2023-08-22T00:21:41.148 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.146+0000 7f3305d14680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:41.195 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.194+0000 7f5f25501680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:21:41.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.205+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5b38155190 con 0x7f5b38157ab0 2023-08-22T00:21:41.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.205+0000 7f5b1f7fe700 1 -- 172.21.15.98:0/2101811260 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5b2c04a5f0 con 0x7f5b38157ab0 2023-08-22T00:21:41.207 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:21:41.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 msgr2=0x7f5b24061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:41.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 0x7f5b24061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 msgr2=0x7f5b38154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f5b2c00c4f0 tx=0x7f5b2c007dd0).stop 2023-08-22T00:21:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 shutdown_connections 2023-08-22T00:21:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b2405efc0 0x7f5b24061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b380af250 0x7f5b38154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b38063b10 0x7f5b380b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 --2- 172.21.15.98:0/2101811260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b38157ab0 0x7f5b38154390 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 >> 172.21.15.98:0/2101811260 conn(0x7f5b380cb600 msgr2=0x7f5b380acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 shutdown_connections 2023-08-22T00:21:41.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.207+0000 7f5b3df51700 1 -- 172.21.15.98:0/2101811260 wait complete. 2023-08-22T00:21:41.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:21:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.341+0000 7f4021be4700 1 Processor -- start 2023-08-22T00:21:41.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.341+0000 7f4021be4700 1 -- start start 2023-08-22T00:21:41.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f4021be4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f4021be4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f4021be4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c1525d0 con 0x7f401c0c39d0 2023-08-22T00:21:41.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f4021be4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c152b80 con 0x7f401c153010 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f4021be4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c067bd0 con 0x7f401c14fd90 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:37356/0 (socket says 172.21.15.98:37356) 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:35702/0 (socket says 172.21.15.98:35702) 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401b7fe700 1 -- 172.21.15.98:0/1772961038 learned_addr learned my addr 172.21.15.98:0/1772961038 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.342+0000 7f401bfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f401c0c39d0 0x7f401c0bd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:35816/0 (socket says 172.21.15.98:35816) 2023-08-22T00:21:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401b7fe700 1 -- 172.21.15.98:0/1772961038 >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 msgr2=0x7f401c0a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401b7fe700 1 --2- 172.21.15.98:0/1772961038 >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401b7fe700 1 -- 172.21.15.98:0/1772961038 >> v1:172.21.15.118:6789/0 conn(0x7f401c0c39d0 legacy=0x7f401c0bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401a7fc700 1 -- 172.21.15.98:0/1772961038 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671290595 0 0) 0x7f4014001490 con 0x7f401c0c39d0 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401b7fe700 1 -- 172.21.15.98:0/1772961038 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c067eb0 con 0x7f401c14fd90 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401affd700 1 --2- 172.21.15.98:0/1772961038 >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401b7fe700 1 --2- 172.21.15.98:0/1772961038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f400c006fd0 tx=0x7f400c0090f0).ready entity=mon.2 client_cookie=a6f192dadffcfb17 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401a7fc700 1 -- 172.21.15.98:0/1772961038 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00b580 con 0x7f401c14fd90 2023-08-22T00:21:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401a7fc700 1 -- 172.21.15.98:0/1772961038 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c00b6e0 con 0x7f401c14fd90 2023-08-22T00:21:41.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f401a7fc700 1 -- 172.21.15.98:0/1772961038 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00ba60 con 0x7f401c14fd90 2023-08-22T00:21:41.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f4021be4700 1 -- 172.21.15.98:0/1772961038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 msgr2=0x7f401c0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.343+0000 7f4021be4700 1 --2- 172.21.15.98:0/1772961038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f400c006fd0 tx=0x7f400c0090f0).stop 2023-08-22T00:21:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 -- 172.21.15.98:0/1772961038 shutdown_connections 2023-08-22T00:21:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 --2- 172.21.15.98:0/1772961038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c14fd90 0x7f401c0675f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 --2- 172.21.15.98:0/1772961038 >> v2:172.21.15.118:3300/0 conn(0x7f401c153010 0x7f401c0a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 -- 172.21.15.98:0/1772961038 >> 172.21.15.98:0/1772961038 conn(0x7f401c0c8950 msgr2=0x7f401c0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 -- 172.21.15.98:0/1772961038 shutdown_connections 2023-08-22T00:21:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.344+0000 7f4021be4700 1 -- 172.21.15.98:0/1772961038 wait complete. 2023-08-22T00:21:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.345+0000 7f4021be4700 1 Processor -- start 2023-08-22T00:21:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.345+0000 7f4021be4700 1 -- start start 2023-08-22T00:21:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401c14fd90 0x7f401c14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c153010 0x7f401c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0659a0 con 0x7f401c0c39d0 2023-08-22T00:21:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1681a0 con 0x7f401c14fd90 2023-08-22T00:21:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c168480 con 0x7f401c153010 2023-08-22T00:21:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41714/0 (socket says 172.21.15.98:41714) 2023-08-22T00:21:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 -- 172.21.15.98:0/3439463998 learned_addr learned my addr 172.21.15.98:0/3439463998 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401bfff700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c153010 0x7f401c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401affd700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401c14fd90 0x7f401c14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 -- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c153010 msgr2=0x7f401c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c153010 0x7f401c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 -- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401c14fd90 msgr2=0x7f401c14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401c14fd90 0x7f401c14e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 -- 172.21.15.98:0/3439463998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100092a0 con 0x7f401c0c39d0 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f401b7fe700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f400c009fd0 tx=0x7f400c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c006a40 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c000bc0 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c01c420 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.346+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c009370 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.347+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c168a40 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.347+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c069d50 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.348+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f400c01ca20 con 0x7f401c0c39d0 2023-08-22T00:21:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.348+0000 7f40037fe700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 0x7f4008061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.349+0000 7f401affd700 1 -- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 msgr2=0x7f4008061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.349+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f400c07c190 con 0x7f401c0c39d0 2023-08-22T00:21:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.349+0000 7f401affd700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 0x7f4008061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.353+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f400c04d1a0 con 0x7f401c0c39d0 2023-08-22T00:21:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.517+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f401c152810 con 0x7f401c0c39d0 2023-08-22T00:21:41.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.518+0000 7f40037fe700 1 -- 172.21.15.98:0/3439463998 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f400c02a020 con 0x7f401c0c39d0 2023-08-22T00:21:41.520 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:21:41.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 msgr2=0x7f4008061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:41.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 0x7f4008061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 msgr2=0x7f401c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f400c009fd0 tx=0x7f400c017000).stop 2023-08-22T00:21:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 shutdown_connections 2023-08-22T00:21:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f400805efc0 0x7f4008061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f401c153010 0x7f401c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f401c0c39d0 0x7f401c165190 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 --2- 172.21.15.98:0/3439463998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401c14fd90 0x7f401c14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 >> 172.21.15.98:0/3439463998 conn(0x7f401c0c8950 msgr2=0x7f401c068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 shutdown_connections 2023-08-22T00:21:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.520+0000 7f4021be4700 1 -- 172.21.15.98:0/3439463998 wait complete. 2023-08-22T00:21:41.533 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:21:41.567 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.566+0000 7f3305d14680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:41.639 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.638+0000 7f5f25501680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:21:41.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.654+0000 7fb24fad7700 1 Processor -- start 2023-08-22T00:21:41.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.654+0000 7fb24fad7700 1 -- start start 2023-08-22T00:21:41.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24fad7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb248150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24fad7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2480a6740 0x7fb2480a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24fad7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2480654c0 con 0x7fb2481550a0 2023-08-22T00:21:41.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24fad7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2480be6e0 con 0x7fb2480a6740 2023-08-22T00:21:41.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24fad7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480a70e0 con 0x7fb2481508b0 2023-08-22T00:21:41.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24d873700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb248150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24e074700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2480a6740 0x7fb2480a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24d072700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb2481550a0 0x7fb2480c38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:35828/0 (socket says 172.21.15.98:35828) 2023-08-22T00:21:41.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24d072700 1 -- 172.21.15.98:0/2413015086 learned_addr learned my addr 172.21.15.98:0/2413015086 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:41.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24e074700 1 -- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 msgr2=0x7fb248150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:41.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.655+0000 7fb24e074700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb248150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24e074700 1 -- 172.21.15.98:0/2413015086 >> v1:172.21.15.118:6789/0 conn(0x7fb2481550a0 legacy=0x7fb2480c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24c871700 1 -- 172.21.15.98:0/2413015086 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667918503 0 0) 0x7fb2480654c0 con 0x7fb2481550a0 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24e074700 1 -- 172.21.15.98:0/2413015086 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480c3fb0 con 0x7fb2480a6740 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24d873700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb248150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24e074700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a6bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb240009e60 tx=0x7fb240009780).ready entity=mon.1 client_cookie=a661f719b9c631ba server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24c871700 1 -- 172.21.15.98:0/2413015086 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000e070 con 0x7fb2480a6740 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24c871700 1 -- 172.21.15.98:0/2413015086 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24000bb60 con 0x7fb2480a6740 2023-08-22T00:21:41.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24c871700 1 -- 172.21.15.98:0/2413015086 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240012410 con 0x7fb2480a6740 2023-08-22T00:21:41.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 -- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 msgr2=0x7fb2480a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a6bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb240009e60 tx=0x7fb240009780).stop 2023-08-22T00:21:41.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 -- 172.21.15.98:0/2413015086 shutdown_connections 2023-08-22T00:21:41.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a6bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2413015086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb248150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.656+0000 7fb24fad7700 1 -- 172.21.15.98:0/2413015086 >> 172.21.15.98:0/2413015086 conn(0x7fb2480c7820 msgr2=0x7fb2480c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.657+0000 7fb24fad7700 1 -- 172.21.15.98:0/2413015086 shutdown_connections 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.657+0000 7fb24fad7700 1 -- 172.21.15.98:0/2413015086 wait complete. 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 Processor -- start 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 -- start start 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb2480acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480ad220 con 0x7fb2481550a0 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480ac2e0 con 0x7fb2480a6740 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.658+0000 7fb24fad7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480ac8a0 con 0x7fb2481508b0 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41718/0 (socket says 172.21.15.98:41718) 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24d072700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb2480acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 -- 172.21.15.98:0/2066851203 learned_addr learned my addr 172.21.15.98:0/2066851203 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24d873700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 -- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 msgr2=0x7fb2480acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb2480acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 -- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 msgr2=0x7fb2480a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 -- 172.21.15.98:0/2066851203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440092a0 con 0x7fb2481550a0 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24d873700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24e074700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fb24000c000 tx=0x7fb240009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240012410 con 0x7fb2481550a0 2023-08-22T00:21:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24001d630 con 0x7fb2481550a0 2023-08-22T00:21:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb240009a20 con 0x7fb2481550a0 2023-08-22T00:21:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400070e0 con 0x7fb2481550a0 2023-08-22T00:21:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.659+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb248164840 con 0x7fb2481550a0 2023-08-22T00:21:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.660+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2480aca30 con 0x7fb2481550a0 2023-08-22T00:21:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.661+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fb240003040 con 0x7fb2481550a0 2023-08-22T00:21:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.661+0000 7fb23dffb700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 0x7fb22c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.661+0000 7fb24d873700 1 -- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 msgr2=0x7fb22c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.661+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fb24007c080 con 0x7fb2481550a0 2023-08-22T00:21:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.661+0000 7fb24d873700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 0x7fb22c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.665+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb24004d0b0 con 0x7fb2481550a0 2023-08-22T00:21:41.671 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.670+0000 7f3305d14680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:41.749 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.747+0000 7f5f25501680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:41.824 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.823+0000 7f3305d14680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:41.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.833+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2480be120 con 0x7fb2481550a0 2023-08-22T00:21:41.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.834+0000 7fb23dffb700 1 -- 172.21.15.98:0/2066851203 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2400506d0 con 0x7fb2481550a0 2023-08-22T00:21:41.835 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:21:41.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 msgr2=0x7fb22c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:41.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 0x7fb22c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 msgr2=0x7fb248163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fb24000c000 tx=0x7fb240009780).stop 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 shutdown_connections 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481550a0 0x7fb248163a40 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2480a6740 0x7fb2480a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb22c05efc0 0x7fb22c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 --2- 172.21.15.98:0/2066851203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2481508b0 0x7fb2480acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 >> 172.21.15.98:0/2066851203 conn(0x7fb2480c7820 msgr2=0x7fb2480c2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 shutdown_connections 2023-08-22T00:21:41.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.836+0000 7fb24fad7700 1 -- 172.21.15.98:0/2066851203 wait complete. 2023-08-22T00:21:41.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:21:41.898 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.897+0000 7f3305d14680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:41.908 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.907+0000 7f5f25501680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:41.965 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:41.964+0000 7f3305d14680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.971+0000 7f5fe8119700 1 Processor -- start 2023-08-22T00:21:41.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.971+0000 7f5fe8119700 1 -- start start 2023-08-22T00:21:41.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.972+0000 7f5fe8119700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 0x7f5fe00c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.972+0000 7f5fe8119700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe01525d0 con 0x7f5fe014fd90 2023-08-22T00:21:41.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.972+0000 7f5fe8119700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe0152b80 con 0x7f5fe00675f0 2023-08-22T00:21:41.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.972+0000 7f5fe8119700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c4330 con 0x7f5fe00c39d0 2023-08-22T00:21:41.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe5eb5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5fe014fd90 0x7f5fe0153010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48786/0 (socket says 172.21.15.98:48786) 2023-08-22T00:21:41.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe5eb5700 1 -- 172.21.15.98:0/1607861489 learned_addr learned my addr 172.21.15.98:0/1607861489 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:41.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe66b6700 1 --2- 172.21.15.98:0/1607861489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 0x7f5fe00c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572944201 0 0) 0x7f5fdc001110 con 0x7f5fe014fd90 2023-08-22T00:21:41.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc0033f0 con 0x7f5fe014fd90 2023-08-22T00:21:41.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461506715 0 0) 0x7f5fe0152b80 con 0x7f5fe00675f0 2023-08-22T00:21:41.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc001110 con 0x7f5fe00675f0 2023-08-22T00:21:41.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe66b6700 1 -- 172.21.15.98:0/1607861489 >> v1:172.21.15.118:6789/0 conn(0x7f5fe00675f0 legacy=0x7f5fe00a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe66b6700 1 -- 172.21.15.98:0/1607861489 >> v1:172.21.15.98:6789/0 conn(0x7f5fe014fd90 legacy=0x7f5fe0153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe66b6700 1 -- 172.21.15.98:0/1607861489 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0067bd0 con 0x7f5fe00c39d0 2023-08-22T00:21:41.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe66b6700 1 --2- 172.21.15.98:0/1607861489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 0x7f5fe00c3e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5fd8009e90 tx=0x7f5fd8009780).ready entity=mon.2 client_cookie=5a00c85aeac1de39 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800e070 con 0x7f5fe00c39d0 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800bab0 con 0x7f5fe00c39d0 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.973+0000 7f5fe4eb3700 1 -- 172.21.15.98:0/1607861489 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800be30 con 0x7f5fe00c39d0 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 -- 172.21.15.98:0/1607861489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 msgr2=0x7f5fe00c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 --2- 172.21.15.98:0/1607861489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 0x7f5fe00c3e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5fd8009e90 tx=0x7f5fd8009780).stop 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 -- 172.21.15.98:0/1607861489 shutdown_connections 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 --2- 172.21.15.98:0/1607861489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00c39d0 0x7f5fe00c3e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 -- 172.21.15.98:0/1607861489 >> 172.21.15.98:0/1607861489 conn(0x7f5fe00c8950 msgr2=0x7f5fe00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:41.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 -- 172.21.15.98:0/1607861489 shutdown_connections 2023-08-22T00:21:41.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.974+0000 7f5fe8119700 1 -- 172.21.15.98:0/1607861489 wait complete. 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.975+0000 7f5fe8119700 1 Processor -- start 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.975+0000 7f5fe8119700 1 -- start start 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00675f0 0x7f5fe014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00c39d0 0x7f5fe0143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c05a0 con 0x7f5fe014fd90 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c0880 con 0x7f5fe00c39d0 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.976+0000 7f5fe8119700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c0b60 con 0x7f5fe00675f0 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41726/0 (socket says 172.21.15.98:41726) 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 -- 172.21.15.98:0/3474546274 learned_addr learned my addr 172.21.15.98:0/3474546274 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe5eb5700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00675f0 0x7f5fe014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe56b4700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00c39d0 0x7f5fe0143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 -- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00675f0 msgr2=0x7f5fe014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00675f0 0x7f5fe014ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 -- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00c39d0 msgr2=0x7f5fe0143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00c39d0 0x7f5fe0143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 -- 172.21.15.98:0/3474546274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009a20 con 0x7f5fe014fd90 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe66b6700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f5fe0063c70 tx=0x7f5fd8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8013e60 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd801d630 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00c0e40 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd801d9f0 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.977+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe014ef50 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0069d50 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5fd8003040 con 0x7f5fe014fd90 2023-08-22T00:21:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fd5ffb700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 0x7f5fc4061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fe5eb5700 1 -- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 msgr2=0x7f5fc4061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f5fd807c2c0 con 0x7f5fe014fd90 2023-08-22T00:21:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.979+0000 7f5fe5eb5700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 0x7f5fc4061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:41.983+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fd804d240 con 0x7f5fe014fd90 2023-08-22T00:21:41.987 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:41.985+0000 7f5f25501680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:21:42.058 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:42.057+0000 7f5f25501680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:21:42.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.151+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fe0067eb0 con 0x7f5fe014fd90 2023-08-22T00:21:42.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.152+0000 7f5fd5ffb700 1 -- 172.21.15.98:0/3474546274 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fd8050860 con 0x7f5fe014fd90 2023-08-22T00:21:42.153 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:21:42.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 msgr2=0x7f5fc4061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 0x7f5fc4061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 msgr2=0x7f5fe00c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f5fe0063c70 tx=0x7f5fd8009780).stop 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 shutdown_connections 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5fc405ef90 0x7f5fc4061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5fe00675f0 0x7f5fe014ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe014fd90 0x7f5fe00c2700 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 --2- 172.21.15.98:0/3474546274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00c39d0 0x7f5fe0143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 >> 172.21.15.98:0/3474546274 conn(0x7f5fe00c8950 msgr2=0x7f5fe01509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 shutdown_connections 2023-08-22T00:21:42.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.154+0000 7f5fe8119700 1 -- 172.21.15.98:0/3474546274 wait complete. 2023-08-22T00:21:42.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:42.220 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:42.219+0000 7f3305d14680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:42.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.284+0000 7f0904d34700 1 Processor -- start 2023-08-22T00:21:42.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.284+0000 7f0904d34700 1 -- start start 2023-08-22T00:21:42.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f0904d34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 0x7f0900152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f0904d34700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0900153080 con 0x7f09000c3e50 2023-08-22T00:21:42.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f0904d34700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000667b0 con 0x7f090014bf70 2023-08-22T00:21:42.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f0904d34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900066510 con 0x7f090014c350 2023-08-22T00:21:42.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f08fed9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f09000c3e50 0x7f09000aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48796/0 (socket says 172.21.15.98:48796) 2023-08-22T00:21:42.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f08fed9d700 1 -- 172.21.15.98:0/1262316479 learned_addr learned my addr 172.21.15.98:0/1262316479 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:42.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f08fdd9b700 1 --2- 172.21.15.98:0/1262316479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 0x7f0900152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.285+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181170837 0 0) 0x7f0900153080 con 0x7f09000c3e50 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e80033f0 con 0x7f09000c3e50 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946280269 0 0) 0x7f09000667b0 con 0x7f090014bf70 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0900153080 con 0x7f090014bf70 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fdd9b700 1 -- 172.21.15.98:0/1262316479 >> v1:172.21.15.118:6789/0 conn(0x7f090014bf70 legacy=0x7f09000c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fdd9b700 1 -- 172.21.15.98:0/1262316479 >> v1:172.21.15.98:6789/0 conn(0x7f09000c3e50 legacy=0x7f09000aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fdd9b700 1 -- 172.21.15.98:0/1262316479 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900155e00 con 0x7f090014c350 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fdd9b700 1 --2- 172.21.15.98:0/1262316479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 0x7f0900152b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f08f4009790 tx=0x7f08f4009060).ready entity=mon.2 client_cookie=ba6c2eb6bf2ff250 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400f510 con 0x7f090014c350 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400f670 con 0x7f090014c350 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f08fd59a700 1 -- 172.21.15.98:0/1262316479 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400f9f0 con 0x7f090014c350 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f0904d34700 1 -- 172.21.15.98:0/1262316479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 msgr2=0x7f0900152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.286+0000 7f0904d34700 1 --2- 172.21.15.98:0/1262316479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 0x7f0900152b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f08f4009790 tx=0x7f08f4009060).stop 2023-08-22T00:21:42.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.287+0000 7f0904d34700 1 -- 172.21.15.98:0/1262316479 shutdown_connections 2023-08-22T00:21:42.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.287+0000 7f0904d34700 1 --2- 172.21.15.98:0/1262316479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014c350 0x7f0900152b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.287+0000 7f0904d34700 1 -- 172.21.15.98:0/1262316479 >> 172.21.15.98:0/1262316479 conn(0x7f09000c5dc0 msgr2=0x7f0900068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.287+0000 7f0904d34700 1 -- 172.21.15.98:0/1262316479 shutdown_connections 2023-08-22T00:21:42.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.287+0000 7f0904d34700 1 -- 172.21.15.98:0/1262316479 wait complete. 2023-08-22T00:21:42.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 Processor -- start 2023-08-22T00:21:42.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 -- start start 2023-08-22T00:21:42.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014bf70 0x7f0900064930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f090014c350 0x7f09000c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900065910 con 0x7f09000c3e50 2023-08-22T00:21:42.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090014f5b0 con 0x7f090014c350 2023-08-22T00:21:42.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.288+0000 7f0904d34700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900150080 con 0x7f090014bf70 2023-08-22T00:21:42.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41742/0 (socket says 172.21.15.98:41742) 2023-08-22T00:21:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 -- 172.21.15.98:0/2729111716 learned_addr learned my addr 172.21.15.98:0/2729111716 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fdd9b700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014bf70 0x7f0900064930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fed9d700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f090014c350 0x7f09000c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014bf70 msgr2=0x7f0900064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014bf70 0x7f0900064930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f090014c350 msgr2=0x7f09000c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f090014c350 0x7f09000c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 -- 172.21.15.98:0/2729111716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40092a0 con 0x7f09000c3e50 2023-08-22T00:21:42.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08fe59c700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f08f000c490 tx=0x7f08f0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000ce40 con 0x7f09000c3e50 2023-08-22T00:21:42.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000f470 con 0x7f09000c3e50 2023-08-22T00:21:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0900064e20 con 0x7f09000c3e50 2023-08-22T00:21:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000f810 con 0x7f09000c3e50 2023-08-22T00:21:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.289+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900065350 con 0x7f09000c3e50 2023-08-22T00:21:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.290+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090014fe50 con 0x7f09000c3e50 2023-08-22T00:21:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.291+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f08f000fbc0 con 0x7f09000c3e50 2023-08-22T00:21:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.291+0000 7f08ee7fc700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 0x7f08e0061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.291+0000 7f08fdd9b700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 msgr2=0x7f08e0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.291+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f08f0079900 con 0x7f09000c3e50 2023-08-22T00:21:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.291+0000 7f08fdd9b700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 0x7f08e0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.295+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08f004a810 con 0x7f09000c3e50 2023-08-22T00:21:42.326 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:42.325+0000 7f5f25501680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:21:42.401 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:42.400+0000 7f3305d14680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.492+0000 7f08fdd9b700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 msgr2=0x7f08e0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.492+0000 7f08fdd9b700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 0x7f08e0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:42.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.505+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0900047480 con 0x7f09000c3e50 2023-08-22T00:21:42.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.506+0000 7f08ee7fc700 1 -- 172.21.15.98:0/2729111716 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f08f004de30 con 0x7f09000c3e50 2023-08-22T00:21:42.508 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:42.508 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 msgr2=0x7f08e0061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 0x7f08e0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 msgr2=0x7f090014f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f08f000c490 tx=0x7f08f0007c90).stop 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 shutdown_connections 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f090014c350 0x7f09000c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09000c3e50 0x7f090014f0c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08e005efc0 0x7f08e0061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 --2- 172.21.15.98:0/2729111716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f090014bf70 0x7f0900064930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 >> 172.21.15.98:0/2729111716 conn(0x7f09000c5dc0 msgr2=0x7f09000c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 shutdown_connections 2023-08-22T00:21:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.508+0000 7f0904d34700 1 -- 172.21.15.98:0/2729111716 wait complete. 2023-08-22T00:21:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:42.515 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:42.514+0000 7f5f25501680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:21:42.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:42.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.642+0000 7f5c2dca7700 1 Processor -- start 2023-08-22T00:21:42.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.642+0000 7f5c2dca7700 1 -- start start 2023-08-22T00:21:42.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.642+0000 7f5c2dca7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5c28153f40 0x7f5c28157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c2dca7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c280a8410 con 0x7f5c280a9140 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c2dca7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c280a8cb0 con 0x7f5c28153b60 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c2dca7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c281586a0 con 0x7f5c28153f40 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5c28153f40 0x7f5c28157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5c28153f40 0x7f5c28157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41744/0 (socket says 172.21.15.98:41744) 2023-08-22T00:21:42.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c27fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5c280a9140 0x7f5c28157e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48810/0 (socket says 172.21.15.98:48810) 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 -- 172.21.15.98:0/2897471694 learned_addr learned my addr 172.21.15.98:0/2897471694 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c26ffd700 1 -- 172.21.15.98:0/2897471694 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654509405 0 0) 0x7f5c280a8cb0 con 0x7f5c28153b60 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 -- 172.21.15.98:0/2897471694 >> v1:172.21.15.118:6789/0 conn(0x7f5c28153b60 legacy=0x7f5c28068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 -- 172.21.15.98:0/2897471694 >> v1:172.21.15.98:6789/0 conn(0x7f5c280a9140 legacy=0x7f5c28157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 -- 172.21.15.98:0/2897471694 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280a8660 con 0x7f5c28153f40 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c1effd700 1 --2- 172.21.15.98:0/2897471694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153f40 0x7f5c28157930 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5c10006fd0 tx=0x7f5c100090f0).ready entity=mon.0 client_cookie=a65e4a3e5741e7c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c26ffd700 1 -- 172.21.15.98:0/2897471694 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000b600 con 0x7f5c28153f40 2023-08-22T00:21:42.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c26ffd700 1 -- 172.21.15.98:0/2897471694 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000b760 con 0x7f5c28153f40 2023-08-22T00:21:42.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.643+0000 7f5c26ffd700 1 -- 172.21.15.98:0/2897471694 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000bae0 con 0x7f5c28153f40 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 -- 172.21.15.98:0/2897471694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153f40 msgr2=0x7f5c28157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/2897471694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153f40 0x7f5c28157930 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5c10006fd0 tx=0x7f5c100090f0).stop 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 -- 172.21.15.98:0/2897471694 shutdown_connections 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/2897471694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153f40 0x7f5c28157930 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 -- 172.21.15.98:0/2897471694 >> 172.21.15.98:0/2897471694 conn(0x7f5c280c5dc0 msgr2=0x7f5c28068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 -- 172.21.15.98:0/2897471694 shutdown_connections 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.644+0000 7f5c2dca7700 1 -- 172.21.15.98:0/2897471694 wait complete. 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.645+0000 7f5c2dca7700 1 Processor -- start 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.646+0000 7f5c2dca7700 1 -- start start 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c280a9140 0x7f5c280a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c28153f40 0x7f5c280a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280bed00 con 0x7f5c28153b60 2023-08-22T00:21:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280bf190 con 0x7f5c28153f40 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c281520f0 con 0x7f5c280a9140 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41756/0 (socket says 172.21.15.98:41756) 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 -- 172.21.15.98:0/1731244557 learned_addr learned my addr 172.21.15.98:0/1731244557 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c27fff700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c28153f40 0x7f5c280a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c277fe700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c280a9140 0x7f5c280a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 -- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c280a9140 msgr2=0x7f5c280a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c280a9140 0x7f5c280a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 -- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c28153f40 msgr2=0x7f5c280a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c28153f40 0x7f5c280a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 -- 172.21.15.98:0/1731244557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10009370 con 0x7f5c28153b60 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1effd700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f5c10009130 tx=0x7f5c10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000b8d0 con 0x7f5c28153b60 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000ba50 con 0x7f5c28153b60 2023-08-22T00:21:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1001c670 con 0x7f5c28153b60 2023-08-22T00:21:42.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.647+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c280be0f0 con 0x7f5c28153b60 2023-08-22T00:21:42.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.648+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c280be6b0 con 0x7f5c28153b60 2023-08-22T00:21:42.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.648+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c28047480 con 0x7f5c28153b60 2023-08-22T00:21:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.649+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5c1001c9e0 con 0x7f5c28153b60 2023-08-22T00:21:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.649+0000 7f5c1ffff700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 0x7f5c080614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.649+0000 7f5c277fe700 1 -- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 msgr2=0x7f5c080614b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.649+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f5c1007bc00 con 0x7f5c28153b60 2023-08-22T00:21:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.649+0000 7f5c277fe700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 0x7f5c080614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.653+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c1004cb10 con 0x7f5c28153b60 2023-08-22T00:21:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.823+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c280a8940 con 0x7f5c28153b60 2023-08-22T00:21:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.824+0000 7f5c1ffff700 1 -- 172.21.15.98:0/1731244557 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17630 (secure 0 0 0) 0x7f5c10020090 con 0x7f5c28153b60 2023-08-22T00:21:42.826 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:42.827 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":91,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:37.775003+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3987238629":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/2943466958":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6833/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6832/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/381978763":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/390340889":"2023-08-23T00:21:37.774961+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.826+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 msgr2=0x7f5c080614b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.826+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 0x7f5c080614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.826+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 msgr2=0x7f5c280bd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.826+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f5c10009130 tx=0x7f5c10017000).stop 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 shutdown_connections 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5c0805eff0 0x7f5c080614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c280a9140 0x7f5c280a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c28153f40 0x7f5c280a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 --2- 172.21.15.98:0/1731244557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c28153b60 0x7f5c280bd7c0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 >> 172.21.15.98:0/1731244557 conn(0x7f5c280c5dc0 msgr2=0x7f5c280aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 shutdown_connections 2023-08-22T00:21:42.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.827+0000 7f5c2dca7700 1 -- 172.21.15.98:0/1731244557 wait complete. 2023-08-22T00:21:42.840 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:21:42.841 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:42.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.960+0000 7fc4ceecd700 1 Processor -- start 2023-08-22T00:21:42.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.960+0000 7fc4ceecd700 1 -- start start 2023-08-22T00:21:42.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4ceecd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc4c8151d60 0x7fc4c8155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4ceecd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c8158bf0 con 0x7fc4c80a6e50 2023-08-22T00:21:42.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4ceecd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c8157d90 con 0x7fc4c8066620 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4ceecd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c8157fe0 con 0x7fc4c8151d60 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4ccc69700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc4c8151d60 0x7fc4c8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4c7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc4c80a6e50 0x7fc4c8065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48824/0 (socket says 172.21.15.98:48824) 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.961+0000 7fc4c7fff700 1 -- 172.21.15.98:0/3342717260 learned_addr learned my addr 172.21.15.98:0/3342717260 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4ccc69700 1 -- 172.21.15.98:0/3342717260 >> v1:172.21.15.118:6789/0 conn(0x7fc4c8066620 legacy=0x7fc4c80643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4ccc69700 1 -- 172.21.15.98:0/3342717260 >> v1:172.21.15.98:6789/0 conn(0x7fc4c80a6e50 legacy=0x7fc4c8065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4ccc69700 1 -- 172.21.15.98:0/3342717260 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c81582c0 con 0x7fc4c8151d60 2023-08-22T00:21:42.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4c77fe700 1 -- 172.21.15.98:0/3342717260 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852364460 0 0) 0x7fc4c8158bf0 con 0x7fc4c80a6e50 2023-08-22T00:21:42.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4ccc69700 1 --2- 172.21.15.98:0/3342717260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8155240 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fc4bc009760 tx=0x7fc4bc009060).ready entity=mon.0 client_cookie=def968791491d4d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4c77fe700 1 -- 172.21.15.98:0/3342717260 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b580 con 0x7fc4c8151d60 2023-08-22T00:21:42.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4c77fe700 1 -- 172.21.15.98:0/3342717260 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b6e0 con 0x7fc4c8151d60 2023-08-22T00:21:42.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.962+0000 7fc4c77fe700 1 -- 172.21.15.98:0/3342717260 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00ba60 con 0x7fc4c8151d60 2023-08-22T00:21:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 -- 172.21.15.98:0/3342717260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 msgr2=0x7fc4c8155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/3342717260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8155240 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fc4bc009760 tx=0x7fc4bc009060).stop 2023-08-22T00:21:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 -- 172.21.15.98:0/3342717260 shutdown_connections 2023-08-22T00:21:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/3342717260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8155240 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 -- 172.21.15.98:0/3342717260 >> 172.21.15.98:0/3342717260 conn(0x7fc4c806a980 msgr2=0x7fc4c80c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 -- 172.21.15.98:0/3342717260 shutdown_connections 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.963+0000 7fc4ceecd700 1 -- 172.21.15.98:0/3342717260 wait complete. 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.964+0000 7fc4ceecd700 1 Processor -- start 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.964+0000 7fc4ceecd700 1 -- start start 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4c8066620 0x7fc4c81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4c80a6e50 0x7fc4c8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c814ce70 con 0x7fc4c8151d60 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81573c0 con 0x7fc4c8066620 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81683c0 con 0x7fc4c80a6e50 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41764/0 (socket says 172.21.15.98:41764) 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 -- 172.21.15.98:0/2634484347 learned_addr learned my addr 172.21.15.98:0/2634484347 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ccc69700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4c8066620 0x7fc4c81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4c7fff700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4c80a6e50 0x7fc4c8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4c80a6e50 msgr2=0x7fc4c8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4c80a6e50 0x7fc4c8156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4c8066620 msgr2=0x7fc4c81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4c8066620 0x7fc4c81569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 -- 172.21.15.98:0/2634484347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0092a0 con 0x7fc4c8151d60 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4cd46a700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc4c0002230 tx=0x7fc4c00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000e4a0 con 0x7fc4c8151d60 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c000e600 con 0x7fc4c8151d60 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80ad430 con 0x7fc4c8151d60 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000e980 con 0x7fc4c8151d60 2023-08-22T00:21:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.965+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c8167d70 con 0x7fc4c8151d60 2023-08-22T00:21:42.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.966+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8047480 con 0x7fc4c8151d60 2023-08-22T00:21:42.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.967+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fc4c001b3b0 con 0x7fc4c8151d60 2023-08-22T00:21:42.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.967+0000 7fc4c4ff9700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 0x7fc4ac061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.967+0000 7fc4ccc69700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 msgr2=0x7fc4ac061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.967+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fc4c0079990 con 0x7fc4c8151d60 2023-08-22T00:21:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.967+0000 7fc4ccc69700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 0x7fc4ac061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:42.971+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4c00488f0 con 0x7fc4c8151d60 2023-08-22T00:21:43.047 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.047+0000 7f3305d14680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:43.118 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.115+0000 7f3305d14680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:43.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.168+0000 7fc4ccc69700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 msgr2=0x7fc4ac061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:43.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.168+0000 7fc4ccc69700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 0x7fc4ac061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:43.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.180+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c81585a0 con 0x7fc4c8151d60 2023-08-22T00:21:43.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.181+0000 7fc4c4ff9700 1 -- 172.21.15.98:0/2634484347 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc4c004a9f0 con 0x7fc4c8151d60 2023-08-22T00:21:43.183 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:43.183 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 msgr2=0x7fc4ac061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:43.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 0x7fc4ac061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 msgr2=0x7fc4c8164890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc4c0002230 tx=0x7fc4c00015e0).stop 2023-08-22T00:21:43.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 shutdown_connections 2023-08-22T00:21:43.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4c8151d60 0x7fc4c8164890 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4c8066620 0x7fc4c81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc4ac05efc0 0x7fc4ac061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 --2- 172.21.15.98:0/2634484347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4c80a6e50 0x7fc4c8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 >> 172.21.15.98:0/2634484347 conn(0x7fc4c806a980 msgr2=0x7fc4c80643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:43.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 shutdown_connections 2023-08-22T00:21:43.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.183+0000 7fc4ceecd700 1 -- 172.21.15.98:0/2634484347 wait complete. 2023-08-22T00:21:43.189 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:43.190 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.190+0000 7f3305d14680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:43.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:43.208 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.207+0000 7f5f25501680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:21:43.283 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.282+0000 7f5f25501680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:21:43.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.314+0000 7f91e08c4700 1 Processor -- start 2023-08-22T00:21:43.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.314+0000 7f91e08c4700 1 -- start start 2023-08-22T00:21:43.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91e08c4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91dc153f40 0x7f91dc157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91e08c4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc0a8410 con 0x7f91dc153b60 2023-08-22T00:21:43.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91e08c4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc0a8cb0 con 0x7f91dc0a9140 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91e08c4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc1586a0 con 0x7f91dc153f40 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91da59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f91dc153b60 0x7f91dc068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48834/0 (socket says 172.21.15.98:48834) 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91da59c700 1 -- 172.21.15.98:0/1817744268 learned_addr learned my addr 172.21.15.98:0/1817744268 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91d9d9b700 1 --2- 172.21.15.98:0/1817744268 >> v2:172.21.15.118:3300/0 conn(0x7f91dc153f40 0x7f91dc157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588281764 0 0) 0x7f91dc0a8410 con 0x7f91dc153b60 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.315+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c40033f0 con 0x7f91dc153b60 2023-08-22T00:21:43.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d9d9b700 1 -- 172.21.15.98:0/1817744268 >> v1:172.21.15.118:6789/0 conn(0x7f91dc0a9140 legacy=0x7f91dc157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056572823 0 0) 0x7f91dc0a8cb0 con 0x7f91dc0a9140 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d9d9b700 1 -- 172.21.15.98:0/1817744268 >> v1:172.21.15.98:6789/0 conn(0x7f91dc153b60 legacy=0x7f91dc068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d9d9b700 1 -- 172.21.15.98:0/1817744268 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0a8660 con 0x7f91dc153f40 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d9d9b700 1 --2- 172.21.15.98:0/1817744268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc153f40 0x7f91dc157930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f91d0009760 tx=0x7f91d0009060).ready entity=mon.1 client_cookie=23cd229451fe62cd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000f510 con 0x7f91dc153f40 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d000f670 con 0x7f91dc153f40 2023-08-22T00:21:43.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91d959a700 1 -- 172.21.15.98:0/1817744268 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000f9f0 con 0x7f91dc153f40 2023-08-22T00:21:43.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91e08c4700 1 -- 172.21.15.98:0/1817744268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc153f40 msgr2=0x7f91dc157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.316+0000 7f91e08c4700 1 --2- 172.21.15.98:0/1817744268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc153f40 0x7f91dc157930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f91d0009760 tx=0x7f91d0009060).stop 2023-08-22T00:21:43.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.317+0000 7f91e08c4700 1 -- 172.21.15.98:0/1817744268 shutdown_connections 2023-08-22T00:21:43.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.317+0000 7f91e08c4700 1 --2- 172.21.15.98:0/1817744268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc153f40 0x7f91dc157930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.317+0000 7f91e08c4700 1 -- 172.21.15.98:0/1817744268 >> 172.21.15.98:0/1817744268 conn(0x7f91dc0c5dc0 msgr2=0x7f91dc068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:43.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.317+0000 7f91e08c4700 1 -- 172.21.15.98:0/1817744268 shutdown_connections 2023-08-22T00:21:43.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.317+0000 7f91e08c4700 1 -- 172.21.15.98:0/1817744268 wait complete. 2023-08-22T00:21:43.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 Processor -- start 2023-08-22T00:21:43.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 -- start start 2023-08-22T00:21:43.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 0x7f91dc149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91dc153b60 0x7f91dc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc152b40 con 0x7f91dc153f40 2023-08-22T00:21:43.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc063e40 con 0x7f91dc0a9140 2023-08-22T00:21:43.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.318+0000 7f91e08c4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0bf900 con 0x7f91dc153b60 2023-08-22T00:21:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91da59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 0x7f91dc149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41766/0 (socket says 172.21.15.98:41766) 2023-08-22T00:21:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 -- 172.21.15.98:0/2976120377 learned_addr learned my addr 172.21.15.98:0/2976120377 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91d9d9b700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91dc153b60 0x7f91dc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91dc153b60 msgr2=0x7f91dc152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91dc153b60 0x7f91dc152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 msgr2=0x7f91dc149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 0x7f91dc149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 -- 172.21.15.98:0/2976120377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00092a0 con 0x7f91dc153f40 2023-08-22T00:21:43.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91da59c700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 0x7f91dc149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:43.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91dad9d700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f91d4001560 tx=0x7f91d4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:43.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400e4a0 con 0x7f91dc153f40 2023-08-22T00:21:43.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400e600 con 0x7f91dc153f40 2023-08-22T00:21:43.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400e9a0 con 0x7f91dc153f40 2023-08-22T00:21:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc0c0480 con 0x7f91dc153f40 2023-08-22T00:21:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.319+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc163dd0 con 0x7f91dc153f40 2023-08-22T00:21:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc0c0610 con 0x7f91dc153f40 2023-08-22T00:21:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f91d4012400 con 0x7f91dc153f40 2023-08-22T00:21:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91ca7fc700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 0x7f91bc061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91da59c700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 msgr2=0x7f91bc061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f91d4079da0 con 0x7f91dc153f40 2023-08-22T00:21:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.321+0000 7f91da59c700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 0x7f91bc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.326+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91d404ad50 con 0x7f91dc153f40 2023-08-22T00:21:43.336 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.336+0000 7f3305d14680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:43.363 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.362+0000 7f5f25501680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:21:43.407 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.406+0000 7f3305d14680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:43.516 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.514+0000 7f5f25501680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:21:43.519 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.519+0000 7f3305d14680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:43.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.522+0000 7f91da59c700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 msgr2=0x7f91bc061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:43.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.522+0000 7f91da59c700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 0x7f91bc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:21:43.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.536+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91dc047480 con 0x7f91dc153f40 2023-08-22T00:21:43.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.536+0000 7f91ca7fc700 1 -- 172.21.15.98:0/2976120377 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f91d404e370 con 0x7f91dc153f40 2023-08-22T00:21:43.538 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:43.538 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:20.707368+0000","modified":"2023-08-22T00:21:23.335879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6441},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6441":{"gid":6441,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6836/3477152775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3477152775},{"type":"v1","addr":"172.21.15.98:6836","nonce":3477152775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 msgr2=0x7f91bc061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 0x7f91bc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 msgr2=0x7f91dc152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f91d4001560 tx=0x7f91d4007f40).stop 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 shutdown_connections 2023-08-22T00:21:43.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91dc153f40 0x7f91dc152650 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91dc0a9140 0x7f91dc149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f91bc05efc0 0x7f91bc061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 --2- 172.21.15.98:0/2976120377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91dc153b60 0x7f91dc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 >> 172.21.15.98:0/2976120377 conn(0x7f91dc0c5dc0 msgr2=0x7f91dc150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 shutdown_connections 2023-08-22T00:21:43.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.538+0000 7f91e08c4700 1 -- 172.21.15.98:0/2976120377 wait complete. 2023-08-22T00:21:43.542 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2023-08-22T00:21:43.552 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:43.590 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.588+0000 7f5f25501680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:21:43.627 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.626+0000 7f3305d14680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:43.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.708+0000 7f189ddd2700 1 Processor -- start 2023-08-22T00:21:43.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.708+0000 7f189ddd2700 1 -- start start 2023-08-22T00:21:43.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f189ddd2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18981550e0 0x7f1898065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f189ddd2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1898066400 0x7f18980bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f189ddd2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980bd750 con 0x7f1898153cf0 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f189ddd2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18980a7030 con 0x7f1898066400 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f189ddd2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980c2010 con 0x7f18981550e0 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1897fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1898066400 0x7f18980bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f18977fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1898153cf0 0x7f18981584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48846/0 (socket says 172.21.15.98:48846) 2023-08-22T00:21:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f18977fe700 1 -- 172.21.15.98:0/1087913351 learned_addr learned my addr 172.21.15.98:0/1087913351 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1896ffd700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18981550e0 0x7f1898065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1897fff700 1 -- 172.21.15.98:0/1087913351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18981550e0 msgr2=0x7f1898065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1897fff700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18981550e0 0x7f1898065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1897fff700 1 -- 172.21.15.98:0/1087913351 >> v1:172.21.15.98:6789/0 conn(0x7f1898153cf0 legacy=0x7f18981584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f18967fc700 1 -- 172.21.15.98:0/1087913351 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106049112 0 0) 0x7f18980bd750 con 0x7f1898153cf0 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.709+0000 7f1897fff700 1 -- 172.21.15.98:0/1087913351 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980a6d50 con 0x7f1898066400 2023-08-22T00:21:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f1897fff700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898066400 0x7f18980bdbe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1890009760 tx=0x7f1890009060).ready entity=mon.0 client_cookie=c7461af7fa141095 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f18967fc700 1 -- 172.21.15.98:0/1087913351 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000f510 con 0x7f1898066400 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f18967fc700 1 -- 172.21.15.98:0/1087913351 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000f670 con 0x7f1898066400 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f18967fc700 1 -- 172.21.15.98:0/1087913351 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000f9f0 con 0x7f1898066400 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 -- 172.21.15.98:0/1087913351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898066400 msgr2=0x7f18980bdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898066400 0x7f18980bdbe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1890009760 tx=0x7f1890009060).stop 2023-08-22T00:21:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 -- 172.21.15.98:0/1087913351 shutdown_connections 2023-08-22T00:21:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898066400 0x7f18980bdbe0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1087913351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18981550e0 0x7f1898065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 -- 172.21.15.98:0/1087913351 >> 172.21.15.98:0/1087913351 conn(0x7f18980c7770 msgr2=0x7f18980c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 -- 172.21.15.98:0/1087913351 shutdown_connections 2023-08-22T00:21:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.710+0000 7f189ddd2700 1 -- 172.21.15.98:0/1087913351 wait complete. 2023-08-22T00:21:43.717 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.711+0000 7f5f25501680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.712+0000 7f189ddd2700 1 Processor -- start 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.712+0000 7f189ddd2700 1 -- start start 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1898066400 0x7f189814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18981550e0 0x7f1898063ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898063350 con 0x7f1898153cf0 2023-08-22T00:21:43.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898063630 con 0x7f18981550e0 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189814f120 con 0x7f1898066400 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41792/0 (socket says 172.21.15.98:41792) 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 -- 172.21.15.98:0/1746754662 learned_addr learned my addr 172.21.15.98:0/1746754662 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f18977fe700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1898066400 0x7f189814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1897fff700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18981550e0 0x7f1898063ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 -- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1898066400 msgr2=0x7f189814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1898066400 0x7f189814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 -- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18981550e0 msgr2=0x7f1898063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18981550e0 0x7f1898063ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 -- 172.21.15.98:0/1746754662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900092a0 con 0x7f1898153cf0 2023-08-22T00:21:43.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f1896ffd700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f188c00e930 tx=0x7f188c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:43.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c012600 con 0x7f1898153cf0 2023-08-22T00:21:43.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c012760 con 0x7f1898153cf0 2023-08-22T00:21:43.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189814f400 con 0x7f1898153cf0 2023-08-22T00:21:43.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c012ae0 con 0x7f1898153cf0 2023-08-22T00:21:43.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.713+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189814d8a0 con 0x7f1898153cf0 2023-08-22T00:21:43.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.714+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1898047480 con 0x7f1898153cf0 2023-08-22T00:21:43.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.715+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f188c01b400 con 0x7f1898153cf0 2023-08-22T00:21:43.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.715+0000 7f187f7fe700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 0x7f1884061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:43.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.715+0000 7f18977fe700 1 -- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 msgr2=0x7f1884061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:43.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.715+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f188c07a5d0 con 0x7f1898153cf0 2023-08-22T00:21:43.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.715+0000 7f18977fe700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 0x7f1884061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:43.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.719+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f188c04b580 con 0x7f1898153cf0 2023-08-22T00:21:43.827 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:43.826+0000 7f5f25501680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:21:43.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.889+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18980bd100 con 0x7f1898153cf0 2023-08-22T00:21:43.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.889+0000 7f187f7fe700 1 -- 172.21.15.98:0/1746754662 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17630 (secure 0 0 0) 0x7f188c016090 con 0x7f1898153cf0 2023-08-22T00:21:43.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:43.891 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":91,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:37.775003+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:19.254016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:19.662112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3987238629":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/2943466958":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6833/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:6832/118203":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/381978763":"2023-08-23T00:21:37.774961+0000","172.21.15.98:0/390340889":"2023-08-23T00:21:37.774961+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 msgr2=0x7f1884061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 0x7f1884061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 msgr2=0x7f189813fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f188c00e930 tx=0x7f188c009060).stop 2023-08-22T00:21:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 shutdown_connections 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f188405efc0 0x7f1884061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1898066400 0x7f189814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18981550e0 0x7f1898063ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 --2- 172.21.15.98:0/1746754662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1898153cf0 0x7f189813fb40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 >> 172.21.15.98:0/1746754662 conn(0x7f18980c7770 msgr2=0x7f18980bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 shutdown_connections 2023-08-22T00:21:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:43.892+0000 7f189ddd2700 1 -- 172.21.15.98:0/1746754662 wait complete. 2023-08-22T00:21:43.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:21:43.916 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.915+0000 7f3305d14680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:43.985 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:21:43.985+0000 7f3305d14680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:44.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.030+0000 7f73fb0ad700 1 Processor -- start 2023-08-22T00:21:44.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.030+0000 7f73fb0ad700 1 -- start start 2023-08-22T00:21:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73fb0ad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73f4153a60 0x7f73f4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73fb0ad700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40c1800 con 0x7f73f40c6210 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73fb0ad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40c0bf0 con 0x7f73f40a9ad0 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73fb0ad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f40c0ed0 con 0x7f73f4153a60 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73f964a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f73f40c6210 0x7f73f4062840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48852/0 (socket says 172.21.15.98:48852) 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73f964a700 1 -- 172.21.15.98:0/3195930094 learned_addr learned my addr 172.21.15.98:0/3195930094 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.031+0000 7f73f8e49700 1 --2- 172.21.15.98:0/3195930094 >> v2:172.21.15.118:3300/0 conn(0x7f73f4153a60 0x7f73f4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994844885 0 0) 0x7f73f40c1800 con 0x7f73f40c6210 2023-08-22T00:21:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e40033f0 con 0x7f73f40c6210 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083271169 0 0) 0x7f73f40c0bf0 con 0x7f73f40a9ad0 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f40c1800 con 0x7f73f40a9ad0 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f8e49700 1 -- 172.21.15.98:0/3195930094 >> v1:172.21.15.118:6789/0 conn(0x7f73f40a9ad0 legacy=0x7f73f40c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f8e49700 1 -- 172.21.15.98:0/3195930094 >> v1:172.21.15.98:6789/0 conn(0x7f73f40c6210 legacy=0x7f73f4062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f8e49700 1 -- 172.21.15.98:0/3195930094 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40c11b0 con 0x7f73f4153a60 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f8e49700 1 --2- 172.21.15.98:0/3195930094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f4153a60 0x7f73f4153e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f73e8009760 tx=0x7f73e8009060).ready entity=mon.1 client_cookie=d51b36f58700ee8c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800d4a0 con 0x7f73f4153a60 2023-08-22T00:21:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e800d600 con 0x7f73f4153a60 2023-08-22T00:21:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.032+0000 7f73f37fe700 1 -- 172.21.15.98:0/3195930094 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800d980 con 0x7f73f4153a60 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 -- 172.21.15.98:0/3195930094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f4153a60 msgr2=0x7f73f4153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/3195930094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f4153a60 0x7f73f4153e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f73e8009760 tx=0x7f73e8009060).stop 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 -- 172.21.15.98:0/3195930094 shutdown_connections 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/3195930094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f4153a60 0x7f73f4153e40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 -- 172.21.15.98:0/3195930094 >> 172.21.15.98:0/3195930094 conn(0x7f73f40650f0 msgr2=0x7f73f40cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 -- 172.21.15.98:0/3195930094 shutdown_connections 2023-08-22T00:21:44.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.033+0000 7f73fb0ad700 1 -- 172.21.15.98:0/3195930094 wait complete. 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.034+0000 7f73fb0ad700 1 Processor -- start 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.034+0000 7f73fb0ad700 1 -- start start 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40a9ad0 0x7f73f414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f4153a60 0x7f73f41515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40adca0 con 0x7f73f40c6210 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40adf80 con 0x7f73f40a9ad0 2023-08-22T00:21:44.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73fb0ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40ae260 con 0x7f73f4153a60 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41804/0 (socket says 172.21.15.98:41804) 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 -- 172.21.15.98:0/215683760 learned_addr learned my addr 172.21.15.98:0/215683760 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f8e49700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40a9ad0 0x7f73f414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f964a700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f4153a60 0x7f73f41515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:44.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f4153a60 msgr2=0x7f73f41515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:44.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f4153a60 0x7f73f41515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40a9ad0 msgr2=0x7f73f414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40a9ad0 0x7f73f414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 -- 172.21.15.98:0/215683760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80092a0 con 0x7f73f40c6210 2023-08-22T00:21:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f3fff700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f73e000c490 tx=0x7f73e0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.035+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000ce40 con 0x7f73f40c6210 2023-08-22T00:21:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.036+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000f470 con 0x7f73f40c6210 2023-08-22T00:21:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.036+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f40ae540 con 0x7f73f40c6210 2023-08-22T00:21:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.036+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000f810 con 0x7f73f40c6210 2023-08-22T00:21:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.036+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f414e2e0 con 0x7f73f40c6210 2023-08-22T00:21:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f73e000fbc0 con 0x7f73f40c6210 2023-08-22T00:21:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f40c1490 con 0x7f73f40c6210 2023-08-22T00:21:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73f0ff9700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73f8e49700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 msgr2=0x7f73d8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:21:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f73e0079880 con 0x7f73f40c6210 2023-08-22T00:21:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.037+0000 7f73f8e49700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:21:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.041+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73e004a890 con 0x7f73f40c6210 2023-08-22T00:21:44.134 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.133+0000 7f5f25501680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:21:44.207 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.206+0000 7f5f25501680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:21:44.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.233+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 33) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f73e00771f0 con 0x7f73f40c6210 2023-08-22T00:21:44.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.234+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 msgr2=0x7f73d8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:21:44.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.234+0000 7f73f0ff9700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:44.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:44.257+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f73f40ad6d0 con 0x7f73f40c6210 2023-08-22T00:21:44.294 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.292+0000 7f5ea4fb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.294 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.292+0000 7f5ea4fb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.294 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.292+0000 7f5ea4fb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.292+0000 7f5ea4fb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.292+0000 7f5ea4fb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.293+0000 7f5ea7fbb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.293+0000 7f5ea7fbb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.293+0000 7f5ea7fbb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.293+0000 7f5ea7fbb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.295 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:21:44.293+0000 7f5ea7fbb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:21:44.297 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:21:44.296+0000 7f2498c30700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:21:44.297 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:21:44.296+0000 7f2498c30700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:21:44.297 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:21:44.296+0000 7f2498c30700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:21:44.303 INFO:tasks.ceph.mds.c.smithi098.stderr: -2690> 2023-08-22T00:21:21.633+0000 7f249c437700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:21:44.304 INFO:tasks.ceph.mds.c.smithi098.stderr: -4> 2023-08-22T00:21:44.296+0000 7f2498c30700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:21:44.304 INFO:tasks.ceph.mds.c.smithi098.stderr: -3> 2023-08-22T00:21:44.296+0000 7f2498c30700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:21:44.304 INFO:tasks.ceph.mds.c.smithi098.stderr: -1> 2023-08-22T00:21:44.296+0000 7f2498c30700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:21:44.322 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:21:45.230 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:21:45.228+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:21:45.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.235+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 34) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f73e0077570 con 0x7f73f40c6210 2023-08-22T00:21:45.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.235+0000 7f73f0ff9700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.236+0000 7f73f8e49700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.238+0000 7f73f8e49700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f73e8006d60 tx=0x7f73e8016000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.242+0000 7f73f0ff9700 1 -- 172.21.15.98:0/215683760 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f73e004b8a0 con 0x7f73f40c6210 2023-08-22T00:21:45.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 msgr2=0x7f73d8061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f73e8006d60 tx=0x7f73e8016000).stop 2023-08-22T00:21:45.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 msgr2=0x7f73f4163fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f73e000c490 tx=0x7f73e0007c90).stop 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 shutdown_connections 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805efc0 0x7f73d8061400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f4153a60 0x7f73f41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40a9ad0 0x7f73f414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 --2- 172.21.15.98:0/215683760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73f40c6210 0x7f73f4163fd0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 >> 172.21.15.98:0/215683760 conn(0x7f73f40650f0 msgr2=0x7f73f414eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 shutdown_connections 2023-08-22T00:21:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.245+0000 7f73fb0ad700 1 -- 172.21.15.98:0/215683760 wait complete. 2023-08-22T00:21:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:21:45.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:21:45.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.383+0000 7f396a6b1700 1 Processor -- start 2023-08-22T00:21:45.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.383+0000 7f396a6b1700 1 -- start start 2023-08-22T00:21:45.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f396a6b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f396a6b1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3964157e60 0x7f3964062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f396a6b1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640c8d30 con 0x7f3964157a80 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f396a6b1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640c9010 con 0x7f3964157e60 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f396a6b1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640c92f0 con 0x7f3964153e90 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3964157e60 0x7f3964062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f39637fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3964157e60 0x7f3964062600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:35918/0 (socket says 172.21.15.98:35918) 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 -- 172.21.15.98:0/2398388551 learned_addr learned my addr 172.21.15.98:0/2398388551 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f39637fe700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:37592/0 (socket says 172.21.15.98:37592) 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 -- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 msgr2=0x7f39640aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 -- 172.21.15.98:0/2398388551 >> v1:172.21.15.118:6789/0 conn(0x7f3964157a80 legacy=0x7f3964153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3962ffd700 1 -- 172.21.15.98:0/2398388551 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41387704 0 0) 0x7f39640c8d30 con 0x7f3964157a80 2023-08-22T00:21:45.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 -- 172.21.15.98:0/2398388551 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640c95d0 con 0x7f3964157e60 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f39637fe700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.384+0000 7f3968c4e700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964157e60 0x7f3964062600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f395c009f20 tx=0x7f395c009840).ready entity=mon.1 client_cookie=347bc4b0816de5a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f3962ffd700 1 -- 172.21.15.98:0/2398388551 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00e070 con 0x7f3964157e60 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f3962ffd700 1 -- 172.21.15.98:0/2398388551 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c00b9d0 con 0x7f3964157e60 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f3962ffd700 1 -- 172.21.15.98:0/2398388551 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00bd50 con 0x7f3964157e60 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 -- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964157e60 msgr2=0x7f3964062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964157e60 0x7f3964062600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f395c009f20 tx=0x7f395c009840).stop 2023-08-22T00:21:45.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 -- 172.21.15.98:0/2398388551 shutdown_connections 2023-08-22T00:21:45.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964157e60 0x7f3964062600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 --2- 172.21.15.98:0/2398388551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964153e90 0x7f39640aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 -- 172.21.15.98:0/2398388551 >> 172.21.15.98:0/2398388551 conn(0x7f39640cb5f0 msgr2=0x7f39640c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:45.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 -- 172.21.15.98:0/2398388551 shutdown_connections 2023-08-22T00:21:45.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.385+0000 7f396a6b1700 1 -- 172.21.15.98:0/2398388551 wait complete. 2023-08-22T00:21:45.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.386+0000 7f396a6b1700 1 Processor -- start 2023-08-22T00:21:45.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.386+0000 7f396a6b1700 1 -- start start 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 0x7f39640b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b0b30 con 0x7f3964157e60 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640c3f80 con 0x7f3964153e90 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f396a6b1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640c4260 con 0x7f3964157a80 2023-08-22T00:21:45.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f3968c4e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f3963fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f39637fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 0x7f39640b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f3968c4e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41900/0 (socket says 172.21.15.98:41900) 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f3963fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:35926/0 (socket says 172.21.15.98:35926) 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.387+0000 7f3968c4e700 1 -- 172.21.15.98:0/1059040261 learned_addr learned my addr 172.21.15.98:0/1059040261 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 -- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 msgr2=0x7f39640b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 0x7f39640b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 -- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 msgr2=0x7f39640c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 -- 172.21.15.98:0/1059040261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580092a0 con 0x7f3964157e60 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f39637fe700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 0x7f39640b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3963fff700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f3968c4e700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f396406aac0 tx=0x7f39641542f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:45.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00bd50 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c0092e0 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c009ae0 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c01d6b0 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.388+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39640c2020 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.389+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39640c1ba0 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.389+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 34) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f395c003040 con 0x7f3964157e60 2023-08-22T00:21:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.390+0000 7f394bfff700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 0x7f39500611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:45.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.390+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7033+0+0 (secure 0 0 0) 0x7f395c07b0e0 con 0x7f3964157e60 2023-08-22T00:21:45.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.390+0000 7f3963fff700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 0x7f39500611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:45.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.390+0000 7f3963fff700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 0x7f39500611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3954007fd0 tx=0x7f3954009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:45.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.394+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39640c1ba0 con 0x7f3964157e60 2023-08-22T00:21:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:45.596+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f39640c1ba0 con 0x7f3964157e60 2023-08-22T00:21:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.267+0000 7f394bfff700 1 -- 172.21.15.98:0/1059040261 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f39640c1ba0 con 0x7f3964157e60 2023-08-22T00:21:46.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 msgr2=0x7f39500611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 0x7f39500611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3954007fd0 tx=0x7f3954009040).stop 2023-08-22T00:21:46.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 msgr2=0x7f39640c2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f396406aac0 tx=0x7f39641542f0).stop 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 shutdown_connections 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3964157e60 0x7f39640c2540 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3964153e90 0x7f39640c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f395005ecf0 0x7f39500611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 --2- 172.21.15.98:0/1059040261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3964157a80 0x7f39640b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 >> 172.21.15.98:0/1059040261 conn(0x7f39640cb5f0 msgr2=0x7f39641508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:46.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 shutdown_connections 2023-08-22T00:21:46.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.269+0000 7f396a6b1700 1 -- 172.21.15.98:0/1059040261 wait complete. 2023-08-22T00:21:46.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:21:46.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.403+0000 7faf68a56700 1 Processor -- start 2023-08-22T00:21:46.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.403+0000 7faf68a56700 1 -- start start 2023-08-22T00:21:46.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf68a56700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf64068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf68a56700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640a8c70 con 0x7faf64067600 2023-08-22T00:21:46.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf68a56700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64068210 con 0x7faf64069210 2023-08-22T00:21:46.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf68a56700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640a86f0 con 0x7faf64154f60 2023-08-22T00:21:46.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf62d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7faf64067600 0x7faf640a9100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48866/0 (socket says 172.21.15.98:48866) 2023-08-22T00:21:46.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf62d9d700 1 -- 172.21.15.98:0/3343589153 learned_addr learned my addr 172.21.15.98:0/3343589153 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6259c700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf64068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415274130 0 0) 0x7faf640a8c70 con 0x7faf64067600 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c0033f0 con 0x7faf64067600 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135950885 0 0) 0x7faf4c0033f0 con 0x7faf64067600 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 msgr2=0x7faf64068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf64068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 >> v1:172.21.15.118:6789/0 conn(0x7faf64069210 legacy=0x7faf64066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64069690 con 0x7faf64067600 2023-08-22T00:21:46.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7faf5c0017f0 con 0x7faf64067600 2023-08-22T00:21:46.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 >> v1:172.21.15.98:6789/0 conn(0x7faf64067600 legacy=0x7faf640a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf4c003910 0x7faf4c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf4c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf4c0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640a86f0 con 0x7faf4c004690 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00b9c0 con 0x7faf4c003910 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.404+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00bb80 con 0x7faf64154f60 2023-08-22T00:21:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf4c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf62d9d700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf4c0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf6259c700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf4c003910 0x7faf4c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 -- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 msgr2=0x7faf4c0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf64154f60 0x7faf4c0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 -- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf4c003910 msgr2=0x7faf4c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf4c003910 0x7faf4c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 -- 172.21.15.98:0/3343589153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0033f0 con 0x7faf4c004690 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf61d9b700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf4c004b10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7faf58001700 tx=0x7faf58007bb0).ready entity=mon.0 client_cookie=53e9eacdf4c6a638 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007020 con 0x7faf4c004690 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58007180 con 0x7faf4c004690 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.405+0000 7faf6159a700 1 -- 172.21.15.98:0/3343589153 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007500 con 0x7faf4c004690 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 -- 172.21.15.98:0/3343589153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 msgr2=0x7faf4c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 --2- 172.21.15.98:0/3343589153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf4c004b10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7faf58001700 tx=0x7faf58007bb0).stop 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf62d9d700 1 -- 172.21.15.98:0/3343589153 reap_dead start 2023-08-22T00:21:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 -- 172.21.15.98:0/3343589153 shutdown_connections 2023-08-22T00:21:46.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 -- 172.21.15.98:0/3343589153 >> 172.21.15.98:0/3343589153 conn(0x7faf640c5dd0 msgr2=0x7faf64068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:46.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 -- 172.21.15.98:0/3343589153 shutdown_connections 2023-08-22T00:21:46.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.406+0000 7faf68a56700 1 -- 172.21.15.98:0/3343589153 wait complete. 2023-08-22T00:21:46.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.407+0000 7faf68a56700 1 Processor -- start 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.407+0000 7faf68a56700 1 -- start start 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 0x7faf64149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf640bf900 0x7faf640bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c8370 con 0x7faf4c004690 2023-08-22T00:21:46.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64063fa0 con 0x7faf640c7ef0 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6414a600 con 0x7faf640bf900 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41914/0 (socket says 172.21.15.98:41914) 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 -- 172.21.15.98:0/2042570468 learned_addr learned my addr 172.21.15.98:0/2042570468 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf62d9d700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf640bf900 0x7faf640bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf61d9b700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 0x7faf64149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 -- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf640bf900 msgr2=0x7faf640bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf640bf900 0x7faf640bfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 -- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 msgr2=0x7faf64149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 0x7faf64149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 -- 172.21.15.98:0/2042570468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640c0250 con 0x7faf4c004690 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf61d9b700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 0x7faf64149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf6259c700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7faf54011a50 tx=0x7faf54009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400f940 con 0x7faf4c004690 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5400faa0 con 0x7faf4c004690 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400fe20 con 0x7faf4c004690 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640641f0 con 0x7faf4c004690 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.408+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640647b0 con 0x7faf4c004690 2023-08-22T00:21:46.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.409+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64047480 con 0x7faf4c004690 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.410+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 34) v1 ==== 75166+0+0 (secure 0 0 0) 0x7faf54014650 con 0x7faf4c004690 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.410+0000 7faf527fc700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 0x7faf440611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.410+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7033+0+0 (secure 0 0 0) 0x7faf5407aca0 con 0x7faf4c004690 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.410+0000 7faf61d9b700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 0x7faf440611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.410+0000 7faf61d9b700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 0x7faf440611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7faf640ae9c0 tx=0x7faf58016000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.414+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf5407f070 con 0x7faf4c004690 2023-08-22T00:21:46.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.575+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf64067c50 con 0x7faf4c004690 2023-08-22T00:21:46.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:46.807+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7faf540788b0 con 0x7faf4c004690 2023-08-22T00:21:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.297+0000 7faf527fc700 1 -- 172.21.15.98:0/2042570468 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf5406f710 con 0x7faf4c004690 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 msgr2=0x7faf440611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 0x7faf440611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7faf640ae9c0 tx=0x7faf58016000).stop 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 msgr2=0x7faf640c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7faf54011a50 tx=0x7faf54009060).stop 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 shutdown_connections 2023-08-22T00:21:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7faf4405ecf0 0x7faf440611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf640bf900 0x7faf640bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf4c004690 0x7faf640c19a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 --2- 172.21.15.98:0/2042570468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf640c7ef0 0x7faf64149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 >> 172.21.15.98:0/2042570468 conn(0x7faf640c5dd0 msgr2=0x7faf64153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 shutdown_connections 2023-08-22T00:21:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.300+0000 7faf68a56700 1 -- 172.21.15.98:0/2042570468 wait complete. 2023-08-22T00:21:47.304 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:21:47.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:21:47.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.440+0000 7fe77a2ae700 1 Processor -- start 2023-08-22T00:21:47.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.440+0000 7fe77a2ae700 1 -- start start 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77a2ae700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe774153c30 0x7fe7740a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77a2ae700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe774154010 0x7fe7740c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77a2ae700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740c38d0 con 0x7fe7740c4e60 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77a2ae700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740aad70 con 0x7fe774153c30 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77a2ae700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740c3bb0 con 0x7fe774154010 2023-08-22T00:21:47.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe774153c30 0x7fe7740a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77884b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe7740c4e60 0x7fe774068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48880/0 (socket says 172.21.15.98:48880) 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe77884b700 1 -- 172.21.15.98:0/2404213127 learned_addr learned my addr 172.21.15.98:0/2404213127 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 -- 172.21.15.98:0/2404213127 >> v2:172.21.15.118:3300/0 conn(0x7fe774154010 msgr2=0x7fe7740c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 --2- 172.21.15.98:0/2404213127 >> v2:172.21.15.118:3300/0 conn(0x7fe774154010 0x7fe7740c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 -- 172.21.15.98:0/2404213127 >> v1:172.21.15.98:6789/0 conn(0x7fe7740c4e60 legacy=0x7fe774068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 -- 172.21.15.98:0/2404213127 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740c3e90 con 0x7fe774153c30 2023-08-22T00:21:47.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe772ffd700 1 -- 172.21.15.98:0/2404213127 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097586779 0 0) 0x7fe7740c38d0 con 0x7fe7740c4e60 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.441+0000 7fe773fff700 1 --2- 172.21.15.98:0/2404213127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774153c30 0x7fe7740a8df0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fe7740aa100 tx=0x7fe768009060).ready entity=mon.0 client_cookie=e6b18d1e0a8ce371 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe772ffd700 1 -- 172.21.15.98:0/2404213127 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800b580 con 0x7fe774153c30 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe772ffd700 1 -- 172.21.15.98:0/2404213127 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800b6e0 con 0x7fe774153c30 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe772ffd700 1 -- 172.21.15.98:0/2404213127 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ba60 con 0x7fe774153c30 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 -- 172.21.15.98:0/2404213127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774153c30 msgr2=0x7fe7740a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/2404213127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774153c30 0x7fe7740a8df0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fe7740aa100 tx=0x7fe768009060).stop 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 -- 172.21.15.98:0/2404213127 shutdown_connections 2023-08-22T00:21:47.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/2404213127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774153c30 0x7fe7740a8df0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/2404213127 >> v2:172.21.15.118:3300/0 conn(0x7fe774154010 0x7fe7740c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:47.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 -- 172.21.15.98:0/2404213127 >> 172.21.15.98:0/2404213127 conn(0x7fe7740c5dd0 msgr2=0x7fe774068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:47.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 -- 172.21.15.98:0/2404213127 shutdown_connections 2023-08-22T00:21:47.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.442+0000 7fe77a2ae700 1 -- 172.21.15.98:0/2404213127 wait complete. 2023-08-22T00:21:47.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.444+0000 7fe77a2ae700 1 Processor -- start 2023-08-22T00:21:47.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.444+0000 7fe77a2ae700 1 -- start start 2023-08-22T00:21:47.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740c4e60 0x7fe774064640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774153c30 0x7fe77414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741501d0 con 0x7fe774154010 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774065880 con 0x7fe774153c30 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77a2ae700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe774064c70 con 0x7fe7740c4e60 2023-08-22T00:21:47.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41940/0 (socket says 172.21.15.98:41940) 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 -- 172.21.15.98:0/831287553 learned_addr learned my addr 172.21.15.98:0/831287553 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe773fff700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740c4e60 0x7fe774064640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 -- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740c4e60 msgr2=0x7fe774064640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740c4e60 0x7fe774064640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe7737fe700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774153c30 0x7fe77414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:47.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 -- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774153c30 msgr2=0x7fe77414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774153c30 0x7fe77414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 -- 172.21.15.98:0/831287553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680092a0 con 0x7fe774154010 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe77884b700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe76c00c810 tx=0x7fe76c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.445+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c005d30 con 0x7fe774154010 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.446+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c007110 con 0x7fe774154010 2023-08-22T00:21:47.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.446+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe774064f50 con 0x7fe774154010 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.446+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0074d0 con 0x7fe774154010 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.446+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe774065510 con 0x7fe774154010 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.447+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774047480 con 0x7fe774154010 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.447+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe76c007880 con 0x7fe774154010 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.447+0000 7fe75bfff700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 0x7fe7600612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:47.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.447+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6595+0+0 (secure 0 0 0) 0x7fe76c07a060 con 0x7fe774154010 2023-08-22T00:21:47.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.447+0000 7fe773fff700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 0x7fe7600612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:47.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.448+0000 7fe773fff700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 0x7fe7600612d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe76800b340 tx=0x7fe768017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:47.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.451+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe76c04b2f0 con 0x7fe774154010 2023-08-22T00:21:47.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:47.613+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7740a80a0 con 0x7fe774154010 2023-08-22T00:21:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.300+0000 7fe75bfff700 1 -- 172.21.15.98:0/831287553 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe76c04e910 con 0x7fe774154010 2023-08-22T00:21:48.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 msgr2=0x7fe7600612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 0x7fe7600612d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe76800b340 tx=0x7fe768017000).stop 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 msgr2=0x7fe774066c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe76c00c810 tx=0x7fe76c007f30).stop 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 shutdown_connections 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76005ee10 0x7fe7600612d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740c4e60 0x7fe774064640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe774154010 0x7fe774066c00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 --2- 172.21.15.98:0/831287553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774153c30 0x7fe77414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 >> 172.21.15.98:0/831287553 conn(0x7fe7740c5dd0 msgr2=0x7fe7740c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:48.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 shutdown_connections 2023-08-22T00:21:48.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.305+0000 7fe77a2ae700 1 -- 172.21.15.98:0/831287553 wait complete. 2023-08-22T00:21:48.309 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:21:48.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:21:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.443+0000 7fc83f047700 1 Processor -- start 2023-08-22T00:21:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.443+0000 7fc83f047700 1 -- start start 2023-08-22T00:21:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83f047700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc8380654d0 0x7fc8380c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83f047700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 0x7fc8380c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83f047700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc838154730 con 0x7fc8381542a0 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83f047700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc838154a10 con 0x7fc8380654d0 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83f047700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838154cf0 con 0x7fc8380658b0 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83cde3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc8380654d0 0x7fc8380c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83cde3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc8380654d0 0x7fc8380c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41956/0 (socket says 172.21.15.98:41956) 2023-08-22T00:21:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83d5e4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc8381542a0 0x7fc838065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48894/0 (socket says 172.21.15.98:48894) 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc83cde3700 1 -- 172.21.15.98:0/1303878566 learned_addr learned my addr 172.21.15.98:0/1303878566 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc837fff700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 0x7fc8380c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc8377fe700 1 -- 172.21.15.98:0/1303878566 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789575997 0 0) 0x7fc838154730 con 0x7fc8381542a0 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.444+0000 7fc8377fe700 1 -- 172.21.15.98:0/1303878566 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8280033f0 con 0x7fc8381542a0 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83cde3700 1 -- 172.21.15.98:0/1303878566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 msgr2=0x7fc8380c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83cde3700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 0x7fc8380c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83cde3700 1 -- 172.21.15.98:0/1303878566 >> v1:172.21.15.98:6789/0 conn(0x7fc8381542a0 legacy=0x7fc838065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83cde3700 1 -- 172.21.15.98:0/1303878566 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838154fd0 con 0x7fc8380654d0 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc837fff700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 0x7fc8380c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83cde3700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380654d0 0x7fc8380c3760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fc82c006fd0 tx=0x7fc82c0090f0).ready entity=mon.0 client_cookie=d042f354f5e23baf server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc8377fe700 1 -- 172.21.15.98:0/1303878566 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00b580 con 0x7fc8380654d0 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc8377fe700 1 -- 172.21.15.98:0/1303878566 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00b6e0 con 0x7fc8380654d0 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc8377fe700 1 -- 172.21.15.98:0/1303878566 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ba60 con 0x7fc8380654d0 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 -- 172.21.15.98:0/1303878566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380654d0 msgr2=0x7fc8380c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380654d0 0x7fc8380c3760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fc82c006fd0 tx=0x7fc82c0090f0).stop 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 -- 172.21.15.98:0/1303878566 shutdown_connections 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380654d0 0x7fc8380c3760 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 --2- 172.21.15.98:0/1303878566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380658b0 0x7fc8380c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 -- 172.21.15.98:0/1303878566 >> 172.21.15.98:0/1303878566 conn(0x7fc8380c7800 msgr2=0x7fc8380c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 -- 172.21.15.98:0/1303878566 shutdown_connections 2023-08-22T00:21:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.445+0000 7fc83f047700 1 -- 172.21.15.98:0/1303878566 wait complete. 2023-08-22T00:21:48.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.447+0000 7fc83f047700 1 Processor -- start 2023-08-22T00:21:48.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.447+0000 7fc83f047700 1 -- start start 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.447+0000 7fc83f047700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380654d0 0x7fc8380a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.447+0000 7fc83f047700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8380c1420 0x7fc838139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838168120 con 0x7fc8380658b0 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380beef0 con 0x7fc8380c1420 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838168320 con 0x7fc8380654d0 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41968/0 (socket says 172.21.15.98:41968) 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 -- 172.21.15.98:0/306571994 learned_addr learned my addr 172.21.15.98:0/306571994 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 -- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380654d0 msgr2=0x7fc8380a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380654d0 0x7fc8380a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 -- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8380c1420 msgr2=0x7fc838139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8380c1420 0x7fc838139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 -- 172.21.15.98:0/306571994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009370 con 0x7fc8380658b0 2023-08-22T00:21:48.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc837fff700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fc824006fd0 tx=0x7fc824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824017070 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240125f0 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc838168600 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824012970 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.448+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380beb80 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.449+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8380bed40 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.450+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc824012d20 con 0x7fc8380658b0 2023-08-22T00:21:48.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.450+0000 7fc834ff9700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 0x7fc81c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.450+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fc824079960 con 0x7fc8380658b0 2023-08-22T00:21:48.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.450+0000 7fc83cde3700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 0x7fc81c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.450+0000 7fc83cde3700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 0x7fc81c0612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc838139b90 tx=0x7fc82c017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.454+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc82404ad90 con 0x7fc8380658b0 2023-08-22T00:21:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.627+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc8380bf0a0 con 0x7fc8380658b0 2023-08-22T00:21:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.630+0000 7fc834ff9700 1 -- 172.21.15.98:0/306571994 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc8380bf0a0 con 0x7fc8380658b0 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 msgr2=0x7fc81c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 0x7fc81c0612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc838139b90 tx=0x7fc82c017000).stop 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 msgr2=0x7fc838138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fc824006fd0 tx=0x7fc824008040).stop 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 shutdown_connections 2023-08-22T00:21:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc81c05ee10 0x7fc81c0612d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8380654d0 0x7fc8380a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:48.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8380c1420 0x7fc838139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:48.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 --2- 172.21.15.98:0/306571994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8380658b0 0x7fc838138b90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 >> 172.21.15.98:0/306571994 conn(0x7fc8380c7800 msgr2=0x7fc838153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:48.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 shutdown_connections 2023-08-22T00:21:48.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.632+0000 7fc83f047700 1 -- 172.21.15.98:0/306571994 wait complete. 2023-08-22T00:21:48.645 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:21:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.761+0000 7fb93c211700 1 Processor -- start 2023-08-22T00:21:48.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.761+0000 7fb93c211700 1 -- start start 2023-08-22T00:21:48.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.762+0000 7fb93c211700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb934066d00 0x7fb934068800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.762+0000 7fb93c211700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.762+0000 7fb93c211700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9341530b0 con 0x7fb934068420 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.762+0000 7fb93c211700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340c33b0 con 0x7fb934066d00 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.762+0000 7fb93c211700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934152890 con 0x7fb9340be880 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:37642/0 (socket says 172.21.15.98:37642) 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 -- 172.21.15.98:0/1092640424 learned_addr learned my addr 172.21.15.98:0/1092640424 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:48.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb9397ac700 1 --2- 172.21.15.98:0/1092640424 >> v2:172.21.15.118:3300/0 conn(0x7fb934066d00 0x7fb934068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 -- 172.21.15.98:0/1092640424 >> v2:172.21.15.118:3300/0 conn(0x7fb934066d00 msgr2=0x7fb934068800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 --2- 172.21.15.98:0/1092640424 >> v2:172.21.15.118:3300/0 conn(0x7fb934066d00 0x7fb934068800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 -- 172.21.15.98:0/1092640424 >> v1:172.21.15.118:6789/0 conn(0x7fb934068420 legacy=0x7fb934152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 -- 172.21.15.98:0/1092640424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340bf200 con 0x7fb9340be880 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb93a7ae700 1 --2- 172.21.15.98:0/1092640424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb92c009f20 tx=0x7fb92c009840).ready entity=mon.2 client_cookie=1cca2a0e45f5f2e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb938fab700 1 -- 172.21.15.98:0/1092640424 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00e070 con 0x7fb9340be880 2023-08-22T00:21:48.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb938fab700 1 -- 172.21.15.98:0/1092640424 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c00b9d0 con 0x7fb9340be880 2023-08-22T00:21:48.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.763+0000 7fb938fab700 1 -- 172.21.15.98:0/1092640424 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00bd50 con 0x7fb9340be880 2023-08-22T00:21:48.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 -- 172.21.15.98:0/1092640424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 msgr2=0x7fb9340bed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 --2- 172.21.15.98:0/1092640424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb92c009f20 tx=0x7fb92c009840).stop 2023-08-22T00:21:48.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 -- 172.21.15.98:0/1092640424 shutdown_connections 2023-08-22T00:21:48.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 --2- 172.21.15.98:0/1092640424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9340bed10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 --2- 172.21.15.98:0/1092640424 >> v2:172.21.15.118:3300/0 conn(0x7fb934066d00 0x7fb934068800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 -- 172.21.15.98:0/1092640424 >> 172.21.15.98:0/1092640424 conn(0x7fb9340c5e80 msgr2=0x7fb9340661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 -- 172.21.15.98:0/1092640424 shutdown_connections 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.764+0000 7fb93c211700 1 -- 172.21.15.98:0/1092640424 wait complete. 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.765+0000 7fb93c211700 1 Processor -- start 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.765+0000 7fb93c211700 1 -- start start 2023-08-22T00:21:48.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb934068420 0x7fb9340c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9341654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340c0e20 con 0x7fb934066d00 2023-08-22T00:21:48.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340ae5c0 con 0x7fb934068420 2023-08-22T00:21:48.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93c211700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934165db0 con 0x7fb9340be880 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41980/0 (socket says 172.21.15.98:41980) 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 -- 172.21.15.98:0/244398180 learned_addr learned my addr 172.21.15.98:0/244398180 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb93a7ae700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9341654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb9397ac700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb934068420 0x7fb9340c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 -- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 msgr2=0x7fb9341654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9341654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 -- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb934068420 msgr2=0x7fb9340c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb934068420 0x7fb9340c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 -- 172.21.15.98:0/244398180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c009ae0 con 0x7fb934066d00 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.766+0000 7fb939fad700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fb92400c4c0 tx=0x7fb924007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.767+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400ce70 con 0x7fb934066d00 2023-08-22T00:21:48.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.767+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924001e90 con 0x7fb934066d00 2023-08-22T00:21:48.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.767+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934166090 con 0x7fb934066d00 2023-08-22T00:21:48.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.767+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924007250 con 0x7fb934066d00 2023-08-22T00:21:48.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.767+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9340c17a0 con 0x7fb934066d00 2023-08-22T00:21:48.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.768+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340c1100 con 0x7fb934066d00 2023-08-22T00:21:48.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.768+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb9240066a0 con 0x7fb934066d00 2023-08-22T00:21:48.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.768+0000 7fb929ffb700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 0x7fb9180612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:48.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.769+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fb924079700 con 0x7fb934066d00 2023-08-22T00:21:48.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.769+0000 7fb9397ac700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 0x7fb9180612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:48.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.769+0000 7fb9397ac700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 0x7fb9180612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb9340c8060 tx=0x7fb930009060).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:48.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.772+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb92404ab30 con 0x7fb934066d00 2023-08-22T00:21:48.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.933+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb934152af0 con 0x7fb934066d00 2023-08-22T00:21:48.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.937+0000 7fb929ffb700 1 -- 172.21.15.98:0/244398180 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb92404e150 con 0x7fb934066d00 2023-08-22T00:21:48.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 msgr2=0x7fb9180612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 0x7fb9180612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb9340c8060 tx=0x7fb930009060).stop 2023-08-22T00:21:48.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 msgr2=0x7fb9340ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fb92400c4c0 tx=0x7fb924007e00).stop 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 shutdown_connections 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb91805ee10 0x7fb9180612d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9340be880 0x7fb9341654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934066d00 0x7fb9340ae0d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 --2- 172.21.15.98:0/244398180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb934068420 0x7fb9340c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:48.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 >> 172.21.15.98:0/244398180 conn(0x7fb9340c5e80 msgr2=0x7fb93414e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:48.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 shutdown_connections 2023-08-22T00:21:48.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:48.939+0000 7fb93c211700 1 -- 172.21.15.98:0/244398180 wait complete. 2023-08-22T00:21:48.952 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-22T00:21:49.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.066+0000 7fe56bc14700 1 Processor -- start 2023-08-22T00:21:49.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.066+0000 7fe56bc14700 1 -- start start 2023-08-22T00:21:49.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.067+0000 7fe56bc14700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564151d60 0x7fe564155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.067+0000 7fe56bc14700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe564066620 0x7fe5640643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.067+0000 7fe56bc14700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe564158bf0 con 0x7fe5640a6e50 2023-08-22T00:21:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.067+0000 7fe56bc14700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe564157d90 con 0x7fe564066620 2023-08-22T00:21:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.067+0000 7fe56bc14700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe564157fe0 con 0x7fe564151d60 2023-08-22T00:21:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe564066620 0x7fe5640643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe564066620 0x7fe5640643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41988/0 (socket says 172.21.15.98:41988) 2023-08-22T00:21:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5691af700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe5640a6e50 0x7fe564065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48906/0 (socket says 172.21.15.98:48906) 2023-08-22T00:21:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 -- 172.21.15.98:0/521408631 learned_addr learned my addr 172.21.15.98:0/521408631 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5699b0700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564151d60 0x7fe564155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 -- 172.21.15.98:0/521408631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564151d60 msgr2=0x7fe564155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564151d60 0x7fe564155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 -- 172.21.15.98:0/521408631 >> v1:172.21.15.98:6789/0 conn(0x7fe5640a6e50 legacy=0x7fe564065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 -- 172.21.15.98:0/521408631 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5641582c0 con 0x7fe564066620 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5689ae700 1 -- 172.21.15.98:0/521408631 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603995773 0 0) 0x7fe564158bf0 con 0x7fe5640a6e50 2023-08-22T00:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe56a1b1700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe564066620 0x7fe5640643c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fe55c009f20 tx=0x7fe55c009840).ready entity=mon.0 client_cookie=e39bdbaf8c7c0ad6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:49.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5689ae700 1 -- 172.21.15.98:0/521408631 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00e070 con 0x7fe564066620 2023-08-22T00:21:49.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5689ae700 1 -- 172.21.15.98:0/521408631 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00ba80 con 0x7fe564066620 2023-08-22T00:21:49.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.068+0000 7fe5689ae700 1 -- 172.21.15.98:0/521408631 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00be00 con 0x7fe564066620 2023-08-22T00:21:49.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 -- 172.21.15.98:0/521408631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe564066620 msgr2=0x7fe5640643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe564066620 0x7fe5640643c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fe55c009f20 tx=0x7fe55c009840).stop 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 -- 172.21.15.98:0/521408631 shutdown_connections 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe564066620 0x7fe5640643c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 --2- 172.21.15.98:0/521408631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564151d60 0x7fe564155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 -- 172.21.15.98:0/521408631 >> 172.21.15.98:0/521408631 conn(0x7fe56406a980 msgr2=0x7fe5640c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 -- 172.21.15.98:0/521408631 shutdown_connections 2023-08-22T00:21:49.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.069+0000 7fe56bc14700 1 -- 172.21.15.98:0/521408631 wait complete. 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.070+0000 7fe56bc14700 1 Processor -- start 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.070+0000 7fe56bc14700 1 -- start start 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564066620 0x7fe5640aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe564151d60 0x7fe5640c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640ad6f0 con 0x7fe5640a6e50 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56413fa10 con 0x7fe564151d60 2023-08-22T00:21:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56414cb20 con 0x7fe564066620 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41992/0 (socket says 172.21.15.98:41992) 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 -- 172.21.15.98:0/2241010176 learned_addr learned my addr 172.21.15.98:0/2241010176 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5699b0700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564066620 0x7fe5640aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56a1b1700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe564151d60 0x7fe5640c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 -- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564066620 msgr2=0x7fe5640aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564066620 0x7fe5640aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 -- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe564151d60 msgr2=0x7fe5640c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe564151d60 0x7fe5640c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 -- 172.21.15.98:0/2241010176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c009ae0 con 0x7fe5640a6e50 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe5691af700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fe56000c510 tx=0x7fe560007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600072e0 con 0x7fe5640a6e50 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560007440 con 0x7fe5640a6e50 2023-08-22T00:21:49.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5640a6640 con 0x7fe5640a6e50 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.071+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600058f0 con 0x7fe5640a6e50 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.072+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5640a62d0 con 0x7fe5640a6e50 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.072+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640a6130 con 0x7fe5640a6e50 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.073+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe560005ca0 con 0x7fe5640a6e50 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.073+0000 7fe559ffb700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 0x7fe5480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:49.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.073+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fe560079700 con 0x7fe5640a6e50 2023-08-22T00:21:49.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.073+0000 7fe5699b0700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 0x7fe5480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:49.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.073+0000 7fe5699b0700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 0x7fe5480612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe554006fd0 tx=0x7fe554008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:49.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.077+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5640a6130 con 0x7fe5640a6e50 2023-08-22T00:21:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:49.302+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fe5640a6130 con 0x7fe5640a6e50 2023-08-22T00:21:50.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.301+0000 7fe559ffb700 1 -- 172.21.15.98:0/2241010176 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v572) v1 ==== 156+0+0 (secure 0 0 0) 0x7fe5640a6130 con 0x7fe5640a6e50 2023-08-22T00:21:50.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 msgr2=0x7fe5480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:50.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 0x7fe5480612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe554006fd0 tx=0x7fe554008040).stop 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 msgr2=0x7fe56413f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fe56000c510 tx=0x7fe560007c60).stop 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 shutdown_connections 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe54805ee10 0x7fe5480612d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe564066620 0x7fe5640aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe564151d60 0x7fe5640c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 --2- 172.21.15.98:0/2241010176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5640a6e50 0x7fe56413f520 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 >> 172.21.15.98:0/2241010176 conn(0x7fe56406a980 msgr2=0x7fe564152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:50.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 shutdown_connections 2023-08-22T00:21:50.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.304+0000 7fe56bc14700 1 -- 172.21.15.98:0/2241010176 wait complete. 2023-08-22T00:21:50.319 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-08-22T00:21:50.320 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-08-22T00:21:50.320 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:21:50.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-22T00:21:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.442+0000 7f9de8b7e700 1 Processor -- start 2023-08-22T00:21:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.442+0000 7f9de8b7e700 1 -- start start 2023-08-22T00:21:50.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de8b7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de4153b60 0x7f9de4068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de8b7e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9de4153f40 0x7f9de4069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de8b7e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40a8410 con 0x7f9de40a9140 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de8b7e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de4069720 con 0x7f9de4153f40 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de8b7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40a8cb0 con 0x7f9de4153b60 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9de4153f40 0x7f9de4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9de4153f40 0x7f9de4069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38874/0 (socket says 172.21.15.98:38874) 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 -- 172.21.15.98:0/2210989680 learned_addr learned my addr 172.21.15.98:0/2210989680 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de259c700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de4153b60 0x7f9de4068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 -- 172.21.15.98:0/2210989680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de4153b60 msgr2=0x7f9de4068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de4153b60 0x7f9de4068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 -- 172.21.15.98:0/2210989680 >> v1:172.21.15.118:6789/0 conn(0x7f9de40a9140 legacy=0x7f9de4157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.443+0000 7f9de1d9b700 1 -- 172.21.15.98:0/2210989680 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de41586a0 con 0x7f9de4153f40 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de1d9b700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153f40 0x7f9de4069230 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f9dd4009830 tx=0x7f9dd40090f0).ready entity=mon.0 client_cookie=1e9c3678c9080b07 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de159a700 1 -- 172.21.15.98:0/2210989680 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400b600 con 0x7f9de4153f40 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de159a700 1 -- 172.21.15.98:0/2210989680 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd400b760 con 0x7f9de4153f40 2023-08-22T00:21:50.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de159a700 1 -- 172.21.15.98:0/2210989680 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400bae0 con 0x7f9de4153f40 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 -- 172.21.15.98:0/2210989680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153f40 msgr2=0x7f9de4069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153f40 0x7f9de4069230 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f9dd4009830 tx=0x7f9dd40090f0).stop 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 -- 172.21.15.98:0/2210989680 shutdown_connections 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de4153b60 0x7f9de4068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/2210989680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153f40 0x7f9de4069230 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 -- 172.21.15.98:0/2210989680 >> 172.21.15.98:0/2210989680 conn(0x7f9de40c5dc0 msgr2=0x7f9de4068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 -- 172.21.15.98:0/2210989680 shutdown_connections 2023-08-22T00:21:50.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.444+0000 7f9de8b7e700 1 -- 172.21.15.98:0/2210989680 wait complete. 2023-08-22T00:21:50.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.445+0000 7f9de8b7e700 1 Processor -- start 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.445+0000 7f9de8b7e700 1 -- start start 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de40a9140 0x7f9de4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 0x7f9de40c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40c0870 con 0x7f9de4153b60 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40bfc80 con 0x7f9de4153f40 2023-08-22T00:21:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de8b7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40bff40 con 0x7f9de40a9140 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38888/0 (socket says 172.21.15.98:38888) 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de1d9b700 1 -- 172.21.15.98:0/4182909250 learned_addr learned my addr 172.21.15.98:0/4182909250 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de259c700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de40a9140 0x7f9de4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.446+0000 7f9de2d9d700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 0x7f9de40c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 -- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de40a9140 msgr2=0x7f9de4156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de40a9140 0x7f9de4156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 -- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 msgr2=0x7f9de40c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 0x7f9de40c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 -- 172.21.15.98:0/4182909250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4009370 con 0x7f9de4153b60 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de2d9d700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 0x7f9de40c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de1d9b700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f9dd4011000 tx=0x7f9dd4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400b8d0 con 0x7f9de4153b60 2023-08-22T00:21:50.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd400ba30 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de40c0220 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd401c650 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.447+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de40bf900 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.448+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de40c09e0 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.448+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9dd401ca40 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.449+0000 7f9dd27fc700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 0x7f9dc40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.449+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f9dd407ba60 con 0x7f9de4153b60 2023-08-22T00:21:50.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.449+0000 7f9de259c700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 0x7f9dc40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:50.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.449+0000 7f9de259c700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 0x7f9dc40612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9dd800bbc0 tx=0x7f9dd8008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:50.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.453+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9dd404ce90 con 0x7f9de4153b60 2023-08-22T00:21:50.619 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:21:50.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:21:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:50.680+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f9de4047480 con 0x7f9de4153b60 2023-08-22T00:21:51.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.303+0000 7f9dd27fc700 1 -- 172.21.15.98:0/4182909250 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v573) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9dd40504b0 con 0x7f9de4153b60 2023-08-22T00:21:51.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 msgr2=0x7f9dc40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 0x7f9dc40612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9dd800bbc0 tx=0x7f9dd8008040).stop 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 msgr2=0x7f9de40c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f9dd4011000 tx=0x7f9dd4017000).stop 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 shutdown_connections 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9dc405ee10 0x7f9dc40612d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9de40a9140 0x7f9de4156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9de4153f40 0x7f9de40c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 --2- 172.21.15.98:0/4182909250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9de4153b60 0x7f9de40c15d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 >> 172.21.15.98:0/4182909250 conn(0x7f9de40c5dc0 msgr2=0x7f9de41514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:51.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 shutdown_connections 2023-08-22T00:21:51.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.305+0000 7f9de8b7e700 1 -- 172.21.15.98:0/4182909250 wait complete. 2023-08-22T00:21:51.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:21:51.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.486+0000 7fd7cbd70700 1 Processor -- start 2023-08-22T00:21:51.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.487+0000 7fd7cbd70700 1 -- start start 2023-08-22T00:21:51.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7cbd70700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd7c4151e10 0x7fd7c40a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7cbd70700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd7c40a9ad0 0x7fd7c40c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7cbd70700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40c3d60 con 0x7fd7c40c2950 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7cbd70700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40a9f50 con 0x7fd7c4151e10 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7cbd70700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40c3150 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd7c4151e10 0x7fd7c40a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd7c4151e10 0x7fd7c40a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38904/0 (socket says 172.21.15.98:38904) 2023-08-22T00:21:51.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/119669224 learned_addr learned my addr 172.21.15.98:0/119669224 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c930b700 1 --2- 172.21.15.98:0/119669224 >> v2:172.21.15.118:3300/0 conn(0x7fd7c40a9ad0 0x7fd7c40c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/119669224 >> v2:172.21.15.118:3300/0 conn(0x7fd7c40a9ad0 msgr2=0x7fd7c40c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 --2- 172.21.15.98:0/119669224 >> v2:172.21.15.118:3300/0 conn(0x7fd7c40a9ad0 0x7fd7c40c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/119669224 >> v1:172.21.15.118:6789/0 conn(0x7fd7c40c2950 legacy=0x7fd7c4066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/119669224 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40c3430 con 0x7fd7c4151e10 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c9b0c700 1 --2- 172.21.15.98:0/119669224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c4151e10 0x7fd7c40a95e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fd7c4068b20 tx=0x7fd7b40090f0).ready entity=mon.0 client_cookie=99ff18f68d85c442 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c8b0a700 1 -- 172.21.15.98:0/119669224 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400b5a0 con 0x7fd7c4151e10 2023-08-22T00:21:51.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c8b0a700 1 -- 172.21.15.98:0/119669224 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400b700 con 0x7fd7c4151e10 2023-08-22T00:21:51.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.488+0000 7fd7c8b0a700 1 -- 172.21.15.98:0/119669224 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400baa0 con 0x7fd7c4151e10 2023-08-22T00:21:51.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 -- 172.21.15.98:0/119669224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c4151e10 msgr2=0x7fd7c40a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/119669224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c4151e10 0x7fd7c40a95e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fd7c4068b20 tx=0x7fd7b40090f0).stop 2023-08-22T00:21:51.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 -- 172.21.15.98:0/119669224 shutdown_connections 2023-08-22T00:21:51.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/119669224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c4151e10 0x7fd7c40a95e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/119669224 >> v2:172.21.15.118:3300/0 conn(0x7fd7c40a9ad0 0x7fd7c40c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 -- 172.21.15.98:0/119669224 >> 172.21.15.98:0/119669224 conn(0x7fd7c40c7820 msgr2=0x7fd7c40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 -- 172.21.15.98:0/119669224 shutdown_connections 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.489+0000 7fd7cbd70700 1 -- 172.21.15.98:0/119669224 wait complete. 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.490+0000 7fd7cbd70700 1 Processor -- start 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.490+0000 7fd7cbd70700 1 -- start start 2023-08-22T00:21:51.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 0x7fd7c40bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7c4151e10 0x7fd7c4164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40ad160 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40bf0e0 con 0x7fd7c40c2950 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7cbd70700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40bf340 con 0x7fd7c4151e10 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38920/0 (socket says 172.21.15.98:38920) 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/3724768334 learned_addr learned my addr 172.21.15.98:0/3724768334 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c930b700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 0x7fd7c40bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7ca30d700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7c4151e10 0x7fd7c4164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7c4151e10 msgr2=0x7fd7c4164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7c4151e10 0x7fd7c4164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 msgr2=0x7fd7c40bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 0x7fd7c40bebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 -- 172.21.15.98:0/3724768334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009370 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c930b700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 0x7fd7c40bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.491+0000 7fd7c9b0c700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fd7c4068a80 tx=0x7fd7b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.492+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400b870 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.492+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400b9d0 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.492+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c40bf620 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.492+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40246c0 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.492+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c40bfbe0 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.493+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c40aa120 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.493+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd7b4021070 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.493+0000 7fd7b9ffb700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 0x7fd7a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.493+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fd7b407b9e0 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.493+0000 7fd7c930b700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 0x7fd7a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.494+0000 7fd7c930b700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 0x7fd7a80612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd7c0006fd0 tx=0x7fd7c0008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.498+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7b404ce10 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.658+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd7c40c01f0 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.662+0000 7fd7b9ffb700 1 -- 172.21.15.98:0/3724768334 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7b4050430 con 0x7fd7c40a9ad0 2023-08-22T00:21:51.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 msgr2=0x7fd7a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 0x7fd7a80612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd7c0006fd0 tx=0x7fd7c0008040).stop 2023-08-22T00:21:51.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 msgr2=0x7fd7c40acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fd7c4068a80 tx=0x7fd7b4015000).stop 2023-08-22T00:21:51.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 shutdown_connections 2023-08-22T00:21:51.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd7a805ee10 0x7fd7a80612d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7c4151e10 0x7fd7c4164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c40a9ad0 0x7fd7c40acc70 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 --2- 172.21.15.98:0/3724768334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c40c2950 0x7fd7c40bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 >> 172.21.15.98:0/3724768334 conn(0x7fd7c40c7820 msgr2=0x7fd7c4063170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:51.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 shutdown_connections 2023-08-22T00:21:51.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.664+0000 7fd7cbd70700 1 -- 172.21.15.98:0/3724768334 wait complete. 2023-08-22T00:21:51.677 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:21:51.678 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:51.720 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:21:51.774 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:21:51.775 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:21:51.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.890+0000 7fcf55dc0700 1 Processor -- start 2023-08-22T00:21:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.890+0000 7fcf55dc0700 1 -- start start 2023-08-22T00:21:51.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf55dc0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf500bd870 0x7fcf500c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf55dc0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 0x7fcf50066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf55dc0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500bd3e0 con 0x7fcf50150e40 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf55dc0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500bd0c0 con 0x7fcf500bd870 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf55dc0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf50066830 con 0x7fcf50065f10 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf500bd870 0x7fcf500c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf500bd870 0x7fcf500c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38932/0 (socket says 172.21.15.98:38932) 2023-08-22T00:21:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 -- 172.21.15.98:0/3090044532 learned_addr learned my addr 172.21.15.98:0/3090044532 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4f7fe700 1 --1- 172.21.15.98:0/3090044532 >> v1:172.21.15.98:6789/0 conn(0x7fcf50150e40 0x7fcf500a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42632/0 (socket says 172.21.15.98:42632) 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4ffff700 1 --2- 172.21.15.98:0/3090044532 >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 0x7fcf50066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 -- 172.21.15.98:0/3090044532 >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 msgr2=0x7fcf50066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 --2- 172.21.15.98:0/3090044532 >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 0x7fcf50066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 -- 172.21.15.98:0/3090044532 >> v1:172.21.15.98:6789/0 conn(0x7fcf50150e40 legacy=0x7fcf500a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4e7fc700 1 -- 172.21.15.98:0/3090044532 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212397541 0 0) 0x7fcf500bd3e0 con 0x7fcf50150e40 2023-08-22T00:21:51.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.891+0000 7fcf4effd700 1 -- 172.21.15.98:0/3090044532 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500c3bb0 con 0x7fcf500bd870 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf4ffff700 1 --2- 172.21.15.98:0/3090044532 >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 0x7fcf50066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf4effd700 1 --2- 172.21.15.98:0/3090044532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf500bd870 0x7fcf500c2050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fcf500c35e0 tx=0x7fcf4400b3b0).ready entity=mon.0 client_cookie=2f86806f909ebb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf4e7fc700 1 -- 172.21.15.98:0/3090044532 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400db10 con 0x7fcf500bd870 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf4e7fc700 1 -- 172.21.15.98:0/3090044532 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4400dc70 con 0x7fcf500bd870 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf4e7fc700 1 -- 172.21.15.98:0/3090044532 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44010470 con 0x7fcf500bd870 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3090044532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf500bd870 msgr2=0x7fcf500c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3090044532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf500bd870 0x7fcf500c2050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fcf500c35e0 tx=0x7fcf4400b3b0).stop 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3090044532 shutdown_connections 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3090044532 >> v2:172.21.15.118:3300/0 conn(0x7fcf50065f10 0x7fcf50066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3090044532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf500bd870 0x7fcf500c2050 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3090044532 >> 172.21.15.98:0/3090044532 conn(0x7fcf5006a980 msgr2=0x7fcf500c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3090044532 shutdown_connections 2023-08-22T00:21:51.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.892+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3090044532 wait complete. 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 Processor -- start 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 -- start start 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf50065f10 0x7fcf500ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 0x7fcf500aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500ab120 con 0x7fcf50150e40 2023-08-22T00:21:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50062fa0 con 0x7fcf50065f10 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf55dc0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500acb40 con 0x7fcf500bd870 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.894+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38934/0 (socket says 172.21.15.98:38934) 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 -- 172.21.15.98:0/3712322474 learned_addr learned my addr 172.21.15.98:0/3712322474 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4f7fe700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf50065f10 0x7fcf500ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4effd700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 0x7fcf500aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 -- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 msgr2=0x7fcf500aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 0x7fcf500aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 -- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf50065f10 msgr2=0x7fcf500ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf50065f10 0x7fcf500ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 -- 172.21.15.98:0/3712322474 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4400b610 con 0x7fcf50150e40 2023-08-22T00:21:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4effd700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 0x7fcf500aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf4ffff700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fcf4800a380 tx=0x7fcf48007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800ae10 con 0x7fcf50150e40 2023-08-22T00:21:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4800d650 con 0x7fcf50150e40 2023-08-22T00:21:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500acdc0 con 0x7fcf50150e40 2023-08-22T00:21:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800d9d0 con 0x7fcf50150e40 2023-08-22T00:21:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.895+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500ad400 con 0x7fcf50150e40 2023-08-22T00:21:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.896+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50047480 con 0x7fcf50150e40 2023-08-22T00:21:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.896+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcf48013070 con 0x7fcf50150e40 2023-08-22T00:21:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.897+0000 7fcf377fe700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 0x7fcf3c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.897+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fcf4807a5b0 con 0x7fcf50150e40 2023-08-22T00:21:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.897+0000 7fcf4f7fe700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 0x7fcf3c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.897+0000 7fcf4f7fe700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 0x7fcf3c0612d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcf50064b50 tx=0x7fcf40007c00).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:51.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:51.901+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf4804b9e0 con 0x7fcf50150e40 2023-08-22T00:21:52.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.098+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf50066610 con 0x7fcf50150e40 2023-08-22T00:21:52.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.099+0000 7fcf377fe700 1 -- 172.21.15.98:0/3712322474 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fcf4801b020 con 0x7fcf50150e40 2023-08-22T00:21:52.101 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:52.101 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3019650419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3019650419},{"type":"v1","addr":"172.21.15.98:6837","nonce":3019650419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5546,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/715747137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":715747137},{"type":"v1","addr":"172.21.15.118:6834","nonce":715747137}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3915679045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3915679045},{"type":"v1","addr":"172.21.15.118:6835","nonce":3915679045}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/372015517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":372015517},{"type":"v1","addr":"172.21.15.98:6836","nonce":372015517}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[]} 2023-08-22T00:21:52.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.100+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 msgr2=0x7fcf3c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:52.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.100+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 0x7fcf3c0612d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcf50064b50 tx=0x7fcf40007c00).stop 2023-08-22T00:21:52.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.100+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 msgr2=0x7fcf500aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:52.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.100+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fcf4800a380 tx=0x7fcf48007900).stop 2023-08-22T00:21:52.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 shutdown_connections 2023-08-22T00:21:52.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf50150e40 0x7fcf500aac30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf50065f10 0x7fcf500ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcf3c05ee10 0x7fcf3c0612d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 --2- 172.21.15.98:0/3712322474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf500bd870 0x7fcf500aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 >> 172.21.15.98:0/3712322474 conn(0x7fcf5006a980 msgr2=0x7fcf5014fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:52.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 shutdown_connections 2023-08-22T00:21:52.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.101+0000 7fcf55dc0700 1 -- 172.21.15.98:0/3712322474 wait complete. 2023-08-22T00:21:52.108 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 32 2023-08-22T00:21:52.114 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:21:52.114 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:21:52.115 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:21:52.115 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:52.116 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:21:52.116 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:21:52.117 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:21:52.117 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:52.118 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:21:52.118 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:21:52.119 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:21:52.119 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:52.119 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:21:52.120 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:21:52.120 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:21:52.121 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:21:52.125 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:21:52.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:21:52.127 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:21:52.128 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:21:52.131 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:21:52.132 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:21:52.133 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:21:52.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:21:52.167 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:21:52.168 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:52.168 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:21:52.169 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:52.175 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:21:52.176 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:52.177 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:21:52.177 DEBUG:teuthology.parallel:result is None 2023-08-22T00:21:52.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:21:52.242 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:21:52.243 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:21:52.264 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:21:52.265 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:21:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.307+0000 7ff749abb700 1 Processor -- start 2023-08-22T00:21:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.307+0000 7ff749abb700 1 -- start start 2023-08-22T00:21:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff749abb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 0x7ff7440c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff749abb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff7440645b0 0x7ff7440c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff749abb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff744153d80 con 0x7ff744150390 2023-08-22T00:21:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff749abb700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff744154be0 con 0x7ff7440645b0 2023-08-22T00:21:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff749abb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff744153fd0 con 0x7ff74414ffb0 2023-08-22T00:21:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff7440645b0 0x7ff7440c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff7440645b0 0x7ff7440c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38976/0 (socket says 172.21.15.98:38976) 2023-08-22T00:21:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 -- 172.21.15.98:0/2481000736 learned_addr learned my addr 172.21.15.98:0/2481000736 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff7437fe700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 0x7ff7440c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 -- 172.21.15.98:0/2481000736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 msgr2=0x7ff7440c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 0x7ff7440c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 -- 172.21.15.98:0/2481000736 >> v1:172.21.15.118:6789/0 conn(0x7ff744150390 legacy=0x7ff744063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff743fff700 1 -- 172.21.15.98:0/2481000736 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7441542b0 con 0x7ff7440645b0 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.308+0000 7ff7437fe700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 0x7ff7440c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:52.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff743fff700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7440645b0 0x7ff7440c3420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7ff73c009f20 tx=0x7ff73c009840).ready entity=mon.0 client_cookie=9c848cbd1257902 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:52.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff7427fc700 1 -- 172.21.15.98:0/2481000736 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00ba40 con 0x7ff7440645b0 2023-08-22T00:21:52.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff7427fc700 1 -- 172.21.15.98:0/2481000736 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c00bba0 con 0x7ff7440645b0 2023-08-22T00:21:52.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff7427fc700 1 -- 172.21.15.98:0/2481000736 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c012480 con 0x7ff7440645b0 2023-08-22T00:21:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 -- 172.21.15.98:0/2481000736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7440645b0 msgr2=0x7ff7440c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7440645b0 0x7ff7440c3420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7ff73c009f20 tx=0x7ff73c009840).stop 2023-08-22T00:21:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 -- 172.21.15.98:0/2481000736 shutdown_connections 2023-08-22T00:21:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7440645b0 0x7ff7440c3420 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 --2- 172.21.15.98:0/2481000736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74414ffb0 0x7ff7440c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 -- 172.21.15.98:0/2481000736 >> 172.21.15.98:0/2481000736 conn(0x7ff744069680 msgr2=0x7ff744069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 -- 172.21.15.98:0/2481000736 shutdown_connections 2023-08-22T00:21:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.309+0000 7ff749abb700 1 -- 172.21.15.98:0/2481000736 wait complete. 2023-08-22T00:21:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 Processor -- start 2023-08-22T00:21:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 -- start start 2023-08-22T00:21:52.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7440645b0 0x7ff744146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff744150390 0x7ff744163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441643a0 con 0x7ff74414ffb0 2023-08-22T00:21:52.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff744153110 con 0x7ff7440645b0 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff749abb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441533f0 con 0x7ff744150390 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff742ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff742ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38978/0 (socket says 172.21.15.98:38978) 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.311+0000 7ff742ffd700 1 -- 172.21.15.98:0/337830839 learned_addr learned my addr 172.21.15.98:0/337830839 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff743fff700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff744150390 0x7ff744163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff7437fe700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7440645b0 0x7ff744146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 -- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff744150390 msgr2=0x7ff744163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff744150390 0x7ff744163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 -- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7440645b0 msgr2=0x7ff744146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7440645b0 0x7ff744146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 -- 172.21.15.98:0/337830839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009ae0 con 0x7ff74414ffb0 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff742ffd700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff73800c490 tx=0x7ff738007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:52.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738007020 con 0x7ff74414ffb0 2023-08-22T00:21:52.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7380071a0 con 0x7ff74414ffb0 2023-08-22T00:21:52.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff744146250 con 0x7ff74414ffb0 2023-08-22T00:21:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738007560 con 0x7ff74414ffb0 2023-08-22T00:21:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.312+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7441467e0 con 0x7ff74414ffb0 2023-08-22T00:21:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.313+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff744068320 con 0x7ff74414ffb0 2023-08-22T00:21:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.313+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff738006ac0 con 0x7ff74414ffb0 2023-08-22T00:21:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.314+0000 7ff72b7fe700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 0x7ff7300612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.314+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6181+0+0 (secure 0 0 0) 0x7ff7380799e0 con 0x7ff74414ffb0 2023-08-22T00:21:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.314+0000 7ff7437fe700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 0x7ff7300612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.314+0000 7ff7437fe700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 0x7ff7300612d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff73400abd0 tx=0x7ff734008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.318+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff73804ae10 con 0x7ff74414ffb0 2023-08-22T00:21:52.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:52.492+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff744046c20 con 0x7ff74414ffb0 2023-08-22T00:21:53.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.311+0000 7ff72b7fe700 1 -- 172.21.15.98:0/337830839 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff73804e430 con 0x7ff74414ffb0 2023-08-22T00:21:53.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 msgr2=0x7ff7300612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 0x7ff7300612d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff73400abd0 tx=0x7ff734008040).stop 2023-08-22T00:21:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 msgr2=0x7ff744145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff73800c490 tx=0x7ff738007da0).stop 2023-08-22T00:21:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 shutdown_connections 2023-08-22T00:21:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff73005ee10 0x7ff7300612d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff744150390 0x7ff744163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7440645b0 0x7ff744146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 --2- 172.21.15.98:0/337830839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff74414ffb0 0x7ff744145d60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 >> 172.21.15.98:0/337830839 conn(0x7ff744069680 msgr2=0x7ff7440c1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 shutdown_connections 2023-08-22T00:21:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.314+0000 7ff749abb700 1 -- 172.21.15.98:0/337830839 wait complete. 2023-08-22T00:21:53.318 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:21:53.330 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:21:53.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.450+0000 7f0df4803700 1 Processor -- start 2023-08-22T00:21:53.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.450+0000 7f0df4803700 1 -- start start 2023-08-22T00:21:53.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0df4803700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0df0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0df4803700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00bd750 con 0x7f0df0066400 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0df4803700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00a7030 con 0x7f0df0153cf0 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0df4803700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c2010 con 0x7f0df01550e0 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0deed9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0df0066400 0x7f0df00bdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42646/0 (socket says 172.21.15.98:42646) 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0deed9d700 1 -- 172.21.15.98:0/3141147445 learned_addr learned my addr 172.21.15.98:0/3141147445 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0df0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846378615 0 0) 0x7f0df00bd750 con 0x7f0df0066400 2023-08-22T00:21:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd80033f0 con 0x7f0df0066400 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2749973671 0 0) 0x7f0dd80033f0 con 0x7f0df0066400 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 msgr2=0x7f0df0065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0df0065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 >> v1:172.21.15.118:6789/0 conn(0x7f0df0153cf0 legacy=0x7f0df01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00a6d50 con 0x7f0df0066400 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f0de80017f0 con 0x7f0df0066400 2023-08-22T00:21:53.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 >> v1:172.21.15.98:6789/0 conn(0x7f0df0066400 legacy=0x7f0df00bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd8003910 0x7f0dd8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd8004690 0x7f0dd8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0dd8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c2010 con 0x7f0dd8004690 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd800b8e0 con 0x7f0dd8003910 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd800ba50 con 0x7f0df01550e0 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd8004690 0x7f0dd8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0dee59c700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd8003910 0x7f0dd8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.452+0000 7f0deed9d700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0dd8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 -- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 msgr2=0x7f0dd8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0dd8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 -- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd8003910 msgr2=0x7f0dd8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd8003910 0x7f0dd8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 -- 172.21.15.98:0/3141147445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80033f0 con 0x7f0dd8004690 2023-08-22T00:21:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0deed9d700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0df01550e0 0x7f0dd8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:53.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd8004690 0x7f0dd8004b10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f0de4009a80 tx=0x7f0de4009060).ready entity=mon.0 client_cookie=81b791926e901acd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4009430 con 0x7f0dd8004690 2023-08-22T00:21:53.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de400e5e0 con 0x7f0dd8004690 2023-08-22T00:21:53.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0ded59a700 1 -- 172.21.15.98:0/3141147445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400e960 con 0x7f0dd8004690 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 -- 172.21.15.98:0/3141147445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd8004690 msgr2=0x7f0dd8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 --2- 172.21.15.98:0/3141147445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd8004690 0x7f0dd8004b10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f0de4009a80 tx=0x7f0de4009060).stop 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0deed9d700 1 -- 172.21.15.98:0/3141147445 reap_dead start 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 -- 172.21.15.98:0/3141147445 shutdown_connections 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 -- 172.21.15.98:0/3141147445 >> 172.21.15.98:0/3141147445 conn(0x7f0df00c7770 msgr2=0x7f0df00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 -- 172.21.15.98:0/3141147445 shutdown_connections 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.453+0000 7f0df4803700 1 -- 172.21.15.98:0/3141147445 wait complete. 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 Processor -- start 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 -- start start 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dd8004690 0x7f0df013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0df01501e0 0x7f0df0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df013b1a0 con 0x7f0df01540d0 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00a81c0 con 0x7f0df01501e0 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0df4803700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00a7900 con 0x7f0dd8004690 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38998/0 (socket says 172.21.15.98:38998) 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.455+0000 7f0deed9d700 1 -- 172.21.15.98:0/2044604492 learned_addr learned my addr 172.21.15.98:0/2044604492 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:53.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0dedd9b700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0df01501e0 0x7f0df0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0dee59c700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dd8004690 0x7f0df013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 -- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dd8004690 msgr2=0x7f0df013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dd8004690 0x7f0df013acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 -- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0df01501e0 msgr2=0x7f0df0152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0df01501e0 0x7f0df0152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 -- 172.21.15.98:0/2044604492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0154a20 con 0x7f0df01540d0 2023-08-22T00:21:53.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0deed9d700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f0df00c8600 tx=0x7f0df00bd6c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de800e7d0 con 0x7f0df01540d0 2023-08-22T00:21:53.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de800e930 con 0x7f0df01540d0 2023-08-22T00:21:53.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df01531a0 con 0x7f0df01540d0 2023-08-22T00:21:53.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de800ecf0 con 0x7f0df01540d0 2023-08-22T00:21:53.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.456+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00a7b70 con 0x7f0df01540d0 2023-08-22T00:21:53.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.457+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df00a8330 con 0x7f0df01540d0 2023-08-22T00:21:53.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.457+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0de8014640 con 0x7f0df01540d0 2023-08-22T00:21:53.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.457+0000 7f0dde7fc700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 0x7f0dd00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.458+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f0de8079940 con 0x7f0df01540d0 2023-08-22T00:21:53.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.458+0000 7f0dee59c700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 0x7f0dd00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.458+0000 7f0dee59c700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 0x7f0dd00612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0de0000f60 tx=0x7f0de0009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.462+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0de804af40 con 0x7f0df01540d0 2023-08-22T00:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.685+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0df0047480 con 0x7f0df01540d0 2023-08-22T00:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.686+0000 7f0dde7fc700 1 -- 172.21.15.98:0/2044604492 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0de804e560 con 0x7f0df01540d0 2023-08-22T00:21:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:21:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:21:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:21:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:21:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:21:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:21:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:21:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:21:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:21:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:21:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:21:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:21:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:21:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:21:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:21:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:21:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:21:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:21:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:21:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:21:53.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 msgr2=0x7f0dd00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 0x7f0dd00612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0de0000f60 tx=0x7f0de0009040).stop 2023-08-22T00:21:53.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 msgr2=0x7f0df0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f0df00c8600 tx=0x7f0df00bd6c0).stop 2023-08-22T00:21:53.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 shutdown_connections 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0dd005ee10 0x7f0dd00612d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dd8004690 0x7f0df013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0df01540d0 0x7f0df0154530 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 --2- 172.21.15.98:0/2044604492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0df01501e0 0x7f0df0152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 >> 172.21.15.98:0/2044604492 conn(0x7f0df00c7770 msgr2=0x7f0df00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 shutdown_connections 2023-08-22T00:21:53.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.688+0000 7f0df4803700 1 -- 172.21.15.98:0/2044604492 wait complete. 2023-08-22T00:21:53.719 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.835+0000 7f3219d56700 1 Processor -- start 2023-08-22T00:21:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.835+0000 7f3219d56700 1 -- start start 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3219d56700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3214153f40 0x7f3214157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3219d56700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32140a9140 0x7f3214157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3219d56700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140a8410 con 0x7f3214153b60 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3219d56700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140a8cb0 con 0x7f3214153f40 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3219d56700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32141586a0 con 0x7f32140a9140 2023-08-22T00:21:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3214153f40 0x7f3214157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3214153f40 0x7f3214157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39004/0 (socket says 172.21.15.98:39004) 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 -- 172.21.15.98:0/2678243846 learned_addr learned my addr 172.21.15.98:0/2678243846 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3213fff700 1 --2- 172.21.15.98:0/2678243846 >> v2:172.21.15.118:3300/0 conn(0x7f32140a9140 0x7f3214157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 -- 172.21.15.98:0/2678243846 >> v2:172.21.15.118:3300/0 conn(0x7f32140a9140 msgr2=0x7f3214157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 --2- 172.21.15.98:0/2678243846 >> v2:172.21.15.118:3300/0 conn(0x7f32140a9140 0x7f3214157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 -- 172.21.15.98:0/2678243846 >> v1:172.21.15.118:6789/0 conn(0x7f3214153b60 legacy=0x7f3214068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.836+0000 7f3212ffd700 1 -- 172.21.15.98:0/2678243846 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140a8660 con 0x7f3214153f40 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3212ffd700 1 --2- 172.21.15.98:0/2678243846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3214153f40 0x7f3214157930 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f32140a8c20 tx=0x7f32040090f0).ready entity=mon.0 client_cookie=60aea7d2525ea41e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f32127fc700 1 -- 172.21.15.98:0/2678243846 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400b5a0 con 0x7f3214153f40 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f32127fc700 1 -- 172.21.15.98:0/2678243846 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320400b700 con 0x7f3214153f40 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f32127fc700 1 -- 172.21.15.98:0/2678243846 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400ba80 con 0x7f3214153f40 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 -- 172.21.15.98:0/2678243846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3214153f40 msgr2=0x7f3214157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 --2- 172.21.15.98:0/2678243846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3214153f40 0x7f3214157930 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f32140a8c20 tx=0x7f32040090f0).stop 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 -- 172.21.15.98:0/2678243846 shutdown_connections 2023-08-22T00:21:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 --2- 172.21.15.98:0/2678243846 >> v2:172.21.15.118:3300/0 conn(0x7f32140a9140 0x7f3214157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 --2- 172.21.15.98:0/2678243846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3214153f40 0x7f3214157930 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 -- 172.21.15.98:0/2678243846 >> 172.21.15.98:0/2678243846 conn(0x7f32140c5dc0 msgr2=0x7f3214068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:53.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 -- 172.21.15.98:0/2678243846 shutdown_connections 2023-08-22T00:21:53.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.837+0000 7f3219d56700 1 -- 172.21.15.98:0/2678243846 wait complete. 2023-08-22T00:21:53.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 Processor -- start 2023-08-22T00:21:53.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 -- start start 2023-08-22T00:21:53.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3214153b60 0x7f32140c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3214153f40 0x7f32140c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c8060 con 0x7f32140a9140 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141661d0 con 0x7f3214153f40 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f3219d56700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c18a0 con 0x7f3214153b60 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f32137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f32137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39010/0 (socket says 172.21.15.98:39010) 2023-08-22T00:21:53.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.839+0000 7f32137fe700 1 -- 172.21.15.98:0/3473859174 learned_addr learned my addr 172.21.15.98:0/3473859174 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f3212ffd700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3214153b60 0x7f32140c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f3213fff700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3214153f40 0x7f32140c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 -- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3214153b60 msgr2=0x7f32140c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3214153b60 0x7f32140c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 -- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3214153f40 msgr2=0x7f32140c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3214153f40 0x7f32140c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:53.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 -- 172.21.15.98:0/3473859174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204009370 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f32137fe700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f31fc00c440 tx=0x7f31fc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00f470 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00f5f0 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32141658a0 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00f9b0 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.840+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3214165e60 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.841+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32140c4b90 con 0x7f32140a9140 2023-08-22T00:21:53.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.841+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f31fc012400 con 0x7f32140a9140 2023-08-22T00:21:53.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.841+0000 7f320b7fe700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 0x7f31f40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:53.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.842+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f31fc079160 con 0x7f32140a9140 2023-08-22T00:21:53.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.842+0000 7f3212ffd700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 0x7f31f40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:53.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.842+0000 7f3212ffd700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 0x7f31f40612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3204009130 tx=0x7f3204015000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:53.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:53.846+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31fc0488f0 con 0x7f32140a9140 2023-08-22T00:21:54.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.010+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3214047480 con 0x7f32140a9140 2023-08-22T00:21:54.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.010+0000 7f320b7fe700 1 -- 172.21.15.98:0/3473859174 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+14046 (secure 0 0 0) 0x7f31fc04a810 con 0x7f32140a9140 2023-08-22T00:21:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:54.012 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":101,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:53.306315+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 msgr2=0x7f31f40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 0x7f31f40612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3204009130 tx=0x7f3204015000).stop 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 msgr2=0x7f3214165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f31fc00c440 tx=0x7f31fc007de0).stop 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 shutdown_connections 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3214153f40 0x7f32140c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32140a9140 0x7f3214165070 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f31f405ee10 0x7f31f40612d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 --2- 172.21.15.98:0/3473859174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3214153b60 0x7f32140c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 >> 172.21.15.98:0/3473859174 conn(0x7f32140c5dc0 msgr2=0x7f32140abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 shutdown_connections 2023-08-22T00:21:54.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.012+0000 7f3219d56700 1 -- 172.21.15.98:0/3473859174 wait complete. 2023-08-22T00:21:54.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:21:54.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:21:54.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.144+0000 7fe3a7845700 1 Processor -- start 2023-08-22T00:21:54.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 -- start start 2023-08-22T00:21:54.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe3a00a8b20 0x7fe3a00a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a00bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0062600 con 0x7fe3a0155950 2023-08-22T00:21:54.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a0066120 con 0x7fe3a00a8b20 2023-08-22T00:21:54.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.145+0000 7fe3a7845700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0066400 con 0x7fe3a00bc160 2023-08-22T00:21:54.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe3a00a8b20 0x7fe3a00a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe3a00a8b20 0x7fe3a00a8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39024/0 (socket says 172.21.15.98:39024) 2023-08-22T00:21:54.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 -- 172.21.15.98:0/953288171 learned_addr learned my addr 172.21.15.98:0/953288171 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a4de0700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a00bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 -- 172.21.15.98:0/953288171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 msgr2=0x7fe3a00bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:54.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a00bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 -- 172.21.15.98:0/953288171 >> v1:172.21.15.118:6789/0 conn(0x7fe3a0155950 legacy=0x7fe3a0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe397fff700 1 -- 172.21.15.98:0/953288171 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303895731 0 0) 0x7fe3a0062600 con 0x7fe3a0155950 2023-08-22T00:21:54.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 -- 172.21.15.98:0/953288171 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00666e0 con 0x7fe3a00a8b20 2023-08-22T00:21:54.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe3a55e1700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a00a8f00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fe39c006fd0 tx=0x7fe39c0090f0).ready entity=mon.0 client_cookie=882a33f7f4cd44e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe397fff700 1 -- 172.21.15.98:0/953288171 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00b600 con 0x7fe3a00a8b20 2023-08-22T00:21:54.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe397fff700 1 -- 172.21.15.98:0/953288171 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00b760 con 0x7fe3a00a8b20 2023-08-22T00:21:54.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.146+0000 7fe397fff700 1 -- 172.21.15.98:0/953288171 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00bb00 con 0x7fe3a00a8b20 2023-08-22T00:21:54.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 -- 172.21.15.98:0/953288171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 msgr2=0x7fe3a00a8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a00a8f00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fe39c006fd0 tx=0x7fe39c0090f0).stop 2023-08-22T00:21:54.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 -- 172.21.15.98:0/953288171 shutdown_connections 2023-08-22T00:21:54.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a00a8f00 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 --2- 172.21.15.98:0/953288171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a00bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 -- 172.21.15.98:0/953288171 >> 172.21.15.98:0/953288171 conn(0x7fe3a00c31d0 msgr2=0x7fe3a00c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 -- 172.21.15.98:0/953288171 shutdown_connections 2023-08-22T00:21:54.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.147+0000 7fe3a7845700 1 -- 172.21.15.98:0/953288171 wait complete. 2023-08-22T00:21:54.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.148+0000 7fe3a7845700 1 Processor -- start 2023-08-22T00:21:54.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.148+0000 7fe3a7845700 1 -- start start 2023-08-22T00:21:54.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3a0155950 0x7fe3a00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00bd6f0 con 0x7fe3a00a8b20 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00bdcb0 con 0x7fe3a0155950 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a7845700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0152e20 con 0x7fe3a00bc160 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a55e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a55e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39028/0 (socket says 172.21.15.98:39028) 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.149+0000 7fe3a55e1700 1 -- 172.21.15.98:0/3999963701 learned_addr learned my addr 172.21.15.98:0/3999963701 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a4de0700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a5de2700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3a0155950 0x7fe3a00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 -- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 msgr2=0x7fe3a01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a01523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 -- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3a0155950 msgr2=0x7fe3a00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3a0155950 0x7fe3a00c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 -- 172.21.15.98:0/3999963701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009370 con 0x7fe3a00a8b20 2023-08-22T00:21:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a55e1700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fe39c009f50 tx=0x7fe39c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00bec0 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c006910 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0153100 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00bb00 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.150+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a013e8a0 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.151+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a00669c0 con 0x7fe3a00a8b20 2023-08-22T00:21:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.152+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe39c021070 con 0x7fe3a00a8b20 2023-08-22T00:21:54.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.152+0000 7fe3957fa700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 0x7fe3840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.152+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fe39c07b940 con 0x7fe3a00a8b20 2023-08-22T00:21:54.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.153+0000 7fe3a4de0700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 0x7fe3840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.153+0000 7fe3a4de0700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 0x7fe3840612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe3a0153c10 tx=0x7fe390008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.156+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe39c04d040 con 0x7fe3a00a8b20 2023-08-22T00:21:54.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.321+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe3a0046c20 con 0x7fe3a00a8b20 2023-08-22T00:21:54.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.321+0000 7fe3957fa700 1 -- 172.21.15.98:0/3999963701 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v101) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe39c029030 con 0x7fe3a00a8b20 2023-08-22T00:21:54.323 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:21:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 msgr2=0x7fe3840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 0x7fe3840612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe3a0153c10 tx=0x7fe390008040).stop 2023-08-22T00:21:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 msgr2=0x7fe3a013e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fe39c009f50 tx=0x7fe39c017000).stop 2023-08-22T00:21:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 shutdown_connections 2023-08-22T00:21:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3a0155950 0x7fe3a00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a00a8b20 0x7fe3a013e3b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe38405ee10 0x7fe3840612d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 --2- 172.21.15.98:0/3999963701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3a00bc160 0x7fe3a01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 >> 172.21.15.98:0/3999963701 conn(0x7fe3a00c31d0 msgr2=0x7fe3a00c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 shutdown_connections 2023-08-22T00:21:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.323+0000 7fe3a7845700 1 -- 172.21.15.98:0/3999963701 wait complete. 2023-08-22T00:21:54.336 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:21:54.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.453+0000 7f9ef1ebe700 1 Processor -- start 2023-08-22T00:21:54.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.453+0000 7f9ef1ebe700 1 -- start start 2023-08-22T00:21:54.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9ef1ebe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9eec157a80 0x7f9eec0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9ef1ebe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9eec157e60 0x7f9eec153780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9ef1ebe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0c8d30 con 0x7f9eec153c70 2023-08-22T00:21:54.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9ef1ebe700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0c9010 con 0x7f9eec157e60 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9ef1ebe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0c92f0 con 0x7f9eec157a80 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.454+0000 7f9eeaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9eec157e60 0x7f9eec153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9eec157e60 0x7f9eec153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39034/0 (socket says 172.21.15.98:39034) 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 -- 172.21.15.98:0/2778492931 learned_addr learned my addr 172.21.15.98:0/2778492931 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 -- 172.21.15.98:0/2778492931 >> v2:172.21.15.118:3300/0 conn(0x7f9eec157a80 msgr2=0x7f9eec0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 --2- 172.21.15.98:0/2778492931 >> v2:172.21.15.118:3300/0 conn(0x7f9eec157a80 0x7f9eec0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 -- 172.21.15.98:0/2778492931 >> v1:172.21.15.118:6789/0 conn(0x7f9eec153c70 legacy=0x7f9eec0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:54.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 -- 172.21.15.98:0/2778492931 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0c95d0 con 0x7f9eec157e60 2023-08-22T00:21:54.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eeaffd700 1 --2- 172.21.15.98:0/2778492931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec153780 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9eec0655d0 tx=0x7f9edc0090f0).ready entity=mon.0 client_cookie=b4455c1d1a323d7c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eea7fc700 1 -- 172.21.15.98:0/2778492931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00b5a0 con 0x7f9eec157e60 2023-08-22T00:21:54.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eea7fc700 1 -- 172.21.15.98:0/2778492931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00b700 con 0x7f9eec157e60 2023-08-22T00:21:54.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9eea7fc700 1 -- 172.21.15.98:0/2778492931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00baa0 con 0x7f9eec157e60 2023-08-22T00:21:54.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/2778492931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 msgr2=0x7f9eec153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/2778492931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec153780 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9eec0655d0 tx=0x7f9edc0090f0).stop 2023-08-22T00:21:54.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/2778492931 shutdown_connections 2023-08-22T00:21:54.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/2778492931 >> v2:172.21.15.118:3300/0 conn(0x7f9eec157a80 0x7f9eec0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/2778492931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec153780 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.455+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/2778492931 >> 172.21.15.98:0/2778492931 conn(0x7f9eec0cb5f0 msgr2=0x7f9eec0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.456+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/2778492931 shutdown_connections 2023-08-22T00:21:54.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.456+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/2778492931 wait complete. 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.457+0000 7f9ef1ebe700 1 Processor -- start 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.457+0000 7f9ef1ebe700 1 -- start start 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 0x7f9eec13f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eec157a80 0x7f9eec152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0c3280 con 0x7f9eec157e60 2023-08-22T00:21:54.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0c2670 con 0x7f9eec153c70 2023-08-22T00:21:54.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0c2950 con 0x7f9eec157a80 2023-08-22T00:21:54.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39040/0 (socket says 172.21.15.98:39040) 2023-08-22T00:21:54.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 -- 172.21.15.98:0/1790285359 learned_addr learned my addr 172.21.15.98:0/1790285359 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eeaffd700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eec157a80 0x7f9eec152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eeb7fe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 0x7f9eec13f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 -- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eec157a80 msgr2=0x7f9eec152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eec157a80 0x7f9eec152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 -- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 msgr2=0x7f9eec13f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 0x7f9eec13f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 -- 172.21.15.98:0/1790285359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009370 con 0x7f9eec157e60 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eeb7fe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 0x7f9eec13f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9eebfff700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f9ee400b7e0 tx=0x7f9ee4009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400d5a0 con 0x7f9eec157e60 2023-08-22T00:21:54.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee400d740 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0c2c30 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400db00 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.458+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec0c2290 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.459+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec083630 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.460+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9ee4019460 con 0x7f9eec157e60 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.460+0000 7f9ee37fe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 0x7f9ecc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.460+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9ee4079c80 con 0x7f9eec157e60 2023-08-22T00:21:54.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.460+0000 7f9eeb7fe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 0x7f9ecc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.461+0000 7f9eeb7fe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 0x7f9ecc0612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9ed4009990 tx=0x7f9ed4008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.464+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ee404b280 con 0x7f9eec157e60 2023-08-22T00:21:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.624+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9eec046c20 con 0x7f9eec157e60 2023-08-22T00:21:54.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.625+0000 7f9ee37fe700 1 -- 172.21.15.98:0/1790285359 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ee404e8a0 con 0x7f9eec157e60 2023-08-22T00:21:54.627 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.626+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 msgr2=0x7f9ecc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.626+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 0x7f9ecc0612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9ed4009990 tx=0x7f9ed4008040).stop 2023-08-22T00:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 msgr2=0x7f9eec152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f9ee400b7e0 tx=0x7f9ee4009310).stop 2023-08-22T00:21:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 shutdown_connections 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9eec157e60 0x7f9eec152650 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eec153c70 0x7f9eec13f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9ecc05ee10 0x7f9ecc0612d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 --2- 172.21.15.98:0/1790285359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eec157a80 0x7f9eec152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 >> 172.21.15.98:0/1790285359 conn(0x7f9eec0cb5f0 msgr2=0x7f9eec153550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 shutdown_connections 2023-08-22T00:21:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.627+0000 7f9ef1ebe700 1 -- 172.21.15.98:0/1790285359 wait complete. 2023-08-22T00:21:54.640 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:21:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.758+0000 7f311fe96700 1 Processor -- start 2023-08-22T00:21:54.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.758+0000 7f311fe96700 1 -- start start 2023-08-22T00:21:54.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311fe96700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3118153f10 0x7f3118150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311fe96700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f31180c26b0 0x7f31180c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311fe96700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180c2220 con 0x7f3118150040 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311fe96700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180c5bd0 con 0x7f31180c26b0 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311fe96700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180c1ef0 con 0x7f3118153f10 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311e433700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f31180c26b0 0x7f31180c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311e433700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f31180c26b0 0x7f31180c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39054/0 (socket says 172.21.15.98:39054) 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311e433700 1 -- 172.21.15.98:0/2519223524 learned_addr learned my addr 172.21.15.98:0/2519223524 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.759+0000 7f311dc32700 1 --1- 172.21.15.98:0/2519223524 >> v1:172.21.15.98:6789/0 conn(0x7f3118150040 0x7f31180c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42660/0 (socket says 172.21.15.98:42660) 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311d431700 1 --2- 172.21.15.98:0/2519223524 >> v2:172.21.15.118:3300/0 conn(0x7f3118153f10 0x7f3118150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311e433700 1 -- 172.21.15.98:0/2519223524 >> v2:172.21.15.118:3300/0 conn(0x7f3118153f10 msgr2=0x7f3118150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311e433700 1 --2- 172.21.15.98:0/2519223524 >> v2:172.21.15.118:3300/0 conn(0x7f3118153f10 0x7f3118150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311e433700 1 -- 172.21.15.98:0/2519223524 >> v1:172.21.15.98:6789/0 conn(0x7f3118150040 legacy=0x7f31180c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311e433700 1 -- 172.21.15.98:0/2519223524 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180c5e30 con 0x7f31180c26b0 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311cc30700 1 -- 172.21.15.98:0/2519223524 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945787259 0 0) 0x7f31180c2220 con 0x7f3118150040 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311e433700 1 --2- 172.21.15.98:0/2519223524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31180c26b0 0x7f31180c2b00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f31180a86c0 tx=0x7f3110009840).ready entity=mon.0 client_cookie=a20f1f56956b05ed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311cc30700 1 -- 172.21.15.98:0/2519223524 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000e070 con 0x7f31180c26b0 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311cc30700 1 -- 172.21.15.98:0/2519223524 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311000ba50 con 0x7f31180c26b0 2023-08-22T00:21:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311cc30700 1 -- 172.21.15.98:0/2519223524 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000bdd0 con 0x7f31180c26b0 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 -- 172.21.15.98:0/2519223524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31180c26b0 msgr2=0x7f31180c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 --2- 172.21.15.98:0/2519223524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31180c26b0 0x7f31180c2b00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f31180a86c0 tx=0x7f3110009840).stop 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 -- 172.21.15.98:0/2519223524 shutdown_connections 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 --2- 172.21.15.98:0/2519223524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31180c26b0 0x7f31180c2b00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 --2- 172.21.15.98:0/2519223524 >> v2:172.21.15.118:3300/0 conn(0x7f3118153f10 0x7f3118150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.760+0000 7f311fe96700 1 -- 172.21.15.98:0/2519223524 >> 172.21.15.98:0/2519223524 conn(0x7f31180c7140 msgr2=0x7f31180c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.761+0000 7f311fe96700 1 -- 172.21.15.98:0/2519223524 shutdown_connections 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.761+0000 7f311fe96700 1 -- 172.21.15.98:0/2519223524 wait complete. 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 Processor -- start 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 -- start start 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31180c26b0 0x7f31181478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3118153f10 0x7f31180aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118148e30 con 0x7f3118150040 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31180aaa80 con 0x7f31180c26b0 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311fe96700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180aad60 con 0x7f3118153f10 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311d431700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.762+0000 7f311d431700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39060/0 (socket says 172.21.15.98:39060) 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 -- 172.21.15.98:0/1817819707 learned_addr learned my addr 172.21.15.98:0/1817819707 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 -- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3118153f10 msgr2=0x7f31180aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3118153f10 0x7f31180aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 -- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31180c26b0 msgr2=0x7f31181478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31180c26b0 0x7f31181478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 -- 172.21.15.98:0/1817819707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110009ae0 con 0x7f3118150040 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311d431700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f311400d860 tx=0x7f3114008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114011590 con 0x7f3118150040 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31140116f0 con 0x7f3118150040 2023-08-22T00:21:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31180ab040 con 0x7f3118150040 2023-08-22T00:21:54.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114011a70 con 0x7f3118150040 2023-08-22T00:21:54.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.763+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31180bfa80 con 0x7f3118150040 2023-08-22T00:21:54.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.764+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3118148c10 con 0x7f3118150040 2023-08-22T00:21:54.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.764+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3114012420 con 0x7f3118150040 2023-08-22T00:21:54.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.765+0000 7f310dffb700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 0x7f30fc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:54.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.765+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f3114079650 con 0x7f3118150040 2023-08-22T00:21:54.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.765+0000 7f311dc32700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 0x7f30fc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:54.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.765+0000 7f311dc32700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 0x7f30fc0612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f31080011e0 tx=0x7f3108007830).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:54.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.769+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f311404ac50 con 0x7f3118150040 2023-08-22T00:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.930+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3118047480 con 0x7f3118150040 2023-08-22T00:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.930+0000 7f310dffb700 1 -- 172.21.15.98:0/1817819707 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3114011e60 con 0x7f3118150040 2023-08-22T00:21:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:54.932 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:21:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:21:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:21:54.933 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 msgr2=0x7f30fc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 0x7f30fc0612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f31080011e0 tx=0x7f3108007830).stop 2023-08-22T00:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 msgr2=0x7f31180a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f311400d860 tx=0x7f3114008040).stop 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 shutdown_connections 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f30fc05ee10 0x7f30fc0612d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3118153f10 0x7f31180aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31180c26b0 0x7f31181478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 --2- 172.21.15.98:0/1817819707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118150040 0x7f31180a9fe0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 >> 172.21.15.98:0/1817819707 conn(0x7f31180c7140 msgr2=0x7f31180bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 shutdown_connections 2023-08-22T00:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:54.932+0000 7f311fe96700 1 -- 172.21.15.98:0/1817819707 wait complete. 2023-08-22T00:21:54.945 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:21:54.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:21:55.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.065+0000 7f7838a58700 1 Processor -- start 2023-08-22T00:21:55.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.065+0000 7f7838a58700 1 -- start start 2023-08-22T00:21:55.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f7838a58700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78340a5910 0x7f7834154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f7838a58700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 0x7f78340c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f7838a58700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7834062600 con 0x7f7834153c80 2023-08-22T00:21:55.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f7838a58700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7834062f10 con 0x7f78340a5910 2023-08-22T00:21:55.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f7838a58700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783414ac50 con 0x7f78340c4260 2023-08-22T00:21:55.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f783259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78340a5910 0x7f7834154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f783259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78340a5910 0x7f7834154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39064/0 (socket says 172.21.15.98:39064) 2023-08-22T00:21:55.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.066+0000 7f783259c700 1 -- 172.21.15.98:0/1446177804 learned_addr learned my addr 172.21.15.98:0/1446177804 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:55.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783259c700 1 -- 172.21.15.98:0/1446177804 >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 msgr2=0x7f78340c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:55.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7831d9b700 1 --2- 172.21.15.98:0/1446177804 >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 0x7f78340c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783259c700 1 --2- 172.21.15.98:0/1446177804 >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 0x7f78340c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783259c700 1 -- 172.21.15.98:0/1446177804 >> v1:172.21.15.118:6789/0 conn(0x7f7834153c80 legacy=0x7f7834063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:55.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783259c700 1 -- 172.21.15.98:0/1446177804 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340c2a60 con 0x7f78340a5910 2023-08-22T00:21:55.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7831d9b700 1 --2- 172.21.15.98:0/1446177804 >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 0x7f78340c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:55.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783259c700 1 --2- 172.21.15.98:0/1446177804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340a5910 0x7f7834154830 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f78340ac850 tx=0x7f78280090f0).ready entity=mon.0 client_cookie=50287a026223e50b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783159a700 1 -- 172.21.15.98:0/1446177804 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782800b5a0 con 0x7f78340a5910 2023-08-22T00:21:55.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783159a700 1 -- 172.21.15.98:0/1446177804 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782800b700 con 0x7f78340a5910 2023-08-22T00:21:55.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f783159a700 1 -- 172.21.15.98:0/1446177804 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782800ba80 con 0x7f78340a5910 2023-08-22T00:21:55.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 -- 172.21.15.98:0/1446177804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340a5910 msgr2=0x7f7834154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 --2- 172.21.15.98:0/1446177804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340a5910 0x7f7834154830 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f78340ac850 tx=0x7f78280090f0).stop 2023-08-22T00:21:55.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 -- 172.21.15.98:0/1446177804 shutdown_connections 2023-08-22T00:21:55.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 --2- 172.21.15.98:0/1446177804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340a5910 0x7f7834154830 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 --2- 172.21.15.98:0/1446177804 >> v2:172.21.15.118:3300/0 conn(0x7f78340c4260 0x7f78340c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.067+0000 7f7838a58700 1 -- 172.21.15.98:0/1446177804 >> 172.21.15.98:0/1446177804 conn(0x7f78340c7170 msgr2=0x7f78340c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:55.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.068+0000 7f7838a58700 1 -- 172.21.15.98:0/1446177804 shutdown_connections 2023-08-22T00:21:55.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.068+0000 7f7838a58700 1 -- 172.21.15.98:0/1446177804 wait complete. 2023-08-22T00:21:55.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 Processor -- start 2023-08-22T00:21:55.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 -- start start 2023-08-22T00:21:55.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 0x7f78340a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 0x7f78340ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340bd520 con 0x7f78340c4260 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340bd800 con 0x7f7834153c80 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.069+0000 7f7838a58700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340bdae0 con 0x7f78340a5910 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39072/0 (socket says 172.21.15.98:39072) 2023-08-22T00:21:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 -- 172.21.15.98:0/496212764 learned_addr learned my addr 172.21.15.98:0/496212764 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f783259c700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 0x7f78340a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7832d9d700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 0x7f78340ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 -- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 msgr2=0x7f78340a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 0x7f78340a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 -- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 msgr2=0x7f78340ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 0x7f78340ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 -- 172.21.15.98:0/496212764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009370 con 0x7f78340c4260 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f783259c700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 0x7f78340a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7832d9d700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 0x7f78340ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7831d9b700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f782400c880 tx=0x7f7824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824010580 con 0x7f78340c4260 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78240106e0 con 0x7f78340c4260 2023-08-22T00:21:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824010a60 con 0x7f78340c4260 2023-08-22T00:21:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340bddc0 con 0x7f78340c4260 2023-08-22T00:21:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.070+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340ab590 con 0x7f78340c4260 2023-08-22T00:21:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.071+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78340c2570 con 0x7f78340c4260 2023-08-22T00:21:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.071+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f782401b460 con 0x7f78340c4260 2023-08-22T00:21:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.072+0000 7f78227fc700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 0x7f78140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.072+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7824079c90 con 0x7f78340c4260 2023-08-22T00:21:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.072+0000 7f783259c700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 0x7f78140612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.072+0000 7f783259c700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 0x7f78140612a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f782800c010 tx=0x7f7828015000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.076+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f782404b290 con 0x7f78340c4260 2023-08-22T00:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.239+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7834047480 con 0x7f78340c4260 2023-08-22T00:21:55.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.321+0000 7f78227fc700 1 -- 172.21.15.98:0/496212764 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) v1 ==== 152+0+0 (secure 0 0 0) 0x7f782404e8b0 con 0x7f78340c4260 2023-08-22T00:21:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 msgr2=0x7f78140612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 0x7f78140612a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f782800c010 tx=0x7f7828015000).stop 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 msgr2=0x7f78340bcf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f782400c880 tx=0x7f7824008040).stop 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 shutdown_connections 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f781405ede0 0x7f78140612a0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7f782800c010 tx=0x7f7828015000).stop 2023-08-22T00:21:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78340a5910 0x7f78340a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7834153c80 0x7f78340ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 --2- 172.21.15.98:0/496212764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78340c4260 0x7f78340bcf80 secure :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0x7f782400c880 tx=0x7f7824008040).stop 2023-08-22T00:21:55.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.325+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 >> 172.21.15.98:0/496212764 conn(0x7f78340c7170 msgr2=0x7f78341540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:55.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.327+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 shutdown_connections 2023-08-22T00:21:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.327+0000 7f7838a58700 1 -- 172.21.15.98:0/496212764 wait complete. 2023-08-22T00:21:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:21:55.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:21:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.463+0000 7f77ab286700 1 Processor -- start 2023-08-22T00:21:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.464+0000 7f77ab286700 1 -- start start 2023-08-22T00:21:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.464+0000 7f77ab286700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 0x7f77a4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.464+0000 7f77ab286700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a40654c0 con 0x7f77a41550a0 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.464+0000 7f77ab286700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a40c3fb0 con 0x7f77a40a6740 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.464+0000 7f77ab286700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40be6e0 con 0x7f77a41508b0 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a8821700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f77a41550a0 0x7f77a40c38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42662/0 (socket says 172.21.15.98:42662) 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a8821700 1 -- 172.21.15.98:0/1700752077 learned_addr learned my addr 172.21.15.98:0/1700752077 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a9022700 1 --2- 172.21.15.98:0/1700752077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 0x7f77a4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916465720 0 0) 0x7f77a40654c0 con 0x7f77a41550a0 2023-08-22T00:21:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77900033f0 con 0x7f77a41550a0 2023-08-22T00:21:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74171603 0 0) 0x7f77a40c3fb0 con 0x7f77a40a6740 2023-08-22T00:21:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77a40654c0 con 0x7f77a40a6740 2023-08-22T00:21:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277977864 0 0) 0x7f77900033f0 con 0x7f77a41550a0 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a9022700 1 -- 172.21.15.98:0/1700752077 >> v1:172.21.15.118:6789/0 conn(0x7f77a40a6740 legacy=0x7f77a40c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a9022700 1 -- 172.21.15.98:0/1700752077 >> v1:172.21.15.98:6789/0 conn(0x7f77a41550a0 legacy=0x7f77a40c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a9022700 1 -- 172.21.15.98:0/1700752077 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40be120 con 0x7f77a41508b0 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f77a9022700 1 --2- 172.21.15.98:0/1700752077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 0x7f77a4150c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7794009790 tx=0x7f7794009060).ready entity=mon.2 client_cookie=6469d3d2adfda197 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0001470 con 0x7f77a41508b0 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77940090d0 con 0x7f77a41508b0 2023-08-22T00:21:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.465+0000 7f779bfff700 1 -- 172.21.15.98:0/1700752077 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794011610 con 0x7f77a41508b0 2023-08-22T00:21:55.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 -- 172.21.15.98:0/1700752077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 msgr2=0x7f77a4150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 --2- 172.21.15.98:0/1700752077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 0x7f77a4150c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7794009790 tx=0x7f7794009060).stop 2023-08-22T00:21:55.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 -- 172.21.15.98:0/1700752077 shutdown_connections 2023-08-22T00:21:55.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 --2- 172.21.15.98:0/1700752077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41508b0 0x7f77a4150c90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 -- 172.21.15.98:0/1700752077 >> 172.21.15.98:0/1700752077 conn(0x7f77a40c7820 msgr2=0x7f77a40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:55.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 -- 172.21.15.98:0/1700752077 shutdown_connections 2023-08-22T00:21:55.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.466+0000 7f77ab286700 1 -- 172.21.15.98:0/1700752077 wait complete. 2023-08-22T00:21:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.468+0000 7f77ab286700 1 Processor -- start 2023-08-22T00:21:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.468+0000 7f77ab286700 1 -- start start 2023-08-22T00:21:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77a40a6740 0x7f77a4165110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41550a0 0x7f77a4163360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4163100 con 0x7f77a41508b0 2023-08-22T00:21:55.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a41513a0 con 0x7f77a40a6740 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77ab286700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4151680 con 0x7f77a41550a0 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39074/0 (socket says 172.21.15.98:39074) 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 -- 172.21.15.98:0/3873627605 learned_addr learned my addr 172.21.15.98:0/3873627605 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a9022700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77a40a6740 0x7f77a4165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a9823700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41550a0 0x7f77a4163360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 -- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41550a0 msgr2=0x7f77a4163360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41550a0 0x7f77a4163360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 -- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77a40a6740 msgr2=0x7f77a4165110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77a40a6740 0x7f77a4165110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 -- 172.21.15.98:0/3873627605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940092a0 con 0x7f77a41508b0 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77a8821700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f77a000c810 tx=0x7f77a0001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00072e0 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0007440 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.469+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00057a0 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.470+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a4151960 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.470+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4151f20 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.470+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a40691b0 con 0x7f77a41508b0 2023-08-22T00:21:55.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.471+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f77a0005bd0 con 0x7f77a41508b0 2023-08-22T00:21:55.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.472+0000 7f77997fa700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 0x7f77880612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:55.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.472+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f77a0079c10 con 0x7f77a41508b0 2023-08-22T00:21:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.472+0000 7f77a9022700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 0x7f77880612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.472+0000 7f77a9022700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 0x7f77880612a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f779400a010 tx=0x7f7794016000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.476+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77a004b1a0 con 0x7f77a41508b0 2023-08-22T00:21:55.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:55.637+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f77a4152560 con 0x7f77a41508b0 2023-08-22T00:21:56.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.326+0000 7f77997fa700 1 -- 172.21.15.98:0/3873627605 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) v1 ==== 170+0+0 (secure 0 0 0) 0x7f77a4152560 con 0x7f77a41508b0 2023-08-22T00:21:56.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.330+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 msgr2=0x7f77880612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.330+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 0x7f77880612a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f779400a010 tx=0x7f7794016000).stop 2023-08-22T00:21:56.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.330+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 msgr2=0x7f77a4162c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.330+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f77a000c810 tx=0x7f77a0001960).stop 2023-08-22T00:21:56.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 shutdown_connections 2023-08-22T00:21:56.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f778805ede0 0x7f77880612a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77a41550a0 0x7f77a4163360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77a40a6740 0x7f77a4165110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 --2- 172.21.15.98:0/3873627605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77a41508b0 0x7f77a4162c10 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.331+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 >> 172.21.15.98:0/3873627605 conn(0x7f77a40c7820 msgr2=0x7f77a40c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:56.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.334+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 shutdown_connections 2023-08-22T00:21:56.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.334+0000 7f77ab286700 1 -- 172.21.15.98:0/3873627605 wait complete. 2023-08-22T00:21:56.353 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:21:56.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:21:56.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.483+0000 7f1809f5c700 1 Processor -- start 2023-08-22T00:21:56.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.483+0000 7f1809f5c700 1 -- start start 2023-08-22T00:21:56.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1809f5c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1804064110 0x7f1804064590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1809f5c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 0x7f1804066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1809f5c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1804158970 con 0x7f1804153dd0 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1809f5c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040c28b0 con 0x7f1804064110 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1809f5c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1804064a80 con 0x7f1804066000 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1802ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1804064110 0x7f1804064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1802ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1804064110 0x7f1804064590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39076/0 (socket says 172.21.15.98:39076) 2023-08-22T00:21:56.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f18037fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1804153dd0 0x7f18040c2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42676/0 (socket says 172.21.15.98:42676) 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1802ffd700 1 -- 172.21.15.98:0/1562557893 learned_addr learned my addr 172.21.15.98:0/1562557893 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1803fff700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 0x7f1804066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1802ffd700 1 -- 172.21.15.98:0/1562557893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 msgr2=0x7f1804066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.484+0000 7f1802ffd700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 0x7f1804066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1802ffd700 1 -- 172.21.15.98:0/1562557893 >> v1:172.21.15.98:6789/0 conn(0x7f1804153dd0 legacy=0x7f18040c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f18027fc700 1 -- 172.21.15.98:0/1562557893 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919735546 0 0) 0x7f1804158970 con 0x7f1804153dd0 2023-08-22T00:21:56.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1802ffd700 1 -- 172.21.15.98:0/1562557893 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804066980 con 0x7f1804064110 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1803fff700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 0x7f1804066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1802ffd700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804064110 0x7f1804064590 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f17f4006fd0 tx=0x7f17f40090f0).ready entity=mon.0 client_cookie=f4ab7ff57c116a92 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f18027fc700 1 -- 172.21.15.98:0/1562557893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400b600 con 0x7f1804064110 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f18027fc700 1 -- 172.21.15.98:0/1562557893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400b760 con 0x7f1804064110 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f18027fc700 1 -- 172.21.15.98:0/1562557893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400bae0 con 0x7f1804064110 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 -- 172.21.15.98:0/1562557893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804064110 msgr2=0x7f1804064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804064110 0x7f1804064590 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f17f4006fd0 tx=0x7f17f40090f0).stop 2023-08-22T00:21:56.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 -- 172.21.15.98:0/1562557893 shutdown_connections 2023-08-22T00:21:56.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804066000 0x7f1804066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1562557893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804064110 0x7f1804064590 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 -- 172.21.15.98:0/1562557893 >> 172.21.15.98:0/1562557893 conn(0x7f18040c7820 msgr2=0x7f18040c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:56.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 -- 172.21.15.98:0/1562557893 shutdown_connections 2023-08-22T00:21:56.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.485+0000 7f1809f5c700 1 -- 172.21.15.98:0/1562557893 wait complete. 2023-08-22T00:21:56.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 Processor -- start 2023-08-22T00:21:56.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 -- start start 2023-08-22T00:21:56.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 0x7f18040a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 0x7f18040a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040a9820 con 0x7f1804066000 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040c0310 con 0x7f1804064110 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1809f5c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040bf700 con 0x7f1804153dd0 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.487+0000 7f1802ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39090/0 (socket says 172.21.15.98:39090) 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 -- 172.21.15.98:0/1883340392 learned_addr learned my addr 172.21.15.98:0/1883340392 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:56.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f18037fe700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 0x7f18040a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1803fff700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 0x7f18040a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 -- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 msgr2=0x7f18040a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 0x7f18040a7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 -- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 msgr2=0x7f18040a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 0x7f18040a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 -- 172.21.15.98:0/1883340392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009370 con 0x7f1804066000 2023-08-22T00:21:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1803fff700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 0x7f18040a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f18037fe700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 0x7f18040a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1802ffd700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f1804068a80 tx=0x7f17f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400b8d0 con 0x7f1804066000 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400ba30 con 0x7f1804066000 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f401c650 con 0x7f1804066000 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18040bf9e0 con 0x7f1804066000 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.488+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18040bffa0 con 0x7f1804066000 2023-08-22T00:21:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.489+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18040c0480 con 0x7f1804066000 2023-08-22T00:21:56.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.489+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f17f401ca00 con 0x7f1804066000 2023-08-22T00:21:56.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.490+0000 7f17eb7fe700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 0x7f17f00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.490+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f17f407bca0 con 0x7f1804066000 2023-08-22T00:21:56.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.490+0000 7f18037fe700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 0x7f17f00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.490+0000 7f18037fe700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 0x7f17f00612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f17f8007fd0 tx=0x7f17f8009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.494+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17f404d010 con 0x7f1804066000 2023-08-22T00:21:56.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.697+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18040c3d60 con 0x7f1804066000 2023-08-22T00:21:56.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.704+0000 7f17eb7fe700 1 -- 172.21.15.98:0/1883340392 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f17f402a070 con 0x7f1804066000 2023-08-22T00:21:56.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.712+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 msgr2=0x7f17f00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.712+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 0x7f17f00612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f17f8007fd0 tx=0x7f17f8009040).stop 2023-08-22T00:21:56.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.712+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 msgr2=0x7f18040bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.712+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f1804068a80 tx=0x7f17f4017000).stop 2023-08-22T00:21:56.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 shutdown_connections 2023-08-22T00:21:56.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f17f005ee10 0x7f17f00612d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1804153dd0 0x7f18040a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1804064110 0x7f18040a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 --2- 172.21.15.98:0/1883340392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1804066000 0x7f18040bf090 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.713+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 >> 172.21.15.98:0/1883340392 conn(0x7f18040c7820 msgr2=0x7f18040ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:56.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.714+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 shutdown_connections 2023-08-22T00:21:56.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.714+0000 7f1809f5c700 1 -- 172.21.15.98:0/1883340392 wait complete. 2023-08-22T00:21:56.717 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 12 and data pool 13 2023-08-22T00:21:56.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 Processor -- start 2023-08-22T00:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 -- start start 2023-08-22T00:21:56.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efeb01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00bd750 con 0x7efeb0065f10 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00a7030 con 0x7efeb0066370 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.851+0000 7efeb61c8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c2010 con 0x7efeb0153cf0 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaeffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efeb0065f10 0x7efeb00bdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42682/0 (socket says 172.21.15.98:42682) 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaeffd700 1 -- 172.21.15.98:0/1079103370 learned_addr learned my addr 172.21.15.98:0/1079103370 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:56.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaf7fe700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efeb01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059410242 0 0) 0x7efeb00bd750 con 0x7efeb0065f10 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe9c0033f0 con 0x7efeb0065f10 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170065704 0 0) 0x7efe9c0033f0 con 0x7efeb0065f10 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 msgr2=0x7efeb01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efeb01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 >> v1:172.21.15.118:6789/0 conn(0x7efeb0066370 legacy=0x7efeb00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00a6d50 con 0x7efeb0065f10 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7efe98001470 con 0x7efeb0065f10 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 >> v1:172.21.15.98:6789/0 conn(0x7efeb0065f10 legacy=0x7efeb00bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efe9c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe9c003e40 0x7efe9c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe9c004b80 0x7efe9c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c2010 con 0x7efe9c004b80 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c00b990 con 0x7efe9c003e40 2023-08-22T00:21:56.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c00bb50 con 0x7efeb0153cf0 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaffff700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe9c004b80 0x7efe9c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaeffd700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe9c003e40 0x7efe9c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.852+0000 7efeaf7fe700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efe9c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 -- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 msgr2=0x7efe9c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0153cf0 0x7efe9c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 -- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe9c003e40 msgr2=0x7efe9c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe9c003e40 0x7efe9c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 -- 172.21.15.98:0/1079103370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0033f0 con 0x7efe9c004b80 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe9c004b80 0x7efe9c005000 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7efea8001e60 tx=0x7efea8007f30).ready entity=mon.0 client_cookie=38051e645008f350 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8006a20 con 0x7efe9c004b80 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8006b80 con 0x7efe9c004b80 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeae7fc700 1 -- 172.21.15.98:0/1079103370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800c6a0 con 0x7efe9c004b80 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 -- 172.21.15.98:0/1079103370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe9c004b80 msgr2=0x7efe9c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1079103370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe9c004b80 0x7efe9c005000 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7efea8001e60 tx=0x7efea8007f30).stop 2023-08-22T00:21:56.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeaffff700 1 -- 172.21.15.98:0/1079103370 reap_dead start 2023-08-22T00:21:56.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 -- 172.21.15.98:0/1079103370 shutdown_connections 2023-08-22T00:21:56.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 -- 172.21.15.98:0/1079103370 >> 172.21.15.98:0/1079103370 conn(0x7efeb00c7770 msgr2=0x7efeb00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:56.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 -- 172.21.15.98:0/1079103370 shutdown_connections 2023-08-22T00:21:56.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.853+0000 7efeb61c8700 1 -- 172.21.15.98:0/1079103370 wait complete. 2023-08-22T00:21:56.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 Processor -- start 2023-08-22T00:21:56.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 -- start start 2023-08-22T00:21:56.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb00ac090 0x7efeb00ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0150960 0x7efeb0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01527a0 con 0x7efeb0066880 2023-08-22T00:21:56.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0152310 con 0x7efeb00ac090 2023-08-22T00:21:56.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.855+0000 7efeb61c8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00671f0 con 0x7efeb0150960 2023-08-22T00:21:56.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39118/0 (socket says 172.21.15.98:39118) 2023-08-22T00:21:56.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 -- 172.21.15.98:0/1750179491 learned_addr learned my addr 172.21.15.98:0/1750179491 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:56.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaffff700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0150960 0x7efeb0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaf7fe700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb00ac090 0x7efeb00ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 -- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0150960 msgr2=0x7efeb0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0150960 0x7efeb0150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 -- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb00ac090 msgr2=0x7efeb00ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:56.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb00ac090 0x7efeb00ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 -- 172.21.15.98:0/1750179491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0151700 con 0x7efeb0066880 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeaeffd700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7efe98004ad0 tx=0x7efe98001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800f9a0 con 0x7efeb0066880 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800fb00 con 0x7efeb0066880 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800fea0 con 0x7efeb0066880 2023-08-22T00:21:56.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb01519e0 con 0x7efeb0066880 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.856+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0151fa0 con 0x7efeb0066880 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.857+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb01524c0 con 0x7efeb0066880 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.857+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7efe98012560 con 0x7efeb0066880 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.858+0000 7efea77fe700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 0x7efe90061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.858+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7efe98079900 con 0x7efeb0066880 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.858+0000 7efeaf7fe700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 0x7efe90061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:56.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.858+0000 7efeaf7fe700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 0x7efe90061300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efea0006d50 tx=0x7efea0008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:56.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:56.862+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efeb01524c0 con 0x7efeb0066880 2023-08-22T00:21:57.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.022+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb01524c0 con 0x7efeb0066880 2023-08-22T00:21:57.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.023+0000 7efea77fe700 1 -- 172.21.15.98:0/1750179491 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17287 (secure 0 0 0) 0x7efeb01524c0 con 0x7efeb0066880 2023-08-22T00:21:57.024 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:57.025 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":104,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:56.699070+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:57.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.024+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 msgr2=0x7efe90061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.024+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 0x7efe90061300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efea0006d50 tx=0x7efea0008040).stop 2023-08-22T00:21:57.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 msgr2=0x7efeb0066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7efe98004ad0 tx=0x7efe98001e50).stop 2023-08-22T00:21:57.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 shutdown_connections 2023-08-22T00:21:57.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efe9005ee40 0x7efe90061300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb0150960 0x7efeb0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb00ac090 0x7efeb00ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 --2- 172.21.15.98:0/1750179491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb0066880 0x7efeb0066d00 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 >> 172.21.15.98:0/1750179491 conn(0x7efeb00c7770 msgr2=0x7efeb0065360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 shutdown_connections 2023-08-22T00:21:57.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.025+0000 7efeb61c8700 1 -- 172.21.15.98:0/1750179491 wait complete. 2023-08-22T00:21:57.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:57.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.154+0000 7fecd88bd700 1 Processor -- start 2023-08-22T00:21:57.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.154+0000 7fecd88bd700 1 -- start start 2023-08-22T00:21:57.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd88bd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fecd4150040 0x7fecd4150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd88bd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fecd4153f10 0x7fecd40c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd88bd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40c2220 con 0x7fecd40c59b0 2023-08-22T00:21:57.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd88bd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40c1ef0 con 0x7fecd4153f10 2023-08-22T00:21:57.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd88bd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40c5e30 con 0x7fecd4150040 2023-08-22T00:21:57.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fecd4153f10 0x7fecd40c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd2d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fecd40c59b0 0x7fecd40c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42688/0 (socket says 172.21.15.98:42688) 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fecd4153f10 0x7fecd40c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39124/0 (socket says 172.21.15.98:39124) 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.155+0000 7fecd2d9d700 1 -- 172.21.15.98:0/2749652253 learned_addr learned my addr 172.21.15.98:0/2749652253 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd259c700 1 --2- 172.21.15.98:0/2749652253 >> v2:172.21.15.118:3300/0 conn(0x7fecd4150040 0x7fecd4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd1d9b700 1 -- 172.21.15.98:0/2749652253 >> v2:172.21.15.118:3300/0 conn(0x7fecd4150040 msgr2=0x7fecd4150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:57.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd1d9b700 1 --2- 172.21.15.98:0/2749652253 >> v2:172.21.15.118:3300/0 conn(0x7fecd4150040 0x7fecd4150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd1d9b700 1 -- 172.21.15.98:0/2749652253 >> v1:172.21.15.98:6789/0 conn(0x7fecd40c59b0 legacy=0x7fecd40c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd159a700 1 -- 172.21.15.98:0/2749652253 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936481911 0 0) 0x7fecd40c2220 con 0x7fecd40c59b0 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd1d9b700 1 -- 172.21.15.98:0/2749652253 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40c6110 con 0x7fecd4153f10 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd1d9b700 1 --2- 172.21.15.98:0/2749652253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40c54c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fecd4067f40 tx=0x7fecbc009060).ready entity=mon.0 client_cookie=fd862f95732717e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd159a700 1 -- 172.21.15.98:0/2749652253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00b580 con 0x7fecd4153f10 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd159a700 1 -- 172.21.15.98:0/2749652253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00b6e0 con 0x7fecd4153f10 2023-08-22T00:21:57.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd159a700 1 -- 172.21.15.98:0/2749652253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00ba60 con 0x7fecd4153f10 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd88bd700 1 -- 172.21.15.98:0/2749652253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 msgr2=0x7fecd40c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.156+0000 7fecd88bd700 1 --2- 172.21.15.98:0/2749652253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40c54c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fecd4067f40 tx=0x7fecbc009060).stop 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 -- 172.21.15.98:0/2749652253 shutdown_connections 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 --2- 172.21.15.98:0/2749652253 >> v2:172.21.15.118:3300/0 conn(0x7fecd4150040 0x7fecd4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 --2- 172.21.15.98:0/2749652253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40c54c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 -- 172.21.15.98:0/2749652253 >> 172.21.15.98:0/2749652253 conn(0x7fecd40c7140 msgr2=0x7fecd40c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 -- 172.21.15.98:0/2749652253 shutdown_connections 2023-08-22T00:21:57.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.157+0000 7fecd88bd700 1 -- 172.21.15.98:0/2749652253 wait complete. 2023-08-22T00:21:57.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.158+0000 7fecd88bd700 1 Processor -- start 2023-08-22T00:21:57.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.158+0000 7fecd88bd700 1 -- start start 2023-08-22T00:21:57.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd40c59b0 0x7fecd414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecd4150040 0x7fecd40a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4150b20 con 0x7fecd4153f10 2023-08-22T00:21:57.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4150cb0 con 0x7fecd40c59b0 2023-08-22T00:21:57.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd88bd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40a4240 con 0x7fecd4150040 2023-08-22T00:21:57.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39138/0 (socket says 172.21.15.98:39138) 2023-08-22T00:21:57.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 -- 172.21.15.98:0/88376207 learned_addr learned my addr 172.21.15.98:0/88376207 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:57.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd259c700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd40c59b0 0x7fecd414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd1d9b700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecd4150040 0x7fecd40a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 -- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecd4150040 msgr2=0x7fecd40a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecd4150040 0x7fecd40a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 -- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd40c59b0 msgr2=0x7fecd414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd40c59b0 0x7fecd414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.159+0000 7fecd2d9d700 1 -- 172.21.15.98:0/88376207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0092a0 con 0x7fecd4153f10 2023-08-22T00:21:57.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecd2d9d700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7feccc00c810 tx=0x7feccc007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc005d30 con 0x7fecd4153f10 2023-08-22T00:21:57.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc005e90 con 0x7fecd4153f10 2023-08-22T00:21:57.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd40a4520 con 0x7fecd4153f10 2023-08-22T00:21:57.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc007360 con 0x7fecd4153f10 2023-08-22T00:21:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.160+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd40a4ae0 con 0x7fecd4153f10 2023-08-22T00:21:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.161+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4150e40 con 0x7fecd4153f10 2023-08-22T00:21:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.161+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7feccc007710 con 0x7fecd4153f10 2023-08-22T00:21:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.161+0000 7fecca7fc700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 0x7fecb40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.161+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7feccc079e30 con 0x7fecd4153f10 2023-08-22T00:21:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.161+0000 7fecd259c700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 0x7fecb40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.162+0000 7fecd259c700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 0x7fecb40612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fecc400bbc0 tx=0x7fecc4008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.166+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feccc04b140 con 0x7fecd4153f10 2023-08-22T00:21:57.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.329+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd4047480 con 0x7fecd4153f10 2023-08-22T00:21:57.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.330+0000 7fecca7fc700 1 -- 172.21.15.98:0/88376207 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17287 (secure 0 0 0) 0x7feccc04e760 con 0x7fecd4153f10 2023-08-22T00:21:57.332 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:57.332 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":104,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:56.699070+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:57.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 msgr2=0x7fecb40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 0x7fecb40612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fecc400bbc0 tx=0x7fecc4008040).stop 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 msgr2=0x7fecd40a6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7feccc00c810 tx=0x7feccc007f30).stop 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 shutdown_connections 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecd4153f10 0x7fecd40a6620 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd40c59b0 0x7fecd414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fecb405ee10 0x7fecb40612d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 --2- 172.21.15.98:0/88376207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecd4150040 0x7fecd40a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 >> 172.21.15.98:0/88376207 conn(0x7fecd40c7140 msgr2=0x7fecd40bcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 shutdown_connections 2023-08-22T00:21:57.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.332+0000 7fecd88bd700 1 -- 172.21.15.98:0/88376207 wait complete. 2023-08-22T00:21:57.346 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:21:57.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.463+0000 7fbc5ac69700 1 Processor -- start 2023-08-22T00:21:57.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.463+0000 7fbc5ac69700 1 -- start start 2023-08-22T00:21:57.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc5ac69700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc540c5360 0x7fbc54066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc5ac69700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc540c69b0 con 0x7fbc54157890 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc5ac69700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc541542c0 con 0x7fbc54066150 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc5ac69700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc540c57f0 con 0x7fbc540c5360 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc540c5360 0x7fbc54066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc540c5360 0x7fbc54066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39152/0 (socket says 172.21.15.98:39152) 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 -- 172.21.15.98:0/1077037106 learned_addr learned my addr 172.21.15.98:0/1077037106 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 -- 172.21.15.98:0/1077037106 >> v1:172.21.15.118:6789/0 conn(0x7fbc54066150 legacy=0x7fbc540c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:57.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 -- 172.21.15.98:0/1077037106 >> v1:172.21.15.98:6789/0 conn(0x7fbc54157890 legacy=0x7fbc540c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 -- 172.21.15.98:0/1077037106 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540c5ad0 con 0x7fbc540c5360 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc53fff700 1 --2- 172.21.15.98:0/1077037106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc540c5360 0x7fbc54066530 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fbc40006fd0 tx=0x7fbc400090f0).ready entity=mon.0 client_cookie=e7ede8e148f43413 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc537fe700 1 -- 172.21.15.98:0/1077037106 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000b600 con 0x7fbc540c5360 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc537fe700 1 -- 172.21.15.98:0/1077037106 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000b760 con 0x7fbc540c5360 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.464+0000 7fbc537fe700 1 -- 172.21.15.98:0/1077037106 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000bae0 con 0x7fbc540c5360 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 -- 172.21.15.98:0/1077037106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc540c5360 msgr2=0x7fbc54066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/1077037106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc540c5360 0x7fbc54066530 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fbc40006fd0 tx=0x7fbc400090f0).stop 2023-08-22T00:21:57.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 -- 172.21.15.98:0/1077037106 shutdown_connections 2023-08-22T00:21:57.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/1077037106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc540c5360 0x7fbc54066530 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 -- 172.21.15.98:0/1077037106 >> 172.21.15.98:0/1077037106 conn(0x7fbc540c7800 msgr2=0x7fbc540c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 -- 172.21.15.98:0/1077037106 shutdown_connections 2023-08-22T00:21:57.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.465+0000 7fbc5ac69700 1 -- 172.21.15.98:0/1077037106 wait complete. 2023-08-22T00:21:57.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.466+0000 7fbc5ac69700 1 Processor -- start 2023-08-22T00:21:57.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.466+0000 7fbc5ac69700 1 -- start start 2023-08-22T00:21:57.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54157890 0x7fbc54152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc54153480 0x7fbc540a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5414e090 con 0x7fbc54066150 2023-08-22T00:21:57.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5414ec10 con 0x7fbc54157890 2023-08-22T00:21:57.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc5ac69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc541538e0 con 0x7fbc54153480 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39156/0 (socket says 172.21.15.98:39156) 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 -- 172.21.15.98:0/2064814598 learned_addr learned my addr 172.21.15.98:0/2064814598 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc53fff700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54157890 0x7fbc54152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc59206700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc54153480 0x7fbc540a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 -- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc54153480 msgr2=0x7fbc540a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc54153480 0x7fbc540a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 -- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54157890 msgr2=0x7fbc54152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54157890 0x7fbc54152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 -- 172.21.15.98:0/2064814598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009370 con 0x7fbc54066150 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.467+0000 7fbc58a05700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fbc4800c470 tx=0x7fbc48007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.468+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4800f470 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.468+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4800f5f0 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.468+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5414e2e0 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.468+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4800f9b0 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.468+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5414e8a0 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.469+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc54069220 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.469+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbc48012400 con 0x7fbc54066150 2023-08-22T00:21:57.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.469+0000 7fbc50ff9700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 0x7fbc380612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.469+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbc480794a0 con 0x7fbc54066150 2023-08-22T00:21:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.470+0000 7fbc53fff700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 0x7fbc380612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.470+0000 7fbc53fff700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 0x7fbc380612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbc40006fd0 tx=0x7fbc40017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.473+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc480488f0 con 0x7fbc54066150 2023-08-22T00:21:57.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.675+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbc540c5db0 con 0x7fbc54066150 2023-08-22T00:21:57.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.703+0000 7fbc50ff9700 1 -- 172.21.15.98:0/2064814598 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbc4804a800 con 0x7fbc54066150 2023-08-22T00:21:57.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 msgr2=0x7fbc380612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 0x7fbc380612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbc40006fd0 tx=0x7fbc40017000).stop 2023-08-22T00:21:57.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 msgr2=0x7fbc541444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fbc4800c470 tx=0x7fbc48007de0).stop 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 shutdown_connections 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc3805ee10 0x7fbc380612d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc54153480 0x7fbc540a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54066150 0x7fbc541444f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 --2- 172.21.15.98:0/2064814598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54157890 0x7fbc54152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 >> 172.21.15.98:0/2064814598 conn(0x7fbc540c7800 msgr2=0x7fbc54064970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 shutdown_connections 2023-08-22T00:21:57.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.705+0000 7fbc5ac69700 1 -- 172.21.15.98:0/2064814598 wait complete. 2023-08-22T00:21:57.719 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:21:57.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.836+0000 7f2643df8700 1 Processor -- start 2023-08-22T00:21:57.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.836+0000 7f2643df8700 1 -- start start 2023-08-22T00:21:57.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2643df8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f263c1505e0 0x7f263c062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2643df8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c063f90 con 0x7f263c0c2620 2023-08-22T00:21:57.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2643df8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0656f0 con 0x7f263c063380 2023-08-22T00:21:57.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2643df8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0637e0 con 0x7f263c1505e0 2023-08-22T00:21:57.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2642395700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f263c0c2620 0x7f263c065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42710/0 (socket says 172.21.15.98:42710) 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2642395700 1 -- 172.21.15.98:0/3053347522 learned_addr learned my addr 172.21.15.98:0/3053347522 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2641b94700 1 --2- 172.21.15.98:0/3053347522 >> v2:172.21.15.118:3300/0 conn(0x7f263c1505e0 0x7f263c062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066334986 0 0) 0x7f263c063f90 con 0x7f263c0c2620 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26280033f0 con 0x7f263c0c2620 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153953968 0 0) 0x7f26280033f0 con 0x7f263c0c2620 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 >> v2:172.21.15.118:3300/0 conn(0x7f263c1505e0 msgr2=0x7f263c062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:57.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 --2- 172.21.15.98:0/3053347522 >> v2:172.21.15.118:3300/0 conn(0x7f263c1505e0 0x7f263c062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 >> v1:172.21.15.118:6789/0 conn(0x7f263c063380 legacy=0x7f263c0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c1509c0 con 0x7f263c0c2620 2023-08-22T00:21:57.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f26340017f0 con 0x7f263c0c2620 2023-08-22T00:21:57.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 >> v1:172.21.15.98:6789/0 conn(0x7f263c0c2620 legacy=0x7f263c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 0x7f2628003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2628004690 0x7f2628004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2628005000 0x7f262800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0637e0 con 0x7f26280038e0 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262800bf60 con 0x7f2628005000 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.837+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262800c0f0 con 0x7f2628004690 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 0x7f2628003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2642395700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2628005000 0x7f262800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641393700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2628004690 0x7f2628004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 -- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2628004690 msgr2=0x7f2628004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2628004690 0x7f2628004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 -- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2628005000 msgr2=0x7f262800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2628005000 0x7f262800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2642395700 1 -- 172.21.15.98:0/3053347522 reap_dead start 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 -- 172.21.15.98:0/3053347522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280033f0 con 0x7f26280038e0 2023-08-22T00:21:57.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2641b94700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 0x7f2628003d00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f2638009a80 tx=0x7f2638009060).ready entity=mon.0 client_cookie=13a2a061e517aa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638009430 con 0x7f26280038e0 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800e640 con 0x7f26280038e0 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2640b92700 1 -- 172.21.15.98:0/3053347522 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800e9c0 con 0x7f26280038e0 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2643df8700 1 -- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 msgr2=0x7f2628003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2643df8700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 0x7f2628003d00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f2638009a80 tx=0x7f2638009060).stop 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2643df8700 1 -- 172.21.15.98:0/3053347522 shutdown_connections 2023-08-22T00:21:57.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2643df8700 1 --2- 172.21.15.98:0/3053347522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26280038e0 0x7f2628003d00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.838+0000 7f2643df8700 1 -- 172.21.15.98:0/3053347522 >> 172.21.15.98:0/3053347522 conn(0x7f263c0c31d0 msgr2=0x7f263c0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:57.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.839+0000 7f2643df8700 1 -- 172.21.15.98:0/3053347522 shutdown_connections 2023-08-22T00:21:57.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.839+0000 7f2643df8700 1 -- 172.21.15.98:0/3053347522 wait complete. 2023-08-22T00:21:57.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 Processor -- start 2023-08-22T00:21:57.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 -- start start 2023-08-22T00:21:57.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26280038e0 0x7f263c1313f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f263c152df0 0x7f263c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c145b30 con 0x7f263c144530 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c153760 con 0x7f26280038e0 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.840+0000 7f2643df8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c144fb0 con 0x7f263c152df0 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39172/0 (socket says 172.21.15.98:39172) 2023-08-22T00:21:57.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 -- 172.21.15.98:0/3962062350 learned_addr learned my addr 172.21.15.98:0/3962062350 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641b94700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26280038e0 0x7f263c1313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 -- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f263c152df0 msgr2=0x7f263c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f263c152df0 0x7f263c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 -- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26280038e0 msgr2=0x7f263c1313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26280038e0 0x7f263c1313f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 -- 172.21.15.98:0/3962062350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c145290 con 0x7f263c144530 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2641393700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f262c00e570 tx=0x7f262c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c010450 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c0105b0 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c145570 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c010930 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.841+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c1481d0 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.842+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c0650c0 con 0x7f263c144530 2023-08-22T00:21:57.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.842+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f262c010ce0 con 0x7f263c144530 2023-08-22T00:21:57.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.843+0000 7f2631ffb700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 0x7f26200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:57.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.843+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f262c079af0 con 0x7f263c144530 2023-08-22T00:21:57.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.843+0000 7f2641b94700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 0x7f26200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:57.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.843+0000 7f2641b94700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 0x7f26200612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2638006d50 tx=0x7f263801a000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:57.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:57.847+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f262c0498f0 con 0x7f263c144530 2023-08-22T00:21:58.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.047+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f263c063d70 con 0x7f263c144530 2023-08-22T00:21:58.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.709+0000 7f2631ffb700 1 -- 172.21.15.98:0/3962062350 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f262c04ada0 con 0x7f263c144530 2023-08-22T00:21:58.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 msgr2=0x7f26200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 0x7f26200612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2638006d50 tx=0x7f263801a000).stop 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 msgr2=0x7f263c1449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f262c00e570 tx=0x7f262c009040).stop 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 shutdown_connections 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f262005ee10 0x7f26200612d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f263c152df0 0x7f263c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:21:58.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26280038e0 0x7f263c1313f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 --2- 172.21.15.98:0/3962062350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f263c144530 0x7f263c1449b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 >> 172.21.15.98:0/3962062350 conn(0x7f263c0c31d0 msgr2=0x7f263c0a8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:58.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 shutdown_connections 2023-08-22T00:21:58.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.712+0000 7f2643df8700 1 -- 172.21.15.98:0/3962062350 wait complete. 2023-08-22T00:21:58.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:21:58.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.849+0000 7ff34e92a700 1 Processor -- start 2023-08-22T00:21:58.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.849+0000 7ff34e92a700 1 -- start start 2023-08-22T00:21:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34e92a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff348154260 0x7ff3480c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34e92a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3480bc850 0x7ff348154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34e92a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3480c4fb0 con 0x7ff348154b30 2023-08-22T00:21:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34e92a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34814e7b0 con 0x7ff348154260 2023-08-22T00:21:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34e92a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3480bcfc0 con 0x7ff3480bc850 2023-08-22T00:21:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff348154260 0x7ff3480c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff348154260 0x7ff3480c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39176/0 (socket says 172.21.15.98:39176) 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 -- 172.21.15.98:0/1539572275 learned_addr learned my addr 172.21.15.98:0/1539572275 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff34cec7700 1 --1- 172.21.15.98:0/1539572275 >> v1:172.21.15.98:6789/0 conn(0x7ff348154b30 0x7ff3480c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42712/0 (socket says 172.21.15.98:42712) 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff3477fe700 1 --2- 172.21.15.98:0/1539572275 >> v2:172.21.15.118:3300/0 conn(0x7ff3480bc850 0x7ff348154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 -- 172.21.15.98:0/1539572275 >> v2:172.21.15.118:3300/0 conn(0x7ff3480bc850 msgr2=0x7ff348154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 --2- 172.21.15.98:0/1539572275 >> v2:172.21.15.118:3300/0 conn(0x7ff3480bc850 0x7ff348154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 -- 172.21.15.98:0/1539572275 >> v1:172.21.15.98:6789/0 conn(0x7ff348154b30 legacy=0x7ff3480c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 -- 172.21.15.98:0/1539572275 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480bd2a0 con 0x7ff348154260 2023-08-22T00:21:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff346ffd700 1 -- 172.21.15.98:0/1539572275 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301931475 0 0) 0x7ff3480c4fb0 con 0x7ff348154b30 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.850+0000 7ff347fff700 1 --2- 172.21.15.98:0/1539572275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154260 0x7ff3480c2030 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7ff3480c6eb0 tx=0x7ff33c0090f0).ready entity=mon.0 client_cookie=931c1752e610996f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff346ffd700 1 -- 172.21.15.98:0/1539572275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00b690 con 0x7ff348154260 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff346ffd700 1 -- 172.21.15.98:0/1539572275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c00b7f0 con 0x7ff348154260 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff346ffd700 1 -- 172.21.15.98:0/1539572275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00bb70 con 0x7ff348154260 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 -- 172.21.15.98:0/1539572275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154260 msgr2=0x7ff3480c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 --2- 172.21.15.98:0/1539572275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154260 0x7ff3480c2030 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7ff3480c6eb0 tx=0x7ff33c0090f0).stop 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 -- 172.21.15.98:0/1539572275 shutdown_connections 2023-08-22T00:21:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 --2- 172.21.15.98:0/1539572275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154260 0x7ff3480c2030 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 --2- 172.21.15.98:0/1539572275 >> v2:172.21.15.118:3300/0 conn(0x7ff3480bc850 0x7ff348154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 -- 172.21.15.98:0/1539572275 >> 172.21.15.98:0/1539572275 conn(0x7ff3480c3980 msgr2=0x7ff3480c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 -- 172.21.15.98:0/1539572275 shutdown_connections 2023-08-22T00:21:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.851+0000 7ff34e92a700 1 -- 172.21.15.98:0/1539572275 wait complete. 2023-08-22T00:21:58.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.852+0000 7ff34e92a700 1 Processor -- start 2023-08-22T00:21:58.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.852+0000 7ff34e92a700 1 -- start start 2023-08-22T00:21:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3480bc850 0x7ff34814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff348154260 0x7ff34814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480aada0 con 0x7ff348154b30 2023-08-22T00:21:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480ab080 con 0x7ff3480bc850 2023-08-22T00:21:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34e92a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480ab360 con 0x7ff348154260 2023-08-22T00:21:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34cec7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34cec7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39192/0 (socket says 172.21.15.98:39192) 2023-08-22T00:21:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff34cec7700 1 -- 172.21.15.98:0/725553300 learned_addr learned my addr 172.21.15.98:0/725553300 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff347fff700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3480bc850 0x7ff34814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.853+0000 7ff3477fe700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff348154260 0x7ff34814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 -- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff348154260 msgr2=0x7ff34814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff348154260 0x7ff34814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 -- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3480bc850 msgr2=0x7ff34814d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3480bc850 0x7ff34814d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 -- 172.21.15.98:0/725553300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009370 con 0x7ff348154b30 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34cec7700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7ff34000c810 tx=0x7ff3400014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340005c70 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff340005dd0 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3480ab640 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340007340 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.854+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34814dec0 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.855+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3480abb60 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.855+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff340007730 con 0x7ff348154b30 2023-08-22T00:21:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.855+0000 7ff32ffff700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 0x7ff3340612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.856+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff340079ea0 con 0x7ff348154b30 2023-08-22T00:21:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.856+0000 7ff347fff700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 0x7ff3340612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.856+0000 7ff347fff700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 0x7ff3340612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff33c009130 tx=0x7ff33c017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:58.860+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3480abb60 con 0x7ff348154b30 2023-08-22T00:21:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.060+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3480abb60 con 0x7ff348154b30 2023-08-22T00:21:59.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.060+0000 7ff32ffff700 1 -- 172.21.15.98:0/725553300 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff3480abb60 con 0x7ff348154b30 2023-08-22T00:21:59.062 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:59.062 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:21:59.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 msgr2=0x7ff3340612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 0x7ff3340612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff33c009130 tx=0x7ff33c017000).stop 2023-08-22T00:21:59.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 msgr2=0x7ff34814f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7ff34000c810 tx=0x7ff3400014a0).stop 2023-08-22T00:21:59.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 shutdown_connections 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff348154b30 0x7ff34814f130 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3480bc850 0x7ff34814d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff33405ee10 0x7ff3340612d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 --2- 172.21.15.98:0/725553300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff348154260 0x7ff34814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 >> 172.21.15.98:0/725553300 conn(0x7ff3480c3980 msgr2=0x7ff348153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 shutdown_connections 2023-08-22T00:21:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.062+0000 7ff34e92a700 1 -- 172.21.15.98:0/725553300 wait complete. 2023-08-22T00:21:59.067 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:21:59.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:21:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.190+0000 7fb15569a700 1 Processor -- start 2023-08-22T00:21:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.190+0000 7fb15569a700 1 -- start start 2023-08-22T00:21:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb15569a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb150157ad0 0x7fb1500c1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb15569a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500c6a80 con 0x7fb150158340 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb15569a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500c2150 con 0x7fb150157eb0 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb15569a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1501587d0 con 0x7fb150157ad0 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb150158340 0x7fb1500bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42722/0 (socket says 172.21.15.98:42722) 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14f7fe700 1 -- 172.21.15.98:0/748637333 learned_addr learned my addr 172.21.15.98:0/748637333 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14effd700 1 --2- 172.21.15.98:0/748637333 >> v2:172.21.15.118:3300/0 conn(0x7fb150157ad0 0x7fb1500c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61056462 0 0) 0x7fb1500c6a80 con 0x7fb150158340 2023-08-22T00:21:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1380033f0 con 0x7fb150158340 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073494497 0 0) 0x7fb1500c2150 con 0x7fb150157eb0 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1500c6a80 con 0x7fb150157eb0 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 868971981 0 0) 0x7fb1380033f0 con 0x7fb150158340 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 >> v2:172.21.15.118:3300/0 conn(0x7fb150157ad0 msgr2=0x7fb1500c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 --2- 172.21.15.98:0/748637333 >> v2:172.21.15.118:3300/0 conn(0x7fb150157ad0 0x7fb1500c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 >> v1:172.21.15.118:6789/0 conn(0x7fb150157eb0 legacy=0x7fb1500a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500c5e70 con 0x7fb150158340 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb1480017f0 con 0x7fb150158340 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 >> v1:172.21.15.98:6789/0 conn(0x7fb150158340 legacy=0x7fb1500bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb138003a70 0x7fb138003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.191+0000 7fb14dffb700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb138004690 0x7fb138004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb13800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800be80 con 0x7fb138005000 2023-08-22T00:21:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bfc0 con 0x7fb138004690 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800c180 con 0x7fb138003a70 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb13800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14effd700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb138003a70 0x7fb138003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14e7fc700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb138004690 0x7fb138004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 -- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb138003a70 msgr2=0x7fb138003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb138003a70 0x7fb138003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 -- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb138004690 msgr2=0x7fb138004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb138004690 0x7fb138004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 -- 172.21.15.98:0/748637333 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380033f0 con 0x7fb138005000 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 -- 172.21.15.98:0/748637333 reap_dead start 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14f7fe700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb13800b8e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fb14800c5c0 tx=0x7fb1500c22e0).ready entity=mon.0 client_cookie=f723908ba342fa76 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800cdc0 con 0x7fb138005000 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148005b20 con 0x7fb138005000 2023-08-22T00:21:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.192+0000 7fb14dffb700 1 -- 172.21.15.98:0/748637333 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148005ea0 con 0x7fb138005000 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 -- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 msgr2=0x7fb13800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb13800b8e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fb14800c5c0 tx=0x7fb1500c22e0).stop 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 -- 172.21.15.98:0/748637333 shutdown_connections 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 --2- 172.21.15.98:0/748637333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb13800b8e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 -- 172.21.15.98:0/748637333 >> 172.21.15.98:0/748637333 conn(0x7fb1500c3990 msgr2=0x7fb1500c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 -- 172.21.15.98:0/748637333 shutdown_connections 2023-08-22T00:21:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.193+0000 7fb15569a700 1 -- 172.21.15.98:0/748637333 wait complete. 2023-08-22T00:21:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.194+0000 7fb15569a700 1 Processor -- start 2023-08-22T00:21:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.194+0000 7fb15569a700 1 -- start start 2023-08-22T00:21:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb15015a330 0x7fb1501437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb150143cb0 0x7fb1500636e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500aa7a0 con 0x7fb138005000 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500aaa80 con 0x7fb150143cb0 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb15569a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500aad60 con 0x7fb15015a330 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39218/0 (socket says 172.21.15.98:39218) 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 -- 172.21.15.98:0/3597171369 learned_addr learned my addr 172.21.15.98:0/3597171369 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14e7fc700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb15015a330 0x7fb1501437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14f7fe700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb150143cb0 0x7fb1500636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 -- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb15015a330 msgr2=0x7fb1501437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb15015a330 0x7fb1501437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 -- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb150143cb0 msgr2=0x7fb1500636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb150143cb0 0x7fb1500636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 -- 172.21.15.98:0/3597171369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500ab040 con 0x7fb138005000 2023-08-22T00:21:59.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb14effd700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fb1400119c0 tx=0x7fb140009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140013680 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1400137e0 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.195+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140013b60 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.196+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500a6e20 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.196+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500aa550 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.196+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb150047480 con 0x7fb138005000 2023-08-22T00:21:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.197+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb140014440 con 0x7fb138005000 2023-08-22T00:21:59.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.197+0000 7fb136ffd700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 0x7fb13c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.197+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb14007a9d0 con 0x7fb138005000 2023-08-22T00:21:59.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.197+0000 7fb14e7fc700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 0x7fb13c0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.198+0000 7fb14e7fc700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 0x7fb13c0612a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb15015a880 tx=0x7fb144007bb0).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.201+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb14004bc80 con 0x7fb138005000 2023-08-22T00:21:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.363+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1500c6150 con 0x7fb138005000 2023-08-22T00:21:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.364+0000 7fb136ffd700 1 -- 172.21.15.98:0/3597171369 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+17274 (secure 0 0 0) 0x7fb14004f2a0 con 0x7fb138005000 2023-08-22T00:21:59.365 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:59.365 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":105,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:21:57.701363+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:21:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.365+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 msgr2=0x7fb13c0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.365+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 0x7fb13c0612a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb15015a880 tx=0x7fb144007bb0).stop 2023-08-22T00:21:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.365+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 msgr2=0x7fb1500a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.365+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fb1400119c0 tx=0x7fb140009060).stop 2023-08-22T00:21:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 shutdown_connections 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb150143cb0 0x7fb1500636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb138005000 0x7fb1500a9ea0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb13c05ede0 0x7fb13c0612a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 --2- 172.21.15.98:0/3597171369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb15015a330 0x7fb1501437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 >> 172.21.15.98:0/3597171369 conn(0x7fb1500c3990 msgr2=0x7fb1500c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 shutdown_connections 2023-08-22T00:21:59.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.366+0000 7fb15569a700 1 -- 172.21.15.98:0/3597171369 wait complete. 2023-08-22T00:21:59.379 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:21:59.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:59.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.494+0000 7ff9fb501700 1 Processor -- start 2023-08-22T00:21:59.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.494+0000 7ff9fb501700 1 -- start start 2023-08-22T00:21:59.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9fb501700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff9f4066620 0x7ff9f40c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9fb501700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f40bd3e0 con 0x7ff9f4150e40 2023-08-22T00:21:59.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9fb501700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f40bd0c0 con 0x7ff9f40bd870 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9fb501700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40c3bb0 con 0x7ff9f4066620 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff9f4066620 0x7ff9f40c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f929d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff9f4150e40 0x7ff9f40a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42728/0 (socket says 172.21.15.98:42728) 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f929d700 1 -- 172.21.15.98:0/1799218549 learned_addr learned my addr 172.21.15.98:0/1799218549 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 --2- 172.21.15.98:0/1799218549 >> v2:172.21.15.98:3300/0 conn(0x7ff9f4066620 0x7ff9f40c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39220/0 (socket says 172.21.15.98:39220) 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 -- 172.21.15.98:0/1799218549 >> v1:172.21.15.118:6789/0 conn(0x7ff9f40bd870 legacy=0x7ff9f4065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 -- 172.21.15.98:0/1799218549 >> v1:172.21.15.98:6789/0 conn(0x7ff9f4150e40 legacy=0x7ff9f40a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 -- 172.21.15.98:0/1799218549 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40c3e90 con 0x7ff9f4066620 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9ebfff700 1 -- 172.21.15.98:0/1799218549 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700666389 0 0) 0x7ff9f40bd3e0 con 0x7ff9f4150e40 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9f9a9e700 1 --2- 172.21.15.98:0/1799218549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f40c2050 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff9ec009e60 tx=0x7ff9ec009780).ready entity=mon.0 client_cookie=6addec24f3fee78f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.495+0000 7ff9ebfff700 1 -- 172.21.15.98:0/1799218549 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00e070 con 0x7ff9f4066620 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9ebfff700 1 -- 172.21.15.98:0/1799218549 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec00bc30 con 0x7ff9f4066620 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9ebfff700 1 -- 172.21.15.98:0/1799218549 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec012410 con 0x7ff9f4066620 2023-08-22T00:21:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 -- 172.21.15.98:0/1799218549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 msgr2=0x7ff9f40c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 --2- 172.21.15.98:0/1799218549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f40c2050 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff9ec009e60 tx=0x7ff9ec009780).stop 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 -- 172.21.15.98:0/1799218549 shutdown_connections 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 --2- 172.21.15.98:0/1799218549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f40c2050 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 -- 172.21.15.98:0/1799218549 >> 172.21.15.98:0/1799218549 conn(0x7ff9f406a980 msgr2=0x7ff9f40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 -- 172.21.15.98:0/1799218549 shutdown_connections 2023-08-22T00:21:59.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.496+0000 7ff9fb501700 1 -- 172.21.15.98:0/1799218549 wait complete. 2023-08-22T00:21:59.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.497+0000 7ff9fb501700 1 Processor -- start 2023-08-22T00:21:59.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.497+0000 7ff9fb501700 1 -- start start 2023-08-22T00:21:59.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 0x7ff9f40aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9f4150e40 0x7ff9f40aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f4153c90 con 0x7ff9f4066620 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40abec0 con 0x7ff9f4150e40 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9fb501700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40ab2b0 con 0x7ff9f40bd870 2023-08-22T00:21:59.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9f929d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9f929d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39228/0 (socket says 172.21.15.98:39228) 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9f929d700 1 -- 172.21.15.98:0/224984638 learned_addr learned my addr 172.21.15.98:0/224984638 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9f9a9e700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9f4150e40 0x7ff9f40aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.498+0000 7ff9f8a9c700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 0x7ff9f40aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 -- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 msgr2=0x7ff9f40aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 0x7ff9f40aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 -- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9f4150e40 msgr2=0x7ff9f40aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9f4150e40 0x7ff9f40aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 -- 172.21.15.98:0/224984638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009a20 con 0x7ff9f4066620 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f8a9c700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 0x7ff9f40aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9f929d700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff9f000c4e0 tx=0x7ff9f0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00072e0 con 0x7ff9f4066620 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0007440 con 0x7ff9f4066620 2023-08-22T00:21:59.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00057a0 con 0x7ff9f4066620 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f40ab590 con 0x7ff9f4066620 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.499+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f40abb50 con 0x7ff9f4066620 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.500+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4047480 con 0x7ff9f4066620 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.500+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff9f0005bd0 con 0x7ff9f4066620 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.500+0000 7ff9e97fa700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 0x7ff9d80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.501+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff9f0079710 con 0x7ff9f4066620 2023-08-22T00:21:59.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.501+0000 7ff9f8a9c700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 0x7ff9d80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.501+0000 7ff9f8a9c700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 0x7ff9d80612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff9f40bf460 tx=0x7ff9e4009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.505+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9f004aa20 con 0x7ff9f4066620 2023-08-22T00:21:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.661+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9f4067da0 con 0x7ff9d805ee10 2023-08-22T00:21:59.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.671+0000 7ff9e97fa700 1 -- 172.21.15.98:0/224984638 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350364 (secure 0 0 0) 0x7ff9f4067da0 con 0x7ff9d805ee10 2023-08-22T00:21:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:21:59.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.674+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 msgr2=0x7ff9d80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.674+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 0x7ff9d80612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff9f40bf460 tx=0x7ff9e4009040).stop 2023-08-22T00:21:59.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.674+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 msgr2=0x7ff9f414b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.674+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff9f000c4e0 tx=0x7ff9f0007c70).stop 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 shutdown_connections 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9f4150e40 0x7ff9f40aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f4066620 0x7ff9f414b450 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff9d805ee10 0x7ff9d80612d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 --2- 172.21.15.98:0/224984638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9f40bd870 0x7ff9f40aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 >> 172.21.15.98:0/224984638 conn(0x7ff9f406a980 msgr2=0x7ff9f40c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 shutdown_connections 2023-08-22T00:21:59.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.675+0000 7ff9fb501700 1 -- 172.21.15.98:0/224984638 wait complete. 2023-08-22T00:21:59.680 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:21:59.689 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:21:58.245363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2427368,"kb_used_data":9640,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752547352,"statfs":{"total":773094113280,"available":770608488448,"internally_reserved":0,"allocated":9871360,"data_stored":5184966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10334,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.054350"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775438+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:53.775438+0000","last_peered":"2023-08-22T00:21:53.775438+0000","last_clean":"2023-08-22T00:21:53.775438+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:53.775438+0000","last_undegraded":"2023-08-22T00:21:53.775438+0000","last_fullsized":"2023-08-22T00:21:53.775438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775199+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:53.775199+0000","last_peered":"2023-08-22T00:21:53.775199+0000","last_clean":"2023-08-22T00:21:53.775199+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:53.775199+0000","last_undegraded":"2023-08-22T00:21:53.775199+0000","last_fullsized":"2023-08-22T00:21:53.775199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.299559+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:52.299559+0000","last_peered":"2023-08-22T00:21:52.299559+0000","last_clean":"2023-08-22T00:21:52.299559+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:52.299559+0000","last_undegraded":"2023-08-22T00:21:52.299559+0000","last_fullsized":"2023-08-22T00:21:52.299559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775191+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:53.775191+0000","last_peered":"2023-08-22T00:21:53.775191+0000","last_clean":"2023-08-22T00:21:53.775191+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:53.775191+0000","last_undegraded":"2023-08-22T00:21:53.775191+0000","last_fullsized":"2023-08-22T00:21:53.775191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923605+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:52.923605+0000","last_peered":"2023-08-22T00:21:52.923605+0000","last_clean":"2023-08-22T00:21:52.923605+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:52.923605+0000","last_undegraded":"2023-08-22T00:21:52.923605+0000","last_fullsized":"2023-08-22T00:21:52.923605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923544+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:52.923544+0000","last_peered":"2023-08-22T00:21:52.923544+0000","last_clean":"2023-08-22T00:21:52.923544+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:52.923544+0000","last_undegraded":"2023-08-22T00:21:52.923544+0000","last_fullsized":"2023-08-22T00:21:52.923544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923475+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:52.923475+0000","last_peered":"2023-08-22T00:21:52.923475+0000","last_clean":"2023-08-22T00:21:52.923475+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:52.923475+0000","last_undegraded":"2023-08-22T00:21:52.923475+0000","last_fullsized":"2023-08-22T00:21:52.923475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775620+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:53.775620+0000","last_peered":"2023-08-22T00:21:53.775620+0000","last_clean":"2023-08-22T00:21:53.775620+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:53.775620+0000","last_undegraded":"2023-08-22T00:21:53.775620+0000","last_fullsized":"2023-08-22T00:21:53.775620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.294288+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:52.294288+0000","last_peered":"2023-08-22T00:21:52.294288+0000","last_clean":"2023-08-22T00:21:52.294288+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:52.294288+0000","last_undegraded":"2023-08-22T00:21:52.294288+0000","last_fullsized":"2023-08-22T00:21:52.294288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.73999999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.70099999999999996}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065344,"statfs":{"total":96636764160,"available":96322912256,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.71899999999999997,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.99299999999999999},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.29599999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.1339999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.79000000000000004},"last":0.51700000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.073},"last":0.749}]},{"osd":4,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.46200000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.63}]},{"osd":5,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65900000000000003,"5min":0.753,"15min":0.94399999999999995},"last":0.52800000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":1.03},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302388,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069452,"statfs":{"total":96636764160,"available":96327118848,"internally_reserved":0,"allocated":1224704,"data_stored":643419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.31},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.309}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.247},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27400000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.498},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.438},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.51300000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.246},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.318}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.379}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.221,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63600000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.438}]},{"osd":4,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.753},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.876,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.88100000000000001,"15min":11.163},"last":0.58799999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.79300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065344,"statfs":{"total":96636764160,"available":96322912256,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.58699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52000000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302388,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069452,"statfs":{"total":96636764160,"available":96327118848,"internally_reserved":0,"allocated":1224704,"data_stored":643419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:21:59.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:21:59.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.844+0000 7fdaddb16700 1 Processor -- start 2023-08-22T00:21:59.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.844+0000 7fdaddb16700 1 -- start start 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdaddb16700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814bf70 0x7fdad8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdaddb16700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdad814c350 0x7fdad81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdaddb16700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad8153080 con 0x7fdad80c3740 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdaddb16700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad8066510 con 0x7fdad814c350 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdaddb16700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80667b0 con 0x7fdad814bf70 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdad6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdad814c350 0x7fdad81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdad7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fdad80c3740 0x7fdad80aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42740/0 (socket says 172.21.15.98:42740) 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdad7fff700 1 -- 172.21.15.98:0/2970732438 learned_addr learned my addr 172.21.15.98:0/2970732438 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.845+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/2970732438 >> v2:172.21.15.98:3300/0 conn(0x7fdad814c350 0x7fdad81556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39232/0 (socket says 172.21.15.98:39232) 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad77fe700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814bf70 0x7fdad8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad6ffd700 1 -- 172.21.15.98:0/2970732438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814bf70 msgr2=0x7fdad8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814bf70 0x7fdad8152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad6ffd700 1 -- 172.21.15.98:0/2970732438 >> v1:172.21.15.98:6789/0 conn(0x7fdad80c3740 legacy=0x7fdad80aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad6ffd700 1 -- 172.21.15.98:0/2970732438 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad8155ba0 con 0x7fdad814c350 2023-08-22T00:21:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad67fc700 1 -- 172.21.15.98:0/2970732438 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735877214 0 0) 0x7fdad8153080 con 0x7fdad80c3740 2023-08-22T00:21:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad814c350 0x7fdad81556b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fdac0009760 tx=0x7fdac0009060).ready entity=mon.0 client_cookie=c252da5291aeab2a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad67fc700 1 -- 172.21.15.98:0/2970732438 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000b580 con 0x7fdad814c350 2023-08-22T00:21:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad67fc700 1 -- 172.21.15.98:0/2970732438 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000b6e0 con 0x7fdad814c350 2023-08-22T00:21:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdad67fc700 1 -- 172.21.15.98:0/2970732438 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000ba60 con 0x7fdad814c350 2023-08-22T00:21:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdaddb16700 1 -- 172.21.15.98:0/2970732438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad814c350 msgr2=0x7fdad81556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.846+0000 7fdaddb16700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad814c350 0x7fdad81556b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fdac0009760 tx=0x7fdac0009060).stop 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 -- 172.21.15.98:0/2970732438 shutdown_connections 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814bf70 0x7fdad8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 --2- 172.21.15.98:0/2970732438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad814c350 0x7fdad81556b0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 -- 172.21.15.98:0/2970732438 >> 172.21.15.98:0/2970732438 conn(0x7fdad80c5dc0 msgr2=0x7fdad8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 -- 172.21.15.98:0/2970732438 shutdown_connections 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.847+0000 7fdaddb16700 1 -- 172.21.15.98:0/2970732438 wait complete. 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.848+0000 7fdaddb16700 1 Processor -- start 2023-08-22T00:21:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.848+0000 7fdaddb16700 1 -- start start 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 0x7fdad80a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 0x7fdad8146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80c00a0 con 0x7fdad80c3740 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80a8d90 con 0x7fdad814bf70 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80a9070 con 0x7fdad814c350 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39246/0 (socket says 172.21.15.98:39246) 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 -- 172.21.15.98:0/1890948292 learned_addr learned my addr 172.21.15.98:0/1890948292 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad7fff700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 0x7fdad8146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 0x7fdad80a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 -- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 msgr2=0x7fdad8146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 0x7fdad8146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 -- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 msgr2=0x7fdad80a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:21:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 0x7fdad80a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 -- 172.21.15.98:0/1890948292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00092a0 con 0x7fdad80c3740 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 0x7fdad80a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad7fff700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 0x7fdad8146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdad77fe700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fdac800d890 tx=0x7fdac8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac80125f0 con 0x7fdad80c3740 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac8012750 con 0x7fdad80c3740 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad80a9350 con 0x7fdad80c3740 2023-08-22T00:21:59.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac8012ad0 con 0x7fdad80c3740 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.849+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad80aa180 con 0x7fdad80c3740 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.850+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad8047480 con 0x7fdad80c3740 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.851+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdac8013480 con 0x7fdad80c3740 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.851+0000 7fdacf7fe700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 0x7fdab80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.851+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdac8079d10 con 0x7fdad80c3740 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.851+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 0x7fdab80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:21:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.851+0000 7fdad6ffd700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 0x7fdab80612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdad80aa690 tx=0x7fdac0017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:21:59.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:21:59.855+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdac804afc0 con 0x7fdad80c3740 2023-08-22T00:22:00.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.012+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdad8155e00 con 0x7fdab805ee10 2023-08-22T00:22:00.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.021+0000 7fdacf7fe700 1 -- 172.21.15.98:0/1890948292 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350364 (secure 0 0 0) 0x7fdad8155e00 con 0x7fdab805ee10 2023-08-22T00:22:00.028 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:00.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 msgr2=0x7fdab80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 0x7fdab80612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdad80aa690 tx=0x7fdac0017000).stop 2023-08-22T00:22:00.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 msgr2=0x7fdad80a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fdac800d890 tx=0x7fdac8008040).stop 2023-08-22T00:22:00.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 shutdown_connections 2023-08-22T00:22:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdab805ee10 0x7fdab80612d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdad814c350 0x7fdad8146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdad80c3740 0x7fdad80a87f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 --2- 172.21.15.98:0/1890948292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdad814bf70 0x7fdad80a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 >> 172.21.15.98:0/1890948292 conn(0x7fdad80c5dc0 msgr2=0x7fdad8149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 shutdown_connections 2023-08-22T00:22:00.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.024+0000 7fdaddb16700 1 -- 172.21.15.98:0/1890948292 wait complete. 2023-08-22T00:22:00.034 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:00.037 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:21:58.245363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2427368,"kb_used_data":9640,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752547352,"statfs":{"total":773094113280,"available":770608488448,"internally_reserved":0,"allocated":9871360,"data_stored":5184966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10334,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.054350"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775438+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:53.775438+0000","last_peered":"2023-08-22T00:21:53.775438+0000","last_clean":"2023-08-22T00:21:53.775438+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:53.775438+0000","last_undegraded":"2023-08-22T00:21:53.775438+0000","last_fullsized":"2023-08-22T00:21:53.775438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775199+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:53.775199+0000","last_peered":"2023-08-22T00:21:53.775199+0000","last_clean":"2023-08-22T00:21:53.775199+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:53.775199+0000","last_undegraded":"2023-08-22T00:21:53.775199+0000","last_fullsized":"2023-08-22T00:21:53.775199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.299559+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:52.299559+0000","last_peered":"2023-08-22T00:21:52.299559+0000","last_clean":"2023-08-22T00:21:52.299559+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:52.299559+0000","last_undegraded":"2023-08-22T00:21:52.299559+0000","last_fullsized":"2023-08-22T00:21:52.299559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775191+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:53.775191+0000","last_peered":"2023-08-22T00:21:53.775191+0000","last_clean":"2023-08-22T00:21:53.775191+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:53.775191+0000","last_undegraded":"2023-08-22T00:21:53.775191+0000","last_fullsized":"2023-08-22T00:21:53.775191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923605+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:52.923605+0000","last_peered":"2023-08-22T00:21:52.923605+0000","last_clean":"2023-08-22T00:21:52.923605+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:52.923605+0000","last_undegraded":"2023-08-22T00:21:52.923605+0000","last_fullsized":"2023-08-22T00:21:52.923605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923544+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:52.923544+0000","last_peered":"2023-08-22T00:21:52.923544+0000","last_clean":"2023-08-22T00:21:52.923544+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:52.923544+0000","last_undegraded":"2023-08-22T00:21:52.923544+0000","last_fullsized":"2023-08-22T00:21:52.923544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.923475+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:52.923475+0000","last_peered":"2023-08-22T00:21:52.923475+0000","last_clean":"2023-08-22T00:21:52.923475+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:52.923475+0000","last_undegraded":"2023-08-22T00:21:52.923475+0000","last_fullsized":"2023-08-22T00:21:52.923475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:53.775620+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:53.775620+0000","last_peered":"2023-08-22T00:21:53.775620+0000","last_clean":"2023-08-22T00:21:53.775620+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:53.775620+0000","last_undegraded":"2023-08-22T00:21:53.775620+0000","last_fullsized":"2023-08-22T00:21:53.775620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:56.320747+0000","last_change":"2023-08-22T00:21:56.320747+0000","last_active":"2023-08-22T00:21:56.320747+0000","last_peered":"2023-08-22T00:21:56.320747+0000","last_clean":"2023-08-22T00:21:56.320747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:56.320747+0000","last_undegraded":"2023-08-22T00:21:56.320747+0000","last_fullsized":"2023-08-22T00:21:56.320747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:21:55.315564+0000","last_change":"2023-08-22T00:21:55.315564+0000","last_active":"2023-08-22T00:21:55.315564+0000","last_peered":"2023-08-22T00:21:55.315564+0000","last_clean":"2023-08-22T00:21:55.315564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:21:55.315564+0000","last_undegraded":"2023-08-22T00:21:55.315564+0000","last_fullsized":"2023-08-22T00:21:55.315564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-08-22T00:21:52.294288+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:52.294288+0000","last_peered":"2023-08-22T00:21:52.294288+0000","last_clean":"2023-08-22T00:21:52.294288+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:52.294288+0000","last_undegraded":"2023-08-22T00:21:52.294288+0000","last_fullsized":"2023-08-22T00:21:52.294288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.73999999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.70099999999999996}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065344,"statfs":{"total":96636764160,"available":96322912256,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.71899999999999997,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.99299999999999999},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.29599999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.1339999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.79000000000000004},"last":0.51700000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.073},"last":0.749}]},{"osd":4,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.46200000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.63}]},{"osd":5,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65900000000000003,"5min":0.753,"15min":0.94399999999999995},"last":0.52800000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":1.03},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302388,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069452,"statfs":{"total":96636764160,"available":96327118848,"internally_reserved":0,"allocated":1224704,"data_stored":643419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.31},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.309}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.247},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27400000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.498},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.438},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.51300000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.246},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.318}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.379}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302400,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069440,"statfs":{"total":96636764160,"available":96327106560,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.221,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63600000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.438}]},{"osd":4,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.753},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.876,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.88100000000000001,"15min":11.163},"last":0.58799999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.79300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065344,"statfs":{"total":96636764160,"available":96322912256,"internally_reserved":0,"allocated":1236992,"data_stored":649688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.58699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52000000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302388,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069452,"statfs":{"total":96636764160,"available":96327118848,"internally_reserved":0,"allocated":1224704,"data_stored":643419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:00.049 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:00.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.192+0000 7f79adaad700 1 Processor -- start 2023-08-22T00:22:00.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.192+0000 7f79adaad700 1 -- start start 2023-08-22T00:22:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79adaad700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a814c200 0x7f79a8063210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79adaad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79a80bc000 0x7f79a80bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79adaad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80c1b10 con 0x7f79a8062e30 2023-08-22T00:22:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79adaad700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a8063700 con 0x7f79a814c200 2023-08-22T00:22:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79adaad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80bcd70 con 0x7f79a80bc000 2023-08-22T00:22:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79a6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a814c200 0x7f79a8063210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79a6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a814c200 0x7f79a8063210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39260/0 (socket says 172.21.15.98:39260) 2023-08-22T00:22:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.193+0000 7f79a6ffd700 1 -- 172.21.15.98:0/2108467574 learned_addr learned my addr 172.21.15.98:0/2108467574 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a7fff700 1 --2- 172.21.15.98:0/2108467574 >> v2:172.21.15.118:3300/0 conn(0x7f79a80bc000 0x7f79a80bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a6ffd700 1 -- 172.21.15.98:0/2108467574 >> v2:172.21.15.118:3300/0 conn(0x7f79a80bc000 msgr2=0x7f79a80bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a6ffd700 1 --2- 172.21.15.98:0/2108467574 >> v2:172.21.15.118:3300/0 conn(0x7f79a80bc000 0x7f79a80bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a6ffd700 1 -- 172.21.15.98:0/2108467574 >> v1:172.21.15.118:6789/0 conn(0x7f79a8062e30 legacy=0x7f79a814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a6ffd700 1 -- 172.21.15.98:0/2108467574 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80bd050 con 0x7f79a814c200 2023-08-22T00:22:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a6ffd700 1 --2- 172.21.15.98:0/2108467574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a8063210 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f79a80bdfa0 tx=0x7f79980090f0).ready entity=mon.0 client_cookie=8fedadebbab627c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a67fc700 1 -- 172.21.15.98:0/2108467574 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800b630 con 0x7f79a814c200 2023-08-22T00:22:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a67fc700 1 -- 172.21.15.98:0/2108467574 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800b790 con 0x7f79a814c200 2023-08-22T00:22:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79a67fc700 1 -- 172.21.15.98:0/2108467574 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800bb10 con 0x7f79a814c200 2023-08-22T00:22:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 -- 172.21.15.98:0/2108467574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 msgr2=0x7f79a8063210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 --2- 172.21.15.98:0/2108467574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a8063210 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f79a80bdfa0 tx=0x7f79980090f0).stop 2023-08-22T00:22:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 -- 172.21.15.98:0/2108467574 shutdown_connections 2023-08-22T00:22:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 --2- 172.21.15.98:0/2108467574 >> v2:172.21.15.118:3300/0 conn(0x7f79a80bc000 0x7f79a80bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 --2- 172.21.15.98:0/2108467574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a8063210 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 -- 172.21.15.98:0/2108467574 >> 172.21.15.98:0/2108467574 conn(0x7f79a80c3980 msgr2=0x7f79a80c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 -- 172.21.15.98:0/2108467574 shutdown_connections 2023-08-22T00:22:00.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.194+0000 7f79adaad700 1 -- 172.21.15.98:0/2108467574 wait complete. 2023-08-22T00:22:00.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 Processor -- start 2023-08-22T00:22:00.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 -- start start 2023-08-22T00:22:00.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 0x7f79a80a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 0x7f79a80be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80bdfd0 con 0x7f79a814c200 2023-08-22T00:22:00.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80be2b0 con 0x7f79a8062e30 2023-08-22T00:22:00.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.196+0000 7f79adaad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81627a0 con 0x7f79a80bc000 2023-08-22T00:22:00.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39268/0 (socket says 172.21.15.98:39268) 2023-08-22T00:22:00.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 -- 172.21.15.98:0/2251157836 learned_addr learned my addr 172.21.15.98:0/2251157836 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:00.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a6ffd700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 0x7f79a80be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a77fe700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 0x7f79a80a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 -- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 msgr2=0x7f79a80be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 0x7f79a80be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 -- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 msgr2=0x7f79a80a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 0x7f79a80a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 -- 172.21.15.98:0/2251157836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009370 con 0x7f79a814c200 2023-08-22T00:22:00.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a6ffd700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 0x7f79a80be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:00.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a77fe700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 0x7f79a80a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79a7fff700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f79a0009fd0 tx=0x7f79a0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000ed50 con 0x7f79a814c200 2023-08-22T00:22:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000eeb0 con 0x7f79a814c200 2023-08-22T00:22:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a8162a80 con 0x7f79a814c200 2023-08-22T00:22:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0014610 con 0x7f79a814c200 2023-08-22T00:22:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.197+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a80bf850 con 0x7f79a814c200 2023-08-22T00:22:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.198+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a80be440 con 0x7f79a814c200 2023-08-22T00:22:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.199+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f79a001d3b0 con 0x7f79a814c200 2023-08-22T00:22:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.199+0000 7f798f7fe700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 0x7f79940612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.199+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79a007a520 con 0x7f79a814c200 2023-08-22T00:22:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.199+0000 7f79a77fe700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 0x7f79940612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.199+0000 7f79a77fe700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 0x7f79940612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f799c002780 tx=0x7f799c009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.203+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79a004b7d0 con 0x7f79a814c200 2023-08-22T00:22:00.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.363+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79a8047480 con 0x7f799405ee10 2023-08-22T00:22:00.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.373+0000 7f798f7fe700 1 -- 172.21.15.98:0/2251157836 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362226 (secure 0 0 0) 0x7f79a8047480 con 0x7f799405ee10 2023-08-22T00:22:00.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 msgr2=0x7f79940612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 0x7f79940612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f799c002780 tx=0x7f799c009040).stop 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 msgr2=0x7f79a80bec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f79a0009fd0 tx=0x7f79a0009900).stop 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 shutdown_connections 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a814c200 0x7f79a80bec30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a8062e30 0x7f79a80a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f799405ee10 0x7f79940612d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 --2- 172.21.15.98:0/2251157836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a80bc000 0x7f79a80be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 >> 172.21.15.98:0/2251157836 conn(0x7f79a80c3980 msgr2=0x7f79a80a5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 shutdown_connections 2023-08-22T00:22:00.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.376+0000 7f79adaad700 1 -- 172.21.15.98:0/2251157836 wait complete. 2023-08-22T00:22:00.383 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:00.389 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:22:00.245903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":228,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427840,"kb_used_data":10112,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546880,"statfs":{"total":773094113280,"available":770608005120,"internally_reserved":0,"allocated":10354688,"data_stored":5427676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10334,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.054350"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735254+0000","last_change":"2023-08-22T00:21:56.726566+0000","last_active":"2023-08-22T00:21:56.735254+0000","last_peered":"2023-08-22T00:21:56.735254+0000","last_clean":"2023-08-22T00:21:56.735254+0000","last_became_active":"2023-08-22T00:21:56.726154+0000","last_became_peered":"2023-08-22T00:21:56.726154+0000","last_unstale":"2023-08-22T00:21:56.735254+0000","last_undegraded":"2023-08-22T00:21:56.735254+0000","last_fullsized":"2023-08-22T00:21:56.735254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732234+0000","last_change":"2023-08-22T00:21:56.350790+0000","last_active":"2023-08-22T00:21:56.732234+0000","last_peered":"2023-08-22T00:21:56.732234+0000","last_clean":"2023-08-22T00:21:56.732234+0000","last_became_active":"2023-08-22T00:21:56.350520+0000","last_became_peered":"2023-08-22T00:21:56.350520+0000","last_unstale":"2023-08-22T00:21:56.732234+0000","last_undegraded":"2023-08-22T00:21:56.732234+0000","last_fullsized":"2023-08-22T00:21:56.732234+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724823+0000","last_change":"2023-08-22T00:21:56.721796+0000","last_active":"2023-08-22T00:21:56.724823+0000","last_peered":"2023-08-22T00:21:56.724823+0000","last_clean":"2023-08-22T00:21:56.724823+0000","last_became_active":"2023-08-22T00:21:56.721509+0000","last_became_peered":"2023-08-22T00:21:56.721509+0000","last_unstale":"2023-08-22T00:21:56.724823+0000","last_undegraded":"2023-08-22T00:21:56.724823+0000","last_fullsized":"2023-08-22T00:21:56.724823+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703828+0000","last_change":"2023-08-22T00:21:56.343367+0000","last_active":"2023-08-22T00:21:56.703828+0000","last_peered":"2023-08-22T00:21:56.703828+0000","last_clean":"2023-08-22T00:21:56.703828+0000","last_became_active":"2023-08-22T00:21:56.343039+0000","last_became_peered":"2023-08-22T00:21:56.343039+0000","last_unstale":"2023-08-22T00:21:56.703828+0000","last_undegraded":"2023-08-22T00:21:56.703828+0000","last_fullsized":"2023-08-22T00:21:56.703828+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729850+0000","last_change":"2023-08-22T00:21:56.722358+0000","last_active":"2023-08-22T00:21:56.729850+0000","last_peered":"2023-08-22T00:21:56.729850+0000","last_clean":"2023-08-22T00:21:56.729850+0000","last_became_active":"2023-08-22T00:21:56.722082+0000","last_became_peered":"2023-08-22T00:21:56.722082+0000","last_unstale":"2023-08-22T00:21:56.729850+0000","last_undegraded":"2023-08-22T00:21:56.729850+0000","last_fullsized":"2023-08-22T00:21:56.729850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.709706+0000","last_change":"2023-08-22T00:21:56.340757+0000","last_active":"2023-08-22T00:21:56.709706+0000","last_peered":"2023-08-22T00:21:56.709706+0000","last_clean":"2023-08-22T00:21:56.709706+0000","last_became_active":"2023-08-22T00:21:56.340483+0000","last_became_peered":"2023-08-22T00:21:56.340483+0000","last_unstale":"2023-08-22T00:21:56.709706+0000","last_undegraded":"2023-08-22T00:21:56.709706+0000","last_fullsized":"2023-08-22T00:21:56.709706+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731290+0000","last_change":"2023-08-22T00:21:56.720668+0000","last_active":"2023-08-22T00:21:56.731290+0000","last_peered":"2023-08-22T00:21:56.731290+0000","last_clean":"2023-08-22T00:21:56.731290+0000","last_became_active":"2023-08-22T00:21:56.719901+0000","last_became_peered":"2023-08-22T00:21:56.719901+0000","last_unstale":"2023-08-22T00:21:56.731290+0000","last_undegraded":"2023-08-22T00:21:56.731290+0000","last_fullsized":"2023-08-22T00:21:56.731290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724670+0000","last_change":"2023-08-22T00:21:56.341820+0000","last_active":"2023-08-22T00:21:56.724670+0000","last_peered":"2023-08-22T00:21:56.724670+0000","last_clean":"2023-08-22T00:21:56.724670+0000","last_became_active":"2023-08-22T00:21:56.341462+0000","last_became_peered":"2023-08-22T00:21:56.341462+0000","last_unstale":"2023-08-22T00:21:56.724670+0000","last_undegraded":"2023-08-22T00:21:56.724670+0000","last_fullsized":"2023-08-22T00:21:56.724670+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723258+0000","last_change":"2023-08-22T00:21:56.720826+0000","last_active":"2023-08-22T00:21:56.723258+0000","last_peered":"2023-08-22T00:21:56.723258+0000","last_clean":"2023-08-22T00:21:56.723258+0000","last_became_active":"2023-08-22T00:21:56.720538+0000","last_became_peered":"2023-08-22T00:21:56.720538+0000","last_unstale":"2023-08-22T00:21:56.723258+0000","last_undegraded":"2023-08-22T00:21:56.723258+0000","last_fullsized":"2023-08-22T00:21:56.723258+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727155+0000","last_change":"2023-08-22T00:21:56.348788+0000","last_active":"2023-08-22T00:21:56.727155+0000","last_peered":"2023-08-22T00:21:56.727155+0000","last_clean":"2023-08-22T00:21:56.727155+0000","last_became_active":"2023-08-22T00:21:56.347376+0000","last_became_peered":"2023-08-22T00:21:56.347376+0000","last_unstale":"2023-08-22T00:21:56.727155+0000","last_undegraded":"2023-08-22T00:21:56.727155+0000","last_fullsized":"2023-08-22T00:21:56.727155+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724401+0000","last_change":"2023-08-22T00:21:56.722763+0000","last_active":"2023-08-22T00:21:56.724401+0000","last_peered":"2023-08-22T00:21:56.724401+0000","last_clean":"2023-08-22T00:21:56.724401+0000","last_became_active":"2023-08-22T00:21:56.722237+0000","last_became_peered":"2023-08-22T00:21:56.722237+0000","last_unstale":"2023-08-22T00:21:56.724401+0000","last_undegraded":"2023-08-22T00:21:56.724401+0000","last_fullsized":"2023-08-22T00:21:56.724401+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719528+0000","last_change":"2023-08-22T00:21:56.343526+0000","last_active":"2023-08-22T00:21:56.719528+0000","last_peered":"2023-08-22T00:21:56.719528+0000","last_clean":"2023-08-22T00:21:56.719528+0000","last_became_active":"2023-08-22T00:21:56.342933+0000","last_became_peered":"2023-08-22T00:21:56.342933+0000","last_unstale":"2023-08-22T00:21:56.719528+0000","last_undegraded":"2023-08-22T00:21:56.719528+0000","last_fullsized":"2023-08-22T00:21:56.719528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727758+0000","last_change":"2023-08-22T00:21:56.726444+0000","last_active":"2023-08-22T00:21:56.727758+0000","last_peered":"2023-08-22T00:21:56.727758+0000","last_clean":"2023-08-22T00:21:56.727758+0000","last_became_active":"2023-08-22T00:21:56.726157+0000","last_became_peered":"2023-08-22T00:21:56.726157+0000","last_unstale":"2023-08-22T00:21:56.727758+0000","last_undegraded":"2023-08-22T00:21:56.727758+0000","last_fullsized":"2023-08-22T00:21:56.727758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705245+0000","last_change":"2023-08-22T00:21:56.337534+0000","last_active":"2023-08-22T00:21:56.705245+0000","last_peered":"2023-08-22T00:21:56.705245+0000","last_clean":"2023-08-22T00:21:56.705245+0000","last_became_active":"2023-08-22T00:21:56.337258+0000","last_became_peered":"2023-08-22T00:21:56.337258+0000","last_unstale":"2023-08-22T00:21:56.705245+0000","last_undegraded":"2023-08-22T00:21:56.705245+0000","last_fullsized":"2023-08-22T00:21:56.705245+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729680+0000","last_change":"2023-08-22T00:21:56.721199+0000","last_active":"2023-08-22T00:21:56.729680+0000","last_peered":"2023-08-22T00:21:56.729680+0000","last_clean":"2023-08-22T00:21:56.729680+0000","last_became_active":"2023-08-22T00:21:56.720911+0000","last_became_peered":"2023-08-22T00:21:56.720911+0000","last_unstale":"2023-08-22T00:21:56.729680+0000","last_undegraded":"2023-08-22T00:21:56.729680+0000","last_fullsized":"2023-08-22T00:21:56.729680+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706902+0000","last_change":"2023-08-22T00:21:56.342754+0000","last_active":"2023-08-22T00:21:56.706902+0000","last_peered":"2023-08-22T00:21:56.706902+0000","last_clean":"2023-08-22T00:21:56.706902+0000","last_became_active":"2023-08-22T00:21:56.342504+0000","last_became_peered":"2023-08-22T00:21:56.342504+0000","last_unstale":"2023-08-22T00:21:56.706902+0000","last_undegraded":"2023-08-22T00:21:56.706902+0000","last_fullsized":"2023-08-22T00:21:56.706902+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726914+0000","last_change":"2023-08-22T00:21:56.724073+0000","last_active":"2023-08-22T00:21:56.726914+0000","last_peered":"2023-08-22T00:21:56.726914+0000","last_clean":"2023-08-22T00:21:56.726914+0000","last_became_active":"2023-08-22T00:21:56.723778+0000","last_became_peered":"2023-08-22T00:21:56.723778+0000","last_unstale":"2023-08-22T00:21:56.726914+0000","last_undegraded":"2023-08-22T00:21:56.726914+0000","last_fullsized":"2023-08-22T00:21:56.726914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706678+0000","last_change":"2023-08-22T00:21:56.345756+0000","last_active":"2023-08-22T00:21:56.706678+0000","last_peered":"2023-08-22T00:21:56.706678+0000","last_clean":"2023-08-22T00:21:56.706678+0000","last_became_active":"2023-08-22T00:21:56.343602+0000","last_became_peered":"2023-08-22T00:21:56.343602+0000","last_unstale":"2023-08-22T00:21:56.706678+0000","last_undegraded":"2023-08-22T00:21:56.706678+0000","last_fullsized":"2023-08-22T00:21:56.706678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732854+0000","last_change":"2023-08-22T00:21:56.731918+0000","last_active":"2023-08-22T00:21:56.732854+0000","last_peered":"2023-08-22T00:21:56.732854+0000","last_clean":"2023-08-22T00:21:56.732854+0000","last_became_active":"2023-08-22T00:21:56.731625+0000","last_became_peered":"2023-08-22T00:21:56.731625+0000","last_unstale":"2023-08-22T00:21:56.732854+0000","last_undegraded":"2023-08-22T00:21:56.732854+0000","last_fullsized":"2023-08-22T00:21:56.732854+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714315+0000","last_change":"2023-08-22T00:21:56.342959+0000","last_active":"2023-08-22T00:21:56.714315+0000","last_peered":"2023-08-22T00:21:56.714315+0000","last_clean":"2023-08-22T00:21:56.714315+0000","last_became_active":"2023-08-22T00:21:56.342697+0000","last_became_peered":"2023-08-22T00:21:56.342697+0000","last_unstale":"2023-08-22T00:21:56.714315+0000","last_undegraded":"2023-08-22T00:21:56.714315+0000","last_fullsized":"2023-08-22T00:21:56.714315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726867+0000","last_change":"2023-08-22T00:21:56.724838+0000","last_active":"2023-08-22T00:21:56.726867+0000","last_peered":"2023-08-22T00:21:56.726867+0000","last_clean":"2023-08-22T00:21:56.726867+0000","last_became_active":"2023-08-22T00:21:56.724509+0000","last_became_peered":"2023-08-22T00:21:56.724509+0000","last_unstale":"2023-08-22T00:21:56.726867+0000","last_undegraded":"2023-08-22T00:21:56.726867+0000","last_fullsized":"2023-08-22T00:21:56.726867+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703530+0000","last_change":"2023-08-22T00:21:56.346146+0000","last_active":"2023-08-22T00:21:56.703530+0000","last_peered":"2023-08-22T00:21:56.703530+0000","last_clean":"2023-08-22T00:21:56.703530+0000","last_became_active":"2023-08-22T00:21:56.344423+0000","last_became_peered":"2023-08-22T00:21:56.344423+0000","last_unstale":"2023-08-22T00:21:56.703530+0000","last_undegraded":"2023-08-22T00:21:56.703530+0000","last_fullsized":"2023-08-22T00:21:56.703530+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726380+0000","last_change":"2023-08-22T00:21:56.720611+0000","last_active":"2023-08-22T00:21:56.726380+0000","last_peered":"2023-08-22T00:21:56.726380+0000","last_clean":"2023-08-22T00:21:56.726380+0000","last_became_active":"2023-08-22T00:21:56.720318+0000","last_became_peered":"2023-08-22T00:21:56.720318+0000","last_unstale":"2023-08-22T00:21:56.726380+0000","last_undegraded":"2023-08-22T00:21:56.726380+0000","last_fullsized":"2023-08-22T00:21:56.726380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.737783+0000","last_change":"2023-08-22T00:21:56.348273+0000","last_active":"2023-08-22T00:21:56.737783+0000","last_peered":"2023-08-22T00:21:56.737783+0000","last_clean":"2023-08-22T00:21:56.737783+0000","last_became_active":"2023-08-22T00:21:56.348000+0000","last_became_peered":"2023-08-22T00:21:56.348000+0000","last_unstale":"2023-08-22T00:21:56.737783+0000","last_undegraded":"2023-08-22T00:21:56.737783+0000","last_fullsized":"2023-08-22T00:21:56.737783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729953+0000","last_change":"2023-08-22T00:21:56.722513+0000","last_active":"2023-08-22T00:21:56.729953+0000","last_peered":"2023-08-22T00:21:56.729953+0000","last_clean":"2023-08-22T00:21:56.729953+0000","last_became_active":"2023-08-22T00:21:56.722126+0000","last_became_peered":"2023-08-22T00:21:56.722126+0000","last_unstale":"2023-08-22T00:21:56.729953+0000","last_undegraded":"2023-08-22T00:21:56.729953+0000","last_fullsized":"2023-08-22T00:21:56.729953+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729128+0000","last_change":"2023-08-22T00:21:56.350297+0000","last_active":"2023-08-22T00:21:56.729128+0000","last_peered":"2023-08-22T00:21:56.729128+0000","last_clean":"2023-08-22T00:21:56.729128+0000","last_became_active":"2023-08-22T00:21:56.350029+0000","last_became_peered":"2023-08-22T00:21:56.350029+0000","last_unstale":"2023-08-22T00:21:56.729128+0000","last_undegraded":"2023-08-22T00:21:56.729128+0000","last_fullsized":"2023-08-22T00:21:56.729128+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731386+0000","last_change":"2023-08-22T00:21:56.727174+0000","last_active":"2023-08-22T00:21:56.731386+0000","last_peered":"2023-08-22T00:21:56.731386+0000","last_clean":"2023-08-22T00:21:56.731386+0000","last_became_active":"2023-08-22T00:21:56.726934+0000","last_became_peered":"2023-08-22T00:21:56.726934+0000","last_unstale":"2023-08-22T00:21:56.731386+0000","last_undegraded":"2023-08-22T00:21:56.731386+0000","last_fullsized":"2023-08-22T00:21:56.731386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710841+0000","last_change":"2023-08-22T00:21:56.343702+0000","last_active":"2023-08-22T00:21:56.710841+0000","last_peered":"2023-08-22T00:21:56.710841+0000","last_clean":"2023-08-22T00:21:56.710841+0000","last_became_active":"2023-08-22T00:21:56.343211+0000","last_became_peered":"2023-08-22T00:21:56.343211+0000","last_unstale":"2023-08-22T00:21:56.710841+0000","last_undegraded":"2023-08-22T00:21:56.710841+0000","last_fullsized":"2023-08-22T00:21:56.710841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719286+0000","last_change":"2023-08-22T00:21:56.711929+0000","last_active":"2023-08-22T00:21:56.719286+0000","last_peered":"2023-08-22T00:21:56.719286+0000","last_clean":"2023-08-22T00:21:56.719286+0000","last_became_active":"2023-08-22T00:21:56.711624+0000","last_became_peered":"2023-08-22T00:21:56.711624+0000","last_unstale":"2023-08-22T00:21:56.719286+0000","last_undegraded":"2023-08-22T00:21:56.719286+0000","last_fullsized":"2023-08-22T00:21:56.719286+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702986+0000","last_change":"2023-08-22T00:21:56.340744+0000","last_active":"2023-08-22T00:21:56.702986+0000","last_peered":"2023-08-22T00:21:56.702986+0000","last_clean":"2023-08-22T00:21:56.702986+0000","last_became_active":"2023-08-22T00:21:56.340439+0000","last_became_peered":"2023-08-22T00:21:56.340439+0000","last_unstale":"2023-08-22T00:21:56.702986+0000","last_undegraded":"2023-08-22T00:21:56.702986+0000","last_fullsized":"2023-08-22T00:21:56.702986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735474+0000","last_change":"2023-08-22T00:21:56.731929+0000","last_active":"2023-08-22T00:21:56.735474+0000","last_peered":"2023-08-22T00:21:56.735474+0000","last_clean":"2023-08-22T00:21:56.735474+0000","last_became_active":"2023-08-22T00:21:56.731632+0000","last_became_peered":"2023-08-22T00:21:56.731632+0000","last_unstale":"2023-08-22T00:21:56.735474+0000","last_undegraded":"2023-08-22T00:21:56.735474+0000","last_fullsized":"2023-08-22T00:21:56.735474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731515+0000","last_change":"2023-08-22T00:21:56.349226+0000","last_active":"2023-08-22T00:21:56.731515+0000","last_peered":"2023-08-22T00:21:56.731515+0000","last_clean":"2023-08-22T00:21:56.731515+0000","last_became_active":"2023-08-22T00:21:56.348925+0000","last_became_peered":"2023-08-22T00:21:56.348925+0000","last_unstale":"2023-08-22T00:21:56.731515+0000","last_undegraded":"2023-08-22T00:21:56.731515+0000","last_fullsized":"2023-08-22T00:21:56.731515+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728659+0000","last_change":"2023-08-22T00:21:56.717738+0000","last_active":"2023-08-22T00:21:56.728659+0000","last_peered":"2023-08-22T00:21:56.728659+0000","last_clean":"2023-08-22T00:21:56.728659+0000","last_became_active":"2023-08-22T00:21:56.717466+0000","last_became_peered":"2023-08-22T00:21:56.717466+0000","last_unstale":"2023-08-22T00:21:56.728659+0000","last_undegraded":"2023-08-22T00:21:56.728659+0000","last_fullsized":"2023-08-22T00:21:56.728659+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706817+0000","last_change":"2023-08-22T00:21:56.349781+0000","last_active":"2023-08-22T00:21:56.706817+0000","last_peered":"2023-08-22T00:21:56.706817+0000","last_clean":"2023-08-22T00:21:56.706817+0000","last_became_active":"2023-08-22T00:21:56.349508+0000","last_became_peered":"2023-08-22T00:21:56.349508+0000","last_unstale":"2023-08-22T00:21:56.706817+0000","last_undegraded":"2023-08-22T00:21:56.706817+0000","last_fullsized":"2023-08-22T00:21:56.706817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720597+0000","last_change":"2023-08-22T00:21:56.718378+0000","last_active":"2023-08-22T00:21:56.720597+0000","last_peered":"2023-08-22T00:21:56.720597+0000","last_clean":"2023-08-22T00:21:56.720597+0000","last_became_active":"2023-08-22T00:21:56.718046+0000","last_became_peered":"2023-08-22T00:21:56.718046+0000","last_unstale":"2023-08-22T00:21:56.720597+0000","last_undegraded":"2023-08-22T00:21:56.720597+0000","last_fullsized":"2023-08-22T00:21:56.720597+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708444+0000","last_change":"2023-08-22T00:21:56.347400+0000","last_active":"2023-08-22T00:21:56.708444+0000","last_peered":"2023-08-22T00:21:56.708444+0000","last_clean":"2023-08-22T00:21:56.708444+0000","last_became_active":"2023-08-22T00:21:56.347119+0000","last_became_peered":"2023-08-22T00:21:56.347119+0000","last_unstale":"2023-08-22T00:21:56.708444+0000","last_undegraded":"2023-08-22T00:21:56.708444+0000","last_fullsized":"2023-08-22T00:21:56.708444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735322+0000","last_change":"2023-08-22T00:21:56.730106+0000","last_active":"2023-08-22T00:21:56.735322+0000","last_peered":"2023-08-22T00:21:56.735322+0000","last_clean":"2023-08-22T00:21:56.735322+0000","last_became_active":"2023-08-22T00:21:56.729475+0000","last_became_peered":"2023-08-22T00:21:56.729475+0000","last_unstale":"2023-08-22T00:21:56.735322+0000","last_undegraded":"2023-08-22T00:21:56.735322+0000","last_fullsized":"2023-08-22T00:21:56.735322+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729063+0000","last_change":"2023-08-22T00:21:56.345942+0000","last_active":"2023-08-22T00:21:56.729063+0000","last_peered":"2023-08-22T00:21:56.729063+0000","last_clean":"2023-08-22T00:21:56.729063+0000","last_became_active":"2023-08-22T00:21:56.345667+0000","last_became_peered":"2023-08-22T00:21:56.345667+0000","last_unstale":"2023-08-22T00:21:56.729063+0000","last_undegraded":"2023-08-22T00:21:56.729063+0000","last_fullsized":"2023-08-22T00:21:56.729063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729369+0000","last_change":"2023-08-22T00:21:56.723984+0000","last_active":"2023-08-22T00:21:56.729369+0000","last_peered":"2023-08-22T00:21:56.729369+0000","last_clean":"2023-08-22T00:21:56.729369+0000","last_became_active":"2023-08-22T00:21:56.723632+0000","last_became_peered":"2023-08-22T00:21:56.723632+0000","last_unstale":"2023-08-22T00:21:56.729369+0000","last_undegraded":"2023-08-22T00:21:56.729369+0000","last_fullsized":"2023-08-22T00:21:56.729369+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711107+0000","last_change":"2023-08-22T00:21:56.351605+0000","last_active":"2023-08-22T00:21:56.711107+0000","last_peered":"2023-08-22T00:21:56.711107+0000","last_clean":"2023-08-22T00:21:56.711107+0000","last_became_active":"2023-08-22T00:21:56.349889+0000","last_became_peered":"2023-08-22T00:21:56.349889+0000","last_unstale":"2023-08-22T00:21:56.711107+0000","last_undegraded":"2023-08-22T00:21:56.711107+0000","last_fullsized":"2023-08-22T00:21:56.711107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735555+0000","last_change":"2023-08-22T00:21:56.733235+0000","last_active":"2023-08-22T00:21:56.735555+0000","last_peered":"2023-08-22T00:21:56.735555+0000","last_clean":"2023-08-22T00:21:56.735555+0000","last_became_active":"2023-08-22T00:21:56.732942+0000","last_became_peered":"2023-08-22T00:21:56.732942+0000","last_unstale":"2023-08-22T00:21:56.735555+0000","last_undegraded":"2023-08-22T00:21:56.735555+0000","last_fullsized":"2023-08-22T00:21:56.735555+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726357+0000","last_change":"2023-08-22T00:21:56.349376+0000","last_active":"2023-08-22T00:21:56.726357+0000","last_peered":"2023-08-22T00:21:56.726357+0000","last_clean":"2023-08-22T00:21:56.726357+0000","last_became_active":"2023-08-22T00:21:56.348958+0000","last_became_peered":"2023-08-22T00:21:56.348958+0000","last_unstale":"2023-08-22T00:21:56.726357+0000","last_undegraded":"2023-08-22T00:21:56.726357+0000","last_fullsized":"2023-08-22T00:21:56.726357+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735368+0000","last_change":"2023-08-22T00:21:56.730982+0000","last_active":"2023-08-22T00:21:56.735368+0000","last_peered":"2023-08-22T00:21:56.735368+0000","last_clean":"2023-08-22T00:21:56.735368+0000","last_became_active":"2023-08-22T00:21:56.730713+0000","last_became_peered":"2023-08-22T00:21:56.730713+0000","last_unstale":"2023-08-22T00:21:56.735368+0000","last_undegraded":"2023-08-22T00:21:56.735368+0000","last_fullsized":"2023-08-22T00:21:56.735368+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706762+0000","last_change":"2023-08-22T00:21:56.354225+0000","last_active":"2023-08-22T00:21:56.706762+0000","last_peered":"2023-08-22T00:21:56.706762+0000","last_clean":"2023-08-22T00:21:56.706762+0000","last_became_active":"2023-08-22T00:21:56.353959+0000","last_became_peered":"2023-08-22T00:21:56.353959+0000","last_unstale":"2023-08-22T00:21:56.706762+0000","last_undegraded":"2023-08-22T00:21:56.706762+0000","last_fullsized":"2023-08-22T00:21:56.706762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735370+0000","last_change":"2023-08-22T00:21:56.729930+0000","last_active":"2023-08-22T00:21:56.735370+0000","last_peered":"2023-08-22T00:21:56.735370+0000","last_clean":"2023-08-22T00:21:56.735370+0000","last_became_active":"2023-08-22T00:21:56.729558+0000","last_became_peered":"2023-08-22T00:21:56.729558+0000","last_unstale":"2023-08-22T00:21:56.735370+0000","last_undegraded":"2023-08-22T00:21:56.735370+0000","last_fullsized":"2023-08-22T00:21:56.735370+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706299+0000","last_change":"2023-08-22T00:21:56.344957+0000","last_active":"2023-08-22T00:21:56.706299+0000","last_peered":"2023-08-22T00:21:56.706299+0000","last_clean":"2023-08-22T00:21:56.706299+0000","last_became_active":"2023-08-22T00:21:56.344659+0000","last_became_peered":"2023-08-22T00:21:56.344659+0000","last_unstale":"2023-08-22T00:21:56.706299+0000","last_undegraded":"2023-08-22T00:21:56.706299+0000","last_fullsized":"2023-08-22T00:21:56.706299+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731835+0000","last_change":"2023-08-22T00:21:56.729695+0000","last_active":"2023-08-22T00:21:56.731835+0000","last_peered":"2023-08-22T00:21:56.731835+0000","last_clean":"2023-08-22T00:21:56.731835+0000","last_became_active":"2023-08-22T00:21:56.728983+0000","last_became_peered":"2023-08-22T00:21:56.728983+0000","last_unstale":"2023-08-22T00:21:56.731835+0000","last_undegraded":"2023-08-22T00:21:56.731835+0000","last_fullsized":"2023-08-22T00:21:56.731835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702930+0000","last_change":"2023-08-22T00:21:56.343786+0000","last_active":"2023-08-22T00:21:56.702930+0000","last_peered":"2023-08-22T00:21:56.702930+0000","last_clean":"2023-08-22T00:21:56.702930+0000","last_became_active":"2023-08-22T00:21:56.343478+0000","last_became_peered":"2023-08-22T00:21:56.343478+0000","last_unstale":"2023-08-22T00:21:56.702930+0000","last_undegraded":"2023-08-22T00:21:56.702930+0000","last_fullsized":"2023-08-22T00:21:56.702930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732696+0000","last_change":"2023-08-22T00:21:56.728733+0000","last_active":"2023-08-22T00:21:56.732696+0000","last_peered":"2023-08-22T00:21:56.732696+0000","last_clean":"2023-08-22T00:21:56.732696+0000","last_became_active":"2023-08-22T00:21:56.728193+0000","last_became_peered":"2023-08-22T00:21:56.728193+0000","last_unstale":"2023-08-22T00:21:56.732696+0000","last_undegraded":"2023-08-22T00:21:56.732696+0000","last_fullsized":"2023-08-22T00:21:56.732696+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703127+0000","last_change":"2023-08-22T00:21:56.343200+0000","last_active":"2023-08-22T00:21:56.703127+0000","last_peered":"2023-08-22T00:21:56.703127+0000","last_clean":"2023-08-22T00:21:56.703127+0000","last_became_active":"2023-08-22T00:21:56.342898+0000","last_became_peered":"2023-08-22T00:21:56.342898+0000","last_unstale":"2023-08-22T00:21:56.703127+0000","last_undegraded":"2023-08-22T00:21:56.703127+0000","last_fullsized":"2023-08-22T00:21:56.703127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735340+0000","last_change":"2023-08-22T00:21:56.726565+0000","last_active":"2023-08-22T00:21:56.735340+0000","last_peered":"2023-08-22T00:21:56.735340+0000","last_clean":"2023-08-22T00:21:56.735340+0000","last_became_active":"2023-08-22T00:21:56.725923+0000","last_became_peered":"2023-08-22T00:21:56.725923+0000","last_unstale":"2023-08-22T00:21:56.735340+0000","last_undegraded":"2023-08-22T00:21:56.735340+0000","last_fullsized":"2023-08-22T00:21:56.735340+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714430+0000","last_change":"2023-08-22T00:21:56.348195+0000","last_active":"2023-08-22T00:21:56.714430+0000","last_peered":"2023-08-22T00:21:56.714430+0000","last_clean":"2023-08-22T00:21:56.714430+0000","last_became_active":"2023-08-22T00:21:56.347907+0000","last_became_peered":"2023-08-22T00:21:56.347907+0000","last_unstale":"2023-08-22T00:21:56.714430+0000","last_undegraded":"2023-08-22T00:21:56.714430+0000","last_fullsized":"2023-08-22T00:21:56.714430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724698+0000","last_change":"2023-08-22T00:21:56.721312+0000","last_active":"2023-08-22T00:21:56.724698+0000","last_peered":"2023-08-22T00:21:56.724698+0000","last_clean":"2023-08-22T00:21:56.724698+0000","last_became_active":"2023-08-22T00:21:56.721030+0000","last_became_peered":"2023-08-22T00:21:56.721030+0000","last_unstale":"2023-08-22T00:21:56.724698+0000","last_undegraded":"2023-08-22T00:21:56.724698+0000","last_fullsized":"2023-08-22T00:21:56.724698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713374+0000","last_change":"2023-08-22T00:21:56.348591+0000","last_active":"2023-08-22T00:21:56.713374+0000","last_peered":"2023-08-22T00:21:56.713374+0000","last_clean":"2023-08-22T00:21:56.713374+0000","last_became_active":"2023-08-22T00:21:56.348298+0000","last_became_peered":"2023-08-22T00:21:56.348298+0000","last_unstale":"2023-08-22T00:21:56.713374+0000","last_undegraded":"2023-08-22T00:21:56.713374+0000","last_fullsized":"2023-08-22T00:21:56.713374+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725839+0000","last_change":"2023-08-22T00:21:56.724152+0000","last_active":"2023-08-22T00:21:56.725839+0000","last_peered":"2023-08-22T00:21:56.725839+0000","last_clean":"2023-08-22T00:21:56.725839+0000","last_became_active":"2023-08-22T00:21:56.723850+0000","last_became_peered":"2023-08-22T00:21:56.723850+0000","last_unstale":"2023-08-22T00:21:56.725839+0000","last_undegraded":"2023-08-22T00:21:56.725839+0000","last_fullsized":"2023-08-22T00:21:56.725839+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711211+0000","last_change":"2023-08-22T00:21:56.352313+0000","last_active":"2023-08-22T00:21:56.711211+0000","last_peered":"2023-08-22T00:21:56.711211+0000","last_clean":"2023-08-22T00:21:56.711211+0000","last_became_active":"2023-08-22T00:21:56.352079+0000","last_became_peered":"2023-08-22T00:21:56.352079+0000","last_unstale":"2023-08-22T00:21:56.711211+0000","last_undegraded":"2023-08-22T00:21:56.711211+0000","last_fullsized":"2023-08-22T00:21:56.711211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735484+0000","last_change":"2023-08-22T00:21:56.727092+0000","last_active":"2023-08-22T00:21:56.735484+0000","last_peered":"2023-08-22T00:21:56.735484+0000","last_clean":"2023-08-22T00:21:56.735484+0000","last_became_active":"2023-08-22T00:21:56.726820+0000","last_became_peered":"2023-08-22T00:21:56.726820+0000","last_unstale":"2023-08-22T00:21:56.735484+0000","last_undegraded":"2023-08-22T00:21:56.735484+0000","last_fullsized":"2023-08-22T00:21:56.735484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703315+0000","last_change":"2023-08-22T00:21:56.345493+0000","last_active":"2023-08-22T00:21:56.703315+0000","last_peered":"2023-08-22T00:21:56.703315+0000","last_clean":"2023-08-22T00:21:56.703315+0000","last_became_active":"2023-08-22T00:21:56.344185+0000","last_became_peered":"2023-08-22T00:21:56.344185+0000","last_unstale":"2023-08-22T00:21:56.703315+0000","last_undegraded":"2023-08-22T00:21:56.703315+0000","last_fullsized":"2023-08-22T00:21:56.703315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735494+0000","last_change":"2023-08-22T00:21:56.727153+0000","last_active":"2023-08-22T00:21:56.735494+0000","last_peered":"2023-08-22T00:21:56.735494+0000","last_clean":"2023-08-22T00:21:56.735494+0000","last_became_active":"2023-08-22T00:21:56.726892+0000","last_became_peered":"2023-08-22T00:21:56.726892+0000","last_unstale":"2023-08-22T00:21:56.735494+0000","last_undegraded":"2023-08-22T00:21:56.735494+0000","last_fullsized":"2023-08-22T00:21:56.735494+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.712345+0000","last_change":"2023-08-22T00:21:56.348507+0000","last_active":"2023-08-22T00:21:56.712345+0000","last_peered":"2023-08-22T00:21:56.712345+0000","last_clean":"2023-08-22T00:21:56.712345+0000","last_became_active":"2023-08-22T00:21:56.348220+0000","last_became_peered":"2023-08-22T00:21:56.348220+0000","last_unstale":"2023-08-22T00:21:56.712345+0000","last_undegraded":"2023-08-22T00:21:56.712345+0000","last_fullsized":"2023-08-22T00:21:56.712345+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727264+0000","last_change":"2023-08-22T00:21:56.722873+0000","last_active":"2023-08-22T00:21:56.727264+0000","last_peered":"2023-08-22T00:21:56.727264+0000","last_clean":"2023-08-22T00:21:56.727264+0000","last_became_active":"2023-08-22T00:21:56.722609+0000","last_became_peered":"2023-08-22T00:21:56.722609+0000","last_unstale":"2023-08-22T00:21:56.727264+0000","last_undegraded":"2023-08-22T00:21:56.727264+0000","last_fullsized":"2023-08-22T00:21:56.727264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708510+0000","last_change":"2023-08-22T00:21:56.342316+0000","last_active":"2023-08-22T00:21:56.708510+0000","last_peered":"2023-08-22T00:21:56.708510+0000","last_clean":"2023-08-22T00:21:56.708510+0000","last_became_active":"2023-08-22T00:21:56.342042+0000","last_became_peered":"2023-08-22T00:21:56.342042+0000","last_unstale":"2023-08-22T00:21:56.708510+0000","last_undegraded":"2023-08-22T00:21:56.708510+0000","last_fullsized":"2023-08-22T00:21:56.708510+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731307+0000","last_change":"2023-08-22T00:21:56.729398+0000","last_active":"2023-08-22T00:21:56.731307+0000","last_peered":"2023-08-22T00:21:56.731307+0000","last_clean":"2023-08-22T00:21:56.731307+0000","last_became_active":"2023-08-22T00:21:56.729134+0000","last_became_peered":"2023-08-22T00:21:56.729134+0000","last_unstale":"2023-08-22T00:21:56.731307+0000","last_undegraded":"2023-08-22T00:21:56.731307+0000","last_fullsized":"2023-08-22T00:21:56.731307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714871+0000","last_change":"2023-08-22T00:21:56.350153+0000","last_active":"2023-08-22T00:21:56.714871+0000","last_peered":"2023-08-22T00:21:56.714871+0000","last_clean":"2023-08-22T00:21:56.714871+0000","last_became_active":"2023-08-22T00:21:56.349891+0000","last_became_peered":"2023-08-22T00:21:56.349891+0000","last_unstale":"2023-08-22T00:21:56.714871+0000","last_undegraded":"2023-08-22T00:21:56.714871+0000","last_fullsized":"2023-08-22T00:21:56.714871+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720801+0000","last_change":"2023-08-22T00:21:56.712558+0000","last_active":"2023-08-22T00:21:56.720801+0000","last_peered":"2023-08-22T00:21:56.720801+0000","last_clean":"2023-08-22T00:21:56.720801+0000","last_became_active":"2023-08-22T00:21:56.712232+0000","last_became_peered":"2023-08-22T00:21:56.712232+0000","last_unstale":"2023-08-22T00:21:56.720801+0000","last_undegraded":"2023-08-22T00:21:56.720801+0000","last_fullsized":"2023-08-22T00:21:56.720801+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.718363+0000","last_change":"2023-08-22T00:21:56.344835+0000","last_active":"2023-08-22T00:21:56.718363+0000","last_peered":"2023-08-22T00:21:56.718363+0000","last_clean":"2023-08-22T00:21:56.718363+0000","last_became_active":"2023-08-22T00:21:56.343691+0000","last_became_peered":"2023-08-22T00:21:56.343691+0000","last_unstale":"2023-08-22T00:21:56.718363+0000","last_undegraded":"2023-08-22T00:21:56.718363+0000","last_fullsized":"2023-08-22T00:21:56.718363+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733699+0000","last_change":"2023-08-22T00:21:56.732886+0000","last_active":"2023-08-22T00:21:56.733699+0000","last_peered":"2023-08-22T00:21:56.733699+0000","last_clean":"2023-08-22T00:21:56.733699+0000","last_became_active":"2023-08-22T00:21:56.732562+0000","last_became_peered":"2023-08-22T00:21:56.732562+0000","last_unstale":"2023-08-22T00:21:56.733699+0000","last_undegraded":"2023-08-22T00:21:56.733699+0000","last_fullsized":"2023-08-22T00:21:56.733699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730666+0000","last_change":"2023-08-22T00:21:56.344853+0000","last_active":"2023-08-22T00:21:56.730666+0000","last_peered":"2023-08-22T00:21:56.730666+0000","last_clean":"2023-08-22T00:21:56.730666+0000","last_became_active":"2023-08-22T00:21:56.344549+0000","last_became_peered":"2023-08-22T00:21:56.344549+0000","last_unstale":"2023-08-22T00:21:56.730666+0000","last_undegraded":"2023-08-22T00:21:56.730666+0000","last_fullsized":"2023-08-22T00:21:56.730666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726847+0000","last_change":"2023-08-22T00:21:56.723081+0000","last_active":"2023-08-22T00:21:56.726847+0000","last_peered":"2023-08-22T00:21:56.726847+0000","last_clean":"2023-08-22T00:21:56.726847+0000","last_became_active":"2023-08-22T00:21:56.722803+0000","last_became_peered":"2023-08-22T00:21:56.722803+0000","last_unstale":"2023-08-22T00:21:56.726847+0000","last_undegraded":"2023-08-22T00:21:56.726847+0000","last_fullsized":"2023-08-22T00:21:56.726847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729681+0000","last_change":"2023-08-22T00:21:56.345081+0000","last_active":"2023-08-22T00:21:56.729681+0000","last_peered":"2023-08-22T00:21:56.729681+0000","last_clean":"2023-08-22T00:21:56.729681+0000","last_became_active":"2023-08-22T00:21:56.344060+0000","last_became_peered":"2023-08-22T00:21:56.344060+0000","last_unstale":"2023-08-22T00:21:56.729681+0000","last_undegraded":"2023-08-22T00:21:56.729681+0000","last_fullsized":"2023-08-22T00:21:56.729681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731314+0000","last_change":"2023-08-22T00:21:56.720734+0000","last_active":"2023-08-22T00:21:56.731314+0000","last_peered":"2023-08-22T00:21:56.731314+0000","last_clean":"2023-08-22T00:21:56.731314+0000","last_became_active":"2023-08-22T00:21:56.720285+0000","last_became_peered":"2023-08-22T00:21:56.720285+0000","last_unstale":"2023-08-22T00:21:56.731314+0000","last_undegraded":"2023-08-22T00:21:56.731314+0000","last_fullsized":"2023-08-22T00:21:56.731314+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703360+0000","last_change":"2023-08-22T00:21:56.346216+0000","last_active":"2023-08-22T00:21:56.703360+0000","last_peered":"2023-08-22T00:21:56.703360+0000","last_clean":"2023-08-22T00:21:56.703360+0000","last_became_active":"2023-08-22T00:21:56.344406+0000","last_became_peered":"2023-08-22T00:21:56.344406+0000","last_unstale":"2023-08-22T00:21:56.703360+0000","last_undegraded":"2023-08-22T00:21:56.703360+0000","last_fullsized":"2023-08-22T00:21:56.703360+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727171+0000","last_change":"2023-08-22T00:21:56.722688+0000","last_active":"2023-08-22T00:21:56.727171+0000","last_peered":"2023-08-22T00:21:56.727171+0000","last_clean":"2023-08-22T00:21:56.727171+0000","last_became_active":"2023-08-22T00:21:56.721734+0000","last_became_peered":"2023-08-22T00:21:56.721734+0000","last_unstale":"2023-08-22T00:21:56.727171+0000","last_undegraded":"2023-08-22T00:21:56.727171+0000","last_fullsized":"2023-08-22T00:21:56.727171+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711472+0000","last_change":"2023-08-22T00:21:56.349229+0000","last_active":"2023-08-22T00:21:56.711472+0000","last_peered":"2023-08-22T00:21:56.711472+0000","last_clean":"2023-08-22T00:21:56.711472+0000","last_became_active":"2023-08-22T00:21:56.348596+0000","last_became_peered":"2023-08-22T00:21:56.348596+0000","last_unstale":"2023-08-22T00:21:56.711472+0000","last_undegraded":"2023-08-22T00:21:56.711472+0000","last_fullsized":"2023-08-22T00:21:56.711472+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723474+0000","last_change":"2023-08-22T00:21:56.719102+0000","last_active":"2023-08-22T00:21:56.723474+0000","last_peered":"2023-08-22T00:21:56.723474+0000","last_clean":"2023-08-22T00:21:56.723474+0000","last_became_active":"2023-08-22T00:21:56.718887+0000","last_became_peered":"2023-08-22T00:21:56.718887+0000","last_unstale":"2023-08-22T00:21:56.723474+0000","last_undegraded":"2023-08-22T00:21:56.723474+0000","last_fullsized":"2023-08-22T00:21:56.723474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704703+0000","last_change":"2023-08-22T00:21:56.346576+0000","last_active":"2023-08-22T00:21:56.704703+0000","last_peered":"2023-08-22T00:21:56.704703+0000","last_clean":"2023-08-22T00:21:56.704703+0000","last_became_active":"2023-08-22T00:21:56.345958+0000","last_became_peered":"2023-08-22T00:21:56.345958+0000","last_unstale":"2023-08-22T00:21:56.704703+0000","last_undegraded":"2023-08-22T00:21:56.704703+0000","last_fullsized":"2023-08-22T00:21:56.704703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732764+0000","last_change":"2023-08-22T00:21:56.730137+0000","last_active":"2023-08-22T00:21:56.732764+0000","last_peered":"2023-08-22T00:21:56.732764+0000","last_clean":"2023-08-22T00:21:56.732764+0000","last_became_active":"2023-08-22T00:21:56.729869+0000","last_became_peered":"2023-08-22T00:21:56.729869+0000","last_unstale":"2023-08-22T00:21:56.732764+0000","last_undegraded":"2023-08-22T00:21:56.732764+0000","last_fullsized":"2023-08-22T00:21:56.732764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703074+0000","last_change":"2023-08-22T00:21:56.339570+0000","last_active":"2023-08-22T00:21:56.703074+0000","last_peered":"2023-08-22T00:21:56.703074+0000","last_clean":"2023-08-22T00:21:56.703074+0000","last_became_active":"2023-08-22T00:21:56.339297+0000","last_became_peered":"2023-08-22T00:21:56.339297+0000","last_unstale":"2023-08-22T00:21:56.703074+0000","last_undegraded":"2023-08-22T00:21:56.703074+0000","last_fullsized":"2023-08-22T00:21:56.703074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735493+0000","last_change":"2023-08-22T00:21:56.732268+0000","last_active":"2023-08-22T00:21:56.735493+0000","last_peered":"2023-08-22T00:21:56.735493+0000","last_clean":"2023-08-22T00:21:56.735493+0000","last_became_active":"2023-08-22T00:21:56.731555+0000","last_became_peered":"2023-08-22T00:21:56.731555+0000","last_unstale":"2023-08-22T00:21:56.735493+0000","last_undegraded":"2023-08-22T00:21:56.735493+0000","last_fullsized":"2023-08-22T00:21:56.735493+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708636+0000","last_change":"2023-08-22T00:21:56.341406+0000","last_active":"2023-08-22T00:21:56.708636+0000","last_peered":"2023-08-22T00:21:56.708636+0000","last_clean":"2023-08-22T00:21:56.708636+0000","last_became_active":"2023-08-22T00:21:56.341130+0000","last_became_peered":"2023-08-22T00:21:56.341130+0000","last_unstale":"2023-08-22T00:21:56.708636+0000","last_undegraded":"2023-08-22T00:21:56.708636+0000","last_fullsized":"2023-08-22T00:21:56.708636+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730380+0000","last_change":"2023-08-22T00:21:56.725753+0000","last_active":"2023-08-22T00:21:56.730380+0000","last_peered":"2023-08-22T00:21:56.730380+0000","last_clean":"2023-08-22T00:21:56.730380+0000","last_became_active":"2023-08-22T00:21:56.725519+0000","last_became_peered":"2023-08-22T00:21:56.725519+0000","last_unstale":"2023-08-22T00:21:56.730380+0000","last_undegraded":"2023-08-22T00:21:56.730380+0000","last_fullsized":"2023-08-22T00:21:56.730380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706213+0000","last_change":"2023-08-22T00:21:56.345503+0000","last_active":"2023-08-22T00:21:56.706213+0000","last_peered":"2023-08-22T00:21:56.706213+0000","last_clean":"2023-08-22T00:21:56.706213+0000","last_became_active":"2023-08-22T00:21:56.345237+0000","last_became_peered":"2023-08-22T00:21:56.345237+0000","last_unstale":"2023-08-22T00:21:56.706213+0000","last_undegraded":"2023-08-22T00:21:56.706213+0000","last_fullsized":"2023-08-22T00:21:56.706213+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719695+0000","last_change":"2023-08-22T00:21:56.717769+0000","last_active":"2023-08-22T00:21:56.719695+0000","last_peered":"2023-08-22T00:21:56.719695+0000","last_clean":"2023-08-22T00:21:56.719695+0000","last_became_active":"2023-08-22T00:21:56.717465+0000","last_became_peered":"2023-08-22T00:21:56.717465+0000","last_unstale":"2023-08-22T00:21:56.719695+0000","last_undegraded":"2023-08-22T00:21:56.719695+0000","last_fullsized":"2023-08-22T00:21:56.719695+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706416+0000","last_change":"2023-08-22T00:21:56.346193+0000","last_active":"2023-08-22T00:21:56.706416+0000","last_peered":"2023-08-22T00:21:56.706416+0000","last_clean":"2023-08-22T00:21:56.706416+0000","last_became_active":"2023-08-22T00:21:56.345908+0000","last_became_peered":"2023-08-22T00:21:56.345908+0000","last_unstale":"2023-08-22T00:21:56.706416+0000","last_undegraded":"2023-08-22T00:21:56.706416+0000","last_fullsized":"2023-08-22T00:21:56.706416+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728506+0000","last_change":"2023-08-22T00:21:56.709589+0000","last_active":"2023-08-22T00:21:56.728506+0000","last_peered":"2023-08-22T00:21:56.728506+0000","last_clean":"2023-08-22T00:21:56.728506+0000","last_became_active":"2023-08-22T00:21:56.709320+0000","last_became_peered":"2023-08-22T00:21:56.709320+0000","last_unstale":"2023-08-22T00:21:56.728506+0000","last_undegraded":"2023-08-22T00:21:56.728506+0000","last_fullsized":"2023-08-22T00:21:56.728506+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727130+0000","last_change":"2023-08-22T00:21:56.347342+0000","last_active":"2023-08-22T00:21:56.727130+0000","last_peered":"2023-08-22T00:21:56.727130+0000","last_clean":"2023-08-22T00:21:56.727130+0000","last_became_active":"2023-08-22T00:21:56.347027+0000","last_became_peered":"2023-08-22T00:21:56.347027+0000","last_unstale":"2023-08-22T00:21:56.727130+0000","last_undegraded":"2023-08-22T00:21:56.727130+0000","last_fullsized":"2023-08-22T00:21:56.727130+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732320+0000","last_change":"2023-08-22T00:21:56.730054+0000","last_active":"2023-08-22T00:21:56.732320+0000","last_peered":"2023-08-22T00:21:56.732320+0000","last_clean":"2023-08-22T00:21:56.732320+0000","last_became_active":"2023-08-22T00:21:56.729585+0000","last_became_peered":"2023-08-22T00:21:56.729585+0000","last_unstale":"2023-08-22T00:21:56.732320+0000","last_undegraded":"2023-08-22T00:21:56.732320+0000","last_fullsized":"2023-08-22T00:21:56.732320+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729715+0000","last_change":"2023-08-22T00:21:56.345349+0000","last_active":"2023-08-22T00:21:56.729715+0000","last_peered":"2023-08-22T00:21:56.729715+0000","last_clean":"2023-08-22T00:21:56.729715+0000","last_became_active":"2023-08-22T00:21:56.345063+0000","last_became_peered":"2023-08-22T00:21:56.345063+0000","last_unstale":"2023-08-22T00:21:56.729715+0000","last_undegraded":"2023-08-22T00:21:56.729715+0000","last_fullsized":"2023-08-22T00:21:56.729715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728906+0000","last_change":"2023-08-22T00:21:56.716056+0000","last_active":"2023-08-22T00:21:56.728906+0000","last_peered":"2023-08-22T00:21:56.728906+0000","last_clean":"2023-08-22T00:21:56.728906+0000","last_became_active":"2023-08-22T00:21:56.715807+0000","last_became_peered":"2023-08-22T00:21:56.715807+0000","last_unstale":"2023-08-22T00:21:56.728906+0000","last_undegraded":"2023-08-22T00:21:56.728906+0000","last_fullsized":"2023-08-22T00:21:56.728906+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732916+0000","last_change":"2023-08-22T00:21:56.348531+0000","last_active":"2023-08-22T00:21:56.732916+0000","last_peered":"2023-08-22T00:21:56.732916+0000","last_clean":"2023-08-22T00:21:56.732916+0000","last_became_active":"2023-08-22T00:21:56.348317+0000","last_became_peered":"2023-08-22T00:21:56.348317+0000","last_unstale":"2023-08-22T00:21:56.732916+0000","last_undegraded":"2023-08-22T00:21:56.732916+0000","last_fullsized":"2023-08-22T00:21:56.732916+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732977+0000","last_change":"2023-08-22T00:21:56.730445+0000","last_active":"2023-08-22T00:21:56.732977+0000","last_peered":"2023-08-22T00:21:56.732977+0000","last_clean":"2023-08-22T00:21:56.732977+0000","last_became_active":"2023-08-22T00:21:56.730189+0000","last_became_peered":"2023-08-22T00:21:56.730189+0000","last_unstale":"2023-08-22T00:21:56.732977+0000","last_undegraded":"2023-08-22T00:21:56.732977+0000","last_fullsized":"2023-08-22T00:21:56.732977+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710745+0000","last_change":"2023-08-22T00:21:56.347926+0000","last_active":"2023-08-22T00:21:56.710745+0000","last_peered":"2023-08-22T00:21:56.710745+0000","last_clean":"2023-08-22T00:21:56.710745+0000","last_became_active":"2023-08-22T00:21:56.347298+0000","last_became_peered":"2023-08-22T00:21:56.347298+0000","last_unstale":"2023-08-22T00:21:56.710745+0000","last_undegraded":"2023-08-22T00:21:56.710745+0000","last_fullsized":"2023-08-22T00:21:56.710745+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726845+0000","last_change":"2023-08-22T00:21:56.721292+0000","last_active":"2023-08-22T00:21:56.726845+0000","last_peered":"2023-08-22T00:21:56.726845+0000","last_clean":"2023-08-22T00:21:56.726845+0000","last_became_active":"2023-08-22T00:21:56.721028+0000","last_became_peered":"2023-08-22T00:21:56.721028+0000","last_unstale":"2023-08-22T00:21:56.726845+0000","last_undegraded":"2023-08-22T00:21:56.726845+0000","last_fullsized":"2023-08-22T00:21:56.726845+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713978+0000","last_change":"2023-08-22T00:21:56.342410+0000","last_active":"2023-08-22T00:21:56.713978+0000","last_peered":"2023-08-22T00:21:56.713978+0000","last_clean":"2023-08-22T00:21:56.713978+0000","last_became_active":"2023-08-22T00:21:56.342137+0000","last_became_peered":"2023-08-22T00:21:56.342137+0000","last_unstale":"2023-08-22T00:21:56.713978+0000","last_undegraded":"2023-08-22T00:21:56.713978+0000","last_fullsized":"2023-08-22T00:21:56.713978+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.734393+0000","last_change":"2023-08-22T00:21:56.724450+0000","last_active":"2023-08-22T00:21:56.734393+0000","last_peered":"2023-08-22T00:21:56.734393+0000","last_clean":"2023-08-22T00:21:56.734393+0000","last_became_active":"2023-08-22T00:21:56.724185+0000","last_became_peered":"2023-08-22T00:21:56.724185+0000","last_unstale":"2023-08-22T00:21:56.734393+0000","last_undegraded":"2023-08-22T00:21:56.734393+0000","last_fullsized":"2023-08-22T00:21:56.734393+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729085+0000","last_change":"2023-08-22T00:21:56.337301+0000","last_active":"2023-08-22T00:21:56.729085+0000","last_peered":"2023-08-22T00:21:56.729085+0000","last_clean":"2023-08-22T00:21:56.729085+0000","last_became_active":"2023-08-22T00:21:56.337052+0000","last_became_peered":"2023-08-22T00:21:56.337052+0000","last_unstale":"2023-08-22T00:21:56.729085+0000","last_undegraded":"2023-08-22T00:21:56.729085+0000","last_fullsized":"2023-08-22T00:21:56.729085+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.722806+0000","last_change":"2023-08-22T00:21:56.720919+0000","last_active":"2023-08-22T00:21:56.722806+0000","last_peered":"2023-08-22T00:21:56.722806+0000","last_clean":"2023-08-22T00:21:56.722806+0000","last_became_active":"2023-08-22T00:21:56.720592+0000","last_became_peered":"2023-08-22T00:21:56.720592+0000","last_unstale":"2023-08-22T00:21:56.722806+0000","last_undegraded":"2023-08-22T00:21:56.722806+0000","last_fullsized":"2023-08-22T00:21:56.722806+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733201+0000","last_change":"2023-08-22T00:21:56.348557+0000","last_active":"2023-08-22T00:21:56.733201+0000","last_peered":"2023-08-22T00:21:56.733201+0000","last_clean":"2023-08-22T00:21:56.733201+0000","last_became_active":"2023-08-22T00:21:56.348290+0000","last_became_peered":"2023-08-22T00:21:56.348290+0000","last_unstale":"2023-08-22T00:21:56.733201+0000","last_undegraded":"2023-08-22T00:21:56.733201+0000","last_fullsized":"2023-08-22T00:21:56.733201+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732774+0000","last_change":"2023-08-22T00:21:56.729061+0000","last_active":"2023-08-22T00:21:56.732774+0000","last_peered":"2023-08-22T00:21:56.732774+0000","last_clean":"2023-08-22T00:21:56.732774+0000","last_became_active":"2023-08-22T00:21:56.728784+0000","last_became_peered":"2023-08-22T00:21:56.728784+0000","last_unstale":"2023-08-22T00:21:56.732774+0000","last_undegraded":"2023-08-22T00:21:56.732774+0000","last_fullsized":"2023-08-22T00:21:56.732774+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708538+0000","last_change":"2023-08-22T00:21:56.357732+0000","last_active":"2023-08-22T00:21:56.708538+0000","last_peered":"2023-08-22T00:21:56.708538+0000","last_clean":"2023-08-22T00:21:56.708538+0000","last_became_active":"2023-08-22T00:21:56.357468+0000","last_became_peered":"2023-08-22T00:21:56.357468+0000","last_unstale":"2023-08-22T00:21:56.708538+0000","last_undegraded":"2023-08-22T00:21:56.708538+0000","last_fullsized":"2023-08-22T00:21:56.708538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724722+0000","last_change":"2023-08-22T00:21:56.721487+0000","last_active":"2023-08-22T00:21:56.724722+0000","last_peered":"2023-08-22T00:21:56.724722+0000","last_clean":"2023-08-22T00:21:56.724722+0000","last_became_active":"2023-08-22T00:21:56.721182+0000","last_became_peered":"2023-08-22T00:21:56.721182+0000","last_unstale":"2023-08-22T00:21:56.724722+0000","last_undegraded":"2023-08-22T00:21:56.724722+0000","last_fullsized":"2023-08-22T00:21:56.724722+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705680+0000","last_change":"2023-08-22T00:21:56.353778+0000","last_active":"2023-08-22T00:21:56.705680+0000","last_peered":"2023-08-22T00:21:56.705680+0000","last_clean":"2023-08-22T00:21:56.705680+0000","last_became_active":"2023-08-22T00:21:56.353554+0000","last_became_peered":"2023-08-22T00:21:56.353554+0000","last_unstale":"2023-08-22T00:21:56.705680+0000","last_undegraded":"2023-08-22T00:21:56.705680+0000","last_fullsized":"2023-08-22T00:21:56.705680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732301+0000","last_change":"2023-08-22T00:21:56.729862+0000","last_active":"2023-08-22T00:21:56.732301+0000","last_peered":"2023-08-22T00:21:56.732301+0000","last_clean":"2023-08-22T00:21:56.732301+0000","last_became_active":"2023-08-22T00:21:56.729181+0000","last_became_peered":"2023-08-22T00:21:56.729181+0000","last_unstale":"2023-08-22T00:21:56.732301+0000","last_undegraded":"2023-08-22T00:21:56.732301+0000","last_fullsized":"2023-08-22T00:21:56.732301+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707048+0000","last_change":"2023-08-22T00:21:56.344464+0000","last_active":"2023-08-22T00:21:56.707048+0000","last_peered":"2023-08-22T00:21:56.707048+0000","last_clean":"2023-08-22T00:21:56.707048+0000","last_became_active":"2023-08-22T00:21:56.344193+0000","last_became_peered":"2023-08-22T00:21:56.344193+0000","last_unstale":"2023-08-22T00:21:56.707048+0000","last_undegraded":"2023-08-22T00:21:56.707048+0000","last_fullsized":"2023-08-22T00:21:56.707048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732013+0000","last_change":"2023-08-22T00:21:56.729667+0000","last_active":"2023-08-22T00:21:56.732013+0000","last_peered":"2023-08-22T00:21:56.732013+0000","last_clean":"2023-08-22T00:21:56.732013+0000","last_became_active":"2023-08-22T00:21:56.729340+0000","last_became_peered":"2023-08-22T00:21:56.729340+0000","last_unstale":"2023-08-22T00:21:56.732013+0000","last_undegraded":"2023-08-22T00:21:56.732013+0000","last_fullsized":"2023-08-22T00:21:56.732013+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703406+0000","last_change":"2023-08-22T00:21:56.346275+0000","last_active":"2023-08-22T00:21:56.703406+0000","last_peered":"2023-08-22T00:21:56.703406+0000","last_clean":"2023-08-22T00:21:56.703406+0000","last_became_active":"2023-08-22T00:21:56.344483+0000","last_became_peered":"2023-08-22T00:21:56.344483+0000","last_unstale":"2023-08-22T00:21:56.703406+0000","last_undegraded":"2023-08-22T00:21:56.703406+0000","last_fullsized":"2023-08-22T00:21:56.703406+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729688+0000","last_change":"2023-08-22T00:21:56.718533+0000","last_active":"2023-08-22T00:21:56.729688+0000","last_peered":"2023-08-22T00:21:56.729688+0000","last_clean":"2023-08-22T00:21:56.729688+0000","last_became_active":"2023-08-22T00:21:56.717827+0000","last_became_peered":"2023-08-22T00:21:56.717827+0000","last_unstale":"2023-08-22T00:21:56.729688+0000","last_undegraded":"2023-08-22T00:21:56.729688+0000","last_fullsized":"2023-08-22T00:21:56.729688+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704811+0000","last_change":"2023-08-22T00:21:56.346400+0000","last_active":"2023-08-22T00:21:56.704811+0000","last_peered":"2023-08-22T00:21:56.704811+0000","last_clean":"2023-08-22T00:21:56.704811+0000","last_became_active":"2023-08-22T00:21:56.345741+0000","last_became_peered":"2023-08-22T00:21:56.345741+0000","last_unstale":"2023-08-22T00:21:56.704811+0000","last_undegraded":"2023-08-22T00:21:56.704811+0000","last_fullsized":"2023-08-22T00:21:56.704811+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733161+0000","last_change":"2023-08-22T00:21:56.731895+0000","last_active":"2023-08-22T00:21:56.733161+0000","last_peered":"2023-08-22T00:21:56.733161+0000","last_clean":"2023-08-22T00:21:56.733161+0000","last_became_active":"2023-08-22T00:21:56.731530+0000","last_became_peered":"2023-08-22T00:21:56.731530+0000","last_unstale":"2023-08-22T00:21:56.733161+0000","last_undegraded":"2023-08-22T00:21:56.733161+0000","last_fullsized":"2023-08-22T00:21:56.733161+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705117+0000","last_change":"2023-08-22T00:21:56.344078+0000","last_active":"2023-08-22T00:21:56.705117+0000","last_peered":"2023-08-22T00:21:56.705117+0000","last_clean":"2023-08-22T00:21:56.705117+0000","last_became_active":"2023-08-22T00:21:56.343460+0000","last_became_peered":"2023-08-22T00:21:56.343460+0000","last_unstale":"2023-08-22T00:21:56.705117+0000","last_undegraded":"2023-08-22T00:21:56.705117+0000","last_fullsized":"2023-08-22T00:21:56.705117+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724294+0000","last_change":"2023-08-22T00:21:56.721181+0000","last_active":"2023-08-22T00:21:56.724294+0000","last_peered":"2023-08-22T00:21:56.724294+0000","last_clean":"2023-08-22T00:21:56.724294+0000","last_became_active":"2023-08-22T00:21:56.720898+0000","last_became_peered":"2023-08-22T00:21:56.720898+0000","last_unstale":"2023-08-22T00:21:56.724294+0000","last_undegraded":"2023-08-22T00:21:56.724294+0000","last_fullsized":"2023-08-22T00:21:56.724294+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705976+0000","last_change":"2023-08-22T00:21:56.345443+0000","last_active":"2023-08-22T00:21:56.705976+0000","last_peered":"2023-08-22T00:21:56.705976+0000","last_clean":"2023-08-22T00:21:56.705976+0000","last_became_active":"2023-08-22T00:21:56.343424+0000","last_became_peered":"2023-08-22T00:21:56.343424+0000","last_unstale":"2023-08-22T00:21:56.705976+0000","last_undegraded":"2023-08-22T00:21:56.705976+0000","last_fullsized":"2023-08-22T00:21:56.705976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733057+0000","last_change":"2023-08-22T00:21:56.730387+0000","last_active":"2023-08-22T00:21:56.733057+0000","last_peered":"2023-08-22T00:21:56.733057+0000","last_clean":"2023-08-22T00:21:56.733057+0000","last_became_active":"2023-08-22T00:21:56.729356+0000","last_became_peered":"2023-08-22T00:21:56.729356+0000","last_unstale":"2023-08-22T00:21:56.733057+0000","last_undegraded":"2023-08-22T00:21:56.733057+0000","last_fullsized":"2023-08-22T00:21:56.733057+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707004+0000","last_change":"2023-08-22T00:21:56.357029+0000","last_active":"2023-08-22T00:21:56.707004+0000","last_peered":"2023-08-22T00:21:56.707004+0000","last_clean":"2023-08-22T00:21:56.707004+0000","last_became_active":"2023-08-22T00:21:56.356725+0000","last_became_peered":"2023-08-22T00:21:56.356725+0000","last_unstale":"2023-08-22T00:21:56.707004+0000","last_undegraded":"2023-08-22T00:21:56.707004+0000","last_fullsized":"2023-08-22T00:21:56.707004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708886+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:56.708886+0000","last_peered":"2023-08-22T00:21:56.708886+0000","last_clean":"2023-08-22T00:21:56.708886+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:56.708886+0000","last_undegraded":"2023-08-22T00:21:56.708886+0000","last_fullsized":"2023-08-22T00:21:56.708886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725813+0000","last_change":"2023-08-22T00:21:56.723379+0000","last_active":"2023-08-22T00:21:56.725813+0000","last_peered":"2023-08-22T00:21:56.725813+0000","last_clean":"2023-08-22T00:21:56.725813+0000","last_became_active":"2023-08-22T00:21:56.723116+0000","last_became_peered":"2023-08-22T00:21:56.723116+0000","last_unstale":"2023-08-22T00:21:56.725813+0000","last_undegraded":"2023-08-22T00:21:56.725813+0000","last_fullsized":"2023-08-22T00:21:56.725813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703538+0000","last_change":"2023-08-22T00:21:56.341109+0000","last_active":"2023-08-22T00:21:56.703538+0000","last_peered":"2023-08-22T00:21:56.703538+0000","last_clean":"2023-08-22T00:21:56.703538+0000","last_became_active":"2023-08-22T00:21:56.340820+0000","last_became_peered":"2023-08-22T00:21:56.340820+0000","last_unstale":"2023-08-22T00:21:56.703538+0000","last_undegraded":"2023-08-22T00:21:56.703538+0000","last_fullsized":"2023-08-22T00:21:56.703538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713598+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:56.713598+0000","last_peered":"2023-08-22T00:21:56.713598+0000","last_clean":"2023-08-22T00:21:56.713598+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:56.713598+0000","last_undegraded":"2023-08-22T00:21:56.713598+0000","last_fullsized":"2023-08-22T00:21:56.713598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731413+0000","last_change":"2023-08-22T00:21:56.728483+0000","last_active":"2023-08-22T00:21:56.731413+0000","last_peered":"2023-08-22T00:21:56.731413+0000","last_clean":"2023-08-22T00:21:56.731413+0000","last_became_active":"2023-08-22T00:21:56.727823+0000","last_became_peered":"2023-08-22T00:21:56.727823+0000","last_unstale":"2023-08-22T00:21:56.731413+0000","last_undegraded":"2023-08-22T00:21:56.731413+0000","last_fullsized":"2023-08-22T00:21:56.731413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719964+0000","last_change":"2023-08-22T00:21:56.338573+0000","last_active":"2023-08-22T00:21:56.719964+0000","last_peered":"2023-08-22T00:21:56.719964+0000","last_clean":"2023-08-22T00:21:56.719964+0000","last_became_active":"2023-08-22T00:21:56.338303+0000","last_became_peered":"2023-08-22T00:21:56.338303+0000","last_unstale":"2023-08-22T00:21:56.719964+0000","last_undegraded":"2023-08-22T00:21:56.719964+0000","last_fullsized":"2023-08-22T00:21:56.719964+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710874+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:56.710874+0000","last_peered":"2023-08-22T00:21:56.710874+0000","last_clean":"2023-08-22T00:21:56.710874+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:56.710874+0000","last_undegraded":"2023-08-22T00:21:56.710874+0000","last_fullsized":"2023-08-22T00:21:56.710874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726797+0000","last_change":"2023-08-22T00:21:56.723157+0000","last_active":"2023-08-22T00:21:56.726797+0000","last_peered":"2023-08-22T00:21:56.726797+0000","last_clean":"2023-08-22T00:21:56.726797+0000","last_became_active":"2023-08-22T00:21:56.721526+0000","last_became_peered":"2023-08-22T00:21:56.721526+0000","last_unstale":"2023-08-22T00:21:56.726797+0000","last_undegraded":"2023-08-22T00:21:56.726797+0000","last_fullsized":"2023-08-22T00:21:56.726797+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713256+0000","last_change":"2023-08-22T00:21:56.349309+0000","last_active":"2023-08-22T00:21:56.713256+0000","last_peered":"2023-08-22T00:21:56.713256+0000","last_clean":"2023-08-22T00:21:56.713256+0000","last_became_active":"2023-08-22T00:21:56.349016+0000","last_became_peered":"2023-08-22T00:21:56.349016+0000","last_unstale":"2023-08-22T00:21:56.713256+0000","last_undegraded":"2023-08-22T00:21:56.713256+0000","last_fullsized":"2023-08-22T00:21:56.713256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713188+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:56.713188+0000","last_peered":"2023-08-22T00:21:56.713188+0000","last_clean":"2023-08-22T00:21:56.713188+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:56.713188+0000","last_undegraded":"2023-08-22T00:21:56.713188+0000","last_fullsized":"2023-08-22T00:21:56.713188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.715153+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:56.715153+0000","last_peered":"2023-08-22T00:21:56.715153+0000","last_clean":"2023-08-22T00:21:56.715153+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:56.715153+0000","last_undegraded":"2023-08-22T00:21:56.715153+0000","last_fullsized":"2023-08-22T00:21:56.715153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727805+0000","last_change":"2023-08-22T00:21:56.725493+0000","last_active":"2023-08-22T00:21:56.727805+0000","last_peered":"2023-08-22T00:21:56.727805+0000","last_clean":"2023-08-22T00:21:56.727805+0000","last_became_active":"2023-08-22T00:21:56.724962+0000","last_became_peered":"2023-08-22T00:21:56.724962+0000","last_unstale":"2023-08-22T00:21:56.727805+0000","last_undegraded":"2023-08-22T00:21:56.727805+0000","last_fullsized":"2023-08-22T00:21:56.727805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729115+0000","last_change":"2023-08-22T00:21:56.347130+0000","last_active":"2023-08-22T00:21:56.729115+0000","last_peered":"2023-08-22T00:21:56.729115+0000","last_clean":"2023-08-22T00:21:56.729115+0000","last_became_active":"2023-08-22T00:21:56.346876+0000","last_became_peered":"2023-08-22T00:21:56.346876+0000","last_unstale":"2023-08-22T00:21:56.729115+0000","last_undegraded":"2023-08-22T00:21:56.729115+0000","last_fullsized":"2023-08-22T00:21:56.729115+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714961+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:56.714961+0000","last_peered":"2023-08-22T00:21:56.714961+0000","last_clean":"2023-08-22T00:21:56.714961+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:56.714961+0000","last_undegraded":"2023-08-22T00:21:56.714961+0000","last_fullsized":"2023-08-22T00:21:56.714961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729932+0000","last_change":"2023-08-22T00:21:56.722443+0000","last_active":"2023-08-22T00:21:56.729932+0000","last_peered":"2023-08-22T00:21:56.729932+0000","last_clean":"2023-08-22T00:21:56.729932+0000","last_became_active":"2023-08-22T00:21:56.722108+0000","last_became_peered":"2023-08-22T00:21:56.722108+0000","last_unstale":"2023-08-22T00:21:56.729932+0000","last_undegraded":"2023-08-22T00:21:56.729932+0000","last_fullsized":"2023-08-22T00:21:56.729932+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719666+0000","last_change":"2023-08-22T00:21:56.352533+0000","last_active":"2023-08-22T00:21:56.719666+0000","last_peered":"2023-08-22T00:21:56.719666+0000","last_clean":"2023-08-22T00:21:56.719666+0000","last_became_active":"2023-08-22T00:21:56.352272+0000","last_became_peered":"2023-08-22T00:21:56.352272+0000","last_unstale":"2023-08-22T00:21:56.719666+0000","last_undegraded":"2023-08-22T00:21:56.719666+0000","last_fullsized":"2023-08-22T00:21:56.719666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713464+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:56.713464+0000","last_peered":"2023-08-22T00:21:56.713464+0000","last_clean":"2023-08-22T00:21:56.713464+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:56.713464+0000","last_undegraded":"2023-08-22T00:21:56.713464+0000","last_fullsized":"2023-08-22T00:21:56.713464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732245+0000","last_change":"2023-08-22T00:21:56.730009+0000","last_active":"2023-08-22T00:21:56.732245+0000","last_peered":"2023-08-22T00:21:56.732245+0000","last_clean":"2023-08-22T00:21:56.732245+0000","last_became_active":"2023-08-22T00:21:56.729760+0000","last_became_peered":"2023-08-22T00:21:56.729760+0000","last_unstale":"2023-08-22T00:21:56.732245+0000","last_undegraded":"2023-08-22T00:21:56.732245+0000","last_fullsized":"2023-08-22T00:21:56.732245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710573+0000","last_change":"2023-08-22T00:21:56.352783+0000","last_active":"2023-08-22T00:21:56.710573+0000","last_peered":"2023-08-22T00:21:56.710573+0000","last_clean":"2023-08-22T00:21:56.710573+0000","last_became_active":"2023-08-22T00:21:56.352531+0000","last_became_peered":"2023-08-22T00:21:56.352531+0000","last_unstale":"2023-08-22T00:21:56.710573+0000","last_undegraded":"2023-08-22T00:21:56.710573+0000","last_fullsized":"2023-08-22T00:21:56.710573+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708612+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:56.708612+0000","last_peered":"2023-08-22T00:21:56.708612+0000","last_clean":"2023-08-22T00:21:56.708612+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:56.708612+0000","last_undegraded":"2023-08-22T00:21:56.708612+0000","last_fullsized":"2023-08-22T00:21:56.708612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729812+0000","last_change":"2023-08-22T00:21:56.719499+0000","last_active":"2023-08-22T00:21:56.729812+0000","last_peered":"2023-08-22T00:21:56.729812+0000","last_clean":"2023-08-22T00:21:56.729812+0000","last_became_active":"2023-08-22T00:21:56.719200+0000","last_became_peered":"2023-08-22T00:21:56.719200+0000","last_unstale":"2023-08-22T00:21:56.729812+0000","last_undegraded":"2023-08-22T00:21:56.729812+0000","last_fullsized":"2023-08-22T00:21:56.729812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710816+0000","last_change":"2023-08-22T00:21:56.343877+0000","last_active":"2023-08-22T00:21:56.710816+0000","last_peered":"2023-08-22T00:21:56.710816+0000","last_clean":"2023-08-22T00:21:56.710816+0000","last_became_active":"2023-08-22T00:21:56.343632+0000","last_became_peered":"2023-08-22T00:21:56.343632+0000","last_unstale":"2023-08-22T00:21:56.710816+0000","last_undegraded":"2023-08-22T00:21:56.710816+0000","last_fullsized":"2023-08-22T00:21:56.710816+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705997+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:56.705997+0000","last_peered":"2023-08-22T00:21:56.705997+0000","last_clean":"2023-08-22T00:21:56.705997+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:56.705997+0000","last_undegraded":"2023-08-22T00:21:56.705997+0000","last_fullsized":"2023-08-22T00:21:56.705997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.437},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.497},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.312}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1294336,"data_stored":677995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.71899999999999997,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.29599999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.78100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.1339999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.79000000000000004},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.073},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.46200000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65900000000000003,"5min":0.753,"15min":0.94399999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":1.03},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.32300000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.246}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.375}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.435},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.38900000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.28199999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":677953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.498}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":678597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.221,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63600000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.441},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.71599999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.876,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.88100000000000001,"15min":11.163},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.51800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1302528,"data_stored":679441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:00.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:22:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.543+0000 7f84fa8e0700 1 Processor -- start 2023-08-22T00:22:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84fa8e0700 1 -- start start 2023-08-22T00:22:00.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84fa8e0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f84f4150e40 0x7f84f40c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84fa8e0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40bd3e0 con 0x7f84f4065f10 2023-08-22T00:22:00.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84fa8e0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40bd0c0 con 0x7f84f40bd870 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84fa8e0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40c3bb0 con 0x7f84f4150e40 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.544+0000 7f84f3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f84f4150e40 0x7f84f40c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f84f4150e40 0x7f84f40c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47548/0 (socket says 172.21.15.98:47548) 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 -- 172.21.15.98:0/980141345 learned_addr learned my addr 172.21.15.98:0/980141345 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 -- 172.21.15.98:0/980141345 >> v1:172.21.15.118:6789/0 conn(0x7f84f40bd870 legacy=0x7f84f40a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 -- 172.21.15.98:0/980141345 >> v1:172.21.15.98:6789/0 conn(0x7f84f4065f10 legacy=0x7f84f4066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 -- 172.21.15.98:0/980141345 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40c3e90 con 0x7f84f4150e40 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f3fff700 1 --2- 172.21.15.98:0/980141345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f4150e40 0x7f84f40c2050 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f84e4006fd0 tx=0x7f84e40090f0).ready entity=mon.0 client_cookie=286448aa7e2ced84 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f2ffd700 1 -- 172.21.15.98:0/980141345 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400b600 con 0x7f84f4150e40 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f2ffd700 1 -- 172.21.15.98:0/980141345 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400b760 con 0x7f84f4150e40 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.545+0000 7f84f2ffd700 1 -- 172.21.15.98:0/980141345 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400bb00 con 0x7f84f4150e40 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 -- 172.21.15.98:0/980141345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f4150e40 msgr2=0x7f84f40c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/980141345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f4150e40 0x7f84f40c2050 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f84e4006fd0 tx=0x7f84e40090f0).stop 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 -- 172.21.15.98:0/980141345 shutdown_connections 2023-08-22T00:22:00.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/980141345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f4150e40 0x7f84f40c2050 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 -- 172.21.15.98:0/980141345 >> 172.21.15.98:0/980141345 conn(0x7f84f406a980 msgr2=0x7f84f40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 -- 172.21.15.98:0/980141345 shutdown_connections 2023-08-22T00:22:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.546+0000 7f84fa8e0700 1 -- 172.21.15.98:0/980141345 wait complete. 2023-08-22T00:22:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.547+0000 7f84fa8e0700 1 Processor -- start 2023-08-22T00:22:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.547+0000 7f84fa8e0700 1 -- start start 2023-08-22T00:22:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84f4065f10 0x7f84f4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84f4150e40 0x7f84f40c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4147d90 con 0x7f84f40bd870 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40abe20 con 0x7f84f4150e40 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40ac3e0 con 0x7f84f4065f10 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47556/0 (socket says 172.21.15.98:47556) 2023-08-22T00:22:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 -- 172.21.15.98:0/3116682509 learned_addr learned my addr 172.21.15.98:0/3116682509 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f3fff700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84f4065f10 0x7f84f4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 -- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84f4065f10 msgr2=0x7f84f4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84f4065f10 0x7f84f4152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 -- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84f4150e40 msgr2=0x7f84f40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f8e7d700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84f4150e40 0x7f84f40c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84f4150e40 0x7f84f40c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 -- 172.21.15.98:0/3116682509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009370 con 0x7f84f40bd870 2023-08-22T00:22:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84f37fe700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f84e800c490 tx=0x7f84e8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800f470 con 0x7f84f40bd870 2023-08-22T00:22:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800f5d0 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f4152560 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800f950 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.548+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f4154190 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.549+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4047480 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.550+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f84e800fd40 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.550+0000 7f84dbfff700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 0x7f84e00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.550+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f84e8079430 con 0x7f84f40bd870 2023-08-22T00:22:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.550+0000 7f84f3fff700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 0x7f84e00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.550+0000 7f84f3fff700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 0x7f84e00612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f84e4009130 tx=0x7f84e4017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.554+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84e80488f0 con 0x7f84f40bd870 2023-08-22T00:22:00.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.780+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f84f40c2380 con 0x7f84f40bd870 2023-08-22T00:22:00.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.781+0000 7f84dbfff700 1 -- 172.21.15.98:0/3116682509 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+953 (secure 0 0 0) 0x7f84e804a7f0 con 0x7f84f40bd870 2023-08-22T00:22:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:00.783 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":969,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":105,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2486108160,"bytes_avail":770608005120,"bytes_total":773094113280},"fsmap":{"epoch":36,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6915}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-22T00:20:14.810414+0000","services":{}},"progress_events":{}} 2023-08-22T00:22:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.782+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 msgr2=0x7f84e00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.782+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 0x7f84e00612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f84e4009130 tx=0x7f84e4017000).stop 2023-08-22T00:22:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.782+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 msgr2=0x7f84f4147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.782+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f84e800c490 tx=0x7f84e8007de0).stop 2023-08-22T00:22:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 shutdown_connections 2023-08-22T00:22:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84e005ee10 0x7f84e00612d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84f4065f10 0x7f84f4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84f4150e40 0x7f84f40c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 --2- 172.21.15.98:0/3116682509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f40bd870 0x7f84f4147f50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 >> 172.21.15.98:0/3116682509 conn(0x7f84f406a980 msgr2=0x7f84f40c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 shutdown_connections 2023-08-22T00:22:00.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.783+0000 7f84fa8e0700 1 -- 172.21.15.98:0/3116682509 wait complete. 2023-08-22T00:22:00.796 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:22:00.796 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.911+0000 7f6e3a7fe700 1 Processor -- start 2023-08-22T00:22:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.911+0000 7f6e3a7fe700 1 -- start start 2023-08-22T00:22:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e3a7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e340c64a0 0x7f6e34154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e3a7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 0x7f6e340bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e3a7fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e340bcd40 con 0x7f6e34154260 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e3a7fe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340c24b0 con 0x7f6e340c64a0 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e3a7fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3414e7b0 con 0x7f6e340c2030 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e337fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e340c64a0 0x7f6e34154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e38d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 0x7f6e340bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e33fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6e34154260 0x7f6e34154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:34760/0 (socket says 172.21.15.98:34760) 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.912+0000 7f6e33fff700 1 -- 172.21.15.98:0/118017738 learned_addr learned my addr 172.21.15.98:0/118017738 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e337fe700 1 -- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 msgr2=0x7f6e340bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e337fe700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 0x7f6e340bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e337fe700 1 -- 172.21.15.98:0/118017738 >> v1:172.21.15.118:6789/0 conn(0x7f6e34154260 legacy=0x7f6e34154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e32ffd700 1 -- 172.21.15.98:0/118017738 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823619776 0 0) 0x7f6e340bcd40 con 0x7f6e34154260 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e337fe700 1 -- 172.21.15.98:0/118017738 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340c4fb0 con 0x7f6e340c64a0 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e38d9b700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 0x7f6e340bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e337fe700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c64a0 0x7f6e34154d50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6e24009790 tx=0x7f6e24009060).ready entity=mon.1 client_cookie=d91c0a879b81d0db server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e32ffd700 1 -- 172.21.15.98:0/118017738 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400b530 con 0x7f6e340c64a0 2023-08-22T00:22:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e32ffd700 1 -- 172.21.15.98:0/118017738 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2400b690 con 0x7f6e340c64a0 2023-08-22T00:22:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.913+0000 7f6e32ffd700 1 -- 172.21.15.98:0/118017738 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400ba10 con 0x7f6e340c64a0 2023-08-22T00:22:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c64a0 msgr2=0x7f6e34154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c64a0 0x7f6e34154d50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6e24009790 tx=0x7f6e24009060).stop 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/118017738 shutdown_connections 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c2030 0x7f6e340bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/118017738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c64a0 0x7f6e34154d50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/118017738 >> 172.21.15.98:0/118017738 conn(0x7f6e340c3980 msgr2=0x7f6e340c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/118017738 shutdown_connections 2023-08-22T00:22:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.914+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/118017738 wait complete. 2023-08-22T00:22:00.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.915+0000 7f6e3a7fe700 1 Processor -- start 2023-08-22T00:22:00.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.915+0000 7f6e3a7fe700 1 -- start start 2023-08-22T00:22:00.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c2030 0x7f6e3414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c64a0 0x7f6e34069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3406a4c0 con 0x7f6e34154260 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340be9a0 con 0x7f6e340c2030 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340be690 con 0x7f6e340c64a0 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47562/0 (socket says 172.21.15.98:47562) 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 -- 172.21.15.98:0/2508674098 learned_addr learned my addr 172.21.15.98:0/2508674098 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e33fff700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c2030 0x7f6e3414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e337fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c64a0 0x7f6e34069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 -- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c64a0 msgr2=0x7f6e34069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c64a0 0x7f6e34069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 -- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c2030 msgr2=0x7f6e3414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c2030 0x7f6e3414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 -- 172.21.15.98:0/2508674098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009a20 con 0x7f6e34154260 2023-08-22T00:22:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e38d9b700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f6e2c009fc0 tx=0x7f6e2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00cbd0 con 0x7f6e34154260 2023-08-22T00:22:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c00f040 con 0x7f6e34154260 2023-08-22T00:22:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e240092a0 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.916+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c013400 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.917+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34153b40 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.918+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e34047480 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.918+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6e2c0137f0 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.918+0000 7f6e1bfff700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 0x7f6e200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.918+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6e2c07a840 con 0x7f6e34154260 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.918+0000 7f6e33fff700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 0x7f6e200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.919+0000 7f6e33fff700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 0x7f6e200612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6e28007fd0 tx=0x7f6e28007dd0).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:00.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:00.922+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e2c04bb50 con 0x7f6e34154260 2023-08-22T00:22:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.080+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e34154fe0 con 0x7f6e2005ee10 2023-08-22T00:22:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.090+0000 7f6e1bfff700 1 -- 172.21.15.98:0/2508674098 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362226 (secure 0 0 0) 0x7f6e34154fe0 con 0x7f6e2005ee10 2023-08-22T00:22:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 msgr2=0x7f6e200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 0x7f6e200612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6e28007fd0 tx=0x7f6e28007dd0).stop 2023-08-22T00:22:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 msgr2=0x7f6e34069fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f6e2c009fc0 tx=0x7f6e2c00b040).stop 2023-08-22T00:22:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 shutdown_connections 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e34154260 0x7f6e34069fd0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e340c2030 0x7f6e3414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6e2005ee10 0x7f6e200612d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 --2- 172.21.15.98:0/2508674098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c64a0 0x7f6e34069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 >> 172.21.15.98:0/2508674098 conn(0x7f6e340c3980 msgr2=0x7f6e341555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 shutdown_connections 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:01.093+0000 7f6e3a7fe700 1 -- 172.21.15.98:0/2508674098 wait complete. 2023-08-22T00:22:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:01.106 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:22:00.245903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":228,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427840,"kb_used_data":10112,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546880,"statfs":{"total":773094113280,"available":770608005120,"internally_reserved":0,"allocated":10354688,"data_stored":5427676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10334,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.054350"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735254+0000","last_change":"2023-08-22T00:21:56.726566+0000","last_active":"2023-08-22T00:21:56.735254+0000","last_peered":"2023-08-22T00:21:56.735254+0000","last_clean":"2023-08-22T00:21:56.735254+0000","last_became_active":"2023-08-22T00:21:56.726154+0000","last_became_peered":"2023-08-22T00:21:56.726154+0000","last_unstale":"2023-08-22T00:21:56.735254+0000","last_undegraded":"2023-08-22T00:21:56.735254+0000","last_fullsized":"2023-08-22T00:21:56.735254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732234+0000","last_change":"2023-08-22T00:21:56.350790+0000","last_active":"2023-08-22T00:21:56.732234+0000","last_peered":"2023-08-22T00:21:56.732234+0000","last_clean":"2023-08-22T00:21:56.732234+0000","last_became_active":"2023-08-22T00:21:56.350520+0000","last_became_peered":"2023-08-22T00:21:56.350520+0000","last_unstale":"2023-08-22T00:21:56.732234+0000","last_undegraded":"2023-08-22T00:21:56.732234+0000","last_fullsized":"2023-08-22T00:21:56.732234+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724823+0000","last_change":"2023-08-22T00:21:56.721796+0000","last_active":"2023-08-22T00:21:56.724823+0000","last_peered":"2023-08-22T00:21:56.724823+0000","last_clean":"2023-08-22T00:21:56.724823+0000","last_became_active":"2023-08-22T00:21:56.721509+0000","last_became_peered":"2023-08-22T00:21:56.721509+0000","last_unstale":"2023-08-22T00:21:56.724823+0000","last_undegraded":"2023-08-22T00:21:56.724823+0000","last_fullsized":"2023-08-22T00:21:56.724823+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703828+0000","last_change":"2023-08-22T00:21:56.343367+0000","last_active":"2023-08-22T00:21:56.703828+0000","last_peered":"2023-08-22T00:21:56.703828+0000","last_clean":"2023-08-22T00:21:56.703828+0000","last_became_active":"2023-08-22T00:21:56.343039+0000","last_became_peered":"2023-08-22T00:21:56.343039+0000","last_unstale":"2023-08-22T00:21:56.703828+0000","last_undegraded":"2023-08-22T00:21:56.703828+0000","last_fullsized":"2023-08-22T00:21:56.703828+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729850+0000","last_change":"2023-08-22T00:21:56.722358+0000","last_active":"2023-08-22T00:21:56.729850+0000","last_peered":"2023-08-22T00:21:56.729850+0000","last_clean":"2023-08-22T00:21:56.729850+0000","last_became_active":"2023-08-22T00:21:56.722082+0000","last_became_peered":"2023-08-22T00:21:56.722082+0000","last_unstale":"2023-08-22T00:21:56.729850+0000","last_undegraded":"2023-08-22T00:21:56.729850+0000","last_fullsized":"2023-08-22T00:21:56.729850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.709706+0000","last_change":"2023-08-22T00:21:56.340757+0000","last_active":"2023-08-22T00:21:56.709706+0000","last_peered":"2023-08-22T00:21:56.709706+0000","last_clean":"2023-08-22T00:21:56.709706+0000","last_became_active":"2023-08-22T00:21:56.340483+0000","last_became_peered":"2023-08-22T00:21:56.340483+0000","last_unstale":"2023-08-22T00:21:56.709706+0000","last_undegraded":"2023-08-22T00:21:56.709706+0000","last_fullsized":"2023-08-22T00:21:56.709706+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731290+0000","last_change":"2023-08-22T00:21:56.720668+0000","last_active":"2023-08-22T00:21:56.731290+0000","last_peered":"2023-08-22T00:21:56.731290+0000","last_clean":"2023-08-22T00:21:56.731290+0000","last_became_active":"2023-08-22T00:21:56.719901+0000","last_became_peered":"2023-08-22T00:21:56.719901+0000","last_unstale":"2023-08-22T00:21:56.731290+0000","last_undegraded":"2023-08-22T00:21:56.731290+0000","last_fullsized":"2023-08-22T00:21:56.731290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724670+0000","last_change":"2023-08-22T00:21:56.341820+0000","last_active":"2023-08-22T00:21:56.724670+0000","last_peered":"2023-08-22T00:21:56.724670+0000","last_clean":"2023-08-22T00:21:56.724670+0000","last_became_active":"2023-08-22T00:21:56.341462+0000","last_became_peered":"2023-08-22T00:21:56.341462+0000","last_unstale":"2023-08-22T00:21:56.724670+0000","last_undegraded":"2023-08-22T00:21:56.724670+0000","last_fullsized":"2023-08-22T00:21:56.724670+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723258+0000","last_change":"2023-08-22T00:21:56.720826+0000","last_active":"2023-08-22T00:21:56.723258+0000","last_peered":"2023-08-22T00:21:56.723258+0000","last_clean":"2023-08-22T00:21:56.723258+0000","last_became_active":"2023-08-22T00:21:56.720538+0000","last_became_peered":"2023-08-22T00:21:56.720538+0000","last_unstale":"2023-08-22T00:21:56.723258+0000","last_undegraded":"2023-08-22T00:21:56.723258+0000","last_fullsized":"2023-08-22T00:21:56.723258+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727155+0000","last_change":"2023-08-22T00:21:56.348788+0000","last_active":"2023-08-22T00:21:56.727155+0000","last_peered":"2023-08-22T00:21:56.727155+0000","last_clean":"2023-08-22T00:21:56.727155+0000","last_became_active":"2023-08-22T00:21:56.347376+0000","last_became_peered":"2023-08-22T00:21:56.347376+0000","last_unstale":"2023-08-22T00:21:56.727155+0000","last_undegraded":"2023-08-22T00:21:56.727155+0000","last_fullsized":"2023-08-22T00:21:56.727155+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724401+0000","last_change":"2023-08-22T00:21:56.722763+0000","last_active":"2023-08-22T00:21:56.724401+0000","last_peered":"2023-08-22T00:21:56.724401+0000","last_clean":"2023-08-22T00:21:56.724401+0000","last_became_active":"2023-08-22T00:21:56.722237+0000","last_became_peered":"2023-08-22T00:21:56.722237+0000","last_unstale":"2023-08-22T00:21:56.724401+0000","last_undegraded":"2023-08-22T00:21:56.724401+0000","last_fullsized":"2023-08-22T00:21:56.724401+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719528+0000","last_change":"2023-08-22T00:21:56.343526+0000","last_active":"2023-08-22T00:21:56.719528+0000","last_peered":"2023-08-22T00:21:56.719528+0000","last_clean":"2023-08-22T00:21:56.719528+0000","last_became_active":"2023-08-22T00:21:56.342933+0000","last_became_peered":"2023-08-22T00:21:56.342933+0000","last_unstale":"2023-08-22T00:21:56.719528+0000","last_undegraded":"2023-08-22T00:21:56.719528+0000","last_fullsized":"2023-08-22T00:21:56.719528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727758+0000","last_change":"2023-08-22T00:21:56.726444+0000","last_active":"2023-08-22T00:21:56.727758+0000","last_peered":"2023-08-22T00:21:56.727758+0000","last_clean":"2023-08-22T00:21:56.727758+0000","last_became_active":"2023-08-22T00:21:56.726157+0000","last_became_peered":"2023-08-22T00:21:56.726157+0000","last_unstale":"2023-08-22T00:21:56.727758+0000","last_undegraded":"2023-08-22T00:21:56.727758+0000","last_fullsized":"2023-08-22T00:21:56.727758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705245+0000","last_change":"2023-08-22T00:21:56.337534+0000","last_active":"2023-08-22T00:21:56.705245+0000","last_peered":"2023-08-22T00:21:56.705245+0000","last_clean":"2023-08-22T00:21:56.705245+0000","last_became_active":"2023-08-22T00:21:56.337258+0000","last_became_peered":"2023-08-22T00:21:56.337258+0000","last_unstale":"2023-08-22T00:21:56.705245+0000","last_undegraded":"2023-08-22T00:21:56.705245+0000","last_fullsized":"2023-08-22T00:21:56.705245+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729680+0000","last_change":"2023-08-22T00:21:56.721199+0000","last_active":"2023-08-22T00:21:56.729680+0000","last_peered":"2023-08-22T00:21:56.729680+0000","last_clean":"2023-08-22T00:21:56.729680+0000","last_became_active":"2023-08-22T00:21:56.720911+0000","last_became_peered":"2023-08-22T00:21:56.720911+0000","last_unstale":"2023-08-22T00:21:56.729680+0000","last_undegraded":"2023-08-22T00:21:56.729680+0000","last_fullsized":"2023-08-22T00:21:56.729680+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706902+0000","last_change":"2023-08-22T00:21:56.342754+0000","last_active":"2023-08-22T00:21:56.706902+0000","last_peered":"2023-08-22T00:21:56.706902+0000","last_clean":"2023-08-22T00:21:56.706902+0000","last_became_active":"2023-08-22T00:21:56.342504+0000","last_became_peered":"2023-08-22T00:21:56.342504+0000","last_unstale":"2023-08-22T00:21:56.706902+0000","last_undegraded":"2023-08-22T00:21:56.706902+0000","last_fullsized":"2023-08-22T00:21:56.706902+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726914+0000","last_change":"2023-08-22T00:21:56.724073+0000","last_active":"2023-08-22T00:21:56.726914+0000","last_peered":"2023-08-22T00:21:56.726914+0000","last_clean":"2023-08-22T00:21:56.726914+0000","last_became_active":"2023-08-22T00:21:56.723778+0000","last_became_peered":"2023-08-22T00:21:56.723778+0000","last_unstale":"2023-08-22T00:21:56.726914+0000","last_undegraded":"2023-08-22T00:21:56.726914+0000","last_fullsized":"2023-08-22T00:21:56.726914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706678+0000","last_change":"2023-08-22T00:21:56.345756+0000","last_active":"2023-08-22T00:21:56.706678+0000","last_peered":"2023-08-22T00:21:56.706678+0000","last_clean":"2023-08-22T00:21:56.706678+0000","last_became_active":"2023-08-22T00:21:56.343602+0000","last_became_peered":"2023-08-22T00:21:56.343602+0000","last_unstale":"2023-08-22T00:21:56.706678+0000","last_undegraded":"2023-08-22T00:21:56.706678+0000","last_fullsized":"2023-08-22T00:21:56.706678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732854+0000","last_change":"2023-08-22T00:21:56.731918+0000","last_active":"2023-08-22T00:21:56.732854+0000","last_peered":"2023-08-22T00:21:56.732854+0000","last_clean":"2023-08-22T00:21:56.732854+0000","last_became_active":"2023-08-22T00:21:56.731625+0000","last_became_peered":"2023-08-22T00:21:56.731625+0000","last_unstale":"2023-08-22T00:21:56.732854+0000","last_undegraded":"2023-08-22T00:21:56.732854+0000","last_fullsized":"2023-08-22T00:21:56.732854+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714315+0000","last_change":"2023-08-22T00:21:56.342959+0000","last_active":"2023-08-22T00:21:56.714315+0000","last_peered":"2023-08-22T00:21:56.714315+0000","last_clean":"2023-08-22T00:21:56.714315+0000","last_became_active":"2023-08-22T00:21:56.342697+0000","last_became_peered":"2023-08-22T00:21:56.342697+0000","last_unstale":"2023-08-22T00:21:56.714315+0000","last_undegraded":"2023-08-22T00:21:56.714315+0000","last_fullsized":"2023-08-22T00:21:56.714315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726867+0000","last_change":"2023-08-22T00:21:56.724838+0000","last_active":"2023-08-22T00:21:56.726867+0000","last_peered":"2023-08-22T00:21:56.726867+0000","last_clean":"2023-08-22T00:21:56.726867+0000","last_became_active":"2023-08-22T00:21:56.724509+0000","last_became_peered":"2023-08-22T00:21:56.724509+0000","last_unstale":"2023-08-22T00:21:56.726867+0000","last_undegraded":"2023-08-22T00:21:56.726867+0000","last_fullsized":"2023-08-22T00:21:56.726867+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703530+0000","last_change":"2023-08-22T00:21:56.346146+0000","last_active":"2023-08-22T00:21:56.703530+0000","last_peered":"2023-08-22T00:21:56.703530+0000","last_clean":"2023-08-22T00:21:56.703530+0000","last_became_active":"2023-08-22T00:21:56.344423+0000","last_became_peered":"2023-08-22T00:21:56.344423+0000","last_unstale":"2023-08-22T00:21:56.703530+0000","last_undegraded":"2023-08-22T00:21:56.703530+0000","last_fullsized":"2023-08-22T00:21:56.703530+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726380+0000","last_change":"2023-08-22T00:21:56.720611+0000","last_active":"2023-08-22T00:21:56.726380+0000","last_peered":"2023-08-22T00:21:56.726380+0000","last_clean":"2023-08-22T00:21:56.726380+0000","last_became_active":"2023-08-22T00:21:56.720318+0000","last_became_peered":"2023-08-22T00:21:56.720318+0000","last_unstale":"2023-08-22T00:21:56.726380+0000","last_undegraded":"2023-08-22T00:21:56.726380+0000","last_fullsized":"2023-08-22T00:21:56.726380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.737783+0000","last_change":"2023-08-22T00:21:56.348273+0000","last_active":"2023-08-22T00:21:56.737783+0000","last_peered":"2023-08-22T00:21:56.737783+0000","last_clean":"2023-08-22T00:21:56.737783+0000","last_became_active":"2023-08-22T00:21:56.348000+0000","last_became_peered":"2023-08-22T00:21:56.348000+0000","last_unstale":"2023-08-22T00:21:56.737783+0000","last_undegraded":"2023-08-22T00:21:56.737783+0000","last_fullsized":"2023-08-22T00:21:56.737783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729953+0000","last_change":"2023-08-22T00:21:56.722513+0000","last_active":"2023-08-22T00:21:56.729953+0000","last_peered":"2023-08-22T00:21:56.729953+0000","last_clean":"2023-08-22T00:21:56.729953+0000","last_became_active":"2023-08-22T00:21:56.722126+0000","last_became_peered":"2023-08-22T00:21:56.722126+0000","last_unstale":"2023-08-22T00:21:56.729953+0000","last_undegraded":"2023-08-22T00:21:56.729953+0000","last_fullsized":"2023-08-22T00:21:56.729953+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729128+0000","last_change":"2023-08-22T00:21:56.350297+0000","last_active":"2023-08-22T00:21:56.729128+0000","last_peered":"2023-08-22T00:21:56.729128+0000","last_clean":"2023-08-22T00:21:56.729128+0000","last_became_active":"2023-08-22T00:21:56.350029+0000","last_became_peered":"2023-08-22T00:21:56.350029+0000","last_unstale":"2023-08-22T00:21:56.729128+0000","last_undegraded":"2023-08-22T00:21:56.729128+0000","last_fullsized":"2023-08-22T00:21:56.729128+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731386+0000","last_change":"2023-08-22T00:21:56.727174+0000","last_active":"2023-08-22T00:21:56.731386+0000","last_peered":"2023-08-22T00:21:56.731386+0000","last_clean":"2023-08-22T00:21:56.731386+0000","last_became_active":"2023-08-22T00:21:56.726934+0000","last_became_peered":"2023-08-22T00:21:56.726934+0000","last_unstale":"2023-08-22T00:21:56.731386+0000","last_undegraded":"2023-08-22T00:21:56.731386+0000","last_fullsized":"2023-08-22T00:21:56.731386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710841+0000","last_change":"2023-08-22T00:21:56.343702+0000","last_active":"2023-08-22T00:21:56.710841+0000","last_peered":"2023-08-22T00:21:56.710841+0000","last_clean":"2023-08-22T00:21:56.710841+0000","last_became_active":"2023-08-22T00:21:56.343211+0000","last_became_peered":"2023-08-22T00:21:56.343211+0000","last_unstale":"2023-08-22T00:21:56.710841+0000","last_undegraded":"2023-08-22T00:21:56.710841+0000","last_fullsized":"2023-08-22T00:21:56.710841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719286+0000","last_change":"2023-08-22T00:21:56.711929+0000","last_active":"2023-08-22T00:21:56.719286+0000","last_peered":"2023-08-22T00:21:56.719286+0000","last_clean":"2023-08-22T00:21:56.719286+0000","last_became_active":"2023-08-22T00:21:56.711624+0000","last_became_peered":"2023-08-22T00:21:56.711624+0000","last_unstale":"2023-08-22T00:21:56.719286+0000","last_undegraded":"2023-08-22T00:21:56.719286+0000","last_fullsized":"2023-08-22T00:21:56.719286+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702986+0000","last_change":"2023-08-22T00:21:56.340744+0000","last_active":"2023-08-22T00:21:56.702986+0000","last_peered":"2023-08-22T00:21:56.702986+0000","last_clean":"2023-08-22T00:21:56.702986+0000","last_became_active":"2023-08-22T00:21:56.340439+0000","last_became_peered":"2023-08-22T00:21:56.340439+0000","last_unstale":"2023-08-22T00:21:56.702986+0000","last_undegraded":"2023-08-22T00:21:56.702986+0000","last_fullsized":"2023-08-22T00:21:56.702986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735474+0000","last_change":"2023-08-22T00:21:56.731929+0000","last_active":"2023-08-22T00:21:56.735474+0000","last_peered":"2023-08-22T00:21:56.735474+0000","last_clean":"2023-08-22T00:21:56.735474+0000","last_became_active":"2023-08-22T00:21:56.731632+0000","last_became_peered":"2023-08-22T00:21:56.731632+0000","last_unstale":"2023-08-22T00:21:56.735474+0000","last_undegraded":"2023-08-22T00:21:56.735474+0000","last_fullsized":"2023-08-22T00:21:56.735474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731515+0000","last_change":"2023-08-22T00:21:56.349226+0000","last_active":"2023-08-22T00:21:56.731515+0000","last_peered":"2023-08-22T00:21:56.731515+0000","last_clean":"2023-08-22T00:21:56.731515+0000","last_became_active":"2023-08-22T00:21:56.348925+0000","last_became_peered":"2023-08-22T00:21:56.348925+0000","last_unstale":"2023-08-22T00:21:56.731515+0000","last_undegraded":"2023-08-22T00:21:56.731515+0000","last_fullsized":"2023-08-22T00:21:56.731515+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728659+0000","last_change":"2023-08-22T00:21:56.717738+0000","last_active":"2023-08-22T00:21:56.728659+0000","last_peered":"2023-08-22T00:21:56.728659+0000","last_clean":"2023-08-22T00:21:56.728659+0000","last_became_active":"2023-08-22T00:21:56.717466+0000","last_became_peered":"2023-08-22T00:21:56.717466+0000","last_unstale":"2023-08-22T00:21:56.728659+0000","last_undegraded":"2023-08-22T00:21:56.728659+0000","last_fullsized":"2023-08-22T00:21:56.728659+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706817+0000","last_change":"2023-08-22T00:21:56.349781+0000","last_active":"2023-08-22T00:21:56.706817+0000","last_peered":"2023-08-22T00:21:56.706817+0000","last_clean":"2023-08-22T00:21:56.706817+0000","last_became_active":"2023-08-22T00:21:56.349508+0000","last_became_peered":"2023-08-22T00:21:56.349508+0000","last_unstale":"2023-08-22T00:21:56.706817+0000","last_undegraded":"2023-08-22T00:21:56.706817+0000","last_fullsized":"2023-08-22T00:21:56.706817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720597+0000","last_change":"2023-08-22T00:21:56.718378+0000","last_active":"2023-08-22T00:21:56.720597+0000","last_peered":"2023-08-22T00:21:56.720597+0000","last_clean":"2023-08-22T00:21:56.720597+0000","last_became_active":"2023-08-22T00:21:56.718046+0000","last_became_peered":"2023-08-22T00:21:56.718046+0000","last_unstale":"2023-08-22T00:21:56.720597+0000","last_undegraded":"2023-08-22T00:21:56.720597+0000","last_fullsized":"2023-08-22T00:21:56.720597+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708444+0000","last_change":"2023-08-22T00:21:56.347400+0000","last_active":"2023-08-22T00:21:56.708444+0000","last_peered":"2023-08-22T00:21:56.708444+0000","last_clean":"2023-08-22T00:21:56.708444+0000","last_became_active":"2023-08-22T00:21:56.347119+0000","last_became_peered":"2023-08-22T00:21:56.347119+0000","last_unstale":"2023-08-22T00:21:56.708444+0000","last_undegraded":"2023-08-22T00:21:56.708444+0000","last_fullsized":"2023-08-22T00:21:56.708444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735322+0000","last_change":"2023-08-22T00:21:56.730106+0000","last_active":"2023-08-22T00:21:56.735322+0000","last_peered":"2023-08-22T00:21:56.735322+0000","last_clean":"2023-08-22T00:21:56.735322+0000","last_became_active":"2023-08-22T00:21:56.729475+0000","last_became_peered":"2023-08-22T00:21:56.729475+0000","last_unstale":"2023-08-22T00:21:56.735322+0000","last_undegraded":"2023-08-22T00:21:56.735322+0000","last_fullsized":"2023-08-22T00:21:56.735322+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729063+0000","last_change":"2023-08-22T00:21:56.345942+0000","last_active":"2023-08-22T00:21:56.729063+0000","last_peered":"2023-08-22T00:21:56.729063+0000","last_clean":"2023-08-22T00:21:56.729063+0000","last_became_active":"2023-08-22T00:21:56.345667+0000","last_became_peered":"2023-08-22T00:21:56.345667+0000","last_unstale":"2023-08-22T00:21:56.729063+0000","last_undegraded":"2023-08-22T00:21:56.729063+0000","last_fullsized":"2023-08-22T00:21:56.729063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729369+0000","last_change":"2023-08-22T00:21:56.723984+0000","last_active":"2023-08-22T00:21:56.729369+0000","last_peered":"2023-08-22T00:21:56.729369+0000","last_clean":"2023-08-22T00:21:56.729369+0000","last_became_active":"2023-08-22T00:21:56.723632+0000","last_became_peered":"2023-08-22T00:21:56.723632+0000","last_unstale":"2023-08-22T00:21:56.729369+0000","last_undegraded":"2023-08-22T00:21:56.729369+0000","last_fullsized":"2023-08-22T00:21:56.729369+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711107+0000","last_change":"2023-08-22T00:21:56.351605+0000","last_active":"2023-08-22T00:21:56.711107+0000","last_peered":"2023-08-22T00:21:56.711107+0000","last_clean":"2023-08-22T00:21:56.711107+0000","last_became_active":"2023-08-22T00:21:56.349889+0000","last_became_peered":"2023-08-22T00:21:56.349889+0000","last_unstale":"2023-08-22T00:21:56.711107+0000","last_undegraded":"2023-08-22T00:21:56.711107+0000","last_fullsized":"2023-08-22T00:21:56.711107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735555+0000","last_change":"2023-08-22T00:21:56.733235+0000","last_active":"2023-08-22T00:21:56.735555+0000","last_peered":"2023-08-22T00:21:56.735555+0000","last_clean":"2023-08-22T00:21:56.735555+0000","last_became_active":"2023-08-22T00:21:56.732942+0000","last_became_peered":"2023-08-22T00:21:56.732942+0000","last_unstale":"2023-08-22T00:21:56.735555+0000","last_undegraded":"2023-08-22T00:21:56.735555+0000","last_fullsized":"2023-08-22T00:21:56.735555+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726357+0000","last_change":"2023-08-22T00:21:56.349376+0000","last_active":"2023-08-22T00:21:56.726357+0000","last_peered":"2023-08-22T00:21:56.726357+0000","last_clean":"2023-08-22T00:21:56.726357+0000","last_became_active":"2023-08-22T00:21:56.348958+0000","last_became_peered":"2023-08-22T00:21:56.348958+0000","last_unstale":"2023-08-22T00:21:56.726357+0000","last_undegraded":"2023-08-22T00:21:56.726357+0000","last_fullsized":"2023-08-22T00:21:56.726357+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735368+0000","last_change":"2023-08-22T00:21:56.730982+0000","last_active":"2023-08-22T00:21:56.735368+0000","last_peered":"2023-08-22T00:21:56.735368+0000","last_clean":"2023-08-22T00:21:56.735368+0000","last_became_active":"2023-08-22T00:21:56.730713+0000","last_became_peered":"2023-08-22T00:21:56.730713+0000","last_unstale":"2023-08-22T00:21:56.735368+0000","last_undegraded":"2023-08-22T00:21:56.735368+0000","last_fullsized":"2023-08-22T00:21:56.735368+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706762+0000","last_change":"2023-08-22T00:21:56.354225+0000","last_active":"2023-08-22T00:21:56.706762+0000","last_peered":"2023-08-22T00:21:56.706762+0000","last_clean":"2023-08-22T00:21:56.706762+0000","last_became_active":"2023-08-22T00:21:56.353959+0000","last_became_peered":"2023-08-22T00:21:56.353959+0000","last_unstale":"2023-08-22T00:21:56.706762+0000","last_undegraded":"2023-08-22T00:21:56.706762+0000","last_fullsized":"2023-08-22T00:21:56.706762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735370+0000","last_change":"2023-08-22T00:21:56.729930+0000","last_active":"2023-08-22T00:21:56.735370+0000","last_peered":"2023-08-22T00:21:56.735370+0000","last_clean":"2023-08-22T00:21:56.735370+0000","last_became_active":"2023-08-22T00:21:56.729558+0000","last_became_peered":"2023-08-22T00:21:56.729558+0000","last_unstale":"2023-08-22T00:21:56.735370+0000","last_undegraded":"2023-08-22T00:21:56.735370+0000","last_fullsized":"2023-08-22T00:21:56.735370+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706299+0000","last_change":"2023-08-22T00:21:56.344957+0000","last_active":"2023-08-22T00:21:56.706299+0000","last_peered":"2023-08-22T00:21:56.706299+0000","last_clean":"2023-08-22T00:21:56.706299+0000","last_became_active":"2023-08-22T00:21:56.344659+0000","last_became_peered":"2023-08-22T00:21:56.344659+0000","last_unstale":"2023-08-22T00:21:56.706299+0000","last_undegraded":"2023-08-22T00:21:56.706299+0000","last_fullsized":"2023-08-22T00:21:56.706299+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731835+0000","last_change":"2023-08-22T00:21:56.729695+0000","last_active":"2023-08-22T00:21:56.731835+0000","last_peered":"2023-08-22T00:21:56.731835+0000","last_clean":"2023-08-22T00:21:56.731835+0000","last_became_active":"2023-08-22T00:21:56.728983+0000","last_became_peered":"2023-08-22T00:21:56.728983+0000","last_unstale":"2023-08-22T00:21:56.731835+0000","last_undegraded":"2023-08-22T00:21:56.731835+0000","last_fullsized":"2023-08-22T00:21:56.731835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702930+0000","last_change":"2023-08-22T00:21:56.343786+0000","last_active":"2023-08-22T00:21:56.702930+0000","last_peered":"2023-08-22T00:21:56.702930+0000","last_clean":"2023-08-22T00:21:56.702930+0000","last_became_active":"2023-08-22T00:21:56.343478+0000","last_became_peered":"2023-08-22T00:21:56.343478+0000","last_unstale":"2023-08-22T00:21:56.702930+0000","last_undegraded":"2023-08-22T00:21:56.702930+0000","last_fullsized":"2023-08-22T00:21:56.702930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732696+0000","last_change":"2023-08-22T00:21:56.728733+0000","last_active":"2023-08-22T00:21:56.732696+0000","last_peered":"2023-08-22T00:21:56.732696+0000","last_clean":"2023-08-22T00:21:56.732696+0000","last_became_active":"2023-08-22T00:21:56.728193+0000","last_became_peered":"2023-08-22T00:21:56.728193+0000","last_unstale":"2023-08-22T00:21:56.732696+0000","last_undegraded":"2023-08-22T00:21:56.732696+0000","last_fullsized":"2023-08-22T00:21:56.732696+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703127+0000","last_change":"2023-08-22T00:21:56.343200+0000","last_active":"2023-08-22T00:21:56.703127+0000","last_peered":"2023-08-22T00:21:56.703127+0000","last_clean":"2023-08-22T00:21:56.703127+0000","last_became_active":"2023-08-22T00:21:56.342898+0000","last_became_peered":"2023-08-22T00:21:56.342898+0000","last_unstale":"2023-08-22T00:21:56.703127+0000","last_undegraded":"2023-08-22T00:21:56.703127+0000","last_fullsized":"2023-08-22T00:21:56.703127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735340+0000","last_change":"2023-08-22T00:21:56.726565+0000","last_active":"2023-08-22T00:21:56.735340+0000","last_peered":"2023-08-22T00:21:56.735340+0000","last_clean":"2023-08-22T00:21:56.735340+0000","last_became_active":"2023-08-22T00:21:56.725923+0000","last_became_peered":"2023-08-22T00:21:56.725923+0000","last_unstale":"2023-08-22T00:21:56.735340+0000","last_undegraded":"2023-08-22T00:21:56.735340+0000","last_fullsized":"2023-08-22T00:21:56.735340+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714430+0000","last_change":"2023-08-22T00:21:56.348195+0000","last_active":"2023-08-22T00:21:56.714430+0000","last_peered":"2023-08-22T00:21:56.714430+0000","last_clean":"2023-08-22T00:21:56.714430+0000","last_became_active":"2023-08-22T00:21:56.347907+0000","last_became_peered":"2023-08-22T00:21:56.347907+0000","last_unstale":"2023-08-22T00:21:56.714430+0000","last_undegraded":"2023-08-22T00:21:56.714430+0000","last_fullsized":"2023-08-22T00:21:56.714430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724698+0000","last_change":"2023-08-22T00:21:56.721312+0000","last_active":"2023-08-22T00:21:56.724698+0000","last_peered":"2023-08-22T00:21:56.724698+0000","last_clean":"2023-08-22T00:21:56.724698+0000","last_became_active":"2023-08-22T00:21:56.721030+0000","last_became_peered":"2023-08-22T00:21:56.721030+0000","last_unstale":"2023-08-22T00:21:56.724698+0000","last_undegraded":"2023-08-22T00:21:56.724698+0000","last_fullsized":"2023-08-22T00:21:56.724698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713374+0000","last_change":"2023-08-22T00:21:56.348591+0000","last_active":"2023-08-22T00:21:56.713374+0000","last_peered":"2023-08-22T00:21:56.713374+0000","last_clean":"2023-08-22T00:21:56.713374+0000","last_became_active":"2023-08-22T00:21:56.348298+0000","last_became_peered":"2023-08-22T00:21:56.348298+0000","last_unstale":"2023-08-22T00:21:56.713374+0000","last_undegraded":"2023-08-22T00:21:56.713374+0000","last_fullsized":"2023-08-22T00:21:56.713374+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725839+0000","last_change":"2023-08-22T00:21:56.724152+0000","last_active":"2023-08-22T00:21:56.725839+0000","last_peered":"2023-08-22T00:21:56.725839+0000","last_clean":"2023-08-22T00:21:56.725839+0000","last_became_active":"2023-08-22T00:21:56.723850+0000","last_became_peered":"2023-08-22T00:21:56.723850+0000","last_unstale":"2023-08-22T00:21:56.725839+0000","last_undegraded":"2023-08-22T00:21:56.725839+0000","last_fullsized":"2023-08-22T00:21:56.725839+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711211+0000","last_change":"2023-08-22T00:21:56.352313+0000","last_active":"2023-08-22T00:21:56.711211+0000","last_peered":"2023-08-22T00:21:56.711211+0000","last_clean":"2023-08-22T00:21:56.711211+0000","last_became_active":"2023-08-22T00:21:56.352079+0000","last_became_peered":"2023-08-22T00:21:56.352079+0000","last_unstale":"2023-08-22T00:21:56.711211+0000","last_undegraded":"2023-08-22T00:21:56.711211+0000","last_fullsized":"2023-08-22T00:21:56.711211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735484+0000","last_change":"2023-08-22T00:21:56.727092+0000","last_active":"2023-08-22T00:21:56.735484+0000","last_peered":"2023-08-22T00:21:56.735484+0000","last_clean":"2023-08-22T00:21:56.735484+0000","last_became_active":"2023-08-22T00:21:56.726820+0000","last_became_peered":"2023-08-22T00:21:56.726820+0000","last_unstale":"2023-08-22T00:21:56.735484+0000","last_undegraded":"2023-08-22T00:21:56.735484+0000","last_fullsized":"2023-08-22T00:21:56.735484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703315+0000","last_change":"2023-08-22T00:21:56.345493+0000","last_active":"2023-08-22T00:21:56.703315+0000","last_peered":"2023-08-22T00:21:56.703315+0000","last_clean":"2023-08-22T00:21:56.703315+0000","last_became_active":"2023-08-22T00:21:56.344185+0000","last_became_peered":"2023-08-22T00:21:56.344185+0000","last_unstale":"2023-08-22T00:21:56.703315+0000","last_undegraded":"2023-08-22T00:21:56.703315+0000","last_fullsized":"2023-08-22T00:21:56.703315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735494+0000","last_change":"2023-08-22T00:21:56.727153+0000","last_active":"2023-08-22T00:21:56.735494+0000","last_peered":"2023-08-22T00:21:56.735494+0000","last_clean":"2023-08-22T00:21:56.735494+0000","last_became_active":"2023-08-22T00:21:56.726892+0000","last_became_peered":"2023-08-22T00:21:56.726892+0000","last_unstale":"2023-08-22T00:21:56.735494+0000","last_undegraded":"2023-08-22T00:21:56.735494+0000","last_fullsized":"2023-08-22T00:21:56.735494+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.712345+0000","last_change":"2023-08-22T00:21:56.348507+0000","last_active":"2023-08-22T00:21:56.712345+0000","last_peered":"2023-08-22T00:21:56.712345+0000","last_clean":"2023-08-22T00:21:56.712345+0000","last_became_active":"2023-08-22T00:21:56.348220+0000","last_became_peered":"2023-08-22T00:21:56.348220+0000","last_unstale":"2023-08-22T00:21:56.712345+0000","last_undegraded":"2023-08-22T00:21:56.712345+0000","last_fullsized":"2023-08-22T00:21:56.712345+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727264+0000","last_change":"2023-08-22T00:21:56.722873+0000","last_active":"2023-08-22T00:21:56.727264+0000","last_peered":"2023-08-22T00:21:56.727264+0000","last_clean":"2023-08-22T00:21:56.727264+0000","last_became_active":"2023-08-22T00:21:56.722609+0000","last_became_peered":"2023-08-22T00:21:56.722609+0000","last_unstale":"2023-08-22T00:21:56.727264+0000","last_undegraded":"2023-08-22T00:21:56.727264+0000","last_fullsized":"2023-08-22T00:21:56.727264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708510+0000","last_change":"2023-08-22T00:21:56.342316+0000","last_active":"2023-08-22T00:21:56.708510+0000","last_peered":"2023-08-22T00:21:56.708510+0000","last_clean":"2023-08-22T00:21:56.708510+0000","last_became_active":"2023-08-22T00:21:56.342042+0000","last_became_peered":"2023-08-22T00:21:56.342042+0000","last_unstale":"2023-08-22T00:21:56.708510+0000","last_undegraded":"2023-08-22T00:21:56.708510+0000","last_fullsized":"2023-08-22T00:21:56.708510+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731307+0000","last_change":"2023-08-22T00:21:56.729398+0000","last_active":"2023-08-22T00:21:56.731307+0000","last_peered":"2023-08-22T00:21:56.731307+0000","last_clean":"2023-08-22T00:21:56.731307+0000","last_became_active":"2023-08-22T00:21:56.729134+0000","last_became_peered":"2023-08-22T00:21:56.729134+0000","last_unstale":"2023-08-22T00:21:56.731307+0000","last_undegraded":"2023-08-22T00:21:56.731307+0000","last_fullsized":"2023-08-22T00:21:56.731307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714871+0000","last_change":"2023-08-22T00:21:56.350153+0000","last_active":"2023-08-22T00:21:56.714871+0000","last_peered":"2023-08-22T00:21:56.714871+0000","last_clean":"2023-08-22T00:21:56.714871+0000","last_became_active":"2023-08-22T00:21:56.349891+0000","last_became_peered":"2023-08-22T00:21:56.349891+0000","last_unstale":"2023-08-22T00:21:56.714871+0000","last_undegraded":"2023-08-22T00:21:56.714871+0000","last_fullsized":"2023-08-22T00:21:56.714871+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720801+0000","last_change":"2023-08-22T00:21:56.712558+0000","last_active":"2023-08-22T00:21:56.720801+0000","last_peered":"2023-08-22T00:21:56.720801+0000","last_clean":"2023-08-22T00:21:56.720801+0000","last_became_active":"2023-08-22T00:21:56.712232+0000","last_became_peered":"2023-08-22T00:21:56.712232+0000","last_unstale":"2023-08-22T00:21:56.720801+0000","last_undegraded":"2023-08-22T00:21:56.720801+0000","last_fullsized":"2023-08-22T00:21:56.720801+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.718363+0000","last_change":"2023-08-22T00:21:56.344835+0000","last_active":"2023-08-22T00:21:56.718363+0000","last_peered":"2023-08-22T00:21:56.718363+0000","last_clean":"2023-08-22T00:21:56.718363+0000","last_became_active":"2023-08-22T00:21:56.343691+0000","last_became_peered":"2023-08-22T00:21:56.343691+0000","last_unstale":"2023-08-22T00:21:56.718363+0000","last_undegraded":"2023-08-22T00:21:56.718363+0000","last_fullsized":"2023-08-22T00:21:56.718363+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733699+0000","last_change":"2023-08-22T00:21:56.732886+0000","last_active":"2023-08-22T00:21:56.733699+0000","last_peered":"2023-08-22T00:21:56.733699+0000","last_clean":"2023-08-22T00:21:56.733699+0000","last_became_active":"2023-08-22T00:21:56.732562+0000","last_became_peered":"2023-08-22T00:21:56.732562+0000","last_unstale":"2023-08-22T00:21:56.733699+0000","last_undegraded":"2023-08-22T00:21:56.733699+0000","last_fullsized":"2023-08-22T00:21:56.733699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730666+0000","last_change":"2023-08-22T00:21:56.344853+0000","last_active":"2023-08-22T00:21:56.730666+0000","last_peered":"2023-08-22T00:21:56.730666+0000","last_clean":"2023-08-22T00:21:56.730666+0000","last_became_active":"2023-08-22T00:21:56.344549+0000","last_became_peered":"2023-08-22T00:21:56.344549+0000","last_unstale":"2023-08-22T00:21:56.730666+0000","last_undegraded":"2023-08-22T00:21:56.730666+0000","last_fullsized":"2023-08-22T00:21:56.730666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726847+0000","last_change":"2023-08-22T00:21:56.723081+0000","last_active":"2023-08-22T00:21:56.726847+0000","last_peered":"2023-08-22T00:21:56.726847+0000","last_clean":"2023-08-22T00:21:56.726847+0000","last_became_active":"2023-08-22T00:21:56.722803+0000","last_became_peered":"2023-08-22T00:21:56.722803+0000","last_unstale":"2023-08-22T00:21:56.726847+0000","last_undegraded":"2023-08-22T00:21:56.726847+0000","last_fullsized":"2023-08-22T00:21:56.726847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729681+0000","last_change":"2023-08-22T00:21:56.345081+0000","last_active":"2023-08-22T00:21:56.729681+0000","last_peered":"2023-08-22T00:21:56.729681+0000","last_clean":"2023-08-22T00:21:56.729681+0000","last_became_active":"2023-08-22T00:21:56.344060+0000","last_became_peered":"2023-08-22T00:21:56.344060+0000","last_unstale":"2023-08-22T00:21:56.729681+0000","last_undegraded":"2023-08-22T00:21:56.729681+0000","last_fullsized":"2023-08-22T00:21:56.729681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731314+0000","last_change":"2023-08-22T00:21:56.720734+0000","last_active":"2023-08-22T00:21:56.731314+0000","last_peered":"2023-08-22T00:21:56.731314+0000","last_clean":"2023-08-22T00:21:56.731314+0000","last_became_active":"2023-08-22T00:21:56.720285+0000","last_became_peered":"2023-08-22T00:21:56.720285+0000","last_unstale":"2023-08-22T00:21:56.731314+0000","last_undegraded":"2023-08-22T00:21:56.731314+0000","last_fullsized":"2023-08-22T00:21:56.731314+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703360+0000","last_change":"2023-08-22T00:21:56.346216+0000","last_active":"2023-08-22T00:21:56.703360+0000","last_peered":"2023-08-22T00:21:56.703360+0000","last_clean":"2023-08-22T00:21:56.703360+0000","last_became_active":"2023-08-22T00:21:56.344406+0000","last_became_peered":"2023-08-22T00:21:56.344406+0000","last_unstale":"2023-08-22T00:21:56.703360+0000","last_undegraded":"2023-08-22T00:21:56.703360+0000","last_fullsized":"2023-08-22T00:21:56.703360+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727171+0000","last_change":"2023-08-22T00:21:56.722688+0000","last_active":"2023-08-22T00:21:56.727171+0000","last_peered":"2023-08-22T00:21:56.727171+0000","last_clean":"2023-08-22T00:21:56.727171+0000","last_became_active":"2023-08-22T00:21:56.721734+0000","last_became_peered":"2023-08-22T00:21:56.721734+0000","last_unstale":"2023-08-22T00:21:56.727171+0000","last_undegraded":"2023-08-22T00:21:56.727171+0000","last_fullsized":"2023-08-22T00:21:56.727171+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711472+0000","last_change":"2023-08-22T00:21:56.349229+0000","last_active":"2023-08-22T00:21:56.711472+0000","last_peered":"2023-08-22T00:21:56.711472+0000","last_clean":"2023-08-22T00:21:56.711472+0000","last_became_active":"2023-08-22T00:21:56.348596+0000","last_became_peered":"2023-08-22T00:21:56.348596+0000","last_unstale":"2023-08-22T00:21:56.711472+0000","last_undegraded":"2023-08-22T00:21:56.711472+0000","last_fullsized":"2023-08-22T00:21:56.711472+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723474+0000","last_change":"2023-08-22T00:21:56.719102+0000","last_active":"2023-08-22T00:21:56.723474+0000","last_peered":"2023-08-22T00:21:56.723474+0000","last_clean":"2023-08-22T00:21:56.723474+0000","last_became_active":"2023-08-22T00:21:56.718887+0000","last_became_peered":"2023-08-22T00:21:56.718887+0000","last_unstale":"2023-08-22T00:21:56.723474+0000","last_undegraded":"2023-08-22T00:21:56.723474+0000","last_fullsized":"2023-08-22T00:21:56.723474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704703+0000","last_change":"2023-08-22T00:21:56.346576+0000","last_active":"2023-08-22T00:21:56.704703+0000","last_peered":"2023-08-22T00:21:56.704703+0000","last_clean":"2023-08-22T00:21:56.704703+0000","last_became_active":"2023-08-22T00:21:56.345958+0000","last_became_peered":"2023-08-22T00:21:56.345958+0000","last_unstale":"2023-08-22T00:21:56.704703+0000","last_undegraded":"2023-08-22T00:21:56.704703+0000","last_fullsized":"2023-08-22T00:21:56.704703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732764+0000","last_change":"2023-08-22T00:21:56.730137+0000","last_active":"2023-08-22T00:21:56.732764+0000","last_peered":"2023-08-22T00:21:56.732764+0000","last_clean":"2023-08-22T00:21:56.732764+0000","last_became_active":"2023-08-22T00:21:56.729869+0000","last_became_peered":"2023-08-22T00:21:56.729869+0000","last_unstale":"2023-08-22T00:21:56.732764+0000","last_undegraded":"2023-08-22T00:21:56.732764+0000","last_fullsized":"2023-08-22T00:21:56.732764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703074+0000","last_change":"2023-08-22T00:21:56.339570+0000","last_active":"2023-08-22T00:21:56.703074+0000","last_peered":"2023-08-22T00:21:56.703074+0000","last_clean":"2023-08-22T00:21:56.703074+0000","last_became_active":"2023-08-22T00:21:56.339297+0000","last_became_peered":"2023-08-22T00:21:56.339297+0000","last_unstale":"2023-08-22T00:21:56.703074+0000","last_undegraded":"2023-08-22T00:21:56.703074+0000","last_fullsized":"2023-08-22T00:21:56.703074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735493+0000","last_change":"2023-08-22T00:21:56.732268+0000","last_active":"2023-08-22T00:21:56.735493+0000","last_peered":"2023-08-22T00:21:56.735493+0000","last_clean":"2023-08-22T00:21:56.735493+0000","last_became_active":"2023-08-22T00:21:56.731555+0000","last_became_peered":"2023-08-22T00:21:56.731555+0000","last_unstale":"2023-08-22T00:21:56.735493+0000","last_undegraded":"2023-08-22T00:21:56.735493+0000","last_fullsized":"2023-08-22T00:21:56.735493+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708636+0000","last_change":"2023-08-22T00:21:56.341406+0000","last_active":"2023-08-22T00:21:56.708636+0000","last_peered":"2023-08-22T00:21:56.708636+0000","last_clean":"2023-08-22T00:21:56.708636+0000","last_became_active":"2023-08-22T00:21:56.341130+0000","last_became_peered":"2023-08-22T00:21:56.341130+0000","last_unstale":"2023-08-22T00:21:56.708636+0000","last_undegraded":"2023-08-22T00:21:56.708636+0000","last_fullsized":"2023-08-22T00:21:56.708636+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730380+0000","last_change":"2023-08-22T00:21:56.725753+0000","last_active":"2023-08-22T00:21:56.730380+0000","last_peered":"2023-08-22T00:21:56.730380+0000","last_clean":"2023-08-22T00:21:56.730380+0000","last_became_active":"2023-08-22T00:21:56.725519+0000","last_became_peered":"2023-08-22T00:21:56.725519+0000","last_unstale":"2023-08-22T00:21:56.730380+0000","last_undegraded":"2023-08-22T00:21:56.730380+0000","last_fullsized":"2023-08-22T00:21:56.730380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706213+0000","last_change":"2023-08-22T00:21:56.345503+0000","last_active":"2023-08-22T00:21:56.706213+0000","last_peered":"2023-08-22T00:21:56.706213+0000","last_clean":"2023-08-22T00:21:56.706213+0000","last_became_active":"2023-08-22T00:21:56.345237+0000","last_became_peered":"2023-08-22T00:21:56.345237+0000","last_unstale":"2023-08-22T00:21:56.706213+0000","last_undegraded":"2023-08-22T00:21:56.706213+0000","last_fullsized":"2023-08-22T00:21:56.706213+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719695+0000","last_change":"2023-08-22T00:21:56.717769+0000","last_active":"2023-08-22T00:21:56.719695+0000","last_peered":"2023-08-22T00:21:56.719695+0000","last_clean":"2023-08-22T00:21:56.719695+0000","last_became_active":"2023-08-22T00:21:56.717465+0000","last_became_peered":"2023-08-22T00:21:56.717465+0000","last_unstale":"2023-08-22T00:21:56.719695+0000","last_undegraded":"2023-08-22T00:21:56.719695+0000","last_fullsized":"2023-08-22T00:21:56.719695+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706416+0000","last_change":"2023-08-22T00:21:56.346193+0000","last_active":"2023-08-22T00:21:56.706416+0000","last_peered":"2023-08-22T00:21:56.706416+0000","last_clean":"2023-08-22T00:21:56.706416+0000","last_became_active":"2023-08-22T00:21:56.345908+0000","last_became_peered":"2023-08-22T00:21:56.345908+0000","last_unstale":"2023-08-22T00:21:56.706416+0000","last_undegraded":"2023-08-22T00:21:56.706416+0000","last_fullsized":"2023-08-22T00:21:56.706416+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728506+0000","last_change":"2023-08-22T00:21:56.709589+0000","last_active":"2023-08-22T00:21:56.728506+0000","last_peered":"2023-08-22T00:21:56.728506+0000","last_clean":"2023-08-22T00:21:56.728506+0000","last_became_active":"2023-08-22T00:21:56.709320+0000","last_became_peered":"2023-08-22T00:21:56.709320+0000","last_unstale":"2023-08-22T00:21:56.728506+0000","last_undegraded":"2023-08-22T00:21:56.728506+0000","last_fullsized":"2023-08-22T00:21:56.728506+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727130+0000","last_change":"2023-08-22T00:21:56.347342+0000","last_active":"2023-08-22T00:21:56.727130+0000","last_peered":"2023-08-22T00:21:56.727130+0000","last_clean":"2023-08-22T00:21:56.727130+0000","last_became_active":"2023-08-22T00:21:56.347027+0000","last_became_peered":"2023-08-22T00:21:56.347027+0000","last_unstale":"2023-08-22T00:21:56.727130+0000","last_undegraded":"2023-08-22T00:21:56.727130+0000","last_fullsized":"2023-08-22T00:21:56.727130+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732320+0000","last_change":"2023-08-22T00:21:56.730054+0000","last_active":"2023-08-22T00:21:56.732320+0000","last_peered":"2023-08-22T00:21:56.732320+0000","last_clean":"2023-08-22T00:21:56.732320+0000","last_became_active":"2023-08-22T00:21:56.729585+0000","last_became_peered":"2023-08-22T00:21:56.729585+0000","last_unstale":"2023-08-22T00:21:56.732320+0000","last_undegraded":"2023-08-22T00:21:56.732320+0000","last_fullsized":"2023-08-22T00:21:56.732320+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729715+0000","last_change":"2023-08-22T00:21:56.345349+0000","last_active":"2023-08-22T00:21:56.729715+0000","last_peered":"2023-08-22T00:21:56.729715+0000","last_clean":"2023-08-22T00:21:56.729715+0000","last_became_active":"2023-08-22T00:21:56.345063+0000","last_became_peered":"2023-08-22T00:21:56.345063+0000","last_unstale":"2023-08-22T00:21:56.729715+0000","last_undegraded":"2023-08-22T00:21:56.729715+0000","last_fullsized":"2023-08-22T00:21:56.729715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728906+0000","last_change":"2023-08-22T00:21:56.716056+0000","last_active":"2023-08-22T00:21:56.728906+0000","last_peered":"2023-08-22T00:21:56.728906+0000","last_clean":"2023-08-22T00:21:56.728906+0000","last_became_active":"2023-08-22T00:21:56.715807+0000","last_became_peered":"2023-08-22T00:21:56.715807+0000","last_unstale":"2023-08-22T00:21:56.728906+0000","last_undegraded":"2023-08-22T00:21:56.728906+0000","last_fullsized":"2023-08-22T00:21:56.728906+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732916+0000","last_change":"2023-08-22T00:21:56.348531+0000","last_active":"2023-08-22T00:21:56.732916+0000","last_peered":"2023-08-22T00:21:56.732916+0000","last_clean":"2023-08-22T00:21:56.732916+0000","last_became_active":"2023-08-22T00:21:56.348317+0000","last_became_peered":"2023-08-22T00:21:56.348317+0000","last_unstale":"2023-08-22T00:21:56.732916+0000","last_undegraded":"2023-08-22T00:21:56.732916+0000","last_fullsized":"2023-08-22T00:21:56.732916+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732977+0000","last_change":"2023-08-22T00:21:56.730445+0000","last_active":"2023-08-22T00:21:56.732977+0000","last_peered":"2023-08-22T00:21:56.732977+0000","last_clean":"2023-08-22T00:21:56.732977+0000","last_became_active":"2023-08-22T00:21:56.730189+0000","last_became_peered":"2023-08-22T00:21:56.730189+0000","last_unstale":"2023-08-22T00:21:56.732977+0000","last_undegraded":"2023-08-22T00:21:56.732977+0000","last_fullsized":"2023-08-22T00:21:56.732977+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710745+0000","last_change":"2023-08-22T00:21:56.347926+0000","last_active":"2023-08-22T00:21:56.710745+0000","last_peered":"2023-08-22T00:21:56.710745+0000","last_clean":"2023-08-22T00:21:56.710745+0000","last_became_active":"2023-08-22T00:21:56.347298+0000","last_became_peered":"2023-08-22T00:21:56.347298+0000","last_unstale":"2023-08-22T00:21:56.710745+0000","last_undegraded":"2023-08-22T00:21:56.710745+0000","last_fullsized":"2023-08-22T00:21:56.710745+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726845+0000","last_change":"2023-08-22T00:21:56.721292+0000","last_active":"2023-08-22T00:21:56.726845+0000","last_peered":"2023-08-22T00:21:56.726845+0000","last_clean":"2023-08-22T00:21:56.726845+0000","last_became_active":"2023-08-22T00:21:56.721028+0000","last_became_peered":"2023-08-22T00:21:56.721028+0000","last_unstale":"2023-08-22T00:21:56.726845+0000","last_undegraded":"2023-08-22T00:21:56.726845+0000","last_fullsized":"2023-08-22T00:21:56.726845+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713978+0000","last_change":"2023-08-22T00:21:56.342410+0000","last_active":"2023-08-22T00:21:56.713978+0000","last_peered":"2023-08-22T00:21:56.713978+0000","last_clean":"2023-08-22T00:21:56.713978+0000","last_became_active":"2023-08-22T00:21:56.342137+0000","last_became_peered":"2023-08-22T00:21:56.342137+0000","last_unstale":"2023-08-22T00:21:56.713978+0000","last_undegraded":"2023-08-22T00:21:56.713978+0000","last_fullsized":"2023-08-22T00:21:56.713978+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.734393+0000","last_change":"2023-08-22T00:21:56.724450+0000","last_active":"2023-08-22T00:21:56.734393+0000","last_peered":"2023-08-22T00:21:56.734393+0000","last_clean":"2023-08-22T00:21:56.734393+0000","last_became_active":"2023-08-22T00:21:56.724185+0000","last_became_peered":"2023-08-22T00:21:56.724185+0000","last_unstale":"2023-08-22T00:21:56.734393+0000","last_undegraded":"2023-08-22T00:21:56.734393+0000","last_fullsized":"2023-08-22T00:21:56.734393+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729085+0000","last_change":"2023-08-22T00:21:56.337301+0000","last_active":"2023-08-22T00:21:56.729085+0000","last_peered":"2023-08-22T00:21:56.729085+0000","last_clean":"2023-08-22T00:21:56.729085+0000","last_became_active":"2023-08-22T00:21:56.337052+0000","last_became_peered":"2023-08-22T00:21:56.337052+0000","last_unstale":"2023-08-22T00:21:56.729085+0000","last_undegraded":"2023-08-22T00:21:56.729085+0000","last_fullsized":"2023-08-22T00:21:56.729085+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.722806+0000","last_change":"2023-08-22T00:21:56.720919+0000","last_active":"2023-08-22T00:21:56.722806+0000","last_peered":"2023-08-22T00:21:56.722806+0000","last_clean":"2023-08-22T00:21:56.722806+0000","last_became_active":"2023-08-22T00:21:56.720592+0000","last_became_peered":"2023-08-22T00:21:56.720592+0000","last_unstale":"2023-08-22T00:21:56.722806+0000","last_undegraded":"2023-08-22T00:21:56.722806+0000","last_fullsized":"2023-08-22T00:21:56.722806+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733201+0000","last_change":"2023-08-22T00:21:56.348557+0000","last_active":"2023-08-22T00:21:56.733201+0000","last_peered":"2023-08-22T00:21:56.733201+0000","last_clean":"2023-08-22T00:21:56.733201+0000","last_became_active":"2023-08-22T00:21:56.348290+0000","last_became_peered":"2023-08-22T00:21:56.348290+0000","last_unstale":"2023-08-22T00:21:56.733201+0000","last_undegraded":"2023-08-22T00:21:56.733201+0000","last_fullsized":"2023-08-22T00:21:56.733201+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732774+0000","last_change":"2023-08-22T00:21:56.729061+0000","last_active":"2023-08-22T00:21:56.732774+0000","last_peered":"2023-08-22T00:21:56.732774+0000","last_clean":"2023-08-22T00:21:56.732774+0000","last_became_active":"2023-08-22T00:21:56.728784+0000","last_became_peered":"2023-08-22T00:21:56.728784+0000","last_unstale":"2023-08-22T00:21:56.732774+0000","last_undegraded":"2023-08-22T00:21:56.732774+0000","last_fullsized":"2023-08-22T00:21:56.732774+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708538+0000","last_change":"2023-08-22T00:21:56.357732+0000","last_active":"2023-08-22T00:21:56.708538+0000","last_peered":"2023-08-22T00:21:56.708538+0000","last_clean":"2023-08-22T00:21:56.708538+0000","last_became_active":"2023-08-22T00:21:56.357468+0000","last_became_peered":"2023-08-22T00:21:56.357468+0000","last_unstale":"2023-08-22T00:21:56.708538+0000","last_undegraded":"2023-08-22T00:21:56.708538+0000","last_fullsized":"2023-08-22T00:21:56.708538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724722+0000","last_change":"2023-08-22T00:21:56.721487+0000","last_active":"2023-08-22T00:21:56.724722+0000","last_peered":"2023-08-22T00:21:56.724722+0000","last_clean":"2023-08-22T00:21:56.724722+0000","last_became_active":"2023-08-22T00:21:56.721182+0000","last_became_peered":"2023-08-22T00:21:56.721182+0000","last_unstale":"2023-08-22T00:21:56.724722+0000","last_undegraded":"2023-08-22T00:21:56.724722+0000","last_fullsized":"2023-08-22T00:21:56.724722+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705680+0000","last_change":"2023-08-22T00:21:56.353778+0000","last_active":"2023-08-22T00:21:56.705680+0000","last_peered":"2023-08-22T00:21:56.705680+0000","last_clean":"2023-08-22T00:21:56.705680+0000","last_became_active":"2023-08-22T00:21:56.353554+0000","last_became_peered":"2023-08-22T00:21:56.353554+0000","last_unstale":"2023-08-22T00:21:56.705680+0000","last_undegraded":"2023-08-22T00:21:56.705680+0000","last_fullsized":"2023-08-22T00:21:56.705680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732301+0000","last_change":"2023-08-22T00:21:56.729862+0000","last_active":"2023-08-22T00:21:56.732301+0000","last_peered":"2023-08-22T00:21:56.732301+0000","last_clean":"2023-08-22T00:21:56.732301+0000","last_became_active":"2023-08-22T00:21:56.729181+0000","last_became_peered":"2023-08-22T00:21:56.729181+0000","last_unstale":"2023-08-22T00:21:56.732301+0000","last_undegraded":"2023-08-22T00:21:56.732301+0000","last_fullsized":"2023-08-22T00:21:56.732301+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707048+0000","last_change":"2023-08-22T00:21:56.344464+0000","last_active":"2023-08-22T00:21:56.707048+0000","last_peered":"2023-08-22T00:21:56.707048+0000","last_clean":"2023-08-22T00:21:56.707048+0000","last_became_active":"2023-08-22T00:21:56.344193+0000","last_became_peered":"2023-08-22T00:21:56.344193+0000","last_unstale":"2023-08-22T00:21:56.707048+0000","last_undegraded":"2023-08-22T00:21:56.707048+0000","last_fullsized":"2023-08-22T00:21:56.707048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732013+0000","last_change":"2023-08-22T00:21:56.729667+0000","last_active":"2023-08-22T00:21:56.732013+0000","last_peered":"2023-08-22T00:21:56.732013+0000","last_clean":"2023-08-22T00:21:56.732013+0000","last_became_active":"2023-08-22T00:21:56.729340+0000","last_became_peered":"2023-08-22T00:21:56.729340+0000","last_unstale":"2023-08-22T00:21:56.732013+0000","last_undegraded":"2023-08-22T00:21:56.732013+0000","last_fullsized":"2023-08-22T00:21:56.732013+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703406+0000","last_change":"2023-08-22T00:21:56.346275+0000","last_active":"2023-08-22T00:21:56.703406+0000","last_peered":"2023-08-22T00:21:56.703406+0000","last_clean":"2023-08-22T00:21:56.703406+0000","last_became_active":"2023-08-22T00:21:56.344483+0000","last_became_peered":"2023-08-22T00:21:56.344483+0000","last_unstale":"2023-08-22T00:21:56.703406+0000","last_undegraded":"2023-08-22T00:21:56.703406+0000","last_fullsized":"2023-08-22T00:21:56.703406+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729688+0000","last_change":"2023-08-22T00:21:56.718533+0000","last_active":"2023-08-22T00:21:56.729688+0000","last_peered":"2023-08-22T00:21:56.729688+0000","last_clean":"2023-08-22T00:21:56.729688+0000","last_became_active":"2023-08-22T00:21:56.717827+0000","last_became_peered":"2023-08-22T00:21:56.717827+0000","last_unstale":"2023-08-22T00:21:56.729688+0000","last_undegraded":"2023-08-22T00:21:56.729688+0000","last_fullsized":"2023-08-22T00:21:56.729688+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704811+0000","last_change":"2023-08-22T00:21:56.346400+0000","last_active":"2023-08-22T00:21:56.704811+0000","last_peered":"2023-08-22T00:21:56.704811+0000","last_clean":"2023-08-22T00:21:56.704811+0000","last_became_active":"2023-08-22T00:21:56.345741+0000","last_became_peered":"2023-08-22T00:21:56.345741+0000","last_unstale":"2023-08-22T00:21:56.704811+0000","last_undegraded":"2023-08-22T00:21:56.704811+0000","last_fullsized":"2023-08-22T00:21:56.704811+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733161+0000","last_change":"2023-08-22T00:21:56.731895+0000","last_active":"2023-08-22T00:21:56.733161+0000","last_peered":"2023-08-22T00:21:56.733161+0000","last_clean":"2023-08-22T00:21:56.733161+0000","last_became_active":"2023-08-22T00:21:56.731530+0000","last_became_peered":"2023-08-22T00:21:56.731530+0000","last_unstale":"2023-08-22T00:21:56.733161+0000","last_undegraded":"2023-08-22T00:21:56.733161+0000","last_fullsized":"2023-08-22T00:21:56.733161+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705117+0000","last_change":"2023-08-22T00:21:56.344078+0000","last_active":"2023-08-22T00:21:56.705117+0000","last_peered":"2023-08-22T00:21:56.705117+0000","last_clean":"2023-08-22T00:21:56.705117+0000","last_became_active":"2023-08-22T00:21:56.343460+0000","last_became_peered":"2023-08-22T00:21:56.343460+0000","last_unstale":"2023-08-22T00:21:56.705117+0000","last_undegraded":"2023-08-22T00:21:56.705117+0000","last_fullsized":"2023-08-22T00:21:56.705117+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724294+0000","last_change":"2023-08-22T00:21:56.721181+0000","last_active":"2023-08-22T00:21:56.724294+0000","last_peered":"2023-08-22T00:21:56.724294+0000","last_clean":"2023-08-22T00:21:56.724294+0000","last_became_active":"2023-08-22T00:21:56.720898+0000","last_became_peered":"2023-08-22T00:21:56.720898+0000","last_unstale":"2023-08-22T00:21:56.724294+0000","last_undegraded":"2023-08-22T00:21:56.724294+0000","last_fullsized":"2023-08-22T00:21:56.724294+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705976+0000","last_change":"2023-08-22T00:21:56.345443+0000","last_active":"2023-08-22T00:21:56.705976+0000","last_peered":"2023-08-22T00:21:56.705976+0000","last_clean":"2023-08-22T00:21:56.705976+0000","last_became_active":"2023-08-22T00:21:56.343424+0000","last_became_peered":"2023-08-22T00:21:56.343424+0000","last_unstale":"2023-08-22T00:21:56.705976+0000","last_undegraded":"2023-08-22T00:21:56.705976+0000","last_fullsized":"2023-08-22T00:21:56.705976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733057+0000","last_change":"2023-08-22T00:21:56.730387+0000","last_active":"2023-08-22T00:21:56.733057+0000","last_peered":"2023-08-22T00:21:56.733057+0000","last_clean":"2023-08-22T00:21:56.733057+0000","last_became_active":"2023-08-22T00:21:56.729356+0000","last_became_peered":"2023-08-22T00:21:56.729356+0000","last_unstale":"2023-08-22T00:21:56.733057+0000","last_undegraded":"2023-08-22T00:21:56.733057+0000","last_fullsized":"2023-08-22T00:21:56.733057+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707004+0000","last_change":"2023-08-22T00:21:56.357029+0000","last_active":"2023-08-22T00:21:56.707004+0000","last_peered":"2023-08-22T00:21:56.707004+0000","last_clean":"2023-08-22T00:21:56.707004+0000","last_became_active":"2023-08-22T00:21:56.356725+0000","last_became_peered":"2023-08-22T00:21:56.356725+0000","last_unstale":"2023-08-22T00:21:56.707004+0000","last_undegraded":"2023-08-22T00:21:56.707004+0000","last_fullsized":"2023-08-22T00:21:56.707004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708886+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:56.708886+0000","last_peered":"2023-08-22T00:21:56.708886+0000","last_clean":"2023-08-22T00:21:56.708886+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:56.708886+0000","last_undegraded":"2023-08-22T00:21:56.708886+0000","last_fullsized":"2023-08-22T00:21:56.708886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725813+0000","last_change":"2023-08-22T00:21:56.723379+0000","last_active":"2023-08-22T00:21:56.725813+0000","last_peered":"2023-08-22T00:21:56.725813+0000","last_clean":"2023-08-22T00:21:56.725813+0000","last_became_active":"2023-08-22T00:21:56.723116+0000","last_became_peered":"2023-08-22T00:21:56.723116+0000","last_unstale":"2023-08-22T00:21:56.725813+0000","last_undegraded":"2023-08-22T00:21:56.725813+0000","last_fullsized":"2023-08-22T00:21:56.725813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703538+0000","last_change":"2023-08-22T00:21:56.341109+0000","last_active":"2023-08-22T00:21:56.703538+0000","last_peered":"2023-08-22T00:21:56.703538+0000","last_clean":"2023-08-22T00:21:56.703538+0000","last_became_active":"2023-08-22T00:21:56.340820+0000","last_became_peered":"2023-08-22T00:21:56.340820+0000","last_unstale":"2023-08-22T00:21:56.703538+0000","last_undegraded":"2023-08-22T00:21:56.703538+0000","last_fullsized":"2023-08-22T00:21:56.703538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713598+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:56.713598+0000","last_peered":"2023-08-22T00:21:56.713598+0000","last_clean":"2023-08-22T00:21:56.713598+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:56.713598+0000","last_undegraded":"2023-08-22T00:21:56.713598+0000","last_fullsized":"2023-08-22T00:21:56.713598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731413+0000","last_change":"2023-08-22T00:21:56.728483+0000","last_active":"2023-08-22T00:21:56.731413+0000","last_peered":"2023-08-22T00:21:56.731413+0000","last_clean":"2023-08-22T00:21:56.731413+0000","last_became_active":"2023-08-22T00:21:56.727823+0000","last_became_peered":"2023-08-22T00:21:56.727823+0000","last_unstale":"2023-08-22T00:21:56.731413+0000","last_undegraded":"2023-08-22T00:21:56.731413+0000","last_fullsized":"2023-08-22T00:21:56.731413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719964+0000","last_change":"2023-08-22T00:21:56.338573+0000","last_active":"2023-08-22T00:21:56.719964+0000","last_peered":"2023-08-22T00:21:56.719964+0000","last_clean":"2023-08-22T00:21:56.719964+0000","last_became_active":"2023-08-22T00:21:56.338303+0000","last_became_peered":"2023-08-22T00:21:56.338303+0000","last_unstale":"2023-08-22T00:21:56.719964+0000","last_undegraded":"2023-08-22T00:21:56.719964+0000","last_fullsized":"2023-08-22T00:21:56.719964+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710874+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:56.710874+0000","last_peered":"2023-08-22T00:21:56.710874+0000","last_clean":"2023-08-22T00:21:56.710874+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:56.710874+0000","last_undegraded":"2023-08-22T00:21:56.710874+0000","last_fullsized":"2023-08-22T00:21:56.710874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726797+0000","last_change":"2023-08-22T00:21:56.723157+0000","last_active":"2023-08-22T00:21:56.726797+0000","last_peered":"2023-08-22T00:21:56.726797+0000","last_clean":"2023-08-22T00:21:56.726797+0000","last_became_active":"2023-08-22T00:21:56.721526+0000","last_became_peered":"2023-08-22T00:21:56.721526+0000","last_unstale":"2023-08-22T00:21:56.726797+0000","last_undegraded":"2023-08-22T00:21:56.726797+0000","last_fullsized":"2023-08-22T00:21:56.726797+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713256+0000","last_change":"2023-08-22T00:21:56.349309+0000","last_active":"2023-08-22T00:21:56.713256+0000","last_peered":"2023-08-22T00:21:56.713256+0000","last_clean":"2023-08-22T00:21:56.713256+0000","last_became_active":"2023-08-22T00:21:56.349016+0000","last_became_peered":"2023-08-22T00:21:56.349016+0000","last_unstale":"2023-08-22T00:21:56.713256+0000","last_undegraded":"2023-08-22T00:21:56.713256+0000","last_fullsized":"2023-08-22T00:21:56.713256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713188+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:56.713188+0000","last_peered":"2023-08-22T00:21:56.713188+0000","last_clean":"2023-08-22T00:21:56.713188+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:56.713188+0000","last_undegraded":"2023-08-22T00:21:56.713188+0000","last_fullsized":"2023-08-22T00:21:56.713188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.715153+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:56.715153+0000","last_peered":"2023-08-22T00:21:56.715153+0000","last_clean":"2023-08-22T00:21:56.715153+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:56.715153+0000","last_undegraded":"2023-08-22T00:21:56.715153+0000","last_fullsized":"2023-08-22T00:21:56.715153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727805+0000","last_change":"2023-08-22T00:21:56.725493+0000","last_active":"2023-08-22T00:21:56.727805+0000","last_peered":"2023-08-22T00:21:56.727805+0000","last_clean":"2023-08-22T00:21:56.727805+0000","last_became_active":"2023-08-22T00:21:56.724962+0000","last_became_peered":"2023-08-22T00:21:56.724962+0000","last_unstale":"2023-08-22T00:21:56.727805+0000","last_undegraded":"2023-08-22T00:21:56.727805+0000","last_fullsized":"2023-08-22T00:21:56.727805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729115+0000","last_change":"2023-08-22T00:21:56.347130+0000","last_active":"2023-08-22T00:21:56.729115+0000","last_peered":"2023-08-22T00:21:56.729115+0000","last_clean":"2023-08-22T00:21:56.729115+0000","last_became_active":"2023-08-22T00:21:56.346876+0000","last_became_peered":"2023-08-22T00:21:56.346876+0000","last_unstale":"2023-08-22T00:21:56.729115+0000","last_undegraded":"2023-08-22T00:21:56.729115+0000","last_fullsized":"2023-08-22T00:21:56.729115+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714961+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:56.714961+0000","last_peered":"2023-08-22T00:21:56.714961+0000","last_clean":"2023-08-22T00:21:56.714961+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:56.714961+0000","last_undegraded":"2023-08-22T00:21:56.714961+0000","last_fullsized":"2023-08-22T00:21:56.714961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729932+0000","last_change":"2023-08-22T00:21:56.722443+0000","last_active":"2023-08-22T00:21:56.729932+0000","last_peered":"2023-08-22T00:21:56.729932+0000","last_clean":"2023-08-22T00:21:56.729932+0000","last_became_active":"2023-08-22T00:21:56.722108+0000","last_became_peered":"2023-08-22T00:21:56.722108+0000","last_unstale":"2023-08-22T00:21:56.729932+0000","last_undegraded":"2023-08-22T00:21:56.729932+0000","last_fullsized":"2023-08-22T00:21:56.729932+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719666+0000","last_change":"2023-08-22T00:21:56.352533+0000","last_active":"2023-08-22T00:21:56.719666+0000","last_peered":"2023-08-22T00:21:56.719666+0000","last_clean":"2023-08-22T00:21:56.719666+0000","last_became_active":"2023-08-22T00:21:56.352272+0000","last_became_peered":"2023-08-22T00:21:56.352272+0000","last_unstale":"2023-08-22T00:21:56.719666+0000","last_undegraded":"2023-08-22T00:21:56.719666+0000","last_fullsized":"2023-08-22T00:21:56.719666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713464+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:56.713464+0000","last_peered":"2023-08-22T00:21:56.713464+0000","last_clean":"2023-08-22T00:21:56.713464+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:56.713464+0000","last_undegraded":"2023-08-22T00:21:56.713464+0000","last_fullsized":"2023-08-22T00:21:56.713464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732245+0000","last_change":"2023-08-22T00:21:56.730009+0000","last_active":"2023-08-22T00:21:56.732245+0000","last_peered":"2023-08-22T00:21:56.732245+0000","last_clean":"2023-08-22T00:21:56.732245+0000","last_became_active":"2023-08-22T00:21:56.729760+0000","last_became_peered":"2023-08-22T00:21:56.729760+0000","last_unstale":"2023-08-22T00:21:56.732245+0000","last_undegraded":"2023-08-22T00:21:56.732245+0000","last_fullsized":"2023-08-22T00:21:56.732245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710573+0000","last_change":"2023-08-22T00:21:56.352783+0000","last_active":"2023-08-22T00:21:56.710573+0000","last_peered":"2023-08-22T00:21:56.710573+0000","last_clean":"2023-08-22T00:21:56.710573+0000","last_became_active":"2023-08-22T00:21:56.352531+0000","last_became_peered":"2023-08-22T00:21:56.352531+0000","last_unstale":"2023-08-22T00:21:56.710573+0000","last_undegraded":"2023-08-22T00:21:56.710573+0000","last_fullsized":"2023-08-22T00:21:56.710573+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708612+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:56.708612+0000","last_peered":"2023-08-22T00:21:56.708612+0000","last_clean":"2023-08-22T00:21:56.708612+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:56.708612+0000","last_undegraded":"2023-08-22T00:21:56.708612+0000","last_fullsized":"2023-08-22T00:21:56.708612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729812+0000","last_change":"2023-08-22T00:21:56.719499+0000","last_active":"2023-08-22T00:21:56.729812+0000","last_peered":"2023-08-22T00:21:56.729812+0000","last_clean":"2023-08-22T00:21:56.729812+0000","last_became_active":"2023-08-22T00:21:56.719200+0000","last_became_peered":"2023-08-22T00:21:56.719200+0000","last_unstale":"2023-08-22T00:21:56.729812+0000","last_undegraded":"2023-08-22T00:21:56.729812+0000","last_fullsized":"2023-08-22T00:21:56.729812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710816+0000","last_change":"2023-08-22T00:21:56.343877+0000","last_active":"2023-08-22T00:21:56.710816+0000","last_peered":"2023-08-22T00:21:56.710816+0000","last_clean":"2023-08-22T00:21:56.710816+0000","last_became_active":"2023-08-22T00:21:56.343632+0000","last_became_peered":"2023-08-22T00:21:56.343632+0000","last_unstale":"2023-08-22T00:21:56.710816+0000","last_undegraded":"2023-08-22T00:21:56.710816+0000","last_fullsized":"2023-08-22T00:21:56.710816+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705997+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:56.705997+0000","last_peered":"2023-08-22T00:21:56.705997+0000","last_clean":"2023-08-22T00:21:56.705997+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:56.705997+0000","last_undegraded":"2023-08-22T00:21:56.705997+0000","last_fullsized":"2023-08-22T00:21:56.705997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.437},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.497},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.312}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1294336,"data_stored":677995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.71899999999999997,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.29599999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.78100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.1339999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.79000000000000004},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.073},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.46200000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65900000000000003,"5min":0.753,"15min":0.94399999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":1.03},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.32300000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.246}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.375}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.435},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.38900000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.28199999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":677953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.498}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":678597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.221,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63600000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.441},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.71599999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.876,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.88100000000000001,"15min":11.163},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.51800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1302528,"data_stored":679441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:02.673 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:22:02.672+0000 7f3e3f48d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:22:04.115 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:04.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.245+0000 7f3f30d1b700 1 Processor -- start 2023-08-22T00:22:04.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.245+0000 7f3f30d1b700 1 -- start start 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f30d1b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3f2c150e40 0x7f3f2c0c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f30d1b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f2c065f10 0x7f3f2c066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f30d1b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c0bd3e0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f30d1b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c0bd0c0 con 0x7f3f2c065f10 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f30d1b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c066830 con 0x7f3f2c150e40 2023-08-22T00:22:04.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f29d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3f2c0bd870 0x7f3f2c0a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38308/0 (socket says 172.21.15.98:38308) 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f29d9b700 1 -- 172.21.15.98:0/2178513823 learned_addr learned my addr 172.21.15.98:0/2178513823 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.246+0000 7f3f2ad9d700 1 --2- 172.21.15.98:0/2178513823 >> v2:172.21.15.98:3300/0 conn(0x7f3f2c065f10 0x7f3f2c066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2a59c700 1 --2- 172.21.15.98:0/2178513823 >> v2:172.21.15.118:3300/0 conn(0x7f3f2c150e40 0x7f3f2c0c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2959a700 1 -- 172.21.15.98:0/2178513823 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930384578 0 0) 0x7f3f2c0bd3e0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2959a700 1 -- 172.21.15.98:0/2178513823 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f140033f0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2ad9d700 1 -- 172.21.15.98:0/2178513823 >> v2:172.21.15.118:3300/0 conn(0x7f3f2c150e40 msgr2=0x7f3f2c0c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:04.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2ad9d700 1 --2- 172.21.15.98:0/2178513823 >> v2:172.21.15.118:3300/0 conn(0x7f3f2c150e40 0x7f3f2c0c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2ad9d700 1 -- 172.21.15.98:0/2178513823 >> v1:172.21.15.98:6789/0 conn(0x7f3f2c0bd870 legacy=0x7f3f2c0a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2ad9d700 1 -- 172.21.15.98:0/2178513823 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0c3bb0 con 0x7f3f2c065f10 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2ad9d700 1 --2- 172.21.15.98:0/2178513823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c065f10 0x7f3f2c066340 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3f2c0c52a0 tx=0x7f3f24009780).ready entity=mon.0 client_cookie=61f9eaf13578e968 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2959a700 1 -- 172.21.15.98:0/2178513823 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400e070 con 0x7f3f2c065f10 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2959a700 1 -- 172.21.15.98:0/2178513823 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400bb60 con 0x7f3f2c065f10 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f2959a700 1 -- 172.21.15.98:0/2178513823 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012410 con 0x7f3f2c065f10 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2178513823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c065f10 msgr2=0x7f3f2c066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2178513823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c065f10 0x7f3f2c066340 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3f2c0c52a0 tx=0x7f3f24009780).stop 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2178513823 shutdown_connections 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2178513823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c065f10 0x7f3f2c066340 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2178513823 >> v2:172.21.15.118:3300/0 conn(0x7f3f2c150e40 0x7f3f2c0c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.247+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2178513823 >> 172.21.15.98:0/2178513823 conn(0x7f3f2c06a980 msgr2=0x7f3f2c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.248+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2178513823 shutdown_connections 2023-08-22T00:22:04.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.248+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2178513823 wait complete. 2023-08-22T00:22:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 Processor -- start 2023-08-22T00:22:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 -- start start 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 0x7f3f2c09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f2c150e40 0x7f3f2c0be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0bf8b0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c1542c0 con 0x7f3f2c065f10 2023-08-22T00:22:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.249+0000 7f3f30d1b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c154860 con 0x7f3f2c150e40 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47574/0 (socket says 172.21.15.98:47574) 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 -- 172.21.15.98:0/2685518059 learned_addr learned my addr 172.21.15.98:0/2685518059 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f2a59c700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 0x7f3f2c09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f2ad9d700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f2c150e40 0x7f3f2c0be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 -- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f2c150e40 msgr2=0x7f3f2c0be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f2c150e40 0x7f3f2c0be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 -- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 msgr2=0x7f3f2c09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 0x7f3f2c09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 -- 172.21.15.98:0/2685518059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24009a20 con 0x7f3f2c0bd870 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f2a59c700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 0x7f3f2c09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f29d9b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f3f1c00c5c0 tx=0x7f3f1c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c007e40 con 0x7f3f2c0bd870 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0072e0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c09f9b0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0057a0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.250+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c0bf5d0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.251+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c1549d0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.252+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3f1c005b90 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.252+0000 7f3f1a7fc700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 0x7f3f0c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.252+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3f1c0797d0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.252+0000 7f3f2a59c700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 0x7f3f0c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.253+0000 7f3f2a59c700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 0x7f3f0c0612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3f20006fd0 tx=0x7f3f20008040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.256+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f1c04aae0 con 0x7f3f2c0bd870 2023-08-22T00:22:04.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.418+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f2c047480 con 0x7f3f0c05ee10 2023-08-22T00:22:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.428+0000 7f3f1a7fc700 1 -- 172.21.15.98:0/2685518059 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362226 (secure 0 0 0) 0x7f3f2c047480 con 0x7f3f0c05ee10 2023-08-22T00:22:04.433 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 msgr2=0x7f3f0c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 0x7f3f0c0612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3f20006fd0 tx=0x7f3f20008040).stop 2023-08-22T00:22:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 msgr2=0x7f3f2c150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f3f1c00c5c0 tx=0x7f3f1c007c80).stop 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 shutdown_connections 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3f0c05ee10 0x7f3f0c0612d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f2c150e40 0x7f3f2c0be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f2c065f10 0x7f3f2c09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 --2- 172.21.15.98:0/2685518059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f2c0bd870 0x7f3f2c150510 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.431+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 >> 172.21.15.98:0/2685518059 conn(0x7f3f2c06a980 msgr2=0x7f3f2c062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.432+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 shutdown_connections 2023-08-22T00:22:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.432+0000 7f3f30d1b700 1 -- 172.21.15.98:0/2685518059 wait complete. 2023-08-22T00:22:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:04.444 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-22T00:22:04.246773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":228,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427840,"kb_used_data":10112,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546880,"statfs":{"total":773094113280,"available":770608005120,"internally_reserved":0,"allocated":10354688,"data_stored":5427676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10334,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.055220"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735254+0000","last_change":"2023-08-22T00:21:56.726566+0000","last_active":"2023-08-22T00:21:56.735254+0000","last_peered":"2023-08-22T00:21:56.735254+0000","last_clean":"2023-08-22T00:21:56.735254+0000","last_became_active":"2023-08-22T00:21:56.726154+0000","last_became_peered":"2023-08-22T00:21:56.726154+0000","last_unstale":"2023-08-22T00:21:56.735254+0000","last_undegraded":"2023-08-22T00:21:56.735254+0000","last_fullsized":"2023-08-22T00:21:56.735254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732234+0000","last_change":"2023-08-22T00:21:56.350790+0000","last_active":"2023-08-22T00:21:56.732234+0000","last_peered":"2023-08-22T00:21:56.732234+0000","last_clean":"2023-08-22T00:21:56.732234+0000","last_became_active":"2023-08-22T00:21:56.350520+0000","last_became_peered":"2023-08-22T00:21:56.350520+0000","last_unstale":"2023-08-22T00:21:56.732234+0000","last_undegraded":"2023-08-22T00:21:56.732234+0000","last_fullsized":"2023-08-22T00:21:56.732234+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724823+0000","last_change":"2023-08-22T00:21:56.721796+0000","last_active":"2023-08-22T00:21:56.724823+0000","last_peered":"2023-08-22T00:21:56.724823+0000","last_clean":"2023-08-22T00:21:56.724823+0000","last_became_active":"2023-08-22T00:21:56.721509+0000","last_became_peered":"2023-08-22T00:21:56.721509+0000","last_unstale":"2023-08-22T00:21:56.724823+0000","last_undegraded":"2023-08-22T00:21:56.724823+0000","last_fullsized":"2023-08-22T00:21:56.724823+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703828+0000","last_change":"2023-08-22T00:21:56.343367+0000","last_active":"2023-08-22T00:21:56.703828+0000","last_peered":"2023-08-22T00:21:56.703828+0000","last_clean":"2023-08-22T00:21:56.703828+0000","last_became_active":"2023-08-22T00:21:56.343039+0000","last_became_peered":"2023-08-22T00:21:56.343039+0000","last_unstale":"2023-08-22T00:21:56.703828+0000","last_undegraded":"2023-08-22T00:21:56.703828+0000","last_fullsized":"2023-08-22T00:21:56.703828+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729850+0000","last_change":"2023-08-22T00:21:56.722358+0000","last_active":"2023-08-22T00:21:56.729850+0000","last_peered":"2023-08-22T00:21:56.729850+0000","last_clean":"2023-08-22T00:21:56.729850+0000","last_became_active":"2023-08-22T00:21:56.722082+0000","last_became_peered":"2023-08-22T00:21:56.722082+0000","last_unstale":"2023-08-22T00:21:56.729850+0000","last_undegraded":"2023-08-22T00:21:56.729850+0000","last_fullsized":"2023-08-22T00:21:56.729850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.709706+0000","last_change":"2023-08-22T00:21:56.340757+0000","last_active":"2023-08-22T00:21:56.709706+0000","last_peered":"2023-08-22T00:21:56.709706+0000","last_clean":"2023-08-22T00:21:56.709706+0000","last_became_active":"2023-08-22T00:21:56.340483+0000","last_became_peered":"2023-08-22T00:21:56.340483+0000","last_unstale":"2023-08-22T00:21:56.709706+0000","last_undegraded":"2023-08-22T00:21:56.709706+0000","last_fullsized":"2023-08-22T00:21:56.709706+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731290+0000","last_change":"2023-08-22T00:21:56.720668+0000","last_active":"2023-08-22T00:21:56.731290+0000","last_peered":"2023-08-22T00:21:56.731290+0000","last_clean":"2023-08-22T00:21:56.731290+0000","last_became_active":"2023-08-22T00:21:56.719901+0000","last_became_peered":"2023-08-22T00:21:56.719901+0000","last_unstale":"2023-08-22T00:21:56.731290+0000","last_undegraded":"2023-08-22T00:21:56.731290+0000","last_fullsized":"2023-08-22T00:21:56.731290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724670+0000","last_change":"2023-08-22T00:21:56.341820+0000","last_active":"2023-08-22T00:21:56.724670+0000","last_peered":"2023-08-22T00:21:56.724670+0000","last_clean":"2023-08-22T00:21:56.724670+0000","last_became_active":"2023-08-22T00:21:56.341462+0000","last_became_peered":"2023-08-22T00:21:56.341462+0000","last_unstale":"2023-08-22T00:21:56.724670+0000","last_undegraded":"2023-08-22T00:21:56.724670+0000","last_fullsized":"2023-08-22T00:21:56.724670+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723258+0000","last_change":"2023-08-22T00:21:56.720826+0000","last_active":"2023-08-22T00:21:56.723258+0000","last_peered":"2023-08-22T00:21:56.723258+0000","last_clean":"2023-08-22T00:21:56.723258+0000","last_became_active":"2023-08-22T00:21:56.720538+0000","last_became_peered":"2023-08-22T00:21:56.720538+0000","last_unstale":"2023-08-22T00:21:56.723258+0000","last_undegraded":"2023-08-22T00:21:56.723258+0000","last_fullsized":"2023-08-22T00:21:56.723258+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727155+0000","last_change":"2023-08-22T00:21:56.348788+0000","last_active":"2023-08-22T00:21:56.727155+0000","last_peered":"2023-08-22T00:21:56.727155+0000","last_clean":"2023-08-22T00:21:56.727155+0000","last_became_active":"2023-08-22T00:21:56.347376+0000","last_became_peered":"2023-08-22T00:21:56.347376+0000","last_unstale":"2023-08-22T00:21:56.727155+0000","last_undegraded":"2023-08-22T00:21:56.727155+0000","last_fullsized":"2023-08-22T00:21:56.727155+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724401+0000","last_change":"2023-08-22T00:21:56.722763+0000","last_active":"2023-08-22T00:21:56.724401+0000","last_peered":"2023-08-22T00:21:56.724401+0000","last_clean":"2023-08-22T00:21:56.724401+0000","last_became_active":"2023-08-22T00:21:56.722237+0000","last_became_peered":"2023-08-22T00:21:56.722237+0000","last_unstale":"2023-08-22T00:21:56.724401+0000","last_undegraded":"2023-08-22T00:21:56.724401+0000","last_fullsized":"2023-08-22T00:21:56.724401+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719528+0000","last_change":"2023-08-22T00:21:56.343526+0000","last_active":"2023-08-22T00:21:56.719528+0000","last_peered":"2023-08-22T00:21:56.719528+0000","last_clean":"2023-08-22T00:21:56.719528+0000","last_became_active":"2023-08-22T00:21:56.342933+0000","last_became_peered":"2023-08-22T00:21:56.342933+0000","last_unstale":"2023-08-22T00:21:56.719528+0000","last_undegraded":"2023-08-22T00:21:56.719528+0000","last_fullsized":"2023-08-22T00:21:56.719528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727758+0000","last_change":"2023-08-22T00:21:56.726444+0000","last_active":"2023-08-22T00:21:56.727758+0000","last_peered":"2023-08-22T00:21:56.727758+0000","last_clean":"2023-08-22T00:21:56.727758+0000","last_became_active":"2023-08-22T00:21:56.726157+0000","last_became_peered":"2023-08-22T00:21:56.726157+0000","last_unstale":"2023-08-22T00:21:56.727758+0000","last_undegraded":"2023-08-22T00:21:56.727758+0000","last_fullsized":"2023-08-22T00:21:56.727758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705245+0000","last_change":"2023-08-22T00:21:56.337534+0000","last_active":"2023-08-22T00:21:56.705245+0000","last_peered":"2023-08-22T00:21:56.705245+0000","last_clean":"2023-08-22T00:21:56.705245+0000","last_became_active":"2023-08-22T00:21:56.337258+0000","last_became_peered":"2023-08-22T00:21:56.337258+0000","last_unstale":"2023-08-22T00:21:56.705245+0000","last_undegraded":"2023-08-22T00:21:56.705245+0000","last_fullsized":"2023-08-22T00:21:56.705245+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729680+0000","last_change":"2023-08-22T00:21:56.721199+0000","last_active":"2023-08-22T00:21:56.729680+0000","last_peered":"2023-08-22T00:21:56.729680+0000","last_clean":"2023-08-22T00:21:56.729680+0000","last_became_active":"2023-08-22T00:21:56.720911+0000","last_became_peered":"2023-08-22T00:21:56.720911+0000","last_unstale":"2023-08-22T00:21:56.729680+0000","last_undegraded":"2023-08-22T00:21:56.729680+0000","last_fullsized":"2023-08-22T00:21:56.729680+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706902+0000","last_change":"2023-08-22T00:21:56.342754+0000","last_active":"2023-08-22T00:21:56.706902+0000","last_peered":"2023-08-22T00:21:56.706902+0000","last_clean":"2023-08-22T00:21:56.706902+0000","last_became_active":"2023-08-22T00:21:56.342504+0000","last_became_peered":"2023-08-22T00:21:56.342504+0000","last_unstale":"2023-08-22T00:21:56.706902+0000","last_undegraded":"2023-08-22T00:21:56.706902+0000","last_fullsized":"2023-08-22T00:21:56.706902+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726914+0000","last_change":"2023-08-22T00:21:56.724073+0000","last_active":"2023-08-22T00:21:56.726914+0000","last_peered":"2023-08-22T00:21:56.726914+0000","last_clean":"2023-08-22T00:21:56.726914+0000","last_became_active":"2023-08-22T00:21:56.723778+0000","last_became_peered":"2023-08-22T00:21:56.723778+0000","last_unstale":"2023-08-22T00:21:56.726914+0000","last_undegraded":"2023-08-22T00:21:56.726914+0000","last_fullsized":"2023-08-22T00:21:56.726914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706678+0000","last_change":"2023-08-22T00:21:56.345756+0000","last_active":"2023-08-22T00:21:56.706678+0000","last_peered":"2023-08-22T00:21:56.706678+0000","last_clean":"2023-08-22T00:21:56.706678+0000","last_became_active":"2023-08-22T00:21:56.343602+0000","last_became_peered":"2023-08-22T00:21:56.343602+0000","last_unstale":"2023-08-22T00:21:56.706678+0000","last_undegraded":"2023-08-22T00:21:56.706678+0000","last_fullsized":"2023-08-22T00:21:56.706678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732854+0000","last_change":"2023-08-22T00:21:56.731918+0000","last_active":"2023-08-22T00:21:56.732854+0000","last_peered":"2023-08-22T00:21:56.732854+0000","last_clean":"2023-08-22T00:21:56.732854+0000","last_became_active":"2023-08-22T00:21:56.731625+0000","last_became_peered":"2023-08-22T00:21:56.731625+0000","last_unstale":"2023-08-22T00:21:56.732854+0000","last_undegraded":"2023-08-22T00:21:56.732854+0000","last_fullsized":"2023-08-22T00:21:56.732854+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714315+0000","last_change":"2023-08-22T00:21:56.342959+0000","last_active":"2023-08-22T00:21:56.714315+0000","last_peered":"2023-08-22T00:21:56.714315+0000","last_clean":"2023-08-22T00:21:56.714315+0000","last_became_active":"2023-08-22T00:21:56.342697+0000","last_became_peered":"2023-08-22T00:21:56.342697+0000","last_unstale":"2023-08-22T00:21:56.714315+0000","last_undegraded":"2023-08-22T00:21:56.714315+0000","last_fullsized":"2023-08-22T00:21:56.714315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726867+0000","last_change":"2023-08-22T00:21:56.724838+0000","last_active":"2023-08-22T00:21:56.726867+0000","last_peered":"2023-08-22T00:21:56.726867+0000","last_clean":"2023-08-22T00:21:56.726867+0000","last_became_active":"2023-08-22T00:21:56.724509+0000","last_became_peered":"2023-08-22T00:21:56.724509+0000","last_unstale":"2023-08-22T00:21:56.726867+0000","last_undegraded":"2023-08-22T00:21:56.726867+0000","last_fullsized":"2023-08-22T00:21:56.726867+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703530+0000","last_change":"2023-08-22T00:21:56.346146+0000","last_active":"2023-08-22T00:21:56.703530+0000","last_peered":"2023-08-22T00:21:56.703530+0000","last_clean":"2023-08-22T00:21:56.703530+0000","last_became_active":"2023-08-22T00:21:56.344423+0000","last_became_peered":"2023-08-22T00:21:56.344423+0000","last_unstale":"2023-08-22T00:21:56.703530+0000","last_undegraded":"2023-08-22T00:21:56.703530+0000","last_fullsized":"2023-08-22T00:21:56.703530+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726380+0000","last_change":"2023-08-22T00:21:56.720611+0000","last_active":"2023-08-22T00:21:56.726380+0000","last_peered":"2023-08-22T00:21:56.726380+0000","last_clean":"2023-08-22T00:21:56.726380+0000","last_became_active":"2023-08-22T00:21:56.720318+0000","last_became_peered":"2023-08-22T00:21:56.720318+0000","last_unstale":"2023-08-22T00:21:56.726380+0000","last_undegraded":"2023-08-22T00:21:56.726380+0000","last_fullsized":"2023-08-22T00:21:56.726380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.737783+0000","last_change":"2023-08-22T00:21:56.348273+0000","last_active":"2023-08-22T00:21:56.737783+0000","last_peered":"2023-08-22T00:21:56.737783+0000","last_clean":"2023-08-22T00:21:56.737783+0000","last_became_active":"2023-08-22T00:21:56.348000+0000","last_became_peered":"2023-08-22T00:21:56.348000+0000","last_unstale":"2023-08-22T00:21:56.737783+0000","last_undegraded":"2023-08-22T00:21:56.737783+0000","last_fullsized":"2023-08-22T00:21:56.737783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729953+0000","last_change":"2023-08-22T00:21:56.722513+0000","last_active":"2023-08-22T00:21:56.729953+0000","last_peered":"2023-08-22T00:21:56.729953+0000","last_clean":"2023-08-22T00:21:56.729953+0000","last_became_active":"2023-08-22T00:21:56.722126+0000","last_became_peered":"2023-08-22T00:21:56.722126+0000","last_unstale":"2023-08-22T00:21:56.729953+0000","last_undegraded":"2023-08-22T00:21:56.729953+0000","last_fullsized":"2023-08-22T00:21:56.729953+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729128+0000","last_change":"2023-08-22T00:21:56.350297+0000","last_active":"2023-08-22T00:21:56.729128+0000","last_peered":"2023-08-22T00:21:56.729128+0000","last_clean":"2023-08-22T00:21:56.729128+0000","last_became_active":"2023-08-22T00:21:56.350029+0000","last_became_peered":"2023-08-22T00:21:56.350029+0000","last_unstale":"2023-08-22T00:21:56.729128+0000","last_undegraded":"2023-08-22T00:21:56.729128+0000","last_fullsized":"2023-08-22T00:21:56.729128+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731386+0000","last_change":"2023-08-22T00:21:56.727174+0000","last_active":"2023-08-22T00:21:56.731386+0000","last_peered":"2023-08-22T00:21:56.731386+0000","last_clean":"2023-08-22T00:21:56.731386+0000","last_became_active":"2023-08-22T00:21:56.726934+0000","last_became_peered":"2023-08-22T00:21:56.726934+0000","last_unstale":"2023-08-22T00:21:56.731386+0000","last_undegraded":"2023-08-22T00:21:56.731386+0000","last_fullsized":"2023-08-22T00:21:56.731386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710841+0000","last_change":"2023-08-22T00:21:56.343702+0000","last_active":"2023-08-22T00:21:56.710841+0000","last_peered":"2023-08-22T00:21:56.710841+0000","last_clean":"2023-08-22T00:21:56.710841+0000","last_became_active":"2023-08-22T00:21:56.343211+0000","last_became_peered":"2023-08-22T00:21:56.343211+0000","last_unstale":"2023-08-22T00:21:56.710841+0000","last_undegraded":"2023-08-22T00:21:56.710841+0000","last_fullsized":"2023-08-22T00:21:56.710841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719286+0000","last_change":"2023-08-22T00:21:56.711929+0000","last_active":"2023-08-22T00:21:56.719286+0000","last_peered":"2023-08-22T00:21:56.719286+0000","last_clean":"2023-08-22T00:21:56.719286+0000","last_became_active":"2023-08-22T00:21:56.711624+0000","last_became_peered":"2023-08-22T00:21:56.711624+0000","last_unstale":"2023-08-22T00:21:56.719286+0000","last_undegraded":"2023-08-22T00:21:56.719286+0000","last_fullsized":"2023-08-22T00:21:56.719286+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702986+0000","last_change":"2023-08-22T00:21:56.340744+0000","last_active":"2023-08-22T00:21:56.702986+0000","last_peered":"2023-08-22T00:21:56.702986+0000","last_clean":"2023-08-22T00:21:56.702986+0000","last_became_active":"2023-08-22T00:21:56.340439+0000","last_became_peered":"2023-08-22T00:21:56.340439+0000","last_unstale":"2023-08-22T00:21:56.702986+0000","last_undegraded":"2023-08-22T00:21:56.702986+0000","last_fullsized":"2023-08-22T00:21:56.702986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735474+0000","last_change":"2023-08-22T00:21:56.731929+0000","last_active":"2023-08-22T00:21:56.735474+0000","last_peered":"2023-08-22T00:21:56.735474+0000","last_clean":"2023-08-22T00:21:56.735474+0000","last_became_active":"2023-08-22T00:21:56.731632+0000","last_became_peered":"2023-08-22T00:21:56.731632+0000","last_unstale":"2023-08-22T00:21:56.735474+0000","last_undegraded":"2023-08-22T00:21:56.735474+0000","last_fullsized":"2023-08-22T00:21:56.735474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731515+0000","last_change":"2023-08-22T00:21:56.349226+0000","last_active":"2023-08-22T00:21:56.731515+0000","last_peered":"2023-08-22T00:21:56.731515+0000","last_clean":"2023-08-22T00:21:56.731515+0000","last_became_active":"2023-08-22T00:21:56.348925+0000","last_became_peered":"2023-08-22T00:21:56.348925+0000","last_unstale":"2023-08-22T00:21:56.731515+0000","last_undegraded":"2023-08-22T00:21:56.731515+0000","last_fullsized":"2023-08-22T00:21:56.731515+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728659+0000","last_change":"2023-08-22T00:21:56.717738+0000","last_active":"2023-08-22T00:21:56.728659+0000","last_peered":"2023-08-22T00:21:56.728659+0000","last_clean":"2023-08-22T00:21:56.728659+0000","last_became_active":"2023-08-22T00:21:56.717466+0000","last_became_peered":"2023-08-22T00:21:56.717466+0000","last_unstale":"2023-08-22T00:21:56.728659+0000","last_undegraded":"2023-08-22T00:21:56.728659+0000","last_fullsized":"2023-08-22T00:21:56.728659+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706817+0000","last_change":"2023-08-22T00:21:56.349781+0000","last_active":"2023-08-22T00:21:56.706817+0000","last_peered":"2023-08-22T00:21:56.706817+0000","last_clean":"2023-08-22T00:21:56.706817+0000","last_became_active":"2023-08-22T00:21:56.349508+0000","last_became_peered":"2023-08-22T00:21:56.349508+0000","last_unstale":"2023-08-22T00:21:56.706817+0000","last_undegraded":"2023-08-22T00:21:56.706817+0000","last_fullsized":"2023-08-22T00:21:56.706817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720597+0000","last_change":"2023-08-22T00:21:56.718378+0000","last_active":"2023-08-22T00:21:56.720597+0000","last_peered":"2023-08-22T00:21:56.720597+0000","last_clean":"2023-08-22T00:21:56.720597+0000","last_became_active":"2023-08-22T00:21:56.718046+0000","last_became_peered":"2023-08-22T00:21:56.718046+0000","last_unstale":"2023-08-22T00:21:56.720597+0000","last_undegraded":"2023-08-22T00:21:56.720597+0000","last_fullsized":"2023-08-22T00:21:56.720597+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708444+0000","last_change":"2023-08-22T00:21:56.347400+0000","last_active":"2023-08-22T00:21:56.708444+0000","last_peered":"2023-08-22T00:21:56.708444+0000","last_clean":"2023-08-22T00:21:56.708444+0000","last_became_active":"2023-08-22T00:21:56.347119+0000","last_became_peered":"2023-08-22T00:21:56.347119+0000","last_unstale":"2023-08-22T00:21:56.708444+0000","last_undegraded":"2023-08-22T00:21:56.708444+0000","last_fullsized":"2023-08-22T00:21:56.708444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735322+0000","last_change":"2023-08-22T00:21:56.730106+0000","last_active":"2023-08-22T00:21:56.735322+0000","last_peered":"2023-08-22T00:21:56.735322+0000","last_clean":"2023-08-22T00:21:56.735322+0000","last_became_active":"2023-08-22T00:21:56.729475+0000","last_became_peered":"2023-08-22T00:21:56.729475+0000","last_unstale":"2023-08-22T00:21:56.735322+0000","last_undegraded":"2023-08-22T00:21:56.735322+0000","last_fullsized":"2023-08-22T00:21:56.735322+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729063+0000","last_change":"2023-08-22T00:21:56.345942+0000","last_active":"2023-08-22T00:21:56.729063+0000","last_peered":"2023-08-22T00:21:56.729063+0000","last_clean":"2023-08-22T00:21:56.729063+0000","last_became_active":"2023-08-22T00:21:56.345667+0000","last_became_peered":"2023-08-22T00:21:56.345667+0000","last_unstale":"2023-08-22T00:21:56.729063+0000","last_undegraded":"2023-08-22T00:21:56.729063+0000","last_fullsized":"2023-08-22T00:21:56.729063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729369+0000","last_change":"2023-08-22T00:21:56.723984+0000","last_active":"2023-08-22T00:21:56.729369+0000","last_peered":"2023-08-22T00:21:56.729369+0000","last_clean":"2023-08-22T00:21:56.729369+0000","last_became_active":"2023-08-22T00:21:56.723632+0000","last_became_peered":"2023-08-22T00:21:56.723632+0000","last_unstale":"2023-08-22T00:21:56.729369+0000","last_undegraded":"2023-08-22T00:21:56.729369+0000","last_fullsized":"2023-08-22T00:21:56.729369+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711107+0000","last_change":"2023-08-22T00:21:56.351605+0000","last_active":"2023-08-22T00:21:56.711107+0000","last_peered":"2023-08-22T00:21:56.711107+0000","last_clean":"2023-08-22T00:21:56.711107+0000","last_became_active":"2023-08-22T00:21:56.349889+0000","last_became_peered":"2023-08-22T00:21:56.349889+0000","last_unstale":"2023-08-22T00:21:56.711107+0000","last_undegraded":"2023-08-22T00:21:56.711107+0000","last_fullsized":"2023-08-22T00:21:56.711107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735555+0000","last_change":"2023-08-22T00:21:56.733235+0000","last_active":"2023-08-22T00:21:56.735555+0000","last_peered":"2023-08-22T00:21:56.735555+0000","last_clean":"2023-08-22T00:21:56.735555+0000","last_became_active":"2023-08-22T00:21:56.732942+0000","last_became_peered":"2023-08-22T00:21:56.732942+0000","last_unstale":"2023-08-22T00:21:56.735555+0000","last_undegraded":"2023-08-22T00:21:56.735555+0000","last_fullsized":"2023-08-22T00:21:56.735555+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726357+0000","last_change":"2023-08-22T00:21:56.349376+0000","last_active":"2023-08-22T00:21:56.726357+0000","last_peered":"2023-08-22T00:21:56.726357+0000","last_clean":"2023-08-22T00:21:56.726357+0000","last_became_active":"2023-08-22T00:21:56.348958+0000","last_became_peered":"2023-08-22T00:21:56.348958+0000","last_unstale":"2023-08-22T00:21:56.726357+0000","last_undegraded":"2023-08-22T00:21:56.726357+0000","last_fullsized":"2023-08-22T00:21:56.726357+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735368+0000","last_change":"2023-08-22T00:21:56.730982+0000","last_active":"2023-08-22T00:21:56.735368+0000","last_peered":"2023-08-22T00:21:56.735368+0000","last_clean":"2023-08-22T00:21:56.735368+0000","last_became_active":"2023-08-22T00:21:56.730713+0000","last_became_peered":"2023-08-22T00:21:56.730713+0000","last_unstale":"2023-08-22T00:21:56.735368+0000","last_undegraded":"2023-08-22T00:21:56.735368+0000","last_fullsized":"2023-08-22T00:21:56.735368+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706762+0000","last_change":"2023-08-22T00:21:56.354225+0000","last_active":"2023-08-22T00:21:56.706762+0000","last_peered":"2023-08-22T00:21:56.706762+0000","last_clean":"2023-08-22T00:21:56.706762+0000","last_became_active":"2023-08-22T00:21:56.353959+0000","last_became_peered":"2023-08-22T00:21:56.353959+0000","last_unstale":"2023-08-22T00:21:56.706762+0000","last_undegraded":"2023-08-22T00:21:56.706762+0000","last_fullsized":"2023-08-22T00:21:56.706762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735370+0000","last_change":"2023-08-22T00:21:56.729930+0000","last_active":"2023-08-22T00:21:56.735370+0000","last_peered":"2023-08-22T00:21:56.735370+0000","last_clean":"2023-08-22T00:21:56.735370+0000","last_became_active":"2023-08-22T00:21:56.729558+0000","last_became_peered":"2023-08-22T00:21:56.729558+0000","last_unstale":"2023-08-22T00:21:56.735370+0000","last_undegraded":"2023-08-22T00:21:56.735370+0000","last_fullsized":"2023-08-22T00:21:56.735370+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706299+0000","last_change":"2023-08-22T00:21:56.344957+0000","last_active":"2023-08-22T00:21:56.706299+0000","last_peered":"2023-08-22T00:21:56.706299+0000","last_clean":"2023-08-22T00:21:56.706299+0000","last_became_active":"2023-08-22T00:21:56.344659+0000","last_became_peered":"2023-08-22T00:21:56.344659+0000","last_unstale":"2023-08-22T00:21:56.706299+0000","last_undegraded":"2023-08-22T00:21:56.706299+0000","last_fullsized":"2023-08-22T00:21:56.706299+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731835+0000","last_change":"2023-08-22T00:21:56.729695+0000","last_active":"2023-08-22T00:21:56.731835+0000","last_peered":"2023-08-22T00:21:56.731835+0000","last_clean":"2023-08-22T00:21:56.731835+0000","last_became_active":"2023-08-22T00:21:56.728983+0000","last_became_peered":"2023-08-22T00:21:56.728983+0000","last_unstale":"2023-08-22T00:21:56.731835+0000","last_undegraded":"2023-08-22T00:21:56.731835+0000","last_fullsized":"2023-08-22T00:21:56.731835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.702930+0000","last_change":"2023-08-22T00:21:56.343786+0000","last_active":"2023-08-22T00:21:56.702930+0000","last_peered":"2023-08-22T00:21:56.702930+0000","last_clean":"2023-08-22T00:21:56.702930+0000","last_became_active":"2023-08-22T00:21:56.343478+0000","last_became_peered":"2023-08-22T00:21:56.343478+0000","last_unstale":"2023-08-22T00:21:56.702930+0000","last_undegraded":"2023-08-22T00:21:56.702930+0000","last_fullsized":"2023-08-22T00:21:56.702930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732696+0000","last_change":"2023-08-22T00:21:56.728733+0000","last_active":"2023-08-22T00:21:56.732696+0000","last_peered":"2023-08-22T00:21:56.732696+0000","last_clean":"2023-08-22T00:21:56.732696+0000","last_became_active":"2023-08-22T00:21:56.728193+0000","last_became_peered":"2023-08-22T00:21:56.728193+0000","last_unstale":"2023-08-22T00:21:56.732696+0000","last_undegraded":"2023-08-22T00:21:56.732696+0000","last_fullsized":"2023-08-22T00:21:56.732696+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703127+0000","last_change":"2023-08-22T00:21:56.343200+0000","last_active":"2023-08-22T00:21:56.703127+0000","last_peered":"2023-08-22T00:21:56.703127+0000","last_clean":"2023-08-22T00:21:56.703127+0000","last_became_active":"2023-08-22T00:21:56.342898+0000","last_became_peered":"2023-08-22T00:21:56.342898+0000","last_unstale":"2023-08-22T00:21:56.703127+0000","last_undegraded":"2023-08-22T00:21:56.703127+0000","last_fullsized":"2023-08-22T00:21:56.703127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735340+0000","last_change":"2023-08-22T00:21:56.726565+0000","last_active":"2023-08-22T00:21:56.735340+0000","last_peered":"2023-08-22T00:21:56.735340+0000","last_clean":"2023-08-22T00:21:56.735340+0000","last_became_active":"2023-08-22T00:21:56.725923+0000","last_became_peered":"2023-08-22T00:21:56.725923+0000","last_unstale":"2023-08-22T00:21:56.735340+0000","last_undegraded":"2023-08-22T00:21:56.735340+0000","last_fullsized":"2023-08-22T00:21:56.735340+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714430+0000","last_change":"2023-08-22T00:21:56.348195+0000","last_active":"2023-08-22T00:21:56.714430+0000","last_peered":"2023-08-22T00:21:56.714430+0000","last_clean":"2023-08-22T00:21:56.714430+0000","last_became_active":"2023-08-22T00:21:56.347907+0000","last_became_peered":"2023-08-22T00:21:56.347907+0000","last_unstale":"2023-08-22T00:21:56.714430+0000","last_undegraded":"2023-08-22T00:21:56.714430+0000","last_fullsized":"2023-08-22T00:21:56.714430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724698+0000","last_change":"2023-08-22T00:21:56.721312+0000","last_active":"2023-08-22T00:21:56.724698+0000","last_peered":"2023-08-22T00:21:56.724698+0000","last_clean":"2023-08-22T00:21:56.724698+0000","last_became_active":"2023-08-22T00:21:56.721030+0000","last_became_peered":"2023-08-22T00:21:56.721030+0000","last_unstale":"2023-08-22T00:21:56.724698+0000","last_undegraded":"2023-08-22T00:21:56.724698+0000","last_fullsized":"2023-08-22T00:21:56.724698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713374+0000","last_change":"2023-08-22T00:21:56.348591+0000","last_active":"2023-08-22T00:21:56.713374+0000","last_peered":"2023-08-22T00:21:56.713374+0000","last_clean":"2023-08-22T00:21:56.713374+0000","last_became_active":"2023-08-22T00:21:56.348298+0000","last_became_peered":"2023-08-22T00:21:56.348298+0000","last_unstale":"2023-08-22T00:21:56.713374+0000","last_undegraded":"2023-08-22T00:21:56.713374+0000","last_fullsized":"2023-08-22T00:21:56.713374+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725839+0000","last_change":"2023-08-22T00:21:56.724152+0000","last_active":"2023-08-22T00:21:56.725839+0000","last_peered":"2023-08-22T00:21:56.725839+0000","last_clean":"2023-08-22T00:21:56.725839+0000","last_became_active":"2023-08-22T00:21:56.723850+0000","last_became_peered":"2023-08-22T00:21:56.723850+0000","last_unstale":"2023-08-22T00:21:56.725839+0000","last_undegraded":"2023-08-22T00:21:56.725839+0000","last_fullsized":"2023-08-22T00:21:56.725839+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711211+0000","last_change":"2023-08-22T00:21:56.352313+0000","last_active":"2023-08-22T00:21:56.711211+0000","last_peered":"2023-08-22T00:21:56.711211+0000","last_clean":"2023-08-22T00:21:56.711211+0000","last_became_active":"2023-08-22T00:21:56.352079+0000","last_became_peered":"2023-08-22T00:21:56.352079+0000","last_unstale":"2023-08-22T00:21:56.711211+0000","last_undegraded":"2023-08-22T00:21:56.711211+0000","last_fullsized":"2023-08-22T00:21:56.711211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735484+0000","last_change":"2023-08-22T00:21:56.727092+0000","last_active":"2023-08-22T00:21:56.735484+0000","last_peered":"2023-08-22T00:21:56.735484+0000","last_clean":"2023-08-22T00:21:56.735484+0000","last_became_active":"2023-08-22T00:21:56.726820+0000","last_became_peered":"2023-08-22T00:21:56.726820+0000","last_unstale":"2023-08-22T00:21:56.735484+0000","last_undegraded":"2023-08-22T00:21:56.735484+0000","last_fullsized":"2023-08-22T00:21:56.735484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703315+0000","last_change":"2023-08-22T00:21:56.345493+0000","last_active":"2023-08-22T00:21:56.703315+0000","last_peered":"2023-08-22T00:21:56.703315+0000","last_clean":"2023-08-22T00:21:56.703315+0000","last_became_active":"2023-08-22T00:21:56.344185+0000","last_became_peered":"2023-08-22T00:21:56.344185+0000","last_unstale":"2023-08-22T00:21:56.703315+0000","last_undegraded":"2023-08-22T00:21:56.703315+0000","last_fullsized":"2023-08-22T00:21:56.703315+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735494+0000","last_change":"2023-08-22T00:21:56.727153+0000","last_active":"2023-08-22T00:21:56.735494+0000","last_peered":"2023-08-22T00:21:56.735494+0000","last_clean":"2023-08-22T00:21:56.735494+0000","last_became_active":"2023-08-22T00:21:56.726892+0000","last_became_peered":"2023-08-22T00:21:56.726892+0000","last_unstale":"2023-08-22T00:21:56.735494+0000","last_undegraded":"2023-08-22T00:21:56.735494+0000","last_fullsized":"2023-08-22T00:21:56.735494+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.712345+0000","last_change":"2023-08-22T00:21:56.348507+0000","last_active":"2023-08-22T00:21:56.712345+0000","last_peered":"2023-08-22T00:21:56.712345+0000","last_clean":"2023-08-22T00:21:56.712345+0000","last_became_active":"2023-08-22T00:21:56.348220+0000","last_became_peered":"2023-08-22T00:21:56.348220+0000","last_unstale":"2023-08-22T00:21:56.712345+0000","last_undegraded":"2023-08-22T00:21:56.712345+0000","last_fullsized":"2023-08-22T00:21:56.712345+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727264+0000","last_change":"2023-08-22T00:21:56.722873+0000","last_active":"2023-08-22T00:21:56.727264+0000","last_peered":"2023-08-22T00:21:56.727264+0000","last_clean":"2023-08-22T00:21:56.727264+0000","last_became_active":"2023-08-22T00:21:56.722609+0000","last_became_peered":"2023-08-22T00:21:56.722609+0000","last_unstale":"2023-08-22T00:21:56.727264+0000","last_undegraded":"2023-08-22T00:21:56.727264+0000","last_fullsized":"2023-08-22T00:21:56.727264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708510+0000","last_change":"2023-08-22T00:21:56.342316+0000","last_active":"2023-08-22T00:21:56.708510+0000","last_peered":"2023-08-22T00:21:56.708510+0000","last_clean":"2023-08-22T00:21:56.708510+0000","last_became_active":"2023-08-22T00:21:56.342042+0000","last_became_peered":"2023-08-22T00:21:56.342042+0000","last_unstale":"2023-08-22T00:21:56.708510+0000","last_undegraded":"2023-08-22T00:21:56.708510+0000","last_fullsized":"2023-08-22T00:21:56.708510+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731307+0000","last_change":"2023-08-22T00:21:56.729398+0000","last_active":"2023-08-22T00:21:56.731307+0000","last_peered":"2023-08-22T00:21:56.731307+0000","last_clean":"2023-08-22T00:21:56.731307+0000","last_became_active":"2023-08-22T00:21:56.729134+0000","last_became_peered":"2023-08-22T00:21:56.729134+0000","last_unstale":"2023-08-22T00:21:56.731307+0000","last_undegraded":"2023-08-22T00:21:56.731307+0000","last_fullsized":"2023-08-22T00:21:56.731307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714871+0000","last_change":"2023-08-22T00:21:56.350153+0000","last_active":"2023-08-22T00:21:56.714871+0000","last_peered":"2023-08-22T00:21:56.714871+0000","last_clean":"2023-08-22T00:21:56.714871+0000","last_became_active":"2023-08-22T00:21:56.349891+0000","last_became_peered":"2023-08-22T00:21:56.349891+0000","last_unstale":"2023-08-22T00:21:56.714871+0000","last_undegraded":"2023-08-22T00:21:56.714871+0000","last_fullsized":"2023-08-22T00:21:56.714871+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.720801+0000","last_change":"2023-08-22T00:21:56.712558+0000","last_active":"2023-08-22T00:21:56.720801+0000","last_peered":"2023-08-22T00:21:56.720801+0000","last_clean":"2023-08-22T00:21:56.720801+0000","last_became_active":"2023-08-22T00:21:56.712232+0000","last_became_peered":"2023-08-22T00:21:56.712232+0000","last_unstale":"2023-08-22T00:21:56.720801+0000","last_undegraded":"2023-08-22T00:21:56.720801+0000","last_fullsized":"2023-08-22T00:21:56.720801+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.718363+0000","last_change":"2023-08-22T00:21:56.344835+0000","last_active":"2023-08-22T00:21:56.718363+0000","last_peered":"2023-08-22T00:21:56.718363+0000","last_clean":"2023-08-22T00:21:56.718363+0000","last_became_active":"2023-08-22T00:21:56.343691+0000","last_became_peered":"2023-08-22T00:21:56.343691+0000","last_unstale":"2023-08-22T00:21:56.718363+0000","last_undegraded":"2023-08-22T00:21:56.718363+0000","last_fullsized":"2023-08-22T00:21:56.718363+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733699+0000","last_change":"2023-08-22T00:21:56.732886+0000","last_active":"2023-08-22T00:21:56.733699+0000","last_peered":"2023-08-22T00:21:56.733699+0000","last_clean":"2023-08-22T00:21:56.733699+0000","last_became_active":"2023-08-22T00:21:56.732562+0000","last_became_peered":"2023-08-22T00:21:56.732562+0000","last_unstale":"2023-08-22T00:21:56.733699+0000","last_undegraded":"2023-08-22T00:21:56.733699+0000","last_fullsized":"2023-08-22T00:21:56.733699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730666+0000","last_change":"2023-08-22T00:21:56.344853+0000","last_active":"2023-08-22T00:21:56.730666+0000","last_peered":"2023-08-22T00:21:56.730666+0000","last_clean":"2023-08-22T00:21:56.730666+0000","last_became_active":"2023-08-22T00:21:56.344549+0000","last_became_peered":"2023-08-22T00:21:56.344549+0000","last_unstale":"2023-08-22T00:21:56.730666+0000","last_undegraded":"2023-08-22T00:21:56.730666+0000","last_fullsized":"2023-08-22T00:21:56.730666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726847+0000","last_change":"2023-08-22T00:21:56.723081+0000","last_active":"2023-08-22T00:21:56.726847+0000","last_peered":"2023-08-22T00:21:56.726847+0000","last_clean":"2023-08-22T00:21:56.726847+0000","last_became_active":"2023-08-22T00:21:56.722803+0000","last_became_peered":"2023-08-22T00:21:56.722803+0000","last_unstale":"2023-08-22T00:21:56.726847+0000","last_undegraded":"2023-08-22T00:21:56.726847+0000","last_fullsized":"2023-08-22T00:21:56.726847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729681+0000","last_change":"2023-08-22T00:21:56.345081+0000","last_active":"2023-08-22T00:21:56.729681+0000","last_peered":"2023-08-22T00:21:56.729681+0000","last_clean":"2023-08-22T00:21:56.729681+0000","last_became_active":"2023-08-22T00:21:56.344060+0000","last_became_peered":"2023-08-22T00:21:56.344060+0000","last_unstale":"2023-08-22T00:21:56.729681+0000","last_undegraded":"2023-08-22T00:21:56.729681+0000","last_fullsized":"2023-08-22T00:21:56.729681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731314+0000","last_change":"2023-08-22T00:21:56.720734+0000","last_active":"2023-08-22T00:21:56.731314+0000","last_peered":"2023-08-22T00:21:56.731314+0000","last_clean":"2023-08-22T00:21:56.731314+0000","last_became_active":"2023-08-22T00:21:56.720285+0000","last_became_peered":"2023-08-22T00:21:56.720285+0000","last_unstale":"2023-08-22T00:21:56.731314+0000","last_undegraded":"2023-08-22T00:21:56.731314+0000","last_fullsized":"2023-08-22T00:21:56.731314+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703360+0000","last_change":"2023-08-22T00:21:56.346216+0000","last_active":"2023-08-22T00:21:56.703360+0000","last_peered":"2023-08-22T00:21:56.703360+0000","last_clean":"2023-08-22T00:21:56.703360+0000","last_became_active":"2023-08-22T00:21:56.344406+0000","last_became_peered":"2023-08-22T00:21:56.344406+0000","last_unstale":"2023-08-22T00:21:56.703360+0000","last_undegraded":"2023-08-22T00:21:56.703360+0000","last_fullsized":"2023-08-22T00:21:56.703360+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727171+0000","last_change":"2023-08-22T00:21:56.722688+0000","last_active":"2023-08-22T00:21:56.727171+0000","last_peered":"2023-08-22T00:21:56.727171+0000","last_clean":"2023-08-22T00:21:56.727171+0000","last_became_active":"2023-08-22T00:21:56.721734+0000","last_became_peered":"2023-08-22T00:21:56.721734+0000","last_unstale":"2023-08-22T00:21:56.727171+0000","last_undegraded":"2023-08-22T00:21:56.727171+0000","last_fullsized":"2023-08-22T00:21:56.727171+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.711472+0000","last_change":"2023-08-22T00:21:56.349229+0000","last_active":"2023-08-22T00:21:56.711472+0000","last_peered":"2023-08-22T00:21:56.711472+0000","last_clean":"2023-08-22T00:21:56.711472+0000","last_became_active":"2023-08-22T00:21:56.348596+0000","last_became_peered":"2023-08-22T00:21:56.348596+0000","last_unstale":"2023-08-22T00:21:56.711472+0000","last_undegraded":"2023-08-22T00:21:56.711472+0000","last_fullsized":"2023-08-22T00:21:56.711472+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.723474+0000","last_change":"2023-08-22T00:21:56.719102+0000","last_active":"2023-08-22T00:21:56.723474+0000","last_peered":"2023-08-22T00:21:56.723474+0000","last_clean":"2023-08-22T00:21:56.723474+0000","last_became_active":"2023-08-22T00:21:56.718887+0000","last_became_peered":"2023-08-22T00:21:56.718887+0000","last_unstale":"2023-08-22T00:21:56.723474+0000","last_undegraded":"2023-08-22T00:21:56.723474+0000","last_fullsized":"2023-08-22T00:21:56.723474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704703+0000","last_change":"2023-08-22T00:21:56.346576+0000","last_active":"2023-08-22T00:21:56.704703+0000","last_peered":"2023-08-22T00:21:56.704703+0000","last_clean":"2023-08-22T00:21:56.704703+0000","last_became_active":"2023-08-22T00:21:56.345958+0000","last_became_peered":"2023-08-22T00:21:56.345958+0000","last_unstale":"2023-08-22T00:21:56.704703+0000","last_undegraded":"2023-08-22T00:21:56.704703+0000","last_fullsized":"2023-08-22T00:21:56.704703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732764+0000","last_change":"2023-08-22T00:21:56.730137+0000","last_active":"2023-08-22T00:21:56.732764+0000","last_peered":"2023-08-22T00:21:56.732764+0000","last_clean":"2023-08-22T00:21:56.732764+0000","last_became_active":"2023-08-22T00:21:56.729869+0000","last_became_peered":"2023-08-22T00:21:56.729869+0000","last_unstale":"2023-08-22T00:21:56.732764+0000","last_undegraded":"2023-08-22T00:21:56.732764+0000","last_fullsized":"2023-08-22T00:21:56.732764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703074+0000","last_change":"2023-08-22T00:21:56.339570+0000","last_active":"2023-08-22T00:21:56.703074+0000","last_peered":"2023-08-22T00:21:56.703074+0000","last_clean":"2023-08-22T00:21:56.703074+0000","last_became_active":"2023-08-22T00:21:56.339297+0000","last_became_peered":"2023-08-22T00:21:56.339297+0000","last_unstale":"2023-08-22T00:21:56.703074+0000","last_undegraded":"2023-08-22T00:21:56.703074+0000","last_fullsized":"2023-08-22T00:21:56.703074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.735493+0000","last_change":"2023-08-22T00:21:56.732268+0000","last_active":"2023-08-22T00:21:56.735493+0000","last_peered":"2023-08-22T00:21:56.735493+0000","last_clean":"2023-08-22T00:21:56.735493+0000","last_became_active":"2023-08-22T00:21:56.731555+0000","last_became_peered":"2023-08-22T00:21:56.731555+0000","last_unstale":"2023-08-22T00:21:56.735493+0000","last_undegraded":"2023-08-22T00:21:56.735493+0000","last_fullsized":"2023-08-22T00:21:56.735493+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708636+0000","last_change":"2023-08-22T00:21:56.341406+0000","last_active":"2023-08-22T00:21:56.708636+0000","last_peered":"2023-08-22T00:21:56.708636+0000","last_clean":"2023-08-22T00:21:56.708636+0000","last_became_active":"2023-08-22T00:21:56.341130+0000","last_became_peered":"2023-08-22T00:21:56.341130+0000","last_unstale":"2023-08-22T00:21:56.708636+0000","last_undegraded":"2023-08-22T00:21:56.708636+0000","last_fullsized":"2023-08-22T00:21:56.708636+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.730380+0000","last_change":"2023-08-22T00:21:56.725753+0000","last_active":"2023-08-22T00:21:56.730380+0000","last_peered":"2023-08-22T00:21:56.730380+0000","last_clean":"2023-08-22T00:21:56.730380+0000","last_became_active":"2023-08-22T00:21:56.725519+0000","last_became_peered":"2023-08-22T00:21:56.725519+0000","last_unstale":"2023-08-22T00:21:56.730380+0000","last_undegraded":"2023-08-22T00:21:56.730380+0000","last_fullsized":"2023-08-22T00:21:56.730380+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706213+0000","last_change":"2023-08-22T00:21:56.345503+0000","last_active":"2023-08-22T00:21:56.706213+0000","last_peered":"2023-08-22T00:21:56.706213+0000","last_clean":"2023-08-22T00:21:56.706213+0000","last_became_active":"2023-08-22T00:21:56.345237+0000","last_became_peered":"2023-08-22T00:21:56.345237+0000","last_unstale":"2023-08-22T00:21:56.706213+0000","last_undegraded":"2023-08-22T00:21:56.706213+0000","last_fullsized":"2023-08-22T00:21:56.706213+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719695+0000","last_change":"2023-08-22T00:21:56.717769+0000","last_active":"2023-08-22T00:21:56.719695+0000","last_peered":"2023-08-22T00:21:56.719695+0000","last_clean":"2023-08-22T00:21:56.719695+0000","last_became_active":"2023-08-22T00:21:56.717465+0000","last_became_peered":"2023-08-22T00:21:56.717465+0000","last_unstale":"2023-08-22T00:21:56.719695+0000","last_undegraded":"2023-08-22T00:21:56.719695+0000","last_fullsized":"2023-08-22T00:21:56.719695+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.706416+0000","last_change":"2023-08-22T00:21:56.346193+0000","last_active":"2023-08-22T00:21:56.706416+0000","last_peered":"2023-08-22T00:21:56.706416+0000","last_clean":"2023-08-22T00:21:56.706416+0000","last_became_active":"2023-08-22T00:21:56.345908+0000","last_became_peered":"2023-08-22T00:21:56.345908+0000","last_unstale":"2023-08-22T00:21:56.706416+0000","last_undegraded":"2023-08-22T00:21:56.706416+0000","last_fullsized":"2023-08-22T00:21:56.706416+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728506+0000","last_change":"2023-08-22T00:21:56.709589+0000","last_active":"2023-08-22T00:21:56.728506+0000","last_peered":"2023-08-22T00:21:56.728506+0000","last_clean":"2023-08-22T00:21:56.728506+0000","last_became_active":"2023-08-22T00:21:56.709320+0000","last_became_peered":"2023-08-22T00:21:56.709320+0000","last_unstale":"2023-08-22T00:21:56.728506+0000","last_undegraded":"2023-08-22T00:21:56.728506+0000","last_fullsized":"2023-08-22T00:21:56.728506+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"104'3","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727130+0000","last_change":"2023-08-22T00:21:56.347342+0000","last_active":"2023-08-22T00:21:56.727130+0000","last_peered":"2023-08-22T00:21:56.727130+0000","last_clean":"2023-08-22T00:21:56.727130+0000","last_became_active":"2023-08-22T00:21:56.347027+0000","last_became_peered":"2023-08-22T00:21:56.347027+0000","last_unstale":"2023-08-22T00:21:56.727130+0000","last_undegraded":"2023-08-22T00:21:56.727130+0000","last_fullsized":"2023-08-22T00:21:56.727130+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732320+0000","last_change":"2023-08-22T00:21:56.730054+0000","last_active":"2023-08-22T00:21:56.732320+0000","last_peered":"2023-08-22T00:21:56.732320+0000","last_clean":"2023-08-22T00:21:56.732320+0000","last_became_active":"2023-08-22T00:21:56.729585+0000","last_became_peered":"2023-08-22T00:21:56.729585+0000","last_unstale":"2023-08-22T00:21:56.732320+0000","last_undegraded":"2023-08-22T00:21:56.732320+0000","last_fullsized":"2023-08-22T00:21:56.732320+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729715+0000","last_change":"2023-08-22T00:21:56.345349+0000","last_active":"2023-08-22T00:21:56.729715+0000","last_peered":"2023-08-22T00:21:56.729715+0000","last_clean":"2023-08-22T00:21:56.729715+0000","last_became_active":"2023-08-22T00:21:56.345063+0000","last_became_peered":"2023-08-22T00:21:56.345063+0000","last_unstale":"2023-08-22T00:21:56.729715+0000","last_undegraded":"2023-08-22T00:21:56.729715+0000","last_fullsized":"2023-08-22T00:21:56.729715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.728906+0000","last_change":"2023-08-22T00:21:56.716056+0000","last_active":"2023-08-22T00:21:56.728906+0000","last_peered":"2023-08-22T00:21:56.728906+0000","last_clean":"2023-08-22T00:21:56.728906+0000","last_became_active":"2023-08-22T00:21:56.715807+0000","last_became_peered":"2023-08-22T00:21:56.715807+0000","last_unstale":"2023-08-22T00:21:56.728906+0000","last_undegraded":"2023-08-22T00:21:56.728906+0000","last_fullsized":"2023-08-22T00:21:56.728906+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732916+0000","last_change":"2023-08-22T00:21:56.348531+0000","last_active":"2023-08-22T00:21:56.732916+0000","last_peered":"2023-08-22T00:21:56.732916+0000","last_clean":"2023-08-22T00:21:56.732916+0000","last_became_active":"2023-08-22T00:21:56.348317+0000","last_became_peered":"2023-08-22T00:21:56.348317+0000","last_unstale":"2023-08-22T00:21:56.732916+0000","last_undegraded":"2023-08-22T00:21:56.732916+0000","last_fullsized":"2023-08-22T00:21:56.732916+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732977+0000","last_change":"2023-08-22T00:21:56.730445+0000","last_active":"2023-08-22T00:21:56.732977+0000","last_peered":"2023-08-22T00:21:56.732977+0000","last_clean":"2023-08-22T00:21:56.732977+0000","last_became_active":"2023-08-22T00:21:56.730189+0000","last_became_peered":"2023-08-22T00:21:56.730189+0000","last_unstale":"2023-08-22T00:21:56.732977+0000","last_undegraded":"2023-08-22T00:21:56.732977+0000","last_fullsized":"2023-08-22T00:21:56.732977+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710745+0000","last_change":"2023-08-22T00:21:56.347926+0000","last_active":"2023-08-22T00:21:56.710745+0000","last_peered":"2023-08-22T00:21:56.710745+0000","last_clean":"2023-08-22T00:21:56.710745+0000","last_became_active":"2023-08-22T00:21:56.347298+0000","last_became_peered":"2023-08-22T00:21:56.347298+0000","last_unstale":"2023-08-22T00:21:56.710745+0000","last_undegraded":"2023-08-22T00:21:56.710745+0000","last_fullsized":"2023-08-22T00:21:56.710745+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726845+0000","last_change":"2023-08-22T00:21:56.721292+0000","last_active":"2023-08-22T00:21:56.726845+0000","last_peered":"2023-08-22T00:21:56.726845+0000","last_clean":"2023-08-22T00:21:56.726845+0000","last_became_active":"2023-08-22T00:21:56.721028+0000","last_became_peered":"2023-08-22T00:21:56.721028+0000","last_unstale":"2023-08-22T00:21:56.726845+0000","last_undegraded":"2023-08-22T00:21:56.726845+0000","last_fullsized":"2023-08-22T00:21:56.726845+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713978+0000","last_change":"2023-08-22T00:21:56.342410+0000","last_active":"2023-08-22T00:21:56.713978+0000","last_peered":"2023-08-22T00:21:56.713978+0000","last_clean":"2023-08-22T00:21:56.713978+0000","last_became_active":"2023-08-22T00:21:56.342137+0000","last_became_peered":"2023-08-22T00:21:56.342137+0000","last_unstale":"2023-08-22T00:21:56.713978+0000","last_undegraded":"2023-08-22T00:21:56.713978+0000","last_fullsized":"2023-08-22T00:21:56.713978+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.734393+0000","last_change":"2023-08-22T00:21:56.724450+0000","last_active":"2023-08-22T00:21:56.734393+0000","last_peered":"2023-08-22T00:21:56.734393+0000","last_clean":"2023-08-22T00:21:56.734393+0000","last_became_active":"2023-08-22T00:21:56.724185+0000","last_became_peered":"2023-08-22T00:21:56.724185+0000","last_unstale":"2023-08-22T00:21:56.734393+0000","last_undegraded":"2023-08-22T00:21:56.734393+0000","last_fullsized":"2023-08-22T00:21:56.734393+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"104'4","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729085+0000","last_change":"2023-08-22T00:21:56.337301+0000","last_active":"2023-08-22T00:21:56.729085+0000","last_peered":"2023-08-22T00:21:56.729085+0000","last_clean":"2023-08-22T00:21:56.729085+0000","last_became_active":"2023-08-22T00:21:56.337052+0000","last_became_peered":"2023-08-22T00:21:56.337052+0000","last_unstale":"2023-08-22T00:21:56.729085+0000","last_undegraded":"2023-08-22T00:21:56.729085+0000","last_fullsized":"2023-08-22T00:21:56.729085+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.722806+0000","last_change":"2023-08-22T00:21:56.720919+0000","last_active":"2023-08-22T00:21:56.722806+0000","last_peered":"2023-08-22T00:21:56.722806+0000","last_clean":"2023-08-22T00:21:56.722806+0000","last_became_active":"2023-08-22T00:21:56.720592+0000","last_became_peered":"2023-08-22T00:21:56.720592+0000","last_unstale":"2023-08-22T00:21:56.722806+0000","last_undegraded":"2023-08-22T00:21:56.722806+0000","last_fullsized":"2023-08-22T00:21:56.722806+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733201+0000","last_change":"2023-08-22T00:21:56.348557+0000","last_active":"2023-08-22T00:21:56.733201+0000","last_peered":"2023-08-22T00:21:56.733201+0000","last_clean":"2023-08-22T00:21:56.733201+0000","last_became_active":"2023-08-22T00:21:56.348290+0000","last_became_peered":"2023-08-22T00:21:56.348290+0000","last_unstale":"2023-08-22T00:21:56.733201+0000","last_undegraded":"2023-08-22T00:21:56.733201+0000","last_fullsized":"2023-08-22T00:21:56.733201+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732774+0000","last_change":"2023-08-22T00:21:56.729061+0000","last_active":"2023-08-22T00:21:56.732774+0000","last_peered":"2023-08-22T00:21:56.732774+0000","last_clean":"2023-08-22T00:21:56.732774+0000","last_became_active":"2023-08-22T00:21:56.728784+0000","last_became_peered":"2023-08-22T00:21:56.728784+0000","last_unstale":"2023-08-22T00:21:56.732774+0000","last_undegraded":"2023-08-22T00:21:56.732774+0000","last_fullsized":"2023-08-22T00:21:56.732774+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708538+0000","last_change":"2023-08-22T00:21:56.357732+0000","last_active":"2023-08-22T00:21:56.708538+0000","last_peered":"2023-08-22T00:21:56.708538+0000","last_clean":"2023-08-22T00:21:56.708538+0000","last_became_active":"2023-08-22T00:21:56.357468+0000","last_became_peered":"2023-08-22T00:21:56.357468+0000","last_unstale":"2023-08-22T00:21:56.708538+0000","last_undegraded":"2023-08-22T00:21:56.708538+0000","last_fullsized":"2023-08-22T00:21:56.708538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724722+0000","last_change":"2023-08-22T00:21:56.721487+0000","last_active":"2023-08-22T00:21:56.724722+0000","last_peered":"2023-08-22T00:21:56.724722+0000","last_clean":"2023-08-22T00:21:56.724722+0000","last_became_active":"2023-08-22T00:21:56.721182+0000","last_became_peered":"2023-08-22T00:21:56.721182+0000","last_unstale":"2023-08-22T00:21:56.724722+0000","last_undegraded":"2023-08-22T00:21:56.724722+0000","last_fullsized":"2023-08-22T00:21:56.724722+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705680+0000","last_change":"2023-08-22T00:21:56.353778+0000","last_active":"2023-08-22T00:21:56.705680+0000","last_peered":"2023-08-22T00:21:56.705680+0000","last_clean":"2023-08-22T00:21:56.705680+0000","last_became_active":"2023-08-22T00:21:56.353554+0000","last_became_peered":"2023-08-22T00:21:56.353554+0000","last_unstale":"2023-08-22T00:21:56.705680+0000","last_undegraded":"2023-08-22T00:21:56.705680+0000","last_fullsized":"2023-08-22T00:21:56.705680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732301+0000","last_change":"2023-08-22T00:21:56.729862+0000","last_active":"2023-08-22T00:21:56.732301+0000","last_peered":"2023-08-22T00:21:56.732301+0000","last_clean":"2023-08-22T00:21:56.732301+0000","last_became_active":"2023-08-22T00:21:56.729181+0000","last_became_peered":"2023-08-22T00:21:56.729181+0000","last_unstale":"2023-08-22T00:21:56.732301+0000","last_undegraded":"2023-08-22T00:21:56.732301+0000","last_fullsized":"2023-08-22T00:21:56.732301+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707048+0000","last_change":"2023-08-22T00:21:56.344464+0000","last_active":"2023-08-22T00:21:56.707048+0000","last_peered":"2023-08-22T00:21:56.707048+0000","last_clean":"2023-08-22T00:21:56.707048+0000","last_became_active":"2023-08-22T00:21:56.344193+0000","last_became_peered":"2023-08-22T00:21:56.344193+0000","last_unstale":"2023-08-22T00:21:56.707048+0000","last_undegraded":"2023-08-22T00:21:56.707048+0000","last_fullsized":"2023-08-22T00:21:56.707048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732013+0000","last_change":"2023-08-22T00:21:56.729667+0000","last_active":"2023-08-22T00:21:56.732013+0000","last_peered":"2023-08-22T00:21:56.732013+0000","last_clean":"2023-08-22T00:21:56.732013+0000","last_became_active":"2023-08-22T00:21:56.729340+0000","last_became_peered":"2023-08-22T00:21:56.729340+0000","last_unstale":"2023-08-22T00:21:56.732013+0000","last_undegraded":"2023-08-22T00:21:56.732013+0000","last_fullsized":"2023-08-22T00:21:56.732013+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703406+0000","last_change":"2023-08-22T00:21:56.346275+0000","last_active":"2023-08-22T00:21:56.703406+0000","last_peered":"2023-08-22T00:21:56.703406+0000","last_clean":"2023-08-22T00:21:56.703406+0000","last_became_active":"2023-08-22T00:21:56.344483+0000","last_became_peered":"2023-08-22T00:21:56.344483+0000","last_unstale":"2023-08-22T00:21:56.703406+0000","last_undegraded":"2023-08-22T00:21:56.703406+0000","last_fullsized":"2023-08-22T00:21:56.703406+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729688+0000","last_change":"2023-08-22T00:21:56.718533+0000","last_active":"2023-08-22T00:21:56.729688+0000","last_peered":"2023-08-22T00:21:56.729688+0000","last_clean":"2023-08-22T00:21:56.729688+0000","last_became_active":"2023-08-22T00:21:56.717827+0000","last_became_peered":"2023-08-22T00:21:56.717827+0000","last_unstale":"2023-08-22T00:21:56.729688+0000","last_undegraded":"2023-08-22T00:21:56.729688+0000","last_fullsized":"2023-08-22T00:21:56.729688+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.704811+0000","last_change":"2023-08-22T00:21:56.346400+0000","last_active":"2023-08-22T00:21:56.704811+0000","last_peered":"2023-08-22T00:21:56.704811+0000","last_clean":"2023-08-22T00:21:56.704811+0000","last_became_active":"2023-08-22T00:21:56.345741+0000","last_became_peered":"2023-08-22T00:21:56.345741+0000","last_unstale":"2023-08-22T00:21:56.704811+0000","last_undegraded":"2023-08-22T00:21:56.704811+0000","last_fullsized":"2023-08-22T00:21:56.704811+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733161+0000","last_change":"2023-08-22T00:21:56.731895+0000","last_active":"2023-08-22T00:21:56.733161+0000","last_peered":"2023-08-22T00:21:56.733161+0000","last_clean":"2023-08-22T00:21:56.733161+0000","last_became_active":"2023-08-22T00:21:56.731530+0000","last_became_peered":"2023-08-22T00:21:56.731530+0000","last_unstale":"2023-08-22T00:21:56.733161+0000","last_undegraded":"2023-08-22T00:21:56.733161+0000","last_fullsized":"2023-08-22T00:21:56.733161+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705117+0000","last_change":"2023-08-22T00:21:56.344078+0000","last_active":"2023-08-22T00:21:56.705117+0000","last_peered":"2023-08-22T00:21:56.705117+0000","last_clean":"2023-08-22T00:21:56.705117+0000","last_became_active":"2023-08-22T00:21:56.343460+0000","last_became_peered":"2023-08-22T00:21:56.343460+0000","last_unstale":"2023-08-22T00:21:56.705117+0000","last_undegraded":"2023-08-22T00:21:56.705117+0000","last_fullsized":"2023-08-22T00:21:56.705117+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.724294+0000","last_change":"2023-08-22T00:21:56.721181+0000","last_active":"2023-08-22T00:21:56.724294+0000","last_peered":"2023-08-22T00:21:56.724294+0000","last_clean":"2023-08-22T00:21:56.724294+0000","last_became_active":"2023-08-22T00:21:56.720898+0000","last_became_peered":"2023-08-22T00:21:56.720898+0000","last_unstale":"2023-08-22T00:21:56.724294+0000","last_undegraded":"2023-08-22T00:21:56.724294+0000","last_fullsized":"2023-08-22T00:21:56.724294+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705976+0000","last_change":"2023-08-22T00:21:56.345443+0000","last_active":"2023-08-22T00:21:56.705976+0000","last_peered":"2023-08-22T00:21:56.705976+0000","last_clean":"2023-08-22T00:21:56.705976+0000","last_became_active":"2023-08-22T00:21:56.343424+0000","last_became_peered":"2023-08-22T00:21:56.343424+0000","last_unstale":"2023-08-22T00:21:56.705976+0000","last_undegraded":"2023-08-22T00:21:56.705976+0000","last_fullsized":"2023-08-22T00:21:56.705976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.733057+0000","last_change":"2023-08-22T00:21:56.730387+0000","last_active":"2023-08-22T00:21:56.733057+0000","last_peered":"2023-08-22T00:21:56.733057+0000","last_clean":"2023-08-22T00:21:56.733057+0000","last_became_active":"2023-08-22T00:21:56.729356+0000","last_became_peered":"2023-08-22T00:21:56.729356+0000","last_unstale":"2023-08-22T00:21:56.733057+0000","last_undegraded":"2023-08-22T00:21:56.733057+0000","last_fullsized":"2023-08-22T00:21:56.733057+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.707004+0000","last_change":"2023-08-22T00:21:56.357029+0000","last_active":"2023-08-22T00:21:56.707004+0000","last_peered":"2023-08-22T00:21:56.707004+0000","last_clean":"2023-08-22T00:21:56.707004+0000","last_became_active":"2023-08-22T00:21:56.356725+0000","last_became_peered":"2023-08-22T00:21:56.356725+0000","last_unstale":"2023-08-22T00:21:56.707004+0000","last_undegraded":"2023-08-22T00:21:56.707004+0000","last_fullsized":"2023-08-22T00:21:56.707004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708886+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:21:56.708886+0000","last_peered":"2023-08-22T00:21:56.708886+0000","last_clean":"2023-08-22T00:21:56.708886+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:21:56.708886+0000","last_undegraded":"2023-08-22T00:21:56.708886+0000","last_fullsized":"2023-08-22T00:21:56.708886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.725813+0000","last_change":"2023-08-22T00:21:56.723379+0000","last_active":"2023-08-22T00:21:56.725813+0000","last_peered":"2023-08-22T00:21:56.725813+0000","last_clean":"2023-08-22T00:21:56.725813+0000","last_became_active":"2023-08-22T00:21:56.723116+0000","last_became_peered":"2023-08-22T00:21:56.723116+0000","last_unstale":"2023-08-22T00:21:56.725813+0000","last_undegraded":"2023-08-22T00:21:56.725813+0000","last_fullsized":"2023-08-22T00:21:56.725813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.703538+0000","last_change":"2023-08-22T00:21:56.341109+0000","last_active":"2023-08-22T00:21:56.703538+0000","last_peered":"2023-08-22T00:21:56.703538+0000","last_clean":"2023-08-22T00:21:56.703538+0000","last_became_active":"2023-08-22T00:21:56.340820+0000","last_became_peered":"2023-08-22T00:21:56.340820+0000","last_unstale":"2023-08-22T00:21:56.703538+0000","last_undegraded":"2023-08-22T00:21:56.703538+0000","last_fullsized":"2023-08-22T00:21:56.703538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713598+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:21:56.713598+0000","last_peered":"2023-08-22T00:21:56.713598+0000","last_clean":"2023-08-22T00:21:56.713598+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:21:56.713598+0000","last_undegraded":"2023-08-22T00:21:56.713598+0000","last_fullsized":"2023-08-22T00:21:56.713598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.731413+0000","last_change":"2023-08-22T00:21:56.728483+0000","last_active":"2023-08-22T00:21:56.731413+0000","last_peered":"2023-08-22T00:21:56.731413+0000","last_clean":"2023-08-22T00:21:56.731413+0000","last_became_active":"2023-08-22T00:21:56.727823+0000","last_became_peered":"2023-08-22T00:21:56.727823+0000","last_unstale":"2023-08-22T00:21:56.731413+0000","last_undegraded":"2023-08-22T00:21:56.731413+0000","last_fullsized":"2023-08-22T00:21:56.731413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719964+0000","last_change":"2023-08-22T00:21:56.338573+0000","last_active":"2023-08-22T00:21:56.719964+0000","last_peered":"2023-08-22T00:21:56.719964+0000","last_clean":"2023-08-22T00:21:56.719964+0000","last_became_active":"2023-08-22T00:21:56.338303+0000","last_became_peered":"2023-08-22T00:21:56.338303+0000","last_unstale":"2023-08-22T00:21:56.719964+0000","last_undegraded":"2023-08-22T00:21:56.719964+0000","last_fullsized":"2023-08-22T00:21:56.719964+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710874+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:21:56.710874+0000","last_peered":"2023-08-22T00:21:56.710874+0000","last_clean":"2023-08-22T00:21:56.710874+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:21:56.710874+0000","last_undegraded":"2023-08-22T00:21:56.710874+0000","last_fullsized":"2023-08-22T00:21:56.710874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.726797+0000","last_change":"2023-08-22T00:21:56.723157+0000","last_active":"2023-08-22T00:21:56.726797+0000","last_peered":"2023-08-22T00:21:56.726797+0000","last_clean":"2023-08-22T00:21:56.726797+0000","last_became_active":"2023-08-22T00:21:56.721526+0000","last_became_peered":"2023-08-22T00:21:56.721526+0000","last_unstale":"2023-08-22T00:21:56.726797+0000","last_undegraded":"2023-08-22T00:21:56.726797+0000","last_fullsized":"2023-08-22T00:21:56.726797+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713256+0000","last_change":"2023-08-22T00:21:56.349309+0000","last_active":"2023-08-22T00:21:56.713256+0000","last_peered":"2023-08-22T00:21:56.713256+0000","last_clean":"2023-08-22T00:21:56.713256+0000","last_became_active":"2023-08-22T00:21:56.349016+0000","last_became_peered":"2023-08-22T00:21:56.349016+0000","last_unstale":"2023-08-22T00:21:56.713256+0000","last_undegraded":"2023-08-22T00:21:56.713256+0000","last_fullsized":"2023-08-22T00:21:56.713256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713188+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:21:56.713188+0000","last_peered":"2023-08-22T00:21:56.713188+0000","last_clean":"2023-08-22T00:21:56.713188+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:21:56.713188+0000","last_undegraded":"2023-08-22T00:21:56.713188+0000","last_fullsized":"2023-08-22T00:21:56.713188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.715153+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:21:56.715153+0000","last_peered":"2023-08-22T00:21:56.715153+0000","last_clean":"2023-08-22T00:21:56.715153+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:21:56.715153+0000","last_undegraded":"2023-08-22T00:21:56.715153+0000","last_fullsized":"2023-08-22T00:21:56.715153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.727805+0000","last_change":"2023-08-22T00:21:56.725493+0000","last_active":"2023-08-22T00:21:56.727805+0000","last_peered":"2023-08-22T00:21:56.727805+0000","last_clean":"2023-08-22T00:21:56.727805+0000","last_became_active":"2023-08-22T00:21:56.724962+0000","last_became_peered":"2023-08-22T00:21:56.724962+0000","last_unstale":"2023-08-22T00:21:56.727805+0000","last_undegraded":"2023-08-22T00:21:56.727805+0000","last_fullsized":"2023-08-22T00:21:56.727805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"104'2","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729115+0000","last_change":"2023-08-22T00:21:56.347130+0000","last_active":"2023-08-22T00:21:56.729115+0000","last_peered":"2023-08-22T00:21:56.729115+0000","last_clean":"2023-08-22T00:21:56.729115+0000","last_became_active":"2023-08-22T00:21:56.346876+0000","last_became_peered":"2023-08-22T00:21:56.346876+0000","last_unstale":"2023-08-22T00:21:56.729115+0000","last_undegraded":"2023-08-22T00:21:56.729115+0000","last_fullsized":"2023-08-22T00:21:56.729115+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.714961+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:21:56.714961+0000","last_peered":"2023-08-22T00:21:56.714961+0000","last_clean":"2023-08-22T00:21:56.714961+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:21:56.714961+0000","last_undegraded":"2023-08-22T00:21:56.714961+0000","last_fullsized":"2023-08-22T00:21:56.714961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729932+0000","last_change":"2023-08-22T00:21:56.722443+0000","last_active":"2023-08-22T00:21:56.729932+0000","last_peered":"2023-08-22T00:21:56.729932+0000","last_clean":"2023-08-22T00:21:56.729932+0000","last_became_active":"2023-08-22T00:21:56.722108+0000","last_became_peered":"2023-08-22T00:21:56.722108+0000","last_unstale":"2023-08-22T00:21:56.729932+0000","last_undegraded":"2023-08-22T00:21:56.729932+0000","last_fullsized":"2023-08-22T00:21:56.729932+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"104'1","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.719666+0000","last_change":"2023-08-22T00:21:56.352533+0000","last_active":"2023-08-22T00:21:56.719666+0000","last_peered":"2023-08-22T00:21:56.719666+0000","last_clean":"2023-08-22T00:21:56.719666+0000","last_became_active":"2023-08-22T00:21:56.352272+0000","last_became_peered":"2023-08-22T00:21:56.352272+0000","last_unstale":"2023-08-22T00:21:56.719666+0000","last_undegraded":"2023-08-22T00:21:56.719666+0000","last_fullsized":"2023-08-22T00:21:56.719666+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.713464+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:21:56.713464+0000","last_peered":"2023-08-22T00:21:56.713464+0000","last_clean":"2023-08-22T00:21:56.713464+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:21:56.713464+0000","last_undegraded":"2023-08-22T00:21:56.713464+0000","last_fullsized":"2023-08-22T00:21:56.713464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.732245+0000","last_change":"2023-08-22T00:21:56.730009+0000","last_active":"2023-08-22T00:21:56.732245+0000","last_peered":"2023-08-22T00:21:56.732245+0000","last_clean":"2023-08-22T00:21:56.732245+0000","last_became_active":"2023-08-22T00:21:56.729760+0000","last_became_peered":"2023-08-22T00:21:56.729760+0000","last_unstale":"2023-08-22T00:21:56.732245+0000","last_undegraded":"2023-08-22T00:21:56.732245+0000","last_fullsized":"2023-08-22T00:21:56.732245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710573+0000","last_change":"2023-08-22T00:21:56.352783+0000","last_active":"2023-08-22T00:21:56.710573+0000","last_peered":"2023-08-22T00:21:56.710573+0000","last_clean":"2023-08-22T00:21:56.710573+0000","last_became_active":"2023-08-22T00:21:56.352531+0000","last_became_peered":"2023-08-22T00:21:56.352531+0000","last_unstale":"2023-08-22T00:21:56.710573+0000","last_undegraded":"2023-08-22T00:21:56.710573+0000","last_fullsized":"2023-08-22T00:21:56.710573+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.708612+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:21:56.708612+0000","last_peered":"2023-08-22T00:21:56.708612+0000","last_clean":"2023-08-22T00:21:56.708612+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:21:56.708612+0000","last_undegraded":"2023-08-22T00:21:56.708612+0000","last_fullsized":"2023-08-22T00:21:56.708612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.729812+0000","last_change":"2023-08-22T00:21:56.719499+0000","last_active":"2023-08-22T00:21:56.729812+0000","last_peered":"2023-08-22T00:21:56.729812+0000","last_clean":"2023-08-22T00:21:56.729812+0000","last_became_active":"2023-08-22T00:21:56.719200+0000","last_became_peered":"2023-08-22T00:21:56.719200+0000","last_unstale":"2023-08-22T00:21:56.729812+0000","last_undegraded":"2023-08-22T00:21:56.729812+0000","last_fullsized":"2023-08-22T00:21:56.729812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:56.320747+0000","last_clean_scrub_stamp":"2023-08-22T00:21:56.320747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.710816+0000","last_change":"2023-08-22T00:21:56.343877+0000","last_active":"2023-08-22T00:21:56.710816+0000","last_peered":"2023-08-22T00:21:56.710816+0000","last_clean":"2023-08-22T00:21:56.710816+0000","last_became_active":"2023-08-22T00:21:56.343632+0000","last_became_peered":"2023-08-22T00:21:56.343632+0000","last_unstale":"2023-08-22T00:21:56.710816+0000","last_undegraded":"2023-08-22T00:21:56.710816+0000","last_fullsized":"2023-08-22T00:21:56.710816+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:21:55.315564+0000","last_clean_scrub_stamp":"2023-08-22T00:21:55.315564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-22T00:21:56.705997+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:21:56.705997+0000","last_peered":"2023-08-22T00:21:56.705997+0000","last_clean":"2023-08-22T00:21:56.705997+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:21:56.705997+0000","last_undegraded":"2023-08-22T00:21:56.705997+0000","last_fullsized":"2023-08-22T00:21:56.705997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.437},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.497},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.312}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1294336,"data_stored":677995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.71899999999999997,"5min":0.81499999999999995,"15min":0.88800000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.29599999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.83899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.98199999999999998},"last":0.78100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.1339999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.79000000000000004},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.82699999999999996,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.073},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.46200000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.76800000000000002},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65900000000000003,"5min":0.753,"15min":0.94399999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:21:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":1.03},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.81200000000000006,"15min":0.99299999999999999},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.32300000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.246}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.375}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.435},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.38900000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1294336,"data_stored":678809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.28199999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":677953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.498}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":678597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.20799999999999999},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.221,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63600000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.441},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.71599999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.876,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.88100000000000001,"15min":11.163},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.32000000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":678437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.51800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1302528,"data_stored":679441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:04.452 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:22:04.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:22:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.606+0000 7ff776185700 1 Processor -- start 2023-08-22T00:22:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 -- start start 2023-08-22T00:22:04.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff770152c30 0x7ff7700630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7700c2410 0x7ff770065fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7701524c0 con 0x7ff7700635d0 2023-08-22T00:22:04.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770065b70 con 0x7ff770152c30 2023-08-22T00:22:04.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.607+0000 7ff776185700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770063c50 con 0x7ff7700c2410 2023-08-22T00:22:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff770152c30 0x7ff7700630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff7700635d0 0x7ff7700c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38324/0 (socket says 172.21.15.98:38324) 2023-08-22T00:22:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff770152c30 0x7ff7700630e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47586/0 (socket says 172.21.15.98:47586) 2023-08-22T00:22:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76effd700 1 -- 172.21.15.98:0/1641505405 learned_addr learned my addr 172.21.15.98:0/1641505405 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76ffff700 1 --2- 172.21.15.98:0/1641505405 >> v2:172.21.15.118:3300/0 conn(0x7ff7700c2410 0x7ff770065fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 -- 172.21.15.98:0/1641505405 >> v2:172.21.15.118:3300/0 conn(0x7ff7700c2410 msgr2=0x7ff770065fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 --2- 172.21.15.98:0/1641505405 >> v2:172.21.15.118:3300/0 conn(0x7ff7700c2410 0x7ff770065fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 -- 172.21.15.98:0/1641505405 >> v1:172.21.15.98:6789/0 conn(0x7ff7700635d0 legacy=0x7ff7700c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 -- 172.21.15.98:0/1641505405 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770063f30 con 0x7ff770152c30 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76e7fc700 1 -- 172.21.15.98:0/1641505405 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927517542 0 0) 0x7ff7701524c0 con 0x7ff7700635d0 2023-08-22T00:22:04.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76f7fe700 1 --2- 172.21.15.98:0/1641505405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770152c30 0x7ff7700630e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ff7700a9cd0 tx=0x7ff758009060).ready entity=mon.0 client_cookie=8d7ab7e831973dba server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76e7fc700 1 -- 172.21.15.98:0/1641505405 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800b580 con 0x7ff770152c30 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76e7fc700 1 -- 172.21.15.98:0/1641505405 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800b6e0 con 0x7ff770152c30 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.608+0000 7ff76e7fc700 1 -- 172.21.15.98:0/1641505405 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800ba60 con 0x7ff770152c30 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 -- 172.21.15.98:0/1641505405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770152c30 msgr2=0x7ff7700630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 --2- 172.21.15.98:0/1641505405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770152c30 0x7ff7700630e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ff7700a9cd0 tx=0x7ff758009060).stop 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 -- 172.21.15.98:0/1641505405 shutdown_connections 2023-08-22T00:22:04.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 --2- 172.21.15.98:0/1641505405 >> v2:172.21.15.118:3300/0 conn(0x7ff7700c2410 0x7ff770065fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 --2- 172.21.15.98:0/1641505405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770152c30 0x7ff7700630e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 -- 172.21.15.98:0/1641505405 >> 172.21.15.98:0/1641505405 conn(0x7ff7700c3a60 msgr2=0x7ff7700c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:04.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 -- 172.21.15.98:0/1641505405 shutdown_connections 2023-08-22T00:22:04.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.609+0000 7ff776185700 1 -- 172.21.15.98:0/1641505405 wait complete. 2023-08-22T00:22:04.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.610+0000 7ff776185700 1 Processor -- start 2023-08-22T00:22:04.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.610+0000 7ff776185700 1 -- start start 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7700635d0 0x7ff77013d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff770152c30 0x7ff7700ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700bec50 con 0x7ff7700c2410 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700be060 con 0x7ff770152c30 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700be2b0 con 0x7ff7700635d0 2023-08-22T00:22:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47602/0 (socket says 172.21.15.98:47602) 2023-08-22T00:22:04.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 -- 172.21.15.98:0/4024084326 learned_addr learned my addr 172.21.15.98:0/4024084326 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:04.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76f7fe700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7700635d0 0x7ff77013d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 -- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7700635d0 msgr2=0x7ff77013d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76ffff700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff770152c30 0x7ff7700ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7700635d0 0x7ff77013d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 -- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff770152c30 msgr2=0x7ff7700ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff770152c30 0x7ff7700ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 -- 172.21.15.98:0/4024084326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7580092a0 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff76effd700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ff760001eb0 tx=0x7ff760007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600072e0 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760007440 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700be590 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.611+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600057a0 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.612+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700c04b0 con 0x7ff7700c2410 2023-08-22T00:22:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.612+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7700bed90 con 0x7ff7700c2410 2023-08-22T00:22:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.613+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff760005bd0 con 0x7ff7700c2410 2023-08-22T00:22:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.613+0000 7ff7677fe700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 0x7ff7500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.613+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff760079650 con 0x7ff7700c2410 2023-08-22T00:22:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.613+0000 7ff76f7fe700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 0x7ff7500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.614+0000 7ff76f7fe700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 0x7ff7500612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff75800b340 tx=0x7ff758017000).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.617+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7700bed90 con 0x7ff7700c2410 2023-08-22T00:22:04.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.845+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff7700bed90 con 0x7ff7700c2410 2023-08-22T00:22:04.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.849+0000 7ff7677fe700 1 -- 172.21.15.98:0/4024084326 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff7700bed90 con 0x7ff7700c2410 2023-08-22T00:22:04.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 msgr2=0x7ff7500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 0x7ff7500612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff75800b340 tx=0x7ff758017000).stop 2023-08-22T00:22:04.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 msgr2=0x7ff7700abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ff760001eb0 tx=0x7ff760007e90).stop 2023-08-22T00:22:04.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 shutdown_connections 2023-08-22T00:22:04.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff75005ee10 0x7ff7500612d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7700635d0 0x7ff77013d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff770152c30 0x7ff7700ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 --2- 172.21.15.98:0/4024084326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7700c2410 0x7ff7700abb80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 >> 172.21.15.98:0/4024084326 conn(0x7ff7700c3a60 msgr2=0x7ff77014abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 shutdown_connections 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.851+0000 7ff776185700 1 -- 172.21.15.98:0/4024084326 wait complete. 2023-08-22T00:22:04.856 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:22:04.864 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:04.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.980+0000 7fd9f728f700 1 Processor -- start 2023-08-22T00:22:04.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.980+0000 7fd9f728f700 1 -- start start 2023-08-22T00:22:04.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f728f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9f0155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f728f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0158bf0 con 0x7fd9f0066620 2023-08-22T00:22:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f728f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0157d90 con 0x7fd9f00a6e50 2023-08-22T00:22:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f728f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0157fe0 con 0x7fd9f0151d60 2023-08-22T00:22:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f582c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd9f0066620 0x7fd9f00643c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38328/0 (socket says 172.21.15.98:38328) 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f582c700 1 -- 172.21.15.98:0/2701129842 learned_addr learned my addr 172.21.15.98:0/2701129842 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786984262 0 0) 0x7fd9f0158bf0 con 0x7fd9f0066620 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9f502b700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9f0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.981+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9dc0033f0 con 0x7fd9f0066620 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3410970870 0 0) 0x7fd9dc0033f0 con 0x7fd9f0066620 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 msgr2=0x7fd9f0155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9f0155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 >> v1:172.21.15.118:6789/0 conn(0x7fd9f00a6e50 legacy=0x7fd9f0065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f01582c0 con 0x7fd9f0066620 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd9e80017f0 con 0x7fd9f0066620 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 >> v1:172.21.15.98:6789/0 conn(0x7fd9f0066620 legacy=0x7fd9f00643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9dc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9dc003e00 0x7fd9dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0157fe0 con 0x7fd9dc004b80 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc00b8e0 con 0x7fd9dc003e00 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc00baa0 con 0x7fd9f0151d60 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f502b700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9dc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f482a700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9dc003e00 0x7fd9dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 -- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 msgr2=0x7fd9dc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f0151d60 0x7fd9dc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 -- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9dc003e00 msgr2=0x7fd9dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9dc003e00 0x7fd9dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 -- 172.21.15.98:0/2701129842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0033f0 con 0x7fd9dc004b80 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9f582c700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9dc005000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fd9e800c5f0 tx=0x7fd9e8001d90).ready entity=mon.0 client_cookie=e701c518ae6241ac server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8001fc0 con 0x7fd9dc004b80 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8005b20 con 0x7fd9dc004b80 2023-08-22T00:22:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.982+0000 7fd9e7fff700 1 -- 172.21.15.98:0/2701129842 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80070d0 con 0x7fd9dc004b80 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 -- 172.21.15.98:0/2701129842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 msgr2=0x7fd9dc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 --2- 172.21.15.98:0/2701129842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9dc005000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fd9e800c5f0 tx=0x7fd9e8001d90).stop 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f582c700 1 -- 172.21.15.98:0/2701129842 reap_dead start 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 -- 172.21.15.98:0/2701129842 shutdown_connections 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 -- 172.21.15.98:0/2701129842 >> 172.21.15.98:0/2701129842 conn(0x7fd9f006a980 msgr2=0x7fd9f00c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:04.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 -- 172.21.15.98:0/2701129842 shutdown_connections 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.983+0000 7fd9f728f700 1 -- 172.21.15.98:0/2701129842 wait complete. 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.984+0000 7fd9f728f700 1 Processor -- start 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.984+0000 7fd9f728f700 1 -- start start 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9f014ae50 0x7fd9f00a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f00a5aa0 0x7fd9f00a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00a6410 con 0x7fd9dc004b80 2023-08-22T00:22:04.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00a42a0 con 0x7fd9f014ae50 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f728f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00a4530 con 0x7fd9f00a5aa0 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47620/0 (socket says 172.21.15.98:47620) 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 -- 172.21.15.98:0/3243101075 learned_addr learned my addr 172.21.15.98:0/3243101075 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f582c700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f00a5aa0 0x7fd9f00a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f482a700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9f014ae50 0x7fd9f00a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 -- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f00a5aa0 msgr2=0x7fd9f00a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f00a5aa0 0x7fd9f00a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 -- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9f014ae50 msgr2=0x7fd9f00a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9f014ae50 0x7fd9f00a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.985+0000 7fd9f502b700 1 -- 172.21.15.98:0/3243101075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00a4810 con 0x7fd9dc004b80 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9f502b700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fd9e00119c0 tx=0x7fd9e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000f700 con 0x7fd9dc004b80 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000f860 con 0x7fd9dc004b80 2023-08-22T00:22:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00a4af0 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000fc20 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.986+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f00a50b0 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.987+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0047480 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.987+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd9e000fd80 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.987+0000 7fd9e57fa700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 0x7fd9d40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.987+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd9e007aa50 con 0x7fd9dc004b80 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.987+0000 7fd9f482a700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 0x7fd9d40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.988+0000 7fd9f482a700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 0x7fd9d40612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd9ec007fd0 tx=0x7fd9ec007b90).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:04.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:04.991+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9e004bd60 con 0x7fd9dc004b80 2023-08-22T00:22:05.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.191+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9f01585a0 con 0x7fd9dc004b80 2023-08-22T00:22:05.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.191+0000 7fd9e57fa700 1 -- 172.21.15.98:0/3243101075 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fd9e004f380 con 0x7fd9dc004b80 2023-08-22T00:22:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:05.194 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:22:05.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 msgr2=0x7fd9d40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 0x7fd9d40612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd9ec007fd0 tx=0x7fd9ec007b90).stop 2023-08-22T00:22:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 msgr2=0x7fd9f00ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fd9e00119c0 tx=0x7fd9e0009060).stop 2023-08-22T00:22:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 shutdown_connections 2023-08-22T00:22:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd9d405ee10 0x7fd9d40612d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9f00a5aa0 0x7fd9f00a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9dc004b80 0x7fd9f00ac330 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 --2- 172.21.15.98:0/3243101075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9f014ae50 0x7fd9f00a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 >> 172.21.15.98:0/3243101075 conn(0x7fd9f006a980 msgr2=0x7fd9f00c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 shutdown_connections 2023-08-22T00:22:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.193+0000 7fd9f728f700 1 -- 172.21.15.98:0/3243101075 wait complete. 2023-08-22T00:22:05.199 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:22:05.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:21:56.699407+0000', 'modified': '2023-08-22T00:21:58.705540+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6915}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6915': {'gid': 6915, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/1304048216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6835', 'nonce': 1304048216}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 1304048216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:22:05.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:22:05.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-22T00:22:05.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.726+0000 7f40e58e0700 1 Processor -- start 2023-08-22T00:22:05.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.726+0000 7f40e58e0700 1 -- start start 2023-08-22T00:22:05.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40e58e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 0x7f40e00c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40e58e0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e00be5d0 con 0x7f40e0065870 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40e58e0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e0067590 con 0x7f40e0150750 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40e58e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0067870 con 0x7f40e0150b30 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40de7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f40e0065870 0x7f40e00bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38330/0 (socket says 172.21.15.98:38330) 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.727+0000 7f40de7fc700 1 -- 172.21.15.98:0/3472781332 learned_addr learned my addr 172.21.15.98:0/3472781332 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:05.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.728+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3472781332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 0x7f40e00c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.728+0000 7f40df7fe700 1 -- 172.21.15.98:0/3472781332 >> v1:172.21.15.118:6789/0 conn(0x7f40e0150750 legacy=0x7f40e00a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.728+0000 7f40df7fe700 1 -- 172.21.15.98:0/3472781332 >> v1:172.21.15.98:6789/0 conn(0x7f40e0065870 legacy=0x7f40e00bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.728+0000 7f40df7fe700 1 -- 172.21.15.98:0/3472781332 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0067b50 con 0x7f40e0150b30 2023-08-22T00:22:05.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.728+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3472781332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 0x7f40e00c3650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f40d8009e90 tx=0x7f40d8009780).ready entity=mon.2 client_cookie=f7c60be9f75bffee server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.730+0000 7f40ddffb700 1 -- 172.21.15.98:0/3472781332 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800e070 con 0x7f40e0150b30 2023-08-22T00:22:05.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.730+0000 7f40ddffb700 1 -- 172.21.15.98:0/3472781332 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800bc30 con 0x7f40e0150b30 2023-08-22T00:22:05.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.730+0000 7f40ddffb700 1 -- 172.21.15.98:0/3472781332 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8012410 con 0x7f40e0150b30 2023-08-22T00:22:05.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.730+0000 7f40e58e0700 1 -- 172.21.15.98:0/3472781332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 msgr2=0x7f40e00c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.730+0000 7f40e58e0700 1 --2- 172.21.15.98:0/3472781332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 0x7f40e00c3650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f40d8009e90 tx=0x7f40d8009780).stop 2023-08-22T00:22:05.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.731+0000 7f40e58e0700 1 -- 172.21.15.98:0/3472781332 shutdown_connections 2023-08-22T00:22:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.731+0000 7f40e58e0700 1 --2- 172.21.15.98:0/3472781332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0150b30 0x7f40e00c3650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.731+0000 7f40e58e0700 1 -- 172.21.15.98:0/3472781332 >> 172.21.15.98:0/3472781332 conn(0x7f40e00c7800 msgr2=0x7f40e00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.731+0000 7f40e58e0700 1 -- 172.21.15.98:0/3472781332 shutdown_connections 2023-08-22T00:22:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.731+0000 7f40e58e0700 1 -- 172.21.15.98:0/3472781332 wait complete. 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.732+0000 7f40e58e0700 1 Processor -- start 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.732+0000 7f40e58e0700 1 -- start start 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0065870 0x7f40e014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 0x7f40e00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00ad380 con 0x7f40e0150750 2023-08-22T00:22:05.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00a42f0 con 0x7f40e0150b30 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e014eb80 con 0x7f40e0065870 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47626/0 (socket says 172.21.15.98:47626) 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 -- 172.21.15.98:0/2697959664 learned_addr learned my addr 172.21.15.98:0/2697959664 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40deffd700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0065870 0x7f40e014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40df7fe700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 0x7f40e00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 -- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0065870 msgr2=0x7f40e014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0065870 0x7f40e014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 -- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 msgr2=0x7f40e00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 0x7f40e00ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 -- 172.21.15.98:0/2697959664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8009a20 con 0x7f40e0150750 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40df7fe700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 0x7f40e00ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f40d400c440 tx=0x7f40d4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40c6ffd700 1 -- 172.21.15.98:0/2697959664 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40072e0 con 0x7f40e0150750 2023-08-22T00:22:05.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40c6ffd700 1 -- 172.21.15.98:0/2697959664 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4007440 con 0x7f40e0150750 2023-08-22T00:22:05.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00a05f0 con 0x7f40e0150750 2023-08-22T00:22:05.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.733+0000 7f40c6ffd700 1 -- 172.21.15.98:0/2697959664 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40057a0 con 0x7f40e0150750 2023-08-22T00:22:05.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.734+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e00a0bb0 con 0x7f40e0150750 2023-08-22T00:22:05.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.735+0000 7f40c6ffd700 1 -- 172.21.15.98:0/2697959664 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f40d4005bd0 con 0x7f40e0150750 2023-08-22T00:22:05.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.736+0000 7f40c6ffd700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 0x7f40cc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.736+0000 7f40c6ffd700 1 -- 172.21.15.98:0/2697959664 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f40d40796a0 con 0x7f40e0150750 2023-08-22T00:22:05.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.736+0000 7f40deffd700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 0x7f40cc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.736+0000 7f40deffd700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 0x7f40cc0612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f40d00036d0 tx=0x7f40d0009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.737+0000 7f40f7294b80 1 Processor -- start 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.737+0000 7f40f7294b80 1 -- start start 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb013600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb013af0 0x5651bb013f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651baf54db0 con 0x5651bb0182c0 2023-08-22T00:22:05.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651baf6a030 con 0x5651bb060f60 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651baf6a170 con 0x5651bb013af0 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47632/0 (socket says 172.21.15.98:47632) 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 -- 172.21.15.98:0/3221674812 learned_addr learned my addr 172.21.15.98:0/3221674812 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40de7fc700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb013600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb013af0 0x5651bb013f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 -- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb013af0 msgr2=0x5651bb013f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb013af0 0x5651bb013f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 -- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 msgr2=0x5651bb013600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb013600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40deffd700 1 -- 172.21.15.98:0/3221674812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651baf3cb00 con 0x5651bb0182c0 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.738+0000 7f40de7fc700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb013600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40deffd700 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f40d00176d0 tx=0x7f40d0012000).ready entity=mon.0 client_cookie=daf654b8d8929991 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40bffff700 1 -- 172.21.15.98:0/3221674812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d001c070 con 0x5651bb0182c0 2023-08-22T00:22:05.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40bffff700 1 -- 172.21.15.98:0/3221674812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00170d0 con 0x5651bb0182c0 2023-08-22T00:22:05.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40bffff700 1 -- 172.21.15.98:0/3221674812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00146e0 con 0x5651bb0182c0 2023-08-22T00:22:05.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 -- 172.21.15.98:0/3221674812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 msgr2=0x5651bb0186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f40d00176d0 tx=0x7f40d0012000).stop 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 -- 172.21.15.98:0/3221674812 shutdown_connections 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb013af0 0x5651bb013f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb0182c0 0x5651bb0186a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3221674812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb013600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 -- 172.21.15.98:0/3221674812 >> 172.21.15.98:0/3221674812 conn(0x5651bae82940 msgr2=0x5651bb0613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 -- 172.21.15.98:0/3221674812 shutdown_connections 2023-08-22T00:22:05.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.739+0000 7f40f7294b80 1 -- 172.21.15.98:0/3221674812 wait complete. 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.740+0000 7f40f7294b80 1 -- start start 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.740+0000 7f40f7294b80 1 Processor -- start 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb013af0 0x5651bb046d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb05b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651baf6a3f0 con 0x5651bb060f60 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651baf35920 con 0x5651bb013af0 2023-08-22T00:22:05.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651bb059ab0 con 0x5651bb0182c0 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40f7294b80 10 client.0 ll_register_callbacks cb 0x5651baf0ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47638/0 (socket says 172.21.15.98:47638) 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 -- 172.21.15.98:0/3932703843 learned_addr learned my addr 172.21.15.98:0/3932703843 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40deffd700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb013af0 0x5651bb046d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40de7fc700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb05b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 -- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 msgr2=0x5651bb05b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb05b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 -- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb013af0 msgr2=0x5651bb046d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb013af0 0x5651bb046d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.741+0000 7f40df7fe700 1 -- 172.21.15.98:0/3932703843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d000f040 con 0x5651bb060f60 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40df7fe700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f40d800b9f0 tx=0x7f40d8009780).ready entity=mon.0 client_cookie=68c0dd7e791975c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8026470 con 0x5651bb060f60 2023-08-22T00:22:05.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f40d80265d0 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651bb012aa0 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d80269a0 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 10 client.7092 fetch_fsmap learned FSMap version 36 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5651baf62f70 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651bb012aa0 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40d8026b00 con 0x5651bb060f60 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 10 client.7092 fetch_fsmap finished waiting for FSMap version 36 2023-08-22T00:22:05.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 10 client.7092 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 20 client.7092 populate_metadata read hostname 'smithi098' 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb0427a0 0x5651bb042b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 4 client.7092 mds_command: new command op to 6915 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 --> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651badd2ef0 con 0x5651bb0427a0 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40deffd700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb0427a0 0x5651bb042b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40bd7fa700 10 client.7092 ms_handle_connect on v2:172.21.15.98:6835/1304048216 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.742+0000 7f40deffd700 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb0427a0 0x5651bb042b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c9019cc0edb17176 server_cookie=8b9eccf69ecbbd83 in_seq=0 out_seq=0 2023-08-22T00:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40bd7fa700 1 -- 172.21.15.98:0/3932703843 <== mds.0 v2:172.21.15.98:6835/1304048216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5651badd2ef0 con 0x5651bb0427a0 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40bd7fa700 10 client.7092 handle_command_reply: tid=0 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 client.7092 shutdown 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 msgr2=0x5651bb05cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f40d800b9f0 tx=0x7f40d8009780).stop 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 shutdown_connections 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb0427a0 0x5651bb042b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb060f60 0x5651bb05cc70 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40bd7fa700 0 client.7092 ms_handle_reset on v2:172.21.15.98:6835/1304048216 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb013af0 0x5651bb046d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 --2- 172.21.15.98:0/3932703843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb05b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 >> 172.21.15.98:0/3932703843 conn(0x5651bae82940 msgr2=0x5651bb016330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 shutdown_connections 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.743+0000 7f40f7294b80 1 -- 172.21.15.98:0/3932703843 wait complete. 2023-08-22T00:22:05.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.744+0000 7f40f7294b80 20 client.7092 trim_cache size 0 max 16384 2023-08-22T00:22:05.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 Processor -- start 2023-08-22T00:22:05.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 -- start start 2023-08-22T00:22:05.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb05acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651bb019980 con 0x5651bb013af0 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651bb01a900 con 0x5651bb060f60 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651bb047540 con 0x5651bb0182c0 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47650/0 (socket says 172.21.15.98:47650) 2023-08-22T00:22:05.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.760+0000 7f40deffd700 1 -- 172.21.15.98:0/2262546981 learned_addr learned my addr 172.21.15.98:0/2262546981 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40df7fe700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb05acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 -- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 msgr2=0x5651bb06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb06c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 -- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 msgr2=0x5651bb05acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb05acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 -- 172.21.15.98:0/2262546981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651baf5e580 con 0x5651bb013af0 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40df7fe700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb05acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40deffd700 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f40d0017000 tx=0x7f40d0026040).ready entity=mon.0 client_cookie=30a8502031a83e75 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40c4ff9700 1 -- 172.21.15.98:0/2262546981 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0029070 con 0x5651bb013af0 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40c4ff9700 1 -- 172.21.15.98:0/2262546981 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d002a040 con 0x5651bb013af0 2023-08-22T00:22:05.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40c4ff9700 1 -- 172.21.15.98:0/2262546981 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0017240 con 0x5651bb013af0 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 -- 172.21.15.98:0/2262546981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 msgr2=0x5651bb058770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f40d0017000 tx=0x7f40d0026040).stop 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 -- 172.21.15.98:0/2262546981 shutdown_connections 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb060f60 0x5651bb05acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb058770 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2262546981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb0182c0 0x5651bb06c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 -- 172.21.15.98:0/2262546981 >> 172.21.15.98:0/2262546981 conn(0x5651bae82940 msgr2=0x5651bb057960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.761+0000 7f40f7294b80 1 -- 172.21.15.98:0/2262546981 shutdown_connections 2023-08-22T00:22:05.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.762+0000 7f40f7294b80 1 -- 172.21.15.98:0/2262546981 wait complete. 2023-08-22T00:22:05.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.762+0000 7f40f7294b80 1 -- start start 2023-08-22T00:22:05.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.762+0000 7f40f7294b80 1 Processor -- start 2023-08-22T00:22:05.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb0182c0 0x5651bb05b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb060f60 0x5651bb0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651bb05b670 con 0x5651bb013af0 2023-08-22T00:22:05.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651bb043750 con 0x5651bb0182c0 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651bb041860 con 0x5651bb060f60 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 10 client.0 ll_register_callbacks cb 0x5651baf0ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47658/0 (socket says 172.21.15.98:47658) 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 -- 172.21.15.98:0/2680588268 learned_addr learned my addr 172.21.15.98:0/2680588268 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40df7fe700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb060f60 0x5651bb0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb0182c0 0x5651bb05b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 -- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb060f60 msgr2=0x5651bb0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb060f60 0x5651bb0c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 -- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb0182c0 msgr2=0x5651bb05b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb0182c0 0x5651bb05b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 -- 172.21.15.98:0/2680588268 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651baf3cb00 con 0x5651bb013af0 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40deffd700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f40d0019000 tx=0x7f40d002f000).ready entity=mon.0 client_cookie=165dd07f78cfdbf3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:22:05.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0029040 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f40d0025a00 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40d00170d0 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d0025e10 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 10 client.7098 fetch_fsmap learned FSMap version 36 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5651baf5e2d0 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.764+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00170d0 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40d0025020 con 0x5651bb013af0 2023-08-22T00:22:05.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 10 client.7098 fetch_fsmap finished waiting for FSMap version 36 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 10 client.7098 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 20 client.7098 populate_metadata read hostname 'smithi098' 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb042b80 0x5651bb0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 4 client.7098 mds_command: new command op to 6915 tid=0[{"prefix": "status"}] 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 --> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651bae08040 con 0x5651bb042b80 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb042b80 0x5651bb0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40bd7fa700 10 client.7098 ms_handle_connect on v2:172.21.15.98:6835/1304048216 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40de7fc700 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb042b80 0x5651bb0c3350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5f43baad321c26f8 server_cookie=d96764c7c078e94e in_seq=0 out_seq=0 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40bd7fa700 1 -- 172.21.15.98:0/2680588268 <== mds.0 v2:172.21.15.98:6835/1304048216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5651bae08040 con 0x5651bb042b80 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40bd7fa700 10 client.7098 handle_command_reply: tid=0 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 client.7098 shutdown 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 msgr2=0x5651bb05ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f40d0019000 tx=0x7f40d002f000).stop 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 shutdown_connections 2023-08-22T00:22:05.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:6835/1304048216,v1:172.21.15.98:6837/1304048216] conn(0x5651bb042b80 0x5651bb0c3350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5651bb060f60 0x5651bb0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bb013af0 0x5651bb05ac90 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40bd7fa700 0 client.7098 ms_handle_reset on v2:172.21.15.98:6835/1304048216 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 --2- 172.21.15.98:0/2680588268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651bb0182c0 0x5651bb05b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 >> 172.21.15.98:0/2680588268 conn(0x5651bae82940 msgr2=0x5651bb0161b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 shutdown_connections 2023-08-22T00:22:05.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.765+0000 7f40f7294b80 1 -- 172.21.15.98:0/2680588268 wait complete. 2023-08-22T00:22:05.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40f7294b80 20 client.7098 trim_cache size 0 max 16384 2023-08-22T00:22:05.778 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:22:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:22:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:22:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 6915, 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.0654061469999991, 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 36, 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 105, 2023-08-22T00:22:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 105, 2023-08-22T00:22:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 13.522658503000001 2023-08-22T00:22:05.780 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:22:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 msgr2=0x7f40cc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 0x7f40cc0612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f40d00036d0 tx=0x7f40d0009040).stop 2023-08-22T00:22:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 msgr2=0x7f40e00ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f40d400c440 tx=0x7f40d4007df0).stop 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 shutdown_connections 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f40cc05ee10 0x7f40cc0612d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40e0065870 0x7f40e014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40e0150b30 0x7f40e00ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 --2- 172.21.15.98:0/2697959664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40e0150750 0x7f40e00ac9a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 >> 172.21.15.98:0/2697959664 conn(0x7f40e00c7800 msgr2=0x7f40e00c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 shutdown_connections 2023-08-22T00:22:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.766+0000 7f40e58e0700 1 -- 172.21.15.98:0/2697959664 wait complete. 2023-08-22T00:22:05.783 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:22:05.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.885+0000 7f6ca8015700 1 Processor -- start 2023-08-22T00:22:05.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.885+0000 7f6ca8015700 1 -- start start 2023-08-22T00:22:05.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca8015700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 0x7f6ca00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca8015700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00c8350 con 0x7f6ca00caba0 2023-08-22T00:22:05.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca8015700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00c7740 con 0x7f6ca0156e50 2023-08-22T00:22:05.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca8015700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00c7a20 con 0x7f6ca00c72c0 2023-08-22T00:22:05.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca5db1700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6ca00caba0 0x7f6ca00a9bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38346/0 (socket says 172.21.15.98:38346) 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca5db1700 1 -- 172.21.15.98:0/3709574991 learned_addr learned my addr 172.21.15.98:0/3709574991 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca55b0700 1 --2- 172.21.15.98:0/3709574991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 0x7f6ca00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10992577 0 0) 0x7f6ca00c8350 con 0x7f6ca00caba0 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c0033f0 con 0x7f6ca00caba0 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137639779 0 0) 0x7f6ca00c7740 con 0x7f6ca0156e50 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca00c8350 con 0x7f6ca0156e50 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca55b0700 1 -- 172.21.15.98:0/3709574991 >> v1:172.21.15.118:6789/0 conn(0x7f6ca0156e50 legacy=0x7f6ca00c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca55b0700 1 -- 172.21.15.98:0/3709574991 >> v1:172.21.15.98:6789/0 conn(0x7f6ca00caba0 legacy=0x7f6ca00a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.886+0000 7f6ca55b0700 1 -- 172.21.15.98:0/3709574991 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00c7d00 con 0x7f6ca00c72c0 2023-08-22T00:22:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca55b0700 1 --2- 172.21.15.98:0/3709574991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 0x7f6ca00caf80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c90009790 tx=0x7f6c90009060).ready entity=mon.2 client_cookie=50bb040809209bb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000f510 con 0x7f6ca00c72c0 2023-08-22T00:22:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000f670 con 0x7f6ca00c72c0 2023-08-22T00:22:05.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca4daf700 1 -- 172.21.15.98:0/3709574991 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000f9f0 con 0x7f6ca00c72c0 2023-08-22T00:22:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 -- 172.21.15.98:0/3709574991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 msgr2=0x7f6ca00caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 --2- 172.21.15.98:0/3709574991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 0x7f6ca00caf80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c90009790 tx=0x7f6c90009060).stop 2023-08-22T00:22:05.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 -- 172.21.15.98:0/3709574991 shutdown_connections 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 --2- 172.21.15.98:0/3709574991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca00c72c0 0x7f6ca00caf80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 -- 172.21.15.98:0/3709574991 >> 172.21.15.98:0/3709574991 conn(0x7f6ca0082ac0 msgr2=0x7f6ca0069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 -- 172.21.15.98:0/3709574991 shutdown_connections 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.887+0000 7f6ca8015700 1 -- 172.21.15.98:0/3709574991 wait complete. 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.888+0000 7f6ca8015700 1 Processor -- start 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.888+0000 7f6ca8015700 1 -- start start 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ca00c72c0 0x7f6ca00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca0156e50 0x7f6ca00c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01502d0 con 0x7f6ca00caba0 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0156240 con 0x7f6ca00c72c0 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca8015700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0156520 con 0x7f6ca0156e50 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca55b0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca55b0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47660/0 (socket says 172.21.15.98:47660) 2023-08-22T00:22:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca55b0700 1 -- 172.21.15.98:0/2178356993 learned_addr learned my addr 172.21.15.98:0/2178356993 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.889+0000 7f6ca65b2700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca0156e50 0x7f6ca00c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca5db1700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ca00c72c0 0x7f6ca00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 -- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca0156e50 msgr2=0x7f6ca00c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca0156e50 0x7f6ca00c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 -- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ca00c72c0 msgr2=0x7f6ca00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ca00c72c0 0x7f6ca00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 -- 172.21.15.98:0/2178356993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900092a0 con 0x7f6ca00caba0 2023-08-22T00:22:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca55b0700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6c90011000 tx=0x7f6c90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000f7e0 con 0x7f6ca00caba0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000f940 con 0x7f6ca00caba0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00ada60 con 0x7f6ca00caba0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9001b660 con 0x7f6ca00caba0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.890+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00ae020 con 0x7f6ca00caba0 2023-08-22T00:22:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.891+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0060020 con 0x7f6ca00caba0 2023-08-22T00:22:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.892+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6c9001ba10 con 0x7f6ca00caba0 2023-08-22T00:22:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.892+0000 7f6c95ffb700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 0x7f6c840612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.892+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6c9007b500 con 0x7f6ca00caba0 2023-08-22T00:22:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.892+0000 7f6ca5db1700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 0x7f6c840612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.892+0000 7f6ca5db1700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 0x7f6c840612a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6c9c005750 tx=0x7f6c9c009040).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:05.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:05.896+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c9004c750 con 0x7f6ca00caba0 2023-08-22T00:22:06.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.102+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ca00c7fe0 con 0x7f6ca00caba0 2023-08-22T00:22:06.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.102+0000 7f6c95ffb700 1 -- 172.21.15.98:0/2178356993 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6c9004fd70 con 0x7f6ca00caba0 2023-08-22T00:22:06.104 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:22:06.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 msgr2=0x7f6c840612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:06.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 0x7f6c840612a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6c9c005750 tx=0x7f6c9c009040).stop 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 msgr2=0x7f6ca014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6c90011000 tx=0x7f6c90017000).stop 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 shutdown_connections 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6c8405ede0 0x7f6c840612a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ca0156e50 0x7f6ca00c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ca00c72c0 0x7f6ca00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:06.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 --2- 172.21.15.98:0/2178356993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca00caba0 0x7f6ca014fde0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:06.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 >> 172.21.15.98:0/2178356993 conn(0x7f6ca0082ac0 msgr2=0x7f6ca0151eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:06.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 shutdown_connections 2023-08-22T00:22:06.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:06.104+0000 7f6ca8015700 1 -- 172.21.15.98:0/2178356993 wait complete. 2023-08-22T00:22:06.116 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:22:06.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:22:06.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:22:06.117 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:22:06.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:06.117 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:22:06.117 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:22:06.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:22:06.118 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:06.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.119 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:22:06.137 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.138 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41580sec preferred_lft 41580sec 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.140 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:22:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:22:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:06.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.143 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:22:06.204 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:22:06.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.206 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:22:06.266 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:22:06.267 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:22:06.267 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:22:06.267 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:22:06.267 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:22:06.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.268 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:22:06.268 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:22:06.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:22:06.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:22:06.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:22:06.270 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:22:06.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.373 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:22:06.392 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:22:06.392 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:22:06.393 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:06.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:06.394 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:22:06.460 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:22:06.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:06.461 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:06.518 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:06.519 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:22:06.585 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:22:06.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:22:06.653 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:22:06.653 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:22:06.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:06.655 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:22:06.713 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:22:06.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:06.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:22:06.783 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:22:06.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:22:06.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:22:06.835+0000 7fc5f15553c0 -1 init, newargv = 0x55b4b23c2850 newargc=15 2023-08-22T00:22:06.837 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[152419]: starting ceph client 2023-08-22T00:22:06.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[152419]: starting fuse 2023-08-22T00:22:06.851 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:22:06.852 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:22:06.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:06.853 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:22:06.911 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:22:06.911 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:22:06.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:22:06.912 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:22:06.913 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:22:06.913 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:22:06.913 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:22:06.914 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:06.914 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:22:06.914 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:22:06.915 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:22:06.915 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:22:06.916 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:06.916 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:22:06.916 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:22:06.917 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:22:06.917 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:22:06.917 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:06.918 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:22:06.918 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:22:06.918 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:22:06.918 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:22:06.919 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:22:06.919 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:22:06.919 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:22:06.920 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:22:06.920 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:06.920 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:22:06.921 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:22:07.034 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.152419.asok 2023-08-22T00:22:07.217 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.152419.asok 2023-08-22T00:22:07.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:07.218 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.152419.asok status 2023-08-22T00:22:07.369 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:22:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "152419", 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:22:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 7113, 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 7113 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:22:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 400910248 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:22:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 400910248 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.7113 192.168.0.1:0/400910248", 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/400910248", 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 36, 2023-08-22T00:22:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 105, 2023-08-22T00:22:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:22:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:22:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:22:07.375 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:22:07.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:07.379 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:22:07.380 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:07.399 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:22:07.399 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:07.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:07.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:07.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:22:07.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.621+0000 7f1223f93700 1 Processor -- start 2023-08-22T00:22:07.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.621+0000 7f1223f93700 1 -- start start 2023-08-22T00:22:07.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1223f93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f121c150410 0x7f121c154620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1223f93700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c0c2570 con 0x7f121c150030 2023-08-22T00:22:07.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1223f93700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c0c2850 con 0x7f121c0c2020 2023-08-22T00:22:07.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1223f93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c153e20 con 0x7f121c150410 2023-08-22T00:22:07.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1221d2f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f121c150030 0x7f121c0bc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38350/0 (socket says 172.21.15.98:38350) 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.622+0000 7f1221d2f700 1 -- 172.21.15.98:0/333348201 learned_addr learned my addr 172.21.15.98:0/333348201 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f122152e700 1 --2- 172.21.15.98:0/333348201 >> v2:172.21.15.118:3300/0 conn(0x7f121c150410 0x7f121c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628769475 0 0) 0x7f121c0c2570 con 0x7f121c150030 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1208004500 con 0x7f121c150030 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426926718 0 0) 0x7f1208004500 con 0x7f121c150030 2023-08-22T00:22:07.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 >> v2:172.21.15.118:3300/0 conn(0x7f121c150410 msgr2=0x7f121c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 --2- 172.21.15.98:0/333348201 >> v2:172.21.15.118:3300/0 conn(0x7f121c150410 0x7f121c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 >> v1:172.21.15.118:6789/0 conn(0x7f121c0c2020 legacy=0x7f121c062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c154100 con 0x7f121c150030 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f1218001470 con 0x7f121c150030 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 >> v1:172.21.15.98:6789/0 conn(0x7f121c150030 legacy=0x7f121c0bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f1208004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080057a0 0x7f1208005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1208006110 0x7f120800c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c153e20 con 0x7f12080049f0 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120800cfc0 con 0x7f1208006110 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120800d180 con 0x7f12080057a0 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f1208004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f122152e700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080057a0 0x7f1208005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1222530700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1208006110 0x7f120800c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 -- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080057a0 msgr2=0x7f1208005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080057a0 0x7f1208005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 -- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1208006110 msgr2=0x7f120800c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1208006110 0x7f120800c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.623+0000 7f1221d2f700 1 -- 172.21.15.98:0/333348201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208004500 con 0x7f12080049f0 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1222530700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1208006110 0x7f120800c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1222530700 1 -- 172.21.15.98:0/333348201 reap_dead start 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1221d2f700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f1208004e10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f121800c190 tx=0x7f1218001e50).ready entity=mon.0 client_cookie=180c7400d2f6659c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218007a20 con 0x7f12080049f0 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800cac0 con 0x7f12080049f0 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1220d2d700 1 -- 172.21.15.98:0/333348201 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800ce40 con 0x7f12080049f0 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 -- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 msgr2=0x7f1208004e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f1208004e10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f121800c190 tx=0x7f1218001e50).stop 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 -- 172.21.15.98:0/333348201 shutdown_connections 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 --2- 172.21.15.98:0/333348201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f1208004e10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 -- 172.21.15.98:0/333348201 >> 172.21.15.98:0/333348201 conn(0x7f121c0c3170 msgr2=0x7f121c0c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:07.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 -- 172.21.15.98:0/333348201 shutdown_connections 2023-08-22T00:22:07.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.624+0000 7f1223f93700 1 -- 172.21.15.98:0/333348201 wait complete. 2023-08-22T00:22:07.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.625+0000 7f1223f93700 1 Processor -- start 2023-08-22T00:22:07.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.625+0000 7f1223f93700 1 -- start start 2023-08-22T00:22:07.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f121c0a8b10 0x7f121c14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 0x7f121c14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c150f10 con 0x7f12080049f0 2023-08-22T00:22:07.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c14d830 con 0x7f121c14dad0 2023-08-22T00:22:07.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1223f93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c14e440 con 0x7f121c0a8b10 2023-08-22T00:22:07.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1221d2f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1221d2f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47666/0 (socket says 172.21.15.98:47666) 2023-08-22T00:22:07.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1221d2f700 1 -- 172.21.15.98:0/2285211176 learned_addr learned my addr 172.21.15.98:0/2285211176 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:07.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f122152e700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f121c0a8b10 0x7f121c14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.626+0000 7f1222530700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 0x7f121c14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 -- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f121c0a8b10 msgr2=0x7f121c14d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f121c0a8b10 0x7f121c14d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 -- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 msgr2=0x7f121c14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 0x7f121c14df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 -- 172.21.15.98:0/2285211176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0abb20 con 0x7f12080049f0 2023-08-22T00:22:07.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1222530700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 0x7f121c14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:07.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1221d2f700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f1218001940 tx=0x7f1218015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180074b0 con 0x7f12080049f0 2023-08-22T00:22:07.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218007610 con 0x7f12080049f0 2023-08-22T00:22:07.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c1508c0 con 0x7f12080049f0 2023-08-22T00:22:07.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180048e0 con 0x7f12080049f0 2023-08-22T00:22:07.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.627+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c0abe00 con 0x7f12080049f0 2023-08-22T00:22:07.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.628+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c067d20 con 0x7f12080049f0 2023-08-22T00:22:07.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.628+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f121801c020 con 0x7f12080049f0 2023-08-22T00:22:07.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.629+0000 7f1211ffb700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 0x7f1200061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.629+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f121807a250 con 0x7f12080049f0 2023-08-22T00:22:07.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.629+0000 7f122152e700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 0x7f1200061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.629+0000 7f122152e700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 0x7f1200061300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f121c153a50 tx=0x7f120c009060).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.633+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f121804b560 con 0x7f12080049f0 2023-08-22T00:22:07.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.820+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f121c151050 con 0x7f120005ee40 2023-08-22T00:22:07.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.821+0000 7f1211ffb700 1 -- 172.21.15.98:0/2285211176 <== mgr.6729 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f120c019070 con 0x7f120005ee40 2023-08-22T00:22:07.822 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:22:07.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:07.823 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:22:07.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:07.824 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:22:07.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 msgr2=0x7f1200061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 0x7f1200061300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f121c153a50 tx=0x7f120c009060).stop 2023-08-22T00:22:07.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 msgr2=0x7f121c0ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f1218001940 tx=0x7f1218015000).stop 2023-08-22T00:22:07.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 shutdown_connections 2023-08-22T00:22:07.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121c14dad0 0x7f121c14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12080049f0 0x7f121c0ab570 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f120005ee40 0x7f1200061300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 --2- 172.21.15.98:0/2285211176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f121c0a8b10 0x7f121c14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 >> 172.21.15.98:0/2285211176 conn(0x7f121c0c3170 msgr2=0x7f121c14f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:07.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 shutdown_connections 2023-08-22T00:22:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.823+0000 7f1223f93700 1 -- 172.21.15.98:0/2285211176 wait complete. 2023-08-22T00:22:07.836 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:22:07.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.952+0000 7f0fb9417700 1 Processor -- start 2023-08-22T00:22:07.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.952+0000 7f0fb9417700 1 -- start start 2023-08-22T00:22:07.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb9417700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0fb40bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb9417700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0fb40c4390 0x7f0fb4153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb9417700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40c3f00 con 0x7f0fb4153cf0 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb9417700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40c47f0 con 0x7f0fb40c4390 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb9417700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c32f0 con 0x7f0fb40bea40 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb37fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0fb4153cf0 0x7f0fb4068910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38364/0 (socket says 172.21.15.98:38364) 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.953+0000 7f0fb37fe700 1 -- 172.21.15.98:0/2961453204 learned_addr learned my addr 172.21.15.98:0/2961453204 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0fb40bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb27fc700 1 --2- 172.21.15.98:0/2961453204 >> v2:172.21.15.118:3300/0 conn(0x7f0fb40c4390 0x7f0fb4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121447733 0 0) 0x7f0fb40c3f00 con 0x7f0fb4153cf0 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c0033f0 con 0x7f0fb4153cf0 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 648011274 0 0) 0x7f0f9c0033f0 con 0x7f0fb4153cf0 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 msgr2=0x7f0fb40bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0fb40bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 >> v2:172.21.15.118:3300/0 conn(0x7f0fb40c4390 msgr2=0x7f0fb4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 --2- 172.21.15.98:0/2961453204 >> v2:172.21.15.118:3300/0 conn(0x7f0fb40c4390 0x7f0fb4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40c35d0 con 0x7f0fb4153cf0 2023-08-22T00:22:07.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f0fac0017f0 con 0x7f0fb4153cf0 2023-08-22T00:22:07.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 >> v1:172.21.15.98:6789/0 conn(0x7f0fb4153cf0 legacy=0x7f0fb4068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f9c0038e0 0x7f0f9c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0f9c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f9c004b80 0x7f0f9c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c47f0 con 0x7f0f9c004b80 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c32f0 con 0x7f0f9c0038e0 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c00b8e0 con 0x7f0fb40bea40 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f9c004b80 0x7f0f9c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb27fc700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0f9c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f9c0038e0 0x7f0f9c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 -- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 msgr2=0x7f0f9c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40bea40 0x7f0f9c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 -- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f9c0038e0 msgr2=0x7f0f9c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f9c0038e0 0x7f0f9c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 -- 172.21.15.98:0/2961453204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0033f0 con 0x7f0f9c004b80 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f9c0038e0 0x7f0f9c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb37fe700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f9c004b80 0x7f0f9c005000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f0fac00c530 tx=0x7f0fac001d90).ready entity=mon.0 client_cookie=df1560a4eca5d403 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.954+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00ce60 con 0x7f0f9c004b80 2023-08-22T00:22:07.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac005b20 con 0x7f0f9c004b80 2023-08-22T00:22:07.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb1ffb700 1 -- 172.21.15.98:0/2961453204 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0070d0 con 0x7f0f9c004b80 2023-08-22T00:22:07.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 -- 172.21.15.98:0/2961453204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f9c004b80 msgr2=0x7f0f9c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 --2- 172.21.15.98:0/2961453204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f9c004b80 0x7f0f9c005000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f0fac00c530 tx=0x7f0fac001d90).stop 2023-08-22T00:22:07.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb37fe700 1 -- 172.21.15.98:0/2961453204 reap_dead start 2023-08-22T00:22:07.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 -- 172.21.15.98:0/2961453204 shutdown_connections 2023-08-22T00:22:07.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 -- 172.21.15.98:0/2961453204 >> 172.21.15.98:0/2961453204 conn(0x7f0fb40c5e80 msgr2=0x7f0fb40661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:07.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 -- 172.21.15.98:0/2961453204 shutdown_connections 2023-08-22T00:22:07.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.955+0000 7f0fb9417700 1 -- 172.21.15.98:0/2961453204 wait complete. 2023-08-22T00:22:07.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.956+0000 7f0fb9417700 1 Processor -- start 2023-08-22T00:22:07.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.956+0000 7f0fb9417700 1 -- start start 2023-08-22T00:22:07.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb40a7380 0x7f0fb40a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40a88e0 0x7f0fb4148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40a8d40 con 0x7f0fb40adbb0 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40a3e00 con 0x7f0fb40a7380 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb9417700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40a6ef0 con 0x7f0fb40a88e0 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47676/0 (socket says 172.21.15.98:47676) 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb2ffd700 1 -- 172.21.15.98:0/3202169874 learned_addr learned my addr 172.21.15.98:0/3202169874 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb27fc700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb40a7380 0x7f0fb40a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb37fe700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40a88e0 0x7f0fb4148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb2ffd700 1 -- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40a88e0 msgr2=0x7f0fb4148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.957+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40a88e0 0x7f0fb4148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb2ffd700 1 -- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb40a7380 msgr2=0x7f0fb40a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:07.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb40a7380 0x7f0fb40a83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb2ffd700 1 -- 172.21.15.98:0/3202169874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40a8f60 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb2ffd700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f0fa8011760 tx=0x7f0fa8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8013620 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8013780 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8013b00 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40a9240 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.958+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40a67a0 con 0x7f0fb40adbb0 2023-08-22T00:22:07.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.959+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb40a69c0 con 0x7f0fb40adbb0 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.959+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 35) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0fa8015480 con 0x7f0fb40adbb0 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.959+0000 7f0f9affd700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 0x7f0fa00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.960+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0fa807a5a0 con 0x7f0fb40adbb0 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.960+0000 7f0fb27fc700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 0x7f0fa00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.960+0000 7f0fb27fc700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 0x7f0fa00612d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0fb4152b50 tx=0x7f0fa4009060).ready entity=mgr.6729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:07.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:07.964+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fa804b850 con 0x7f0fb40adbb0 2023-08-22T00:22:08.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.169+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0fb40c38b0 con 0x7f0fb40adbb0 2023-08-22T00:22:08.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.742+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 36) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f0fa8078210 con 0x7f0fb40adbb0 2023-08-22T00:22:08.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.744+0000 7f0f9affd700 1 -- 172.21.15.98:0/3202169874 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v36) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0fa8070780 con 0x7f0fb40adbb0 2023-08-22T00:22:08.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 msgr2=0x7f0fa00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 0x7f0fa00612d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0fb4152b50 tx=0x7f0fa4009060).stop 2023-08-22T00:22:08.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 msgr2=0x7f0fb40adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f0fa8011760 tx=0x7f0fa8008040).stop 2023-08-22T00:22:08.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 shutdown_connections 2023-08-22T00:22:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0fa005ee10 0x7f0fa00612d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fb40a88e0 0x7f0fb4148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fb40adbb0 0x7f0fb40adf90 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 --2- 172.21.15.98:0/3202169874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb40a7380 0x7f0fb40a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 >> 172.21.15.98:0/3202169874 conn(0x7f0fb40c5e80 msgr2=0x7f0fb40c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 shutdown_connections 2023-08-22T00:22:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.746+0000 7f0fb9417700 1 -- 172.21.15.98:0/3202169874 wait complete. 2023-08-22T00:22:08.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:22:08.885 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:08.884+0000 7f47c1b1b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:08.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.889+0000 7fa6dd424700 1 Processor -- start 2023-08-22T00:22:08.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.889+0000 7fa6dd424700 1 -- start start 2023-08-22T00:22:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6dd424700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 0x7fa6d80630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6dd424700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d81524c0 con 0x7fa6d80c2410 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6dd424700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8063c50 con 0x7fa6d80635d0 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6dd424700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8063a50 con 0x7fa6d8152c30 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6d77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa6d80c2410 0x7fa6d8065fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38366/0 (socket says 172.21.15.98:38366) 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6d77fe700 1 -- 172.21.15.98:0/1572146426 learned_addr learned my addr 172.21.15.98:0/1572146426 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.890+0000 7fa6d6ffd700 1 --2- 172.21.15.98:0/1572146426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 0x7fa6d80630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954510537 0 0) 0x7fa6d81524c0 con 0x7fa6d80c2410 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00033f0 con 0x7fa6d80c2410 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207845911 0 0) 0x7fa6d8063c50 con 0x7fa6d80635d0 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d81524c0 con 0x7fa6d80635d0 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d6ffd700 1 -- 172.21.15.98:0/1572146426 >> v1:172.21.15.118:6789/0 conn(0x7fa6d80635d0 legacy=0x7fa6d80c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d6ffd700 1 -- 172.21.15.98:0/1572146426 >> v1:172.21.15.98:6789/0 conn(0x7fa6d80c2410 legacy=0x7fa6d8065fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d6ffd700 1 -- 172.21.15.98:0/1572146426 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8063f30 con 0x7fa6d8152c30 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d6ffd700 1 --2- 172.21.15.98:0/1572146426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 0x7fa6d80630e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa6c8009790 tx=0x7fa6c8009060).ready entity=mon.2 client_cookie=a38412df59d84660 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800f510 con 0x7fa6d8152c30 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800f670 con 0x7fa6d8152c30 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.891+0000 7fa6d5ffb700 1 -- 172.21.15.98:0/1572146426 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800f9f0 con 0x7fa6d8152c30 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 -- 172.21.15.98:0/1572146426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 msgr2=0x7fa6d80630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 --2- 172.21.15.98:0/1572146426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 0x7fa6d80630e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa6c8009790 tx=0x7fa6c8009060).stop 2023-08-22T00:22:08.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 -- 172.21.15.98:0/1572146426 shutdown_connections 2023-08-22T00:22:08.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 --2- 172.21.15.98:0/1572146426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d8152c30 0x7fa6d80630e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 -- 172.21.15.98:0/1572146426 >> 172.21.15.98:0/1572146426 conn(0x7fa6d80c3a60 msgr2=0x7fa6d80c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:08.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 -- 172.21.15.98:0/1572146426 shutdown_connections 2023-08-22T00:22:08.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.892+0000 7fa6dd424700 1 -- 172.21.15.98:0/1572146426 wait complete. 2023-08-22T00:22:08.898 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:08.893+0000 7fab47cdd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:08.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.893+0000 7fa6dd424700 1 Processor -- start 2023-08-22T00:22:08.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.893+0000 7fa6dd424700 1 -- start start 2023-08-22T00:22:08.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 0x7fa6d80a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 0x7fa6d813ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8149080 con 0x7fa6d8152c30 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80a93f0 con 0x7fa6d80635d0 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6dd424700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80a8560 con 0x7fa6d80c2410 2023-08-22T00:22:08.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47700/0 (socket says 172.21.15.98:47700) 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 -- 172.21.15.98:0/428308624 learned_addr learned my addr 172.21.15.98:0/428308624 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d6ffd700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 0x7fa6d80a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d67fc700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 0x7fa6d813ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 -- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 msgr2=0x7fa6d813ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 0x7fa6d813ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 -- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 msgr2=0x7fa6d80a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:08.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 0x7fa6d80a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:08.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 -- 172.21.15.98:0/428308624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80092a0 con 0x7fa6d8152c30 2023-08-22T00:22:08.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d6ffd700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 0x7fa6d80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:08.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d67fc700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 0x7fa6d813ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:08.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6d77fe700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fa6d0001460 tx=0x7fa6d0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:08.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.894+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0005d30 con 0x7fa6d8152c30 2023-08-22T00:22:08.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.895+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0005e90 con 0x7fa6d8152c30 2023-08-22T00:22:08.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.895+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007320 con 0x7fa6d8152c30 2023-08-22T00:22:08.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.895+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d80a87e0 con 0x7fa6d8152c30 2023-08-22T00:22:08.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.895+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80a8da0 con 0x7fa6d8152c30 2023-08-22T00:22:08.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d80a9580 con 0x7fa6d8152c30 2023-08-22T00:22:08.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 36) v1 ==== 75289+0+0 (secure 0 0 0) 0x7fa6d0007690 con 0x7fa6d8152c30 2023-08-22T00:22:08.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6beffd700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 0x7fa6c4061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:08.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6d6ffd700 1 -- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 msgr2=0x7fa6c4061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:08.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa6d0079870 con 0x7fa6d8152c30 2023-08-22T00:22:08.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.896+0000 7fa6d6ffd700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 0x7fa6c4061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:08.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:08.900+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6d004ab80 con 0x7fa6d8152c30 2023-08-22T00:22:08.949 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:08.948+0000 7f47c1b1b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:08.959 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:08.958+0000 7fab47cdd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:09.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.068+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fa6d8046c20 con 0x7fa6d8152c30 2023-08-22T00:22:09.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.071+0000 7fa6beffd700 1 -- 172.21.15.98:0/428308624 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa6d0018020 con 0x7fa6d8152c30 2023-08-22T00:22:09.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 msgr2=0x7fa6c4061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:09.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 0x7fa6c4061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 msgr2=0x7fa6d80aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fa6d0001460 tx=0x7fa6d0007f90).stop 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 shutdown_connections 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d8152c30 0x7fa6d80aac40 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6d80635d0 0x7fa6d80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa6c405ee60 0x7fa6c4061320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:09.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 --2- 172.21.15.98:0/428308624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6d80c2410 0x7fa6d813ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 >> 172.21.15.98:0/428308624 conn(0x7fa6d80c3a60 msgr2=0x7fa6d814b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:09.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 shutdown_connections 2023-08-22T00:22:09.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.073+0000 7fa6dd424700 1 -- 172.21.15.98:0/428308624 wait complete. 2023-08-22T00:22:09.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-22T00:22:09.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.209+0000 7f094daae700 1 Processor -- start 2023-08-22T00:22:09.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.209+0000 7f094daae700 1 -- start start 2023-08-22T00:22:09.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f094daae700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f09481519f0 0x7f09480be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f094daae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f094daae700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0948064050 con 0x7f0948064480 2023-08-22T00:22:09.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f094daae700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480bd6e0 con 0x7f09481519f0 2023-08-22T00:22:09.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f094daae700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480c4b30 con 0x7f09480c41c0 2023-08-22T00:22:09.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f09477fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f09481519f0 0x7f09480be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:09.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f0947fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0948064480 0x7f09480648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38368/0 (socket says 172.21.15.98:38368) 2023-08-22T00:22:09.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f0947fff700 1 -- 172.21.15.98:0/969649630 learned_addr learned my addr 172.21.15.98:0/969649630 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:09.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.210+0000 7f0946ffd700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:09.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09477fe700 1 -- 172.21.15.98:0/969649630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 msgr2=0x7f09480c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09477fe700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09477fe700 1 -- 172.21.15.98:0/969649630 >> v1:172.21.15.98:6789/0 conn(0x7f0948064480 legacy=0x7f09480648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09477fe700 1 -- 172.21.15.98:0/969649630 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480be590 con 0x7f09481519f0 2023-08-22T00:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09467fc700 1 -- 172.21.15.98:0/969649630 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383155688 0 0) 0x7f0948064050 con 0x7f0948064480 2023-08-22T00:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09477fe700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09481519f0 0x7f09480be0a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f0938009760 tx=0x7f0938009060).ready entity=mon.0 client_cookie=92b657503765d0ce server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09467fc700 1 -- 172.21.15.98:0/969649630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800f510 con 0x7f09481519f0 2023-08-22T00:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09467fc700 1 -- 172.21.15.98:0/969649630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800f670 con 0x7f09481519f0 2023-08-22T00:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f09467fc700 1 -- 172.21.15.98:0/969649630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800f9f0 con 0x7f09481519f0 2023-08-22T00:22:09.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f094daae700 1 -- 172.21.15.98:0/969649630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09481519f0 msgr2=0x7f09480be0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:09.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.211+0000 7f094daae700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09481519f0 0x7f09480be0a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f0938009760 tx=0x7f0938009060).stop 2023-08-22T00:22:09.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 -- 172.21.15.98:0/969649630 shutdown_connections 2023-08-22T00:22:09.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09481519f0 0x7f09480be0a0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 --2- 172.21.15.98:0/969649630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 -- 172.21.15.98:0/969649630 >> 172.21.15.98:0/969649630 conn(0x7f094806a910 msgr2=0x7f0948065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:09.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 -- 172.21.15.98:0/969649630 shutdown_connections 2023-08-22T00:22:09.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.212+0000 7f094daae700 1 -- 172.21.15.98:0/969649630 wait complete. 2023-08-22T00:22:09.223 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:09.222+0000 7f47c1b1b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:09.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.213+0000 7f094daae700 1 Processor -- start 2023-08-22T00:22:09.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.213+0000 7f094daae700 1 -- start start 2023-08-22T00:22:09.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948064480 0x7f09480a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09481519f0 0x7f094814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480a5c20 con 0x7f0948064480 2023-08-22T00:22:09.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094814fd30 con 0x7f09481519f0 2023-08-22T00:22:09.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480a5010 con 0x7f09480c41c0 2023-08-22T00:22:09.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948064480 0x7f09480a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:09.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948064480 0x7f09480a4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47716/0 (socket says 172.21.15.98:47716) 2023-08-22T00:22:09.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 -- 172.21.15.98:0/655325406 learned_addr learned my addr 172.21.15.98:0/655325406 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:09.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:09.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f0947fff700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09481519f0 0x7f094814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:09.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 msgr2=0x7f09480a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:09.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09480c41c0 0x7f09480a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09481519f0 msgr2=0x7f094814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09481519f0 0x7f094814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380092a0 con 0x7f0948064480 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f09477fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948064480 0x7f09480a4a50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f094805fca0 tx=0x7f0938017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800f7e0 con 0x7f0948064480 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800f940 con 0x7f0948064480 2023-08-22T00:22:09.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093801b690 con 0x7f0948064480 2023-08-22T00:22:09.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09480a52f0 con 0x7f0948064480 2023-08-22T00:22:09.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.214+0000 7f094daae700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09480a58b0 con 0x7f0948064480 2023-08-22T00:22:09.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.216+0000 7f094daae700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948047480 con 0x7f0948064480 2023-08-22T00:22:09.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.217+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 36) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f093801ba80 con 0x7f0948064480 2023-08-22T00:22:09.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.217+0000 7f092f7fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:09.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.217+0000 7f0946ffd700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:09.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.217+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f093807c200 con 0x7f0948064480 2023-08-22T00:22:09.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.217+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:09.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.221+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f093804d5b0 con 0x7f0948064480 2023-08-22T00:22:09.245 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:09.244+0000 7fab47cdd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:09.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.415+0000 7f094daae700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0948151dd0 con 0x7f093405ee30 2023-08-22T00:22:09.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.418+0000 7f0946ffd700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:09.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.418+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:09.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.819+0000 7f0946ffd700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:09.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:09.819+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:22:09.837 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:09.832+0000 7f47c1b1b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:09.868 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:09.857+0000 7fab47cdd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:09.906 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:09.904+0000 7f47c1b1b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:09.928 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:09.928+0000 7fab47cdd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:10.090 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.088+0000 7f47c1b1b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:10.113 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.113+0000 7fab47cdd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:10.508 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.506+0000 7f47c1b1b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:10.531 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.531+0000 7fab47cdd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:10.612 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.610+0000 7f47c1b1b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:10.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:10.620+0000 7f0946ffd700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:10.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:10.620+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:22:10.635 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.635+0000 7fab47cdd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:10.762 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.761+0000 7f47c1b1b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:10.787 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.786+0000 7fab47cdd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:10.838 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.836+0000 7f47c1b1b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:10.862 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.862+0000 7fab47cdd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:10.904 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:10.903+0000 7f47c1b1b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:10.929 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:10.929+0000 7fab47cdd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:11.159 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:11.157+0000 7f47c1b1b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:11.183 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:11.182+0000 7fab47cdd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:11.345 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:11.343+0000 7f47c1b1b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:11.368 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:11.368+0000 7fab47cdd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:11.994 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:11.992+0000 7f47c1b1b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:12.018 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.018+0000 7fab47cdd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:12.063 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.061+0000 7f47c1b1b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:12.087 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.087+0000 7fab47cdd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:12.137 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.136+0000 7f47c1b1b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:12.162 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.162+0000 7fab47cdd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:12.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:12.221+0000 7f0946ffd700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:12.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:12.221+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:22:12.285 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.283+0000 7f47c1b1b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:12.312 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.312+0000 7fab47cdd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:12.357 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.355+0000 7f47c1b1b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:12.386 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.386+0000 7fab47cdd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:12.470 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.468+0000 7f47c1b1b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:12.502 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.502+0000 7fab47cdd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:12.578 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.577+0000 7f47c1b1b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:12.610 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.610+0000 7fab47cdd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:12.867 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.866+0000 7f47c1b1b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:12.901 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.901+0000 7fab47cdd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:12.938 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:12.936+0000 7f47c1b1b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:12.972 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:12.972+0000 7fab47cdd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:12.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:12.991+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 37) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f0938079f10 con 0x7f0948064480 2023-08-22T00:22:12.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:12.992+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 msgr2=0x7f09340612f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:12.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:12.992+0000 7f092f7fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f09340612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:13.052 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac1f86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.053 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac1f86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.053 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac1f86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.053 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac1f86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.054 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac1f86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.054 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac4f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.054 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac4f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.054 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac4f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.055 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac4f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:13.055 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:13.052+0000 7faac4f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:14.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.012+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 38) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f093807a290 con 0x7f0948064480 2023-08-22T00:22:14.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.012+0000 7f092f7fe700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f0934061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.012+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0948151dd0 con 0x7f093405ee30 2023-08-22T00:22:14.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.014+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f0934061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.015+0000 7f0946ffd700 1 --2- 172.21.15.98:0/655325406 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f093405ee30 0x7f0934061270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f09480a4f40 tx=0x7f093c009060).ready entity=mgr.7137 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:14.018 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:14.018+0000 7faaf4a36700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-22T00:22:14.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.026+0000 7f092f7fe700 1 -- 172.21.15.98:0/655325406 <== mgr.7137 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f0948151dd0 con 0x7f093405ee30 2023-08-22T00:22:14.028 INFO:teuthology.orchestra.run.smithi098.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-22T00:22:14.032 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-22T00:22:14.033 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:22:14.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.156+0000 7fe2b6e6d700 1 Processor -- start 2023-08-22T00:22:14.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.156+0000 7fe2b6e6d700 1 -- start start 2023-08-22T00:22:14.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b6e6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b0153dd0 0x7fe2b00c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b6e6d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2b00c3230 0x7fe2b0064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b6e6d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b0158970 con 0x7fe2b0064600 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b6e6d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b0064ab0 con 0x7fe2b00c3230 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b6e6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c28b0 con 0x7fe2b0153dd0 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b540a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe2b0064600 0x7fe2b0066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36876/0 (socket says 172.21.15.98:36876) 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b540a700 1 -- 172.21.15.98:0/1356840570 learned_addr learned my addr 172.21.15.98:0/1356840570 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788296723 0 0) 0x7fe2b0158970 con 0x7fe2b0064600 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a00033f0 con 0x7fe2b0064600 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b0153dd0 0x7fe2b00c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> v2:172.21.15.118:3300/0 conn(0x7fe2b00c3230 0x7fe2b0064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804269290 0 0) 0x7fe2a00033f0 con 0x7fe2b0064600 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b0153dd0 msgr2=0x7fe2b00c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b0153dd0 0x7fe2b00c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 >> v2:172.21.15.118:3300/0 conn(0x7fe2b00c3230 msgr2=0x7fe2b0064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 --2- 172.21.15.98:0/1356840570 >> v2:172.21.15.118:3300/0 conn(0x7fe2b00c3230 0x7fe2b0064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0158690 con 0x7fe2b0064600 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe2a80017f0 con 0x7fe2b0064600 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> v2:172.21.15.118:3300/0 conn(0x7fe2b00c3230 0x7fe2b0064110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 >> v1:172.21.15.98:6789/0 conn(0x7fe2b0064600 legacy=0x7fe2b0066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.157+0000 7fe2af7fe700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a00038e0 0x7fe2a0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0004690 0x7fe2a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2a0005000 0x7fe2a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0064ab0 con 0x7fe2a0004690 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c28b0 con 0x7fe2a0005000 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a000bed0 con 0x7fe2a00038e0 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b0153dd0 0x7fe2b00c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0004690 0x7fe2a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2b540a700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2a0005000 0x7fe2a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a00038e0 0x7fe2a0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 -- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a00038e0 msgr2=0x7fe2a0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:14.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a00038e0 0x7fe2a0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 -- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2a0005000 msgr2=0x7fe2a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:14.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2a0005000 0x7fe2a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 -- 172.21.15.98:0/1356840570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00033f0 con 0x7fe2a0004690 2023-08-22T00:22:14.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2affff700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0004690 0x7fe2a0004b10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fe29c00bac0 tx=0x7fe29c008040).ready entity=mon.0 client_cookie=dbb7f67f2653f139 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:14.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00b400 con 0x7fe2a0004690 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00d5d0 con 0x7fe2a0004690 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.158+0000 7fe2af7fe700 1 -- 172.21.15.98:0/1356840570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00d950 con 0x7fe2a0004690 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/1356840570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0004690 msgr2=0x7fe2a0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/1356840570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0004690 0x7fe2a0004b10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fe29c00bac0 tx=0x7fe29c008040).stop 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b540a700 1 -- 172.21.15.98:0/1356840570 reap_dead start 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/1356840570 shutdown_connections 2023-08-22T00:22:14.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/1356840570 >> 172.21.15.98:0/1356840570 conn(0x7fe2b00c7820 msgr2=0x7fe2b00c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/1356840570 shutdown_connections 2023-08-22T00:22:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.159+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/1356840570 wait complete. 2023-08-22T00:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.160+0000 7fe2b6e6d700 1 Processor -- start 2023-08-22T00:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.160+0000 7fe2b6e6d700 1 -- start start 2023-08-22T00:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a0004690 0x7fe2b01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b00a9900 0x7fe2b00a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00a7840 con 0x7fe2b00abd90 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00aca70 con 0x7fe2b00a9900 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00acd50 con 0x7fe2a0004690 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58690/0 (socket says 172.21.15.98:58690) 2023-08-22T00:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 -- 172.21.15.98:0/3759135752 learned_addr learned my addr 172.21.15.98:0/3759135752 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2affff700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b00a9900 0x7fe2b00a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a0004690 0x7fe2b01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 -- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a0004690 msgr2=0x7fe2b01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a0004690 0x7fe2b01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 -- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b00a9900 msgr2=0x7fe2b00a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b00a9900 0x7fe2b00a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 -- 172.21.15.98:0/3759135752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00ad030 con 0x7fe2b00abd90 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b540a700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe2a8000f80 tx=0x7fe2a8002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8007990 con 0x7fe2b00abd90 2023-08-22T00:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8007de0 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00ad310 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800fdd0 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.161+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b00ac6e0 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.162+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b00a79f0 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.163+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fe2a8012560 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.163+0000 7fe2acff9700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 0x7fe294061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.163+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fe2a8079990 con 0x7fe2b00abd90 2023-08-22T00:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.163+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 0x7fe294061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.163+0000 7fe2b4c09700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 0x7fe294061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe2b0069670 tx=0x7fe2a4008040).ready entity=mgr.7137 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.167+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe2b00a79f0 con 0x7fe2b00abd90 2023-08-22T00:22:14.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:14.372+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe2b00c3d60 con 0x7fe2b00abd90 2023-08-22T00:22:15.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.019+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fe2a8077720 con 0x7fe2b00abd90 2023-08-22T00:22:15.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.020+0000 7fe2acff9700 1 -- 172.21.15.98:0/3759135752 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v39) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe2a80735f0 con 0x7fe2b00abd90 2023-08-22T00:22:15.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 msgr2=0x7fe294061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 0x7fe294061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe2b0069670 tx=0x7fe2a4008040).stop 2023-08-22T00:22:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 msgr2=0x7fe2b00ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe2a8000f80 tx=0x7fe2a8002210).stop 2023-08-22T00:22:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 shutdown_connections 2023-08-22T00:22:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe29405ed40 0x7fe294061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2a0004690 0x7fe2b01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2b00abd90 0x7fe2b00ac1f0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 --2- 172.21.15.98:0/3759135752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b00a9900 0x7fe2b00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 >> 172.21.15.98:0/3759135752 conn(0x7fe2b00c7820 msgr2=0x7fe2b014eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 shutdown_connections 2023-08-22T00:22:15.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.022+0000 7fe2b6e6d700 1 -- 172.21.15.98:0/3759135752 wait complete. 2023-08-22T00:22:15.038 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:22:15.038 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:22:15.083 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:22:15.134 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:22:15.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:22:15.135 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:22:15.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:15.163 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:15.162+0000 7fab67768680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:15.169 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:15.169+0000 7f84155f6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:15.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[152419]: fuse finished with error 0 and tester_r 0 2023-08-22T00:22:15.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:22:15.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:15.184 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:22:15.226 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:15.225+0000 7fab67768680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:15.239 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:15.238+0000 7f84155f6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:15.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:22:15.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:15.242 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:22:15.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:22:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:22:15.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:22:15.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:15.262 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:22:15.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:22:15.302 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:22:15.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:22:15.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:15.304 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:22:15.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:22:15.323 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:22:15.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:15.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.463+0000 7fce36c24700 1 Processor -- start 2023-08-22T00:22:15.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.463+0000 7fce36c24700 1 -- start start 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce36c24700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce3014bf70 0x7fce30152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce36c24700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 0x7fce301556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce36c24700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce30153080 con 0x7fce300c3740 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce36c24700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce30066510 con 0x7fce3014bf70 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce36c24700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300667b0 con 0x7fce3014c350 2023-08-22T00:22:15.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce3014bf70 0x7fce30152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce3014bf70 0x7fce30152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58722/0 (socket says 172.21.15.98:58722) 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 -- 172.21.15.98:0/1253279226 learned_addr learned my addr 172.21.15.98:0/1253279226 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce2ffff700 1 --2- 172.21.15.98:0/1253279226 >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 0x7fce301556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 -- 172.21.15.98:0/1253279226 >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 msgr2=0x7fce301556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 --2- 172.21.15.98:0/1253279226 >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 0x7fce301556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 -- 172.21.15.98:0/1253279226 >> v1:172.21.15.118:6789/0 conn(0x7fce300c3740 legacy=0x7fce300c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.464+0000 7fce349c0700 1 -- 172.21.15.98:0/1253279226 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30155ba0 con 0x7fce3014bf70 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce2ffff700 1 --2- 172.21.15.98:0/1253279226 >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 0x7fce301556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce349c0700 1 --2- 172.21.15.98:0/1253279226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014bf70 0x7fce30152b90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fce300c2df0 tx=0x7fce240090f0).ready entity=mon.0 client_cookie=13b96b25156d3d94 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce2f7fe700 1 -- 172.21.15.98:0/1253279226 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400b600 con 0x7fce3014bf70 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce2f7fe700 1 -- 172.21.15.98:0/1253279226 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400b760 con 0x7fce3014bf70 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce2f7fe700 1 -- 172.21.15.98:0/1253279226 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400bae0 con 0x7fce3014bf70 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 -- 172.21.15.98:0/1253279226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014bf70 msgr2=0x7fce30152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 --2- 172.21.15.98:0/1253279226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014bf70 0x7fce30152b90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fce300c2df0 tx=0x7fce240090f0).stop 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 -- 172.21.15.98:0/1253279226 shutdown_connections 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 --2- 172.21.15.98:0/1253279226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014bf70 0x7fce30152b90 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 --2- 172.21.15.98:0/1253279226 >> v2:172.21.15.118:3300/0 conn(0x7fce3014c350 0x7fce301556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 -- 172.21.15.98:0/1253279226 >> 172.21.15.98:0/1253279226 conn(0x7fce300c5dc0 msgr2=0x7fce30068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 -- 172.21.15.98:0/1253279226 shutdown_connections 2023-08-22T00:22:15.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.465+0000 7fce36c24700 1 -- 172.21.15.98:0/1253279226 wait complete. 2023-08-22T00:22:15.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.467+0000 7fce36c24700 1 Processor -- start 2023-08-22T00:22:15.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.467+0000 7fce36c24700 1 -- start start 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce300c3740 0x7fce300aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce3014bf70 0x7fce3014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3014e760 con 0x7fce3014c350 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3014ea40 con 0x7fce300c3740 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce36c24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3014ed20 con 0x7fce3014bf70 2023-08-22T00:22:15.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce349c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce300c3740 0x7fce300aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58732/0 (socket says 172.21.15.98:58732) 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 -- 172.21.15.98:0/1206078289 learned_addr learned my addr 172.21.15.98:0/1206078289 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce2ffff700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce3014bf70 0x7fce3014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce3014bf70 msgr2=0x7fce3014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce3014bf70 0x7fce3014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce300c3740 msgr2=0x7fce300aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:15.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce300c3740 0x7fce300aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.468+0000 7fce351c1700 1 -- 172.21.15.98:0/1206078289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24009370 con 0x7fce3014c350 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce351c1700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fce28001de0 tx=0x7fce28001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280103c0 con 0x7fce3014c350 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800d070 con 0x7fce3014c350 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3014f000 con 0x7fce3014c350 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800a590 con 0x7fce3014c350 2023-08-22T00:22:15.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.469+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce30148c10 con 0x7fce3014c350 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.470+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce30047480 con 0x7fce3014c350 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.470+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fce28017020 con 0x7fce3014c350 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.471+0000 7fce2cff9700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 0x7fce140614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.471+0000 7fce349c0700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 msgr2=0x7fce140614b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.471+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fce28015020 con 0x7fce3014c350 2023-08-22T00:22:15.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.471+0000 7fce349c0700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 0x7fce140614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:15.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.475+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce280478f0 con 0x7fce3014c350 2023-08-22T00:22:15.502 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:15.501+0000 7fab67768680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:15.530 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:15.530+0000 7f84155f6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:15.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.672+0000 7fce349c0700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 msgr2=0x7fce140614b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:15.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.672+0000 7fce349c0700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 0x7fce140614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:15.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.686+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce30155e00 con 0x7fce3014c350 2023-08-22T00:22:16.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.687+0000 7fce2cff9700 1 -- 172.21.15.98:0/1206078289 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fce2804a070 con 0x7fce3014c350 2023-08-22T00:22:16.192 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:16.110+0000 7fab67768680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:16.192 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:16.181+0000 7fab67768680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:16.193 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:22:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 msgr2=0x7fce140614b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 0x7fce140614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 msgr2=0x7fce30068630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fce28001de0 tx=0x7fce28001560).stop 2023-08-22T00:22:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 shutdown_connections 2023-08-22T00:22:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3014c350 0x7fce30068630 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce300c3740 0x7fce300aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fce1405eff0 0x7fce140614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 --2- 172.21.15.98:0/1206078289 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce3014bf70 0x7fce3014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 >> 172.21.15.98:0/1206078289 conn(0x7fce300c5dc0 msgr2=0x7fce300c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 shutdown_connections 2023-08-22T00:22:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:15.689+0000 7fce36c24700 1 -- 172.21.15.98:0/1206078289 wait complete. 2023-08-22T00:22:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:22:16.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:16.201 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:16.147+0000 7f84155f6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:16.219 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:16.219+0000 7f84155f6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:16.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.323+0000 7fd234171700 1 Processor -- start 2023-08-22T00:22:16.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.323+0000 7fd234171700 1 -- start start 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd234171700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd22c14c350 0x7fd22c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd234171700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c153080 con 0x7fd22c0c3e50 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd234171700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0667b0 con 0x7fd22c14bf70 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd234171700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c066510 con 0x7fd22c14c350 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23270e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd22c0c3e50 0x7fd22c0aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36882/0 (socket says 172.21.15.98:36882) 2023-08-22T00:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23270e700 1 -- 172.21.15.98:0/4002507812 learned_addr learned my addr 172.21.15.98:0/4002507812 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23170c700 1 --2- 172.21.15.98:0/4002507812 >> v2:172.21.15.118:3300/0 conn(0x7fd22c14c350 0x7fd22c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290574879 0 0) 0x7fd22c153080 con 0x7fd22c0c3e50 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2180033f0 con 0x7fd22c0c3e50 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525457482 0 0) 0x7fd22c0667b0 con 0x7fd22c14bf70 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c153080 con 0x7fd22c14bf70 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23170c700 1 -- 172.21.15.98:0/4002507812 >> v1:172.21.15.118:6789/0 conn(0x7fd22c14bf70 legacy=0x7fd22c0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23170c700 1 -- 172.21.15.98:0/4002507812 >> v1:172.21.15.98:6789/0 conn(0x7fd22c0c3e50 legacy=0x7fd22c0aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23170c700 1 -- 172.21.15.98:0/4002507812 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c155e00 con 0x7fd22c14c350 2023-08-22T00:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.324+0000 7fd23170c700 1 --2- 172.21.15.98:0/4002507812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c152b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fd21c009760 tx=0x7fd21c009060).ready entity=mon.1 client_cookie=a6fb1be443de7460 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00d4a0 con 0x7fd22c14c350 2023-08-22T00:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00d600 con 0x7fd22c14c350 2023-08-22T00:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd230f0b700 1 -- 172.21.15.98:0/4002507812 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00d980 con 0x7fd22c14c350 2023-08-22T00:22:16.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 -- 172.21.15.98:0/4002507812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 msgr2=0x7fd22c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 --2- 172.21.15.98:0/4002507812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c152b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fd21c009760 tx=0x7fd21c009060).stop 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 -- 172.21.15.98:0/4002507812 shutdown_connections 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 --2- 172.21.15.98:0/4002507812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c152b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 -- 172.21.15.98:0/4002507812 >> 172.21.15.98:0/4002507812 conn(0x7fd22c0c5dc0 msgr2=0x7fd22c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 -- 172.21.15.98:0/4002507812 shutdown_connections 2023-08-22T00:22:16.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.325+0000 7fd234171700 1 -- 172.21.15.98:0/4002507812 wait complete. 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.326+0000 7fd234171700 1 Processor -- start 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.326+0000 7fd234171700 1 -- start start 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd22c14bf70 0x7fd22c146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c0a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c147110 con 0x7fd22c0c3e50 2023-08-22T00:22:16.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1473f0 con 0x7fd22c14c350 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd234171700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1476d0 con 0x7fd22c14bf70 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd231f0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd231f0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58736/0 (socket says 172.21.15.98:58736) 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd231f0d700 1 -- 172.21.15.98:0/701495124 learned_addr learned my addr 172.21.15.98:0/701495124 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd23270e700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c0a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.327+0000 7fd23170c700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd22c14bf70 0x7fd22c146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 -- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd22c14bf70 msgr2=0x7fd22c146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd22c14bf70 0x7fd22c146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 -- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 msgr2=0x7fd22c0a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c0a87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 -- 172.21.15.98:0/701495124 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0092a0 con 0x7fd22c0c3e50 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd23270e700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c0a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd231f0d700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd22800c490 tx=0x7fd228007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800ce40 con 0x7fd22c0c3e50 2023-08-22T00:22:16.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800f470 con 0x7fd22c0c3e50 2023-08-22T00:22:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1479b0 con 0x7fd22c0c3e50 2023-08-22T00:22:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800f810 con 0x7fd22c0c3e50 2023-08-22T00:22:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.328+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c146520 con 0x7fd22c0c3e50 2023-08-22T00:22:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.329+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c147d00 con 0x7fd22c0c3e50 2023-08-22T00:22:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.330+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fd22800fbc0 con 0x7fd22c0c3e50 2023-08-22T00:22:16.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.330+0000 7fd221ffb700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 0x7fd210061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.330+0000 7fd23170c700 1 -- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 msgr2=0x7fd210061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:16.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.330+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fd2280797b0 con 0x7fd22c0c3e50 2023-08-22T00:22:16.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.330+0000 7fd23170c700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 0x7fd210061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:16.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.334+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd22804a810 con 0x7fd22c0c3e50 2023-08-22T00:22:16.369 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:16.367+0000 7fab67768680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:16.417 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:16.417+0000 7f84155f6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:16.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.503+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd22c047480 con 0x7fd22c0c3e50 2023-08-22T00:22:16.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.503+0000 7fd221ffb700 1 -- 172.21.15.98:0/701495124 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+17518 (secure 0 0 0) 0x7fd22804de30 con 0x7fd22c0c3e50 2023-08-22T00:22:16.505 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:16.505 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":106,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:12.985109+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1768314078":"2023-08-23T00:22:12.985066+0000","172.21.15.98:6832/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:0/151378610":"2023-08-23T00:22:12.985066+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 msgr2=0x7fd210061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 0x7fd210061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 msgr2=0x7fd22c146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd22800c490 tx=0x7fd228007c90).stop 2023-08-22T00:22:16.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 shutdown_connections 2023-08-22T00:22:16.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c14c350 0x7fd22c0a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c0c3e50 0x7fd22c146b30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd21005efc0 0x7fd210061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 --2- 172.21.15.98:0/701495124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd22c14bf70 0x7fd22c146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 >> 172.21.15.98:0/701495124 conn(0x7fd22c0c5dc0 msgr2=0x7fd22c0c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:16.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.505+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 shutdown_connections 2023-08-22T00:22:16.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.506+0000 7fd234171700 1 -- 172.21.15.98:0/701495124 wait complete. 2023-08-22T00:22:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:21:55.264170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:21:55.661161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:22:16.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:22:16.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.680+0000 7efcea643700 1 Processor -- start 2023-08-22T00:22:16.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.680+0000 7efcea643700 1 -- start start 2023-08-22T00:22:16.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efce414fd90 0x7efce40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efce4153010 0x7efce40a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce40c39d0 0x7efce40c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce41525d0 con 0x7efce4153010 2023-08-22T00:22:16.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce4152b80 con 0x7efce414fd90 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efcea643700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce40c4330 con 0x7efce40c39d0 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efce4153010 0x7efce40a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efce4153010 0x7efce40a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58740/0 (socket says 172.21.15.98:58740) 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 -- 172.21.15.98:0/2304869172 learned_addr learned my addr 172.21.15.98:0/2304869172 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce8be0700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce40c39d0 0x7efce40c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce3fff700 1 --2- 172.21.15.98:0/2304869172 >> v2:172.21.15.118:3300/0 conn(0x7efce414fd90 0x7efce40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 -- 172.21.15.98:0/2304869172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce40c39d0 msgr2=0x7efce40c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:16.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce40c39d0 0x7efce40c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 -- 172.21.15.98:0/2304869172 >> v2:172.21.15.118:3300/0 conn(0x7efce414fd90 msgr2=0x7efce40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 --2- 172.21.15.98:0/2304869172 >> v2:172.21.15.118:3300/0 conn(0x7efce414fd90 0x7efce40675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 -- 172.21.15.98:0/2304869172 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4067bd0 con 0x7efce4153010 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.681+0000 7efce37fe700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce4153010 0x7efce40a7c10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7efce4069c80 tx=0x7efcd80090f0).ready entity=mon.0 client_cookie=ad8c5d40fe4f80f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efce2ffd700 1 -- 172.21.15.98:0/2304869172 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80108a0 con 0x7efce4153010 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efce2ffd700 1 -- 172.21.15.98:0/2304869172 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8010a00 con 0x7efce4153010 2023-08-22T00:22:16.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efce2ffd700 1 -- 172.21.15.98:0/2304869172 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8010da0 con 0x7efce4153010 2023-08-22T00:22:16.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 -- 172.21.15.98:0/2304869172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce4153010 msgr2=0x7efce40a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce4153010 0x7efce40a7c10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7efce4069c80 tx=0x7efcd80090f0).stop 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 -- 172.21.15.98:0/2304869172 shutdown_connections 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce40c39d0 0x7efce40c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 --2- 172.21.15.98:0/2304869172 >> v2:172.21.15.118:3300/0 conn(0x7efce414fd90 0x7efce40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 --2- 172.21.15.98:0/2304869172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce4153010 0x7efce40a7c10 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 -- 172.21.15.98:0/2304869172 >> 172.21.15.98:0/2304869172 conn(0x7efce40c8950 msgr2=0x7efce40c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 -- 172.21.15.98:0/2304869172 shutdown_connections 2023-08-22T00:22:16.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.682+0000 7efcea643700 1 -- 172.21.15.98:0/2304869172 wait complete. 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.683+0000 7efcea643700 1 Processor -- start 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 -- start start 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 0x7efce414cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce4153010 0x7efce414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40644d0 con 0x7efce40c39d0 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce4063ec0 con 0x7efce414fd90 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efcea643700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce414d410 con 0x7efce4153010 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efce3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.684+0000 7efce3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58750/0 (socket says 172.21.15.98:58750) 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 -- 172.21.15.98:0/3850067797 learned_addr learned my addr 172.21.15.98:0/3850067797 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce37fe700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 0x7efce414cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce8be0700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce4153010 0x7efce414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 -- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce4153010 msgr2=0x7efce414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce4153010 0x7efce414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 -- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 msgr2=0x7efce414cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 0x7efce414cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 -- 172.21.15.98:0/3850067797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009370 con 0x7efce40c39d0 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce37fe700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 0x7efce414cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efce3fff700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7efcd400e930 tx=0x7efcd4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4012600 con 0x7efce40c39d0 2023-08-22T00:22:16.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4012760 con 0x7efce40c39d0 2023-08-22T00:22:16.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce4064160 con 0x7efce40c39d0 2023-08-22T00:22:16.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4012ae0 con 0x7efce40c39d0 2023-08-22T00:22:16.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.685+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce414d6f0 con 0x7efce40c39d0 2023-08-22T00:22:16.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.686+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4067eb0 con 0x7efce40c39d0 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.687+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7efcd4025480 con 0x7efce40c39d0 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.687+0000 7efccbfff700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 0x7efcd0061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.687+0000 7efce37fe700 1 -- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 msgr2=0x7efcd0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.687+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7efcd407ab70 con 0x7efce40c39d0 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.687+0000 7efce37fe700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 0x7efcd0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:16.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.691+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efcd404bbf0 con 0x7efce40c39d0 2023-08-22T00:22:16.787 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:16.785+0000 7fab67768680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:16.857 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:16.857+0000 7f84155f6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:16.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.859+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efce4046c20 con 0x7efce40c39d0 2023-08-22T00:22:16.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.859+0000 7efccbfff700 1 -- 172.21.15.98:0/3850067797 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v106) v1 ==== 110+0+10 (secure 0 0 0) 0x7efcd404f210 con 0x7efce40c39d0 2023-08-22T00:22:16.859 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:22:16.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 msgr2=0x7efcd0061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:16.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 0x7efcd0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 msgr2=0x7efce4066c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7efcd400e930 tx=0x7efcd4009060).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 shutdown_connections 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efcd005efc0 0x7efcd0061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efce4153010 0x7efce414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efce40c39d0 0x7efce4066c60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 --2- 172.21.15.98:0/3850067797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efce414fd90 0x7efce414cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 >> 172.21.15.98:0/3850067797 conn(0x7efce40c8950 msgr2=0x7efce41513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:16.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 shutdown_connections 2023-08-22T00:22:16.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.861+0000 7efcea643700 1 -- 172.21.15.98:0/3850067797 wait complete. 2023-08-22T00:22:16.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:22:16.889 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:16.888+0000 7fab67768680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:16.968 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:16.968+0000 7f84155f6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:16.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.994+0000 7fc3f0286700 1 Processor -- start 2023-08-22T00:22:16.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.994+0000 7fc3f0286700 1 -- start start 2023-08-22T00:22:16.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3f0286700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3e8062600 0x7fc3e8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3f0286700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3e8063b10 0x7fc3e80acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3f0286700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e81541c0 con 0x7fc3e8157ab0 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3f0286700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80ca860 con 0x7fc3e8063b10 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3f0286700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e8063fc0 con 0x7fc3e8062600 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3e8063b10 0x7fc3e80acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3e8063b10 0x7fc3e80acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58760/0 (socket says 172.21.15.98:58760) 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 -- 172.21.15.98:0/1696544819 learned_addr learned my addr 172.21.15.98:0/1696544819 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ed821700 1 --2- 172.21.15.98:0/1696544819 >> v2:172.21.15.118:3300/0 conn(0x7fc3e8062600 0x7fc3e8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 -- 172.21.15.98:0/1696544819 >> v2:172.21.15.118:3300/0 conn(0x7fc3e8062600 msgr2=0x7fc3e8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 --2- 172.21.15.98:0/1696544819 >> v2:172.21.15.118:3300/0 conn(0x7fc3e8062600 0x7fc3e8157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 -- 172.21.15.98:0/1696544819 >> v1:172.21.15.118:6789/0 conn(0x7fc3e8157ab0 legacy=0x7fc3e80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 -- 172.21.15.98:0/1696544819 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8062a90 con 0x7fc3e8063b10 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ee823700 1 --2- 172.21.15.98:0/1696544819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e80acbf0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fc3e80c6450 tx=0x7fc3e0009840).ready entity=mon.0 client_cookie=14219a8e83cdeefe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ed020700 1 -- 172.21.15.98:0/1696544819 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000e070 con 0x7fc3e8063b10 2023-08-22T00:22:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ed020700 1 -- 172.21.15.98:0/1696544819 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000ba20 con 0x7fc3e8063b10 2023-08-22T00:22:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.996+0000 7fc3ed020700 1 -- 172.21.15.98:0/1696544819 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000bda0 con 0x7fc3e8063b10 2023-08-22T00:22:17.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 -- 172.21.15.98:0/1696544819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 msgr2=0x7fc3e80acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 --2- 172.21.15.98:0/1696544819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e80acbf0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fc3e80c6450 tx=0x7fc3e0009840).stop 2023-08-22T00:22:17.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 -- 172.21.15.98:0/1696544819 shutdown_connections 2023-08-22T00:22:17.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 --2- 172.21.15.98:0/1696544819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e80acbf0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 --2- 172.21.15.98:0/1696544819 >> v2:172.21.15.118:3300/0 conn(0x7fc3e8062600 0x7fc3e8157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 -- 172.21.15.98:0/1696544819 >> 172.21.15.98:0/1696544819 conn(0x7fc3e80cb600 msgr2=0x7fc3e80c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 -- 172.21.15.98:0/1696544819 shutdown_connections 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.997+0000 7fc3f0286700 1 -- 172.21.15.98:0/1696544819 wait complete. 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.999+0000 7fc3f0286700 1 Processor -- start 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:16.999+0000 7fc3f0286700 1 -- start start 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3e8157ab0 0x7fc3e80c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3e80c20c0 0x7fc3e80c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80b0aa0 con 0x7fc3e8063b10 2023-08-22T00:22:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81551e0 con 0x7fc3e8157ab0 2023-08-22T00:22:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3f0286700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c2a10 con 0x7fc3e80c20c0 2023-08-22T00:22:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58772/0 (socket says 172.21.15.98:58772) 2023-08-22T00:22:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 -- 172.21.15.98:0/3867151450 learned_addr learned my addr 172.21.15.98:0/3867151450 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ed821700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3e8157ab0 0x7fc3e80c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee823700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3e80c20c0 0x7fc3e80c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 -- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3e80c20c0 msgr2=0x7fc3e80c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3e80c20c0 0x7fc3e80c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 -- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3e8157ab0 msgr2=0x7fc3e80c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3e8157ab0 0x7fc3e80c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 -- 172.21.15.98:0/3867151450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009ae0 con 0x7fc3e8063b10 2023-08-22T00:22:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.000+0000 7fc3ee022700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fc3e400c520 tx=0x7fc3e4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.001+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400ce50 con 0x7fc3e8063b10 2023-08-22T00:22:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.001+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4001e90 con 0x7fc3e8063b10 2023-08-22T00:22:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.001+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80b07c0 con 0x7fc3e8063b10 2023-08-22T00:22:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.001+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4007250 con 0x7fc3e8063b10 2023-08-22T00:22:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.001+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e8154e70 con 0x7fc3e8063b10 2023-08-22T00:22:17.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.002+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8083670 con 0x7fc3e8063b10 2023-08-22T00:22:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.002+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fc3e40066a0 con 0x7fc3e8063b10 2023-08-22T00:22:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.002+0000 7fc3de7fc700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 0x7fc3cc061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.003+0000 7fc3ed821700 1 -- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 msgr2=0x7fc3cc061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.003+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fc3e4079b00 con 0x7fc3e8063b10 2023-08-22T00:22:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.003+0000 7fc3ed821700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 0x7fc3cc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.006+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3e404ab60 con 0x7fc3e8063b10 2023-08-22T00:22:17.041 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:17.040+0000 7fab67768680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:17.116 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:17.114+0000 7fab67768680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:17.131 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:17.131+0000 7f84155f6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:17.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.174+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3e8046c20 con 0x7fc3e8063b10 2023-08-22T00:22:17.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.174+0000 7fc3de7fc700 1 -- 172.21.15.98:0/3867151450 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3e404e180 con 0x7fc3e8063b10 2023-08-22T00:22:17.175 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:22:17.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 msgr2=0x7fc3cc061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:17.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 0x7fc3cc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 msgr2=0x7fc3e81639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fc3e400c520 tx=0x7fc3e4007e00).stop 2023-08-22T00:22:17.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 shutdown_connections 2023-08-22T00:22:17.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc3cc05efc0 0x7fc3cc061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3e80c20c0 0x7fc3e80c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3e8063b10 0x7fc3e81639f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 --2- 172.21.15.98:0/3867151450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3e8157ab0 0x7fc3e80c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 >> 172.21.15.98:0/3867151450 conn(0x7fc3e80cb600 msgr2=0x7fc3e80aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 shutdown_connections 2023-08-22T00:22:17.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.176+0000 7fc3f0286700 1 -- 172.21.15.98:0/3867151450 wait complete. 2023-08-22T00:22:17.183 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:17.181+0000 7fab67768680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:17.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:22:17.210 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:17.210+0000 7f84155f6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:17.282 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:17.282+0000 7f84155f6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.312+0000 7f37d8bd7700 1 Processor -- start 2023-08-22T00:22:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.312+0000 7f37d8bd7700 1 -- start start 2023-08-22T00:22:17.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d8bd7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 0x7f37d4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d8bd7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f37d41550a0 0x7f37d40c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d8bd7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d40654c0 con 0x7f37d40c3d90 2023-08-22T00:22:17.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d8bd7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d40be6e0 con 0x7f37d41550a0 2023-08-22T00:22:17.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d8bd7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d40be120 con 0x7f37d41508b0 2023-08-22T00:22:17.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f37d41550a0 0x7f37d40c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d2d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f37d40c3d90 0x7f37d40a6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36892/0 (socket says 172.21.15.98:36892) 2023-08-22T00:22:17.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d2d9d700 1 -- 172.21.15.98:0/1208840965 learned_addr learned my addr 172.21.15.98:0/1208840965 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1208840965 >> v2:172.21.15.98:3300/0 conn(0x7f37d41550a0 0x7f37d40c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58788/0 (socket says 172.21.15.98:58788) 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d259c700 1 --2- 172.21.15.98:0/1208840965 >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 0x7f37d4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1208840965 >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 msgr2=0x7f37d4150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1208840965 >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 0x7f37d4150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d159a700 1 -- 172.21.15.98:0/1208840965 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268615957 0 0) 0x7f37d40654c0 con 0x7f37d40c3d90 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1208840965 >> v1:172.21.15.98:6789/0 conn(0x7f37d40c3d90 legacy=0x7f37d40a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1208840965 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40be400 con 0x7f37d41550a0 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d259c700 1 --2- 172.21.15.98:0/1208840965 >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 0x7f37d4150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1208840965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41550a0 0x7f37d40c38a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f37d40c5330 tx=0x7f37c8009060).ready entity=mon.0 client_cookie=4102ca7eb86e8d59 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d159a700 1 -- 172.21.15.98:0/1208840965 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80090d0 con 0x7f37d41550a0 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d159a700 1 -- 172.21.15.98:0/1208840965 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c800f510 con 0x7f37d41550a0 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.313+0000 7f37d159a700 1 -- 172.21.15.98:0/1208840965 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800f890 con 0x7f37d41550a0 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1208840965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41550a0 msgr2=0x7f37d40c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1208840965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41550a0 0x7f37d40c38a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f37d40c5330 tx=0x7f37c8009060).stop 2023-08-22T00:22:17.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1208840965 shutdown_connections 2023-08-22T00:22:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1208840965 >> v2:172.21.15.118:3300/0 conn(0x7f37d41508b0 0x7f37d4150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1208840965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41550a0 0x7f37d40c38a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1208840965 >> 172.21.15.98:0/1208840965 conn(0x7f37d40c7820 msgr2=0x7f37d40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1208840965 shutdown_connections 2023-08-22T00:22:17.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.314+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1208840965 wait complete. 2023-08-22T00:22:17.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.316+0000 7f37d8bd7700 1 Processor -- start 2023-08-22T00:22:17.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.316+0000 7f37d8bd7700 1 -- start start 2023-08-22T00:22:17.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37d40c3d90 0x7f37d40ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37d41550a0 0x7f37d414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40acb70 con 0x7f37d41508b0 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d41527f0 con 0x7f37d40c3d90 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40ad5f0 con 0x7f37d41550a0 2023-08-22T00:22:17.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58796/0 (socket says 172.21.15.98:58796) 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1426659475 learned_addr learned my addr 172.21.15.98:0/1426659475 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d2d9d700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37d41550a0 0x7f37d414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d259c700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37d40c3d90 0x7f37d40ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37d41550a0 msgr2=0x7f37d414a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37d41550a0 0x7f37d414a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37d40c3d90 msgr2=0x7f37d40ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37d40c3d90 0x7f37d40ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 -- 172.21.15.98:0/1426659475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40092a0 con 0x7f37d41508b0 2023-08-22T00:22:17.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d1d9b700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f37c8009dd0 tx=0x7f37c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800f890 con 0x7f37d41508b0 2023-08-22T00:22:17.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8006950 con 0x7f37d41508b0 2023-08-22T00:22:17.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c80092a0 con 0x7f37d41508b0 2023-08-22T00:22:17.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800fea0 con 0x7f37d41508b0 2023-08-22T00:22:17.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.317+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d4152ab0 con 0x7f37d41508b0 2023-08-22T00:22:17.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.318+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d40a7920 con 0x7f37d41508b0 2023-08-22T00:22:17.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.319+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f37c801b620 con 0x7f37d41508b0 2023-08-22T00:22:17.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.319+0000 7f37c27fc700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 0x7f37b4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.319+0000 7f37d259c700 1 -- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 msgr2=0x7f37b4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:17.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.319+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f37c807b7d0 con 0x7f37d41508b0 2023-08-22T00:22:17.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.319+0000 7f37d259c700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 0x7f37b4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:17.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.323+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37c804c6d0 con 0x7f37d41508b0 2023-08-22T00:22:17.440 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:17.439+0000 7fab67768680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:17.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.492+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37d40ad450 con 0x7f37d41508b0 2023-08-22T00:22:17.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.492+0000 7f37c27fc700 1 -- 172.21.15.98:0/1426659475 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37c8028020 con 0x7f37d41508b0 2023-08-22T00:22:17.494 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:22:17.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 msgr2=0x7f37b4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:17.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 0x7f37b4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 msgr2=0x7f37d40a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f37c8009dd0 tx=0x7f37c8017000).stop 2023-08-22T00:22:17.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 shutdown_connections 2023-08-22T00:22:17.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f37b405efc0 0x7f37b4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37d41550a0 0x7f37d414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37d40c3d90 0x7f37d40ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 --2- 172.21.15.98:0/1426659475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37d41508b0 0x7f37d40a7430 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 >> 172.21.15.98:0/1426659475 conn(0x7f37d40c7820 msgr2=0x7f37d414d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 shutdown_connections 2023-08-22T00:22:17.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.494+0000 7f37d8bd7700 1 -- 172.21.15.98:0/1426659475 wait complete. 2023-08-22T00:22:17.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:22:17.549 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:17.548+0000 7f84155f6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:17.625 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:17.623+0000 7fab67768680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:17.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.670+0000 7fd2ebe53700 1 Processor -- start 2023-08-22T00:22:17.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.670+0000 7fd2ebe53700 1 -- start start 2023-08-22T00:22:17.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ebe53700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd2e414e720 0x7fd2e4155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ebe53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 0x7fd2e40c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ebe53700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e40654a0 con 0x7fd2e40641b0 2023-08-22T00:22:17.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ebe53700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4064660 con 0x7fd2e414e720 2023-08-22T00:22:17.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ebe53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4064920 con 0x7fd2e4067d00 2023-08-22T00:22:17.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2e9bef700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd2e414e720 0x7fd2e4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2e9bef700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd2e414e720 0x7fd2e4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58810/0 (socket says 172.21.15.98:58810) 2023-08-22T00:22:17.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2e9bef700 1 -- 172.21.15.98:0/495484752 learned_addr learned my addr 172.21.15.98:0/495484752 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.671+0000 7fd2ea3f0700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 0x7fd2e40c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e9bef700 1 -- 172.21.15.98:0/495484752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 msgr2=0x7fd2e40c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:17.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e9bef700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 0x7fd2e40c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e9bef700 1 -- 172.21.15.98:0/495484752 >> v1:172.21.15.118:6789/0 conn(0x7fd2e40641b0 legacy=0x7fd2e40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e9bef700 1 -- 172.21.15.98:0/495484752 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4064c00 con 0x7fd2e414e720 2023-08-22T00:22:17.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2ea3f0700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 0x7fd2e40c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:17.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e9bef700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e414e720 0x7fd2e4155290 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fd2e0006fd0 tx=0x7fd2e00090f0).ready entity=mon.0 client_cookie=2ac8962202cf7b03 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e8bed700 1 -- 172.21.15.98:0/495484752 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000b600 con 0x7fd2e414e720 2023-08-22T00:22:17.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e8bed700 1 -- 172.21.15.98:0/495484752 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e000b760 con 0x7fd2e414e720 2023-08-22T00:22:17.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.672+0000 7fd2e8bed700 1 -- 172.21.15.98:0/495484752 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000bae0 con 0x7fd2e414e720 2023-08-22T00:22:17.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 -- 172.21.15.98:0/495484752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e414e720 msgr2=0x7fd2e4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e414e720 0x7fd2e4155290 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fd2e0006fd0 tx=0x7fd2e00090f0).stop 2023-08-22T00:22:17.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 -- 172.21.15.98:0/495484752 shutdown_connections 2023-08-22T00:22:17.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e4067d00 0x7fd2e40c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/495484752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e414e720 0x7fd2e4155290 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 -- 172.21.15.98:0/495484752 >> 172.21.15.98:0/495484752 conn(0x7fd2e40c8950 msgr2=0x7fd2e40c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 -- 172.21.15.98:0/495484752 shutdown_connections 2023-08-22T00:22:17.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.673+0000 7fd2ebe53700 1 -- 172.21.15.98:0/495484752 wait complete. 2023-08-22T00:22:17.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.674+0000 7fd2ebe53700 1 Processor -- start 2023-08-22T00:22:17.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.674+0000 7fd2ebe53700 1 -- start start 2023-08-22T00:22:17.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.675+0000 7fd2ebe53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e40641b0 0x7fd2e4168aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e414e720 0x7fd2e41476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e41699d0 con 0x7fd2e4067d00 2023-08-22T00:22:17.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40aa690 con 0x7fd2e40641b0 2023-08-22T00:22:17.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4169130 con 0x7fd2e414e720 2023-08-22T00:22:17.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58824/0 (socket says 172.21.15.98:58824) 2023-08-22T00:22:17.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 -- 172.21.15.98:0/1435931111 learned_addr learned my addr 172.21.15.98:0/1435931111 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e9bef700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e40641b0 0x7fd2e4168aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ea3f0700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e414e720 0x7fd2e41476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 -- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e414e720 msgr2=0x7fd2e41476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e414e720 0x7fd2e41476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 -- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e40641b0 msgr2=0x7fd2e4168aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e40641b0 0x7fd2e4168aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 -- 172.21.15.98:0/1435931111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e0009370 con 0x7fd2e4067d00 2023-08-22T00:22:17.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2e93ee700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd2d400c440 tx=0x7fd2d4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4007020 con 0x7fd2e4067d00 2023-08-22T00:22:17.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4007180 con 0x7fd2e4067d00 2023-08-22T00:22:17.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4007520 con 0x7fd2e4067d00 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.676+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4169410 con 0x7fd2e4067d00 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.677+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e40a81c0 con 0x7fd2e4067d00 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e4069d50 con 0x7fd2e4067d00 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fd2d40068b0 con 0x7fd2e4067d00 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2d9ffb700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 0x7fd2c8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2e9bef700 1 -- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 msgr2=0x7fd2c8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fd2d40794a0 con 0x7fd2e4067d00 2023-08-22T00:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.678+0000 7fd2e9bef700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 0x7fd2c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.682+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2d40478f0 con 0x7fd2e4067d00 2023-08-22T00:22:17.745 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:17.745+0000 7f84155f6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:17.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.851+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2e405e760 con 0x7fd2e4067d00 2023-08-22T00:22:17.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.851+0000 7fd2d9ffb700 1 -- 172.21.15.98:0/1435931111 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2d404a500 con 0x7fd2e4067d00 2023-08-22T00:22:17.852 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:22:17.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.853+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 msgr2=0x7fd2c8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:17.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.853+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 0x7fd2c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.853+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 msgr2=0x7fd2e40aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.853+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd2d400c440 tx=0x7fd2d4007e00).stop 2023-08-22T00:22:17.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 shutdown_connections 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2c805efc0 0x7fd2c8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2e414e720 0x7fd2e41476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e40641b0 0x7fd2e4168aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 --2- 172.21.15.98:0/1435931111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e4067d00 0x7fd2e40aa1a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 >> 172.21.15.98:0/1435931111 conn(0x7fd2e40c8950 msgr2=0x7fd2e4065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 shutdown_connections 2023-08-22T00:22:17.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.854+0000 7fd2ebe53700 1 -- 172.21.15.98:0/1435931111 wait complete. 2023-08-22T00:22:17.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:17.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.985+0000 7fc9d01be700 1 Processor -- start 2023-08-22T00:22:17.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.985+0000 7fc9d01be700 1 -- start start 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9d01be700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80664b0 0x7fc9c8151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9d01be700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc9c8151f30 0x7fc9c8063940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9d01be700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80634b0 con 0x7fc9c80660d0 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9d01be700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80bd680 con 0x7fc9c8151f30 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9d01be700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80bde30 con 0x7fc9c80664b0 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc9c8151f30 0x7fc9c8063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc9c8151f30 0x7fc9c8063940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58836/0 (socket says 172.21.15.98:58836) 2023-08-22T00:22:17.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 -- 172.21.15.98:0/4238558041 learned_addr learned my addr 172.21.15.98:0/4238558041 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9cd759700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80664b0 0x7fc9c8151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 -- 172.21.15.98:0/4238558041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80664b0 msgr2=0x7fc9c8151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80664b0 0x7fc9c8151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ccf58700 1 -- 172.21.15.98:0/4238558041 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215572205 0 0) 0x7fc9c80634b0 con 0x7fc9c80660d0 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 -- 172.21.15.98:0/4238558041 >> v1:172.21.15.118:6789/0 conn(0x7fc9c80660d0 legacy=0x7fc9c80a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.986+0000 7fc9ce75b700 1 -- 172.21.15.98:0/4238558041 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80be110 con 0x7fc9c8151f30 2023-08-22T00:22:17.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9ce75b700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c8151f30 0x7fc9c8063940 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fc9c0009f20 tx=0x7fc9c0009840).ready entity=mon.0 client_cookie=c2065be6d6e0dba3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9ccf58700 1 -- 172.21.15.98:0/4238558041 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000e070 con 0x7fc9c8151f30 2023-08-22T00:22:17.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9ccf58700 1 -- 172.21.15.98:0/4238558041 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000b9d0 con 0x7fc9c8151f30 2023-08-22T00:22:17.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9ccf58700 1 -- 172.21.15.98:0/4238558041 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bd50 con 0x7fc9c8151f30 2023-08-22T00:22:17.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 -- 172.21.15.98:0/4238558041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c8151f30 msgr2=0x7fc9c8063940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c8151f30 0x7fc9c8063940 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fc9c0009f20 tx=0x7fc9c0009840).stop 2023-08-22T00:22:17.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 -- 172.21.15.98:0/4238558041 shutdown_connections 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c8151f30 0x7fc9c8063940 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 --2- 172.21.15.98:0/4238558041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80664b0 0x7fc9c8151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 -- 172.21.15.98:0/4238558041 >> 172.21.15.98:0/4238558041 conn(0x7fc9c806a980 msgr2=0x7fc9c80c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 -- 172.21.15.98:0/4238558041 shutdown_connections 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.987+0000 7fc9d01be700 1 -- 172.21.15.98:0/4238558041 wait complete. 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.989+0000 7fc9d01be700 1 Processor -- start 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.989+0000 7fc9d01be700 1 -- start start 2023-08-22T00:22:17.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 0x7fc9c814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9c8151f30 0x7fc9c8161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8148c20 con 0x7fc9c80664b0 2023-08-22T00:22:17.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c814d900 con 0x7fc9c8151f30 2023-08-22T00:22:17.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9d01be700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c814dbe0 con 0x7fc9c80660d0 2023-08-22T00:22:17.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9cd759700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9cdf5a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 0x7fc9c814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9cd759700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58838/0 (socket says 172.21.15.98:58838) 2023-08-22T00:22:17.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9ce75b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9c8151f30 0x7fc9c8161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9cd759700 1 -- 172.21.15.98:0/262999533 learned_addr learned my addr 172.21.15.98:0/262999533 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.990+0000 7fc9cdf5a700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9c8151f30 msgr2=0x7fc9c8161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cdf5a700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9c8151f30 0x7fc9c8161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cdf5a700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 msgr2=0x7fc9c80ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cdf5a700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cdf5a700 1 -- 172.21.15.98:0/262999533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009ae0 con 0x7fc9c80660d0 2023-08-22T00:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cd759700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9cdf5a700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 0x7fc9c814d000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc9c4001eb0 tx=0x7fc9c4007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4012400 con 0x7fc9c80660d0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4012580 con 0x7fc9c80660d0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c81485d0 con 0x7fc9c80660d0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4012940 con 0x7fc9c80660d0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.991+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8130e20 con 0x7fc9c80660d0 2023-08-22T00:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.992+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8148f00 con 0x7fc9c80660d0 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.993+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fc9c4012cb0 con 0x7fc9c80660d0 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.993+0000 7fc9bdffb700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 0x7fc9ac061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.993+0000 7fc9cd759700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 msgr2=0x7fc9ac061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.993+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fc9c4079760 con 0x7fc9c80660d0 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.993+0000 7fc9cd759700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 0x7fc9ac061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:17.997+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9c404a7c0 con 0x7fc9c80660d0 2023-08-22T00:22:18.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.194+0000 7fc9cd759700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 msgr2=0x7fc9ac061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:18.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.194+0000 7fc9cd759700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 0x7fc9ac061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:18.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.208+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c8148a70 con 0x7fc9c80660d0 2023-08-22T00:22:18.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.209+0000 7fc9bdffb700 1 -- 172.21.15.98:0/262999533 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fc9c404dde0 con 0x7fc9c80660d0 2023-08-22T00:22:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:18.211 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:22:18.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 msgr2=0x7fc9ac061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 0x7fc9ac061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 msgr2=0x7fc9c814d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 0x7fc9c814d000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc9c4001eb0 tx=0x7fc9c4007bb0).stop 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 shutdown_connections 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc9ac05ef90 0x7fc9ac061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9c80660d0 0x7fc9c814d000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9c8151f30 0x7fc9c8161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 --2- 172.21.15.98:0/262999533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80664b0 0x7fc9c80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 >> 172.21.15.98:0/262999533 conn(0x7fc9c806a980 msgr2=0x7fc9c8063940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 shutdown_connections 2023-08-22T00:22:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.211+0000 7fc9d01be700 1 -- 172.21.15.98:0/262999533 wait complete. 2023-08-22T00:22:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:22:18.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:18.271 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.269+0000 7fab67768680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:18.341 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.339+0000 7fab67768680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:18.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.347+0000 7f9386916700 1 Processor -- start 2023-08-22T00:22:18.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.347+0000 7f9386916700 1 -- start start 2023-08-22T00:22:18.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9386916700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93800c61a0 0x7f938014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9386916700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93801544f0 0x7f93801549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9386916700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9380155260 con 0x7f938014e0d0 2023-08-22T00:22:18.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9386916700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93800c17b0 con 0x7f93800c61a0 2023-08-22T00:22:18.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9386916700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93800bf9e0 con 0x7f93801544f0 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f937f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93800c61a0 0x7f938014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f937f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93800c61a0 0x7f938014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58842/0 (socket says 172.21.15.98:58842) 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f937f7fe700 1 -- 172.21.15.98:0/1773825907 learned_addr learned my addr 172.21.15.98:0/1773825907 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f937ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f938014e0d0 0x7f93800c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36908/0 (socket says 172.21.15.98:36908) 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.348+0000 7f9384eb3700 1 --2- 172.21.15.98:0/1773825907 >> v2:172.21.15.118:3300/0 conn(0x7f93801544f0 0x7f93801549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937f7fe700 1 -- 172.21.15.98:0/1773825907 >> v2:172.21.15.118:3300/0 conn(0x7f93801544f0 msgr2=0x7f93801549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937f7fe700 1 --2- 172.21.15.98:0/1773825907 >> v2:172.21.15.118:3300/0 conn(0x7f93801544f0 0x7f93801549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937f7fe700 1 -- 172.21.15.98:0/1773825907 >> v1:172.21.15.98:6789/0 conn(0x7f938014e0d0 legacy=0x7f93800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937effd700 1 -- 172.21.15.98:0/1773825907 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055005127 0 0) 0x7f9380155260 con 0x7f938014e0d0 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937f7fe700 1 -- 172.21.15.98:0/1773825907 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800bfcc0 con 0x7f93800c61a0 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937f7fe700 1 --2- 172.21.15.98:0/1773825907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93800c61a0 0x7f938014e4b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f93800c68f0 tx=0x7f93740090f0).ready entity=mon.0 client_cookie=a6669bb81b5ae310 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937effd700 1 -- 172.21.15.98:0/1773825907 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400b520 con 0x7f93800c61a0 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937effd700 1 -- 172.21.15.98:0/1773825907 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400b680 con 0x7f93800c61a0 2023-08-22T00:22:18.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f937effd700 1 -- 172.21.15.98:0/1773825907 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400ba00 con 0x7f93800c61a0 2023-08-22T00:22:18.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f9386916700 1 -- 172.21.15.98:0/1773825907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93800c61a0 msgr2=0x7f938014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.349+0000 7f9386916700 1 --2- 172.21.15.98:0/1773825907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93800c61a0 0x7f938014e4b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f93800c68f0 tx=0x7f93740090f0).stop 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 -- 172.21.15.98:0/1773825907 shutdown_connections 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 --2- 172.21.15.98:0/1773825907 >> v2:172.21.15.118:3300/0 conn(0x7f93801544f0 0x7f93801549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 --2- 172.21.15.98:0/1773825907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93800c61a0 0x7f938014e4b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 -- 172.21.15.98:0/1773825907 >> 172.21.15.98:0/1773825907 conn(0x7f93800caa80 msgr2=0x7f93800cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 -- 172.21.15.98:0/1773825907 shutdown_connections 2023-08-22T00:22:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.350+0000 7f9386916700 1 -- 172.21.15.98:0/1773825907 wait complete. 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.351+0000 7f9386916700 1 Processor -- start 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.351+0000 7f9386916700 1 -- start start 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93800c61a0 0x7f9380165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 0x7f93800c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c2d60 con 0x7f93801544f0 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938014eb50 con 0x7f938014e0d0 2023-08-22T00:22:18.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9386916700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938014ee30 con 0x7f93800c61a0 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58846/0 (socket says 172.21.15.98:58846) 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 -- 172.21.15.98:0/855036807 learned_addr learned my addr 172.21.15.98:0/855036807 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f937f7fe700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 0x7f93800c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f937ffff700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93800c61a0 0x7f9380165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 -- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93800c61a0 msgr2=0x7f9380165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93800c61a0 0x7f9380165070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 -- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 msgr2=0x7f93800c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 0x7f93800c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 -- 172.21.15.98:0/855036807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374009370 con 0x7f93801544f0 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f937f7fe700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 0x7f93800c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9384eb3700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9378009e90 tx=0x7f937800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.352+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937800caa0 con 0x7f93801544f0 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.353+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937800f040 con 0x7f93801544f0 2023-08-22T00:22:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.353+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937800ce10 con 0x7f93801544f0 2023-08-22T00:22:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.353+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938014f110 con 0x7f93801544f0 2023-08-22T00:22:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.353+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93800c29e0 con 0x7f93801544f0 2023-08-22T00:22:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938014f630 con 0x7f93801544f0 2023-08-22T00:22:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f9378013610 con 0x7f93801544f0 2023-08-22T00:22:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f9367fff700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 0x7f936c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f937ffff700 1 -- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 msgr2=0x7f936c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f937807ac50 con 0x7f93801544f0 2023-08-22T00:22:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.354+0000 7f937ffff700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 0x7f936c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.361+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f938014f630 con 0x7f93801544f0 2023-08-22T00:22:18.417 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.416+0000 7fab67768680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:18.433 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.433+0000 7f84155f6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:18.516 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.515+0000 7f84155f6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:18.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.550+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f938014f630 con 0x7f93801544f0 2023-08-22T00:22:18.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.551+0000 7f9367fff700 1 -- 172.21.15.98:0/855036807 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+17518 (secure 0 0 0) 0x7f938014f630 con 0x7f93801544f0 2023-08-22T00:22:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:18.554 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":106,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:12.985109+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1768314078":"2023-08-23T00:22:12.985066+0000","172.21.15.98:6832/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:0/151378610":"2023-08-23T00:22:12.985066+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:18.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 msgr2=0x7f936c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:18.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 0x7f936c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 msgr2=0x7f9380166c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9378009e90 tx=0x7f937800b040).stop 2023-08-22T00:22:18.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 shutdown_connections 2023-08-22T00:22:18.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f936c05efc0 0x7f936c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93800c61a0 0x7f9380165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93801544f0 0x7f9380166c30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 --2- 172.21.15.98:0/855036807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938014e0d0 0x7f93800c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 >> 172.21.15.98:0/855036807 conn(0x7f93800caa80 msgr2=0x7f938014d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 shutdown_connections 2023-08-22T00:22:18.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.553+0000 7f9386916700 1 -- 172.21.15.98:0/855036807 wait complete. 2023-08-22T00:22:18.563 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.562+0000 7fab67768680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:18.566 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:22:18.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:18.600 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.599+0000 7f84155f6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:18.634 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.632+0000 7fab67768680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:18.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.684+0000 7f9078ef9700 1 Processor -- start 2023-08-22T00:22:18.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.684+0000 7f9078ef9700 1 -- start start 2023-08-22T00:22:18.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9078ef9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f90740a9140 0x7f9074158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9078ef9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740a8410 con 0x7f9074153f40 2023-08-22T00:22:18.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9078ef9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740a8cb0 con 0x7f9074153b60 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9078ef9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90741586a0 con 0x7f90740a9140 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9072d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f90740a9140 0x7f9074158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9071d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9074153f40 0x7f9074157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36920/0 (socket says 172.21.15.98:36920) 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9071d9b700 1 -- 172.21.15.98:0/4016043490 learned_addr learned my addr 172.21.15.98:0/4016043490 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9072d9d700 1 --2- 172.21.15.98:0/4016043490 >> v2:172.21.15.98:3300/0 conn(0x7f90740a9140 0x7f9074158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58850/0 (socket says 172.21.15.98:58850) 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9072d9d700 1 -- 172.21.15.98:0/4016043490 >> v1:172.21.15.118:6789/0 conn(0x7f9074153b60 legacy=0x7f9074068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9072d9d700 1 -- 172.21.15.98:0/4016043490 >> v1:172.21.15.98:6789/0 conn(0x7f9074153f40 legacy=0x7f9074157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f9072d9d700 1 -- 172.21.15.98:0/4016043490 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740a8660 con 0x7f90740a9140 2023-08-22T00:22:18.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.685+0000 7f907159a700 1 -- 172.21.15.98:0/4016043490 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979055672 0 0) 0x7f90740a8410 con 0x7f9074153f40 2023-08-22T00:22:18.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.686+0000 7f9072d9d700 1 --2- 172.21.15.98:0/4016043490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90740a9140 0x7f9074158040 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f906c009e60 tx=0x7f906c009780).ready entity=mon.0 client_cookie=b44f5cf8bb889c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:18.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.686+0000 7f907159a700 1 -- 172.21.15.98:0/4016043490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00e070 con 0x7f90740a9140 2023-08-22T00:22:18.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.686+0000 7f907159a700 1 -- 172.21.15.98:0/4016043490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c00bc30 con 0x7f90740a9140 2023-08-22T00:22:18.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.686+0000 7f907159a700 1 -- 172.21.15.98:0/4016043490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c012410 con 0x7f90740a9140 2023-08-22T00:22:18.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 -- 172.21.15.98:0/4016043490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90740a9140 msgr2=0x7f9074158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 --2- 172.21.15.98:0/4016043490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90740a9140 0x7f9074158040 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f906c009e60 tx=0x7f906c009780).stop 2023-08-22T00:22:18.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 -- 172.21.15.98:0/4016043490 shutdown_connections 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 --2- 172.21.15.98:0/4016043490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90740a9140 0x7f9074158040 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 -- 172.21.15.98:0/4016043490 >> 172.21.15.98:0/4016043490 conn(0x7f90740c5dc0 msgr2=0x7f9074068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 -- 172.21.15.98:0/4016043490 shutdown_connections 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.687+0000 7f9078ef9700 1 -- 172.21.15.98:0/4016043490 wait complete. 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.689+0000 7f9078ef9700 1 Processor -- start 2023-08-22T00:22:18.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.689+0000 7f9078ef9700 1 -- start start 2023-08-22T00:22:18.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90740a9140 0x7f90740c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9074153f40 0x7f90741559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740c2ab0 con 0x7f9074153b60 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9074155ea0 con 0x7f90740a9140 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9078ef9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907414f910 con 0x7f9074153f40 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58860/0 (socket says 172.21.15.98:58860) 2023-08-22T00:22:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 -- 172.21.15.98:0/1930710552 learned_addr learned my addr 172.21.15.98:0/1930710552 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f907259c700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90740a9140 0x7f90740c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9072d9d700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9074153f40 0x7f90741559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9074153f40 msgr2=0x7f90741559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9074153f40 0x7f90741559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90740a9140 msgr2=0x7f90740c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90740a9140 0x7f90740c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 -- 172.21.15.98:0/1930710552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009a20 con 0x7f9074153b60 2023-08-22T00:22:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.690+0000 7f9071d9b700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f906800c490 tx=0x7f9068007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.691+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680070d0 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.691+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068007230 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.691+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907414f5e0 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.691+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680075f0 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.691+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9074153560 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9074047480 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f90680059b0 con 0x7f9074153b60 2023-08-22T00:22:18.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f90627fc700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 0x7f9054061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:18.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f907259c700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 msgr2=0x7f9054061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:18.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f9068079940 con 0x7f9074153b60 2023-08-22T00:22:18.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.692+0000 7f907259c700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 0x7f9054061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:18.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.696+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f906804a9a0 con 0x7f9074153b60 2023-08-22T00:22:18.749 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.747+0000 7fab67768680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:18.756 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.756+0000 7f84155f6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:18.830 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.830+0000 7f84155f6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:18.855 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:18.853+0000 7fab67768680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:18.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.893+0000 7f907259c700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 msgr2=0x7f9054061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:18.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.893+0000 7f907259c700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 0x7f9054061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:18.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.908+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90740a8940 con 0x7f9074153b60 2023-08-22T00:22:18.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.909+0000 7f90627fc700 1 -- 172.21.15.98:0/1930710552 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f906804dfc0 con 0x7f9074153b60 2023-08-22T00:22:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:18.909 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:22:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 msgr2=0x7f9054061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 0x7f9054061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 msgr2=0x7f90741554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f906800c490 tx=0x7f9068007e40).stop 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 shutdown_connections 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f905405efc0 0x7f9054061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9074153f40 0x7f90741559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90740a9140 0x7f90740c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 --2- 172.21.15.98:0/1930710552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9074153b60 0x7f90741554c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 >> 172.21.15.98:0/1930710552 conn(0x7f90740c5dc0 msgr2=0x7f90740ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 shutdown_connections 2023-08-22T00:22:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:18.911+0000 7f9078ef9700 1 -- 172.21.15.98:0/1930710552 wait complete. 2023-08-22T00:22:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:22:18.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:18.950 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:18.950+0000 7f84155f6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:19.066 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.065+0000 7f84155f6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:19.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.067+0000 7f2d86f24700 1 Processor -- start 2023-08-22T00:22:19.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.067+0000 7f2d86f24700 1 -- start start 2023-08-22T00:22:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d86f24700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d800c3e50 0x7f2d800aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d86f24700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d800667b0 con 0x7f2d8014c350 2023-08-22T00:22:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d86f24700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d80155e00 con 0x7f2d8014bf70 2023-08-22T00:22:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d86f24700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d80066510 con 0x7f2d800c3e50 2023-08-22T00:22:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d854c1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d800c3e50 0x7f2d800aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d7ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2d8014c350 0x7f2d800aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36922/0 (socket says 172.21.15.98:36922) 2023-08-22T00:22:19.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d7ffff700 1 -- 172.21.15.98:0/2435320899 learned_addr learned my addr 172.21.15.98:0/2435320899 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:19.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d854c1700 1 -- 172.21.15.98:0/2435320899 >> v1:172.21.15.118:6789/0 conn(0x7f2d8014bf70 legacy=0x7f2d800c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d854c1700 1 -- 172.21.15.98:0/2435320899 >> v1:172.21.15.98:6789/0 conn(0x7f2d8014c350 legacy=0x7f2d800aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d854c1700 1 -- 172.21.15.98:0/2435320899 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d801560e0 con 0x7f2d800c3e50 2023-08-22T00:22:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d7f7fe700 1 -- 172.21.15.98:0/2435320899 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959047824 0 0) 0x7f2d800667b0 con 0x7f2d8014c350 2023-08-22T00:22:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d854c1700 1 --2- 172.21.15.98:0/2435320899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800aaf70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f2d78009e60 tx=0x7f2d78009780).ready entity=mon.0 client_cookie=6a8f65f9aea3dc2b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.068+0000 7f2d7f7fe700 1 -- 172.21.15.98:0/2435320899 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800e070 con 0x7f2d800c3e50 2023-08-22T00:22:19.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d7f7fe700 1 -- 172.21.15.98:0/2435320899 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800bc30 con 0x7f2d800c3e50 2023-08-22T00:22:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d7f7fe700 1 -- 172.21.15.98:0/2435320899 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78012410 con 0x7f2d800c3e50 2023-08-22T00:22:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 -- 172.21.15.98:0/2435320899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 msgr2=0x7f2d800aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2435320899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800aaf70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f2d78009e60 tx=0x7f2d78009780).stop 2023-08-22T00:22:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 -- 172.21.15.98:0/2435320899 shutdown_connections 2023-08-22T00:22:19.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2435320899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800aaf70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 -- 172.21.15.98:0/2435320899 >> 172.21.15.98:0/2435320899 conn(0x7f2d800c5dc0 msgr2=0x7f2d80068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 -- 172.21.15.98:0/2435320899 shutdown_connections 2023-08-22T00:22:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.069+0000 7f2d86f24700 1 -- 172.21.15.98:0/2435320899 wait complete. 2023-08-22T00:22:19.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.070+0000 7f2d86f24700 1 Processor -- start 2023-08-22T00:22:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.070+0000 7f2d86f24700 1 -- start start 2023-08-22T00:22:19.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 0x7f2d80065150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d8014c350 0x7f2d80065640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80064cc0 con 0x7f2d800c3e50 2023-08-22T00:22:19.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800640b0 con 0x7f2d8014c350 2023-08-22T00:22:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d86f24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80064390 con 0x7f2d8014bf70 2023-08-22T00:22:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d84cc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d7ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 0x7f2d80065150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d84cc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58880/0 (socket says 172.21.15.98:58880) 2023-08-22T00:22:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d7ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 0x7f2d80065150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:60616/0 (socket says 172.21.15.98:60616) 2023-08-22T00:22:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d84cc0700 1 -- 172.21.15.98:0/2058832221 learned_addr learned my addr 172.21.15.98:0/2058832221 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.071+0000 7f2d854c1700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d8014c350 0x7f2d80065640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 msgr2=0x7f2d80065150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 0x7f2d80065150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d8014c350 msgr2=0x7f2d80065640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d8014c350 0x7f2d80065640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 -- 172.21.15.98:0/2058832221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009a20 con 0x7f2d800c3e50 2023-08-22T00:22:19.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d84cc0700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f2d7400c4c0 tx=0x7f2d74007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400ce70 con 0x7f2d800c3e50 2023-08-22T00:22:19.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74001e90 con 0x7f2d800c3e50 2023-08-22T00:22:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d80064670 con 0x7f2d800c3e50 2023-08-22T00:22:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74007250 con 0x7f2d800c3e50 2023-08-22T00:22:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.072+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d800ae450 con 0x7f2d800c3e50 2023-08-22T00:22:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.073+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d80064fa0 con 0x7f2d800c3e50 2023-08-22T00:22:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.073+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2d740066a0 con 0x7f2d800c3e50 2023-08-22T00:22:19.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.074+0000 7f2d7cff9700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 0x7f2d64061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.074+0000 7f2d7ffff700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 msgr2=0x7f2d64061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.074+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f2d74079b30 con 0x7f2d800c3e50 2023-08-22T00:22:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.074+0000 7f2d7ffff700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 0x7f2d64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.078+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d7404ab90 con 0x7f2d800c3e50 2023-08-22T00:22:19.144 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:19.142+0000 7fab67768680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:19.214 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:19.212+0000 7fab67768680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:19.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.275+0000 7f2d7ffff700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 msgr2=0x7f2d64061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:19.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.275+0000 7f2d7ffff700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 0x7f2d64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:19.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.288+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d80047480 con 0x7f2d800c3e50 2023-08-22T00:22:19.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.288+0000 7f2d7cff9700 1 -- 172.21.15.98:0/2058832221 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f2d7404e1b0 con 0x7f2d800c3e50 2023-08-22T00:22:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:19.289 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:21:56.699407+0000","modified":"2023-08-22T00:21:58.705540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1304048216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1304048216},{"type":"v1","addr":"172.21.15.98:6837","nonce":1304048216}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-22T00:22:19.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 msgr2=0x7f2d64061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:19.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 0x7f2d64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:19.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 msgr2=0x7f2d800adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f2d7400c4c0 tx=0x7f2d74007e00).stop 2023-08-22T00:22:19.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 shutdown_connections 2023-08-22T00:22:19.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d8014c350 0x7f2d80065640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d800c3e50 0x7f2d800adf60 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d6405efc0 0x7f2d64061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:19.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 --2- 172.21.15.98:0/2058832221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d8014bf70 0x7f2d80065150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 >> 172.21.15.98:0/2058832221 conn(0x7f2d800c5dc0 msgr2=0x7f2d80155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:19.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 shutdown_connections 2023-08-22T00:22:19.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.290+0000 7f2d86f24700 1 -- 172.21.15.98:0/2058832221 wait complete. 2023-08-22T00:22:19.293 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2023-08-22T00:22:19.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:19.375 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.375+0000 7f84155f6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:19.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.422+0000 7f27d11cd700 1 Processor -- start 2023-08-22T00:22:19.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.422+0000 7f27d11cd700 1 -- start start 2023-08-22T00:22:19.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27d11cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 0x7f27cc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27d11cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27cc0c3e50 0x7f27cc1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27d11cd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc153080 con 0x7f27cc14c350 2023-08-22T00:22:19.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27d11cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc066510 con 0x7f27cc0c3e50 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27d11cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0667b0 con 0x7f27cc14bf70 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27ca59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f27cc14c350 0x7f27cc0c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36938/0 (socket says 172.21.15.98:36938) 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.423+0000 7f27ca59c700 1 -- 172.21.15.98:0/3192245537 learned_addr learned my addr 172.21.15.98:0/3192245537 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 --2- 172.21.15.98:0/3192245537 >> v2:172.21.15.118:3300/0 conn(0x7f27cc0c3e50 0x7f27cc1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cad9d700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 0x7f27cc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27c9d9b700 1 -- 172.21.15.98:0/3192245537 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278139149 0 0) 0x7f27cc153080 con 0x7f27cc14c350 2023-08-22T00:22:19.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27c9d9b700 1 -- 172.21.15.98:0/3192245537 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b40033f0 con 0x7f27cc14c350 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 -- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 msgr2=0x7f27cc152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 0x7f27cc152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 -- 172.21.15.98:0/3192245537 >> v1:172.21.15.98:6789/0 conn(0x7f27cc14c350 legacy=0x7f27cc0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 -- 172.21.15.98:0/3192245537 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc155ba0 con 0x7f27cc0c3e50 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cad9d700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 0x7f27cc152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27cb59e700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc0c3e50 0x7f27cc1556b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f27c4009e60 tx=0x7f27c4009780).ready entity=mon.1 client_cookie=413d4fd3bb939727 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27c9d9b700 1 -- 172.21.15.98:0/3192245537 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400e070 con 0x7f27cc0c3e50 2023-08-22T00:22:19.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27c9d9b700 1 -- 172.21.15.98:0/3192245537 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c400bab0 con 0x7f27cc0c3e50 2023-08-22T00:22:19.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.424+0000 7f27c9d9b700 1 -- 172.21.15.98:0/3192245537 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400be30 con 0x7f27cc0c3e50 2023-08-22T00:22:19.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 -- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc0c3e50 msgr2=0x7f27cc1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc0c3e50 0x7f27cc1556b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f27c4009e60 tx=0x7f27c4009780).stop 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 -- 172.21.15.98:0/3192245537 shutdown_connections 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc0c3e50 0x7f27cc1556b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3192245537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc14bf70 0x7f27cc152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 -- 172.21.15.98:0/3192245537 >> 172.21.15.98:0/3192245537 conn(0x7f27cc0c5dc0 msgr2=0x7f27cc068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 -- 172.21.15.98:0/3192245537 shutdown_connections 2023-08-22T00:22:19.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.425+0000 7f27d11cd700 1 -- 172.21.15.98:0/3192245537 wait complete. 2023-08-22T00:22:19.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.426+0000 7f27d11cd700 1 Processor -- start 2023-08-22T00:22:19.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.426+0000 7f27d11cd700 1 -- start start 2023-08-22T00:22:19.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 0x7f27cc0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 0x7f27cc0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0ac060 con 0x7f27cc14bf70 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0ac340 con 0x7f27cc14c350 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27d11cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0ac620 con 0x7f27cc0c3e50 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27ca59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27ca59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58892/0 (socket says 172.21.15.98:58892) 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27cb59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 0x7f27cc0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27ca59c700 1 -- 172.21.15.98:0/3099415904 learned_addr learned my addr 172.21.15.98:0/3099415904 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.427+0000 7f27cad9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 0x7f27cc0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 -- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 msgr2=0x7f27cc0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 0x7f27cc0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 -- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 msgr2=0x7f27cc13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 -- 172.21.15.98:0/3099415904 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0092a0 con 0x7f27cc0c3e50 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27ca59c700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cb59e700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 0x7f27cc0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27cad9d700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 0x7f27cc0ab810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f27bc00e980 tx=0x7f27bc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc012600 con 0x7f27cc0c3e50 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc012760 con 0x7f27cc0c3e50 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c4009a20 con 0x7f27cc0c3e50 2023-08-22T00:22:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc012ae0 con 0x7f27cc0c3e50 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.428+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc0acbe0 con 0x7f27cc0c3e50 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.429+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc0acf50 con 0x7f27cc0c3e50 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.429+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 40) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f27bc01b400 con 0x7f27cc0c3e50 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.430+0000 7f27b2ffd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 0x7f27b8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.430+0000 7f27ca59c700 1 -- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 msgr2=0x7f27b8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.430+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f27bc07a840 con 0x7f27cc0c3e50 2023-08-22T00:22:19.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.430+0000 7f27ca59c700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 0x7f27b8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:19.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.434+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27bc04b740 con 0x7f27cc0c3e50 2023-08-22T00:22:19.451 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.451+0000 7f84155f6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.475+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mgrmap(e 41) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f27bc078100 con 0x7f27cc0c3e50 2023-08-22T00:22:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.476+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 msgr2=0x7f27b8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.476+0000 7f27b2ffd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 0x7f27b8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:19.533 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83960ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.533 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83960ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.533 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83960ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.534 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83960ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.534 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83960ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.534 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83938a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.534 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83938a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.535 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83938a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.535 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83938a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.535 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:19.533+0000 7f83938a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.618+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27cc047480 con 0x7f27cc0c3e50 2023-08-22T00:22:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.619+0000 7f27b2ffd700 1 -- 172.21.15.98:0/3099415904 <== mon.2 v2:172.21.15.118:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17827 (secure 0 0 0) 0x7f27bc06d490 con 0x7f27cc0c3e50 2023-08-22T00:22:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:19.620 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":107,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:19.465202+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:21:55.264170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-08-22T00:21:55.661161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3839769739":"2023-08-23T00:22:19.465143+0000","172.21.15.98:0/432410969":"2023-08-23T00:22:19.465143+0000","172.21.15.98:0/2869824332":"2023-08-23T00:22:19.465143+0000","172.21.15.98:0/3201354763":"2023-08-23T00:22:19.465143+0000","172.21.15.98:0/1768314078":"2023-08-23T00:22:12.985066+0000","172.21.15.98:6832/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:0/3158657941":"2023-08-23T00:22:19.465143+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:12.985066+0000","172.21.15.98:0/151378610":"2023-08-23T00:22:12.985066+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:19.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 msgr2=0x7f27cc0ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 0x7f27cc0ab810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f27bc00e980 tx=0x7f27bc009060).stop 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 shutdown_connections 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f27b805efc0 0x7f27b8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27cc0c3e50 0x7f27cc0ab810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27cc14c350 0x7f27cc0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 --2- 172.21.15.98:0/3099415904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27cc14bf70 0x7f27cc13f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 >> 172.21.15.98:0/3099415904 conn(0x7f27cc0c5dc0 msgr2=0x7f27cc14b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 shutdown_connections 2023-08-22T00:22:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.621+0000 7f27d11cd700 1 -- 172.21.15.98:0/3099415904 wait complete. 2023-08-22T00:22:19.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:22:19.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.751+0000 7f146cf3e700 1 Processor -- start 2023-08-22T00:22:19.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.751+0000 7f146cf3e700 1 -- start start 2023-08-22T00:22:19.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146cf3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1468063f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146cf3e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1468064450 0x7f14680c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146cf3e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1468154ca0 con 0x7f146814e5d0 2023-08-22T00:22:19.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146cf3e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14681554f0 con 0x7f1468064450 2023-08-22T00:22:19.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146cf3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1468154f30 con 0x7f14680be430 2023-08-22T00:22:19.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f146814e5d0 0x7f1468154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36948/0 (socket says 172.21.15.98:36948) 2023-08-22T00:22:19.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146659c700 1 -- 172.21.15.98:0/3704720751 learned_addr learned my addr 172.21.15.98:0/3704720751 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f1466d9d700 1 --2- 172.21.15.98:0/3704720751 >> v2:172.21.15.118:3300/0 conn(0x7f1468064450 0x7f14680c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480091904 0 0) 0x7f1468154ca0 con 0x7f146814e5d0 2023-08-22T00:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f1465d9b700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1468063f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14500033f0 con 0x7f146814e5d0 2023-08-22T00:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153863559 0 0) 0x7f14500033f0 con 0x7f146814e5d0 2023-08-22T00:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 msgr2=0x7f1468063f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1468063f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 >> v2:172.21.15.118:3300/0 conn(0x7f1468064450 msgr2=0x7f14680c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 --2- 172.21.15.98:0/3704720751 >> v2:172.21.15.118:3300/0 conn(0x7f1468064450 0x7f14680c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468155210 con 0x7f146814e5d0 2023-08-22T00:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f1458001470 con 0x7f146814e5d0 2023-08-22T00:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 >> v1:172.21.15.98:6789/0 conn(0x7f146814e5d0 legacy=0x7f1468154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14500038e0 0x7f1450003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1450004690 0x7f1450004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1450005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14681554f0 con 0x7f1450004690 2023-08-22T00:22:19.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468154f30 con 0x7f14500038e0 2023-08-22T00:22:19.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145000b8e0 con 0x7f14680be430 2023-08-22T00:22:19.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f1465d9b700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1450004690 0x7f1450004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.752+0000 7f146659c700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14500038e0 0x7f1450003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1466d9d700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1450005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 -- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 msgr2=0x7f1450005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:19.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1450005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 -- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14500038e0 msgr2=0x7f1450003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14500038e0 0x7f1450003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 -- 172.21.15.98:0/3704720751 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500033f0 con 0x7f1450004690 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1466d9d700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14680be430 0x7f1450005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1465d9b700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1450004690 0x7f1450004b10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f145c009a60 tx=0x7f145c009060).ready entity=mon.0 client_cookie=9539de36bf72c583 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c009ea0 con 0x7f1450004690 2023-08-22T00:22:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c009430 con 0x7f1450004690 2023-08-22T00:22:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146559a700 1 -- 172.21.15.98:0/3704720751 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00e870 con 0x7f1450004690 2023-08-22T00:22:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 -- 172.21.15.98:0/3704720751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1450004690 msgr2=0x7f1450004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 --2- 172.21.15.98:0/3704720751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1450004690 0x7f1450004b10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f145c009a60 tx=0x7f145c009060).stop 2023-08-22T00:22:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f1466d9d700 1 -- 172.21.15.98:0/3704720751 reap_dead start 2023-08-22T00:22:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 -- 172.21.15.98:0/3704720751 shutdown_connections 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 -- 172.21.15.98:0/3704720751 >> 172.21.15.98:0/3704720751 conn(0x7f14680c4290 msgr2=0x7f14680c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 -- 172.21.15.98:0/3704720751 shutdown_connections 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.753+0000 7f146cf3e700 1 -- 172.21.15.98:0/3704720751 wait complete. 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 Processor -- start 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 -- start start 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450004690 0x7f14680a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1468168740 0x7f146814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146814fab0 con 0x7f14680a5d60 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468168bc0 con 0x7f1450004690 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.754+0000 7f146cf3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680a3a00 con 0x7f1468168740 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58986/0 (socket says 172.21.15.98:58986) 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 -- 172.21.15.98:0/1637967181 learned_addr learned my addr 172.21.15.98:0/1637967181 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:19.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f146659c700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450004690 0x7f14680a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1465d9b700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1468168740 0x7f146814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 -- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1468168740 msgr2=0x7f146814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1468168740 0x7f146814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 -- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450004690 msgr2=0x7f14680a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450004690 0x7f14680a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 -- 172.21.15.98:0/1637967181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680a3ce0 con 0x7f14680a5d60 2023-08-22T00:22:19.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f1466d9d700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f14680a6c90 tx=0x7f146000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000e030 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146000f040 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680a3fc0 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460010d20 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.755+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146814d580 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.756+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468069110 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.756+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 41) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f1460015690 con 0x7f14680a5d60 2023-08-22T00:22:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.757+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f146007a5f0 con 0x7f14680a5d60 2023-08-22T00:22:19.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.761+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f146004b8f0 con 0x7f14680a5d60 2023-08-22T00:22:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:19.963+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14680bc7f0 con 0x7f14680a5d60 2023-08-22T00:22:20.469 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:22:20.468+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:22:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.472+0000 7f14567fc700 1 -- 172.21.15.98:0/1637967181 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f146004ef10 con 0x7f14680a5d60 2023-08-22T00:22:20.474 INFO:tasks.ceph.mds.c.smithi098.stderr: -1385> 2023-08-22T00:22:02.672+0000 7f3e3f48d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:22:20.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 msgr2=0x7f14680a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:20.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f14680a6c90 tx=0x7f146000b040).stop 2023-08-22T00:22:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 shutdown_connections 2023-08-22T00:22:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14680a5d60 0x7f14680a61c0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450004690 0x7f14680a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 --2- 172.21.15.98:0/1637967181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1468168740 0x7f146814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.474+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 >> 172.21.15.98:0/1637967181 conn(0x7f14680c4290 msgr2=0x7f1468156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:20.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.477+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 shutdown_connections 2023-08-22T00:22:20.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.477+0000 7f146cf3e700 1 -- 172.21.15.98:0/1637967181 wait complete. 2023-08-22T00:22:20.483 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:22:20.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:22:20.500 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:22:20.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.615+0000 7fb1bd7c3700 1 Processor -- start 2023-08-22T00:22:20.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.615+0000 7fb1bd7c3700 1 -- start start 2023-08-22T00:22:20.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1bd7c3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1b80ad040 0x7fb1b80c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1bd7c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b81548f0 0x7fb1b8063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1bd7c3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b8063fb0 con 0x7fb1b80ad420 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1bd7c3700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80c9040 con 0x7fb1b80ad040 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1bd7c3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8063500 con 0x7fb1b81548f0 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1b80ad040 0x7fb1b80c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b67fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb1b80ad420 0x7fb1b81541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46144/0 (socket says 172.21.15.98:46144) 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1b80ad040 0x7fb1b80c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54882/0 (socket says 172.21.15.98:54882) 2023-08-22T00:22:20.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b67fc700 1 -- 172.21.15.98:0/603848356 learned_addr learned my addr 172.21.15.98:0/603848356 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b77fe700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b81548f0 0x7fb1b8063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 -- 172.21.15.98:0/603848356 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b81548f0 msgr2=0x7fb1b8063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b81548f0 0x7fb1b8063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 -- 172.21.15.98:0/603848356 >> v1:172.21.15.98:6789/0 conn(0x7fb1b80ad420 legacy=0x7fb1b81541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 -- 172.21.15.98:0/603848356 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8063710 con 0x7fb1b80ad040 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b5ffb700 1 -- 172.21.15.98:0/603848356 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855356669 0 0) 0x7fb1b8063fb0 con 0x7fb1b80ad420 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b6ffd700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad040 0x7fb1b80c5df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fb1a8009760 tx=0x7fb1a8009060).ready entity=mon.0 client_cookie=fdd59f25b036986 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b5ffb700 1 -- 172.21.15.98:0/603848356 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80090d0 con 0x7fb1b80ad040 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b5ffb700 1 -- 172.21.15.98:0/603848356 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800f510 con 0x7fb1b80ad040 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.616+0000 7fb1b5ffb700 1 -- 172.21.15.98:0/603848356 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800f890 con 0x7fb1b80ad040 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/603848356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad040 msgr2=0x7fb1b80c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad040 0x7fb1b80c5df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fb1a8009760 tx=0x7fb1a8009060).stop 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/603848356 shutdown_connections 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b81548f0 0x7fb1b8063010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/603848356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad040 0x7fb1b80c5df0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/603848356 >> 172.21.15.98:0/603848356 conn(0x7fb1b80cb600 msgr2=0x7fb1b80c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/603848356 shutdown_connections 2023-08-22T00:22:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.617+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/603848356 wait complete. 2023-08-22T00:22:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.618+0000 7fb1bd7c3700 1 Processor -- start 2023-08-22T00:22:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.618+0000 7fb1bd7c3700 1 -- start start 2023-08-22T00:22:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b80ad040 0x7fb1b8151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 0x7fb1b80c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80c3620 con 0x7fb1b80ad420 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8164670 con 0x7fb1b81548f0 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1bd7c3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81640a0 con 0x7fb1b80ad040 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54884/0 (socket says 172.21.15.98:54884) 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 -- 172.21.15.98:0/245516882 learned_addr learned my addr 172.21.15.98:0/245516882 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b6ffd700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b80ad040 0x7fb1b8151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b77fe700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 0x7fb1b80c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 -- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b80ad040 msgr2=0x7fb1b8151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b80ad040 0x7fb1b8151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 -- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 msgr2=0x7fb1b80c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 0x7fb1b80c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 -- 172.21.15.98:0/245516882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80092a0 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b77fe700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 0x7fb1b80c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.619+0000 7fb1b67fc700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4a0 tx=0x7fb1ac007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.620+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0072e0 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.620+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac007440 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.620+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b80c3060 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.620+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0057a0 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.620+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b80c33f0 con 0x7fb1b80ad420 2023-08-22T00:22:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.621+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b8164800 con 0x7fb1b80ad420 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.621+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 42) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fb1ac005bd0 con 0x7fb1b80ad420 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.621+0000 7fb19effd700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 0x7fb1a40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.621+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6947+0+0 (secure 0 0 0) 0x7fb1ac079650 con 0x7fb1b80ad420 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.621+0000 7fb1b6ffd700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 0x7fb1a40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.622+0000 7fb1b6ffd700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 0x7fb1a40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb1a8009fd0 tx=0x7fb1a8017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.626+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1ac04a950 con 0x7fb1b80ad420 2023-08-22T00:22:20.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:22:20.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:22:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:20.838+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1b8046c20 con 0x7fb1b80ad420 2023-08-22T00:22:21.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.481+0000 7fb19effd700 1 -- 172.21.15.98:0/245516882 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb1ac04df70 con 0x7fb1b80ad420 2023-08-22T00:22:21.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 msgr2=0x7fb1a40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 0x7fb1a40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb1a8009fd0 tx=0x7fb1a8017000).stop 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 msgr2=0x7fb1b80c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4a0 tx=0x7fb1ac007c30).stop 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 shutdown_connections 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb1a405ecf0 0x7fb1a40611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b80ad040 0x7fb1b8151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1b81548f0 0x7fb1b80c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 --2- 172.21.15.98:0/245516882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b80ad420 0x7fb1b80c25a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 >> 172.21.15.98:0/245516882 conn(0x7fb1b80cb600 msgr2=0x7fb1b80aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 shutdown_connections 2023-08-22T00:22:21.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.484+0000 7fb1bd7c3700 1 -- 172.21.15.98:0/245516882 wait complete. 2023-08-22T00:22:21.499 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:22:21.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.623+0000 7fa66763f700 1 Processor -- start 2023-08-22T00:22:21.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.623+0000 7fa66763f700 1 -- start start 2023-08-22T00:22:21.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa66763f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa660154f60 0x7fa660068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa66763f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660069210 0x7fa660066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa66763f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600a8c70 con 0x7fa6600673e0 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa66763f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600a86f0 con 0x7fa660154f60 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa66763f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660068210 con 0x7fa660069210 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.624+0000 7fa6653db700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa660154f60 0x7fa660068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa665bdc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa6600673e0 0x7fa6600be7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46150/0 (socket says 172.21.15.98:46150) 2023-08-22T00:22:21.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa660154f60 0x7fa660068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54896/0 (socket says 172.21.15.98:54896) 2023-08-22T00:22:21.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa665bdc700 1 -- 172.21.15.98:0/3433104943 learned_addr learned my addr 172.21.15.98:0/3433104943 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:21.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa664bda700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660069210 0x7fa660066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa653fff700 1 -- 172.21.15.98:0/3433104943 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30195270 0 0) 0x7fa6600a8c70 con 0x7fa6600673e0 2023-08-22T00:22:21.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 -- 172.21.15.98:0/3433104943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660069210 msgr2=0x7fa660066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660069210 0x7fa660066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 -- 172.21.15.98:0/3433104943 >> v1:172.21.15.98:6789/0 conn(0x7fa6600673e0 legacy=0x7fa6600be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 -- 172.21.15.98:0/3433104943 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660069690 con 0x7fa660154f60 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa6653db700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa660068d20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fa654009760 tx=0x7fa654009060).ready entity=mon.0 client_cookie=e20fc8ba6c4aedc8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa653fff700 1 -- 172.21.15.98:0/3433104943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540090d0 con 0x7fa660154f60 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa653fff700 1 -- 172.21.15.98:0/3433104943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400b580 con 0x7fa660154f60 2023-08-22T00:22:21.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.625+0000 7fa653fff700 1 -- 172.21.15.98:0/3433104943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400b900 con 0x7fa660154f60 2023-08-22T00:22:21.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 -- 172.21.15.98:0/3433104943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 msgr2=0x7fa660068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa660068d20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fa654009760 tx=0x7fa654009060).stop 2023-08-22T00:22:21.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 -- 172.21.15.98:0/3433104943 shutdown_connections 2023-08-22T00:22:21.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa660068d20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 --2- 172.21.15.98:0/3433104943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660069210 0x7fa660066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 -- 172.21.15.98:0/3433104943 >> 172.21.15.98:0/3433104943 conn(0x7fa6600c5dd0 msgr2=0x7fa660068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:21.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 -- 172.21.15.98:0/3433104943 shutdown_connections 2023-08-22T00:22:21.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.626+0000 7fa66763f700 1 -- 172.21.15.98:0/3433104943 wait complete. 2023-08-22T00:22:21.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.627+0000 7fa66763f700 1 Processor -- start 2023-08-22T00:22:21.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.627+0000 7fa66763f700 1 -- start start 2023-08-22T00:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.628+0000 7fa66763f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6600673e0 0x7fa6600c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.628+0000 7fa66763f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660069210 0x7fa6600bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.628+0000 7fa66763f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.628+0000 7fa66763f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600c0790 con 0x7fa660154f60 2023-08-22T00:22:21.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa66763f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600c0a70 con 0x7fa660069210 2023-08-22T00:22:21.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa66763f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600c0d50 con 0x7fa6600673e0 2023-08-22T00:22:21.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54910/0 (socket says 172.21.15.98:54910) 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 -- 172.21.15.98:0/3500121255 learned_addr learned my addr 172.21.15.98:0/3500121255 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa6653db700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6600673e0 0x7fa6600c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa664bda700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660069210 0x7fa6600bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 -- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6600673e0 msgr2=0x7fa6600c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6600673e0 0x7fa6600c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 -- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660069210 msgr2=0x7fa6600bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:21.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660069210 0x7fa6600bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 -- 172.21.15.98:0/3500121255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540092a0 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa665bdc700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fa65800c7e0 tx=0x7fa658007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658005d30 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658005e90 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658007320 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6600c1030 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.629+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6600c1d20 con 0x7fa660154f60 2023-08-22T00:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.630+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6600c1550 con 0x7fa660154f60 2023-08-22T00:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.630+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 42) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fa658007710 con 0x7fa660154f60 2023-08-22T00:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.631+0000 7fa6517fa700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 0x7fa6440611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.631+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6947+0+0 (secure 0 0 0) 0x7fa658079fc0 con 0x7fa660154f60 2023-08-22T00:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.631+0000 7fa6653db700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 0x7fa6440611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.631+0000 7fa6653db700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 0x7fa6440611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa65400b340 tx=0x7fa654017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:21.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.635+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa65804b2c0 con 0x7fa660154f60 2023-08-22T00:22:21.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:21.795+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa660047480 con 0x7fa660154f60 2023-08-22T00:22:22.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.317+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa658077c20 con 0x7fa660154f60 2023-08-22T00:22:22.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.488+0000 7fa6517fa700 1 -- 172.21.15.98:0/3500121255 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa6580725b0 con 0x7fa660154f60 2023-08-22T00:22:22.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 msgr2=0x7fa6440611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 0x7fa6440611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa65400b340 tx=0x7fa654017000).stop 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 msgr2=0x7fa6600abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fa65800c7e0 tx=0x7fa658007f90).stop 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 shutdown_connections 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa64405ecf0 0x7fa6440611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6600673e0 0x7fa6600c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa660154f60 0x7fa6600abe10 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 --2- 172.21.15.98:0/3500121255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660069210 0x7fa6600bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 >> 172.21.15.98:0/3500121255 conn(0x7fa6600c5dd0 msgr2=0x7fa6601576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:22.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 shutdown_connections 2023-08-22T00:22:22.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.493+0000 7fa66763f700 1 -- 172.21.15.98:0/3500121255 wait complete. 2023-08-22T00:22:22.496 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:22:22.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:22:22.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.633+0000 7fc063638700 1 Processor -- start 2023-08-22T00:22:22.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.633+0000 7fc063638700 1 -- start start 2023-08-22T00:22:22.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc05c067880 0x7fc05c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc05c0c34f0 0x7fc05c065640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c063ea0 0x7fc05c064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c065b30 con 0x7fc05c0c34f0 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c151ec0 con 0x7fc05c067880 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc063638700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c065d20 con 0x7fc05c063ea0 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc05c0c34f0 0x7fc05c065640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc05c0c34f0 0x7fc05c065640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54920/0 (socket says 172.21.15.98:54920) 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 -- 172.21.15.98:0/1402580843 learned_addr learned my addr 172.21.15.98:0/1402580843 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc061bd5700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c063ea0 0x7fc05c064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc0613d4700 1 --2- 172.21.15.98:0/1402580843 >> v2:172.21.15.118:3300/0 conn(0x7fc05c067880 0x7fc05c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 -- 172.21.15.98:0/1402580843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c063ea0 msgr2=0x7fc05c064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c063ea0 0x7fc05c064330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 -- 172.21.15.98:0/1402580843 >> v2:172.21.15.118:3300/0 conn(0x7fc05c067880 msgr2=0x7fc05c067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 --2- 172.21.15.98:0/1402580843 >> v2:172.21.15.118:3300/0 conn(0x7fc05c067880 0x7fc05c067c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.634+0000 7fc060bd3700 1 -- 172.21.15.98:0/1402580843 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c151a30 con 0x7fc05c0c34f0 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc060bd3700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c0c34f0 0x7fc05c065640 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc05c0bdee0 tx=0x7fc05000b3b0).ready entity=mon.0 client_cookie=d37bea818ad5775a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:22.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc05bfff700 1 -- 172.21.15.98:0/1402580843 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000da30 con 0x7fc05c0c34f0 2023-08-22T00:22:22.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc05bfff700 1 -- 172.21.15.98:0/1402580843 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000db90 con 0x7fc05c0c34f0 2023-08-22T00:22:22.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc05bfff700 1 -- 172.21.15.98:0/1402580843 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050010470 con 0x7fc05c0c34f0 2023-08-22T00:22:22.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc063638700 1 -- 172.21.15.98:0/1402580843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c0c34f0 msgr2=0x7fc05c065640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:22.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.635+0000 7fc063638700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c0c34f0 0x7fc05c065640 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc05c0bdee0 tx=0x7fc05000b3b0).stop 2023-08-22T00:22:22.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.636+0000 7fc063638700 1 -- 172.21.15.98:0/1402580843 shutdown_connections 2023-08-22T00:22:22.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.636+0000 7fc063638700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c063ea0 0x7fc05c064330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.636+0000 7fc063638700 1 --2- 172.21.15.98:0/1402580843 >> v2:172.21.15.118:3300/0 conn(0x7fc05c067880 0x7fc05c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.636+0000 7fc063638700 1 --2- 172.21.15.98:0/1402580843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c0c34f0 0x7fc05c065640 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.636+0000 7fc063638700 1 -- 172.21.15.98:0/1402580843 >> 172.21.15.98:0/1402580843 conn(0x7fc05c0c4470 msgr2=0x7fc05c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.637+0000 7fc063638700 1 -- 172.21.15.98:0/1402580843 shutdown_connections 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.637+0000 7fc063638700 1 -- 172.21.15.98:0/1402580843 wait complete. 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.639+0000 7fc063638700 1 Processor -- start 2023-08-22T00:22:22.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.639+0000 7fc063638700 1 -- start start 2023-08-22T00:22:22.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c067880 0x7fc05c0ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 0x7fc05c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c1607b0 con 0x7fc05c063ea0 2023-08-22T00:22:22.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0a9440 con 0x7fc05c067880 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc063638700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0aac40 con 0x7fc05c0c34f0 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54922/0 (socket says 172.21.15.98:54922) 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 -- 172.21.15.98:0/2579389438 learned_addr learned my addr 172.21.15.98:0/2579389438 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc060bd3700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c067880 0x7fc05c0ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc061bd5700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 0x7fc05c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 -- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 msgr2=0x7fc05c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 0x7fc05c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 -- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c067880 msgr2=0x7fc05c0ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c067880 0x7fc05c0ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc0613d4700 1 -- 172.21.15.98:0/2579389438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05000b610 con 0x7fc05c063ea0 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.640+0000 7fc061bd5700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 0x7fc05c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc0613d4700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc05400e960 tx=0x7fc054009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054013990 con 0x7fc05c063ea0 2023-08-22T00:22:22.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054013af0 con 0x7fc05c063ea0 2023-08-22T00:22:22.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054013e70 con 0x7fc05c063ea0 2023-08-22T00:22:22.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c0aa030 con 0x7fc05c063ea0 2023-08-22T00:22:22.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.641+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c0aa5f0 con 0x7fc05c063ea0 2023-08-22T00:22:22.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.642+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03c005120 con 0x7fc05c063ea0 2023-08-22T00:22:22.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.642+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc054019070 con 0x7fc05c063ea0 2023-08-22T00:22:22.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.643+0000 7fc0597fa700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 0x7fc0480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:22.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.643+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6509+0+0 (secure 0 0 0) 0x7fc05407e190 con 0x7fc05c063ea0 2023-08-22T00:22:22.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.643+0000 7fc060bd3700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 0x7fc0480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:22.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.643+0000 7fc060bd3700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 0x7fc0480613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc05c0c3980 tx=0x7fc05000b3b0).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:22.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.647+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc05404f300 con 0x7fc05c063ea0 2023-08-22T00:22:22.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:22.810+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc03c0057f0 con 0x7fc05c063ea0 2023-08-22T00:22:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.488+0000 7fc0597fa700 1 -- 172.21.15.98:0/2579389438 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc054052920 con 0x7fc05c063ea0 2023-08-22T00:22:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 msgr2=0x7fc0480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 0x7fc0480613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc05c0c3980 tx=0x7fc05000b3b0).stop 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 msgr2=0x7fc05c1602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc05400e960 tx=0x7fc054009060).stop 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 shutdown_connections 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ef30 0x7fc0480613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05c0c34f0 0x7fc05c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc05c063ea0 0x7fc05c1602c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 --2- 172.21.15.98:0/2579389438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c067880 0x7fc05c0ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 >> 172.21.15.98:0/2579389438 conn(0x7fc05c0c4470 msgr2=0x7fc05c0c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 shutdown_connections 2023-08-22T00:22:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.490+0000 7fc063638700 1 -- 172.21.15.98:0/2579389438 wait complete. 2023-08-22T00:22:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:22:23.505 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:22:23.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.626+0000 7fbc65885700 1 Processor -- start 2023-08-22T00:22:23.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.626+0000 7fbc65885700 1 -- start start 2023-08-22T00:22:23.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc65885700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 0x7fbc600ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc65885700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc601578b0 0x7fbc60157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc65885700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600c6330 con 0x7fbc600acee0 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc65885700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc601541e0 con 0x7fbc601578b0 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc65885700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc601581c0 con 0x7fbc600c8ef0 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc5f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbc601578b0 0x7fbc60157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc5effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbc600acee0 0x7fbc600c5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46152/0 (socket says 172.21.15.98:46152) 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.627+0000 7fbc5effd700 1 -- 172.21.15.98:0/2913155045 learned_addr learned my addr 172.21.15.98:0/2913155045 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:23.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5e7fc700 1 --2- 172.21.15.98:0/2913155045 >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 0x7fbc600ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5f7fe700 1 -- 172.21.15.98:0/2913155045 >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 msgr2=0x7fbc600ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5f7fe700 1 --2- 172.21.15.98:0/2913155045 >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 0x7fbc600ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5f7fe700 1 -- 172.21.15.98:0/2913155045 >> v1:172.21.15.98:6789/0 conn(0x7fbc600acee0 legacy=0x7fbc600c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5f7fe700 1 -- 172.21.15.98:0/2913155045 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600c9420 con 0x7fbc601578b0 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5e7fc700 1 --2- 172.21.15.98:0/2913155045 >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 0x7fbc600ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5dffb700 1 -- 172.21.15.98:0/2913155045 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921722658 0 0) 0x7fbc600c6330 con 0x7fbc600acee0 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5f7fe700 1 --2- 172.21.15.98:0/2913155045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc601578b0 0x7fbc60157cd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fbc600c75a0 tx=0x7fbc58009780).ready entity=mon.0 client_cookie=95b78af2332aa6b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5dffb700 1 -- 172.21.15.98:0/2913155045 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800e070 con 0x7fbc601578b0 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5dffb700 1 -- 172.21.15.98:0/2913155045 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800bc30 con 0x7fbc601578b0 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc5dffb700 1 -- 172.21.15.98:0/2913155045 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58012410 con 0x7fbc601578b0 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 -- 172.21.15.98:0/2913155045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc601578b0 msgr2=0x7fbc60157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 --2- 172.21.15.98:0/2913155045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc601578b0 0x7fbc60157cd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fbc600c75a0 tx=0x7fbc58009780).stop 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 -- 172.21.15.98:0/2913155045 shutdown_connections 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 --2- 172.21.15.98:0/2913155045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc601578b0 0x7fbc60157cd0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 --2- 172.21.15.98:0/2913155045 >> v2:172.21.15.118:3300/0 conn(0x7fbc600c8ef0 0x7fbc600ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 -- 172.21.15.98:0/2913155045 >> 172.21.15.98:0/2913155045 conn(0x7fbc600cb600 msgr2=0x7fbc600c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:23.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 -- 172.21.15.98:0/2913155045 shutdown_connections 2023-08-22T00:22:23.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.628+0000 7fbc65885700 1 -- 172.21.15.98:0/2913155045 wait complete. 2023-08-22T00:22:23.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 Processor -- start 2023-08-22T00:22:23.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 -- start start 2023-08-22T00:22:23.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc600acee0 0x7fbc60163a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc601578b0 0x7fbc60155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601567b0 con 0x7fbc600c8ef0 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60156c40 con 0x7fbc600acee0 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.630+0000 7fbc65885700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60155ba0 con 0x7fbc601578b0 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54948/0 (socket says 172.21.15.98:54948) 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 -- 172.21.15.98:0/245877329 learned_addr learned my addr 172.21.15.98:0/245877329 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:23.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 -- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc601578b0 msgr2=0x7fbc60155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc601578b0 0x7fbc60155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 -- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc600acee0 msgr2=0x7fbc60163a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc600acee0 0x7fbc60163a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 -- 172.21.15.98:0/245877329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009a20 con 0x7fbc600c8ef0 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc5e7fc700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fbc5000c880 tx=0x7fbc50008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50010580 con 0x7fbc600c8ef0 2023-08-22T00:22:23.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc500106e0 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60155e80 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50010a60 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.631+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc60156440 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.632+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60083670 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.632+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbc5001b460 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.633+0000 7fbc56ffd700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 0x7fbc400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.633+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7fbc50079f50 con 0x7fbc600c8ef0 2023-08-22T00:22:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.633+0000 7fbc5effd700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 0x7fbc400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.633+0000 7fbc5effd700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 0x7fbc400613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbc600af720 tx=0x7fbc48007a50).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.637+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc5004b200 con 0x7fbc600c8ef0 2023-08-22T00:22:23.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.798+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc601568f0 con 0x7fbc600c8ef0 2023-08-22T00:22:23.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.801+0000 7fbc56ffd700 1 -- 172.21.15.98:0/245877329 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc5004e820 con 0x7fbc600c8ef0 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 msgr2=0x7fbc400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 0x7fbc400613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbc600af720 tx=0x7fbc48007a50).stop 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 msgr2=0x7fbc600c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fbc5000c880 tx=0x7fbc50008040).stop 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 shutdown_connections 2023-08-22T00:22:23.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbc4005ef30 0x7fbc400613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc601578b0 0x7fbc60155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc600acee0 0x7fbc60163a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 --2- 172.21.15.98:0/245877329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc600c8ef0 0x7fbc600c4cf0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 >> 172.21.15.98:0/245877329 conn(0x7fbc600cb600 msgr2=0x7fbc600c0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 shutdown_connections 2023-08-22T00:22:23.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.803+0000 7fbc65885700 1 -- 172.21.15.98:0/245877329 wait complete. 2023-08-22T00:22:23.816 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:22:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.939+0000 7f2f6ca62700 1 Processor -- start 2023-08-22T00:22:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.939+0000 7f2f6ca62700 1 -- start start 2023-08-22T00:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f6ca62700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f68151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f6ca62700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f68062600 con 0x7f2f68151840 2023-08-22T00:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f6ca62700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f68066120 con 0x7f2f680a8b20 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f6ca62700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68066400 con 0x7f2f680a8f00 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f66d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2f68151840 0x7f2f68062a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46160/0 (socket says 172.21.15.98:46160) 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f66d9d700 1 -- 172.21.15.98:0/1012326671 learned_addr learned my addr 172.21.15.98:0/1012326671 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.940+0000 7f2f65d9b700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f68151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891624476 0 0) 0x7f2f68062600 con 0x7f2f68151840 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f500033f0 con 0x7f2f68151840 2023-08-22T00:22:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173223846 0 0) 0x7f2f500033f0 con 0x7f2f68151840 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 msgr2=0x7f2f68151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f68151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 >> v1:172.21.15.118:6789/0 conn(0x7f2f680a8b20 legacy=0x7f2f680bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680666e0 con 0x7f2f68151840 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f2f600017f0 con 0x7f2f68151840 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 >> v1:172.21.15.98:6789/0 conn(0x7f2f68151840 legacy=0x7f2f68062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f50003910 0x7f2f50003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50004690 0x7f2f50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68066400 con 0x7f2f50003910 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5000b930 con 0x7f2f50004690 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5000baf0 con 0x7f2f680a8f00 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f50003910 0x7f2f50003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f65d9b700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50004690 0x7f2f50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f66d9d700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 -- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 msgr2=0x7f2f50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f680a8f00 0x7f2f50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 -- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50004690 msgr2=0x7f2f50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50004690 0x7f2f50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 -- 172.21.15.98:0/1012326671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500033f0 con 0x7f2f50003910 2023-08-22T00:22:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.941+0000 7f2f6659c700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f50003910 0x7f2f50003cf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f2f5c001820 tx=0x7f2f5c007b90).ready entity=mon.0 client_cookie=3067a5390782a26d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c007ea0 con 0x7f2f50003910 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c012400 con 0x7f2f50003910 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6559a700 1 -- 172.21.15.98:0/1012326671 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0127c0 con 0x7f2f50003910 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 -- 172.21.15.98:0/1012326671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f50003910 msgr2=0x7f2f50003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/1012326671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f50003910 0x7f2f50003cf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f2f5c001820 tx=0x7f2f5c007b90).stop 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f66d9d700 1 -- 172.21.15.98:0/1012326671 reap_dead start 2023-08-22T00:22:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 -- 172.21.15.98:0/1012326671 shutdown_connections 2023-08-22T00:22:23.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 -- 172.21.15.98:0/1012326671 >> 172.21.15.98:0/1012326671 conn(0x7f2f680c31d0 msgr2=0x7f2f680c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:23.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 -- 172.21.15.98:0/1012326671 shutdown_connections 2023-08-22T00:22:23.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.942+0000 7f2f6ca62700 1 -- 172.21.15.98:0/1012326671 wait complete. 2023-08-22T00:22:23.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.944+0000 7f2f6ca62700 1 Processor -- start 2023-08-22T00:22:23.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.944+0000 7f2f6ca62700 1 -- start start 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 0x7f2f681464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 0x7f2f680657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680c2b00 con 0x7f2f680c14a0 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68065cc0 con 0x7f2f50003910 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680c1ef0 con 0x7f2f68065350 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54968/0 (socket says 172.21.15.98:54968) 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 -- 172.21.15.98:0/577729392 learned_addr learned my addr 172.21.15.98:0/577729392 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6659c700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 0x7f2f681464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f66d9d700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 0x7f2f680657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 -- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 msgr2=0x7f2f680657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 0x7f2f680657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 -- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 msgr2=0x7f2f681464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 0x7f2f681464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:23.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 -- 172.21.15.98:0/577729392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680c21d0 con 0x7f2f680c14a0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f66d9d700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 0x7f2f680657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6659c700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 0x7f2f681464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f65d9b700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f2f580119f0 tx=0x7f2f58009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800f940 con 0x7f2f680c14a0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800faa0 con 0x7f2f680c14a0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f680c24b0 con 0x7f2f680c14a0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800fe20 con 0x7f2f680c14a0 2023-08-22T00:22:23.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.945+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f681469b0 con 0x7f2f680c14a0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.946+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f680669c0 con 0x7f2f680c14a0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.947+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2f58014650 con 0x7f2f680c14a0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.947+0000 7f2f567fc700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 0x7f2f480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.947+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f2f5807abc0 con 0x7f2f680c14a0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.947+0000 7f2f6659c700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 0x7f2f480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.947+0000 7f2f6659c700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 0x7f2f480613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2f5c001820 tx=0x7f2f5c016000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:23.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:23.951+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f5804bed0 con 0x7f2f680c14a0 2023-08-22T00:22:24.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.112+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2f68046c20 con 0x7f2f680c14a0 2023-08-22T00:22:24.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.116+0000 7f2f567fc700 1 -- 172.21.15.98:0/577729392 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2f5804f4f0 con 0x7f2f680c14a0 2023-08-22T00:22:24.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 msgr2=0x7f2f480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 0x7f2f480613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2f5c001820 tx=0x7f2f5c016000).stop 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 msgr2=0x7f2f680c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f2f580119f0 tx=0x7f2f58009060).stop 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 shutdown_connections 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2f4805ef30 0x7f2f480613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f68065350 0x7f2f680657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f50003910 0x7f2f681464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 --2- 172.21.15.98:0/577729392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f680c14a0 0x7f2f680c1920 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 >> 172.21.15.98:0/577729392 conn(0x7f2f680c31d0 msgr2=0x7f2f680c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:24.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 shutdown_connections 2023-08-22T00:22:24.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.118+0000 7f2f6ca62700 1 -- 172.21.15.98:0/577729392 wait complete. 2023-08-22T00:22:24.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-22T00:22:24.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.246+0000 7f8e0cebc700 1 Processor -- start 2023-08-22T00:22:24.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.246+0000 7f8e0cebc700 1 -- start start 2023-08-22T00:22:24.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.247+0000 7f8e0cebc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e08154c00 0x7f8e0814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.247+0000 7f8e0cebc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080c17b0 con 0x7f8e0814e0d0 2023-08-22T00:22:24.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.247+0000 7f8e0cebc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e08155260 con 0x7f8e080c61a0 2023-08-22T00:22:24.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.247+0000 7f8e0cebc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080bf9e0 con 0x7f8e08154c00 2023-08-22T00:22:24.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8e0814e0d0 0x7f8e080c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46168/0 (socket says 172.21.15.98:46168) 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 -- 172.21.15.98:0/3476137595 learned_addr learned my addr 172.21.15.98:0/3476137595 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/3476137595 >> v2:172.21.15.118:3300/0 conn(0x7f8e08154c00 0x7f8e0814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588712455 0 0) 0x7f8e080c17b0 con 0x7f8e0814e0d0 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df00033f0 con 0x7f8e0814e0d0 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847641799 0 0) 0x7f8df00033f0 con 0x7f8e0814e0d0 2023-08-22T00:22:24.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 >> v2:172.21.15.118:3300/0 conn(0x7f8e08154c00 msgr2=0x7f8e0814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:24.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 --2- 172.21.15.98:0/3476137595 >> v2:172.21.15.118:3300/0 conn(0x7f8e08154c00 0x7f8e0814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 >> v1:172.21.15.118:6789/0 conn(0x7f8e080c61a0 legacy=0x7f8e081544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080bfcc0 con 0x7f8e0814e0d0 2023-08-22T00:22:24.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/3476137595 >> v2:172.21.15.118:3300/0 conn(0x7f8e08154c00 0x7f8e0814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:24.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8df8001470 con 0x7f8e0814e0d0 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 >> v1:172.21.15.98:6789/0 conn(0x7f8e0814e0d0 legacy=0x7f8e080c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 0x7f8df0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8df0004690 0x7f8df0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df0005000 0x7f8df000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080bf9e0 con 0x7f8df00038e0 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df000bf60 con 0x7f8df0004690 2023-08-22T00:22:24.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df000c0f0 con 0x7f8df0005000 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 0x7f8df0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e05d9b700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8df0004690 0x7f8df0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df0005000 0x7f8df000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 -- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df0005000 msgr2=0x7f8df000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df0005000 0x7f8df000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 -- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8df0004690 msgr2=0x7f8df0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:24.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.248+0000 7f8e0659c700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8df0004690 0x7f8df0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0659c700 1 -- 172.21.15.98:0/3476137595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00033f0 con 0x7f8df00038e0 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e06d9d700 1 -- 172.21.15.98:0/3476137595 reap_dead start 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e05d9b700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8df0004690 0x7f8df0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0659c700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 0x7f8df0003d00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f8df800c190 tx=0x7f8df8001e50).ready entity=mon.0 client_cookie=aed5806d4a71e8ae server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8007a20 con 0x7f8df00038e0 2023-08-22T00:22:24.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800cac0 con 0x7f8df00038e0 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0559a700 1 -- 172.21.15.98:0/3476137595 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800ce40 con 0x7f8df00038e0 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 -- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 msgr2=0x7f8df0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 0x7f8df0003d00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f8df800c190 tx=0x7f8df8001e50).stop 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 -- 172.21.15.98:0/3476137595 shutdown_connections 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/3476137595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8df00038e0 0x7f8df0003d00 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 -- 172.21.15.98:0/3476137595 >> 172.21.15.98:0/3476137595 conn(0x7f8e080caa80 msgr2=0x7f8e080cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:24.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 -- 172.21.15.98:0/3476137595 shutdown_connections 2023-08-22T00:22:24.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.249+0000 7f8e0cebc700 1 -- 172.21.15.98:0/3476137595 wait complete. 2023-08-22T00:22:24.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.250+0000 7f8e0cebc700 1 Processor -- start 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.250+0000 7f8e0cebc700 1 -- start start 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df00038e0 0x7f8e080b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e080c3500 0x7f8e081677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c2af0 con 0x7f8e08167cd0 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080b0bb0 con 0x7f8e080c3500 2023-08-22T00:22:24.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0cebc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c3070 con 0x7f8df00038e0 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54990/0 (socket says 172.21.15.98:54990) 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e06d9d700 1 -- 172.21.15.98:0/852506046 learned_addr learned my addr 172.21.15.98:0/852506046 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e0659c700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df00038e0 0x7f8e080b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.251+0000 7f8e05d9b700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e080c3500 0x7f8e081677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 -- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df00038e0 msgr2=0x7f8e080b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df00038e0 0x7f8e080b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 -- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e080c3500 msgr2=0x7f8e081677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e080c3500 0x7f8e081677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 -- 172.21.15.98:0/852506046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08168230 con 0x7f8e08167cd0 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e06d9d700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8e08065370 tx=0x7f8e0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000e070 con 0x7f8e08167cd0 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00011c50 con 0x7f8e08167cd0 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e08168510 con 0x7f8e08167cd0 2023-08-22T00:22:24.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00016450 con 0x7f8e08167cd0 2023-08-22T00:22:24.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.252+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080c3980 con 0x7f8e08167cd0 2023-08-22T00:22:24.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.253+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e08047480 con 0x7f8e08167cd0 2023-08-22T00:22:24.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.253+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8e00016800 con 0x7f8e08167cd0 2023-08-22T00:22:24.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.253+0000 7f8df67fc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 0x7f8de80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.254+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f8e0007a440 con 0x7f8e08167cd0 2023-08-22T00:22:24.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.254+0000 7f8e0659c700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 0x7f8de80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.254+0000 7f8e0659c700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 0x7f8de80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8df8001ed0 tx=0x7f8df8015000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.258+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e0004b7a0 con 0x7f8e08167cd0 2023-08-22T00:22:24.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.482+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f8e08063680 con 0x7f8e08167cd0 2023-08-22T00:22:24.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.489+0000 7f8df67fc700 1 -- 172.21.15.98:0/852506046 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v602) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8e0004edc0 con 0x7f8e08167cd0 2023-08-22T00:22:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 msgr2=0x7f8de80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 0x7f8de80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8df8001ed0 tx=0x7f8df8015000).stop 2023-08-22T00:22:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 msgr2=0x7f8e080c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8e08065370 tx=0x7f8e0000b040).stop 2023-08-22T00:22:24.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 shutdown_connections 2023-08-22T00:22:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8de805ef30 0x7f8de80613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8df00038e0 0x7f8e080b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e08167cd0 0x7f8e080c9b20 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 --2- 172.21.15.98:0/852506046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e080c3500 0x7f8e081677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.490+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 >> 172.21.15.98:0/852506046 conn(0x7f8e080caa80 msgr2=0x7f8e08153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.491+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 shutdown_connections 2023-08-22T00:22:24.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.491+0000 7f8e0cebc700 1 -- 172.21.15.98:0/852506046 wait complete. 2023-08-22T00:22:24.503 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-08-22T00:22:24.504 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:22:24.504 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-22T00:22:24.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.619+0000 7f2b96cad700 1 Processor -- start 2023-08-22T00:22:24.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.619+0000 7f2b96cad700 1 -- start start 2023-08-22T00:22:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.620+0000 7f2b96cad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b90151d60 0x7f2b90155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.620+0000 7f2b96cad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.620+0000 7f2b96cad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b90158bf0 con 0x7f2b90066400 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.620+0000 7f2b96cad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b90157d90 con 0x7f2b90151d60 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.620+0000 7f2b96cad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90066870 con 0x7f2b900a6e50 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b90151d60 0x7f2b90155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:38926/0 (socket says 172.21.15.98:38926) 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8ffff700 1 -- 172.21.15.98:0/2163518459 learned_addr learned my addr 172.21.15.98:0/2163518459 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 -- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 msgr2=0x7f2b90065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:24.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 -- 172.21.15.98:0/2163518459 >> v1:172.21.15.118:6789/0 conn(0x7f2b90066400 legacy=0x7f2b900bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8f7fe700 1 -- 172.21.15.98:0/2163518459 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233307608 0 0) 0x7f2b90158bf0 con 0x7f2b90066400 2023-08-22T00:22:24.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 -- 172.21.15.98:0/2163518459 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90157fe0 con 0x7f2b90151d60 2023-08-22T00:22:24.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8ffff700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b94a49700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90151d60 0x7f2b90155240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2b84009760 tx=0x7f2b84009060).ready entity=mon.1 client_cookie=bbc5e6e90c60c826 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8f7fe700 1 -- 172.21.15.98:0/2163518459 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8400f510 con 0x7f2b90151d60 2023-08-22T00:22:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8f7fe700 1 -- 172.21.15.98:0/2163518459 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8400f670 con 0x7f2b90151d60 2023-08-22T00:22:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.621+0000 7f2b8f7fe700 1 -- 172.21.15.98:0/2163518459 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8400f9f0 con 0x7f2b90151d60 2023-08-22T00:22:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 -- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90151d60 msgr2=0x7f2b90155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90151d60 0x7f2b90155240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2b84009760 tx=0x7f2b84009060).stop 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 -- 172.21.15.98:0/2163518459 shutdown_connections 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90151d60 0x7f2b90155240 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 --2- 172.21.15.98:0/2163518459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b90065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 -- 172.21.15.98:0/2163518459 >> 172.21.15.98:0/2163518459 conn(0x7f2b9006a980 msgr2=0x7f2b900c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 -- 172.21.15.98:0/2163518459 shutdown_connections 2023-08-22T00:22:24.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.622+0000 7f2b96cad700 1 -- 172.21.15.98:0/2163518459 wait complete. 2023-08-22T00:22:24.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.623+0000 7f2b96cad700 1 Processor -- start 2023-08-22T00:22:24.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.623+0000 7f2b96cad700 1 -- start start 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90066400 0x7f2b900ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b900a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900ac100 con 0x7f2b90151d60 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900a8a50 con 0x7f2b90066400 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b96cad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900a54f0 con 0x7f2b900a6e50 2023-08-22T00:22:24.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54992/0 (socket says 172.21.15.98:54992) 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 -- 172.21.15.98:0/4231444080 learned_addr learned my addr 172.21.15.98:0/4231444080 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b8ffff700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b900a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b94a49700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90066400 0x7f2b900ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 -- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 msgr2=0x7f2b900a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b900a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 -- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90066400 msgr2=0x7f2b900ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90066400 0x7f2b900ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.624+0000 7f2b9524a700 1 -- 172.21.15.98:0/4231444080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c009370 con 0x7f2b90151d60 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b9524a700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f2b8800c810 tx=0x7f2b88001500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88010510 con 0x7f2b90151d60 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88010670 con 0x7f2b90151d60 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b840092a0 con 0x7f2b90151d60 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88010a10 con 0x7f2b90151d60 2023-08-22T00:22:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.625+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b900a4a30 con 0x7f2b90151d60 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.626+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b900a8bc0 con 0x7f2b90151d60 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.626+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2b88012440 con 0x7f2b90151d60 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.626+0000 7f2b8cff9700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 0x7f2b740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.626+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f2b88079970 con 0x7f2b90151d60 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.627+0000 7f2b94a49700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 0x7f2b740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.627+0000 7f2b94a49700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 0x7f2b740613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2b84009760 tx=0x7f2b84017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:24.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.631+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b880488f0 con 0x7f2b90151d60 2023-08-22T00:22:24.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:24.855+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f2b90047480 con 0x7f2b90151d60 2023-08-22T00:22:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.494+0000 7f2b8cff9700 1 -- 172.21.15.98:0/4231444080 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v603) v1 ==== 186+0+0 (secure 0 0 0) 0x7f2b8804e700 con 0x7f2b90151d60 2023-08-22T00:22:25.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 msgr2=0x7f2b740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 0x7f2b740613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2b84009760 tx=0x7f2b84017000).stop 2023-08-22T00:22:25.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 msgr2=0x7f2b900a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f2b8800c810 tx=0x7f2b88001500).stop 2023-08-22T00:22:25.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 shutdown_connections 2023-08-22T00:22:25.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b90151d60 0x7f2b900a8ee0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b90066400 0x7f2b900ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2b7405ef30 0x7f2b740613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 --2- 172.21.15.98:0/4231444080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2b900a6e50 0x7f2b900a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 >> 172.21.15.98:0/4231444080 conn(0x7f2b9006a980 msgr2=0x7f2b900c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:25.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 shutdown_connections 2023-08-22T00:22:25.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.497+0000 7f2b96cad700 1 -- 172.21.15.98:0/4231444080 wait complete. 2023-08-22T00:22:25.512 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:22:25.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.635+0000 7f4c67428700 1 Processor -- start 2023-08-22T00:22:25.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.635+0000 7f4c67428700 1 -- start start 2023-08-22T00:22:25.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c67428700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4c60150e30 0x7f4c600c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c67428700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c60063560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c67428700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600c1010 con 0x7f4c60150a50 2023-08-22T00:22:25.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c67428700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600c6480 con 0x7f4c60150e30 2023-08-22T00:22:25.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c67428700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c6270 con 0x7f4c600c38c0 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c651c4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4c60150a50 0x7f4c600a9790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46172/0 (socket says 172.21.15.98:46172) 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c651c4700 1 -- 172.21.15.98:0/3337367316 learned_addr learned my addr 172.21.15.98:0/3337367316 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c659c5700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c60063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214603281 0 0) 0x7f4c600c1010 con 0x7f4c60150a50 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c649c3700 1 --2- 172.21.15.98:0/3337367316 >> v2:172.21.15.118:3300/0 conn(0x7f4c60150e30 0x7f4c600c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c4c0033f0 con 0x7f4c60150a50 2023-08-22T00:22:25.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234645220 0 0) 0x7f4c4c0033f0 con 0x7f4c60150a50 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 msgr2=0x7f4c60063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c60063560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 >> v2:172.21.15.118:3300/0 conn(0x7f4c60150e30 msgr2=0x7f4c600c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 --2- 172.21.15.98:0/3337367316 >> v2:172.21.15.118:3300/0 conn(0x7f4c60150e30 0x7f4c600c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600630d0 con 0x7f4c60150a50 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4c50001470 con 0x7f4c60150a50 2023-08-22T00:22:25.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 >> v1:172.21.15.98:6789/0 conn(0x7f4c60150a50 legacy=0x7f4c600a9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c6480 con 0x7f4c4c004b80 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c6270 con 0x7f4c4c0038e0 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c00b8e0 con 0x7f4c600c38c0 2023-08-22T00:22:25.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c659c5700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c649c3700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.637+0000 7f4c651c4700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 -- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 msgr2=0x7f4c4c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:25.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c600c38c0 0x7f4c4c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 -- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c4c0038e0 msgr2=0x7f4c4c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 -- 172.21.15.98:0/3337367316 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0033f0 con 0x7f4c4c004b80 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f4c5800e210 tx=0x7f4c5800b040).ready entity=mon.0 client_cookie=30a22cc28bc92ce8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58009ac0 con 0x7f4c4c004b80 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5800f040 con 0x7f4c4c004b80 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c57fff700 1 -- 172.21.15.98:0/3337367316 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800ecd0 con 0x7f4c4c004b80 2023-08-22T00:22:25.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c67428700 1 -- 172.21.15.98:0/3337367316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 msgr2=0x7f4c4c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c67428700 1 --2- 172.21.15.98:0/3337367316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f4c5800e210 tx=0x7f4c5800b040).stop 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c659c5700 1 -- 172.21.15.98:0/3337367316 reap_dead start 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c67428700 1 -- 172.21.15.98:0/3337367316 shutdown_connections 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.638+0000 7f4c67428700 1 -- 172.21.15.98:0/3337367316 >> 172.21.15.98:0/3337367316 conn(0x7f4c600c71e0 msgr2=0x7f4c600c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.639+0000 7f4c67428700 1 -- 172.21.15.98:0/3337367316 shutdown_connections 2023-08-22T00:22:25.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.639+0000 7f4c67428700 1 -- 172.21.15.98:0/3337367316 wait complete. 2023-08-22T00:22:25.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.640+0000 7f4c67428700 1 Processor -- start 2023-08-22T00:22:25.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.640+0000 7f4c67428700 1 -- start start 2023-08-22T00:22:25.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 0x7f4c600bf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c60154100 0x7f4c60154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6014df70 con 0x7f4c4c004b80 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60151e00 con 0x7f4c600bf190 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600bfb00 con 0x7f4c60154100 2023-08-22T00:22:25.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55012/0 (socket says 172.21.15.98:55012) 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 -- 172.21.15.98:0/94311112 learned_addr learned my addr 172.21.15.98:0/94311112 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c649c3700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 0x7f4c600bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c659c5700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c60154100 0x7f4c60154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 -- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c60154100 msgr2=0x7f4c60154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c60154100 0x7f4c60154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 -- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 msgr2=0x7f4c600bf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 0x7f4c600bf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 -- 172.21.15.98:0/94311112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60154a50 con 0x7f4c4c004b80 2023-08-22T00:22:25.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c649c3700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 0x7f4c600bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:25.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c651c4700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f4c50000fd0 tx=0x7f4c60063040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:25.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50004e10 con 0x7f4c4c004b80 2023-08-22T00:22:25.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50007e00 con 0x7f4c4c004b80 2023-08-22T00:22:25.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c601517f0 con 0x7f4c4c004b80 2023-08-22T00:22:25.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50011e90 con 0x7f4c4c004b80 2023-08-22T00:22:25.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.641+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c60151a90 con 0x7f4c4c004b80 2023-08-22T00:22:25.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.642+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c60068070 con 0x7f4c4c004b80 2023-08-22T00:22:25.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.643+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4c50017640 con 0x7f4c4c004b80 2023-08-22T00:22:25.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.643+0000 7f4c557fa700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 0x7f4c440613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:25.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.643+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f4c5007c660 con 0x7f4c4c004b80 2023-08-22T00:22:25.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.643+0000 7f4c649c3700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 0x7f4c440613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:25.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.643+0000 7f4c649c3700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 0x7f4c440613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4c5c006f70 tx=0x7f4c5c008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:25.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.647+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c5004d970 con 0x7f4c4c004b80 2023-08-22T00:22:25.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.809+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4c60046c20 con 0x7f4c4c004b80 2023-08-22T00:22:25.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.813+0000 7f4c557fa700 1 -- 172.21.15.98:0/94311112 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c50050f90 con 0x7f4c4c004b80 2023-08-22T00:22:25.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.814+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 msgr2=0x7f4c440613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 0x7f4c440613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4c5c006f70 tx=0x7f4c5c008040).stop 2023-08-22T00:22:25.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 msgr2=0x7f4c6013d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:25.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f4c50000fd0 tx=0x7f4c60063040).stop 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 shutdown_connections 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4c4405ef00 0x7f4c440613c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c60154100 0x7f4c60154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c4c004b80 0x7f4c6013d380 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 --2- 172.21.15.98:0/94311112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c600bf190 0x7f4c600bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 >> 172.21.15.98:0/94311112 conn(0x7f4c600c71e0 msgr2=0x7f4c600a96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 shutdown_connections 2023-08-22T00:22:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:25.815+0000 7f4c67428700 1 -- 172.21.15.98:0/94311112 wait complete. 2023-08-22T00:22:25.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:22:25.828 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:22:25.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:22:25.918 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:22:25.919 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:22:25.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:26.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.034+0000 7f703c8a8700 1 Processor -- start 2023-08-22T00:22:26.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.034+0000 7f703c8a8700 1 -- start start 2023-08-22T00:22:26.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703c8a8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7038154260 0x7f70380c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703c8a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f7038154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703c8a8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380c4fb0 con 0x7f70380bc850 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703c8a8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703814e7b0 con 0x7f7038154260 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703c8a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380bcfc0 con 0x7f70380c64a0 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7038154260 0x7f70380c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f7035d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f70380bc850 0x7f7038154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46176/0 (socket says 172.21.15.98:46176) 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7038154260 0x7f70380c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55024/0 (socket says 172.21.15.98:55024) 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f7035d9b700 1 -- 172.21.15.98:0/3005873228 learned_addr learned my addr 172.21.15.98:0/3005873228 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 -- 172.21.15.98:0/3005873228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 msgr2=0x7f7038154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:26.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 --2- 172.21.15.98:0/3005873228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f7038154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 -- 172.21.15.98:0/3005873228 >> v1:172.21.15.98:6789/0 conn(0x7f70380bc850 legacy=0x7f7038154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 -- 172.21.15.98:0/3005873228 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380bd2a0 con 0x7f7038154260 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703559a700 1 -- 172.21.15.98:0/3005873228 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986338253 0 0) 0x7f70380c4fb0 con 0x7f70380bc850 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703659c700 1 --2- 172.21.15.98:0/3005873228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f70380c2030 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f7028009760 tx=0x7f7028009060).ready entity=mon.0 client_cookie=944fe930c36fded7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703559a700 1 -- 172.21.15.98:0/3005873228 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800b610 con 0x7f7038154260 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703559a700 1 -- 172.21.15.98:0/3005873228 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702800b770 con 0x7f7038154260 2023-08-22T00:22:26.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.035+0000 7f703559a700 1 -- 172.21.15.98:0/3005873228 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800baf0 con 0x7f7038154260 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 -- 172.21.15.98:0/3005873228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 msgr2=0x7f70380c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 --2- 172.21.15.98:0/3005873228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f70380c2030 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f7028009760 tx=0x7f7028009060).stop 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 -- 172.21.15.98:0/3005873228 shutdown_connections 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 --2- 172.21.15.98:0/3005873228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f7038154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 --2- 172.21.15.98:0/3005873228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f70380c2030 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 -- 172.21.15.98:0/3005873228 >> 172.21.15.98:0/3005873228 conn(0x7f70380c3980 msgr2=0x7f70380c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:26.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 -- 172.21.15.98:0/3005873228 shutdown_connections 2023-08-22T00:22:26.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.036+0000 7f703c8a8700 1 -- 172.21.15.98:0/3005873228 wait complete. 2023-08-22T00:22:26.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.037+0000 7f703c8a8700 1 Processor -- start 2023-08-22T00:22:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.037+0000 7f703c8a8700 1 -- start start 2023-08-22T00:22:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380bc850 0x7f703814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f70380668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703814dec0 con 0x7f7038154260 2023-08-22T00:22:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380672b0 con 0x7f70380bc850 2023-08-22T00:22:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f703c8a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7038164540 con 0x7f70380c64a0 2023-08-22T00:22:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55026/0 (socket says 172.21.15.98:55026) 2023-08-22T00:22:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 -- 172.21.15.98:0/2881686965 learned_addr learned my addr 172.21.15.98:0/2881686965 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:26.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 -- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 msgr2=0x7f70380668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f70380668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 -- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380bc850 msgr2=0x7f703814d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380bc850 0x7f703814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 -- 172.21.15.98:0/2881686965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280092a0 con 0x7f7038154260 2023-08-22T00:22:26.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.038+0000 7f7036d9d700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f703000bb60 tx=0x7f7030009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.039+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000c940 con 0x7f7038154260 2023-08-22T00:22:26.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.039+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000cac0 con 0x7f7038154260 2023-08-22T00:22:26.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.039+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70380aaaf0 con 0x7f7038154260 2023-08-22T00:22:26.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.039+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000cc70 con 0x7f7038154260 2023-08-22T00:22:26.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.039+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70381641d0 con 0x7f7038154260 2023-08-22T00:22:26.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.040+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7038047480 con 0x7f7038154260 2023-08-22T00:22:26.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.040+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7030012020 con 0x7f7038154260 2023-08-22T00:22:26.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.041+0000 7f70267fc700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 0x7f70180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.041+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f703007a5c0 con 0x7f7038154260 2023-08-22T00:22:26.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.041+0000 7f703659c700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 0x7f70180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.041+0000 7f703659c700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 0x7f70180613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7038156380 tx=0x7f7028017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.044+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f703004b990 con 0x7f7038154260 2023-08-22T00:22:26.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.244+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70380bd580 con 0x7f7038154260 2023-08-22T00:22:26.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.245+0000 7f70267fc700 1 -- 172.21.15.98:0/2881686965 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7030009910 con 0x7f7038154260 2023-08-22T00:22:26.246 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:26.246 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1809394239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1809394239},{"type":"v1","addr":"172.21.15.98:6836","nonce":1809394239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6424,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3453688508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3453688508},{"type":"v1","addr":"172.21.15.118:6834","nonce":3453688508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6427,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4253237609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4253237609},{"type":"v1","addr":"172.21.15.118:6835","nonce":4253237609}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1293889111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1293889111},{"type":"v1","addr":"172.21.15.98:6837","nonce":1293889111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-08-22T00:22:26.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 msgr2=0x7f70180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 0x7f70180613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7038156380 tx=0x7f7028017000).stop 2023-08-22T00:22:26.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 msgr2=0x7f7038066dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f703000bb60 tx=0x7f7030009810).stop 2023-08-22T00:22:26.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 shutdown_connections 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7038154260 0x7f7038066dc0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380bc850 0x7f703814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f701805ef30 0x7f70180613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 --2- 172.21.15.98:0/2881686965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380c64a0 0x7f70380668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 >> 172.21.15.98:0/2881686965 conn(0x7f70380c3980 msgr2=0x7f7038156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 shutdown_connections 2023-08-22T00:22:26.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.247+0000 7f703c8a8700 1 -- 172.21.15.98:0/2881686965 wait complete. 2023-08-22T00:22:26.250 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 38 2023-08-22T00:22:26.260 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:22:26.260 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:22:26.260 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:22:26.261 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:22:26.261 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:22:26.261 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:22:26.261 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:22:26.261 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:22:26.262 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:22:26.262 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:22:26.262 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:22:26.262 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:22:26.263 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:22:26.263 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:22:26.263 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:22:26.263 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:22:26.269 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:22:26.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:22:26.270 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:22:26.270 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:22:26.273 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:22:26.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:22:26.274 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:22:26.274 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:22:26.312 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:22:26.312 DEBUG:teuthology.parallel:result is None 2023-08-22T00:22:26.314 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:22:26.314 DEBUG:teuthology.parallel:result is None 2023-08-22T00:22:26.317 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:22:26.317 DEBUG:teuthology.parallel:result is None 2023-08-22T00:22:26.318 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:22:26.319 DEBUG:teuthology.parallel:result is None 2023-08-22T00:22:26.319 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:22:26.387 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:22:26.387 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:22:26.410 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:22:26.411 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:22:26.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.444+0000 7f6de30fc700 1 Processor -- start 2023-08-22T00:22:26.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.444+0000 7f6de30fc700 1 -- start start 2023-08-22T00:22:26.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.445+0000 7f6de30fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ddc0bcc10 0x7f6ddc0bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.445+0000 7f6de30fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de30fc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0c1840 con 0x7f6ddc0c2960 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de30fc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c2e10 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de30fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0bc640 con 0x7f6ddc066da0 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ddc0bcc10 0x7f6ddc0bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddbfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6ddc0c2960 0x7f6ddc066690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46186/0 (socket says 172.21.15.98:46186) 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddbfff700 1 -- 172.21.15.98:0/1469371488 learned_addr learned my addr 172.21.15.98:0/1469371488 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:26.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de1699700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 -- 172.21.15.98:0/1469371488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 msgr2=0x7f6ddc151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 -- 172.21.15.98:0/1469371488 >> v1:172.21.15.98:6789/0 conn(0x7f6ddc0c2960 legacy=0x7f6ddc066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddb7fe700 1 -- 172.21.15.98:0/1469371488 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717343102 0 0) 0x7f6ddc0c1840 con 0x7f6ddc0c2960 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 -- 172.21.15.98:0/1469371488 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc152010 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6de0e98700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0bcff0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6dd4009e60 tx=0x7f6dd4009780).ready entity=mon.0 client_cookie=b782cdb27b149686 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddb7fe700 1 -- 172.21.15.98:0/1469371488 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400e070 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddb7fe700 1 -- 172.21.15.98:0/1469371488 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400bc30 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.446+0000 7f6ddb7fe700 1 -- 172.21.15.98:0/1469371488 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4012410 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 -- 172.21.15.98:0/1469371488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0bcc10 msgr2=0x7f6ddc0bcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0bcff0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6dd4009e60 tx=0x7f6dd4009780).stop 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 -- 172.21.15.98:0/1469371488 shutdown_connections 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 --2- 172.21.15.98:0/1469371488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0bcff0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 -- 172.21.15.98:0/1469371488 >> 172.21.15.98:0/1469371488 conn(0x7f6ddc0c3170 msgr2=0x7f6ddc0c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:26.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 -- 172.21.15.98:0/1469371488 shutdown_connections 2023-08-22T00:22:26.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.447+0000 7f6de30fc700 1 -- 172.21.15.98:0/1469371488 wait complete. 2023-08-22T00:22:26.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.448+0000 7f6de30fc700 1 Processor -- start 2023-08-22T00:22:26.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.448+0000 7f6de30fc700 1 -- start start 2023-08-22T00:22:26.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1665b0 con 0x7f6ddc0c2960 2023-08-22T00:22:26.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0ac270 con 0x7f6ddc0bcc10 2023-08-22T00:22:26.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de30fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1655e0 con 0x7f6ddc066da0 2023-08-22T00:22:26.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de1699700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de1699700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55080/0 (socket says 172.21.15.98:55080) 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.449+0000 7f6de1699700 1 -- 172.21.15.98:0/2845841346 learned_addr learned my addr 172.21.15.98:0/2845841346 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de0e98700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6ddbfff700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 -- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 msgr2=0x7f6ddc14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 -- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 msgr2=0x7f6ddc0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 -- 172.21.15.98:0/2845841346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009a20 con 0x7f6ddc0c2960 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6ddbfff700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de1699700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6dcc00bfd0 tx=0x7f6dcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011590 con 0x7f6ddc0c2960 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0116f0 con 0x7f6ddc0c2960 2023-08-22T00:22:26.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011a70 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc166120 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.450+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc165ad0 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.451+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc1662b0 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.451+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6dcc012420 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.452+0000 7f6dd8ff9700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 0x7f6dbc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.452+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f6dcc079950 con 0x7f6ddc0c2960 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.452+0000 7f6de0e98700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 0x7f6dbc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:26.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.452+0000 7f6de0e98700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 0x7f6dbc0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6dd4009e60 tx=0x7f6dd4009780).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:26.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.456+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dcc04ac00 con 0x7f6ddc0c2960 2023-08-22T00:22:26.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:26.633+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6ddc0c0f10 con 0x7f6ddc0c2960 2023-08-22T00:22:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.504+0000 7f6dd8ff9700 1 -- 172.21.15.98:0/2845841346 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6dcc011e60 con 0x7f6ddc0c2960 2023-08-22T00:22:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 msgr2=0x7f6dbc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 0x7f6dbc0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6dd4009e60 tx=0x7f6dd4009780).stop 2023-08-22T00:22:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 msgr2=0x7f6ddc0abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6dcc00bfd0 tx=0x7f6dcc008040).stop 2023-08-22T00:22:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 shutdown_connections 2023-08-22T00:22:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6dbc05ef30 0x7f6dbc0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ddc066da0 0x7f6ddc14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ddc0c2960 0x7f6ddc0abd80 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 --2- 172.21.15.98:0/2845841346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc0bcc10 0x7f6ddc0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 >> 172.21.15.98:0/2845841346 conn(0x7f6ddc0c3170 msgr2=0x7f6ddc152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 shutdown_connections 2023-08-22T00:22:27.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.507+0000 7f6de30fc700 1 -- 172.21.15.98:0/2845841346 wait complete. 2023-08-22T00:22:27.511 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:22:27.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:22:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.643+0000 7fbade5a6700 1 Processor -- start 2023-08-22T00:22:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.643+0000 7fbade5a6700 1 -- start start 2023-08-22T00:22:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.644+0000 7fbade5a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 0x7fbad814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.644+0000 7fbade5a6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbad81544f0 0x7fbad8154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.644+0000 7fbade5a6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad8155260 con 0x7fbad80c5a90 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.644+0000 7fbade5a6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad80c17b0 con 0x7fbad81544f0 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.644+0000 7fbade5a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80bf9e0 con 0x7fbad814e0d0 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 0x7fbad814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbad81544f0 0x7fbad8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad77fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbad80c5a90 0x7fbad80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56010/0 (socket says 172.21.15.98:56010) 2023-08-22T00:22:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad77fe700 1 -- 172.21.15.98:0/3120511247 learned_addr learned my addr 172.21.15.98:0/3120511247 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 -- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 msgr2=0x7fbad814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 0x7fbad814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 -- 172.21.15.98:0/3120511247 >> v1:172.21.15.118:6789/0 conn(0x7fbad80c5a90 legacy=0x7fbad80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 -- 172.21.15.98:0/3120511247 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80bfcc0 con 0x7fbad81544f0 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad6ffd700 1 -- 172.21.15.98:0/3120511247 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094053708 0 0) 0x7fbad8155260 con 0x7fbad80c5a90 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad7fff700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 0x7fbad814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbadcb43700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad81544f0 0x7fbad8154980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbad0009e60 tx=0x7fbad0009780).ready entity=mon.1 client_cookie=19b8c9a5fe9a9805 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad6ffd700 1 -- 172.21.15.98:0/3120511247 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000e070 con 0x7fbad81544f0 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad6ffd700 1 -- 172.21.15.98:0/3120511247 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad000bb60 con 0x7fbad81544f0 2023-08-22T00:22:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.645+0000 7fbad6ffd700 1 -- 172.21.15.98:0/3120511247 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0012410 con 0x7fbad81544f0 2023-08-22T00:22:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 -- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad81544f0 msgr2=0x7fbad8154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad81544f0 0x7fbad8154980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbad0009e60 tx=0x7fbad0009780).stop 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 -- 172.21.15.98:0/3120511247 shutdown_connections 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad81544f0 0x7fbad8154980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 --2- 172.21.15.98:0/3120511247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad814e0d0 0x7fbad814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 -- 172.21.15.98:0/3120511247 >> 172.21.15.98:0/3120511247 conn(0x7fbad80caa80 msgr2=0x7fbad80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 -- 172.21.15.98:0/3120511247 shutdown_connections 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.646+0000 7fbade5a6700 1 -- 172.21.15.98:0/3120511247 wait complete. 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.647+0000 7fbade5a6700 1 Processor -- start 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.647+0000 7fbade5a6700 1 -- start start 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad80c5a90 0x7fbad813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad814e0d0 0x7fbad80b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81500d0 con 0x7fbad81544f0 2023-08-22T00:22:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad814f4c0 con 0x7fbad814e0d0 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbade5a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad814f7a0 con 0x7fbad80c5a90 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55082/0 (socket says 172.21.15.98:55082) 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 -- 172.21.15.98:0/4109043875 learned_addr learned my addr 172.21.15.98:0/4109043875 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbad77fe700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad814e0d0 0x7fbad80b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbad7fff700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad80c5a90 0x7fbad813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 -- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad80c5a90 msgr2=0x7fbad813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad80c5a90 0x7fbad813ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 -- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad814e0d0 msgr2=0x7fbad80b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad814e0d0 0x7fbad80b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.648+0000 7fbadcb43700 1 -- 172.21.15.98:0/4109043875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80092a0 con 0x7fbad81544f0 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbadcb43700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fbad81543e0 tx=0x7fbad80c68f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000b6f0 con 0x7fbad81544f0 2023-08-22T00:22:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad001d630 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad0009a20 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad001d9d0 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.649+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad814fd60 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.650+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8047480 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.650+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbad0003040 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.650+0000 7fbacffff700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 0x7fbab80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.650+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fbad007bcc0 con 0x7fbad81544f0 2023-08-22T00:22:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.650+0000 7fbad7fff700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 0x7fbab80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.651+0000 7fbad7fff700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 0x7fbab80613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbac8009dc0 tx=0x7fbac8009060).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.655+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbad004d1a0 con 0x7fbad81544f0 2023-08-22T00:22:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.879+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbad8064ef0 con 0x7fbad81544f0 2023-08-22T00:22:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.879+0000 7fbacffff700 1 -- 172.21.15.98:0/4109043875 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbad00507c0 con 0x7fbad81544f0 2023-08-22T00:22:27.881 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:27.881 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:22:27.881 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:22:27.882 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.883 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:22:27.884 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:22:27.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.887 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:22:27.888 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:22:27.889 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.890 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.893 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.894 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:22:27.895 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.898 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:22:27.898 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:22:27.898 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.898 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:22:27.899 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:22:27.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:22:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.903 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:22:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:22:27.905 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 msgr2=0x7fbab80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 0x7fbab80613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbac8009dc0 tx=0x7fbac8009060).stop 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 msgr2=0x7fbad80abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fbad81543e0 tx=0x7fbad80c68f0).stop 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 shutdown_connections 2023-08-22T00:22:27.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbab805ef30 0x7fbab80613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad80c5a90 0x7fbad813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbad81544f0 0x7fbad80abd00 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 --2- 172.21.15.98:0/4109043875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad814e0d0 0x7fbad80b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 >> 172.21.15.98:0/4109043875 conn(0x7fbad80caa80 msgr2=0x7fbad80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 shutdown_connections 2023-08-22T00:22:27.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:27.881+0000 7fbade5a6700 1 -- 172.21.15.98:0/4109043875 wait complete. 2023-08-22T00:22:27.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:28.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.023+0000 7f0cb059f700 1 Processor -- start 2023-08-22T00:22:28.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.023+0000 7f0cb059f700 1 -- start start 2023-08-22T00:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cb059f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0ca814c350 0x7f0ca8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cb059f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca8153080 con 0x7f0ca814bf70 2023-08-22T00:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cb059f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80667b0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cb059f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca8066510 con 0x7f0ca814c350 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cadb3a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0ca814c350 0x7f0ca8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cae33b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0ca814bf70 0x7f0ca80c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46196/0 (socket says 172.21.15.98:46196) 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.024+0000 7f0cae33b700 1 -- 172.21.15.98:0/950436347 learned_addr learned my addr 172.21.15.98:0/950436347 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cadb3a700 1 -- 172.21.15.98:0/950436347 >> v1:172.21.15.118:6789/0 conn(0x7f0ca80c3e50 legacy=0x7f0ca80aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cadb3a700 1 -- 172.21.15.98:0/950436347 >> v1:172.21.15.98:6789/0 conn(0x7f0ca814bf70 legacy=0x7f0ca80c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cadb3a700 1 -- 172.21.15.98:0/950436347 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8155e00 con 0x7f0ca814c350 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cad339700 1 -- 172.21.15.98:0/950436347 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572204436 0 0) 0x7f0ca8153080 con 0x7f0ca814bf70 2023-08-22T00:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cadb3a700 1 --2- 172.21.15.98:0/950436347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca814c350 0x7f0ca8152b90 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0c98009760 tx=0x7f0c98009060).ready entity=mon.0 client_cookie=a077c60a2cf90eae server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cad339700 1 -- 172.21.15.98:0/950436347 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800b520 con 0x7f0ca814c350 2023-08-22T00:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cad339700 1 -- 172.21.15.98:0/950436347 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800b680 con 0x7f0ca814c350 2023-08-22T00:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cad339700 1 -- 172.21.15.98:0/950436347 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800ba00 con 0x7f0ca814c350 2023-08-22T00:22:28.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cb059f700 1 -- 172.21.15.98:0/950436347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca814c350 msgr2=0x7f0ca8152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.025+0000 7f0cb059f700 1 --2- 172.21.15.98:0/950436347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca814c350 0x7f0ca8152b90 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0c98009760 tx=0x7f0c98009060).stop 2023-08-22T00:22:28.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.026+0000 7f0cb059f700 1 -- 172.21.15.98:0/950436347 shutdown_connections 2023-08-22T00:22:28.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.026+0000 7f0cb059f700 1 --2- 172.21.15.98:0/950436347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca814c350 0x7f0ca8152b90 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.026+0000 7f0cb059f700 1 -- 172.21.15.98:0/950436347 >> 172.21.15.98:0/950436347 conn(0x7f0ca80c5dc0 msgr2=0x7f0ca8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.026+0000 7f0cb059f700 1 -- 172.21.15.98:0/950436347 shutdown_connections 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.026+0000 7f0cb059f700 1 -- 172.21.15.98:0/950436347 wait complete. 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 Processor -- start 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 -- start start 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ca814bf70 0x7f0ca81637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ca814c350 0x7f0ca8163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814cdd0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814c7f0 con 0x7f0ca814c350 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.027+0000 7f0cb059f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814e780 con 0x7f0ca814bf70 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55098/0 (socket says 172.21.15.98:55098) 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 -- 172.21.15.98:0/425058290 learned_addr learned my addr 172.21.15.98:0/425058290 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 -- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ca814bf70 msgr2=0x7f0ca81637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ca814bf70 0x7f0ca81637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 -- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ca814c350 msgr2=0x7f0ca8163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ca814c350 0x7f0ca8163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 -- 172.21.15.98:0/425058290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980092a0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cae33b700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f0ca000c4e0 tx=0x7f0ca0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00072e0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0007440 con 0x7f0ca80c3e50 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00057a0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca814ca60 con 0x7f0ca80c3e50 2023-08-22T00:22:28.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.028+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca814ea60 con 0x7f0ca80c3e50 2023-08-22T00:22:28.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.029+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80a7a70 con 0x7f0ca80c3e50 2023-08-22T00:22:28.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.029+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0ca0005bd0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.030+0000 7f0c9e7fc700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 0x7f0c8c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.030+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f0ca00797f0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.030+0000 7f0cadb3a700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 0x7f0c8c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.030+0000 7f0cadb3a700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 0x7f0c8c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0c98009760 tx=0x7f0c98017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.034+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ca004acd0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.197+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca8067a40 con 0x7f0ca80c3e50 2023-08-22T00:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.198+0000 7f0c9e7fc700 1 -- 172.21.15.98:0/425058290 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+14055 (secure 0 0 0) 0x7f0ca004e2f0 con 0x7f0ca80c3e50 2023-08-22T00:22:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:28.199 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":116,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:27.495687+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.199+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 msgr2=0x7f0c8c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.199+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 0x7f0c8c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0c98009760 tx=0x7f0c98017000).stop 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.199+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 msgr2=0x7f0ca814df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.199+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f0ca000c4e0 tx=0x7f0ca0007c70).stop 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 shutdown_connections 2023-08-22T00:22:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ca814c350 0x7f0ca8163cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ca80c3e50 0x7f0ca814df70 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0c8c05ef30 0x7f0c8c0613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 --2- 172.21.15.98:0/425058290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ca814bf70 0x7f0ca81637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 >> 172.21.15.98:0/425058290 conn(0x7f0ca80c5dc0 msgr2=0x7f0ca80c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 shutdown_connections 2023-08-22T00:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.200+0000 7f0cb059f700 1 -- 172.21.15.98:0/425058290 wait complete. 2023-08-22T00:22:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:22:28.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:22:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.331+0000 7fe78f294700 1 Processor -- start 2023-08-22T00:22:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.331+0000 7fe78f294700 1 -- start start 2023-08-22T00:22:28.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78f294700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe7880aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78f294700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe788157e60 0x7fe788062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78f294700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880c8d30 con 0x7fe788157a80 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78f294700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880c9010 con 0x7fe788157e60 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78f294700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c92f0 con 0x7fe788153e90 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78d030700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe788157a80 0x7fe788153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46204/0 (socket says 172.21.15.98:46204) 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.332+0000 7fe78d030700 1 -- 172.21.15.98:0/2201296176 learned_addr learned my addr 172.21.15.98:0/2201296176 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:28.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78c82f700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe7880aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d831700 1 --2- 172.21.15.98:0/2201296176 >> v2:172.21.15.118:3300/0 conn(0x7fe788157e60 0x7fe788062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607264030 0 0) 0x7fe7880c8d30 con 0x7fe788157a80 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7740033f0 con 0x7fe788157a80 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2139967441 0 0) 0x7fe7740033f0 con 0x7fe788157a80 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 msgr2=0x7fe7880aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe7880aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 >> v2:172.21.15.118:3300/0 conn(0x7fe788157e60 msgr2=0x7fe788062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 --2- 172.21.15.98:0/2201296176 >> v2:172.21.15.118:3300/0 conn(0x7fe788157e60 0x7fe788062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880c95d0 con 0x7fe788157a80 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe77c001470 con 0x7fe788157a80 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 >> v1:172.21.15.98:6789/0 conn(0x7fe788157a80 legacy=0x7fe788153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7740038e0 0x7fe774003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774004690 0x7fe774004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe774005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c9010 con 0x7fe7740038e0 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c92f0 con 0x7fe774004690 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77400b8e0 con 0x7fe788153e90 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7740038e0 0x7fe774003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78c82f700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774004690 0x7fe774004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d831700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe774005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 -- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 msgr2=0x7fe774005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe788153e90 0x7fe774005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 -- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774004690 msgr2=0x7fe774004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe774004690 0x7fe774004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.333+0000 7fe78d030700 1 -- 172.21.15.98:0/2201296176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740033f0 con 0x7fe7740038e0 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78d030700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7740038e0 0x7fe774003d00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fe77c00c210 tx=0x7fe7881542f0).ready entity=mon.0 client_cookie=f447f116ed2e425b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c007a60 con 0x7fe7740038e0 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c00cae0 con 0x7fe7740038e0 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe77bfff700 1 -- 172.21.15.98:0/2201296176 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00ce60 con 0x7fe7740038e0 2023-08-22T00:22:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 -- 172.21.15.98:0/2201296176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7740038e0 msgr2=0x7fe774003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 --2- 172.21.15.98:0/2201296176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7740038e0 0x7fe774003d00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fe77c00c210 tx=0x7fe7881542f0).stop 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78d831700 1 -- 172.21.15.98:0/2201296176 reap_dead start 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 -- 172.21.15.98:0/2201296176 shutdown_connections 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 -- 172.21.15.98:0/2201296176 >> 172.21.15.98:0/2201296176 conn(0x7fe7880cb5f0 msgr2=0x7fe7880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 -- 172.21.15.98:0/2201296176 shutdown_connections 2023-08-22T00:22:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.334+0000 7fe78f294700 1 -- 172.21.15.98:0/2201296176 wait complete. 2023-08-22T00:22:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.335+0000 7fe78f294700 1 Processor -- start 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.335+0000 7fe78f294700 1 -- start start 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740038e0 0x7fe788064780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe788064c70 0x7fe78814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78814d6e0 con 0x7fe78814cf80 2023-08-22T00:22:28.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788151130 con 0x7fe788064c70 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78f294700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe788151410 con 0x7fe7740038e0 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78d831700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78d831700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55120/0 (socket says 172.21.15.98:55120) 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.336+0000 7fe78d831700 1 -- 172.21.15.98:0/51404996 learned_addr learned my addr 172.21.15.98:0/51404996 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d030700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740038e0 0x7fe788064780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78c82f700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe788064c70 0x7fe78814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 -- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740038e0 msgr2=0x7fe788064780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740038e0 0x7fe788064780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 -- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe788064c70 msgr2=0x7fe78814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe788064c70 0x7fe78814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 -- 172.21.15.98:0/51404996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7881516f0 con 0x7fe78814cf80 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78d831700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fe788083c40 tx=0x7fe78000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000e040 con 0x7fe78814cf80 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000f040 con 0x7fe78814cf80 2023-08-22T00:22:28.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7881519d0 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000fd70 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.337+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7881456a0 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.338+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe788083630 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.338+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe780015660 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.339+0000 7fe7797fa700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 0x7fe76c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.339+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fe78007a720 con 0x7fe78814cf80 2023-08-22T00:22:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.339+0000 7fe78d030700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 0x7fe76c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.339+0000 7fe78d030700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 0x7fe76c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe77c000fd0 tx=0x7fe77c015000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.343+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe78004bc00 con 0x7fe78814cf80 2023-08-22T00:22:28.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.503+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe788046c20 con 0x7fe78814cf80 2023-08-22T00:22:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.506+0000 7fe7797fa700 1 -- 172.21.15.98:0/51404996 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v116) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe78004f220 con 0x7fe78814cf80 2023-08-22T00:22:28.507 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:22:28.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 msgr2=0x7fe76c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 0x7fe76c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe77c000fd0 tx=0x7fe77c015000).stop 2023-08-22T00:22:28.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 msgr2=0x7fe7881451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fe788083c40 tx=0x7fe78000b040).stop 2023-08-22T00:22:28.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 shutdown_connections 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe76c05ef30 0x7fe76c0613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7740038e0 0x7fe788064780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe78814cf80 0x7fe7881451b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 --2- 172.21.15.98:0/51404996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe788064c70 0x7fe78814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 >> 172.21.15.98:0/51404996 conn(0x7fe7880cb5f0 msgr2=0x7fe78814e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 shutdown_connections 2023-08-22T00:22:28.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.508+0000 7fe78f294700 1 -- 172.21.15.98:0/51404996 wait complete. 2023-08-22T00:22:28.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:22:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.638+0000 7f86c818d700 1 Processor -- start 2023-08-22T00:22:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.638+0000 7f86c818d700 1 -- start start 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c818d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f86c00a6210 0x7f86c01541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c818d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00c1900 con 0x7f86c0153e00 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c818d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0066cf0 con 0x7f86c00bcd40 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c818d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00c1bc0 con 0x7f86c00a6210 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c672a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f86c00a6210 0x7f86c01541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c5f29700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f86c0153e00 0x7f86c00bc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46220/0 (socket says 172.21.15.98:46220) 2023-08-22T00:22:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c5f29700 1 -- 172.21.15.98:0/1018172719 learned_addr learned my addr 172.21.15.98:0/1018172719 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c672a700 1 -- 172.21.15.98:0/1018172719 >> v1:172.21.15.118:6789/0 conn(0x7f86c00bcd40 legacy=0x7f86c00a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c672a700 1 -- 172.21.15.98:0/1018172719 >> v1:172.21.15.98:6789/0 conn(0x7f86c0153e00 legacy=0x7f86c00bc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c672a700 1 -- 172.21.15.98:0/1018172719 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0066450 con 0x7f86c00a6210 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.639+0000 7f86c4f27700 1 -- 172.21.15.98:0/1018172719 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156550325 0 0) 0x7f86c00c1900 con 0x7f86c0153e00 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c672a700 1 --2- 172.21.15.98:0/1018172719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00a6210 0x7f86c01541e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f86b8009e90 tx=0x7f86b8009780).ready entity=mon.0 client_cookie=dcec8f18e99e9b54 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c4f27700 1 -- 172.21.15.98:0/1018172719 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800e070 con 0x7f86c00a6210 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c4f27700 1 -- 172.21.15.98:0/1018172719 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800bbb0 con 0x7f86c00a6210 2023-08-22T00:22:28.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c4f27700 1 -- 172.21.15.98:0/1018172719 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8012410 con 0x7f86c00a6210 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 -- 172.21.15.98:0/1018172719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00a6210 msgr2=0x7f86c01541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 --2- 172.21.15.98:0/1018172719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00a6210 0x7f86c01541e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f86b8009e90 tx=0x7f86b8009780).stop 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 -- 172.21.15.98:0/1018172719 shutdown_connections 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 --2- 172.21.15.98:0/1018172719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00a6210 0x7f86c01541e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 -- 172.21.15.98:0/1018172719 >> 172.21.15.98:0/1018172719 conn(0x7f86c00c3600 msgr2=0x7f86c00c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 -- 172.21.15.98:0/1018172719 shutdown_connections 2023-08-22T00:22:28.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.640+0000 7f86c818d700 1 -- 172.21.15.98:0/1018172719 wait complete. 2023-08-22T00:22:28.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.641+0000 7f86c818d700 1 Processor -- start 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.641+0000 7f86c818d700 1 -- start start 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 0x7f86c0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86c0153e00 0x7f86c00c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c6770 con 0x7f86c00bcd40 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0141e10 con 0x7f86c00a6210 2023-08-22T00:22:28.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c818d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0164340 con 0x7f86c0153e00 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c5728700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c5728700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55144/0 (socket says 172.21.15.98:55144) 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c5728700 1 -- 172.21.15.98:0/821185910 learned_addr learned my addr 172.21.15.98:0/821185910 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c5f29700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 0x7f86c0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.642+0000 7f86c672a700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86c0153e00 0x7f86c00c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 -- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86c0153e00 msgr2=0x7f86c00c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86c0153e00 0x7f86c00c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 -- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 msgr2=0x7f86c0141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 0x7f86c0141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 -- 172.21.15.98:0/821185910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8009a20 con 0x7f86c00bcd40 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5f29700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 0x7f86c0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c5728700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f86bc00b490 tx=0x7f86bc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc012410 con 0x7f86c00bcd40 2023-08-22T00:22:28.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0125b0 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c0164620 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc012970 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.643+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c0164be0 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.644+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00681b0 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.644+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f86bc012d20 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.644+0000 7f86b5ffb700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 0x7f86a4061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.645+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f86bc079b40 con 0x7f86c00bcd40 2023-08-22T00:22:28.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.645+0000 7f86c5f29700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 0x7f86a4061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.645+0000 7f86c5f29700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 0x7f86a4061420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c00bc0a0 tx=0x7f86b0009040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.649+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86bc04b020 con 0x7f86c00bcd40 2023-08-22T00:22:28.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.809+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86c0066730 con 0x7f86c00bcd40 2023-08-22T00:22:28.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.810+0000 7f86b5ffb700 1 -- 172.21.15.98:0/821185910 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86bc04e640 con 0x7f86c00bcd40 2023-08-22T00:22:28.811 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 msgr2=0x7f86a4061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 0x7f86a4061420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c00bc0a0 tx=0x7f86b0009040).stop 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 msgr2=0x7f86c00c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f86bc00b490 tx=0x7f86bc009060).stop 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 shutdown_connections 2023-08-22T00:22:28.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.811+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f86a405ef60 0x7f86a4061420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86c0153e00 0x7f86c00c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c00a6210 0x7f86c0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 --2- 172.21.15.98:0/821185910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00bcd40 0x7f86c00c5d90 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 >> 172.21.15.98:0/821185910 conn(0x7f86c00c3600 msgr2=0x7f86c014ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 shutdown_connections 2023-08-22T00:22:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.812+0000 7f86c818d700 1 -- 172.21.15.98:0/821185910 wait complete. 2023-08-22T00:22:28.825 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:22:28.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.940+0000 7fc9bf892700 1 Processor -- start 2023-08-22T00:22:28.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.940+0000 7fc9bf892700 1 -- start start 2023-08-22T00:22:28.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bf892700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9b8153f40 0x7fc9b8157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bf892700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80a8410 con 0x7fc9b8153b60 2023-08-22T00:22:28.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bf892700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80a8cb0 con 0x7fc9b80a9140 2023-08-22T00:22:28.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bf892700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b81586a0 con 0x7fc9b8153f40 2023-08-22T00:22:28.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bd62e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc9b8153b60 0x7fc9b8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46236/0 (socket says 172.21.15.98:46236) 2023-08-22T00:22:28.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.941+0000 7fc9bd62e700 1 -- 172.21.15.98:0/8448593 learned_addr learned my addr 172.21.15.98:0/8448593 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:28.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57217027 0 0) 0x7fc9b80a8410 con 0x7fc9b8153b60 2023-08-22T00:22:28.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/8448593 >> v2:172.21.15.118:3300/0 conn(0x7fc9b8153f40 0x7fc9b8157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a40033f0 con 0x7fc9b8153b60 2023-08-22T00:22:28.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711219258 0 0) 0x7fc9a40033f0 con 0x7fc9b8153b60 2023-08-22T00:22:28.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 >> v2:172.21.15.118:3300/0 conn(0x7fc9b8153f40 msgr2=0x7fc9b8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 --2- 172.21.15.98:0/8448593 >> v2:172.21.15.118:3300/0 conn(0x7fc9b8153f40 0x7fc9b8157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 >> v1:172.21.15.118:6789/0 conn(0x7fc9b80a9140 legacy=0x7fc9b8157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80a8660 con 0x7fc9b8153b60 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc9a8001470 con 0x7fc9b8153b60 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 >> v1:172.21.15.98:6789/0 conn(0x7fc9b8153b60 legacy=0x7fc9b8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a40038e0 0x7fc9a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 0x7fc9a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a4005000 0x7fc9a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81586a0 con 0x7fc9a4004690 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a400beb0 con 0x7fc9a40038e0 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a400c070 con 0x7fc9a4005000 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 0x7fc9a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bd62e700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a40038e0 0x7fc9a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bde2f700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a4005000 0x7fc9a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 -- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a4005000 msgr2=0x7fc9a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9a4005000 0x7fc9a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 -- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a40038e0 msgr2=0x7fc9a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a40038e0 0x7fc9a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 -- 172.21.15.98:0/8448593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40033f0 con 0x7fc9a4004690 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bde2f700 1 -- 172.21.15.98:0/8448593 reap_dead start 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.942+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 0x7fc9a4004b10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fc9b4009a80 tx=0x7fc9b4009060).ready entity=mon.0 client_cookie=bf5e33808598b7c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4009430 con 0x7fc9a4004690 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400e640 con 0x7fc9a4004690 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9affff700 1 -- 172.21.15.98:0/8448593 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e9c0 con 0x7fc9a4004690 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 -- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 msgr2=0x7fc9a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 0x7fc9a4004b10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fc9b4009a80 tx=0x7fc9b4009060).stop 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 -- 172.21.15.98:0/8448593 shutdown_connections 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 --2- 172.21.15.98:0/8448593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a4004690 0x7fc9a4004b10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 -- 172.21.15.98:0/8448593 >> 172.21.15.98:0/8448593 conn(0x7fc9b80c5dc0 msgr2=0x7fc9b8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 -- 172.21.15.98:0/8448593 shutdown_connections 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.943+0000 7fc9bf892700 1 -- 172.21.15.98:0/8448593 wait complete. 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.945+0000 7fc9bf892700 1 Processor -- start 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.945+0000 7fc9bf892700 1 -- start start 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 0x7fc9b8143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9b80c69f0 0x7fc9b80bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8143900 con 0x7fc9b8167f70 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80bff90 con 0x7fc9a4004690 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bf892700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80660f0 con 0x7fc9b80c69f0 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55164/0 (socket says 172.21.15.98:55164) 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 -- 172.21.15.98:0/600879855 learned_addr learned my addr 172.21.15.98:0/600879855 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bde2f700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9b80c69f0 0x7fc9b80bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bd62e700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 0x7fc9b8143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 -- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9b80c69f0 msgr2=0x7fc9b80bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9b80c69f0 0x7fc9b80bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 -- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 msgr2=0x7fc9b8143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 0x7fc9b8143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 -- 172.21.15.98:0/600879855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80c6e70 con 0x7fc9b8167f70 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bd62e700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 0x7fc9b8143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.946+0000 7fc9bce2d700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fc9b400e4b0 tx=0x7fc9b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.947+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400ed70 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.947+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400eed0 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.947+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b8065800 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.947+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e9c0 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.947+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b8064060 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.948+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b8047480 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.948+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc9b4024600 con 0x7fc9b8167f70 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.948+0000 7fc9ad7fa700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 0x7fc99c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:28.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.948+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fc9b407b200 con 0x7fc9b8167f70 2023-08-22T00:22:28.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.948+0000 7fc9bd62e700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 0x7fc99c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:28.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.949+0000 7fc9bd62e700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 0x7fc99c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc9a8000e10 tx=0x7fc9a8009040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:28.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:28.952+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9b404c7b0 con 0x7fc9b8167f70 2023-08-22T00:22:29.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.115+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc9b8066230 con 0x7fc9b8167f70 2023-08-22T00:22:29.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.116+0000 7fc9ad7fa700 1 -- 172.21.15.98:0/600879855 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc9b4029090 con 0x7fc9b8167f70 2023-08-22T00:22:29.117 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:29.117 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:22:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:22:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:22:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:29.119 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:22:29.119 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:22:29.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:29.119 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:22:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 msgr2=0x7fc99c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 0x7fc99c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc9a8000e10 tx=0x7fc9a8009040).stop 2023-08-22T00:22:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 msgr2=0x7fc9b80c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fc9b400e4b0 tx=0x7fc9b401a000).stop 2023-08-22T00:22:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 shutdown_connections 2023-08-22T00:22:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc99c05ef30 0x7fc99c0613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9b80c69f0 0x7fc9b80bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a4004690 0x7fc9b8143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 --2- 172.21.15.98:0/600879855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b8167f70 0x7fc9b80c6500 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 >> 172.21.15.98:0/600879855 conn(0x7fc9b80c5dc0 msgr2=0x7fc9b8152510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 shutdown_connections 2023-08-22T00:22:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.117+0000 7fc9bf892700 1 -- 172.21.15.98:0/600879855 wait complete. 2023-08-22T00:22:29.130 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:22:29.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:22:29.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.251+0000 7fa008c41700 1 Processor -- start 2023-08-22T00:22:29.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.251+0000 7fa008c41700 1 -- start start 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa008c41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 0x7fa004068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa008c41700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa004069210 0x7fa004066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa008c41700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040a8c70 con 0x7fa0040673e0 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa008c41700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040a86f0 con 0x7fa004069210 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa008c41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa004068210 con 0x7fa004154f60 2023-08-22T00:22:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa001d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa004069210 0x7fa004066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa001d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa004069210 0x7fa004066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55170/0 (socket says 172.21.15.98:55170) 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.252+0000 7fa001d9b700 1 -- 172.21.15.98:0/3664630344 learned_addr learned my addr 172.21.15.98:0/3664630344 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa00259c700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 0x7fa004068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa001d9b700 1 -- 172.21.15.98:0/3664630344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 msgr2=0x7fa004068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa001d9b700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 0x7fa004068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa001d9b700 1 -- 172.21.15.98:0/3664630344 >> v1:172.21.15.118:6789/0 conn(0x7fa0040673e0 legacy=0x7fa0040be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa001d9b700 1 -- 172.21.15.98:0/3664630344 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004069690 con 0x7fa004069210 2023-08-22T00:22:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa00259c700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 0x7fa004068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa001d9b700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004069210 0x7fa004066ef0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f9ff4006fd0 tx=0x7f9ff40090f0).ready entity=mon.0 client_cookie=89c444ddc1fb9962 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa00159a700 1 -- 172.21.15.98:0/3664630344 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400b600 con 0x7fa004069210 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa00159a700 1 -- 172.21.15.98:0/3664630344 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400b760 con 0x7fa004069210 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa00159a700 1 -- 172.21.15.98:0/3664630344 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400bb00 con 0x7fa004069210 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa008c41700 1 -- 172.21.15.98:0/3664630344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004069210 msgr2=0x7fa004066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.253+0000 7fa008c41700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004069210 0x7fa004066ef0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f9ff4006fd0 tx=0x7f9ff40090f0).stop 2023-08-22T00:22:29.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 -- 172.21.15.98:0/3664630344 shutdown_connections 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004154f60 0x7fa004068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 --2- 172.21.15.98:0/3664630344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004069210 0x7fa004066ef0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 -- 172.21.15.98:0/3664630344 >> 172.21.15.98:0/3664630344 conn(0x7fa0040c5dd0 msgr2=0x7fa004068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 -- 172.21.15.98:0/3664630344 shutdown_connections 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.254+0000 7fa008c41700 1 -- 172.21.15.98:0/3664630344 wait complete. 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 Processor -- start 2023-08-22T00:22:29.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 -- start start 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 0x7fa0040ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 0x7fa004064c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004065ed0 con 0x7fa004154f60 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00414abd0 con 0x7fa0040673e0 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.255+0000 7fa008c41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040652c0 con 0x7fa004069210 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55184/0 (socket says 172.21.15.98:55184) 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 -- 172.21.15.98:0/3156233211 learned_addr learned my addr 172.21.15.98:0/3156233211 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa00259c700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 0x7fa0040ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa001d9b700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 0x7fa004064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 -- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 msgr2=0x7fa004064c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 0x7fa004064c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 -- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 msgr2=0x7fa0040ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 0x7fa0040ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 -- 172.21.15.98:0/3156233211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009370 con 0x7fa004154f60 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa00259c700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 0x7fa0040ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa001d9b700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 0x7fa004064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa002d9d700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f9ffc00c840 tx=0x7f9ffc002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc010510 con 0x7fa004154f60 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0106b0 con 0x7fa004154f60 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040655a0 con 0x7fa004154f60 2023-08-22T00:22:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc010a70 con 0x7fa004154f60 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.256+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa004065b60 con 0x7fa004154f60 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.257+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0040c08d0 con 0x7fa004154f60 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.258+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9ffc012440 con 0x7fa004154f60 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.258+0000 7f9ff27fc700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 0x7f9fe40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.258+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9ffc0797f0 con 0x7fa004154f60 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.258+0000 7fa00259c700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 0x7f9fe40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.258+0000 7fa00259c700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 0x7f9fe40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ff8006fd0 tx=0x7f9ff8008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.262+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ffc0488f0 con 0x7fa004154f60 2023-08-22T00:22:29.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.423+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fa004066010 con 0x7fa004154f60 2023-08-22T00:22:29.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.510+0000 7f9ff27fc700 1 -- 172.21.15.98:0/3156233211 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v117) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa004066010 con 0x7fa004154f60 2023-08-22T00:22:29.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 msgr2=0x7f9fe40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 0x7f9fe40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ff8006fd0 tx=0x7f9ff8008040).stop 2023-08-22T00:22:29.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 msgr2=0x7fa00414a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f9ffc00c840 tx=0x7f9ffc002560).stop 2023-08-22T00:22:29.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 shutdown_connections 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004154f60 0x7fa00414a6e0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040673e0 0x7fa0040ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9fe405ef30 0x7f9fe40613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 --2- 172.21.15.98:0/3156233211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004069210 0x7fa004064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 >> 172.21.15.98:0/3156233211 conn(0x7fa0040c5dd0 msgr2=0x7fa0040a7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.513+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 shutdown_connections 2023-08-22T00:22:29.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.514+0000 7fa008c41700 1 -- 172.21.15.98:0/3156233211 wait complete. 2023-08-22T00:22:29.522 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:22:29.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:22:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.652+0000 7fee56fdc700 1 Processor -- start 2023-08-22T00:22:29.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.652+0000 7fee56fdc700 1 -- start start 2023-08-22T00:22:29.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee56fdc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee500c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee56fdc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500c69b0 con 0x7fee500c5360 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee56fdc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee501542c0 con 0x7fee50066150 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee56fdc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500c57f0 con 0x7fee50066530 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee4ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fee500c5360 0x7fee50157890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46240/0 (socket says 172.21.15.98:46240) 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.653+0000 7fee4ffff700 1 -- 172.21.15.98:0/3003452541 learned_addr learned my addr 172.21.15.98:0/3003452541 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:29.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee55579700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee500c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463631960 0 0) 0x7fee500c69b0 con 0x7fee500c5360 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee400033f0 con 0x7fee500c5360 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320093165 0 0) 0x7fee501542c0 con 0x7fee50066150 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee500c69b0 con 0x7fee50066150 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276286165 0 0) 0x7fee400033f0 con 0x7fee500c5360 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 msgr2=0x7fee500c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee500c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 >> v1:172.21.15.118:6789/0 conn(0x7fee50066150 legacy=0x7fee500c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500c5ad0 con 0x7fee500c5360 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fee3c001470 con 0x7fee500c5360 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 >> v1:172.21.15.98:6789/0 conn(0x7fee500c5360 legacy=0x7fee50157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee40003aa0 0x7fee40003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40004690 0x7fee40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500c57f0 con 0x7fee40003aa0 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4000b940 con 0x7fee40004690 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4000bb00 con 0x7fee50066530 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee54d78700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee40003aa0 0x7fee40003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee4ffff700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40004690 0x7fee40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.654+0000 7fee55579700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 -- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 msgr2=0x7fee40005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50066530 0x7fee40005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 -- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40004690 msgr2=0x7fee40004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40004690 0x7fee40004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 -- 172.21.15.98:0/3003452541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400033f0 con 0x7fee40003aa0 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee54d78700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee40003aa0 0x7fee40003ea0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fee440018d0 tx=0x7fee44007bb0).ready entity=mon.0 client_cookie=99e102539f3e11ab server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44007020 con 0x7fee40003aa0 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44007180 con 0x7fee40003aa0 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee4f7fe700 1 -- 172.21.15.98:0/3003452541 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44007500 con 0x7fee40003aa0 2023-08-22T00:22:29.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 -- 172.21.15.98:0/3003452541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee40003aa0 msgr2=0x7fee40003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3003452541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee40003aa0 0x7fee40003ea0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fee440018d0 tx=0x7fee44007bb0).stop 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee55579700 1 -- 172.21.15.98:0/3003452541 reap_dead start 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 -- 172.21.15.98:0/3003452541 shutdown_connections 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 -- 172.21.15.98:0/3003452541 >> 172.21.15.98:0/3003452541 conn(0x7fee500c7800 msgr2=0x7fee500c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 -- 172.21.15.98:0/3003452541 shutdown_connections 2023-08-22T00:22:29.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.655+0000 7fee56fdc700 1 -- 172.21.15.98:0/3003452541 wait complete. 2023-08-22T00:22:29.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.656+0000 7fee56fdc700 1 Processor -- start 2023-08-22T00:22:29.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 -- start start 2023-08-22T00:22:29.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40003aa0 0x7fee50144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 0x7fee500ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50144a50 con 0x7fee500a4a70 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500a38d0 con 0x7fee40003aa0 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee56fdc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500ad7a0 con 0x7fee50164040 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.657+0000 7fee55579700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55198/0 (socket says 172.21.15.98:55198) 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 -- 172.21.15.98:0/3496399099 learned_addr learned my addr 172.21.15.98:0/3496399099 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee4ffff700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 0x7fee500ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 -- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 msgr2=0x7fee500ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 0x7fee500ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 -- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40003aa0 msgr2=0x7fee50144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee54d78700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40003aa0 0x7fee50144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40003aa0 0x7fee50144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 -- 172.21.15.98:0/3496399099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee501645b0 con 0x7fee500a4a70 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee4ffff700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 0x7fee500ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee55579700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fee480094d0 tx=0x7fee4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800e040 con 0x7fee500a4a70 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800f040 con 0x7fee500a4a70 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50164890 con 0x7fee500a4a70 2023-08-22T00:22:29.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800fdf0 con 0x7fee500a4a70 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.658+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50164e50 con 0x7fee500a4a70 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.659+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50069220 con 0x7fee500a4a70 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.660+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fee48015660 con 0x7fee500a4a70 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.660+0000 7fee4cff9700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 0x7fee340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.660+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fee4807b510 con 0x7fee500a4a70 2023-08-22T00:22:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.660+0000 7fee54d78700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 0x7fee340613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.661+0000 7fee54d78700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 0x7fee340613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fee440016b0 tx=0x7fee44016000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.664+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee4804c940 con 0x7fee500a4a70 2023-08-22T00:22:29.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:29.825+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fee500a3a10 con 0x7fee500a4a70 2023-08-22T00:22:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.518+0000 7fee4cff9700 1 -- 172.21.15.98:0/3496399099 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v118) v1 ==== 170+0+0 (secure 0 0 0) 0x7fee4804ff60 con 0x7fee500a4a70 2023-08-22T00:22:30.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.531+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 msgr2=0x7fee340613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.531+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 0x7fee340613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fee440016b0 tx=0x7fee44016000).stop 2023-08-22T00:22:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.531+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 msgr2=0x7fee50150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.531+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fee480094d0 tx=0x7fee4800b040).stop 2023-08-22T00:22:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 shutdown_connections 2023-08-22T00:22:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee500a4a70 0x7fee50150750 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee40003aa0 0x7fee50144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fee3405ef30 0x7fee340613f0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fee440016b0 tx=0x7fee44016000).stop 2023-08-22T00:22:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 --2- 172.21.15.98:0/3496399099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee50164040 0x7fee500ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.532+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 >> 172.21.15.98:0/3496399099 conn(0x7fee500c7800 msgr2=0x7fee500bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:30.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.536+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 shutdown_connections 2023-08-22T00:22:30.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.536+0000 7fee56fdc700 1 -- 172.21.15.98:0/3496399099 wait complete. 2023-08-22T00:22:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:22:30.560 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:22:30.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.682+0000 7f539867f700 1 Processor -- start 2023-08-22T00:22:30.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.682+0000 7f539867f700 1 -- start start 2023-08-22T00:22:30.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f539867f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f539014b250 0x7f53900c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f539867f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390151e80 con 0x7f53900c39f0 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f539867f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390065560 con 0x7f539014ae70 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f539867f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5390066b90 con 0x7f539014b250 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f539014b250 0x7f53900c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5396c1c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f53900c39f0 0x7f5390154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53466/0 (socket says 172.21.15.98:53466) 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f539014b250 0x7f53900c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42338/0 (socket says 172.21.15.98:42338) 2023-08-22T00:22:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5396c1c700 1 -- 172.21.15.98:0/2099140637 learned_addr learned my addr 172.21.15.98:0/2099140637 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:30.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 -- 172.21.15.98:0/2099140637 >> v1:172.21.15.118:6789/0 conn(0x7f539014ae70 legacy=0x7f53900c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:30.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 -- 172.21.15.98:0/2099140637 >> v1:172.21.15.98:6789/0 conn(0x7f53900c39f0 legacy=0x7f5390154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395419700 1 -- 172.21.15.98:0/2099140637 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230110924 0 0) 0x7f5390151e80 con 0x7f53900c39f0 2023-08-22T00:22:30.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 -- 172.21.15.98:0/2099140637 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900c7590 con 0x7f539014b250 2023-08-22T00:22:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395c1a700 1 --2- 172.21.15.98:0/2099140637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53900c3500 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f5380009760 tx=0x7f5380009060).ready entity=mon.0 client_cookie=b716b9f38dbc23e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395419700 1 -- 172.21.15.98:0/2099140637 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000b580 con 0x7f539014b250 2023-08-22T00:22:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395419700 1 -- 172.21.15.98:0/2099140637 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000b6e0 con 0x7f539014b250 2023-08-22T00:22:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.683+0000 7f5395419700 1 -- 172.21.15.98:0/2099140637 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000ba60 con 0x7f539014b250 2023-08-22T00:22:30.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 -- 172.21.15.98:0/2099140637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 msgr2=0x7f53900c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 --2- 172.21.15.98:0/2099140637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53900c3500 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f5380009760 tx=0x7f5380009060).stop 2023-08-22T00:22:30.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 -- 172.21.15.98:0/2099140637 shutdown_connections 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 --2- 172.21.15.98:0/2099140637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53900c3500 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 -- 172.21.15.98:0/2099140637 >> 172.21.15.98:0/2099140637 conn(0x7f53900c7800 msgr2=0x7f53900c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 -- 172.21.15.98:0/2099140637 shutdown_connections 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.684+0000 7f539867f700 1 -- 172.21.15.98:0/2099140637 wait complete. 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.685+0000 7f539867f700 1 Processor -- start 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.686+0000 7f539867f700 1 -- start start 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.686+0000 7f539867f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 0x7f5390139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f539014ae70 0x7f53901533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390139810 con 0x7f539014b250 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390153dc0 con 0x7f53900c39f0 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390139a40 con 0x7f539014ae70 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42354/0 (socket says 172.21.15.98:42354) 2023-08-22T00:22:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 -- 172.21.15.98:0/3907218413 learned_addr learned my addr 172.21.15.98:0/3907218413 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5395c1a700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f539014ae70 0x7f53901533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539641b700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 0x7f5390139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 -- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f539014ae70 msgr2=0x7f53901533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f539014ae70 0x7f53901533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 -- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 msgr2=0x7f5390139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 0x7f5390139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 -- 172.21.15.98:0/3907218413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800092a0 con 0x7f539014b250 2023-08-22T00:22:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539641b700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 0x7f5390139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f5396c1c700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f538800c7e0 tx=0x7f5388007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388005d30 con 0x7f539014b250 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388005e90 con 0x7f539014b250 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388007320 con 0x7f539014b250 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53900acbe0 con 0x7f539014b250 2023-08-22T00:22:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.687+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53900ad1a0 con 0x7f539014b250 2023-08-22T00:22:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.689+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390139bf0 con 0x7f539014b250 2023-08-22T00:22:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.689+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5388007710 con 0x7f539014b250 2023-08-22T00:22:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.689+0000 7f53867fc700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 0x7f53740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.689+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f538807a1a0 con 0x7f539014b250 2023-08-22T00:22:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.689+0000 7f539641b700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 0x7f53740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.690+0000 7f539641b700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 0x7f53740613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f538c00a8a0 tx=0x7f538c008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.694+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5390139bf0 con 0x7f539014b250 2023-08-22T00:22:30.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.893+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5390139bf0 con 0x7f539014b250 2023-08-22T00:22:30.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.900+0000 7f53867fc700 1 -- 172.21.15.98:0/3907218413 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5390139bf0 con 0x7f539014b250 2023-08-22T00:22:30.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.903+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 msgr2=0x7f53740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.903+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 0x7f53740613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f538c00a8a0 tx=0x7f538c008040).stop 2023-08-22T00:22:30.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.904+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 msgr2=0x7f53901538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:30.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.904+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f538800c7e0 tx=0x7f5388007f90).stop 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 shutdown_connections 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539014b250 0x7f53901538d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53900c39f0 0x7f5390139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f537405ef30 0x7f53740613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 --2- 172.21.15.98:0/3907218413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f539014ae70 0x7f53901533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:30.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 >> 172.21.15.98:0/3907218413 conn(0x7f53900c7800 msgr2=0x7f53900bdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:30.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.912+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 shutdown_connections 2023-08-22T00:22:30.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:30.913+0000 7f539867f700 1 -- 172.21.15.98:0/3907218413 wait complete. 2023-08-22T00:22:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 14 and data pool 15 2023-08-22T00:22:30.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:31.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.050+0000 7f4a0f93d700 1 Processor -- start 2023-08-22T00:22:31.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.050+0000 7f4a0f93d700 1 -- start start 2023-08-22T00:22:31.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0f93d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4a08153cf0 0x7f4a081584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0f93d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a080bd750 con 0x7f4a08065f10 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0f93d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a080a7030 con 0x7f4a08066370 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0f93d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a080c2010 con 0x7f4a08153cf0 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0ced8700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4a08065f10 0x7f4a080bdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53482/0 (socket says 172.21.15.98:53482) 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0ced8700 1 -- 172.21.15.98:0/2583793547 learned_addr learned my addr 172.21.15.98:0/2583793547 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.051+0000 7f4a0d6d9700 1 --2- 172.21.15.98:0/2583793547 >> v2:172.21.15.118:3300/0 conn(0x7f4a08153cf0 0x7f4a081584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789301093 0 0) 0x7f4a080bd750 con 0x7f4a08065f10 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f40033f0 con 0x7f4a08065f10 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 696612240 0 0) 0x7f49f40033f0 con 0x7f4a08065f10 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 >> v2:172.21.15.118:3300/0 conn(0x7f4a08153cf0 msgr2=0x7f4a081584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 --2- 172.21.15.98:0/2583793547 >> v2:172.21.15.118:3300/0 conn(0x7f4a08153cf0 0x7f4a081584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 >> v1:172.21.15.118:6789/0 conn(0x7f4a08066370 legacy=0x7f4a080c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a080a6d50 con 0x7f4a08065f10 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f49f8001470 con 0x7f4a08065f10 2023-08-22T00:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 >> v1:172.21.15.98:6789/0 conn(0x7f4a08065f10 legacy=0x7f4a080bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49f40038e0 0x7f49f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f49f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49f4005000 0x7f49f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080c2010 con 0x7f49f4004690 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f400beb0 con 0x7f49f4005000 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f400c070 con 0x7f49f40038e0 2023-08-22T00:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f49f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0d6d9700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49f40038e0 0x7f49f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0deda700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49f4005000 0x7f49f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 -- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49f40038e0 msgr2=0x7f49f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49f40038e0 0x7f49f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 -- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49f4005000 msgr2=0x7f49f400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49f4005000 0x7f49f400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 -- 172.21.15.98:0/2583793547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40033f0 con 0x7f49f4004690 2023-08-22T00:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0deda700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49f4005000 0x7f49f400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0deda700 1 -- 172.21.15.98:0/2583793547 reap_dead start 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f49f4004b10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f49f800c190 tx=0x7f49f8001e50).ready entity=mon.0 client_cookie=d9716682623fd8c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8007a20 con 0x7f49f4004690 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f800cac0 con 0x7f49f4004690 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.052+0000 7f49fffff700 1 -- 172.21.15.98:0/2583793547 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f800ce40 con 0x7f49f4004690 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 -- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 msgr2=0x7f49f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f49f4004b10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f49f800c190 tx=0x7f49f8001e50).stop 2023-08-22T00:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 -- 172.21.15.98:0/2583793547 shutdown_connections 2023-08-22T00:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/2583793547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f49f4004b10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 -- 172.21.15.98:0/2583793547 >> 172.21.15.98:0/2583793547 conn(0x7f4a080c7770 msgr2=0x7f4a080c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 -- 172.21.15.98:0/2583793547 shutdown_connections 2023-08-22T00:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.053+0000 7f4a0f93d700 1 -- 172.21.15.98:0/2583793547 wait complete. 2023-08-22T00:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.054+0000 7f4a0f93d700 1 Processor -- start 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.054+0000 7f4a0f93d700 1 -- start start 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0814d410 0x7f4a0814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a0814c3c0 0x7f4a08164b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080aba80 con 0x7f49f4004690 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0814e540 con 0x7f4a0814d410 2023-08-22T00:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0f93d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0814eec0 con 0x7f4a0814c3c0 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0d6d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0d6d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42374/0 (socket says 172.21.15.98:42374) 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0d6d9700 1 -- 172.21.15.98:0/4269000404 learned_addr learned my addr 172.21.15.98:0/4269000404 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0deda700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a0814c3c0 0x7f4a08164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.055+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0814d410 0x7f4a0814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 -- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a0814c3c0 msgr2=0x7f4a08164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a0814c3c0 0x7f4a08164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 -- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0814d410 msgr2=0x7f4a0814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0814d410 0x7f4a0814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 -- 172.21.15.98:0/4269000404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0814d890 con 0x7f49f4004690 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0d6d9700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f4a04011a20 tx=0x7f4a04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400f940 con 0x7f49f4004690 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0400faa0 con 0x7f49f4004690 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400fe20 con 0x7f49f4004690 2023-08-22T00:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a080abcb0 con 0x7f49f4004690 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.056+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0814def0 con 0x7f49f4004690 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.057+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a08047480 con 0x7f49f4004690 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.057+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4a04014650 con 0x7f49f4004690 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.057+0000 7f49fd7fa700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 0x7f49ec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.058+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4a0407ad70 con 0x7f49f4004690 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.058+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 0x7f49ec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.058+0000 7f4a0ced8700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 0x7f49ec0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4a081537a0 tx=0x7f49f8015000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.062+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a0404bf00 con 0x7f49f4004690 2023-08-22T00:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.223+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a080bd100 con 0x7f49f4004690 2023-08-22T00:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.224+0000 7f49fd7fa700 1 -- 172.21.15.98:0/4269000404 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f4a0404f520 con 0x7f49f4004690 2023-08-22T00:22:31.226 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:31.226 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":119,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:30.895271+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 msgr2=0x7f49ec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 0x7f49ec0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4a081537a0 tx=0x7f49f8015000).stop 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 msgr2=0x7f4a080ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f4a04011a20 tx=0x7f4a04009060).stop 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 shutdown_connections 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f49ec05ef30 0x7f49ec0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a0814c3c0 0x7f4a08164b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f4004690 0x7f4a080ab590 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 --2- 172.21.15.98:0/4269000404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0814d410 0x7f4a0814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 >> 172.21.15.98:0/4269000404 conn(0x7f4a080c7770 msgr2=0x7f4a080a5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:31.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 shutdown_connections 2023-08-22T00:22:31.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.226+0000 7f4a0f93d700 1 -- 172.21.15.98:0/4269000404 wait complete. 2023-08-22T00:22:31.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:31.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.356+0000 7f1d836d0700 1 Processor -- start 2023-08-22T00:22:31.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.356+0000 7f1d836d0700 1 -- start start 2023-08-22T00:22:31.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d836d0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d7c14c350 0x7f1d7c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d836d0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 0x7f1d7c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d836d0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c153080 con 0x7f1d7c14bf70 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d836d0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c066510 con 0x7f1d7c14c350 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d836d0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0667b0 con 0x7f1d7c0c3e50 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d7c14c350 0x7f1d7c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1d7c14c350 0x7f1d7c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42382/0 (socket says 172.21.15.98:42382) 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 -- 172.21.15.98:0/2003975824 learned_addr learned my addr 172.21.15.98:0/2003975824 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d81c6d700 1 --2- 172.21.15.98:0/2003975824 >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 0x7f1d7c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 -- 172.21.15.98:0/2003975824 >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 msgr2=0x7f1d7c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 --2- 172.21.15.98:0/2003975824 >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 0x7f1d7c1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 -- 172.21.15.98:0/2003975824 >> v1:172.21.15.118:6789/0 conn(0x7f1d7c14bf70 legacy=0x7f1d7c0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 -- 172.21.15.98:0/2003975824 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c155ba0 con 0x7f1d7c14c350 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d81c6d700 1 --2- 172.21.15.98:0/2003975824 >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 0x7f1d7c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.357+0000 7f1d80c6b700 1 --2- 172.21.15.98:0/2003975824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14c350 0x7f1d7c152b90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f1d7c0a8280 tx=0x7f1d6c0090f0).ready entity=mon.0 client_cookie=f31c9e326b3d5d9b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d73fff700 1 -- 172.21.15.98:0/2003975824 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00b600 con 0x7f1d7c14c350 2023-08-22T00:22:31.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d73fff700 1 -- 172.21.15.98:0/2003975824 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00b760 con 0x7f1d7c14c350 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d73fff700 1 -- 172.21.15.98:0/2003975824 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00bae0 con 0x7f1d7c14c350 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 -- 172.21.15.98:0/2003975824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14c350 msgr2=0x7f1d7c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 --2- 172.21.15.98:0/2003975824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14c350 0x7f1d7c152b90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f1d7c0a8280 tx=0x7f1d6c0090f0).stop 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 -- 172.21.15.98:0/2003975824 shutdown_connections 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 --2- 172.21.15.98:0/2003975824 >> v2:172.21.15.118:3300/0 conn(0x7f1d7c0c3e50 0x7f1d7c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 --2- 172.21.15.98:0/2003975824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14c350 0x7f1d7c152b90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 -- 172.21.15.98:0/2003975824 >> 172.21.15.98:0/2003975824 conn(0x7f1d7c0c5dc0 msgr2=0x7f1d7c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:31.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 -- 172.21.15.98:0/2003975824 shutdown_connections 2023-08-22T00:22:31.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.358+0000 7f1d836d0700 1 -- 172.21.15.98:0/2003975824 wait complete. 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.359+0000 7f1d836d0700 1 Processor -- start 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.359+0000 7f1d836d0700 1 -- start start 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c0c3e50 0x7f1d7c165870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 0x7f1d7c0aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0a87e0 con 0x7f1d7c14bf70 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0a8a80 con 0x7f1d7c0c3e50 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d836d0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c166060 con 0x7f1d7c14c350 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d80c6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d80c6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42386/0 (socket says 172.21.15.98:42386) 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.360+0000 7f1d80c6b700 1 -- 172.21.15.98:0/1306795298 learned_addr learned my addr 172.21.15.98:0/1306795298 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d8146c700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c0c3e50 0x7f1d7c165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d81c6d700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 0x7f1d7c0aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 -- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 msgr2=0x7f1d7c0aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 0x7f1d7c0aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 -- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c0c3e50 msgr2=0x7f1d7c165870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c0c3e50 0x7f1d7c165870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 -- 172.21.15.98:0/1306795298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009370 con 0x7f1d7c14bf70 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d81c6d700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 0x7f1d7c0aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d80c6b700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f1d6c011000 tx=0x7f1d6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00b8d0 con 0x7f1d7c14bf70 2023-08-22T00:22:31.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00ba30 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c166340 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c01b660 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.361+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c165d60 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.362+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c047480 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.362+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1d6c01b9d0 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.363+0000 7f1d717fa700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 0x7f1d600613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.363+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1d6c07b900 con 0x7f1d7c14bf70 2023-08-22T00:22:31.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.363+0000 7f1d8146c700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 0x7f1d600613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.363+0000 7f1d8146c700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 0x7f1d600613c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1d78003920 tx=0x7f1d78000bc0).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.367+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d6c04ca90 con 0x7f1d7c14bf70 2023-08-22T00:22:31.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.532+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7c155e00 con 0x7f1d7c14bf70 2023-08-22T00:22:31.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.533+0000 7f1d717fa700 1 -- 172.21.15.98:0/1306795298 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f1d6c0500b0 con 0x7f1d7c14bf70 2023-08-22T00:22:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:31.536 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":119,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:30.895271+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:31.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 msgr2=0x7f1d600613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 0x7f1d600613c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1d78003920 tx=0x7f1d78000bc0).stop 2023-08-22T00:22:31.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 msgr2=0x7f1d7c0aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f1d6c011000 tx=0x7f1d6c017000).stop 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 shutdown_connections 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1d6005ef00 0x7f1d600613c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7c14c350 0x7f1d7c0aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c0c3e50 0x7f1d7c165870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 --2- 172.21.15.98:0/1306795298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d7c14bf70 0x7f1d7c0aa3d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 >> 172.21.15.98:0/1306795298 conn(0x7f1d7c0c5dc0 msgr2=0x7f1d7c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:31.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 shutdown_connections 2023-08-22T00:22:31.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.535+0000 7f1d836d0700 1 -- 172.21.15.98:0/1306795298 wait complete. 2023-08-22T00:22:31.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:22:31.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.666+0000 7fcafbb0b700 1 Processor -- start 2023-08-22T00:22:31.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.666+0000 7fcafbb0b700 1 -- start start 2023-08-22T00:22:31.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafbb0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcaf40c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafbb0b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcaf4064820 0x7fcaf4066000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafbb0b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf4158970 con 0x7fcaf40c3230 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafbb0b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf40c28b0 con 0x7fcaf4064820 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafbb0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4158690 con 0x7fcaf4153dd0 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcaf90a6700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcaf40c3230 0x7fcaf4064110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53498/0 (socket says 172.21.15.98:53498) 2023-08-22T00:22:31.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcaf90a6700 1 -- 172.21.15.98:0/2698491394 learned_addr learned my addr 172.21.15.98:0/2698491394 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:31.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcafa0a8700 1 --2- 172.21.15.98:0/2698491394 >> v2:172.21.15.118:3300/0 conn(0x7fcaf4064820 0x7fcaf4066000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcaf40c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007885833 0 0) 0x7fcaf4158970 con 0x7fcaf40c3230 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.667+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae00033f0 con 0x7fcaf40c3230 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1535221437 0 0) 0x7fcae00033f0 con 0x7fcaf40c3230 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 msgr2=0x7fcaf40c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcaf40c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 >> v2:172.21.15.118:3300/0 conn(0x7fcaf4064820 msgr2=0x7fcaf4066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 --2- 172.21.15.98:0/2698491394 >> v2:172.21.15.118:3300/0 conn(0x7fcaf4064820 0x7fcaf4066000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40c2260 con 0x7fcaf40c3230 2023-08-22T00:22:31.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fcaf0001470 con 0x7fcaf40c3230 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 >> v1:172.21.15.98:6789/0 conn(0x7fcaf40c3230 legacy=0x7fcaf4064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcae00038e0 0x7fcae0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae0004690 0x7fcae0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcae0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40c28b0 con 0x7fcae00038e0 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4158690 con 0x7fcae0004690 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae000b8e0 con 0x7fcaf4153dd0 2023-08-22T00:22:31.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcae00038e0 0x7fcae0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcafa0a8700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcae0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf90a6700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae0004690 0x7fcae0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 -- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 msgr2=0x7fcae0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4153dd0 0x7fcae0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 -- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae0004690 msgr2=0x7fcae0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae0004690 0x7fcae0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 -- 172.21.15.98:0/2698491394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00033f0 con 0x7fcae00038e0 2023-08-22T00:22:31.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcae00038e0 0x7fcae0003d00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fcae4009a80 tx=0x7fcae4009060).ready entity=mon.0 client_cookie=3996e5ef5d48c41a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4009430 con 0x7fcae00038e0 2023-08-22T00:22:31.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae400e640 con 0x7fcae00038e0 2023-08-22T00:22:31.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.668+0000 7fcaf88a5700 1 -- 172.21.15.98:0/2698491394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400e9c0 con 0x7fcae00038e0 2023-08-22T00:22:31.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2698491394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcae00038e0 msgr2=0x7fcae0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2698491394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcae00038e0 0x7fcae0003d00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fcae4009a80 tx=0x7fcae4009060).stop 2023-08-22T00:22:31.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafa0a8700 1 -- 172.21.15.98:0/2698491394 reap_dead start 2023-08-22T00:22:31.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2698491394 shutdown_connections 2023-08-22T00:22:31.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2698491394 >> 172.21.15.98:0/2698491394 conn(0x7fcaf40c7820 msgr2=0x7fcaf40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:31.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2698491394 shutdown_connections 2023-08-22T00:22:31.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.669+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2698491394 wait complete. 2023-08-22T00:22:31.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.670+0000 7fcafbb0b700 1 Processor -- start 2023-08-22T00:22:31.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.670+0000 7fcafbb0b700 1 -- start start 2023-08-22T00:22:31.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 0x7fcaf40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4156b40 0x7fcaf40aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40ac8b0 con 0x7fcaf40aacc0 2023-08-22T00:22:31.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40ab120 con 0x7fcae00038e0 2023-08-22T00:22:31.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafbb0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40abfc0 con 0x7fcaf4156b40 2023-08-22T00:22:31.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42414/0 (socket says 172.21.15.98:42414) 2023-08-22T00:22:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 -- 172.21.15.98:0/2537194096 learned_addr learned my addr 172.21.15.98:0/2537194096 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcaf90a6700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4156b40 0x7fcaf40aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 0x7fcaf40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 -- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4156b40 msgr2=0x7fcaf40aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4156b40 0x7fcaf40aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 -- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 msgr2=0x7fcaf40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 0x7fcaf40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 -- 172.21.15.98:0/2537194096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40ac260 con 0x7fcaf40aacc0 2023-08-22T00:22:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 0x7fcaf40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcafa0a8700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fcaf40c77c0 tx=0x7fcaec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00e040 con 0x7fcaf40aacc0 2023-08-22T00:22:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.671+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00f040 con 0x7fcaf40aacc0 2023-08-22T00:22:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.672+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf40ac540 con 0x7fcaf40aacc0 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.672+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00fe20 con 0x7fcaf40aacc0 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.672+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4156fc0 con 0x7fcaf40aacc0 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.673+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf40aca20 con 0x7fcaf40aacc0 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.673+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcaec015660 con 0x7fcaf40aacc0 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.673+0000 7fcae9ffb700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 0x7fcad80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.674+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcaec07ab60 con 0x7fcaf40aacc0 2023-08-22T00:22:31.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.674+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 0x7fcad80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:31.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.674+0000 7fcaf98a7700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 0x7fcad80613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcaf41531c0 tx=0x7fcae401a000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:31.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.678+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcaec04bc30 con 0x7fcaf40aacc0 2023-08-22T00:22:31.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:31.877+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcaf40c3d60 con 0x7fcaf40aacc0 2023-08-22T00:22:32.313 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:22:32.311+0000 7f6c396d1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:22:32.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.523+0000 7fcae9ffb700 1 -- 172.21.15.98:0/2537194096 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcaec04f250 con 0x7fcaf40aacc0 2023-08-22T00:22:32.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 msgr2=0x7fcad80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 0x7fcad80613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcaf41531c0 tx=0x7fcae401a000).stop 2023-08-22T00:22:32.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 msgr2=0x7fcaf4167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fcaf40c77c0 tx=0x7fcaec00b040).stop 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 shutdown_connections 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaf40aacc0 0x7fcaf4167b20 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00038e0 0x7fcaf40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcad805ef30 0x7fcad80613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 --2- 172.21.15.98:0/2537194096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcaf4156b40 0x7fcaf40aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 >> 172.21.15.98:0/2537194096 conn(0x7fcaf40c7820 msgr2=0x7fcaf40c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:32.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 shutdown_connections 2023-08-22T00:22:32.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.526+0000 7fcafbb0b700 1 -- 172.21.15.98:0/2537194096 wait complete. 2023-08-22T00:22:32.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:22:32.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.661+0000 7f5a55a38700 1 Processor -- start 2023-08-22T00:22:32.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.661+0000 7f5a55a38700 1 -- start start 2023-08-22T00:22:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a55a38700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a500a8f00 0x7f5a50151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a55a38700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 0x7f5a50151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a55a38700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a50062600 con 0x7f5a500a8b20 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a55a38700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a501521a0 con 0x7f5a500a8f00 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a55a38700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a50066120 con 0x7f5a50151840 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a4e7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a500a8f00 0x7f5a50151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a4e7fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a500a8f00 0x7f5a50151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42418/0 (socket says 172.21.15.98:42418) 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a4effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5a500a8b20 0x7f5a500bc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53500/0 (socket says 172.21.15.98:53500) 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.662+0000 7f5a4e7fc700 1 -- 172.21.15.98:0/633945453 learned_addr learned my addr 172.21.15.98:0/633945453 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4e7fc700 1 -- 172.21.15.98:0/633945453 >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 msgr2=0x7f5a50151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4f7fe700 1 --2- 172.21.15.98:0/633945453 >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 0x7f5a50151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4dffb700 1 -- 172.21.15.98:0/633945453 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831890838 0 0) 0x7f5a50062600 con 0x7f5a500a8b20 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/633945453 >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 0x7f5a50151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4e7fc700 1 -- 172.21.15.98:0/633945453 >> v1:172.21.15.98:6789/0 conn(0x7f5a500a8b20 legacy=0x7f5a500bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4e7fc700 1 -- 172.21.15.98:0/633945453 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50066400 con 0x7f5a500a8f00 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4f7fe700 1 --2- 172.21.15.98:0/633945453 >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 0x7f5a50151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/633945453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8f00 0x7f5a50151350 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f5a500a98f0 tx=0x7f5a400090f0).ready entity=mon.0 client_cookie=34afd664b58a618a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4dffb700 1 -- 172.21.15.98:0/633945453 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000b600 con 0x7f5a500a8f00 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4dffb700 1 -- 172.21.15.98:0/633945453 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000b760 con 0x7f5a500a8f00 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a4dffb700 1 -- 172.21.15.98:0/633945453 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000bb00 con 0x7f5a500a8f00 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 -- 172.21.15.98:0/633945453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8f00 msgr2=0x7f5a50151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 --2- 172.21.15.98:0/633945453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8f00 0x7f5a50151350 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f5a500a98f0 tx=0x7f5a400090f0).stop 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 -- 172.21.15.98:0/633945453 shutdown_connections 2023-08-22T00:22:32.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 --2- 172.21.15.98:0/633945453 >> v2:172.21.15.118:3300/0 conn(0x7f5a50151840 0x7f5a50151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 --2- 172.21.15.98:0/633945453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8f00 0x7f5a50151350 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.663+0000 7f5a55a38700 1 -- 172.21.15.98:0/633945453 >> 172.21.15.98:0/633945453 conn(0x7f5a500c31d0 msgr2=0x7f5a500c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.664+0000 7f5a55a38700 1 -- 172.21.15.98:0/633945453 shutdown_connections 2023-08-22T00:22:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.664+0000 7f5a55a38700 1 -- 172.21.15.98:0/633945453 wait complete. 2023-08-22T00:22:32.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.665+0000 7f5a55a38700 1 Processor -- start 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.665+0000 7f5a55a38700 1 -- start start 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 0x7f5a500c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 0x7f5a50162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500c0700 con 0x7f5a500a8b20 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50162710 con 0x7f5a50151840 2023-08-22T00:22:32.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5014cfc0 con 0x7f5a500a8f00 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42428/0 (socket says 172.21.15.98:42428) 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 -- 172.21.15.98:0/2005881726 learned_addr learned my addr 172.21.15.98:0/2005881726 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 -- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 msgr2=0x7f5a500c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 0x7f5a500c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4f7fe700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 0x7f5a50162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 0x7f5a500c0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 -- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 msgr2=0x7f5a50162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 0x7f5a50162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 -- 172.21.15.98:0/2005881726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009370 con 0x7f5a500a8b20 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 0x7f5a500c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4f7fe700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 0x7f5a50162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a4effd700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f5a4400c560 tx=0x7f5a44007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:32.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440072e0 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44007440 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5009f670 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.666+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440058f0 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.667+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a500befd0 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.668+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50068850 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.668+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5a44005ce0 con 0x7f5a500a8b20 2023-08-22T00:22:32.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.668+0000 7f5a36ffd700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 0x7f5a3c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:32.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.668+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5a44079960 con 0x7f5a500a8b20 2023-08-22T00:22:32.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.668+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 0x7f5a3c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:32.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.669+0000 7f5a4e7fc700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 0x7f5a3c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a501517e0 tx=0x7f5a40017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:32.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.672+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a4404aaf0 con 0x7f5a500a8b20 2023-08-22T00:22:32.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:32.873+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5a500666e0 con 0x7f5a500a8b20 2023-08-22T00:22:33.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.531+0000 7f5a36ffd700 1 -- 172.21.15.98:0/2005881726 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a4404e110 con 0x7f5a500a8b20 2023-08-22T00:22:33.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 msgr2=0x7f5a3c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 0x7f5a3c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a501517e0 tx=0x7f5a40017000).stop 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 msgr2=0x7f5a500be6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f5a4400c560 tx=0x7f5a44007c90).stop 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 shutdown_connections 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a50151840 0x7f5a50162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a500a8b20 0x7f5a500be6c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5a3c05ef30 0x7f5a3c0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 --2- 172.21.15.98:0/2005881726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a500a8f00 0x7f5a500c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 >> 172.21.15.98:0/2005881726 conn(0x7f5a500c31d0 msgr2=0x7f5a500bc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:33.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 shutdown_connections 2023-08-22T00:22:33.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.533+0000 7f5a55a38700 1 -- 172.21.15.98:0/2005881726 wait complete. 2023-08-22T00:22:33.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:33.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.667+0000 7f33dcf68700 1 Processor -- start 2023-08-22T00:22:33.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.667+0000 7f33dcf68700 1 -- start start 2023-08-22T00:22:33.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33dcf68700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f33d80c61a0 0x7f33d814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33dcf68700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f33d81544f0 0x7f33d81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33dcf68700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d8155260 con 0x7f33d814e0d0 2023-08-22T00:22:33.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33dcf68700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80c17b0 con 0x7f33d81544f0 2023-08-22T00:22:33.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33dcf68700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80bf9e0 con 0x7f33d80c61a0 2023-08-22T00:22:33.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33d6d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f33d81544f0 0x7f33d81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33d6d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f33d81544f0 0x7f33d81549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42430/0 (socket says 172.21.15.98:42430) 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33d659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f33d814e0d0 0x7f33d80c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53510/0 (socket says 172.21.15.98:53510) 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.668+0000 7f33d6d9d700 1 -- 172.21.15.98:0/2910602532 learned_addr learned my addr 172.21.15.98:0/2910602532 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d6d9d700 1 -- 172.21.15.98:0/2910602532 >> v2:172.21.15.118:3300/0 conn(0x7f33d80c61a0 msgr2=0x7f33d814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d5d9b700 1 --2- 172.21.15.98:0/2910602532 >> v2:172.21.15.118:3300/0 conn(0x7f33d80c61a0 0x7f33d814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d6d9d700 1 --2- 172.21.15.98:0/2910602532 >> v2:172.21.15.118:3300/0 conn(0x7f33d80c61a0 0x7f33d814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d559a700 1 -- 172.21.15.98:0/2910602532 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137378706 0 0) 0x7f33d8155260 con 0x7f33d814e0d0 2023-08-22T00:22:33.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d6d9d700 1 -- 172.21.15.98:0/2910602532 >> v1:172.21.15.98:6789/0 conn(0x7f33d814e0d0 legacy=0x7f33d80c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d6d9d700 1 -- 172.21.15.98:0/2910602532 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80bfcc0 con 0x7f33d81544f0 2023-08-22T00:22:33.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d6d9d700 1 --2- 172.21.15.98:0/2910602532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d81544f0 0x7f33d81549a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f33d80c6eb0 tx=0x7f33d0009840).ready entity=mon.0 client_cookie=a41959b7e83f8b0e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:33.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d559a700 1 -- 172.21.15.98:0/2910602532 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000e070 con 0x7f33d81544f0 2023-08-22T00:22:33.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d559a700 1 -- 172.21.15.98:0/2910602532 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d000ba50 con 0x7f33d81544f0 2023-08-22T00:22:33.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33d559a700 1 -- 172.21.15.98:0/2910602532 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000bdd0 con 0x7f33d81544f0 2023-08-22T00:22:33.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33dcf68700 1 -- 172.21.15.98:0/2910602532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d81544f0 msgr2=0x7f33d81549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.669+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2910602532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d81544f0 0x7f33d81549a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f33d80c6eb0 tx=0x7f33d0009840).stop 2023-08-22T00:22:33.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 -- 172.21.15.98:0/2910602532 shutdown_connections 2023-08-22T00:22:33.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2910602532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d81544f0 0x7f33d81549a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2910602532 >> v2:172.21.15.118:3300/0 conn(0x7f33d80c61a0 0x7f33d814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 -- 172.21.15.98:0/2910602532 >> 172.21.15.98:0/2910602532 conn(0x7f33d80caa80 msgr2=0x7f33d80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:33.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 -- 172.21.15.98:0/2910602532 shutdown_connections 2023-08-22T00:22:33.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.670+0000 7f33dcf68700 1 -- 172.21.15.98:0/2910602532 wait complete. 2023-08-22T00:22:33.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 Processor -- start 2023-08-22T00:22:33.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 -- start start 2023-08-22T00:22:33.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 0x7f33d8151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 0x7f33d8151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8151a60 con 0x7f33d80c61a0 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80af900 con 0x7f33d814e0d0 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.671+0000 7f33dcf68700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d814ee50 con 0x7f33d81544f0 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42440/0 (socket says 172.21.15.98:42440) 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 -- 172.21.15.98:0/2097581157 learned_addr learned my addr 172.21.15.98:0/2097581157 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d5d9b700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 0x7f33d8151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d6d9d700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 0x7f33d8151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 -- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 msgr2=0x7f33d8151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 0x7f33d8151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 -- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 msgr2=0x7f33d8151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 0x7f33d8151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 -- 172.21.15.98:0/2097581157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0009ae0 con 0x7f33d80c61a0 2023-08-22T00:22:33.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d5d9b700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 0x7f33d8151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:33.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d6d9d700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 0x7f33d8151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:33.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33d659c700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f33c800c590 tx=0x7f33c8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80072e0 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8007440 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d814eb50 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80058f0 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.672+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d80afb50 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.673+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d814e9a0 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.673+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f33c8005ce0 con 0x7f33d80c61a0 2023-08-22T00:22:33.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.674+0000 7f33c67fc700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 0x7f33b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:33.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.674+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f33c8079aa0 con 0x7f33d80c61a0 2023-08-22T00:22:33.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.674+0000 7f33d5d9b700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 0x7f33b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:33.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.674+0000 7f33d5d9b700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 0x7f33b80613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33d80a9ad0 tx=0x7f33cc008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:33.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.678+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f33c804ac30 con 0x7f33d80c61a0 2023-08-22T00:22:33.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.878+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33d8047480 con 0x7f33d80c61a0 2023-08-22T00:22:33.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.879+0000 7f33c67fc700 1 -- 172.21.15.98:0/2097581157 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f33c8018030 con 0x7f33d80c61a0 2023-08-22T00:22:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:33.880 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:22:33.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.880+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 msgr2=0x7f33b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.880+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 0x7f33b80613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33d80a9ad0 tx=0x7f33cc008040).stop 2023-08-22T00:22:33.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.880+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 msgr2=0x7f33d8149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:33.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.880+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f33c800c590 tx=0x7f33c8007c90).stop 2023-08-22T00:22:33.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 shutdown_connections 2023-08-22T00:22:33.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f33b805ef30 0x7f33b80613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33d81544f0 0x7f33d8151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d80c61a0 0x7f33d8149920 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 --2- 172.21.15.98:0/2097581157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33d814e0d0 0x7f33d8151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:33.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 >> 172.21.15.98:0/2097581157 conn(0x7f33d80caa80 msgr2=0x7f33d80c06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:33.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 shutdown_connections 2023-08-22T00:22:33.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:33.881+0000 7f33dcf68700 1 -- 172.21.15.98:0/2097581157 wait complete. 2023-08-22T00:22:33.885 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:22:33.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:22:34.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.008+0000 7f9ba30c7700 1 Processor -- start 2023-08-22T00:22:34.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.008+0000 7f9ba30c7700 1 -- start start 2023-08-22T00:22:34.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 0x7f9b9c154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c155260 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c0bf9e0 con 0x7f9b9c1544f0 2023-08-22T00:22:34.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba30c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0bfcc0 con 0x7f9b9c14e0d0 2023-08-22T00:22:34.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42454/0 (socket says 172.21.15.98:42454) 2023-08-22T00:22:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 -- 172.21.15.98:0/844419875 learned_addr learned my addr 172.21.15.98:0/844419875 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba0e63700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba1664700 1 --2- 172.21.15.98:0/844419875 >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 0x7f9b9c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 -- 172.21.15.98:0/844419875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 msgr2=0x7f9b9c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 -- 172.21.15.98:0/844419875 >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 msgr2=0x7f9b9c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/844419875 >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 0x7f9b9c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9b9bfff700 1 -- 172.21.15.98:0/844419875 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c0bffa0 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.009+0000 7f9ba1664700 1 --2- 172.21.15.98:0/844419875 >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 0x7f9b9c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f9b9c0c6bd0 tx=0x7f9b880090f0).ready entity=mon.0 client_cookie=17996cba54ffc7d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9b9b7fe700 1 -- 172.21.15.98:0/844419875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800b520 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9b9b7fe700 1 -- 172.21.15.98:0/844419875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800b680 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9b9b7fe700 1 -- 172.21.15.98:0/844419875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800ba00 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 -- 172.21.15.98:0/844419875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 msgr2=0x7f9b9c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f9b9c0c6bd0 tx=0x7f9b880090f0).stop 2023-08-22T00:22:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 -- 172.21.15.98:0/844419875 shutdown_connections 2023-08-22T00:22:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/844419875 >> v2:172.21.15.118:3300/0 conn(0x7f9b9c1544f0 0x7f9b9c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/844419875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c0c5f10 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 -- 172.21.15.98:0/844419875 >> 172.21.15.98:0/844419875 conn(0x7f9b9c0caa80 msgr2=0x7f9b9c0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 -- 172.21.15.98:0/844419875 shutdown_connections 2023-08-22T00:22:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.010+0000 7f9ba30c7700 1 -- 172.21.15.98:0/844419875 wait complete. 2023-08-22T00:22:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.011+0000 7f9ba30c7700 1 Processor -- start 2023-08-22T00:22:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 -- start start 2023-08-22T00:22:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 0x7f9b9c150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c150690 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c14fa80 con 0x7f9b9c1544f0 2023-08-22T00:22:34.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba30c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c14fd60 con 0x7f9b9c14e0d0 2023-08-22T00:22:34.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba0e63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba0e63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42464/0 (socket says 172.21.15.98:42464) 2023-08-22T00:22:34.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.012+0000 7f9ba0e63700 1 -- 172.21.15.98:0/2541831979 learned_addr learned my addr 172.21.15.98:0/2541831979 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:34.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba1664700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 0x7f9b9c150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 -- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 msgr2=0x7f9b9c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 -- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 msgr2=0x7f9b9c150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 0x7f9b9c150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 -- 172.21.15.98:0/2541831979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009370 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba1664700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 0x7f9b9c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:34.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba0e63700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f9b9000e950 tx=0x7f9b90009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000c850 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000c9b0 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c150040 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000cd30 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.013+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c14d020 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.014+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c150970 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.015+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9b90012600 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.015+0000 7f9b98ff9700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 0x7f9b800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.015+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9b9007ac60 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.015+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 0x7f9b800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.015+0000 7f9b9bfff700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 0x7f9b800613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9b88009130 tx=0x7f9b88017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.019+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b9004beb0 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.179+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b9c047480 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.180+0000 7f9b98ff9700 1 -- 172.21.15.98:0/2541831979 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+17275 (secure 0 0 0) 0x7f9b90016020 con 0x7f9b9c0c5a90 2023-08-22T00:22:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:34.182 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":120,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:22:31.897208+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:22:34.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 msgr2=0x7f9b800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 0x7f9b800613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9b88009130 tx=0x7f9b88017000).stop 2023-08-22T00:22:34.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 msgr2=0x7f9b9c14cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f9b9000e950 tx=0x7f9b90009060).stop 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 shutdown_connections 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b9c1544f0 0x7f9b9c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b9c0c5a90 0x7f9b9c14cb30 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9b8005ef30 0x7f9b800613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 --2- 172.21.15.98:0/2541831979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b9c14e0d0 0x7f9b9c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 >> 172.21.15.98:0/2541831979 conn(0x7f9b9c0caa80 msgr2=0x7f9b9c062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 shutdown_connections 2023-08-22T00:22:34.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.182+0000 7f9ba30c7700 1 -- 172.21.15.98:0/2541831979 wait complete. 2023-08-22T00:22:34.195 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:22:34.195 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:34.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.309+0000 7fe72d90c700 1 Processor -- start 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.309+0000 7fe72d90c700 1 -- start start 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe72d90c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe728153f10 0x7fe728150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe72d90c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280c26b0 0x7fe7280c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe72d90c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280c2220 con 0x7fe728150040 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe72d90c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280c5bd0 con 0x7fe728153f10 2023-08-22T00:22:34.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe72d90c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c1ef0 con 0x7fe7280c26b0 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.310+0000 7fe7267fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe728153f10 0x7fe728150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe728153f10 0x7fe728150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42468/0 (socket says 172.21.15.98:42468) 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 -- 172.21.15.98:0/2570343577 learned_addr learned my addr 172.21.15.98:0/2570343577 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7277fe700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280c26b0 0x7fe7280c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 -- 172.21.15.98:0/2570343577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280c26b0 msgr2=0x7fe7280c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280c26b0 0x7fe7280c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 -- 172.21.15.98:0/2570343577 >> v1:172.21.15.118:6789/0 conn(0x7fe728150040 legacy=0x7fe7280c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 -- 172.21.15.98:0/2570343577 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280c5e30 con 0x7fe728153f10 2023-08-22T00:22:34.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe7267fc700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728153f10 0x7fe728150420 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fe71c00bac0 tx=0x7fe71c00b370).ready entity=mon.0 client_cookie=892c02d92c3035f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe725ffb700 1 -- 172.21.15.98:0/2570343577 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00dc40 con 0x7fe728153f10 2023-08-22T00:22:34.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe725ffb700 1 -- 172.21.15.98:0/2570343577 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c00dda0 con 0x7fe728153f10 2023-08-22T00:22:34.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe725ffb700 1 -- 172.21.15.98:0/2570343577 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c015600 con 0x7fe728153f10 2023-08-22T00:22:34.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe72d90c700 1 -- 172.21.15.98:0/2570343577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728153f10 msgr2=0x7fe728150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728153f10 0x7fe728150420 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fe71c00bac0 tx=0x7fe71c00b370).stop 2023-08-22T00:22:34.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe72d90c700 1 -- 172.21.15.98:0/2570343577 shutdown_connections 2023-08-22T00:22:34.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.311+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280c26b0 0x7fe7280c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.312+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2570343577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728153f10 0x7fe728150420 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.312+0000 7fe72d90c700 1 -- 172.21.15.98:0/2570343577 >> 172.21.15.98:0/2570343577 conn(0x7fe7280c7140 msgr2=0x7fe7280c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.312+0000 7fe72d90c700 1 -- 172.21.15.98:0/2570343577 shutdown_connections 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.312+0000 7fe72d90c700 1 -- 172.21.15.98:0/2570343577 wait complete. 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.313+0000 7fe72d90c700 1 Processor -- start 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.313+0000 7fe72d90c700 1 -- start start 2023-08-22T00:22:34.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7280c26b0 0x7fe7280c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe728153f10 0x7fe728166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728166940 con 0x7fe728150040 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c0a90 con 0x7fe7280c26b0 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe728165d30 con 0x7fe728153f10 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42480/0 (socket says 172.21.15.98:42480) 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 -- 172.21.15.98:0/2972553805 learned_addr learned my addr 172.21.15.98:0/2972553805 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe726ffd700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7280c26b0 0x7fe7280c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7277fe700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe728153f10 0x7fe728166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 -- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe728153f10 msgr2=0x7fe728166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe728153f10 0x7fe728166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 -- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7280c26b0 msgr2=0x7fe7280c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7280c26b0 0x7fe7280c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 -- 172.21.15.98:0/2972553805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c00b6a0 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe7267fc700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe7280c4140 tx=0x7fe71c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c01c560 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c01c6c0 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe728166010 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c01ca40 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.314+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7281665d0 con 0x7fe728150040 2023-08-22T00:22:34.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.315+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728047480 con 0x7fe728150040 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.316+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe71c027460 con 0x7fe728150040 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.316+0000 7fe70effd700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 0x7fe7140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.316+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe71c00b040 con 0x7fe728150040 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.316+0000 7fe726ffd700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 0x7fe7140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.317+0000 7fe726ffd700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 0x7fe7140613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe728065970 tx=0x7fe718009040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.320+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe71c04c930 con 0x7fe728150040 2023-08-22T00:22:34.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.476+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe728166a80 con 0x7fe71405ef30 2023-08-22T00:22:34.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.485+0000 7fe70effd700 1 -- 172.21.15.98:0/2972553805 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353332 (secure 0 0 0) 0x7fe728166a80 con 0x7fe71405ef30 2023-08-22T00:22:34.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:34.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 msgr2=0x7fe7140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 0x7fe7140613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe728065970 tx=0x7fe718009040).stop 2023-08-22T00:22:34.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 msgr2=0x7fe728165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe7280c4140 tx=0x7fe71c01a000).stop 2023-08-22T00:22:34.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 shutdown_connections 2023-08-22T00:22:34.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe71405ef30 0x7fe7140613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe728153f10 0x7fe728166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7280c26b0 0x7fe7280c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 --2- 172.21.15.98:0/2972553805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe728150040 0x7fe728165430 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 >> 172.21.15.98:0/2972553805 conn(0x7fe7280c7140 msgr2=0x7fe728062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 shutdown_connections 2023-08-22T00:22:34.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.489+0000 7fe72d90c700 1 -- 172.21.15.98:0/2972553805 wait complete. 2023-08-22T00:22:34.497 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:34.502 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:22:33.482154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428980,"kb_used_data":11252,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752545740,"statfs":{"total":773094113280,"available":770606837760,"internally_reserved":0,"allocated":11522048,"data_stored":6063594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002108"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516417+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518074+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516838+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513614+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515928+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516006+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515520+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513788+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512602+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518275+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512567+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517425+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513292+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514106+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513184+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515873+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518071+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517535+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513144+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515529+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513757+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513055+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515752+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520072+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514504+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517910+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512482+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516530+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513351+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519005+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517686+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515950+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520007+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520518+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518849+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512544+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513352+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517202+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512899+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517434+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517229+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514932+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519689+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517221+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519216+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512859+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517890+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512553+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515711+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518343+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517255+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747611+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:22:27.747611+0000","last_peered":"2023-08-22T00:22:27.747611+0000","last_clean":"2023-08-22T00:22:27.747611+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:22:27.747611+0000","last_undegraded":"2023-08-22T00:22:27.747611+0000","last_fullsized":"2023-08-22T00:22:27.747611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515023+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506215+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:22:27.506215+0000","last_peered":"2023-08-22T00:22:27.506215+0000","last_clean":"2023-08-22T00:22:27.506215+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:22:27.506215+0000","last_undegraded":"2023-08-22T00:22:27.506215+0000","last_fullsized":"2023-08-22T00:22:27.506215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515086+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747877+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:22:27.747877+0000","last_peered":"2023-08-22T00:22:27.747877+0000","last_clean":"2023-08-22T00:22:27.747877+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:22:27.747877+0000","last_undegraded":"2023-08-22T00:22:27.747877+0000","last_fullsized":"2023-08-22T00:22:27.747877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515710+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506316+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:22:27.506316+0000","last_peered":"2023-08-22T00:22:27.506316+0000","last_clean":"2023-08-22T00:22:27.506316+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:22:27.506316+0000","last_undegraded":"2023-08-22T00:22:27.506316+0000","last_fullsized":"2023-08-22T00:22:27.506316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731220+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:22:27.731220+0000","last_peered":"2023-08-22T00:22:27.731220+0000","last_clean":"2023-08-22T00:22:27.731220+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:22:27.731220+0000","last_undegraded":"2023-08-22T00:22:27.731220+0000","last_fullsized":"2023-08-22T00:22:27.731220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519872+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731145+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:22:27.731145+0000","last_peered":"2023-08-22T00:22:27.731145+0000","last_clean":"2023-08-22T00:22:27.731145+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:22:27.731145+0000","last_undegraded":"2023-08-22T00:22:27.731145+0000","last_fullsized":"2023-08-22T00:22:27.731145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518597+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731168+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:22:27.731168+0000","last_peered":"2023-08-22T00:22:27.731168+0000","last_clean":"2023-08-22T00:22:27.731168+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:22:27.731168+0000","last_undegraded":"2023-08-22T00:22:27.731168+0000","last_fullsized":"2023-08-22T00:22:27.731168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520636+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747713+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:22:27.747713+0000","last_peered":"2023-08-22T00:22:27.747713+0000","last_clean":"2023-08-22T00:22:27.747713+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:22:27.747713+0000","last_undegraded":"2023-08-22T00:22:27.747713+0000","last_fullsized":"2023-08-22T00:22:27.747713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518267+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506216+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:22:27.506216+0000","last_peered":"2023-08-22T00:22:27.506216+0000","last_clean":"2023-08-22T00:22:27.506216+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:22:27.506216+0000","last_undegraded":"2023-08-22T00:22:27.506216+0000","last_fullsized":"2023-08-22T00:22:27.506216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55500000000000005,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.77500000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66400000000000003,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.749,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.56899999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.442},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.79600000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.28699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.437}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.624}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.26300000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.252}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.35799999999999998},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.45700000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53500000000000003,"5min":0.627,"15min":0.63600000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.505,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.28899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70099999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.377},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38900000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1429504,"data_stored":752197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.625}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:34.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:34.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.657+0000 7f5591811700 1 Processor -- start 2023-08-22T00:22:34.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.657+0000 7f5591811700 1 -- start start 2023-08-22T00:22:34.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f5591811700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f558c0a89a0 0x7f558c0bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f5591811700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 0x7f558c063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f5591811700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c063f60 con 0x7f558c0c24d0 2023-08-22T00:22:34.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f5591811700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c0bd3b0 con 0x7f558c0a89a0 2023-08-22T00:22:34.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f5591811700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c154830 con 0x7f558c155310 2023-08-22T00:22:34.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f558affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f558c0a89a0 0x7f558c0bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f558b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f558c0c24d0 0x7f558c0c2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53522/0 (socket says 172.21.15.98:53522) 2023-08-22T00:22:34.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f558b7fe700 1 -- 172.21.15.98:0/2258779491 learned_addr learned my addr 172.21.15.98:0/2258779491 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:34.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.658+0000 7f558affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f558c0a89a0 0x7f558c0bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42496/0 (socket says 172.21.15.98:42496) 2023-08-22T00:22:34.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558a7fc700 1 --2- 172.21.15.98:0/2258779491 >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 0x7f558c063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558affd700 1 -- 172.21.15.98:0/2258779491 >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 msgr2=0x7f558c063a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:34.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558affd700 1 --2- 172.21.15.98:0/2258779491 >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 0x7f558c063a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558affd700 1 -- 172.21.15.98:0/2258779491 >> v1:172.21.15.98:6789/0 conn(0x7f558c0c24d0 legacy=0x7f558c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5589ffb700 1 -- 172.21.15.98:0/2258779491 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222208855 0 0) 0x7f558c063f60 con 0x7f558c0c24d0 2023-08-22T00:22:34.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558affd700 1 -- 172.21.15.98:0/2258779491 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c154b10 con 0x7f558c0a89a0 2023-08-22T00:22:34.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558a7fc700 1 --2- 172.21.15.98:0/2258779491 >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 0x7f558c063a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:34.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f558affd700 1 --2- 172.21.15.98:0/2258779491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c0a89a0 0x7f558c0bcd60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f558c0a6120 tx=0x7f5580009060).ready entity=mon.0 client_cookie=fe7bee65fad4f2a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5589ffb700 1 -- 172.21.15.98:0/2258779491 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000b580 con 0x7f558c0a89a0 2023-08-22T00:22:34.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5589ffb700 1 -- 172.21.15.98:0/2258779491 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558000b6e0 con 0x7f558c0a89a0 2023-08-22T00:22:34.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5589ffb700 1 -- 172.21.15.98:0/2258779491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000ba60 con 0x7f558c0a89a0 2023-08-22T00:22:34.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 -- 172.21.15.98:0/2258779491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c0a89a0 msgr2=0x7f558c0bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 --2- 172.21.15.98:0/2258779491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c0a89a0 0x7f558c0bcd60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f558c0a6120 tx=0x7f5580009060).stop 2023-08-22T00:22:34.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 -- 172.21.15.98:0/2258779491 shutdown_connections 2023-08-22T00:22:34.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 --2- 172.21.15.98:0/2258779491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c0a89a0 0x7f558c0bcd60 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 --2- 172.21.15.98:0/2258779491 >> v2:172.21.15.118:3300/0 conn(0x7f558c155310 0x7f558c063a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.659+0000 7f5591811700 1 -- 172.21.15.98:0/2258779491 >> 172.21.15.98:0/2258779491 conn(0x7f558c0c7140 msgr2=0x7f558c0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.660+0000 7f5591811700 1 -- 172.21.15.98:0/2258779491 shutdown_connections 2023-08-22T00:22:34.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.660+0000 7f5591811700 1 -- 172.21.15.98:0/2258779491 wait complete. 2023-08-22T00:22:34.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.661+0000 7f5591811700 1 Processor -- start 2023-08-22T00:22:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.661+0000 7f5591811700 1 -- start start 2023-08-22T00:22:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f558c0a89a0 0x7f558c14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f558c0c24d0 0x7f558c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0be6f0 con 0x7f558c155310 2023-08-22T00:22:34.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0bef90 con 0x7f558c0a89a0 2023-08-22T00:22:34.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f5591811700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1537a0 con 0x7f558c0c24d0 2023-08-22T00:22:34.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f558b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f558b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42512/0 (socket says 172.21.15.98:42512) 2023-08-22T00:22:34.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f558b7fe700 1 -- 172.21.15.98:0/3764387682 learned_addr learned my addr 172.21.15.98:0/3764387682 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:34.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.662+0000 7f558affd700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f558c0a89a0 0x7f558c14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558a7fc700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f558c0c24d0 0x7f558c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 -- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f558c0c24d0 msgr2=0x7f558c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f558c0c24d0 0x7f558c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 -- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f558c0a89a0 msgr2=0x7f558c14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f558c0a89a0 0x7f558c14d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 -- 172.21.15.98:0/3764387682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800092a0 con 0x7f558c155310 2023-08-22T00:22:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f558b7fe700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f558400c790 tx=0x7f5584007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584005d30 con 0x7f558c155310 2023-08-22T00:22:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584007110 con 0x7f558c155310 2023-08-22T00:22:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c0be940 con 0x7f558c155310 2023-08-22T00:22:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55840074d0 con 0x7f558c155310 2023-08-22T00:22:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.663+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c14d7d0 con 0x7f558c155310 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.664+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c047480 con 0x7f558c155310 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.664+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5584007840 con 0x7f558c155310 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.665+0000 7f5572ffd700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 0x7f55780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.665+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f558407a190 con 0x7f558c155310 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.665+0000 7f558affd700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 0x7f55780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.665+0000 7f558affd700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 0x7f55780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f558000b340 tx=0x7f5580017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.669+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f558404b320 con 0x7f558c155310 2023-08-22T00:22:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.826+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f558c0bf0d0 con 0x7f557805ef30 2023-08-22T00:22:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.835+0000 7f5572ffd700 1 -- 172.21.15.98:0/3764387682 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353332 (secure 0 0 0) 0x7f558c0bf0d0 con 0x7f557805ef30 2023-08-22T00:22:34.840 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 msgr2=0x7f55780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 0x7f55780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f558000b340 tx=0x7f5580017000).stop 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 msgr2=0x7f558c064e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f558400c790 tx=0x7f5584007f30).stop 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 shutdown_connections 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f558c155310 0x7f558c064e60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f558c0a89a0 0x7f558c14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f557805ef30 0x7f55780613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 --2- 172.21.15.98:0/3764387682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f558c0c24d0 0x7f558c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.838+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 >> 172.21.15.98:0/3764387682 conn(0x7f558c0c7140 msgr2=0x7f558c14f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.839+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 shutdown_connections 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:34.839+0000 7f5591811700 1 -- 172.21.15.98:0/3764387682 wait complete. 2023-08-22T00:22:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:34.852 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:22:33.482154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428980,"kb_used_data":11252,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752545740,"statfs":{"total":773094113280,"available":770606837760,"internally_reserved":0,"allocated":11522048,"data_stored":6063594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002108"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516417+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518074+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516838+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513614+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515928+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516006+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515520+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513788+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512602+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518275+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512567+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517425+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513292+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514106+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513184+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515873+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518071+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517535+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513144+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515529+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513757+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513055+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515752+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520072+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514504+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517910+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512482+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516530+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513351+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519005+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517686+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515950+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520007+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520518+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518849+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512544+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513352+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517202+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512899+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517434+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517229+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514932+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519689+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517221+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519216+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512859+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517890+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512553+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515711+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518343+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517255+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747611+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:22:27.747611+0000","last_peered":"2023-08-22T00:22:27.747611+0000","last_clean":"2023-08-22T00:22:27.747611+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:22:27.747611+0000","last_undegraded":"2023-08-22T00:22:27.747611+0000","last_fullsized":"2023-08-22T00:22:27.747611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515023+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506215+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:22:27.506215+0000","last_peered":"2023-08-22T00:22:27.506215+0000","last_clean":"2023-08-22T00:22:27.506215+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:22:27.506215+0000","last_undegraded":"2023-08-22T00:22:27.506215+0000","last_fullsized":"2023-08-22T00:22:27.506215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515086+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747877+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:22:27.747877+0000","last_peered":"2023-08-22T00:22:27.747877+0000","last_clean":"2023-08-22T00:22:27.747877+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:22:27.747877+0000","last_undegraded":"2023-08-22T00:22:27.747877+0000","last_fullsized":"2023-08-22T00:22:27.747877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515710+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506316+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:22:27.506316+0000","last_peered":"2023-08-22T00:22:27.506316+0000","last_clean":"2023-08-22T00:22:27.506316+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:22:27.506316+0000","last_undegraded":"2023-08-22T00:22:27.506316+0000","last_fullsized":"2023-08-22T00:22:27.506316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731220+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:22:27.731220+0000","last_peered":"2023-08-22T00:22:27.731220+0000","last_clean":"2023-08-22T00:22:27.731220+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:22:27.731220+0000","last_undegraded":"2023-08-22T00:22:27.731220+0000","last_fullsized":"2023-08-22T00:22:27.731220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519872+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731145+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:22:27.731145+0000","last_peered":"2023-08-22T00:22:27.731145+0000","last_clean":"2023-08-22T00:22:27.731145+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:22:27.731145+0000","last_undegraded":"2023-08-22T00:22:27.731145+0000","last_fullsized":"2023-08-22T00:22:27.731145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518597+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731168+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:22:27.731168+0000","last_peered":"2023-08-22T00:22:27.731168+0000","last_clean":"2023-08-22T00:22:27.731168+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:22:27.731168+0000","last_undegraded":"2023-08-22T00:22:27.731168+0000","last_fullsized":"2023-08-22T00:22:27.731168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520636+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747713+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:22:27.747713+0000","last_peered":"2023-08-22T00:22:27.747713+0000","last_clean":"2023-08-22T00:22:27.747713+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:22:27.747713+0000","last_undegraded":"2023-08-22T00:22:27.747713+0000","last_fullsized":"2023-08-22T00:22:27.747713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518267+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506216+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:22:27.506216+0000","last_peered":"2023-08-22T00:22:27.506216+0000","last_clean":"2023-08-22T00:22:27.506216+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:22:27.506216+0000","last_undegraded":"2023-08-22T00:22:27.506216+0000","last_fullsized":"2023-08-22T00:22:27.506216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55500000000000005,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.77500000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66400000000000003,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.749,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.56899999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.442},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.79600000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.28699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.437}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.624}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.26300000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.252}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.35799999999999998},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.45700000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53500000000000003,"5min":0.627,"15min":0.63600000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.505,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.28899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70099999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.377},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38900000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1429504,"data_stored":752197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.625}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:34.905 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:35.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.020+0000 7f71c6fe7700 1 Processor -- start 2023-08-22T00:22:35.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 -- start start 2023-08-22T00:22:35.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 0x7f71c014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71c00c5a90 0x7f71c00c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c0155260 con 0x7f71c00c5a90 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c00bf9e0 con 0x7f71c014e0d0 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.021+0000 7f71c6fe7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00bfcc0 con 0x7f71c01544f0 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71c00c5a90 0x7f71c00c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71c00c5a90 0x7f71c00c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42526/0 (socket says 172.21.15.98:42526) 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 -- 172.21.15.98:0/1529036957 learned_addr learned my addr 172.21.15.98:0/1529036957 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:35.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71c4d83700 1 --2- 172.21.15.98:0/1529036957 >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 0x7f71c014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71c5584700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 -- 172.21.15.98:0/1529036957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 msgr2=0x7f71c01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 -- 172.21.15.98:0/1529036957 >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 msgr2=0x7f71c014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 --2- 172.21.15.98:0/1529036957 >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 0x7f71c014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 -- 172.21.15.98:0/1529036957 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00bffa0 con 0x7f71c00c5a90 2023-08-22T00:22:35.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71c4d83700 1 --2- 172.21.15.98:0/1529036957 >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 0x7f71c014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bffff700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c00c5a90 0x7f71c00c5f40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f71ac006fd0 tx=0x7f71ac0090f0).ready entity=mon.0 client_cookie=883208e1f9048e93 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bf7fe700 1 -- 172.21.15.98:0/1529036957 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00b600 con 0x7f71c00c5a90 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bf7fe700 1 -- 172.21.15.98:0/1529036957 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00b760 con 0x7f71c00c5a90 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.022+0000 7f71bf7fe700 1 -- 172.21.15.98:0/1529036957 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00bae0 con 0x7f71c00c5a90 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 -- 172.21.15.98:0/1529036957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c00c5a90 msgr2=0x7f71c00c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c00c5a90 0x7f71c00c5f40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f71ac006fd0 tx=0x7f71ac0090f0).stop 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 -- 172.21.15.98:0/1529036957 shutdown_connections 2023-08-22T00:22:35.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/1529036957 >> v2:172.21.15.118:3300/0 conn(0x7f71c014e0d0 0x7f71c014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/1529036957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c00c5a90 0x7f71c00c5f40 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 -- 172.21.15.98:0/1529036957 >> 172.21.15.98:0/1529036957 conn(0x7f71c00caa80 msgr2=0x7f71c00cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 -- 172.21.15.98:0/1529036957 shutdown_connections 2023-08-22T00:22:35.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.023+0000 7f71c6fe7700 1 -- 172.21.15.98:0/1529036957 wait complete. 2023-08-22T00:22:35.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.024+0000 7f71c6fe7700 1 Processor -- start 2023-08-22T00:22:35.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.024+0000 7f71c6fe7700 1 -- start start 2023-08-22T00:22:35.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 0x7f71c00ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c014ec30 con 0x7f71c014e0d0 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c014ef10 con 0x7f71c00c5a90 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c014f1f0 con 0x7f71c01544f0 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42528/0 (socket says 172.21.15.98:42528) 2023-08-22T00:22:35.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 -- 172.21.15.98:0/18181111 learned_addr learned my addr 172.21.15.98:0/18181111 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c5584700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c4d83700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 0x7f71c00ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 -- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 msgr2=0x7f71c014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c014fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 -- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 msgr2=0x7f71c00ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 0x7f71c00ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 -- 172.21.15.98:0/18181111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009370 con 0x7f71c014e0d0 2023-08-22T00:22:35.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c4d83700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 0x7f71c00ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bffff700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f71c00ca9e0 tx=0x7f71ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00b8d0 con 0x7f71c014e0d0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00ba30 con 0x7f71c014e0d0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c014f4d0 con 0x7f71c014e0d0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac01b670 con 0x7f71c014e0d0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.025+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c01510d0 con 0x7f71c014e0d0 2023-08-22T00:22:35.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.026+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c014e9a0 con 0x7f71c014e0d0 2023-08-22T00:22:35.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.027+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f71ac01baa0 con 0x7f71c014e0d0 2023-08-22T00:22:35.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.027+0000 7f71bcff9700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 0x7f71a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.027+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f71ac07b920 con 0x7f71c014e0d0 2023-08-22T00:22:35.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.027+0000 7f71c4d83700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 0x7f71a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.027+0000 7f71c4d83700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 0x7f71a40613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f71b4006fd0 tx=0x7f71b4008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.031+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71ac04cb60 con 0x7f71c014e0d0 2023-08-22T00:22:35.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.188+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71c0047480 con 0x7f71a405ef30 2023-08-22T00:22:35.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.197+0000 7f71bcff9700 1 -- 172.21.15.98:0/18181111 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353332 (secure 0 0 0) 0x7f71c0047480 con 0x7f71a405ef30 2023-08-22T00:22:35.205 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:35.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 msgr2=0x7f71a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 0x7f71a40613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f71b4006fd0 tx=0x7f71b4008040).stop 2023-08-22T00:22:35.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 msgr2=0x7f71c00af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f71c00ca9e0 tx=0x7f71ac017000).stop 2023-08-22T00:22:35.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 shutdown_connections 2023-08-22T00:22:35.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f71a405ef30 0x7f71a40613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71c01544f0 0x7f71c014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c00c5a90 0x7f71c00ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 --2- 172.21.15.98:0/18181111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c014e0d0 0x7f71c00af7e0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 >> 172.21.15.98:0/18181111 conn(0x7f71c00caa80 msgr2=0x7f71c00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 shutdown_connections 2023-08-22T00:22:35.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.200+0000 7f71c6fe7700 1 -- 172.21.15.98:0/18181111 wait complete. 2023-08-22T00:22:35.211 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:35.213 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:22:33.482154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428980,"kb_used_data":11252,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752545740,"statfs":{"total":773094113280,"available":770606837760,"internally_reserved":0,"allocated":11522048,"data_stored":6063594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002108"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516417+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518074+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516838+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513614+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515928+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516006+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515520+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513788+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512602+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518275+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512567+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517425+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513292+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514106+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513184+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515873+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518071+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517535+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513144+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515529+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513757+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513055+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515752+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520072+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514504+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517910+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512482+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516530+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513351+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519005+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517686+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515950+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520007+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520518+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518849+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512544+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513352+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517202+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512899+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517434+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517229+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514932+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519689+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517221+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519216+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512859+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517890+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512553+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515711+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518343+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517255+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747611+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:22:27.747611+0000","last_peered":"2023-08-22T00:22:27.747611+0000","last_clean":"2023-08-22T00:22:27.747611+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:22:27.747611+0000","last_undegraded":"2023-08-22T00:22:27.747611+0000","last_fullsized":"2023-08-22T00:22:27.747611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515023+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506215+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:22:27.506215+0000","last_peered":"2023-08-22T00:22:27.506215+0000","last_clean":"2023-08-22T00:22:27.506215+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:22:27.506215+0000","last_undegraded":"2023-08-22T00:22:27.506215+0000","last_fullsized":"2023-08-22T00:22:27.506215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515086+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747877+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:22:27.747877+0000","last_peered":"2023-08-22T00:22:27.747877+0000","last_clean":"2023-08-22T00:22:27.747877+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:22:27.747877+0000","last_undegraded":"2023-08-22T00:22:27.747877+0000","last_fullsized":"2023-08-22T00:22:27.747877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515710+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506316+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:22:27.506316+0000","last_peered":"2023-08-22T00:22:27.506316+0000","last_clean":"2023-08-22T00:22:27.506316+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:22:27.506316+0000","last_undegraded":"2023-08-22T00:22:27.506316+0000","last_fullsized":"2023-08-22T00:22:27.506316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731220+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:22:27.731220+0000","last_peered":"2023-08-22T00:22:27.731220+0000","last_clean":"2023-08-22T00:22:27.731220+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:22:27.731220+0000","last_undegraded":"2023-08-22T00:22:27.731220+0000","last_fullsized":"2023-08-22T00:22:27.731220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519872+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731145+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:22:27.731145+0000","last_peered":"2023-08-22T00:22:27.731145+0000","last_clean":"2023-08-22T00:22:27.731145+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:22:27.731145+0000","last_undegraded":"2023-08-22T00:22:27.731145+0000","last_fullsized":"2023-08-22T00:22:27.731145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518597+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731168+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:22:27.731168+0000","last_peered":"2023-08-22T00:22:27.731168+0000","last_clean":"2023-08-22T00:22:27.731168+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:22:27.731168+0000","last_undegraded":"2023-08-22T00:22:27.731168+0000","last_fullsized":"2023-08-22T00:22:27.731168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520636+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747713+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:22:27.747713+0000","last_peered":"2023-08-22T00:22:27.747713+0000","last_clean":"2023-08-22T00:22:27.747713+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:22:27.747713+0000","last_undegraded":"2023-08-22T00:22:27.747713+0000","last_fullsized":"2023-08-22T00:22:27.747713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518267+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506216+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:22:27.506216+0000","last_peered":"2023-08-22T00:22:27.506216+0000","last_clean":"2023-08-22T00:22:27.506216+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:22:27.506216+0000","last_undegraded":"2023-08-22T00:22:27.506216+0000","last_fullsized":"2023-08-22T00:22:27.506216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55500000000000005,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.77500000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66400000000000003,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.749,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.56899999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.442},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.79600000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.28699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.437}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.624}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.26300000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.252}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.35799999999999998},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.45700000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53500000000000003,"5min":0.627,"15min":0.63600000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.505,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.28899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70099999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.377},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38900000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1429504,"data_stored":752197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.625}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:35.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-08-22T00:22:35.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-08-22T00:22:35.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.516417+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-08-22T00:22:35.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-08-22T00:22:35.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518074+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-08-22T00:22:35.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-08-22T00:22:35.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.516838+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-08-22T00:22:35.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-08-22T00:22:35.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513614+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-08-22T00:22:35.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-08-22T00:22:35.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515928+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-08-22T00:22:35.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-08-22T00:22:35.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.516006+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-08-22T00:22:35.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-08-22T00:22:35.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515520+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:22:35.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-08-22T00:22:35.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-08-22T00:22:35.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513788+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-08-22T00:22:35.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-08-22T00:22:35.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512602+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-08-22T00:22:35.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-08-22T00:22:35.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518275+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-08-22T00:22:35.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-08-22T00:22:35.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512567+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-08-22T00:22:35.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-08-22T00:22:35.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517425+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-08-22T00:22:35.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-08-22T00:22:35.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513292+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-08-22T00:22:35.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-08-22T00:22:35.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.514106+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-08-22T00:22:35.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-08-22T00:22:35.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513184+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-08-22T00:22:35.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-08-22T00:22:35.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515873+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-08-22T00:22:35.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-08-22T00:22:35.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518071+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-08-22T00:22:35.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-08-22T00:22:35.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517535+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-08-22T00:22:35.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-08-22T00:22:35.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513097+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-08-22T00:22:35.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-08-22T00:22:35.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513144+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-08-22T00:22:35.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-08-22T00:22:35.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515529+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-08-22T00:22:35.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-08-22T00:22:35.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513757+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-08-22T00:22:35.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-08-22T00:22:35.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513055+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:22:35.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-08-22T00:22:35.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-08-22T00:22:35.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515752+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-08-22T00:22:35.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-08-22T00:22:35.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.520072+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-08-22T00:22:35.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-08-22T00:22:35.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.514504+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-08-22T00:22:35.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-08-22T00:22:35.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517910+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-08-22T00:22:35.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-08-22T00:22:35.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512482+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-08-22T00:22:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-08-22T00:22:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.516530+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:22:35.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-08-22T00:22:35.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-08-22T00:22:35.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513351+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-08-22T00:22:35.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-08-22T00:22:35.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.519005+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-08-22T00:22:35.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-08-22T00:22:35.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.520097+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-08-22T00:22:35.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-08-22T00:22:35.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517686+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-08-22T00:22:35.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-08-22T00:22:35.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515950+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:22:35.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-08-22T00:22:35.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-08-22T00:22:35.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.520007+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-08-22T00:22:35.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-08-22T00:22:35.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.520518+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-08-22T00:22:35.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-08-22T00:22:35.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512299+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-08-22T00:22:35.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-08-22T00:22:35.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518849+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-08-22T00:22:35.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-08-22T00:22:35.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512544+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:22:35.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-08-22T00:22:35.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-08-22T00:22:35.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.513352+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-08-22T00:22:35.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-08-22T00:22:35.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512288+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-08-22T00:22:35.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-08-22T00:22:35.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517202+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-08-22T00:22:35.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-08-22T00:22:35.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.516299+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:22:35.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-08-22T00:22:35.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-08-22T00:22:35.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512899+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-08-22T00:22:35.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-08-22T00:22:35.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517434+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-08-22T00:22:35.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-08-22T00:22:35.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517229+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-08-22T00:22:35.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-08-22T00:22:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.514932+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-08-22T00:22:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-08-22T00:22:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512288+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:22:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-08-22T00:22:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-08-22T00:22:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.519689+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-08-22T00:22:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-08-22T00:22:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517221+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-08-22T00:22:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-08-22T00:22:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.519216+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-08-22T00:22:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-08-22T00:22:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512859+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:22:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-08-22T00:22:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-08-22T00:22:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517890+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-08-22T00:22:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-08-22T00:22:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.512553+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:22:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-08-22T00:22:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-08-22T00:22:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515711+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:22:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-08-22T00:22:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-08-22T00:22:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518343+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:22:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-08-22T00:22:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-08-22T00:22:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.517255+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-08-22T00:22:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-08-22T00:22:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515023+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:22:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-08-22T00:22:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-08-22T00:22:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515086+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:22:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-08-22T00:22:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-08-22T00:22:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.515710+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:22:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-08-22T00:22:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-08-22T00:22:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.519872+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-08-22T00:22:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-08-22T00:22:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518597+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-08-22T00:22:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-08-22T00:22:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.520636+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:22:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-08-22T00:22:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:22:30.510210+0000', 'last_change': '2023-08-22T00:22:30.510210+0000', 'last_active': '2023-08-22T00:22:30.510210+0000', 'last_peered': '2023-08-22T00:22:30.510210+0000', 'last_clean': '2023-08-22T00:22:30.510210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:30.510210+0000', 'last_undegraded': '2023-08-22T00:22:30.510210+0000', 'last_fullsized': '2023-08-22T00:22:30.510210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:30.510210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:22:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-08-22T00:22:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:22:29.505656+0000', 'last_change': '2023-08-22T00:22:29.518267+0000', 'last_active': '2023-08-22T00:22:29.505656+0000', 'last_peered': '2023-08-22T00:22:29.505656+0000', 'last_clean': '2023-08-22T00:22:29.505656+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:22:29.505656+0000', 'last_undegraded': '2023-08-22T00:22:29.505656+0000', 'last_fullsized': '2023-08-22T00:22:29.505656+0000', 'mapping_epoch': 117, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 117, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'last_clean_scrub_stamp': '2023-08-22T00:22:29.505656+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:22:35.307 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:22:35.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.422+0000 7f5e4ca3c700 1 Processor -- start 2023-08-22T00:22:35.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.422+0000 7f5e4ca3c700 1 -- start start 2023-08-22T00:22:35.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5e480a61b0 0x7f5e48150f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5e48151400 0x7f5e480c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e480bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e48151e40 con 0x7f5e480a61b0 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e480c4f80 con 0x7f5e48151400 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.423+0000 7f5e4ca3c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48151880 con 0x7f5e480a6590 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5e480a61b0 0x7f5e48150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5e480a61b0 0x7f5e48150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42530/0 (socket says 172.21.15.98:42530) 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 -- 172.21.15.98:0/379154610 learned_addr learned my addr 172.21.15.98:0/379154610 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:35.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e46d9d700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e480bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e45d9b700 1 --2- 172.21.15.98:0/379154610 >> v2:172.21.15.118:3300/0 conn(0x7f5e48151400 0x7f5e480c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 -- 172.21.15.98:0/379154610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 msgr2=0x7f5e480bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e480bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 -- 172.21.15.98:0/379154610 >> v2:172.21.15.118:3300/0 conn(0x7f5e48151400 msgr2=0x7f5e480c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 --2- 172.21.15.98:0/379154610 >> v2:172.21.15.118:3300/0 conn(0x7f5e48151400 0x7f5e480c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 -- 172.21.15.98:0/379154610 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48151b60 con 0x7f5e480a61b0 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4659c700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e480a61b0 0x7f5e48150f10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f5e48154440 tx=0x7f5e300090f0).ready entity=mon.0 client_cookie=955473c861ab762d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4559a700 1 -- 172.21.15.98:0/379154610 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000f510 con 0x7f5e480a61b0 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4559a700 1 -- 172.21.15.98:0/379154610 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000f670 con 0x7f5e480a61b0 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.424+0000 7f5e4559a700 1 -- 172.21.15.98:0/379154610 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000fa10 con 0x7f5e480a61b0 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/379154610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e480a61b0 msgr2=0x7f5e48150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e480a61b0 0x7f5e48150f10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f5e48154440 tx=0x7f5e300090f0).stop 2023-08-22T00:22:35.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/379154610 shutdown_connections 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e480bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/379154610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e480a61b0 0x7f5e48150f10 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/379154610 >> v2:172.21.15.118:3300/0 conn(0x7f5e48151400 0x7f5e480c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/379154610 >> 172.21.15.98:0/379154610 conn(0x7f5e480c3980 msgr2=0x7f5e480c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/379154610 shutdown_connections 2023-08-22T00:22:35.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.425+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/379154610 wait complete. 2023-08-22T00:22:35.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.426+0000 7f5e4ca3c700 1 Processor -- start 2023-08-22T00:22:35.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.426+0000 7f5e4ca3c700 1 -- start start 2023-08-22T00:22:35.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e480a61b0 0x7f5e48141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e4814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a6e90 con 0x7f5e48151400 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a7cb0 con 0x7f5e480a61b0 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a70a0 con 0x7f5e480a6590 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42538/0 (socket says 172.21.15.98:42538) 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 -- 172.21.15.98:0/3639402699 learned_addr learned my addr 172.21.15.98:0/3639402699 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e45d9b700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e4814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4659c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e480a61b0 0x7f5e48141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 -- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 msgr2=0x7f5e4814fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e4814fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 -- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e480a61b0 msgr2=0x7f5e48141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e480a61b0 0x7f5e48141430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 -- 172.21.15.98:0/3639402699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009370 con 0x7f5e48151400 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e45d9b700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e4814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e46d9d700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f5e40009ef0 tx=0x7f5e4000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000cc20 con 0x7f5e48151400 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000f040 con 0x7f5e48151400 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e480a7380 con 0x7f5e48151400 2023-08-22T00:22:35.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40013400 con 0x7f5e48151400 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.427+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e480a7940 con 0x7f5e48151400 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.428+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e48047480 con 0x7f5e48151400 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.429+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5e400137b0 con 0x7f5e48151400 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.429+0000 7f5e3e7fc700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 0x7f5e280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.429+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5e4007aa00 con 0x7f5e48151400 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.429+0000 7f5e4659c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 0x7f5e280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.429+0000 7f5e4659c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 0x7f5e280613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5e481511a0 tx=0x7f5e30017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.433+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e4004bb90 con 0x7f5e48151400 2023-08-22T00:22:35.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.659+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5e480a7df0 con 0x7f5e48151400 2023-08-22T00:22:35.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.660+0000 7f5e3e7fc700 1 -- 172.21.15.98:0/3639402699 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7f5e4004f1b0 con 0x7f5e48151400 2023-08-22T00:22:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:35.661 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1004,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":120,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2487275520,"bytes_avail":770606837760,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":43,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7377}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-22T00:20:14.810414+0000","services":{}},"progress_events":{}} 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 msgr2=0x7f5e280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 0x7f5e280613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5e481511a0 tx=0x7f5e30017000).stop 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 msgr2=0x7f5e480a69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f5e40009ef0 tx=0x7f5e4000b040).stop 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 shutdown_connections 2023-08-22T00:22:35.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e48151400 0x7f5e480a69a0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e480a61b0 0x7f5e48141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5e2805ef30 0x7f5e280613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.661+0000 7f5e4ca3c700 1 --2- 172.21.15.98:0/3639402699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e480a6590 0x7f5e4814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.662+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 >> 172.21.15.98:0/3639402699 conn(0x7f5e480c3980 msgr2=0x7f5e48069650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.662+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 shutdown_connections 2023-08-22T00:22:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.662+0000 7f5e4ca3c700 1 -- 172.21.15.98:0/3639402699 wait complete. 2023-08-22T00:22:35.674 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:22:35.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:35.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.789+0000 7fbc1d58b700 1 Processor -- start 2023-08-22T00:22:35.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.789+0000 7fbc1d58b700 1 -- start start 2023-08-22T00:22:35.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc1d58b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc18151d60 0x7fbc18155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc1d58b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc18158bf0 con 0x7fbc180a6e50 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc1d58b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc18157d90 con 0x7fbc18066620 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc1d58b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc18157fe0 con 0x7fbc18151d60 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc167fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbc180a6e50 0x7fbc18065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53530/0 (socket says 172.21.15.98:53530) 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.790+0000 7fbc167fc700 1 -- 172.21.15.98:0/2193329618 learned_addr learned my addr 172.21.15.98:0/2193329618 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc16ffd700 1 --2- 172.21.15.98:0/2193329618 >> v2:172.21.15.118:3300/0 conn(0x7fbc18151d60 0x7fbc18155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783976654 0 0) 0x7fbc18158bf0 con 0x7fbc180a6e50 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc040033f0 con 0x7fbc180a6e50 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754685025 0 0) 0x7fbc18157d90 con 0x7fbc18066620 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc18158bf0 con 0x7fbc18066620 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1999807071 0 0) 0x7fbc040033f0 con 0x7fbc180a6e50 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 >> v2:172.21.15.118:3300/0 conn(0x7fbc18151d60 msgr2=0x7fbc18155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 --2- 172.21.15.98:0/2193329618 >> v2:172.21.15.118:3300/0 conn(0x7fbc18151d60 0x7fbc18155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 >> v1:172.21.15.118:6789/0 conn(0x7fbc18066620 legacy=0x7fbc180643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc181582c0 con 0x7fbc180a6e50 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fbc08001470 con 0x7fbc180a6e50 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 >> v1:172.21.15.98:6789/0 conn(0x7fbc180a6e50 legacy=0x7fbc18065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04003ac0 0x7fbc04003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc04004690 0x7fbc04004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc0400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18157fe0 con 0x7fbc04005000 2023-08-22T00:22:35.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0400bf60 con 0x7fbc04003ac0 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0400c120 con 0x7fbc04004690 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc0400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc16ffd700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04003ac0 0x7fbc04003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc167fc700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc04004690 0x7fbc04004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 -- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc04004690 msgr2=0x7fbc04004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc04004690 0x7fbc04004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 -- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04003ac0 msgr2=0x7fbc04003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:35.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04003ac0 0x7fbc04003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 -- 172.21.15.98:0/2193329618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040033f0 con 0x7fbc04005000 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 -- 172.21.15.98:0/2193329618 reap_dead start 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.791+0000 7fbc177fe700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc0400b8e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fbc10001f90 tx=0x7fbc10007f30).ready entity=mon.0 client_cookie=7eb860d67adb8bbb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10006a20 con 0x7fbc04005000 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10006b80 con 0x7fbc04005000 2023-08-22T00:22:35.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc15ffb700 1 -- 172.21.15.98:0/2193329618 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000c8b0 con 0x7fbc04005000 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 -- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 msgr2=0x7fbc0400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc0400b8e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fbc10001f90 tx=0x7fbc10007f30).stop 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 -- 172.21.15.98:0/2193329618 shutdown_connections 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/2193329618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc0400b8e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 -- 172.21.15.98:0/2193329618 >> 172.21.15.98:0/2193329618 conn(0x7fbc1806a980 msgr2=0x7fbc180c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 -- 172.21.15.98:0/2193329618 shutdown_connections 2023-08-22T00:22:35.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.792+0000 7fbc1d58b700 1 -- 172.21.15.98:0/2193329618 wait complete. 2023-08-22T00:22:35.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.793+0000 7fbc1d58b700 1 Processor -- start 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.793+0000 7fbc1d58b700 1 -- start start 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 0x7fbc180a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1814b7e0 0x7fbc180c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180a96a0 con 0x7fbc04005000 2023-08-22T00:22:35.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180a8600 con 0x7fbc180a8180 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc1d58b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180a88e0 con 0x7fbc1814b7e0 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc16ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc16ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42562/0 (socket says 172.21.15.98:42562) 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc16ffd700 1 -- 172.21.15.98:0/381368417 learned_addr learned my addr 172.21.15.98:0/381368417 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc177fe700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1814b7e0 0x7fbc180c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.794+0000 7fbc167fc700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 0x7fbc180a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 -- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1814b7e0 msgr2=0x7fbc180c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1814b7e0 0x7fbc180c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 -- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 msgr2=0x7fbc180a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 0x7fbc180a9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 -- 172.21.15.98:0/381368417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180a8bc0 con 0x7fbc04005000 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc167fc700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 0x7fbc180a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc16ffd700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fbc000119c0 tx=0x7fbc00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00011e50 con 0x7fbc04005000 2023-08-22T00:22:35.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000f940 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000fcc0 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc180a8ea0 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.795+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc180aa080 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.796+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc180a94f0 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.796+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbc00014650 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.796+0000 7fbc0effd700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 0x7fbbf80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.797+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbc0007abe0 con 0x7fbc04005000 2023-08-22T00:22:35.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.797+0000 7fbc167fc700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 0x7fbbf80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:35.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.797+0000 7fbc167fc700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 0x7fbbf80613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbc08001bb0 tx=0x7fbc08009040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:35.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.801+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc0004bd70 con 0x7fbc04005000 2023-08-22T00:22:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.959+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc180c6350 con 0x7fbbf805ef30 2023-08-22T00:22:35.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.968+0000 7fbc0effd700 1 -- 172.21.15.98:0/381368417 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353332 (secure 0 0 0) 0x7fbc180c6350 con 0x7fbbf805ef30 2023-08-22T00:22:35.973 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:35.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 msgr2=0x7fbbf80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 0x7fbbf80613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbc08001bb0 tx=0x7fbc08009040).stop 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 msgr2=0x7fbc1814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fbc000119c0 tx=0x7fbc00009060).stop 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 shutdown_connections 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbbf805ef30 0x7fbbf80613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1814b7e0 0x7fbc180c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc04005000 0x7fbc1814b2f0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 --2- 172.21.15.98:0/381368417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc180a8180 0x7fbc180a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:35.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 >> 172.21.15.98:0/381368417 conn(0x7fbc1806a980 msgr2=0x7fbc18150cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:35.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 shutdown_connections 2023-08-22T00:22:35.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:35.972+0000 7fbc1d58b700 1 -- 172.21.15.98:0/381368417 wait complete. 2023-08-22T00:22:35.977 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:35.985 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:22:35.482645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428980,"kb_used_data":11252,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752545740,"statfs":{"total":773094113280,"available":770606837760,"internally_reserved":0,"allocated":11522048,"data_stored":6063594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002108"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516417+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518074+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516838+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513614+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515928+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516006+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515520+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513788+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512602+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518275+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512567+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517425+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513292+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514106+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513184+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515873+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518071+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517535+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513144+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515529+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513757+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513055+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515752+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520072+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514504+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517910+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512482+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516530+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513351+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519005+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520097+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517686+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515950+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520007+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520518+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518849+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512544+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.513352+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517202+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.516299+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512899+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517434+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517229+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.514932+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512288+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519689+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517221+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519216+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512859+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517890+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.512553+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515711+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518343+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.517255+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747611+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:22:27.747611+0000","last_peered":"2023-08-22T00:22:27.747611+0000","last_clean":"2023-08-22T00:22:27.747611+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:22:27.747611+0000","last_undegraded":"2023-08-22T00:22:27.747611+0000","last_fullsized":"2023-08-22T00:22:27.747611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515023+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506215+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:22:27.506215+0000","last_peered":"2023-08-22T00:22:27.506215+0000","last_clean":"2023-08-22T00:22:27.506215+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:22:27.506215+0000","last_undegraded":"2023-08-22T00:22:27.506215+0000","last_fullsized":"2023-08-22T00:22:27.506215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515086+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747877+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:22:27.747877+0000","last_peered":"2023-08-22T00:22:27.747877+0000","last_clean":"2023-08-22T00:22:27.747877+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:22:27.747877+0000","last_undegraded":"2023-08-22T00:22:27.747877+0000","last_fullsized":"2023-08-22T00:22:27.747877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.515710+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506316+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:22:27.506316+0000","last_peered":"2023-08-22T00:22:27.506316+0000","last_clean":"2023-08-22T00:22:27.506316+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:22:27.506316+0000","last_undegraded":"2023-08-22T00:22:27.506316+0000","last_fullsized":"2023-08-22T00:22:27.506316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731220+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:22:27.731220+0000","last_peered":"2023-08-22T00:22:27.731220+0000","last_clean":"2023-08-22T00:22:27.731220+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:22:27.731220+0000","last_undegraded":"2023-08-22T00:22:27.731220+0000","last_fullsized":"2023-08-22T00:22:27.731220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.519872+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731145+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:22:27.731145+0000","last_peered":"2023-08-22T00:22:27.731145+0000","last_clean":"2023-08-22T00:22:27.731145+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:22:27.731145+0000","last_undegraded":"2023-08-22T00:22:27.731145+0000","last_fullsized":"2023-08-22T00:22:27.731145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518597+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.731168+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:22:27.731168+0000","last_peered":"2023-08-22T00:22:27.731168+0000","last_clean":"2023-08-22T00:22:27.731168+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:22:27.731168+0000","last_undegraded":"2023-08-22T00:22:27.731168+0000","last_fullsized":"2023-08-22T00:22:27.731168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.520636+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.747713+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:22:27.747713+0000","last_peered":"2023-08-22T00:22:27.747713+0000","last_clean":"2023-08-22T00:22:27.747713+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:22:27.747713+0000","last_undegraded":"2023-08-22T00:22:27.747713+0000","last_fullsized":"2023-08-22T00:22:27.747713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:22:30.510210+0000","last_change":"2023-08-22T00:22:30.510210+0000","last_active":"2023-08-22T00:22:30.510210+0000","last_peered":"2023-08-22T00:22:30.510210+0000","last_clean":"2023-08-22T00:22:30.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:30.510210+0000","last_undegraded":"2023-08-22T00:22:30.510210+0000","last_fullsized":"2023-08-22T00:22:30.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:22:29.505656+0000","last_change":"2023-08-22T00:22:29.518267+0000","last_active":"2023-08-22T00:22:29.505656+0000","last_peered":"2023-08-22T00:22:29.505656+0000","last_clean":"2023-08-22T00:22:29.505656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:22:29.505656+0000","last_undegraded":"2023-08-22T00:22:29.505656+0000","last_fullsized":"2023-08-22T00:22:29.505656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-08-22T00:22:27.506216+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:22:27.506216+0000","last_peered":"2023-08-22T00:22:27.506216+0000","last_clean":"2023-08-22T00:22:27.506216+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:22:27.506216+0000","last_undegraded":"2023-08-22T00:22:27.506216+0000","last_fullsized":"2023-08-22T00:22:27.506216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55500000000000005,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.77500000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66400000000000003,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.749,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.56899999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.442},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.79600000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.28699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.437}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53100000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48199999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.47099999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.93700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.871,"15min":0.89200000000000002},"last":0.624}]},{"osd":7,"last update":"Tue Aug 22 00:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.98799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.26300000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.252}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.35799999999999998},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.45700000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53500000000000003,"5min":0.627,"15min":0.63600000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.505,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.28899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70099999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065144,"statfs":{"total":96636764160,"available":96322707456,"internally_reserved":0,"allocated":1441792,"data_stored":758771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.377},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38900000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.34999999999999998,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.746},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78700000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1429504,"data_stored":752197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.625}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:38.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:22:39.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.122+0000 7f4e02427700 1 Processor -- start 2023-08-22T00:22:39.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.122+0000 7f4e02427700 1 -- start start 2023-08-22T00:22:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e02427700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4dfc150e40 0x7f4dfc0c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e02427700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4dfc066380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e02427700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0bd3e0 con 0x7f4dfc0bd870 2023-08-22T00:22:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e02427700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc066870 con 0x7f4dfc150e40 2023-08-22T00:22:39.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e02427700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0bd0c0 con 0x7f4dfc065f10 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4dfb7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4dfc0bd870 0x7f4dfc0a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53534/0 (socket says 172.21.15.98:53534) 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4dfb7fe700 1 -- 172.21.15.98:0/2912660651 learned_addr learned my addr 172.21.15.98:0/2912660651 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4dfc066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2912660651 >> v2:172.21.15.118:3300/0 conn(0x7f4dfc150e40 0x7f4dfc0c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746616489 0 0) 0x7f4dfc0bd3e0 con 0x7f4dfc0bd870 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.123+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de80033f0 con 0x7f4dfc0bd870 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414827769 0 0) 0x7f4de80033f0 con 0x7f4dfc0bd870 2023-08-22T00:22:39.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 msgr2=0x7f4dfc066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4dfc066380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 >> v2:172.21.15.118:3300/0 conn(0x7f4dfc150e40 msgr2=0x7f4dfc0c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 --2- 172.21.15.98:0/2912660651 >> v2:172.21.15.118:3300/0 conn(0x7f4dfc150e40 0x7f4dfc0c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0c3bb0 con 0x7f4dfc0bd870 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4dec001470 con 0x7f4dfc0bd870 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 >> v1:172.21.15.98:6789/0 conn(0x7f4dfc0bd870 legacy=0x7f4dfc0a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4de80038e0 0x7f4de8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4de8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4de8004b80 0x7f4de8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc066870 con 0x7f4de8004b80 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0bd0c0 con 0x7f4de80038e0 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de800b8e0 con 0x7f4dfc065f10 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4de8004b80 0x7f4de8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4de80038e0 0x7f4de8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4dfb7fe700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4de8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 -- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 msgr2=0x7f4de8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc065f10 0x7f4de8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 -- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4de80038e0 msgr2=0x7f4de8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4de80038e0 0x7f4de8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 -- 172.21.15.98:0/2912660651 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80033f0 con 0x7f4de8004b80 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.124+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4de8004b80 0x7f4de8005000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f4df400e210 tx=0x7f4df400b040).ready entity=mon.0 client_cookie=b710eb7a93674ee server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4009ac0 con 0x7f4de8004b80 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400f040 con 0x7f4de8004b80 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4dfaffd700 1 -- 172.21.15.98:0/2912660651 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400ecd0 con 0x7f4de8004b80 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 -- 172.21.15.98:0/2912660651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4de8004b80 msgr2=0x7f4de8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 --2- 172.21.15.98:0/2912660651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4de8004b80 0x7f4de8005000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f4df400e210 tx=0x7f4df400b040).stop 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e009c4700 1 -- 172.21.15.98:0/2912660651 reap_dead start 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 -- 172.21.15.98:0/2912660651 shutdown_connections 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 -- 172.21.15.98:0/2912660651 >> 172.21.15.98:0/2912660651 conn(0x7f4dfc06a980 msgr2=0x7f4dfc0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 -- 172.21.15.98:0/2912660651 shutdown_connections 2023-08-22T00:22:39.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.125+0000 7f4e02427700 1 -- 172.21.15.98:0/2912660651 wait complete. 2023-08-22T00:22:39.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.126+0000 7f4e02427700 1 Processor -- start 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 -- start start 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 0x7f4dfc1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 0x7f4dfc153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc154790 con 0x7f4dfc165250 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.127+0000 7f4e02427700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0abe70 con 0x7f4dfc1589b0 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e02427700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc165ba0 con 0x7f4dfc1585d0 2023-08-22T00:22:39.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42574/0 (socket says 172.21.15.98:42574) 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 -- 172.21.15.98:0/2287447449 learned_addr learned my addr 172.21.15.98:0/2287447449 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 0x7f4dfc1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4dfb7fe700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 0x7f4dfc153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 -- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 msgr2=0x7f4dfc1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 0x7f4dfc1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 -- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 msgr2=0x7f4dfc153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 0x7f4dfc153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 -- 172.21.15.98:0/2287447449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc166020 con 0x7f4dfc165250 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4dfb7fe700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 0x7f4dfc153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 0x7f4dfc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e009c4700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f4df4014000 tx=0x7f4df401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4021030 con 0x7f4dfc165250 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4009ac0 con 0x7f4dfc165250 2023-08-22T00:22:39.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc1544b0 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4013dc0 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.128+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc0abb00 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.129+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc0ac000 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.130+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4df4024070 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.130+0000 7f4df3fff700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 0x7f4ddc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.130+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4df4022070 con 0x7f4dfc165250 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.130+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 0x7f4ddc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.130+0000 7f4dfbfff700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 0x7f4ddc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4de4006d80 tx=0x7f4de4008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.134+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4df404ca80 con 0x7f4dfc165250 2023-08-22T00:22:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.290+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dfc047480 con 0x7f4ddc05ef30 2023-08-22T00:22:39.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.300+0000 7f4df3fff700 1 -- 172.21.15.98:0/2287447449 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362070 (secure 0 0 0) 0x7f4dfc047480 con 0x7f4ddc05ef30 2023-08-22T00:22:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 msgr2=0x7f4ddc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 0x7f4ddc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4de4006d80 tx=0x7f4de4008040).stop 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 msgr2=0x7f4dfc1656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f4df4014000 tx=0x7f4df401a000).stop 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 shutdown_connections 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4ddc05ef30 0x7f4ddc0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc1585d0 0x7f4dfc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dfc165250 0x7f4dfc1656b0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.303+0000 7f4e02427700 1 --2- 172.21.15.98:0/2287447449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc1589b0 0x7f4dfc153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.304+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 >> 172.21.15.98:0/2287447449 conn(0x7f4dfc06a980 msgr2=0x7f4dfc062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.304+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 shutdown_connections 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.304+0000 7f4e02427700 1 -- 172.21.15.98:0/2287447449 wait complete. 2023-08-22T00:22:39.308 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:22:39.317 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-22T00:22:37.483100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429344,"kb_used_data":11616,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752545376,"statfs":{"total":773094113280,"available":770606465024,"internally_reserved":0,"allocated":11894784,"data_stored":6247748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002108"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930227+0000","last_change":"2023-08-22T00:22:30.926060+0000","last_active":"2023-08-22T00:22:30.930227+0000","last_peered":"2023-08-22T00:22:30.930227+0000","last_clean":"2023-08-22T00:22:30.930227+0000","last_became_active":"2023-08-22T00:22:30.925816+0000","last_became_peered":"2023-08-22T00:22:30.925816+0000","last_unstale":"2023-08-22T00:22:30.930227+0000","last_undegraded":"2023-08-22T00:22:30.930227+0000","last_fullsized":"2023-08-22T00:22:30.930227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.3f","version":"119'3","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.923446+0000","last_change":"2023-08-22T00:22:30.544091+0000","last_active":"2023-08-22T00:22:30.923446+0000","last_peered":"2023-08-22T00:22:30.923446+0000","last_clean":"2023-08-22T00:22:30.923446+0000","last_became_active":"2023-08-22T00:22:30.543680+0000","last_became_peered":"2023-08-22T00:22:30.543680+0000","last_unstale":"2023-08-22T00:22:30.923446+0000","last_undegraded":"2023-08-22T00:22:30.923446+0000","last_fullsized":"2023-08-22T00:22:30.923446+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932201+0000","last_change":"2023-08-22T00:22:30.927409+0000","last_active":"2023-08-22T00:22:30.932201+0000","last_peered":"2023-08-22T00:22:30.932201+0000","last_clean":"2023-08-22T00:22:30.932201+0000","last_became_active":"2023-08-22T00:22:30.927149+0000","last_became_peered":"2023-08-22T00:22:30.927149+0000","last_unstale":"2023-08-22T00:22:30.932201+0000","last_undegraded":"2023-08-22T00:22:30.932201+0000","last_fullsized":"2023-08-22T00:22:30.932201+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919733+0000","last_change":"2023-08-22T00:22:30.539980+0000","last_active":"2023-08-22T00:22:30.919733+0000","last_peered":"2023-08-22T00:22:30.919733+0000","last_clean":"2023-08-22T00:22:30.919733+0000","last_became_active":"2023-08-22T00:22:30.539236+0000","last_became_peered":"2023-08-22T00:22:30.539236+0000","last_unstale":"2023-08-22T00:22:30.919733+0000","last_undegraded":"2023-08-22T00:22:30.919733+0000","last_fullsized":"2023-08-22T00:22:30.919733+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932030+0000","last_change":"2023-08-22T00:22:30.924408+0000","last_active":"2023-08-22T00:22:30.932030+0000","last_peered":"2023-08-22T00:22:30.932030+0000","last_clean":"2023-08-22T00:22:30.932030+0000","last_became_active":"2023-08-22T00:22:30.924164+0000","last_became_peered":"2023-08-22T00:22:30.924164+0000","last_unstale":"2023-08-22T00:22:30.932030+0000","last_undegraded":"2023-08-22T00:22:30.932030+0000","last_fullsized":"2023-08-22T00:22:30.932030+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.911782+0000","last_change":"2023-08-22T00:22:30.542398+0000","last_active":"2023-08-22T00:22:30.911782+0000","last_peered":"2023-08-22T00:22:30.911782+0000","last_clean":"2023-08-22T00:22:30.911782+0000","last_became_active":"2023-08-22T00:22:30.542132+0000","last_became_peered":"2023-08-22T00:22:30.542132+0000","last_unstale":"2023-08-22T00:22:30.911782+0000","last_undegraded":"2023-08-22T00:22:30.911782+0000","last_fullsized":"2023-08-22T00:22:30.911782+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932270+0000","last_change":"2023-08-22T00:22:30.927383+0000","last_active":"2023-08-22T00:22:30.932270+0000","last_peered":"2023-08-22T00:22:30.932270+0000","last_clean":"2023-08-22T00:22:30.932270+0000","last_became_active":"2023-08-22T00:22:30.927119+0000","last_became_peered":"2023-08-22T00:22:30.927119+0000","last_unstale":"2023-08-22T00:22:30.932270+0000","last_undegraded":"2023-08-22T00:22:30.932270+0000","last_fullsized":"2023-08-22T00:22:30.932270+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3c","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.916389+0000","last_change":"2023-08-22T00:22:30.536199+0000","last_active":"2023-08-22T00:22:30.916389+0000","last_peered":"2023-08-22T00:22:30.916389+0000","last_clean":"2023-08-22T00:22:30.916389+0000","last_became_active":"2023-08-22T00:22:30.535562+0000","last_became_peered":"2023-08-22T00:22:30.535562+0000","last_unstale":"2023-08-22T00:22:30.916389+0000","last_undegraded":"2023-08-22T00:22:30.916389+0000","last_fullsized":"2023-08-22T00:22:30.916389+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926772+0000","last_change":"2023-08-22T00:22:30.923452+0000","last_active":"2023-08-22T00:22:30.926772+0000","last_peered":"2023-08-22T00:22:30.926772+0000","last_clean":"2023-08-22T00:22:30.926772+0000","last_became_active":"2023-08-22T00:22:30.923164+0000","last_became_peered":"2023-08-22T00:22:30.923164+0000","last_unstale":"2023-08-22T00:22:30.926772+0000","last_undegraded":"2023-08-22T00:22:30.926772+0000","last_fullsized":"2023-08-22T00:22:30.926772+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919117+0000","last_change":"2023-08-22T00:22:30.537334+0000","last_active":"2023-08-22T00:22:30.919117+0000","last_peered":"2023-08-22T00:22:30.919117+0000","last_clean":"2023-08-22T00:22:30.919117+0000","last_became_active":"2023-08-22T00:22:30.537029+0000","last_became_peered":"2023-08-22T00:22:30.537029+0000","last_unstale":"2023-08-22T00:22:30.919117+0000","last_undegraded":"2023-08-22T00:22:30.919117+0000","last_fullsized":"2023-08-22T00:22:30.919117+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924077+0000","last_change":"2023-08-22T00:22:30.920419+0000","last_active":"2023-08-22T00:22:30.924077+0000","last_peered":"2023-08-22T00:22:30.924077+0000","last_clean":"2023-08-22T00:22:30.924077+0000","last_became_active":"2023-08-22T00:22:30.920145+0000","last_became_peered":"2023-08-22T00:22:30.920145+0000","last_unstale":"2023-08-22T00:22:30.924077+0000","last_undegraded":"2023-08-22T00:22:30.924077+0000","last_fullsized":"2023-08-22T00:22:30.924077+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3a","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.931940+0000","last_change":"2023-08-22T00:22:30.531486+0000","last_active":"2023-08-22T00:22:30.931940+0000","last_peered":"2023-08-22T00:22:30.931940+0000","last_clean":"2023-08-22T00:22:30.931940+0000","last_became_active":"2023-08-22T00:22:30.531192+0000","last_became_peered":"2023-08-22T00:22:30.531192+0000","last_unstale":"2023-08-22T00:22:30.931940+0000","last_undegraded":"2023-08-22T00:22:30.931940+0000","last_fullsized":"2023-08-22T00:22:30.931940+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930200+0000","last_change":"2023-08-22T00:22:30.925461+0000","last_active":"2023-08-22T00:22:30.930200+0000","last_peered":"2023-08-22T00:22:30.930200+0000","last_clean":"2023-08-22T00:22:30.930200+0000","last_became_active":"2023-08-22T00:22:30.925115+0000","last_became_peered":"2023-08-22T00:22:30.925115+0000","last_unstale":"2023-08-22T00:22:30.930200+0000","last_undegraded":"2023-08-22T00:22:30.930200+0000","last_fullsized":"2023-08-22T00:22:30.930200+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.905941+0000","last_change":"2023-08-22T00:22:30.536043+0000","last_active":"2023-08-22T00:22:30.905941+0000","last_peered":"2023-08-22T00:22:30.905941+0000","last_clean":"2023-08-22T00:22:30.905941+0000","last_became_active":"2023-08-22T00:22:30.535770+0000","last_became_peered":"2023-08-22T00:22:30.535770+0000","last_unstale":"2023-08-22T00:22:30.905941+0000","last_undegraded":"2023-08-22T00:22:30.905941+0000","last_fullsized":"2023-08-22T00:22:30.905941+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926208+0000","last_change":"2023-08-22T00:22:30.922880+0000","last_active":"2023-08-22T00:22:30.926208+0000","last_peered":"2023-08-22T00:22:30.926208+0000","last_clean":"2023-08-22T00:22:30.926208+0000","last_became_active":"2023-08-22T00:22:30.922604+0000","last_became_peered":"2023-08-22T00:22:30.922604+0000","last_unstale":"2023-08-22T00:22:30.926208+0000","last_undegraded":"2023-08-22T00:22:30.926208+0000","last_fullsized":"2023-08-22T00:22:30.926208+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912620+0000","last_change":"2023-08-22T00:22:30.535499+0000","last_active":"2023-08-22T00:22:30.912620+0000","last_peered":"2023-08-22T00:22:30.912620+0000","last_clean":"2023-08-22T00:22:30.912620+0000","last_became_active":"2023-08-22T00:22:30.534437+0000","last_became_peered":"2023-08-22T00:22:30.534437+0000","last_unstale":"2023-08-22T00:22:30.912620+0000","last_undegraded":"2023-08-22T00:22:30.912620+0000","last_fullsized":"2023-08-22T00:22:30.912620+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924069+0000","last_change":"2023-08-22T00:22:30.920488+0000","last_active":"2023-08-22T00:22:30.924069+0000","last_peered":"2023-08-22T00:22:30.924069+0000","last_clean":"2023-08-22T00:22:30.924069+0000","last_became_active":"2023-08-22T00:22:30.920177+0000","last_became_peered":"2023-08-22T00:22:30.920177+0000","last_unstale":"2023-08-22T00:22:30.924069+0000","last_undegraded":"2023-08-22T00:22:30.924069+0000","last_fullsized":"2023-08-22T00:22:30.924069+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.903490+0000","last_change":"2023-08-22T00:22:30.537442+0000","last_active":"2023-08-22T00:22:30.903490+0000","last_peered":"2023-08-22T00:22:30.903490+0000","last_clean":"2023-08-22T00:22:30.903490+0000","last_became_active":"2023-08-22T00:22:30.537139+0000","last_became_peered":"2023-08-22T00:22:30.537139+0000","last_unstale":"2023-08-22T00:22:30.903490+0000","last_undegraded":"2023-08-22T00:22:30.903490+0000","last_fullsized":"2023-08-22T00:22:30.903490+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.925855+0000","last_change":"2023-08-22T00:22:30.921442+0000","last_active":"2023-08-22T00:22:30.925855+0000","last_peered":"2023-08-22T00:22:30.925855+0000","last_clean":"2023-08-22T00:22:30.925855+0000","last_became_active":"2023-08-22T00:22:30.921140+0000","last_became_peered":"2023-08-22T00:22:30.921140+0000","last_unstale":"2023-08-22T00:22:30.925855+0000","last_undegraded":"2023-08-22T00:22:30.925855+0000","last_fullsized":"2023-08-22T00:22:30.925855+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.901049+0000","last_change":"2023-08-22T00:22:30.547004+0000","last_active":"2023-08-22T00:22:30.901049+0000","last_peered":"2023-08-22T00:22:30.901049+0000","last_clean":"2023-08-22T00:22:30.901049+0000","last_became_active":"2023-08-22T00:22:30.546728+0000","last_became_peered":"2023-08-22T00:22:30.546728+0000","last_unstale":"2023-08-22T00:22:30.901049+0000","last_undegraded":"2023-08-22T00:22:30.901049+0000","last_fullsized":"2023-08-22T00:22:30.901049+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.925841+0000","last_change":"2023-08-22T00:22:30.919330+0000","last_active":"2023-08-22T00:22:30.925841+0000","last_peered":"2023-08-22T00:22:30.925841+0000","last_clean":"2023-08-22T00:22:30.925841+0000","last_became_active":"2023-08-22T00:22:30.918988+0000","last_became_peered":"2023-08-22T00:22:30.918988+0000","last_unstale":"2023-08-22T00:22:30.925841+0000","last_undegraded":"2023-08-22T00:22:30.925841+0000","last_fullsized":"2023-08-22T00:22:30.925841+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.906657+0000","last_change":"2023-08-22T00:22:30.538072+0000","last_active":"2023-08-22T00:22:30.906657+0000","last_peered":"2023-08-22T00:22:30.906657+0000","last_clean":"2023-08-22T00:22:30.906657+0000","last_became_active":"2023-08-22T00:22:30.537824+0000","last_became_peered":"2023-08-22T00:22:30.537824+0000","last_unstale":"2023-08-22T00:22:30.906657+0000","last_undegraded":"2023-08-22T00:22:30.906657+0000","last_fullsized":"2023-08-22T00:22:30.906657+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.921518+0000","last_change":"2023-08-22T00:22:30.917063+0000","last_active":"2023-08-22T00:22:30.921518+0000","last_peered":"2023-08-22T00:22:30.921518+0000","last_clean":"2023-08-22T00:22:30.921518+0000","last_became_active":"2023-08-22T00:22:30.915840+0000","last_became_peered":"2023-08-22T00:22:30.915840+0000","last_unstale":"2023-08-22T00:22:30.921518+0000","last_undegraded":"2023-08-22T00:22:30.921518+0000","last_fullsized":"2023-08-22T00:22:30.921518+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.34","version":"119'4","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.934673+0000","last_change":"2023-08-22T00:22:30.549487+0000","last_active":"2023-08-22T00:22:30.934673+0000","last_peered":"2023-08-22T00:22:30.934673+0000","last_clean":"2023-08-22T00:22:30.934673+0000","last_became_active":"2023-08-22T00:22:30.549204+0000","last_became_peered":"2023-08-22T00:22:30.549204+0000","last_unstale":"2023-08-22T00:22:30.934673+0000","last_undegraded":"2023-08-22T00:22:30.934673+0000","last_fullsized":"2023-08-22T00:22:30.934673+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924718+0000","last_change":"2023-08-22T00:22:30.917729+0000","last_active":"2023-08-22T00:22:30.924718+0000","last_peered":"2023-08-22T00:22:30.924718+0000","last_clean":"2023-08-22T00:22:30.924718+0000","last_became_active":"2023-08-22T00:22:30.916928+0000","last_became_peered":"2023-08-22T00:22:30.916928+0000","last_unstale":"2023-08-22T00:22:30.924718+0000","last_undegraded":"2023-08-22T00:22:30.924718+0000","last_fullsized":"2023-08-22T00:22:30.924718+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918539+0000","last_change":"2023-08-22T00:22:30.535499+0000","last_active":"2023-08-22T00:22:30.918539+0000","last_peered":"2023-08-22T00:22:30.918539+0000","last_clean":"2023-08-22T00:22:30.918539+0000","last_became_active":"2023-08-22T00:22:30.535173+0000","last_became_peered":"2023-08-22T00:22:30.535173+0000","last_unstale":"2023-08-22T00:22:30.918539+0000","last_undegraded":"2023-08-22T00:22:30.918539+0000","last_fullsized":"2023-08-22T00:22:30.918539+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.929465+0000","last_change":"2023-08-22T00:22:30.913323+0000","last_active":"2023-08-22T00:22:30.929465+0000","last_peered":"2023-08-22T00:22:30.929465+0000","last_clean":"2023-08-22T00:22:30.929465+0000","last_became_active":"2023-08-22T00:22:30.913077+0000","last_became_peered":"2023-08-22T00:22:30.913077+0000","last_unstale":"2023-08-22T00:22:30.929465+0000","last_undegraded":"2023-08-22T00:22:30.929465+0000","last_fullsized":"2023-08-22T00:22:30.929465+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.901104+0000","last_change":"2023-08-22T00:22:30.547301+0000","last_active":"2023-08-22T00:22:30.901104+0000","last_peered":"2023-08-22T00:22:30.901104+0000","last_clean":"2023-08-22T00:22:30.901104+0000","last_became_active":"2023-08-22T00:22:30.547011+0000","last_became_peered":"2023-08-22T00:22:30.547011+0000","last_unstale":"2023-08-22T00:22:30.901104+0000","last_undegraded":"2023-08-22T00:22:30.901104+0000","last_fullsized":"2023-08-22T00:22:30.901104+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926767+0000","last_change":"2023-08-22T00:22:30.922042+0000","last_active":"2023-08-22T00:22:30.926767+0000","last_peered":"2023-08-22T00:22:30.926767+0000","last_clean":"2023-08-22T00:22:30.926767+0000","last_became_active":"2023-08-22T00:22:30.921760+0000","last_became_peered":"2023-08-22T00:22:30.921760+0000","last_unstale":"2023-08-22T00:22:30.926767+0000","last_undegraded":"2023-08-22T00:22:30.926767+0000","last_fullsized":"2023-08-22T00:22:30.926767+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.906230+0000","last_change":"2023-08-22T00:22:30.544038+0000","last_active":"2023-08-22T00:22:30.906230+0000","last_peered":"2023-08-22T00:22:30.906230+0000","last_clean":"2023-08-22T00:22:30.906230+0000","last_became_active":"2023-08-22T00:22:30.543782+0000","last_became_peered":"2023-08-22T00:22:30.543782+0000","last_unstale":"2023-08-22T00:22:30.906230+0000","last_undegraded":"2023-08-22T00:22:30.906230+0000","last_fullsized":"2023-08-22T00:22:30.906230+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932128+0000","last_change":"2023-08-22T00:22:30.926573+0000","last_active":"2023-08-22T00:22:30.932128+0000","last_peered":"2023-08-22T00:22:30.932128+0000","last_clean":"2023-08-22T00:22:30.932128+0000","last_became_active":"2023-08-22T00:22:30.926266+0000","last_became_peered":"2023-08-22T00:22:30.926266+0000","last_unstale":"2023-08-22T00:22:30.932128+0000","last_undegraded":"2023-08-22T00:22:30.932128+0000","last_fullsized":"2023-08-22T00:22:30.932128+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.30","version":"119'4","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932348+0000","last_change":"2023-08-22T00:22:30.538331+0000","last_active":"2023-08-22T00:22:30.932348+0000","last_peered":"2023-08-22T00:22:30.932348+0000","last_clean":"2023-08-22T00:22:30.932348+0000","last_became_active":"2023-08-22T00:22:30.537695+0000","last_became_peered":"2023-08-22T00:22:30.537695+0000","last_unstale":"2023-08-22T00:22:30.932348+0000","last_undegraded":"2023-08-22T00:22:30.932348+0000","last_fullsized":"2023-08-22T00:22:30.932348+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932163+0000","last_change":"2023-08-22T00:22:30.926060+0000","last_active":"2023-08-22T00:22:30.932163+0000","last_peered":"2023-08-22T00:22:30.932163+0000","last_clean":"2023-08-22T00:22:30.932163+0000","last_became_active":"2023-08-22T00:22:30.925783+0000","last_became_peered":"2023-08-22T00:22:30.925783+0000","last_unstale":"2023-08-22T00:22:30.932163+0000","last_undegraded":"2023-08-22T00:22:30.932163+0000","last_fullsized":"2023-08-22T00:22:30.932163+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.917394+0000","last_change":"2023-08-22T00:22:30.542052+0000","last_active":"2023-08-22T00:22:30.917394+0000","last_peered":"2023-08-22T00:22:30.917394+0000","last_clean":"2023-08-22T00:22:30.917394+0000","last_became_active":"2023-08-22T00:22:30.538855+0000","last_became_peered":"2023-08-22T00:22:30.538855+0000","last_unstale":"2023-08-22T00:22:30.917394+0000","last_undegraded":"2023-08-22T00:22:30.917394+0000","last_fullsized":"2023-08-22T00:22:30.917394+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924664+0000","last_change":"2023-08-22T00:22:30.920957+0000","last_active":"2023-08-22T00:22:30.924664+0000","last_peered":"2023-08-22T00:22:30.924664+0000","last_clean":"2023-08-22T00:22:30.924664+0000","last_became_active":"2023-08-22T00:22:30.920647+0000","last_became_peered":"2023-08-22T00:22:30.920647+0000","last_unstale":"2023-08-22T00:22:30.924664+0000","last_undegraded":"2023-08-22T00:22:30.924664+0000","last_fullsized":"2023-08-22T00:22:30.924664+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.907089+0000","last_change":"2023-08-22T00:22:30.538490+0000","last_active":"2023-08-22T00:22:30.907089+0000","last_peered":"2023-08-22T00:22:30.907089+0000","last_clean":"2023-08-22T00:22:30.907089+0000","last_became_active":"2023-08-22T00:22:30.538199+0000","last_became_peered":"2023-08-22T00:22:30.538199+0000","last_unstale":"2023-08-22T00:22:30.907089+0000","last_undegraded":"2023-08-22T00:22:30.907089+0000","last_fullsized":"2023-08-22T00:22:30.907089+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926998+0000","last_change":"2023-08-22T00:22:30.925415+0000","last_active":"2023-08-22T00:22:30.926998+0000","last_peered":"2023-08-22T00:22:30.926998+0000","last_clean":"2023-08-22T00:22:30.926998+0000","last_became_active":"2023-08-22T00:22:30.925086+0000","last_became_peered":"2023-08-22T00:22:30.925086+0000","last_unstale":"2023-08-22T00:22:30.926998+0000","last_undegraded":"2023-08-22T00:22:30.926998+0000","last_fullsized":"2023-08-22T00:22:30.926998+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.925168+0000","last_change":"2023-08-22T00:22:30.547321+0000","last_active":"2023-08-22T00:22:30.925168+0000","last_peered":"2023-08-22T00:22:30.925168+0000","last_clean":"2023-08-22T00:22:30.925168+0000","last_became_active":"2023-08-22T00:22:30.547033+0000","last_became_peered":"2023-08-22T00:22:30.547033+0000","last_unstale":"2023-08-22T00:22:30.925168+0000","last_undegraded":"2023-08-22T00:22:30.925168+0000","last_fullsized":"2023-08-22T00:22:30.925168+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926143+0000","last_change":"2023-08-22T00:22:30.920591+0000","last_active":"2023-08-22T00:22:30.926143+0000","last_peered":"2023-08-22T00:22:30.926143+0000","last_clean":"2023-08-22T00:22:30.926143+0000","last_became_active":"2023-08-22T00:22:30.920104+0000","last_became_peered":"2023-08-22T00:22:30.920104+0000","last_unstale":"2023-08-22T00:22:30.926143+0000","last_undegraded":"2023-08-22T00:22:30.926143+0000","last_fullsized":"2023-08-22T00:22:30.926143+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.908604+0000","last_change":"2023-08-22T00:22:30.544586+0000","last_active":"2023-08-22T00:22:30.908604+0000","last_peered":"2023-08-22T00:22:30.908604+0000","last_clean":"2023-08-22T00:22:30.908604+0000","last_became_active":"2023-08-22T00:22:30.544315+0000","last_became_peered":"2023-08-22T00:22:30.544315+0000","last_unstale":"2023-08-22T00:22:30.908604+0000","last_undegraded":"2023-08-22T00:22:30.908604+0000","last_fullsized":"2023-08-22T00:22:30.908604+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924742+0000","last_change":"2023-08-22T00:22:30.921567+0000","last_active":"2023-08-22T00:22:30.924742+0000","last_peered":"2023-08-22T00:22:30.924742+0000","last_clean":"2023-08-22T00:22:30.924742+0000","last_became_active":"2023-08-22T00:22:30.921330+0000","last_became_peered":"2023-08-22T00:22:30.921330+0000","last_unstale":"2023-08-22T00:22:30.924742+0000","last_undegraded":"2023-08-22T00:22:30.924742+0000","last_fullsized":"2023-08-22T00:22:30.924742+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2b","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.922513+0000","last_change":"2023-08-22T00:22:30.537514+0000","last_active":"2023-08-22T00:22:30.922513+0000","last_peered":"2023-08-22T00:22:30.922513+0000","last_clean":"2023-08-22T00:22:30.922513+0000","last_became_active":"2023-08-22T00:22:30.537215+0000","last_became_peered":"2023-08-22T00:22:30.537215+0000","last_unstale":"2023-08-22T00:22:30.922513+0000","last_undegraded":"2023-08-22T00:22:30.922513+0000","last_fullsized":"2023-08-22T00:22:30.922513+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926118+0000","last_change":"2023-08-22T00:22:30.920586+0000","last_active":"2023-08-22T00:22:30.926118+0000","last_peered":"2023-08-22T00:22:30.926118+0000","last_clean":"2023-08-22T00:22:30.926118+0000","last_became_active":"2023-08-22T00:22:30.920314+0000","last_became_peered":"2023-08-22T00:22:30.920314+0000","last_unstale":"2023-08-22T00:22:30.926118+0000","last_undegraded":"2023-08-22T00:22:30.926118+0000","last_fullsized":"2023-08-22T00:22:30.926118+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.901212+0000","last_change":"2023-08-22T00:22:30.547229+0000","last_active":"2023-08-22T00:22:30.901212+0000","last_peered":"2023-08-22T00:22:30.901212+0000","last_clean":"2023-08-22T00:22:30.901212+0000","last_became_active":"2023-08-22T00:22:30.546970+0000","last_became_peered":"2023-08-22T00:22:30.546970+0000","last_unstale":"2023-08-22T00:22:30.901212+0000","last_undegraded":"2023-08-22T00:22:30.901212+0000","last_fullsized":"2023-08-22T00:22:30.901212+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926788+0000","last_change":"2023-08-22T00:22:30.924908+0000","last_active":"2023-08-22T00:22:30.926788+0000","last_peered":"2023-08-22T00:22:30.926788+0000","last_clean":"2023-08-22T00:22:30.926788+0000","last_became_active":"2023-08-22T00:22:30.924622+0000","last_became_peered":"2023-08-22T00:22:30.924622+0000","last_unstale":"2023-08-22T00:22:30.926788+0000","last_undegraded":"2023-08-22T00:22:30.926788+0000","last_fullsized":"2023-08-22T00:22:30.926788+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.903431+0000","last_change":"2023-08-22T00:22:30.534964+0000","last_active":"2023-08-22T00:22:30.903431+0000","last_peered":"2023-08-22T00:22:30.903431+0000","last_clean":"2023-08-22T00:22:30.903431+0000","last_became_active":"2023-08-22T00:22:30.534714+0000","last_became_peered":"2023-08-22T00:22:30.534714+0000","last_unstale":"2023-08-22T00:22:30.903431+0000","last_undegraded":"2023-08-22T00:22:30.903431+0000","last_fullsized":"2023-08-22T00:22:30.903431+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924703+0000","last_change":"2023-08-22T00:22:30.921384+0000","last_active":"2023-08-22T00:22:30.924703+0000","last_peered":"2023-08-22T00:22:30.924703+0000","last_clean":"2023-08-22T00:22:30.924703+0000","last_became_active":"2023-08-22T00:22:30.921088+0000","last_became_peered":"2023-08-22T00:22:30.921088+0000","last_unstale":"2023-08-22T00:22:30.924703+0000","last_undegraded":"2023-08-22T00:22:30.924703+0000","last_fullsized":"2023-08-22T00:22:30.924703+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.908620+0000","last_change":"2023-08-22T00:22:30.542321+0000","last_active":"2023-08-22T00:22:30.908620+0000","last_peered":"2023-08-22T00:22:30.908620+0000","last_clean":"2023-08-22T00:22:30.908620+0000","last_became_active":"2023-08-22T00:22:30.542047+0000","last_became_peered":"2023-08-22T00:22:30.542047+0000","last_unstale":"2023-08-22T00:22:30.908620+0000","last_undegraded":"2023-08-22T00:22:30.908620+0000","last_fullsized":"2023-08-22T00:22:30.908620+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924924+0000","last_change":"2023-08-22T00:22:30.922265+0000","last_active":"2023-08-22T00:22:30.924924+0000","last_peered":"2023-08-22T00:22:30.924924+0000","last_clean":"2023-08-22T00:22:30.924924+0000","last_became_active":"2023-08-22T00:22:30.921644+0000","last_became_peered":"2023-08-22T00:22:30.921644+0000","last_unstale":"2023-08-22T00:22:30.924924+0000","last_undegraded":"2023-08-22T00:22:30.924924+0000","last_fullsized":"2023-08-22T00:22:30.924924+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.921784+0000","last_change":"2023-08-22T00:22:30.526549+0000","last_active":"2023-08-22T00:22:30.921784+0000","last_peered":"2023-08-22T00:22:30.921784+0000","last_clean":"2023-08-22T00:22:30.921784+0000","last_became_active":"2023-08-22T00:22:30.526267+0000","last_became_peered":"2023-08-22T00:22:30.526267+0000","last_unstale":"2023-08-22T00:22:30.921784+0000","last_undegraded":"2023-08-22T00:22:30.921784+0000","last_fullsized":"2023-08-22T00:22:30.921784+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919796+0000","last_change":"2023-08-22T00:22:30.918578+0000","last_active":"2023-08-22T00:22:30.919796+0000","last_peered":"2023-08-22T00:22:30.919796+0000","last_clean":"2023-08-22T00:22:30.919796+0000","last_became_active":"2023-08-22T00:22:30.918258+0000","last_became_peered":"2023-08-22T00:22:30.918258+0000","last_unstale":"2023-08-22T00:22:30.919796+0000","last_undegraded":"2023-08-22T00:22:30.919796+0000","last_fullsized":"2023-08-22T00:22:30.919796+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.26","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:31.392607+0000","last_change":"2023-08-22T00:22:30.536461+0000","last_active":"2023-08-22T00:22:31.392607+0000","last_peered":"2023-08-22T00:22:31.392607+0000","last_clean":"2023-08-22T00:22:31.392607+0000","last_became_active":"2023-08-22T00:22:30.536155+0000","last_became_peered":"2023-08-22T00:22:30.536155+0000","last_unstale":"2023-08-22T00:22:31.392607+0000","last_undegraded":"2023-08-22T00:22:31.392607+0000","last_fullsized":"2023-08-22T00:22:31.392607+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926347+0000","last_change":"2023-08-22T00:22:30.922641+0000","last_active":"2023-08-22T00:22:30.926347+0000","last_peered":"2023-08-22T00:22:30.926347+0000","last_clean":"2023-08-22T00:22:30.926347+0000","last_became_active":"2023-08-22T00:22:30.922339+0000","last_became_peered":"2023-08-22T00:22:30.922339+0000","last_unstale":"2023-08-22T00:22:30.926347+0000","last_undegraded":"2023-08-22T00:22:30.926347+0000","last_fullsized":"2023-08-22T00:22:30.926347+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.900302+0000","last_change":"2023-08-22T00:22:30.527131+0000","last_active":"2023-08-22T00:22:30.900302+0000","last_peered":"2023-08-22T00:22:30.900302+0000","last_clean":"2023-08-22T00:22:30.900302+0000","last_became_active":"2023-08-22T00:22:30.526847+0000","last_became_peered":"2023-08-22T00:22:30.526847+0000","last_unstale":"2023-08-22T00:22:30.900302+0000","last_undegraded":"2023-08-22T00:22:30.900302+0000","last_fullsized":"2023-08-22T00:22:30.900302+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.929032+0000","last_change":"2023-08-22T00:22:30.928307+0000","last_active":"2023-08-22T00:22:30.929032+0000","last_peered":"2023-08-22T00:22:30.929032+0000","last_clean":"2023-08-22T00:22:30.929032+0000","last_became_active":"2023-08-22T00:22:30.927987+0000","last_became_peered":"2023-08-22T00:22:30.927987+0000","last_unstale":"2023-08-22T00:22:30.929032+0000","last_undegraded":"2023-08-22T00:22:30.929032+0000","last_fullsized":"2023-08-22T00:22:30.929032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.908709+0000","last_change":"2023-08-22T00:22:30.536257+0000","last_active":"2023-08-22T00:22:30.908709+0000","last_peered":"2023-08-22T00:22:30.908709+0000","last_clean":"2023-08-22T00:22:30.908709+0000","last_became_active":"2023-08-22T00:22:30.535918+0000","last_became_peered":"2023-08-22T00:22:30.535918+0000","last_unstale":"2023-08-22T00:22:30.908709+0000","last_undegraded":"2023-08-22T00:22:30.908709+0000","last_fullsized":"2023-08-22T00:22:30.908709+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924740+0000","last_change":"2023-08-22T00:22:30.918047+0000","last_active":"2023-08-22T00:22:30.924740+0000","last_peered":"2023-08-22T00:22:30.924740+0000","last_clean":"2023-08-22T00:22:30.924740+0000","last_became_active":"2023-08-22T00:22:30.917486+0000","last_became_peered":"2023-08-22T00:22:30.917486+0000","last_unstale":"2023-08-22T00:22:30.924740+0000","last_undegraded":"2023-08-22T00:22:30.924740+0000","last_fullsized":"2023-08-22T00:22:30.924740+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.906232+0000","last_change":"2023-08-22T00:22:30.543139+0000","last_active":"2023-08-22T00:22:30.906232+0000","last_peered":"2023-08-22T00:22:30.906232+0000","last_clean":"2023-08-22T00:22:30.906232+0000","last_became_active":"2023-08-22T00:22:30.542864+0000","last_became_peered":"2023-08-22T00:22:30.542864+0000","last_unstale":"2023-08-22T00:22:30.906232+0000","last_undegraded":"2023-08-22T00:22:30.906232+0000","last_fullsized":"2023-08-22T00:22:30.906232+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930099+0000","last_change":"2023-08-22T00:22:30.925277+0000","last_active":"2023-08-22T00:22:30.930099+0000","last_peered":"2023-08-22T00:22:30.930099+0000","last_clean":"2023-08-22T00:22:30.930099+0000","last_became_active":"2023-08-22T00:22:30.924970+0000","last_became_peered":"2023-08-22T00:22:30.924970+0000","last_unstale":"2023-08-22T00:22:30.930099+0000","last_undegraded":"2023-08-22T00:22:30.930099+0000","last_fullsized":"2023-08-22T00:22:30.930099+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.901371+0000","last_change":"2023-08-22T00:22:30.534128+0000","last_active":"2023-08-22T00:22:30.901371+0000","last_peered":"2023-08-22T00:22:30.901371+0000","last_clean":"2023-08-22T00:22:30.901371+0000","last_became_active":"2023-08-22T00:22:30.533816+0000","last_became_peered":"2023-08-22T00:22:30.533816+0000","last_unstale":"2023-08-22T00:22:30.901371+0000","last_undegraded":"2023-08-22T00:22:30.901371+0000","last_fullsized":"2023-08-22T00:22:30.901371+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932251+0000","last_change":"2023-08-22T00:22:30.927910+0000","last_active":"2023-08-22T00:22:30.932251+0000","last_peered":"2023-08-22T00:22:30.932251+0000","last_clean":"2023-08-22T00:22:30.932251+0000","last_became_active":"2023-08-22T00:22:30.927532+0000","last_became_peered":"2023-08-22T00:22:30.927532+0000","last_unstale":"2023-08-22T00:22:30.932251+0000","last_undegraded":"2023-08-22T00:22:30.932251+0000","last_fullsized":"2023-08-22T00:22:30.932251+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919159+0000","last_change":"2023-08-22T00:22:30.536606+0000","last_active":"2023-08-22T00:22:30.919159+0000","last_peered":"2023-08-22T00:22:30.919159+0000","last_clean":"2023-08-22T00:22:30.919159+0000","last_became_active":"2023-08-22T00:22:30.536311+0000","last_became_peered":"2023-08-22T00:22:30.536311+0000","last_unstale":"2023-08-22T00:22:30.919159+0000","last_undegraded":"2023-08-22T00:22:30.919159+0000","last_fullsized":"2023-08-22T00:22:30.919159+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.931713+0000","last_change":"2023-08-22T00:22:30.915348+0000","last_active":"2023-08-22T00:22:30.931713+0000","last_peered":"2023-08-22T00:22:30.931713+0000","last_clean":"2023-08-22T00:22:30.931713+0000","last_became_active":"2023-08-22T00:22:30.915107+0000","last_became_peered":"2023-08-22T00:22:30.915107+0000","last_unstale":"2023-08-22T00:22:30.931713+0000","last_undegraded":"2023-08-22T00:22:30.931713+0000","last_fullsized":"2023-08-22T00:22:30.931713+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912277+0000","last_change":"2023-08-22T00:22:30.538502+0000","last_active":"2023-08-22T00:22:30.912277+0000","last_peered":"2023-08-22T00:22:30.912277+0000","last_clean":"2023-08-22T00:22:30.912277+0000","last_became_active":"2023-08-22T00:22:30.538039+0000","last_became_peered":"2023-08-22T00:22:30.538039+0000","last_unstale":"2023-08-22T00:22:30.912277+0000","last_undegraded":"2023-08-22T00:22:30.912277+0000","last_fullsized":"2023-08-22T00:22:30.912277+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924823+0000","last_change":"2023-08-22T00:22:30.916531+0000","last_active":"2023-08-22T00:22:30.924823+0000","last_peered":"2023-08-22T00:22:30.924823+0000","last_clean":"2023-08-22T00:22:30.924823+0000","last_became_active":"2023-08-22T00:22:30.916272+0000","last_became_peered":"2023-08-22T00:22:30.916272+0000","last_unstale":"2023-08-22T00:22:30.924823+0000","last_undegraded":"2023-08-22T00:22:30.924823+0000","last_fullsized":"2023-08-22T00:22:30.924823+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926466+0000","last_change":"2023-08-22T00:22:30.537407+0000","last_active":"2023-08-22T00:22:30.926466+0000","last_peered":"2023-08-22T00:22:30.926466+0000","last_clean":"2023-08-22T00:22:30.926466+0000","last_became_active":"2023-08-22T00:22:30.531563+0000","last_became_peered":"2023-08-22T00:22:30.531563+0000","last_unstale":"2023-08-22T00:22:30.926466+0000","last_undegraded":"2023-08-22T00:22:30.926466+0000","last_fullsized":"2023-08-22T00:22:30.926466+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.931999+0000","last_change":"2023-08-22T00:22:30.915493+0000","last_active":"2023-08-22T00:22:30.931999+0000","last_peered":"2023-08-22T00:22:30.931999+0000","last_clean":"2023-08-22T00:22:30.931999+0000","last_became_active":"2023-08-22T00:22:30.915220+0000","last_became_peered":"2023-08-22T00:22:30.915220+0000","last_unstale":"2023-08-22T00:22:30.931999+0000","last_undegraded":"2023-08-22T00:22:30.931999+0000","last_fullsized":"2023-08-22T00:22:30.931999+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918003+0000","last_change":"2023-08-22T00:22:30.545993+0000","last_active":"2023-08-22T00:22:30.918003+0000","last_peered":"2023-08-22T00:22:30.918003+0000","last_clean":"2023-08-22T00:22:30.918003+0000","last_became_active":"2023-08-22T00:22:30.545727+0000","last_became_peered":"2023-08-22T00:22:30.545727+0000","last_unstale":"2023-08-22T00:22:30.918003+0000","last_undegraded":"2023-08-22T00:22:30.918003+0000","last_fullsized":"2023-08-22T00:22:30.918003+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930103+0000","last_change":"2023-08-22T00:22:30.917538+0000","last_active":"2023-08-22T00:22:30.930103+0000","last_peered":"2023-08-22T00:22:30.930103+0000","last_clean":"2023-08-22T00:22:30.930103+0000","last_became_active":"2023-08-22T00:22:30.917290+0000","last_became_peered":"2023-08-22T00:22:30.917290+0000","last_unstale":"2023-08-22T00:22:30.930103+0000","last_undegraded":"2023-08-22T00:22:30.930103+0000","last_fullsized":"2023-08-22T00:22:30.930103+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932014+0000","last_change":"2023-08-22T00:22:30.543199+0000","last_active":"2023-08-22T00:22:30.932014+0000","last_peered":"2023-08-22T00:22:30.932014+0000","last_clean":"2023-08-22T00:22:30.932014+0000","last_became_active":"2023-08-22T00:22:30.542910+0000","last_became_peered":"2023-08-22T00:22:30.542910+0000","last_unstale":"2023-08-22T00:22:30.932014+0000","last_undegraded":"2023-08-22T00:22:30.932014+0000","last_fullsized":"2023-08-22T00:22:30.932014+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926899+0000","last_change":"2023-08-22T00:22:30.924422+0000","last_active":"2023-08-22T00:22:30.926899+0000","last_peered":"2023-08-22T00:22:30.926899+0000","last_clean":"2023-08-22T00:22:30.926899+0000","last_became_active":"2023-08-22T00:22:30.924130+0000","last_became_peered":"2023-08-22T00:22:30.924130+0000","last_unstale":"2023-08-22T00:22:30.926899+0000","last_undegraded":"2023-08-22T00:22:30.926899+0000","last_fullsized":"2023-08-22T00:22:30.926899+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.911470+0000","last_change":"2023-08-22T00:22:30.542355+0000","last_active":"2023-08-22T00:22:30.911470+0000","last_peered":"2023-08-22T00:22:30.911470+0000","last_clean":"2023-08-22T00:22:30.911470+0000","last_became_active":"2023-08-22T00:22:30.542075+0000","last_became_peered":"2023-08-22T00:22:30.542075+0000","last_unstale":"2023-08-22T00:22:30.911470+0000","last_undegraded":"2023-08-22T00:22:30.911470+0000","last_fullsized":"2023-08-22T00:22:30.911470+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926503+0000","last_change":"2023-08-22T00:22:30.919420+0000","last_active":"2023-08-22T00:22:30.926503+0000","last_peered":"2023-08-22T00:22:30.926503+0000","last_clean":"2023-08-22T00:22:30.926503+0000","last_became_active":"2023-08-22T00:22:30.919126+0000","last_became_peered":"2023-08-22T00:22:30.919126+0000","last_unstale":"2023-08-22T00:22:30.926503+0000","last_undegraded":"2023-08-22T00:22:30.926503+0000","last_fullsized":"2023-08-22T00:22:30.926503+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.906698+0000","last_change":"2023-08-22T00:22:30.535456+0000","last_active":"2023-08-22T00:22:30.906698+0000","last_peered":"2023-08-22T00:22:30.906698+0000","last_clean":"2023-08-22T00:22:30.906698+0000","last_became_active":"2023-08-22T00:22:30.534709+0000","last_became_peered":"2023-08-22T00:22:30.534709+0000","last_unstale":"2023-08-22T00:22:30.906698+0000","last_undegraded":"2023-08-22T00:22:30.906698+0000","last_fullsized":"2023-08-22T00:22:30.906698+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.914331+0000","last_change":"2023-08-22T00:22:30.912836+0000","last_active":"2023-08-22T00:22:30.914331+0000","last_peered":"2023-08-22T00:22:30.914331+0000","last_clean":"2023-08-22T00:22:30.914331+0000","last_became_active":"2023-08-22T00:22:30.912549+0000","last_became_peered":"2023-08-22T00:22:30.912549+0000","last_unstale":"2023-08-22T00:22:30.914331+0000","last_undegraded":"2023-08-22T00:22:30.914331+0000","last_fullsized":"2023-08-22T00:22:30.914331+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.915543+0000","last_change":"2023-08-22T00:22:30.531518+0000","last_active":"2023-08-22T00:22:30.915543+0000","last_peered":"2023-08-22T00:22:30.915543+0000","last_clean":"2023-08-22T00:22:30.915543+0000","last_became_active":"2023-08-22T00:22:30.531237+0000","last_became_peered":"2023-08-22T00:22:30.531237+0000","last_unstale":"2023-08-22T00:22:30.915543+0000","last_undegraded":"2023-08-22T00:22:30.915543+0000","last_fullsized":"2023-08-22T00:22:30.915543+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.931948+0000","last_change":"2023-08-22T00:22:30.923108+0000","last_active":"2023-08-22T00:22:30.931948+0000","last_peered":"2023-08-22T00:22:30.931948+0000","last_clean":"2023-08-22T00:22:30.931948+0000","last_became_active":"2023-08-22T00:22:30.922851+0000","last_became_peered":"2023-08-22T00:22:30.922851+0000","last_unstale":"2023-08-22T00:22:30.931948+0000","last_undegraded":"2023-08-22T00:22:30.931948+0000","last_fullsized":"2023-08-22T00:22:30.931948+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.903484+0000","last_change":"2023-08-22T00:22:30.538157+0000","last_active":"2023-08-22T00:22:30.903484+0000","last_peered":"2023-08-22T00:22:30.903484+0000","last_clean":"2023-08-22T00:22:30.903484+0000","last_became_active":"2023-08-22T00:22:30.537892+0000","last_became_peered":"2023-08-22T00:22:30.537892+0000","last_unstale":"2023-08-22T00:22:30.903484+0000","last_undegraded":"2023-08-22T00:22:30.903484+0000","last_fullsized":"2023-08-22T00:22:30.903484+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.927103+0000","last_change":"2023-08-22T00:22:30.925103+0000","last_active":"2023-08-22T00:22:30.927103+0000","last_peered":"2023-08-22T00:22:30.927103+0000","last_clean":"2023-08-22T00:22:30.927103+0000","last_became_active":"2023-08-22T00:22:30.923947+0000","last_became_peered":"2023-08-22T00:22:30.923947+0000","last_unstale":"2023-08-22T00:22:30.927103+0000","last_undegraded":"2023-08-22T00:22:30.927103+0000","last_fullsized":"2023-08-22T00:22:30.927103+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912644+0000","last_change":"2023-08-22T00:22:30.536100+0000","last_active":"2023-08-22T00:22:30.912644+0000","last_peered":"2023-08-22T00:22:30.912644+0000","last_clean":"2023-08-22T00:22:30.912644+0000","last_became_active":"2023-08-22T00:22:30.535876+0000","last_became_peered":"2023-08-22T00:22:30.535876+0000","last_unstale":"2023-08-22T00:22:30.912644+0000","last_undegraded":"2023-08-22T00:22:30.912644+0000","last_fullsized":"2023-08-22T00:22:30.912644+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924899+0000","last_change":"2023-08-22T00:22:30.918494+0000","last_active":"2023-08-22T00:22:30.924899+0000","last_peered":"2023-08-22T00:22:30.924899+0000","last_clean":"2023-08-22T00:22:30.924899+0000","last_became_active":"2023-08-22T00:22:30.917605+0000","last_became_peered":"2023-08-22T00:22:30.917605+0000","last_unstale":"2023-08-22T00:22:30.924899+0000","last_undegraded":"2023-08-22T00:22:30.924899+0000","last_fullsized":"2023-08-22T00:22:30.924899+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.907997+0000","last_change":"2023-08-22T00:22:30.528672+0000","last_active":"2023-08-22T00:22:30.907997+0000","last_peered":"2023-08-22T00:22:30.907997+0000","last_clean":"2023-08-22T00:22:30.907997+0000","last_became_active":"2023-08-22T00:22:30.528439+0000","last_became_peered":"2023-08-22T00:22:30.528439+0000","last_unstale":"2023-08-22T00:22:30.907997+0000","last_undegraded":"2023-08-22T00:22:30.907997+0000","last_fullsized":"2023-08-22T00:22:30.907997+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.927577+0000","last_change":"2023-08-22T00:22:30.925733+0000","last_active":"2023-08-22T00:22:30.927577+0000","last_peered":"2023-08-22T00:22:30.927577+0000","last_clean":"2023-08-22T00:22:30.927577+0000","last_became_active":"2023-08-22T00:22:30.925374+0000","last_became_peered":"2023-08-22T00:22:30.925374+0000","last_unstale":"2023-08-22T00:22:30.927577+0000","last_undegraded":"2023-08-22T00:22:30.927577+0000","last_fullsized":"2023-08-22T00:22:30.927577+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.907192+0000","last_change":"2023-08-22T00:22:30.543760+0000","last_active":"2023-08-22T00:22:30.907192+0000","last_peered":"2023-08-22T00:22:30.907192+0000","last_clean":"2023-08-22T00:22:30.907192+0000","last_became_active":"2023-08-22T00:22:30.543503+0000","last_became_peered":"2023-08-22T00:22:30.543503+0000","last_unstale":"2023-08-22T00:22:30.907192+0000","last_undegraded":"2023-08-22T00:22:30.907192+0000","last_fullsized":"2023-08-22T00:22:30.907192+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919824+0000","last_change":"2023-08-22T00:22:30.918515+0000","last_active":"2023-08-22T00:22:30.919824+0000","last_peered":"2023-08-22T00:22:30.919824+0000","last_clean":"2023-08-22T00:22:30.919824+0000","last_became_active":"2023-08-22T00:22:30.918199+0000","last_became_peered":"2023-08-22T00:22:30.918199+0000","last_unstale":"2023-08-22T00:22:30.919824+0000","last_undegraded":"2023-08-22T00:22:30.919824+0000","last_fullsized":"2023-08-22T00:22:30.919824+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"119'3","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918210+0000","last_change":"2023-08-22T00:22:30.542183+0000","last_active":"2023-08-22T00:22:30.918210+0000","last_peered":"2023-08-22T00:22:30.918210+0000","last_clean":"2023-08-22T00:22:30.918210+0000","last_became_active":"2023-08-22T00:22:30.541909+0000","last_became_peered":"2023-08-22T00:22:30.541909+0000","last_unstale":"2023-08-22T00:22:30.918210+0000","last_undegraded":"2023-08-22T00:22:30.918210+0000","last_fullsized":"2023-08-22T00:22:30.918210+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926364+0000","last_change":"2023-08-22T00:22:30.922911+0000","last_active":"2023-08-22T00:22:30.926364+0000","last_peered":"2023-08-22T00:22:30.926364+0000","last_clean":"2023-08-22T00:22:30.926364+0000","last_became_active":"2023-08-22T00:22:30.922659+0000","last_became_peered":"2023-08-22T00:22:30.922659+0000","last_unstale":"2023-08-22T00:22:30.926364+0000","last_undegraded":"2023-08-22T00:22:30.926364+0000","last_fullsized":"2023-08-22T00:22:30.926364+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.932586+0000","last_change":"2023-08-22T00:22:30.538447+0000","last_active":"2023-08-22T00:22:30.932586+0000","last_peered":"2023-08-22T00:22:30.932586+0000","last_clean":"2023-08-22T00:22:30.932586+0000","last_became_active":"2023-08-22T00:22:30.538171+0000","last_became_peered":"2023-08-22T00:22:30.538171+0000","last_unstale":"2023-08-22T00:22:30.932586+0000","last_undegraded":"2023-08-22T00:22:30.932586+0000","last_fullsized":"2023-08-22T00:22:30.932586+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.931908+0000","last_change":"2023-08-22T00:22:30.919739+0000","last_active":"2023-08-22T00:22:30.931908+0000","last_peered":"2023-08-22T00:22:30.931908+0000","last_clean":"2023-08-22T00:22:30.931908+0000","last_became_active":"2023-08-22T00:22:30.918888+0000","last_became_peered":"2023-08-22T00:22:30.918888+0000","last_unstale":"2023-08-22T00:22:30.931908+0000","last_undegraded":"2023-08-22T00:22:30.931908+0000","last_fullsized":"2023-08-22T00:22:30.931908+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919579+0000","last_change":"2023-08-22T00:22:30.540893+0000","last_active":"2023-08-22T00:22:30.919579+0000","last_peered":"2023-08-22T00:22:30.919579+0000","last_clean":"2023-08-22T00:22:30.919579+0000","last_became_active":"2023-08-22T00:22:30.540583+0000","last_became_peered":"2023-08-22T00:22:30.540583+0000","last_unstale":"2023-08-22T00:22:30.919579+0000","last_undegraded":"2023-08-22T00:22:30.919579+0000","last_fullsized":"2023-08-22T00:22:30.919579+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930199+0000","last_change":"2023-08-22T00:22:30.921222+0000","last_active":"2023-08-22T00:22:30.930199+0000","last_peered":"2023-08-22T00:22:30.930199+0000","last_clean":"2023-08-22T00:22:30.930199+0000","last_became_active":"2023-08-22T00:22:30.921027+0000","last_became_peered":"2023-08-22T00:22:30.921027+0000","last_unstale":"2023-08-22T00:22:30.930199+0000","last_undegraded":"2023-08-22T00:22:30.930199+0000","last_fullsized":"2023-08-22T00:22:30.930199+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.900717+0000","last_change":"2023-08-22T00:22:30.546992+0000","last_active":"2023-08-22T00:22:30.900717+0000","last_peered":"2023-08-22T00:22:30.900717+0000","last_clean":"2023-08-22T00:22:30.900717+0000","last_became_active":"2023-08-22T00:22:30.546695+0000","last_became_peered":"2023-08-22T00:22:30.546695+0000","last_unstale":"2023-08-22T00:22:30.900717+0000","last_undegraded":"2023-08-22T00:22:30.900717+0000","last_fullsized":"2023-08-22T00:22:30.900717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.916517+0000","last_change":"2023-08-22T00:22:30.913985+0000","last_active":"2023-08-22T00:22:30.916517+0000","last_peered":"2023-08-22T00:22:30.916517+0000","last_clean":"2023-08-22T00:22:30.916517+0000","last_became_active":"2023-08-22T00:22:30.913245+0000","last_became_peered":"2023-08-22T00:22:30.913245+0000","last_unstale":"2023-08-22T00:22:30.916517+0000","last_undegraded":"2023-08-22T00:22:30.916517+0000","last_fullsized":"2023-08-22T00:22:30.916517+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.904035+0000","last_change":"2023-08-22T00:22:30.532918+0000","last_active":"2023-08-22T00:22:30.904035+0000","last_peered":"2023-08-22T00:22:30.904035+0000","last_clean":"2023-08-22T00:22:30.904035+0000","last_became_active":"2023-08-22T00:22:30.531091+0000","last_became_peered":"2023-08-22T00:22:30.531091+0000","last_unstale":"2023-08-22T00:22:30.904035+0000","last_undegraded":"2023-08-22T00:22:30.904035+0000","last_fullsized":"2023-08-22T00:22:30.904035+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919519+0000","last_change":"2023-08-22T00:22:30.909076+0000","last_active":"2023-08-22T00:22:30.919519+0000","last_peered":"2023-08-22T00:22:30.919519+0000","last_clean":"2023-08-22T00:22:30.919519+0000","last_became_active":"2023-08-22T00:22:30.908793+0000","last_became_peered":"2023-08-22T00:22:30.908793+0000","last_unstale":"2023-08-22T00:22:30.919519+0000","last_undegraded":"2023-08-22T00:22:30.919519+0000","last_fullsized":"2023-08-22T00:22:30.919519+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"119'4","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924627+0000","last_change":"2023-08-22T00:22:30.533473+0000","last_active":"2023-08-22T00:22:30.924627+0000","last_peered":"2023-08-22T00:22:30.924627+0000","last_clean":"2023-08-22T00:22:30.924627+0000","last_became_active":"2023-08-22T00:22:30.532875+0000","last_became_peered":"2023-08-22T00:22:30.532875+0000","last_unstale":"2023-08-22T00:22:30.924627+0000","last_undegraded":"2023-08-22T00:22:30.924627+0000","last_fullsized":"2023-08-22T00:22:30.924627+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930013+0000","last_change":"2023-08-22T00:22:30.922432+0000","last_active":"2023-08-22T00:22:30.930013+0000","last_peered":"2023-08-22T00:22:30.930013+0000","last_clean":"2023-08-22T00:22:30.930013+0000","last_became_active":"2023-08-22T00:22:30.921985+0000","last_became_peered":"2023-08-22T00:22:30.921985+0000","last_unstale":"2023-08-22T00:22:30.930013+0000","last_undegraded":"2023-08-22T00:22:30.930013+0000","last_fullsized":"2023-08-22T00:22:30.930013+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.927527+0000","last_change":"2023-08-22T00:22:30.543562+0000","last_active":"2023-08-22T00:22:30.927527+0000","last_peered":"2023-08-22T00:22:30.927527+0000","last_clean":"2023-08-22T00:22:30.927527+0000","last_became_active":"2023-08-22T00:22:30.543176+0000","last_became_peered":"2023-08-22T00:22:30.543176+0000","last_unstale":"2023-08-22T00:22:30.927527+0000","last_undegraded":"2023-08-22T00:22:30.927527+0000","last_fullsized":"2023-08-22T00:22:30.927527+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930154+0000","last_change":"2023-08-22T00:22:30.919921+0000","last_active":"2023-08-22T00:22:30.930154+0000","last_peered":"2023-08-22T00:22:30.930154+0000","last_clean":"2023-08-22T00:22:30.930154+0000","last_became_active":"2023-08-22T00:22:30.919632+0000","last_became_peered":"2023-08-22T00:22:30.919632+0000","last_unstale":"2023-08-22T00:22:30.930154+0000","last_undegraded":"2023-08-22T00:22:30.930154+0000","last_fullsized":"2023-08-22T00:22:30.930154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.916042+0000","last_change":"2023-08-22T00:22:30.543202+0000","last_active":"2023-08-22T00:22:30.916042+0000","last_peered":"2023-08-22T00:22:30.916042+0000","last_clean":"2023-08-22T00:22:30.916042+0000","last_became_active":"2023-08-22T00:22:30.542852+0000","last_became_peered":"2023-08-22T00:22:30.542852+0000","last_unstale":"2023-08-22T00:22:30.916042+0000","last_undegraded":"2023-08-22T00:22:30.916042+0000","last_fullsized":"2023-08-22T00:22:30.916042+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.930079+0000","last_change":"2023-08-22T00:22:30.916856+0000","last_active":"2023-08-22T00:22:30.930079+0000","last_peered":"2023-08-22T00:22:30.930079+0000","last_clean":"2023-08-22T00:22:30.930079+0000","last_became_active":"2023-08-22T00:22:30.916542+0000","last_became_peered":"2023-08-22T00:22:30.916542+0000","last_unstale":"2023-08-22T00:22:30.930079+0000","last_undegraded":"2023-08-22T00:22:30.930079+0000","last_fullsized":"2023-08-22T00:22:30.930079+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.916103+0000","last_change":"2023-08-22T00:22:30.543015+0000","last_active":"2023-08-22T00:22:30.916103+0000","last_peered":"2023-08-22T00:22:30.916103+0000","last_clean":"2023-08-22T00:22:30.916103+0000","last_became_active":"2023-08-22T00:22:30.542528+0000","last_became_peered":"2023-08-22T00:22:30.542528+0000","last_unstale":"2023-08-22T00:22:30.916103+0000","last_undegraded":"2023-08-22T00:22:30.916103+0000","last_fullsized":"2023-08-22T00:22:30.916103+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.921302+0000","last_change":"2023-08-22T00:22:30.919851+0000","last_active":"2023-08-22T00:22:30.921302+0000","last_peered":"2023-08-22T00:22:30.921302+0000","last_clean":"2023-08-22T00:22:30.921302+0000","last_became_active":"2023-08-22T00:22:30.919542+0000","last_became_peered":"2023-08-22T00:22:30.919542+0000","last_unstale":"2023-08-22T00:22:30.921302+0000","last_undegraded":"2023-08-22T00:22:30.921302+0000","last_fullsized":"2023-08-22T00:22:30.921302+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.902439+0000","last_change":"2023-08-22T00:22:30.535018+0000","last_active":"2023-08-22T00:22:30.902439+0000","last_peered":"2023-08-22T00:22:30.902439+0000","last_clean":"2023-08-22T00:22:30.902439+0000","last_became_active":"2023-08-22T00:22:30.534743+0000","last_became_peered":"2023-08-22T00:22:30.534743+0000","last_unstale":"2023-08-22T00:22:30.902439+0000","last_undegraded":"2023-08-22T00:22:30.902439+0000","last_fullsized":"2023-08-22T00:22:30.902439+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924731+0000","last_change":"2023-08-22T00:22:30.917888+0000","last_active":"2023-08-22T00:22:30.924731+0000","last_peered":"2023-08-22T00:22:30.924731+0000","last_clean":"2023-08-22T00:22:30.924731+0000","last_became_active":"2023-08-22T00:22:30.917223+0000","last_became_peered":"2023-08-22T00:22:30.917223+0000","last_unstale":"2023-08-22T00:22:30.924731+0000","last_undegraded":"2023-08-22T00:22:30.924731+0000","last_fullsized":"2023-08-22T00:22:30.924731+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.911718+0000","last_change":"2023-08-22T00:22:30.536550+0000","last_active":"2023-08-22T00:22:30.911718+0000","last_peered":"2023-08-22T00:22:30.911718+0000","last_clean":"2023-08-22T00:22:30.911718+0000","last_became_active":"2023-08-22T00:22:30.536268+0000","last_became_peered":"2023-08-22T00:22:30.536268+0000","last_unstale":"2023-08-22T00:22:30.911718+0000","last_undegraded":"2023-08-22T00:22:30.911718+0000","last_fullsized":"2023-08-22T00:22:30.911718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912475+0000","last_change":"2023-08-22T00:22:30.911555+0000","last_active":"2023-08-22T00:22:30.912475+0000","last_peered":"2023-08-22T00:22:30.912475+0000","last_clean":"2023-08-22T00:22:30.912475+0000","last_became_active":"2023-08-22T00:22:30.911283+0000","last_became_peered":"2023-08-22T00:22:30.911283+0000","last_unstale":"2023-08-22T00:22:30.912475+0000","last_undegraded":"2023-08-22T00:22:30.912475+0000","last_fullsized":"2023-08-22T00:22:30.912475+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.902040+0000","last_change":"2023-08-22T00:22:30.534445+0000","last_active":"2023-08-22T00:22:30.902040+0000","last_peered":"2023-08-22T00:22:30.902040+0000","last_clean":"2023-08-22T00:22:30.902040+0000","last_became_active":"2023-08-22T00:22:30.534173+0000","last_became_peered":"2023-08-22T00:22:30.534173+0000","last_unstale":"2023-08-22T00:22:30.902040+0000","last_undegraded":"2023-08-22T00:22:30.902040+0000","last_fullsized":"2023-08-22T00:22:30.902040+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924274+0000","last_change":"2023-08-22T00:22:30.916610+0000","last_active":"2023-08-22T00:22:30.924274+0000","last_peered":"2023-08-22T00:22:30.924274+0000","last_clean":"2023-08-22T00:22:30.924274+0000","last_became_active":"2023-08-22T00:22:30.916313+0000","last_became_peered":"2023-08-22T00:22:30.916313+0000","last_unstale":"2023-08-22T00:22:30.924274+0000","last_undegraded":"2023-08-22T00:22:30.924274+0000","last_fullsized":"2023-08-22T00:22:30.924274+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.906668+0000","last_change":"2023-08-22T00:22:30.547344+0000","last_active":"2023-08-22T00:22:30.906668+0000","last_peered":"2023-08-22T00:22:30.906668+0000","last_clean":"2023-08-22T00:22:30.906668+0000","last_became_active":"2023-08-22T00:22:30.547059+0000","last_became_peered":"2023-08-22T00:22:30.547059+0000","last_unstale":"2023-08-22T00:22:30.906668+0000","last_undegraded":"2023-08-22T00:22:30.906668+0000","last_fullsized":"2023-08-22T00:22:30.906668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.917090+0000","last_change":"2023-08-22T00:22:30.913922+0000","last_active":"2023-08-22T00:22:30.917090+0000","last_peered":"2023-08-22T00:22:30.917090+0000","last_clean":"2023-08-22T00:22:30.917090+0000","last_became_active":"2023-08-22T00:22:30.913562+0000","last_became_peered":"2023-08-22T00:22:30.913562+0000","last_unstale":"2023-08-22T00:22:30.917090+0000","last_undegraded":"2023-08-22T00:22:30.917090+0000","last_fullsized":"2023-08-22T00:22:30.917090+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.900775+0000","last_change":"2023-08-22T00:22:30.536197+0000","last_active":"2023-08-22T00:22:30.900775+0000","last_peered":"2023-08-22T00:22:30.900775+0000","last_clean":"2023-08-22T00:22:30.900775+0000","last_became_active":"2023-08-22T00:22:30.535912+0000","last_became_peered":"2023-08-22T00:22:30.535912+0000","last_unstale":"2023-08-22T00:22:30.900775+0000","last_undegraded":"2023-08-22T00:22:30.900775+0000","last_fullsized":"2023-08-22T00:22:30.900775+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.917651+0000","last_change":"2023-08-22T00:22:30.916780+0000","last_active":"2023-08-22T00:22:30.917651+0000","last_peered":"2023-08-22T00:22:30.917651+0000","last_clean":"2023-08-22T00:22:30.917651+0000","last_became_active":"2023-08-22T00:22:30.916505+0000","last_became_peered":"2023-08-22T00:22:30.916505+0000","last_unstale":"2023-08-22T00:22:30.917651+0000","last_undegraded":"2023-08-22T00:22:30.917651+0000","last_fullsized":"2023-08-22T00:22:30.917651+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912368+0000","last_change":"2023-08-22T00:22:30.545596+0000","last_active":"2023-08-22T00:22:30.912368+0000","last_peered":"2023-08-22T00:22:30.912368+0000","last_clean":"2023-08-22T00:22:30.912368+0000","last_became_active":"2023-08-22T00:22:30.545273+0000","last_became_peered":"2023-08-22T00:22:30.545273+0000","last_unstale":"2023-08-22T00:22:30.912368+0000","last_undegraded":"2023-08-22T00:22:30.912368+0000","last_fullsized":"2023-08-22T00:22:30.912368+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.908700+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:22:30.908700+0000","last_peered":"2023-08-22T00:22:30.908700+0000","last_clean":"2023-08-22T00:22:30.908700+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:22:30.908700+0000","last_undegraded":"2023-08-22T00:22:30.908700+0000","last_fullsized":"2023-08-22T00:22:30.908700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.912098+0000","last_change":"2023-08-22T00:22:30.909194+0000","last_active":"2023-08-22T00:22:30.912098+0000","last_peered":"2023-08-22T00:22:30.912098+0000","last_clean":"2023-08-22T00:22:30.912098+0000","last_became_active":"2023-08-22T00:22:30.908901+0000","last_became_peered":"2023-08-22T00:22:30.908901+0000","last_unstale":"2023-08-22T00:22:30.912098+0000","last_undegraded":"2023-08-22T00:22:30.912098+0000","last_fullsized":"2023-08-22T00:22:30.912098+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.925512+0000","last_change":"2023-08-22T00:22:30.539292+0000","last_active":"2023-08-22T00:22:30.925512+0000","last_peered":"2023-08-22T00:22:30.925512+0000","last_clean":"2023-08-22T00:22:30.925512+0000","last_became_active":"2023-08-22T00:22:30.538998+0000","last_became_peered":"2023-08-22T00:22:30.538998+0000","last_unstale":"2023-08-22T00:22:30.925512+0000","last_undegraded":"2023-08-22T00:22:30.925512+0000","last_fullsized":"2023-08-22T00:22:30.925512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918520+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:22:30.918520+0000","last_peered":"2023-08-22T00:22:30.918520+0000","last_clean":"2023-08-22T00:22:30.918520+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:22:30.918520+0000","last_undegraded":"2023-08-22T00:22:30.918520+0000","last_fullsized":"2023-08-22T00:22:30.918520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.927130+0000","last_change":"2023-08-22T00:22:30.924582+0000","last_active":"2023-08-22T00:22:30.927130+0000","last_peered":"2023-08-22T00:22:30.927130+0000","last_clean":"2023-08-22T00:22:30.927130+0000","last_became_active":"2023-08-22T00:22:30.924326+0000","last_became_peered":"2023-08-22T00:22:30.924326+0000","last_unstale":"2023-08-22T00:22:30.927130+0000","last_undegraded":"2023-08-22T00:22:30.927130+0000","last_fullsized":"2023-08-22T00:22:30.927130+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.902540+0000","last_change":"2023-08-22T00:22:30.527188+0000","last_active":"2023-08-22T00:22:30.902540+0000","last_peered":"2023-08-22T00:22:30.902540+0000","last_clean":"2023-08-22T00:22:30.902540+0000","last_became_active":"2023-08-22T00:22:30.526910+0000","last_became_peered":"2023-08-22T00:22:30.526910+0000","last_unstale":"2023-08-22T00:22:30.902540+0000","last_undegraded":"2023-08-22T00:22:30.902540+0000","last_fullsized":"2023-08-22T00:22:30.902540+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.899752+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:22:30.899752+0000","last_peered":"2023-08-22T00:22:30.899752+0000","last_clean":"2023-08-22T00:22:30.899752+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:22:30.899752+0000","last_undegraded":"2023-08-22T00:22:30.899752+0000","last_fullsized":"2023-08-22T00:22:30.899752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.924842+0000","last_change":"2023-08-22T00:22:30.916997+0000","last_active":"2023-08-22T00:22:30.924842+0000","last_peered":"2023-08-22T00:22:30.924842+0000","last_clean":"2023-08-22T00:22:30.924842+0000","last_became_active":"2023-08-22T00:22:30.916726+0000","last_became_peered":"2023-08-22T00:22:30.916726+0000","last_unstale":"2023-08-22T00:22:30.924842+0000","last_undegraded":"2023-08-22T00:22:30.924842+0000","last_fullsized":"2023-08-22T00:22:30.924842+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.929291+0000","last_change":"2023-08-22T00:22:30.538468+0000","last_active":"2023-08-22T00:22:30.929291+0000","last_peered":"2023-08-22T00:22:30.929291+0000","last_clean":"2023-08-22T00:22:30.929291+0000","last_became_active":"2023-08-22T00:22:30.538197+0000","last_became_peered":"2023-08-22T00:22:30.538197+0000","last_unstale":"2023-08-22T00:22:30.929291+0000","last_undegraded":"2023-08-22T00:22:30.929291+0000","last_fullsized":"2023-08-22T00:22:30.929291+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918225+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:22:30.918225+0000","last_peered":"2023-08-22T00:22:30.918225+0000","last_clean":"2023-08-22T00:22:30.918225+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:22:30.918225+0000","last_undegraded":"2023-08-22T00:22:30.918225+0000","last_fullsized":"2023-08-22T00:22:30.918225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.905976+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:22:30.905976+0000","last_peered":"2023-08-22T00:22:30.905976+0000","last_clean":"2023-08-22T00:22:30.905976+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:22:30.905976+0000","last_undegraded":"2023-08-22T00:22:30.905976+0000","last_fullsized":"2023-08-22T00:22:30.905976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.920816+0000","last_change":"2023-08-22T00:22:30.916223+0000","last_active":"2023-08-22T00:22:30.920816+0000","last_peered":"2023-08-22T00:22:30.920816+0000","last_clean":"2023-08-22T00:22:30.920816+0000","last_became_active":"2023-08-22T00:22:30.915527+0000","last_became_peered":"2023-08-22T00:22:30.915527+0000","last_unstale":"2023-08-22T00:22:30.920816+0000","last_undegraded":"2023-08-22T00:22:30.920816+0000","last_fullsized":"2023-08-22T00:22:30.920816+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.911540+0000","last_change":"2023-08-22T00:22:30.542793+0000","last_active":"2023-08-22T00:22:30.911540+0000","last_peered":"2023-08-22T00:22:30.911540+0000","last_clean":"2023-08-22T00:22:30.911540+0000","last_became_active":"2023-08-22T00:22:30.541987+0000","last_became_peered":"2023-08-22T00:22:30.541987+0000","last_unstale":"2023-08-22T00:22:30.911540+0000","last_undegraded":"2023-08-22T00:22:30.911540+0000","last_fullsized":"2023-08-22T00:22:30.911540+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.905887+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:22:30.905887+0000","last_peered":"2023-08-22T00:22:30.905887+0000","last_clean":"2023-08-22T00:22:30.905887+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:22:30.905887+0000","last_undegraded":"2023-08-22T00:22:30.905887+0000","last_fullsized":"2023-08-22T00:22:30.905887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926105+0000","last_change":"2023-08-22T00:22:30.920532+0000","last_active":"2023-08-22T00:22:30.926105+0000","last_peered":"2023-08-22T00:22:30.926105+0000","last_clean":"2023-08-22T00:22:30.926105+0000","last_became_active":"2023-08-22T00:22:30.920255+0000","last_became_peered":"2023-08-22T00:22:30.920255+0000","last_unstale":"2023-08-22T00:22:30.926105+0000","last_undegraded":"2023-08-22T00:22:30.926105+0000","last_fullsized":"2023-08-22T00:22:30.926105+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.919881+0000","last_change":"2023-08-22T00:22:30.539549+0000","last_active":"2023-08-22T00:22:30.919881+0000","last_peered":"2023-08-22T00:22:30.919881+0000","last_clean":"2023-08-22T00:22:30.919881+0000","last_became_active":"2023-08-22T00:22:30.539257+0000","last_became_peered":"2023-08-22T00:22:30.539257+0000","last_unstale":"2023-08-22T00:22:30.919881+0000","last_undegraded":"2023-08-22T00:22:30.919881+0000","last_fullsized":"2023-08-22T00:22:30.919881+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.908919+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:22:30.908919+0000","last_peered":"2023-08-22T00:22:30.908919+0000","last_clean":"2023-08-22T00:22:30.908919+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:22:30.908919+0000","last_undegraded":"2023-08-22T00:22:30.908919+0000","last_fullsized":"2023-08-22T00:22:30.908919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.934359+0000","last_change":"2023-08-22T00:22:30.928383+0000","last_active":"2023-08-22T00:22:30.934359+0000","last_peered":"2023-08-22T00:22:30.934359+0000","last_clean":"2023-08-22T00:22:30.934359+0000","last_became_active":"2023-08-22T00:22:30.928088+0000","last_became_peered":"2023-08-22T00:22:30.928088+0000","last_unstale":"2023-08-22T00:22:30.934359+0000","last_undegraded":"2023-08-22T00:22:30.934359+0000","last_fullsized":"2023-08-22T00:22:30.934359+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.918440+0000","last_change":"2023-08-22T00:22:30.536518+0000","last_active":"2023-08-22T00:22:30.918440+0000","last_peered":"2023-08-22T00:22:30.918440+0000","last_clean":"2023-08-22T00:22:30.918440+0000","last_became_active":"2023-08-22T00:22:30.536228+0000","last_became_peered":"2023-08-22T00:22:30.536228+0000","last_unstale":"2023-08-22T00:22:30.918440+0000","last_undegraded":"2023-08-22T00:22:30.918440+0000","last_fullsized":"2023-08-22T00:22:30.918440+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.910370+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:22:30.910370+0000","last_peered":"2023-08-22T00:22:30.910370+0000","last_clean":"2023-08-22T00:22:30.910370+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:22:30.910370+0000","last_undegraded":"2023-08-22T00:22:30.910370+0000","last_fullsized":"2023-08-22T00:22:30.910370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.926168+0000","last_change":"2023-08-22T00:22:30.920826+0000","last_active":"2023-08-22T00:22:30.926168+0000","last_peered":"2023-08-22T00:22:30.926168+0000","last_clean":"2023-08-22T00:22:30.926168+0000","last_became_active":"2023-08-22T00:22:30.920552+0000","last_became_peered":"2023-08-22T00:22:30.920552+0000","last_unstale":"2023-08-22T00:22:30.926168+0000","last_undegraded":"2023-08-22T00:22:30.926168+0000","last_fullsized":"2023-08-22T00:22:30.926168+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:30.510210+0000","last_clean_scrub_stamp":"2023-08-22T00:22:30.510210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.927990+0000","last_change":"2023-08-22T00:22:30.541347+0000","last_active":"2023-08-22T00:22:30.927990+0000","last_peered":"2023-08-22T00:22:30.927990+0000","last_clean":"2023-08-22T00:22:30.927990+0000","last_became_active":"2023-08-22T00:22:30.538929+0000","last_became_peered":"2023-08-22T00:22:30.538929+0000","last_unstale":"2023-08-22T00:22:30.927990+0000","last_undegraded":"2023-08-22T00:22:30.927990+0000","last_fullsized":"2023-08-22T00:22:30.927990+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:22:29.505656+0000","last_clean_scrub_stamp":"2023-08-22T00:22:29.505656+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-22T00:22:30.902810+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:22:30.902810+0000","last_peered":"2023-08-22T00:22:30.902810+0000","last_clean":"2023-08-22T00:22:30.902810+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:22:30.902810+0000","last_undegraded":"2023-08-22T00:22:30.902810+0000","last_fullsized":"2023-08-22T00:22:30.902810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1486848,"data_stored":780504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.443}]},{"osd":1,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.78100000000000003,"15min":0.81200000000000006},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.751},"last":0.432}]},{"osd":5,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66500000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.748,"15min":0.95399999999999996},"last":0.51000000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84099999999999997},"last":0.33400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306732,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065108,"statfs":{"total":96636764160,"available":96322670592,"internally_reserved":0,"allocated":1478656,"data_stored":780392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.29799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38}]},{"osd":1,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55500000000000005,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.434},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.77500000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66400000000000003,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.749,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33400000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.53100000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.79600000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":780462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.499,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.219},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.184},"max":{"1min":0.47899999999999998,"5min":2.504,"15min":2.504},"last":0.318}]},{"osd":2,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.22800000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.48699999999999999,"5min":0.64500000000000002,"15min":0.89700000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.42199999999999999},"min":{"1min":0.27800000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.254},{"interface":"front","average":{"1min":0.374,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.29599999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.93700000000000006},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":1.117,"15min":1.3360000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.749,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.441}]},{"osd":6,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":2.298,"15min":2.298},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.35299999999999998},"max":{"1min":0.77000000000000002,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.41399999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":2.992,"15min":2.992},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":2.323,"15min":2.323},"last":0.35099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":780946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.35399999999999998,"15min":0.377},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.40100000000000002,"15min":0.42199999999999999},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48699999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53300000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.33400000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.45700000000000002,"5min":0.59699999999999998,"15min":0.64200000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40300000000000002,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66200000000000003,"5min":0.80600000000000005,"15min":0.82699999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79900000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57099999999999995,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38900000000000001},"max":{"1min":0.69399999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.871,"15min":0.89200000000000002},"last":0.58199999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79300000000000004,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834575045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1486848,"data_stored":781318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.35799999999999998},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.26900000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.20499999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.29399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.371},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48599999999999999,"5min":0.60499999999999998,"15min":0.64800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.873,"15min":1.0580000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":1.0169999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.39800000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1499136,"data_stored":782504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.35799999999999998},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.45700000000000002,"5min":0.55900000000000005,"15min":0.58699999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.254}]},{"osd":1,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53500000000000003,"5min":0.627,"15min":0.63600000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.505,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.51600000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.94799999999999995},"last":0.66100000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70099999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306752,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065088,"statfs":{"total":96636764160,"available":96322650112,"internally_reserved":0,"allocated":1499136,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.54200000000000004},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63400000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.28399999999999997},"max":{"1min":0.73299999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52400000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.254},"max":{"1min":0.63500000000000001,"5min":0.72699999999999998,"15min":0.746},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.309},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70899999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.499},{"interface":"front","average":{"1min":0.504,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.379}]},{"osd":5,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51400000000000001,"15min":0.49099999999999999},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42699999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.41599999999999998,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.82099999999999995,"15min":0.85199999999999998},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":780392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.94599999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.748,"15min":0.873},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.313},"max":{"1min":0.65700000000000003,"5min":0.77700000000000002,"15min":0.89400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63500000000000001,"5min":0.81000000000000005,"15min":0.84599999999999997},"last":0.51500000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.92000000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.95999999999999996},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.88,"15min":0.92800000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.88},"last":0.504}]},{"osd":4,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65700000000000003,"5min":0.75600000000000001,"15min":0.78500000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.74399999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:22:39.325 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:22:39.325 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:22:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.477+0000 7f9bd47e1700 1 Processor -- start 2023-08-22T00:22:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.477+0000 7f9bd47e1700 1 -- start start 2023-08-22T00:22:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.478+0000 7f9bd47e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bcc155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.478+0000 7f9bd47e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9bcc067d00 0x7f9bcc0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.478+0000 7f9bd47e1700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc0654a0 con 0x7f9bcc0641b0 2023-08-22T00:22:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.478+0000 7f9bd47e1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc064920 con 0x7f9bcc067d00 2023-08-22T00:22:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.478+0000 7f9bd47e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc064c00 con 0x7f9bcc14e720 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd1d7c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9bcc0641b0 0x7f9bcc0675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53536/0 (socket says 172.21.15.98:53536) 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd1d7c700 1 -- 172.21.15.98:0/1045125494 learned_addr learned my addr 172.21.15.98:0/1045125494 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd257d700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bcc155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171703022 0 0) 0x7f9bcc0654a0 con 0x7f9bcc0641b0 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/1045125494 >> v2:172.21.15.118:3300/0 conn(0x7f9bcc067d00 0x7f9bcc0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb80033f0 con 0x7f9bcc0641b0 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435420406 0 0) 0x7f9bb80033f0 con 0x7f9bcc0641b0 2023-08-22T00:22:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 msgr2=0x7f9bcc155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bcc155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 >> v2:172.21.15.118:3300/0 conn(0x7f9bcc067d00 msgr2=0x7f9bcc0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 --2- 172.21.15.98:0/1045125494 >> v2:172.21.15.118:3300/0 conn(0x7f9bcc067d00 0x7f9bcc0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc064ee0 con 0x7f9bcc0641b0 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9bbc001470 con 0x7f9bcc0641b0 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 >> v1:172.21.15.98:6789/0 conn(0x7f9bcc0641b0 legacy=0x7f9bcc0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bb80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8003e10 0x7f9bb8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb8004b80 0x7f9bb8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc064920 con 0x7f9bb8004b80 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc064c00 con 0x7f9bb8003e10 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb800b8e0 con 0x7f9bcc14e720 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb8004b80 0x7f9bb8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd257d700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bb80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.479+0000 7f9bd1d7c700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8003e10 0x7f9bb8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 -- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 msgr2=0x7f9bb80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14e720 0x7f9bb80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 -- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8003e10 msgr2=0x7f9bb8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8003e10 0x7f9bb8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 -- 172.21.15.98:0/1045125494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80033f0 con 0x7f9bb8004b80 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb8004b80 0x7f9bb8005000 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f9bc400e210 tx=0x7f9bc400b040).ready entity=mon.0 client_cookie=b3bc4f5d510e8f15 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4009ac0 con 0x7f9bb8004b80 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400f040 con 0x7f9bb8004b80 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd157b700 1 -- 172.21.15.98:0/1045125494 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400ecd0 con 0x7f9bb8004b80 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 -- 172.21.15.98:0/1045125494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb8004b80 msgr2=0x7f9bb8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/1045125494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb8004b80 0x7f9bb8005000 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f9bc400e210 tx=0x7f9bc400b040).stop 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd2d7e700 1 -- 172.21.15.98:0/1045125494 reap_dead start 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 -- 172.21.15.98:0/1045125494 shutdown_connections 2023-08-22T00:22:39.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 -- 172.21.15.98:0/1045125494 >> 172.21.15.98:0/1045125494 conn(0x7f9bcc0c8950 msgr2=0x7f9bcc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:39.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 -- 172.21.15.98:0/1045125494 shutdown_connections 2023-08-22T00:22:39.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.480+0000 7f9bd47e1700 1 -- 172.21.15.98:0/1045125494 wait complete. 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.481+0000 7f9bd47e1700 1 Processor -- start 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 -- start start 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 0x7f9bcc0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 0x7f9bcc0ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0c1ed0 con 0x7f9bcc0abf70 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0ac8e0 con 0x7f9bb8004b80 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd47e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1658a0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd257d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd1d7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 0x7f9bcc0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd257d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40966/0 (socket says 172.21.15.98:40966) 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.482+0000 7f9bd257d700 1 -- 172.21.15.98:0/106598424 learned_addr learned my addr 172.21.15.98:0/106598424 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 0x7f9bcc0ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 -- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 msgr2=0x7f9bcc1653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 -- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 msgr2=0x7f9bcc0ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 0x7f9bcc0ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 -- 172.21.15.98:0/106598424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc0c12c0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd257d700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd2d7e700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 0x7f9bcc0ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd1d7c700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 0x7f9bcc0c2360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9bcc06aae0 tx=0x7f9bcc1547e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0114c0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc011620 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc0c15a0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0119c0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.483+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc0c1b60 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.484+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc0a7ed0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.485+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9bbc01d3b0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.485+0000 7f9bc27fc700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 0x7f9bb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.485+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9bbc0798d0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.485+0000 7f9bd257d700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 0x7f9bb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.485+0000 7f9bd257d700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 0x7f9bb00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9bc8006d50 tx=0x7f9bc8009060).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.490+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9bbc04e4f0 con 0x7f9bcc14cb60 2023-08-22T00:22:39.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.717+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9bcc069d50 con 0x7f9bcc14cb60 2023-08-22T00:22:39.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.721+0000 7f9bc27fc700 1 -- 172.21.15.98:0/106598424 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9bbc019020 con 0x7f9bcc14cb60 2023-08-22T00:22:39.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 msgr2=0x7f9bb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 0x7f9bb00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9bc8006d50 tx=0x7f9bc8009060).stop 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 msgr2=0x7f9bcc0c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 0x7f9bcc0c2360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9bcc06aae0 tx=0x7f9bcc1547e0).stop 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 shutdown_connections 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bcc0abf70 0x7f9bcc0ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8004b80 0x7f9bcc1653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bb005ef30 0x7f9bb00613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 --2- 172.21.15.98:0/106598424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bcc14cb60 0x7f9bcc0c2360 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 >> 172.21.15.98:0/106598424 conn(0x7f9bcc0c8950 msgr2=0x7f9bcc0be380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:39.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 shutdown_connections 2023-08-22T00:22:39.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.723+0000 7f9bd47e1700 1 -- 172.21.15.98:0/106598424 wait complete. 2023-08-22T00:22:39.726 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:22:39.736 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:22:39.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.850+0000 7f1988e6d700 1 Processor -- start 2023-08-22T00:22:39.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.850+0000 7f1988e6d700 1 -- start start 2023-08-22T00:22:39.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19840660d0 0x7f19840664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19840a6a40 0x7f1984151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1984151f30 0x7f1984155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840634b0 con 0x7f1984151f30 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840bd680 con 0x7f19840a6a40 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1988e6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840bde30 con 0x7f19840660d0 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1984151f30 0x7f1984155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1984151f30 0x7f1984155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42602/0 (socket says 172.21.15.98:42602) 2023-08-22T00:22:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 -- 172.21.15.98:0/903185272 learned_addr learned my addr 172.21.15.98:0/903185272 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 -- 172.21.15.98:0/903185272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19840660d0 msgr2=0x7f19840664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 --2- 172.21.15.98:0/903185272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19840660d0 0x7f19840664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 -- 172.21.15.98:0/903185272 >> v2:172.21.15.118:3300/0 conn(0x7f19840a6a40 msgr2=0x7f1984151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 --2- 172.21.15.98:0/903185272 >> v2:172.21.15.118:3300/0 conn(0x7f19840a6a40 0x7f1984151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 -- 172.21.15.98:0/903185272 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840be110 con 0x7f1984151f30 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f1982d9d700 1 --2- 172.21.15.98:0/903185272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1984151f30 0x7f1984155bd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f19840ada40 tx=0x7f197c009840).ready entity=mon.0 client_cookie=5eab0d23652c5e77 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f198159a700 1 -- 172.21.15.98:0/903185272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00e070 con 0x7f1984151f30 2023-08-22T00:22:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f198159a700 1 -- 172.21.15.98:0/903185272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00ba50 con 0x7f1984151f30 2023-08-22T00:22:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.851+0000 7f198159a700 1 -- 172.21.15.98:0/903185272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00bdd0 con 0x7f1984151f30 2023-08-22T00:22:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 -- 172.21.15.98:0/903185272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1984151f30 msgr2=0x7f1984155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 --2- 172.21.15.98:0/903185272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1984151f30 0x7f1984155bd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f19840ada40 tx=0x7f197c009840).stop 2023-08-22T00:22:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 -- 172.21.15.98:0/903185272 shutdown_connections 2023-08-22T00:22:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 --2- 172.21.15.98:0/903185272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19840660d0 0x7f19840664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 --2- 172.21.15.98:0/903185272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1984151f30 0x7f1984155bd0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 --2- 172.21.15.98:0/903185272 >> v2:172.21.15.118:3300/0 conn(0x7f19840a6a40 0x7f1984151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 -- 172.21.15.98:0/903185272 >> 172.21.15.98:0/903185272 conn(0x7f198406a980 msgr2=0x7f19840c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 -- 172.21.15.98:0/903185272 shutdown_connections 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.852+0000 7f1988e6d700 1 -- 172.21.15.98:0/903185272 wait complete. 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.853+0000 7f1988e6d700 1 Processor -- start 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.853+0000 7f1988e6d700 1 -- start start 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 0x7f19840abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1984151f30 0x7f19840a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840ac890 con 0x7f19840a6a40 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840beaa0 con 0x7f19840660d0 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1988e6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c26a0 con 0x7f1984151f30 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42616/0 (socket says 172.21.15.98:42616) 2023-08-22T00:22:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 -- 172.21.15.98:0/1494140537 learned_addr learned my addr 172.21.15.98:0/1494140537 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1982d9d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1984151f30 0x7f19840a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f198259c700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 0x7f19840abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 -- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1984151f30 msgr2=0x7f19840a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1984151f30 0x7f19840a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 -- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 msgr2=0x7f19840abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 0x7f19840abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 -- 172.21.15.98:0/1494140537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009ae0 con 0x7f19840a6a40 2023-08-22T00:22:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f198259c700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 0x7f19840abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f1981d9b700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f197800b490 tx=0x7f1978009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.854+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978002320 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.855+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780024a0 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.855+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978002860 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.855+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19840c1d90 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.855+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19840c2050 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.855+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984047480 con 0x7f19840a6a40 2023-08-22T00:22:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.856+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1978002bd0 con 0x7f19840a6a40 2023-08-22T00:22:39.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.856+0000 7f19727fc700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 0x7f19640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:39.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.856+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1978079f40 con 0x7f19840a6a40 2023-08-22T00:22:39.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.856+0000 7f198259c700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 0x7f19640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:39.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.856+0000 7f198259c700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 0x7f19640613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1974009990 tx=0x7f1974008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:39.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:39.860+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f197804b0d0 con 0x7f19840a6a40 2023-08-22T00:22:40.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.062+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19840c27e0 con 0x7f19840a6a40 2023-08-22T00:22:40.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.063+0000 7f19727fc700 1 -- 172.21.15.98:0/1494140537 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f197804e6f0 con 0x7f19840a6a40 2023-08-22T00:22:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:40.065 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:22:40.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 msgr2=0x7f19640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 0x7f19640613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1974009990 tx=0x7f1974008040).stop 2023-08-22T00:22:40.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 msgr2=0x7f19840ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f197800b490 tx=0x7f1978009060).stop 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 shutdown_connections 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f196405ef30 0x7f19640613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1984151f30 0x7f19840a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19840660d0 0x7f19840abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 --2- 172.21.15.98:0/1494140537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19840a6a40 0x7f19840ac3a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 >> 172.21.15.98:0/1494140537 conn(0x7f198406a980 msgr2=0x7f19840a9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 shutdown_connections 2023-08-22T00:22:40.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.065+0000 7f1988e6d700 1 -- 172.21.15.98:0/1494140537 wait complete. 2023-08-22T00:22:40.068 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:22:40.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:22:30.895611+0000', 'modified': '2023-08-22T00:22:33.524037+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7377}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7377': {'gid': 7377, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/4016657982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6835', 'nonce': 4016657982}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 4016657982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:22:40.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:22:40.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-22T00:22:40.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.603+0000 7f9e0a26e700 1 Processor -- start 2023-08-22T00:22:40.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.603+0000 7f9e0a26e700 1 -- start start 2023-08-22T00:22:40.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0a26e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e040645b0 0x7f9e0415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0a26e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e040c2b40 con 0x7f9e04155050 2023-08-22T00:22:40.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0a26e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04151d40 con 0x7f9e04151960 2023-08-22T00:22:40.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0a26e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040c1d40 con 0x7f9e040645b0 2023-08-22T00:22:40.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0880b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e040645b0 0x7f9e0415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e037fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9e04155050 0x7f9e04063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46622/0 (socket says 172.21.15.98:46622) 2023-08-22T00:22:40.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e037fe700 1 -- 172.21.15.98:0/144804102 learned_addr learned my addr 172.21.15.98:0/144804102 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:40.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.604+0000 7f9e0880b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e040645b0 0x7f9e0415eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43336/0 (socket says 172.21.15.98:43336) 2023-08-22T00:22:40.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0880b700 1 -- 172.21.15.98:0/144804102 >> v1:172.21.15.118:6789/0 conn(0x7f9e04151960 legacy=0x7f9e040c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0880b700 1 -- 172.21.15.98:0/144804102 >> v1:172.21.15.98:6789/0 conn(0x7f9e04155050 legacy=0x7f9e04063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e02ffd700 1 -- 172.21.15.98:0/144804102 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302318814 0 0) 0x7f9e040c2b40 con 0x7f9e04155050 2023-08-22T00:22:40.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0880b700 1 -- 172.21.15.98:0/144804102 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040c1f30 con 0x7f9e040645b0 2023-08-22T00:22:40.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0880b700 1 --2- 172.21.15.98:0/144804102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e040645b0 0x7f9e0415eca0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9dfc009e60 tx=0x7f9dfc009780).ready entity=mon.0 client_cookie=dea3972c91a92edf server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e02ffd700 1 -- 172.21.15.98:0/144804102 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00e070 con 0x7f9e040645b0 2023-08-22T00:22:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e02ffd700 1 -- 172.21.15.98:0/144804102 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00bbf0 con 0x7f9e040645b0 2023-08-22T00:22:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e02ffd700 1 -- 172.21.15.98:0/144804102 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc012410 con 0x7f9e040645b0 2023-08-22T00:22:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0a26e700 1 -- 172.21.15.98:0/144804102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e040645b0 msgr2=0x7f9e0415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/144804102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e040645b0 0x7f9e0415eca0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9dfc009e60 tx=0x7f9dfc009780).stop 2023-08-22T00:22:40.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0a26e700 1 -- 172.21.15.98:0/144804102 shutdown_connections 2023-08-22T00:22:40.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.605+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/144804102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e040645b0 0x7f9e0415eca0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.606+0000 7f9e0a26e700 1 -- 172.21.15.98:0/144804102 >> 172.21.15.98:0/144804102 conn(0x7f9e04069680 msgr2=0x7f9e04069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.606+0000 7f9e0a26e700 1 -- 172.21.15.98:0/144804102 shutdown_connections 2023-08-22T00:22:40.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.606+0000 7f9e0a26e700 1 -- 172.21.15.98:0/144804102 wait complete. 2023-08-22T00:22:40.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.607+0000 7f9e0a26e700 1 Processor -- start 2023-08-22T00:22:40.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.607+0000 7f9e0a26e700 1 -- start start 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 0x7f9e040668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e04155050 0x7f9e041653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04066410 con 0x7f9e04151960 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04065800 con 0x7f9e040645b0 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04065ae0 con 0x7f9e04155050 2023-08-22T00:22:40.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43344/0 (socket says 172.21.15.98:43344) 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 -- 172.21.15.98:0/2939574082 learned_addr learned my addr 172.21.15.98:0/2939574082 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e04155050 0x7f9e041653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 -- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e04155050 msgr2=0x7f9e041653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e04155050 0x7f9e041653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 -- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 msgr2=0x7f9e040668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 0x7f9e040668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 0x7f9e040668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 -- 172.21.15.98:0/2939574082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009a20 con 0x7f9e04151960 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 0x7f9e040668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f9df400c4a0 tx=0x7f9df4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9dfbfff700 1 -- 172.21.15.98:0/2939574082 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40072e0 con 0x7f9e04151960 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9dfbfff700 1 -- 172.21.15.98:0/2939574082 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4007440 con 0x7f9e04151960 2023-08-22T00:22:40.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04065dc0 con 0x7f9e04151960 2023-08-22T00:22:40.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9dfbfff700 1 -- 172.21.15.98:0/2939574082 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40057a0 con 0x7f9e04151960 2023-08-22T00:22:40.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.608+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04142f00 con 0x7f9e04151960 2023-08-22T00:22:40.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.610+0000 7f9dfbfff700 1 -- 172.21.15.98:0/2939574082 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9df4005bd0 con 0x7f9e04151960 2023-08-22T00:22:40.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.610+0000 7f9dfbfff700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 0x7f9de40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.610+0000 7f9dfbfff700 1 -- 172.21.15.98:0/2939574082 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9df4079a20 con 0x7f9e04151960 2023-08-22T00:22:40.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.610+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 0x7f9de40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.610+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 0x7f9de40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9dec00a8a0 tx=0x7f9dec008040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.612+0000 7f9e1bc22b80 1 Processor -- start 2023-08-22T00:22:40.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.612+0000 7f9e1bc22b80 1 -- start start 2023-08-22T00:22:40.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb4faedb0 con 0x561fb50baf60 2023-08-22T00:22:40.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb4fc4030 con 0x561fb506daf0 2023-08-22T00:22:40.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb4fc4170 con 0x561fb50722c0 2023-08-22T00:22:40.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43354/0 (socket says 172.21.15.98:43354) 2023-08-22T00:22:40.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 -- 172.21.15.98:0/2513451142 learned_addr learned my addr 172.21.15.98:0/2513451142 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 -- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 msgr2=0x561fb50726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 -- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 msgr2=0x561fb506df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 -- 172.21.15.98:0/2513451142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb4f96b00 con 0x561fb50baf60 2023-08-22T00:22:40.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.613+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f9df4077c70 tx=0x7f9df400f000).ready entity=mon.0 client_cookie=651735aa992d72b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9df97fa700 1 -- 172.21.15.98:0/2513451142 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df404c9b0 con 0x561fb50baf60 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9df97fa700 1 -- 172.21.15.98:0/2513451142 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df404cc10 con 0x561fb50baf60 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9df97fa700 1 -- 172.21.15.98:0/2513451142 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df401bc10 con 0x561fb50baf60 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2513451142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 msgr2=0x561fb506d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f9df4077c70 tx=0x7f9df400f000).stop 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2513451142 shutdown_connections 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2513451142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb506d600 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2513451142 >> 172.21.15.98:0/2513451142 conn(0x561fb4edc940 msgr2=0x561fb50bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2513451142 shutdown_connections 2023-08-22T00:22:40.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.614+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2513451142 wait complete. 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.615+0000 7f9e1bc22b80 1 -- start start 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.615+0000 7f9e1bc22b80 1 Processor -- start 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 0x561fb50b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb509d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb4fc43f0 con 0x561fb506daf0 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb4f8f920 con 0x561fb50722c0 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb50b4c40 con 0x561fb50baf60 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 10 client.0 ll_register_callbacks cb 0x561fb4f64ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43368/0 (socket says 172.21.15.98:43368) 2023-08-22T00:22:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 -- 172.21.15.98:0/1467046926 learned_addr learned my addr 172.21.15.98:0/1467046926 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e0880b700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb509d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e037fe700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 0x561fb50b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 -- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 msgr2=0x561fb509d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb509d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 -- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 msgr2=0x561fb50b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 0x561fb50b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 -- 172.21.15.98:0/1467046926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04142f00 con 0x561fb506daf0 2023-08-22T00:22:40.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e037fe700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 0x561fb50b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:40.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e0880b700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb509d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:40.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e03fff700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f9dec0153f0 tx=0x7f9dec002000).ready entity=mon.0 client_cookie=b67dc72c1d49df19 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9de27fc700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:22:40.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01a070 con 0x561fb506daf0 2023-08-22T00:22:40.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9dec01cc30 con 0x561fb506daf0 2023-08-22T00:22:40.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.616+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fb506caa0 con 0x561fb506daf0 2023-08-22T00:22:40.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dec020420 con 0x561fb506daf0 2023-08-22T00:22:40.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 10 client.7557 fetch_fsmap learned FSMap version 43 2023-08-22T00:22:40.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x561fb4fbcf70 con 0x561fb506daf0 2023-08-22T00:22:40.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fb506caa0 con 0x561fb506daf0 2023-08-22T00:22:40.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9dec01c2c0 con 0x561fb506daf0 2023-08-22T00:22:40.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 10 client.7557 fetch_fsmap finished waiting for FSMap version 43 2023-08-22T00:22:40.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 10 client.7557 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-22T00:22:40.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 20 client.7557 populate_metadata read hostname 'smithi098' 2023-08-22T00:22:40.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb50b2220 0x561fb509c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 4 client.7557 mds_command: new command op to 7377 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:22:40.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 --> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fb4e2cef0 con 0x561fb50b2220 2023-08-22T00:22:40.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e037fe700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb50b2220 0x561fb509c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9de27fc700 10 client.7557 ms_handle_connect on v2:172.21.15.98:6835/4016657982 2023-08-22T00:22:40.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.617+0000 7f9e037fe700 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb50b2220 0x561fb509c2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d3ca3391b0da07f0 server_cookie=18f82ada35aa8ded in_seq=0 out_seq=0 2023-08-22T00:22:40.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9de27fc700 1 -- 172.21.15.98:0/1467046926 <== mds.0 v2:172.21.15.98:6835/4016657982 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561fb4e2cef0 con 0x561fb50b2220 2023-08-22T00:22:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9de27fc700 10 client.7557 handle_command_reply: tid=0 2023-08-22T00:22:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 client.7557 shutdown 2023-08-22T00:22:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 msgr2=0x561fb5099ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f9dec0153f0 tx=0x7f9dec002000).stop 2023-08-22T00:22:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 shutdown_connections 2023-08-22T00:22:40.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb50b2220 0x561fb509c2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb509d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb506daf0 0x561fb5099ed0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9de27fc700 0 client.7557 ms_handle_reset on v2:172.21.15.98:6835/4016657982 2023-08-22T00:22:40.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/1467046926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb50722c0 0x561fb50b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 >> 172.21.15.98:0/1467046926 conn(0x561fb4edc940 msgr2=0x561fb5070330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 shutdown_connections 2023-08-22T00:22:40.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/1467046926 wait complete. 2023-08-22T00:22:40.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.618+0000 7f9e1bc22b80 20 client.7557 trim_cache size 0 max 16384 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.634+0000 7f9e1bc22b80 1 Processor -- start 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.634+0000 7f9e1bc22b80 1 -- start start 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb5099c80 con 0x561fb50baf60 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb5070ad0 con 0x561fb506daf0 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb50a1490 con 0x561fb50722c0 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43378/0 (socket says 172.21.15.98:43378) 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 -- 172.21.15.98:0/2995772265 learned_addr learned my addr 172.21.15.98:0/2995772265 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 -- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 msgr2=0x561fb50b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 -- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 msgr2=0x561fb506e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.635+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e0880b700 1 -- 172.21.15.98:0/2995772265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb4fb8580 con 0x561fb50baf60 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f9dfc011000 tx=0x7f9dfc009780).ready entity=mon.0 client_cookie=f27a68513ac7a6eb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9df9ffb700 1 -- 172.21.15.98:0/2995772265 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc012780 con 0x561fb50baf60 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9df9ffb700 1 -- 172.21.15.98:0/2995772265 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0128e0 con 0x561fb50baf60 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9df9ffb700 1 -- 172.21.15.98:0/2995772265 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc012c60 con 0x561fb50baf60 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2995772265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 msgr2=0x561fb50bb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f9dfc011000 tx=0x7f9dfc009780).stop 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2995772265 shutdown_connections 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50baf60 0x561fb50bb840 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb506e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2995772265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50722c0 0x561fb50b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2995772265 >> 172.21.15.98:0/2995772265 conn(0x561fb4edc940 msgr2=0x561fb5068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.636+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2995772265 shutdown_connections 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.637+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2995772265 wait complete. 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.637+0000 7f9e1bc22b80 1 -- start start 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.637+0000 7f9e1bc22b80 1 Processor -- start 2023-08-22T00:22:40.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb511ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb5099290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb50a06a0 con 0x561fb50722c0 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb5099780 con 0x561fb506daf0 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb511b140 con 0x561fb50baf60 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e1bc22b80 10 client.0 ll_register_callbacks cb 0x561fb4f64ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:22:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43392/0 (socket says 172.21.15.98:43392) 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 -- 172.21.15.98:0/2687475925 learned_addr learned my addr 172.21.15.98:0/2687475925 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb511ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb5099290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 -- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 msgr2=0x561fb5099290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb5099290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 -- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 msgr2=0x561fb511ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb511ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 -- 172.21.15.98:0/2687475925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e040c1f30 con 0x561fb50722c0 2023-08-22T00:22:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e0880b700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb5099290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9e037fe700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f9df400a000 tx=0x7f9df4057000).ready entity=mon.0 client_cookie=cf97743a0244ac31 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9de27fc700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.638+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df405f040 con 0x561fb50722c0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9df4005900 con 0x561fb50722c0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9df404cc10 con 0x561fb50722c0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df4063280 con 0x561fb50722c0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 10 client.7563 fetch_fsmap learned FSMap version 43 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x561fb4fb82d0 con 0x561fb50722c0 2023-08-22T00:22:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df404cc10 con 0x561fb50722c0 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9df404af80 con 0x561fb50722c0 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 10 client.7563 fetch_fsmap finished waiting for FSMap version 43 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 10 client.7563 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 20 client.7563 populate_metadata read hostname 'smithi098' 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb511d890 0x561fb511dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 4 client.7563 mds_command: new command op to 7377 tid=0[{"prefix": "status"}] 2023-08-22T00:22:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 --> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561fb4e62040 con 0x561fb511d890 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb511d890 0x561fb511dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 10 client.7563 ms_handle_connect on v2:172.21.15.98:6835/4016657982 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9e03fff700 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb511d890 0x561fb511dc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=904298ebc783997 server_cookie=3c926c4aefbe701c in_seq=0 out_seq=0 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 1 -- 172.21.15.98:0/2687475925 <== mds.0 v2:172.21.15.98:6835/4016657982 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561fb4e62040 con 0x561fb511d890 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.639+0000 7f9de27fc700 10 client.7563 handle_command_reply: tid=0 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 client.7563 shutdown 2023-08-22T00:22:40.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 msgr2=0x561fb5098da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f9df400a000 tx=0x7f9df4057000).stop 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 shutdown_connections 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:6835/4016657982,v1:172.21.15.98:6837/4016657982] conn(0x561fb511d890 0x561fb511dc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561fb50baf60 0x561fb5099290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fb506daf0 0x561fb511ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9de27fc700 0 client.7563 ms_handle_reset on v2:172.21.15.98:6835/4016657982 2023-08-22T00:22:40.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 --2- 172.21.15.98:0/2687475925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561fb50722c0 0x561fb5098da0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 >> 172.21.15.98:0/2687475925 conn(0x561fb4edc940 msgr2=0x561fb506e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 shutdown_connections 2023-08-22T00:22:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 1 -- 172.21.15.98:0/2687475925 wait complete. 2023-08-22T00:22:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e1bc22b80 20 client.7563 trim_cache size 0 max 16384 2023-08-22T00:22:40.669 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 7377, 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:22:40.670 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.7433844900000004, 2023-08-22T00:22:40.671 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 43, 2023-08-22T00:22:40.671 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 120, 2023-08-22T00:22:40.671 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 120, 2023-08-22T00:22:40.671 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.252415896 2023-08-22T00:22:40.671 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:22:40.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 msgr2=0x7f9de40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 0x7f9de40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9dec00a8a0 tx=0x7f9dec008040).stop 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 msgr2=0x7f9e040ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f9df400c4a0 tx=0x7f9df4007c30).stop 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 shutdown_connections 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9de405ef30 0x7f9de40613f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e04155050 0x7f9e041653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e040645b0 0x7f9e040668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 --2- 172.21.15.98:0/2939574082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e04151960 0x7f9e040ac6b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 >> 172.21.15.98:0/2939574082 conn(0x7f9e04069680 msgr2=0x7f9e040a48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 shutdown_connections 2023-08-22T00:22:40.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.640+0000 7f9e0a26e700 1 -- 172.21.15.98:0/2939574082 wait complete. 2023-08-22T00:22:40.674 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:22:40.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.776+0000 7f4e9de70700 1 Processor -- start 2023-08-22T00:22:40.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 -- start start 2023-08-22T00:22:40.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 0x7f4e980a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e98156ac0 0x7f4e98156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e98156630 con 0x7f4e980a9a20 2023-08-22T00:22:40.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e98152570 con 0x7f4e98156ac0 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.777+0000 7f4e9de70700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980c0670 con 0x7f4e981520e0 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e98156ac0 0x7f4e98156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e977fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4e980a9a20 0x7f4e98154ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46624/0 (socket says 172.21.15.98:46624) 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e977fe700 1 -- 172.21.15.98:0/4158607682 learned_addr learned my addr 172.21.15.98:0/4158607682 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e96ffd700 1 --2- 172.21.15.98:0/4158607682 >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 0x7f4e980a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 -- 172.21.15.98:0/4158607682 >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 msgr2=0x7f4e980a9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:40.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 --2- 172.21.15.98:0/4158607682 >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 0x7f4e980a9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 -- 172.21.15.98:0/4158607682 >> v1:172.21.15.98:6789/0 conn(0x7f4e980a9a20 legacy=0x7f4e98154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 -- 172.21.15.98:0/4158607682 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98155a20 con 0x7f4e98156ac0 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e967fc700 1 -- 172.21.15.98:0/4158607682 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465400778 0 0) 0x7f4e98156630 con 0x7f4e980a9a20 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e96ffd700 1 --2- 172.21.15.98:0/4158607682 >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 0x7f4e980a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e97fff700 1 --2- 172.21.15.98:0/4158607682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e98156ac0 0x7f4e98156ed0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f4e980ad520 tx=0x7f4e90009780).ready entity=mon.0 client_cookie=dc2d8c4473f50ba3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e967fc700 1 -- 172.21.15.98:0/4158607682 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000e070 con 0x7f4e98156ac0 2023-08-22T00:22:40.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e967fc700 1 -- 172.21.15.98:0/4158607682 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000bc30 con 0x7f4e98156ac0 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e967fc700 1 -- 172.21.15.98:0/4158607682 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012410 con 0x7f4e98156ac0 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.778+0000 7f4e9de70700 1 -- 172.21.15.98:0/4158607682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e98156ac0 msgr2=0x7f4e98156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 --2- 172.21.15.98:0/4158607682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e98156ac0 0x7f4e98156ed0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f4e980ad520 tx=0x7f4e90009780).stop 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 -- 172.21.15.98:0/4158607682 shutdown_connections 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 --2- 172.21.15.98:0/4158607682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e98156ac0 0x7f4e98156ed0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 --2- 172.21.15.98:0/4158607682 >> v2:172.21.15.118:3300/0 conn(0x7f4e981520e0 0x7f4e980a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 -- 172.21.15.98:0/4158607682 >> 172.21.15.98:0/4158607682 conn(0x7f4e98069d20 msgr2=0x7f4e9806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 -- 172.21.15.98:0/4158607682 shutdown_connections 2023-08-22T00:22:40.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.779+0000 7f4e9de70700 1 -- 172.21.15.98:0/4158607682 wait complete. 2023-08-22T00:22:40.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.780+0000 7f4e9de70700 1 Processor -- start 2023-08-22T00:22:40.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.780+0000 7f4e9de70700 1 -- start start 2023-08-22T00:22:40.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 0x7f4e980c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e98156ac0 0x7f4e980c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c3210 con 0x7f4e981520e0 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c23c0 con 0x7f4e98156ac0 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c26a0 con 0x7f4e980a9a20 2023-08-22T00:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43412/0 (socket says 172.21.15.98:43412) 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 -- 172.21.15.98:0/2520145753 learned_addr learned my addr 172.21.15.98:0/2520145753 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e977fe700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 0x7f4e980c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 -- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 msgr2=0x7f4e980c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 0x7f4e980c1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 -- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e98156ac0 msgr2=0x7f4e980c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e98156ac0 0x7f4e980c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 -- 172.21.15.98:0/2520145753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90009a20 con 0x7f4e981520e0 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e977fe700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 0x7f4e980c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e96ffd700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f4e8000d890 tx=0x7f4e80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800125f0 con 0x7f4e981520e0 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80012750 con 0x7f4e981520e0 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980c2980 con 0x7f4e981520e0 2023-08-22T00:22:40.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80012ad0 con 0x7f4e981520e0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.781+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e98143880 con 0x7f4e981520e0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.782+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980c2bc0 con 0x7f4e981520e0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.783+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4e80013480 con 0x7f4e981520e0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.783+0000 7f4e8f7fe700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 0x7f4e780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.783+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4e8007a2a0 con 0x7f4e981520e0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.783+0000 7f4e977fe700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 0x7f4e780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:40.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.783+0000 7f4e977fe700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 0x7f4e780613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4e880016f0 tx=0x7f4e88009040).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:40.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.787+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e980c2bc0 con 0x7f4e981520e0 2023-08-22T00:22:40.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.987+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e980c2bc0 con 0x7f4e981520e0 2023-08-22T00:22:40.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.987+0000 7f4e8f7fe700 1 -- 172.21.15.98:0/2520145753 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e980c2bc0 con 0x7f4e981520e0 2023-08-22T00:22:40.989 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:22:40.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 msgr2=0x7f4e780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 0x7f4e780613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4e880016f0 tx=0x7f4e88009040).stop 2023-08-22T00:22:40.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 msgr2=0x7f4e98143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f4e8000d890 tx=0x7f4e80008040).stop 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 shutdown_connections 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e7805ef30 0x7f4e780613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e980a9a20 0x7f4e980c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e98156ac0 0x7f4e980c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 --2- 172.21.15.98:0/2520145753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e981520e0 0x7f4e98143390 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:40.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 >> 172.21.15.98:0/2520145753 conn(0x7f4e98069d20 msgr2=0x7f4e9806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:40.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 shutdown_connections 2023-08-22T00:22:40.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:40.989+0000 7f4e9de70700 1 -- 172.21.15.98:0/2520145753 wait complete. 2023-08-22T00:22:41.001 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:22:41.001 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:22:41.001 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:22:41.002 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:22:41.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:41.002 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:22:41.002 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:22:41.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:22:41.003 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:41.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.005 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:22:41.024 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:22:41.024 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:22:41.024 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:41.025 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:22:41.026 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41545sec preferred_lft 41545sec 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:22:41.027 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:22:41.028 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:22:41.029 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:22:41.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.030 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:22:41.090 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:22:41.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.092 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:22:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:22:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:22:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:22:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:22:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:22:41.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.153 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:22:41.154 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:22:41.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:22:41.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:22:41.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:22:41.155 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:22:41.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.258 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:22:41.276 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:22:41.276 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:22:41.277 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:41.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:22:41.277 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:22:41.344 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:22:41.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:41.346 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:41.402 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:22:41.402 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:22:41.469 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:22:41.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:22:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:22:41.536 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:22:41.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:41.537 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:22:41.595 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:22:41.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:41.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:22:41.665 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:22:41.666 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:22:41.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:22:41.718+0000 7f351054e3c0 -1 init, newargv = 0x5616764afc00 newargc=15 2023-08-22T00:22:41.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[156014]: starting ceph client 2023-08-22T00:22:41.724 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[156014]: starting fuse 2023-08-22T00:22:41.734 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:22:41.735 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:22:41.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:41.736 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:22:41.794 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:22:41.795 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:22:41.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:22:41.795 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:22:41.796 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:22:41.796 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:22:41.796 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:22:41.797 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:41.797 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:22:41.798 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:22:41.798 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:22:41.798 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:22:41.799 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:41.799 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:22:41.800 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:22:41.800 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:22:41.800 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:22:41.801 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:41.801 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:22:41.802 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:22:41.802 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:22:41.802 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:22:41.802 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:22:41.803 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:22:41.803 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:22:41.803 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:22:41.804 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:22:41.804 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:22:41.808 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:22:41.918 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.156014.asok 2023-08-22T00:22:42.100 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.156014.asok 2023-08-22T00:22:42.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:42.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.156014.asok status 2023-08-22T00:22:42.253 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:22:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:22:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "156014", 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:22:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 7578, 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 7578 2023-08-22T00:22:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2349990261 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2349990261 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.7578 192.168.0.1:0/2349990261", 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/2349990261", 2023-08-22T00:22:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 43, 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 120, 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:22:42.258 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:22:42.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:42.263 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:22:42.263 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:42.282 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:22:42.282 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:42.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:22:42.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:22:42.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:22:42.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.506+0000 7fb5d7083700 1 Processor -- start 2023-08-22T00:22:42.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.506+0000 7fb5d7083700 1 -- start start 2023-08-22T00:22:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d7083700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5d0064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d7083700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d0154b30 con 0x7fb5d00a6a80 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d7083700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d0066820 con 0x7fb5d00a6e60 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d7083700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01547e0 con 0x7fb5d0067c60 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d4e1f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb5d00a6a80 0x7fb5d0066110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46630/0 (socket says 172.21.15.98:46630) 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d4e1f700 1 -- 172.21.15.98:0/389734626 learned_addr learned my addr 172.21.15.98:0/389734626 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417954383 0 0) 0x7fb5d0154b30 con 0x7fb5d00a6a80 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c00033f0 con 0x7fb5d00a6a80 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5d5620700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5d0064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 94883087 0 0) 0x7fb5c00033f0 con 0x7fb5d00a6a80 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 msgr2=0x7fb5d0064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5d0064fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 >> v1:172.21.15.118:6789/0 conn(0x7fb5d00a6e60 legacy=0x7fb5d0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.507+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d01556d0 con 0x7fb5d00a6a80 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb5c4001470 con 0x7fb5d00a6a80 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 >> v1:172.21.15.98:6789/0 conn(0x7fb5d00a6a80 legacy=0x7fb5d0066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c0003910 0x7fb5c0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c0004690 0x7fb5c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01547e0 con 0x7fb5c0003910 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c000b940 con 0x7fb5c0004690 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c000bb00 con 0x7fb5d0067c60 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c0003910 0x7fb5c0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cffff700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c0004690 0x7fb5c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d5620700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 -- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 msgr2=0x7fb5c0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d0067c60 0x7fb5c0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 -- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c0004690 msgr2=0x7fb5c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c0004690 0x7fb5c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 -- 172.21.15.98:0/389734626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00033f0 con 0x7fb5c0003910 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c0003910 0x7fb5c0003d30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fb5c400c190 tx=0x7fb5c4001e50).ready entity=mon.0 client_cookie=38d0ca1f43c9492f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4007a20 con 0x7fb5c0003910 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c400cac0 con 0x7fb5c0003910 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.508+0000 7fb5cf7fe700 1 -- 172.21.15.98:0/389734626 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400ce40 con 0x7fb5c0003910 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 -- 172.21.15.98:0/389734626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c0003910 msgr2=0x7fb5c0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 --2- 172.21.15.98:0/389734626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c0003910 0x7fb5c0003d30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fb5c400c190 tx=0x7fb5c4001e50).stop 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d5620700 1 -- 172.21.15.98:0/389734626 reap_dead start 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 -- 172.21.15.98:0/389734626 shutdown_connections 2023-08-22T00:22:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 -- 172.21.15.98:0/389734626 >> 172.21.15.98:0/389734626 conn(0x7fb5d00c42e0 msgr2=0x7fb5d00c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 -- 172.21.15.98:0/389734626 shutdown_connections 2023-08-22T00:22:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.509+0000 7fb5d7083700 1 -- 172.21.15.98:0/389734626 wait complete. 2023-08-22T00:22:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.510+0000 7fb5d7083700 1 Processor -- start 2023-08-22T00:22:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 -- start start 2023-08-22T00:22:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5c0003910 0x7fb5d014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d00ab730 0x7fb5d00abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00ad390 con 0x7fb5d00c46f0 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00ac0a0 con 0x7fb5d00ab730 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d7083700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c5060 con 0x7fb5c0003910 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.511+0000 7fb5d5620700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43428/0 (socket says 172.21.15.98:43428) 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 -- 172.21.15.98:0/152076772 learned_addr learned my addr 172.21.15.98:0/152076772 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 -- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5c0003910 msgr2=0x7fb5d014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5c0003910 0x7fb5d014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5c0003910 0x7fb5d014d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 -- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d00ab730 msgr2=0x7fb5d00abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5cffff700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d00ab730 0x7fb5d00abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d00ab730 0x7fb5d00abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 -- 172.21.15.98:0/152076772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d014dc90 con 0x7fb5d00c46f0 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d5620700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fb5c8009fa0 tx=0x7fb5c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800e040 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800f040 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d00ac2f0 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c801c640 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.512+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d00ac8b0 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.513+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d0069460 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.513+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb5c801b3e0 con 0x7fb5d00c46f0 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.514+0000 7fb5ccff9700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 0x7fb5b40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.514+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb5c807c6d0 con 0x7fb5d00c46f0 2023-08-22T00:22:42.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.514+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 0x7fb5b40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.514+0000 7fb5d4e1f700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 0x7fb5b40613c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb5c4001ed0 tx=0x7fb5c4015000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.518+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5c804d800 con 0x7fb5d00c46f0 2023-08-22T00:22:42.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.705+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d0068260 con 0x7fb5b405ef00 2023-08-22T00:22:42.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.706+0000 7fb5ccff9700 1 -- 172.21.15.98:0/152076772 <== mgr.7197 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb5d0068260 con 0x7fb5b405ef00 2023-08-22T00:22:42.708 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:22:42.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:22:42.708 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:22:42.708 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:22:42.708 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:22:42.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 msgr2=0x7fb5b40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 0x7fb5b40613c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb5c4001ed0 tx=0x7fb5c4015000).stop 2023-08-22T00:22:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 msgr2=0x7fb5d00c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fb5c8009fa0 tx=0x7fb5c800b040).stop 2023-08-22T00:22:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 shutdown_connections 2023-08-22T00:22:42.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5b405ef00 0x7fb5b40613c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5c0003910 0x7fb5d014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5d00c46f0 0x7fb5d00c4b70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.708+0000 7fb5d7083700 1 --2- 172.21.15.98:0/152076772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d00ab730 0x7fb5d00abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.709+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 >> 172.21.15.98:0/152076772 conn(0x7fb5d00c42e0 msgr2=0x7fb5d014e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.709+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 shutdown_connections 2023-08-22T00:22:42.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.709+0000 7fb5d7083700 1 -- 172.21.15.98:0/152076772 wait complete. 2023-08-22T00:22:42.722 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:22:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.838+0000 7ff555616700 1 Processor -- start 2023-08-22T00:22:42.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.838+0000 7ff555616700 1 -- start start 2023-08-22T00:22:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.839+0000 7ff555616700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff5500a8ac0 0x7ff5500a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.839+0000 7ff555616700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5500bd260 0x7ff5500c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.839+0000 7ff555616700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5500bd640 con 0x7ff5500bb770 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.839+0000 7ff555616700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550155380 con 0x7ff5500a8ac0 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.839+0000 7ff555616700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550155620 con 0x7ff5500bd260 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff5500a8ac0 0x7ff5500a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff5500bb770 0x7ff5500bbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46644/0 (socket says 172.21.15.98:46644) 2023-08-22T00:22:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54f7fe700 1 -- 172.21.15.98:0/3455516474 learned_addr learned my addr 172.21.15.98:0/3455516474 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 -- 172.21.15.98:0/3455516474 >> v2:172.21.15.118:3300/0 conn(0x7ff5500bd260 msgr2=0x7ff5500c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 --2- 172.21.15.98:0/3455516474 >> v2:172.21.15.118:3300/0 conn(0x7ff5500bd260 0x7ff5500c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 -- 172.21.15.98:0/3455516474 >> v1:172.21.15.98:6789/0 conn(0x7ff5500bb770 legacy=0x7ff5500bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54dffb700 1 -- 172.21.15.98:0/3455516474 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607021855 0 0) 0x7ff5500bd640 con 0x7ff5500bb770 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 -- 172.21.15.98:0/3455516474 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500c12c0 con 0x7ff5500a8ac0 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54effd700 1 --2- 172.21.15.98:0/3455516474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500a8ac0 0x7ff5500a8ea0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7ff5500c2550 tx=0x7ff544009060).ready entity=mon.0 client_cookie=4627a0ff8ed896ea server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54dffb700 1 -- 172.21.15.98:0/3455516474 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400b580 con 0x7ff5500a8ac0 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54dffb700 1 -- 172.21.15.98:0/3455516474 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54400b6e0 con 0x7ff5500a8ac0 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.840+0000 7ff54dffb700 1 -- 172.21.15.98:0/3455516474 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400ba60 con 0x7ff5500a8ac0 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 -- 172.21.15.98:0/3455516474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500a8ac0 msgr2=0x7ff5500a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 --2- 172.21.15.98:0/3455516474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500a8ac0 0x7ff5500a8ea0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7ff5500c2550 tx=0x7ff544009060).stop 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 -- 172.21.15.98:0/3455516474 shutdown_connections 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 --2- 172.21.15.98:0/3455516474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500a8ac0 0x7ff5500a8ea0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 --2- 172.21.15.98:0/3455516474 >> v2:172.21.15.118:3300/0 conn(0x7ff5500bd260 0x7ff5500c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 -- 172.21.15.98:0/3455516474 >> 172.21.15.98:0/3455516474 conn(0x7ff5500c31d0 msgr2=0x7ff5500c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:42.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 -- 172.21.15.98:0/3455516474 shutdown_connections 2023-08-22T00:22:42.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.841+0000 7ff555616700 1 -- 172.21.15.98:0/3455516474 wait complete. 2023-08-22T00:22:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.842+0000 7ff555616700 1 Processor -- start 2023-08-22T00:22:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.842+0000 7ff555616700 1 -- start start 2023-08-22T00:22:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500a8ac0 0x7ff55013c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 0x7ff5501543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550154db0 con 0x7ff5500bd260 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500bdd20 con 0x7ff5500a8ac0 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff555616700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500be8a0 con 0x7ff5500bb770 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff54f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff54f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43448/0 (socket says 172.21.15.98:43448) 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.843+0000 7ff54f7fe700 1 -- 172.21.15.98:0/3049854549 learned_addr learned my addr 172.21.15.98:0/3049854549 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54effd700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500a8ac0 0x7ff55013c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54e7fc700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 0x7ff5501543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 -- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 msgr2=0x7ff5501543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 0x7ff5501543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 -- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500a8ac0 msgr2=0x7ff55013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500a8ac0 0x7ff55013c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 -- 172.21.15.98:0/3049854549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440092a0 con 0x7ff5500bd260 2023-08-22T00:22:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54e7fc700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 0x7ff5501543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:22:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff54f7fe700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7ff54800c790 tx=0x7ff548007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548005d30 con 0x7ff5500bd260 2023-08-22T00:22:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548007110 con 0x7ff5500bd260 2023-08-22T00:22:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5500bdf70 con 0x7ff5500bd260 2023-08-22T00:22:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480074d0 con 0x7ff5500bd260 2023-08-22T00:22:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.844+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5500be530 con 0x7ff5500bd260 2023-08-22T00:22:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.845+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5500bea50 con 0x7ff5500bd260 2023-08-22T00:22:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.845+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 43) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff548007840 con 0x7ff5500bd260 2023-08-22T00:22:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.846+0000 7ff536ffd700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 0x7ff53c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.846+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff54807a0f0 con 0x7ff5500bd260 2023-08-22T00:22:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.846+0000 7ff54effd700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 0x7ff53c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:42.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.846+0000 7ff54effd700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 0x7ff53c0613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff5500c2550 tx=0x7ff544017000).ready entity=mgr.7197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:42.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:42.850+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff54804b280 con 0x7ff5500bd260 2023-08-22T00:22:43.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.054+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff5500c2ae0 con 0x7ff5500bd260 2023-08-22T00:22:43.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.553+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 44) v1 ==== 75391+0+0 (secure 0 0 0) 0x7ff54801adb0 con 0x7ff5500bd260 2023-08-22T00:22:43.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.554+0000 7ff536ffd700 1 -- 172.21.15.98:0/3049854549 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v44) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff548071ca0 con 0x7ff5500bd260 2023-08-22T00:22:43.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 msgr2=0x7ff53c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 0x7ff53c0613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff5500c2550 tx=0x7ff544017000).stop 2023-08-22T00:22:43.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 msgr2=0x7ff5501548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7ff54800c790 tx=0x7ff548007f30).stop 2023-08-22T00:22:43.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 shutdown_connections 2023-08-22T00:22:43.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5500bd260 0x7ff5501548c0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500a8ac0 0x7ff55013c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff53c05ef30 0x7ff53c0613f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 --2- 172.21.15.98:0/3049854549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5500bb770 0x7ff5501543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 >> 172.21.15.98:0/3049854549 conn(0x7ff5500c31d0 msgr2=0x7ff55014fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:43.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 shutdown_connections 2023-08-22T00:22:43.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.556+0000 7ff555616700 1 -- 172.21.15.98:0/3049854549 wait complete. 2023-08-22T00:22:43.572 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:22:43.694 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:43.694+0000 7f7cd5eb8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:43.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.699+0000 7f7f9f071700 1 Processor -- start 2023-08-22T00:22:43.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.699+0000 7f7f9f071700 1 -- start start 2023-08-22T00:22:43.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.699+0000 7f7f9f071700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f981508b0 0x7f7f98150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9f071700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980654c0 con 0x7f7f981550a0 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9f071700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980c3fb0 con 0x7f7f980a6740 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9f071700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980be6e0 con 0x7f7f981508b0 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f97fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7f981550a0 0x7f7f980c38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46654/0 (socket says 172.21.15.98:46654) 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f97fff700 1 -- 172.21.15.98:0/3245720712 learned_addr learned my addr 172.21.15.98:0/3245720712 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:43.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> v2:172.21.15.118:3300/0 conn(0x7f7f981508b0 0x7f7f98150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488143069 0 0) 0x7f7f980654c0 con 0x7f7f981550a0 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f880033f0 con 0x7f7f981550a0 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859675519 0 0) 0x7f7f880033f0 con 0x7f7f981550a0 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 >> v2:172.21.15.118:3300/0 conn(0x7f7f981508b0 msgr2=0x7f7f98150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 --2- 172.21.15.98:0/3245720712 >> v2:172.21.15.118:3300/0 conn(0x7f7f981508b0 0x7f7f98150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 >> v1:172.21.15.118:6789/0 conn(0x7f7f980a6740 legacy=0x7f7f980c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980be120 con 0x7f7f981550a0 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7f84001470 con 0x7f7f981550a0 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> v2:172.21.15.118:3300/0 conn(0x7f7f981508b0 0x7f7f98150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 >> v1:172.21.15.98:6789/0 conn(0x7f7f981550a0 legacy=0x7f7f980c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f88003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f88004690 0x7f7f88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f88005000 0x7f7f8800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980be6e0 con 0x7f7f880038e0 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8800bf30 con 0x7f7f88005000 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8800c0f0 con 0x7f7f88004690 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f88003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f97fff700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f88004690 0x7f7f88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.700+0000 7f7f9d60e700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f88005000 0x7f7f8800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 -- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f88004690 msgr2=0x7f7f88004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:43.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f88004690 0x7f7f88004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 -- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f88005000 msgr2=0x7f7f8800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f88005000 0x7f7f8800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9d60e700 1 -- 172.21.15.98:0/3245720712 reap_dead start 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 -- 172.21.15.98:0/3245720712 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880033f0 con 0x7f7f880038e0 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f88003cc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f7f8c009c70 tx=0x7f7f8c009060).ready entity=mon.0 client_cookie=b2248a91b17b467a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0095c0 con 0x7f7f880038e0 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00e690 con 0x7f7f880038e0 2023-08-22T00:22:43.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f7f977fe700 1 -- 172.21.15.98:0/3245720712 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00ea10 con 0x7f7f880038e0 2023-08-22T00:22:43.708 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:43.701+0000 7f8552d29680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:22:43.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 -- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 msgr2=0x7f7f88003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f88003cc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f7f8c009c70 tx=0x7f7f8c009060).stop 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 -- 172.21.15.98:0/3245720712 shutdown_connections 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 --2- 172.21.15.98:0/3245720712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f88003cc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 -- 172.21.15.98:0/3245720712 >> 172.21.15.98:0/3245720712 conn(0x7f7f980c7820 msgr2=0x7f7f980c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 -- 172.21.15.98:0/3245720712 shutdown_connections 2023-08-22T00:22:43.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.702+0000 7f7f9f071700 1 -- 172.21.15.98:0/3245720712 wait complete. 2023-08-22T00:22:43.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.703+0000 7f7f9f071700 1 Processor -- start 2023-08-22T00:22:43.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.703+0000 7f7f9f071700 1 -- start start 2023-08-22T00:22:43.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 0x7f7f980a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f980a86e0 0x7f7f9814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98148560 con 0x7f7f880038e0 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9814ea70 con 0x7f7f98145020 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9f071700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98147d40 con 0x7f7f980a86e0 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9ce0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9ce0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43482/0 (socket says 172.21.15.98:43482) 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9ce0d700 1 -- 172.21.15.98:0/73431282 learned_addr learned my addr 172.21.15.98:0/73431282 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 0x7f7f980a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9d60e700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f980a86e0 0x7f7f9814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 -- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f980a86e0 msgr2=0x7f7f9814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f980a86e0 0x7f7f9814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 -- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 msgr2=0x7f7f98141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 -- 172.21.15.98:0/73431282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98141920 con 0x7f7f98145020 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.704+0000 7f7f97fff700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 0x7f7f980a81f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7f84000df0 tx=0x7f7f84001e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.705+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840114c0 con 0x7f7f98145020 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.705+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84011620 con 0x7f7f98145020 2023-08-22T00:22:43.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.705+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f98147fa0 con 0x7f7f98145020 2023-08-22T00:22:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.705+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840119a0 con 0x7f7f98145020 2023-08-22T00:22:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.705+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9814e700 con 0x7f7f98145020 2023-08-22T00:22:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9814ec00 con 0x7f7f98145020 2023-08-22T00:22:43.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 44) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f7f84011d10 con 0x7f7f98145020 2023-08-22T00:22:43.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f94ff9700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 0x7f7f7c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:43.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f9ce0d700 1 -- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 msgr2=0x7f7f7c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:43.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7f84079730 con 0x7f7f98145020 2023-08-22T00:22:43.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.706+0000 7f7f9ce0d700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 0x7f7f7c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:43.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.715+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f8404aa30 con 0x7f7f98145020 2023-08-22T00:22:43.761 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:43.761+0000 7f7cd5eb8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:43.768 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:43.767+0000 7f8552d29680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:22:43.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.884+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7f980be400 con 0x7f7f98145020 2023-08-22T00:22:43.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.890+0000 7f7f94ff9700 1 -- 172.21.15.98:0/73431282 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7f84019030 con 0x7f7f98145020 2023-08-22T00:22:43.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 msgr2=0x7f7f7c061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 0x7f7f7c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 msgr2=0x7f7f980a81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 0x7f7f980a81f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7f84000df0 tx=0x7f7f84001e70).stop 2023-08-22T00:22:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 shutdown_connections 2023-08-22T00:22:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7f7c05ef80 0x7f7f7c061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f980a86e0 0x7f7f9814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f880038e0 0x7f7f98141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 --2- 172.21.15.98:0/73431282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f98145020 0x7f7f980a81f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:43.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 >> 172.21.15.98:0/73431282 conn(0x7f7f980c7820 msgr2=0x7f7f980c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:43.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 shutdown_connections 2023-08-22T00:22:43.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:43.892+0000 7f7f9f071700 1 -- 172.21.15.98:0/73431282 wait complete. 2023-08-22T00:22:43.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-08-22T00:22:44.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.030+0000 7f5a0823f700 1 Processor -- start 2023-08-22T00:22:44.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.031+0000 7f5a0823f700 1 -- start start 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a0823f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00150750 0x7f5a00150b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a0823f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a00065fa0 0x7f5a00066450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a0823f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a00066940 con 0x7f5a00065690 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a0823f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a000bc6d0 con 0x7f5a00065fa0 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a0823f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000bcf70 con 0x7f5a00150750 2023-08-22T00:22:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a00065fa0 0x7f5a00066450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a00065fa0 0x7f5a00066450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43494/0 (socket says 172.21.15.98:43494) 2023-08-22T00:22:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 -- 172.21.15.98:0/4247010865 learned_addr learned my addr 172.21.15.98:0/4247010865 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a05fdb700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00150750 0x7f5a00150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 -- 172.21.15.98:0/4247010865 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00150750 msgr2=0x7f5a00150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00150750 0x7f5a00150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 -- 172.21.15.98:0/4247010865 >> v1:172.21.15.118:6789/0 conn(0x7f5a00065690 legacy=0x7f5a000c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 -- 172.21.15.98:0/4247010865 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000c3b20 con 0x7f5a00065fa0 2023-08-22T00:22:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.032+0000 7f5a067dc700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065fa0 0x7f5a00066450 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f59f8009f20 tx=0x7f59f8009840).ready entity=mon.0 client_cookie=a23d805c5e78e233 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a04fd9700 1 -- 172.21.15.98:0/4247010865 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800e070 con 0x7f5a00065fa0 2023-08-22T00:22:44.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a04fd9700 1 -- 172.21.15.98:0/4247010865 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800b9d0 con 0x7f5a00065fa0 2023-08-22T00:22:44.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a04fd9700 1 -- 172.21.15.98:0/4247010865 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800bd50 con 0x7f5a00065fa0 2023-08-22T00:22:44.038 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:44.033+0000 7f7cd5eb8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:44.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 -- 172.21.15.98:0/4247010865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065fa0 msgr2=0x7f5a00066450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065fa0 0x7f5a00066450 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f59f8009f20 tx=0x7f59f8009840).stop 2023-08-22T00:22:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 -- 172.21.15.98:0/4247010865 shutdown_connections 2023-08-22T00:22:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065fa0 0x7f5a00066450 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:44.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 --2- 172.21.15.98:0/4247010865 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00150750 0x7f5a00150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 -- 172.21.15.98:0/4247010865 >> 172.21.15.98:0/4247010865 conn(0x7f5a0006a930 msgr2=0x7f5a000c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 -- 172.21.15.98:0/4247010865 shutdown_connections 2023-08-22T00:22:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.033+0000 7f5a0823f700 1 -- 172.21.15.98:0/4247010865 wait complete. 2023-08-22T00:22:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.034+0000 7f5a0823f700 1 Processor -- start 2023-08-22T00:22:44.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 -- start start 2023-08-22T00:22:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00065fa0 0x7f5a0014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a00150750 0x7f5a000c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000ab310 con 0x7f5a00065690 2023-08-22T00:22:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000aa720 con 0x7f5a00150750 2023-08-22T00:22:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a0823f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000aa9e0 con 0x7f5a00065fa0 2023-08-22T00:22:44.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a05fdb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:44.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a05fdb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43502/0 (socket says 172.21.15.98:43502) 2023-08-22T00:22:44.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a05fdb700 1 -- 172.21.15.98:0/1460400410 learned_addr learned my addr 172.21.15.98:0/1460400410 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:44.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.035+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00065fa0 0x7f5a0014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:44.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a067dc700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a00150750 0x7f5a000c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:44.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00065fa0 msgr2=0x7f5a0014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:44.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00065fa0 0x7f5a0014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:44.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a00150750 msgr2=0x7f5a000c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:44.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a00150750 0x7f5a000c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:44.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009ae0 con 0x7f5a00065690 2023-08-22T00:22:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a05fdb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f59fc00e930 tx=0x7f59fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc012600 con 0x7f5a00065690 2023-08-22T00:22:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc012760 con 0x7f5a00065690 2023-08-22T00:22:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a000aacc0 con 0x7f5a00065690 2023-08-22T00:22:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc012ae0 con 0x7f5a00065690 2023-08-22T00:22:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.036+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0014d070 con 0x7f5a00065690 2023-08-22T00:22:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.037+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 44) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f59fc01b400 con 0x7f5a00065690 2023-08-22T00:22:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.038+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0014fe50 con 0x7f5a00065690 2023-08-22T00:22:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.038+0000 7f59f5ffb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.038+0000 7f5a057da700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.038+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f59fc07a660 con 0x7f5a00065690 2023-08-22T00:22:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.038+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:22:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.042+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59fc04b6d0 con 0x7f5a00065690 2023-08-22T00:22:44.067 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:44.066+0000 7f8552d29680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:22:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.239+0000 7f5a057da700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.239+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:22:44.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.247+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a000ab450 con 0x7f59e405ef50 2023-08-22T00:22:44.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.640+0000 7f5a057da700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:44.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:44.640+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:22:44.652 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:44.641+0000 7f7cd5eb8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:44.680 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:44.678+0000 7f8552d29680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:22:44.713 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:44.712+0000 7f7cd5eb8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:44.751 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:44.750+0000 7f8552d29680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:22:44.897 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:44.896+0000 7f7cd5eb8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:44.936 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:44.935+0000 7f8552d29680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:22:45.316 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.315+0000 7f7cd5eb8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:45.354 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:45.353+0000 7f8552d29680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:22:45.418 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.417+0000 7f7cd5eb8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:45.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:45.441+0000 7f5a057da700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:45.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:45.441+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:22:45.457 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:45.456+0000 7f8552d29680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:45.569 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.569+0000 7f7cd5eb8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:45.609 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:45.608+0000 7f8552d29680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:45.643 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.643+0000 7f7cd5eb8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:45.683 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:45.682+0000 7f8552d29680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:22:45.711 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.710+0000 7f7cd5eb8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:45.752 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:45.750+0000 7f8552d29680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:22:45.963 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:45.963+0000 7f7cd5eb8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:46.004 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:46.003+0000 7f8552d29680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:22:46.145 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:46.145+0000 7f7cd5eb8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:46.187 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:46.186+0000 7f8552d29680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:22:46.792 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:46.791+0000 7f7cd5eb8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:46.842 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:46.841+0000 7f8552d29680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:22:46.861 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:46.860+0000 7f7cd5eb8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:46.911 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:46.910+0000 7f8552d29680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:22:46.936 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:46.935+0000 7f7cd5eb8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:46.989 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:46.988+0000 7f8552d29680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:22:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.042+0000 7f5a057da700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:22:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.042+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:22:47.082 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.081+0000 7f7cd5eb8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:47.137 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.136+0000 7f8552d29680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:22:47.151 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.151+0000 7f7cd5eb8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:47.208 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.207+0000 7f8552d29680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:22:47.266 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.265+0000 7f7cd5eb8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:47.325 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.323+0000 7f8552d29680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:22:47.373 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.372+0000 7f7cd5eb8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:47.432 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.431+0000 7f8552d29680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:22:47.660 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.660+0000 7f7cd5eb8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:47.723 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.722+0000 7f8552d29680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:22:47.731 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:22:47.730+0000 7f7cd5eb8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:47.794 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.793+0000 7f8552d29680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:22:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.798+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 45) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f59fc078090 con 0x7f5a00065690 2023-08-22T00:22:47.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.812+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 46) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f59fc046cf0 con 0x7f5a00065690 2023-08-22T00:22:47.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.813+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:22:47.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:47.813+0000 7f59f5ffb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:22:47.876 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.875+0000 7f84cb7cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.875+0000 7f84cb7cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.875+0000 7f84cb7cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.875+0000 7f84cb7cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.875+0000 7f84cb7cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.876+0000 7f84cffd8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.876+0000 7f84cffd8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.876+0000 7f84cffd8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.876+0000 7f84cffd8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:47.878 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:22:47.876+0000 7f84cffd8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:22:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.816+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 47) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f59fc046840 con 0x7f5a00065690 2023-08-22T00:22:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.817+0000 7f59f5ffb700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.817+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f59e400dd10 con 0x7f59e405ef50 2023-08-22T00:22:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.817+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.820+0000 7f5a057da700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5a000c0e70 tx=0x7f59f0007d40).ready entity=mgr.7611 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:48.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.828+0000 7f59f5ffb700 1 -- 172.21.15.98:0/1460400410 <== mgr.7611 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f59e400dd10 con 0x7f59e405ef50 2023-08-22T00:22:48.831 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /bad-path 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.830+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 msgr2=0x7f59e4061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.830+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5a000c0e70 tx=0x7f59f0007d40).stop 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.830+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 msgr2=0x7f5a0014cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.830+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f59fc00e930 tx=0x7f59fc009060).stop 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.830+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 shutdown_connections 2023-08-22T00:22:48.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a00150750 0x7f5a000c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00065690 0x7f5a0014cb80 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f59e405ef50 0x7f59e4061390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 --2- 172.21.15.98:0/1460400410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a00065fa0 0x7f5a0014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 >> 172.21.15.98:0/1460400410 conn(0x7f5a0006a930 msgr2=0x7f5a0005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 shutdown_connections 2023-08-22T00:22:48.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.831+0000 7f5a0823f700 1 -- 172.21.15.98:0/1460400410 wait complete. 2023-08-22T00:22:48.846 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-08-22T00:22:48.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-22T00:22:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.971+0000 7f85797d8700 1 Processor -- start 2023-08-22T00:22:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.971+0000 7f85797d8700 1 -- start start 2023-08-22T00:22:48.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85797d8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8574153ae0 0x7f85740c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85797d8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f85740c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85797d8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574155360 con 0x7f8574157fe0 2023-08-22T00:22:48.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85797d8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8574157b50 con 0x7f8574153ae0 2023-08-22T00:22:48.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85797d8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740c6390 con 0x7f85740bfd80 2023-08-22T00:22:48.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85737fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8574157fe0 0x7f85740645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46658/0 (socket says 172.21.15.98:46658) 2023-08-22T00:22:48.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85737fe700 1 -- 172.21.15.98:0/4163523463 learned_addr learned my addr 172.21.15.98:0/4163523463 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:22:48.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> v2:172.21.15.118:3300/0 conn(0x7f8574153ae0 0x7f85740c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f85727fc700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f85740c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820955369 0 0) 0x7f856c001490 con 0x7f8574157fe0 2023-08-22T00:22:48.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.972+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855c0033f0 con 0x7f8574157fe0 2023-08-22T00:22:48.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411112153 0 0) 0x7f855c0033f0 con 0x7f8574157fe0 2023-08-22T00:22:48.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 msgr2=0x7f85740c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:48.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f85740c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 >> v2:172.21.15.118:3300/0 conn(0x7f8574153ae0 msgr2=0x7f85740c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:48.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 --2- 172.21.15.98:0/4163523463 >> v2:172.21.15.118:3300/0 conn(0x7f8574153ae0 0x7f85740c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574154ac0 con 0x7f8574157fe0 2023-08-22T00:22:48.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f856c001980 con 0x7f8574157fe0 2023-08-22T00:22:48.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 >> v1:172.21.15.98:6789/0 conn(0x7f8574157fe0 legacy=0x7f85740645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f855c0038e0 0x7f855c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f855c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f855c004b80 0x7f855c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574157b50 con 0x7f855c0038e0 2023-08-22T00:22:48.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740c6390 con 0x7f855c004b80 2023-08-22T00:22:48.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c00b8e0 con 0x7f85740bfd80 2023-08-22T00:22:48.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> v2:172.21.15.118:3300/0 conn(0x7f8574153ae0 0x7f85740c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:48.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f85727fc700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f855c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f855c0038e0 0x7f855c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f85737fe700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f855c004b80 0x7f855c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 -- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 msgr2=0x7f855c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:48.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f855c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 -- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f855c004b80 msgr2=0x7f855c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f855c004b80 0x7f855c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 -- 172.21.15.98:0/4163523463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0033f0 con 0x7f855c0038e0 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f85727fc700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85740bfd80 0x7f855c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8572ffd700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f855c0038e0 0x7f855c003d00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f8568009c30 tx=0x7f8568009060).ready entity=mon.0 client_cookie=f90b4dfe463198a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.973+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680095c0 con 0x7f855c0038e0 2023-08-22T00:22:48.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800e710 con 0x7f855c0038e0 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f8571ffb700 1 -- 172.21.15.98:0/4163523463 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800ea90 con 0x7f855c0038e0 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 -- 172.21.15.98:0/4163523463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f855c0038e0 msgr2=0x7f855c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 --2- 172.21.15.98:0/4163523463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f855c0038e0 0x7f855c003d00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f8568009c30 tx=0x7f8568009060).stop 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85737fe700 1 -- 172.21.15.98:0/4163523463 reap_dead start 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 -- 172.21.15.98:0/4163523463 shutdown_connections 2023-08-22T00:22:48.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 -- 172.21.15.98:0/4163523463 >> 172.21.15.98:0/4163523463 conn(0x7f85740caa50 msgr2=0x7f85740cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 -- 172.21.15.98:0/4163523463 shutdown_connections 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.974+0000 7f85797d8700 1 -- 172.21.15.98:0/4163523463 wait complete. 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.975+0000 7f85797d8700 1 Processor -- start 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.975+0000 7f85797d8700 1 -- start start 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f855c0038e0 0x7f85740ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740afb00 0x7f85740c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740ada00 con 0x7f857414b4f0 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740ae2a0 con 0x7f85740afb00 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85797d8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740b00b0 con 0x7f855c0038e0 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43588/0 (socket says 172.21.15.98:43588) 2023-08-22T00:22:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 -- 172.21.15.98:0/987583786 learned_addr learned my addr 172.21.15.98:0/987583786 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:22:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f8572ffd700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f855c0038e0 0x7f85740ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85737fe700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740afb00 0x7f85740c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 -- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f855c0038e0 msgr2=0x7f85740ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f855c0038e0 0x7f85740ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 -- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740afb00 msgr2=0x7f85740c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740afb00 0x7f85740c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.976+0000 7f85727fc700 1 -- 172.21.15.98:0/987583786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85740adc50 con 0x7f857414b4f0 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f85727fc700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f8564011d70 tx=0x7f8564009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400fa10 con 0x7f857414b4f0 2023-08-22T00:22:48.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400fb70 con 0x7f857414b4f0 2023-08-22T00:22:48.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85740adf30 con 0x7f857414b4f0 2023-08-22T00:22:48.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564014440 con 0x7f857414b4f0 2023-08-22T00:22:48.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.977+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857414dae0 con 0x7f857414b4f0 2023-08-22T00:22:48.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.978+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8574047480 con 0x7f857414b4f0 2023-08-22T00:22:48.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.978+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 47) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f85640147f0 con 0x7f857414b4f0 2023-08-22T00:22:48.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.978+0000 7f855affd700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 0x7f8560061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:22:48.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.978+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f856407a890 con 0x7f857414b4f0 2023-08-22T00:22:48.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.979+0000 7f8572ffd700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 0x7f8560061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:22:48.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.979+0000 7f8572ffd700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 0x7f8560061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f85680099f0 tx=0x7f8568019000).ready entity=mgr.7611 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:22:48.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:48.983+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f856404bc70 con 0x7f857414b4f0 2023-08-22T00:22:49.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.166+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8574154da0 con 0x7f856005ed40 2023-08-22T00:22:49.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.168+0000 7f855affd700 1 -- 172.21.15.98:0/987583786 <== mgr.7611 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f8574154da0 con 0x7f856005ed40 2023-08-22T00:22:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:22:49.170 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:22:48", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-22T00:22:49.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 msgr2=0x7f8560061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 0x7f8560061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f85680099f0 tx=0x7f8568019000).stop 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 msgr2=0x7f85740af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f8564011d70 tx=0x7f8564009060).stop 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 shutdown_connections 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f856005ed40 0x7f8560061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f855c0038e0 0x7f85740ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:49.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740afb00 0x7f85740c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:49.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 --2- 172.21.15.98:0/987583786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f857414b4f0 0x7f85740af610 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:22:49.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 >> 172.21.15.98:0/987583786 conn(0x7f85740caa50 msgr2=0x7f8574152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:22:49.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 shutdown_connections 2023-08-22T00:22:49.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:22:49.170+0000 7f85797d8700 1 -- 172.21.15.98:0/987583786 wait complete. 2023-08-22T00:22:49.184 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:22:48", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-22T00:22:50.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:22:50.760 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:23:00.834 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:00.833+0000 7f84bffb8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:00.834 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:00.833+0000 7f84bffb8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:00.835 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:00.833+0000 7f84bffb8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:00.835 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:00.833+0000 7f84bffb8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:00.835 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:00.833+0000 7f84bffb8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:20.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:23:20.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:23:49.186 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-22T00:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.319+0000 7f91b6a63700 1 Processor -- start 2023-08-22T00:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.319+0000 7f91b6a63700 1 -- start start 2023-08-22T00:23:49.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91b6a63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 0x7f91b00c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91b6a63700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 0x7f91b0155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91b6a63700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00be430 con 0x7f91b0154bf0 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91b6a63700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00bd890 con 0x7f91b00aafa0 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91b6a63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00c38a0 con 0x7f91b014aed0 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91af7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f91b0154bf0 0x7f91b00aa890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:41726/0 (socket says 172.21.15.98:41726) 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.320+0000 7f91af7fe700 1 -- 172.21.15.98:0/2501682102 learned_addr learned my addr 172.21.15.98:0/2501682102 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:49.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 --2- 172.21.15.98:0/2501682102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 0x7f91b00c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91b5000700 1 --2- 172.21.15.98:0/2501682102 >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 0x7f91b0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614740188 0 0) 0x7f91b00be430 con 0x7f91b0154bf0 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91980033f0 con 0x7f91b0154bf0 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895998419 0 0) 0x7f91980033f0 con 0x7f91b0154bf0 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 -- 172.21.15.98:0/2501682102 >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 msgr2=0x7f91b0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 --2- 172.21.15.98:0/2501682102 >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 0x7f91b0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 -- 172.21.15.98:0/2501682102 >> v1:172.21.15.98:6789/0 conn(0x7f91b0154bf0 legacy=0x7f91b00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 -- 172.21.15.98:0/2501682102 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00bdb00 con 0x7f91b014aed0 2023-08-22T00:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91b5000700 1 --2- 172.21.15.98:0/2501682102 >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 0x7f91b0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91affff700 1 --2- 172.21.15.98:0/2501682102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 0x7f91b00c33b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4009060).ready entity=mon.2 client_cookie=58ee61df30ff0aed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0001470 con 0x7f91b014aed0 2023-08-22T00:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4011400 con 0x7f91b014aed0 2023-08-22T00:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.321+0000 7f91aeffd700 1 -- 172.21.15.98:0/2501682102 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4011780 con 0x7f91b014aed0 2023-08-22T00:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 -- 172.21.15.98:0/2501682102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 msgr2=0x7f91b00c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 --2- 172.21.15.98:0/2501682102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 0x7f91b00c33b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4009060).stop 2023-08-22T00:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 -- 172.21.15.98:0/2501682102 shutdown_connections 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 --2- 172.21.15.98:0/2501682102 >> v2:172.21.15.118:3300/0 conn(0x7f91b00aafa0 0x7f91b0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 --2- 172.21.15.98:0/2501682102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b014aed0 0x7f91b00c33b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 -- 172.21.15.98:0/2501682102 >> 172.21.15.98:0/2501682102 conn(0x7f91b00c5330 msgr2=0x7f91b00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 -- 172.21.15.98:0/2501682102 shutdown_connections 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.322+0000 7f91b6a63700 1 -- 172.21.15.98:0/2501682102 wait complete. 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.323+0000 7f91b6a63700 1 Processor -- start 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.323+0000 7f91b6a63700 1 -- start start 2023-08-22T00:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 0x7f91b013d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b0154bf0 0x7f91b0064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0067710 con 0x7f91b014aed0 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0066b00 con 0x7f91b00aafa0 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b6a63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0066de0 con 0x7f91b0154bf0 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91af7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91af7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48982/0 (socket says 172.21.15.98:48982) 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91af7fe700 1 -- 172.21.15.98:0/333299689 learned_addr learned my addr 172.21.15.98:0/333299689 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91b5000700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b0154bf0 0x7f91b0064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91affff700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 0x7f91b013d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91af7fe700 1 -- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b0154bf0 msgr2=0x7f91b0064490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.324+0000 7f91af7fe700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b0154bf0 0x7f91b0064490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91af7fe700 1 -- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 msgr2=0x7f91b013d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91af7fe700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 0x7f91b013d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91af7fe700 1 -- 172.21.15.98:0/333299689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009a20 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91affff700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 0x7f91b013d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91af7fe700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f91a00011e0 tx=0x7f91a0001940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0007320 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00074a0 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a40092a0 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00059f0 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.325+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b00673a0 con 0x7f91b014aed0 2023-08-22T00:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.326+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b0047480 con 0x7f91b014aed0 2023-08-22T00:23:49.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.326+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 49) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f91a0013410 con 0x7f91b014aed0 2023-08-22T00:23:49.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.326+0000 7f9197fff700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 0x7f919c061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.327+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f91a007a540 con 0x7f91b014aed0 2023-08-22T00:23:49.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.327+0000 7f91affff700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 0x7f919c061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.327+0000 7f91affff700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 0x7f919c061560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4016000).ready entity=mgr.7611 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.331+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91a004b380 con 0x7f91b014aed0 2023-08-22T00:23:49.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.518+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91b0067850 con 0x7f919c05f0a0 2023-08-22T00:23:49.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.520+0000 7f9197fff700 1 -- 172.21.15.98:0/333299689 <== mgr.7611 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f91b0067850 con 0x7f919c05f0a0 2023-08-22T00:23:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:49.522 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:22:48", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-22T00:23:49.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 msgr2=0x7f919c061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 0x7f919c061560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4016000).stop 2023-08-22T00:23:49.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 msgr2=0x7f91b0063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f91a00011e0 tx=0x7f91a0001940).stop 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 shutdown_connections 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f919c05f0a0 0x7f919c061560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91b0154bf0 0x7f91b0064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.521+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91b00aafa0 0x7f91b013d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.522+0000 7f91b6a63700 1 --2- 172.21.15.98:0/333299689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b014aed0 0x7f91b0063fa0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.522+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 >> 172.21.15.98:0/333299689 conn(0x7f91b00c5330 msgr2=0x7f91b01497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:49.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.522+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 shutdown_connections 2023-08-22T00:23:49.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.522+0000 7f91b6a63700 1 -- 172.21.15.98:0/333299689 wait complete. 2023-08-22T00:23:49.534 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:22:48", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-22T00:23:49.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-08-22T00:23:49.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.655+0000 7f02ac278700 1 Processor -- start 2023-08-22T00:23:49.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.655+0000 7f02ac278700 1 -- start start 2023-08-22T00:23:49.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02ac278700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f02a4153c80 0x7f02a41540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02ac278700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a4062600 con 0x7f02a4154830 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02ac278700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a41545e0 con 0x7f02a40a5910 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02ac278700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a4062f10 con 0x7f02a4153c80 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02aa815700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f02a4153c80 0x7f02a41540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9813700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f02a4154830 0x7f02a40c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:41730/0 (socket says 172.21.15.98:41730) 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9813700 1 -- 172.21.15.98:0/2735162557 learned_addr learned my addr 172.21.15.98:0/2735162557 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:49.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02aa815700 1 -- 172.21.15.98:0/2735162557 >> v1:172.21.15.118:6789/0 conn(0x7f02a40a5910 legacy=0x7f02a40c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02aa815700 1 -- 172.21.15.98:0/2735162557 >> v1:172.21.15.98:6789/0 conn(0x7f02a4154830 legacy=0x7f02a40c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02aa815700 1 -- 172.21.15.98:0/2735162557 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40c2d30 con 0x7f02a4153c80 2023-08-22T00:23:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9012700 1 -- 172.21.15.98:0/2735162557 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508177267 0 0) 0x7f02a4062600 con 0x7f02a4154830 2023-08-22T00:23:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02aa815700 1 --2- 172.21.15.98:0/2735162557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4153c80 0x7f02a41540f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f029c009e60 tx=0x7f029c009780).ready entity=mon.0 client_cookie=4c3088ab5bf898d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9012700 1 -- 172.21.15.98:0/2735162557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c00e070 con 0x7f02a4153c80 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9012700 1 -- 172.21.15.98:0/2735162557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c00bc30 con 0x7f02a4153c80 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.656+0000 7f02a9012700 1 -- 172.21.15.98:0/2735162557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c012410 con 0x7f02a4153c80 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 -- 172.21.15.98:0/2735162557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4153c80 msgr2=0x7f02a41540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 --2- 172.21.15.98:0/2735162557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4153c80 0x7f02a41540f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f029c009e60 tx=0x7f029c009780).stop 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 -- 172.21.15.98:0/2735162557 shutdown_connections 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 --2- 172.21.15.98:0/2735162557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4153c80 0x7f02a41540f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 -- 172.21.15.98:0/2735162557 >> 172.21.15.98:0/2735162557 conn(0x7f02a40c7170 msgr2=0x7f02a40c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:49.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 -- 172.21.15.98:0/2735162557 shutdown_connections 2023-08-22T00:23:49.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.657+0000 7f02ac278700 1 -- 172.21.15.98:0/2735162557 wait complete. 2023-08-22T00:23:49.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.658+0000 7f02ac278700 1 Processor -- start 2023-08-22T00:23:49.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.658+0000 7f02ac278700 1 -- start start 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 0x7f02a40bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02a4154830 0x7f02a40bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40c04c0 con 0x7f02a40a5910 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40bf8b0 con 0x7f02a4153c80 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40bfb90 con 0x7f02a4154830 2023-08-22T00:23:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48998/0 (socket says 172.21.15.98:48998) 2023-08-22T00:23:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 -- 172.21.15.98:0/3969706599 learned_addr learned my addr 172.21.15.98:0/3969706599 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02a9813700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 0x7f02a40bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa815700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02a4154830 0x7f02a40bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 -- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02a4154830 msgr2=0x7f02a40bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02a4154830 0x7f02a40bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 -- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 msgr2=0x7f02a40bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 0x7f02a40bed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 -- 172.21.15.98:0/3969706599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c009a20 con 0x7f02a40a5910 2023-08-22T00:23:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02a9813700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 0x7f02a40bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:49.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02aa014700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f02a000c490 tx=0x7f02a0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000f470 con 0x7f02a40a5910 2023-08-22T00:23:49.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a000f5d0 con 0x7f02a40a5910 2023-08-22T00:23:49.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a40bfe70 con 0x7f02a40a5910 2023-08-22T00:23:49.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000f950 con 0x7f02a40a5910 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.659+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a40ab640 con 0x7f02a40a5910 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.660+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4047480 con 0x7f02a40a5910 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.661+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 49) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f02a000fd40 con 0x7f02a40a5910 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.661+0000 7f029a7fc700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 0x7f0288061590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.661+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f02a0079a10 con 0x7f02a40a5910 2023-08-22T00:23:49.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.661+0000 7f02a9813700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 0x7f0288061590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.662+0000 7f02a9813700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 0x7f0288061590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f02a4152ee0 tx=0x7f0294009040).ready entity=mgr.7611 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.665+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f02a00488f0 con 0x7f02a40a5910 2023-08-22T00:23:49.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.848+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f02a40c0600 con 0x7f028805f0d0 2023-08-22T00:23:49.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.852+0000 7f029a7fc700 1 -- 172.21.15.98:0/3969706599 <== mgr.7611 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f02940012d0 con 0x7f028805f0d0 2023-08-22T00:23:49.853 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /bad-path 2023-08-22T00:23:49.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 msgr2=0x7f0288061590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 0x7f0288061590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f02a4152ee0 tx=0x7f0294009040).stop 2023-08-22T00:23:49.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 msgr2=0x7f02a40ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f02a000c490 tx=0x7f02a0007de0).stop 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 shutdown_connections 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f028805f0d0 0x7f0288061590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02a4154830 0x7f02a40bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a40a5910 0x7f02a40ab150 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 --2- 172.21.15.98:0/3969706599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a4153c80 0x7f02a40bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 >> 172.21.15.98:0/3969706599 conn(0x7f02a40c7170 msgr2=0x7f02a40ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 shutdown_connections 2023-08-22T00:23:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.854+0000 7f02ac278700 1 -- 172.21.15.98:0/3969706599 wait complete. 2023-08-22T00:23:49.866 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-08-22T00:23:49.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:23:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.983+0000 7ff1caf2a700 1 Processor -- start 2023-08-22T00:23:49.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.983+0000 7ff1caf2a700 1 -- start start 2023-08-22T00:23:49.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1caf2a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1caf2a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c41578b0 0x7ff1c4157d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:49.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1caf2a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c40c6330 con 0x7ff1c40acee0 2023-08-22T00:23:49.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1caf2a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c4158230 con 0x7ff1c41578b0 2023-08-22T00:23:49.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1caf2a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c41541e0 con 0x7ff1c40c8ef0 2023-08-22T00:23:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.984+0000 7ff1c94c7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c41578b0 0x7ff1c4157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c41578b0 0x7ff1c4157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49012/0 (socket says 172.21.15.98:49012) 2023-08-22T00:23:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 -- 172.21.15.98:0/1854274510 learned_addr learned my addr 172.21.15.98:0/1854274510 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c3fff700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 -- 172.21.15.98:0/1854274510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 msgr2=0x7ff1c40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 -- 172.21.15.98:0/1854274510 >> v1:172.21.15.118:6789/0 conn(0x7ff1c40acee0 legacy=0x7ff1c40c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:49.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 -- 172.21.15.98:0/1854274510 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c40c9420 con 0x7ff1c41578b0 2023-08-22T00:23:49.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c94c7700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c4157d40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7ff1bc009f20 tx=0x7ff1bc009840).ready entity=mon.0 client_cookie=dcd8755b9aa3739e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:49.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c37fe700 1 -- 172.21.15.98:0/1854274510 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00e070 con 0x7ff1c41578b0 2023-08-22T00:23:49.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c37fe700 1 -- 172.21.15.98:0/1854274510 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00ba80 con 0x7ff1c41578b0 2023-08-22T00:23:49.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.985+0000 7ff1c37fe700 1 -- 172.21.15.98:0/1854274510 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00be00 con 0x7ff1c41578b0 2023-08-22T00:23:49.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 -- 172.21.15.98:0/1854274510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 msgr2=0x7ff1c4157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:49.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c4157d40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7ff1bc009f20 tx=0x7ff1bc009840).stop 2023-08-22T00:23:49.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 -- 172.21.15.98:0/1854274510 shutdown_connections 2023-08-22T00:23:49.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c4157d40 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/1854274510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:49.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 -- 172.21.15.98:0/1854274510 >> 172.21.15.98:0/1854274510 conn(0x7ff1c40cb600 msgr2=0x7ff1c40c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:49.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 -- 172.21.15.98:0/1854274510 shutdown_connections 2023-08-22T00:23:49.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.986+0000 7ff1caf2a700 1 -- 172.21.15.98:0/1854274510 wait complete. 2023-08-22T00:23:50.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.987+0000 7ff1caf2a700 1 Processor -- start 2023-08-22T00:23:50.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.987+0000 7ff1caf2a700 1 -- start start 2023-08-22T00:23:50.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40acee0 0x7ff1c4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40c2620 con 0x7ff1c41578b0 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40c2900 con 0x7ff1c40acee0 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40c2be0 con 0x7ff1c40c8ef0 2023-08-22T00:23:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49016/0 (socket says 172.21.15.98:49016) 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 -- 172.21.15.98:0/4269439851 learned_addr learned my addr 172.21.15.98:0/4269439851 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 -- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 msgr2=0x7ff1c40c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 -- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40acee0 msgr2=0x7ff1c4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c8cc6700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40acee0 0x7ff1c4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40acee0 0x7ff1c4151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 -- 172.21.15.98:0/4269439851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009ae0 con 0x7ff1c41578b0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c94c7700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7ff1bc00b6c0 tx=0x7ff1bc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc01d460 con 0x7ff1c41578b0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc01d5c0 con 0x7ff1c41578b0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c40c2ec0 con 0x7ff1c41578b0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc01d980 con 0x7ff1c41578b0 2023-08-22T00:23:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.988+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c4152050 con 0x7ff1c41578b0 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.989+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c40c33e0 con 0x7ff1c41578b0 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.990+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 49) v1 ==== 75505+0+0 (secure 0 0 0) 0x7ff1bc003040 con 0x7ff1c41578b0 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.990+0000 7ff1c0ff9700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 0x7ff1a8061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.990+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7ff1bc07ba50 con 0x7ff1c41578b0 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.990+0000 7ff1c8cc6700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 0x7ff1a8061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.990+0000 7ff1c8cc6700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 0x7ff1a8061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff1b8001600 tx=0x7ff1b8009040).ready entity=mgr.7611 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:50.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:49.994+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1c40c33e0 con 0x7ff1c41578b0 2023-08-22T00:23:50.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.199+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff1c40c33e0 con 0x7ff1c41578b0 2023-08-22T00:23:50.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.417+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7ff1bc079140 con 0x7ff1c41578b0 2023-08-22T00:23:50.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.417+0000 7ff1c0ff9700 1 -- 172.21.15.98:0/4269439851 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v50) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff1bc042820 con 0x7ff1c41578b0 2023-08-22T00:23:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.419+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 msgr2=0x7ff1a8061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.419+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 0x7ff1a8061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff1b8001600 tx=0x7ff1b8009040).stop 2023-08-22T00:23:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 msgr2=0x7ff1c40c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7ff1bc00b6c0 tx=0x7ff1bc009840).stop 2023-08-22T00:23:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 shutdown_connections 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c41578b0 0x7ff1c40c36c0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40acee0 0x7ff1c4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1a805f0a0 0x7ff1a8061560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 --2- 172.21.15.98:0/4269439851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c40c8ef0 0x7ff1c40c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 >> 172.21.15.98:0/4269439851 conn(0x7ff1c40cb600 msgr2=0x7ff1c41528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 shutdown_connections 2023-08-22T00:23:50.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.420+0000 7ff1caf2a700 1 -- 172.21.15.98:0/4269439851 wait complete. 2023-08-22T00:23:50.434 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:23:50.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:23:50.478 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:23:50.527 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:23:50.527 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:23:50.528 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:23:50.528 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:23:50.564 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:50.562+0000 7fe755277680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:23:50.565 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:50.564+0000 7f0b97baa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:23:50.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[156014]: fuse finished with error 0 and tester_r 0 2023-08-22T00:23:50.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:23:50.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:23:50.573 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:23:50.627 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:50.626+0000 7fe755277680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:23:50.634 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:50.633+0000 7f0b97baa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:23:50.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:23:50.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:23:50.652 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:23:50.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:23:50.670 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:23:50.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:23:50.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:23:50.671 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:23:50.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:23:50.710 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:23:50.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:23:50.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:23:50.711 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:23:50.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:23:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:23:50.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:23:50.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.868+0000 7fbf0fe6d700 1 Processor -- start 2023-08-22T00:23:50.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.868+0000 7fbf0fe6d700 1 -- start start 2023-08-22T00:23:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0fe6d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf0814bf70 0x7fbf08152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0fe6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf081556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0fe6d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf08153080 con 0x7fbf0814c350 2023-08-22T00:23:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0fe6d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf08066510 con 0x7fbf0814bf70 2023-08-22T00:23:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0fe6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080667b0 con 0x7fbf080c3e50 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0dc09700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf0814bf70 0x7fbf08152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0dc09700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf0814bf70 0x7fbf08152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48648/0 (socket says 172.21.15.98:48648) 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0dc09700 1 -- 172.21.15.98:0/382850277 learned_addr learned my addr 172.21.15.98:0/382850277 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.869+0000 7fbf0e40a700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf081556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0dc09700 1 -- 172.21.15.98:0/382850277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 msgr2=0x7fbf081556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0dc09700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf081556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0dc09700 1 -- 172.21.15.98:0/382850277 >> v1:172.21.15.118:6789/0 conn(0x7fbf0814c350 legacy=0x7fbf080c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0dc09700 1 -- 172.21.15.98:0/382850277 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08155ba0 con 0x7fbf0814bf70 2023-08-22T00:23:50.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0dc09700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf08152b90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fbf04006fd0 tx=0x7fbf040090f0).ready entity=mon.0 client_cookie=6db01880d172d10c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:50.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0cc07700 1 -- 172.21.15.98:0/382850277 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400b580 con 0x7fbf0814bf70 2023-08-22T00:23:50.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0cc07700 1 -- 172.21.15.98:0/382850277 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400b6e0 con 0x7fbf0814bf70 2023-08-22T00:23:50.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0cc07700 1 -- 172.21.15.98:0/382850277 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ba60 con 0x7fbf0814bf70 2023-08-22T00:23:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/382850277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 msgr2=0x7fbf08152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf08152b90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fbf04006fd0 tx=0x7fbf040090f0).stop 2023-08-22T00:23:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.870+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/382850277 shutdown_connections 2023-08-22T00:23:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.871+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf081556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.871+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/382850277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf08152b90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.871+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/382850277 >> 172.21.15.98:0/382850277 conn(0x7fbf080c5dc0 msgr2=0x7fbf08068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.871+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/382850277 shutdown_connections 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.871+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/382850277 wait complete. 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 Processor -- start 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 -- start start 2023-08-22T00:23:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf080aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf0814c350 0x7fbf08149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080a8e50 con 0x7fbf0814bf70 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080c1fe0 con 0x7fbf0814c350 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.872+0000 7fbf0fe6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080c22c0 con 0x7fbf080c3e50 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48664/0 (socket says 172.21.15.98:48664) 2023-08-22T00:23:50.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 -- 172.21.15.98:0/3373617115 learned_addr learned my addr 172.21.15.98:0/3373617115 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0e40a700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf0814c350 0x7fbf08149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0dc09700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf080aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 msgr2=0x7fbf080aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf080aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf0814c350 msgr2=0x7fbf08149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf0814c350 0x7fbf08149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 -- 172.21.15.98:0/3373617115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009370 con 0x7fbf0814bf70 2023-08-22T00:23:50.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0d408700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fbef800c440 tx=0x7fbef8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:50.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8007020 con 0x7fbf0814bf70 2023-08-22T00:23:50.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8007180 con 0x7fbf0814bf70 2023-08-22T00:23:50.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf080c25a0 con 0x7fbf0814bf70 2023-08-22T00:23:50.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8007520 con 0x7fbf0814bf70 2023-08-22T00:23:50.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.873+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf080a9340 con 0x7fbf0814bf70 2023-08-22T00:23:50.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.874+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf08047480 con 0x7fbf0814bf70 2023-08-22T00:23:50.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.875+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fbef80068b0 con 0x7fbf0814bf70 2023-08-22T00:23:50.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.875+0000 7fbefdffb700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 0x7fbeec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:50.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.875+0000 7fbf0dc09700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 msgr2=0x7fbeec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:50.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.875+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fbef8079d30 con 0x7fbf0814bf70 2023-08-22T00:23:50.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.875+0000 7fbf0dc09700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 0x7fbeec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:50.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:50.883+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbef804abd0 con 0x7fbf0814bf70 2023-08-22T00:23:50.903 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:50.902+0000 7fe755277680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:23:50.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:23:50.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:23:50.926 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:50.926+0000 7f0b97baa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:23:51.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.076+0000 7fbf0dc09700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 msgr2=0x7fbeec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:51.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.076+0000 7fbf0dc09700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 0x7fbeec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:23:51.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.099+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf08155e00 con 0x7fbf0814bf70 2023-08-22T00:23:51.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.100+0000 7fbefdffb700 1 -- 172.21.15.98:0/3373617115 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fbef804e1f0 con 0x7fbf0814bf70 2023-08-22T00:23:51.101 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:51.102 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:23:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 msgr2=0x7fbeec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 0x7fbeec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 msgr2=0x7fbf080bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fbef800c440 tx=0x7fbef8007dd0).stop 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 shutdown_connections 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbeec05f050 0x7fbeec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf080c3e50 0x7fbf080aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf0814c350 0x7fbf08149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 --2- 172.21.15.98:0/3373617115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0814bf70 0x7fbf080bf900 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 >> 172.21.15.98:0/3373617115 conn(0x7fbf080c5dc0 msgr2=0x7fbf08149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 shutdown_connections 2023-08-22T00:23:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.102+0000 7fbf0fe6d700 1 -- 172.21.15.98:0/3373617115 wait complete. 2023-08-22T00:23:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:23:51.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:23:51.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.233+0000 7f6db9029700 1 Processor -- start 2023-08-22T00:23:51.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.233+0000 7f6db9029700 1 -- start start 2023-08-22T00:23:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db9029700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 0x7f6db40c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db9029700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6db4065f10 0x7f6db40663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db9029700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40bd3e0 con 0x7f6db4150e40 2023-08-22T00:23:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db9029700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db4066890 con 0x7f6db4065f10 2023-08-22T00:23:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db9029700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40bd0c0 con 0x7f6db40bd870 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db2d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6db4150e40 0x7f6db40a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48018/0 (socket says 172.21.15.98:48018) 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db2d9d700 1 -- 172.21.15.98:0/3840272192 learned_addr learned my addr 172.21.15.98:0/3840272192 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db259c700 1 --2- 172.21.15.98:0/3840272192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 0x7f6db40c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.234+0000 7f6db359e700 1 --2- 172.21.15.98:0/3840272192 >> v2:172.21.15.118:3300/0 conn(0x7f6db4065f10 0x7f6db40663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db1d9b700 1 -- 172.21.15.98:0/3840272192 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008302734 0 0) 0x7f6db40bd3e0 con 0x7f6db4150e40 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db1d9b700 1 -- 172.21.15.98:0/3840272192 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d9c0033f0 con 0x7f6db4150e40 2023-08-22T00:23:51.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db259c700 1 -- 172.21.15.98:0/3840272192 >> v2:172.21.15.118:3300/0 conn(0x7f6db4065f10 msgr2=0x7f6db40663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:51.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db259c700 1 --2- 172.21.15.98:0/3840272192 >> v2:172.21.15.118:3300/0 conn(0x7f6db4065f10 0x7f6db40663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db259c700 1 -- 172.21.15.98:0/3840272192 >> v1:172.21.15.98:6789/0 conn(0x7f6db4150e40 legacy=0x7f6db40a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db259c700 1 -- 172.21.15.98:0/3840272192 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40c3bb0 con 0x7f6db40bd870 2023-08-22T00:23:51.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db259c700 1 --2- 172.21.15.98:0/3840272192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 0x7f6db40c2050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6da8009760 tx=0x7f6da8009060).ready entity=mon.2 client_cookie=e4dc9c560bc8efc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db1d9b700 1 -- 172.21.15.98:0/3840272192 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80090d0 con 0x7f6db40bd870 2023-08-22T00:23:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db1d9b700 1 -- 172.21.15.98:0/3840272192 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800d4a0 con 0x7f6db40bd870 2023-08-22T00:23:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.235+0000 7f6db1d9b700 1 -- 172.21.15.98:0/3840272192 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800d820 con 0x7f6db40bd870 2023-08-22T00:23:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 -- 172.21.15.98:0/3840272192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 msgr2=0x7f6db40c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 --2- 172.21.15.98:0/3840272192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 0x7f6db40c2050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6da8009760 tx=0x7f6da8009060).stop 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 -- 172.21.15.98:0/3840272192 shutdown_connections 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 --2- 172.21.15.98:0/3840272192 >> v2:172.21.15.118:3300/0 conn(0x7f6db4065f10 0x7f6db40663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 --2- 172.21.15.98:0/3840272192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db40bd870 0x7f6db40c2050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 -- 172.21.15.98:0/3840272192 >> 172.21.15.98:0/3840272192 conn(0x7f6db406a980 msgr2=0x7f6db40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 -- 172.21.15.98:0/3840272192 shutdown_connections 2023-08-22T00:23:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.236+0000 7f6db9029700 1 -- 172.21.15.98:0/3840272192 wait complete. 2023-08-22T00:23:51.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.238+0000 7f6db9029700 1 Processor -- start 2023-08-22T00:23:51.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.238+0000 7f6db9029700 1 -- start start 2023-08-22T00:23:51.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db4065f10 0x7f6db413fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6db40bd870 0x7f6db40c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40c68b0 con 0x7f6db4150e40 2023-08-22T00:23:51.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4140220 con 0x7f6db40bd870 2023-08-22T00:23:51.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db9029700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40acab0 con 0x7f6db4065f10 2023-08-22T00:23:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48666/0 (socket says 172.21.15.98:48666) 2023-08-22T00:23:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db359e700 1 -- 172.21.15.98:0/4049129039 learned_addr learned my addr 172.21.15.98:0/4049129039 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:51.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db2d9d700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db4065f10 0x7f6db413fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.239+0000 7f6db259c700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6db40bd870 0x7f6db40c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 -- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db4065f10 msgr2=0x7f6db413fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db4065f10 0x7f6db413fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 -- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6db40bd870 msgr2=0x7f6db40c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6db40bd870 0x7f6db40c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 -- 172.21.15.98:0/4049129039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da80092a0 con 0x7f6db4150e40 2023-08-22T00:23:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db359e700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f6dac009df0 tx=0x7f6dac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00caa0 con 0x7f6db4150e40 2023-08-22T00:23:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db40acd90 con 0x7f6db4150e40 2023-08-22T00:23:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00f040 con 0x7f6db4150e40 2023-08-22T00:23:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00ce10 con 0x7f6db4150e40 2023-08-22T00:23:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.240+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db40ad350 con 0x7f6db4150e40 2023-08-22T00:23:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.241+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4047480 con 0x7f6db4150e40 2023-08-22T00:23:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.242+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f6dac013610 con 0x7f6db4150e40 2023-08-22T00:23:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.242+0000 7f6d9affd700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 0x7f6da0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.242+0000 7f6db2d9d700 1 -- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 msgr2=0x7f6da0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.242+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f6dac07acb0 con 0x7f6db4150e40 2023-08-22T00:23:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.242+0000 7f6db2d9d700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 0x7f6da0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.246+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dac04bb20 con 0x7f6db4150e40 2023-08-22T00:23:51.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.416+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6db4067da0 con 0x7f6db4150e40 2023-08-22T00:23:51.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.416+0000 7f6d9affd700 1 -- 172.21.15.98:0/4049129039 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17838 (secure 0 0 0) 0x7f6dac04f140 con 0x7f6db4150e40 2023-08-22T00:23:51.418 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:51.418 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":123,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:23:49.403528+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/1203952998":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/2488608596":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4058526191":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4074775334":"2023-08-23T00:22:47.807078+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:23:51.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 msgr2=0x7f6da0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:51.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 0x7f6da0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 msgr2=0x7f6db40c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f6dac009df0 tx=0x7f6dac00b040).stop 2023-08-22T00:23:51.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 shutdown_connections 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6da005f050 0x7f6da0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.418+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6db4065f10 0x7f6db413fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.419+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4150e40 0x7f6db40c63c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.419+0000 7f6db9029700 1 --2- 172.21.15.98:0/4049129039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6db40bd870 0x7f6db40c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.419+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 >> 172.21.15.98:0/4049129039 conn(0x7f6db406a980 msgr2=0x7f6db40a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.419+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 shutdown_connections 2023-08-22T00:23:51.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.419+0000 7f6db9029700 1 -- 172.21.15.98:0/4049129039 wait complete. 2023-08-22T00:23:51.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:22:29.447406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:22:29.849463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:23:51.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:23:51.523 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:51.521+0000 7fe755277680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:23:51.570 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:51.569+0000 7f0b97baa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:23:51.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.573+0000 7effc45d9700 1 Processor -- start 2023-08-22T00:23:51.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.573+0000 7effc45d9700 1 -- start start 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc45d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 0x7effbc067260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc45d9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effbc0c6120 0x7effbc063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc45d9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc064820 con 0x7effbc064390 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc45d9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc154e30 con 0x7effbc0c6120 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc45d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc062d10 con 0x7effbc0c5d40 2023-08-22T00:23:51.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effbc0c6120 0x7effbc063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc2375700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 0x7effbc067260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effbc0c6120 0x7effbc063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:41728/0 (socket says 172.21.15.98:41728) 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 -- 172.21.15.98:0/4118443294 learned_addr learned my addr 172.21.15.98:0/4118443294 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 -- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 msgr2=0x7effbc067260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 0x7effbc067260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 -- 172.21.15.98:0/4118443294 >> v1:172.21.15.118:6789/0 conn(0x7effbc064390 legacy=0x7effbc062600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 -- 172.21.15.98:0/4118443294 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc14ad80 con 0x7effbc0c6120 2023-08-22T00:23:51.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc2375700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 0x7effbc067260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:23:51.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.575+0000 7effc1b74700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c6120 0x7effbc063ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7effbc069210 tx=0x7effb80090f0).ready entity=mon.1 client_cookie=2712e684776d1b2e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.576+0000 7effc1373700 1 -- 172.21.15.98:0/4118443294 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800f510 con 0x7effbc0c6120 2023-08-22T00:23:51.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.576+0000 7effc1373700 1 -- 172.21.15.98:0/4118443294 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800f670 con 0x7effbc0c6120 2023-08-22T00:23:51.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.576+0000 7effc1373700 1 -- 172.21.15.98:0/4118443294 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800f9f0 con 0x7effbc0c6120 2023-08-22T00:23:51.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.576+0000 7effc45d9700 1 -- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c6120 msgr2=0x7effbc063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.576+0000 7effc45d9700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c6120 0x7effbc063ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7effbc069210 tx=0x7effb80090f0).stop 2023-08-22T00:23:51.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 -- 172.21.15.98:0/4118443294 shutdown_connections 2023-08-22T00:23:51.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc0c5d40 0x7effbc067260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 --2- 172.21.15.98:0/4118443294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c6120 0x7effbc063ea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 -- 172.21.15.98:0/4118443294 >> 172.21.15.98:0/4118443294 conn(0x7effbc0c3a60 msgr2=0x7effbc0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 -- 172.21.15.98:0/4118443294 shutdown_connections 2023-08-22T00:23:51.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.588+0000 7effc45d9700 1 -- 172.21.15.98:0/4118443294 wait complete. 2023-08-22T00:23:51.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.590+0000 7effc45d9700 1 Processor -- start 2023-08-22T00:23:51.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.590+0000 7effc45d9700 1 -- start start 2023-08-22T00:23:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc064390 0x7effbc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effbc0c6120 0x7effbc0bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0ac990 con 0x7effbc0c6120 2023-08-22T00:23:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc163b90 con 0x7effbc0c5d40 2023-08-22T00:23:51.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc45d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0a9f70 con 0x7effbc064390 2023-08-22T00:23:51.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc2b76700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effbc0c6120 0x7effbc0bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc1b74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc1b74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:41738/0 (socket says 172.21.15.98:41738) 2023-08-22T00:23:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc1b74700 1 -- 172.21.15.98:0/974278077 learned_addr learned my addr 172.21.15.98:0/974278077 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.591+0000 7effc2375700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc064390 0x7effbc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 -- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc064390 msgr2=0x7effbc1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc064390 0x7effbc1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 -- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effbc0c6120 msgr2=0x7effbc0bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effbc0c6120 0x7effbc0bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 -- 172.21.15.98:0/974278077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac00d740 con 0x7effbc0c5d40 2023-08-22T00:23:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc1b74700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7effb8011000 tx=0x7effb8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800fe80 con 0x7effbc0c5d40 2023-08-22T00:23:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb8009370 con 0x7effbc0c5d40 2023-08-22T00:23:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800f7e0 con 0x7effbc0c5d40 2023-08-22T00:23:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0aa510 con 0x7effbc0c5d40 2023-08-22T00:23:51.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.592+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb801b640 con 0x7effbc0c5d40 2023-08-22T00:23:51.601 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:51.594+0000 7fe755277680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:23:51.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.593+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa4005120 con 0x7effbc0c5d40 2023-08-22T00:23:51.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.593+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7effb801ba30 con 0x7effbc0c5d40 2023-08-22T00:23:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.594+0000 7effb27fc700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 0x7effa0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.594+0000 7effc2375700 1 -- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 msgr2=0x7effa0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.594+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7effb807b790 con 0x7effbc0c5d40 2023-08-22T00:23:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.594+0000 7effc2375700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 0x7effa0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:51.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.598+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7effb804c590 con 0x7effbc0c5d40 2023-08-22T00:23:51.646 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:51.645+0000 7f0b97baa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:23:51.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.765+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7effa4005850 con 0x7effbc0c5d40 2023-08-22T00:23:51.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.766+0000 7effb27fc700 1 -- 172.21.15.98:0/974278077 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v123) v1 ==== 110+0+10 (secure 0 0 0) 0x7effb801f0b0 con 0x7effbc0c5d40 2023-08-22T00:23:51.767 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:23:51.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 msgr2=0x7effa0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:51.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 0x7effa0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 msgr2=0x7effbc1607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7effb8011000 tx=0x7effb8017000).stop 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 shutdown_connections 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7effa005f050 0x7effa0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effbc064390 0x7effbc1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effbc0c6120 0x7effbc0bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 --2- 172.21.15.98:0/974278077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effbc0c5d40 0x7effbc1607c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 >> 172.21.15.98:0/974278077 conn(0x7effbc0c3a60 msgr2=0x7effbc062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 shutdown_connections 2023-08-22T00:23:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.768+0000 7effc45d9700 1 -- 172.21.15.98:0/974278077 wait complete. 2023-08-22T00:23:51.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:23:51.782 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:51.780+0000 7fe755277680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:23:51.842 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:51.841+0000 7f0b97baa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:23:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.901+0000 7f1df5060700 1 Processor -- start 2023-08-22T00:23:51.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.901+0000 7f1df5060700 1 -- start start 2023-08-22T00:23:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1df014ae70 0x7f1df00c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1df00c7370 0x7f1df00c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df014b250 0x7f1df00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df0066b90 con 0x7f1df00c7370 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df0151e80 con 0x7f1df014ae70 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1df5060700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0065560 con 0x7f1df014b250 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1dee59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1df00c7370 0x7f1df00c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1dee59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1df00c7370 0x7f1df00c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48694/0 (socket says 172.21.15.98:48694) 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.902+0000 7f1dee59c700 1 -- 172.21.15.98:0/1587945751 learned_addr learned my addr 172.21.15.98:0/1587945751 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:51.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1deed9d700 1 --2- 172.21.15.98:0/1587945751 >> v2:172.21.15.118:3300/0 conn(0x7f1df014ae70 0x7f1df00c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1def59e700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df014b250 0x7f1df00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 -- 172.21.15.98:0/1587945751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df014b250 msgr2=0x7f1df00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df014b250 0x7f1df00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 -- 172.21.15.98:0/1587945751 >> v2:172.21.15.118:3300/0 conn(0x7f1df014ae70 msgr2=0x7f1df00c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 --2- 172.21.15.98:0/1587945751 >> v2:172.21.15.118:3300/0 conn(0x7f1df014ae70 0x7f1df00c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 -- 172.21.15.98:0/1587945751 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0150fb0 con 0x7f1df00c7370 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dee59c700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df00c7370 0x7f1df00c3500 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f1df01511a0 tx=0x7f1de400b3b0).ready entity=mon.0 client_cookie=1c1148b27532b98a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dedd9b700 1 -- 172.21.15.98:0/1587945751 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400da40 con 0x7f1df00c7370 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dedd9b700 1 -- 172.21.15.98:0/1587945751 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de400dba0 con 0x7f1df00c7370 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.903+0000 7f1dedd9b700 1 -- 172.21.15.98:0/1587945751 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4010470 con 0x7f1df00c7370 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 -- 172.21.15.98:0/1587945751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df00c7370 msgr2=0x7f1df00c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df00c7370 0x7f1df00c3500 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f1df01511a0 tx=0x7f1de400b3b0).stop 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 -- 172.21.15.98:0/1587945751 shutdown_connections 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df014b250 0x7f1df00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 --2- 172.21.15.98:0/1587945751 >> v2:172.21.15.118:3300/0 conn(0x7f1df014ae70 0x7f1df00c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 --2- 172.21.15.98:0/1587945751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df00c7370 0x7f1df00c3500 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 -- 172.21.15.98:0/1587945751 >> 172.21.15.98:0/1587945751 conn(0x7f1df00c7800 msgr2=0x7f1df00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:51.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 -- 172.21.15.98:0/1587945751 shutdown_connections 2023-08-22T00:23:51.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.904+0000 7f1df5060700 1 -- 172.21.15.98:0/1587945751 wait complete. 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.905+0000 7f1df5060700 1 Processor -- start 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.905+0000 7f1df5060700 1 -- start start 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df00c7370 0x7f1df0163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df014b250 0x7f1df00c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00a38d0 con 0x7f1df014ae70 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00a3b70 con 0x7f1df014b250 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00a3e50 con 0x7f1df00c7370 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48710/0 (socket says 172.21.15.98:48710) 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 -- 172.21.15.98:0/3175074274 learned_addr learned my addr 172.21.15.98:0/3175074274 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1def59e700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df014b250 0x7f1df00c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1deed9d700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df00c7370 0x7f1df0163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 -- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df00c7370 msgr2=0x7f1df0163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df00c7370 0x7f1df0163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 -- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df014b250 msgr2=0x7f1df00c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df014b250 0x7f1df00c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 -- 172.21.15.98:0/3175074274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de400b610 con 0x7f1df014ae70 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dee59c700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f1df00c5310 tx=0x7f1de400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400be10 con 0x7f1df014ae70 2023-08-22T00:23:51.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4019450 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df00a4130 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40197f0 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.906+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df00a46f0 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df005e8b0 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f1de4019ba0 con 0x7f1df014ae70 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1dd6ffd700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 0x7f1ddc061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1deed9d700 1 -- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 msgr2=0x7f1ddc061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:51.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f1de407ba90 con 0x7f1df014ae70 2023-08-22T00:23:51.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.908+0000 7f1deed9d700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 0x7f1ddc061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:51.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:51.912+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1df005e8b0 con 0x7f1df014ae70 2023-08-22T00:23:52.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.078+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1df005e8b0 con 0x7f1df014ae70 2023-08-22T00:23:52.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.079+0000 7f1dd6ffd700 1 -- 172.21.15.98:0/3175074274 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1df005e8b0 con 0x7f1df014ae70 2023-08-22T00:23:52.080 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.080+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 msgr2=0x7f1ddc061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.080+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 0x7f1ddc061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.080+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 msgr2=0x7f1df00c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.080+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f1df00c5310 tx=0x7f1de400b3b0).stop 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 shutdown_connections 2023-08-22T00:23:52.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1ddc05f080 0x7f1ddc061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1df00c7370 0x7f1df0163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df014b250 0x7f1df00c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 --2- 172.21.15.98:0/3175074274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1df014ae70 0x7f1df00c0dc0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 >> 172.21.15.98:0/3175074274 conn(0x7f1df00c7800 msgr2=0x7f1df0148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 shutdown_connections 2023-08-22T00:23:52.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.081+0000 7f1df5060700 1 -- 172.21.15.98:0/3175074274 wait complete. 2023-08-22T00:23:52.094 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:23:52.202 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.200+0000 7fe755277680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:23:52.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.214+0000 7f5456d63700 1 Processor -- start 2023-08-22T00:23:52.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.214+0000 7f5456d63700 1 -- start start 2023-08-22T00:23:52.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5456d63700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f54501508b0 0x7f5450150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5456d63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 0x7f54500a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5456d63700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500654c0 con 0x7f54501550a0 2023-08-22T00:23:52.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5456d63700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54500be6e0 con 0x7f54501508b0 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5456d63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54500a70c0 con 0x7f54500a6740 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5454aff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f54501508b0 0x7f5450150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5454aff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f54501508b0 0x7f5450150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48724/0 (socket says 172.21.15.98:48724) 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5454aff700 1 -- 172.21.15.98:0/505176140 learned_addr learned my addr 172.21.15.98:0/505176140 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.215+0000 7f5455300700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 0x7f54500a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5454aff700 1 -- 172.21.15.98:0/505176140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 msgr2=0x7f54500a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5454aff700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 0x7f54500a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5454aff700 1 -- 172.21.15.98:0/505176140 >> v1:172.21.15.118:6789/0 conn(0x7f54501550a0 legacy=0x7f54500c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5454aff700 1 -- 172.21.15.98:0/505176140 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54500c3fb0 con 0x7f54501508b0 2023-08-22T00:23:52.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5455300700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 0x7f54500a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:52.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5454aff700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f5450150c90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f5444006fd0 tx=0x7f54440090f0).ready entity=mon.0 client_cookie=21847adbfb2abd46 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f544f7fe700 1 -- 172.21.15.98:0/505176140 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400b600 con 0x7f54501508b0 2023-08-22T00:23:52.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f544f7fe700 1 -- 172.21.15.98:0/505176140 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400b760 con 0x7f54501508b0 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f544f7fe700 1 -- 172.21.15.98:0/505176140 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400bb00 con 0x7f54501508b0 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5456d63700 1 -- 172.21.15.98:0/505176140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 msgr2=0x7f5450150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.216+0000 7f5456d63700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f5450150c90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f5444006fd0 tx=0x7f54440090f0).stop 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 -- 172.21.15.98:0/505176140 shutdown_connections 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54500a6740 0x7f54500a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 --2- 172.21.15.98:0/505176140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f5450150c90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 -- 172.21.15.98:0/505176140 >> 172.21.15.98:0/505176140 conn(0x7f54500c7820 msgr2=0x7f54500c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 -- 172.21.15.98:0/505176140 shutdown_connections 2023-08-22T00:23:52.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.217+0000 7f5456d63700 1 -- 172.21.15.98:0/505176140 wait complete. 2023-08-22T00:23:52.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.218+0000 7f5456d63700 1 Processor -- start 2023-08-22T00:23:52.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.218+0000 7f5456d63700 1 -- start start 2023-08-22T00:23:52.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f545014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54501550a0 0x7f545014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545014f480 con 0x7f54501508b0 2023-08-22T00:23:52.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545014b780 con 0x7f54500a6740 2023-08-22T00:23:52.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5456d63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545014b910 con 0x7f54501550a0 2023-08-22T00:23:52.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5454aff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5455300700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54501550a0 0x7f545014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5454aff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:41764/0 (socket says 172.21.15.98:41764) 2023-08-22T00:23:52.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f5454aff700 1 -- 172.21.15.98:0/1113969711 learned_addr learned my addr 172.21.15.98:0/1113969711 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:52.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.219+0000 7f544ffff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f545014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 -- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54501550a0 msgr2=0x7f545014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54501550a0 0x7f545014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 -- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 msgr2=0x7f545014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f545014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 -- 172.21.15.98:0/1113969711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009370 con 0x7f54500a6740 2023-08-22T00:23:52.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f544ffff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f545014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:23:52.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5454aff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f54500c36b0 tx=0x7f5444017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444006d90 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400bec0 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5450161900 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444002f30 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.220+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5450161ec0 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.221+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54500a6f30 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.221+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f5444021070 con 0x7f54500a6740 2023-08-22T00:23:52.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.222+0000 7f544cff9700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 0x7f5434061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.222+0000 7f544ffff700 1 -- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 msgr2=0x7f5434061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:52.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.222+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f544407be80 con 0x7f54500a6740 2023-08-22T00:23:52.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.222+0000 7f544ffff700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 0x7f5434061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:52.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.226+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f544404cd20 con 0x7f54500a6740 2023-08-22T00:23:52.285 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.283+0000 7f0b97baa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:23:52.307 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.305+0000 7fe755277680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:23:52.392 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.390+0000 7f0b97baa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:23:52.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.394+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54500be120 con 0x7f54500a6740 2023-08-22T00:23:52.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.394+0000 7f544cff9700 1 -- 172.21.15.98:0/1113969711 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5444050340 con 0x7f54500a6740 2023-08-22T00:23:52.395 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 msgr2=0x7f5434061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 0x7f5434061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 msgr2=0x7f54501612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f54500c36b0 tx=0x7f5444017000).stop 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 shutdown_connections 2023-08-22T00:23:52.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f543405f050 0x7f5434061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54501550a0 0x7f545014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54500a6740 0x7f54501612a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 --2- 172.21.15.98:0/1113969711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54501508b0 0x7f545014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 >> 172.21.15.98:0/1113969711 conn(0x7f54500c7820 msgr2=0x7f54500aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 shutdown_connections 2023-08-22T00:23:52.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.396+0000 7f5456d63700 1 -- 172.21.15.98:0/1113969711 wait complete. 2023-08-22T00:23:52.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:23:52.460 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.458+0000 7fe755277680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:23:52.535 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.533+0000 7fe755277680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:23:52.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.533+0000 7f492f0a7700 1 Processor -- start 2023-08-22T00:23:52.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.533+0000 7f492f0a7700 1 -- start start 2023-08-22T00:23:52.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492f0a7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f492814fd90 0x7f49280675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492f0a7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f49280c39d0 0x7f49280c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492f0a7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49281525d0 con 0x7f4928153010 2023-08-22T00:23:52.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492f0a7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4928152b80 con 0x7f49280c39d0 2023-08-22T00:23:52.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492f0a7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280c42f0 con 0x7f492814fd90 2023-08-22T00:23:52.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492d644700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f49280c39d0 0x7f49280c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492d644700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f49280c39d0 0x7f49280c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48740/0 (socket says 172.21.15.98:48740) 2023-08-22T00:23:52.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.534+0000 7f492d644700 1 -- 172.21.15.98:0/2660128359 learned_addr learned my addr 172.21.15.98:0/2660128359 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:52.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492ce43700 1 --2- 172.21.15.98:0/2660128359 >> v2:172.21.15.118:3300/0 conn(0x7f492814fd90 0x7f49280675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492d644700 1 -- 172.21.15.98:0/2660128359 >> v2:172.21.15.118:3300/0 conn(0x7f492814fd90 msgr2=0x7f49280675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:52.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492d644700 1 --2- 172.21.15.98:0/2660128359 >> v2:172.21.15.118:3300/0 conn(0x7f492814fd90 0x7f49280675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492d644700 1 -- 172.21.15.98:0/2660128359 >> v1:172.21.15.118:6789/0 conn(0x7f4928153010 legacy=0x7f49280a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492d644700 1 -- 172.21.15.98:0/2660128359 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928067bd0 con 0x7f49280c39d0 2023-08-22T00:23:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f492d644700 1 --2- 172.21.15.98:0/2660128359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49280c39d0 0x7f49280c3e00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4928069c80 tx=0x7f4920009840).ready entity=mon.0 client_cookie=c8f5ece4ef5307d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f49277fe700 1 -- 172.21.15.98:0/2660128359 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000e070 con 0x7f49280c39d0 2023-08-22T00:23:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f49277fe700 1 -- 172.21.15.98:0/2660128359 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000ba20 con 0x7f49280c39d0 2023-08-22T00:23:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.535+0000 7f49277fe700 1 -- 172.21.15.98:0/2660128359 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000bda0 con 0x7f49280c39d0 2023-08-22T00:23:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 -- 172.21.15.98:0/2660128359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49280c39d0 msgr2=0x7f49280c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 --2- 172.21.15.98:0/2660128359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49280c39d0 0x7f49280c3e00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4928069c80 tx=0x7f4920009840).stop 2023-08-22T00:23:52.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 -- 172.21.15.98:0/2660128359 shutdown_connections 2023-08-22T00:23:52.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 --2- 172.21.15.98:0/2660128359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49280c39d0 0x7f49280c3e00 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 --2- 172.21.15.98:0/2660128359 >> v2:172.21.15.118:3300/0 conn(0x7f492814fd90 0x7f49280675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 -- 172.21.15.98:0/2660128359 >> 172.21.15.98:0/2660128359 conn(0x7f49280c8950 msgr2=0x7f49280c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 -- 172.21.15.98:0/2660128359 shutdown_connections 2023-08-22T00:23:52.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.536+0000 7f492f0a7700 1 -- 172.21.15.98:0/2660128359 wait complete. 2023-08-22T00:23:52.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.537+0000 7f492f0a7700 1 Processor -- start 2023-08-22T00:23:52.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.537+0000 7f492f0a7700 1 -- start start 2023-08-22T00:23:52.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49280c39d0 0x7f49280ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492814fd90 0x7f49280adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492814c280 con 0x7f4928153010 2023-08-22T00:23:52.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492814c840 con 0x7f492814fd90 2023-08-22T00:23:52.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492f0a7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49280c0360 con 0x7f49280c39d0 2023-08-22T00:23:52.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48754/0 (socket says 172.21.15.98:48754) 2023-08-22T00:23:52.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 -- 172.21.15.98:0/534096557 learned_addr learned my addr 172.21.15.98:0/534096557 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:52.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f4927fff700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492814fd90 0x7f49280adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492ce43700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49280c39d0 0x7f49280ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 -- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49280c39d0 msgr2=0x7f49280ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49280c39d0 0x7f49280ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 -- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492814fd90 msgr2=0x7f49280adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492814fd90 0x7f49280adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.538+0000 7f492d644700 1 -- 172.21.15.98:0/534096557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920009ae0 con 0x7f4928153010 2023-08-22T00:23:52.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f492d644700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f492000b6c0 tx=0x7f4920009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200092e0 con 0x7f4928153010 2023-08-22T00:23:52.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492001e470 con 0x7f4928153010 2023-08-22T00:23:52.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492001e830 con 0x7f4928153010 2023-08-22T00:23:52.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49280c0640 con 0x7f4928153010 2023-08-22T00:23:52.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.539+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492814c4d0 con 0x7f4928153010 2023-08-22T00:23:52.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.540+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4928069d50 con 0x7f4928153010 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.541+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f4920003040 con 0x7f4928153010 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.541+0000 7f4924ff9700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 0x7f490c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.541+0000 7f492ce43700 1 -- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 msgr2=0x7f490c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.541+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f492007b9b0 con 0x7f4928153010 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.541+0000 7f492ce43700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 0x7f490c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:52.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.545+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f492004c740 con 0x7f4928153010 2023-08-22T00:23:52.558 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.555+0000 7f0b97baa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:23:52.602 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.601+0000 7fe755277680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:23:52.634 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.633+0000 7f0b97baa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:23:52.704 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.703+0000 7f0b97baa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:23:52.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.712+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4928067eb0 con 0x7f4928153010 2023-08-22T00:23:52.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.713+0000 7f4924ff9700 1 -- 172.21.15.98:0/534096557 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4920023070 con 0x7f4928153010 2023-08-22T00:23:52.714 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:23:52.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 msgr2=0x7f490c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:52.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 0x7f490c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 msgr2=0x7f4928149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f492000b6c0 tx=0x7f4920009840).stop 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 shutdown_connections 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f490c05f050 0x7f490c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49280c39d0 0x7f49280ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4928153010 0x7f4928149fb0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 --2- 172.21.15.98:0/534096557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492814fd90 0x7f49280adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 >> 172.21.15.98:0/534096557 conn(0x7f49280c8950 msgr2=0x7f49280c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 shutdown_connections 2023-08-22T00:23:52.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.715+0000 7f492f0a7700 1 -- 172.21.15.98:0/534096557 wait complete. 2023-08-22T00:23:52.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:23:52.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.844+0000 7fd2e0555700 1 Processor -- start 2023-08-22T00:23:52.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.844+0000 7fd2e0555700 1 -- start start 2023-08-22T00:23:52.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2e0555700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd2d8153b60 0x7fd2d8068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2e0555700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 0x7fd2d8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2e0555700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80a8410 con 0x7fd2d8153f40 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2e0555700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80a8cb0 con 0x7fd2d8153b60 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2e0555700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81586a0 con 0x7fd2d80a9140 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2ddaf0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd2d8153f40 0x7fd2d8157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48030/0 (socket says 172.21.15.98:48030) 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2ddaf0700 1 -- 172.21.15.98:0/4043107227 learned_addr learned my addr 172.21.15.98:0/4043107227 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/4043107227 >> v2:172.21.15.118:3300/0 conn(0x7fd2d8153b60 0x7fd2d8068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.845+0000 7fd2deaf2700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 0x7fd2d8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2dd2ef700 1 -- 172.21.15.98:0/4043107227 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073602523 0 0) 0x7fd2d80a8410 con 0x7fd2d8153f40 2023-08-22T00:23:52.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2dd2ef700 1 -- 172.21.15.98:0/4043107227 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c40033f0 con 0x7fd2d8153f40 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2de2f1700 1 -- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 msgr2=0x7fd2d8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 0x7fd2d8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2de2f1700 1 -- 172.21.15.98:0/4043107227 >> v1:172.21.15.98:6789/0 conn(0x7fd2d8153f40 legacy=0x7fd2d8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2de2f1700 1 -- 172.21.15.98:0/4043107227 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80a8660 con 0x7fd2d8153b60 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2deaf2700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 0x7fd2d8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8068d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd2d4009760 tx=0x7fd2d4009060).ready entity=mon.1 client_cookie=9ff3873f5a9d0678 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2dd2ef700 1 -- 172.21.15.98:0/4043107227 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400d4a0 con 0x7fd2d8153b60 2023-08-22T00:23:52.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2dd2ef700 1 -- 172.21.15.98:0/4043107227 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400d600 con 0x7fd2d8153b60 2023-08-22T00:23:52.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.846+0000 7fd2dd2ef700 1 -- 172.21.15.98:0/4043107227 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400d980 con 0x7fd2d8153b60 2023-08-22T00:23:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 -- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 msgr2=0x7fd2d8068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8068d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd2d4009760 tx=0x7fd2d4009060).stop 2023-08-22T00:23:52.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 -- 172.21.15.98:0/4043107227 shutdown_connections 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d80a9140 0x7fd2d8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 --2- 172.21.15.98:0/4043107227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8068d40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 -- 172.21.15.98:0/4043107227 >> 172.21.15.98:0/4043107227 conn(0x7fd2d80c5dc0 msgr2=0x7fd2d8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 -- 172.21.15.98:0/4043107227 shutdown_connections 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.847+0000 7fd2e0555700 1 -- 172.21.15.98:0/4043107227 wait complete. 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 Processor -- start 2023-08-22T00:23:52.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 -- start start 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d8153f40 0x7fd2d8164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.848+0000 7fd2e0555700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c1350 con 0x7fd2d80a9140 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2e0555700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81650b0 con 0x7fd2d8153b60 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2e0555700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c0740 con 0x7fd2d8153f40 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48756/0 (socket says 172.21.15.98:48756) 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 -- 172.21.15.98:0/3992469485 learned_addr learned my addr 172.21.15.98:0/3992469485 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2deaf2700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d8153f40 0x7fd2d8164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2ddaf0700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d8153f40 msgr2=0x7fd2d8164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d8153f40 0x7fd2d8164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 msgr2=0x7fd2d8151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:52.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 -- 172.21.15.98:0/3992469485 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009a20 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2de2f1700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd2d4009d50 tx=0x7fd2d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400dd40 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400d770 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d40092a0 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400dea0 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.849+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80c0d00 con 0x7fd2d80a9140 2023-08-22T00:23:52.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.850+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80c1630 con 0x7fd2d80a9140 2023-08-22T00:23:52.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.851+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fd2d4018070 con 0x7fd2d80a9140 2023-08-22T00:23:52.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.851+0000 7fd2ce7fc700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 0x7fd2bc061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:52.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.851+0000 7fd2ddaf0700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 msgr2=0x7fd2bc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:52.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.851+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fd2d407bcb0 con 0x7fd2d80a9140 2023-08-22T00:23:52.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.851+0000 7fd2ddaf0700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 0x7fd2bc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:52.858 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:52.855+0000 7fe755277680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:23:52.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:52.855+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2d404cc30 con 0x7fd2d80a9140 2023-08-22T00:23:52.972 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:52.971+0000 7f0b97baa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:23:53.039 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:53.038+0000 7fe755277680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:23:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.052+0000 7fd2ddaf0700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 msgr2=0x7fd2bc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.052+0000 7fd2ddaf0700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 0x7fd2bc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:23:53.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.067+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2d8047480 con 0x7fd2d80a9140 2023-08-22T00:23:53.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.067+0000 7fd2ce7fc700 1 -- 172.21.15.98:0/3992469485 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fd2d4050250 con 0x7fd2d80a9140 2023-08-22T00:23:53.069 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:53.069 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:23:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.069+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 msgr2=0x7fd2bc061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.069+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 0x7fd2bc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 msgr2=0x7fd2d80c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd2d4009d50 tx=0x7fd2d4016000).stop 2023-08-22T00:23:53.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 shutdown_connections 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd2bc05f050 0x7fd2bc061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2d8153f40 0x7fd2d8164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d80a9140 0x7fd2d80c17e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 --2- 172.21.15.98:0/3992469485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2d8153b60 0x7fd2d8151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 >> 172.21.15.98:0/3992469485 conn(0x7fd2d80c5dc0 msgr2=0x7fd2d81527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 shutdown_connections 2023-08-22T00:23:53.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.070+0000 7fd2e0555700 1 -- 172.21.15.98:0/3992469485 wait complete. 2023-08-22T00:23:53.073 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:23:53.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:23:53.162 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:53.161+0000 7f0b97baa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:23:53.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.201+0000 7f2e6be73700 1 Processor -- start 2023-08-22T00:23:53.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.201+0000 7f2e6be73700 1 -- start start 2023-08-22T00:23:53.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6be73700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 0x7f2e640aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6be73700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e640667b0 con 0x7f2e6414c350 2023-08-22T00:23:53.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6be73700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e64155e00 con 0x7f2e6414bf70 2023-08-22T00:23:53.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6be73700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64066510 con 0x7f2e640c3e50 2023-08-22T00:23:53.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6940e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2e6414c350 0x7f2e640aa860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48036/0 (socket says 172.21.15.98:48036) 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6940e700 1 -- 172.21.15.98:0/2799926789 learned_addr learned my addr 172.21.15.98:0/2799926789 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.202+0000 7f2e6a410700 1 --2- 172.21.15.98:0/2799926789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 0x7f2e640aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148066851 0 0) 0x7f2e640667b0 con 0x7f2e6414c350 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e500033f0 con 0x7f2e6414c350 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938760852 0 0) 0x7f2e64155e00 con 0x7f2e6414bf70 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e640667b0 con 0x7f2e6414bf70 2023-08-22T00:23:53.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e6a410700 1 -- 172.21.15.98:0/2799926789 >> v1:172.21.15.118:6789/0 conn(0x7f2e6414bf70 legacy=0x7f2e640c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e6a410700 1 -- 172.21.15.98:0/2799926789 >> v1:172.21.15.98:6789/0 conn(0x7f2e6414c350 legacy=0x7f2e640aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e6a410700 1 -- 172.21.15.98:0/2799926789 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e641560e0 con 0x7f2e640c3e50 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e6a410700 1 --2- 172.21.15.98:0/2799926789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 0x7f2e640aaf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2e5c009e90 tx=0x7f2e5c009780).ready entity=mon.2 client_cookie=7849ba35ff9b393d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00e070 con 0x7f2e640c3e50 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00bab0 con 0x7f2e640c3e50 2023-08-22T00:23:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.203+0000 7f2e68c0d700 1 -- 172.21.15.98:0/2799926789 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00be30 con 0x7f2e640c3e50 2023-08-22T00:23:53.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 -- 172.21.15.98:0/2799926789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 msgr2=0x7f2e640aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2799926789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 0x7f2e640aaf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2e5c009e90 tx=0x7f2e5c009780).stop 2023-08-22T00:23:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 -- 172.21.15.98:0/2799926789 shutdown_connections 2023-08-22T00:23:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2799926789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e640c3e50 0x7f2e640aaf70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 -- 172.21.15.98:0/2799926789 >> 172.21.15.98:0/2799926789 conn(0x7f2e640c5dc0 msgr2=0x7f2e64068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 -- 172.21.15.98:0/2799926789 shutdown_connections 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.204+0000 7f2e6be73700 1 -- 172.21.15.98:0/2799926789 wait complete. 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.205+0000 7f2e6be73700 1 Processor -- start 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.205+0000 7f2e6be73700 1 -- start start 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e6414bf70 0x7f2e640ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e6414c350 0x7f2e640a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64155620 con 0x7f2e640c3e50 2023-08-22T00:23:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64162b40 con 0x7f2e6414c350 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6be73700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e641668a0 con 0x7f2e6414bf70 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48758/0 (socket says 172.21.15.98:48758) 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 -- 172.21.15.98:0/2878373434 learned_addr learned my addr 172.21.15.98:0/2878373434 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6a410700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e6414c350 0x7f2e640a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e6940e700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e6414bf70 0x7f2e640ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 -- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e6414bf70 msgr2=0x7f2e640ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e6414bf70 0x7f2e640ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 -- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e6414c350 msgr2=0x7f2e640a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e6414c350 0x7f2e640a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 -- 172.21.15.98:0/2878373434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009a20 con 0x7f2e640c3e50 2023-08-22T00:23:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e69c0f700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f2e6000c490 tx=0x7f2e60007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.206+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000ce40 con 0x7f2e640c3e50 2023-08-22T00:23:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.207+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000f470 con 0x7f2e640c3e50 2023-08-22T00:23:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.207+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e641665c0 con 0x7f2e640c3e50 2023-08-22T00:23:53.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.207+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000f810 con 0x7f2e640c3e50 2023-08-22T00:23:53.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.207+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e641627d0 con 0x7f2e640c3e50 2023-08-22T00:23:53.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.208+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e640c4660 con 0x7f2e640c3e50 2023-08-22T00:23:53.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.208+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f2e6000fb80 con 0x7f2e640c3e50 2023-08-22T00:23:53.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.209+0000 7f2e59ffb700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 0x7f2e48061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.209+0000 7f2e6940e700 1 -- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 msgr2=0x7f2e48061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:53.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.209+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f2e60079840 con 0x7f2e640c3e50 2023-08-22T00:23:53.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.209+0000 7f2e6940e700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 0x7f2e48061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:53.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.213+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e600488f0 con 0x7f2e640c3e50 2023-08-22T00:23:53.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.376+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e64047480 con 0x7f2e640c3e50 2023-08-22T00:23:53.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.377+0000 7f2e59ffb700 1 -- 172.21.15.98:0/2878373434 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17838 (secure 0 0 0) 0x7f2e6004a790 con 0x7f2e640c3e50 2023-08-22T00:23:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:53.378 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":123,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:23:49.403528+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/1203952998":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/2488608596":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4058526191":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4074775334":"2023-08-23T00:22:47.807078+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:23:53.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 msgr2=0x7f2e48061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:53.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 0x7f2e48061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 msgr2=0x7f2e64162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f2e6000c490 tx=0x7f2e60007c90).stop 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 shutdown_connections 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e6414c350 0x7f2e640a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e640c3e50 0x7f2e64162fd0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e4805f080 0x7f2e48061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 --2- 172.21.15.98:0/2878373434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e6414bf70 0x7f2e640ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 >> 172.21.15.98:0/2878373434 conn(0x7f2e640c5dc0 msgr2=0x7f2e64068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 shutdown_connections 2023-08-22T00:23:53.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.379+0000 7f2e6be73700 1 -- 172.21.15.98:0/2878373434 wait complete. 2023-08-22T00:23:53.392 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:23:53.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:23:53.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.511+0000 7f9a0b649700 1 Processor -- start 2023-08-22T00:23:53.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.511+0000 7f9a0b649700 1 -- start start 2023-08-22T00:23:53.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a0b649700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9a04154c00 0x7f9a0414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a0b649700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040c17b0 con 0x7f9a0414e0d0 2023-08-22T00:23:53.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a0b649700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a04155260 con 0x7f9a040c61a0 2023-08-22T00:23:53.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a0b649700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040bf9e0 con 0x7f9a04154c00 2023-08-22T00:23:53.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a093e5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9a0414e0d0 0x7f9a040c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48044/0 (socket says 172.21.15.98:48044) 2023-08-22T00:23:53.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a093e5700 1 -- 172.21.15.98:0/990594514 learned_addr learned my addr 172.21.15.98:0/990594514 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:53.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f9a09be6700 1 --2- 172.21.15.98:0/990594514 >> v2:172.21.15.118:3300/0 conn(0x7f9a04154c00 0x7f9a0414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350104254 0 0) 0x7f9a040c17b0 con 0x7f9a0414e0d0 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f00033f0 con 0x7f9a0414e0d0 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608851730 0 0) 0x7f9a04155260 con 0x7f9a040c61a0 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a040c17b0 con 0x7f9a040c61a0 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440075921 0 0) 0x7f99f00033f0 con 0x7f9a0414e0d0 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 >> v2:172.21.15.118:3300/0 conn(0x7f9a04154c00 msgr2=0x7f9a0414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 --2- 172.21.15.98:0/990594514 >> v2:172.21.15.118:3300/0 conn(0x7f9a04154c00 0x7f9a0414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 >> v1:172.21.15.118:6789/0 conn(0x7f9a040c61a0 legacy=0x7f9a041544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040bfcc0 con 0x7f9a0414e0d0 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9a00001470 con 0x7f9a0414e0d0 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 >> v1:172.21.15.98:6789/0 conn(0x7f9a0414e0d0 legacy=0x7f9a040c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.512+0000 7f99fbfff700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0003a70 0x7f99f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f0004690 0x7f99f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 0x7f99f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040bf9e0 con 0x7f99f0005000 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000bf60 con 0x7f99f0004690 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000c0d0 con 0x7f99f0003a70 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 0x7f99f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a093e5700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0003a70 0x7f99f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a08be4700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f0004690 0x7f99f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 -- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0003a70 msgr2=0x7f99f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0003a70 0x7f99f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 -- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f0004690 msgr2=0x7f99f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f0004690 0x7f99f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 -- 172.21.15.98:0/990594514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00033f0 con 0x7f99f0005000 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 -- 172.21.15.98:0/990594514 reap_dead start 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f9a09be6700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 0x7f99f000b8e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f99fc00e1c0 tx=0x7f99fc00b040).ready entity=mon.0 client_cookie=8b1ce7ca00f9b8a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc017070 con 0x7f99f0005000 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00f040 con 0x7f99f0005000 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.513+0000 7f99fbfff700 1 -- 172.21.15.98:0/990594514 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00eca0 con 0x7f99f0005000 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 -- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 msgr2=0x7f99f000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 0x7f99f000b8e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f99fc00e1c0 tx=0x7f99fc00b040).stop 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 -- 172.21.15.98:0/990594514 shutdown_connections 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 --2- 172.21.15.98:0/990594514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99f0005000 0x7f99f000b8e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 -- 172.21.15.98:0/990594514 >> 172.21.15.98:0/990594514 conn(0x7f9a040caa80 msgr2=0x7f9a040cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 -- 172.21.15.98:0/990594514 shutdown_connections 2023-08-22T00:23:53.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.514+0000 7f9a0b649700 1 -- 172.21.15.98:0/990594514 wait complete. 2023-08-22T00:23:53.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.515+0000 7f9a0b649700 1 Processor -- start 2023-08-22T00:23:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.516+0000 7f9a0b649700 1 -- start start 2023-08-22T00:23:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0005000 0x7f9a0414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a04156540 0x7f9a041569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414fd30 con 0x7f9a040adeb0 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04156eb0 con 0x7f9a04156540 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040ae900 con 0x7f99f0005000 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48766/0 (socket says 172.21.15.98:48766) 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 -- 172.21.15.98:0/3492592454 learned_addr learned my addr 172.21.15.98:0/3492592454 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a093e5700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0005000 0x7f9a0414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a09be6700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a04156540 0x7f9a041569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0005000 msgr2=0x7f9a0414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0005000 0x7f9a0414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a04156540 msgr2=0x7f9a041569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a04156540 0x7f9a041569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 -- 172.21.15.98:0/3492592454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040aebe0 con 0x7f9a040adeb0 2023-08-22T00:23:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a08be4700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f99f40029a0 tx=0x7f99f4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400f6f0 con 0x7f9a040adeb0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400f850 con 0x7f9a040adeb0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0414f9c0 con 0x7f9a040adeb0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400fbd0 con 0x7f9a040adeb0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.517+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a040aeec0 con 0x7f9a040adeb0 2023-08-22T00:23:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.518+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0414fea0 con 0x7f9a040adeb0 2023-08-22T00:23:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.519+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f99f4014450 con 0x7f9a040adeb0 2023-08-22T00:23:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.519+0000 7f99f97fa700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 0x7f99e8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.519+0000 7f9a093e5700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 msgr2=0x7f99e8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.519+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f99f407a2c0 con 0x7f9a040adeb0 2023-08-22T00:23:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.519+0000 7f9a093e5700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 0x7f99e8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.523+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f404a8f0 con 0x7f9a040adeb0 2023-08-22T00:23:53.691 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:53.691+0000 7fe755277680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:23:53.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.720+0000 7f9a093e5700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 msgr2=0x7f99e8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:53.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.720+0000 7f9a093e5700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 0x7f99e8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:23:53.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.733+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a04047480 con 0x7f9a040adeb0 2023-08-22T00:23:53.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.733+0000 7f99f97fa700 1 -- 172.21.15.98:0/3492592454 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f99f404b1b0 con 0x7f9a040adeb0 2023-08-22T00:23:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:53.735 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 msgr2=0x7f99e8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 0x7f99e8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 msgr2=0x7f9a040ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f99f40029a0 tx=0x7f99f4007bb0).stop 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 shutdown_connections 2023-08-22T00:23:53.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f99e805f050 0x7f99e8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f0005000 0x7f9a0414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a04156540 0x7f9a041569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 --2- 172.21.15.98:0/3492592454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040adeb0 0x7f9a040ae330 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 >> 172.21.15.98:0/3492592454 conn(0x7f9a040caa80 msgr2=0x7f9a040c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.735+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 shutdown_connections 2023-08-22T00:23:53.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.736+0000 7f9a0b649700 1 -- 172.21.15.98:0/3492592454 wait complete. 2023-08-22T00:23:53.739 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:23:53.750 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:23:53.760 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:53.760+0000 7fe755277680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:23:53.835 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:53.834+0000 7fe755277680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:23:53.847 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:53.845+0000 7f0b97baa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:23:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.870+0000 7f35ecb28700 1 Processor -- start 2023-08-22T00:23:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.870+0000 7f35ecb28700 1 -- start start 2023-08-22T00:23:53.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35ecb28700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35e814bf70 0x7f35e8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35ecb28700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e8153080 con 0x7f35e814c350 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35ecb28700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80667b0 con 0x7f35e80c3e50 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35ecb28700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e8066510 con 0x7f35e814bf70 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e5d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f35e814c350 0x7f35e80c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48056/0 (socket says 172.21.15.98:48056) 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e5d9b700 1 -- 172.21.15.98:0/2458690391 learned_addr learned my addr 172.21.15.98:0/2458690391 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e659c700 1 --2- 172.21.15.98:0/2458690391 >> v2:172.21.15.118:3300/0 conn(0x7f35e814bf70 0x7f35e8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272120440 0 0) 0x7f35e8153080 con 0x7f35e814c350 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d00033f0 con 0x7f35e814c350 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673952986 0 0) 0x7f35e80667b0 con 0x7f35e80c3e50 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e8153080 con 0x7f35e80c3e50 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117448686 0 0) 0x7f35d00033f0 con 0x7f35e814c350 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 >> v2:172.21.15.118:3300/0 conn(0x7f35e814bf70 msgr2=0x7f35e8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 --2- 172.21.15.98:0/2458690391 >> v2:172.21.15.118:3300/0 conn(0x7f35e814bf70 0x7f35e8152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 >> v1:172.21.15.118:6789/0 conn(0x7f35e80c3e50 legacy=0x7f35e80aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8155e00 con 0x7f35e814c350 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f35dc001470 con 0x7f35e814c350 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 >> v1:172.21.15.98:6789/0 conn(0x7f35e814c350 legacy=0x7f35e80c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0003a70 0x7f35d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8066510 con 0x7f35d0005000 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d000bf60 con 0x7f35d0003a70 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.872+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d000c0d0 con 0x7f35d0004690 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e5d9b700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e659c700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0003a70 0x7f35d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 -- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35d0004690 msgr2=0x7f35d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 -- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0003a70 msgr2=0x7f35d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0003a70 0x7f35d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 -- 172.21.15.98:0/2458690391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00033f0 con 0x7f35d0005000 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 -- 172.21.15.98:0/2458690391 reap_dead start 2023-08-22T00:23:53.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e6d9d700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f35e0001f60 tx=0x7f35e0007f30).ready entity=mon.0 client_cookie=d6c95f4aa1fc17d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0003120 con 0x7f35d0005000 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0006a20 con 0x7f35d0005000 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35e559a700 1 -- 172.21.15.98:0/2458690391 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0006dc0 con 0x7f35d0005000 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35ecb28700 1 -- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 msgr2=0x7f35d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.873+0000 7f35ecb28700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f35e0001f60 tx=0x7f35e0007f30).stop 2023-08-22T00:23:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.874+0000 7f35ecb28700 1 -- 172.21.15.98:0/2458690391 shutdown_connections 2023-08-22T00:23:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.874+0000 7f35ecb28700 1 --2- 172.21.15.98:0/2458690391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.874+0000 7f35ecb28700 1 -- 172.21.15.98:0/2458690391 >> 172.21.15.98:0/2458690391 conn(0x7f35e80c5dc0 msgr2=0x7f35e8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.874+0000 7f35ecb28700 1 -- 172.21.15.98:0/2458690391 shutdown_connections 2023-08-22T00:23:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.874+0000 7f35ecb28700 1 -- 172.21.15.98:0/2458690391 wait complete. 2023-08-22T00:23:53.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.875+0000 7f35ecb28700 1 Processor -- start 2023-08-22T00:23:53.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.875+0000 7f35ecb28700 1 -- start start 2023-08-22T00:23:53.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0005000 0x7f35e814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e8068630 0x7f35e8068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e814fea0 con 0x7f35e8149470 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8068fa0 con 0x7f35d0005000 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81498f0 con 0x7f35e8068630 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48788/0 (socket says 172.21.15.98:48788) 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 -- 172.21.15.98:0/1723508660 learned_addr learned my addr 172.21.15.98:0/1723508660 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e659c700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0005000 0x7f35e814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e6d9d700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e8068630 0x7f35e8068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e8068630 msgr2=0x7f35e8068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e8068630 0x7f35e8068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0005000 msgr2=0x7f35e814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0005000 0x7f35e814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 -- 172.21.15.98:0/1723508660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e814e960 con 0x7f35e8149470 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35e5d9b700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f35dc007810 tx=0x7f35dc001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0114c0 con 0x7f35e8149470 2023-08-22T00:23:53.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc011620 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e814ec40 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0119c0 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.876+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e8065320 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.877+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e814f990 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.878+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f35dc011d30 con 0x7f35e8149470 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.878+0000 7f35d67fc700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 0x7f35c8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:53.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.878+0000 7f35e659c700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 msgr2=0x7f35c8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:53.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.878+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f35dc07a3d0 con 0x7f35e8149470 2023-08-22T00:23:53.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.878+0000 7f35e659c700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 0x7f35c8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:53.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:53.882+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35e814f990 con 0x7f35e8149470 2023-08-22T00:23:53.924 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:53.920+0000 7f0b97baa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:23:53.982 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:53.981+0000 7fe755277680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:23:53.999 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:53.998+0000 7f0b97baa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:23:54.052 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:54.052+0000 7fe755277680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:23:54.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.079+0000 7f35e659c700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 msgr2=0x7f35c8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:54.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.079+0000 7f35e659c700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 0x7f35c8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:23:54.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.093+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35e814f990 con 0x7f35e8149470 2023-08-22T00:23:54.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.094+0000 7f35d67fc700 1 -- 172.21.15.98:0/1723508660 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f35e814f990 con 0x7f35e8149470 2023-08-22T00:23:54.095 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:54.095 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:22:30.895611+0000","modified":"2023-08-22T00:22:33.524037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4016657982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4016657982},{"type":"v1","addr":"172.21.15.98:6837","nonce":4016657982}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-22T00:23:54.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 msgr2=0x7f35c8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:54.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 0x7f35c8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:54.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 msgr2=0x7f35e8064e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f35dc007810 tx=0x7f35dc001df0).stop 2023-08-22T00:23:54.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 shutdown_connections 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f35c805f050 0x7f35c8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e8068630 0x7f35e8068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35d0005000 0x7f35e814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 --2- 172.21.15.98:0/1723508660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35e8149470 0x7f35e8064e30 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 >> 172.21.15.98:0/1723508660 conn(0x7f35e80c5dc0 msgr2=0x7f35e8149b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 shutdown_connections 2023-08-22T00:23:54.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.096+0000 7f35ecb28700 1 -- 172.21.15.98:0/1723508660 wait complete. 2023-08-22T00:23:54.099 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 43 2023-08-22T00:23:54.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:23:54.155 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.154+0000 7f0b97baa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:23:54.168 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:54.167+0000 7fe755277680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:23:54.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.227+0000 7f74538f4700 1 Processor -- start 2023-08-22T00:23:54.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.227+0000 7f74538f4700 1 -- start start 2023-08-22T00:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f74538f4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f744c0a6590 0x7f744c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f74538f4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c0bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f74538f4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c151e40 con 0x7f744c0a61b0 2023-08-22T00:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f74538f4700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c0c4f80 con 0x7f744c0a6590 2023-08-22T00:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f74538f4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c151620 con 0x7f744c0c3490 2023-08-22T00:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f744c0a6590 0x7f744c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7451690700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f744c0a61b0 0x7f744c150f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48070/0 (socket says 172.21.15.98:48070) 2023-08-22T00:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f744c0a6590 0x7f744c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48796/0 (socket says 172.21.15.98:48796) 2023-08-22T00:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7451690700 1 -- 172.21.15.98:0/3398281465 learned_addr learned my addr 172.21.15.98:0/3398281465 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:54.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7451e91700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c0bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 -- 172.21.15.98:0/3398281465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 msgr2=0x7f744c0bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c0bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 -- 172.21.15.98:0/3398281465 >> v1:172.21.15.98:6789/0 conn(0x7f744c0a61b0 legacy=0x7f744c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7443fff700 1 -- 172.21.15.98:0/3398281465 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106031697 0 0) 0x7f744c151e40 con 0x7f744c0a61b0 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.228+0000 7f7450e8f700 1 -- 172.21.15.98:0/3398281465 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c151880 con 0x7f744c0a6590 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f7450e8f700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0c5410 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f7448009760 tx=0x7f7448009060).ready entity=mon.0 client_cookie=d9e5cae21341bb53 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f7443fff700 1 -- 172.21.15.98:0/3398281465 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800f510 con 0x7f744c0a6590 2023-08-22T00:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f7443fff700 1 -- 172.21.15.98:0/3398281465 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800f670 con 0x7f744c0a6590 2023-08-22T00:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f7443fff700 1 -- 172.21.15.98:0/3398281465 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800f9f0 con 0x7f744c0a6590 2023-08-22T00:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 -- 172.21.15.98:0/3398281465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 msgr2=0x7f744c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0c5410 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f7448009760 tx=0x7f7448009060).stop 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 -- 172.21.15.98:0/3398281465 shutdown_connections 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c0bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 --2- 172.21.15.98:0/3398281465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0c5410 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 -- 172.21.15.98:0/3398281465 >> 172.21.15.98:0/3398281465 conn(0x7f744c0c3980 msgr2=0x7f744c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 -- 172.21.15.98:0/3398281465 shutdown_connections 2023-08-22T00:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.229+0000 7f74538f4700 1 -- 172.21.15.98:0/3398281465 wait complete. 2023-08-22T00:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.230+0000 7f74538f4700 1 Processor -- start 2023-08-22T00:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 -- start start 2023-08-22T00:23:54.236 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f0b97baa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 0x7f744c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1506a0 con 0x7f744c0a6590 2023-08-22T00:23:54.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c149240 con 0x7f744c0a61b0 2023-08-22T00:23:54.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.231+0000 7f74538f4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0a3f40 con 0x7f744c0c3490 2023-08-22T00:23:54.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48802/0 (socket says 172.21.15.98:48802) 2023-08-22T00:23:54.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 -- 172.21.15.98:0/1534766438 learned_addr learned my addr 172.21.15.98:0/1534766438 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:54.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7451e91700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7451690700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 0x7f744c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 -- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 msgr2=0x7f744c069650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c069650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 -- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 msgr2=0x7f744c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 0x7f744c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 -- 172.21.15.98:0/1534766438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480092a0 con 0x7f744c0a6590 2023-08-22T00:23:54.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7451690700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 0x7f744c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:54.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f7450e8f700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f7448011000 tx=0x7f7448017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800f7e0 con 0x7f744c0a6590 2023-08-22T00:23:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800f940 con 0x7f744c0a6590 2023-08-22T00:23:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744801b660 con 0x7f744c0a6590 2023-08-22T00:23:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c0a4220 con 0x7f744c0a6590 2023-08-22T00:23:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.232+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c0a4590 con 0x7f744c0a6590 2023-08-22T00:23:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.233+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c0a3da0 con 0x7f744c0a6590 2023-08-22T00:23:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.234+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f744801ba50 con 0x7f744c0a6590 2023-08-22T00:23:54.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.234+0000 7f74417fa700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 0x7f7430061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.234+0000 7f7451690700 1 -- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 msgr2=0x7f7430061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:54.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.234+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f744807bc00 con 0x7f744c0a6590 2023-08-22T00:23:54.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.234+0000 7f7451690700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 0x7f7430061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:54.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.238+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f744c0a3da0 con 0x7f744c0a6590 2023-08-22T00:23:54.278 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:54.277+0000 7fe755277680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:23:54.351 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.350+0000 7f0b97baa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:23:54.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.405+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f744c0a3da0 con 0x7f744c0a6590 2023-08-22T00:23:54.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.406+0000 7f74417fa700 1 -- 172.21.15.98:0/1534766438 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17838 (secure 0 0 0) 0x7f744c0a3da0 con 0x7f744c0a6590 2023-08-22T00:23:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:23:54.409 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":123,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:23:49.403528+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:22:29.447406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-08-22T00:22:29.849463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:6833/118203":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/1203952998":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/2488608596":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4058526191":"2023-08-23T00:22:47.807078+0000","172.21.15.98:0/4074775334":"2023-08-23T00:22:47.807078+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:23:54.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 msgr2=0x7f7430061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:54.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 0x7f7430061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:54.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 msgr2=0x7f744c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f7448011000 tx=0x7f7448017000).stop 2023-08-22T00:23:54.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 shutdown_connections 2023-08-22T00:23:54.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743005f080 0x7f7430061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:54.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f744c0c3490 0x7f744c069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f744c0a61b0 0x7f744c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 --2- 172.21.15.98:0/1534766438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f744c0a6590 0x7f744c0bd770 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 >> 172.21.15.98:0/1534766438 conn(0x7f744c0c3980 msgr2=0x7f744c14a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 shutdown_connections 2023-08-22T00:23:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.408+0000 7f74538f4700 1 -- 172.21.15.98:0/1534766438 wait complete. 2023-08-22T00:23:54.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:23:54.470 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.469+0000 7f0b97baa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:23:54.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.543+0000 7f19add25700 1 Processor -- start 2023-08-22T00:23:54.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.543+0000 7f19add25700 1 -- start start 2023-08-22T00:23:54.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19add25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19a80aa1e0 0x7f19a8153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19add25700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a80c1800 con 0x7f19a80c5b00 2023-08-22T00:23:54.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19add25700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a80c0bf0 con 0x7f19a8153a60 2023-08-22T00:23:54.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19add25700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a80c0ed0 con 0x7f19a80aa1e0 2023-08-22T00:23:54.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19a7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f19a80c5b00 0x7f19a8062840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48078/0 (socket says 172.21.15.98:48078) 2023-08-22T00:23:54.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19a7fff700 1 -- 172.21.15.98:0/318331067 learned_addr learned my addr 172.21.15.98:0/318331067 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:54.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19a6ffd700 1 --2- 172.21.15.98:0/318331067 >> v2:172.21.15.118:3300/0 conn(0x7f19a80aa1e0 0x7f19a8153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127701818 0 0) 0x7f19a80c0bf0 con 0x7f19a8153a60 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.544+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19940033f0 con 0x7f19a8153a60 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395867810 0 0) 0x7f19a80c1800 con 0x7f19a80c5b00 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a80c0bf0 con 0x7f19a80c5b00 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a6ffd700 1 -- 172.21.15.98:0/318331067 >> v1:172.21.15.118:6789/0 conn(0x7f19a8153a60 legacy=0x7f19a80a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a6ffd700 1 -- 172.21.15.98:0/318331067 >> v1:172.21.15.98:6789/0 conn(0x7f19a80c5b00 legacy=0x7f19a8062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a6ffd700 1 -- 172.21.15.98:0/318331067 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80c11b0 con 0x7f19a80aa1e0 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a6ffd700 1 --2- 172.21.15.98:0/318331067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8153e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1990009760 tx=0x7f1990009060).ready entity=mon.1 client_cookie=57137c2ea42f5281 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000d4a0 con 0x7f19a80aa1e0 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000d600 con 0x7f19a80aa1e0 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19a67fc700 1 -- 172.21.15.98:0/318331067 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000d980 con 0x7f19a80aa1e0 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19add25700 1 -- 172.21.15.98:0/318331067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 msgr2=0x7f19a8153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.545+0000 7f19add25700 1 --2- 172.21.15.98:0/318331067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8153e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1990009760 tx=0x7f1990009060).stop 2023-08-22T00:23:54.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.546+0000 7f19add25700 1 -- 172.21.15.98:0/318331067 shutdown_connections 2023-08-22T00:23:54.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.546+0000 7f19add25700 1 --2- 172.21.15.98:0/318331067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8153e40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.546+0000 7f19add25700 1 -- 172.21.15.98:0/318331067 >> 172.21.15.98:0/318331067 conn(0x7f19a80650f0 msgr2=0x7f19a80cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:54.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.546+0000 7f19add25700 1 -- 172.21.15.98:0/318331067 shutdown_connections 2023-08-22T00:23:54.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.546+0000 7f19add25700 1 -- 172.21.15.98:0/318331067 wait complete. 2023-08-22T00:23:54.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.547+0000 7f19add25700 1 Processor -- start 2023-08-22T00:23:54.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.547+0000 7f19add25700 1 -- start start 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a8153a60 0x7f19a80aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a81645d0 con 0x7f19a80c5b00 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a81572a0 con 0x7f19a80aa1e0 2023-08-22T00:23:54.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8157580 con 0x7f19a8153a60 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48810/0 (socket says 172.21.15.98:48810) 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 -- 172.21.15.98:0/4056962736 learned_addr learned my addr 172.21.15.98:0/4056962736 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a77fe700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a7fff700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a8153a60 0x7f19a80aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a8153a60 msgr2=0x7f19a80aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a8153a60 0x7f19a80aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 msgr2=0x7f19a8164a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8164a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 -- 172.21.15.98:0/4056962736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900092a0 con 0x7f19a80c5b00 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19a6ffd700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1990010000 tx=0x7f1990016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000dcf0 con 0x7f19a80c5b00 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000de50 con 0x7f19a80c5b00 2023-08-22T00:23:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a8164260 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000d980 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.548+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a8150c40 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.550+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a81640d0 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.550+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 50) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f199001d640 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.550+0000 7f199f7fe700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 0x7f1988061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.551+0000 7f19a77fe700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 msgr2=0x7f1988061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.551+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f199007bcc0 con 0x7f19a80c5b00 2023-08-22T00:23:54.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.551+0000 7f19a77fe700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 0x7f1988061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:23:54.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.558+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f199004cc40 con 0x7f19a80c5b00 2023-08-22T00:23:54.568 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:54.567+0000 7fe755277680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:23:54.639 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:23:54.639+0000 7fe755277680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:23:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.752+0000 7f19a77fe700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 msgr2=0x7f1988061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:23:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.752+0000 7f19a77fe700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 0x7f1988061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:23:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.766+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19a81643f0 con 0x7f19a80c5b00 2023-08-22T00:23:54.774 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.773+0000 7f0b97baa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:23:54.846 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.845+0000 7f0b97baa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:23:54.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.863+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 51) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f19900795a0 con 0x7f19a80c5b00 2023-08-22T00:23:54.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.863+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 msgr2=0x7f1988061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:23:54.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:54.863+0000 7f199f7fe700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 0x7f1988061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:54.868 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.868 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.868 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.869 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.869 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-08-22T00:23:54.869 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:23:54.873 INFO:tasks.ceph.mds.a.smithi098.stderr: -5917> 2023-08-22T00:22:32.311+0000 7f6c396d1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:23:54.880 INFO:tasks.ceph.mds.a.smithi098.stderr: -7> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.880 INFO:tasks.ceph.mds.a.smithi098.stderr: -6> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.880 INFO:tasks.ceph.mds.a.smithi098.stderr: -5> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.881 INFO:tasks.ceph.mds.a.smithi098.stderr: -4> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:23:54.881 INFO:tasks.ceph.mds.a.smithi098.stderr: -3> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-08-22T00:23:54.881 INFO:tasks.ceph.mds.a.smithi098.stderr: -1> 2023-08-22T00:23:54.867+0000 7f6c35eca700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:23:54.900 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:23:54.922 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b1a664700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b1a664700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b1a664700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b1a664700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b1a664700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b15e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b15e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.923 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b15e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.924 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b15e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:54.924 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:23:54.921+0000 7f0b15e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:23:55.415 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:23:55.414+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:23:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.420+0000 7f199f7fe700 1 -- 172.21.15.98:0/4056962736 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1990053c40 con 0x7f19a80c5b00 2023-08-22T00:23:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 msgr2=0x7f19a8156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1990010000 tx=0x7f1990016000).stop 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 shutdown_connections 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f198805f050 0x7f1988061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a8153a60 0x7f19a80aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a80aa1e0 0x7f19a8164a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 --2- 172.21.15.98:0/4056962736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19a80c5b00 0x7f19a8156850 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 >> 172.21.15.98:0/4056962736 conn(0x7f19a80650f0 msgr2=0x7f19a80c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 shutdown_connections 2023-08-22T00:23:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.423+0000 7f19add25700 1 -- 172.21.15.98:0/4056962736 wait complete. 2023-08-22T00:23:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:23:55.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:23:55.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.555+0000 7f6f25bd3700 1 Processor -- start 2023-08-22T00:23:55.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.555+0000 7f6f25bd3700 1 -- start start 2023-08-22T00:23:55.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f25bd3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:55.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f25bd3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20063fb0 con 0x7f6f201548f0 2023-08-22T00:23:55.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f25bd3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20063710 con 0x7f6f200ad420 2023-08-22T00:23:55.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f25bd3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200c9040 con 0x7f6f200ad040 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f1ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6f201548f0 0x7f6f200c9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48094/0 (socket says 172.21.15.98:48094) 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f1ffff700 1 -- 172.21.15.98:0/2862384002 learned_addr learned my addr 172.21.15.98:0/2862384002 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.556+0000 7f6f1f7fe700 1 --2- 172.21.15.98:0/2862384002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150815743 0 0) 0x7f6f20063fb0 con 0x7f6f201548f0 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c0033f0 con 0x7f6f201548f0 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607709271 0 0) 0x7f6f20063710 con 0x7f6f200ad420 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f20063fb0 con 0x7f6f200ad420 2023-08-22T00:23:55.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608072492 0 0) 0x7f6f0c0033f0 con 0x7f6f201548f0 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1f7fe700 1 -- 172.21.15.98:0/2862384002 >> v1:172.21.15.118:6789/0 conn(0x7f6f200ad420 legacy=0x7f6f201541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1f7fe700 1 -- 172.21.15.98:0/2862384002 >> v1:172.21.15.98:6789/0 conn(0x7f6f201548f0 legacy=0x7f6f200c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1f7fe700 1 -- 172.21.15.98:0/2862384002 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200639f0 con 0x7f6f200ad040 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1f7fe700 1 --2- 172.21.15.98:0/2862384002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200c5df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6f08009790 tx=0x7f6f08009060).ready entity=mon.2 client_cookie=33d6d09768d68ac4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180017f0 con 0x7f6f200ad040 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f080090d0 con 0x7f6f200ad040 2023-08-22T00:23:55.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.557+0000 7f6f1e7fc700 1 -- 172.21.15.98:0/2862384002 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011610 con 0x7f6f200ad040 2023-08-22T00:23:55.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 -- 172.21.15.98:0/2862384002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 msgr2=0x7f6f200c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/2862384002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200c5df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6f08009790 tx=0x7f6f08009060).stop 2023-08-22T00:23:55.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 -- 172.21.15.98:0/2862384002 shutdown_connections 2023-08-22T00:23:55.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/2862384002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200c5df0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 -- 172.21.15.98:0/2862384002 >> 172.21.15.98:0/2862384002 conn(0x7f6f200cb600 msgr2=0x7f6f200c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:55.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 -- 172.21.15.98:0/2862384002 shutdown_connections 2023-08-22T00:23:55.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.558+0000 7f6f25bd3700 1 -- 172.21.15.98:0/2862384002 wait complete. 2023-08-22T00:23:55.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.559+0000 7f6f25bd3700 1 Processor -- start 2023-08-22T00:23:55.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.559+0000 7f6f25bd3700 1 -- start start 2023-08-22T00:23:55.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:55.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 0x7f6f200abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:55.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:55.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200ac8c0 con 0x7f6f201548f0 2023-08-22T00:23:55.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200aa1d0 con 0x7f6f200ad420 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200c3230 con 0x7f6f200ad040 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48892/0 (socket says 172.21.15.98:48892) 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 -- 172.21.15.98:0/3743147336 learned_addr learned my addr 172.21.15.98:0/3743147336 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1effd700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 0x7f6f200abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1f7fe700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:55.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 -- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 msgr2=0x7f6f200a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200a9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 -- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 msgr2=0x7f6f200abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 0x7f6f200abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 -- 172.21.15.98:0/3743147336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080092a0 con 0x7f6f201548f0 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1effd700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 0x7f6f200abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:55.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f1ffff700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f6f1800cb70 tx=0x7f6f18007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18004c40 con 0x7f6f201548f0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f18004da0 con 0x7f6f201548f0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f200c2990 con 0x7f6f201548f0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180073a0 con 0x7f6f201548f0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.560+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f200c2f50 con 0x7f6f201548f0 2023-08-22T00:23:55.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.562+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f200c53c0 con 0x7f6f201548f0 2023-08-22T00:23:55.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.562+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 51) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f6f18007790 con 0x7f6f201548f0 2023-08-22T00:23:55.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.562+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 7192+0+0 (secure 0 0 0) 0x7f6f18079ed0 con 0x7f6f201548f0 2023-08-22T00:23:55.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.566+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f1804b0e0 con 0x7f6f201548f0 2023-08-22T00:23:55.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.769+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f20158800 con 0x7f6f201548f0 2023-08-22T00:23:55.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.865+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 52) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f6f18077a40 con 0x7f6f201548f0 2023-08-22T00:23:55.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.866+0000 7f6f177fe700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 0x7f6f000680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:55.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.866+0000 7f6f1f7fe700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 0x7f6f000680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:55.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:55.867+0000 7f6f1f7fe700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 0x7f6f000680b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6f080096e0 tx=0x7f6f08016000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:56.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.426+0000 7f6f177fe700 1 -- 172.21.15.98:0/3743147336 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6f18070340 con 0x7f6f201548f0 2023-08-22T00:23:56.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 msgr2=0x7f6f000680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:56.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 0x7f6f000680b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6f080096e0 tx=0x7f6f08016000).stop 2023-08-22T00:23:56.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 msgr2=0x7f6f200ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f6f1800cb70 tx=0x7f6f18007bd0).stop 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 shutdown_connections 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6f000301b0 0x7f6f000680b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f200ad040 0x7f6f200a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f201548f0 0x7f6f200ac3d0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 --2- 172.21.15.98:0/3743147336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f200ad420 0x7f6f200abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 >> 172.21.15.98:0/3743147336 conn(0x7f6f200cb600 msgr2=0x7f6f200c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:56.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 shutdown_connections 2023-08-22T00:23:56.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.428+0000 7f6f25bd3700 1 -- 172.21.15.98:0/3743147336 wait complete. 2023-08-22T00:23:56.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:23:56.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.565+0000 7efc34428700 1 Processor -- start 2023-08-22T00:23:56.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.565+0000 7efc34428700 1 -- start start 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 0x7efc2c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efc2c069210 0x7efc2c066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c0be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0a86f0 con 0x7efc2c069210 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0a8c70 con 0x7efc2c154f60 2023-08-22T00:23:56.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc34428700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c068210 con 0x7efc2c0673e0 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc319c3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efc2c069210 0x7efc2c066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc319c3700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efc2c069210 0x7efc2c066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48902/0 (socket says 172.21.15.98:48902) 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc319c3700 1 -- 172.21.15.98:0/3717195823 learned_addr learned my addr 172.21.15.98:0/3717195823 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc329c5700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c0be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.566+0000 7efc321c4700 1 --2- 172.21.15.98:0/3717195823 >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 0x7efc2c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 -- 172.21.15.98:0/3717195823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 msgr2=0x7efc2c0be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:56.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c0be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 -- 172.21.15.98:0/3717195823 >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 msgr2=0x7efc2c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 --2- 172.21.15.98:0/3717195823 >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 0x7efc2c068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 -- 172.21.15.98:0/3717195823 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c069690 con 0x7efc2c069210 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc321c4700 1 --2- 172.21.15.98:0/3717195823 >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 0x7efc2c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc319c3700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c069210 0x7efc2c066ef0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7efc2c046db0 tx=0x7efc280090f0).ready entity=mon.0 client_cookie=5dee40ec92197275 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc311c2700 1 -- 172.21.15.98:0/3717195823 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800b600 con 0x7efc2c069210 2023-08-22T00:23:56.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc311c2700 1 -- 172.21.15.98:0/3717195823 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2800b760 con 0x7efc2c069210 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc311c2700 1 -- 172.21.15.98:0/3717195823 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800bb00 con 0x7efc2c069210 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 -- 172.21.15.98:0/3717195823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c069210 msgr2=0x7efc2c066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c069210 0x7efc2c066ef0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7efc2c046db0 tx=0x7efc280090f0).stop 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 -- 172.21.15.98:0/3717195823 shutdown_connections 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c0be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 --2- 172.21.15.98:0/3717195823 >> v2:172.21.15.118:3300/0 conn(0x7efc2c154f60 0x7efc2c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 --2- 172.21.15.98:0/3717195823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c069210 0x7efc2c066ef0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 -- 172.21.15.98:0/3717195823 >> 172.21.15.98:0/3717195823 conn(0x7efc2c0c5dd0 msgr2=0x7efc2c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:56.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.567+0000 7efc34428700 1 -- 172.21.15.98:0/3717195823 shutdown_connections 2023-08-22T00:23:56.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.568+0000 7efc34428700 1 -- 172.21.15.98:0/3717195823 wait complete. 2023-08-22T00:23:56.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.569+0000 7efc34428700 1 Processor -- start 2023-08-22T00:23:56.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.569+0000 7efc34428700 1 -- start start 2023-08-22T00:23:56.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.569+0000 7efc34428700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c166960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c069210 0x7efc2c063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0abc20 con 0x7efc2c154f60 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c064eb0 con 0x7efc2c069210 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0648f0 con 0x7efc2c0673e0 2023-08-22T00:23:56.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48912/0 (socket says 172.21.15.98:48912) 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 -- 172.21.15.98:0/2648128107 learned_addr learned my addr 172.21.15.98:0/2648128107 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc319c3700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c069210 0x7efc2c063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc321c4700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 -- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 msgr2=0x7efc2c166960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c166960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 -- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c069210 msgr2=0x7efc2c063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c069210 0x7efc2c063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 -- 172.21.15.98:0/2648128107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28009370 con 0x7efc2c154f60 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc329c5700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7efc24009fa0 tx=0x7efc24009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400ed20 con 0x7efc2c154f60 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400ee80 con 0x7efc2c154f60 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c064bd0 con 0x7efc2c154f60 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24014610 con 0x7efc2c154f60 2023-08-22T00:23:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.570+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c166e50 con 0x7efc2c154f60 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 52) v1 ==== 75166+0+0 (secure 0 0 0) 0x7efc2401d3b0 con 0x7efc2c154f60 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0c3ae0 con 0x7efc2c154f60 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc227fc700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 0x7efc100611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 7192+0+0 (secure 0 0 0) 0x7efc2407a590 con 0x7efc2c154f60 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc321c4700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 0x7efc100611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.572+0000 7efc321c4700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 0x7efc100611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efc2c065db0 tx=0x7efc1c008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:56.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.576+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc2404b740 con 0x7efc2c154f60 2023-08-22T00:23:56.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:56.739+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc2c067c50 con 0x7efc2c154f60 2023-08-22T00:23:57.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.428+0000 7efc227fc700 1 -- 172.21.15.98:0/2648128107 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc2404ed60 con 0x7efc2c154f60 2023-08-22T00:23:57.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 msgr2=0x7efc100611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 0x7efc100611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efc2c065db0 tx=0x7efc1c008040).stop 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 msgr2=0x7efc2c0aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7efc24009fa0 tx=0x7efc24009900).stop 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 shutdown_connections 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efc1005ecf0 0x7efc100611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc2c0673e0 0x7efc2c166960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc2c154f60 0x7efc2c0aa0d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 --2- 172.21.15.98:0/2648128107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc2c069210 0x7efc2c063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 >> 172.21.15.98:0/2648128107 conn(0x7efc2c0c5dd0 msgr2=0x7efc2c0c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 shutdown_connections 2023-08-22T00:23:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.432+0000 7efc34428700 1 -- 172.21.15.98:0/2648128107 wait complete. 2023-08-22T00:23:57.435 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:23:57.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:23:57.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.569+0000 7f12178f0700 1 Processor -- start 2023-08-22T00:23:57.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.569+0000 7f12178f0700 1 -- start start 2023-08-22T00:23:57.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f12178f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1210153ae0 0x7f12100c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f12178f0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210155360 con 0x7f12100bfd80 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f12178f0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100c0670 con 0x7f12100c0200 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f12178f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1210157b50 con 0x7f1210153ae0 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f1214e8b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f12100bfd80 0x7f1210157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48096/0 (socket says 172.21.15.98:48096) 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f1214e8b700 1 -- 172.21.15.98:0/167543972 learned_addr learned my addr 172.21.15.98:0/167543972 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227954927 0 0) 0x7f120c001110 con 0x7f12100bfd80 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0033f0 con 0x7f12100bfd80 2023-08-22T00:23:57.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.570+0000 7f121568c700 1 --2- 172.21.15.98:0/167543972 >> v2:172.21.15.118:3300/0 conn(0x7f1210153ae0 0x7f12100c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236074552 0 0) 0x7f11fc0033f0 con 0x7f12100bfd80 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 >> v2:172.21.15.118:3300/0 conn(0x7f1210153ae0 msgr2=0x7f12100c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 --2- 172.21.15.98:0/167543972 >> v2:172.21.15.118:3300/0 conn(0x7f1210153ae0 0x7f12100c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 >> v1:172.21.15.118:6789/0 conn(0x7f12100c0200 legacy=0x7f12100645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100c6390 con 0x7f12100bfd80 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f120c001600 con 0x7f12100bfd80 2023-08-22T00:23:57.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 >> v1:172.21.15.98:6789/0 conn(0x7f12100bfd80 legacy=0x7f1210157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11fc0038e0 0x7f11fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f11fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11fc005000 0x7f11fc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210157b50 con 0x7f11fc004690 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00beb0 con 0x7f11fc0038e0 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00c070 con 0x7f11fc005000 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f11fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f121568c700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11fc0038e0 0x7f11fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1215e8d700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11fc005000 0x7f11fc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 -- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11fc005000 msgr2=0x7f11fc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11fc005000 0x7f11fc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 -- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11fc0038e0 msgr2=0x7f11fc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11fc0038e0 0x7f11fc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 -- 172.21.15.98:0/167543972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0033f0 con 0x7f11fc004690 2023-08-22T00:23:57.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1215e8d700 1 -- 172.21.15.98:0/167543972 reap_dead start 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1214e8b700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f11fc004b10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f120c00c390 tx=0x7f120c0078d0).ready entity=mon.0 client_cookie=e898f0247f1bd8c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00cc60 con 0x7f11fc004690 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00cdc0 con 0x7f11fc004690 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.571+0000 7f1207fff700 1 -- 172.21.15.98:0/167543972 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0072e0 con 0x7f11fc004690 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 -- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 msgr2=0x7f11fc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f11fc004b10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f120c00c390 tx=0x7f120c0078d0).stop 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 -- 172.21.15.98:0/167543972 shutdown_connections 2023-08-22T00:23:57.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 --2- 172.21.15.98:0/167543972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f11fc004b10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 -- 172.21.15.98:0/167543972 >> 172.21.15.98:0/167543972 conn(0x7f12100caa50 msgr2=0x7f12100cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:57.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 -- 172.21.15.98:0/167543972 shutdown_connections 2023-08-22T00:23:57.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.572+0000 7f12178f0700 1 -- 172.21.15.98:0/167543972 wait complete. 2023-08-22T00:23:57.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.573+0000 7f12178f0700 1 Processor -- start 2023-08-22T00:23:57.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.573+0000 7f12178f0700 1 -- start start 2023-08-22T00:23:57.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1210152930 0x7f12100af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1210152db0 0x7f12100afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210150e10 con 0x7f11fc004690 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210150570 con 0x7f1210152db0 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f12178f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ae280 con 0x7f1210152930 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48932/0 (socket says 172.21.15.98:48932) 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 -- 172.21.15.98:0/262049783 learned_addr learned my addr 172.21.15.98:0/262049783 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f1214e8b700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1210152930 0x7f12100af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f1215e8d700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1210152db0 0x7f12100afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 -- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1210152930 msgr2=0x7f12100af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1210152930 0x7f12100af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 -- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1210152db0 msgr2=0x7f12100afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1210152db0 0x7f12100afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 -- 172.21.15.98:0/262049783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100c4240 con 0x7f11fc004690 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.574+0000 7f121568c700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f1200011a20 tx=0x7f1200009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.575+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200011e60 con 0x7f11fc004690 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.575+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120000f940 con 0x7f11fc004690 2023-08-22T00:23:57.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.575+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12101507c0 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.575+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000fcc0 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.575+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100b00c0 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.576+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12101510f0 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.576+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 52) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f1200014650 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.576+0000 7f12057fa700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 0x7f11f40611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.576+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6638+0+0 (secure 0 0 0) 0x7f120007a870 con 0x7f11fc004690 2023-08-22T00:23:57.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.576+0000 7f1214e8b700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 0x7f11f40611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:57.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.577+0000 7f1214e8b700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 0x7f11f40611e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f12100c4af0 tx=0x7f120c015000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:57.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.580+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f120004bcb0 con 0x7f11fc004690 2023-08-22T00:23:57.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.745+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1210047480 con 0x7f11fc004690 2023-08-22T00:23:57.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:57.877+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1200078610 con 0x7f11fc004690 2023-08-22T00:23:58.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.435+0000 7f12057fa700 1 -- 172.21.15.98:0/262049783 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) v1 ==== 169+0+0 (secure 0 0 0) 0x7f12000703d0 con 0x7f11fc004690 2023-08-22T00:23:58.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 msgr2=0x7f11f40611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 0x7f11f40611e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f12100c4af0 tx=0x7f120c015000).stop 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 msgr2=0x7f12100add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f1200011a20 tx=0x7f1200009060).stop 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 shutdown_connections 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1210152db0 0x7f12100afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11fc004690 0x7f12100add90 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11f405ed20 0x7f11f40611e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 --2- 172.21.15.98:0/262049783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1210152930 0x7f12100af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 >> 172.21.15.98:0/262049783 conn(0x7f12100caa50 msgr2=0x7f1210063280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:58.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 shutdown_connections 2023-08-22T00:23:58.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.438+0000 7f12178f0700 1 -- 172.21.15.98:0/262049783 wait complete. 2023-08-22T00:23:58.441 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:23:58.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:23:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.572+0000 7f42c94d4700 1 Processor -- start 2023-08-22T00:23:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 -- start start 2023-08-22T00:23:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f42c40635a0 0x7f42c40c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 0x7f42c4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4063f90 con 0x7f42c41505e0 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40656f0 con 0x7f42c40635a0 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.573+0000 7f42c94d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41509c0 con 0x7f42c40c2400 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f42c40635a0 0x7f42c40c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c2ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f42c41505e0 0x7f42c4062e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48108/0 (socket says 172.21.15.98:48108) 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c2ffd700 1 -- 172.21.15.98:0/4011423504 learned_addr learned my addr 172.21.15.98:0/4011423504 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:58.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c37fe700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 0x7f42c4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 -- 172.21.15.98:0/4011423504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 msgr2=0x7f42c4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:58.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 0x7f42c4065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 -- 172.21.15.98:0/4011423504 >> v1:172.21.15.98:6789/0 conn(0x7f42c41505e0 legacy=0x7f42c4062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 -- 172.21.15.98:0/4011423504 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40650c0 con 0x7f42c40635a0 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c1ffb700 1 -- 172.21.15.98:0/4011423504 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697634061 0 0) 0x7f42c4063f90 con 0x7f42c41505e0 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c37fe700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 0x7f42c4065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c27fc700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40635a0 0x7f42c40c1f10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f42b400ba00 tx=0x7f42b4006f30).ready entity=mon.0 client_cookie=557e5396db4bccf1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c1ffb700 1 -- 172.21.15.98:0/4011423504 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400db70 con 0x7f42c40635a0 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c1ffb700 1 -- 172.21.15.98:0/4011423504 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400dcd0 con 0x7f42c40635a0 2023-08-22T00:23:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.574+0000 7f42c1ffb700 1 -- 172.21.15.98:0/4011423504 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4015600 con 0x7f42c40635a0 2023-08-22T00:23:58.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 -- 172.21.15.98:0/4011423504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40635a0 msgr2=0x7f42c40c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40635a0 0x7f42c40c1f10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f42b400ba00 tx=0x7f42b4006f30).stop 2023-08-22T00:23:58.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 -- 172.21.15.98:0/4011423504 shutdown_connections 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c40c2400 0x7f42c4065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 --2- 172.21.15.98:0/4011423504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40635a0 0x7f42c40c1f10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 -- 172.21.15.98:0/4011423504 >> 172.21.15.98:0/4011423504 conn(0x7f42c40c31d0 msgr2=0x7f42c40c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 -- 172.21.15.98:0/4011423504 shutdown_connections 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.575+0000 7f42c94d4700 1 -- 172.21.15.98:0/4011423504 wait complete. 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.576+0000 7f42c94d4700 1 Processor -- start 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.576+0000 7f42c94d4700 1 -- start start 2023-08-22T00:23:58.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 0x7f42c414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 0x7f42c4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4155a30 con 0x7f42c40c2400 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c414bc40 con 0x7f42c40635a0 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41642a0 con 0x7f42c41505e0 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48944/0 (socket says 172.21.15.98:48944) 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 -- 172.21.15.98:0/2385777046 learned_addr learned my addr 172.21.15.98:0/2385777046 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c37fe700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 0x7f42c4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c2ffd700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 0x7f42c414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 -- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 msgr2=0x7f42c4155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 0x7f42c4155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 -- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 msgr2=0x7f42c414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 0x7f42c414b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 -- 172.21.15.98:0/2385777046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b400b540 con 0x7f42c40c2400 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c37fe700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 0x7f42c4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c2ffd700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 0x7f42c414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c27fc700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f42b4014000 tx=0x7f42b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b401e630 con 0x7f42c40c2400 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b401e790 con 0x7f42c40c2400 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c41634e0 con 0x7f42c40c2400 2023-08-22T00:23:58.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.577+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b401eb50 con 0x7f42c40c2400 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.578+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4163aa0 con 0x7f42c40c2400 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.578+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c40c2bf0 con 0x7f42c40c2400 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.579+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f42b401c070 con 0x7f42c40c2400 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.579+0000 7f42aaffd700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 0x7f42b00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.579+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7f42b407d280 con 0x7f42c40c2400 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.579+0000 7f42c2ffd700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 0x7f42b00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.579+0000 7f42c2ffd700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 0x7f42b00612d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f42c4155400 tx=0x7f42b8009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.583+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42b404e690 con 0x7f42c40c2400 2023-08-22T00:23:58.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.745+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f42c4063d70 con 0x7f42c40c2400 2023-08-22T00:23:58.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.748+0000 7f42aaffd700 1 -- 172.21.15.98:0/2385777046 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42b4051cb0 con 0x7f42c40c2400 2023-08-22T00:23:58.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 msgr2=0x7f42b00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 0x7f42b00612d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f42c4155400 tx=0x7f42b8009040).stop 2023-08-22T00:23:58.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 msgr2=0x7f42c414ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f42b4014000 tx=0x7f42b401a000).stop 2023-08-22T00:23:58.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 shutdown_connections 2023-08-22T00:23:58.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f42b005ee10 0x7f42b00612d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42c41505e0 0x7f42c4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c40635a0 0x7f42c414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 --2- 172.21.15.98:0/2385777046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42c40c2400 0x7f42c414ad90 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 >> 172.21.15.98:0/2385777046 conn(0x7f42c40c31d0 msgr2=0x7f42c40c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:58.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 shutdown_connections 2023-08-22T00:23:58.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.750+0000 7f42c94d4700 1 -- 172.21.15.98:0/2385777046 wait complete. 2023-08-22T00:23:58.763 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:23:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.880+0000 7f21ac695700 1 Processor -- start 2023-08-22T00:23:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.880+0000 7f21ac695700 1 -- start start 2023-08-22T00:23:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.881+0000 7f21ac695700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21a40654d0 0x7f21a40c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.881+0000 7f21ac695700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a4154730 con 0x7f21a41542a0 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.881+0000 7f21ac695700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a4154a10 con 0x7f21a40658b0 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.881+0000 7f21ac695700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4154cf0 con 0x7f21a40654d0 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21a40654d0 0x7f21a40c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21a40654d0 0x7f21a40c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48952/0 (socket says 172.21.15.98:48952) 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aac32700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f21a41542a0 0x7f21a4065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48112/0 (socket says 172.21.15.98:48112) 2023-08-22T00:23:58.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 -- 172.21.15.98:0/2384664988 learned_addr learned my addr 172.21.15.98:0/2384664988 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 -- 172.21.15.98:0/2384664988 >> v1:172.21.15.118:6789/0 conn(0x7f21a40658b0 legacy=0x7f21a40c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 -- 172.21.15.98:0/2384664988 >> v1:172.21.15.98:6789/0 conn(0x7f21a41542a0 legacy=0x7f21a4065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 -- 172.21.15.98:0/2384664988 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4154fd0 con 0x7f21a40654d0 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21a942f700 1 -- 172.21.15.98:0/2384664988 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316987732 0 0) 0x7f21a4154730 con 0x7f21a41542a0 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21aa431700 1 --2- 172.21.15.98:0/2384664988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40654d0 0x7f21a40c3760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f2194006fd0 tx=0x7f21940090f0).ready entity=mon.0 client_cookie=a3742b10b1a0991f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21a942f700 1 -- 172.21.15.98:0/2384664988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400b600 con 0x7f21a40654d0 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21a942f700 1 -- 172.21.15.98:0/2384664988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219400b760 con 0x7f21a40654d0 2023-08-22T00:23:58.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.882+0000 7f21a942f700 1 -- 172.21.15.98:0/2384664988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400bae0 con 0x7f21a40654d0 2023-08-22T00:23:58.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 -- 172.21.15.98:0/2384664988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40654d0 msgr2=0x7f21a40c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 --2- 172.21.15.98:0/2384664988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40654d0 0x7f21a40c3760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f2194006fd0 tx=0x7f21940090f0).stop 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 -- 172.21.15.98:0/2384664988 shutdown_connections 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 --2- 172.21.15.98:0/2384664988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40654d0 0x7f21a40c3760 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 -- 172.21.15.98:0/2384664988 >> 172.21.15.98:0/2384664988 conn(0x7f21a40c7800 msgr2=0x7f21a40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 -- 172.21.15.98:0/2384664988 shutdown_connections 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.883+0000 7f21ac695700 1 -- 172.21.15.98:0/2384664988 wait complete. 2023-08-22T00:23:58.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.884+0000 7f21ac695700 1 Processor -- start 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.884+0000 7f21ac695700 1 -- start start 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21a40654d0 0x7f21a40bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21a40658b0 0x7f21a41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c1120 con 0x7f21a40bffd0 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c04a0 con 0x7f21a40658b0 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c0780 con 0x7f21a40654d0 2023-08-22T00:23:58.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48956/0 (socket says 172.21.15.98:48956) 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 -- 172.21.15.98:0/3465351936 learned_addr learned my addr 172.21.15.98:0/3465351936 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aa431700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21a40654d0 0x7f21a40bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21a9c30700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21a40658b0 0x7f21a41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 -- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21a40654d0 msgr2=0x7f21a40bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21a40654d0 0x7f21a40bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 -- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21a40658b0 msgr2=0x7f21a41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:58.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21a40658b0 0x7f21a41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 -- 172.21.15.98:0/3465351936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009370 con 0x7f21a40bffd0 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21aac32700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f219c00c810 tx=0x7f219c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c005c70 con 0x7f21a40bffd0 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c005df0 con 0x7f21a40bffd0 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40c0a60 con 0x7f21a40bffd0 2023-08-22T00:23:58.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.885+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c007360 con 0x7f21a40bffd0 2023-08-22T00:23:58.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.886+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40a9fe0 con 0x7f21a40bffd0 2023-08-22T00:23:58.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.886+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4069220 con 0x7f21a40bffd0 2023-08-22T00:23:58.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.887+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f219c007710 con 0x7f21a40bffd0 2023-08-22T00:23:58.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.887+0000 7f219a7fc700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 0x7f21880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:58.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.887+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7f219c079ea0 con 0x7f21a40bffd0 2023-08-22T00:23:58.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.887+0000 7f21aa431700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 0x7f21880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:58.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.887+0000 7f21aa431700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 0x7f21880612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2194009130 tx=0x7f2194017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:58.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:58.891+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f219c04b2b0 con 0x7f21a40bffd0 2023-08-22T00:23:59.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.053+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f21a40c3c50 con 0x7f21a40bffd0 2023-08-22T00:23:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.057+0000 7f219a7fc700 1 -- 172.21.15.98:0/3465351936 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f219c04e8d0 con 0x7f21a40bffd0 2023-08-22T00:23:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 msgr2=0x7f21880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 0x7f21880612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2194009130 tx=0x7f2194017000).stop 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 msgr2=0x7f21a4138e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f219c00c810 tx=0x7f219c007f30).stop 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 shutdown_connections 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f218805ee10 0x7f21880612d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21a40654d0 0x7f21a40bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a40bffd0 0x7f21a4138e90 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 --2- 172.21.15.98:0/3465351936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21a40658b0 0x7f21a41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 >> 172.21.15.98:0/3465351936 conn(0x7f21a40c7800 msgr2=0x7f21a4157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:59.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 shutdown_connections 2023-08-22T00:23:59.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.059+0000 7f21ac695700 1 -- 172.21.15.98:0/3465351936 wait complete. 2023-08-22T00:23:59.072 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-22T00:23:59.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.186+0000 7f3c5d8f0700 1 Processor -- start 2023-08-22T00:23:59.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.186+0000 7f3c5d8f0700 1 -- start start 2023-08-22T00:23:59.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c5d8f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3c581550a0 0x7f3c58063b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c5d8f0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c58066420 con 0x7f3c58155fe0 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c5d8f0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c58064360 con 0x7f3c58155480 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c5d8f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c58064640 con 0x7f3c581550a0 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c577fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3c58155fe0 0x7f3c580668b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48116/0 (socket says 172.21.15.98:48116) 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c577fe700 1 -- 172.21.15.98:0/3626610585 learned_addr learned my addr 172.21.15.98:0/3626610585 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016705026 0 0) 0x7f3c58066420 con 0x7f3c58155fe0 2023-08-22T00:23:59.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c400033f0 con 0x7f3c58155fe0 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/3626610585 >> v2:172.21.15.118:3300/0 conn(0x7f3c581550a0 0x7f3c58063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3988548359 0 0) 0x7f3c400033f0 con 0x7f3c58155fe0 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 >> v2:172.21.15.118:3300/0 conn(0x7f3c581550a0 msgr2=0x7f3c58063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 --2- 172.21.15.98:0/3626610585 >> v2:172.21.15.118:3300/0 conn(0x7f3c581550a0 0x7f3c58063b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 >> v1:172.21.15.118:6789/0 conn(0x7f3c58155480 legacy=0x7f3c581558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580660b0 con 0x7f3c58155fe0 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f3c500017f0 con 0x7f3c58155fe0 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 >> v1:172.21.15.98:6789/0 conn(0x7f3c58155fe0 legacy=0x7f3c580668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c400038e0 0x7f3c40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40004690 0x7f3c40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 0x7f3c4000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58064640 con 0x7f3c40005000 2023-08-22T00:23:59.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000beb0 con 0x7f3c40004690 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000c070 con 0x7f3c400038e0 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c577fe700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 0x7f3c4000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.187+0000 7f3c567fc700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40004690 0x7f3c40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c400038e0 0x7f3c40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 -- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c400038e0 msgr2=0x7f3c40003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c400038e0 0x7f3c40003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 -- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40004690 msgr2=0x7f3c40004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40004690 0x7f3c40004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 -- 172.21.15.98:0/3626610585 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400033f0 con 0x7f3c40005000 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 -- 172.21.15.98:0/3626610585 reap_dead start 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c577fe700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 0x7f3c4000b8e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f3c5000c5f0 tx=0x7f3c580bcef0).ready entity=mon.0 client_cookie=9e6f3e92392f7be8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000cdf0 con 0x7f3c40005000 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50005b20 con 0x7f3c40005000 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c55ffb700 1 -- 172.21.15.98:0/3626610585 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50005ea0 con 0x7f3c40005000 2023-08-22T00:23:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 msgr2=0x7f3c4000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 0x7f3c4000b8e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f3c5000c5f0 tx=0x7f3c580bcef0).stop 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/3626610585 shutdown_connections 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/3626610585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c40005000 0x7f3c4000b8e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.188+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/3626610585 >> 172.21.15.98:0/3626610585 conn(0x7f3c580c7770 msgr2=0x7f3c580c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.189+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/3626610585 shutdown_connections 2023-08-22T00:23:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.189+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/3626610585 wait complete. 2023-08-22T00:23:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.190+0000 7f3c5d8f0700 1 Processor -- start 2023-08-22T00:23:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.190+0000 7f3c5d8f0700 1 -- start start 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 0x7f3c580c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c580bfa30 0x7f3c58145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580bf6d0 con 0x7f3c58145a50 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580c3100 con 0x7f3c40005000 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580c3380 con 0x7f3c580bfa30 2023-08-22T00:23:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48976/0 (socket says 172.21.15.98:48976) 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 -- 172.21.15.98:0/2621568812 learned_addr learned my addr 172.21.15.98:0/2621568812 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 0x7f3c580c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c567fc700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c580bfa30 0x7f3c58145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 -- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c580bfa30 msgr2=0x7f3c58145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c580bfa30 0x7f3c58145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 -- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 msgr2=0x7f3c580c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:23:59.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 0x7f3c580c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 -- 172.21.15.98:0/2621568812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580c3660 con 0x7f3c58145a50 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 0x7f3c580c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c577fe700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f3c580c8420 tx=0x7f3c50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500017f0 con 0x7f3c58145a50 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50013450 con 0x7f3c58145a50 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c580c3940 con 0x7f3c58145a50 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50005ea0 con 0x7f3c58145a50 2023-08-22T00:23:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.191+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c580a4d50 con 0x7f3c58145a50 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.192+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c580a4f40 con 0x7f3c58145a50 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.192+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3c50013ac0 con 0x7f3c58145a50 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.193+0000 7f3c3effd700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 0x7f3c440612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.193+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7f3c5007b2d0 con 0x7f3c58145a50 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.193+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 0x7f3c440612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.193+0000 7f3c56ffd700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 0x7f3c440612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3c48006d50 tx=0x7f3c48008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:23:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.197+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c5004c7a0 con 0x7f3c58145a50 2023-08-22T00:23:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:23:59.434+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f3c58047480 con 0x7f3c58145a50 2023-08-22T00:24:00.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.437+0000 7f3c3effd700 1 -- 172.21.15.98:0/2621568812 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v666) v1 ==== 183+0+0 (secure 0 0 0) 0x7f3c50025070 con 0x7f3c58145a50 2023-08-22T00:24:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.439+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 msgr2=0x7f3c440612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 0x7f3c440612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3c48006d50 tx=0x7f3c48008040).stop 2023-08-22T00:24:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 msgr2=0x7f3c580be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f3c580c8420 tx=0x7f3c50015000).stop 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 shutdown_connections 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58145a50 0x7f3c580be810 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c40005000 0x7f3c580c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3c4405ee10 0x7f3c440612d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 --2- 172.21.15.98:0/2621568812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c580bfa30 0x7f3c58145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 >> 172.21.15.98:0/2621568812 conn(0x7f3c580c7770 msgr2=0x7f3c5814f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 shutdown_connections 2023-08-22T00:24:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.440+0000 7f3c5d8f0700 1 -- 172.21.15.98:0/2621568812 wait complete. 2023-08-22T00:24:00.455 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-08-22T00:24:00.456 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-08-22T00:24:00.456 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:24:00.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-22T00:24:00.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.577+0000 7fec47786700 1 Processor -- start 2023-08-22T00:24:00.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.578+0000 7fec47786700 1 -- start start 2023-08-22T00:24:00.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.578+0000 7fec47786700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec40150e40 0x7fec400c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.578+0000 7fec47786700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fec400bd870 0x7fec400a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec47786700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec400bd3e0 con 0x7fec40065f10 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec47786700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec400bd0c0 con 0x7fec400bd870 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec47786700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec400c3bb0 con 0x7fec40150e40 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fec400bd870 0x7fec400a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fec400bd870 0x7fec400a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50640/0 (socket says 172.21.15.98:50640) 2023-08-22T00:24:00.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 -- 172.21.15.98:0/1054301486 learned_addr learned my addr 172.21.15.98:0/1054301486 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec45522700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec40150e40 0x7fec400c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 -- 172.21.15.98:0/1054301486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec40150e40 msgr2=0x7fec400c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec40150e40 0x7fec400c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 -- 172.21.15.98:0/1054301486 >> v1:172.21.15.118:6789/0 conn(0x7fec40065f10 legacy=0x7fec40154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 -- 172.21.15.98:0/1054301486 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec400c3e90 con 0x7fec400bd870 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec44d21700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec400bd870 0x7fec400a6950 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fec3c006fd0 tx=0x7fec3c00b3b0).ready entity=mon.0 client_cookie=9aaee5e63635d257 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec37fff700 1 -- 172.21.15.98:0/1054301486 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00db40 con 0x7fec400bd870 2023-08-22T00:24:00.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec37fff700 1 -- 172.21.15.98:0/1054301486 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c00dca0 con 0x7fec400bd870 2023-08-22T00:24:00.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.579+0000 7fec37fff700 1 -- 172.21.15.98:0/1054301486 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c010680 con 0x7fec400bd870 2023-08-22T00:24:00.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 -- 172.21.15.98:0/1054301486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec400bd870 msgr2=0x7fec400a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec400bd870 0x7fec400a6950 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fec3c006fd0 tx=0x7fec3c00b3b0).stop 2023-08-22T00:24:00.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 -- 172.21.15.98:0/1054301486 shutdown_connections 2023-08-22T00:24:00.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec40150e40 0x7fec400c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 --2- 172.21.15.98:0/1054301486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec400bd870 0x7fec400a6950 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 -- 172.21.15.98:0/1054301486 >> 172.21.15.98:0/1054301486 conn(0x7fec4006a980 msgr2=0x7fec400c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 -- 172.21.15.98:0/1054301486 shutdown_connections 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.580+0000 7fec47786700 1 -- 172.21.15.98:0/1054301486 wait complete. 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.581+0000 7fec47786700 1 Processor -- start 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.581+0000 7fec47786700 1 -- start start 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec40065f10 0x7fec40151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec400bd870 0x7fec4013cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40153f60 con 0x7fec40150e40 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40154240 con 0x7fec40065f10 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec47786700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec40154520 con 0x7fec400bd870 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50652/0 (socket says 172.21.15.98:50652) 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 -- 172.21.15.98:0/3764359204 learned_addr learned my addr 172.21.15.98:0/3764359204 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:00.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec44d21700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec400bd870 0x7fec4013cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45522700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec40065f10 0x7fec40151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 -- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec400bd870 msgr2=0x7fec4013cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec400bd870 0x7fec4013cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 -- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec40065f10 msgr2=0x7fec40151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec40065f10 0x7fec40151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.582+0000 7fec45d23700 1 -- 172.21.15.98:0/3764359204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c00b610 con 0x7fec40150e40 2023-08-22T00:24:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec45d23700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fec38002230 tx=0x7fec380015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800e4a0 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3800e600 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800e980 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4013d5f0 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.583+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec40153970 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.584+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40047480 con 0x7fec40150e40 2023-08-22T00:24:00.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.584+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fec3801b3b0 con 0x7fec40150e40 2023-08-22T00:24:00.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.584+0000 7fec357fa700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 0x7fec240612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:00.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.584+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7fec38079490 con 0x7fec40150e40 2023-08-22T00:24:00.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.584+0000 7fec45522700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 0x7fec240612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:00.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.585+0000 7fec45522700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 0x7fec240612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fec40153270 tx=0x7fec30008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:00.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.588+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec380488f0 con 0x7fec40150e40 2023-08-22T00:24:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:00.814+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fec400c3810 con 0x7fec40150e40 2023-08-22T00:24:01.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.440+0000 7fec357fa700 1 -- 172.21.15.98:0/3764359204 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v667) v1 ==== 151+0+0 (secure 0 0 0) 0x7fec3804a8f0 con 0x7fec40150e40 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.442+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 msgr2=0x7fec240612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.442+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 0x7fec240612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fec40153270 tx=0x7fec30008040).stop 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.442+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 msgr2=0x7fec40153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.442+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fec38002230 tx=0x7fec380015e0).stop 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 shutdown_connections 2023-08-22T00:24:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec40150e40 0x7fec40153480 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec40065f10 0x7fec40151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fec2405ee10 0x7fec240612d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 --2- 172.21.15.98:0/3764359204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec400bd870 0x7fec4013cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 >> 172.21.15.98:0/3764359204 conn(0x7fec4006a980 msgr2=0x7fec400c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 shutdown_connections 2023-08-22T00:24:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.443+0000 7fec47786700 1 -- 172.21.15.98:0/3764359204 wait complete. 2023-08-22T00:24:01.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:24:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.580+0000 7fc240f73700 1 Processor -- start 2023-08-22T00:24:01.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.580+0000 7fc240f73700 1 -- start start 2023-08-22T00:24:01.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc240f73700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 0x7fc23c066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc240f73700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc23c157890 0x7fc23c0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc240f73700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0c69b0 con 0x7fc23c0c5360 2023-08-22T00:24:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc240f73700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c1542c0 con 0x7fc23c157890 2023-08-22T00:24:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc240f73700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c57f0 con 0x7fc23c066150 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc23ad9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc23c157890 0x7fc23c0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc23a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 0x7fc23c066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc239d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc23c0c5360 0x7fc23c0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56188/0 (socket says 172.21.15.98:56188) 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc239d9b700 1 -- 172.21.15.98:0/1815012482 learned_addr learned my addr 172.21.15.98:0/1815012482 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc23ad9d700 1 -- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 msgr2=0x7fc23c066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.581+0000 7fc23ad9d700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 0x7fc23c066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23ad9d700 1 -- 172.21.15.98:0/1815012482 >> v1:172.21.15.118:6789/0 conn(0x7fc23c0c5360 legacy=0x7fc23c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23ad9d700 1 -- 172.21.15.98:0/1815012482 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0c5ad0 con 0x7fc23c157890 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23a59c700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 0x7fc23c066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23ad9d700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c157890 0x7fc23c0c33f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc234009e60 tx=0x7fc234009780).ready entity=mon.1 client_cookie=78b77c6bc9b6ff4a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23959a700 1 -- 172.21.15.98:0/1815012482 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23400e070 con 0x7fc23c157890 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23959a700 1 -- 172.21.15.98:0/1815012482 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23400bb60 con 0x7fc23c157890 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc23959a700 1 -- 172.21.15.98:0/1815012482 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234012410 con 0x7fc23c157890 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 -- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c157890 msgr2=0x7fc23c0c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c157890 0x7fc23c0c33f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc234009e60 tx=0x7fc234009780).stop 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 -- 172.21.15.98:0/1815012482 shutdown_connections 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c157890 0x7fc23c0c33f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 --2- 172.21.15.98:0/1815012482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c066150 0x7fc23c066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 -- 172.21.15.98:0/1815012482 >> 172.21.15.98:0/1815012482 conn(0x7fc23c0c7800 msgr2=0x7fc23c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 -- 172.21.15.98:0/1815012482 shutdown_connections 2023-08-22T00:24:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.582+0000 7fc240f73700 1 -- 172.21.15.98:0/1815012482 wait complete. 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 Processor -- start 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 -- start start 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c066150 0x7fc23c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c0a77d0 0x7fc23c0a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0a47c0 con 0x7fc23c157890 2023-08-22T00:24:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0a7c50 con 0x7fc23c066150 2023-08-22T00:24:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc240f73700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0a3ed0 con 0x7fc23c0a77d0 2023-08-22T00:24:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc239d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc239d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50662/0 (socket says 172.21.15.98:50662) 2023-08-22T00:24:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.584+0000 7fc239d9b700 1 -- 172.21.15.98:0/2062399683 learned_addr learned my addr 172.21.15.98:0/2062399683 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc23a59c700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c066150 0x7fc23c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc23ad9d700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c0a77d0 0x7fc23c0a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 -- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c0a77d0 msgr2=0x7fc23c0a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c0a77d0 0x7fc23c0a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 -- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c066150 msgr2=0x7fc23c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c066150 0x7fc23c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 -- 172.21.15.98:0/2062399683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0092a0 con 0x7fc23c157890 2023-08-22T00:24:01.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc239d9b700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fc23000c470 tx=0x7fc230007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300072e0 con 0x7fc23c157890 2023-08-22T00:24:01.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230007440 con 0x7fc23c157890 2023-08-22T00:24:01.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc234009a20 con 0x7fc23c157890 2023-08-22T00:24:01.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300057a0 con 0x7fc23c157890 2023-08-22T00:24:01.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.585+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c0a4170 con 0x7fc23c157890 2023-08-22T00:24:01.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.586+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c069220 con 0x7fc23c157890 2023-08-22T00:24:01.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.586+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc230005bd0 con 0x7fc23c157890 2023-08-22T00:24:01.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.587+0000 7fc22a7fc700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 0x7fc21c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.587+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7fc230079600 con 0x7fc23c157890 2023-08-22T00:24:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.587+0000 7fc23a59c700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 0x7fc21c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.587+0000 7fc23a59c700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 0x7fc21c0612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc22c009270 tx=0x7fc22c008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.591+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc23004aa10 con 0x7fc23c157890 2023-08-22T00:24:01.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.752+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc23c0a4900 con 0x7fc23c157890 2023-08-22T00:24:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.755+0000 7fc22a7fc700 1 -- 172.21.15.98:0/2062399683 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc23004e030 con 0x7fc23c157890 2023-08-22T00:24:01.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 msgr2=0x7fc21c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 0x7fc21c0612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc22c009270 tx=0x7fc22c008040).stop 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 msgr2=0x7fc23c0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fc23000c470 tx=0x7fc230007d90).stop 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 shutdown_connections 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc21c05ee10 0x7fc21c0612d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc23c0a77d0 0x7fc23c0a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc23c066150 0x7fc23c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 --2- 172.21.15.98:0/2062399683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc23c157890 0x7fc23c0a72e0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 >> 172.21.15.98:0/2062399683 conn(0x7fc23c0c7800 msgr2=0x7fc23c064af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 shutdown_connections 2023-08-22T00:24:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.757+0000 7fc240f73700 1 -- 172.21.15.98:0/2062399683 wait complete. 2023-08-22T00:24:01.771 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:24:01.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:24:01.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:24:01.858 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:24:01.859 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:24:01.859 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:24:01.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.973+0000 7f8c226c8700 1 Processor -- start 2023-08-22T00:24:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.974+0000 7f8c226c8700 1 -- start start 2023-08-22T00:24:01.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.974+0000 7f8c226c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c1c0aa040 0x7f8c1c0c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.974+0000 7f8c226c8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c062a10 con 0x7f8c1c153f70 2023-08-22T00:24:01.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.974+0000 7f8c226c8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0c1230 con 0x7f8c1c0a9c60 2023-08-22T00:24:01.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.974+0000 7f8c226c8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c1050 con 0x7f8c1c0aa040 2023-08-22T00:24:01.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8c1c153f70 0x7f8c1c062ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49626/0 (socket says 172.21.15.98:49626) 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1b7fe700 1 -- 172.21.15.98:0/1558424726 learned_addr learned my addr 172.21.15.98:0/1558424726 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474811413 0 0) 0x7f8c1c062a10 con 0x7f8c1c153f70 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c040033f0 con 0x7f8c1c153f70 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c20c65700 1 --2- 172.21.15.98:0/1558424726 >> v2:172.21.15.118:3300/0 conn(0x7f8c1c0aa040 0x7f8c1c0c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261944488 0 0) 0x7f8c040033f0 con 0x7f8c1c153f70 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 >> v2:172.21.15.118:3300/0 conn(0x7f8c1c0aa040 msgr2=0x7f8c1c0c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 --2- 172.21.15.98:0/1558424726 >> v2:172.21.15.118:3300/0 conn(0x7f8c1c0aa040 0x7f8c1c0c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 >> v1:172.21.15.118:6789/0 conn(0x7f8c1c0a9c60 legacy=0x7f8c1c153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0c1510 con 0x7f8c1c153f70 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8c10001470 con 0x7f8c1c153f70 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 >> v1:172.21.15.98:6789/0 conn(0x7f8c1c153f70 legacy=0x7f8c1c062ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c04003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04004690 0x7f8c04004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c04005120 0x7f8c0400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c1050 con 0x7f8c040038e0 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c080 con 0x7f8c04004690 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c240 con 0x7f8c04005120 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c04003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c1b7fe700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04004690 0x7f8c04004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.975+0000 7f8c20c65700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c04005120 0x7f8c0400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 -- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c04005120 msgr2=0x7f8c0400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c04005120 0x7f8c0400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 -- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04004690 msgr2=0x7f8c04004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04004690 0x7f8c04004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c20c65700 1 -- 172.21.15.98:0/1558424726 reap_dead start 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 -- 172.21.15.98:0/1558424726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040033f0 con 0x7f8c040038e0 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c04003d00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f8c0c001730 tx=0x7f8c0c007bb0).ready entity=mon.0 client_cookie=af19ae4ac19f41d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c007020 con 0x7f8c040038e0 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c007180 con 0x7f8c040038e0 2023-08-22T00:24:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c1affd700 1 -- 172.21.15.98:0/1558424726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c007520 con 0x7f8c040038e0 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 -- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 msgr2=0x7f8c04003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c04003d00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f8c0c001730 tx=0x7f8c0c007bb0).stop 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 -- 172.21.15.98:0/1558424726 shutdown_connections 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 --2- 172.21.15.98:0/1558424726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c04003d00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 -- 172.21.15.98:0/1558424726 >> 172.21.15.98:0/1558424726 conn(0x7f8c1c0cb5a0 msgr2=0x7f8c1c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 -- 172.21.15.98:0/1558424726 shutdown_connections 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.976+0000 7f8c226c8700 1 -- 172.21.15.98:0/1558424726 wait complete. 2023-08-22T00:24:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.977+0000 7f8c226c8700 1 Processor -- start 2023-08-22T00:24:01.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 -- start start 2023-08-22T00:24:01.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c1c167a40 0x7f8c1c167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c1c144170 0x7f8c1c1445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c14c170 con 0x7f8c040038e0 2023-08-22T00:24:01.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c4230 con 0x7f8c1c144170 2023-08-22T00:24:01.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c226c8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0adae0 con 0x7f8c1c167a40 2023-08-22T00:24:01.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c1bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c1bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50684/0 (socket says 172.21.15.98:50684) 2023-08-22T00:24:01.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.978+0000 7f8c1bfff700 1 -- 172.21.15.98:0/4019781319 learned_addr learned my addr 172.21.15.98:0/4019781319 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:01.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 -- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c1c167a40 msgr2=0x7f8c1c167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c1c167a40 0x7f8c1c167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:01.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 -- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c1c144170 msgr2=0x7f8c1c1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:01.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c1c144170 0x7f8c1c1445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:01.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 -- 172.21.15.98:0/4019781319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c14be40 con 0x7f8c040038e0 2023-08-22T00:24:01.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c1bfff700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f8c0c001d20 tx=0x7f8c0c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c006f50 con 0x7f8c040038e0 2023-08-22T00:24:01.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c01e440 con 0x7f8c040038e0 2023-08-22T00:24:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c0c3c70 con 0x7f8c040038e0 2023-08-22T00:24:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c01e800 con 0x7f8c040038e0 2023-08-22T00:24:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.979+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c157180 con 0x7f8c040038e0 2023-08-22T00:24:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.980+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c14c450 con 0x7f8c040038e0 2023-08-22T00:24:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.981+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8c0c012400 con 0x7f8c040038e0 2023-08-22T00:24:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.981+0000 7f8c03fff700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 0x7f8c080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.981+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6224+0+0 (secure 0 0 0) 0x7f8c0c07ad00 con 0x7f8c040038e0 2023-08-22T00:24:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.981+0000 7f8c1b7fe700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 0x7f8c080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.982+0000 7f8c1b7fe700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 0x7f8c080612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8c1c0c2670 tx=0x7f8c10001e50).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:01.985+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c0c04c010 con 0x7f8c040038e0 2023-08-22T00:24:02.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.185+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1c047480 con 0x7f8c040038e0 2023-08-22T00:24:02.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.186+0000 7f8c03fff700 1 -- 172.21.15.98:0/4019781319 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f8c0c023de0 con 0x7f8c040038e0 2023-08-22T00:24:02.188 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:02.188 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2703980520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2703980520},{"type":"v1","addr":"172.21.15.118:6834","nonce":2703980520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/45041942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":45041942},{"type":"v1","addr":"172.21.15.118:6835","nonce":45041942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/1433311218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1433311218},{"type":"v1","addr":"172.21.15.98:6836","nonce":1433311218}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7779,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2898239881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":2898239881},{"type":"v1","addr":"172.21.15.98:6837","nonce":2898239881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2023-08-22T00:24:02.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 msgr2=0x7f8c080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 0x7f8c080612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8c1c0c2670 tx=0x7f8c10001e50).stop 2023-08-22T00:24:02.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 msgr2=0x7f8c1c156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f8c0c001d20 tx=0x7f8c0c014000).stop 2023-08-22T00:24:02.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 shutdown_connections 2023-08-22T00:24:02.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c1c144170 0x7f8c1c1445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c040038e0 0x7f8c1c156c90 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8c0805ee10 0x7f8c080612d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 --2- 172.21.15.98:0/4019781319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c1c167a40 0x7f8c1c167ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.187+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 >> 172.21.15.98:0/4019781319 conn(0x7f8c1c0cb5a0 msgr2=0x7f8c1c0c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.188+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 shutdown_connections 2023-08-22T00:24:02.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.188+0000 7f8c226c8700 1 -- 172.21.15.98:0/4019781319 wait complete. 2023-08-22T00:24:02.192 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 45 2023-08-22T00:24:02.201 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:24:02.201 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:24:02.201 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:24:02.201 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:24:02.202 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:24:02.202 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:24:02.202 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:24:02.202 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:24:02.203 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:24:02.203 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:24:02.203 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:24:02.204 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:24:02.204 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:24:02.204 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:24:02.205 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:24:02.205 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:24:02.212 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:24:02.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:24:02.213 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:24:02.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:24:02.217 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:24:02.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:24:02.218 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:24:02.218 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:24:02.255 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:24:02.255 DEBUG:teuthology.parallel:result is None 2023-08-22T00:24:02.257 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:24:02.257 DEBUG:teuthology.parallel:result is None 2023-08-22T00:24:02.261 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:24:02.261 DEBUG:teuthology.parallel:result is None 2023-08-22T00:24:02.263 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:24:02.263 DEBUG:teuthology.parallel:result is None 2023-08-22T00:24:02.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:24:02.330 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:24:02.331 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:24:02.345 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:24:02.346 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:24:02.346 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-08-22T00:24:02.345+0000 7f593d8fe700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-22T00:24:02.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.390+0000 7f72e0ab7700 1 Processor -- start 2023-08-22T00:24:02.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.390+0000 7f72e0ab7700 1 -- start start 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72e0ab7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72dc065870 0x7f72dc150b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72e0ab7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72dc0bdec0 0x7f72dc0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72e0ab7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc067590 con 0x7f72dc150750 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72e0ab7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc067870 con 0x7f72dc0bdec0 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72e0ab7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc067b50 con 0x7f72dc065870 2023-08-22T00:24:02.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72dc0bdec0 0x7f72dc0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72da59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f72dc150750 0x7f72dc0a73b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49638/0 (socket says 172.21.15.98:49638) 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72da59c700 1 -- 172.21.15.98:0/2008617830 learned_addr learned my addr 172.21.15.98:0/2008617830 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72d9d9b700 1 --2- 172.21.15.98:0/2008617830 >> v2:172.21.15.118:3300/0 conn(0x7f72dc065870 0x7f72dc150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 -- 172.21.15.98:0/2008617830 >> v2:172.21.15.118:3300/0 conn(0x7f72dc065870 msgr2=0x7f72dc150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 --2- 172.21.15.98:0/2008617830 >> v2:172.21.15.118:3300/0 conn(0x7f72dc065870 0x7f72dc150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 -- 172.21.15.98:0/2008617830 >> v1:172.21.15.98:6789/0 conn(0x7f72dc150750 legacy=0x7f72dc0a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72d959a700 1 -- 172.21.15.98:0/2008617830 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369687975 0 0) 0x7f72dc067590 con 0x7f72dc150750 2023-08-22T00:24:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 -- 172.21.15.98:0/2008617830 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc067e30 con 0x7f72dc0bdec0 2023-08-22T00:24:02.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.391+0000 7f72dad9d700 1 --2- 172.21.15.98:0/2008617830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0c3650 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f72dc069d20 tx=0x7f72d4009780).ready entity=mon.0 client_cookie=7452dcfa8709cf79 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:02.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72d959a700 1 -- 172.21.15.98:0/2008617830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400e070 con 0x7f72dc0bdec0 2023-08-22T00:24:02.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72d959a700 1 -- 172.21.15.98:0/2008617830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400bb60 con 0x7f72dc0bdec0 2023-08-22T00:24:02.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72d959a700 1 -- 172.21.15.98:0/2008617830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4012410 con 0x7f72dc0bdec0 2023-08-22T00:24:02.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 -- 172.21.15.98:0/2008617830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 msgr2=0x7f72dc0c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/2008617830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0c3650 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f72dc069d20 tx=0x7f72d4009780).stop 2023-08-22T00:24:02.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 -- 172.21.15.98:0/2008617830 shutdown_connections 2023-08-22T00:24:02.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/2008617830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0c3650 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/2008617830 >> v2:172.21.15.118:3300/0 conn(0x7f72dc065870 0x7f72dc150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 -- 172.21.15.98:0/2008617830 >> 172.21.15.98:0/2008617830 conn(0x7f72dc0c7800 msgr2=0x7f72dc0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 -- 172.21.15.98:0/2008617830 shutdown_connections 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.392+0000 7f72e0ab7700 1 -- 172.21.15.98:0/2008617830 wait complete. 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.393+0000 7f72e0ab7700 1 Processor -- start 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.393+0000 7f72e0ab7700 1 -- start start 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72dc065870 0x7f72dc14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72dc150750 0x7f72dc0a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c4740 con 0x7f72dc0bdec0 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c4990 con 0x7f72dc065870 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72e0ab7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c4c70 con 0x7f72dc150750 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72d9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72d9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50718/0 (socket says 172.21.15.98:50718) 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72d9d9b700 1 -- 172.21.15.98:0/102618069 learned_addr learned my addr 172.21.15.98:0/102618069 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72da59c700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72dc065870 0x7f72dc14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.394+0000 7f72dad9d700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72dc150750 0x7f72dc0a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 -- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72dc150750 msgr2=0x7f72dc0a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72dc150750 0x7f72dc0a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 -- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72dc065870 msgr2=0x7f72dc14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72dc065870 0x7f72dc14c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 -- 172.21.15.98:0/102618069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009a20 con 0x7f72dc0bdec0 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72d9d9b700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f72d000e8d0 tx=0x7f72d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d000c610 con 0x7f72dc0bdec0 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d000c770 con 0x7f72dc0bdec0 2023-08-22T00:24:02.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0c4f50 con 0x7f72dc0bdec0 2023-08-22T00:24:02.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d000caf0 con 0x7f72dc0bdec0 2023-08-22T00:24:02.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.395+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0c5510 con 0x7f72dc0bdec0 2023-08-22T00:24:02.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.396+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc068e80 con 0x7f72dc0bdec0 2023-08-22T00:24:02.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.396+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f72d001b400 con 0x7f72dc0bdec0 2023-08-22T00:24:02.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.396+0000 7f72ca7fc700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 0x7f72bc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:02.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.396+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6224+0+0 (secure 0 0 0) 0x7f72d007a300 con 0x7f72dc0bdec0 2023-08-22T00:24:02.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.396+0000 7f72da59c700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 0x7f72bc0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:02.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.397+0000 7f72da59c700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 0x7f72bc0612a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f72cc007fd0 tx=0x7f72cc007dd0).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:02.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.401+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72d004b760 con 0x7f72dc0bdec0 2023-08-22T00:24:02.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:02.577+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f72dc0be350 con 0x7f72dc0bdec0 2023-08-22T00:24:03.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.448+0000 7f72ca7fc700 1 -- 172.21.15.98:0/102618069 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7f72d0016020 con 0x7f72dc0bdec0 2023-08-22T00:24:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 msgr2=0x7f72bc0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 0x7f72bc0612a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f72cc007fd0 tx=0x7f72cc007dd0).stop 2023-08-22T00:24:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 msgr2=0x7f72dc0a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f72d000e8d0 tx=0x7f72d0009060).stop 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 shutdown_connections 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f72bc05ede0 0x7f72bc0612a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72dc150750 0x7f72dc0a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72dc065870 0x7f72dc14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.450+0000 7f72e0ab7700 1 --2- 172.21.15.98:0/102618069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72dc0bdec0 0x7f72dc0a3b80 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.451+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 >> 172.21.15.98:0/102618069 conn(0x7f72dc0c7800 msgr2=0x7f72dc0c7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.451+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 shutdown_connections 2023-08-22T00:24:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.451+0000 7f72e0ab7700 1 -- 172.21.15.98:0/102618069 wait complete. 2023-08-22T00:24:03.454 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:24:03.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:24:03.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.588+0000 7f3ce18f6700 1 Processor -- start 2023-08-22T00:24:03.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.588+0000 7f3ce18f6700 1 -- start start 2023-08-22T00:24:03.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3ce18f6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 0x7f3cdc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3ce18f6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 0x7f3cdc154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3ce18f6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc155260 con 0x7f3cdc0c5a90 2023-08-22T00:24:03.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3ce18f6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc0c17b0 con 0x7f3cdc1544f0 2023-08-22T00:24:03.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3ce18f6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0bf9e0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3cdb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 0x7f3cdc154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3cda7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3cdc0c5a90 0x7f3cdc0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56232/0 (socket says 172.21.15.98:56232) 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3cda7fc700 1 -- 172.21.15.98:0/2141504845 learned_addr learned my addr 172.21.15.98:0/2141504845 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.589+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/2141504845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 0x7f3cdc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdaffd700 1 -- 172.21.15.98:0/2141504845 >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 msgr2=0x7f3cdc154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:03.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/2141504845 >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 0x7f3cdc154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdaffd700 1 -- 172.21.15.98:0/2141504845 >> v1:172.21.15.118:6789/0 conn(0x7f3cdc0c5a90 legacy=0x7f3cdc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdaffd700 1 -- 172.21.15.98:0/2141504845 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0bfcc0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdb7fe700 1 --2- 172.21.15.98:0/2141504845 >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 0x7f3cdc154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/2141504845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 0x7f3cdc14e4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3cd0009760 tx=0x7f3cd0009060).ready entity=mon.2 client_cookie=9eac79d820377063 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cd9ffb700 1 -- 172.21.15.98:0/2141504845 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000f510 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cd9ffb700 1 -- 172.21.15.98:0/2141504845 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000f670 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3cd9ffb700 1 -- 172.21.15.98:0/2141504845 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000f9f0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 -- 172.21.15.98:0/2141504845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 msgr2=0x7f3cdc14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/2141504845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 0x7f3cdc14e4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3cd0009760 tx=0x7f3cd0009060).stop 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 -- 172.21.15.98:0/2141504845 shutdown_connections 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/2141504845 >> v2:172.21.15.118:3300/0 conn(0x7f3cdc1544f0 0x7f3cdc154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/2141504845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc14e0d0 0x7f3cdc14e4b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 -- 172.21.15.98:0/2141504845 >> 172.21.15.98:0/2141504845 conn(0x7f3cdc0caa80 msgr2=0x7f3cdc0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 -- 172.21.15.98:0/2141504845 shutdown_connections 2023-08-22T00:24:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.590+0000 7f3ce18f6700 1 -- 172.21.15.98:0/2141504845 wait complete. 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.592+0000 7f3ce18f6700 1 Processor -- start 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.592+0000 7f3ce18f6700 1 -- start start 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.592+0000 7f3ce18f6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc0c5a90 0x7f3cdc0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.592+0000 7f3ce18f6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.592+0000 7f3ce18f6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cdc1544f0 0x7f3cdc0af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3ce18f6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0ae640 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3ce18f6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc151390 con 0x7f3cdc1544f0 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3ce18f6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0add10 con 0x7f3cdc0c5a90 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50726/0 (socket says 172.21.15.98:50726) 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 -- 172.21.15.98:0/4031340157 learned_addr learned my addr 172.21.15.98:0/4031340157 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc0c5a90 0x7f3cdc0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cdb7fe700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cdc1544f0 0x7f3cdc0af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 -- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc0c5a90 msgr2=0x7f3cdc0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc0c5a90 0x7f3cdc0aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 -- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cdc1544f0 msgr2=0x7f3cdc0af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cdc1544f0 0x7f3cdc0af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 -- 172.21.15.98:0/4031340157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009a20 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cda7fc700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f3ccc001eb0 tx=0x7f3ccc007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc00ce40 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00092a0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0072e0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0057a0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.593+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0ae2d0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.594+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0ae7f0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.594+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3ccc005b90 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.595+0000 7f3cc2ffd700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 0x7f3cc80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.595+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f3ccc079240 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.595+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 0x7f3cc80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.595+0000 7f3cdaffd700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 0x7f3cc80612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3cd0009fd0 tx=0x7f3cd0017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.599+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cdc0ae7f0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.823+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3cdc0ae7f0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.824+0000 7f3cc2ffd700 1 -- 172.21.15.98:0/4031340157 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3cdc0ae7f0 con 0x7f3cdc14e0d0 2023-08-22T00:24:03.825 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.826 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:24:03.827 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:24:03.831 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:24:03.832 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.833 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.836 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:24:03.838 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:24:03.839 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:24:03.842 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.843 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:24:03.844 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.845 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:24:03.847 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:24:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:24:03.849 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:24:03.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:03.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:24:03.849 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:24:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.825+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 msgr2=0x7f3cc80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.825+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 0x7f3cc80612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3cd0009fd0 tx=0x7f3cd0017000).stop 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 msgr2=0x7f3cdc0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f3ccc001eb0 tx=0x7f3ccc007e50).stop 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 shutdown_connections 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3cc805ee10 0x7f3cc80612d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cdc0c5a90 0x7f3cdc0aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cdc1544f0 0x7f3cdc0af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 --2- 172.21.15.98:0/4031340157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc14e0d0 0x7f3cdc0aefc0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 >> 172.21.15.98:0/4031340157 conn(0x7f3cdc0caa80 msgr2=0x7f3cdc0c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 shutdown_connections 2023-08-22T00:24:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.826+0000 7f3ce18f6700 1 -- 172.21.15.98:0/4031340157 wait complete. 2023-08-22T00:24:03.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:24:03.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.967+0000 7f1fc5d3f700 1 Processor -- start 2023-08-22T00:24:03.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.967+0000 7f1fc5d3f700 1 -- start start 2023-08-22T00:24:03.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fc5d3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fc5d3f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1fc00bcd60 0x7f1fc0063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fc5d3f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc0063f60 con 0x7f1fc00a89a0 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fc5d3f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00bd3b0 con 0x7f1fc00bcd60 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fc5d3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0154830 con 0x7f1fc0155310 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1fc00bcd60 0x7f1fc0063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbf7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1fc00a89a0 0x7f1fc00c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49650/0 (socket says 172.21.15.98:49650) 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbf7fe700 1 -- 172.21.15.98:0/4234832250 learned_addr learned my addr 172.21.15.98:0/4234832250 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:03.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbeffd700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 -- 172.21.15.98:0/4234832250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 msgr2=0x7f1fc00c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 -- 172.21.15.98:0/4234832250 >> v1:172.21.15.98:6789/0 conn(0x7f1fc00a89a0 legacy=0x7f1fc00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbe7fc700 1 -- 172.21.15.98:0/4234832250 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923511049 0 0) 0x7f1fc0063f60 con 0x7f1fc00a89a0 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 -- 172.21.15.98:0/4234832250 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0154b10 con 0x7f1fc00bcd60 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbffff700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00bcd60 0x7f1fc0063a70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f1fb8009e90 tx=0x7f1fb8009780).ready entity=mon.0 client_cookie=c149c3ca9e868eca server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.968+0000 7f1fbe7fc700 1 -- 172.21.15.98:0/4234832250 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800e070 con 0x7f1fc00bcd60 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fbe7fc700 1 -- 172.21.15.98:0/4234832250 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800bbf0 con 0x7f1fc00bcd60 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fbe7fc700 1 -- 172.21.15.98:0/4234832250 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8012410 con 0x7f1fc00bcd60 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/4234832250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00bcd60 msgr2=0x7f1fc0063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00bcd60 0x7f1fc0063a70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f1fb8009e90 tx=0x7f1fb8009780).stop 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/4234832250 shutdown_connections 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00bcd60 0x7f1fc0063a70 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/4234832250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/4234832250 >> 172.21.15.98:0/4234832250 conn(0x7f1fc00c7140 msgr2=0x7f1fc00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:03.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/4234832250 shutdown_connections 2023-08-22T00:24:03.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.969+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/4234832250 wait complete. 2023-08-22T00:24:03.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.970+0000 7f1fc5d3f700 1 Processor -- start 2023-08-22T00:24:03.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.970+0000 7f1fc5d3f700 1 -- start start 2023-08-22T00:24:03.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc00bcd60 0x7f1fc01477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00bf6b0 con 0x7f1fc00a89a0 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0165ce0 con 0x7f1fc00bcd60 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fc5d3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c4e60 con 0x7f1fc0155310 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fbf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fbf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50742/0 (socket says 172.21.15.98:50742) 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fbf7fe700 1 -- 172.21.15.98:0/3561225661 learned_addr learned my addr 172.21.15.98:0/3561225661 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fbeffd700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc00bcd60 0x7f1fc01477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.971+0000 7f1fbffff700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 -- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 msgr2=0x7f1fc00c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 -- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc00bcd60 msgr2=0x7f1fc01477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc00bcd60 0x7f1fc01477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 -- 172.21.15.98:0/3561225661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8009a20 con 0x7f1fc00a89a0 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fbf7fe700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f1fb0001eb0 tx=0x7f1fb0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00070d0 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0007230 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc01653b0 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00075d0 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.972+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc0165970 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.973+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc00a8160 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.973+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1fb0005bc0 con 0x7f1fc00a89a0 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.973+0000 7f1fa77fe700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 0x7f1fac0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.973+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1fb0079560 con 0x7f1fc00a89a0 2023-08-22T00:24:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.973+0000 7f1fbeffd700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 0x7f1fac0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.974+0000 7f1fbeffd700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 0x7f1fac0612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1fc0065de0 tx=0x7f1fb4008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:03.978+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1fb004abc0 con 0x7f1fc00a89a0 2023-08-22T00:24:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.142+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fc0047480 con 0x7f1fc00a89a0 2023-08-22T00:24:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.143+0000 7f1fa77fe700 1 -- 172.21.15.98:0/3561225661 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+14055 (secure 0 0 0) 0x7f1fb0018020 con 0x7f1fc00a89a0 2023-08-22T00:24:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:04.145 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":132,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:03.442185+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:24:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 msgr2=0x7f1fac0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 0x7f1fac0612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1fc0065de0 tx=0x7f1fb4008040).stop 2023-08-22T00:24:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 msgr2=0x7f1fc014de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f1fb0001eb0 tx=0x7f1fb0007e90).stop 2023-08-22T00:24:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 shutdown_connections 2023-08-22T00:24:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1fac05ee10 0x7f1fac0612d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fc0155310 0x7f1fc00c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc00a89a0 0x7f1fc014de60 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 --2- 172.21.15.98:0/3561225661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc00bcd60 0x7f1fc01477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 >> 172.21.15.98:0/3561225661 conn(0x7f1fc00c7140 msgr2=0x7f1fc01483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 shutdown_connections 2023-08-22T00:24:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.145+0000 7f1fc5d3f700 1 -- 172.21.15.98:0/3561225661 wait complete. 2023-08-22T00:24:04.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:24:04.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:24:04.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.276+0000 7f64143b2700 1 Processor -- start 2023-08-22T00:24:04.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.276+0000 7f64143b2700 1 -- start start 2023-08-22T00:24:04.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.277+0000 7f64143b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f640c1579e0 0x7f640c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.277+0000 7f64143b2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c064280 con 0x7f640c063000 2023-08-22T00:24:04.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.277+0000 7f64143b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0c4c20 con 0x7f640c0c5750 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.277+0000 7f64143b2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0c1850 con 0x7f640c1579e0 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641194d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f640c1579e0 0x7f640c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641294f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f640c063000 0x7f640c154a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49658/0 (socket says 172.21.15.98:49658) 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641294f700 1 -- 172.21.15.98:0/3252591909 learned_addr learned my addr 172.21.15.98:0/3252591909 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641194d700 1 -- 172.21.15.98:0/3252591909 >> v1:172.21.15.118:6789/0 conn(0x7f640c0c5750 legacy=0x7f640c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641194d700 1 -- 172.21.15.98:0/3252591909 >> v1:172.21.15.98:6789/0 conn(0x7f640c063000 legacy=0x7f640c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641114c700 1 -- 172.21.15.98:0/3252591909 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598872892 0 0) 0x7f640c064280 con 0x7f640c063000 2023-08-22T00:24:04.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641194d700 1 -- 172.21.15.98:0/3252591909 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c063670 con 0x7f640c1579e0 2023-08-22T00:24:04.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641194d700 1 --2- 172.21.15.98:0/3252591909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c0c5b30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f6408009760 tx=0x7f6408009060).ready entity=mon.0 client_cookie=f6bcfaba86f1b8a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641114c700 1 -- 172.21.15.98:0/3252591909 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800b520 con 0x7f640c1579e0 2023-08-22T00:24:04.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641114c700 1 -- 172.21.15.98:0/3252591909 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800b680 con 0x7f640c1579e0 2023-08-22T00:24:04.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.278+0000 7f641114c700 1 -- 172.21.15.98:0/3252591909 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800ba00 con 0x7f640c1579e0 2023-08-22T00:24:04.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 -- 172.21.15.98:0/3252591909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 msgr2=0x7f640c0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 --2- 172.21.15.98:0/3252591909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c0c5b30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f6408009760 tx=0x7f6408009060).stop 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 -- 172.21.15.98:0/3252591909 shutdown_connections 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 --2- 172.21.15.98:0/3252591909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c0c5b30 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 -- 172.21.15.98:0/3252591909 >> 172.21.15.98:0/3252591909 conn(0x7f640c0c3a60 msgr2=0x7f640c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 -- 172.21.15.98:0/3252591909 shutdown_connections 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.279+0000 7f64143b2700 1 -- 172.21.15.98:0/3252591909 wait complete. 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.280+0000 7f64143b2700 1 Processor -- start 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.280+0000 7f64143b2700 1 -- start start 2023-08-22T00:24:04.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f640c063000 0x7f640c0bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f640c0c5750 0x7f640c13f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0c0a10 con 0x7f640c1579e0 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c13fb70 con 0x7f640c063000 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f64143b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0c0170 con 0x7f640c0c5750 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f641294f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f641294f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50768/0 (socket says 172.21.15.98:50768) 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.281+0000 7f641294f700 1 -- 172.21.15.98:0/599616176 learned_addr learned my addr 172.21.15.98:0/599616176 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641214e700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f640c063000 0x7f640c0bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641194d700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f640c0c5750 0x7f640c13f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 -- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f640c0c5750 msgr2=0x7f640c13f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f640c0c5750 0x7f640c13f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 -- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f640c063000 msgr2=0x7f640c0bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f640c063000 0x7f640c0bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 -- 172.21.15.98:0/599616176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080092a0 con 0x7f640c1579e0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f641294f700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f640400c730 tx=0x7f6404001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404005d30 con 0x7f640c1579e0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404005e90 con 0x7f640c1579e0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404007340 con 0x7f640c1579e0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c0c0450 con 0x7f640c1579e0 2023-08-22T00:24:04.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.282+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c1659e0 con 0x7f640c1579e0 2023-08-22T00:24:04.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.283+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c0c05e0 con 0x7f640c1579e0 2023-08-22T00:24:04.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.283+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f64040076f0 con 0x7f640c1579e0 2023-08-22T00:24:04.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.284+0000 7f64027fc700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 0x7f63f00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.284+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6404079bf0 con 0x7f640c1579e0 2023-08-22T00:24:04.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.284+0000 7f641214e700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 0x7f63f00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.284+0000 7f641214e700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 0x7f63f00612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f63fc0038b0 tx=0x7f63fc007d20).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.288+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f640404b250 con 0x7f640c1579e0 2023-08-22T00:24:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.450+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f640c165c00 con 0x7f640c1579e0 2023-08-22T00:24:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.451+0000 7f64027fc700 1 -- 172.21.15.98:0/599616176 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f64040079a0 con 0x7f640c1579e0 2023-08-22T00:24:04.452 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 msgr2=0x7f63f00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 0x7f63f00612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f63fc0038b0 tx=0x7f63fc007d20).stop 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 msgr2=0x7f640c13f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f640400c730 tx=0x7f6404001520).stop 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 shutdown_connections 2023-08-22T00:24:04.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c1579e0 0x7f640c13f680 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f640c063000 0x7f640c0bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f63f005ee10 0x7f63f00612d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 --2- 172.21.15.98:0/599616176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f640c0c5750 0x7f640c13f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.452+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 >> 172.21.15.98:0/599616176 conn(0x7f640c0c3a60 msgr2=0x7f640c0c2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.453+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 shutdown_connections 2023-08-22T00:24:04.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.453+0000 7f64143b2700 1 -- 172.21.15.98:0/599616176 wait complete. 2023-08-22T00:24:04.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:24:04.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.582+0000 7f9c7330d700 1 Processor -- start 2023-08-22T00:24:04.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 -- start start 2023-08-22T00:24:04.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9c6c157e60 0x7f9c6c062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0c8d30 con 0x7f9c6c157a80 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c9010 con 0x7f9c6c157e60 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.583+0000 7f9c7330d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c92f0 con 0x7f9c6c153e90 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c710a9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9c6c157a80 0x7f9c6c153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49660/0 (socket says 172.21.15.98:49660) 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9c6c157e60 0x7f9c6c062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c710a9700 1 -- 172.21.15.98:0/50701269 learned_addr learned my addr 172.21.15.98:0/50701269 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c708a8700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 -- 172.21.15.98:0/50701269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 msgr2=0x7f9c6c0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c0aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 -- 172.21.15.98:0/50701269 >> v1:172.21.15.98:6789/0 conn(0x7f9c6c157a80 legacy=0x7f9c6c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 -- 172.21.15.98:0/50701269 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0c95d0 con 0x7f9c6c157e60 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c63fff700 1 -- 172.21.15.98:0/50701269 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13798235 0 0) 0x7f9c6c0c8d30 con 0x7f9c6c157a80 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c718aa700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c062600 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f9c64009e60 tx=0x7f9c64009780).ready entity=mon.0 client_cookie=83fdbde6ff886cb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c63fff700 1 -- 172.21.15.98:0/50701269 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400e070 con 0x7f9c6c157e60 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c63fff700 1 -- 172.21.15.98:0/50701269 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400bb60 con 0x7f9c6c157e60 2023-08-22T00:24:04.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.584+0000 7f9c63fff700 1 -- 172.21.15.98:0/50701269 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64012410 con 0x7f9c6c157e60 2023-08-22T00:24:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 -- 172.21.15.98:0/50701269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 msgr2=0x7f9c6c062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c062600 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f9c64009e60 tx=0x7f9c64009780).stop 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 -- 172.21.15.98:0/50701269 shutdown_connections 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c062600 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 --2- 172.21.15.98:0/50701269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 -- 172.21.15.98:0/50701269 >> 172.21.15.98:0/50701269 conn(0x7f9c6c0cb5f0 msgr2=0x7f9c6c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 -- 172.21.15.98:0/50701269 shutdown_connections 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.585+0000 7f9c7330d700 1 -- 172.21.15.98:0/50701269 wait complete. 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.586+0000 7f9c7330d700 1 Processor -- start 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.586+0000 7f9c7330d700 1 -- start start 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 0x7f9c6c0c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c155e00 con 0x7f9c6c157e60 2023-08-22T00:24:04.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1560e0 con 0x7f9c6c157a80 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c7330d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1563c0 con 0x7f9c6c153e90 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.587+0000 7f9c718aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50794/0 (socket says 172.21.15.98:50794) 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 -- 172.21.15.98:0/3349387158 learned_addr learned my addr 172.21.15.98:0/3349387158 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c710a9700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c708a8700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 0x7f9c6c0c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 -- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 msgr2=0x7f9c6c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 -- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 msgr2=0x7f9c6c0c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 0x7f9c6c0c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 -- 172.21.15.98:0/3349387158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64009a20 con 0x7f9c6c157e60 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c708a8700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 0x7f9c6c0c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c710a9700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c718aa700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f9c6c06aac0 tx=0x7f9c6c1542f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6401d630 con 0x7f9c6c157e60 2023-08-22T00:24:04.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6401d790 con 0x7f9c6c157e60 2023-08-22T00:24:04.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c1566a0 con 0x7f9c6c157e60 2023-08-22T00:24:04.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6401db30 con 0x7f9c6c157e60 2023-08-22T00:24:04.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.588+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c155920 con 0x7f9c6c157e60 2023-08-22T00:24:04.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.589+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c156b40 con 0x7f9c6c157e60 2023-08-22T00:24:04.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.589+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9c64003040 con 0x7f9c6c157e60 2023-08-22T00:24:04.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.590+0000 7f9c617fa700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 0x7f9c500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.590+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9c6407ba50 con 0x7f9c6c157e60 2023-08-22T00:24:04.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.590+0000 7f9c710a9700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 0x7f9c500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.590+0000 7f9c710a9700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 0x7f9c500612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9c5c007fd0 tx=0x7f9c5c009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.594+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c6404d0b0 con 0x7f9c6c157e60 2023-08-22T00:24:04.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.751+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c6c083630 con 0x7f9c6c157e60 2023-08-22T00:24:04.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.752+0000 7f9c617fa700 1 -- 172.21.15.98:0/3349387158 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c640506d0 con 0x7f9c6c157e60 2023-08-22T00:24:04.753 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.753+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 msgr2=0x7f9c500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.753+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 0x7f9c500612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9c5c007fd0 tx=0x7f9c5c009040).stop 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.753+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 msgr2=0x7f9c6c0c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.753+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f9c6c06aac0 tx=0x7f9c6c1542f0).stop 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 shutdown_connections 2023-08-22T00:24:04.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9c5005ee10 0x7f9c500612d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6c153e90 0x7f9c6c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c6c157e60 0x7f9c6c0c0a50 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 --2- 172.21.15.98:0/3349387158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c6c157a80 0x7f9c6c0c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 >> 172.21.15.98:0/3349387158 conn(0x7f9c6c0cb5f0 msgr2=0x7f9c6c0ac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 shutdown_connections 2023-08-22T00:24:04.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.754+0000 7f9c7330d700 1 -- 172.21.15.98:0/3349387158 wait complete. 2023-08-22T00:24:04.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:24:04.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.881+0000 7fc293733700 1 Processor -- start 2023-08-22T00:24:04.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.881+0000 7fc293733700 1 -- start start 2023-08-22T00:24:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc293733700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc28c14e0d0 0x7fc28c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc293733700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc28c0c5a90 0x7fc28c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc293733700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c155260 con 0x7fc28c1544f0 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc293733700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c0c17b0 con 0x7fc28c14e0d0 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc293733700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c0bf9e0 con 0x7fc28c0c5a90 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc2914cf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc28c14e0d0 0x7fc28c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc291cd0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc28c1544f0 0x7fc28c1549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49662/0 (socket says 172.21.15.98:49662) 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc2914cf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc28c14e0d0 0x7fc28c14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50802/0 (socket says 172.21.15.98:50802) 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.882+0000 7fc291cd0700 1 -- 172.21.15.98:0/3307369392 learned_addr learned my addr 172.21.15.98:0/3307369392 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:04.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc290cce700 1 --2- 172.21.15.98:0/3307369392 >> v2:172.21.15.118:3300/0 conn(0x7fc28c0c5a90 0x7fc28c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc2914cf700 1 -- 172.21.15.98:0/3307369392 >> v2:172.21.15.118:3300/0 conn(0x7fc28c0c5a90 msgr2=0x7fc28c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc2914cf700 1 --2- 172.21.15.98:0/3307369392 >> v2:172.21.15.118:3300/0 conn(0x7fc28c0c5a90 0x7fc28c0c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc2914cf700 1 -- 172.21.15.98:0/3307369392 >> v1:172.21.15.98:6789/0 conn(0x7fc28c1544f0 legacy=0x7fc28c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc2914cf700 1 -- 172.21.15.98:0/3307369392 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0bfcc0 con 0x7fc28c14e0d0 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc283fff700 1 -- 172.21.15.98:0/3307369392 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158895748 0 0) 0x7fc28c155260 con 0x7fc28c1544f0 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc2914cf700 1 --2- 172.21.15.98:0/3307369392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c14e0d0 0x7fc28c14e4b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fc288009760 tx=0x7fc288009060).ready entity=mon.0 client_cookie=e5c6a4da11caf2d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc283fff700 1 -- 172.21.15.98:0/3307369392 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800b520 con 0x7fc28c14e0d0 2023-08-22T00:24:04.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc283fff700 1 -- 172.21.15.98:0/3307369392 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28800b680 con 0x7fc28c14e0d0 2023-08-22T00:24:04.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc283fff700 1 -- 172.21.15.98:0/3307369392 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800ba00 con 0x7fc28c14e0d0 2023-08-22T00:24:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.883+0000 7fc293733700 1 -- 172.21.15.98:0/3307369392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c14e0d0 msgr2=0x7fc28c14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 --2- 172.21.15.98:0/3307369392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c14e0d0 0x7fc28c14e4b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fc288009760 tx=0x7fc288009060).stop 2023-08-22T00:24:04.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 -- 172.21.15.98:0/3307369392 shutdown_connections 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 --2- 172.21.15.98:0/3307369392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c14e0d0 0x7fc28c14e4b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 --2- 172.21.15.98:0/3307369392 >> v2:172.21.15.118:3300/0 conn(0x7fc28c0c5a90 0x7fc28c0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 -- 172.21.15.98:0/3307369392 >> 172.21.15.98:0/3307369392 conn(0x7fc28c0caa80 msgr2=0x7fc28c0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 -- 172.21.15.98:0/3307369392 shutdown_connections 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.884+0000 7fc293733700 1 -- 172.21.15.98:0/3307369392 wait complete. 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.885+0000 7fc293733700 1 Processor -- start 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.885+0000 7fc293733700 1 -- start start 2023-08-22T00:24:04.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28c0c5a90 0x7fc28c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c14e0d0 0x7fc28c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c165420 con 0x7fc28c1544f0 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c164810 con 0x7fc28c14e0d0 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c164af0 con 0x7fc28c0c5a90 2023-08-22T00:24:04.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50814/0 (socket says 172.21.15.98:50814) 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 -- 172.21.15.98:0/1082542058 learned_addr learned my addr 172.21.15.98:0/1082542058 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc290cce700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c14e0d0 0x7fc28c0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc2914cf700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28c0c5a90 0x7fc28c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 -- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28c0c5a90 msgr2=0x7fc28c14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28c0c5a90 0x7fc28c14eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 -- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c14e0d0 msgr2=0x7fc28c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c14e0d0 0x7fc28c0aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 -- 172.21.15.98:0/1082542058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880092a0 con 0x7fc28c1544f0 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc291cd0700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fc28400c730 tx=0x7fc284001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284005d30 con 0x7fc28c1544f0 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284005e90 con 0x7fc28c1544f0 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c164dd0 con 0x7fc28c1544f0 2023-08-22T00:24:04.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284007300 con 0x7fc28c1544f0 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.886+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c164500 con 0x7fc28c1544f0 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.887+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c047480 con 0x7fc28c1544f0 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.888+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc2840076b0 con 0x7fc28c1544f0 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.888+0000 7fc2817fa700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 0x7fc2700612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.888+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fc284079580 con 0x7fc28c1544f0 2023-08-22T00:24:04.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.888+0000 7fc2914cf700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 0x7fc2700612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:04.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.888+0000 7fc2914cf700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 0x7fc2700612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc28c145250 tx=0x7fc288017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:04.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:04.892+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc28404abe0 con 0x7fc28c1544f0 2023-08-22T00:24:05.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.058+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc28c0ace40 con 0x7fc28c1544f0 2023-08-22T00:24:05.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.058+0000 7fc2817fa700 1 -- 172.21.15.98:0/1082542058 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc28404e200 con 0x7fc28c1544f0 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:24:05.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:05.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:05.061 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:24:05.061 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:24:05.061 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:05.061 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:24:05.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 msgr2=0x7fc2700612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 0x7fc2700612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc28c145250 tx=0x7fc288017000).stop 2023-08-22T00:24:05.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 msgr2=0x7fc28c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fc28400c730 tx=0x7fc284001520).stop 2023-08-22T00:24:05.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 shutdown_connections 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc27005ee10 0x7fc2700612d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28c0c5a90 0x7fc28c14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1544f0 0x7fc28c1424e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 --2- 172.21.15.98:0/1082542058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c14e0d0 0x7fc28c0aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 >> 172.21.15.98:0/1082542058 conn(0x7fc28c0caa80 msgr2=0x7fc28c1549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 shutdown_connections 2023-08-22T00:24:05.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.060+0000 7fc293733700 1 -- 172.21.15.98:0/1082542058 wait complete. 2023-08-22T00:24:05.073 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:24:05.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:24:05.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.193+0000 7f88bdb69700 1 Processor -- start 2023-08-22T00:24:05.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.193+0000 7f88bdb69700 1 -- start start 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88bdb69700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88b8153ae0 0x7f88b80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88bdb69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 0x7f88b80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88bdb69700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b8155360 con 0x7f88b80bfd80 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88bdb69700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80c0670 con 0x7f88b8153ae0 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88bdb69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8157b50 con 0x7f88b80c0200 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88b8153ae0 0x7f88b80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b6ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f88b80bfd80 0x7f88b8157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49674/0 (socket says 172.21.15.98:49674) 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b6ffd700 1 -- 172.21.15.98:0/3913485378 learned_addr learned my addr 172.21.15.98:0/3913485378 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 -- 172.21.15.98:0/3913485378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 msgr2=0x7f88b80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b7fff700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 0x7f88b80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 0x7f88b80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 -- 172.21.15.98:0/3913485378 >> v1:172.21.15.98:6789/0 conn(0x7f88b80bfd80 legacy=0x7f88b8157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b67fc700 1 -- 172.21.15.98:0/3913485378 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463126495 0 0) 0x7f88a0001110 con 0x7f88b80bfd80 2023-08-22T00:24:05.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 -- 172.21.15.98:0/3913485378 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80c6390 con 0x7f88b8153ae0 2023-08-22T00:24:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b7fff700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 0x7f88b80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b77fe700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b8153ae0 0x7f88b80c5ea0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f88a8009e60 tx=0x7f88a8009780).ready entity=mon.0 client_cookie=f699e11b06afb1e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b67fc700 1 -- 172.21.15.98:0/3913485378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800e070 con 0x7f88b8153ae0 2023-08-22T00:24:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.194+0000 7f88b67fc700 1 -- 172.21.15.98:0/3913485378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800bc30 con 0x7f88b8153ae0 2023-08-22T00:24:05.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88b67fc700 1 -- 172.21.15.98:0/3913485378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8012410 con 0x7f88b8153ae0 2023-08-22T00:24:05.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 -- 172.21.15.98:0/3913485378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b8153ae0 msgr2=0x7f88b80c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b8153ae0 0x7f88b80c5ea0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f88a8009e60 tx=0x7f88a8009780).stop 2023-08-22T00:24:05.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 -- 172.21.15.98:0/3913485378 shutdown_connections 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80c0200 0x7f88b80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 --2- 172.21.15.98:0/3913485378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b8153ae0 0x7f88b80c5ea0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 -- 172.21.15.98:0/3913485378 >> 172.21.15.98:0/3913485378 conn(0x7f88b80caa50 msgr2=0x7f88b80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 -- 172.21.15.98:0/3913485378 shutdown_connections 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.195+0000 7f88bdb69700 1 -- 172.21.15.98:0/3913485378 wait complete. 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.196+0000 7f88bdb69700 1 Processor -- start 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.196+0000 7f88bdb69700 1 -- start start 2023-08-22T00:24:05.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80bfd80 0x7f88b8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88b8153ae0 0x7f88b80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80ada00 con 0x7f88b80c0200 2023-08-22T00:24:05.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80ae580 con 0x7f88b8153ae0 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88bdb69700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8151220 con 0x7f88b80bfd80 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88b6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88b6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50836/0 (socket says 172.21.15.98:50836) 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88b6ffd700 1 -- 172.21.15.98:0/1990331045 learned_addr learned my addr 172.21.15.98:0/1990331045 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88b77fe700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80bfd80 0x7f88b8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.197+0000 7f88b7fff700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88b8153ae0 0x7f88b80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 -- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80bfd80 msgr2=0x7f88b8150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80bfd80 0x7f88b8150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 -- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88b8153ae0 msgr2=0x7f88b80afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88b8153ae0 0x7f88b80afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 -- 172.21.15.98:0/1990331045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009a20 con 0x7f88b80c0200 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88b6ffd700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f88a000c520 tx=0x7f88a0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000ce30 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a00072e0 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00057a0 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b80adc50 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.198+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b80ae210 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.199+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b80ae710 con 0x7f88b80c0200 2023-08-22T00:24:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.199+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f88a0005bd0 con 0x7f88b80c0200 2023-08-22T00:24:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.200+0000 7f88af7fe700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 0x7f88980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.200+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f88a0079030 con 0x7f88b80c0200 2023-08-22T00:24:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.200+0000 7f88b77fe700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 0x7f88980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.200+0000 7f88b77fe700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 0x7f88980612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f88a800b9f0 tx=0x7f88a8009780).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.204+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88a004a630 con 0x7f88b80c0200 2023-08-22T00:24:05.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.366+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f88b8155360 con 0x7f88b80c0200 2023-08-22T00:24:05.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.454+0000 7f88af7fe700 1 -- 172.21.15.98:0/1990331045 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 152+0+0 (secure 0 0 0) 0x7f88b8155360 con 0x7f88b80c0200 2023-08-22T00:24:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 msgr2=0x7f88980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 0x7f88980612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f88a800b9f0 tx=0x7f88a8009780).stop 2023-08-22T00:24:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 msgr2=0x7f88b8141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f88a000c520 tx=0x7f88a0007a90).stop 2023-08-22T00:24:05.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 shutdown_connections 2023-08-22T00:24:05.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f889805ee10 0x7f88980612d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88b80bfd80 0x7f88b8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88b8153ae0 0x7f88b80afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 --2- 172.21.15.98:0/1990331045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b80c0200 0x7f88b8141450 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 >> 172.21.15.98:0/1990331045 conn(0x7f88b80caa50 msgr2=0x7f88b8155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:05.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 shutdown_connections 2023-08-22T00:24:05.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.456+0000 7f88bdb69700 1 -- 172.21.15.98:0/1990331045 wait complete. 2023-08-22T00:24:05.461 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:24:05.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:24:05.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.595+0000 7fa6250dd700 1 Processor -- start 2023-08-22T00:24:05.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.595+0000 7fa6250dd700 1 -- start start 2023-08-22T00:24:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa6250dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa6200a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa6250dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6200bd260 0x7fa620150680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa6250dd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa620155380 con 0x7fa6200a8ac0 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa6250dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200bd6f0 con 0x7fa6200bd260 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa6250dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa620155620 con 0x7fa6200bc780 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61ed9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa6200a8ac0 0x7fa6200c0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49684/0 (socket says 172.21.15.98:49684) 2023-08-22T00:24:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61ed9d700 1 -- 172.21.15.98:0/3135637880 learned_addr learned my addr 172.21.15.98:0/3135637880 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578903523 0 0) 0x7fa620155380 con 0x7fa6200a8ac0 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61e59c700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa6200a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3135637880 >> v2:172.21.15.118:3300/0 conn(0x7fa6200bd260 0x7fa620150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.596+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c0033f0 con 0x7fa6200a8ac0 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3446944293 0 0) 0x7fa60c0033f0 con 0x7fa6200a8ac0 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 msgr2=0x7fa6200a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa6200a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 >> v2:172.21.15.118:3300/0 conn(0x7fa6200bd260 msgr2=0x7fa620150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 --2- 172.21.15.98:0/3135637880 >> v2:172.21.15.118:3300/0 conn(0x7fa6200bd260 0x7fa620150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200c2ae0 con 0x7fa6200a8ac0 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fa608001470 con 0x7fa6200a8ac0 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 >> v1:172.21.15.98:6789/0 conn(0x7fa6200a8ac0 legacy=0x7fa6200c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa60c0038e0 0x7fa60c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa60c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa60c004b80 0x7fa60c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200bd6f0 con 0x7fa60c004b80 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620155620 con 0x7fa60c0038e0 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c00b8e0 con 0x7fa6200bc780 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa60c004b80 0x7fa60c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61e59c700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa60c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61ed9d700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa60c0038e0 0x7fa60c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 -- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 msgr2=0x7fa60c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200bc780 0x7fa60c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 -- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa60c0038e0 msgr2=0x7fa60c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa60c0038e0 0x7fa60c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 -- 172.21.15.98:0/3135637880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0033f0 con 0x7fa60c004b80 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa60c004b80 0x7fa60c005000 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fa61800e210 tx=0x7fa61800b040).ready entity=mon.0 client_cookie=eb1806eb40800436 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618009ac0 con 0x7fa60c004b80 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800f040 con 0x7fa60c004b80 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.597+0000 7fa61dd9b700 1 -- 172.21.15.98:0/3135637880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800ecd0 con 0x7fa60c004b80 2023-08-22T00:24:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 -- 172.21.15.98:0/3135637880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa60c004b80 msgr2=0x7fa60c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3135637880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa60c004b80 0x7fa60c005000 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fa61800e210 tx=0x7fa61800b040).stop 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa61f59e700 1 -- 172.21.15.98:0/3135637880 reap_dead start 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 -- 172.21.15.98:0/3135637880 shutdown_connections 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 -- 172.21.15.98:0/3135637880 >> 172.21.15.98:0/3135637880 conn(0x7fa6200c31d0 msgr2=0x7fa6200c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 -- 172.21.15.98:0/3135637880 shutdown_connections 2023-08-22T00:24:05.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.598+0000 7fa6250dd700 1 -- 172.21.15.98:0/3135637880 wait complete. 2023-08-22T00:24:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.599+0000 7fa6250dd700 1 Processor -- start 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.599+0000 7fa6250dd700 1 -- start start 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200c0300 0x7fa6200c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa620153a80 0x7fa620141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620141970 con 0x7fa620153600 2023-08-22T00:24:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620166110 con 0x7fa620153a80 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa6250dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201663f0 con 0x7fa6200c0300 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50852/0 (socket says 172.21.15.98:50852) 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 -- 172.21.15.98:0/3996558167 learned_addr learned my addr 172.21.15.98:0/3996558167 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61ed9d700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200c0300 0x7fa6200c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61f59e700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa620153a80 0x7fa620141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 -- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200c0300 msgr2=0x7fa6200c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200c0300 0x7fa6200c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 -- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa620153a80 msgr2=0x7fa620141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa620153a80 0x7fa620141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.600+0000 7fa61e59c700 1 -- 172.21.15.98:0/3996558167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6201666d0 con 0x7fa620153600 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa61e59c700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fa6100119c0 tx=0x7fa610009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610011eb0 con 0x7fa620153600 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000f8e0 con 0x7fa620153600 2023-08-22T00:24:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6201669b0 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000fc60 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.601+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa620165ee0 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.602+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6200c2dc0 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.602+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa610014650 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.603+0000 7fa616ffd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 0x7fa6000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.603+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fa61007a310 con 0x7fa620153600 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.603+0000 7fa61ed9d700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 0x7fa6000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.603+0000 7fa61ed9d700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 0x7fa6000612d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa608007860 tx=0x7fa620155510).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:05.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.607+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa61004b740 con 0x7fa620153600 2023-08-22T00:24:05.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:05.767+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa62014dc40 con 0x7fa620153600 2023-08-22T00:24:06.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.463+0000 7fa616ffd700 1 -- 172.21.15.98:0/3996558167 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa61004ed60 con 0x7fa620153600 2023-08-22T00:24:06.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.469+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 msgr2=0x7fa6000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.469+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 0x7fa6000612d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa608007860 tx=0x7fa620155510).stop 2023-08-22T00:24:06.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.469+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 msgr2=0x7fa620140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.469+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fa6100119c0 tx=0x7fa610009060).stop 2023-08-22T00:24:06.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 shutdown_connections 2023-08-22T00:24:06.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa60005ee10 0x7fa6000612d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6200c0300 0x7fa6200c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa620153a80 0x7fa620141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 --2- 172.21.15.98:0/3996558167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620153600 0x7fa620140f90 secure :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0x7fa6100119c0 tx=0x7fa610009060).stop 2023-08-22T00:24:06.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.470+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 >> 172.21.15.98:0/3996558167 conn(0x7fa6200c31d0 msgr2=0x7fa620150450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:06.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.471+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 shutdown_connections 2023-08-22T00:24:06.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.476+0000 7fa6250dd700 1 -- 172.21.15.98:0/3996558167 wait complete. 2023-08-22T00:24:06.489 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:24:06.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:24:06.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.625+0000 7f785ca52700 1 Processor -- start 2023-08-22T00:24:06.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.625+0000 7f785ca52700 1 -- start start 2023-08-22T00:24:06.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785ca52700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78580c5750 0x7f78580c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785ca52700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 0x7f7858063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785ca52700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858064280 con 0x7f78580c2010 2023-08-22T00:24:06.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785ca52700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580c1850 con 0x7f78580c5750 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785ca52700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580c4c20 con 0x7f78581579e0 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78580c5750 0x7f78580c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f7856d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f78580c2010 0x7f78580c2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49692/0 (socket says 172.21.15.98:49692) 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f7856d9d700 1 -- 172.21.15.98:0/284577185 learned_addr learned my addr 172.21.15.98:0/284577185 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f7855d9b700 1 --2- 172.21.15.98:0/284577185 >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 0x7f7858063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 -- 172.21.15.98:0/284577185 >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 msgr2=0x7f7858063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:06.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 --2- 172.21.15.98:0/284577185 >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 0x7f7858063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 -- 172.21.15.98:0/284577185 >> v1:172.21.15.98:6789/0 conn(0x7f78580c2010 legacy=0x7f78580c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 -- 172.21.15.98:0/284577185 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858063670 con 0x7f78580c5750 2023-08-22T00:24:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785559a700 1 -- 172.21.15.98:0/284577185 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681455432 0 0) 0x7f7858064280 con 0x7f78580c2010 2023-08-22T00:24:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f7855d9b700 1 --2- 172.21.15.98:0/284577185 >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 0x7f7858063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785659c700 1 --2- 172.21.15.98:0/284577185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78580c5750 0x7f78580c5b30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f78580c46e0 tx=0x7f784c009060).ready entity=mon.0 client_cookie=feedbe32d910eb5f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785559a700 1 -- 172.21.15.98:0/284577185 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00b580 con 0x7f78580c5750 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785559a700 1 -- 172.21.15.98:0/284577185 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00b6e0 con 0x7f78580c5750 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.626+0000 7f785559a700 1 -- 172.21.15.98:0/284577185 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00ba60 con 0x7f78580c5750 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 -- 172.21.15.98:0/284577185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78580c5750 msgr2=0x7f78580c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 --2- 172.21.15.98:0/284577185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78580c5750 0x7f78580c5b30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f78580c46e0 tx=0x7f784c009060).stop 2023-08-22T00:24:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 -- 172.21.15.98:0/284577185 shutdown_connections 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 --2- 172.21.15.98:0/284577185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78580c5750 0x7f78580c5b30 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 --2- 172.21.15.98:0/284577185 >> v2:172.21.15.118:3300/0 conn(0x7f78581579e0 0x7f7858063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 -- 172.21.15.98:0/284577185 >> 172.21.15.98:0/284577185 conn(0x7f78580c3a60 msgr2=0x7f78580c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 -- 172.21.15.98:0/284577185 shutdown_connections 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.627+0000 7f785ca52700 1 -- 172.21.15.98:0/284577185 wait complete. 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.628+0000 7f785ca52700 1 Processor -- start 2023-08-22T00:24:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.628+0000 7f785ca52700 1 -- start start 2023-08-22T00:24:06.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580c2010 0x7f7858153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 0x7f7858153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580a9570 con 0x7f78581579e0 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858140c60 con 0x7f78580c5750 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785ca52700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7858140f40 con 0x7f78580c2010 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50868/0 (socket says 172.21.15.98:50868) 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 -- 172.21.15.98:0/2255008023 learned_addr learned my addr 172.21.15.98:0/2255008023 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7855d9b700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 0x7f7858153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 -- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580c2010 msgr2=0x7f7858153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f785659c700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580c2010 0x7f7858153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580c2010 0x7f7858153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 -- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 msgr2=0x7f7858153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 0x7f7858153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 -- 172.21.15.98:0/2255008023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0092a0 con 0x7f78581579e0 2023-08-22T00:24:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7855d9b700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 0x7f7858153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f7856d9d700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f785000c790 tx=0x7f7850007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.629+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850005d30 con 0x7f78581579e0 2023-08-22T00:24:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.630+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850007110 con 0x7f78581579e0 2023-08-22T00:24:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.630+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7858141220 con 0x7f78581579e0 2023-08-22T00:24:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.630+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500074d0 con 0x7f78581579e0 2023-08-22T00:24:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.630+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78581417e0 con 0x7f78581579e0 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.631+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858141a00 con 0x7f78581579e0 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.631+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7850007840 con 0x7f78581579e0 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.631+0000 7f78467fc700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 0x7f78380612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.631+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f7850079f20 con 0x7f78581579e0 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.631+0000 7f785659c700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 0x7f78380612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.632+0000 7f785659c700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 0x7f78380612d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f784c00b340 tx=0x7f784c017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.636+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f785004b290 con 0x7f78581579e0 2023-08-22T00:24:06.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.835+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7858142610 con 0x7f78581579e0 2023-08-22T00:24:06.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.845+0000 7f78467fc700 1 -- 172.21.15.98:0/2255008023 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7858142610 con 0x7f78581579e0 2023-08-22T00:24:06.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.853+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 msgr2=0x7f78380612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.853+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 0x7f78380612d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f784c00b340 tx=0x7f784c017000).stop 2023-08-22T00:24:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.853+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 msgr2=0x7f7858141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.853+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f785000c790 tx=0x7f7850007f30).stop 2023-08-22T00:24:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 shutdown_connections 2023-08-22T00:24:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f783805ee10 0x7f78380612d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580c2010 0x7f7858153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78581579e0 0x7f7858141d00 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 --2- 172.21.15.98:0/2255008023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580c5750 0x7f7858153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.861+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 >> 172.21.15.98:0/2255008023 conn(0x7f78580c3a60 msgr2=0x7f785806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.863+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 shutdown_connections 2023-08-22T00:24:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.863+0000 7f785ca52700 1 -- 172.21.15.98:0/2255008023 wait complete. 2023-08-22T00:24:06.868 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 16 and data pool 17 2023-08-22T00:24:06.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:24:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.997+0000 7f4fd96f7700 1 Processor -- start 2023-08-22T00:24:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.997+0000 7f4fd96f7700 1 -- start start 2023-08-22T00:24:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd96f7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fd4150040 0x7f4fd4150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd96f7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40c2220 con 0x7f4fd40c26b0 2023-08-22T00:24:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd96f7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40c5bd0 con 0x7f4fd4153f10 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd96f7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40c1ef0 con 0x7f4fd4150040 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fd4150040 0x7f4fd4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4fd4150040 0x7f4fd4150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50870/0 (socket says 172.21.15.98:50870) 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd37fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4fd40c26b0 0x7f4fd4062600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49708/0 (socket says 172.21.15.98:49708) 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 -- 172.21.15.98:0/2694696021 learned_addr learned my addr 172.21.15.98:0/2694696021 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 -- 172.21.15.98:0/2694696021 >> v1:172.21.15.118:6789/0 conn(0x7f4fd4153f10 legacy=0x7f4fd40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 -- 172.21.15.98:0/2694696021 >> v1:172.21.15.98:6789/0 conn(0x7f4fd40c26b0 legacy=0x7f4fd4062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd1ffb700 1 -- 172.21.15.98:0/2694696021 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822928411 0 0) 0x7f4fd40c2220 con 0x7f4fd40c26b0 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 -- 172.21.15.98:0/2694696021 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40c5e30 con 0x7f4fd4150040 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.998+0000 7f4fd2ffd700 1 --2- 172.21.15.98:0/2694696021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd4150420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f4fbc006fd0 tx=0x7f4fbc0090f0).ready entity=mon.0 client_cookie=22fde06387366e74 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd1ffb700 1 -- 172.21.15.98:0/2694696021 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00b600 con 0x7f4fd4150040 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd1ffb700 1 -- 172.21.15.98:0/2694696021 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00b760 con 0x7f4fd4150040 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd1ffb700 1 -- 172.21.15.98:0/2694696021 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00bae0 con 0x7f4fd4150040 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 -- 172.21.15.98:0/2694696021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 msgr2=0x7f4fd4150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/2694696021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd4150420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f4fbc006fd0 tx=0x7f4fbc0090f0).stop 2023-08-22T00:24:07.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 -- 172.21.15.98:0/2694696021 shutdown_connections 2023-08-22T00:24:07.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/2694696021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd4150420 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 -- 172.21.15.98:0/2694696021 >> 172.21.15.98:0/2694696021 conn(0x7f4fd40c7140 msgr2=0x7f4fd40c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 -- 172.21.15.98:0/2694696021 shutdown_connections 2023-08-22T00:24:07.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:06.999+0000 7f4fd96f7700 1 -- 172.21.15.98:0/2694696021 wait complete. 2023-08-22T00:24:07.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.000+0000 7f4fd96f7700 1 Processor -- start 2023-08-22T00:24:07.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.000+0000 7f4fd96f7700 1 -- start start 2023-08-22T00:24:07.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fd40c26b0 0x7f4fd4164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 0x7f4fd40ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd41652c0 con 0x7f4fd4150040 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4161ea0 con 0x7f4fd4153f10 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd96f7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4162cc0 con 0x7f4fd40c26b0 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50880/0 (socket says 172.21.15.98:50880) 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd27fc700 1 -- 172.21.15.98:0/4077133129 learned_addr learned my addr 172.21.15.98:0/4077133129 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd37fe700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 0x7f4fd40ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.001+0000 7f4fd2ffd700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fd40c26b0 0x7f4fd4164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 -- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fd40c26b0 msgr2=0x7f4fd4164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fd40c26b0 0x7f4fd4164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 -- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 msgr2=0x7f4fd40ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 0x7f4fd40ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 -- 172.21.15.98:0/4077133129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009370 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd37fe700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 0x7f4fd40ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd27fc700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f4fc400c470 tx=0x7f4fc4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4007020 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4007180 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd40a9bc0 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4007520 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.002+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4162390 con 0x7f4fd4150040 2023-08-22T00:24:07.008 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.003+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4047480 con 0x7f4fd4150040 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.003+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4fc40068b0 con 0x7f4fd4150040 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.003+0000 7f4fcaffd700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 0x7f4fb40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.003+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4fc4079280 con 0x7f4fd4150040 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.003+0000 7f4fd2ffd700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 0x7f4fb40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.004+0000 7f4fd2ffd700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 0x7f4fb40612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4fd414d6f0 tx=0x7f4fbc017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.007+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fc40478f0 con 0x7f4fd4150040 2023-08-22T00:24:07.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.170+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fd40c6110 con 0x7f4fd4150040 2023-08-22T00:24:07.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.171+0000 7f4fcaffd700 1 -- 172.21.15.98:0/4077133129 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f4fc404a590 con 0x7f4fd4150040 2023-08-22T00:24:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:07.173 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":135,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:06.836623+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:24:07.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.172+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 msgr2=0x7f4fb40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.172+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 0x7f4fb40612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4fd414d6f0 tx=0x7f4fbc017000).stop 2023-08-22T00:24:07.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.172+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 msgr2=0x7f4fd40abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.172+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f4fc400c470 tx=0x7f4fc4007e00).stop 2023-08-22T00:24:07.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 shutdown_connections 2023-08-22T00:24:07.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fb405ee10 0x7f4fb40612d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4fd40c26b0 0x7f4fd4164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fd4153f10 0x7f4fd40ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 --2- 172.21.15.98:0/4077133129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fd4150040 0x7f4fd40abe60 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 >> 172.21.15.98:0/4077133129 conn(0x7f4fd40c7140 msgr2=0x7f4fd4062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 shutdown_connections 2023-08-22T00:24:07.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.173+0000 7f4fd96f7700 1 -- 172.21.15.98:0/4077133129 wait complete. 2023-08-22T00:24:07.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:24:07.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.302+0000 7f9fbc40b700 1 Processor -- start 2023-08-22T00:24:07.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.302+0000 7f9fbc40b700 1 -- start start 2023-08-22T00:24:07.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fbc40b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb4151d60 0x7f9fb4155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fbc40b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 0x7f9fb4065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fbc40b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb4158bf0 con 0x7f9fb4066400 2023-08-22T00:24:07.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fbc40b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb4157d90 con 0x7f9fb4151d60 2023-08-22T00:24:07.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fbc40b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb4066870 con 0x7f9fb40a6e50 2023-08-22T00:24:07.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fba1a7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb4151d60 0x7f9fb4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fba1a7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9fb4151d60 0x7f9fb4155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50890/0 (socket says 172.21.15.98:50890) 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.303+0000 7f9fba1a7700 1 -- 172.21.15.98:0/1889359830 learned_addr learned my addr 172.21.15.98:0/1889359830 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fb99a6700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 0x7f9fb4065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fba1a7700 1 -- 172.21.15.98:0/1889359830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 msgr2=0x7f9fb4065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 0x7f9fb4065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fba1a7700 1 -- 172.21.15.98:0/1889359830 >> v1:172.21.15.118:6789/0 conn(0x7f9fb4066400 legacy=0x7f9fb40bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fba1a7700 1 -- 172.21.15.98:0/1889359830 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4157fe0 con 0x7f9fb4151d60 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fb99a6700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 0x7f9fb4065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb4151d60 0x7f9fb4155240 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f9fa4006fd0 tx=0x7f9fa40090f0).ready entity=mon.0 client_cookie=d05ea2c6a8aa071a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fb91a5700 1 -- 172.21.15.98:0/1889359830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400b600 con 0x7f9fb4151d60 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fb91a5700 1 -- 172.21.15.98:0/1889359830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400b760 con 0x7f9fb4151d60 2023-08-22T00:24:07.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fb91a5700 1 -- 172.21.15.98:0/1889359830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400bae0 con 0x7f9fb4151d60 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fbc40b700 1 -- 172.21.15.98:0/1889359830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb4151d60 msgr2=0x7f9fb4155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.304+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb4151d60 0x7f9fb4155240 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f9fa4006fd0 tx=0x7f9fa40090f0).stop 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 -- 172.21.15.98:0/1889359830 shutdown_connections 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb4151d60 0x7f9fb4155240 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/1889359830 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb40a6e50 0x7f9fb4065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 -- 172.21.15.98:0/1889359830 >> 172.21.15.98:0/1889359830 conn(0x7f9fb406a980 msgr2=0x7f9fb40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 -- 172.21.15.98:0/1889359830 shutdown_connections 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.305+0000 7f9fbc40b700 1 -- 172.21.15.98:0/1889359830 wait complete. 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 Processor -- start 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 -- start start 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 0x7f9fb40aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 0x7f9fb40a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40aac30 con 0x7f9fb40a6e50 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb41656a0 con 0x7f9fb4066400 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.306+0000 7f9fbc40b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40ad550 con 0x7f9fb4151d60 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50906/0 (socket says 172.21.15.98:50906) 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 -- 172.21.15.98:0/4101741567 learned_addr learned my addr 172.21.15.98:0/4101741567 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 0x7f9fb40aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 -- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 msgr2=0x7f9fb40a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fba9a8700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 0x7f9fb40a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 0x7f9fb40a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 -- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 msgr2=0x7f9fb40aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 0x7f9fb40aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 -- 172.21.15.98:0/4101741567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4009370 con 0x7f9fb40a6e50 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fba9a8700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 0x7f9fb40a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 0x7f9fb40aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fb99a6700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f9fb000c880 tx=0x7f9fb0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0010580 con 0x7f9fb40a6e50 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00106e0 con 0x7f9fb40a6e50 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4151210 con 0x7f9fb40a6e50 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0010a60 con 0x7f9fb40a6e50 2023-08-22T00:24:07.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.307+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb40a4f00 con 0x7f9fb40a6e50 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.308+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb4066030 con 0x7f9fb40a6e50 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.308+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9fb001b460 con 0x7f9fb40a6e50 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.309+0000 7f9faa7fc700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 0x7f9f980612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.309+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9fb0079fb0 con 0x7f9fb40a6e50 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.309+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 0x7f9f980612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.309+0000 7f9fba1a7700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 0x7f9f980612a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9fb40c8330 tx=0x7f9fa4017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.313+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fb004b260 con 0x7f9fb40a6e50 2023-08-22T00:24:07.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.477+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb4047480 con 0x7f9fb40a6e50 2023-08-22T00:24:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.478+0000 7f9faa7fc700 1 -- 172.21.15.98:0/4101741567 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f9fb004e880 con 0x7f9fb40a6e50 2023-08-22T00:24:07.479 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:07.480 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":135,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:06.836623+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:24:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 msgr2=0x7f9f980612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 0x7f9f980612a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9fb40c8330 tx=0x7f9fa4017000).stop 2023-08-22T00:24:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 msgr2=0x7f9fb41651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f9fb000c880 tx=0x7f9fb0008040).stop 2023-08-22T00:24:07.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 shutdown_connections 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9f9805ede0 0x7f9f980612a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fb4151d60 0x7f9fb40a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4066400 0x7f9fb40aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 --2- 172.21.15.98:0/4101741567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fb40a6e50 0x7f9fb41651b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 >> 172.21.15.98:0/4101741567 conn(0x7f9fb406a980 msgr2=0x7f9fb414c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 shutdown_connections 2023-08-22T00:24:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.480+0000 7f9fbc40b700 1 -- 172.21.15.98:0/4101741567 wait complete. 2023-08-22T00:24:07.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:24:07.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.611+0000 7fa487833700 1 Processor -- start 2023-08-22T00:24:07.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 -- start start 2023-08-22T00:24:07.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4800c5360 0x7fa480066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa480157890 0x7fa4800c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800c69b0 con 0x7fa480066150 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4801542c0 con 0x7fa4800c5360 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.612+0000 7fa487833700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c57f0 con 0x7fa480157890 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4800c5360 0x7fa480066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa4800c5360 0x7fa480066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50916/0 (socket says 172.21.15.98:50916) 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 -- 172.21.15.98:0/1943026045 learned_addr learned my addr 172.21.15.98:0/1943026045 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa485dd0700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa480157890 0x7fa4800c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 -- 172.21.15.98:0/1943026045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa480157890 msgr2=0x7fa4800c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa480157890 0x7fa4800c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 -- 172.21.15.98:0/1943026045 >> v1:172.21.15.118:6789/0 conn(0x7fa480066150 legacy=0x7fa4800c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 -- 172.21.15.98:0/1943026045 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800c5ad0 con 0x7fa4800c5360 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa484dce700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4800c5360 0x7fa480066530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fa47c006fd0 tx=0x7fa47c0090f0).ready entity=mon.0 client_cookie=ececf94c4015b921 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa477fff700 1 -- 172.21.15.98:0/1943026045 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00b600 con 0x7fa4800c5360 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa477fff700 1 -- 172.21.15.98:0/1943026045 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00b760 con 0x7fa4800c5360 2023-08-22T00:24:07.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.613+0000 7fa477fff700 1 -- 172.21.15.98:0/1943026045 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00bae0 con 0x7fa4800c5360 2023-08-22T00:24:07.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 -- 172.21.15.98:0/1943026045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4800c5360 msgr2=0x7fa480066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4800c5360 0x7fa480066530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fa47c006fd0 tx=0x7fa47c0090f0).stop 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 -- 172.21.15.98:0/1943026045 shutdown_connections 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa480157890 0x7fa4800c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 --2- 172.21.15.98:0/1943026045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4800c5360 0x7fa480066530 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 -- 172.21.15.98:0/1943026045 >> 172.21.15.98:0/1943026045 conn(0x7fa4800c7800 msgr2=0x7fa4800c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 -- 172.21.15.98:0/1943026045 shutdown_connections 2023-08-22T00:24:07.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.614+0000 7fa487833700 1 -- 172.21.15.98:0/1943026045 wait complete. 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.615+0000 7fa487833700 1 Processor -- start 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.615+0000 7fa487833700 1 -- start start 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa480157890 0x7fa4800ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4800ab650 0x7fa480156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800a7510 con 0x7fa480066150 2023-08-22T00:24:07.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800abb10 con 0x7fa480157890 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa487833700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800abdf0 con 0x7fa4800ab650 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa4855cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.616+0000 7fa4855cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50930/0 (socket says 172.21.15.98:50930) 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 -- 172.21.15.98:0/2285534795 learned_addr learned my addr 172.21.15.98:0/2285534795 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa484dce700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa480157890 0x7fa4800ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa485dd0700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4800ab650 0x7fa480156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 -- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4800ab650 msgr2=0x7fa480156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4800ab650 0x7fa480156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 -- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa480157890 msgr2=0x7fa4800ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa480157890 0x7fa4800ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 -- 172.21.15.98:0/2285534795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009370 con 0x7fa480066150 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4855cf700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fa47000c440 tx=0x7fa470007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000cea0 con 0x7fa480066150 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000f470 con 0x7fa480066150 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800ac0d0 con 0x7fa480066150 2023-08-22T00:24:07.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000f810 con 0x7fa480066150 2023-08-22T00:24:07.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.617+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4800a5370 con 0x7fa480066150 2023-08-22T00:24:07.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.618+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4800a72e0 con 0x7fa480066150 2023-08-22T00:24:07.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.618+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa47000fc40 con 0x7fa480066150 2023-08-22T00:24:07.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.619+0000 7fa4757fa700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 0x7fa4640612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.619+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa4700793c0 con 0x7fa480066150 2023-08-22T00:24:07.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.619+0000 7fa484dce700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 0x7fa4640612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.619+0000 7fa484dce700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 0x7fa4640612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa47c006fd0 tx=0x7fa47c017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.623+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4700488f0 con 0x7fa480066150 2023-08-22T00:24:07.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.828+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa4800c5db0 con 0x7fa480066150 2023-08-22T00:24:07.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.843+0000 7fa4757fa700 1 -- 172.21.15.98:0/2285534795 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa4800a72e0 con 0x7fa480066150 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 msgr2=0x7fa4640612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 0x7fa4640612d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa47c006fd0 tx=0x7fa47c017000).stop 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 msgr2=0x7fa48014f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fa47000c440 tx=0x7fa470007de0).stop 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 shutdown_connections 2023-08-22T00:24:07.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.845+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa46405ee10 0x7fa4640612d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4800ab650 0x7fa480156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa480066150 0x7fa48014f480 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 --2- 172.21.15.98:0/2285534795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa480157890 0x7fa4800ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 >> 172.21.15.98:0/2285534795 conn(0x7fa4800c7800 msgr2=0x7fa4800c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 shutdown_connections 2023-08-22T00:24:07.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.846+0000 7fa487833700 1 -- 172.21.15.98:0/2285534795 wait complete. 2023-08-22T00:24:07.858 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:24:07.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.977+0000 7f1cd3587700 1 Processor -- start 2023-08-22T00:24:07.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.977+0000 7f1cd3587700 1 -- start start 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ccc1505e0 0x7f1ccc062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ccc063380 0x7f1ccc0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 0x7f1ccc0bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc063f90 con 0x7f1ccc063380 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0656f0 con 0x7f1ccc1505e0 2023-08-22T00:24:07.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd3587700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0637e0 con 0x7f1ccc0c2400 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd0b22700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ccc063380 0x7f1ccc0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd0b22700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ccc063380 0x7f1ccc0c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50934/0 (socket says 172.21.15.98:50934) 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.978+0000 7f1cd0b22700 1 -- 172.21.15.98:0/4112520090 learned_addr learned my addr 172.21.15.98:0/4112520090 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd1323700 1 --2- 172.21.15.98:0/4112520090 >> v2:172.21.15.118:3300/0 conn(0x7f1ccc1505e0 0x7f1ccc062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd1b24700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 0x7f1ccc0bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 -- 172.21.15.98:0/4112520090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 msgr2=0x7f1ccc0bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 0x7f1ccc0bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 -- 172.21.15.98:0/4112520090 >> v2:172.21.15.118:3300/0 conn(0x7f1ccc1505e0 msgr2=0x7f1ccc062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/4112520090 >> v2:172.21.15.118:3300/0 conn(0x7f1ccc1505e0 0x7f1ccc062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 -- 172.21.15.98:0/4112520090 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc1509c0 con 0x7f1ccc063380 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd1b24700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 0x7f1ccc0bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc0c1f10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f1ccc06a2b0 tx=0x7f1cc80090f0).ready entity=mon.0 client_cookie=9758c79e2dd2361b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cc3fff700 1 -- 172.21.15.98:0/4112520090 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800b600 con 0x7f1ccc063380 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cc3fff700 1 -- 172.21.15.98:0/4112520090 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800b760 con 0x7f1ccc063380 2023-08-22T00:24:07.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cc3fff700 1 -- 172.21.15.98:0/4112520090 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800bae0 con 0x7f1ccc063380 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 -- 172.21.15.98:0/4112520090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 msgr2=0x7f1ccc0c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc0c1f10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f1ccc06a2b0 tx=0x7f1cc80090f0).stop 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 -- 172.21.15.98:0/4112520090 shutdown_connections 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc0c2400 0x7f1ccc0bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 --2- 172.21.15.98:0/4112520090 >> v2:172.21.15.118:3300/0 conn(0x7f1ccc1505e0 0x7f1ccc062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 --2- 172.21.15.98:0/4112520090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc0c1f10 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 -- 172.21.15.98:0/4112520090 >> 172.21.15.98:0/4112520090 conn(0x7f1ccc0c31d0 msgr2=0x7f1ccc0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:07.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 -- 172.21.15.98:0/4112520090 shutdown_connections 2023-08-22T00:24:07.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.979+0000 7f1cd3587700 1 -- 172.21.15.98:0/4112520090 wait complete. 2023-08-22T00:24:07.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 Processor -- start 2023-08-22T00:24:07.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 -- start start 2023-08-22T00:24:07.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0c2400 0x7f1ccc065e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc1505e0 0x7f1ccc066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1476f0 con 0x7f1ccc063380 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc066800 con 0x7f1ccc0c2400 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.981+0000 7f1cd3587700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0c0590 con 0x7f1ccc1505e0 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50944/0 (socket says 172.21.15.98:50944) 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 -- 172.21.15.98:0/797105310 learned_addr learned my addr 172.21.15.98:0/797105310 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 -- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc1505e0 msgr2=0x7f1ccc066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1b24700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc1505e0 0x7f1ccc066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0c2400 0x7f1ccc065e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc1505e0 0x7f1ccc066310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 -- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0c2400 msgr2=0x7f1ccc065e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0c2400 0x7f1ccc065e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:07.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 -- 172.21.15.98:0/797105310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc8009370 con 0x7f1ccc063380 2023-08-22T00:24:07.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd1323700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f1cbc00d890 tx=0x7f1cbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0125f0 con 0x7f1ccc063380 2023-08-22T00:24:07.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc012750 con 0x7f1ccc063380 2023-08-22T00:24:07.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc148520 con 0x7f1ccc063380 2023-08-22T00:24:07.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc012ad0 con 0x7f1ccc063380 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.982+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc0bff40 con 0x7f1ccc063380 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.983+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc0650c0 con 0x7f1ccc063380 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.983+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1cbc013480 con 0x7f1ccc063380 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.984+0000 7f1cc17fa700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 0x7f1cb00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.984+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1cbc079ce0 con 0x7f1ccc063380 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.984+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 0x7f1cb00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:07.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.984+0000 7f1cd0b22700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 0x7f1cb00612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1ccc066a40 tx=0x7f1cc8017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:07.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:07.988+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cbc04aff0 con 0x7f1ccc063380 2023-08-22T00:24:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.192+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ccc063d70 con 0x7f1ccc063380 2023-08-22T00:24:08.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.844+0000 7f1cc17fa700 1 -- 172.21.15.98:0/797105310 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cbc04e610 con 0x7f1ccc063380 2023-08-22T00:24:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 msgr2=0x7f1cb00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 0x7f1cb00612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1ccc066a40 tx=0x7f1cc8017000).stop 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 msgr2=0x7f1ccc147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f1cbc00d890 tx=0x7f1cbc008040).stop 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 shutdown_connections 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f1cb005ee10 0x7f1cb00612d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ccc1505e0 0x7f1ccc066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ccc063380 0x7f1ccc147200 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 --2- 172.21.15.98:0/797105310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0c2400 0x7f1ccc065e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 >> 172.21.15.98:0/797105310 conn(0x7f1ccc0c31d0 msgr2=0x7f1ccc0c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 shutdown_connections 2023-08-22T00:24:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.846+0000 7f1cd3587700 1 -- 172.21.15.98:0/797105310 wait complete. 2023-08-22T00:24:08.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:24:08.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.979+0000 7f45ecec0700 1 Processor -- start 2023-08-22T00:24:08.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.979+0000 7f45ecec0700 1 -- start start 2023-08-22T00:24:08.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45e814bf70 0x7f45e8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 0x7f45e81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e80c3740 0x7f45e80c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e8066510 con 0x7f45e814bf70 2023-08-22T00:24:08.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e8153080 con 0x7f45e814c350 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45ecec0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80667b0 con 0x7f45e80c3740 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45e659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45e814bf70 0x7f45e8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45e659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45e814bf70 0x7f45e8152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50948/0 (socket says 172.21.15.98:50948) 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.980+0000 7f45e659c700 1 -- 172.21.15.98:0/3992120863 learned_addr learned my addr 172.21.15.98:0/3992120863 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e5d9b700 1 --2- 172.21.15.98:0/3992120863 >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 0x7f45e81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e6d9d700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e80c3740 0x7f45e80c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 -- 172.21.15.98:0/3992120863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e80c3740 msgr2=0x7f45e80c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e80c3740 0x7f45e80c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 -- 172.21.15.98:0/3992120863 >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 msgr2=0x7f45e81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 --2- 172.21.15.98:0/3992120863 >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 0x7f45e81556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 -- 172.21.15.98:0/3992120863 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8155ba0 con 0x7f45e814bf70 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e5d9b700 1 --2- 172.21.15.98:0/3992120863 >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 0x7f45e81556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e659c700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814bf70 0x7f45e8152b90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f45e80c2df0 tx=0x7f45dc0090f0).ready entity=mon.0 client_cookie=1ef94eaf8755304d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e559a700 1 -- 172.21.15.98:0/3992120863 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00b600 con 0x7f45e814bf70 2023-08-22T00:24:08.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e559a700 1 -- 172.21.15.98:0/3992120863 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00b760 con 0x7f45e814bf70 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45e559a700 1 -- 172.21.15.98:0/3992120863 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00bae0 con 0x7f45e814bf70 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45ecec0700 1 -- 172.21.15.98:0/3992120863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814bf70 msgr2=0x7f45e8152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.981+0000 7f45ecec0700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814bf70 0x7f45e8152b90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f45e80c2df0 tx=0x7f45dc0090f0).stop 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 -- 172.21.15.98:0/3992120863 shutdown_connections 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e80c3740 0x7f45e80c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 --2- 172.21.15.98:0/3992120863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814bf70 0x7f45e8152b90 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 --2- 172.21.15.98:0/3992120863 >> v2:172.21.15.118:3300/0 conn(0x7f45e814c350 0x7f45e81556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 -- 172.21.15.98:0/3992120863 >> 172.21.15.98:0/3992120863 conn(0x7f45e80c5dc0 msgr2=0x7f45e8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:08.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 -- 172.21.15.98:0/3992120863 shutdown_connections 2023-08-22T00:24:08.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.982+0000 7f45ecec0700 1 -- 172.21.15.98:0/3992120863 wait complete. 2023-08-22T00:24:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 Processor -- start 2023-08-22T00:24:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 -- start start 2023-08-22T00:24:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45e80c3740 0x7f45e8148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 0x7f45e8064520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8065ca0 con 0x7f45e814c350 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8153840 con 0x7f45e80c3740 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.983+0000 7f45ecec0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8065090 con 0x7f45e814bf70 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50956/0 (socket says 172.21.15.98:50956) 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 -- 172.21.15.98:0/1946066472 learned_addr learned my addr 172.21.15.98:0/1946066472 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e659c700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45e80c3740 0x7f45e8148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e5d9b700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 0x7f45e8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 -- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 msgr2=0x7f45e8064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 0x7f45e8064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 -- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45e80c3740 msgr2=0x7f45e8148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45e80c3740 0x7f45e8148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 -- 172.21.15.98:0/1946066472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009370 con 0x7f45e814c350 2023-08-22T00:24:08.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e5d9b700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 0x7f45e8064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45e6d9d700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f45e0009fa0 tx=0x7f45e0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000ed20 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000ee80 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0014610 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8065370 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.984+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e8065930 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.985+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e8065e50 con 0x7f45e814c350 2023-08-22T00:24:08.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.985+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f45e001d3b0 con 0x7f45e814c350 2023-08-22T00:24:08.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.986+0000 7f45d67fc700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 0x7f45c80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:08.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.986+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f45e007a4f0 con 0x7f45e814c350 2023-08-22T00:24:08.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.986+0000 7f45e659c700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 0x7f45c80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:08.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.986+0000 7f45e659c700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 0x7f45c80612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45dc009130 tx=0x7f45dc017000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:08.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:08.990+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45e8065e50 con 0x7f45e814c350 2023-08-22T00:24:09.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.192+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45e8047480 con 0x7f45e814c350 2023-08-22T00:24:09.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.192+0000 7f45d67fc700 1 -- 172.21.15.98:0/1946066472 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f45e004b7a0 con 0x7f45e814c350 2023-08-22T00:24:09.194 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:09.194 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:24:09.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 msgr2=0x7f45c80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 0x7f45c80612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45dc009130 tx=0x7f45dc017000).stop 2023-08-22T00:24:09.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 msgr2=0x7f45e8064a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f45e0009fa0 tx=0x7f45e0009900).stop 2023-08-22T00:24:09.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 shutdown_connections 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45e814c350 0x7f45e8064a10 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45e80c3740 0x7f45e8148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f45c805ee10 0x7f45c80612d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 --2- 172.21.15.98:0/1946066472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45e814bf70 0x7f45e8064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 >> 172.21.15.98:0/1946066472 conn(0x7f45e80c5dc0 msgr2=0x7f45e8068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 shutdown_connections 2023-08-22T00:24:09.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.194+0000 7f45ecec0700 1 -- 172.21.15.98:0/1946066472 wait complete. 2023-08-22T00:24:09.198 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:24:09.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:24:09.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.323+0000 7f84ef0e0700 1 Processor -- start 2023-08-22T00:24:09.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.323+0000 7f84ef0e0700 1 -- start start 2023-08-22T00:24:09.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ef0e0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f84e8153f40 0x7f84e8157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ef0e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e8157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ef0e0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80a8410 con 0x7f84e8153b60 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ef0e0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80a8cb0 con 0x7f84e8153f40 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ef0e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81586a0 con 0x7f84e80a9140 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f84e8153f40 0x7f84e8157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ece7c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f84e8153b60 0x7f84e8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49718/0 (socket says 172.21.15.98:49718) 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ece7c700 1 -- 172.21.15.98:0/3226245989 learned_addr learned my addr 172.21.15.98:0/3226245989 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ed67d700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e8157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 -- 172.21.15.98:0/3226245989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 msgr2=0x7f84e8157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:09.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e8157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 -- 172.21.15.98:0/3226245989 >> v1:172.21.15.98:6789/0 conn(0x7f84e8153b60 legacy=0x7f84e8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e77fe700 1 -- 172.21.15.98:0/3226245989 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978069348 0 0) 0x7f84e80a8410 con 0x7f84e8153b60 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 -- 172.21.15.98:0/3226245989 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80a8660 con 0x7f84e8153f40 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84ed67d700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e8157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e7fff700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8157930 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f84d4009760 tx=0x7f84d4009060).ready entity=mon.0 client_cookie=a3c57a3ce4a5002a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e77fe700 1 -- 172.21.15.98:0/3226245989 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400b580 con 0x7f84e8153f40 2023-08-22T00:24:09.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e77fe700 1 -- 172.21.15.98:0/3226245989 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d400b6e0 con 0x7f84e8153f40 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.324+0000 7f84e77fe700 1 -- 172.21.15.98:0/3226245989 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400ba60 con 0x7f84e8153f40 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 -- 172.21.15.98:0/3226245989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 msgr2=0x7f84e8157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8157930 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f84d4009760 tx=0x7f84d4009060).stop 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 -- 172.21.15.98:0/3226245989 shutdown_connections 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e8157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/3226245989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8157930 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 -- 172.21.15.98:0/3226245989 >> 172.21.15.98:0/3226245989 conn(0x7f84e80c5dc0 msgr2=0x7f84e8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 -- 172.21.15.98:0/3226245989 shutdown_connections 2023-08-22T00:24:09.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.325+0000 7f84ef0e0700 1 -- 172.21.15.98:0/3226245989 wait complete. 2023-08-22T00:24:09.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.326+0000 7f84ef0e0700 1 Processor -- start 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.326+0000 7f84ef0e0700 1 -- start start 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e80c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8153b60 0x7f84e8168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8168470 con 0x7f84e8153f40 2023-08-22T00:24:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8165350 con 0x7f84e8153b60 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ef0e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8165630 con 0x7f84e80a9140 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50972/0 (socket says 172.21.15.98:50972) 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 -- 172.21.15.98:0/1571877853 learned_addr learned my addr 172.21.15.98:0/1571877853 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ece7c700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e80c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84e7fff700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8153b60 0x7f84e8168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 -- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 msgr2=0x7f84e80c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e80c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 -- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8153b60 msgr2=0x7f84e8168900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8153b60 0x7f84e8168900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ed67d700 1 -- 172.21.15.98:0/1571877853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40092a0 con 0x7f84e8153f40 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.327+0000 7f84ece7c700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e80c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84ed67d700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f84e000a380 tx=0x7f84e00078f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0016470 con 0x7f84e8153f40 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e00165d0 con 0x7f84e8153f40 2023-08-22T00:24:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e8168100 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0016950 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.328+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e8168df0 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.329+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e80c4b90 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.329+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f84e0013070 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.329+0000 7f84e4ff9700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 0x7f84cc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.329+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f84e007aa50 con 0x7f84e8153f40 2023-08-22T00:24:09.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.330+0000 7f84ece7c700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 0x7f84cc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.330+0000 7f84ece7c700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 0x7f84cc0612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84e80c15f0 tx=0x7f84dc009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.334+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84e004bd60 con 0x7f84e8153f40 2023-08-22T00:24:09.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.495+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84e8047480 con 0x7f84e8153f40 2023-08-22T00:24:09.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.496+0000 7f84e4ff9700 1 -- 172.21.15.98:0/1571877853 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+17275 (secure 0 0 0) 0x7f84e001b090 con 0x7f84e8153f40 2023-08-22T00:24:09.497 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:09.498 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":136,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:07.838767+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:24:09.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 msgr2=0x7f84cc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 0x7f84cc0612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84e80c15f0 tx=0x7f84dc009040).stop 2023-08-22T00:24:09.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 msgr2=0x7f84e8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f84e000a380 tx=0x7f84e00078f0).stop 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 shutdown_connections 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f84cc05ee10 0x7f84cc0612d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84e80a9140 0x7f84e80c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e8153f40 0x7f84e8067590 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 --2- 172.21.15.98:0/1571877853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8153b60 0x7f84e8168900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 >> 172.21.15.98:0/1571877853 conn(0x7f84e80c5dc0 msgr2=0x7f84e8151200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 shutdown_connections 2023-08-22T00:24:09.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.498+0000 7f84ef0e0700 1 -- 172.21.15.98:0/1571877853 wait complete. 2023-08-22T00:24:09.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:24:09.512 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:24:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.627+0000 7fc06be47700 1 Processor -- start 2023-08-22T00:24:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.627+0000 7fc06be47700 1 -- start start 2023-08-22T00:24:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06be47700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0640c64a0 0x7fc064154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06be47700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 0x7fc0640bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06be47700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640bcd40 con 0x7fc064154260 2023-08-22T00:24:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06be47700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640c24b0 con 0x7fc0640c64a0 2023-08-22T00:24:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06be47700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414e7b0 con 0x7fc0640c2030 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc0693e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0640c64a0 0x7fc064154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 0x7fc0640bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc069be3700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc064154260 0x7fc064154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56266/0 (socket says 172.21.15.98:56266) 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc069be3700 1 -- 172.21.15.98:0/2767614295 learned_addr learned my addr 172.21.15.98:0/2767614295 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 -- 172.21.15.98:0/2767614295 >> v2:172.21.15.118:3300/0 conn(0x7fc0640c64a0 msgr2=0x7fc064154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 --2- 172.21.15.98:0/2767614295 >> v2:172.21.15.118:3300/0 conn(0x7fc0640c64a0 0x7fc064154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 -- 172.21.15.98:0/2767614295 >> v1:172.21.15.118:6789/0 conn(0x7fc064154260 legacy=0x7fc064154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 -- 172.21.15.98:0/2767614295 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640c4fb0 con 0x7fc0640c2030 2023-08-22T00:24:09.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.628+0000 7fc06a3e4700 1 --2- 172.21.15.98:0/2767614295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 0x7fc0640bc850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc05c009e60 tx=0x7fc05c009780).ready entity=mon.2 client_cookie=b468f7eddd393b0b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc068be1700 1 -- 172.21.15.98:0/2767614295 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc0640c2030 2023-08-22T00:24:09.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc068be1700 1 -- 172.21.15.98:0/2767614295 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00bbf0 con 0x7fc0640c2030 2023-08-22T00:24:09.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc068be1700 1 -- 172.21.15.98:0/2767614295 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012410 con 0x7fc0640c2030 2023-08-22T00:24:09.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 -- 172.21.15.98:0/2767614295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 msgr2=0x7fc0640bc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 --2- 172.21.15.98:0/2767614295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 0x7fc0640bc850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc05c009e60 tx=0x7fc05c009780).stop 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 -- 172.21.15.98:0/2767614295 shutdown_connections 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 --2- 172.21.15.98:0/2767614295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0640c2030 0x7fc0640bc850 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 --2- 172.21.15.98:0/2767614295 >> v2:172.21.15.118:3300/0 conn(0x7fc0640c64a0 0x7fc064154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 -- 172.21.15.98:0/2767614295 >> 172.21.15.98:0/2767614295 conn(0x7fc0640c3980 msgr2=0x7fc0640c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 -- 172.21.15.98:0/2767614295 shutdown_connections 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.629+0000 7fc06be47700 1 -- 172.21.15.98:0/2767614295 wait complete. 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.630+0000 7fc06be47700 1 Processor -- start 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.630+0000 7fc06be47700 1 -- start start 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0640c2030 0x7fc06414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc064154260 0x7fc0640a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414b5b0 con 0x7fc0640c64a0 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414bf30 con 0x7fc0640c2030 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06be47700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414a700 con 0x7fc064154260 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc0693e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc0693e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50986/0 (socket says 172.21.15.98:50986) 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc0693e2700 1 -- 172.21.15.98:0/3760189988 learned_addr learned my addr 172.21.15.98:0/3760189988 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc069be3700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0640c2030 0x7fc06414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.631+0000 7fc06a3e4700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc064154260 0x7fc0640a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 -- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc064154260 msgr2=0x7fc0640a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc064154260 0x7fc0640a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 -- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0640c2030 msgr2=0x7fc06414ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0640c2030 0x7fc06414ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 -- 172.21.15.98:0/3760189988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009a20 con 0x7fc0640c64a0 2023-08-22T00:24:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc0693e2700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc05400e930 tx=0x7fc054009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054012600 con 0x7fc0640c64a0 2023-08-22T00:24:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054012760 con 0x7fc0640c64a0 2023-08-22T00:24:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06414a9a0 con 0x7fc0640c64a0 2023-08-22T00:24:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054012ae0 con 0x7fc0640c64a0 2023-08-22T00:24:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.632+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06414af60 con 0x7fc0640c64a0 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.633+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064047480 con 0x7fc0640c64a0 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.633+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc05401b400 con 0x7fc0640c64a0 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.633+0000 7fc059ffb700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 0x7fc0480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.633+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc05407a400 con 0x7fc0640c64a0 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.634+0000 7fc069be3700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 0x7fc0480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.634+0000 7fc069be3700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 0x7fc0480612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc060007fd0 tx=0x7fc060000bc0).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.638+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc05404b6b0 con 0x7fc0640c64a0 2023-08-22T00:24:09.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.792+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0640a4bf0 con 0x7fc04805ee10 2023-08-22T00:24:09.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.802+0000 7fc059ffb700 1 -- 172.21.15.98:0/3760189988 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353163 (secure 0 0 0) 0x7fc060007530 con 0x7fc04805ee10 2023-08-22T00:24:09.807 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 msgr2=0x7fc0480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 0x7fc0480612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc060007fd0 tx=0x7fc060000bc0).stop 2023-08-22T00:24:09.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 msgr2=0x7fc064142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc05400e930 tx=0x7fc054009060).stop 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 shutdown_connections 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc04805ee10 0x7fc0480612d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc064154260 0x7fc0640a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0640c2030 0x7fc06414ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 --2- 172.21.15.98:0/3760189988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0640c64a0 0x7fc064142a90 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 >> 172.21.15.98:0/3760189988 conn(0x7fc0640c3980 msgr2=0x7fc0641553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 shutdown_connections 2023-08-22T00:24:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.806+0000 7fc06be47700 1 -- 172.21.15.98:0/3760189988 wait complete. 2023-08-22T00:24:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:24:09.819 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-22T00:24:08.873337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430532,"kb_used_data":12804,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544188,"statfs":{"total":773094113280,"available":770605248512,"internally_reserved":0,"allocated":13111296,"data_stored":6928986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5607,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.555207"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460307+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457953+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.462281+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459071+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461504+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457499+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457465+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465627+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456843+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459403+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459081+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461244+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461680+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459998+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461925+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458286+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.467149+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460343+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460639+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458388+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458304+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461264+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456944+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465660+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459877+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457075+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466383+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461027+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460818+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466021+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465792+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461229+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459115+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458746+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460369+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459709+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466045+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456770+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461870+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460879+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466655+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459946+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459963+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458831+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456810+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461068+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458672+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460673+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459470+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465687+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459532+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458719+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089204+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:24:04.089204+0000","last_peered":"2023-08-22T00:24:04.089204+0000","last_clean":"2023-08-22T00:24:04.089204+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:24:04.089204+0000","last_undegraded":"2023-08-22T00:24:04.089204+0000","last_fullsized":"2023-08-22T00:24:04.089204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466072+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089634+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:24:04.089634+0000","last_peered":"2023-08-22T00:24:04.089634+0000","last_clean":"2023-08-22T00:24:04.089634+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:24:04.089634+0000","last_undegraded":"2023-08-22T00:24:04.089634+0000","last_fullsized":"2023-08-22T00:24:04.089634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461213+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089274+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:24:04.089274+0000","last_peered":"2023-08-22T00:24:04.089274+0000","last_clean":"2023-08-22T00:24:04.089274+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:24:04.089274+0000","last_undegraded":"2023-08-22T00:24:04.089274+0000","last_fullsized":"2023-08-22T00:24:04.089274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461636+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089649+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:24:04.089649+0000","last_peered":"2023-08-22T00:24:04.089649+0000","last_clean":"2023-08-22T00:24:04.089649+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:24:04.089649+0000","last_undegraded":"2023-08-22T00:24:04.089649+0000","last_fullsized":"2023-08-22T00:24:04.089649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089715+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:24:04.089715+0000","last_peered":"2023-08-22T00:24:04.089715+0000","last_clean":"2023-08-22T00:24:04.089715+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:24:04.089715+0000","last_undegraded":"2023-08-22T00:24:04.089715+0000","last_fullsized":"2023-08-22T00:24:04.089715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456778+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089606+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:24:04.089606+0000","last_peered":"2023-08-22T00:24:04.089606+0000","last_clean":"2023-08-22T00:24:04.089606+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:24:04.089606+0000","last_undegraded":"2023-08-22T00:24:04.089606+0000","last_fullsized":"2023-08-22T00:24:04.089606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465780+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089611+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:24:04.089611+0000","last_peered":"2023-08-22T00:24:04.089611+0000","last_clean":"2023-08-22T00:24:04.089611+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:24:04.089611+0000","last_undegraded":"2023-08-22T00:24:04.089611+0000","last_fullsized":"2023-08-22T00:24:04.089611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.463528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089203+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:24:04.089203+0000","last_peered":"2023-08-22T00:24:04.089203+0000","last_clean":"2023-08-22T00:24:04.089203+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:24:04.089203+0000","last_undegraded":"2023-08-22T00:24:04.089203+0000","last_fullsized":"2023-08-22T00:24:04.089203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461578+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:03.449854+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:24:03.449854+0000","last_peered":"2023-08-22T00:24:03.449854+0000","last_clean":"2023-08-22T00:24:03.449854+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:24:03.449854+0000","last_undegraded":"2023-08-22T00:24:03.449854+0000","last_fullsized":"2023-08-22T00:24:03.449854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.77500000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.435,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.75,"15min":0.75},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.308},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79100000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.628},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.629}]},{"osd":4,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.373,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":2.504,"15min":2.504},"last":0.255}]},{"osd":2,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.374},"min":{"1min":0.27700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.46800000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.29499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.53100000000000003,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":0.52800000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.311},"max":{"1min":0.76400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.378},"max":{"1min":0.83699999999999997,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82499999999999996,"5min":1.24,"15min":1.24},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.441,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.40200000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":2.298,"15min":2.298},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.45300000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":2.992,"15min":2.992},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":2.323,"15min":2.323},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575061,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46400000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52500000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.26500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46700000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.249},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.64200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.499,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.313}]},{"osd":4,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83799999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.53300000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.39900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.628,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34300000000000003,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.67300000000000004,"5min":1.216,"15min":1.216},"last":0.27800000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.626,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.313},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.39100000000000001},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.438,"15min":0.46100000000000002},"min":{"1min":0.35599999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.41199999999999998},"min":{"1min":0.30599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.25600000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":1.0580000000000001},"last":0.434},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73699999999999999,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.88500000000000001,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77500000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77600000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.187,"15min":0.187},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.377},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42699999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41999999999999998,"15min":0.443},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.32400000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82899999999999996,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.629,"15min":0.65600000000000003},"min":{"1min":0.38600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.65400000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.443}]},{"osd":6,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90500000000000003,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.95999999999999996},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84999999999999998,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.48499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.746},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67300000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71299999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834575060,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.57099999999999995}]},{"osd":1,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.54500000000000004},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67900000000000005,"5min":0.77700000000000002,"15min":0.78700000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.39400000000000002,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.88,"15min":0.88},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.80300000000000005},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.505,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.76400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:24:09.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:24:09.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.975+0000 7f4bace8d700 1 Processor -- start 2023-08-22T00:24:09.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.975+0000 7f4bace8d700 1 -- start start 2023-08-22T00:24:09.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4bace8d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ba8155fe0 0x7f4ba815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4bace8d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba8066420 con 0x7f4ba81550a0 2023-08-22T00:24:09.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4bace8d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba8064360 con 0x7f4ba8155480 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4bace8d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba8064640 con 0x7f4ba8155fe0 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4ba81550a0 0x7f4ba8063b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:49728/0 (socket says 172.21.15.98:49728) 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba659c700 1 -- 172.21.15.98:0/484696346 learned_addr learned my addr 172.21.15.98:0/484696346 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba6d9d700 1 --2- 172.21.15.98:0/484696346 >> v2:172.21.15.118:3300/0 conn(0x7f4ba8155fe0 0x7f4ba815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710666019 0 0) 0x7f4ba8066420 con 0x7f4ba81550a0 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b900033f0 con 0x7f4ba81550a0 2023-08-22T00:24:09.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002292429 0 0) 0x7f4b900033f0 con 0x7f4ba81550a0 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 >> v2:172.21.15.118:3300/0 conn(0x7f4ba8155fe0 msgr2=0x7f4ba815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 --2- 172.21.15.98:0/484696346 >> v2:172.21.15.118:3300/0 conn(0x7f4ba8155fe0 0x7f4ba815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 >> v1:172.21.15.118:6789/0 conn(0x7f4ba8155480 legacy=0x7f4ba81558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80660b0 con 0x7f4ba81550a0 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4b98001470 con 0x7f4ba81550a0 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.976+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 >> v1:172.21.15.98:6789/0 conn(0x7f4ba81550a0 legacy=0x7f4ba8063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b900038e0 0x7f4b90003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 0x7f4b90004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b90005000 0x7f4b9000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8064640 con 0x7f4b90004690 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9000bf60 con 0x7f4b900038e0 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9000c0f0 con 0x7f4b90005000 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 0x7f4b90004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba659c700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b900038e0 0x7f4b90003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba6d9d700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b90005000 0x7f4b9000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b90005000 msgr2=0x7f4b9000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:09.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b90005000 0x7f4b9000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b900038e0 msgr2=0x7f4b90003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:09.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b900038e0 0x7f4b90003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba6d9d700 1 -- 172.21.15.98:0/484696346 reap_dead start 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/484696346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900033f0 con 0x7f4b90004690 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 0x7f4b90004b10 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f4b9c001730 tx=0x7f4b9c007bb0).ready entity=mon.0 client_cookie=c7ed0cb9180bb60a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007020 con 0x7f4b90004690 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c007180 con 0x7f4b90004690 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.977+0000 7f4ba559a700 1 -- 172.21.15.98:0/484696346 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007520 con 0x7f4b90004690 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 -- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 msgr2=0x7f4b90004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 0x7f4b90004b10 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f4b9c001730 tx=0x7f4b9c007bb0).stop 2023-08-22T00:24:09.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 -- 172.21.15.98:0/484696346 shutdown_connections 2023-08-22T00:24:09.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 --2- 172.21.15.98:0/484696346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b90004690 0x7f4b90004b10 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 -- 172.21.15.98:0/484696346 >> 172.21.15.98:0/484696346 conn(0x7f4ba80c7770 msgr2=0x7f4ba80c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:09.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 -- 172.21.15.98:0/484696346 shutdown_connections 2023-08-22T00:24:09.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.978+0000 7f4bace8d700 1 -- 172.21.15.98:0/484696346 wait complete. 2023-08-22T00:24:09.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.979+0000 7f4bace8d700 1 Processor -- start 2023-08-22T00:24:09.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.979+0000 7f4bace8d700 1 -- start start 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b90004690 0x7f4ba80c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ba80aaec0 0x7f4ba80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80c2680 con 0x7f4ba80bf220 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80c1d70 con 0x7f4b90004690 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80bf990 con 0x7f4ba80aaec0 2023-08-22T00:24:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51006/0 (socket says 172.21.15.98:51006) 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/2378576073 learned_addr learned my addr 172.21.15.98:0/2378576073 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba659c700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b90004690 0x7f4ba80c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba6d9d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ba80aaec0 0x7f4ba80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ba80aaec0 msgr2=0x7f4ba80ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ba80aaec0 0x7f4ba80ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b90004690 msgr2=0x7f4ba80c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b90004690 0x7f4ba80c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 -- 172.21.15.98:0/2378576073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80c2030 con 0x7f4ba80bf220 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4ba5d9b700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f4b90005640 tx=0x7f4b9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007020 con 0x7f4ba80bf220 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c013460 con 0x7f4ba80bf220 2023-08-22T00:24:09.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c013820 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80c2680 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.980+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba80bf6a0 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.981+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8047480 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.982+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4b9c013c50 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.982+0000 7f4b967fc700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 0x7f4b880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.982+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4b9c07ab20 con 0x7f4ba80bf220 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.982+0000 7f4ba659c700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 0x7f4b880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.983+0000 7f4ba659c700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 0x7f4b880612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4b980015a0 tx=0x7f4ba80bcef0).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:09.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:09.986+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b9c04bdf0 con 0x7f4ba80bf220 2023-08-22T00:24:10.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.143+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ba80c24d0 con 0x7f4b8805ee10 2023-08-22T00:24:10.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.152+0000 7f4b967fc700 1 -- 172.21.15.98:0/2378576073 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353163 (secure 0 0 0) 0x7f4ba80c24d0 con 0x7f4b8805ee10 2023-08-22T00:24:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:10.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 msgr2=0x7f4b880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 0x7f4b880612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4b980015a0 tx=0x7f4ba80bcef0).stop 2023-08-22T00:24:10.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 msgr2=0x7f4ba814b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f4b90005640 tx=0x7f4b9c015000).stop 2023-08-22T00:24:10.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 shutdown_connections 2023-08-22T00:24:10.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4b8805ee10 0x7f4b880612d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ba80aaec0 0x7f4ba80ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b90004690 0x7f4ba80c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 --2- 172.21.15.98:0/2378576073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba80bf220 0x7f4ba814b810 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 >> 172.21.15.98:0/2378576073 conn(0x7f4ba80c7770 msgr2=0x7f4ba8062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:10.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 shutdown_connections 2023-08-22T00:24:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.156+0000 7f4bace8d700 1 -- 172.21.15.98:0/2378576073 wait complete. 2023-08-22T00:24:10.164 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:24:10.169 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-22T00:24:08.873337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430532,"kb_used_data":12804,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544188,"statfs":{"total":773094113280,"available":770605248512,"internally_reserved":0,"allocated":13111296,"data_stored":6928986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5607,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.555207"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460307+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457953+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.462281+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459071+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461504+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457499+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457465+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465627+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456843+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459403+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459081+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461244+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461680+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459998+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461925+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458286+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.467149+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460343+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460639+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458388+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458304+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461264+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456944+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465660+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459877+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457075+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466383+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461027+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460818+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466021+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465792+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461229+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459115+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458746+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460369+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459709+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466045+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456770+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461870+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460879+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466655+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459946+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459963+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458831+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456810+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461068+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458672+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460673+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459470+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465687+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459532+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458719+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089204+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:24:04.089204+0000","last_peered":"2023-08-22T00:24:04.089204+0000","last_clean":"2023-08-22T00:24:04.089204+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:24:04.089204+0000","last_undegraded":"2023-08-22T00:24:04.089204+0000","last_fullsized":"2023-08-22T00:24:04.089204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466072+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089634+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:24:04.089634+0000","last_peered":"2023-08-22T00:24:04.089634+0000","last_clean":"2023-08-22T00:24:04.089634+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:24:04.089634+0000","last_undegraded":"2023-08-22T00:24:04.089634+0000","last_fullsized":"2023-08-22T00:24:04.089634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461213+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089274+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:24:04.089274+0000","last_peered":"2023-08-22T00:24:04.089274+0000","last_clean":"2023-08-22T00:24:04.089274+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:24:04.089274+0000","last_undegraded":"2023-08-22T00:24:04.089274+0000","last_fullsized":"2023-08-22T00:24:04.089274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461636+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089649+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:24:04.089649+0000","last_peered":"2023-08-22T00:24:04.089649+0000","last_clean":"2023-08-22T00:24:04.089649+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:24:04.089649+0000","last_undegraded":"2023-08-22T00:24:04.089649+0000","last_fullsized":"2023-08-22T00:24:04.089649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089715+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:24:04.089715+0000","last_peered":"2023-08-22T00:24:04.089715+0000","last_clean":"2023-08-22T00:24:04.089715+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:24:04.089715+0000","last_undegraded":"2023-08-22T00:24:04.089715+0000","last_fullsized":"2023-08-22T00:24:04.089715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456778+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089606+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:24:04.089606+0000","last_peered":"2023-08-22T00:24:04.089606+0000","last_clean":"2023-08-22T00:24:04.089606+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:24:04.089606+0000","last_undegraded":"2023-08-22T00:24:04.089606+0000","last_fullsized":"2023-08-22T00:24:04.089606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465780+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089611+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:24:04.089611+0000","last_peered":"2023-08-22T00:24:04.089611+0000","last_clean":"2023-08-22T00:24:04.089611+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:24:04.089611+0000","last_undegraded":"2023-08-22T00:24:04.089611+0000","last_fullsized":"2023-08-22T00:24:04.089611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.463528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089203+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:24:04.089203+0000","last_peered":"2023-08-22T00:24:04.089203+0000","last_clean":"2023-08-22T00:24:04.089203+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:24:04.089203+0000","last_undegraded":"2023-08-22T00:24:04.089203+0000","last_fullsized":"2023-08-22T00:24:04.089203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461578+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:03.449854+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:24:03.449854+0000","last_peered":"2023-08-22T00:24:03.449854+0000","last_clean":"2023-08-22T00:24:03.449854+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:24:03.449854+0000","last_undegraded":"2023-08-22T00:24:03.449854+0000","last_fullsized":"2023-08-22T00:24:03.449854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.77500000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.435,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.75,"15min":0.75},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.308},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79100000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.628},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.629}]},{"osd":4,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.373,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":2.504,"15min":2.504},"last":0.255}]},{"osd":2,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.374},"min":{"1min":0.27700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.46800000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.29499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.53100000000000003,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":0.52800000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.311},"max":{"1min":0.76400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.378},"max":{"1min":0.83699999999999997,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82499999999999996,"5min":1.24,"15min":1.24},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.441,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.40200000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":2.298,"15min":2.298},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.45300000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":2.992,"15min":2.992},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":2.323,"15min":2.323},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575061,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46400000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52500000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.26500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46700000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.249},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.64200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.499,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.313}]},{"osd":4,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83799999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.53300000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.39900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.628,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34300000000000003,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.67300000000000004,"5min":1.216,"15min":1.216},"last":0.27800000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.626,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.313},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.39100000000000001},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.438,"15min":0.46100000000000002},"min":{"1min":0.35599999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.41199999999999998},"min":{"1min":0.30599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.25600000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":1.0580000000000001},"last":0.434},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73699999999999999,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.88500000000000001,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77500000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77600000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.187,"15min":0.187},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.377},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42699999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41999999999999998,"15min":0.443},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.32400000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82899999999999996,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.629,"15min":0.65600000000000003},"min":{"1min":0.38600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.65400000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.443}]},{"osd":6,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90500000000000003,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.95999999999999996},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84999999999999998,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.48499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.746},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67300000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71299999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834575060,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.57099999999999995}]},{"osd":1,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.54500000000000004},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67900000000000005,"5min":0.77700000000000002,"15min":0.78700000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.39400000000000002,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.88,"15min":0.88},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.80300000000000005},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.505,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.76400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:24:10.182 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:24:10.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.324+0000 7fa459b8f700 1 Processor -- start 2023-08-22T00:24:10.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.324+0000 7fa459b8f700 1 -- start start 2023-08-22T00:24:10.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa459b8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 0x7fa454154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa459b8f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa4540c2030 0x7fa4540bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa459b8f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540bcd40 con 0x7fa454154260 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa459b8f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4540c24b0 con 0x7fa4540c2030 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa459b8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45414e7b0 con 0x7fa4540c64a0 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa4537fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa454154260 0x7fa454154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37764/0 (socket says 172.21.15.98:37764) 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa4537fe700 1 -- 172.21.15.98:0/3931153885 learned_addr learned my addr 172.21.15.98:0/3931153885 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:10.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 --2- 172.21.15.98:0/3931153885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 0x7fa454154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa453fff700 1 --2- 172.21.15.98:0/3931153885 >> v2:172.21.15.118:3300/0 conn(0x7fa4540c2030 0x7fa4540bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567785612 0 0) 0x7fa4540bcd40 con 0x7fa454154260 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa43c0033f0 con 0x7fa454154260 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 -- 172.21.15.98:0/3931153885 >> v2:172.21.15.118:3300/0 conn(0x7fa4540c2030 msgr2=0x7fa4540bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 --2- 172.21.15.98:0/3931153885 >> v2:172.21.15.118:3300/0 conn(0x7fa4540c2030 0x7fa4540bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 -- 172.21.15.98:0/3931153885 >> v1:172.21.15.98:6789/0 conn(0x7fa454154260 legacy=0x7fa454154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553275983 0 0) 0x7fa43c0033f0 con 0x7fa454154260 2023-08-22T00:24:10.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 -- 172.21.15.98:0/3931153885 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540c4fb0 con 0x7fa4540c64a0 2023-08-22T00:24:10.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.325+0000 7fa452ffd700 1 --2- 172.21.15.98:0/3931153885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 0x7fa454154d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa444009760 tx=0x7fa444009060).ready entity=mon.2 client_cookie=ad1bd924ca2d30ce server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400f510 con 0x7fa4540c64a0 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44400f670 con 0x7fa4540c64a0 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa4527fc700 1 -- 172.21.15.98:0/3931153885 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400f9f0 con 0x7fa4540c64a0 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 -- 172.21.15.98:0/3931153885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 msgr2=0x7fa454154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 --2- 172.21.15.98:0/3931153885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 0x7fa454154d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa444009760 tx=0x7fa444009060).stop 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 -- 172.21.15.98:0/3931153885 shutdown_connections 2023-08-22T00:24:10.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 --2- 172.21.15.98:0/3931153885 >> v2:172.21.15.118:3300/0 conn(0x7fa4540c2030 0x7fa4540bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 --2- 172.21.15.98:0/3931153885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4540c64a0 0x7fa454154d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 -- 172.21.15.98:0/3931153885 >> 172.21.15.98:0/3931153885 conn(0x7fa4540c3980 msgr2=0x7fa4540c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:10.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 -- 172.21.15.98:0/3931153885 shutdown_connections 2023-08-22T00:24:10.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.326+0000 7fa459b8f700 1 -- 172.21.15.98:0/3931153885 wait complete. 2023-08-22T00:24:10.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.327+0000 7fa459b8f700 1 Processor -- start 2023-08-22T00:24:10.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.327+0000 7fa459b8f700 1 -- start start 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540c2030 0x7fa454151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa454154260 0x7fa45414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454153730 con 0x7fa4540c64a0 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45414d280 con 0x7fa4540c2030 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa459b8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa454152b20 con 0x7fa454154260 2023-08-22T00:24:10.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa452ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa452ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35544/0 (socket says 172.21.15.98:35544) 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.328+0000 7fa452ffd700 1 -- 172.21.15.98:0/1779918255 learned_addr learned my addr 172.21.15.98:0/1779918255 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 -- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa454154260 msgr2=0x7fa45414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa453fff700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa454154260 0x7fa45414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa4537fe700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540c2030 0x7fa454151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa454154260 0x7fa45414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 -- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540c2030 msgr2=0x7fa454151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.336 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540c2030 0x7fa454151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 -- 172.21.15.98:0/1779918255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440092a0 con 0x7fa4540c64a0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa452ffd700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fa444009d50 tx=0x7fa444017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400f7e0 con 0x7fa4540c64a0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44400f940 con 0x7fa4540c64a0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa454152e00 con 0x7fa4540c64a0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44401b660 con 0x7fa4540c64a0 2023-08-22T00:24:10.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.329+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4541533c0 con 0x7fa4540c64a0 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.330+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa454047480 con 0x7fa4540c64a0 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.330+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa44401b9d0 con 0x7fa4540c64a0 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.331+0000 7fa43b7fe700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 0x7fa4400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.331+0000 7fa4537fe700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 0x7fa4400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.331+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa44407b770 con 0x7fa4540c64a0 2023-08-22T00:24:10.338 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.331+0000 7fa4537fe700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 0x7fa4400612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa448007fd0 tx=0x7fa448009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.335+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa44404cb20 con 0x7fa4540c64a0 2023-08-22T00:24:10.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.494+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4540bcfc0 con 0x7fa44005ee10 2023-08-22T00:24:10.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.503+0000 7fa43b7fe700 1 -- 172.21.15.98:0/1779918255 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353163 (secure 0 0 0) 0x7fa4540bcfc0 con 0x7fa44005ee10 2023-08-22T00:24:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:10.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 msgr2=0x7fa4400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 0x7fa4400612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa448007fd0 tx=0x7fa448009040).stop 2023-08-22T00:24:10.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 msgr2=0x7fa45414cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fa444009d50 tx=0x7fa444017000).stop 2023-08-22T00:24:10.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 shutdown_connections 2023-08-22T00:24:10.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa44005ee10 0x7fa4400612d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa454154260 0x7fa45414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540c2030 0x7fa454151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 --2- 172.21.15.98:0/1779918255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4540c64a0 0x7fa45414cd90 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 >> 172.21.15.98:0/1779918255 conn(0x7fa4540c3980 msgr2=0x7fa4540c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 shutdown_connections 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.507+0000 7fa459b8f700 1 -- 172.21.15.98:0/1779918255 wait complete. 2023-08-22T00:24:10.513 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:24:10.520 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-22T00:24:08.873337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430532,"kb_used_data":12804,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544188,"statfs":{"total":773094113280,"available":770605248512,"internally_reserved":0,"allocated":13111296,"data_stored":6928986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5607,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.555207"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460307+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457953+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.462281+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459071+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461504+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457499+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457465+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465627+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456843+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459403+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458754+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459081+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461244+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461680+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459998+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461925+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458286+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.467149+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460343+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460639+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458388+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458585+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458304+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461264+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456944+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465660+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459877+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.457075+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466383+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461027+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460818+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466021+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465792+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461229+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459115+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458746+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460369+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459709+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466045+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456770+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461870+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460879+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466655+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459946+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459963+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458831+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456810+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461068+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458672+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.460673+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459470+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465687+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.459532+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.458719+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089204+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:24:04.089204+0000","last_peered":"2023-08-22T00:24:04.089204+0000","last_clean":"2023-08-22T00:24:04.089204+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:24:04.089204+0000","last_undegraded":"2023-08-22T00:24:04.089204+0000","last_fullsized":"2023-08-22T00:24:04.089204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.466072+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089634+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:24:04.089634+0000","last_peered":"2023-08-22T00:24:04.089634+0000","last_clean":"2023-08-22T00:24:04.089634+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:24:04.089634+0000","last_undegraded":"2023-08-22T00:24:04.089634+0000","last_fullsized":"2023-08-22T00:24:04.089634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461213+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089274+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:24:04.089274+0000","last_peered":"2023-08-22T00:24:04.089274+0000","last_clean":"2023-08-22T00:24:04.089274+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:24:04.089274+0000","last_undegraded":"2023-08-22T00:24:04.089274+0000","last_fullsized":"2023-08-22T00:24:04.089274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461636+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089649+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:24:04.089649+0000","last_peered":"2023-08-22T00:24:04.089649+0000","last_clean":"2023-08-22T00:24:04.089649+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:24:04.089649+0000","last_undegraded":"2023-08-22T00:24:04.089649+0000","last_fullsized":"2023-08-22T00:24:04.089649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089715+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:24:04.089715+0000","last_peered":"2023-08-22T00:24:04.089715+0000","last_clean":"2023-08-22T00:24:04.089715+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:24:04.089715+0000","last_undegraded":"2023-08-22T00:24:04.089715+0000","last_fullsized":"2023-08-22T00:24:04.089715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.456778+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089606+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:24:04.089606+0000","last_peered":"2023-08-22T00:24:04.089606+0000","last_clean":"2023-08-22T00:24:04.089606+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:24:04.089606+0000","last_undegraded":"2023-08-22T00:24:04.089606+0000","last_fullsized":"2023-08-22T00:24:04.089606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.465780+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089611+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:24:04.089611+0000","last_peered":"2023-08-22T00:24:04.089611+0000","last_clean":"2023-08-22T00:24:04.089611+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:24:04.089611+0000","last_undegraded":"2023-08-22T00:24:04.089611+0000","last_fullsized":"2023-08-22T00:24:04.089611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.463528+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:04.089203+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:24:04.089203+0000","last_peered":"2023-08-22T00:24:04.089203+0000","last_clean":"2023-08-22T00:24:04.089203+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:24:04.089203+0000","last_undegraded":"2023-08-22T00:24:04.089203+0000","last_fullsized":"2023-08-22T00:24:04.089203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:24:06.453629+0000","last_change":"2023-08-22T00:24:06.453629+0000","last_active":"2023-08-22T00:24:06.453629+0000","last_peered":"2023-08-22T00:24:06.453629+0000","last_clean":"2023-08-22T00:24:06.453629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:06.453629+0000","last_undegraded":"2023-08-22T00:24:06.453629+0000","last_fullsized":"2023-08-22T00:24:06.453629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:24:05.449447+0000","last_change":"2023-08-22T00:24:05.461578+0000","last_active":"2023-08-22T00:24:05.449447+0000","last_peered":"2023-08-22T00:24:05.449447+0000","last_clean":"2023-08-22T00:24:05.449447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:24:05.449447+0000","last_undegraded":"2023-08-22T00:24:05.449447+0000","last_fullsized":"2023-08-22T00:24:05.449447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-08-22T00:24:03.449854+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:24:03.449854+0000","last_peered":"2023-08-22T00:24:03.449854+0000","last_clean":"2023-08-22T00:24:03.449854+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:24:03.449854+0000","last_undegraded":"2023-08-22T00:24:03.449854+0000","last_fullsized":"2023-08-22T00:24:03.449854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.77500000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.435,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.75,"15min":0.75},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.308},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79100000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.628},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.629}]},{"osd":4,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.373,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":2.504,"15min":2.504},"last":0.255}]},{"osd":2,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.374},"min":{"1min":0.27700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.46800000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.29499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.53100000000000003,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":0.52800000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.311},"max":{"1min":0.76400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.378},"max":{"1min":0.83699999999999997,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82499999999999996,"5min":1.24,"15min":1.24},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.441,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.40200000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":2.298,"15min":2.298},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.45300000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":2.992,"15min":2.992},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":2.323,"15min":2.323},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575061,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46400000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52500000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.26500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46700000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.249},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.64200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.499,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.313}]},{"osd":4,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83799999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.53300000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.39900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.628,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302800,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069040,"statfs":{"total":96636764160,"available":96326696960,"internally_reserved":0,"allocated":1646592,"data_stored":870232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34300000000000003,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.67300000000000004,"5min":1.216,"15min":1.216},"last":0.27800000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.626,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.313},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.39100000000000001},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.438,"15min":0.46100000000000002},"min":{"1min":0.35599999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.41199999999999998},"min":{"1min":0.30599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.25600000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":1.0580000000000001},"last":0.434},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73699999999999999,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.41799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.88500000000000001,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77500000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77600000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.187,"15min":0.187},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.377},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42699999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41999999999999998,"15min":0.443},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.32400000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82899999999999996,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.629,"15min":0.65600000000000003},"min":{"1min":0.38600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.96799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.65400000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.443}]},{"osd":6,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90500000000000003,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.95999999999999996},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84999999999999998,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.48499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306884,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064956,"statfs":{"total":96636764160,"available":96322514944,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.746},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67300000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71299999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834575060,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302788,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069052,"statfs":{"total":96636764160,"available":96326709248,"internally_reserved":0,"allocated":1634304,"data_stored":863658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.57099999999999995}]},{"osd":1,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.54500000000000004},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67900000000000005,"5min":0.77700000000000002,"15min":0.78700000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.39400000000000002,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.88,"15min":0.88},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.80300000000000005},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.505,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.76400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:24:10.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-08-22T00:24:10.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-08-22T00:24:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460307+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-08-22T00:24:10.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-08-22T00:24:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.457953+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-08-22T00:24:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-08-22T00:24:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.462281+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-08-22T00:24:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-08-22T00:24:10.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459071+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-08-22T00:24:10.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-08-22T00:24:10.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461504+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-08-22T00:24:10.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-08-22T00:24:10.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.457499+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-08-22T00:24:10.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-08-22T00:24:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.457465+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-08-22T00:24:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-08-22T00:24:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.465627+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-08-22T00:24:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-08-22T00:24:10.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.456843+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-08-22T00:24:10.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-08-22T00:24:10.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459403+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-08-22T00:24:10.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-08-22T00:24:10.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461754+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-08-22T00:24:10.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-08-22T00:24:10.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458754+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-08-22T00:24:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-08-22T00:24:10.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459081+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-08-22T00:24:10.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-08-22T00:24:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460585+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:24:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-08-22T00:24:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-08-22T00:24:10.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461244+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:24:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-08-22T00:24:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-08-22T00:24:10.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461680+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:24:10.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-08-22T00:24:10.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-08-22T00:24:10.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459998+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-08-22T00:24:10.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-08-22T00:24:10.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.457528+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-08-22T00:24:10.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-08-22T00:24:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461925+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-08-22T00:24:10.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-08-22T00:24:10.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458286+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-08-22T00:24:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-08-22T00:24:10.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.467149+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-08-22T00:24:10.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-08-22T00:24:10.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460343+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-08-22T00:24:10.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-08-22T00:24:10.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460639+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-08-22T00:24:10.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-08-22T00:24:10.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458388+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-08-22T00:24:10.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-08-22T00:24:10.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458585+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-08-22T00:24:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-08-22T00:24:10.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458304+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-08-22T00:24:10.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-08-22T00:24:10.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461264+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-08-22T00:24:10.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-08-22T00:24:10.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.456944+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-08-22T00:24:10.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-08-22T00:24:10.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.465660+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-08-22T00:24:10.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-08-22T00:24:10.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459877+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-08-22T00:24:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-08-22T00:24:10.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.457075+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-08-22T00:24:10.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-08-22T00:24:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.466383+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-08-22T00:24:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-08-22T00:24:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461027+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-08-22T00:24:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-08-22T00:24:10.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460818+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:24:10.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-08-22T00:24:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-08-22T00:24:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.466021+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-08-22T00:24:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-08-22T00:24:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.465792+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-08-22T00:24:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-08-22T00:24:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461229+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-08-22T00:24:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-08-22T00:24:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459115+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-08-22T00:24:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-08-22T00:24:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458746+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-08-22T00:24:10.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-08-22T00:24:10.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460369+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-08-22T00:24:10.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-08-22T00:24:10.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459709+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-08-22T00:24:10.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-08-22T00:24:10.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.466045+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-08-22T00:24:10.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-08-22T00:24:10.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.456770+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-08-22T00:24:10.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-08-22T00:24:10.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461870+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-08-22T00:24:10.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-08-22T00:24:10.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460879+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-08-22T00:24:10.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-08-22T00:24:10.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.466655+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-08-22T00:24:10.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-08-22T00:24:10.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459946+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-08-22T00:24:10.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-08-22T00:24:10.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459963+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-08-22T00:24:10.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-08-22T00:24:10.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458831+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-08-22T00:24:10.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-08-22T00:24:10.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.456810+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-08-22T00:24:10.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-08-22T00:24:10.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461068+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-08-22T00:24:10.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-08-22T00:24:10.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458672+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-08-22T00:24:10.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-08-22T00:24:10.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.460673+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-08-22T00:24:10.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-08-22T00:24:10.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459470+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:24:10.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-08-22T00:24:10.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-08-22T00:24:10.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.465687+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-08-22T00:24:10.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-08-22T00:24:10.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.459532+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-08-22T00:24:10.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-08-22T00:24:10.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.458719+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:24:10.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-08-22T00:24:10.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-08-22T00:24:10.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.466072+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-08-22T00:24:10.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-08-22T00:24:10.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461213+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:24:10.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-08-22T00:24:10.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-08-22T00:24:10.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461636+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:24:10.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-08-22T00:24:10.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-08-22T00:24:10.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.456778+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:24:10.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-08-22T00:24:10.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-08-22T00:24:10.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.465780+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:24:10.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-08-22T00:24:10.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-08-22T00:24:10.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.463528+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-08-22T00:24:10.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:24:06.453629+0000', 'last_change': '2023-08-22T00:24:06.453629+0000', 'last_active': '2023-08-22T00:24:06.453629+0000', 'last_peered': '2023-08-22T00:24:06.453629+0000', 'last_clean': '2023-08-22T00:24:06.453629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:06.453629+0000', 'last_undegraded': '2023-08-22T00:24:06.453629+0000', 'last_fullsized': '2023-08-22T00:24:06.453629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:06.453629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:24:10.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-08-22T00:24:10.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:24:05.449447+0000', 'last_change': '2023-08-22T00:24:05.461578+0000', 'last_active': '2023-08-22T00:24:05.449447+0000', 'last_peered': '2023-08-22T00:24:05.449447+0000', 'last_clean': '2023-08-22T00:24:05.449447+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:24:05.449447+0000', 'last_undegraded': '2023-08-22T00:24:05.449447+0000', 'last_fullsized': '2023-08-22T00:24:05.449447+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'last_clean_scrub_stamp': '2023-08-22T00:24:05.449447+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:24:10.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:24:10.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.739+0000 7fe1e8b40700 1 Processor -- start 2023-08-22T00:24:10.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.739+0000 7fe1e8b40700 1 -- start start 2023-08-22T00:24:10.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e8b40700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e4150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e8b40700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1e40c26b0 0x7fe1e40c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e8b40700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40c2220 con 0x7fe1e4150040 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e8b40700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c5bd0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e8b40700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c1ef0 con 0x7fe1e4153f10 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1e40c26b0 0x7fe1e40c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1e40c26b0 0x7fe1e40c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35546/0 (socket says 172.21.15.98:35546) 2023-08-22T00:24:10.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 -- 172.21.15.98:0/1100217375 learned_addr learned my addr 172.21.15.98:0/1100217375 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e1d9b700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 -- 172.21.15.98:0/1100217375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 msgr2=0x7fe1e4150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e4150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 -- 172.21.15.98:0/1100217375 >> v1:172.21.15.118:6789/0 conn(0x7fe1e4150040 legacy=0x7fe1e40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 -- 172.21.15.98:0/1100217375 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40c5e30 con 0x7fe1e40c26b0 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e2d9d700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e40c2b40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fe1dc00d1a0 tx=0x7fe1dc00ba50).ready entity=mon.0 client_cookie=91dc885d8389a4b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e159a700 1 -- 172.21.15.98:0/1100217375 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc010070 con 0x7fe1e40c26b0 2023-08-22T00:24:10.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e159a700 1 -- 172.21.15.98:0/1100217375 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00de10 con 0x7fe1e40c26b0 2023-08-22T00:24:10.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.741+0000 7fe1e159a700 1 -- 172.21.15.98:0/1100217375 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00b2e0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 -- 172.21.15.98:0/1100217375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 msgr2=0x7fe1e40c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e40c2b40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fe1dc00d1a0 tx=0x7fe1dc00ba50).stop 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 -- 172.21.15.98:0/1100217375 shutdown_connections 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e40c2b40 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/1100217375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 -- 172.21.15.98:0/1100217375 >> 172.21.15.98:0/1100217375 conn(0x7fe1e40c7140 msgr2=0x7fe1e40c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 -- 172.21.15.98:0/1100217375 shutdown_connections 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.742+0000 7fe1e8b40700 1 -- 172.21.15.98:0/1100217375 wait complete. 2023-08-22T00:24:10.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.743+0000 7fe1e8b40700 1 Processor -- start 2023-08-22T00:24:10.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.743+0000 7fe1e8b40700 1 -- start start 2023-08-22T00:24:10.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e4150040 0x7fe1e40bd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e41675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40a46a0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40a4980 con 0x7fe1e4150040 2023-08-22T00:24:10.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e8b40700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40a4c60 con 0x7fe1e4153f10 2023-08-22T00:24:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e1d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e4150040 0x7fe1e40bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35548/0 (socket says 172.21.15.98:35548) 2023-08-22T00:24:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 -- 172.21.15.98:0/2836827617 learned_addr learned my addr 172.21.15.98:0/2836827617 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:10.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e2d9d700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e41675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 -- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 msgr2=0x7fe1e41675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e41675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 -- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e4150040 msgr2=0x7fe1e40bd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e4150040 0x7fe1e40bd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 -- 172.21.15.98:0/2836827617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc00bcf0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1e259c700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fe1d400c4c0 tx=0x7fe1d4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.744+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400ce70 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.745+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d4001e90 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.745+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40a4f40 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.745+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4007270 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.745+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e413ff00 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.745+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4150ec0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.746+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe1d40066a0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.746+0000 7fe1da7fc700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 0x7fe1c40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.746+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe1d40796d0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.746+0000 7fe1e1d9b700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 0x7fe1c40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.747+0000 7fe1e1d9b700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 0x7fe1c40612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe1e40a54b0 tx=0x7fe1cc009060).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:10.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.750+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1d404a9e0 con 0x7fe1e40c26b0 2023-08-22T00:24:10.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.979+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe1e4140180 con 0x7fe1e40c26b0 2023-08-22T00:24:10.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.979+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2836827617 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7fe1e4140180 con 0x7fe1e40c26b0 2023-08-22T00:24:10.981 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:10.982 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1099,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2488864768,"bytes_avail":770605248512,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":49,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7860}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-22T00:23:49.836015+0000","services":{}},"progress_events":{}} 2023-08-22T00:24:10.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 msgr2=0x7fe1c40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 0x7fe1c40612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe1e40a54b0 tx=0x7fe1cc009060).stop 2023-08-22T00:24:10.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 msgr2=0x7fe1e413fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:10.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fe1d400c4c0 tx=0x7fe1d4007e00).stop 2023-08-22T00:24:10.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 shutdown_connections 2023-08-22T00:24:10.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1c405ee10 0x7fe1c40612d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1e4153f10 0x7fe1e41675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e40c26b0 0x7fe1e413fa10 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 --2- 172.21.15.98:0/2836827617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e4150040 0x7fe1e40bd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:10.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 >> 172.21.15.98:0/2836827617 conn(0x7fe1e40c7140 msgr2=0x7fe1e40bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:10.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 shutdown_connections 2023-08-22T00:24:10.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:10.981+0000 7fe1e8b40700 1 -- 172.21.15.98:0/2836827617 wait complete. 2023-08-22T00:24:10.994 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:24:10.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:24:11.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.111+0000 7ffbebaad700 1 Processor -- start 2023-08-22T00:24:11.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.111+0000 7ffbebaad700 1 -- start start 2023-08-22T00:24:11.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbebaad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffbe4158030 0x7ffbe4158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbebaad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbe4063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbebaad700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe41541b0 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbebaad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40bc440 con 0x7ffbe4158030 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbebaad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4063f90 con 0x7ffbe4063610 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbe9048700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ffbe40bc8d0 0x7ffbe40c2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37780/0 (socket says 172.21.15.98:37780) 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbe9048700 1 -- 172.21.15.98:0/3041396940 learned_addr learned my addr 172.21.15.98:0/3041396940 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249421570 0 0) 0x7ffbd4001110 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd00033f0 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbe9849700 1 --2- 172.21.15.98:0/3041396940 >> v2:172.21.15.118:3300/0 conn(0x7ffbe4158030 0x7ffbe4158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.112+0000 7ffbea04a700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbe4063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1017980365 0 0) 0x7ffbd00033f0 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 msgr2=0x7ffbe4063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbe4063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 >> v2:172.21.15.118:3300/0 conn(0x7ffbe4158030 msgr2=0x7ffbe4158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:11.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 --2- 172.21.15.98:0/3041396940 >> v2:172.21.15.118:3300/0 conn(0x7ffbe4158030 0x7ffbe4158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40bbb50 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ffbd4001600 con 0x7ffbe40bc8d0 2023-08-22T00:24:11.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 >> v1:172.21.15.98:6789/0 conn(0x7ffbe40bc8d0 legacy=0x7ffbe40c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd00038e0 0x7ffbd0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbd0004690 0x7ffbd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbd0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40bc440 con 0x7ffbd0004690 2023-08-22T00:24:11.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4063f90 con 0x7ffbd00038e0 2023-08-22T00:24:11.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd000b930 con 0x7ffbe4063610 2023-08-22T00:24:11.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbd0004690 0x7ffbd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9849700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd00038e0 0x7ffbd0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbea04a700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbd0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 -- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 msgr2=0x7ffbd0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:11.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbd0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 -- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd00038e0 msgr2=0x7ffbd0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:11.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd00038e0 0x7ffbd0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 -- 172.21.15.98:0/3041396940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00033f0 con 0x7ffbd0004690 2023-08-22T00:24:11.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbea04a700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe4063610 0x7ffbd0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:11.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe9048700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbd0004690 0x7ffbd0004b10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7ffbd400c370 tx=0x7ffbd4007900).ready entity=mon.0 client_cookie=a0a72bc47bbaa4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:11.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4007bf0 con 0x7ffbd0004690 2023-08-22T00:24:11.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd400cc60 con 0x7ffbd0004690 2023-08-22T00:24:11.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.113+0000 7ffbe8847700 1 -- 172.21.15.98:0/3041396940 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40070d0 con 0x7ffbd0004690 2023-08-22T00:24:11.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 -- 172.21.15.98:0/3041396940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbd0004690 msgr2=0x7ffbd0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 --2- 172.21.15.98:0/3041396940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbd0004690 0x7ffbd0004b10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7ffbd400c370 tx=0x7ffbd4007900).stop 2023-08-22T00:24:11.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbea04a700 1 -- 172.21.15.98:0/3041396940 reap_dead start 2023-08-22T00:24:11.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 -- 172.21.15.98:0/3041396940 shutdown_connections 2023-08-22T00:24:11.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 -- 172.21.15.98:0/3041396940 >> 172.21.15.98:0/3041396940 conn(0x7ffbe40691b0 msgr2=0x7ffbe40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:11.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 -- 172.21.15.98:0/3041396940 shutdown_connections 2023-08-22T00:24:11.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.114+0000 7ffbebaad700 1 -- 172.21.15.98:0/3041396940 wait complete. 2023-08-22T00:24:11.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.115+0000 7ffbebaad700 1 Processor -- start 2023-08-22T00:24:11.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.115+0000 7ffbebaad700 1 -- start start 2023-08-22T00:24:11.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd0004690 0x7ffbe4146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe40c5ba0 0x7ffbe40c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c6510 con 0x7ffbe40be530 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40bf1f0 con 0x7ffbd0004690 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbebaad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40bf4d0 con 0x7ffbe40c5ba0 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35566/0 (socket says 172.21.15.98:35566) 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 -- 172.21.15.98:0/511221815 learned_addr learned my addr 172.21.15.98:0/511221815 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:11.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbe9849700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd0004690 0x7ffbe4146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbe9048700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe40c5ba0 0x7ffbe40c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 -- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe40c5ba0 msgr2=0x7ffbe40c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe40c5ba0 0x7ffbe40c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 -- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd0004690 msgr2=0x7ffbe4146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd0004690 0x7ffbe4146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 -- 172.21.15.98:0/511221815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40bf7b0 con 0x7ffbe40be530 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.116+0000 7ffbea04a700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7ffbe4068ea0 tx=0x7ffbdc009850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:11.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.117+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc007ea0 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.117+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00f030 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.117+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40bfa90 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.117+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc015420 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.117+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40beea0 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.118+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe40bffb0 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.118+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ffbdc003040 con 0x7ffbe40be530 2023-08-22T00:24:11.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.118+0000 7ffbd9ffb700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 0x7ffbc80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.118+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ffbdc07a3c0 con 0x7ffbe40be530 2023-08-22T00:24:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.118+0000 7ffbe9849700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 0x7ffbc80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.119+0000 7ffbe9849700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 0x7ffbc80612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffbe0006d20 tx=0x7ffbe0006f40).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.122+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffbdc04b6d0 con 0x7ffbe40be530 2023-08-22T00:24:11.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.279+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbe4047480 con 0x7ffbc805ee10 2023-08-22T00:24:11.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.289+0000 7ffbd9ffb700 1 -- 172.21.15.98:0/511221815 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361980 (secure 0 0 0) 0x7ffbe4047480 con 0x7ffbc805ee10 2023-08-22T00:24:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 msgr2=0x7ffbc80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 0x7ffbc80612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffbe0006d20 tx=0x7ffbe0006f40).stop 2023-08-22T00:24:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 msgr2=0x7ffbe40be9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7ffbe4068ea0 tx=0x7ffbdc009850).stop 2023-08-22T00:24:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 shutdown_connections 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe40be530 0x7ffbe40be9b0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbd0004690 0x7ffbe4146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ffbc805ee10 0x7ffbc80612d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 --2- 172.21.15.98:0/511221815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbe40c5ba0 0x7ffbe40c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 >> 172.21.15.98:0/511221815 conn(0x7ffbe40691b0 msgr2=0x7ffbe4152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 shutdown_connections 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:11.292+0000 7ffbebaad700 1 -- 172.21.15.98:0/511221815 wait complete. 2023-08-22T00:24:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:24:11.305 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-22T00:24:10.873691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":244,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430944,"kb_used_data":13216,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543776,"statfs":{"total":773094113280,"available":770604826624,"internally_reserved":0,"allocated":13533184,"data_stored":7139436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5607,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.555207"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854327+0000","last_change":"2023-08-22T00:24:06.851037+0000","last_active":"2023-08-22T00:24:06.854327+0000","last_peered":"2023-08-22T00:24:06.854327+0000","last_clean":"2023-08-22T00:24:06.854327+0000","last_became_active":"2023-08-22T00:24:06.849185+0000","last_became_peered":"2023-08-22T00:24:06.849185+0000","last_unstale":"2023-08-22T00:24:06.854327+0000","last_undegraded":"2023-08-22T00:24:06.854327+0000","last_fullsized":"2023-08-22T00:24:06.854327+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870590+0000","last_change":"2023-08-22T00:24:06.487200+0000","last_active":"2023-08-22T00:24:06.870590+0000","last_peered":"2023-08-22T00:24:06.870590+0000","last_clean":"2023-08-22T00:24:06.870590+0000","last_became_active":"2023-08-22T00:24:06.486930+0000","last_became_peered":"2023-08-22T00:24:06.486930+0000","last_unstale":"2023-08-22T00:24:06.870590+0000","last_undegraded":"2023-08-22T00:24:06.870590+0000","last_fullsized":"2023-08-22T00:24:06.870590+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870823+0000","last_change":"2023-08-22T00:24:06.869014+0000","last_active":"2023-08-22T00:24:06.870823+0000","last_peered":"2023-08-22T00:24:06.870823+0000","last_clean":"2023-08-22T00:24:06.870823+0000","last_became_active":"2023-08-22T00:24:06.868747+0000","last_became_peered":"2023-08-22T00:24:06.868747+0000","last_unstale":"2023-08-22T00:24:06.870823+0000","last_undegraded":"2023-08-22T00:24:06.870823+0000","last_fullsized":"2023-08-22T00:24:06.870823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842776+0000","last_change":"2023-08-22T00:24:06.479752+0000","last_active":"2023-08-22T00:24:06.842776+0000","last_peered":"2023-08-22T00:24:06.842776+0000","last_clean":"2023-08-22T00:24:06.842776+0000","last_became_active":"2023-08-22T00:24:06.479480+0000","last_became_peered":"2023-08-22T00:24:06.479480+0000","last_unstale":"2023-08-22T00:24:06.842776+0000","last_undegraded":"2023-08-22T00:24:06.842776+0000","last_fullsized":"2023-08-22T00:24:06.842776+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868864+0000","last_change":"2023-08-22T00:24:06.856964+0000","last_active":"2023-08-22T00:24:06.868864+0000","last_peered":"2023-08-22T00:24:06.868864+0000","last_clean":"2023-08-22T00:24:06.868864+0000","last_became_active":"2023-08-22T00:24:06.856695+0000","last_became_peered":"2023-08-22T00:24:06.856695+0000","last_unstale":"2023-08-22T00:24:06.868864+0000","last_undegraded":"2023-08-22T00:24:06.868864+0000","last_fullsized":"2023-08-22T00:24:06.868864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.848978+0000","last_change":"2023-08-22T00:24:06.484764+0000","last_active":"2023-08-22T00:24:06.848978+0000","last_peered":"2023-08-22T00:24:06.848978+0000","last_clean":"2023-08-22T00:24:06.848978+0000","last_became_active":"2023-08-22T00:24:06.484310+0000","last_became_peered":"2023-08-22T00:24:06.484310+0000","last_unstale":"2023-08-22T00:24:06.848978+0000","last_undegraded":"2023-08-22T00:24:06.848978+0000","last_fullsized":"2023-08-22T00:24:06.848978+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864520+0000","last_change":"2023-08-22T00:24:06.859650+0000","last_active":"2023-08-22T00:24:06.864520+0000","last_peered":"2023-08-22T00:24:06.864520+0000","last_clean":"2023-08-22T00:24:06.864520+0000","last_became_active":"2023-08-22T00:24:06.859339+0000","last_became_peered":"2023-08-22T00:24:06.859339+0000","last_unstale":"2023-08-22T00:24:06.864520+0000","last_undegraded":"2023-08-22T00:24:06.864520+0000","last_fullsized":"2023-08-22T00:24:06.864520+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859163+0000","last_change":"2023-08-22T00:24:06.472733+0000","last_active":"2023-08-22T00:24:06.859163+0000","last_peered":"2023-08-22T00:24:06.859163+0000","last_clean":"2023-08-22T00:24:06.859163+0000","last_became_active":"2023-08-22T00:24:06.472458+0000","last_became_peered":"2023-08-22T00:24:06.472458+0000","last_unstale":"2023-08-22T00:24:06.859163+0000","last_undegraded":"2023-08-22T00:24:06.859163+0000","last_fullsized":"2023-08-22T00:24:06.859163+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869785+0000","last_change":"2023-08-22T00:24:06.860963+0000","last_active":"2023-08-22T00:24:06.869785+0000","last_peered":"2023-08-22T00:24:06.869785+0000","last_clean":"2023-08-22T00:24:06.869785+0000","last_became_active":"2023-08-22T00:24:06.860712+0000","last_became_peered":"2023-08-22T00:24:06.860712+0000","last_unstale":"2023-08-22T00:24:06.869785+0000","last_undegraded":"2023-08-22T00:24:06.869785+0000","last_fullsized":"2023-08-22T00:24:06.869785+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854074+0000","last_change":"2023-08-22T00:24:06.480715+0000","last_active":"2023-08-22T00:24:06.854074+0000","last_peered":"2023-08-22T00:24:06.854074+0000","last_clean":"2023-08-22T00:24:06.854074+0000","last_became_active":"2023-08-22T00:24:06.480141+0000","last_became_peered":"2023-08-22T00:24:06.480141+0000","last_unstale":"2023-08-22T00:24:06.854074+0000","last_undegraded":"2023-08-22T00:24:06.854074+0000","last_fullsized":"2023-08-22T00:24:06.854074+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865233+0000","last_change":"2023-08-22T00:24:06.863016+0000","last_active":"2023-08-22T00:24:06.865233+0000","last_peered":"2023-08-22T00:24:06.865233+0000","last_clean":"2023-08-22T00:24:06.865233+0000","last_became_active":"2023-08-22T00:24:06.862757+0000","last_became_peered":"2023-08-22T00:24:06.862757+0000","last_unstale":"2023-08-22T00:24:06.865233+0000","last_undegraded":"2023-08-22T00:24:06.865233+0000","last_fullsized":"2023-08-22T00:24:06.865233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850727+0000","last_change":"2023-08-22T00:24:06.489978+0000","last_active":"2023-08-22T00:24:06.850727+0000","last_peered":"2023-08-22T00:24:06.850727+0000","last_clean":"2023-08-22T00:24:06.850727+0000","last_became_active":"2023-08-22T00:24:06.489663+0000","last_became_peered":"2023-08-22T00:24:06.489663+0000","last_unstale":"2023-08-22T00:24:06.850727+0000","last_undegraded":"2023-08-22T00:24:06.850727+0000","last_fullsized":"2023-08-22T00:24:06.850727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870741+0000","last_change":"2023-08-22T00:24:06.870220+0000","last_active":"2023-08-22T00:24:06.870741+0000","last_peered":"2023-08-22T00:24:06.870741+0000","last_clean":"2023-08-22T00:24:06.870741+0000","last_became_active":"2023-08-22T00:24:06.869938+0000","last_became_peered":"2023-08-22T00:24:06.869938+0000","last_unstale":"2023-08-22T00:24:06.870741+0000","last_undegraded":"2023-08-22T00:24:06.870741+0000","last_fullsized":"2023-08-22T00:24:06.870741+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841469+0000","last_change":"2023-08-22T00:24:06.489981+0000","last_active":"2023-08-22T00:24:06.841469+0000","last_peered":"2023-08-22T00:24:06.841469+0000","last_clean":"2023-08-22T00:24:06.841469+0000","last_became_active":"2023-08-22T00:24:06.489678+0000","last_became_peered":"2023-08-22T00:24:06.489678+0000","last_unstale":"2023-08-22T00:24:06.841469+0000","last_undegraded":"2023-08-22T00:24:06.841469+0000","last_fullsized":"2023-08-22T00:24:06.841469+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854512+0000","last_change":"2023-08-22T00:24:06.851891+0000","last_active":"2023-08-22T00:24:06.854512+0000","last_peered":"2023-08-22T00:24:06.854512+0000","last_clean":"2023-08-22T00:24:06.854512+0000","last_became_active":"2023-08-22T00:24:06.851555+0000","last_became_peered":"2023-08-22T00:24:06.851555+0000","last_unstale":"2023-08-22T00:24:06.854512+0000","last_undegraded":"2023-08-22T00:24:06.854512+0000","last_fullsized":"2023-08-22T00:24:06.854512+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844045+0000","last_change":"2023-08-22T00:24:06.485667+0000","last_active":"2023-08-22T00:24:06.844045+0000","last_peered":"2023-08-22T00:24:06.844045+0000","last_clean":"2023-08-22T00:24:06.844045+0000","last_became_active":"2023-08-22T00:24:06.485371+0000","last_became_peered":"2023-08-22T00:24:06.485371+0000","last_unstale":"2023-08-22T00:24:06.844045+0000","last_undegraded":"2023-08-22T00:24:06.844045+0000","last_fullsized":"2023-08-22T00:24:06.844045+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870533+0000","last_change":"2023-08-22T00:24:06.866550+0000","last_active":"2023-08-22T00:24:06.870533+0000","last_peered":"2023-08-22T00:24:06.870533+0000","last_clean":"2023-08-22T00:24:06.870533+0000","last_became_active":"2023-08-22T00:24:06.866284+0000","last_became_peered":"2023-08-22T00:24:06.866284+0000","last_unstale":"2023-08-22T00:24:06.870533+0000","last_undegraded":"2023-08-22T00:24:06.870533+0000","last_fullsized":"2023-08-22T00:24:06.870533+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843814+0000","last_change":"2023-08-22T00:24:06.484546+0000","last_active":"2023-08-22T00:24:06.843814+0000","last_peered":"2023-08-22T00:24:06.843814+0000","last_clean":"2023-08-22T00:24:06.843814+0000","last_became_active":"2023-08-22T00:24:06.484325+0000","last_became_peered":"2023-08-22T00:24:06.484325+0000","last_unstale":"2023-08-22T00:24:06.843814+0000","last_undegraded":"2023-08-22T00:24:06.843814+0000","last_fullsized":"2023-08-22T00:24:06.843814+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870805+0000","last_change":"2023-08-22T00:24:06.868390+0000","last_active":"2023-08-22T00:24:06.870805+0000","last_peered":"2023-08-22T00:24:06.870805+0000","last_clean":"2023-08-22T00:24:06.870805+0000","last_became_active":"2023-08-22T00:24:06.866084+0000","last_became_peered":"2023-08-22T00:24:06.866084+0000","last_unstale":"2023-08-22T00:24:06.870805+0000","last_undegraded":"2023-08-22T00:24:06.870805+0000","last_fullsized":"2023-08-22T00:24:06.870805+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841418+0000","last_change":"2023-08-22T00:24:06.484107+0000","last_active":"2023-08-22T00:24:06.841418+0000","last_peered":"2023-08-22T00:24:06.841418+0000","last_clean":"2023-08-22T00:24:06.841418+0000","last_became_active":"2023-08-22T00:24:06.483839+0000","last_became_peered":"2023-08-22T00:24:06.483839+0000","last_unstale":"2023-08-22T00:24:06.841418+0000","last_undegraded":"2023-08-22T00:24:06.841418+0000","last_fullsized":"2023-08-22T00:24:06.841418+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870782+0000","last_change":"2023-08-22T00:24:06.867719+0000","last_active":"2023-08-22T00:24:06.870782+0000","last_peered":"2023-08-22T00:24:06.870782+0000","last_clean":"2023-08-22T00:24:06.870782+0000","last_became_active":"2023-08-22T00:24:06.865969+0000","last_became_peered":"2023-08-22T00:24:06.865969+0000","last_unstale":"2023-08-22T00:24:06.870782+0000","last_undegraded":"2023-08-22T00:24:06.870782+0000","last_fullsized":"2023-08-22T00:24:06.870782+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849105+0000","last_change":"2023-08-22T00:24:06.482445+0000","last_active":"2023-08-22T00:24:06.849105+0000","last_peered":"2023-08-22T00:24:06.849105+0000","last_clean":"2023-08-22T00:24:06.849105+0000","last_became_active":"2023-08-22T00:24:06.482164+0000","last_became_peered":"2023-08-22T00:24:06.482164+0000","last_unstale":"2023-08-22T00:24:06.849105+0000","last_undegraded":"2023-08-22T00:24:06.849105+0000","last_fullsized":"2023-08-22T00:24:06.849105+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.851539+0000","last_change":"2023-08-22T00:24:06.846874+0000","last_active":"2023-08-22T00:24:06.851539+0000","last_peered":"2023-08-22T00:24:06.851539+0000","last_clean":"2023-08-22T00:24:06.851539+0000","last_became_active":"2023-08-22T00:24:06.846590+0000","last_became_peered":"2023-08-22T00:24:06.846590+0000","last_unstale":"2023-08-22T00:24:06.851539+0000","last_undegraded":"2023-08-22T00:24:06.851539+0000","last_fullsized":"2023-08-22T00:24:06.851539+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869671+0000","last_change":"2023-08-22T00:24:06.477369+0000","last_active":"2023-08-22T00:24:06.869671+0000","last_peered":"2023-08-22T00:24:06.869671+0000","last_clean":"2023-08-22T00:24:06.869671+0000","last_became_active":"2023-08-22T00:24:06.476947+0000","last_became_peered":"2023-08-22T00:24:06.476947+0000","last_unstale":"2023-08-22T00:24:06.869671+0000","last_undegraded":"2023-08-22T00:24:06.869671+0000","last_fullsized":"2023-08-22T00:24:06.869671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864604+0000","last_change":"2023-08-22T00:24:06.862961+0000","last_active":"2023-08-22T00:24:06.864604+0000","last_peered":"2023-08-22T00:24:06.864604+0000","last_clean":"2023-08-22T00:24:06.864604+0000","last_became_active":"2023-08-22T00:24:06.862657+0000","last_became_peered":"2023-08-22T00:24:06.862657+0000","last_unstale":"2023-08-22T00:24:06.864604+0000","last_undegraded":"2023-08-22T00:24:06.864604+0000","last_fullsized":"2023-08-22T00:24:06.864604+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.33","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.853757+0000","last_change":"2023-08-22T00:24:06.473580+0000","last_active":"2023-08-22T00:24:06.853757+0000","last_peered":"2023-08-22T00:24:06.853757+0000","last_clean":"2023-08-22T00:24:06.853757+0000","last_became_active":"2023-08-22T00:24:06.473294+0000","last_became_peered":"2023-08-22T00:24:06.473294+0000","last_unstale":"2023-08-22T00:24:06.853757+0000","last_undegraded":"2023-08-22T00:24:06.853757+0000","last_fullsized":"2023-08-22T00:24:06.853757+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867432+0000","last_change":"2023-08-22T00:24:06.866869+0000","last_active":"2023-08-22T00:24:06.867432+0000","last_peered":"2023-08-22T00:24:06.867432+0000","last_clean":"2023-08-22T00:24:06.867432+0000","last_became_active":"2023-08-22T00:24:06.866536+0000","last_became_peered":"2023-08-22T00:24:06.866536+0000","last_unstale":"2023-08-22T00:24:06.867432+0000","last_undegraded":"2023-08-22T00:24:06.867432+0000","last_fullsized":"2023-08-22T00:24:06.867432+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.852117+0000","last_change":"2023-08-22T00:24:06.475151+0000","last_active":"2023-08-22T00:24:06.852117+0000","last_peered":"2023-08-22T00:24:06.852117+0000","last_clean":"2023-08-22T00:24:06.852117+0000","last_became_active":"2023-08-22T00:24:06.474870+0000","last_became_peered":"2023-08-22T00:24:06.474870+0000","last_unstale":"2023-08-22T00:24:06.852117+0000","last_undegraded":"2023-08-22T00:24:06.852117+0000","last_fullsized":"2023-08-22T00:24:06.852117+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868888+0000","last_change":"2023-08-22T00:24:06.860108+0000","last_active":"2023-08-22T00:24:06.868888+0000","last_peered":"2023-08-22T00:24:06.868888+0000","last_clean":"2023-08-22T00:24:06.868888+0000","last_became_active":"2023-08-22T00:24:06.859856+0000","last_became_peered":"2023-08-22T00:24:06.859856+0000","last_unstale":"2023-08-22T00:24:06.868888+0000","last_undegraded":"2023-08-22T00:24:06.868888+0000","last_fullsized":"2023-08-22T00:24:06.868888+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850240+0000","last_change":"2023-08-22T00:24:06.475109+0000","last_active":"2023-08-22T00:24:06.850240+0000","last_peered":"2023-08-22T00:24:06.850240+0000","last_clean":"2023-08-22T00:24:06.850240+0000","last_became_active":"2023-08-22T00:24:06.474823+0000","last_became_peered":"2023-08-22T00:24:06.474823+0000","last_unstale":"2023-08-22T00:24:06.850240+0000","last_undegraded":"2023-08-22T00:24:06.850240+0000","last_fullsized":"2023-08-22T00:24:06.850240+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.853934+0000","last_change":"2023-08-22T00:24:06.850093+0000","last_active":"2023-08-22T00:24:06.853934+0000","last_peered":"2023-08-22T00:24:06.853934+0000","last_clean":"2023-08-22T00:24:06.853934+0000","last_became_active":"2023-08-22T00:24:06.849833+0000","last_became_peered":"2023-08-22T00:24:06.849833+0000","last_unstale":"2023-08-22T00:24:06.853934+0000","last_undegraded":"2023-08-22T00:24:06.853934+0000","last_fullsized":"2023-08-22T00:24:06.853934+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.30","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.866522+0000","last_change":"2023-08-22T00:24:06.473575+0000","last_active":"2023-08-22T00:24:06.866522+0000","last_peered":"2023-08-22T00:24:06.866522+0000","last_clean":"2023-08-22T00:24:06.866522+0000","last_became_active":"2023-08-22T00:24:06.473283+0000","last_became_peered":"2023-08-22T00:24:06.473283+0000","last_unstale":"2023-08-22T00:24:06.866522+0000","last_undegraded":"2023-08-22T00:24:06.866522+0000","last_fullsized":"2023-08-22T00:24:06.866522+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849426+0000","last_change":"2023-08-22T00:24:06.847874+0000","last_active":"2023-08-22T00:24:06.849426+0000","last_peered":"2023-08-22T00:24:06.849426+0000","last_clean":"2023-08-22T00:24:06.849426+0000","last_became_active":"2023-08-22T00:24:06.847549+0000","last_became_peered":"2023-08-22T00:24:06.847549+0000","last_unstale":"2023-08-22T00:24:06.849426+0000","last_undegraded":"2023-08-22T00:24:06.849426+0000","last_fullsized":"2023-08-22T00:24:06.849426+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.856675+0000","last_change":"2023-08-22T00:24:06.485181+0000","last_active":"2023-08-22T00:24:06.856675+0000","last_peered":"2023-08-22T00:24:06.856675+0000","last_clean":"2023-08-22T00:24:06.856675+0000","last_became_active":"2023-08-22T00:24:06.484925+0000","last_became_peered":"2023-08-22T00:24:06.484925+0000","last_unstale":"2023-08-22T00:24:06.856675+0000","last_undegraded":"2023-08-22T00:24:06.856675+0000","last_fullsized":"2023-08-22T00:24:06.856675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854216+0000","last_change":"2023-08-22T00:24:06.850023+0000","last_active":"2023-08-22T00:24:06.854216+0000","last_peered":"2023-08-22T00:24:06.854216+0000","last_clean":"2023-08-22T00:24:06.854216+0000","last_became_active":"2023-08-22T00:24:06.849733+0000","last_became_peered":"2023-08-22T00:24:06.849733+0000","last_unstale":"2023-08-22T00:24:06.854216+0000","last_undegraded":"2023-08-22T00:24:06.854216+0000","last_fullsized":"2023-08-22T00:24:06.854216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842877+0000","last_change":"2023-08-22T00:24:06.484297+0000","last_active":"2023-08-22T00:24:06.842877+0000","last_peered":"2023-08-22T00:24:06.842877+0000","last_clean":"2023-08-22T00:24:06.842877+0000","last_became_active":"2023-08-22T00:24:06.484017+0000","last_became_peered":"2023-08-22T00:24:06.484017+0000","last_unstale":"2023-08-22T00:24:06.842877+0000","last_undegraded":"2023-08-22T00:24:06.842877+0000","last_fullsized":"2023-08-22T00:24:06.842877+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864033+0000","last_change":"2023-08-22T00:24:06.861206+0000","last_active":"2023-08-22T00:24:06.864033+0000","last_peered":"2023-08-22T00:24:06.864033+0000","last_clean":"2023-08-22T00:24:06.864033+0000","last_became_active":"2023-08-22T00:24:06.860952+0000","last_became_peered":"2023-08-22T00:24:06.860952+0000","last_unstale":"2023-08-22T00:24:06.864033+0000","last_undegraded":"2023-08-22T00:24:06.864033+0000","last_fullsized":"2023-08-22T00:24:06.864033+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2d","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870757+0000","last_change":"2023-08-22T00:24:06.482677+0000","last_active":"2023-08-22T00:24:06.870757+0000","last_peered":"2023-08-22T00:24:06.870757+0000","last_clean":"2023-08-22T00:24:06.870757+0000","last_became_active":"2023-08-22T00:24:06.482408+0000","last_became_peered":"2023-08-22T00:24:06.482408+0000","last_unstale":"2023-08-22T00:24:06.870757+0000","last_undegraded":"2023-08-22T00:24:06.870757+0000","last_fullsized":"2023-08-22T00:24:06.870757+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867217+0000","last_change":"2023-08-22T00:24:06.865902+0000","last_active":"2023-08-22T00:24:06.867217+0000","last_peered":"2023-08-22T00:24:06.867217+0000","last_clean":"2023-08-22T00:24:06.867217+0000","last_became_active":"2023-08-22T00:24:06.865618+0000","last_became_peered":"2023-08-22T00:24:06.865618+0000","last_unstale":"2023-08-22T00:24:06.867217+0000","last_undegraded":"2023-08-22T00:24:06.867217+0000","last_fullsized":"2023-08-22T00:24:06.867217+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843599+0000","last_change":"2023-08-22T00:24:06.470587+0000","last_active":"2023-08-22T00:24:06.843599+0000","last_peered":"2023-08-22T00:24:06.843599+0000","last_clean":"2023-08-22T00:24:06.843599+0000","last_became_active":"2023-08-22T00:24:06.470145+0000","last_became_peered":"2023-08-22T00:24:06.470145+0000","last_unstale":"2023-08-22T00:24:06.843599+0000","last_undegraded":"2023-08-22T00:24:06.843599+0000","last_fullsized":"2023-08-22T00:24:06.843599+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865546+0000","last_change":"2023-08-22T00:24:06.859745+0000","last_active":"2023-08-22T00:24:06.865546+0000","last_peered":"2023-08-22T00:24:06.865546+0000","last_clean":"2023-08-22T00:24:06.865546+0000","last_became_active":"2023-08-22T00:24:06.859245+0000","last_became_peered":"2023-08-22T00:24:06.859245+0000","last_unstale":"2023-08-22T00:24:06.865546+0000","last_undegraded":"2023-08-22T00:24:06.865546+0000","last_fullsized":"2023-08-22T00:24:06.865546+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864081+0000","last_change":"2023-08-22T00:24:06.473472+0000","last_active":"2023-08-22T00:24:06.864081+0000","last_peered":"2023-08-22T00:24:06.864081+0000","last_clean":"2023-08-22T00:24:06.864081+0000","last_became_active":"2023-08-22T00:24:06.473193+0000","last_became_peered":"2023-08-22T00:24:06.473193+0000","last_unstale":"2023-08-22T00:24:06.864081+0000","last_undegraded":"2023-08-22T00:24:06.864081+0000","last_fullsized":"2023-08-22T00:24:06.864081+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.855558+0000","last_change":"2023-08-22T00:24:06.853365+0000","last_active":"2023-08-22T00:24:06.855558+0000","last_peered":"2023-08-22T00:24:06.855558+0000","last_clean":"2023-08-22T00:24:06.855558+0000","last_became_active":"2023-08-22T00:24:06.853066+0000","last_became_peered":"2023-08-22T00:24:06.853066+0000","last_unstale":"2023-08-22T00:24:06.855558+0000","last_undegraded":"2023-08-22T00:24:06.855558+0000","last_fullsized":"2023-08-22T00:24:06.855558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841304+0000","last_change":"2023-08-22T00:24:06.482010+0000","last_active":"2023-08-22T00:24:06.841304+0000","last_peered":"2023-08-22T00:24:06.841304+0000","last_clean":"2023-08-22T00:24:06.841304+0000","last_became_active":"2023-08-22T00:24:06.481674+0000","last_became_peered":"2023-08-22T00:24:06.481674+0000","last_unstale":"2023-08-22T00:24:06.841304+0000","last_undegraded":"2023-08-22T00:24:06.841304+0000","last_fullsized":"2023-08-22T00:24:06.841304+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865106+0000","last_change":"2023-08-22T00:24:06.861266+0000","last_active":"2023-08-22T00:24:06.865106+0000","last_peered":"2023-08-22T00:24:06.865106+0000","last_clean":"2023-08-22T00:24:06.865106+0000","last_became_active":"2023-08-22T00:24:06.860832+0000","last_became_peered":"2023-08-22T00:24:06.860832+0000","last_unstale":"2023-08-22T00:24:06.865106+0000","last_undegraded":"2023-08-22T00:24:06.865106+0000","last_fullsized":"2023-08-22T00:24:06.865106+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.848350+0000","last_change":"2023-08-22T00:24:06.485268+0000","last_active":"2023-08-22T00:24:06.848350+0000","last_peered":"2023-08-22T00:24:06.848350+0000","last_clean":"2023-08-22T00:24:06.848350+0000","last_became_active":"2023-08-22T00:24:06.484428+0000","last_became_peered":"2023-08-22T00:24:06.484428+0000","last_unstale":"2023-08-22T00:24:06.848350+0000","last_undegraded":"2023-08-22T00:24:06.848350+0000","last_fullsized":"2023-08-22T00:24:06.848350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.862952+0000","last_change":"2023-08-22T00:24:06.860576+0000","last_active":"2023-08-22T00:24:06.862952+0000","last_peered":"2023-08-22T00:24:06.862952+0000","last_clean":"2023-08-22T00:24:06.862952+0000","last_became_active":"2023-08-22T00:24:06.860272+0000","last_became_peered":"2023-08-22T00:24:06.860272+0000","last_unstale":"2023-08-22T00:24:06.862952+0000","last_undegraded":"2023-08-22T00:24:06.862952+0000","last_fullsized":"2023-08-22T00:24:06.862952+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.840422+0000","last_change":"2023-08-22T00:24:06.493905+0000","last_active":"2023-08-22T00:24:06.840422+0000","last_peered":"2023-08-22T00:24:06.840422+0000","last_clean":"2023-08-22T00:24:06.840422+0000","last_became_active":"2023-08-22T00:24:06.493604+0000","last_became_peered":"2023-08-22T00:24:06.493604+0000","last_unstale":"2023-08-22T00:24:06.840422+0000","last_undegraded":"2023-08-22T00:24:06.840422+0000","last_fullsized":"2023-08-22T00:24:06.840422+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868685+0000","last_change":"2023-08-22T00:24:06.856154+0000","last_active":"2023-08-22T00:24:06.868685+0000","last_peered":"2023-08-22T00:24:06.868685+0000","last_clean":"2023-08-22T00:24:06.868685+0000","last_became_active":"2023-08-22T00:24:06.855889+0000","last_became_peered":"2023-08-22T00:24:06.855889+0000","last_unstale":"2023-08-22T00:24:06.868685+0000","last_undegraded":"2023-08-22T00:24:06.868685+0000","last_fullsized":"2023-08-22T00:24:06.868685+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845350+0000","last_change":"2023-08-22T00:24:06.471390+0000","last_active":"2023-08-22T00:24:06.845350+0000","last_peered":"2023-08-22T00:24:06.845350+0000","last_clean":"2023-08-22T00:24:06.845350+0000","last_became_active":"2023-08-22T00:24:06.471117+0000","last_became_peered":"2023-08-22T00:24:06.471117+0000","last_unstale":"2023-08-22T00:24:06.845350+0000","last_undegraded":"2023-08-22T00:24:06.845350+0000","last_fullsized":"2023-08-22T00:24:06.845350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854241+0000","last_change":"2023-08-22T00:24:06.850674+0000","last_active":"2023-08-22T00:24:06.854241+0000","last_peered":"2023-08-22T00:24:06.854241+0000","last_clean":"2023-08-22T00:24:06.854241+0000","last_became_active":"2023-08-22T00:24:06.849978+0000","last_became_peered":"2023-08-22T00:24:06.849978+0000","last_unstale":"2023-08-22T00:24:06.854241+0000","last_undegraded":"2023-08-22T00:24:06.854241+0000","last_fullsized":"2023-08-22T00:24:06.854241+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843949+0000","last_change":"2023-08-22T00:24:06.482225+0000","last_active":"2023-08-22T00:24:06.843949+0000","last_peered":"2023-08-22T00:24:06.843949+0000","last_clean":"2023-08-22T00:24:06.843949+0000","last_became_active":"2023-08-22T00:24:06.481897+0000","last_became_peered":"2023-08-22T00:24:06.481897+0000","last_unstale":"2023-08-22T00:24:06.843949+0000","last_undegraded":"2023-08-22T00:24:06.843949+0000","last_fullsized":"2023-08-22T00:24:06.843949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869278+0000","last_change":"2023-08-22T00:24:06.866432+0000","last_active":"2023-08-22T00:24:06.869278+0000","last_peered":"2023-08-22T00:24:06.869278+0000","last_clean":"2023-08-22T00:24:06.869278+0000","last_became_active":"2023-08-22T00:24:06.866170+0000","last_became_peered":"2023-08-22T00:24:06.866170+0000","last_unstale":"2023-08-22T00:24:06.869278+0000","last_undegraded":"2023-08-22T00:24:06.869278+0000","last_fullsized":"2023-08-22T00:24:06.869278+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849247+0000","last_change":"2023-08-22T00:24:06.479663+0000","last_active":"2023-08-22T00:24:06.849247+0000","last_peered":"2023-08-22T00:24:06.849247+0000","last_clean":"2023-08-22T00:24:06.849247+0000","last_became_active":"2023-08-22T00:24:06.479374+0000","last_became_peered":"2023-08-22T00:24:06.479374+0000","last_unstale":"2023-08-22T00:24:06.849247+0000","last_undegraded":"2023-08-22T00:24:06.849247+0000","last_fullsized":"2023-08-22T00:24:06.849247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869615+0000","last_change":"2023-08-22T00:24:06.858021+0000","last_active":"2023-08-22T00:24:06.869615+0000","last_peered":"2023-08-22T00:24:06.869615+0000","last_clean":"2023-08-22T00:24:06.869615+0000","last_became_active":"2023-08-22T00:24:06.857750+0000","last_became_peered":"2023-08-22T00:24:06.857750+0000","last_unstale":"2023-08-22T00:24:06.869615+0000","last_undegraded":"2023-08-22T00:24:06.869615+0000","last_fullsized":"2023-08-22T00:24:06.869615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841592+0000","last_change":"2023-08-22T00:24:06.480391+0000","last_active":"2023-08-22T00:24:06.841592+0000","last_peered":"2023-08-22T00:24:06.841592+0000","last_clean":"2023-08-22T00:24:06.841592+0000","last_became_active":"2023-08-22T00:24:06.480121+0000","last_became_peered":"2023-08-22T00:24:06.480121+0000","last_unstale":"2023-08-22T00:24:06.841592+0000","last_undegraded":"2023-08-22T00:24:06.841592+0000","last_fullsized":"2023-08-22T00:24:06.841592+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864411+0000","last_change":"2023-08-22T00:24:06.861148+0000","last_active":"2023-08-22T00:24:06.864411+0000","last_peered":"2023-08-22T00:24:06.864411+0000","last_clean":"2023-08-22T00:24:06.864411+0000","last_became_active":"2023-08-22T00:24:06.860796+0000","last_became_peered":"2023-08-22T00:24:06.860796+0000","last_unstale":"2023-08-22T00:24:06.864411+0000","last_undegraded":"2023-08-22T00:24:06.864411+0000","last_fullsized":"2023-08-22T00:24:06.864411+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844514+0000","last_change":"2023-08-22T00:24:06.472957+0000","last_active":"2023-08-22T00:24:06.844514+0000","last_peered":"2023-08-22T00:24:06.844514+0000","last_clean":"2023-08-22T00:24:06.844514+0000","last_became_active":"2023-08-22T00:24:06.472684+0000","last_became_peered":"2023-08-22T00:24:06.472684+0000","last_unstale":"2023-08-22T00:24:06.844514+0000","last_undegraded":"2023-08-22T00:24:06.844514+0000","last_fullsized":"2023-08-22T00:24:06.844514+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864649+0000","last_change":"2023-08-22T00:24:06.863023+0000","last_active":"2023-08-22T00:24:06.864649+0000","last_peered":"2023-08-22T00:24:06.864649+0000","last_clean":"2023-08-22T00:24:06.864649+0000","last_became_active":"2023-08-22T00:24:06.862540+0000","last_became_peered":"2023-08-22T00:24:06.862540+0000","last_unstale":"2023-08-22T00:24:06.864649+0000","last_undegraded":"2023-08-22T00:24:06.864649+0000","last_fullsized":"2023-08-22T00:24:06.864649+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845293+0000","last_change":"2023-08-22T00:24:06.472286+0000","last_active":"2023-08-22T00:24:06.845293+0000","last_peered":"2023-08-22T00:24:06.845293+0000","last_clean":"2023-08-22T00:24:06.845293+0000","last_became_active":"2023-08-22T00:24:06.472021+0000","last_became_peered":"2023-08-22T00:24:06.472021+0000","last_unstale":"2023-08-22T00:24:06.845293+0000","last_undegraded":"2023-08-22T00:24:06.845293+0000","last_fullsized":"2023-08-22T00:24:06.845293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.866711+0000","last_change":"2023-08-22T00:24:06.851116+0000","last_active":"2023-08-22T00:24:06.866711+0000","last_peered":"2023-08-22T00:24:06.866711+0000","last_clean":"2023-08-22T00:24:06.866711+0000","last_became_active":"2023-08-22T00:24:06.850865+0000","last_became_peered":"2023-08-22T00:24:06.850865+0000","last_unstale":"2023-08-22T00:24:06.866711+0000","last_undegraded":"2023-08-22T00:24:06.866711+0000","last_fullsized":"2023-08-22T00:24:06.866711+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841730+0000","last_change":"2023-08-22T00:24:06.486949+0000","last_active":"2023-08-22T00:24:06.841730+0000","last_peered":"2023-08-22T00:24:06.841730+0000","last_clean":"2023-08-22T00:24:06.841730+0000","last_became_active":"2023-08-22T00:24:06.486733+0000","last_became_peered":"2023-08-22T00:24:06.486733+0000","last_unstale":"2023-08-22T00:24:06.841730+0000","last_undegraded":"2023-08-22T00:24:06.841730+0000","last_fullsized":"2023-08-22T00:24:06.841730+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868806+0000","last_change":"2023-08-22T00:24:06.856392+0000","last_active":"2023-08-22T00:24:06.868806+0000","last_peered":"2023-08-22T00:24:06.868806+0000","last_clean":"2023-08-22T00:24:06.868806+0000","last_became_active":"2023-08-22T00:24:06.856201+0000","last_became_peered":"2023-08-22T00:24:06.856201+0000","last_unstale":"2023-08-22T00:24:06.868806+0000","last_undegraded":"2023-08-22T00:24:06.868806+0000","last_fullsized":"2023-08-22T00:24:06.868806+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843857+0000","last_change":"2023-08-22T00:24:06.474553+0000","last_active":"2023-08-22T00:24:06.843857+0000","last_peered":"2023-08-22T00:24:06.843857+0000","last_clean":"2023-08-22T00:24:06.843857+0000","last_became_active":"2023-08-22T00:24:06.471954+0000","last_became_peered":"2023-08-22T00:24:06.471954+0000","last_unstale":"2023-08-22T00:24:06.843857+0000","last_undegraded":"2023-08-22T00:24:06.843857+0000","last_fullsized":"2023-08-22T00:24:06.843857+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869636+0000","last_change":"2023-08-22T00:24:06.859380+0000","last_active":"2023-08-22T00:24:06.869636+0000","last_peered":"2023-08-22T00:24:06.869636+0000","last_clean":"2023-08-22T00:24:06.869636+0000","last_became_active":"2023-08-22T00:24:06.859126+0000","last_became_peered":"2023-08-22T00:24:06.859126+0000","last_unstale":"2023-08-22T00:24:06.869636+0000","last_undegraded":"2023-08-22T00:24:06.869636+0000","last_fullsized":"2023-08-22T00:24:06.869636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859615+0000","last_change":"2023-08-22T00:24:06.479741+0000","last_active":"2023-08-22T00:24:06.859615+0000","last_peered":"2023-08-22T00:24:06.859615+0000","last_clean":"2023-08-22T00:24:06.859615+0000","last_became_active":"2023-08-22T00:24:06.479340+0000","last_became_peered":"2023-08-22T00:24:06.479340+0000","last_unstale":"2023-08-22T00:24:06.859615+0000","last_undegraded":"2023-08-22T00:24:06.859615+0000","last_fullsized":"2023-08-22T00:24:06.859615+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.861715+0000","last_change":"2023-08-22T00:24:06.860430+0000","last_active":"2023-08-22T00:24:06.861715+0000","last_peered":"2023-08-22T00:24:06.861715+0000","last_clean":"2023-08-22T00:24:06.861715+0000","last_became_active":"2023-08-22T00:24:06.860168+0000","last_became_peered":"2023-08-22T00:24:06.860168+0000","last_unstale":"2023-08-22T00:24:06.861715+0000","last_undegraded":"2023-08-22T00:24:06.861715+0000","last_fullsized":"2023-08-22T00:24:06.861715+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.858823+0000","last_change":"2023-08-22T00:24:06.475014+0000","last_active":"2023-08-22T00:24:06.858823+0000","last_peered":"2023-08-22T00:24:06.858823+0000","last_clean":"2023-08-22T00:24:06.858823+0000","last_became_active":"2023-08-22T00:24:06.474710+0000","last_became_peered":"2023-08-22T00:24:06.474710+0000","last_unstale":"2023-08-22T00:24:06.858823+0000","last_undegraded":"2023-08-22T00:24:06.858823+0000","last_fullsized":"2023-08-22T00:24:06.858823+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869756+0000","last_change":"2023-08-22T00:24:06.860134+0000","last_active":"2023-08-22T00:24:06.869756+0000","last_peered":"2023-08-22T00:24:06.869756+0000","last_clean":"2023-08-22T00:24:06.869756+0000","last_became_active":"2023-08-22T00:24:06.859878+0000","last_became_peered":"2023-08-22T00:24:06.859878+0000","last_unstale":"2023-08-22T00:24:06.869756+0000","last_undegraded":"2023-08-22T00:24:06.869756+0000","last_fullsized":"2023-08-22T00:24:06.869756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863643+0000","last_change":"2023-08-22T00:24:06.480712+0000","last_active":"2023-08-22T00:24:06.863643+0000","last_peered":"2023-08-22T00:24:06.863643+0000","last_clean":"2023-08-22T00:24:06.863643+0000","last_became_active":"2023-08-22T00:24:06.480415+0000","last_became_peered":"2023-08-22T00:24:06.480415+0000","last_unstale":"2023-08-22T00:24:06.863643+0000","last_undegraded":"2023-08-22T00:24:06.863643+0000","last_fullsized":"2023-08-22T00:24:06.863643+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867238+0000","last_change":"2023-08-22T00:24:06.865978+0000","last_active":"2023-08-22T00:24:06.867238+0000","last_peered":"2023-08-22T00:24:06.867238+0000","last_clean":"2023-08-22T00:24:06.867238+0000","last_became_active":"2023-08-22T00:24:06.865696+0000","last_became_peered":"2023-08-22T00:24:06.865696+0000","last_unstale":"2023-08-22T00:24:06.867238+0000","last_undegraded":"2023-08-22T00:24:06.867238+0000","last_fullsized":"2023-08-22T00:24:06.867238+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843520+0000","last_change":"2023-08-22T00:24:06.486332+0000","last_active":"2023-08-22T00:24:06.843520+0000","last_peered":"2023-08-22T00:24:06.843520+0000","last_clean":"2023-08-22T00:24:06.843520+0000","last_became_active":"2023-08-22T00:24:06.486078+0000","last_became_peered":"2023-08-22T00:24:06.486078+0000","last_unstale":"2023-08-22T00:24:06.843520+0000","last_undegraded":"2023-08-22T00:24:06.843520+0000","last_fullsized":"2023-08-22T00:24:06.843520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869412+0000","last_change":"2023-08-22T00:24:06.862044+0000","last_active":"2023-08-22T00:24:06.869412+0000","last_peered":"2023-08-22T00:24:06.869412+0000","last_clean":"2023-08-22T00:24:06.869412+0000","last_became_active":"2023-08-22T00:24:06.861771+0000","last_became_peered":"2023-08-22T00:24:06.861771+0000","last_unstale":"2023-08-22T00:24:06.869412+0000","last_undegraded":"2023-08-22T00:24:06.869412+0000","last_fullsized":"2023-08-22T00:24:06.869412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849354+0000","last_change":"2023-08-22T00:24:06.482927+0000","last_active":"2023-08-22T00:24:06.849354+0000","last_peered":"2023-08-22T00:24:06.849354+0000","last_clean":"2023-08-22T00:24:06.849354+0000","last_became_active":"2023-08-22T00:24:06.482675+0000","last_became_peered":"2023-08-22T00:24:06.482675+0000","last_unstale":"2023-08-22T00:24:06.849354+0000","last_undegraded":"2023-08-22T00:24:06.849354+0000","last_fullsized":"2023-08-22T00:24:06.849354+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854246+0000","last_change":"2023-08-22T00:24:06.850715+0000","last_active":"2023-08-22T00:24:06.854246+0000","last_peered":"2023-08-22T00:24:06.854246+0000","last_clean":"2023-08-22T00:24:06.854246+0000","last_became_active":"2023-08-22T00:24:06.850448+0000","last_became_peered":"2023-08-22T00:24:06.850448+0000","last_unstale":"2023-08-22T00:24:06.854246+0000","last_undegraded":"2023-08-22T00:24:06.854246+0000","last_fullsized":"2023-08-22T00:24:06.854246+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.852109+0000","last_change":"2023-08-22T00:24:06.481833+0000","last_active":"2023-08-22T00:24:06.852109+0000","last_peered":"2023-08-22T00:24:06.852109+0000","last_clean":"2023-08-22T00:24:06.852109+0000","last_became_active":"2023-08-22T00:24:06.481558+0000","last_became_peered":"2023-08-22T00:24:06.481558+0000","last_unstale":"2023-08-22T00:24:06.852109+0000","last_undegraded":"2023-08-22T00:24:06.852109+0000","last_fullsized":"2023-08-22T00:24:06.852109+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868650+0000","last_change":"2023-08-22T00:24:06.855616+0000","last_active":"2023-08-22T00:24:06.868650+0000","last_peered":"2023-08-22T00:24:06.868650+0000","last_clean":"2023-08-22T00:24:06.868650+0000","last_became_active":"2023-08-22T00:24:06.853721+0000","last_became_peered":"2023-08-22T00:24:06.853721+0000","last_unstale":"2023-08-22T00:24:06.868650+0000","last_undegraded":"2023-08-22T00:24:06.868650+0000","last_fullsized":"2023-08-22T00:24:06.868650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841564+0000","last_change":"2023-08-22T00:24:06.468064+0000","last_active":"2023-08-22T00:24:06.841564+0000","last_peered":"2023-08-22T00:24:06.841564+0000","last_clean":"2023-08-22T00:24:06.841564+0000","last_became_active":"2023-08-22T00:24:06.467779+0000","last_became_peered":"2023-08-22T00:24:06.467779+0000","last_unstale":"2023-08-22T00:24:06.841564+0000","last_undegraded":"2023-08-22T00:24:06.841564+0000","last_fullsized":"2023-08-22T00:24:06.841564+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854491+0000","last_change":"2023-08-22T00:24:06.851810+0000","last_active":"2023-08-22T00:24:06.854491+0000","last_peered":"2023-08-22T00:24:06.854491+0000","last_clean":"2023-08-22T00:24:06.854491+0000","last_became_active":"2023-08-22T00:24:06.851472+0000","last_became_peered":"2023-08-22T00:24:06.851472+0000","last_unstale":"2023-08-22T00:24:06.854491+0000","last_undegraded":"2023-08-22T00:24:06.854491+0000","last_fullsized":"2023-08-22T00:24:06.854491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843833+0000","last_change":"2023-08-22T00:24:06.486439+0000","last_active":"2023-08-22T00:24:06.843833+0000","last_peered":"2023-08-22T00:24:06.843833+0000","last_clean":"2023-08-22T00:24:06.843833+0000","last_became_active":"2023-08-22T00:24:06.485786+0000","last_became_peered":"2023-08-22T00:24:06.485786+0000","last_unstale":"2023-08-22T00:24:06.843833+0000","last_undegraded":"2023-08-22T00:24:06.843833+0000","last_fullsized":"2023-08-22T00:24:06.843833+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865390+0000","last_change":"2023-08-22T00:24:06.862917+0000","last_active":"2023-08-22T00:24:06.865390+0000","last_peered":"2023-08-22T00:24:06.865390+0000","last_clean":"2023-08-22T00:24:06.865390+0000","last_became_active":"2023-08-22T00:24:06.862648+0000","last_became_peered":"2023-08-22T00:24:06.862648+0000","last_unstale":"2023-08-22T00:24:06.865390+0000","last_undegraded":"2023-08-22T00:24:06.865390+0000","last_fullsized":"2023-08-22T00:24:06.865390+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870504+0000","last_change":"2023-08-22T00:24:06.493815+0000","last_active":"2023-08-22T00:24:06.870504+0000","last_peered":"2023-08-22T00:24:06.870504+0000","last_clean":"2023-08-22T00:24:06.870504+0000","last_became_active":"2023-08-22T00:24:06.493554+0000","last_became_peered":"2023-08-22T00:24:06.493554+0000","last_unstale":"2023-08-22T00:24:06.870504+0000","last_undegraded":"2023-08-22T00:24:06.870504+0000","last_fullsized":"2023-08-22T00:24:06.870504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869627+0000","last_change":"2023-08-22T00:24:06.857988+0000","last_active":"2023-08-22T00:24:06.869627+0000","last_peered":"2023-08-22T00:24:06.869627+0000","last_clean":"2023-08-22T00:24:06.869627+0000","last_became_active":"2023-08-22T00:24:06.857702+0000","last_became_peered":"2023-08-22T00:24:06.857702+0000","last_unstale":"2023-08-22T00:24:06.869627+0000","last_undegraded":"2023-08-22T00:24:06.869627+0000","last_fullsized":"2023-08-22T00:24:06.869627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865339+0000","last_change":"2023-08-22T00:24:06.472158+0000","last_active":"2023-08-22T00:24:06.865339+0000","last_peered":"2023-08-22T00:24:06.865339+0000","last_clean":"2023-08-22T00:24:06.865339+0000","last_became_active":"2023-08-22T00:24:06.471841+0000","last_became_peered":"2023-08-22T00:24:06.471841+0000","last_unstale":"2023-08-22T00:24:06.865339+0000","last_undegraded":"2023-08-22T00:24:06.865339+0000","last_fullsized":"2023-08-22T00:24:06.865339+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864432+0000","last_change":"2023-08-22T00:24:06.859315+0000","last_active":"2023-08-22T00:24:06.864432+0000","last_peered":"2023-08-22T00:24:06.864432+0000","last_clean":"2023-08-22T00:24:06.864432+0000","last_became_active":"2023-08-22T00:24:06.859031+0000","last_became_peered":"2023-08-22T00:24:06.859031+0000","last_unstale":"2023-08-22T00:24:06.864432+0000","last_undegraded":"2023-08-22T00:24:06.864432+0000","last_fullsized":"2023-08-22T00:24:06.864432+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842429+0000","last_change":"2023-08-22T00:24:06.484141+0000","last_active":"2023-08-22T00:24:06.842429+0000","last_peered":"2023-08-22T00:24:06.842429+0000","last_clean":"2023-08-22T00:24:06.842429+0000","last_became_active":"2023-08-22T00:24:06.483882+0000","last_became_peered":"2023-08-22T00:24:06.483882+0000","last_unstale":"2023-08-22T00:24:06.842429+0000","last_undegraded":"2023-08-22T00:24:06.842429+0000","last_fullsized":"2023-08-22T00:24:06.842429+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864548+0000","last_change":"2023-08-22T00:24:06.862325+0000","last_active":"2023-08-22T00:24:06.864548+0000","last_peered":"2023-08-22T00:24:06.864548+0000","last_clean":"2023-08-22T00:24:06.864548+0000","last_became_active":"2023-08-22T00:24:06.861996+0000","last_became_peered":"2023-08-22T00:24:06.861996+0000","last_unstale":"2023-08-22T00:24:06.864548+0000","last_undegraded":"2023-08-22T00:24:06.864548+0000","last_fullsized":"2023-08-22T00:24:06.864548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849248+0000","last_change":"2023-08-22T00:24:06.485152+0000","last_active":"2023-08-22T00:24:06.849248+0000","last_peered":"2023-08-22T00:24:06.849248+0000","last_clean":"2023-08-22T00:24:06.849248+0000","last_became_active":"2023-08-22T00:24:06.484759+0000","last_became_peered":"2023-08-22T00:24:06.484759+0000","last_unstale":"2023-08-22T00:24:06.849248+0000","last_undegraded":"2023-08-22T00:24:06.849248+0000","last_fullsized":"2023-08-22T00:24:06.849248+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864403+0000","last_change":"2023-08-22T00:24:06.859284+0000","last_active":"2023-08-22T00:24:06.864403+0000","last_peered":"2023-08-22T00:24:06.864403+0000","last_clean":"2023-08-22T00:24:06.864403+0000","last_became_active":"2023-08-22T00:24:06.858975+0000","last_became_peered":"2023-08-22T00:24:06.858975+0000","last_unstale":"2023-08-22T00:24:06.864403+0000","last_undegraded":"2023-08-22T00:24:06.864403+0000","last_fullsized":"2023-08-22T00:24:06.864403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864560+0000","last_change":"2023-08-22T00:24:06.480100+0000","last_active":"2023-08-22T00:24:06.864560+0000","last_peered":"2023-08-22T00:24:06.864560+0000","last_clean":"2023-08-22T00:24:06.864560+0000","last_became_active":"2023-08-22T00:24:06.479781+0000","last_became_peered":"2023-08-22T00:24:06.479781+0000","last_unstale":"2023-08-22T00:24:06.864560+0000","last_undegraded":"2023-08-22T00:24:06.864560+0000","last_fullsized":"2023-08-22T00:24:06.864560+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869509+0000","last_change":"2023-08-22T00:24:06.862669+0000","last_active":"2023-08-22T00:24:06.869509+0000","last_peered":"2023-08-22T00:24:06.869509+0000","last_clean":"2023-08-22T00:24:06.869509+0000","last_became_active":"2023-08-22T00:24:06.862424+0000","last_became_peered":"2023-08-22T00:24:06.862424+0000","last_unstale":"2023-08-22T00:24:06.869509+0000","last_undegraded":"2023-08-22T00:24:06.869509+0000","last_fullsized":"2023-08-22T00:24:06.869509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843189+0000","last_change":"2023-08-22T00:24:06.485497+0000","last_active":"2023-08-22T00:24:06.843189+0000","last_peered":"2023-08-22T00:24:06.843189+0000","last_clean":"2023-08-22T00:24:06.843189+0000","last_became_active":"2023-08-22T00:24:06.485017+0000","last_became_peered":"2023-08-22T00:24:06.485017+0000","last_unstale":"2023-08-22T00:24:06.843189+0000","last_undegraded":"2023-08-22T00:24:06.843189+0000","last_fullsized":"2023-08-22T00:24:06.843189+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867289+0000","last_change":"2023-08-22T00:24:06.866097+0000","last_active":"2023-08-22T00:24:06.867289+0000","last_peered":"2023-08-22T00:24:06.867289+0000","last_clean":"2023-08-22T00:24:06.867289+0000","last_became_active":"2023-08-22T00:24:06.865820+0000","last_became_peered":"2023-08-22T00:24:06.865820+0000","last_unstale":"2023-08-22T00:24:06.867289+0000","last_undegraded":"2023-08-22T00:24:06.867289+0000","last_fullsized":"2023-08-22T00:24:06.867289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.840527+0000","last_change":"2023-08-22T00:24:06.484393+0000","last_active":"2023-08-22T00:24:06.840527+0000","last_peered":"2023-08-22T00:24:06.840527+0000","last_clean":"2023-08-22T00:24:06.840527+0000","last_became_active":"2023-08-22T00:24:06.482446+0000","last_became_peered":"2023-08-22T00:24:06.482446+0000","last_unstale":"2023-08-22T00:24:06.840527+0000","last_undegraded":"2023-08-22T00:24:06.840527+0000","last_fullsized":"2023-08-22T00:24:06.840527+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.860143+0000","last_change":"2023-08-22T00:24:06.857850+0000","last_active":"2023-08-22T00:24:06.860143+0000","last_peered":"2023-08-22T00:24:06.860143+0000","last_clean":"2023-08-22T00:24:06.860143+0000","last_became_active":"2023-08-22T00:24:06.857117+0000","last_became_peered":"2023-08-22T00:24:06.857117+0000","last_unstale":"2023-08-22T00:24:06.860143+0000","last_undegraded":"2023-08-22T00:24:06.860143+0000","last_fullsized":"2023-08-22T00:24:06.860143+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843727+0000","last_change":"2023-08-22T00:24:06.486566+0000","last_active":"2023-08-22T00:24:06.843727+0000","last_peered":"2023-08-22T00:24:06.843727+0000","last_clean":"2023-08-22T00:24:06.843727+0000","last_became_active":"2023-08-22T00:24:06.486164+0000","last_became_peered":"2023-08-22T00:24:06.486164+0000","last_unstale":"2023-08-22T00:24:06.843727+0000","last_undegraded":"2023-08-22T00:24:06.843727+0000","last_fullsized":"2023-08-22T00:24:06.843727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867135+0000","last_change":"2023-08-22T00:24:06.866006+0000","last_active":"2023-08-22T00:24:06.867135+0000","last_peered":"2023-08-22T00:24:06.867135+0000","last_clean":"2023-08-22T00:24:06.867135+0000","last_became_active":"2023-08-22T00:24:06.865713+0000","last_became_peered":"2023-08-22T00:24:06.865713+0000","last_unstale":"2023-08-22T00:24:06.867135+0000","last_undegraded":"2023-08-22T00:24:06.867135+0000","last_fullsized":"2023-08-22T00:24:06.867135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.858278+0000","last_change":"2023-08-22T00:24:06.483958+0000","last_active":"2023-08-22T00:24:06.858278+0000","last_peered":"2023-08-22T00:24:06.858278+0000","last_clean":"2023-08-22T00:24:06.858278+0000","last_became_active":"2023-08-22T00:24:06.483697+0000","last_became_peered":"2023-08-22T00:24:06.483697+0000","last_unstale":"2023-08-22T00:24:06.858278+0000","last_undegraded":"2023-08-22T00:24:06.858278+0000","last_fullsized":"2023-08-22T00:24:06.858278+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869094+0000","last_change":"2023-08-22T00:24:06.857243+0000","last_active":"2023-08-22T00:24:06.869094+0000","last_peered":"2023-08-22T00:24:06.869094+0000","last_clean":"2023-08-22T00:24:06.869094+0000","last_became_active":"2023-08-22T00:24:06.856998+0000","last_became_peered":"2023-08-22T00:24:06.856998+0000","last_unstale":"2023-08-22T00:24:06.869094+0000","last_undegraded":"2023-08-22T00:24:06.869094+0000","last_fullsized":"2023-08-22T00:24:06.869094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842995+0000","last_change":"2023-08-22T00:24:06.481426+0000","last_active":"2023-08-22T00:24:06.842995+0000","last_peered":"2023-08-22T00:24:06.842995+0000","last_clean":"2023-08-22T00:24:06.842995+0000","last_became_active":"2023-08-22T00:24:06.481111+0000","last_became_peered":"2023-08-22T00:24:06.481111+0000","last_unstale":"2023-08-22T00:24:06.842995+0000","last_undegraded":"2023-08-22T00:24:06.842995+0000","last_fullsized":"2023-08-22T00:24:06.842995+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865131+0000","last_change":"2023-08-22T00:24:06.854326+0000","last_active":"2023-08-22T00:24:06.865131+0000","last_peered":"2023-08-22T00:24:06.865131+0000","last_clean":"2023-08-22T00:24:06.865131+0000","last_became_active":"2023-08-22T00:24:06.854086+0000","last_became_peered":"2023-08-22T00:24:06.854086+0000","last_unstale":"2023-08-22T00:24:06.865131+0000","last_undegraded":"2023-08-22T00:24:06.865131+0000","last_fullsized":"2023-08-22T00:24:06.865131+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849231+0000","last_change":"2023-08-22T00:24:06.482596+0000","last_active":"2023-08-22T00:24:06.849231+0000","last_peered":"2023-08-22T00:24:06.849231+0000","last_clean":"2023-08-22T00:24:06.849231+0000","last_became_active":"2023-08-22T00:24:06.482033+0000","last_became_peered":"2023-08-22T00:24:06.482033+0000","last_unstale":"2023-08-22T00:24:06.849231+0000","last_undegraded":"2023-08-22T00:24:06.849231+0000","last_fullsized":"2023-08-22T00:24:06.849231+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868727+0000","last_change":"2023-08-22T00:24:06.868327+0000","last_active":"2023-08-22T00:24:06.868727+0000","last_peered":"2023-08-22T00:24:06.868727+0000","last_clean":"2023-08-22T00:24:06.868727+0000","last_became_active":"2023-08-22T00:24:06.868079+0000","last_became_peered":"2023-08-22T00:24:06.868079+0000","last_unstale":"2023-08-22T00:24:06.868727+0000","last_undegraded":"2023-08-22T00:24:06.868727+0000","last_fullsized":"2023-08-22T00:24:06.868727+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850792+0000","last_change":"2023-08-22T00:24:06.486568+0000","last_active":"2023-08-22T00:24:06.850792+0000","last_peered":"2023-08-22T00:24:06.850792+0000","last_clean":"2023-08-22T00:24:06.850792+0000","last_became_active":"2023-08-22T00:24:06.486279+0000","last_became_peered":"2023-08-22T00:24:06.486279+0000","last_unstale":"2023-08-22T00:24:06.850792+0000","last_undegraded":"2023-08-22T00:24:06.850792+0000","last_fullsized":"2023-08-22T00:24:06.850792+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.855721+0000","last_change":"2023-08-22T00:24:06.853381+0000","last_active":"2023-08-22T00:24:06.855721+0000","last_peered":"2023-08-22T00:24:06.855721+0000","last_clean":"2023-08-22T00:24:06.855721+0000","last_became_active":"2023-08-22T00:24:06.853097+0000","last_became_peered":"2023-08-22T00:24:06.853097+0000","last_unstale":"2023-08-22T00:24:06.855721+0000","last_undegraded":"2023-08-22T00:24:06.855721+0000","last_fullsized":"2023-08-22T00:24:06.855721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849441+0000","last_change":"2023-08-22T00:24:06.477629+0000","last_active":"2023-08-22T00:24:06.849441+0000","last_peered":"2023-08-22T00:24:06.849441+0000","last_clean":"2023-08-22T00:24:06.849441+0000","last_became_active":"2023-08-22T00:24:06.476807+0000","last_became_peered":"2023-08-22T00:24:06.476807+0000","last_unstale":"2023-08-22T00:24:06.849441+0000","last_undegraded":"2023-08-22T00:24:06.849441+0000","last_fullsized":"2023-08-22T00:24:06.849441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864688+0000","last_change":"2023-08-22T00:24:06.863661+0000","last_active":"2023-08-22T00:24:06.864688+0000","last_peered":"2023-08-22T00:24:06.864688+0000","last_clean":"2023-08-22T00:24:06.864688+0000","last_became_active":"2023-08-22T00:24:06.863357+0000","last_became_peered":"2023-08-22T00:24:06.863357+0000","last_unstale":"2023-08-22T00:24:06.864688+0000","last_undegraded":"2023-08-22T00:24:06.864688+0000","last_fullsized":"2023-08-22T00:24:06.864688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845395+0000","last_change":"2023-08-22T00:24:06.483009+0000","last_active":"2023-08-22T00:24:06.845395+0000","last_peered":"2023-08-22T00:24:06.845395+0000","last_clean":"2023-08-22T00:24:06.845395+0000","last_became_active":"2023-08-22T00:24:06.482744+0000","last_became_peered":"2023-08-22T00:24:06.482744+0000","last_unstale":"2023-08-22T00:24:06.845395+0000","last_undegraded":"2023-08-22T00:24:06.845395+0000","last_fullsized":"2023-08-22T00:24:06.845395+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864516+0000","last_change":"2023-08-22T00:24:06.859860+0000","last_active":"2023-08-22T00:24:06.864516+0000","last_peered":"2023-08-22T00:24:06.864516+0000","last_clean":"2023-08-22T00:24:06.864516+0000","last_became_active":"2023-08-22T00:24:06.859564+0000","last_became_peered":"2023-08-22T00:24:06.859564+0000","last_unstale":"2023-08-22T00:24:06.864516+0000","last_undegraded":"2023-08-22T00:24:06.864516+0000","last_fullsized":"2023-08-22T00:24:06.864516+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844221+0000","last_change":"2023-08-22T00:24:06.491746+0000","last_active":"2023-08-22T00:24:06.844221+0000","last_peered":"2023-08-22T00:24:06.844221+0000","last_clean":"2023-08-22T00:24:06.844221+0000","last_became_active":"2023-08-22T00:24:06.491484+0000","last_became_peered":"2023-08-22T00:24:06.491484+0000","last_unstale":"2023-08-22T00:24:06.844221+0000","last_undegraded":"2023-08-22T00:24:06.844221+0000","last_fullsized":"2023-08-22T00:24:06.844221+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868785+0000","last_change":"2023-08-22T00:24:06.856037+0000","last_active":"2023-08-22T00:24:06.868785+0000","last_peered":"2023-08-22T00:24:06.868785+0000","last_clean":"2023-08-22T00:24:06.868785+0000","last_became_active":"2023-08-22T00:24:06.855805+0000","last_became_peered":"2023-08-22T00:24:06.855805+0000","last_unstale":"2023-08-22T00:24:06.868785+0000","last_undegraded":"2023-08-22T00:24:06.868785+0000","last_fullsized":"2023-08-22T00:24:06.868785+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843920+0000","last_change":"2023-08-22T00:24:06.483498+0000","last_active":"2023-08-22T00:24:06.843920+0000","last_peered":"2023-08-22T00:24:06.843920+0000","last_clean":"2023-08-22T00:24:06.843920+0000","last_became_active":"2023-08-22T00:24:06.483222+0000","last_became_peered":"2023-08-22T00:24:06.483222+0000","last_unstale":"2023-08-22T00:24:06.843920+0000","last_undegraded":"2023-08-22T00:24:06.843920+0000","last_fullsized":"2023-08-22T00:24:06.843920+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870540+0000","last_change":"2023-08-22T00:24:06.870074+0000","last_active":"2023-08-22T00:24:06.870540+0000","last_peered":"2023-08-22T00:24:06.870540+0000","last_clean":"2023-08-22T00:24:06.870540+0000","last_became_active":"2023-08-22T00:24:06.869798+0000","last_became_peered":"2023-08-22T00:24:06.869798+0000","last_unstale":"2023-08-22T00:24:06.870540+0000","last_undegraded":"2023-08-22T00:24:06.870540+0000","last_fullsized":"2023-08-22T00:24:06.870540+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845758+0000","last_change":"2023-08-22T00:24:06.482192+0000","last_active":"2023-08-22T00:24:06.845758+0000","last_peered":"2023-08-22T00:24:06.845758+0000","last_clean":"2023-08-22T00:24:06.845758+0000","last_became_active":"2023-08-22T00:24:06.481888+0000","last_became_peered":"2023-08-22T00:24:06.481888+0000","last_unstale":"2023-08-22T00:24:06.845758+0000","last_undegraded":"2023-08-22T00:24:06.845758+0000","last_fullsized":"2023-08-22T00:24:06.845758+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841519+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:24:06.841519+0000","last_peered":"2023-08-22T00:24:06.841519+0000","last_clean":"2023-08-22T00:24:06.841519+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:24:06.841519+0000","last_undegraded":"2023-08-22T00:24:06.841519+0000","last_fullsized":"2023-08-22T00:24:06.841519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.860119+0000","last_change":"2023-08-22T00:24:06.854502+0000","last_active":"2023-08-22T00:24:06.860119+0000","last_peered":"2023-08-22T00:24:06.860119+0000","last_clean":"2023-08-22T00:24:06.860119+0000","last_became_active":"2023-08-22T00:24:06.854293+0000","last_became_peered":"2023-08-22T00:24:06.854293+0000","last_unstale":"2023-08-22T00:24:06.860119+0000","last_undegraded":"2023-08-22T00:24:06.860119+0000","last_fullsized":"2023-08-22T00:24:06.860119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863963+0000","last_change":"2023-08-22T00:24:06.479488+0000","last_active":"2023-08-22T00:24:06.863963+0000","last_peered":"2023-08-22T00:24:06.863963+0000","last_clean":"2023-08-22T00:24:06.863963+0000","last_became_active":"2023-08-22T00:24:06.479217+0000","last_became_peered":"2023-08-22T00:24:06.479217+0000","last_unstale":"2023-08-22T00:24:06.863963+0000","last_undegraded":"2023-08-22T00:24:06.863963+0000","last_fullsized":"2023-08-22T00:24:06.863963+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.846947+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:24:06.846947+0000","last_peered":"2023-08-22T00:24:06.846947+0000","last_clean":"2023-08-22T00:24:06.846947+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:24:06.846947+0000","last_undegraded":"2023-08-22T00:24:06.846947+0000","last_fullsized":"2023-08-22T00:24:06.846947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865527+0000","last_change":"2023-08-22T00:24:06.859557+0000","last_active":"2023-08-22T00:24:06.865527+0000","last_peered":"2023-08-22T00:24:06.865527+0000","last_clean":"2023-08-22T00:24:06.865527+0000","last_became_active":"2023-08-22T00:24:06.858911+0000","last_became_peered":"2023-08-22T00:24:06.858911+0000","last_unstale":"2023-08-22T00:24:06.865527+0000","last_undegraded":"2023-08-22T00:24:06.865527+0000","last_fullsized":"2023-08-22T00:24:06.865527+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849669+0000","last_change":"2023-08-22T00:24:06.481801+0000","last_active":"2023-08-22T00:24:06.849669+0000","last_peered":"2023-08-22T00:24:06.849669+0000","last_clean":"2023-08-22T00:24:06.849669+0000","last_became_active":"2023-08-22T00:24:06.481517+0000","last_became_peered":"2023-08-22T00:24:06.481517+0000","last_unstale":"2023-08-22T00:24:06.849669+0000","last_undegraded":"2023-08-22T00:24:06.849669+0000","last_fullsized":"2023-08-22T00:24:06.849669+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844302+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:24:06.844302+0000","last_peered":"2023-08-22T00:24:06.844302+0000","last_clean":"2023-08-22T00:24:06.844302+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:24:06.844302+0000","last_undegraded":"2023-08-22T00:24:06.844302+0000","last_fullsized":"2023-08-22T00:24:06.844302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865085+0000","last_change":"2023-08-22T00:24:06.861080+0000","last_active":"2023-08-22T00:24:06.865085+0000","last_peered":"2023-08-22T00:24:06.865085+0000","last_clean":"2023-08-22T00:24:06.865085+0000","last_became_active":"2023-08-22T00:24:06.860468+0000","last_became_peered":"2023-08-22T00:24:06.860468+0000","last_unstale":"2023-08-22T00:24:06.865085+0000","last_undegraded":"2023-08-22T00:24:06.865085+0000","last_fullsized":"2023-08-22T00:24:06.865085+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845810+0000","last_change":"2023-08-22T00:24:06.495253+0000","last_active":"2023-08-22T00:24:06.845810+0000","last_peered":"2023-08-22T00:24:06.845810+0000","last_clean":"2023-08-22T00:24:06.845810+0000","last_became_active":"2023-08-22T00:24:06.494996+0000","last_became_peered":"2023-08-22T00:24:06.494996+0000","last_unstale":"2023-08-22T00:24:06.845810+0000","last_undegraded":"2023-08-22T00:24:06.845810+0000","last_fullsized":"2023-08-22T00:24:06.845810+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849445+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:24:06.849445+0000","last_peered":"2023-08-22T00:24:06.849445+0000","last_clean":"2023-08-22T00:24:06.849445+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:24:06.849445+0000","last_undegraded":"2023-08-22T00:24:06.849445+0000","last_fullsized":"2023-08-22T00:24:06.849445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854916+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:24:06.854916+0000","last_peered":"2023-08-22T00:24:06.854916+0000","last_clean":"2023-08-22T00:24:06.854916+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:24:06.854916+0000","last_undegraded":"2023-08-22T00:24:06.854916+0000","last_fullsized":"2023-08-22T00:24:06.854916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869353+0000","last_change":"2023-08-22T00:24:06.865245+0000","last_active":"2023-08-22T00:24:06.869353+0000","last_peered":"2023-08-22T00:24:06.869353+0000","last_clean":"2023-08-22T00:24:06.869353+0000","last_became_active":"2023-08-22T00:24:06.865000+0000","last_became_peered":"2023-08-22T00:24:06.865000+0000","last_unstale":"2023-08-22T00:24:06.869353+0000","last_undegraded":"2023-08-22T00:24:06.869353+0000","last_fullsized":"2023-08-22T00:24:06.869353+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841795+0000","last_change":"2023-08-22T00:24:06.494201+0000","last_active":"2023-08-22T00:24:06.841795+0000","last_peered":"2023-08-22T00:24:06.841795+0000","last_clean":"2023-08-22T00:24:06.841795+0000","last_became_active":"2023-08-22T00:24:06.493966+0000","last_became_peered":"2023-08-22T00:24:06.493966+0000","last_unstale":"2023-08-22T00:24:06.841795+0000","last_undegraded":"2023-08-22T00:24:06.841795+0000","last_fullsized":"2023-08-22T00:24:06.841795+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854836+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:24:06.854836+0000","last_peered":"2023-08-22T00:24:06.854836+0000","last_clean":"2023-08-22T00:24:06.854836+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:24:06.854836+0000","last_undegraded":"2023-08-22T00:24:06.854836+0000","last_fullsized":"2023-08-22T00:24:06.854836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867119+0000","last_change":"2023-08-22T00:24:06.866180+0000","last_active":"2023-08-22T00:24:06.867119+0000","last_peered":"2023-08-22T00:24:06.867119+0000","last_clean":"2023-08-22T00:24:06.867119+0000","last_became_active":"2023-08-22T00:24:06.865887+0000","last_became_peered":"2023-08-22T00:24:06.865887+0000","last_unstale":"2023-08-22T00:24:06.867119+0000","last_undegraded":"2023-08-22T00:24:06.867119+0000","last_fullsized":"2023-08-22T00:24:06.867119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843400+0000","last_change":"2023-08-22T00:24:06.485586+0000","last_active":"2023-08-22T00:24:06.843400+0000","last_peered":"2023-08-22T00:24:06.843400+0000","last_clean":"2023-08-22T00:24:06.843400+0000","last_became_active":"2023-08-22T00:24:06.485052+0000","last_became_peered":"2023-08-22T00:24:06.485052+0000","last_unstale":"2023-08-22T00:24:06.843400+0000","last_undegraded":"2023-08-22T00:24:06.843400+0000","last_fullsized":"2023-08-22T00:24:06.843400+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.856189+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:24:06.856189+0000","last_peered":"2023-08-22T00:24:06.856189+0000","last_clean":"2023-08-22T00:24:06.856189+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:24:06.856189+0000","last_undegraded":"2023-08-22T00:24:06.856189+0000","last_fullsized":"2023-08-22T00:24:06.856189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863430+0000","last_change":"2023-08-22T00:24:06.860075+0000","last_active":"2023-08-22T00:24:06.863430+0000","last_peered":"2023-08-22T00:24:06.863430+0000","last_clean":"2023-08-22T00:24:06.863430+0000","last_became_active":"2023-08-22T00:24:06.859814+0000","last_became_peered":"2023-08-22T00:24:06.859814+0000","last_unstale":"2023-08-22T00:24:06.863430+0000","last_undegraded":"2023-08-22T00:24:06.863430+0000","last_fullsized":"2023-08-22T00:24:06.863430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869796+0000","last_change":"2023-08-22T00:24:06.484934+0000","last_active":"2023-08-22T00:24:06.869796+0000","last_peered":"2023-08-22T00:24:06.869796+0000","last_clean":"2023-08-22T00:24:06.869796+0000","last_became_active":"2023-08-22T00:24:06.484647+0000","last_became_peered":"2023-08-22T00:24:06.484647+0000","last_unstale":"2023-08-22T00:24:06.869796+0000","last_undegraded":"2023-08-22T00:24:06.869796+0000","last_fullsized":"2023-08-22T00:24:06.869796+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841426+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:24:06.841426+0000","last_peered":"2023-08-22T00:24:06.841426+0000","last_clean":"2023-08-22T00:24:06.841426+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:24:06.841426+0000","last_undegraded":"2023-08-22T00:24:06.841426+0000","last_fullsized":"2023-08-22T00:24:06.841426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859226+0000","last_change":"2023-08-22T00:24:06.857385+0000","last_active":"2023-08-22T00:24:06.859226+0000","last_peered":"2023-08-22T00:24:06.859226+0000","last_clean":"2023-08-22T00:24:06.859226+0000","last_became_active":"2023-08-22T00:24:06.857127+0000","last_became_peered":"2023-08-22T00:24:06.857127+0000","last_unstale":"2023-08-22T00:24:06.859226+0000","last_undegraded":"2023-08-22T00:24:06.859226+0000","last_fullsized":"2023-08-22T00:24:06.859226+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870630+0000","last_change":"2023-08-22T00:24:06.484588+0000","last_active":"2023-08-22T00:24:06.870630+0000","last_peered":"2023-08-22T00:24:06.870630+0000","last_clean":"2023-08-22T00:24:06.870630+0000","last_became_active":"2023-08-22T00:24:06.483947+0000","last_became_peered":"2023-08-22T00:24:06.483947+0000","last_unstale":"2023-08-22T00:24:06.870630+0000","last_undegraded":"2023-08-22T00:24:06.870630+0000","last_fullsized":"2023-08-22T00:24:06.870630+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843849+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:24:06.843849+0000","last_peered":"2023-08-22T00:24:06.843849+0000","last_clean":"2023-08-22T00:24:06.843849+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:24:06.843849+0000","last_undegraded":"2023-08-22T00:24:06.843849+0000","last_fullsized":"2023-08-22T00:24:06.843849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":891887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.77500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.435,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.496},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.75,"15min":0.75},"last":0.628},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.308},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79100000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575062,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":891923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.62}]},{"osd":5,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302844,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068996,"statfs":{"total":96636764160,"available":96326651904,"internally_reserved":0,"allocated":1691648,"data_stored":891977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.373,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":2.504,"15min":2.504},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.374},"min":{"1min":0.27700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.46800000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.29499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.36399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.53100000000000003,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.318},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":0.52800000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.311},"max":{"1min":0.76400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.496},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.378},"max":{"1min":0.83699999999999997,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.505}]},{"osd":5,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82499999999999996,"5min":1.24,"15min":1.24},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.441,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.46400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":2.298,"15min":2.298},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":2.992,"15min":2.992},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":2.323,"15min":2.323},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302860,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068980,"statfs":{"total":96636764160,"available":96326635520,"internally_reserved":0,"allocated":1708032,"data_stored":893233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46400000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52500000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.26500000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.26500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46700000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.64200000000000002},"last":0.309},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.499,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.315}]},{"osd":4,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83799999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.39900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.628,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.65800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302836,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069004,"statfs":{"total":96636764160,"available":96326660096,"internally_reserved":0,"allocated":1683456,"data_stored":891853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34300000000000003,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.67300000000000004,"5min":1.216,"15min":1.216},"last":0.31}]},{"osd":1,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.626,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.39100000000000001},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.438,"15min":0.46100000000000002},"min":{"1min":0.35599999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.41199999999999998},"min":{"1min":0.30599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":1.0580000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73699999999999999,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.88500000000000001,"15min":0.998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77500000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77600000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.5}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":893943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.187,"15min":0.187},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.377},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.307}]},{"osd":2,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41999999999999998,"15min":0.443},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.32400000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35299999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82899999999999996,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.629,"15min":0.65600000000000003},"min":{"1min":0.38600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.51100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.96799999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.65400000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.54500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90500000000000003,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.497},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.95999999999999996},"last":0.61699999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84999999999999998,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":892745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.746},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67300000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71299999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":891875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.54500000000000004},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67900000000000005,"5min":0.77700000000000002,"15min":0.78700000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.39400000000000002,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.80300000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.505,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.76400000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:24:12.761 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:24:12.759+0000 7fa1da0b0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:24:14.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:24:14.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.443+0000 7f5515611700 1 Processor -- start 2023-08-22T00:24:14.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.443+0000 7f5515611700 1 -- start start 2023-08-22T00:24:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f5515611700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f55100a89a0 0x7f55100bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f5515611700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 0x7f5510063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f5515611700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5510063f60 con 0x7f55100c24d0 2023-08-22T00:24:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f5515611700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100bd3b0 con 0x7f55100a89a0 2023-08-22T00:24:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f5515611700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5510154830 con 0x7f5510155310 2023-08-22T00:24:14.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f55100a89a0 0x7f55100bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f55100a89a0 0x7f55100bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35572/0 (socket says 172.21.15.98:35572) 2023-08-22T00:24:14.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 -- 172.21.15.98:0/2840715906 learned_addr learned my addr 172.21.15.98:0/2840715906 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:14.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550e7fc700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 0x7f5510063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 -- 172.21.15.98:0/2840715906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 msgr2=0x7f5510063a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:14.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 0x7f5510063a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 -- 172.21.15.98:0/2840715906 >> v1:172.21.15.118:6789/0 conn(0x7f55100c24d0 legacy=0x7f55100c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 -- 172.21.15.98:0/2840715906 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510154b10 con 0x7f55100a89a0 2023-08-22T00:24:14.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550e7fc700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 0x7f5510063a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:14.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550effd700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55100bcd60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f5504006fd0 tx=0x7f55040090f0).ready entity=mon.0 client_cookie=50a9b610293a29f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.444+0000 7f550dffb700 1 -- 172.21.15.98:0/2840715906 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400b600 con 0x7f55100a89a0 2023-08-22T00:24:14.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f550dffb700 1 -- 172.21.15.98:0/2840715906 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400b760 con 0x7f55100a89a0 2023-08-22T00:24:14.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f550dffb700 1 -- 172.21.15.98:0/2840715906 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400bae0 con 0x7f55100a89a0 2023-08-22T00:24:14.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 -- 172.21.15.98:0/2840715906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 msgr2=0x7f55100bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55100bcd60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f5504006fd0 tx=0x7f55040090f0).stop 2023-08-22T00:24:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 -- 172.21.15.98:0/2840715906 shutdown_connections 2023-08-22T00:24:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55100bcd60 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 --2- 172.21.15.98:0/2840715906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5510155310 0x7f5510063a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 -- 172.21.15.98:0/2840715906 >> 172.21.15.98:0/2840715906 conn(0x7f55100c7140 msgr2=0x7f55100c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:14.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 -- 172.21.15.98:0/2840715906 shutdown_connections 2023-08-22T00:24:14.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.445+0000 7f5515611700 1 -- 172.21.15.98:0/2840715906 wait complete. 2023-08-22T00:24:14.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.446+0000 7f5515611700 1 Processor -- start 2023-08-22T00:24:14.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.446+0000 7f5515611700 1 -- start start 2023-08-22T00:24:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55100c24d0 0x7f55100657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5510155310 0x7f55100be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55100ab3e0 con 0x7f55100a89a0 2023-08-22T00:24:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55100bf140 con 0x7f5510155310 2023-08-22T00:24:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f5515611700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55100bf420 con 0x7f55100c24d0 2023-08-22T00:24:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f550effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f550effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35582/0 (socket says 172.21.15.98:35582) 2023-08-22T00:24:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f550effd700 1 -- 172.21.15.98:0/3949676004 learned_addr learned my addr 172.21.15.98:0/3949676004 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f550e7fc700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55100c24d0 0x7f55100657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.447+0000 7f550f7fe700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5510155310 0x7f55100be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 -- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55100c24d0 msgr2=0x7f55100657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55100c24d0 0x7f55100657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 -- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5510155310 msgr2=0x7f55100be6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5510155310 0x7f55100be6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 -- 172.21.15.98:0/3949676004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009370 con 0x7f55100a89a0 2023-08-22T00:24:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f550effd700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f5510067070 tx=0x7f5504017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400bea0 con 0x7f55100a89a0 2023-08-22T00:24:14.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400b8d0 con 0x7f55100a89a0 2023-08-22T00:24:14.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55100bf700 con 0x7f55100a89a0 2023-08-22T00:24:14.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550401b660 con 0x7f55100a89a0 2023-08-22T00:24:14.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.448+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55100a97e0 con 0x7f55100a89a0 2023-08-22T00:24:14.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.449+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55101543e0 con 0x7f55100a89a0 2023-08-22T00:24:14.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.449+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f550401b9d0 con 0x7f55100a89a0 2023-08-22T00:24:14.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.450+0000 7f54f6ffd700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 0x7f54fc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.450+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f550407b860 con 0x7f55100a89a0 2023-08-22T00:24:14.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.450+0000 7f550e7fc700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 0x7f54fc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.450+0000 7f550e7fc700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 0x7f54fc0612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5510165280 tx=0x7f5500008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.454+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f550404cb70 con 0x7f55100a89a0 2023-08-22T00:24:14.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.616+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55100ab520 con 0x7f54fc05ee10 2023-08-22T00:24:14.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.625+0000 7f54f6ffd700 1 -- 172.21.15.98:0/3949676004 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361980 (secure 0 0 0) 0x7f550000b800 con 0x7f54fc05ee10 2023-08-22T00:24:14.630 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:14.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 msgr2=0x7f54fc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 0x7f54fc0612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5510165280 tx=0x7f5500008040).stop 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 msgr2=0x7f55101521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f5510067070 tx=0x7f5504017000).stop 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 shutdown_connections 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5510155310 0x7f55100be6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55100a89a0 0x7f55101521a0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54fc05ee10 0x7f54fc0612d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 --2- 172.21.15.98:0/3949676004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55100c24d0 0x7f55100657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 >> 172.21.15.98:0/3949676004 conn(0x7f55100c7140 msgr2=0x7f55100c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 shutdown_connections 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.629+0000 7f5515611700 1 -- 172.21.15.98:0/3949676004 wait complete. 2023-08-22T00:24:14.634 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:24:14.642 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:24:12.874174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":244,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430944,"kb_used_data":13216,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543776,"statfs":{"total":773094113280,"available":770604826624,"internally_reserved":0,"allocated":13533184,"data_stored":7139436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5607,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.555690"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854327+0000","last_change":"2023-08-22T00:24:06.851037+0000","last_active":"2023-08-22T00:24:06.854327+0000","last_peered":"2023-08-22T00:24:06.854327+0000","last_clean":"2023-08-22T00:24:06.854327+0000","last_became_active":"2023-08-22T00:24:06.849185+0000","last_became_peered":"2023-08-22T00:24:06.849185+0000","last_unstale":"2023-08-22T00:24:06.854327+0000","last_undegraded":"2023-08-22T00:24:06.854327+0000","last_fullsized":"2023-08-22T00:24:06.854327+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870590+0000","last_change":"2023-08-22T00:24:06.487200+0000","last_active":"2023-08-22T00:24:06.870590+0000","last_peered":"2023-08-22T00:24:06.870590+0000","last_clean":"2023-08-22T00:24:06.870590+0000","last_became_active":"2023-08-22T00:24:06.486930+0000","last_became_peered":"2023-08-22T00:24:06.486930+0000","last_unstale":"2023-08-22T00:24:06.870590+0000","last_undegraded":"2023-08-22T00:24:06.870590+0000","last_fullsized":"2023-08-22T00:24:06.870590+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870823+0000","last_change":"2023-08-22T00:24:06.869014+0000","last_active":"2023-08-22T00:24:06.870823+0000","last_peered":"2023-08-22T00:24:06.870823+0000","last_clean":"2023-08-22T00:24:06.870823+0000","last_became_active":"2023-08-22T00:24:06.868747+0000","last_became_peered":"2023-08-22T00:24:06.868747+0000","last_unstale":"2023-08-22T00:24:06.870823+0000","last_undegraded":"2023-08-22T00:24:06.870823+0000","last_fullsized":"2023-08-22T00:24:06.870823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842776+0000","last_change":"2023-08-22T00:24:06.479752+0000","last_active":"2023-08-22T00:24:06.842776+0000","last_peered":"2023-08-22T00:24:06.842776+0000","last_clean":"2023-08-22T00:24:06.842776+0000","last_became_active":"2023-08-22T00:24:06.479480+0000","last_became_peered":"2023-08-22T00:24:06.479480+0000","last_unstale":"2023-08-22T00:24:06.842776+0000","last_undegraded":"2023-08-22T00:24:06.842776+0000","last_fullsized":"2023-08-22T00:24:06.842776+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868864+0000","last_change":"2023-08-22T00:24:06.856964+0000","last_active":"2023-08-22T00:24:06.868864+0000","last_peered":"2023-08-22T00:24:06.868864+0000","last_clean":"2023-08-22T00:24:06.868864+0000","last_became_active":"2023-08-22T00:24:06.856695+0000","last_became_peered":"2023-08-22T00:24:06.856695+0000","last_unstale":"2023-08-22T00:24:06.868864+0000","last_undegraded":"2023-08-22T00:24:06.868864+0000","last_fullsized":"2023-08-22T00:24:06.868864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.848978+0000","last_change":"2023-08-22T00:24:06.484764+0000","last_active":"2023-08-22T00:24:06.848978+0000","last_peered":"2023-08-22T00:24:06.848978+0000","last_clean":"2023-08-22T00:24:06.848978+0000","last_became_active":"2023-08-22T00:24:06.484310+0000","last_became_peered":"2023-08-22T00:24:06.484310+0000","last_unstale":"2023-08-22T00:24:06.848978+0000","last_undegraded":"2023-08-22T00:24:06.848978+0000","last_fullsized":"2023-08-22T00:24:06.848978+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864520+0000","last_change":"2023-08-22T00:24:06.859650+0000","last_active":"2023-08-22T00:24:06.864520+0000","last_peered":"2023-08-22T00:24:06.864520+0000","last_clean":"2023-08-22T00:24:06.864520+0000","last_became_active":"2023-08-22T00:24:06.859339+0000","last_became_peered":"2023-08-22T00:24:06.859339+0000","last_unstale":"2023-08-22T00:24:06.864520+0000","last_undegraded":"2023-08-22T00:24:06.864520+0000","last_fullsized":"2023-08-22T00:24:06.864520+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859163+0000","last_change":"2023-08-22T00:24:06.472733+0000","last_active":"2023-08-22T00:24:06.859163+0000","last_peered":"2023-08-22T00:24:06.859163+0000","last_clean":"2023-08-22T00:24:06.859163+0000","last_became_active":"2023-08-22T00:24:06.472458+0000","last_became_peered":"2023-08-22T00:24:06.472458+0000","last_unstale":"2023-08-22T00:24:06.859163+0000","last_undegraded":"2023-08-22T00:24:06.859163+0000","last_fullsized":"2023-08-22T00:24:06.859163+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869785+0000","last_change":"2023-08-22T00:24:06.860963+0000","last_active":"2023-08-22T00:24:06.869785+0000","last_peered":"2023-08-22T00:24:06.869785+0000","last_clean":"2023-08-22T00:24:06.869785+0000","last_became_active":"2023-08-22T00:24:06.860712+0000","last_became_peered":"2023-08-22T00:24:06.860712+0000","last_unstale":"2023-08-22T00:24:06.869785+0000","last_undegraded":"2023-08-22T00:24:06.869785+0000","last_fullsized":"2023-08-22T00:24:06.869785+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854074+0000","last_change":"2023-08-22T00:24:06.480715+0000","last_active":"2023-08-22T00:24:06.854074+0000","last_peered":"2023-08-22T00:24:06.854074+0000","last_clean":"2023-08-22T00:24:06.854074+0000","last_became_active":"2023-08-22T00:24:06.480141+0000","last_became_peered":"2023-08-22T00:24:06.480141+0000","last_unstale":"2023-08-22T00:24:06.854074+0000","last_undegraded":"2023-08-22T00:24:06.854074+0000","last_fullsized":"2023-08-22T00:24:06.854074+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865233+0000","last_change":"2023-08-22T00:24:06.863016+0000","last_active":"2023-08-22T00:24:06.865233+0000","last_peered":"2023-08-22T00:24:06.865233+0000","last_clean":"2023-08-22T00:24:06.865233+0000","last_became_active":"2023-08-22T00:24:06.862757+0000","last_became_peered":"2023-08-22T00:24:06.862757+0000","last_unstale":"2023-08-22T00:24:06.865233+0000","last_undegraded":"2023-08-22T00:24:06.865233+0000","last_fullsized":"2023-08-22T00:24:06.865233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850727+0000","last_change":"2023-08-22T00:24:06.489978+0000","last_active":"2023-08-22T00:24:06.850727+0000","last_peered":"2023-08-22T00:24:06.850727+0000","last_clean":"2023-08-22T00:24:06.850727+0000","last_became_active":"2023-08-22T00:24:06.489663+0000","last_became_peered":"2023-08-22T00:24:06.489663+0000","last_unstale":"2023-08-22T00:24:06.850727+0000","last_undegraded":"2023-08-22T00:24:06.850727+0000","last_fullsized":"2023-08-22T00:24:06.850727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870741+0000","last_change":"2023-08-22T00:24:06.870220+0000","last_active":"2023-08-22T00:24:06.870741+0000","last_peered":"2023-08-22T00:24:06.870741+0000","last_clean":"2023-08-22T00:24:06.870741+0000","last_became_active":"2023-08-22T00:24:06.869938+0000","last_became_peered":"2023-08-22T00:24:06.869938+0000","last_unstale":"2023-08-22T00:24:06.870741+0000","last_undegraded":"2023-08-22T00:24:06.870741+0000","last_fullsized":"2023-08-22T00:24:06.870741+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841469+0000","last_change":"2023-08-22T00:24:06.489981+0000","last_active":"2023-08-22T00:24:06.841469+0000","last_peered":"2023-08-22T00:24:06.841469+0000","last_clean":"2023-08-22T00:24:06.841469+0000","last_became_active":"2023-08-22T00:24:06.489678+0000","last_became_peered":"2023-08-22T00:24:06.489678+0000","last_unstale":"2023-08-22T00:24:06.841469+0000","last_undegraded":"2023-08-22T00:24:06.841469+0000","last_fullsized":"2023-08-22T00:24:06.841469+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854512+0000","last_change":"2023-08-22T00:24:06.851891+0000","last_active":"2023-08-22T00:24:06.854512+0000","last_peered":"2023-08-22T00:24:06.854512+0000","last_clean":"2023-08-22T00:24:06.854512+0000","last_became_active":"2023-08-22T00:24:06.851555+0000","last_became_peered":"2023-08-22T00:24:06.851555+0000","last_unstale":"2023-08-22T00:24:06.854512+0000","last_undegraded":"2023-08-22T00:24:06.854512+0000","last_fullsized":"2023-08-22T00:24:06.854512+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844045+0000","last_change":"2023-08-22T00:24:06.485667+0000","last_active":"2023-08-22T00:24:06.844045+0000","last_peered":"2023-08-22T00:24:06.844045+0000","last_clean":"2023-08-22T00:24:06.844045+0000","last_became_active":"2023-08-22T00:24:06.485371+0000","last_became_peered":"2023-08-22T00:24:06.485371+0000","last_unstale":"2023-08-22T00:24:06.844045+0000","last_undegraded":"2023-08-22T00:24:06.844045+0000","last_fullsized":"2023-08-22T00:24:06.844045+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870533+0000","last_change":"2023-08-22T00:24:06.866550+0000","last_active":"2023-08-22T00:24:06.870533+0000","last_peered":"2023-08-22T00:24:06.870533+0000","last_clean":"2023-08-22T00:24:06.870533+0000","last_became_active":"2023-08-22T00:24:06.866284+0000","last_became_peered":"2023-08-22T00:24:06.866284+0000","last_unstale":"2023-08-22T00:24:06.870533+0000","last_undegraded":"2023-08-22T00:24:06.870533+0000","last_fullsized":"2023-08-22T00:24:06.870533+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843814+0000","last_change":"2023-08-22T00:24:06.484546+0000","last_active":"2023-08-22T00:24:06.843814+0000","last_peered":"2023-08-22T00:24:06.843814+0000","last_clean":"2023-08-22T00:24:06.843814+0000","last_became_active":"2023-08-22T00:24:06.484325+0000","last_became_peered":"2023-08-22T00:24:06.484325+0000","last_unstale":"2023-08-22T00:24:06.843814+0000","last_undegraded":"2023-08-22T00:24:06.843814+0000","last_fullsized":"2023-08-22T00:24:06.843814+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870805+0000","last_change":"2023-08-22T00:24:06.868390+0000","last_active":"2023-08-22T00:24:06.870805+0000","last_peered":"2023-08-22T00:24:06.870805+0000","last_clean":"2023-08-22T00:24:06.870805+0000","last_became_active":"2023-08-22T00:24:06.866084+0000","last_became_peered":"2023-08-22T00:24:06.866084+0000","last_unstale":"2023-08-22T00:24:06.870805+0000","last_undegraded":"2023-08-22T00:24:06.870805+0000","last_fullsized":"2023-08-22T00:24:06.870805+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841418+0000","last_change":"2023-08-22T00:24:06.484107+0000","last_active":"2023-08-22T00:24:06.841418+0000","last_peered":"2023-08-22T00:24:06.841418+0000","last_clean":"2023-08-22T00:24:06.841418+0000","last_became_active":"2023-08-22T00:24:06.483839+0000","last_became_peered":"2023-08-22T00:24:06.483839+0000","last_unstale":"2023-08-22T00:24:06.841418+0000","last_undegraded":"2023-08-22T00:24:06.841418+0000","last_fullsized":"2023-08-22T00:24:06.841418+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870782+0000","last_change":"2023-08-22T00:24:06.867719+0000","last_active":"2023-08-22T00:24:06.870782+0000","last_peered":"2023-08-22T00:24:06.870782+0000","last_clean":"2023-08-22T00:24:06.870782+0000","last_became_active":"2023-08-22T00:24:06.865969+0000","last_became_peered":"2023-08-22T00:24:06.865969+0000","last_unstale":"2023-08-22T00:24:06.870782+0000","last_undegraded":"2023-08-22T00:24:06.870782+0000","last_fullsized":"2023-08-22T00:24:06.870782+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849105+0000","last_change":"2023-08-22T00:24:06.482445+0000","last_active":"2023-08-22T00:24:06.849105+0000","last_peered":"2023-08-22T00:24:06.849105+0000","last_clean":"2023-08-22T00:24:06.849105+0000","last_became_active":"2023-08-22T00:24:06.482164+0000","last_became_peered":"2023-08-22T00:24:06.482164+0000","last_unstale":"2023-08-22T00:24:06.849105+0000","last_undegraded":"2023-08-22T00:24:06.849105+0000","last_fullsized":"2023-08-22T00:24:06.849105+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.851539+0000","last_change":"2023-08-22T00:24:06.846874+0000","last_active":"2023-08-22T00:24:06.851539+0000","last_peered":"2023-08-22T00:24:06.851539+0000","last_clean":"2023-08-22T00:24:06.851539+0000","last_became_active":"2023-08-22T00:24:06.846590+0000","last_became_peered":"2023-08-22T00:24:06.846590+0000","last_unstale":"2023-08-22T00:24:06.851539+0000","last_undegraded":"2023-08-22T00:24:06.851539+0000","last_fullsized":"2023-08-22T00:24:06.851539+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869671+0000","last_change":"2023-08-22T00:24:06.477369+0000","last_active":"2023-08-22T00:24:06.869671+0000","last_peered":"2023-08-22T00:24:06.869671+0000","last_clean":"2023-08-22T00:24:06.869671+0000","last_became_active":"2023-08-22T00:24:06.476947+0000","last_became_peered":"2023-08-22T00:24:06.476947+0000","last_unstale":"2023-08-22T00:24:06.869671+0000","last_undegraded":"2023-08-22T00:24:06.869671+0000","last_fullsized":"2023-08-22T00:24:06.869671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864604+0000","last_change":"2023-08-22T00:24:06.862961+0000","last_active":"2023-08-22T00:24:06.864604+0000","last_peered":"2023-08-22T00:24:06.864604+0000","last_clean":"2023-08-22T00:24:06.864604+0000","last_became_active":"2023-08-22T00:24:06.862657+0000","last_became_peered":"2023-08-22T00:24:06.862657+0000","last_unstale":"2023-08-22T00:24:06.864604+0000","last_undegraded":"2023-08-22T00:24:06.864604+0000","last_fullsized":"2023-08-22T00:24:06.864604+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.33","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.853757+0000","last_change":"2023-08-22T00:24:06.473580+0000","last_active":"2023-08-22T00:24:06.853757+0000","last_peered":"2023-08-22T00:24:06.853757+0000","last_clean":"2023-08-22T00:24:06.853757+0000","last_became_active":"2023-08-22T00:24:06.473294+0000","last_became_peered":"2023-08-22T00:24:06.473294+0000","last_unstale":"2023-08-22T00:24:06.853757+0000","last_undegraded":"2023-08-22T00:24:06.853757+0000","last_fullsized":"2023-08-22T00:24:06.853757+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867432+0000","last_change":"2023-08-22T00:24:06.866869+0000","last_active":"2023-08-22T00:24:06.867432+0000","last_peered":"2023-08-22T00:24:06.867432+0000","last_clean":"2023-08-22T00:24:06.867432+0000","last_became_active":"2023-08-22T00:24:06.866536+0000","last_became_peered":"2023-08-22T00:24:06.866536+0000","last_unstale":"2023-08-22T00:24:06.867432+0000","last_undegraded":"2023-08-22T00:24:06.867432+0000","last_fullsized":"2023-08-22T00:24:06.867432+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.852117+0000","last_change":"2023-08-22T00:24:06.475151+0000","last_active":"2023-08-22T00:24:06.852117+0000","last_peered":"2023-08-22T00:24:06.852117+0000","last_clean":"2023-08-22T00:24:06.852117+0000","last_became_active":"2023-08-22T00:24:06.474870+0000","last_became_peered":"2023-08-22T00:24:06.474870+0000","last_unstale":"2023-08-22T00:24:06.852117+0000","last_undegraded":"2023-08-22T00:24:06.852117+0000","last_fullsized":"2023-08-22T00:24:06.852117+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868888+0000","last_change":"2023-08-22T00:24:06.860108+0000","last_active":"2023-08-22T00:24:06.868888+0000","last_peered":"2023-08-22T00:24:06.868888+0000","last_clean":"2023-08-22T00:24:06.868888+0000","last_became_active":"2023-08-22T00:24:06.859856+0000","last_became_peered":"2023-08-22T00:24:06.859856+0000","last_unstale":"2023-08-22T00:24:06.868888+0000","last_undegraded":"2023-08-22T00:24:06.868888+0000","last_fullsized":"2023-08-22T00:24:06.868888+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850240+0000","last_change":"2023-08-22T00:24:06.475109+0000","last_active":"2023-08-22T00:24:06.850240+0000","last_peered":"2023-08-22T00:24:06.850240+0000","last_clean":"2023-08-22T00:24:06.850240+0000","last_became_active":"2023-08-22T00:24:06.474823+0000","last_became_peered":"2023-08-22T00:24:06.474823+0000","last_unstale":"2023-08-22T00:24:06.850240+0000","last_undegraded":"2023-08-22T00:24:06.850240+0000","last_fullsized":"2023-08-22T00:24:06.850240+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.853934+0000","last_change":"2023-08-22T00:24:06.850093+0000","last_active":"2023-08-22T00:24:06.853934+0000","last_peered":"2023-08-22T00:24:06.853934+0000","last_clean":"2023-08-22T00:24:06.853934+0000","last_became_active":"2023-08-22T00:24:06.849833+0000","last_became_peered":"2023-08-22T00:24:06.849833+0000","last_unstale":"2023-08-22T00:24:06.853934+0000","last_undegraded":"2023-08-22T00:24:06.853934+0000","last_fullsized":"2023-08-22T00:24:06.853934+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.30","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.866522+0000","last_change":"2023-08-22T00:24:06.473575+0000","last_active":"2023-08-22T00:24:06.866522+0000","last_peered":"2023-08-22T00:24:06.866522+0000","last_clean":"2023-08-22T00:24:06.866522+0000","last_became_active":"2023-08-22T00:24:06.473283+0000","last_became_peered":"2023-08-22T00:24:06.473283+0000","last_unstale":"2023-08-22T00:24:06.866522+0000","last_undegraded":"2023-08-22T00:24:06.866522+0000","last_fullsized":"2023-08-22T00:24:06.866522+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849426+0000","last_change":"2023-08-22T00:24:06.847874+0000","last_active":"2023-08-22T00:24:06.849426+0000","last_peered":"2023-08-22T00:24:06.849426+0000","last_clean":"2023-08-22T00:24:06.849426+0000","last_became_active":"2023-08-22T00:24:06.847549+0000","last_became_peered":"2023-08-22T00:24:06.847549+0000","last_unstale":"2023-08-22T00:24:06.849426+0000","last_undegraded":"2023-08-22T00:24:06.849426+0000","last_fullsized":"2023-08-22T00:24:06.849426+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.856675+0000","last_change":"2023-08-22T00:24:06.485181+0000","last_active":"2023-08-22T00:24:06.856675+0000","last_peered":"2023-08-22T00:24:06.856675+0000","last_clean":"2023-08-22T00:24:06.856675+0000","last_became_active":"2023-08-22T00:24:06.484925+0000","last_became_peered":"2023-08-22T00:24:06.484925+0000","last_unstale":"2023-08-22T00:24:06.856675+0000","last_undegraded":"2023-08-22T00:24:06.856675+0000","last_fullsized":"2023-08-22T00:24:06.856675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854216+0000","last_change":"2023-08-22T00:24:06.850023+0000","last_active":"2023-08-22T00:24:06.854216+0000","last_peered":"2023-08-22T00:24:06.854216+0000","last_clean":"2023-08-22T00:24:06.854216+0000","last_became_active":"2023-08-22T00:24:06.849733+0000","last_became_peered":"2023-08-22T00:24:06.849733+0000","last_unstale":"2023-08-22T00:24:06.854216+0000","last_undegraded":"2023-08-22T00:24:06.854216+0000","last_fullsized":"2023-08-22T00:24:06.854216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842877+0000","last_change":"2023-08-22T00:24:06.484297+0000","last_active":"2023-08-22T00:24:06.842877+0000","last_peered":"2023-08-22T00:24:06.842877+0000","last_clean":"2023-08-22T00:24:06.842877+0000","last_became_active":"2023-08-22T00:24:06.484017+0000","last_became_peered":"2023-08-22T00:24:06.484017+0000","last_unstale":"2023-08-22T00:24:06.842877+0000","last_undegraded":"2023-08-22T00:24:06.842877+0000","last_fullsized":"2023-08-22T00:24:06.842877+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864033+0000","last_change":"2023-08-22T00:24:06.861206+0000","last_active":"2023-08-22T00:24:06.864033+0000","last_peered":"2023-08-22T00:24:06.864033+0000","last_clean":"2023-08-22T00:24:06.864033+0000","last_became_active":"2023-08-22T00:24:06.860952+0000","last_became_peered":"2023-08-22T00:24:06.860952+0000","last_unstale":"2023-08-22T00:24:06.864033+0000","last_undegraded":"2023-08-22T00:24:06.864033+0000","last_fullsized":"2023-08-22T00:24:06.864033+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2d","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870757+0000","last_change":"2023-08-22T00:24:06.482677+0000","last_active":"2023-08-22T00:24:06.870757+0000","last_peered":"2023-08-22T00:24:06.870757+0000","last_clean":"2023-08-22T00:24:06.870757+0000","last_became_active":"2023-08-22T00:24:06.482408+0000","last_became_peered":"2023-08-22T00:24:06.482408+0000","last_unstale":"2023-08-22T00:24:06.870757+0000","last_undegraded":"2023-08-22T00:24:06.870757+0000","last_fullsized":"2023-08-22T00:24:06.870757+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867217+0000","last_change":"2023-08-22T00:24:06.865902+0000","last_active":"2023-08-22T00:24:06.867217+0000","last_peered":"2023-08-22T00:24:06.867217+0000","last_clean":"2023-08-22T00:24:06.867217+0000","last_became_active":"2023-08-22T00:24:06.865618+0000","last_became_peered":"2023-08-22T00:24:06.865618+0000","last_unstale":"2023-08-22T00:24:06.867217+0000","last_undegraded":"2023-08-22T00:24:06.867217+0000","last_fullsized":"2023-08-22T00:24:06.867217+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843599+0000","last_change":"2023-08-22T00:24:06.470587+0000","last_active":"2023-08-22T00:24:06.843599+0000","last_peered":"2023-08-22T00:24:06.843599+0000","last_clean":"2023-08-22T00:24:06.843599+0000","last_became_active":"2023-08-22T00:24:06.470145+0000","last_became_peered":"2023-08-22T00:24:06.470145+0000","last_unstale":"2023-08-22T00:24:06.843599+0000","last_undegraded":"2023-08-22T00:24:06.843599+0000","last_fullsized":"2023-08-22T00:24:06.843599+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865546+0000","last_change":"2023-08-22T00:24:06.859745+0000","last_active":"2023-08-22T00:24:06.865546+0000","last_peered":"2023-08-22T00:24:06.865546+0000","last_clean":"2023-08-22T00:24:06.865546+0000","last_became_active":"2023-08-22T00:24:06.859245+0000","last_became_peered":"2023-08-22T00:24:06.859245+0000","last_unstale":"2023-08-22T00:24:06.865546+0000","last_undegraded":"2023-08-22T00:24:06.865546+0000","last_fullsized":"2023-08-22T00:24:06.865546+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864081+0000","last_change":"2023-08-22T00:24:06.473472+0000","last_active":"2023-08-22T00:24:06.864081+0000","last_peered":"2023-08-22T00:24:06.864081+0000","last_clean":"2023-08-22T00:24:06.864081+0000","last_became_active":"2023-08-22T00:24:06.473193+0000","last_became_peered":"2023-08-22T00:24:06.473193+0000","last_unstale":"2023-08-22T00:24:06.864081+0000","last_undegraded":"2023-08-22T00:24:06.864081+0000","last_fullsized":"2023-08-22T00:24:06.864081+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.855558+0000","last_change":"2023-08-22T00:24:06.853365+0000","last_active":"2023-08-22T00:24:06.855558+0000","last_peered":"2023-08-22T00:24:06.855558+0000","last_clean":"2023-08-22T00:24:06.855558+0000","last_became_active":"2023-08-22T00:24:06.853066+0000","last_became_peered":"2023-08-22T00:24:06.853066+0000","last_unstale":"2023-08-22T00:24:06.855558+0000","last_undegraded":"2023-08-22T00:24:06.855558+0000","last_fullsized":"2023-08-22T00:24:06.855558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841304+0000","last_change":"2023-08-22T00:24:06.482010+0000","last_active":"2023-08-22T00:24:06.841304+0000","last_peered":"2023-08-22T00:24:06.841304+0000","last_clean":"2023-08-22T00:24:06.841304+0000","last_became_active":"2023-08-22T00:24:06.481674+0000","last_became_peered":"2023-08-22T00:24:06.481674+0000","last_unstale":"2023-08-22T00:24:06.841304+0000","last_undegraded":"2023-08-22T00:24:06.841304+0000","last_fullsized":"2023-08-22T00:24:06.841304+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865106+0000","last_change":"2023-08-22T00:24:06.861266+0000","last_active":"2023-08-22T00:24:06.865106+0000","last_peered":"2023-08-22T00:24:06.865106+0000","last_clean":"2023-08-22T00:24:06.865106+0000","last_became_active":"2023-08-22T00:24:06.860832+0000","last_became_peered":"2023-08-22T00:24:06.860832+0000","last_unstale":"2023-08-22T00:24:06.865106+0000","last_undegraded":"2023-08-22T00:24:06.865106+0000","last_fullsized":"2023-08-22T00:24:06.865106+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.848350+0000","last_change":"2023-08-22T00:24:06.485268+0000","last_active":"2023-08-22T00:24:06.848350+0000","last_peered":"2023-08-22T00:24:06.848350+0000","last_clean":"2023-08-22T00:24:06.848350+0000","last_became_active":"2023-08-22T00:24:06.484428+0000","last_became_peered":"2023-08-22T00:24:06.484428+0000","last_unstale":"2023-08-22T00:24:06.848350+0000","last_undegraded":"2023-08-22T00:24:06.848350+0000","last_fullsized":"2023-08-22T00:24:06.848350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.862952+0000","last_change":"2023-08-22T00:24:06.860576+0000","last_active":"2023-08-22T00:24:06.862952+0000","last_peered":"2023-08-22T00:24:06.862952+0000","last_clean":"2023-08-22T00:24:06.862952+0000","last_became_active":"2023-08-22T00:24:06.860272+0000","last_became_peered":"2023-08-22T00:24:06.860272+0000","last_unstale":"2023-08-22T00:24:06.862952+0000","last_undegraded":"2023-08-22T00:24:06.862952+0000","last_fullsized":"2023-08-22T00:24:06.862952+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.840422+0000","last_change":"2023-08-22T00:24:06.493905+0000","last_active":"2023-08-22T00:24:06.840422+0000","last_peered":"2023-08-22T00:24:06.840422+0000","last_clean":"2023-08-22T00:24:06.840422+0000","last_became_active":"2023-08-22T00:24:06.493604+0000","last_became_peered":"2023-08-22T00:24:06.493604+0000","last_unstale":"2023-08-22T00:24:06.840422+0000","last_undegraded":"2023-08-22T00:24:06.840422+0000","last_fullsized":"2023-08-22T00:24:06.840422+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868685+0000","last_change":"2023-08-22T00:24:06.856154+0000","last_active":"2023-08-22T00:24:06.868685+0000","last_peered":"2023-08-22T00:24:06.868685+0000","last_clean":"2023-08-22T00:24:06.868685+0000","last_became_active":"2023-08-22T00:24:06.855889+0000","last_became_peered":"2023-08-22T00:24:06.855889+0000","last_unstale":"2023-08-22T00:24:06.868685+0000","last_undegraded":"2023-08-22T00:24:06.868685+0000","last_fullsized":"2023-08-22T00:24:06.868685+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845350+0000","last_change":"2023-08-22T00:24:06.471390+0000","last_active":"2023-08-22T00:24:06.845350+0000","last_peered":"2023-08-22T00:24:06.845350+0000","last_clean":"2023-08-22T00:24:06.845350+0000","last_became_active":"2023-08-22T00:24:06.471117+0000","last_became_peered":"2023-08-22T00:24:06.471117+0000","last_unstale":"2023-08-22T00:24:06.845350+0000","last_undegraded":"2023-08-22T00:24:06.845350+0000","last_fullsized":"2023-08-22T00:24:06.845350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854241+0000","last_change":"2023-08-22T00:24:06.850674+0000","last_active":"2023-08-22T00:24:06.854241+0000","last_peered":"2023-08-22T00:24:06.854241+0000","last_clean":"2023-08-22T00:24:06.854241+0000","last_became_active":"2023-08-22T00:24:06.849978+0000","last_became_peered":"2023-08-22T00:24:06.849978+0000","last_unstale":"2023-08-22T00:24:06.854241+0000","last_undegraded":"2023-08-22T00:24:06.854241+0000","last_fullsized":"2023-08-22T00:24:06.854241+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843949+0000","last_change":"2023-08-22T00:24:06.482225+0000","last_active":"2023-08-22T00:24:06.843949+0000","last_peered":"2023-08-22T00:24:06.843949+0000","last_clean":"2023-08-22T00:24:06.843949+0000","last_became_active":"2023-08-22T00:24:06.481897+0000","last_became_peered":"2023-08-22T00:24:06.481897+0000","last_unstale":"2023-08-22T00:24:06.843949+0000","last_undegraded":"2023-08-22T00:24:06.843949+0000","last_fullsized":"2023-08-22T00:24:06.843949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869278+0000","last_change":"2023-08-22T00:24:06.866432+0000","last_active":"2023-08-22T00:24:06.869278+0000","last_peered":"2023-08-22T00:24:06.869278+0000","last_clean":"2023-08-22T00:24:06.869278+0000","last_became_active":"2023-08-22T00:24:06.866170+0000","last_became_peered":"2023-08-22T00:24:06.866170+0000","last_unstale":"2023-08-22T00:24:06.869278+0000","last_undegraded":"2023-08-22T00:24:06.869278+0000","last_fullsized":"2023-08-22T00:24:06.869278+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849247+0000","last_change":"2023-08-22T00:24:06.479663+0000","last_active":"2023-08-22T00:24:06.849247+0000","last_peered":"2023-08-22T00:24:06.849247+0000","last_clean":"2023-08-22T00:24:06.849247+0000","last_became_active":"2023-08-22T00:24:06.479374+0000","last_became_peered":"2023-08-22T00:24:06.479374+0000","last_unstale":"2023-08-22T00:24:06.849247+0000","last_undegraded":"2023-08-22T00:24:06.849247+0000","last_fullsized":"2023-08-22T00:24:06.849247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869615+0000","last_change":"2023-08-22T00:24:06.858021+0000","last_active":"2023-08-22T00:24:06.869615+0000","last_peered":"2023-08-22T00:24:06.869615+0000","last_clean":"2023-08-22T00:24:06.869615+0000","last_became_active":"2023-08-22T00:24:06.857750+0000","last_became_peered":"2023-08-22T00:24:06.857750+0000","last_unstale":"2023-08-22T00:24:06.869615+0000","last_undegraded":"2023-08-22T00:24:06.869615+0000","last_fullsized":"2023-08-22T00:24:06.869615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841592+0000","last_change":"2023-08-22T00:24:06.480391+0000","last_active":"2023-08-22T00:24:06.841592+0000","last_peered":"2023-08-22T00:24:06.841592+0000","last_clean":"2023-08-22T00:24:06.841592+0000","last_became_active":"2023-08-22T00:24:06.480121+0000","last_became_peered":"2023-08-22T00:24:06.480121+0000","last_unstale":"2023-08-22T00:24:06.841592+0000","last_undegraded":"2023-08-22T00:24:06.841592+0000","last_fullsized":"2023-08-22T00:24:06.841592+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864411+0000","last_change":"2023-08-22T00:24:06.861148+0000","last_active":"2023-08-22T00:24:06.864411+0000","last_peered":"2023-08-22T00:24:06.864411+0000","last_clean":"2023-08-22T00:24:06.864411+0000","last_became_active":"2023-08-22T00:24:06.860796+0000","last_became_peered":"2023-08-22T00:24:06.860796+0000","last_unstale":"2023-08-22T00:24:06.864411+0000","last_undegraded":"2023-08-22T00:24:06.864411+0000","last_fullsized":"2023-08-22T00:24:06.864411+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844514+0000","last_change":"2023-08-22T00:24:06.472957+0000","last_active":"2023-08-22T00:24:06.844514+0000","last_peered":"2023-08-22T00:24:06.844514+0000","last_clean":"2023-08-22T00:24:06.844514+0000","last_became_active":"2023-08-22T00:24:06.472684+0000","last_became_peered":"2023-08-22T00:24:06.472684+0000","last_unstale":"2023-08-22T00:24:06.844514+0000","last_undegraded":"2023-08-22T00:24:06.844514+0000","last_fullsized":"2023-08-22T00:24:06.844514+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864649+0000","last_change":"2023-08-22T00:24:06.863023+0000","last_active":"2023-08-22T00:24:06.864649+0000","last_peered":"2023-08-22T00:24:06.864649+0000","last_clean":"2023-08-22T00:24:06.864649+0000","last_became_active":"2023-08-22T00:24:06.862540+0000","last_became_peered":"2023-08-22T00:24:06.862540+0000","last_unstale":"2023-08-22T00:24:06.864649+0000","last_undegraded":"2023-08-22T00:24:06.864649+0000","last_fullsized":"2023-08-22T00:24:06.864649+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845293+0000","last_change":"2023-08-22T00:24:06.472286+0000","last_active":"2023-08-22T00:24:06.845293+0000","last_peered":"2023-08-22T00:24:06.845293+0000","last_clean":"2023-08-22T00:24:06.845293+0000","last_became_active":"2023-08-22T00:24:06.472021+0000","last_became_peered":"2023-08-22T00:24:06.472021+0000","last_unstale":"2023-08-22T00:24:06.845293+0000","last_undegraded":"2023-08-22T00:24:06.845293+0000","last_fullsized":"2023-08-22T00:24:06.845293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.866711+0000","last_change":"2023-08-22T00:24:06.851116+0000","last_active":"2023-08-22T00:24:06.866711+0000","last_peered":"2023-08-22T00:24:06.866711+0000","last_clean":"2023-08-22T00:24:06.866711+0000","last_became_active":"2023-08-22T00:24:06.850865+0000","last_became_peered":"2023-08-22T00:24:06.850865+0000","last_unstale":"2023-08-22T00:24:06.866711+0000","last_undegraded":"2023-08-22T00:24:06.866711+0000","last_fullsized":"2023-08-22T00:24:06.866711+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841730+0000","last_change":"2023-08-22T00:24:06.486949+0000","last_active":"2023-08-22T00:24:06.841730+0000","last_peered":"2023-08-22T00:24:06.841730+0000","last_clean":"2023-08-22T00:24:06.841730+0000","last_became_active":"2023-08-22T00:24:06.486733+0000","last_became_peered":"2023-08-22T00:24:06.486733+0000","last_unstale":"2023-08-22T00:24:06.841730+0000","last_undegraded":"2023-08-22T00:24:06.841730+0000","last_fullsized":"2023-08-22T00:24:06.841730+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868806+0000","last_change":"2023-08-22T00:24:06.856392+0000","last_active":"2023-08-22T00:24:06.868806+0000","last_peered":"2023-08-22T00:24:06.868806+0000","last_clean":"2023-08-22T00:24:06.868806+0000","last_became_active":"2023-08-22T00:24:06.856201+0000","last_became_peered":"2023-08-22T00:24:06.856201+0000","last_unstale":"2023-08-22T00:24:06.868806+0000","last_undegraded":"2023-08-22T00:24:06.868806+0000","last_fullsized":"2023-08-22T00:24:06.868806+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843857+0000","last_change":"2023-08-22T00:24:06.474553+0000","last_active":"2023-08-22T00:24:06.843857+0000","last_peered":"2023-08-22T00:24:06.843857+0000","last_clean":"2023-08-22T00:24:06.843857+0000","last_became_active":"2023-08-22T00:24:06.471954+0000","last_became_peered":"2023-08-22T00:24:06.471954+0000","last_unstale":"2023-08-22T00:24:06.843857+0000","last_undegraded":"2023-08-22T00:24:06.843857+0000","last_fullsized":"2023-08-22T00:24:06.843857+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869636+0000","last_change":"2023-08-22T00:24:06.859380+0000","last_active":"2023-08-22T00:24:06.869636+0000","last_peered":"2023-08-22T00:24:06.869636+0000","last_clean":"2023-08-22T00:24:06.869636+0000","last_became_active":"2023-08-22T00:24:06.859126+0000","last_became_peered":"2023-08-22T00:24:06.859126+0000","last_unstale":"2023-08-22T00:24:06.869636+0000","last_undegraded":"2023-08-22T00:24:06.869636+0000","last_fullsized":"2023-08-22T00:24:06.869636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859615+0000","last_change":"2023-08-22T00:24:06.479741+0000","last_active":"2023-08-22T00:24:06.859615+0000","last_peered":"2023-08-22T00:24:06.859615+0000","last_clean":"2023-08-22T00:24:06.859615+0000","last_became_active":"2023-08-22T00:24:06.479340+0000","last_became_peered":"2023-08-22T00:24:06.479340+0000","last_unstale":"2023-08-22T00:24:06.859615+0000","last_undegraded":"2023-08-22T00:24:06.859615+0000","last_fullsized":"2023-08-22T00:24:06.859615+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.861715+0000","last_change":"2023-08-22T00:24:06.860430+0000","last_active":"2023-08-22T00:24:06.861715+0000","last_peered":"2023-08-22T00:24:06.861715+0000","last_clean":"2023-08-22T00:24:06.861715+0000","last_became_active":"2023-08-22T00:24:06.860168+0000","last_became_peered":"2023-08-22T00:24:06.860168+0000","last_unstale":"2023-08-22T00:24:06.861715+0000","last_undegraded":"2023-08-22T00:24:06.861715+0000","last_fullsized":"2023-08-22T00:24:06.861715+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.858823+0000","last_change":"2023-08-22T00:24:06.475014+0000","last_active":"2023-08-22T00:24:06.858823+0000","last_peered":"2023-08-22T00:24:06.858823+0000","last_clean":"2023-08-22T00:24:06.858823+0000","last_became_active":"2023-08-22T00:24:06.474710+0000","last_became_peered":"2023-08-22T00:24:06.474710+0000","last_unstale":"2023-08-22T00:24:06.858823+0000","last_undegraded":"2023-08-22T00:24:06.858823+0000","last_fullsized":"2023-08-22T00:24:06.858823+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869756+0000","last_change":"2023-08-22T00:24:06.860134+0000","last_active":"2023-08-22T00:24:06.869756+0000","last_peered":"2023-08-22T00:24:06.869756+0000","last_clean":"2023-08-22T00:24:06.869756+0000","last_became_active":"2023-08-22T00:24:06.859878+0000","last_became_peered":"2023-08-22T00:24:06.859878+0000","last_unstale":"2023-08-22T00:24:06.869756+0000","last_undegraded":"2023-08-22T00:24:06.869756+0000","last_fullsized":"2023-08-22T00:24:06.869756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863643+0000","last_change":"2023-08-22T00:24:06.480712+0000","last_active":"2023-08-22T00:24:06.863643+0000","last_peered":"2023-08-22T00:24:06.863643+0000","last_clean":"2023-08-22T00:24:06.863643+0000","last_became_active":"2023-08-22T00:24:06.480415+0000","last_became_peered":"2023-08-22T00:24:06.480415+0000","last_unstale":"2023-08-22T00:24:06.863643+0000","last_undegraded":"2023-08-22T00:24:06.863643+0000","last_fullsized":"2023-08-22T00:24:06.863643+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867238+0000","last_change":"2023-08-22T00:24:06.865978+0000","last_active":"2023-08-22T00:24:06.867238+0000","last_peered":"2023-08-22T00:24:06.867238+0000","last_clean":"2023-08-22T00:24:06.867238+0000","last_became_active":"2023-08-22T00:24:06.865696+0000","last_became_peered":"2023-08-22T00:24:06.865696+0000","last_unstale":"2023-08-22T00:24:06.867238+0000","last_undegraded":"2023-08-22T00:24:06.867238+0000","last_fullsized":"2023-08-22T00:24:06.867238+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843520+0000","last_change":"2023-08-22T00:24:06.486332+0000","last_active":"2023-08-22T00:24:06.843520+0000","last_peered":"2023-08-22T00:24:06.843520+0000","last_clean":"2023-08-22T00:24:06.843520+0000","last_became_active":"2023-08-22T00:24:06.486078+0000","last_became_peered":"2023-08-22T00:24:06.486078+0000","last_unstale":"2023-08-22T00:24:06.843520+0000","last_undegraded":"2023-08-22T00:24:06.843520+0000","last_fullsized":"2023-08-22T00:24:06.843520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869412+0000","last_change":"2023-08-22T00:24:06.862044+0000","last_active":"2023-08-22T00:24:06.869412+0000","last_peered":"2023-08-22T00:24:06.869412+0000","last_clean":"2023-08-22T00:24:06.869412+0000","last_became_active":"2023-08-22T00:24:06.861771+0000","last_became_peered":"2023-08-22T00:24:06.861771+0000","last_unstale":"2023-08-22T00:24:06.869412+0000","last_undegraded":"2023-08-22T00:24:06.869412+0000","last_fullsized":"2023-08-22T00:24:06.869412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849354+0000","last_change":"2023-08-22T00:24:06.482927+0000","last_active":"2023-08-22T00:24:06.849354+0000","last_peered":"2023-08-22T00:24:06.849354+0000","last_clean":"2023-08-22T00:24:06.849354+0000","last_became_active":"2023-08-22T00:24:06.482675+0000","last_became_peered":"2023-08-22T00:24:06.482675+0000","last_unstale":"2023-08-22T00:24:06.849354+0000","last_undegraded":"2023-08-22T00:24:06.849354+0000","last_fullsized":"2023-08-22T00:24:06.849354+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854246+0000","last_change":"2023-08-22T00:24:06.850715+0000","last_active":"2023-08-22T00:24:06.854246+0000","last_peered":"2023-08-22T00:24:06.854246+0000","last_clean":"2023-08-22T00:24:06.854246+0000","last_became_active":"2023-08-22T00:24:06.850448+0000","last_became_peered":"2023-08-22T00:24:06.850448+0000","last_unstale":"2023-08-22T00:24:06.854246+0000","last_undegraded":"2023-08-22T00:24:06.854246+0000","last_fullsized":"2023-08-22T00:24:06.854246+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.852109+0000","last_change":"2023-08-22T00:24:06.481833+0000","last_active":"2023-08-22T00:24:06.852109+0000","last_peered":"2023-08-22T00:24:06.852109+0000","last_clean":"2023-08-22T00:24:06.852109+0000","last_became_active":"2023-08-22T00:24:06.481558+0000","last_became_peered":"2023-08-22T00:24:06.481558+0000","last_unstale":"2023-08-22T00:24:06.852109+0000","last_undegraded":"2023-08-22T00:24:06.852109+0000","last_fullsized":"2023-08-22T00:24:06.852109+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868650+0000","last_change":"2023-08-22T00:24:06.855616+0000","last_active":"2023-08-22T00:24:06.868650+0000","last_peered":"2023-08-22T00:24:06.868650+0000","last_clean":"2023-08-22T00:24:06.868650+0000","last_became_active":"2023-08-22T00:24:06.853721+0000","last_became_peered":"2023-08-22T00:24:06.853721+0000","last_unstale":"2023-08-22T00:24:06.868650+0000","last_undegraded":"2023-08-22T00:24:06.868650+0000","last_fullsized":"2023-08-22T00:24:06.868650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841564+0000","last_change":"2023-08-22T00:24:06.468064+0000","last_active":"2023-08-22T00:24:06.841564+0000","last_peered":"2023-08-22T00:24:06.841564+0000","last_clean":"2023-08-22T00:24:06.841564+0000","last_became_active":"2023-08-22T00:24:06.467779+0000","last_became_peered":"2023-08-22T00:24:06.467779+0000","last_unstale":"2023-08-22T00:24:06.841564+0000","last_undegraded":"2023-08-22T00:24:06.841564+0000","last_fullsized":"2023-08-22T00:24:06.841564+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854491+0000","last_change":"2023-08-22T00:24:06.851810+0000","last_active":"2023-08-22T00:24:06.854491+0000","last_peered":"2023-08-22T00:24:06.854491+0000","last_clean":"2023-08-22T00:24:06.854491+0000","last_became_active":"2023-08-22T00:24:06.851472+0000","last_became_peered":"2023-08-22T00:24:06.851472+0000","last_unstale":"2023-08-22T00:24:06.854491+0000","last_undegraded":"2023-08-22T00:24:06.854491+0000","last_fullsized":"2023-08-22T00:24:06.854491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843833+0000","last_change":"2023-08-22T00:24:06.486439+0000","last_active":"2023-08-22T00:24:06.843833+0000","last_peered":"2023-08-22T00:24:06.843833+0000","last_clean":"2023-08-22T00:24:06.843833+0000","last_became_active":"2023-08-22T00:24:06.485786+0000","last_became_peered":"2023-08-22T00:24:06.485786+0000","last_unstale":"2023-08-22T00:24:06.843833+0000","last_undegraded":"2023-08-22T00:24:06.843833+0000","last_fullsized":"2023-08-22T00:24:06.843833+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865390+0000","last_change":"2023-08-22T00:24:06.862917+0000","last_active":"2023-08-22T00:24:06.865390+0000","last_peered":"2023-08-22T00:24:06.865390+0000","last_clean":"2023-08-22T00:24:06.865390+0000","last_became_active":"2023-08-22T00:24:06.862648+0000","last_became_peered":"2023-08-22T00:24:06.862648+0000","last_unstale":"2023-08-22T00:24:06.865390+0000","last_undegraded":"2023-08-22T00:24:06.865390+0000","last_fullsized":"2023-08-22T00:24:06.865390+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870504+0000","last_change":"2023-08-22T00:24:06.493815+0000","last_active":"2023-08-22T00:24:06.870504+0000","last_peered":"2023-08-22T00:24:06.870504+0000","last_clean":"2023-08-22T00:24:06.870504+0000","last_became_active":"2023-08-22T00:24:06.493554+0000","last_became_peered":"2023-08-22T00:24:06.493554+0000","last_unstale":"2023-08-22T00:24:06.870504+0000","last_undegraded":"2023-08-22T00:24:06.870504+0000","last_fullsized":"2023-08-22T00:24:06.870504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869627+0000","last_change":"2023-08-22T00:24:06.857988+0000","last_active":"2023-08-22T00:24:06.869627+0000","last_peered":"2023-08-22T00:24:06.869627+0000","last_clean":"2023-08-22T00:24:06.869627+0000","last_became_active":"2023-08-22T00:24:06.857702+0000","last_became_peered":"2023-08-22T00:24:06.857702+0000","last_unstale":"2023-08-22T00:24:06.869627+0000","last_undegraded":"2023-08-22T00:24:06.869627+0000","last_fullsized":"2023-08-22T00:24:06.869627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865339+0000","last_change":"2023-08-22T00:24:06.472158+0000","last_active":"2023-08-22T00:24:06.865339+0000","last_peered":"2023-08-22T00:24:06.865339+0000","last_clean":"2023-08-22T00:24:06.865339+0000","last_became_active":"2023-08-22T00:24:06.471841+0000","last_became_peered":"2023-08-22T00:24:06.471841+0000","last_unstale":"2023-08-22T00:24:06.865339+0000","last_undegraded":"2023-08-22T00:24:06.865339+0000","last_fullsized":"2023-08-22T00:24:06.865339+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864432+0000","last_change":"2023-08-22T00:24:06.859315+0000","last_active":"2023-08-22T00:24:06.864432+0000","last_peered":"2023-08-22T00:24:06.864432+0000","last_clean":"2023-08-22T00:24:06.864432+0000","last_became_active":"2023-08-22T00:24:06.859031+0000","last_became_peered":"2023-08-22T00:24:06.859031+0000","last_unstale":"2023-08-22T00:24:06.864432+0000","last_undegraded":"2023-08-22T00:24:06.864432+0000","last_fullsized":"2023-08-22T00:24:06.864432+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842429+0000","last_change":"2023-08-22T00:24:06.484141+0000","last_active":"2023-08-22T00:24:06.842429+0000","last_peered":"2023-08-22T00:24:06.842429+0000","last_clean":"2023-08-22T00:24:06.842429+0000","last_became_active":"2023-08-22T00:24:06.483882+0000","last_became_peered":"2023-08-22T00:24:06.483882+0000","last_unstale":"2023-08-22T00:24:06.842429+0000","last_undegraded":"2023-08-22T00:24:06.842429+0000","last_fullsized":"2023-08-22T00:24:06.842429+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864548+0000","last_change":"2023-08-22T00:24:06.862325+0000","last_active":"2023-08-22T00:24:06.864548+0000","last_peered":"2023-08-22T00:24:06.864548+0000","last_clean":"2023-08-22T00:24:06.864548+0000","last_became_active":"2023-08-22T00:24:06.861996+0000","last_became_peered":"2023-08-22T00:24:06.861996+0000","last_unstale":"2023-08-22T00:24:06.864548+0000","last_undegraded":"2023-08-22T00:24:06.864548+0000","last_fullsized":"2023-08-22T00:24:06.864548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849248+0000","last_change":"2023-08-22T00:24:06.485152+0000","last_active":"2023-08-22T00:24:06.849248+0000","last_peered":"2023-08-22T00:24:06.849248+0000","last_clean":"2023-08-22T00:24:06.849248+0000","last_became_active":"2023-08-22T00:24:06.484759+0000","last_became_peered":"2023-08-22T00:24:06.484759+0000","last_unstale":"2023-08-22T00:24:06.849248+0000","last_undegraded":"2023-08-22T00:24:06.849248+0000","last_fullsized":"2023-08-22T00:24:06.849248+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864403+0000","last_change":"2023-08-22T00:24:06.859284+0000","last_active":"2023-08-22T00:24:06.864403+0000","last_peered":"2023-08-22T00:24:06.864403+0000","last_clean":"2023-08-22T00:24:06.864403+0000","last_became_active":"2023-08-22T00:24:06.858975+0000","last_became_peered":"2023-08-22T00:24:06.858975+0000","last_unstale":"2023-08-22T00:24:06.864403+0000","last_undegraded":"2023-08-22T00:24:06.864403+0000","last_fullsized":"2023-08-22T00:24:06.864403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864560+0000","last_change":"2023-08-22T00:24:06.480100+0000","last_active":"2023-08-22T00:24:06.864560+0000","last_peered":"2023-08-22T00:24:06.864560+0000","last_clean":"2023-08-22T00:24:06.864560+0000","last_became_active":"2023-08-22T00:24:06.479781+0000","last_became_peered":"2023-08-22T00:24:06.479781+0000","last_unstale":"2023-08-22T00:24:06.864560+0000","last_undegraded":"2023-08-22T00:24:06.864560+0000","last_fullsized":"2023-08-22T00:24:06.864560+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869509+0000","last_change":"2023-08-22T00:24:06.862669+0000","last_active":"2023-08-22T00:24:06.869509+0000","last_peered":"2023-08-22T00:24:06.869509+0000","last_clean":"2023-08-22T00:24:06.869509+0000","last_became_active":"2023-08-22T00:24:06.862424+0000","last_became_peered":"2023-08-22T00:24:06.862424+0000","last_unstale":"2023-08-22T00:24:06.869509+0000","last_undegraded":"2023-08-22T00:24:06.869509+0000","last_fullsized":"2023-08-22T00:24:06.869509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843189+0000","last_change":"2023-08-22T00:24:06.485497+0000","last_active":"2023-08-22T00:24:06.843189+0000","last_peered":"2023-08-22T00:24:06.843189+0000","last_clean":"2023-08-22T00:24:06.843189+0000","last_became_active":"2023-08-22T00:24:06.485017+0000","last_became_peered":"2023-08-22T00:24:06.485017+0000","last_unstale":"2023-08-22T00:24:06.843189+0000","last_undegraded":"2023-08-22T00:24:06.843189+0000","last_fullsized":"2023-08-22T00:24:06.843189+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867289+0000","last_change":"2023-08-22T00:24:06.866097+0000","last_active":"2023-08-22T00:24:06.867289+0000","last_peered":"2023-08-22T00:24:06.867289+0000","last_clean":"2023-08-22T00:24:06.867289+0000","last_became_active":"2023-08-22T00:24:06.865820+0000","last_became_peered":"2023-08-22T00:24:06.865820+0000","last_unstale":"2023-08-22T00:24:06.867289+0000","last_undegraded":"2023-08-22T00:24:06.867289+0000","last_fullsized":"2023-08-22T00:24:06.867289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.840527+0000","last_change":"2023-08-22T00:24:06.484393+0000","last_active":"2023-08-22T00:24:06.840527+0000","last_peered":"2023-08-22T00:24:06.840527+0000","last_clean":"2023-08-22T00:24:06.840527+0000","last_became_active":"2023-08-22T00:24:06.482446+0000","last_became_peered":"2023-08-22T00:24:06.482446+0000","last_unstale":"2023-08-22T00:24:06.840527+0000","last_undegraded":"2023-08-22T00:24:06.840527+0000","last_fullsized":"2023-08-22T00:24:06.840527+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.860143+0000","last_change":"2023-08-22T00:24:06.857850+0000","last_active":"2023-08-22T00:24:06.860143+0000","last_peered":"2023-08-22T00:24:06.860143+0000","last_clean":"2023-08-22T00:24:06.860143+0000","last_became_active":"2023-08-22T00:24:06.857117+0000","last_became_peered":"2023-08-22T00:24:06.857117+0000","last_unstale":"2023-08-22T00:24:06.860143+0000","last_undegraded":"2023-08-22T00:24:06.860143+0000","last_fullsized":"2023-08-22T00:24:06.860143+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843727+0000","last_change":"2023-08-22T00:24:06.486566+0000","last_active":"2023-08-22T00:24:06.843727+0000","last_peered":"2023-08-22T00:24:06.843727+0000","last_clean":"2023-08-22T00:24:06.843727+0000","last_became_active":"2023-08-22T00:24:06.486164+0000","last_became_peered":"2023-08-22T00:24:06.486164+0000","last_unstale":"2023-08-22T00:24:06.843727+0000","last_undegraded":"2023-08-22T00:24:06.843727+0000","last_fullsized":"2023-08-22T00:24:06.843727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867135+0000","last_change":"2023-08-22T00:24:06.866006+0000","last_active":"2023-08-22T00:24:06.867135+0000","last_peered":"2023-08-22T00:24:06.867135+0000","last_clean":"2023-08-22T00:24:06.867135+0000","last_became_active":"2023-08-22T00:24:06.865713+0000","last_became_peered":"2023-08-22T00:24:06.865713+0000","last_unstale":"2023-08-22T00:24:06.867135+0000","last_undegraded":"2023-08-22T00:24:06.867135+0000","last_fullsized":"2023-08-22T00:24:06.867135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.858278+0000","last_change":"2023-08-22T00:24:06.483958+0000","last_active":"2023-08-22T00:24:06.858278+0000","last_peered":"2023-08-22T00:24:06.858278+0000","last_clean":"2023-08-22T00:24:06.858278+0000","last_became_active":"2023-08-22T00:24:06.483697+0000","last_became_peered":"2023-08-22T00:24:06.483697+0000","last_unstale":"2023-08-22T00:24:06.858278+0000","last_undegraded":"2023-08-22T00:24:06.858278+0000","last_fullsized":"2023-08-22T00:24:06.858278+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869094+0000","last_change":"2023-08-22T00:24:06.857243+0000","last_active":"2023-08-22T00:24:06.869094+0000","last_peered":"2023-08-22T00:24:06.869094+0000","last_clean":"2023-08-22T00:24:06.869094+0000","last_became_active":"2023-08-22T00:24:06.856998+0000","last_became_peered":"2023-08-22T00:24:06.856998+0000","last_unstale":"2023-08-22T00:24:06.869094+0000","last_undegraded":"2023-08-22T00:24:06.869094+0000","last_fullsized":"2023-08-22T00:24:06.869094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.842995+0000","last_change":"2023-08-22T00:24:06.481426+0000","last_active":"2023-08-22T00:24:06.842995+0000","last_peered":"2023-08-22T00:24:06.842995+0000","last_clean":"2023-08-22T00:24:06.842995+0000","last_became_active":"2023-08-22T00:24:06.481111+0000","last_became_peered":"2023-08-22T00:24:06.481111+0000","last_unstale":"2023-08-22T00:24:06.842995+0000","last_undegraded":"2023-08-22T00:24:06.842995+0000","last_fullsized":"2023-08-22T00:24:06.842995+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865131+0000","last_change":"2023-08-22T00:24:06.854326+0000","last_active":"2023-08-22T00:24:06.865131+0000","last_peered":"2023-08-22T00:24:06.865131+0000","last_clean":"2023-08-22T00:24:06.865131+0000","last_became_active":"2023-08-22T00:24:06.854086+0000","last_became_peered":"2023-08-22T00:24:06.854086+0000","last_unstale":"2023-08-22T00:24:06.865131+0000","last_undegraded":"2023-08-22T00:24:06.865131+0000","last_fullsized":"2023-08-22T00:24:06.865131+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849231+0000","last_change":"2023-08-22T00:24:06.482596+0000","last_active":"2023-08-22T00:24:06.849231+0000","last_peered":"2023-08-22T00:24:06.849231+0000","last_clean":"2023-08-22T00:24:06.849231+0000","last_became_active":"2023-08-22T00:24:06.482033+0000","last_became_peered":"2023-08-22T00:24:06.482033+0000","last_unstale":"2023-08-22T00:24:06.849231+0000","last_undegraded":"2023-08-22T00:24:06.849231+0000","last_fullsized":"2023-08-22T00:24:06.849231+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868727+0000","last_change":"2023-08-22T00:24:06.868327+0000","last_active":"2023-08-22T00:24:06.868727+0000","last_peered":"2023-08-22T00:24:06.868727+0000","last_clean":"2023-08-22T00:24:06.868727+0000","last_became_active":"2023-08-22T00:24:06.868079+0000","last_became_peered":"2023-08-22T00:24:06.868079+0000","last_unstale":"2023-08-22T00:24:06.868727+0000","last_undegraded":"2023-08-22T00:24:06.868727+0000","last_fullsized":"2023-08-22T00:24:06.868727+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.850792+0000","last_change":"2023-08-22T00:24:06.486568+0000","last_active":"2023-08-22T00:24:06.850792+0000","last_peered":"2023-08-22T00:24:06.850792+0000","last_clean":"2023-08-22T00:24:06.850792+0000","last_became_active":"2023-08-22T00:24:06.486279+0000","last_became_peered":"2023-08-22T00:24:06.486279+0000","last_unstale":"2023-08-22T00:24:06.850792+0000","last_undegraded":"2023-08-22T00:24:06.850792+0000","last_fullsized":"2023-08-22T00:24:06.850792+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.855721+0000","last_change":"2023-08-22T00:24:06.853381+0000","last_active":"2023-08-22T00:24:06.855721+0000","last_peered":"2023-08-22T00:24:06.855721+0000","last_clean":"2023-08-22T00:24:06.855721+0000","last_became_active":"2023-08-22T00:24:06.853097+0000","last_became_peered":"2023-08-22T00:24:06.853097+0000","last_unstale":"2023-08-22T00:24:06.855721+0000","last_undegraded":"2023-08-22T00:24:06.855721+0000","last_fullsized":"2023-08-22T00:24:06.855721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849441+0000","last_change":"2023-08-22T00:24:06.477629+0000","last_active":"2023-08-22T00:24:06.849441+0000","last_peered":"2023-08-22T00:24:06.849441+0000","last_clean":"2023-08-22T00:24:06.849441+0000","last_became_active":"2023-08-22T00:24:06.476807+0000","last_became_peered":"2023-08-22T00:24:06.476807+0000","last_unstale":"2023-08-22T00:24:06.849441+0000","last_undegraded":"2023-08-22T00:24:06.849441+0000","last_fullsized":"2023-08-22T00:24:06.849441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864688+0000","last_change":"2023-08-22T00:24:06.863661+0000","last_active":"2023-08-22T00:24:06.864688+0000","last_peered":"2023-08-22T00:24:06.864688+0000","last_clean":"2023-08-22T00:24:06.864688+0000","last_became_active":"2023-08-22T00:24:06.863357+0000","last_became_peered":"2023-08-22T00:24:06.863357+0000","last_unstale":"2023-08-22T00:24:06.864688+0000","last_undegraded":"2023-08-22T00:24:06.864688+0000","last_fullsized":"2023-08-22T00:24:06.864688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845395+0000","last_change":"2023-08-22T00:24:06.483009+0000","last_active":"2023-08-22T00:24:06.845395+0000","last_peered":"2023-08-22T00:24:06.845395+0000","last_clean":"2023-08-22T00:24:06.845395+0000","last_became_active":"2023-08-22T00:24:06.482744+0000","last_became_peered":"2023-08-22T00:24:06.482744+0000","last_unstale":"2023-08-22T00:24:06.845395+0000","last_undegraded":"2023-08-22T00:24:06.845395+0000","last_fullsized":"2023-08-22T00:24:06.845395+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.864516+0000","last_change":"2023-08-22T00:24:06.859860+0000","last_active":"2023-08-22T00:24:06.864516+0000","last_peered":"2023-08-22T00:24:06.864516+0000","last_clean":"2023-08-22T00:24:06.864516+0000","last_became_active":"2023-08-22T00:24:06.859564+0000","last_became_peered":"2023-08-22T00:24:06.859564+0000","last_unstale":"2023-08-22T00:24:06.864516+0000","last_undegraded":"2023-08-22T00:24:06.864516+0000","last_fullsized":"2023-08-22T00:24:06.864516+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844221+0000","last_change":"2023-08-22T00:24:06.491746+0000","last_active":"2023-08-22T00:24:06.844221+0000","last_peered":"2023-08-22T00:24:06.844221+0000","last_clean":"2023-08-22T00:24:06.844221+0000","last_became_active":"2023-08-22T00:24:06.491484+0000","last_became_peered":"2023-08-22T00:24:06.491484+0000","last_unstale":"2023-08-22T00:24:06.844221+0000","last_undegraded":"2023-08-22T00:24:06.844221+0000","last_fullsized":"2023-08-22T00:24:06.844221+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.868785+0000","last_change":"2023-08-22T00:24:06.856037+0000","last_active":"2023-08-22T00:24:06.868785+0000","last_peered":"2023-08-22T00:24:06.868785+0000","last_clean":"2023-08-22T00:24:06.868785+0000","last_became_active":"2023-08-22T00:24:06.855805+0000","last_became_peered":"2023-08-22T00:24:06.855805+0000","last_unstale":"2023-08-22T00:24:06.868785+0000","last_undegraded":"2023-08-22T00:24:06.868785+0000","last_fullsized":"2023-08-22T00:24:06.868785+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843920+0000","last_change":"2023-08-22T00:24:06.483498+0000","last_active":"2023-08-22T00:24:06.843920+0000","last_peered":"2023-08-22T00:24:06.843920+0000","last_clean":"2023-08-22T00:24:06.843920+0000","last_became_active":"2023-08-22T00:24:06.483222+0000","last_became_peered":"2023-08-22T00:24:06.483222+0000","last_unstale":"2023-08-22T00:24:06.843920+0000","last_undegraded":"2023-08-22T00:24:06.843920+0000","last_fullsized":"2023-08-22T00:24:06.843920+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870540+0000","last_change":"2023-08-22T00:24:06.870074+0000","last_active":"2023-08-22T00:24:06.870540+0000","last_peered":"2023-08-22T00:24:06.870540+0000","last_clean":"2023-08-22T00:24:06.870540+0000","last_became_active":"2023-08-22T00:24:06.869798+0000","last_became_peered":"2023-08-22T00:24:06.869798+0000","last_unstale":"2023-08-22T00:24:06.870540+0000","last_undegraded":"2023-08-22T00:24:06.870540+0000","last_fullsized":"2023-08-22T00:24:06.870540+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845758+0000","last_change":"2023-08-22T00:24:06.482192+0000","last_active":"2023-08-22T00:24:06.845758+0000","last_peered":"2023-08-22T00:24:06.845758+0000","last_clean":"2023-08-22T00:24:06.845758+0000","last_became_active":"2023-08-22T00:24:06.481888+0000","last_became_peered":"2023-08-22T00:24:06.481888+0000","last_unstale":"2023-08-22T00:24:06.845758+0000","last_undegraded":"2023-08-22T00:24:06.845758+0000","last_fullsized":"2023-08-22T00:24:06.845758+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841519+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:24:06.841519+0000","last_peered":"2023-08-22T00:24:06.841519+0000","last_clean":"2023-08-22T00:24:06.841519+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:24:06.841519+0000","last_undegraded":"2023-08-22T00:24:06.841519+0000","last_fullsized":"2023-08-22T00:24:06.841519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.860119+0000","last_change":"2023-08-22T00:24:06.854502+0000","last_active":"2023-08-22T00:24:06.860119+0000","last_peered":"2023-08-22T00:24:06.860119+0000","last_clean":"2023-08-22T00:24:06.860119+0000","last_became_active":"2023-08-22T00:24:06.854293+0000","last_became_peered":"2023-08-22T00:24:06.854293+0000","last_unstale":"2023-08-22T00:24:06.860119+0000","last_undegraded":"2023-08-22T00:24:06.860119+0000","last_fullsized":"2023-08-22T00:24:06.860119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863963+0000","last_change":"2023-08-22T00:24:06.479488+0000","last_active":"2023-08-22T00:24:06.863963+0000","last_peered":"2023-08-22T00:24:06.863963+0000","last_clean":"2023-08-22T00:24:06.863963+0000","last_became_active":"2023-08-22T00:24:06.479217+0000","last_became_peered":"2023-08-22T00:24:06.479217+0000","last_unstale":"2023-08-22T00:24:06.863963+0000","last_undegraded":"2023-08-22T00:24:06.863963+0000","last_fullsized":"2023-08-22T00:24:06.863963+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.846947+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:24:06.846947+0000","last_peered":"2023-08-22T00:24:06.846947+0000","last_clean":"2023-08-22T00:24:06.846947+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:24:06.846947+0000","last_undegraded":"2023-08-22T00:24:06.846947+0000","last_fullsized":"2023-08-22T00:24:06.846947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865527+0000","last_change":"2023-08-22T00:24:06.859557+0000","last_active":"2023-08-22T00:24:06.865527+0000","last_peered":"2023-08-22T00:24:06.865527+0000","last_clean":"2023-08-22T00:24:06.865527+0000","last_became_active":"2023-08-22T00:24:06.858911+0000","last_became_peered":"2023-08-22T00:24:06.858911+0000","last_unstale":"2023-08-22T00:24:06.865527+0000","last_undegraded":"2023-08-22T00:24:06.865527+0000","last_fullsized":"2023-08-22T00:24:06.865527+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849669+0000","last_change":"2023-08-22T00:24:06.481801+0000","last_active":"2023-08-22T00:24:06.849669+0000","last_peered":"2023-08-22T00:24:06.849669+0000","last_clean":"2023-08-22T00:24:06.849669+0000","last_became_active":"2023-08-22T00:24:06.481517+0000","last_became_peered":"2023-08-22T00:24:06.481517+0000","last_unstale":"2023-08-22T00:24:06.849669+0000","last_undegraded":"2023-08-22T00:24:06.849669+0000","last_fullsized":"2023-08-22T00:24:06.849669+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.844302+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:24:06.844302+0000","last_peered":"2023-08-22T00:24:06.844302+0000","last_clean":"2023-08-22T00:24:06.844302+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:24:06.844302+0000","last_undegraded":"2023-08-22T00:24:06.844302+0000","last_fullsized":"2023-08-22T00:24:06.844302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.865085+0000","last_change":"2023-08-22T00:24:06.861080+0000","last_active":"2023-08-22T00:24:06.865085+0000","last_peered":"2023-08-22T00:24:06.865085+0000","last_clean":"2023-08-22T00:24:06.865085+0000","last_became_active":"2023-08-22T00:24:06.860468+0000","last_became_peered":"2023-08-22T00:24:06.860468+0000","last_unstale":"2023-08-22T00:24:06.865085+0000","last_undegraded":"2023-08-22T00:24:06.865085+0000","last_fullsized":"2023-08-22T00:24:06.865085+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.845810+0000","last_change":"2023-08-22T00:24:06.495253+0000","last_active":"2023-08-22T00:24:06.845810+0000","last_peered":"2023-08-22T00:24:06.845810+0000","last_clean":"2023-08-22T00:24:06.845810+0000","last_became_active":"2023-08-22T00:24:06.494996+0000","last_became_peered":"2023-08-22T00:24:06.494996+0000","last_unstale":"2023-08-22T00:24:06.845810+0000","last_undegraded":"2023-08-22T00:24:06.845810+0000","last_fullsized":"2023-08-22T00:24:06.845810+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.849445+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:24:06.849445+0000","last_peered":"2023-08-22T00:24:06.849445+0000","last_clean":"2023-08-22T00:24:06.849445+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:24:06.849445+0000","last_undegraded":"2023-08-22T00:24:06.849445+0000","last_fullsized":"2023-08-22T00:24:06.849445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854916+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:24:06.854916+0000","last_peered":"2023-08-22T00:24:06.854916+0000","last_clean":"2023-08-22T00:24:06.854916+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:24:06.854916+0000","last_undegraded":"2023-08-22T00:24:06.854916+0000","last_fullsized":"2023-08-22T00:24:06.854916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869353+0000","last_change":"2023-08-22T00:24:06.865245+0000","last_active":"2023-08-22T00:24:06.869353+0000","last_peered":"2023-08-22T00:24:06.869353+0000","last_clean":"2023-08-22T00:24:06.869353+0000","last_became_active":"2023-08-22T00:24:06.865000+0000","last_became_peered":"2023-08-22T00:24:06.865000+0000","last_unstale":"2023-08-22T00:24:06.869353+0000","last_undegraded":"2023-08-22T00:24:06.869353+0000","last_fullsized":"2023-08-22T00:24:06.869353+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841795+0000","last_change":"2023-08-22T00:24:06.494201+0000","last_active":"2023-08-22T00:24:06.841795+0000","last_peered":"2023-08-22T00:24:06.841795+0000","last_clean":"2023-08-22T00:24:06.841795+0000","last_became_active":"2023-08-22T00:24:06.493966+0000","last_became_peered":"2023-08-22T00:24:06.493966+0000","last_unstale":"2023-08-22T00:24:06.841795+0000","last_undegraded":"2023-08-22T00:24:06.841795+0000","last_fullsized":"2023-08-22T00:24:06.841795+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.854836+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:24:06.854836+0000","last_peered":"2023-08-22T00:24:06.854836+0000","last_clean":"2023-08-22T00:24:06.854836+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:24:06.854836+0000","last_undegraded":"2023-08-22T00:24:06.854836+0000","last_fullsized":"2023-08-22T00:24:06.854836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.867119+0000","last_change":"2023-08-22T00:24:06.866180+0000","last_active":"2023-08-22T00:24:06.867119+0000","last_peered":"2023-08-22T00:24:06.867119+0000","last_clean":"2023-08-22T00:24:06.867119+0000","last_became_active":"2023-08-22T00:24:06.865887+0000","last_became_peered":"2023-08-22T00:24:06.865887+0000","last_unstale":"2023-08-22T00:24:06.867119+0000","last_undegraded":"2023-08-22T00:24:06.867119+0000","last_fullsized":"2023-08-22T00:24:06.867119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843400+0000","last_change":"2023-08-22T00:24:06.485586+0000","last_active":"2023-08-22T00:24:06.843400+0000","last_peered":"2023-08-22T00:24:06.843400+0000","last_clean":"2023-08-22T00:24:06.843400+0000","last_became_active":"2023-08-22T00:24:06.485052+0000","last_became_peered":"2023-08-22T00:24:06.485052+0000","last_unstale":"2023-08-22T00:24:06.843400+0000","last_undegraded":"2023-08-22T00:24:06.843400+0000","last_fullsized":"2023-08-22T00:24:06.843400+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.856189+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:24:06.856189+0000","last_peered":"2023-08-22T00:24:06.856189+0000","last_clean":"2023-08-22T00:24:06.856189+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:24:06.856189+0000","last_undegraded":"2023-08-22T00:24:06.856189+0000","last_fullsized":"2023-08-22T00:24:06.856189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.863430+0000","last_change":"2023-08-22T00:24:06.860075+0000","last_active":"2023-08-22T00:24:06.863430+0000","last_peered":"2023-08-22T00:24:06.863430+0000","last_clean":"2023-08-22T00:24:06.863430+0000","last_became_active":"2023-08-22T00:24:06.859814+0000","last_became_peered":"2023-08-22T00:24:06.859814+0000","last_unstale":"2023-08-22T00:24:06.863430+0000","last_undegraded":"2023-08-22T00:24:06.863430+0000","last_fullsized":"2023-08-22T00:24:06.863430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.869796+0000","last_change":"2023-08-22T00:24:06.484934+0000","last_active":"2023-08-22T00:24:06.869796+0000","last_peered":"2023-08-22T00:24:06.869796+0000","last_clean":"2023-08-22T00:24:06.869796+0000","last_became_active":"2023-08-22T00:24:06.484647+0000","last_became_peered":"2023-08-22T00:24:06.484647+0000","last_unstale":"2023-08-22T00:24:06.869796+0000","last_undegraded":"2023-08-22T00:24:06.869796+0000","last_fullsized":"2023-08-22T00:24:06.869796+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.841426+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:24:06.841426+0000","last_peered":"2023-08-22T00:24:06.841426+0000","last_clean":"2023-08-22T00:24:06.841426+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:24:06.841426+0000","last_undegraded":"2023-08-22T00:24:06.841426+0000","last_fullsized":"2023-08-22T00:24:06.841426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.859226+0000","last_change":"2023-08-22T00:24:06.857385+0000","last_active":"2023-08-22T00:24:06.859226+0000","last_peered":"2023-08-22T00:24:06.859226+0000","last_clean":"2023-08-22T00:24:06.859226+0000","last_became_active":"2023-08-22T00:24:06.857127+0000","last_became_peered":"2023-08-22T00:24:06.857127+0000","last_unstale":"2023-08-22T00:24:06.859226+0000","last_undegraded":"2023-08-22T00:24:06.859226+0000","last_fullsized":"2023-08-22T00:24:06.859226+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:06.453629+0000","last_clean_scrub_stamp":"2023-08-22T00:24:06.453629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.870630+0000","last_change":"2023-08-22T00:24:06.484588+0000","last_active":"2023-08-22T00:24:06.870630+0000","last_peered":"2023-08-22T00:24:06.870630+0000","last_clean":"2023-08-22T00:24:06.870630+0000","last_became_active":"2023-08-22T00:24:06.483947+0000","last_became_peered":"2023-08-22T00:24:06.483947+0000","last_unstale":"2023-08-22T00:24:06.870630+0000","last_undegraded":"2023-08-22T00:24:06.870630+0000","last_fullsized":"2023-08-22T00:24:06.870630+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:24:05.449447+0000","last_clean_scrub_stamp":"2023-08-22T00:24:05.449447+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-08-22T00:24:06.843849+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:24:06.843849+0000","last_peered":"2023-08-22T00:24:06.843849+0000","last_clean":"2023-08-22T00:24:06.843849+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:24:06.843849+0000","last_undegraded":"2023-08-22T00:24:06.843849+0000","last_fullsized":"2023-08-22T00:24:06.843849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":891887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.77500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.435,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.496},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.75,"15min":0.75},"last":0.628},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.308},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79100000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Aug 22 00:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575062,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":891923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.871},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.82699999999999996,"15min":0.82799999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.62}]},{"osd":5,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302844,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068996,"statfs":{"total":96636764160,"available":96326651904,"internally_reserved":0,"allocated":1691648,"data_stored":891977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.373,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":2.504,"15min":2.504},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.374},"min":{"1min":0.27700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.46800000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.29499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.36399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.53100000000000003,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.318},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40899999999999997,"15min":0.42699999999999999},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":0.52800000000000002,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.311},"max":{"1min":0.76400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.496},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.378},"max":{"1min":0.83699999999999997,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.505}]},{"osd":5,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82499999999999996,"5min":1.24,"15min":1.24},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.441,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.46400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":2.298,"15min":2.298},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":2.992,"15min":2.992},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":2.323,"15min":2.323},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302860,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068980,"statfs":{"total":96636764160,"available":96326635520,"internally_reserved":0,"allocated":1708032,"data_stored":893233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46400000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52500000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.26500000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.26500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46700000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.64200000000000002},"last":0.309},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.499,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.315}]},{"osd":4,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83799999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.88100000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.39900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.628,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.65800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302836,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069004,"statfs":{"total":96636764160,"available":96326660096,"internally_reserved":0,"allocated":1683456,"data_stored":891853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34300000000000003,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.67300000000000004,"5min":1.216,"15min":1.216},"last":0.31}]},{"osd":1,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.626,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.39100000000000001},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.66900000000000004},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.438,"15min":0.46100000000000002},"min":{"1min":0.35599999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.41199999999999998},"min":{"1min":0.30599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":1.0580000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73699999999999999,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.88500000000000001,"15min":0.998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77500000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77600000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.5}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":893943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.187,"15min":0.187},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.377},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.307}]},{"osd":2,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41999999999999998,"15min":0.443},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.32400000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35299999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82899999999999996,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.629,"15min":0.65600000000000003},"min":{"1min":0.38600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.51100000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.96799999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.65400000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.54500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90500000000000003,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.497},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.95999999999999996},"last":0.61699999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84999999999999998,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":892745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.746},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67300000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499}]},{"osd":5,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71299999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":891875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.54500000000000004},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67900000000000005,"5min":0.77700000000000002,"15min":0.78700000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.39400000000000002,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.80300000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.505,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.76400000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:24:14.652 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:24:14.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:24:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.803+0000 7f43a74dc700 1 Processor -- start 2023-08-22T00:24:14.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.803+0000 7f43a74dc700 1 -- start start 2023-08-22T00:24:14.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a74dc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f43a0066710 0x7f43a0064590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a74dc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a0158970 con 0x7f43a0153dd0 2023-08-22T00:24:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a74dc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00c28b0 con 0x7f43a0064110 2023-08-22T00:24:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a74dc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a0064a80 con 0x7f43a0066710 2023-08-22T00:24:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5a79700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f43a0066710 0x7f43a0064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5278700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f43a0153dd0 0x7f43a00c2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37784/0 (socket says 172.21.15.98:37784) 2023-08-22T00:24:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5278700 1 -- 172.21.15.98:0/563980379 learned_addr learned my addr 172.21.15.98:0/563980379 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5a79700 1 -- 172.21.15.98:0/563980379 >> v1:172.21.15.118:6789/0 conn(0x7f43a0064110 legacy=0x7f43a0066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5a79700 1 -- 172.21.15.98:0/563980379 >> v1:172.21.15.98:6789/0 conn(0x7f43a0153dd0 legacy=0x7f43a00c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f43a5a79700 1 -- 172.21.15.98:0/563980379 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0158690 con 0x7f43a0066710 2023-08-22T00:24:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.804+0000 7f4397fff700 1 -- 172.21.15.98:0/563980379 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555623319 0 0) 0x7f43a0158970 con 0x7f43a0153dd0 2023-08-22T00:24:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a5a79700 1 --2- 172.21.15.98:0/563980379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0066710 0x7f43a0064590 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f4398009e60 tx=0x7f4398009780).ready entity=mon.0 client_cookie=2283ae745c56703b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f4397fff700 1 -- 172.21.15.98:0/563980379 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800e070 con 0x7f43a0066710 2023-08-22T00:24:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f4397fff700 1 -- 172.21.15.98:0/563980379 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439800bbf0 con 0x7f43a0066710 2023-08-22T00:24:14.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f4397fff700 1 -- 172.21.15.98:0/563980379 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398012410 con 0x7f43a0066710 2023-08-22T00:24:14.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 -- 172.21.15.98:0/563980379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0066710 msgr2=0x7f43a0064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 --2- 172.21.15.98:0/563980379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0066710 0x7f43a0064590 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f4398009e60 tx=0x7f4398009780).stop 2023-08-22T00:24:14.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 -- 172.21.15.98:0/563980379 shutdown_connections 2023-08-22T00:24:14.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 --2- 172.21.15.98:0/563980379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0066710 0x7f43a0064590 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 -- 172.21.15.98:0/563980379 >> 172.21.15.98:0/563980379 conn(0x7f43a00c7820 msgr2=0x7f43a00c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:14.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 -- 172.21.15.98:0/563980379 shutdown_connections 2023-08-22T00:24:14.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.805+0000 7f43a74dc700 1 -- 172.21.15.98:0/563980379 wait complete. 2023-08-22T00:24:14.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.807+0000 7f43a74dc700 1 Processor -- start 2023-08-22T00:24:14.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.807+0000 7f43a74dc700 1 -- start start 2023-08-22T00:24:14.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 0x7f43a0168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43a0066710 0x7f43a0065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0065a30 con 0x7f43a0153dd0 2023-08-22T00:24:14.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0164c00 con 0x7f43a0064110 2023-08-22T00:24:14.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a74dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01642d0 con 0x7f43a0066710 2023-08-22T00:24:14.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35606/0 (socket says 172.21.15.98:35606) 2023-08-22T00:24:14.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 -- 172.21.15.98:0/1177946523 learned_addr learned my addr 172.21.15.98:0/1177946523 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:14.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5278700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 0x7f43a0168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a4a77700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43a0066710 0x7f43a0065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 -- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43a0066710 msgr2=0x7f43a0065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43a0066710 0x7f43a0065250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 -- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 msgr2=0x7f43a0168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 0x7f43a0168230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 -- 172.21.15.98:0/1177946523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398009a20 con 0x7f43a0153dd0 2023-08-22T00:24:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5278700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 0x7f43a0168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.808+0000 7f43a5a79700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f43a0068a80 tx=0x7f4398009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.809+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43980117d0 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.809+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398011930 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.809+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a01645b0 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.809+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011cd0 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.809+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a0165090 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.810+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a0164d90 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.810+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f439801d630 con 0x7f43a0153dd0 2023-08-22T00:24:14.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.810+0000 7f43957fa700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 0x7f43840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:14.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.810+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f439807c0d0 con 0x7f43a0153dd0 2023-08-22T00:24:14.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.810+0000 7f43a5278700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 0x7f43840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:14.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.811+0000 7f43a5278700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 0x7f43840612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4390007fd0 tx=0x7f4390009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:14.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:14.814+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f439804d3e0 con 0x7f43a0153dd0 2023-08-22T00:24:15.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.044+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f43a00c3d60 con 0x7f43a0153dd0 2023-08-22T00:24:15.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.047+0000 7f43957fa700 1 -- 172.21.15.98:0/1177946523 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4398050a00 con 0x7f43a0153dd0 2023-08-22T00:24:15.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 msgr2=0x7f43840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 0x7f43840612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4390007fd0 tx=0x7f4390009040).stop 2023-08-22T00:24:15.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 msgr2=0x7f43a014aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f43a0068a80 tx=0x7f4398009780).stop 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 shutdown_connections 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43a0153dd0 0x7f43a014aaa0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a0064110 0x7f43a0168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f438405ee10 0x7f43840612d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 --2- 172.21.15.98:0/1177946523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43a0066710 0x7f43a0065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 >> 172.21.15.98:0/1177946523 conn(0x7f43a00c7820 msgr2=0x7f43a00c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 shutdown_connections 2023-08-22T00:24:15.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.049+0000 7f43a74dc700 1 -- 172.21.15.98:0/1177946523 wait complete. 2023-08-22T00:24:15.052 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:24:15.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:24:15.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.176+0000 7f120ce98700 1 Processor -- start 2023-08-22T00:24:15.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.176+0000 7f120ce98700 1 -- start start 2023-08-22T00:24:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 0x7f1208068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1208153f40 0x7f1208069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 0x7f1208157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1208069720 con 0x7f1208153f40 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080a8410 con 0x7f1208153b60 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f120ce98700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080a8cb0 con 0x7f12080a9140 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f1205d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1208153f40 0x7f1208069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f1205d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1208153f40 0x7f1208069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35622/0 (socket says 172.21.15.98:35622) 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.177+0000 7f1205d9b700 1 -- 172.21.15.98:0/1774552653 learned_addr learned my addr 172.21.15.98:0/1774552653 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1206d9d700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 0x7f1208157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 -- 172.21.15.98:0/1774552653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 msgr2=0x7f1208157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120659c700 1 --2- 172.21.15.98:0/1774552653 >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 0x7f1208068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 0x7f1208157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 -- 172.21.15.98:0/1774552653 >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 msgr2=0x7f1208068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 --2- 172.21.15.98:0/1774552653 >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 0x7f1208068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 -- 172.21.15.98:0/1774552653 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12081586a0 con 0x7f1208153f40 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120659c700 1 --2- 172.21.15.98:0/1774552653 >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 0x7f1208068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:15.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1206d9d700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 0x7f1208157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f1205d9b700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153f40 0x7f1208069230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f120805fcb0 tx=0x7f11f80090f0).ready entity=mon.0 client_cookie=35612759a538e66c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120559a700 1 -- 172.21.15.98:0/1774552653 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800b600 con 0x7f1208153f40 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120559a700 1 -- 172.21.15.98:0/1774552653 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b760 con 0x7f1208153f40 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120559a700 1 -- 172.21.15.98:0/1774552653 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bae0 con 0x7f1208153f40 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 -- 172.21.15.98:0/1774552653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153f40 msgr2=0x7f1208069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153f40 0x7f1208069230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f120805fcb0 tx=0x7f11f80090f0).stop 2023-08-22T00:24:15.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 -- 172.21.15.98:0/1774552653 shutdown_connections 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12080a9140 0x7f1208157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 --2- 172.21.15.98:0/1774552653 >> v2:172.21.15.118:3300/0 conn(0x7f1208153b60 0x7f1208068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 --2- 172.21.15.98:0/1774552653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153f40 0x7f1208069230 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 -- 172.21.15.98:0/1774552653 >> 172.21.15.98:0/1774552653 conn(0x7f12080c5dc0 msgr2=0x7f1208068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 -- 172.21.15.98:0/1774552653 shutdown_connections 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.178+0000 7f120ce98700 1 -- 172.21.15.98:0/1774552653 wait complete. 2023-08-22T00:24:15.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 Processor -- start 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 -- start start 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12080a9140 0x7f12080c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 0x7f1208144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080bdfb0 con 0x7f1208153b60 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080c25d0 con 0x7f12080a9140 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120ce98700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080bd960 con 0x7f1208153f40 2023-08-22T00:24:15.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f1205d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f1205d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35632/0 (socket says 172.21.15.98:35632) 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f1205d9b700 1 -- 172.21.15.98:0/2410559890 learned_addr learned my addr 172.21.15.98:0/2410559890 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.180+0000 7f120659c700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12080a9140 0x7f12080c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1206d9d700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 0x7f1208144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 -- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 msgr2=0x7f1208144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 0x7f1208144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 -- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12080a9140 msgr2=0x7f12080c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12080a9140 0x7f12080c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 -- 172.21.15.98:0/2410559890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009370 con 0x7f1208153b60 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1206d9d700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 0x7f1208144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f1205d9b700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f11f8009130 tx=0x7f11f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bae0 con 0x7f1208153b60 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8000c90 con 0x7f1208153b60 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080bdc40 con 0x7f1208153b60 2023-08-22T00:24:15.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f801c670 con 0x7f1208153b60 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.181+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1208144730 con 0x7f1208153b60 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.182+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12080bd7c0 con 0x7f1208153b60 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.182+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f11f801c9e0 con 0x7f1208153b60 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.183+0000 7f11f67fc700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 0x7f11e80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.183+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f11f807bb40 con 0x7f1208153b60 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.183+0000 7f120659c700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 0x7f11e80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.183+0000 7f120659c700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 0x7f11e80612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f11fc00abd0 tx=0x7f11fc008040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.187+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12080bd7c0 con 0x7f1208153b60 2023-08-22T00:24:15.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.385+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12080bd7c0 con 0x7f1208153b60 2023-08-22T00:24:15.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.385+0000 7f11f67fc700 1 -- 172.21.15.98:0/2410559890 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f12080bd7c0 con 0x7f1208153b60 2023-08-22T00:24:15.387 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:15.387 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:24:15.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 msgr2=0x7f11e80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 0x7f11e80612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f11fc00abd0 tx=0x7f11fc008040).stop 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 msgr2=0x7f12081550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f11f8009130 tx=0x7f11f8017000).stop 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 shutdown_connections 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f11e805ee10 0x7f11e80612d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1208153f40 0x7f1208144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12080a9140 0x7f12080c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 --2- 172.21.15.98:0/2410559890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208153b60 0x7f12081550d0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 >> 172.21.15.98:0/2410559890 conn(0x7f12080c5dc0 msgr2=0x7f1208153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 shutdown_connections 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.387+0000 7f120ce98700 1 -- 172.21.15.98:0/2410559890 wait complete. 2023-08-22T00:24:15.390 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:24:15.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:24:06.836967+0000', 'modified': '2023-08-22T00:24:08.842465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7860}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7860': {'gid': 7860, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/4166377087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6835', 'nonce': 4166377087}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 4166377087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:24:15.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:24:15.803 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-22T00:24:15.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.920+0000 7f872b8b8700 1 Processor -- start 2023-08-22T00:24:15.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.920+0000 7f872b8b8700 1 -- start start 2023-08-22T00:24:15.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f872b8b8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8724150410 0x7f8724154620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f872b8b8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87240c2570 con 0x7f8724150030 2023-08-22T00:24:15.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f872b8b8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87240c2850 con 0x7f87240c2020 2023-08-22T00:24:15.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f872b8b8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8724153e20 con 0x7f8724150410 2023-08-22T00:24:15.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f8729654700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8724150030 0x7f87240bc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37796/0 (socket says 172.21.15.98:37796) 2023-08-22T00:24:15.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f8729654700 1 -- 172.21.15.98:0/868845714 learned_addr learned my addr 172.21.15.98:0/868845714 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:15.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f8728e53700 1 --2- 172.21.15.98:0/868845714 >> v2:172.21.15.118:3300/0 conn(0x7f8724150410 0x7f8724154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121367867 0 0) 0x7f87240c2570 con 0x7f8724150030 2023-08-22T00:24:15.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8710004500 con 0x7f8724150030 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416704734 0 0) 0x7f8710004500 con 0x7f8724150030 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 >> v2:172.21.15.118:3300/0 conn(0x7f8724150410 msgr2=0x7f8724154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 --2- 172.21.15.98:0/868845714 >> v2:172.21.15.118:3300/0 conn(0x7f8724150410 0x7f8724154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 >> v1:172.21.15.118:6789/0 conn(0x7f87240c2020 legacy=0x7f8724062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724154100 con 0x7f8724150030 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8714001470 con 0x7f8724150030 2023-08-22T00:24:15.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 >> v1:172.21.15.98:6789/0 conn(0x7f8724150030 legacy=0x7f87240bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87100049f0 0x7f8710004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.921+0000 7f871bfff700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87100057a0 0x7f8710005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 0x7f871000c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724153e20 con 0x7f8710006110 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871000cfc0 con 0x7f87100049f0 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871000d180 con 0x7f87100057a0 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 0x7f871000c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729654700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87100049f0 0x7f8710004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8728e53700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87100057a0 0x7f8710005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 -- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87100057a0 msgr2=0x7f8710005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87100057a0 0x7f8710005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 -- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87100049f0 msgr2=0x7f8710004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87100049f0 0x7f8710004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 -- 172.21.15.98:0/868845714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710004500 con 0x7f8710006110 2023-08-22T00:24:15.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 -- 172.21.15.98:0/868845714 reap_dead start 2023-08-22T00:24:15.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f8729e55700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 0x7f871000c9f0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f871c001e30 tx=0x7f871c007f30).ready entity=mon.0 client_cookie=5f708be32e1f42c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c006a20 con 0x7f8710006110 2023-08-22T00:24:15.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c006b80 con 0x7f8710006110 2023-08-22T00:24:15.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.922+0000 7f871bfff700 1 -- 172.21.15.98:0/868845714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00c5d0 con 0x7f8710006110 2023-08-22T00:24:15.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 -- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 msgr2=0x7f871000c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 0x7f871000c9f0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f871c001e30 tx=0x7f871c007f30).stop 2023-08-22T00:24:15.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 -- 172.21.15.98:0/868845714 shutdown_connections 2023-08-22T00:24:15.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 --2- 172.21.15.98:0/868845714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8710006110 0x7f871000c9f0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 -- 172.21.15.98:0/868845714 >> 172.21.15.98:0/868845714 conn(0x7f87240c3170 msgr2=0x7f87240c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 -- 172.21.15.98:0/868845714 shutdown_connections 2023-08-22T00:24:15.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.923+0000 7f872b8b8700 1 -- 172.21.15.98:0/868845714 wait complete. 2023-08-22T00:24:15.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.924+0000 7f872b8b8700 1 Processor -- start 2023-08-22T00:24:15.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.924+0000 7f872b8b8700 1 -- start start 2023-08-22T00:24:15.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8710006110 0x7f8724162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87240a9b00 0x7f87240c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87241621b0 con 0x7f87240a9680 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724162770 con 0x7f87240a9b00 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f872b8b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240a8d30 con 0x7f8710006110 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35644/0 (socket says 172.21.15.98:35644) 2023-08-22T00:24:15.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 -- 172.21.15.98:0/4274090638 learned_addr learned my addr 172.21.15.98:0/4274090638 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8729654700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8710006110 0x7f8724162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8729e55700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87240a9b00 0x7f87240c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 -- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8710006110 msgr2=0x7f8724162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8710006110 0x7f8724162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 -- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87240a9b00 msgr2=0x7f87240c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87240a9b00 0x7f87240c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 -- 172.21.15.98:0/4274090638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240a9010 con 0x7f87240a9680 2023-08-22T00:24:15.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f8728e53700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f87200119f0 tx=0x7f8720009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f87197fa700 1 -- 172.21.15.98:0/4274090638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000f6e0 con 0x7f87240a9680 2023-08-22T00:24:15.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.925+0000 7f87197fa700 1 -- 172.21.15.98:0/4274090638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000f840 con 0x7f87240a9680 2023-08-22T00:24:15.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.926+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8724162400 con 0x7f87240a9680 2023-08-22T00:24:15.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.926+0000 7f87197fa700 1 -- 172.21.15.98:0/4274090638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000fbc0 con 0x7f87240a9680 2023-08-22T00:24:15.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.926+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87240aa220 con 0x7f87240a9680 2023-08-22T00:24:15.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.927+0000 7f87197fa700 1 -- 172.21.15.98:0/4274090638 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8720014440 con 0x7f87240a9680 2023-08-22T00:24:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.927+0000 7f87197fa700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 0x7f87080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.927+0000 7f87197fa700 1 -- 172.21.15.98:0/4274090638 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f872007a960 con 0x7f87240a9680 2023-08-22T00:24:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.927+0000 7f8729654700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 0x7f87080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.928+0000 7f8729654700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 0x7f87080612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8714001050 tx=0x7f8714001e50).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.929+0000 7f873d26cb80 1 Processor -- start 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.929+0000 7f873d26cb80 1 -- start start 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979db16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979ceddb0 con 0x555979dacaf0 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979d03030 con 0x555979db12c0 2023-08-22T00:24:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555979d03170 con 0x555979df9f60 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729e55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729e55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35648/0 (socket says 172.21.15.98:35648) 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729e55700 1 -- 172.21.15.98:0/3389865285 learned_addr learned my addr 172.21.15.98:0/3389865285 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729654700 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979db16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8728e53700 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729e55700 1 -- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 msgr2=0x555979dac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.930+0000 7f8729e55700 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.931+0000 7f8729e55700 1 -- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 msgr2=0x555979db16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.931+0000 7f8729e55700 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979db16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.931+0000 7f8729e55700 1 -- 172.21.15.98:0/3389865285 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555979cd5b00 con 0x555979dacaf0 2023-08-22T00:24:15.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.931+0000 7f8729e55700 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f871c00c3c0 tx=0x7f871c016000).ready entity=mon.0 client_cookie=88d1307198446d31 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f870e7fc700 1 -- 172.21.15.98:0/3389865285 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c007bf0 con 0x555979dacaf0 2023-08-22T00:24:15.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f870e7fc700 1 -- 172.21.15.98:0/3389865285 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00c940 con 0x555979dacaf0 2023-08-22T00:24:15.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f870e7fc700 1 -- 172.21.15.98:0/3389865285 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ccc0 con 0x555979dacaf0 2023-08-22T00:24:15.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 -- 172.21.15.98:0/3389865285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 msgr2=0x555979dacf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f871c00c3c0 tx=0x7f871c016000).stop 2023-08-22T00:24:15.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 -- 172.21.15.98:0/3389865285 shutdown_connections 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979dacaf0 0x555979dacf70 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979db16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3389865285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 -- 172.21.15.98:0/3389865285 >> 172.21.15.98:0/3389865285 conn(0x555979c1b940 msgr2=0x555979dfa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 -- 172.21.15.98:0/3389865285 shutdown_connections 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.932+0000 7f873d26cb80 1 -- 172.21.15.98:0/3389865285 wait complete. 2023-08-22T00:24:15.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.933+0000 7f873d26cb80 1 -- start start 2023-08-22T00:24:15.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.933+0000 7f873d26cb80 1 Processor -- start 2023-08-22T00:24:15.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979dde000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979d033f0 con 0x555979df9f60 2023-08-22T00:24:15.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979cce920 con 0x555979db12c0 2023-08-22T00:24:15.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555979ddff70 con 0x555979dacaf0 2023-08-22T00:24:15.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f873d26cb80 10 client.0 ll_register_callbacks cb 0x555979ca3ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:24:15.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35662/0 (socket says 172.21.15.98:35662) 2023-08-22T00:24:15.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 -- 172.21.15.98:0/3298756740 learned_addr learned my addr 172.21.15.98:0/3298756740 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8728e53700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979dde000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729654700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 -- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979dacaf0 msgr2=0x555979dd2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 -- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 msgr2=0x555979dde000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979dde000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.934+0000 7f8729e55700 1 -- 172.21.15.98:0/3298756740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8710004500 con 0x555979df9f60 2023-08-22T00:24:15.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f8729e55700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f871c001350 tx=0x7f871c01f000).ready entity=mon.0 client_cookie=d36493a392a2c116 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:24:15.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00cee0 con 0x555979df9f60 2023-08-22T00:24:15.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f871c02adb0 con 0x555979df9f60 2023-08-22T00:24:15.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555979dabaa0 con 0x555979df9f60 2023-08-22T00:24:15.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871c01ea50 con 0x555979df9f60 2023-08-22T00:24:15.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 10 client.8052 fetch_fsmap learned FSMap version 49 2023-08-22T00:24:15.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x555979cfbf70 con 0x555979df9f60 2023-08-22T00:24:15.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555979dabaa0 con 0x555979df9f60 2023-08-22T00:24:15.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f871c01ebb0 con 0x555979df9f60 2023-08-22T00:24:15.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 10 client.8052 fetch_fsmap finished waiting for FSMap version 49 2023-08-22T00:24:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 10 client.8052 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:24:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 20 client.8052 populate_metadata read hostname 'smithi098' 2023-08-22T00:24:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979dd5de0 0x555979dd61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 4 client.8052 mds_command: new command op to 7860 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 --> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555979b6bef0 con 0x555979dd5de0 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.935+0000 7f8729654700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979dd5de0 0x555979dd61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f8729654700 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979dd5de0 0x555979dd61c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8b5f380a0336f3b server_cookie=d080a7909af2c7a1 in_seq=0 out_seq=0 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f87037fe700 10 client.8052 ms_handle_connect on v2:172.21.15.98:6835/4166377087 2023-08-22T00:24:15.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f87037fe700 1 -- 172.21.15.98:0/3298756740 <== mds.0 v2:172.21.15.98:6835/4166377087 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555979b6bef0 con 0x555979dd5de0 2023-08-22T00:24:15.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f87037fe700 10 client.8052 handle_command_reply: tid=0 2023-08-22T00:24:15.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 client.8052 shutdown 2023-08-22T00:24:15.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 msgr2=0x555979dd33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f871c001350 tx=0x7f871c01f000).stop 2023-08-22T00:24:15.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 shutdown_connections 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979dd5de0 0x555979dd61c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979df9f60 0x555979dd33e0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f87037fe700 0 client.8052 ms_handle_reset on v2:172.21.15.98:6835/4166377087 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 --2- 172.21.15.98:0/3298756740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979db12c0 0x555979dde000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 >> 172.21.15.98:0/3298756740 conn(0x555979c1b940 msgr2=0x555979daf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 shutdown_connections 2023-08-22T00:24:15.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.936+0000 7f873d26cb80 1 -- 172.21.15.98:0/3298756740 wait complete. 2023-08-22T00:24:15.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.937+0000 7f873d26cb80 20 client.8052 trim_cache size 0 max 16384 2023-08-22T00:24:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 Processor -- start 2023-08-22T00:24:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 -- start start 2023-08-22T00:24:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979e08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979db1820 con 0x555979db12c0 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979dad710 con 0x555979dacaf0 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.953+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555979ceebf0 con 0x555979df9f60 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35664/0 (socket says 172.21.15.98:35664) 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 -- 172.21.15.98:0/2751038867 learned_addr learned my addr 172.21.15.98:0/2751038867 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 -- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 msgr2=0x555979e08520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979e08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 -- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 msgr2=0x555979dd2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8729654700 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 -- 172.21.15.98:0/2751038867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555979cf7580 con 0x555979db12c0 2023-08-22T00:24:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f8728e53700 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f872004f5d0 tx=0x7f872001f040).ready entity=mon.0 client_cookie=ea5ff2c3d8fa3b34 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f870effd700 1 -- 172.21.15.98:0/2751038867 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720054040 con 0x555979db12c0 2023-08-22T00:24:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f870effd700 1 -- 172.21.15.98:0/2751038867 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872004da10 con 0x555979db12c0 2023-08-22T00:24:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f870effd700 1 -- 172.21.15.98:0/2751038867 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872004bfe0 con 0x555979db12c0 2023-08-22T00:24:15.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.954+0000 7f873d26cb80 1 -- 172.21.15.98:0/2751038867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 msgr2=0x555979daf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f872004f5d0 tx=0x7f872001f040).stop 2023-08-22T00:24:15.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 -- 172.21.15.98:0/2751038867 shutdown_connections 2023-08-22T00:24:15.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979e08520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979dd2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2751038867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979daf1b0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 -- 172.21.15.98:0/2751038867 >> 172.21.15.98:0/2751038867 conn(0x555979c1b940 msgr2=0x555979ddd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 -- 172.21.15.98:0/2751038867 shutdown_connections 2023-08-22T00:24:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 -- 172.21.15.98:0/2751038867 wait complete. 2023-08-22T00:24:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 -- start start 2023-08-22T00:24:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.955+0000 7f873d26cb80 1 Processor -- start 2023-08-22T00:24:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979df4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dd81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979e08770 con 0x555979db12c0 2023-08-22T00:24:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555979dd2f00 con 0x555979dacaf0 2023-08-22T00:24:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555979da84c0 con 0x555979df9f60 2023-08-22T00:24:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f873d26cb80 10 client.0 ll_register_callbacks cb 0x555979ca3ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:24:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8728e53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35670/0 (socket says 172.21.15.98:35670) 2023-08-22T00:24:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8728e53700 1 -- 172.21.15.98:0/2536944646 learned_addr learned my addr 172.21.15.98:0/2536944646 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8729654700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979df4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8729e55700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dd81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.956+0000 7f8728e53700 1 -- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 msgr2=0x555979dd81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8728e53700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dd81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8728e53700 1 -- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 msgr2=0x555979df4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8728e53700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979df4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8728e53700 1 -- 172.21.15.98:0/2536944646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87240aa220 con 0x555979db12c0 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8729e55700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dd81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8728e53700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f872004f710 tx=0x7f872005c000).ready entity=mon.0 client_cookie=7dbfce9e002e5ce7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720054030 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f872004fb00 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f871c00c940 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f872004b6c0 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 10 client.8058 fetch_fsmap learned FSMap version 49 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x555979cf72d0 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00c940 con 0x555979db12c0 2023-08-22T00:24:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f872004b820 con 0x555979db12c0 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 10 client.8058 fetch_fsmap finished waiting for FSMap version 49 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 10 client.8058 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 20 client.8058 populate_metadata read hostname 'smithi098' 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979df8850 0x555979dd86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 4 client.8058 mds_command: new command op to 7860 tid=0[{"prefix": "status"}] 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 --> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555979ba1040 con 0x555979df8850 2023-08-22T00:24:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.957+0000 7f8729654700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979df8850 0x555979dd86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f8729654700 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979df8850 0x555979dd86c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=19a20ade54675bc3 server_cookie=da3ce8ad40af7b00 in_seq=0 out_seq=0 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f87037fe700 10 client.8058 ms_handle_connect on v2:172.21.15.98:6835/4166377087 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f87037fe700 1 -- 172.21.15.98:0/2536944646 <== mds.0 v2:172.21.15.98:6835/4166377087 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555979ba1040 con 0x555979df8850 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f87037fe700 10 client.8058 handle_command_reply: tid=0 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 client.8058 shutdown 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 msgr2=0x555979e07c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f872004f710 tx=0x7f872005c000).stop 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 shutdown_connections 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:6835/4166377087,v1:172.21.15.98:6837/4166377087] conn(0x555979df8850 0x555979dd86c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555979df9f60 0x555979dd81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555979dacaf0 0x555979df4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f87037fe700 0 client.8058 ms_handle_reset on v2:172.21.15.98:6835/4166377087 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 --2- 172.21.15.98:0/2536944646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555979db12c0 0x555979e07c80 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 >> 172.21.15.98:0/2536944646 conn(0x555979c1b940 msgr2=0x555979dad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 shutdown_connections 2023-08-22T00:24:15.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 1 -- 172.21.15.98:0/2536944646 wait complete. 2023-08-22T00:24:15.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f873d26cb80 20 client.8058 trim_cache size 0 max 16384 2023-08-22T00:24:15.991 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:24:15.991 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:24:15.991 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 7860, 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.1206378919999995, 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 49, 2023-08-22T00:24:15.992 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 136, 2023-08-22T00:24:15.993 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 136, 2023-08-22T00:24:15.993 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 13.627301978 2023-08-22T00:24:15.993 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:24:15.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 msgr2=0x7f87080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 0x7f87080612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8714001050 tx=0x7f8714001e50).stop 2023-08-22T00:24:15.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 msgr2=0x7f87240a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:15.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.958+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f87200119f0 tx=0x7f8720009060).stop 2023-08-22T00:24:15.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 shutdown_connections 2023-08-22T00:24:15.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f870805ee10 0x7f87080612d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8710006110 0x7f8724162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87240a9b00 0x7f87240c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 --2- 172.21.15.98:0/4274090638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87240a9680 0x7f87240a4c70 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:15.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 >> 172.21.15.98:0/4274090638 conn(0x7f87240c3170 msgr2=0x7f87240c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:15.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 shutdown_connections 2023-08-22T00:24:15.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:15.959+0000 7f872b8b8700 1 -- 172.21.15.98:0/4274090638 wait complete. 2023-08-22T00:24:15.997 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:24:16.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.100+0000 7fb22d425700 1 Processor -- start 2023-08-22T00:24:16.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 -- start start 2023-08-22T00:24:16.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb2280bc760 0x7fb2280c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb228063140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280c6e90 con 0x7fb2280c58c0 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280c6590 con 0x7fb2280bc760 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.101+0000 7fb22d425700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228062820 con 0x7fb228062cb0 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb2280bc760 0x7fb2280c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb2280bc760 0x7fb2280c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35678/0 (socket says 172.21.15.98:35678) 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 -- 172.21.15.98:0/1436352090 learned_addr learned my addr 172.21.15.98:0/1436352090 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2277fe700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb228063140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 -- 172.21.15.98:0/1436352090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 msgr2=0x7fb228063140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb228063140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 -- 172.21.15.98:0/1436352090 >> v1:172.21.15.118:6789/0 conn(0x7fb2280c58c0 legacy=0x7fb2280be030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 -- 172.21.15.98:0/1436352090 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280c70e0 con 0x7fb2280bc760 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2277fe700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb228063140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb2267fc700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280bc760 0x7fb2280c5ca0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fb210006fd0 tx=0x7fb2100090f0).ready entity=mon.0 client_cookie=7f1bca25767b69f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb225ffb700 1 -- 172.21.15.98:0/1436352090 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000b600 con 0x7fb2280bc760 2023-08-22T00:24:16.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb225ffb700 1 -- 172.21.15.98:0/1436352090 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21000b760 con 0x7fb2280bc760 2023-08-22T00:24:16.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb225ffb700 1 -- 172.21.15.98:0/1436352090 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000bae0 con 0x7fb2280bc760 2023-08-22T00:24:16.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb22d425700 1 -- 172.21.15.98:0/1436352090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280bc760 msgr2=0x7fb2280c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.102+0000 7fb22d425700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280bc760 0x7fb2280c5ca0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fb210006fd0 tx=0x7fb2100090f0).stop 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 -- 172.21.15.98:0/1436352090 shutdown_connections 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb228063140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 --2- 172.21.15.98:0/1436352090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280bc760 0x7fb2280c5ca0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 -- 172.21.15.98:0/1436352090 >> 172.21.15.98:0/1436352090 conn(0x7fb228090e80 msgr2=0x7fb228063ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:16.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 -- 172.21.15.98:0/1436352090 shutdown_connections 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.103+0000 7fb22d425700 1 -- 172.21.15.98:0/1436352090 wait complete. 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.104+0000 7fb22d425700 1 Processor -- start 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.104+0000 7fb22d425700 1 -- start start 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb22814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 0x7fb228092280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228091550 con 0x7fb2280c58c0 2023-08-22T00:24:16.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228091df0 con 0x7fb2280bc760 2023-08-22T00:24:16.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb22d425700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228093450 con 0x7fb228062cb0 2023-08-22T00:24:16.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb2277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb2277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35690/0 (socket says 172.21.15.98:35690) 2023-08-22T00:24:16.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.105+0000 7fb2277fe700 1 -- 172.21.15.98:0/2460136473 learned_addr learned my addr 172.21.15.98:0/2460136473 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:16.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb226ffd700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb22814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2267fc700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 0x7fb228092280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 -- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 msgr2=0x7fb22814e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb22814e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 -- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 msgr2=0x7fb228092280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 0x7fb228092280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 -- 172.21.15.98:0/2460136473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009370 con 0x7fb2280c58c0 2023-08-22T00:24:16.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb226ffd700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb22814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:16.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2267fc700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 0x7fb228092280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:16.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb2277fe700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fb22000d4b0 tx=0x7fb220009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:16.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220007e00 con 0x7fb2280c58c0 2023-08-22T00:24:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220016950 con 0x7fb2280c58c0 2023-08-22T00:24:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2280917a0 con 0x7fb2280c58c0 2023-08-22T00:24:16.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220016cd0 con 0x7fb2280c58c0 2023-08-22T00:24:16.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.106+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22814eca0 con 0x7fb2280c58c0 2023-08-22T00:24:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.107+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228091f80 con 0x7fb2280c58c0 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.107+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb22001c070 con 0x7fb2280c58c0 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.108+0000 7fb21effd700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 0x7fb2080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.108+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb220082d40 con 0x7fb2280c58c0 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.108+0000 7fb226ffd700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 0x7fb2080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.108+0000 7fb226ffd700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 0x7fb2080612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb228150a90 tx=0x7fb218009040).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.112+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb220053ff0 con 0x7fb2280c58c0 2023-08-22T00:24:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.309+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2280c73c0 con 0x7fb2280c58c0 2023-08-22T00:24:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.310+0000 7fb21effd700 1 -- 172.21.15.98:0/2460136473 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb220057610 con 0x7fb2280c58c0 2023-08-22T00:24:16.311 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:24:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 msgr2=0x7fb2080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 0x7fb2080612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb228150a90 tx=0x7fb218009040).stop 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 msgr2=0x7fb228092ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fb22000d4b0 tx=0x7fb220009a50).stop 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 shutdown_connections 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb20805ee10 0x7fb2080612d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb228062cb0 0x7fb22814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2280c58c0 0x7fb228092ac0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 --2- 172.21.15.98:0/2460136473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2280bc760 0x7fb228092280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 >> 172.21.15.98:0/2460136473 conn(0x7fb228090e80 msgr2=0x7fb228067720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 shutdown_connections 2023-08-22T00:24:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:16.312+0000 7fb22d425700 1 -- 172.21.15.98:0/2460136473 wait complete. 2023-08-22T00:24:16.325 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:24:16.325 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:24:16.325 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:24:16.326 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:24:16.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:16.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:24:16.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:24:16.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:24:16.327 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:24:16.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.328 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:24:16.346 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:24:16.346 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:24:16.347 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:24:16.348 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41449sec preferred_lft 41449sec 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:24:16.349 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:24:16.350 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:24:16.351 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:24:16.351 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:24:16.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.351 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:24:16.413 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:24:16.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.414 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:24:16.473 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:24:16.474 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:24:16.474 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:24:16.474 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:24:16.474 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:24:16.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.475 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:24:16.475 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:24:16.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:24:16.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:24:16.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:24:16.476 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:24:16.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.579 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:24:16.597 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:24:16.597 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:24:16.597 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:24:16.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:24:16.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:24:16.664 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:24:16.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:16.665 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:16.722 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:24:16.722 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:24:16.789 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:24:16.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:24:16.856 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:24:16.857 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:24:16.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:16.858 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:24:16.916 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:24:16.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:16.958 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:24:16.986 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:24:16.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:24:17.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:24:17.039+0000 7f2c5821b3c0 -1 init, newargv = 0x559094049bc0 newargc=15 2023-08-22T00:24:17.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[159819]: starting ceph client 2023-08-22T00:24:17.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[159819]: starting fuse 2023-08-22T00:24:17.054 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:24:17.055 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:24:17.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:17.056 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:24:17.114 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:24:17.114 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:24:17.114 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:24:17.115 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:24:17.115 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:24:17.115 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:24:17.116 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:24:17.116 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:24:17.117 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:24:17.117 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:24:17.117 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:24:17.118 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:24:17.118 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:24:17.118 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:24:17.118 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:24:17.119 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:24:17.119 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:24:17.119 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:24:17.120 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:24:17.120 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:24:17.120 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:24:17.121 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:24:17.121 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:24:17.121 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:24:17.122 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:24:17.123 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:24:17.123 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:24:17.124 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:24:17.125 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:24:17.237 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.159819.asok 2023-08-22T00:24:17.419 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.159819.asok 2023-08-22T00:24:17.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:17.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.159819.asok status 2023-08-22T00:24:17.571 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:24:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:24:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:24:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:24:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:24:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "159819", 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:24:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 8070, 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 8070 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:24:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:24:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:24:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 519393075 2023-08-22T00:24:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:24:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:24:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:24:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 519393075 2023-08-22T00:24:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:24:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.8070 192.168.0.1:0/519393075", 2023-08-22T00:24:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/519393075", 2023-08-22T00:24:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:24:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 49, 2023-08-22T00:24:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 136, 2023-08-22T00:24:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:24:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:24:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:24:17.579 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:24:17.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:17.582 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:24:17.582 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:17.601 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:24:17.602 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:17.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:17.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:24:17.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:24:17.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.825+0000 7ff22589c700 1 Processor -- start 2023-08-22T00:24:17.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.825+0000 7ff22589c700 1 -- start start 2023-08-22T00:24:17.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff22589c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff2200c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff22589c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff220155050 0x7ff220063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff22589c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff220064840 con 0x7ff220064390 2023-08-22T00:24:17.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff22589c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200c2b40 con 0x7ff220155050 2023-08-22T00:24:17.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff22589c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff220151d40 con 0x7ff220151960 2023-08-22T00:24:17.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff21f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff220064390 0x7ff220157900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37802/0 (socket says 172.21.15.98:37802) 2023-08-22T00:24:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff21f7fe700 1 -- 172.21.15.98:0/829031964 learned_addr learned my addr 172.21.15.98:0/829031964 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.826+0000 7ff21effd700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff2200c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21e7fc700 1 --2- 172.21.15.98:0/829031964 >> v2:172.21.15.118:3300/0 conn(0x7ff220155050 0x7ff220063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680431266 0 0) 0x7ff218001490 con 0x7ff220064390 2023-08-22T00:24:17.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c0033f0 con 0x7ff220064390 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887539135 0 0) 0x7ff20c0033f0 con 0x7ff220064390 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 msgr2=0x7ff2200c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff2200c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 >> v2:172.21.15.118:3300/0 conn(0x7ff220155050 msgr2=0x7ff220063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 --2- 172.21.15.98:0/829031964 >> v2:172.21.15.118:3300/0 conn(0x7ff220155050 0x7ff220063ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200c1f30 con 0x7ff220064390 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff218001980 con 0x7ff220064390 2023-08-22T00:24:17.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 >> v1:172.21.15.98:6789/0 conn(0x7ff220064390 legacy=0x7ff220157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff20c0038e0 0x7ff20c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff20c004690 0x7ff20c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff20c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c2b40 con 0x7ff20c0038e0 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220151d40 con 0x7ff20c004690 2023-08-22T00:24:17.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c00b8e0 con 0x7ff220151960 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff20c0038e0 0x7ff20c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21e7fc700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff20c004690 0x7ff20c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21f7fe700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff20c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 -- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 msgr2=0x7ff20c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff20c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 -- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff20c004690 msgr2=0x7ff20c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:17.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff20c004690 0x7ff20c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 -- 172.21.15.98:0/829031964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0033f0 con 0x7ff20c0038e0 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21f7fe700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220151960 0x7ff20c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21effd700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff20c0038e0 0x7ff20c003d00 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7ff208009a60 tx=0x7ff208009060).ready entity=mon.0 client_cookie=ae6fbc5c19b246b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.827+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208009ea0 con 0x7ff20c0038e0 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208009430 con 0x7ff20c0038e0 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff21dffb700 1 -- 172.21.15.98:0/829031964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800e870 con 0x7ff20c0038e0 2023-08-22T00:24:17.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 -- 172.21.15.98:0/829031964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff20c0038e0 msgr2=0x7ff20c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 --2- 172.21.15.98:0/829031964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff20c0038e0 0x7ff20c003d00 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7ff208009a60 tx=0x7ff208009060).stop 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff21f7fe700 1 -- 172.21.15.98:0/829031964 reap_dead start 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 -- 172.21.15.98:0/829031964 shutdown_connections 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 -- 172.21.15.98:0/829031964 >> 172.21.15.98:0/829031964 conn(0x7ff220069680 msgr2=0x7ff220069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 -- 172.21.15.98:0/829031964 shutdown_connections 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.828+0000 7ff22589c700 1 -- 172.21.15.98:0/829031964 wait complete. 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.829+0000 7ff22589c700 1 Processor -- start 2023-08-22T00:24:17.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.829+0000 7ff22589c700 1 -- start start 2023-08-22T00:24:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff20c0038e0 0x7ff220152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22014f870 0x7ff2200c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220165aa0 con 0x7ff22014fcf0 2023-08-22T00:24:17.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c6770 con 0x7ff22014f870 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff22589c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff220152730 con 0x7ff20c0038e0 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff21f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff21f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35722/0 (socket says 172.21.15.98:35722) 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff21f7fe700 1 -- 172.21.15.98:0/1100791248 learned_addr learned my addr 172.21.15.98:0/1100791248 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff21e7fc700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22014f870 0x7ff2200c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.830+0000 7ff21effd700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff20c0038e0 0x7ff220152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 -- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff20c0038e0 msgr2=0x7ff220152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff20c0038e0 0x7ff220152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 -- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22014f870 msgr2=0x7ff2200c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22014f870 0x7ff2200c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 -- 172.21.15.98:0/1100791248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2201657c0 con 0x7ff22014fcf0 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff21f7fe700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7ff218000f80 tx=0x7ff22006ac50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180079e0 con 0x7ff22014fcf0 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800e830 con 0x7ff22014fcf0 2023-08-22T00:24:17.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800ebd0 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2201520e0 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.831+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff220164ad0 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.832+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220151f40 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.832+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff2180133e0 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.832+0000 7ff216ffd700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 0x7ff2000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.833+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff218079a40 con 0x7ff22014fcf0 2023-08-22T00:24:17.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.833+0000 7ff21effd700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 0x7ff2000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.833+0000 7ff21effd700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 0x7ff2000612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff208006d50 tx=0x7ff20801a000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:17.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:17.837+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff220151f40 con 0x7ff22014fcf0 2023-08-22T00:24:18.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.023+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff220064840 con 0x7ff20005ee10 2023-08-22T00:24:18.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.024+0000 7ff216ffd700 1 -- 172.21.15.98:0/1100791248 <== mgr.7695 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff220064840 con 0x7ff20005ee10 2023-08-22T00:24:18.025 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:24:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:24:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:24:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:24:18.026 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:24:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 msgr2=0x7ff2000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 0x7ff2000612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff208006d50 tx=0x7ff20801a000).stop 2023-08-22T00:24:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 msgr2=0x7ff2200c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7ff218000f80 tx=0x7ff22006ac50).stop 2023-08-22T00:24:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 shutdown_connections 2023-08-22T00:24:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff20005ee10 0x7ff2000612d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff20c0038e0 0x7ff220152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff22014fcf0 0x7ff2200c6280 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 --2- 172.21.15.98:0/1100791248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22014f870 0x7ff2200c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 >> 172.21.15.98:0/1100791248 conn(0x7ff220069680 msgr2=0x7ff220065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 shutdown_connections 2023-08-22T00:24:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.026+0000 7ff22589c700 1 -- 172.21.15.98:0/1100791248 wait complete. 2023-08-22T00:24:18.042 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:24:18.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.160+0000 7f220ebf8700 1 Processor -- start 2023-08-22T00:24:18.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.160+0000 7f220ebf8700 1 -- start start 2023-08-22T00:24:18.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220ebf8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2208064110 0x7f2208064590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220ebf8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f2208066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220ebf8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2208158970 con 0x7f2208153dd0 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220ebf8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080c28b0 con 0x7f2208064110 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220ebf8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2208064a80 con 0x7f2208066000 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220c994700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2208153dd0 0x7f22080c2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37818/0 (socket says 172.21.15.98:37818) 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220c994700 1 -- 172.21.15.98:0/804245565 learned_addr learned my addr 172.21.15.98:0/804245565 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f2207fff700 1 --2- 172.21.15.98:0/804245565 >> v2:172.21.15.118:3300/0 conn(0x7f2208064110 0x7f2208064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220d195700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f2208066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644284657 0 0) 0x7f2208158970 con 0x7f2208153dd0 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f80033f0 con 0x7f2208153dd0 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292146184 0 0) 0x7f21f80033f0 con 0x7f2208153dd0 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f2207fff700 1 -- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 msgr2=0x7f2208066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f2207fff700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f2208066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f2207fff700 1 -- 172.21.15.98:0/804245565 >> v1:172.21.15.98:6789/0 conn(0x7f2208153dd0 legacy=0x7f22080c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f2207fff700 1 -- 172.21.15.98:0/804245565 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208066980 con 0x7f2208064110 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.161+0000 7f220d195700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f2208066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f2207fff700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208064110 0x7f2208064590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f21f4009760 tx=0x7f21f4009060).ready entity=mon.1 client_cookie=1f10413ecc167aba server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc001470 con 0x7f2208064110 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4011400 con 0x7f2208064110 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f22077fe700 1 -- 172.21.15.98:0/804245565 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4011780 con 0x7f2208064110 2023-08-22T00:24:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 -- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208064110 msgr2=0x7f2208064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208064110 0x7f2208064590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f21f4009760 tx=0x7f21f4009060).stop 2023-08-22T00:24:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 -- 172.21.15.98:0/804245565 shutdown_connections 2023-08-22T00:24:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f2208066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 --2- 172.21.15.98:0/804245565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208064110 0x7f2208064590 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 -- 172.21.15.98:0/804245565 >> 172.21.15.98:0/804245565 conn(0x7f22080c7820 msgr2=0x7f22080c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:18.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 -- 172.21.15.98:0/804245565 shutdown_connections 2023-08-22T00:24:18.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.162+0000 7f220ebf8700 1 -- 172.21.15.98:0/804245565 wait complete. 2023-08-22T00:24:18.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.164+0000 7f220ebf8700 1 Processor -- start 2023-08-22T00:24:18.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.164+0000 7f220ebf8700 1 -- start start 2023-08-22T00:24:18.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f22080ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208153dd0 0x7f22080ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080a8110 con 0x7f2208064110 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080a7490 con 0x7f2208153dd0 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220ebf8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080a7770 con 0x7f2208066000 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35730/0 (socket says 172.21.15.98:35730) 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 -- 172.21.15.98:0/1524065533 learned_addr learned my addr 172.21.15.98:0/1524065533 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f2207fff700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f22080ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220d195700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208153dd0 0x7f22080ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 -- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 msgr2=0x7f22080ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f22080ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 -- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208153dd0 msgr2=0x7f22080ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208153dd0 0x7f22080ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 -- 172.21.15.98:0/1524065533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a20 con 0x7f2208064110 2023-08-22T00:24:18.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f220c994700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f21fc00c810 tx=0x7f21fc001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.165+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc007170 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.166+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc0072d0 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.166+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0048c0 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.166+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40092a0 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.166+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080a7d30 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.167+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22080691b0 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.167+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 53) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f21fc004cb0 con 0x7f2208064110 2023-08-22T00:24:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.167+0000 7f2204ff9700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 0x7f21ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:18.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.167+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f21fc079a10 con 0x7f2208064110 2023-08-22T00:24:18.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.167+0000 7f2207fff700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 0x7f21ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:18.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.168+0000 7f2207fff700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 0x7f21ec0612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2208157bd0 tx=0x7f21f4016000).ready entity=mgr.7695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:18.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.171+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21fc04ad20 con 0x7f2208064110 2023-08-22T00:24:18.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:18.375+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2208046c20 con 0x7f2208064110 2023-08-22T00:24:19.340 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.339+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 54) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f21fc077680 con 0x7f2208064110 2023-08-22T00:24:19.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.341+0000 7f2204ff9700 1 -- 172.21.15.98:0/1524065533 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v54) v1 ==== 92+0+0 (secure 0 0 0) 0x7f21fc076880 con 0x7f2208064110 2023-08-22T00:24:19.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.344+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 msgr2=0x7f21ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.344+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 0x7f21ec0612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2208157bd0 tx=0x7f21f4016000).stop 2023-08-22T00:24:19.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 msgr2=0x7f22080acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f21fc00c810 tx=0x7f21fc001a00).stop 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 shutdown_connections 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208153dd0 0x7f22080ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2208064110 0x7f22080acf70 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f21ec05ee10 0x7f21ec0612d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 --2- 172.21.15.98:0/1524065533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2208066000 0x7f22080ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 >> 172.21.15.98:0/1524065533 conn(0x7f22080c7820 msgr2=0x7f22080c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:19.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 shutdown_connections 2023-08-22T00:24:19.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.345+0000 7f220ebf8700 1 -- 172.21.15.98:0/1524065533 wait complete. 2023-08-22T00:24:19.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:24:19.481 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:19.481+0000 7f0ab6ce5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:24:19.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.493+0000 7fea1043f700 1 Processor -- start 2023-08-22T00:24:19.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.494+0000 7fea1043f700 1 -- start start 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.494+0000 7fea1043f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea08157a80 0x7fea080aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.494+0000 7fea1043f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea08153780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea1043f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080c8d30 con 0x7fea08153c70 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea1043f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080c9010 con 0x7fea08157a80 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea1043f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080c92f0 con 0x7fea08157e60 2023-08-22T00:24:19.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e9dc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fea08153c70 0x7fea080c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37844/0 (socket says 172.21.15.98:37844) 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e9dc700 1 -- 172.21.15.98:0/619147199 learned_addr learned my addr 172.21.15.98:0/619147199 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 --2- 172.21.15.98:0/619147199 >> v2:172.21.15.118:3300/0 conn(0x7fea08157a80 0x7fea080aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d9da700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea08153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d1d9700 1 -- 172.21.15.98:0/619147199 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806284369 0 0) 0x7fea080c8d30 con 0x7fea08153c70 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d1d9700 1 -- 172.21.15.98:0/619147199 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f40033f0 con 0x7fea08153c70 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 -- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 msgr2=0x7fea08153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea08153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 -- 172.21.15.98:0/619147199 >> v1:172.21.15.98:6789/0 conn(0x7fea08153c70 legacy=0x7fea080c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 -- 172.21.15.98:0/619147199 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080c95d0 con 0x7fea08157a80 2023-08-22T00:24:19.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0e1db700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08157a80 0x7fea080aa920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fea04009760 tx=0x7fea04009060).ready entity=mon.1 client_cookie=870bd8e1196a2a1b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:19.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d1d9700 1 -- 172.21.15.98:0/619147199 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400d4a0 con 0x7fea08157a80 2023-08-22T00:24:19.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d1d9700 1 -- 172.21.15.98:0/619147199 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400d600 con 0x7fea08157a80 2023-08-22T00:24:19.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.495+0000 7fea0d1d9700 1 -- 172.21.15.98:0/619147199 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400d980 con 0x7fea08157a80 2023-08-22T00:24:19.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 -- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08157a80 msgr2=0x7fea080aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08157a80 0x7fea080aa920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fea04009760 tx=0x7fea04009060).stop 2023-08-22T00:24:19.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 -- 172.21.15.98:0/619147199 shutdown_connections 2023-08-22T00:24:19.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08157a80 0x7fea080aa920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 --2- 172.21.15.98:0/619147199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea08153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 -- 172.21.15.98:0/619147199 >> 172.21.15.98:0/619147199 conn(0x7fea080cb5f0 msgr2=0x7fea080c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:19.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 -- 172.21.15.98:0/619147199 shutdown_connections 2023-08-22T00:24:19.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.496+0000 7fea1043f700 1 -- 172.21.15.98:0/619147199 wait complete. 2023-08-22T00:24:19.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.497+0000 7fea1043f700 1 Processor -- start 2023-08-22T00:24:19.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.497+0000 7fea1043f700 1 -- start start 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 0x7fea081529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea080c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080c46f0 con 0x7fea08157a80 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08154860 con 0x7fea08153c70 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea1043f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea08154b40 con 0x7fea08157e60 2023-08-22T00:24:19.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0d9da700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0d9da700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35768/0 (socket says 172.21.15.98:35768) 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 0x7fea081529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0d9da700 1 -- 172.21.15.98:0/2069483112 learned_addr learned my addr 172.21.15.98:0/2069483112 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e9dc700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea080c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 -- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 msgr2=0x7fea080c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea080c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 -- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 msgr2=0x7fea080c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0e1db700 1 -- 172.21.15.98:0/2069483112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040092a0 con 0x7fea08153c70 2023-08-22T00:24:19.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.498+0000 7fea0d9da700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:24:19.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fea0e1db700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 0x7fea081529d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fea04013000 tx=0x7fea04016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:19.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400dd30 con 0x7fea08153c70 2023-08-22T00:24:19.509 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:19.499+0000 7f5bd885b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:24:19.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400de90 con 0x7fea08153c70 2023-08-22T00:24:19.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400d980 con 0x7fea08153c70 2023-08-22T00:24:19.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea08154e20 con 0x7fea08153c70 2023-08-22T00:24:19.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.499+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0814e060 con 0x7fea08153c70 2023-08-22T00:24:19.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.500+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea08083630 con 0x7fea08153c70 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.500+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 54) v1 ==== 75289+0+0 (secure 0 0 0) 0x7fea0401d640 con 0x7fea08153c70 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.500+0000 7fe9fe7fc700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 0x7fe9ec061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.501+0000 7fea0d9da700 1 -- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 msgr2=0x7fe9ec061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.501+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fea0407b540 con 0x7fea08153c70 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.501+0000 7fea0d9da700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 0x7fe9ec061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:24:19.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.505+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea0404c850 con 0x7fea08153c70 2023-08-22T00:24:19.546 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:19.545+0000 7f0ab6ce5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:24:19.565 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:19.564+0000 7f5bd885b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:24:19.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.676+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fea08155590 con 0x7fea08153c70 2023-08-22T00:24:19.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.680+0000 7fe9fe7fc700 1 -- 172.21.15.98:0/2069483112 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea0404fe70 con 0x7fea08153c70 2023-08-22T00:24:19.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 msgr2=0x7fe9ec061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 0x7fe9ec061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 msgr2=0x7fea081529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 0x7fea081529d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fea04013000 tx=0x7fea04016000).stop 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 shutdown_connections 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe9ec05ee60 0x7fe9ec061320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea08157e60 0x7fea080c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea08153c70 0x7fea081529d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 --2- 172.21.15.98:0/2069483112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea08157a80 0x7fea080c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 >> 172.21.15.98:0/2069483112 conn(0x7fea080cb5f0 msgr2=0x7fea080c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:19.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 shutdown_connections 2023-08-22T00:24:19.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.682+0000 7fea1043f700 1 -- 172.21.15.98:0/2069483112 wait complete. 2023-08-22T00:24:19.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:19.696 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:24:19.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-22T00:24:19.820 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:19.820+0000 7f0ab6ce5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:24:19.856 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:19.855+0000 7f5bd885b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:24:19.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.886+0000 7ff3e559f700 1 Processor -- start 2023-08-22T00:24:19.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.886+0000 7ff3e559f700 1 -- start start 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3e559f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3e0064440 0x7ff3e00c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3e559f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e00c2d60 0x7ff3e0153820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3e559f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e006a880 con 0x7ff3e0064060 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3e559f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00c31f0 con 0x7ff3e0064440 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3e559f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00c6330 con 0x7ff3e00c2d60 2023-08-22T00:24:19.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3de7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3e0064440 0x7ff3e00c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3df7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e00c2d60 0x7ff3e0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3deffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff3e0064060 0x7ff3e00c5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:56286/0 (socket says 172.21.15.98:56286) 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3deffd700 1 -- 172.21.15.98:0/3455250907 learned_addr learned my addr 172.21.15.98:0/3455250907 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e00c2d60 msgr2=0x7ff3e0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e00c2d60 0x7ff3e0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3455250907 >> v1:172.21.15.118:6789/0 conn(0x7ff3e0064060 legacy=0x7ff3e00c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3455250907 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00c33e0 con 0x7ff3e0064440 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.887+0000 7ff3ddffb700 1 -- 172.21.15.98:0/3455250907 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449629845 0 0) 0x7ff3e006a880 con 0x7ff3e0064060 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064440 0x7ff3e00c2870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ff3d4009760 tx=0x7ff3d4009060).ready entity=mon.1 client_cookie=8b56efff43f3372e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3ddffb700 1 -- 172.21.15.98:0/3455250907 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400f510 con 0x7ff3e0064440 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3ddffb700 1 -- 172.21.15.98:0/3455250907 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400f670 con 0x7ff3e0064440 2023-08-22T00:24:19.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3ddffb700 1 -- 172.21.15.98:0/3455250907 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400f9f0 con 0x7ff3e0064440 2023-08-22T00:24:19.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 -- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064440 msgr2=0x7ff3e00c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064440 0x7ff3e00c2870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ff3d4009760 tx=0x7ff3d4009060).stop 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 -- 172.21.15.98:0/3455250907 shutdown_connections 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e00c2d60 0x7ff3e0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3455250907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064440 0x7ff3e00c2870 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 -- 172.21.15.98:0/3455250907 >> 172.21.15.98:0/3455250907 conn(0x7ff3e00c4470 msgr2=0x7ff3e00695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 -- 172.21.15.98:0/3455250907 shutdown_connections 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.888+0000 7ff3e559f700 1 -- 172.21.15.98:0/3455250907 wait complete. 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 Processor -- start 2023-08-22T00:24:19.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 -- start start 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e0064440 0x7ff3e00aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e00c2d60 0x7ff3e00a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00bf940 con 0x7ff3e00c2d60 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00bf050 con 0x7ff3e0064060 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.890+0000 7ff3e559f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00ab1b0 con 0x7ff3e0064440 2023-08-22T00:24:19.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3df7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e00c2d60 0x7ff3e00a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:46264/0 (socket says 172.21.15.98:46264) 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3de7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e0064440 0x7ff3e00aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 -- 172.21.15.98:0/3824994630 learned_addr learned my addr 172.21.15.98:0/3824994630 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e0064440 msgr2=0x7ff3e00aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e0064440 0x7ff3e00aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e00c2d60 msgr2=0x7ff3e00a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e00c2d60 0x7ff3e00a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40092a0 con 0x7ff3e0064060 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3deffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ff3d000c4e0 tx=0x7ff3d0007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000ce90 con 0x7ff3e0064060 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d00072e0 con 0x7ff3e0064060 2023-08-22T00:24:19.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e00bf2f0 con 0x7ff3e0064060 2023-08-22T00:24:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0007660 con 0x7ff3e0064060 2023-08-22T00:24:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.891+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e01483c0 con 0x7ff3e0064060 2023-08-22T00:24:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.892+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0047480 con 0x7ff3e0064060 2023-08-22T00:24:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.893+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 54) v1 ==== 75289+0+0 (secure 0 0 0) 0x7ff3d00059b0 con 0x7ff3e0064060 2023-08-22T00:24:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.893+0000 7ff3c6ffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.893+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.893+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff3d00797c0 con 0x7ff3e0064060 2023-08-22T00:24:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.893+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:24:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:19.897+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3d004aad0 con 0x7ff3e0064060 2023-08-22T00:24:20.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:20.094+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:20.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:20.094+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:24:20.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:20.105+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3e00c36c0 con 0x7ff3cc05ee30 2023-08-22T00:24:20.430 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:20.430+0000 7f0ab6ce5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:24:20.487 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:20.485+0000 7f5bd885b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:24:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:20.495+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:20.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:20.495+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:24:20.501 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:20.501+0000 7f0ab6ce5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:24:20.559 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:20.557+0000 7f5bd885b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:24:20.686 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:20.685+0000 7f0ab6ce5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:24:20.742 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:20.741+0000 7f5bd885b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:24:20.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:24:20.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:24:21.108 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.107+0000 7f0ab6ce5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:24:21.163 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.162+0000 7f5bd885b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:24:21.210 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.210+0000 7f0ab6ce5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:24:21.267 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.266+0000 7f5bd885b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:24:21.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:21.296+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:21.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:21.296+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:24:21.363 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.363+0000 7f0ab6ce5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:24:21.419 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.418+0000 7f5bd885b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:24:21.438 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.437+0000 7f0ab6ce5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:24:21.494 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.493+0000 7f5bd885b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:24:21.505 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.504+0000 7f0ab6ce5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:24:21.562 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.561+0000 7f5bd885b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:24:21.759 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.758+0000 7f0ab6ce5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:24:21.815 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.814+0000 7f5bd885b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:24:21.943 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:21.943+0000 7f0ab6ce5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:24:21.998 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:21.997+0000 7f5bd885b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:24:22.594 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:22.593+0000 7f0ab6ce5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:24:22.650 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:22.649+0000 7f5bd885b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:24:22.662 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:22.662+0000 7f0ab6ce5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:24:22.718 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:22.717+0000 7f5bd885b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:24:22.736 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:22.736+0000 7f0ab6ce5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:24:22.792 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:22.791+0000 7f5bd885b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:24:22.885 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:22.884+0000 7f0ab6ce5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:24:22.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:22.897+0000 7ff3de7fc700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:24:22.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:22.897+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:24:22.944 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:22.943+0000 7f5bd885b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:24:22.956 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:22.956+0000 7f0ab6ce5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:24:23.014 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.013+0000 7f5bd885b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:24:23.071 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:23.070+0000 7f0ab6ce5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:24:23.128 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.127+0000 7f5bd885b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:24:23.179 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:23.179+0000 7f0ab6ce5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:24:23.236 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.235+0000 7f5bd885b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:24:23.467 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:23.467+0000 7f0ab6ce5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:24:23.534 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.533+0000 7f5bd885b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:24:23.538 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:24:23.537+0000 7f0ab6ce5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:24:23.608 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.607+0000 7f5bd885b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:24:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:23.607+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 55) v1 ==== 75289+0+0 (secure 0 0 0) 0x7ff3d0077430 con 0x7ff3e0064060 2023-08-22T00:24:23.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:23.625+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 8 ==== mgrmap(e 56) v1 ==== 75113+0+0 (secure 0 0 0) 0x7ff3d00777b0 con 0x7ff3e0064060 2023-08-22T00:24:23.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:23.625+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc0612f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:24:23.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:23.625+0000 7ff3c6ffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc0612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:24:23.681 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b52b04700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b52b04700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b52b04700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b52b04700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b52b04700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b55b0a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b55b0a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.682 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b55b0a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.683 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b55b0a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:23.683 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:24:23.680+0000 7f5b55b0a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:24:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.631+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mon.1 v2:172.21.15.118:3300/0 9 ==== mgrmap(e 57) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff3d0046640 con 0x7ff3e0064060 2023-08-22T00:24:24.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.632+0000 7ff3c6ffd700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.632+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3e00c36c0 con 0x7ff3cc05ee30 2023-08-22T00:24:24.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.632+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.643+0000 7ff3de7fc700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc061270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff3d4009fd0 tx=0x7ff3d4017000).ready entity=mgr.8100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:24.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.648+0000 7ff3c6ffd700 1 -- 172.21.15.98:0/3824994630 <== mgr.8100 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3e00c36c0 con 0x7ff3cc05ee30 2023-08-22T00:24:24.650 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:24:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 msgr2=0x7ff3cc061270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc061270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff3d4009fd0 tx=0x7ff3d4017000).stop 2023-08-22T00:24:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 msgr2=0x7ff3e0147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ff3d000c4e0 tx=0x7ff3d0007c70).stop 2023-08-22T00:24:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 shutdown_connections 2023-08-22T00:24:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e00c2d60 0x7ff3e00a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e0064060 0x7ff3e0147ed0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff3cc05ee30 0x7ff3cc061270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 --2- 172.21.15.98:0/3824994630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e0064440 0x7ff3e00aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 >> 172.21.15.98:0/3824994630 conn(0x7ff3e00c4470 msgr2=0x7ff3e0149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 shutdown_connections 2023-08-22T00:24:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.650+0000 7ff3e559f700 1 -- 172.21.15.98:0/3824994630 wait complete. 2023-08-22T00:24:24.664 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:24:24.665 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-22-00_25_00 in ~36s... 2023-08-22T00:24:24.665 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-08-22T00:24:24.666 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-22T00:24:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.787+0000 7fd5b735c700 1 Processor -- start 2023-08-22T00:24:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.787+0000 7fd5b735c700 1 -- start start 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b735c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5b00645e0 0x7fd5b0064a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b735c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b0155360 con 0x7fd5b00c5ea0 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b735c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b0157b50 con 0x7fd5b0153ae0 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b735c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b0064f40 con 0x7fd5b00645e0 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b58f9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5b00645e0 0x7fd5b0064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b48f7700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd5b00c5ea0 0x7fd5b0157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33356/0 (socket says 172.21.15.98:33356) 2023-08-22T00:24:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b58f9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5b00645e0 0x7fd5b0064a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36890/0 (socket says 172.21.15.98:36890) 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b48f7700 1 -- 172.21.15.98:0/2913108754 learned_addr learned my addr 172.21.15.98:0/2913108754 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b58f9700 1 -- 172.21.15.98:0/2913108754 >> v1:172.21.15.118:6789/0 conn(0x7fd5b0153ae0 legacy=0x7fd5b00bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b58f9700 1 -- 172.21.15.98:0/2913108754 >> v1:172.21.15.98:6789/0 conn(0x7fd5b00c5ea0 legacy=0x7fd5b0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.788+0000 7fd5b58f9700 1 -- 172.21.15.98:0/2913108754 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00c6320 con 0x7fd5b00645e0 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b58f9700 1 --2- 172.21.15.98:0/2913108754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b00645e0 0x7fd5b0064a50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fd5a8009e60 tx=0x7fd5a8009780).ready entity=mon.0 client_cookie=dae095683164630 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5a7fff700 1 -- 172.21.15.98:0/2913108754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800e070 con 0x7fd5b00645e0 2023-08-22T00:24:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5a7fff700 1 -- 172.21.15.98:0/2913108754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800bb30 con 0x7fd5b00645e0 2023-08-22T00:24:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5a7fff700 1 -- 172.21.15.98:0/2913108754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800beb0 con 0x7fd5b00645e0 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 -- 172.21.15.98:0/2913108754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b00645e0 msgr2=0x7fd5b0064a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 --2- 172.21.15.98:0/2913108754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b00645e0 0x7fd5b0064a50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fd5a8009e60 tx=0x7fd5a8009780).stop 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 -- 172.21.15.98:0/2913108754 shutdown_connections 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 --2- 172.21.15.98:0/2913108754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b00645e0 0x7fd5b0064a50 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 -- 172.21.15.98:0/2913108754 >> 172.21.15.98:0/2913108754 conn(0x7fd5b00caa50 msgr2=0x7fd5b00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 -- 172.21.15.98:0/2913108754 shutdown_connections 2023-08-22T00:24:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.789+0000 7fd5b735c700 1 -- 172.21.15.98:0/2913108754 wait complete. 2023-08-22T00:24:24.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.790+0000 7fd5b735c700 1 Processor -- start 2023-08-22T00:24:24.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.791+0000 7fd5b735c700 1 -- start start 2023-08-22T00:24:24.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 0x7fd5b014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5b00c5ea0 0x7fd5b00ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0164da0 con 0x7fd5b0153ae0 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00adb30 con 0x7fd5b00645e0 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00ade10 con 0x7fd5b00c5ea0 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36896/0 (socket says 172.21.15.98:36896) 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 -- 172.21.15.98:0/261369940 learned_addr learned my addr 172.21.15.98:0/261369940 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:24:24.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b50f8700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 0x7fd5b014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b48f7700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5b00c5ea0 0x7fd5b00ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 -- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5b00c5ea0 msgr2=0x7fd5b00ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5b00c5ea0 0x7fd5b00ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 -- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 msgr2=0x7fd5b014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 0x7fd5b014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 -- 172.21.15.98:0/261369940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009a20 con 0x7fd5b0153ae0 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b50f8700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 0x7fd5b014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:24:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b58f9700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd5b0065120 tx=0x7fd5a8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8012700 con 0x7fd5b0153ae0 2023-08-22T00:24:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8012860 con 0x7fd5b0153ae0 2023-08-22T00:24:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00ae0f0 con 0x7fd5b0153ae0 2023-08-22T00:24:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8012c00 con 0x7fd5b0153ae0 2023-08-22T00:24:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.792+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b014f9b0 con 0x7fd5b0153ae0 2023-08-22T00:24:24.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.793+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b014f9b0 con 0x7fd5b0153ae0 2023-08-22T00:24:24.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.793+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 57) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fd5a8027460 con 0x7fd5b0153ae0 2023-08-22T00:24:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.794+0000 7fd5a57fa700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 0x7fd594061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:24:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.794+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fd5a807beb0 con 0x7fd5b0153ae0 2023-08-22T00:24:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.794+0000 7fd5b50f8700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 0x7fd594061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:24:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.794+0000 7fd5b50f8700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 0x7fd594061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd5a0006fd0 tx=0x7fd5a0008040).ready entity=mgr.8100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:24:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.798+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5a804d280 con 0x7fd5b0153ae0 2023-08-22T00:24:24.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.983+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5b014f9b0 con 0x7fd59405ed40 2023-08-22T00:24:24.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.985+0000 7fd5a57fa700 1 -- 172.21.15.98:0/261369940 <== mgr.8100 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fd5b014f9b0 con 0x7fd59405ed40 2023-08-22T00:24:24.987 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:24:24.987 INFO:teuthology.orchestra.run.smithi098.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-22T00:24:24.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 msgr2=0x7fd594061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 0x7fd594061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd5a0006fd0 tx=0x7fd5a0008040).stop 2023-08-22T00:24:24.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 msgr2=0x7fd5b00aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:24:24.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd5b0065120 tx=0x7fd5a8009780).stop 2023-08-22T00:24:24.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 shutdown_connections 2023-08-22T00:24:24.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5b0153ae0 0x7fd5b00aede0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5b00645e0 0x7fd5b014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd59405ed40 0x7fd594061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 --2- 172.21.15.98:0/261369940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5b00c5ea0 0x7fd5b00ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:24:24.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 >> 172.21.15.98:0/261369940 conn(0x7fd5b00caa50 msgr2=0x7fd5b0155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:24:24.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 shutdown_connections 2023-08-22T00:24:24.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:24:24.987+0000 7fd5b735c700 1 -- 172.21.15.98:0/261369940 wait complete. 2023-08-22T00:24:25.000 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-22T00:24:25.000 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-08-22T00:24:25.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:25.001 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:26.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:26.024 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:27.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:27.053 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:28.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:28.083 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:29.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:29.111 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:30.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:30.140 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:31.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:31.168 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:32.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:32.197 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:33.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:33.227 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:34.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:34.255 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:35.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:35.284 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:36.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:36.313 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:37.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:37.343 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:38.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:38.372 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:39.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:39.402 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:40.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:40.431 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:41.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:41.461 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:42.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:42.489 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:43.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:43.517 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:44.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:44.598 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:45.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:45.629 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:46.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:46.657 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:47.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:47.686 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:48.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:48.715 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:49.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:49.744 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:50.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:50.776 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:51.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:24:51.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:24:51.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:51.811 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:52.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:52.840 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:53.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:53.869 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:54.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:54.898 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:55.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:55.926 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:56.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:56.956 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:57.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:57.985 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:24:59.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:24:59.015 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:25:00.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:00.043 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:25:00.654 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:00.654+0000 7f5b45aea700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:00.655 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:00.654+0000 7f5b45aea700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:00.655 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:00.654+0000 7f5b45aea700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:00.655 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:00.654+0000 7f5b45aea700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:00.655 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:00.654+0000 7f5b45aea700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:01.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:01.074 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:25:01.101 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_25_00_UTC 2023-08-22T00:25:01.101 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-22-00_25_00_UTC'] 2023-08-22T00:25:01.102 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692663864.6652317, now = 1692663901.1022513, timo = 36 2023-08-22T00:25:02.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-22T00:25:02.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.235+0000 7f4e5f9df700 1 Processor -- start 2023-08-22T00:25:02.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.235+0000 7f4e5f9df700 1 -- start start 2023-08-22T00:25:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5f9df700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4e58151bf0 0x7f4e58064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5f9df700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e58064f50 con 0x7f4e58151100 2023-08-22T00:25:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5f9df700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580aa190 con 0x7f4e58065530 2023-08-22T00:25:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5f9df700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580bdfe0 con 0x7f4e58151bf0 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5d77b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4e58151100 0x7f4e581514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37394/0 (socket says 172.21.15.98:37394) 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5d77b700 1 -- 172.21.15.98:0/2401897770 learned_addr learned my addr 172.21.15.98:0/2401897770 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/2401897770 >> v2:172.21.15.118:3300/0 conn(0x7f4e58151bf0 0x7f4e58064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.236+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117034069 0 0) 0x7f4e48001110 con 0x7f4e58151100 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e440033f0 con 0x7f4e58151100 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3917000283 0 0) 0x7f4e440033f0 con 0x7f4e58151100 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 >> v2:172.21.15.118:3300/0 conn(0x7f4e58151bf0 msgr2=0x7f4e58064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 --2- 172.21.15.98:0/2401897770 >> v2:172.21.15.118:3300/0 conn(0x7f4e58151bf0 0x7f4e58064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 >> v1:172.21.15.118:6789/0 conn(0x7f4e58065530 legacy=0x7f4e580bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580645d0 con 0x7f4e58151100 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f4e48001600 con 0x7f4e58151100 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 >> v1:172.21.15.98:6789/0 conn(0x7f4e58151100 legacy=0x7f4e581514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440038e0 0x7f4e44003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 0x7f4e44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44005000 0x7f4e4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580bdfe0 con 0x7f4e44004690 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400be00 con 0x7f4e440038e0 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400bfc0 con 0x7f4e44005000 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 0x7f4e44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5d77b700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440038e0 0x7f4e44003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5df7c700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44005000 0x7f4e4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44005000 msgr2=0x7f4e4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44005000 0x7f4e4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440038e0 msgr2=0x7f4e44003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440038e0 0x7f4e44003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/2401897770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440033f0 con 0x7f4e44004690 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5df7c700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44005000 0x7f4e4400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5df7c700 1 -- 172.21.15.98:0/2401897770 reap_dead start 2023-08-22T00:25:02.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.237+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 0x7f4e44004b10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f4e54009a60 tx=0x7f4e54009060).ready entity=mon.0 client_cookie=9fe9c4c5d946a2cf server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54009ea0 con 0x7f4e44004690 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54009430 con 0x7f4e44004690 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e4ffff700 1 -- 172.21.15.98:0/2401897770 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400e870 con 0x7f4e44004690 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 -- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 msgr2=0x7f4e44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 0x7f4e44004b10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f4e54009a60 tx=0x7f4e54009060).stop 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 -- 172.21.15.98:0/2401897770 shutdown_connections 2023-08-22T00:25:02.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/2401897770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e44004690 0x7f4e44004b10 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 -- 172.21.15.98:0/2401897770 >> 172.21.15.98:0/2401897770 conn(0x7f4e5806a910 msgr2=0x7f4e58065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:02.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 -- 172.21.15.98:0/2401897770 shutdown_connections 2023-08-22T00:25:02.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.238+0000 7f4e5f9df700 1 -- 172.21.15.98:0/2401897770 wait complete. 2023-08-22T00:25:02.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.240+0000 7f4e5f9df700 1 Processor -- start 2023-08-22T00:25:02.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.240+0000 7f4e5f9df700 1 -- start start 2023-08-22T00:25:02.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 0x7f4e58161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 0x7f4e581529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5814d540 con 0x7f4e5814cc50 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58157460 con 0x7f4e580c8200 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5f9df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58139aa0 con 0x7f4e44004690 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32798/0 (socket says 172.21.15.98:32798) 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/1589093158 learned_addr learned my addr 172.21.15.98:0/1589093158 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5d77b700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 0x7f4e58161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5df7c700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 0x7f4e581529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 msgr2=0x7f4e58161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 0x7f4e58161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 msgr2=0x7f4e581529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 0x7f4e581529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 -- 172.21.15.98:0/1589093158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e581645a0 con 0x7f4e5814cc50 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5df7c700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 0x7f4e581529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5d77b700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 0x7f4e58161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.241+0000 7f4e5cf7a700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f4e5401b420 tx=0x7f4e5401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.242+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5401ba40 con 0x7f4e5814cc50 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.242+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5401bbc0 con 0x7f4e5814cc50 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.242+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58156ea0 con 0x7f4e5814cc50 2023-08-22T00:25:02.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.242+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54025480 con 0x7f4e5814cc50 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.242+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e58164230 con 0x7f4e5814cc50 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.243+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e58164730 con 0x7f4e5814cc50 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.243+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 58) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f4e540257f0 con 0x7f4e5814cc50 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.243+0000 7f4e4d7fa700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 0x7f4e3c061500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.243+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f4e5407bae0 con 0x7f4e5814cc50 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.243+0000 7f4e5d77b700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 0x7f4e3c061500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.244+0000 7f4e5d77b700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 0x7f4e3c061500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4e48007ef0 tx=0x7f4e48009040).ready entity=mgr.8100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.248+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e5404cbf0 con 0x7f4e5814cc50 2023-08-22T00:25:02.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.394+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 59) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f4e540794a0 con 0x7f4e5814cc50 2023-08-22T00:25:02.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.436+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e58047480 con 0x7f4e3c05f040 2023-08-22T00:25:02.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.439+0000 7f4e4d7fa700 1 -- 172.21.15.98:0/1589093158 <== mgr.8100 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4e58047480 con 0x7f4e3c05f040 2023-08-22T00:25:02.440 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path snap_test_dir1 2023-08-22T00:25:02.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 msgr2=0x7f4e3c061500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 0x7f4e3c061500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4e48007ef0 tx=0x7f4e48009040).stop 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 msgr2=0x7f4e58164a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f4e5401b420 tx=0x7f4e5401a000).stop 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 shutdown_connections 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e3c05f040 0x7f4e3c061500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e44004690 0x7f4e58161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c8200 0x7f4e581529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 --2- 172.21.15.98:0/1589093158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5814cc50 0x7f4e58164a30 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 >> 172.21.15.98:0/1589093158 conn(0x7f4e5806a910 msgr2=0x7f4e580a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:02.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 shutdown_connections 2023-08-22T00:25:02.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.441+0000 7f4e5f9df700 1 -- 172.21.15.98:0/1589093158 wait complete. 2023-08-22T00:25:02.453 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-22T00:25:02.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:02.454 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:25:02.476 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_25_00_UTC 2023-08-22T00:25:02.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-22-00_25_00_UTC 2023-08-22T00:25:02.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:02.478 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-22-00_25_00_UTC) 2023-08-22T00:25:02.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:02.542 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:25:02.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:25:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.768+0000 7f05f70c7700 1 Processor -- start 2023-08-22T00:25:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.768+0000 7f05f70c7700 1 -- start start 2023-08-22T00:25:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05f70c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05f0065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05f70c7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f0066780 con 0x7f05f00c34c0 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05f70c7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00c3dd0 con 0x7f05f00c3940 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05f70c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00c2100 con 0x7f05f01507e0 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05effff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f05f00c34c0 0x7f05f00c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37410/0 (socket says 172.21.15.98:37410) 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05effff700 1 -- 172.21.15.98:0/2501400477 learned_addr learned my addr 172.21.15.98:0/2501400477 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.769+0000 7f05f4e63700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05f0065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806588338 0 0) 0x7f05f0066780 con 0x7f05f00c34c0 2023-08-22T00:25:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e00033f0 con 0x7f05f00c34c0 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291268645 0 0) 0x7f05e00033f0 con 0x7f05f00c34c0 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 msgr2=0x7f05f0065730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05f0065730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 >> v1:172.21.15.118:6789/0 conn(0x7f05f00c3940 legacy=0x7f05f0150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0066130 con 0x7f05f00c34c0 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f05dc001470 con 0x7f05f00c34c0 2023-08-22T00:25:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 >> v1:172.21.15.98:6789/0 conn(0x7f05f00c34c0 legacy=0x7f05f00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05e0003910 0x7f05e0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05e0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05e0004b80 0x7f05e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00c2100 con 0x7f05e0004b80 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e000b910 con 0x7f05e0003910 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e000bad0 con 0x7f05f01507e0 2023-08-22T00:25:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05e0004b80 0x7f05e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f4e63700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05e0003910 0x7f05e0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05effff700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05e0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 -- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 msgr2=0x7f05e0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f01507e0 0x7f05e0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 -- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05e0003910 msgr2=0x7f05e0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05e0003910 0x7f05e0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 -- 172.21.15.98:0/2501400477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00033f0 con 0x7f05e0004b80 2023-08-22T00:25:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05f5664700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05e0004b80 0x7f05e0005000 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f05f00c1a50 tx=0x7f05e8007f30).ready entity=mon.0 client_cookie=39ba8a04248cf151 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.770+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8006a20 con 0x7f05e0004b80 2023-08-22T00:25:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8006b80 con 0x7f05e0004b80 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05ef7fe700 1 -- 172.21.15.98:0/2501400477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800c5d0 con 0x7f05e0004b80 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 -- 172.21.15.98:0/2501400477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05e0004b80 msgr2=0x7f05e0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 --2- 172.21.15.98:0/2501400477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05e0004b80 0x7f05e0005000 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f05f00c1a50 tx=0x7f05e8007f30).stop 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f5664700 1 -- 172.21.15.98:0/2501400477 reap_dead start 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 -- 172.21.15.98:0/2501400477 shutdown_connections 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 -- 172.21.15.98:0/2501400477 >> 172.21.15.98:0/2501400477 conn(0x7f05f00c7800 msgr2=0x7f05f00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 -- 172.21.15.98:0/2501400477 shutdown_connections 2023-08-22T00:25:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.771+0000 7f05f70c7700 1 -- 172.21.15.98:0/2501400477 wait complete. 2023-08-22T00:25:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.772+0000 7f05f70c7700 1 Processor -- start 2023-08-22T00:25:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.772+0000 7f05f70c7700 1 -- start start 2023-08-22T00:25:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f014a3c0 0x7f05f014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f00c09c0 0x7f05f00c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00c1330 con 0x7f05f00aa790 2023-08-22T00:25:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00bf6a0 con 0x7f05f00c09c0 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f70c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00bf980 con 0x7f05f014a3c0 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05effff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05effff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32820/0 (socket says 172.21.15.98:32820) 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05effff700 1 -- 172.21.15.98:0/60805938 learned_addr learned my addr 172.21.15.98:0/60805938 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f4e63700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f014a3c0 0x7f05f014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.773+0000 7f05f5664700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f00c09c0 0x7f05f00c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 -- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f014a3c0 msgr2=0x7f05f014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f014a3c0 0x7f05f014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 -- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f00c09c0 msgr2=0x7f05f00c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f00c09c0 0x7f05f00c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 -- 172.21.15.98:0/60805938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00bfc60 con 0x7f05f00aa790 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05effff700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f05dc0010e0 tx=0x7f05dc001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc011590 con 0x7f05f00aa790 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0116f0 con 0x7f05f00aa790 2023-08-22T00:25:02.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f00bff40 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc011a70 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.774+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f00bf260 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.775+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f0069220 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.775+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 59) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f05dc01d3b0 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.775+0000 7f05ecff9700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 0x7f05d4061580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.775+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f05dc079b70 con 0x7f05f00aa790 2023-08-22T00:25:02.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.776+0000 7f05f4e63700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 0x7f05d4061580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:02.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.776+0000 7f05f4e63700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 0x7f05d4061580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f05e4006d80 tx=0x7f05e4009060).ready entity=mgr.8100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:02.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.780+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f05dc04ab20 con 0x7f05f00aa790 2023-08-22T00:25:02.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:02.985+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f05f0046c20 con 0x7f05f00aa790 2023-08-22T00:25:03.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.400+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f05dc077430 con 0x7f05f00aa790 2023-08-22T00:25:03.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.401+0000 7f05ecff9700 1 -- 172.21.15.98:0/60805938 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v60) v1 ==== 93+0+0 (secure 0 0 0) 0x7f05dc072350 con 0x7f05f00aa790 2023-08-22T00:25:03.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.403+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 msgr2=0x7f05d4061580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.403+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 0x7f05d4061580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f05e4006d80 tx=0x7f05e4009060).stop 2023-08-22T00:25:03.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.403+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 msgr2=0x7f05f00bed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.403+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f05dc0010e0 tx=0x7f05dc001e50).stop 2023-08-22T00:25:03.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 shutdown_connections 2023-08-22T00:25:03.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f05d405f0c0 0x7f05d4061580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05f014a3c0 0x7f05f014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f00c09c0 0x7f05f00c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 --2- 172.21.15.98:0/60805938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f00aa790 0x7f05f00bed70 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 >> 172.21.15.98:0/60805938 conn(0x7f05f00c7800 msgr2=0x7f05f014f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:03.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 shutdown_connections 2023-08-22T00:25:03.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.404+0000 7f05f70c7700 1 -- 172.21.15.98:0/60805938 wait complete. 2023-08-22T00:25:03.418 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:25:03.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:03.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:03.514 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:25:03.514 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:25:03.514 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:25:03.515 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:03.546 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:03.545+0000 7f6ed1297680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:03.554 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:03.551+0000 7f9f4e3d4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:03.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[159819]: fuse finished with error 0 and tester_r 0 2023-08-22T00:25:03.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:25:03.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:03.557 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:25:03.608 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:03.608+0000 7f6ed1297680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:03.617 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:03.617+0000 7f9f4e3d4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:03.725 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:25:03.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:03.726 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:25:03.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:25:03.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:25:03.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:03.745 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:25:03.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:03.785 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:25:03.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:25:03.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:03.786 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:25:03.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:03.805 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:25:03.808 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:03.886 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:03.885+0000 7f6ed1297680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:03.904 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:03.904+0000 7f9f4e3d4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:03.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 Processor -- start 2023-08-22T00:25:03.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 -- start start 2023-08-22T00:25:03.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 0x7f50001584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:03.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50000bd750 con 0x7f5000066370 2023-08-22T00:25:03.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50000a7030 con 0x7f5000065f10 2023-08-22T00:25:03.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.945+0000 7f5005c08700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c2010 con 0x7f5000153cf0 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5000066370 0x7f50000c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37428/0 (socket says 172.21.15.98:37428) 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffffff700 1 -- 172.21.15.98:0/1605592002 learned_addr learned my addr 172.21.15.98:0/1605592002 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4fff7fe700 1 --2- 172.21.15.98:0/1605592002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 0x7f50001584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545648726 0 0) 0x7f50000bd750 con 0x7f5000066370 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe80033f0 con 0x7f5000066370 2023-08-22T00:25:03.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602526101 0 0) 0x7f50000a7030 con 0x7f5000065f10 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50000bd750 con 0x7f5000065f10 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4fff7fe700 1 -- 172.21.15.98:0/1605592002 >> v1:172.21.15.118:6789/0 conn(0x7f5000065f10 legacy=0x7f50000bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4fff7fe700 1 -- 172.21.15.98:0/1605592002 >> v1:172.21.15.98:6789/0 conn(0x7f5000066370 legacy=0x7f50000c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4fff7fe700 1 -- 172.21.15.98:0/1605592002 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000a6d50 con 0x7f5000153cf0 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4fff7fe700 1 --2- 172.21.15.98:0/1605592002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 0x7f50001584e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4ff0009790 tx=0x7f4ff0009060).ready entity=mon.2 client_cookie=fbfb10835009e51e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000f510 con 0x7f5000153cf0 2023-08-22T00:25:03.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000f670 con 0x7f5000153cf0 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.946+0000 7f4ffe7fc700 1 -- 172.21.15.98:0/1605592002 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000f9f0 con 0x7f5000153cf0 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 -- 172.21.15.98:0/1605592002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 msgr2=0x7f50001584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 --2- 172.21.15.98:0/1605592002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 0x7f50001584e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4ff0009790 tx=0x7f4ff0009060).stop 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 -- 172.21.15.98:0/1605592002 shutdown_connections 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 --2- 172.21.15.98:0/1605592002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000153cf0 0x7f50001584e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 -- 172.21.15.98:0/1605592002 >> 172.21.15.98:0/1605592002 conn(0x7f50000c7770 msgr2=0x7f50000c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 -- 172.21.15.98:0/1605592002 shutdown_connections 2023-08-22T00:25:03.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.947+0000 7f5005c08700 1 -- 172.21.15.98:0/1605592002 wait complete. 2023-08-22T00:25:03.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.948+0000 7f5005c08700 1 Processor -- start 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.948+0000 7f5005c08700 1 -- start start 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000066370 0x7f5000165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000164c30 con 0x7f5000153cf0 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000150df0 con 0x7f5000065f10 2023-08-22T00:25:03.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f5005c08700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5000150830 con 0x7f5000066370 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffeffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000066370 0x7f5000165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32850/0 (socket says 172.21.15.98:32850) 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:42830/0 (socket says 172.21.15.98:42830) 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 -- 172.21.15.98:0/3593427107 learned_addr learned my addr 172.21.15.98:0/3593427107 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000066370 msgr2=0x7f5000165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000066370 0x7f5000165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.949+0000 7f4ffffff700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 msgr2=0x7f50000a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4ffffff700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4ffffff700 1 -- 172.21.15.98:0/3593427107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00092a0 con 0x7f5000153cf0 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4fff7fe700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4ffffff700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4ff8001560 tx=0x7f4ff8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:03.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8005d30 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8005e90 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8007340 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5000150b10 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.950+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5000165540 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.951+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000164d70 con 0x7f5000153cf0 2023-08-22T00:25:03.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.951+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f4ff80076b0 con 0x7f5000153cf0 2023-08-22T00:25:03.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.951+0000 7f4fe77fe700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 0x7f4fec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:03.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.951+0000 7f4fff7fe700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 msgr2=0x7f4fec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:03.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.951+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f4ff807a2c0 con 0x7f5000153cf0 2023-08-22T00:25:03.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.952+0000 7f4fff7fe700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 0x7f4fec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:03.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:03.955+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5000164d70 con 0x7f5000153cf0 2023-08-22T00:25:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.153+0000 7f4fff7fe700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 msgr2=0x7f4fec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.153+0000 7f4fff7fe700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 0x7f4fec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:04.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.166+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5000164d70 con 0x7f5000153cf0 2023-08-22T00:25:04.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.167+0000 7f4fe77fe700 1 -- 172.21.15.98:0/3593427107 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f5000164d70 con 0x7f5000153cf0 2023-08-22T00:25:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:04.167 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:25:04.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 msgr2=0x7f4fec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:04.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 0x7f4fec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 msgr2=0x7f50000a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4ff8001560 tx=0x7f4ff8001650).stop 2023-08-22T00:25:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 shutdown_connections 2023-08-22T00:25:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5000153cf0 0x7f50000a7b20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5000065f10 0x7f50000a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4fec05f050 0x7f4fec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 --2- 172.21.15.98:0/3593427107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5000066370 0x7f5000165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 >> 172.21.15.98:0/3593427107 conn(0x7f50000c7770 msgr2=0x7f50001540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 shutdown_connections 2023-08-22T00:25:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.169+0000 7f5005c08700 1 -- 172.21.15.98:0/3593427107 wait complete. 2023-08-22T00:25:04.172 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:25:04.182 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:04.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.301+0000 7f0e430a8700 1 Processor -- start 2023-08-22T00:25:04.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.301+0000 7f0e430a8700 1 -- start start 2023-08-22T00:25:04.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e430a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a8d30 0x7f0e3c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e430a8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e430a8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0c4450 con 0x7f0e3c0a9110 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e430a8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c2fb0 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e430a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c154b30 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0e3c0a9110 0x7f0e3c0c4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37444/0 (socket says 172.21.15.98:37444) 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3bfff700 1 -- 172.21.15.98:0/1621104264 learned_addr learned my addr 172.21.15.98:0/1621104264 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 --2- 172.21.15.98:0/1621104264 >> v2:172.21.15.98:3300/0 conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32854/0 (socket says 172.21.15.98:32854) 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e40e44700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a8d30 0x7f0e3c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 -- 172.21.15.98:0/1621104264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a8d30 msgr2=0x7f0e3c1544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a8d30 0x7f0e3c1544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 -- 172.21.15.98:0/1621104264 >> v1:172.21.15.98:6789/0 conn(0x7f0e3c0a9110 legacy=0x7f0e3c0c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 -- 172.21.15.98:0/1621104264 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c154e10 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3b7fe700 1 -- 172.21.15.98:0/1621104264 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985226556 0 0) 0x7f0e3c0c4450 con 0x7f0e3c0a9110 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e41645700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f0e34009e60 tx=0x7f0e34009780).ready entity=mon.0 client_cookie=f0b540a4d47ce7bd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3b7fe700 1 -- 172.21.15.98:0/1621104264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400e070 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3b7fe700 1 -- 172.21.15.98:0/1621104264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400bb60 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.302+0000 7f0e3b7fe700 1 -- 172.21.15.98:0/1621104264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012410 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 -- 172.21.15.98:0/1621104264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0aa7a0 msgr2=0x7f0e3c0aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f0e34009e60 tx=0x7f0e34009780).stop 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 -- 172.21.15.98:0/1621104264 shutdown_connections 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c0aaba0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 --2- 172.21.15.98:0/1621104264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a8d30 0x7f0e3c1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 -- 172.21.15.98:0/1621104264 >> 172.21.15.98:0/1621104264 conn(0x7f0e3c0c5320 msgr2=0x7f0e3c0c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 -- 172.21.15.98:0/1621104264 shutdown_connections 2023-08-22T00:25:04.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.303+0000 7f0e430a8700 1 -- 172.21.15.98:0/1621104264 wait complete. 2023-08-22T00:25:04.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.304+0000 7f0e430a8700 1 Processor -- start 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.304+0000 7f0e430a8700 1 -- start start 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a9110 0x7f0e3c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c1430 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c0540 con 0x7f0e3c0aa7a0 2023-08-22T00:25:04.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e430a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c0820 con 0x7f0e3c0a9110 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e40e44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e40e44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32858/0 (socket says 172.21.15.98:32858) 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e40e44700 1 -- 172.21.15.98:0/2433072547 learned_addr learned my addr 172.21.15.98:0/2433072547 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e3bfff700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a9110 0x7f0e3c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.305+0000 7f0e41645700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 -- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a9110 msgr2=0x7f0e3c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a9110 0x7f0e3c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 -- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c0aa7a0 msgr2=0x7f0e3c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 -- 172.21.15.98:0/2433072547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009a20 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e40e44700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f0e3000e930 tx=0x7f0e30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30012600 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30012760 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30012ae0 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c0c0b00 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.306+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0c10c0 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.307+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c0c1710 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.308+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f0e3001b400 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.308+0000 7f0e38ff9700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 0x7f0e20061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.308+0000 7f0e3bfff700 1 -- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 msgr2=0x7f0e20061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:04.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.308+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f0e3007a7c0 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.308+0000 7f0e3bfff700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 0x7f0e20061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:04.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.312+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e3004b6c0 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.482+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e3c047480 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.483+0000 7f0e38ff9700 1 -- 172.21.15.98:0/2433072547 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+17520 (secure 0 0 0) 0x7f0e3004ece0 con 0x7f0e3c0a8d30 2023-08-22T00:25:04.484 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:04.484 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":137,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:23.621215+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/2154899392":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6833/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6832/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:0/3091707063":"2023-08-23T00:24:23.621175+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:04.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 msgr2=0x7f0e20061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:04.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 0x7f0e20061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 msgr2=0x7f0e3c1640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f0e3000e930 tx=0x7f0e30009060).stop 2023-08-22T00:25:04.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 shutdown_connections 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c0aa7a0 0x7f0e3c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c0a8d30 0x7f0e3c1640f0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0e2005f050 0x7f0e20061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 --2- 172.21.15.98:0/2433072547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c0a9110 0x7f0e3c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.485+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 >> 172.21.15.98:0/2433072547 conn(0x7f0e3c0c5320 msgr2=0x7f0e3c155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.486+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 shutdown_connections 2023-08-22T00:25:04.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.486+0000 7f0e430a8700 1 -- 172.21.15.98:0/2433072547 wait complete. 2023-08-22T00:25:04.498 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:04.497+0000 7f6ed1297680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:04.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:24:05.390179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:24:05.791512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:25:04.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:25:04.556 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:04.555+0000 7f9f4e3d4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:04.570 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:04.569+0000 7f6ed1297680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:04.629 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:04.628+0000 7f9f4e3d4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:04.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 Processor -- start 2023-08-22T00:25:04.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 -- start start 2023-08-22T00:25:04.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f734c1519f0 0x7f734c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 0x7f734c0c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0c3c00 con 0x7f734c0be8e0 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0c4780 con 0x7f734c1519f0 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.642+0000 7f7352c15700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0c3ee0 con 0x7f734c0c3180 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73511b2700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f734c0be8e0 0x7f734c157ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37452/0 (socket says 172.21.15.98:37452) 2023-08-22T00:25:04.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73511b2700 1 -- 172.21.15.98:0/3790310020 learned_addr learned my addr 172.21.15.98:0/3790310020 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734bfff700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 0x7f734c0c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 --2- 172.21.15.98:0/3790310020 >> v2:172.21.15.118:3300/0 conn(0x7f734c1519f0 0x7f734c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756705265 0 0) 0x7f734c0c3c00 con 0x7f734c0be8e0 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c0033f0 con 0x7f734c0be8e0 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 -- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 msgr2=0x7f734c0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:04.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 0x7f734c0c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 -- 172.21.15.98:0/3790310020 >> v1:172.21.15.98:6789/0 conn(0x7f734c0be8e0 legacy=0x7f734c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106465081 0 0) 0x7f733c0033f0 con 0x7f734c0be8e0 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 -- 172.21.15.98:0/3790310020 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0c41c0 con 0x7f734c1519f0 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734bfff700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 0x7f734c0c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f73509b1700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c1519f0 0x7f734c151dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f7340009760 tx=0x7f7340009060).ready entity=mon.1 client_cookie=7516cc8983433c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440017f0 con 0x7f734c1519f0 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340011400 con 0x7f734c1519f0 2023-08-22T00:25:04.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.643+0000 7f734b7fe700 1 -- 172.21.15.98:0/3790310020 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340011780 con 0x7f734c1519f0 2023-08-22T00:25:04.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 -- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c1519f0 msgr2=0x7f734c151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c1519f0 0x7f734c151dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f7340009760 tx=0x7f7340009060).stop 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 -- 172.21.15.98:0/3790310020 shutdown_connections 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c1519f0 0x7f734c151dd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 --2- 172.21.15.98:0/3790310020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0c3180 0x7f734c0c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 -- 172.21.15.98:0/3790310020 >> 172.21.15.98:0/3790310020 conn(0x7f734c0c5ea0 msgr2=0x7f734c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 -- 172.21.15.98:0/3790310020 shutdown_connections 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.644+0000 7f7352c15700 1 -- 172.21.15.98:0/3790310020 wait complete. 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.645+0000 7f7352c15700 1 Processor -- start 2023-08-22T00:25:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.645+0000 7f7352c15700 1 -- start start 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 0x7f734c0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 0x7f734c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 0x7f734c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1655a0 con 0x7f734c1519f0 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0ab110 con 0x7f734c0c3180 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f7352c15700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c164720 con 0x7f734c0be8e0 2023-08-22T00:25:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f73511b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 0x7f734c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f73509b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 0x7f734c0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f734bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 0x7f734c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f73509b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 0x7f734c0aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:42760/0 (socket says 172.21.15.98:42760) 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.646+0000 7f73509b1700 1 -- 172.21.15.98:0/3370484811 learned_addr learned my addr 172.21.15.98:0/3370484811 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 -- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 msgr2=0x7f734c0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 0x7f734c0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 -- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 msgr2=0x7f734c14c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 0x7f734c14c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 -- 172.21.15.98:0/3370484811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73380092a0 con 0x7f734c1519f0 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f734bfff700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 0x7f734c14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f73511b2700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 0x7f734c152400 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f734400cb90 tx=0x7f7344001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344002090 con 0x7f734c1519f0 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344004c40 con 0x7f734c1519f0 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73400092a0 con 0x7f734c1519f0 2023-08-22T00:25:04.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344007170 con 0x7f734c1519f0 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.647+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c164ce0 con 0x7f734c1519f0 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.648+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c0c44a0 con 0x7f734c1519f0 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.648+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f73440074e0 con 0x7f734c1519f0 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.649+0000 7f7348ff9700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 0x7f7330061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.649+0000 7f73509b1700 1 -- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 msgr2=0x7f7330061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.649+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f734407a020 con 0x7f734c1519f0 2023-08-22T00:25:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.649+0000 7f73509b1700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 0x7f7330061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.653+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f734404af80 con 0x7f734c1519f0 2023-08-22T00:25:04.757 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:04.756+0000 7f6ed1297680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.821+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f734c046c20 con 0x7f734c1519f0 2023-08-22T00:25:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.821+0000 7f7348ff9700 1 -- 172.21.15.98:0/3370484811 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v137) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7344007810 con 0x7f734c1519f0 2023-08-22T00:25:04.822 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:25:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 msgr2=0x7f7330061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 0x7f7330061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 msgr2=0x7f734c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 0x7f734c152400 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f734400cb90 tx=0x7f7344001980).stop 2023-08-22T00:25:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 shutdown_connections 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f733005f050 0x7f7330061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c0be8e0 0x7f734c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f734c1519f0 0x7f734c152400 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 --2- 172.21.15.98:0/3370484811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c0c3180 0x7f734c14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 >> 172.21.15.98:0/3370484811 conn(0x7f734c0c5ea0 msgr2=0x7f734c0c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.823+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 shutdown_connections 2023-08-22T00:25:04.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.824+0000 7f7352c15700 1 -- 172.21.15.98:0/3370484811 wait complete. 2023-08-22T00:25:04.826 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:04.825+0000 7f9f4e3d4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:04.836 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:25:04.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.962+0000 7f5234652700 1 Processor -- start 2023-08-22T00:25:04.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.962+0000 7f5234652700 1 -- start start 2023-08-22T00:25:04.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f522c0688b0 0x7f522c152190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f522c066cd0 0x7f522c0be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0bf260 con 0x7f522c0688b0 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0c33b0 con 0x7f522c066cd0 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5234652700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c153160 con 0x7f522c152680 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f522c0688b0 0x7f522c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f522c0688b0 0x7f522c152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32882/0 (socket says 172.21.15.98:32882) 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 -- 172.21.15.98:0/3538430869 learned_addr learned my addr 172.21.15.98:0/3538430869 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5231bed700 1 --2- 172.21.15.98:0/3538430869 >> v2:172.21.15.118:3300/0 conn(0x7f522c066cd0 0x7f522c0be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f5232bef700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 -- 172.21.15.98:0/3538430869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 msgr2=0x7f522c0bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0bed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 -- 172.21.15.98:0/3538430869 >> v2:172.21.15.118:3300/0 conn(0x7f522c066cd0 msgr2=0x7f522c0be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 --2- 172.21.15.98:0/3538430869 >> v2:172.21.15.118:3300/0 conn(0x7f522c066cd0 0x7f522c0be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.963+0000 7f52323ee700 1 -- 172.21.15.98:0/3538430869 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c152ba0 con 0x7f522c0688b0 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f52323ee700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c152190 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f522c069c60 tx=0x7f52280090f0).ready entity=mon.0 client_cookie=9c7bd5799a0b8f53 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f52313ec700 1 -- 172.21.15.98:0/3538430869 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800b600 con 0x7f522c0688b0 2023-08-22T00:25:04.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f52313ec700 1 -- 172.21.15.98:0/3538430869 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800b760 con 0x7f522c0688b0 2023-08-22T00:25:04.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f52313ec700 1 -- 172.21.15.98:0/3538430869 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800bb00 con 0x7f522c0688b0 2023-08-22T00:25:04.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 -- 172.21.15.98:0/3538430869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 msgr2=0x7f522c152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c152190 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f522c069c60 tx=0x7f52280090f0).stop 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 -- 172.21.15.98:0/3538430869 shutdown_connections 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 --2- 172.21.15.98:0/3538430869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c152190 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 --2- 172.21.15.98:0/3538430869 >> v2:172.21.15.118:3300/0 conn(0x7f522c066cd0 0x7f522c0be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 -- 172.21.15.98:0/3538430869 >> 172.21.15.98:0/3538430869 conn(0x7f522c0c5e80 msgr2=0x7f522c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 -- 172.21.15.98:0/3538430869 shutdown_connections 2023-08-22T00:25:04.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.964+0000 7f5234652700 1 -- 172.21.15.98:0/3538430869 wait complete. 2023-08-22T00:25:04.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 Processor -- start 2023-08-22T00:25:04.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 -- start start 2023-08-22T00:25:04.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c066cd0 0x7f522c142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c154340 con 0x7f522c0688b0 2023-08-22T00:25:04.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1551a0 con 0x7f522c066cd0 2023-08-22T00:25:04.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5234652700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0c15b0 con 0x7f522c152680 2023-08-22T00:25:04.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5231bed700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5231bed700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32890/0 (socket says 172.21.15.98:32890) 2023-08-22T00:25:04.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.966+0000 7f5231bed700 1 -- 172.21.15.98:0/1537823475 learned_addr learned my addr 172.21.15.98:0/1537823475 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:04.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f52323ee700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c066cd0 0x7f522c142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5232bef700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 -- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 msgr2=0x7f522c0c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 -- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c066cd0 msgr2=0x7f522c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c066cd0 0x7f522c142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 -- 172.21.15.98:0/1537823475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009370 con 0x7f522c0688b0 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5231bed700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f521c00d8c0 tx=0x7f521c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:04.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00f520 con 0x7f522c0688b0 2023-08-22T00:25:04.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c00f680 con 0x7f522c0688b0 2023-08-22T00:25:04.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c154590 con 0x7f522c0688b0 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00fa00 con 0x7f522c0688b0 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.967+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c154b50 con 0x7f522c0688b0 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.968+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c155350 con 0x7f522c0688b0 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.969+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f521c013480 con 0x7f522c0688b0 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.969+0000 7f52227fc700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 0x7f5210061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:04.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.969+0000 7f52323ee700 1 -- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 msgr2=0x7f5210061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:04.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.969+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f521c079db0 con 0x7f522c0688b0 2023-08-22T00:25:04.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.969+0000 7f52323ee700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 0x7f5210061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:04.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:04.973+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f521c04acb0 con 0x7f522c0688b0 2023-08-22T00:25:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.140+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f522c154ef0 con 0x7f522c0688b0 2023-08-22T00:25:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.141+0000 7f52227fc700 1 -- 172.21.15.98:0/1537823475 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v137) v1 ==== 92+0+10 (secure 0 0 0) 0x7f521c04e2d0 con 0x7f522c0688b0 2023-08-22T00:25:05.141 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:25:05.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 msgr2=0x7f5210061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:05.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 0x7f5210061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 msgr2=0x7f522c0ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f521c00d8c0 tx=0x7f521c008040).stop 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 shutdown_connections 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f521005f050 0x7f5210061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f522c152680 0x7f522c0c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c066cd0 0x7f522c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 --2- 172.21.15.98:0/1537823475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f522c0688b0 0x7f522c0ac160 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 >> 172.21.15.98:0/1537823475 conn(0x7f522c0c5e80 msgr2=0x7f522c14ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 shutdown_connections 2023-08-22T00:25:05.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.143+0000 7f5234652700 1 -- 172.21.15.98:0/1537823475 wait complete. 2023-08-22T00:25:05.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:25:05.176 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.176+0000 7f6ed1297680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:05.274 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.273+0000 7f9f4e3d4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.276+0000 7f4d8000f700 1 Processor -- start 2023-08-22T00:25:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.276+0000 7f4d8000f700 1 -- start start 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d8000f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d78154e90 0x7f4d780640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d8000f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4d780a6e50 0x7f4d780645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d8000f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d781560a0 con 0x7f4d78155270 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d8000f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d780c2e10 con 0x7f4d780a6e50 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d8000f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d78155770 con 0x7f4d78154e90 2023-08-22T00:25:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7d5aa700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4d78155270 0x7f4d780a6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37464/0 (socket says 172.21.15.98:37464) 2023-08-22T00:25:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7d5aa700 1 -- 172.21.15.98:0/676116048 learned_addr learned my addr 172.21.15.98:0/676116048 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/676116048 >> v2:172.21.15.98:3300/0 conn(0x7f4d780a6e50 0x7f4d780645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7ddab700 1 --2- 172.21.15.98:0/676116048 >> v2:172.21.15.118:3300/0 conn(0x7f4d78154e90 0x7f4d780640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7cda9700 1 -- 172.21.15.98:0/676116048 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799656917 0 0) 0x7f4d781560a0 con 0x7f4d78155270 2023-08-22T00:25:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7cda9700 1 -- 172.21.15.98:0/676116048 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d640033f0 con 0x7f4d78155270 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/676116048 >> v2:172.21.15.118:3300/0 conn(0x7f4d78154e90 msgr2=0x7f4d780640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/676116048 >> v2:172.21.15.118:3300/0 conn(0x7f4d78154e90 0x7f4d780640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/676116048 >> v1:172.21.15.98:6789/0 conn(0x7f4d78155270 legacy=0x7f4d780a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/676116048 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78155a50 con 0x7f4d780a6e50 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.277+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/676116048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6e50 0x7f4d780645a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f4d7806b600 tx=0x7f4d70009780).ready entity=mon.0 client_cookie=4e0a6fd5663feadd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d7cda9700 1 -- 172.21.15.98:0/676116048 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000e070 con 0x7f4d780a6e50 2023-08-22T00:25:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d7cda9700 1 -- 172.21.15.98:0/676116048 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000bab0 con 0x7f4d780a6e50 2023-08-22T00:25:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d7cda9700 1 -- 172.21.15.98:0/676116048 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000be30 con 0x7f4d780a6e50 2023-08-22T00:25:05.283 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.279+0000 7f6ed1297680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 -- 172.21.15.98:0/676116048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6e50 msgr2=0x7f4d780645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 --2- 172.21.15.98:0/676116048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6e50 0x7f4d780645a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f4d7806b600 tx=0x7f4d70009780).stop 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 -- 172.21.15.98:0/676116048 shutdown_connections 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 --2- 172.21.15.98:0/676116048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6e50 0x7f4d780645a0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 --2- 172.21.15.98:0/676116048 >> v2:172.21.15.118:3300/0 conn(0x7f4d78154e90 0x7f4d780640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 -- 172.21.15.98:0/676116048 >> 172.21.15.98:0/676116048 conn(0x7f4d780c7800 msgr2=0x7f4d780c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 -- 172.21.15.98:0/676116048 shutdown_connections 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.278+0000 7f4d8000f700 1 -- 172.21.15.98:0/676116048 wait complete. 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.279+0000 7f4d8000f700 1 Processor -- start 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.279+0000 7f4d8000f700 1 -- start start 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d780a6e50 0x7f4d78161b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d78154e90 0x7f4d780a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c06e0 con 0x7f4d780a6300 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78167f80 con 0x7f4d78154e90 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d8000f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78168260 con 0x7f4d780a6e50 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d7e5ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d7e5ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32904/0 (socket says 172.21.15.98:32904) 2023-08-22T00:25:05.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/1673022714 learned_addr learned my addr 172.21.15.98:0/1673022714 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d7d5aa700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d78154e90 0x7f4d780a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.280+0000 7f4d7ddab700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d780a6e50 0x7f4d78161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d780a6e50 msgr2=0x7f4d78161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d780a6e50 0x7f4d78161b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d78154e90 msgr2=0x7f4d780a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d78154e90 0x7f4d780a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 -- 172.21.15.98:0/1673022714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009a20 con 0x7f4d780a6300 2023-08-22T00:25:05.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d7e5ac700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f4d70011000 tx=0x7f4d70009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70013e60 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7001d630 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7001d9d0 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d780c0370 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.281+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d780bfff0 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.282+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78069220 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.283+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f4d70003040 con 0x7f4d780a6300 2023-08-22T00:25:05.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.283+0000 7f4d6dffb700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 0x7f4d5c0614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.283+0000 7f4d7ddab700 1 -- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 msgr2=0x7f4d5c0614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:05.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.283+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f4d7007c460 con 0x7f4d780a6300 2023-08-22T00:25:05.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.283+0000 7f4d7ddab700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 0x7f4d5c0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:05.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.287+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d7004d2b0 con 0x7f4d780a6300 2023-08-22T00:25:05.384 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.382+0000 7f9f4e3d4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:05.434 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.433+0000 7f6ed1297680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.456+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d78155d30 con 0x7f4d780a6300 2023-08-22T00:25:05.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.457+0000 7f4d6dffb700 1 -- 172.21.15.98:0/1673022714 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d700508d0 con 0x7f4d780a6300 2023-08-22T00:25:05.459 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:25:05.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 msgr2=0x7f4d5c0614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:05.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 0x7f4d5c0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 msgr2=0x7f4d781674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f4d70011000 tx=0x7f4d70009780).stop 2023-08-22T00:25:05.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 shutdown_connections 2023-08-22T00:25:05.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4d5c05f020 0x7f4d5c0614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d780a6e50 0x7f4d78161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d780a6300 0x7f4d781674c0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 --2- 172.21.15.98:0/1673022714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d78154e90 0x7f4d780a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 >> 172.21.15.98:0/1673022714 conn(0x7f4d780c7800 msgr2=0x7f4d780a9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 shutdown_connections 2023-08-22T00:25:05.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.459+0000 7f4d8000f700 1 -- 172.21.15.98:0/1673022714 wait complete. 2023-08-22T00:25:05.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:25:05.509 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.508+0000 7f6ed1297680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:05.545 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.544+0000 7f9f4e3d4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:05.577 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.576+0000 7f6ed1297680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:05.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.595+0000 7fb5f2af4700 1 Processor -- start 2023-08-22T00:25:05.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.595+0000 7fb5f2af4700 1 -- start start 2023-08-22T00:25:05.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f2af4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 0x7fb5ec0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f2af4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec0a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f2af4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0654c0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f2af4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0be6e0 con 0x7fb5ec150c90 2023-08-22T00:25:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f2af4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0be120 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f0890700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb5ec1508b0 0x7fb5ec1550a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37470/0 (socket says 172.21.15.98:37470) 2023-08-22T00:25:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f0890700 1 -- 172.21.15.98:0/4288936175 learned_addr learned my addr 172.21.15.98:0/4288936175 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5ebfff700 1 --2- 172.21.15.98:0/4288936175 >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 0x7fb5ec0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.596+0000 7fb5f1091700 1 --2- 172.21.15.98:0/4288936175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec0a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5eb7fe700 1 -- 172.21.15.98:0/4288936175 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762272482 0 0) 0x7fb5ec0654c0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5eb7fe700 1 -- 172.21.15.98:0/4288936175 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5dc0033f0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5f1091700 1 -- 172.21.15.98:0/4288936175 >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 msgr2=0x7fb5ec0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5f1091700 1 --2- 172.21.15.98:0/4288936175 >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 0x7fb5ec0c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5f1091700 1 -- 172.21.15.98:0/4288936175 >> v1:172.21.15.98:6789/0 conn(0x7fb5ec1508b0 legacy=0x7fb5ec1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5f1091700 1 -- 172.21.15.98:0/4288936175 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0be400 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5ebfff700 1 --2- 172.21.15.98:0/4288936175 >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 0x7fb5ec0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5f1091700 1 --2- 172.21.15.98:0/4288936175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec0a6740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb5e4009e60 tx=0x7fb5e4009780).ready entity=mon.2 client_cookie=d9f0f7e3ce84c3f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5eb7fe700 1 -- 172.21.15.98:0/4288936175 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400e070 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5eb7fe700 1 -- 172.21.15.98:0/4288936175 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e400bab0 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.597+0000 7fb5eb7fe700 1 -- 172.21.15.98:0/4288936175 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400be30 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 -- 172.21.15.98:0/4288936175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 msgr2=0x7fb5ec0a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/4288936175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec0a6740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb5e4009e60 tx=0x7fb5e4009780).stop 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 -- 172.21.15.98:0/4288936175 shutdown_connections 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/4288936175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec0a6740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/4288936175 >> v2:172.21.15.118:3300/0 conn(0x7fb5ec150c90 0x7fb5ec0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 -- 172.21.15.98:0/4288936175 >> 172.21.15.98:0/4288936175 conn(0x7fb5ec0c7820 msgr2=0x7fb5ec0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 -- 172.21.15.98:0/4288936175 shutdown_connections 2023-08-22T00:25:05.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.598+0000 7fb5f2af4700 1 -- 172.21.15.98:0/4288936175 wait complete. 2023-08-22T00:25:05.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.599+0000 7fb5f2af4700 1 Processor -- start 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.599+0000 7fb5f2af4700 1 -- start start 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5ec150c90 0x7fb5ec153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1414d0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec14ce60 con 0x7fb5ec150c90 2023-08-22T00:25:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f2af4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec14fee0 con 0x7fb5ec0c3d90 2023-08-22T00:25:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32916/0 (socket says 172.21.15.98:32916) 2023-08-22T00:25:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 -- 172.21.15.98:0/730071079 learned_addr learned my addr 172.21.15.98:0/730071079 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f0890700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5f1091700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5ec150c90 0x7fb5ec153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 -- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 msgr2=0x7fb5ec1402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec1402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 -- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5ec150c90 msgr2=0x7fb5ec153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5ec150c90 0x7fb5ec153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 -- 172.21.15.98:0/730071079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80092a0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.600+0000 7fb5ebfff700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fb5d800ea20 tx=0x7fb5d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.601+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800ee60 con 0x7fb5ec1508b0 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.601+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800c850 con 0x7fb5ec1508b0 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.601+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e4009a20 con 0x7fb5ec1508b0 2023-08-22T00:25:05.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.601+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800cbd0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.601+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec141160 con 0x7fb5ec1508b0 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec0691b0 con 0x7fb5ec1508b0 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fb5d801b400 con 0x7fb5ec1508b0 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5e8ff9700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 0x7fb5d0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5f0890700 1 -- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 msgr2=0x7fb5d0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7fb5d807a880 con 0x7fb5ec1508b0 2023-08-22T00:25:05.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.602+0000 7fb5f0890700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 0x7fb5d0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:05.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.606+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5d804b840 con 0x7fb5ec1508b0 2023-08-22T00:25:05.626 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.625+0000 7f9f4e3d4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:05.696 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.695+0000 7f9f4e3d4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:05.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.776+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5ec046c20 con 0x7fb5ec1508b0 2023-08-22T00:25:05.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.777+0000 7fb5e8ff9700 1 -- 172.21.15.98:0/730071079 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5d804ee60 con 0x7fb5ec1508b0 2023-08-22T00:25:05.778 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:25:05.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 msgr2=0x7fb5d0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:05.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 0x7fb5d0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 msgr2=0x7fb5ec14d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fb5d800ea20 tx=0x7fb5d8009060).stop 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 shutdown_connections 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb5d005f050 0x7fb5d0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5ec0c3d90 0x7fb5ec1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5ec150c90 0x7fb5ec153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 --2- 172.21.15.98:0/730071079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5ec1508b0 0x7fb5ec14d4d0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.778+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 >> 172.21.15.98:0/730071079 conn(0x7fb5ec0c7820 msgr2=0x7fb5ec14bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.779+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 shutdown_connections 2023-08-22T00:25:05.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.779+0000 7fb5f2af4700 1 -- 172.21.15.98:0/730071079 wait complete. 2023-08-22T00:25:05.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:05.830 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:05.830+0000 7f6ed1297680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:05.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.911+0000 7f6ade2c0700 1 Processor -- start 2023-08-22T00:25:05.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.911+0000 7f6ade2c0700 1 -- start start 2023-08-22T00:25:05.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.911+0000 7f6ade2c0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ad8154c00 0x7f6ad814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ade2c0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad80c17b0 con 0x7f6ad80c61a0 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ade2c0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad8155260 con 0x7f6ad814e0d0 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ade2c0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80bf9e0 con 0x7f6ad8154c00 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6adc85d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ad8154c00 0x7f6ad814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6ad80c61a0 0x7f6ad81544f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37474/0 (socket says 172.21.15.98:37474) 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad77fe700 1 -- 172.21.15.98:0/1739148198 learned_addr learned my addr 172.21.15.98:0/1739148198 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6adc85d700 1 -- 172.21.15.98:0/1739148198 >> v1:172.21.15.118:6789/0 conn(0x7f6ad814e0d0 legacy=0x7f6ad80c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6adc85d700 1 -- 172.21.15.98:0/1739148198 >> v1:172.21.15.98:6789/0 conn(0x7f6ad80c61a0 legacy=0x7f6ad81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6adc85d700 1 -- 172.21.15.98:0/1739148198 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80bfcc0 con 0x7f6ad8154c00 2023-08-22T00:25:05.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad6ffd700 1 -- 172.21.15.98:0/1739148198 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682382694 0 0) 0x7f6ad80c17b0 con 0x7f6ad80c61a0 2023-08-22T00:25:05.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6adc85d700 1 --2- 172.21.15.98:0/1739148198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad8154c00 0x7f6ad814e4b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6ad0009e60 tx=0x7f6ad0009780).ready entity=mon.0 client_cookie=2b71c55946e04696 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad6ffd700 1 -- 172.21.15.98:0/1739148198 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000e070 con 0x7f6ad8154c00 2023-08-22T00:25:05.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad6ffd700 1 -- 172.21.15.98:0/1739148198 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000bc30 con 0x7f6ad8154c00 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.912+0000 7f6ad6ffd700 1 -- 172.21.15.98:0/1739148198 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0012410 con 0x7f6ad8154c00 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 -- 172.21.15.98:0/1739148198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad8154c00 msgr2=0x7f6ad814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/1739148198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad8154c00 0x7f6ad814e4b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6ad0009e60 tx=0x7f6ad0009780).stop 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 -- 172.21.15.98:0/1739148198 shutdown_connections 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/1739148198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad8154c00 0x7f6ad814e4b0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 -- 172.21.15.98:0/1739148198 >> 172.21.15.98:0/1739148198 conn(0x7f6ad80caa80 msgr2=0x7f6ad80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:05.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 -- 172.21.15.98:0/1739148198 shutdown_connections 2023-08-22T00:25:05.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.913+0000 7f6ade2c0700 1 -- 172.21.15.98:0/1739148198 wait complete. 2023-08-22T00:25:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.914+0000 7f6ade2c0700 1 Processor -- start 2023-08-22T00:25:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.914+0000 7f6ade2c0700 1 -- start start 2023-08-22T00:25:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80c61a0 0x7f6ad81514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ad8154c00 0x7f6ad80ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80c4fd0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80c25a0 con 0x7f6ad80c61a0 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ade2c0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80ae2b0 con 0x7f6ad8154c00 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32936/0 (socket says 172.21.15.98:32936) 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 -- 172.21.15.98:0/4211364704 learned_addr learned my addr 172.21.15.98:0/4211364704 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:05.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6adc85d700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ad8154c00 0x7f6ad80ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad7fff700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80c61a0 0x7f6ad81514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ad8154c00 msgr2=0x7f6ad80ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ad8154c00 0x7f6ad80ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80c61a0 msgr2=0x7f6ad81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:05.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80c61a0 0x7f6ad81514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:05.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 -- 172.21.15.98:0/4211364704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009a20 con 0x7f6ad814e0d0 2023-08-22T00:25:05.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.915+0000 7f6ad77fe700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f6acc00c460 tx=0x7f6acc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:05.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.916+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0070d0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.916+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc007250 con 0x7f6ad814e0d0 2023-08-22T00:25:05.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.916+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad80ae590 con 0x7f6ad814e0d0 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.916+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007610 con 0x7f6ad814e0d0 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.916+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad80c2840 con 0x7f6ad814e0d0 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad80aeab0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f6acc0059b0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6abffff700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 0x7f6ac4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:05.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6ad7fff700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 msgr2=0x7f6ac4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:05.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f6acc0799f0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.917+0000 7f6ad7fff700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 0x7f6ac4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:05.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:05.925+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ad80aeab0 con 0x7f6ad814e0d0 2023-08-22T00:25:05.968 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:05.967+0000 7f9f4e3d4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:06.017 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:06.017+0000 7f6ed1297680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:06.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.118+0000 7f6ad7fff700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 msgr2=0x7f6ac4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:06.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.118+0000 7f6ad7fff700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 0x7f6ac4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:06.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.134+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad80aeab0 con 0x7f6ad814e0d0 2023-08-22T00:25:06.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.135+0000 7f6abffff700 1 -- 172.21.15.98:0/4211364704 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f6ad80aeab0 con 0x7f6ad814e0d0 2023-08-22T00:25:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:06.137 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:25:06.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 msgr2=0x7f6ac4061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 0x7f6ac4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 msgr2=0x7f6ad814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f6acc00c460 tx=0x7f6acc007e10).stop 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 shutdown_connections 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6ac405f050 0x7f6ac4061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ad8154c00 0x7f6ad80ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80c61a0 0x7f6ad81514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 --2- 172.21.15.98:0/4211364704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad814e0d0 0x7f6ad814c0d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 >> 172.21.15.98:0/4211364704 conn(0x7f6ad80caa80 msgr2=0x7f6ad80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 shutdown_connections 2023-08-22T00:25:06.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.137+0000 7f6ade2c0700 1 -- 172.21.15.98:0/4211364704 wait complete. 2023-08-22T00:25:06.140 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:25:06.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:06.160 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:06.159+0000 7f9f4e3d4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:06.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.268+0000 7f6e111c1700 1 Processor -- start 2023-08-22T00:25:06.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.269+0000 7f6e111c1700 1 -- start start 2023-08-22T00:25:06.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e111c1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e0c0c3050 0x7f6e0c0bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e111c1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6e0c0c3430 0x7f6e0c063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e111c1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c1510d0 con 0x7f6e0c064490 2023-08-22T00:25:06.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e111c1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c151d50 con 0x7f6e0c0c3430 2023-08-22T00:25:06.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e111c1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c1513b0 con 0x7f6e0c0c3050 2023-08-22T00:25:06.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6e0c0c3430 0x7f6e0c063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6e0c0c3430 0x7f6e0c063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32940/0 (socket says 172.21.15.98:32940) 2023-08-22T00:25:06.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 -- 172.21.15.98:0/291015873 learned_addr learned my addr 172.21.15.98:0/291015873 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:06.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0ad9d700 1 --2- 172.21.15.98:0/291015873 >> v2:172.21.15.118:3300/0 conn(0x7f6e0c0c3050 0x7f6e0c0bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 -- 172.21.15.98:0/291015873 >> v2:172.21.15.118:3300/0 conn(0x7f6e0c0c3050 msgr2=0x7f6e0c0bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:06.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 --2- 172.21.15.98:0/291015873 >> v2:172.21.15.118:3300/0 conn(0x7f6e0c0c3050 0x7f6e0c0bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 -- 172.21.15.98:0/291015873 >> v1:172.21.15.118:6789/0 conn(0x7f6e0c064490 legacy=0x7f6e0c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.270+0000 7f6e0a59c700 1 -- 172.21.15.98:0/291015873 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c151690 con 0x7f6e0c0c3430 2023-08-22T00:25:06.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e0a59c700 1 --2- 172.21.15.98:0/291015873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c0c3430 0x7f6e0c063fa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f6e0c0676c0 tx=0x7f6e000090f0).ready entity=mon.0 client_cookie=6e5175581299acd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:06.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e09d9b700 1 -- 172.21.15.98:0/291015873 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000b520 con 0x7f6e0c0c3430 2023-08-22T00:25:06.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e09d9b700 1 -- 172.21.15.98:0/291015873 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0000b680 con 0x7f6e0c0c3430 2023-08-22T00:25:06.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e09d9b700 1 -- 172.21.15.98:0/291015873 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000ba00 con 0x7f6e0c0c3430 2023-08-22T00:25:06.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e111c1700 1 -- 172.21.15.98:0/291015873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c0c3430 msgr2=0x7f6e0c063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.271+0000 7f6e111c1700 1 --2- 172.21.15.98:0/291015873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c0c3430 0x7f6e0c063fa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f6e0c0676c0 tx=0x7f6e000090f0).stop 2023-08-22T00:25:06.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 -- 172.21.15.98:0/291015873 shutdown_connections 2023-08-22T00:25:06.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 --2- 172.21.15.98:0/291015873 >> v2:172.21.15.118:3300/0 conn(0x7f6e0c0c3050 0x7f6e0c0bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 --2- 172.21.15.98:0/291015873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c0c3430 0x7f6e0c063fa0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 -- 172.21.15.98:0/291015873 >> 172.21.15.98:0/291015873 conn(0x7f6e0c0c3980 msgr2=0x7f6e0c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 -- 172.21.15.98:0/291015873 shutdown_connections 2023-08-22T00:25:06.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.272+0000 7f6e111c1700 1 -- 172.21.15.98:0/291015873 wait complete. 2023-08-22T00:25:06.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.274+0000 7f6e111c1700 1 Processor -- start 2023-08-22T00:25:06.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.274+0000 7f6e111c1700 1 -- start start 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e0c0c3050 0x7f6e0c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e0c0c3430 0x7f6e0c165b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a4d70 con 0x7f6e0c064490 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a7f80 con 0x7f6e0c0c3050 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e111c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a8260 con 0x7f6e0c0c3430 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32948/0 (socket says 172.21.15.98:32948) 2023-08-22T00:25:06.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 -- 172.21.15.98:0/2036677667 learned_addr learned my addr 172.21.15.98:0/2036677667 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:06.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0a59c700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e0c0c3050 0x7f6e0c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0b59e700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e0c0c3430 0x7f6e0c165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 -- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e0c0c3430 msgr2=0x7f6e0c165b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e0c0c3430 0x7f6e0c165b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 -- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e0c0c3050 msgr2=0x7f6e0c0aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e0c0c3050 0x7f6e0c0aa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 -- 172.21.15.98:0/2036677667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009370 con 0x7f6e0c064490 2023-08-22T00:25:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.275+0000 7f6e0ad9d700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f6dfc00e950 tx=0x7f6dfc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.276+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc012600 con 0x7f6e0c064490 2023-08-22T00:25:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.276+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc012760 con 0x7f6e0c064490 2023-08-22T00:25:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.276+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc012ae0 con 0x7f6e0c064490 2023-08-22T00:25:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.276+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c0a8540 con 0x7f6e0c064490 2023-08-22T00:25:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.276+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0a7bc0 con 0x7f6e0c064490 2023-08-22T00:25:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.277+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c0a5050 con 0x7f6e0c064490 2023-08-22T00:25:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.277+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f6dfc01b400 con 0x7f6e0c064490 2023-08-22T00:25:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.278+0000 7f6df2ffd700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 0x7f6df8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.278+0000 7f6e0a59c700 1 -- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 msgr2=0x7f6df8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.278+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f6dfc07a980 con 0x7f6e0c064490 2023-08-22T00:25:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.278+0000 7f6e0a59c700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 0x7f6df8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.282+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dfc04b820 con 0x7f6e0c064490 2023-08-22T00:25:06.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.452+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0c047480 con 0x7f6e0c064490 2023-08-22T00:25:06.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.453+0000 7f6df2ffd700 1 -- 172.21.15.98:0/2036677667 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+17520 (secure 0 0 0) 0x7f6dfc016090 con 0x7f6e0c064490 2023-08-22T00:25:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:06.459 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":137,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:24:23.621215+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/2154899392":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6833/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6832/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:0/3091707063":"2023-08-23T00:24:23.621175+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:06.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 msgr2=0x7f6df8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:06.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 0x7f6df8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 msgr2=0x7f6e0c0a9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f6dfc00e950 tx=0x7f6dfc009060).stop 2023-08-22T00:25:06.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 shutdown_connections 2023-08-22T00:25:06.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6df805f050 0x7f6df8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e0c0c3430 0x7f6e0c165b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0c064490 0x7f6e0c0a9190 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 --2- 172.21.15.98:0/2036677667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e0c0c3050 0x7f6e0c0aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 >> 172.21.15.98:0/2036677667 conn(0x7f6e0c0c3980 msgr2=0x7f6e0c0c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 shutdown_connections 2023-08-22T00:25:06.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.455+0000 7f6e111c1700 1 -- 172.21.15.98:0/2036677667 wait complete. 2023-08-22T00:25:06.471 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:25:06.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:06.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.626+0000 7f7cd0f63700 1 Processor -- start 2023-08-22T00:25:06.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.626+0000 7f7cd0f63700 1 -- start start 2023-08-22T00:25:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 0x7f7ccc0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc151030 0x7f7ccc151480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc0645b0 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc063fa0 con 0x7f7ccc150c50 2023-08-22T00:25:06.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cd0f63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc151f30 con 0x7f7ccc151030 2023-08-22T00:25:06.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cc9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cc9d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32964/0 (socket says 172.21.15.98:32964) 2023-08-22T00:25:06.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/2067010403 learned_addr learned my addr 172.21.15.98:0/2067010403 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:06.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7cca59c700 1 --2- 172.21.15.98:0/2067010403 >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 0x7f7ccc0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.627+0000 7f7ccad9d700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc151030 0x7f7ccc151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/2067010403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc151030 msgr2=0x7f7ccc151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc151030 0x7f7ccc151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/2067010403 >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 msgr2=0x7f7ccc0c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/2067010403 >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 0x7f7ccc0c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/2067010403 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc152210 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cca59c700 1 --2- 172.21.15.98:0/2067010403 >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 0x7f7ccc0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f7ccc0c5540 tx=0x7f7cc00090f0).ready entity=mon.0 client_cookie=21d1b95298756f56 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc959a700 1 -- 172.21.15.98:0/2067010403 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000b600 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc959a700 1 -- 172.21.15.98:0/2067010403 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000b760 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.628+0000 7f7cc959a700 1 -- 172.21.15.98:0/2067010403 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000bae0 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 -- 172.21.15.98:0/2067010403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc0bc6d0 msgr2=0x7f7ccc0c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f7ccc0c5540 tx=0x7f7cc00090f0).stop 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 -- 172.21.15.98:0/2067010403 shutdown_connections 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc151030 0x7f7ccc151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/2067010403 >> v2:172.21.15.118:3300/0 conn(0x7f7ccc150c50 0x7f7ccc0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/2067010403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0c39d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 -- 172.21.15.98:0/2067010403 >> 172.21.15.98:0/2067010403 conn(0x7f7ccc0c7770 msgr2=0x7f7ccc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 -- 172.21.15.98:0/2067010403 shutdown_connections 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.629+0000 7f7cd0f63700 1 -- 172.21.15.98:0/2067010403 wait complete. 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.630+0000 7f7cd0f63700 1 Processor -- start 2023-08-22T00:25:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.630+0000 7f7cd0f63700 1 -- start start 2023-08-22T00:25:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ccc151030 0x7f7ccc1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0aa0e0 con 0x7f7ccc150c50 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0a8900 con 0x7f7ccc151030 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0a8be0 con 0x7f7ccc0bc6d0 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32966/0 (socket says 172.21.15.98:32966) 2023-08-22T00:25:06.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/585156033 learned_addr learned my addr 172.21.15.98:0/585156033 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7ccad9d700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ccc151030 0x7f7ccc1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cca59c700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc0bc6d0 msgr2=0x7f7ccc0a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ccc151030 msgr2=0x7f7ccc1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ccc151030 0x7f7ccc1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 -- 172.21.15.98:0/585156033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009370 con 0x7f7ccc150c50 2023-08-22T00:25:06.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cc9d9b700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f7cc0009130 tx=0x7f7cc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:06.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000b8d0 con 0x7f7ccc150c50 2023-08-22T00:25:06.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000ba30 con 0x7f7ccc150c50 2023-08-22T00:25:06.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc0a8ec0 con 0x7f7ccc150c50 2023-08-22T00:25:06.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.631+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc001c670 con 0x7f7ccc150c50 2023-08-22T00:25:06.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.632+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc1468e0 con 0x7f7ccc150c50 2023-08-22T00:25:06.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.632+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc0a8760 con 0x7f7ccc150c50 2023-08-22T00:25:06.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.633+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f7cc001caa0 con 0x7f7ccc150c50 2023-08-22T00:25:06.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.633+0000 7f7cba7fc700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 0x7f7cac0614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.634+0000 7f7cca59c700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 msgr2=0x7f7cac0614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:06.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.634+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f7cc007bbe0 con 0x7f7ccc150c50 2023-08-22T00:25:06.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.634+0000 7f7cca59c700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 0x7f7cac0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:06.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.638+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ccc0a8760 con 0x7f7ccc150c50 2023-08-22T00:25:06.669 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:06.668+0000 7f6ed1297680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:06.741 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:06.738+0000 7f6ed1297680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:06.813 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:06.813+0000 7f6ed1297680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:06.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.835+0000 7f7cca59c700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 msgr2=0x7f7cac0614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:06.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.835+0000 7f7cca59c700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 0x7f7cac0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:06.849 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:06.848+0000 7f9f4e3d4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:06.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.848+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ccc0a8760 con 0x7f7ccc150c50 2023-08-22T00:25:06.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.849+0000 7f7cba7fc700 1 -- 172.21.15.98:0/585156033 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f7ccc0a8760 con 0x7f7ccc150c50 2023-08-22T00:25:06.853 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:06.853 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:25:06.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 msgr2=0x7f7cac0614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:06.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 0x7f7cac0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 msgr2=0x7f7ccc14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f7cc0009130 tx=0x7f7cc0017000).stop 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 shutdown_connections 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cac05f020 0x7f7cac0614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ccc0bc6d0 0x7f7ccc0a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ccc151030 0x7f7ccc1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 --2- 172.21.15.98:0/585156033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc150c50 0x7f7ccc14fb40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 >> 172.21.15.98:0/585156033 conn(0x7f7ccc0c7770 msgr2=0x7f7ccc0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 shutdown_connections 2023-08-22T00:25:06.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.851+0000 7f7cd0f63700 1 -- 172.21.15.98:0/585156033 wait complete. 2023-08-22T00:25:06.856 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:25:06.865 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:06.924 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:06.923+0000 7f9f4e3d4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:06.960 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:06.960+0000 7f6ed1297680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:06.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.984+0000 7f1596c72700 1 Processor -- start 2023-08-22T00:25:06.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.984+0000 7f1596c72700 1 -- start start 2023-08-22T00:25:06.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1596c72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 0x7f15900c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1596c72700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 0x7f15900c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1596c72700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15900645b0 con 0x7f1590151030 2023-08-22T00:25:06.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1596c72700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1590063fa0 con 0x7f15900bc6d0 2023-08-22T00:25:06.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1596c72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590151f30 con 0x7f1590150c50 2023-08-22T00:25:06.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 0x7f15900c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f158ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 0x7f15900c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f159520f700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1590151030 0x7f15901514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:46748/0 (socket says 172.21.15.98:46748) 2023-08-22T00:25:06.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f159520f700 1 -- 172.21.15.98:0/152751450 learned_addr learned my addr 172.21.15.98:0/152751450 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:06.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 -- 172.21.15.98:0/152751450 >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 msgr2=0x7f15900c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:06.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 --2- 172.21.15.98:0/152751450 >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 0x7f15900c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 -- 172.21.15.98:0/152751450 >> v1:172.21.15.118:6789/0 conn(0x7f1590151030 legacy=0x7f15901514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 -- 172.21.15.98:0/152751450 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590152210 con 0x7f1590150c50 2023-08-22T00:25:06.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f158f7fe700 1 -- 172.21.15.98:0/152751450 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260751779 0 0) 0x7f15900645b0 con 0x7f1590151030 2023-08-22T00:25:06.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f158ffff700 1 --2- 172.21.15.98:0/152751450 >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 0x7f15900c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:06.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.985+0000 7f1594a0e700 1 --2- 172.21.15.98:0/152751450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 0x7f15900c34e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1584009760 tx=0x7f1584009060).ready entity=mon.2 client_cookie=c9363f976c3c472d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:06.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f158f7fe700 1 -- 172.21.15.98:0/152751450 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400f510 con 0x7f1590150c50 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f158f7fe700 1 -- 172.21.15.98:0/152751450 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400f670 con 0x7f1590150c50 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f158f7fe700 1 -- 172.21.15.98:0/152751450 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400f9f0 con 0x7f1590150c50 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 -- 172.21.15.98:0/152751450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 msgr2=0x7f15900c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 --2- 172.21.15.98:0/152751450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 0x7f15900c34e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1584009760 tx=0x7f1584009060).stop 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 -- 172.21.15.98:0/152751450 shutdown_connections 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 --2- 172.21.15.98:0/152751450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1590150c50 0x7f15900c34e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 --2- 172.21.15.98:0/152751450 >> v2:172.21.15.118:3300/0 conn(0x7f15900bc6d0 0x7f15900c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 -- 172.21.15.98:0/152751450 >> 172.21.15.98:0/152751450 conn(0x7f15900c7770 msgr2=0x7f15900c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:06.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 -- 172.21.15.98:0/152751450 shutdown_connections 2023-08-22T00:25:06.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.986+0000 7f1596c72700 1 -- 172.21.15.98:0/152751450 wait complete. 2023-08-22T00:25:06.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.988+0000 7f1596c72700 1 Processor -- start 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.988+0000 7f1596c72700 1 -- start start 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15900bc6d0 0x7f15900bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 0x7f15900abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 0x7f15900ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900ad2a0 con 0x7f1590150c50 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900ac690 con 0x7f1590151030 2023-08-22T00:25:06.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1596c72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900ac970 con 0x7f15900bc6d0 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f158ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 0x7f15900abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f158ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 0x7f15900abb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32978/0 (socket says 172.21.15.98:32978) 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 0x7f15900ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f1594a0e700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15900bc6d0 0x7f15900bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f158ffff700 1 -- 172.21.15.98:0/79360875 learned_addr learned my addr 172.21.15.98:0/79360875 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15900bc6d0 msgr2=0x7f15900bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15900bc6d0 0x7f15900bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:06.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 msgr2=0x7f15900abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 0x7f15900abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 -- 172.21.15.98:0/79360875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0092a0 con 0x7f1590151030 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.989+0000 7f159520f700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 0x7f15900ac030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f158800c810 tx=0x7f1588007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.990+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588005d30 con 0x7f1590151030 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.990+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588005e90 con 0x7f1590151030 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.990+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15840092a0 con 0x7f1590151030 2023-08-22T00:25:07.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.990+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588007300 con 0x7f1590151030 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.990+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15900acf30 con 0x7f1590151030 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.991+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15900ad450 con 0x7f1590151030 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.991+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f15880076f0 con 0x7f1590151030 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.991+0000 7f158cff9700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 0x7f15740614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.992+0000 7f1594a0e700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 msgr2=0x7f15740614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.992+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f1588079e50 con 0x7f1590151030 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.992+0000 7f1594a0e700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 0x7f15740614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:07.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:06.996+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15900ad450 con 0x7f1590151030 2023-08-22T00:25:07.006 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.005+0000 7f9f4e3d4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:07.032 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:07.031+0000 7f6ed1297680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:07.146 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:07.146+0000 7f6ed1297680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:07.160 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.159+0000 7f9f4e3d4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:07.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.193+0000 7f1594a0e700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 msgr2=0x7f15740614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:07.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.193+0000 7f1594a0e700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 0x7f15740614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:07.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.207+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15900ad410 con 0x7f1590151030 2023-08-22T00:25:07.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.208+0000 7f158cff9700 1 -- 172.21.15.98:0/79360875 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1588018030 con 0x7f1590151030 2023-08-22T00:25:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:07.209 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":49,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:24:06.836967+0000","modified":"2023-08-22T00:24:08.842465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/4166377087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":4166377087},{"type":"v1","addr":"172.21.15.98:6837","nonce":4166377087}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-22T00:25:07.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 msgr2=0x7f15740614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:07.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 0x7f15740614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:07.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 msgr2=0x7f15900ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 0x7f15900ac030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f158800c810 tx=0x7f1588007f90).stop 2023-08-22T00:25:07.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 shutdown_connections 2023-08-22T00:25:07.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f157405f020 0x7f15740614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15900bc6d0 0x7f15900bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1590151030 0x7f15900ac030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 --2- 172.21.15.98:0/79360875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1590150c50 0x7f15900abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 >> 172.21.15.98:0/79360875 conn(0x7f15900c7770 msgr2=0x7f15900a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 shutdown_connections 2023-08-22T00:25:07.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.210+0000 7f1596c72700 1 -- 172.21.15.98:0/79360875 wait complete. 2023-08-22T00:25:07.214 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 49 2023-08-22T00:25:07.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:07.236 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.235+0000 7f9f4e3d4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:07.255 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:07.254+0000 7f6ed1297680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:07.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.341+0000 7f7411751700 1 Processor -- start 2023-08-22T00:25:07.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.341+0000 7f7411751700 1 -- start start 2023-08-22T00:25:07.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7411751700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f740c151cd0 0x7f740c0a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7411751700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7411751700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c064930 con 0x7f740c063ce0 2023-08-22T00:25:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7411751700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0a4c00 con 0x7f740c151cd0 2023-08-22T00:25:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7411751700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c064650 con 0x7f740c155fe0 2023-08-22T00:25:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f740c151cd0 0x7f740c0a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f740c151cd0 0x7f740c0a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32990/0 (socket says 172.21.15.98:32990) 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 -- 172.21.15.98:0/427131222 learned_addr learned my addr 172.21.15.98:0/427131222 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740b7fe700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 -- 172.21.15.98:0/427131222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 msgr2=0x7f740c066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c066b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 -- 172.21.15.98:0/427131222 >> v1:172.21.15.118:6789/0 conn(0x7f740c063ce0 legacy=0x7f740c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 -- 172.21.15.98:0/427131222 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c066040 con 0x7f740c151cd0 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f740affd700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0a4710 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f73fc006fd0 tx=0x7f73fc0090f0).ready entity=mon.0 client_cookie=fde6c752fcb8ed91 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7409ffb700 1 -- 172.21.15.98:0/427131222 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00b580 con 0x7f740c151cd0 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7409ffb700 1 -- 172.21.15.98:0/427131222 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00b6e0 con 0x7f740c151cd0 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.342+0000 7f7409ffb700 1 -- 172.21.15.98:0/427131222 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00ba60 con 0x7f740c151cd0 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 -- 172.21.15.98:0/427131222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 msgr2=0x7f740c0a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0a4710 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f73fc006fd0 tx=0x7f73fc0090f0).stop 2023-08-22T00:25:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 -- 172.21.15.98:0/427131222 shutdown_connections 2023-08-22T00:25:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c066b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 --2- 172.21.15.98:0/427131222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0a4710 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 -- 172.21.15.98:0/427131222 >> 172.21.15.98:0/427131222 conn(0x7f740c0c7770 msgr2=0x7f740c0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 -- 172.21.15.98:0/427131222 shutdown_connections 2023-08-22T00:25:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.343+0000 7f7411751700 1 -- 172.21.15.98:0/427131222 wait complete. 2023-08-22T00:25:07.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.344+0000 7f7411751700 1 Processor -- start 2023-08-22T00:25:07.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.344+0000 7f7411751700 1 -- start start 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 0x7f740c0c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c149ac0 con 0x7f740c151cd0 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0abb80 con 0x7f740c063ce0 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f7411751700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0aaf70 con 0x7f740c155fe0 2023-08-22T00:25:07.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f740a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f740a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32998/0 (socket says 172.21.15.98:32998) 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f740a7fc700 1 -- 172.21.15.98:0/86744928 learned_addr learned my addr 172.21.15.98:0/86744928 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f740b7fe700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.345+0000 7f740affd700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 0x7f740c0c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 -- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 msgr2=0x7f740c0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c0a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 -- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 msgr2=0x7f740c0c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 0x7f740c0c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 -- 172.21.15.98:0/86744928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009370 con 0x7f740c151cd0 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740affd700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 0x7f740c0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f740a7fc700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f740000c4c0 tx=0x7f7400007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000ce70 con 0x7f740c151cd0 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400001e90 con 0x7f740c151cd0 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c0ab250 con 0x7f740c151cd0 2023-08-22T00:25:07.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400007250 con 0x7f740c151cd0 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.346+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c0ab810 con 0x7f740c151cd0 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.347+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c0abd30 con 0x7f740c151cd0 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.348+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f74000066a0 con 0x7f740c151cd0 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.348+0000 7f73f2ffd700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.348+0000 7f740affd700 1 -- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 msgr2=0x7f73f8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.348+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f740007a0b0 con 0x7f740c151cd0 2023-08-22T00:25:07.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.348+0000 7f740affd700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:07.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.352+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f740004b0d0 con 0x7f740c151cd0 2023-08-22T00:25:07.360 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.359+0000 7f9f4e3d4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:07.478 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.477+0000 7f9f4e3d4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:07.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.531+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f740c0abcf0 con 0x7f740c151cd0 2023-08-22T00:25:07.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.532+0000 7f73f2ffd700 1 -- 172.21.15.98:0/86744928 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+17631 (secure 0 0 0) 0x7f740004e6f0 con 0x7f740c151cd0 2023-08-22T00:25:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:07.534 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":138,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:07.400534+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:24:05.390179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-08-22T00:24:05.791512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":138,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/2154899392":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6833/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:6832/118203":"2023-08-23T00:24:23.621175+0000","172.21.15.98:0/3091707063":"2023-08-23T00:24:23.621175+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:07.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 msgr2=0x7f73f8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:07.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:07.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 msgr2=0x7f740c0aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f740000c4c0 tx=0x7f7400007e00).stop 2023-08-22T00:25:07.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 shutdown_connections 2023-08-22T00:25:07.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:07.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740c155fe0 0x7f740c0a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c063ce0 0x7f740c0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 --2- 172.21.15.98:0/86744928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f740c151cd0 0x7f740c0aa720 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 >> 172.21.15.98:0/86744928 conn(0x7f740c0c7770 msgr2=0x7f740c0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:07.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 shutdown_connections 2023-08-22T00:25:07.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.534+0000 7f7411751700 1 -- 172.21.15.98:0/86744928 wait complete. 2023-08-22T00:25:07.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:25:07.554 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:07.553+0000 7f6ed1297680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:07.624 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:07.623+0000 7f6ed1297680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:07.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.711+0000 7f89ecd9e700 1 Processor -- start 2023-08-22T00:25:07.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.711+0000 7f89ecd9e700 1 -- start start 2023-08-22T00:25:07.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89ecd9e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f89e8151c60 0x7f89e80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89ecd9e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e80c3c70 0x7f89e80be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89ecd9e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e8067dd0 con 0x7f89e80bee50 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89ecd9e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e80c40f0 con 0x7f89e8151c60 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89ecd9e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8152040 con 0x7f89e80c3c70 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f89e8151c60 0x7f89e80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e6d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f89e80bee50 0x7f89e80661b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37490/0 (socket says 172.21.15.98:37490) 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e6d9d700 1 -- 172.21.15.98:0/1985366495 learned_addr learned my addr 172.21.15.98:0/1985366495 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e5d9b700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e80c3c70 0x7f89e80be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 -- 172.21.15.98:0/1985366495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e80c3c70 msgr2=0x7f89e80be960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:07.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e80c3c70 0x7f89e80be960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 -- 172.21.15.98:0/1985366495 >> v1:172.21.15.98:6789/0 conn(0x7f89e80bee50 legacy=0x7f89e80661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 -- 172.21.15.98:0/1985366495 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80674a0 con 0x7f89e8151c60 2023-08-22T00:25:07.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e559a700 1 -- 172.21.15.98:0/1985366495 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946285635 0 0) 0x7f89e8067dd0 con 0x7f89e80bee50 2023-08-22T00:25:07.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.712+0000 7f89e659c700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e8151c60 0x7f89e80c3780 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f89d8009760 tx=0x7f89d8009060).ready entity=mon.0 client_cookie=cfa320dbfefb7911 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:07.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89e559a700 1 -- 172.21.15.98:0/1985366495 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800f510 con 0x7f89e8151c60 2023-08-22T00:25:07.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89e559a700 1 -- 172.21.15.98:0/1985366495 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800f670 con 0x7f89e8151c60 2023-08-22T00:25:07.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89e559a700 1 -- 172.21.15.98:0/1985366495 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800f9f0 con 0x7f89e8151c60 2023-08-22T00:25:07.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 -- 172.21.15.98:0/1985366495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e8151c60 msgr2=0x7f89e80c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e8151c60 0x7f89e80c3780 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f89d8009760 tx=0x7f89d8009060).stop 2023-08-22T00:25:07.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 -- 172.21.15.98:0/1985366495 shutdown_connections 2023-08-22T00:25:07.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e8151c60 0x7f89e80c3780 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/1985366495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e80c3c70 0x7f89e80be960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 -- 172.21.15.98:0/1985366495 >> 172.21.15.98:0/1985366495 conn(0x7f89e80c93e0 msgr2=0x7f89e80c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 -- 172.21.15.98:0/1985366495 shutdown_connections 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.713+0000 7f89ecd9e700 1 -- 172.21.15.98:0/1985366495 wait complete. 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.714+0000 7f89ecd9e700 1 Processor -- start 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 -- start start 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89e80c3c70 0x7f89e8153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e8151c60 0x7f89e8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80bffc0 con 0x7f89e80bee50 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80ad930 con 0x7f89e80c3c70 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89ecd9e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80bfc90 con 0x7f89e8151c60 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33016/0 (socket says 172.21.15.98:33016) 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89e659c700 1 -- 172.21.15.98:0/3379378201 learned_addr learned my addr 172.21.15.98:0/3379378201 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89e6d9d700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e8151c60 0x7f89e8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.715+0000 7f89e5d9b700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89e80c3c70 0x7f89e8153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 -- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e8151c60 msgr2=0x7f89e8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e8151c60 0x7f89e8154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 -- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89e80c3c70 msgr2=0x7f89e8153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89e80c3c70 0x7f89e8153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 -- 172.21.15.98:0/3379378201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80092a0 con 0x7f89e80bee50 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89e659c700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f89d8009e00 tx=0x7f89d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8000bc0 con 0x7f89e80bee50 2023-08-22T00:25:07.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800f7e0 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e80ad090 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8000d20 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.716+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e80ad650 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.717+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e806a030 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.717+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 60) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f89d801a8a0 con 0x7f89e80bee50 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.718+0000 7f89d67fc700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 0x7f89c8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:07.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.718+0000 7f89e5d9b700 1 -- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 msgr2=0x7f89c8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:07.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.718+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6702+0+0 (secure 0 0 0) 0x7f89d807b530 con 0x7f89e80bee50 2023-08-22T00:25:07.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.718+0000 7f89e5d9b700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 0x7f89c8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:07.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.724+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89d804c460 con 0x7f89e80bee50 2023-08-22T00:25:07.793 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.792+0000 7f9f4e3d4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:07.867 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.866+0000 7f9f4e3d4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:07.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.886+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 61) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f89d8078dc0 con 0x7f89e80bee50 2023-08-22T00:25:07.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.886+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 msgr2=0x7f89c8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:07.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.886+0000 7f89d67fc700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 0x7f89c8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:07.944 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ed068d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.944 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ed068d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ed068d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ed068d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ed068d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ecce86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ecce86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ecce86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ecce86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:07.942+0000 7f9ecce86700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:07.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:07.946+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89e8067780 con 0x7f89e80bee50 2023-08-22T00:25:08.882 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:25:08.881+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:25:08.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.885+0000 7f89d67fc700 1 -- 172.21.15.98:0/3379378201 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89d8054a20 con 0x7f89e80bee50 2023-08-22T00:25:08.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 msgr2=0x7f89e814d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:08.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f89d8009e00 tx=0x7f89d8017000).stop 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 shutdown_connections 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f89c805f050 0x7f89c8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89e8151c60 0x7f89e8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e80bee50 0x7f89e814d6f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.888+0000 7f89ecd9e700 1 --2- 172.21.15.98:0/3379378201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89e80c3c70 0x7f89e8153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:08.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.889+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 >> 172.21.15.98:0/3379378201 conn(0x7f89e80c93e0 msgr2=0x7f89e8150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.889+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 shutdown_connections 2023-08-22T00:25:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:08.889+0000 7f89ecd9e700 1 -- 172.21.15.98:0/3379378201 wait complete. 2023-08-22T00:25:08.894 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:25:08.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:25:08.930 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:25:09.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.036+0000 7f4cf1c28700 1 Processor -- start 2023-08-22T00:25:09.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.036+0000 7f4cf1c28700 1 -- start start 2023-08-22T00:25:09.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cf1c28700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 0x7f4cec0a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cf1c28700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4cec0bc780 0x7f4cec150680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cf1c28700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0bd640 con 0x7f4cec0bd260 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cf1c28700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec155380 con 0x7f4cec0bc780 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cf1c28700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec155620 con 0x7f4cec0a8ac0 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4cec0bc780 0x7f4cec150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4cec0bc780 0x7f4cec150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33126/0 (socket says 172.21.15.98:33126) 2023-08-22T00:25:09.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 -- 172.21.15.98:0/943172986 learned_addr learned my addr 172.21.15.98:0/943172986 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:09.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/943172986 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 0x7f4cec0a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 -- 172.21.15.98:0/943172986 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 msgr2=0x7f4cec0a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:09.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 --2- 172.21.15.98:0/943172986 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 0x7f4cec0a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 -- 172.21.15.98:0/943172986 >> v1:172.21.15.118:6789/0 conn(0x7f4cec0bd260 legacy=0x7f4cec0c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:09.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 -- 172.21.15.98:0/943172986 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0c2ae0 con 0x7f4cec0bc780 2023-08-22T00:25:09.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/943172986 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 0x7f4cec0a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4cebfff700 1 --2- 172.21.15.98:0/943172986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec150680 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f4cec0646e0 tx=0x7f4ce400ba50).ready entity=mon.0 client_cookie=75e6ad531f61542c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4ceaffd700 1 -- 172.21.15.98:0/943172986 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4010070 con 0x7f4cec0bc780 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4ceaffd700 1 -- 172.21.15.98:0/943172986 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce400de50 con 0x7f4cec0bc780 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.037+0000 7f4ceaffd700 1 -- 172.21.15.98:0/943172986 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400b2e0 con 0x7f4cec0bc780 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 -- 172.21.15.98:0/943172986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 msgr2=0x7f4cec150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:09.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/943172986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec150680 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f4cec0646e0 tx=0x7f4ce400ba50).stop 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 -- 172.21.15.98:0/943172986 shutdown_connections 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/943172986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec150680 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/943172986 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0a8ac0 0x7f4cec0a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 -- 172.21.15.98:0/943172986 >> 172.21.15.98:0/943172986 conn(0x7f4cec0c31d0 msgr2=0x7f4cec0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 -- 172.21.15.98:0/943172986 shutdown_connections 2023-08-22T00:25:09.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.038+0000 7f4cf1c28700 1 -- 172.21.15.98:0/943172986 wait complete. 2023-08-22T00:25:09.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.039+0000 7f4cf1c28700 1 Processor -- start 2023-08-22T00:25:09.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.039+0000 7f4cf1c28700 1 -- start start 2023-08-22T00:25:09.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 0x7f4cec13a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec0bd260 0x7f4cec0bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c0330 con 0x7f4cec0bc780 2023-08-22T00:25:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec13a8d0 con 0x7f4cec0a8ac0 2023-08-22T00:25:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cf1c28700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c07c0 con 0x7f4cec0bd260 2023-08-22T00:25:09.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33132/0 (socket says 172.21.15.98:33132) 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 -- 172.21.15.98:0/2612577593 learned_addr learned my addr 172.21.15.98:0/2612577593 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4cebfff700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec0bd260 0x7f4cec0bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 0x7f4cec13a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 -- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec0bd260 msgr2=0x7f4cec0bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:09.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec0bd260 0x7f4cec0bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 -- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 msgr2=0x7f4cec13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 0x7f4cec13a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 -- 172.21.15.98:0/2612577593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce400bcf0 con 0x7f4cec0bc780 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 0x7f4cec13a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.040+0000 7f4ce2ffd700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f4cd400f7d0 tx=0x7f4cd400d470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:09.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.041+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400d2e0 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.041+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400b450 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.041+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec0bfa00 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.041+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400b7d0 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.041+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec0bffc0 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.042+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0c04a0 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.042+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 62) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f4cd400bbc0 con 0x7f4cec0bc780 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.042+0000 7f4ce3fff700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 0x7f4cd00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:09.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.042+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f4cd407dd20 con 0x7f4cec0bc780 2023-08-22T00:25:09.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.042+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 0x7f4cd00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:09.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.043+0000 7f4ceb7fe700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 0x7f4cd00611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4cec0bc2c0 tx=0x7f4cdc008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:09.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.046+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cd404efe0 con 0x7f4cec0bc780 2023-08-22T00:25:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.251+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4cec0c2dc0 con 0x7f4cec0bc780 2023-08-22T00:25:09.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.894+0000 7f4ce3fff700 1 -- 172.21.15.98:0/2612577593 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4cd4052600 con 0x7f4cec0bc780 2023-08-22T00:25:09.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 msgr2=0x7f4cd00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:09.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 0x7f4cd00611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4cec0bc2c0 tx=0x7f4cdc008040).stop 2023-08-22T00:25:09.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 msgr2=0x7f4cec0bd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:09.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f4cd400f7d0 tx=0x7f4cd400d470).stop 2023-08-22T00:25:09.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 shutdown_connections 2023-08-22T00:25:09.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4cd005ecf0 0x7f4cd00611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec0bd260 0x7f4cec0bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0a8ac0 0x7f4cec13a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 --2- 172.21.15.98:0/2612577593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cec0bc780 0x7f4cec0bd910 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:09.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.896+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 >> 172.21.15.98:0/2612577593 conn(0x7f4cec0c31d0 msgr2=0x7f4cec065220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:09.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.897+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 shutdown_connections 2023-08-22T00:25:09.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:09.897+0000 7f4cf1c28700 1 -- 172.21.15.98:0/2612577593 wait complete. 2023-08-22T00:25:09.911 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:25:10.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.071+0000 7f15fd434700 1 Processor -- start 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.071+0000 7f15fd434700 1 -- start start 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15fd434700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15f8154830 0x7f15f80c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15fd434700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f8062600 con 0x7f15f8153c80 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15fd434700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80c2a60 con 0x7f15f80a5910 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15fd434700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f8062f10 con 0x7f15f8154830 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f67fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15f8154830 0x7f15f80c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:10.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f15f8153c80 0x7f15f8063330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37506/0 (socket says 172.21.15.98:37506) 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f77fe700 1 -- 172.21.15.98:0/2318011671 learned_addr learned my addr 172.21.15.98:0/2318011671 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f67fc700 1 -- 172.21.15.98:0/2318011671 >> v1:172.21.15.118:6789/0 conn(0x7f15f80a5910 legacy=0x7f15f80c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f67fc700 1 -- 172.21.15.98:0/2318011671 >> v1:172.21.15.98:6789/0 conn(0x7f15f8153c80 legacy=0x7f15f8063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f67fc700 1 -- 172.21.15.98:0/2318011671 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80c2d30 con 0x7f15f8154830 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f5ffb700 1 -- 172.21.15.98:0/2318011671 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828513247 0 0) 0x7f15f8062600 con 0x7f15f8153c80 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f67fc700 1 --2- 172.21.15.98:0/2318011671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f8154830 0x7f15f80c2570 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f15ec009760 tx=0x7f15ec009060).ready entity=mon.0 client_cookie=46e070e9d6a96f4b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:10.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f5ffb700 1 -- 172.21.15.98:0/2318011671 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00b520 con 0x7f15f8154830 2023-08-22T00:25:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f5ffb700 1 -- 172.21.15.98:0/2318011671 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00b680 con 0x7f15f8154830 2023-08-22T00:25:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.072+0000 7f15f5ffb700 1 -- 172.21.15.98:0/2318011671 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00ba00 con 0x7f15f8154830 2023-08-22T00:25:10.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 -- 172.21.15.98:0/2318011671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f8154830 msgr2=0x7f15f80c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 --2- 172.21.15.98:0/2318011671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f8154830 0x7f15f80c2570 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f15ec009760 tx=0x7f15ec009060).stop 2023-08-22T00:25:10.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 -- 172.21.15.98:0/2318011671 shutdown_connections 2023-08-22T00:25:10.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 --2- 172.21.15.98:0/2318011671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f8154830 0x7f15f80c2570 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 -- 172.21.15.98:0/2318011671 >> 172.21.15.98:0/2318011671 conn(0x7f15f80c7170 msgr2=0x7f15f80c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:10.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 -- 172.21.15.98:0/2318011671 shutdown_connections 2023-08-22T00:25:10.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.073+0000 7f15fd434700 1 -- 172.21.15.98:0/2318011671 wait complete. 2023-08-22T00:25:10.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.074+0000 7f15fd434700 1 Processor -- start 2023-08-22T00:25:10.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.074+0000 7f15fd434700 1 -- start start 2023-08-22T00:25:10.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:10.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 0x7f15f81498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:10.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 0x7f15f80a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:10.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80bfe20 con 0x7f15f80a5910 2023-08-22T00:25:10.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80c0100 con 0x7f15f8153c80 2023-08-22T00:25:10.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15fd434700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80c03e0 con 0x7f15f8154830 2023-08-22T00:25:10.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:10.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33144/0 (socket says 172.21.15.98:33144) 2023-08-22T00:25:10.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 -- 172.21.15.98:0/2542024769 learned_addr learned my addr 172.21.15.98:0/2542024769 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:10.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f67fc700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 0x7f15f81498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:10.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f77fe700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 0x7f15f80a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:10.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 -- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 msgr2=0x7f15f80a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 0x7f15f80a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 -- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 msgr2=0x7f15f81498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 0x7f15f81498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 -- 172.21.15.98:0/2542024769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0092a0 con 0x7f15f80a5910 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f77fe700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 0x7f15f80a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:10.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f67fc700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 0x7f15f81498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.075+0000 7f15f6ffd700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f15e800c440 tx=0x7f15e8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.076+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800f470 con 0x7f15f80a5910 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.076+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800f5f0 con 0x7f15f80a5910 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.076+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800f9b0 con 0x7f15f80a5910 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.076+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80aa680 con 0x7f15f80a5910 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.076+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f80a67e0 con 0x7f15f80a5910 2023-08-22T00:25:10.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.077+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80a6a60 con 0x7f15f80a5910 2023-08-22T00:25:10.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.077+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 62) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f15e8012400 con 0x7f15f80a5910 2023-08-22T00:25:10.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.077+0000 7f15deffd700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 0x7f15e4061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:10.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.077+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f15e80793e0 con 0x7f15f80a5910 2023-08-22T00:25:10.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.077+0000 7f15f67fc700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 0x7f15e4061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:10.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.078+0000 7f15f67fc700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 0x7f15e4061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f15ec00b2e0 tx=0x7f15ec017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:10.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.081+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15e80488f0 con 0x7f15f80a5910 2023-08-22T00:25:10.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.243+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f15f8047480 con 0x7f15f80a5910 2023-08-22T00:25:10.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.414+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f15e8077000 con 0x7f15f80a5910 2023-08-22T00:25:10.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.901+0000 7f15deffd700 1 -- 172.21.15.98:0/2542024769 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) v1 ==== 181+0+0 (secure 0 0 0) 0x7f15e80733b0 con 0x7f15f80a5910 2023-08-22T00:25:10.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 msgr2=0x7f15e4061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 0x7f15e4061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f15ec00b2e0 tx=0x7f15ec017000).stop 2023-08-22T00:25:10.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 msgr2=0x7f15f80a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f15e800c440 tx=0x7f15e8007de0).stop 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 shutdown_connections 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f15e405ecc0 0x7f15e4061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8154830 0x7f15f80a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15f80a5910 0x7f15f80a62f0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 --2- 172.21.15.98:0/2542024769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f8153c80 0x7f15f81498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:10.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 >> 172.21.15.98:0/2542024769 conn(0x7f15f80c7170 msgr2=0x7f15f8063330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:10.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 shutdown_connections 2023-08-22T00:25:10.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:10.905+0000 7f15fd434700 1 -- 172.21.15.98:0/2542024769 wait complete. 2023-08-22T00:25:10.909 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:25:10.920 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:25:11.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.039+0000 7f660b88e700 1 Processor -- start 2023-08-22T00:25:11.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.040+0000 7f660b88e700 1 -- start start 2023-08-22T00:25:11.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.040+0000 7f660b88e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6604067aa0 0x7f6604151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.040+0000 7f660b88e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040c1760 con 0x7f66040632f0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.040+0000 7f660b88e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6604067f50 con 0x7f6604066ff0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.040+0000 7f660b88e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6604152fc0 con 0x7f6604067aa0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f660962a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f66040632f0 0x7f66040668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48144/0 (socket says 172.21.15.98:48144) 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f660962a700 1 -- 172.21.15.98:0/1406436362 learned_addr learned my addr 172.21.15.98:0/1406436362 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f6609e2b700 1 --2- 172.21.15.98:0/1406436362 >> v2:172.21.15.118:3300/0 conn(0x7f6604067aa0 0x7f6604151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420465302 0 0) 0x7f66040c1760 con 0x7f66040632f0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f00033f0 con 0x7f66040632f0 2023-08-22T00:25:11.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812604683 0 0) 0x7f65f00033f0 con 0x7f66040632f0 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 >> v2:172.21.15.118:3300/0 conn(0x7f6604067aa0 msgr2=0x7f6604151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 --2- 172.21.15.98:0/1406436362 >> v2:172.21.15.118:3300/0 conn(0x7f6604067aa0 0x7f6604151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 >> v1:172.21.15.118:6789/0 conn(0x7f6604066ff0 legacy=0x7f66040c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604152490 con 0x7f66040632f0 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f65f4001470 con 0x7f66040632f0 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 >> v1:172.21.15.98:6789/0 conn(0x7f66040632f0 legacy=0x7f66040668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f65f00038e0 0x7f65f0003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f65f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65f0005000 0x7f65f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604152fc0 con 0x7f65f0004690 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000beb0 con 0x7f65f0005000 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000c070 con 0x7f65f00038e0 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f6608e29700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f65f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.041+0000 7f660962a700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f65f00038e0 0x7f65f0003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6609e2b700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65f0005000 0x7f65f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 -- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f65f00038e0 msgr2=0x7f65f0003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f65f00038e0 0x7f65f0003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 -- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65f0005000 msgr2=0x7f65f000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65f0005000 0x7f65f000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6609e2b700 1 -- 172.21.15.98:0/1406436362 reap_dead start 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 -- 172.21.15.98:0/1406436362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00033f0 con 0x7f65f0004690 2023-08-22T00:25:11.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f6608e29700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f65f0004b10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f66000017f0 tx=0x7f6600007b90).ready entity=mon.0 client_cookie=3713029da5d65777 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600007ea0 con 0x7f65f0004690 2023-08-22T00:25:11.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600012400 con 0x7f65f0004690 2023-08-22T00:25:11.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f65fbfff700 1 -- 172.21.15.98:0/1406436362 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66000127a0 con 0x7f65f0004690 2023-08-22T00:25:11.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f660b88e700 1 -- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 msgr2=0x7f65f0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f660b88e700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f65f0004b10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f66000017f0 tx=0x7f6600007b90).stop 2023-08-22T00:25:11.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f660b88e700 1 -- 172.21.15.98:0/1406436362 shutdown_connections 2023-08-22T00:25:11.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f660b88e700 1 --2- 172.21.15.98:0/1406436362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f65f0004b10 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.042+0000 7f660b88e700 1 -- 172.21.15.98:0/1406436362 >> 172.21.15.98:0/1406436362 conn(0x7f66040c4470 msgr2=0x7f6604065560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.043+0000 7f660b88e700 1 -- 172.21.15.98:0/1406436362 shutdown_connections 2023-08-22T00:25:11.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.043+0000 7f660b88e700 1 -- 172.21.15.98:0/1406436362 wait complete. 2023-08-22T00:25:11.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.044+0000 7f660b88e700 1 Processor -- start 2023-08-22T00:25:11.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.044+0000 7f660b88e700 1 -- start start 2023-08-22T00:25:11.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66040ab8e0 0x7f66040abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66040bbe60 0x7f66040bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660414b220 con 0x7f65f0004690 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66041624a0 con 0x7f66040bbe60 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040ac250 con 0x7f66040ab8e0 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35714/0 (socket says 172.21.15.98:35714) 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 -- 172.21.15.98:0/4256652221 learned_addr learned my addr 172.21.15.98:0/4256652221 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 -- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66040ab8e0 msgr2=0x7f66040abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66040ab8e0 0x7f66040abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 -- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66040bbe60 msgr2=0x7f66040bc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66040bbe60 0x7f66040bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 -- 172.21.15.98:0/4256652221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040bc7d0 con 0x7f65f0004690 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660962a700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f65f4004760 tx=0x7f65f4001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400f5f0 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400f750 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400fad0 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66040ac4c0 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.045+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6604162130 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.046+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6604047480 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.047+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f65f401d3b0 con 0x7f65f0004690 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.047+0000 7f65f97fa700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 0x7f65e80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.047+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6580+0+0 (secure 0 0 0) 0x7f65f4079ae0 con 0x7f65f0004690 2023-08-22T00:25:11.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.047+0000 7f6608e29700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 0x7f65e80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.047+0000 7f6608e29700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 0x7f65e80613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f66040a6880 tx=0x7f6600015000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.051+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65f404ac50 con 0x7f65f0004690 2023-08-22T00:25:11.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.219+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66040674b0 con 0x7f65f0004690 2023-08-22T00:25:11.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.341+0000 7f65f97fa700 1 -- 172.21.15.98:0/4256652221 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) v1 ==== 169+0+0 (secure 0 0 0) 0x7f65f4019020 con 0x7f65f0004690 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 msgr2=0x7f65e80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 0x7f65e80613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f66040a6880 tx=0x7f6600015000).stop 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 msgr2=0x7f660413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f65f4004760 tx=0x7f65f4001e70).stop 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 shutdown_connections 2023-08-22T00:25:11.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66040bbe60 0x7f66040bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65f0004690 0x7f660413f890 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f65e805ef30 0x7f65e80613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 --2- 172.21.15.98:0/4256652221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66040ab8e0 0x7f66040abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 >> 172.21.15.98:0/4256652221 conn(0x7f66040c4470 msgr2=0x7f66040654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 shutdown_connections 2023-08-22T00:25:11.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.345+0000 7f660b88e700 1 -- 172.21.15.98:0/4256652221 wait complete. 2023-08-22T00:25:11.349 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:25:11.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:25:11.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.482+0000 7f0f8c675700 1 Processor -- start 2023-08-22T00:25:11.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.482+0000 7f0f8c675700 1 -- start start 2023-08-22T00:25:11.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8c675700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0f840c73c0 0x7f0f84151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8c675700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f84066780 con 0x7f0f841507e0 2023-08-22T00:25:11.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8c675700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840c3dd0 con 0x7f0f84065730 2023-08-22T00:25:11.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8c675700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840c2100 con 0x7f0f840c73c0 2023-08-22T00:25:11.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8a411700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0f841507e0 0x7f0f840c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48150/0 (socket says 172.21.15.98:48150) 2023-08-22T00:25:11.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8a411700 1 -- 172.21.15.98:0/2900030766 learned_addr learned my addr 172.21.15.98:0/2900030766 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:11.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011041186 0 0) 0x7f0f84066780 con 0x7f0f841507e0 2023-08-22T00:25:11.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8ac12700 1 --2- 172.21.15.98:0/2900030766 >> v2:172.21.15.118:3300/0 conn(0x7f0f840c73c0 0x7f0f84151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f700033f0 con 0x7f0f841507e0 2023-08-22T00:25:11.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3395141439 0 0) 0x7f0f700033f0 con 0x7f0f841507e0 2023-08-22T00:25:11.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 >> v2:172.21.15.118:3300/0 conn(0x7f0f840c73c0 msgr2=0x7f0f84151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 --2- 172.21.15.98:0/2900030766 >> v2:172.21.15.118:3300/0 conn(0x7f0f840c73c0 0x7f0f84151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 >> v1:172.21.15.118:6789/0 conn(0x7f0f84065730 legacy=0x7f0f840c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84066130 con 0x7f0f841507e0 2023-08-22T00:25:11.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.483+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f0f74001470 con 0x7f0f841507e0 2023-08-22T00:25:11.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 >> v1:172.21.15.98:6789/0 conn(0x7f0f841507e0 legacy=0x7f0f840c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f700038e0 0x7f0f70003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 0x7f0f70004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f70005000 0x7f0f7000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840c2100 con 0x7f0f70004690 2023-08-22T00:25:11.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7000bf60 con 0x7f0f70005000 2023-08-22T00:25:11.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7000c0f0 con 0x7f0f700038e0 2023-08-22T00:25:11.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 0x7f0f70004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8a411700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f700038e0 0x7f0f70003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8ac12700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f70005000 0x7f0f7000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 -- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f700038e0 msgr2=0x7f0f70003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f700038e0 0x7f0f70003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 -- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f70005000 msgr2=0x7f0f7000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f70005000 0x7f0f7000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 -- 172.21.15.98:0/2900030766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700033f0 con 0x7f0f70004690 2023-08-22T00:25:11.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8ac12700 1 -- 172.21.15.98:0/2900030766 reap_dead start 2023-08-22T00:25:11.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 0x7f0f70004b10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f0f80001760 tx=0x7f0f80007bb0).ready entity=mon.0 client_cookie=7d0145c6c914c8fe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80007020 con 0x7f0f70004690 2023-08-22T00:25:11.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80007180 con 0x7f0f70004690 2023-08-22T00:25:11.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.484+0000 7f0f8940f700 1 -- 172.21.15.98:0/2900030766 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80007520 con 0x7f0f70004690 2023-08-22T00:25:11.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 -- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 msgr2=0x7f0f70004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 0x7f0f70004b10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f0f80001760 tx=0x7f0f80007bb0).stop 2023-08-22T00:25:11.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 -- 172.21.15.98:0/2900030766 shutdown_connections 2023-08-22T00:25:11.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2900030766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f70004690 0x7f0f70004b10 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 -- 172.21.15.98:0/2900030766 >> 172.21.15.98:0/2900030766 conn(0x7f0f840c7800 msgr2=0x7f0f840c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 -- 172.21.15.98:0/2900030766 shutdown_connections 2023-08-22T00:25:11.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.485+0000 7f0f8c675700 1 -- 172.21.15.98:0/2900030766 wait complete. 2023-08-22T00:25:11.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.486+0000 7f0f8c675700 1 Processor -- start 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.486+0000 7f0f8c675700 1 -- start start 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f70004690 0x7f0f840ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f840c80d0 0x7f0f84062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8414fc10 con 0x7f0f841571b0 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840c8550 con 0x7f0f840c80d0 2023-08-22T00:25:11.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8414f000 con 0x7f0f70004690 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35724/0 (socket says 172.21.15.98:35724) 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 -- 172.21.15.98:0/2784250609 learned_addr learned my addr 172.21.15.98:0/2784250609 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8a411700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f70004690 0x7f0f840ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8ac12700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f840c80d0 0x7f0f84062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 -- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f70004690 msgr2=0x7f0f840ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f70004690 0x7f0f840ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 -- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f840c80d0 msgr2=0x7f0f84062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f840c80d0 0x7f0f84062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 -- 172.21.15.98:0/2784250609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8414f2e0 con 0x7f0f841571b0 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f89c10700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f0f80001d50 tx=0x7f0f80016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80006cf0 con 0x7f0f841571b0 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80006e50 con 0x7f0f841571b0 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8414f5c0 con 0x7f0f841571b0 2023-08-22T00:25:11.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8001e690 con 0x7f0f841571b0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.487+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f840a6400 con 0x7f0f841571b0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.488+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84069220 con 0x7f0f841571b0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.489+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0f80012400 con 0x7f0f841571b0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.489+0000 7f0f7a7fc700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 0x7f0f680613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.489+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f0f8007aad0 con 0x7f0f841571b0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.489+0000 7f0f8a411700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 0x7f0f680613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.489+0000 7f0f8a411700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 0x7f0f680613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0f74001ce0 tx=0x7f0f74001e50).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.493+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f8004bd30 con 0x7f0f841571b0 2023-08-22T00:25:11.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.655+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f84156f90 con 0x7f0f841571b0 2023-08-22T00:25:11.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.662+0000 7f0f7a7fc700 1 -- 172.21.15.98:0/2784250609 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f80023070 con 0x7f0f841571b0 2023-08-22T00:25:11.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 msgr2=0x7f0f680613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 0x7f0f680613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0f74001ce0 tx=0x7f0f74001e50).stop 2023-08-22T00:25:11.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 msgr2=0x7f0f840c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f0f80001d50 tx=0x7f0f80016000).stop 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 shutdown_connections 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0f6805ef30 0x7f0f680613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f70004690 0x7f0f840ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f840c80d0 0x7f0f84062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 --2- 172.21.15.98:0/2784250609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f841571b0 0x7f0f840c7be0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 >> 172.21.15.98:0/2784250609 conn(0x7f0f840c7800 msgr2=0x7f0f84063fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 shutdown_connections 2023-08-22T00:25:11.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.664+0000 7f0f8c675700 1 -- 172.21.15.98:0/2784250609 wait complete. 2023-08-22T00:25:11.678 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:25:11.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.797+0000 7f76a91b1700 1 Processor -- start 2023-08-22T00:25:11.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.797+0000 7f76a91b1700 1 -- start start 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a91b1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76a41507e0 0x7f76a4065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a91b1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f76a40c3940 0x7f76a4150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a91b1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a4066780 con 0x7f76a40c34c0 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a91b1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40c2100 con 0x7f76a41507e0 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a91b1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40c40b0 con 0x7f76a40c3940 2023-08-22T00:25:11.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76a41507e0 0x7f76a4065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f76a41507e0 0x7f76a4065730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35728/0 (socket says 172.21.15.98:35728) 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a2d9d700 1 -- 172.21.15.98:0/2257552642 learned_addr learned my addr 172.21.15.98:0/2257552642 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.798+0000 7f76a359e700 1 --2- 172.21.15.98:0/2257552642 >> v2:172.21.15.118:3300/0 conn(0x7f76a40c3940 0x7f76a4150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a2d9d700 1 -- 172.21.15.98:0/2257552642 >> v2:172.21.15.118:3300/0 conn(0x7f76a40c3940 msgr2=0x7f76a4150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a2d9d700 1 --2- 172.21.15.98:0/2257552642 >> v2:172.21.15.118:3300/0 conn(0x7f76a40c3940 0x7f76a4150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a2d9d700 1 -- 172.21.15.98:0/2257552642 >> v1:172.21.15.118:6789/0 conn(0x7f76a40c34c0 legacy=0x7f76a40c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a2d9d700 1 -- 172.21.15.98:0/2257552642 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40c3dd0 con 0x7f76a41507e0 2023-08-22T00:25:11.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a2d9d700 1 --2- 172.21.15.98:0/2257552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a41507e0 0x7f76a4065730 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f76a40a7290 tx=0x7f769800b3b0).ready entity=mon.0 client_cookie=cdbcdad39c94df29 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a1d9b700 1 -- 172.21.15.98:0/2257552642 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800dac0 con 0x7f76a41507e0 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a1d9b700 1 -- 172.21.15.98:0/2257552642 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800dc20 con 0x7f76a41507e0 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a1d9b700 1 -- 172.21.15.98:0/2257552642 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698010470 con 0x7f76a41507e0 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 -- 172.21.15.98:0/2257552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a41507e0 msgr2=0x7f76a4065730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 --2- 172.21.15.98:0/2257552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a41507e0 0x7f76a4065730 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f76a40a7290 tx=0x7f769800b3b0).stop 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 -- 172.21.15.98:0/2257552642 shutdown_connections 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 --2- 172.21.15.98:0/2257552642 >> v2:172.21.15.118:3300/0 conn(0x7f76a40c3940 0x7f76a4150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 --2- 172.21.15.98:0/2257552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a41507e0 0x7f76a4065730 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 -- 172.21.15.98:0/2257552642 >> 172.21.15.98:0/2257552642 conn(0x7f76a40c7800 msgr2=0x7f76a40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 -- 172.21.15.98:0/2257552642 shutdown_connections 2023-08-22T00:25:11.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.799+0000 7f76a91b1700 1 -- 172.21.15.98:0/2257552642 wait complete. 2023-08-22T00:25:11.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 Processor -- start 2023-08-22T00:25:11.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 -- start start 2023-08-22T00:25:11.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76a41507e0 0x7f76a40aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 0x7f76a40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40abc80 con 0x7f76a40c34c0 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40ab070 con 0x7f76a414c1d0 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.801+0000 7f76a91b1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40ab350 con 0x7f76a41507e0 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35736/0 (socket says 172.21.15.98:35736) 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 -- 172.21.15.98:0/4073833544 learned_addr learned my addr 172.21.15.98:0/4073833544 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:11.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a359e700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 0x7f76a40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a259c700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76a41507e0 0x7f76a40aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 -- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76a41507e0 msgr2=0x7f76a40aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76a41507e0 0x7f76a40aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 -- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 msgr2=0x7f76a40c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 0x7f76a40c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 -- 172.21.15.98:0/4073833544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769800b610 con 0x7f76a40c34c0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a359e700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 0x7f76a40c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a2d9d700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f76a40be830 tx=0x7f769800b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698020070 con 0x7f76a40c34c0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698000c90 con 0x7f76a40c34c0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698019890 con 0x7f76a40c34c0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40ab630 con 0x7f76a40c34c0 2023-08-22T00:25:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.802+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a40aac80 con 0x7f76a40c34c0 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.803+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a4069220 con 0x7f76a40c34c0 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.804+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7698019c40 con 0x7f76a40c34c0 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.804+0000 7f768affd700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 0x7f76900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.804+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f769807d9d0 con 0x7f76a40c34c0 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.804+0000 7f76a259c700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 0x7f76900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.804+0000 7f76a259c700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 0x7f76900613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f76a4162ce0 tx=0x7f7694009040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.808+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f769804ec90 con 0x7f76a40c34c0 2023-08-22T00:25:11.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.971+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f76a4066130 con 0x7f76a40c34c0 2023-08-22T00:25:11.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.974+0000 7f768affd700 1 -- 172.21.15.98:0/4073833544 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f769802a020 con 0x7f76a40c34c0 2023-08-22T00:25:11.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 msgr2=0x7f76900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 0x7f76900613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f76a4162ce0 tx=0x7f7694009040).stop 2023-08-22T00:25:11.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 msgr2=0x7f76a40bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:11.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f76a40be830 tx=0x7f769800b3b0).stop 2023-08-22T00:25:11.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 shutdown_connections 2023-08-22T00:25:11.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a414c1d0 0x7f76a40c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a40c34c0 0x7f76a40bf5c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f769005ef30 0x7f76900613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 --2- 172.21.15.98:0/4073833544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76a41507e0 0x7f76a40aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 >> 172.21.15.98:0/4073833544 conn(0x7f76a40c7800 msgr2=0x7f76a4151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 shutdown_connections 2023-08-22T00:25:11.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:11.976+0000 7f76a91b1700 1 -- 172.21.15.98:0/4073833544 wait complete. 2023-08-22T00:25:11.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-22T00:25:12.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.105+0000 7ff1cef0a700 1 Processor -- start 2023-08-22T00:25:12.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 -- start start 2023-08-22T00:25:12.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c81514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80645b0 con 0x7ff1c8150c50 2023-08-22T00:25:12.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c8063fa0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.106+0000 7ff1cef0a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8151f30 con 0x7ff1c8151030 2023-08-22T00:25:12.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35740/0 (socket says 172.21.15.98:35740) 2023-08-22T00:25:12.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 -- 172.21.15.98:0/3924577154 learned_addr learned my addr 172.21.15.98:0/3924577154 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:12.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1cd4a7700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c81514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 -- 172.21.15.98:0/3924577154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 msgr2=0x7ff1c81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:12.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c81514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 -- 172.21.15.98:0/3924577154 >> v1:172.21.15.118:6789/0 conn(0x7ff1c8150c50 legacy=0x7ff1c80c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 -- 172.21.15.98:0/3924577154 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8152210 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1cd4a7700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c81514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7ff1b4006fd0 tx=0x7ff1b40090f0).ready entity=mon.0 client_cookie=46578fb1a3d8ac8f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c77fe700 1 -- 172.21.15.98:0/3924577154 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400b600 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c77fe700 1 -- 172.21.15.98:0/3924577154 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400b760 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.107+0000 7ff1c77fe700 1 -- 172.21.15.98:0/3924577154 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400bae0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 -- 172.21.15.98:0/3924577154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 msgr2=0x7ff1c80c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7ff1b4006fd0 tx=0x7ff1b40090f0).stop 2023-08-22T00:25:12.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 -- 172.21.15.98:0/3924577154 shutdown_connections 2023-08-22T00:25:12.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c81514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/3924577154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80c3bf0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 -- 172.21.15.98:0/3924577154 >> 172.21.15.98:0/3924577154 conn(0x7ff1c80c7770 msgr2=0x7ff1c80c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:12.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 -- 172.21.15.98:0/3924577154 shutdown_connections 2023-08-22T00:25:12.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.108+0000 7ff1cef0a700 1 -- 172.21.15.98:0/3924577154 wait complete. 2023-08-22T00:25:12.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.109+0000 7ff1cef0a700 1 Processor -- start 2023-08-22T00:25:12.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.109+0000 7ff1cef0a700 1 -- start start 2023-08-22T00:25:12.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 0x7ff1c80948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80aa720 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8094d90 con 0x7ff1c8150c50 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cef0a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80bedd0 con 0x7ff1c8151030 2023-08-22T00:25:12.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1ccca6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1ccca6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35758/0 (socket says 172.21.15.98:35758) 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1ccca6700 1 -- 172.21.15.98:0/662286052 learned_addr learned my addr 172.21.15.98:0/662286052 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1cd4a7700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.110+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 0x7ff1c80948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 -- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 msgr2=0x7ff1c814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 -- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 msgr2=0x7ff1c80948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 0x7ff1c80948a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 -- 172.21.15.98:0/662286052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4009370 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1cd4a7700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 0x7ff1c80948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1ccca6700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7ff1bc00c440 tx=0x7ff1bc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00f470 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00f5f0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c80bf0b0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00f9b0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.111+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80bf670 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.112+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c8047480 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.112+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff1bc012400 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.113+0000 7ff1c4ff9700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 0x7ff1ac0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.113+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7ff1bc079520 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.113+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 0x7ff1ac0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.113+0000 7ff1c7fff700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 0x7ff1ac0613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff1c80bcaf0 tx=0x7ff1b4017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.117+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1bc0488f0 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.348+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7ff1c8064240 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.422+0000 7ff1c4ff9700 1 -- 172.21.15.98:0/662286052 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v714) v1 ==== 148+0+0 (secure 0 0 0) 0x7ff1bc04a830 con 0x7ff1c80bc6d0 2023-08-22T00:25:12.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 msgr2=0x7ff1ac0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 0x7ff1ac0613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff1c80bcaf0 tx=0x7ff1b4017000).stop 2023-08-22T00:25:12.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 msgr2=0x7ff1c80be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7ff1bc00c440 tx=0x7ff1bc007de0).stop 2023-08-22T00:25:12.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 shutdown_connections 2023-08-22T00:25:12.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff1ac05ef00 0x7ff1ac0613c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1c8151030 0x7ff1c814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1c80bc6d0 0x7ff1c80be810 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 --2- 172.21.15.98:0/662286052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c8150c50 0x7ff1c80948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 >> 172.21.15.98:0/662286052 conn(0x7ff1c80c7770 msgr2=0x7ff1c80c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:12.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 shutdown_connections 2023-08-22T00:25:12.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.424+0000 7ff1cef0a700 1 -- 172.21.15.98:0/662286052 wait complete. 2023-08-22T00:25:12.439 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-08-22T00:25:12.440 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-08-22T00:25:12.440 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:25:12.440 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-22T00:25:12.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.555+0000 7fc6959ea700 1 Processor -- start 2023-08-22T00:25:12.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.555+0000 7fc6959ea700 1 -- start start 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc6959ea700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc690153f10 0x7fc690150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc6959ea700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900c2220 con 0x7fc690150040 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc6959ea700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900c5bd0 con 0x7fc6900c26b0 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc6959ea700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900c1ef0 con 0x7fc690153f10 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc68effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc690150040 0x7fc6900c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48158/0 (socket says 172.21.15.98:48158) 2023-08-22T00:25:12.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc68effd700 1 -- 172.21.15.98:0/3279294475 learned_addr learned my addr 172.21.15.98:0/3279294475 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/3279294475 >> v2:172.21.15.118:3300/0 conn(0x7fc690153f10 0x7fc690150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598058418 0 0) 0x7fc6900c2220 con 0x7fc690150040 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.556+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6780033f0 con 0x7fc690150040 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673770730 0 0) 0x7fc6900c5bd0 con 0x7fc6900c26b0 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6900c2220 con 0x7fc6900c26b0 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4278779049 0 0) 0x7fc6780033f0 con 0x7fc690150040 2023-08-22T00:25:12.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 >> v2:172.21.15.118:3300/0 conn(0x7fc690153f10 msgr2=0x7fc690150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 --2- 172.21.15.98:0/3279294475 >> v2:172.21.15.118:3300/0 conn(0x7fc690153f10 0x7fc690150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 >> v1:172.21.15.118:6789/0 conn(0x7fc6900c26b0 legacy=0x7fc690062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c5e30 con 0x7fc690150040 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc684001470 con 0x7fc690150040 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 >> v1:172.21.15.98:6789/0 conn(0x7fc690150040 legacy=0x7fc6900c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc678003a70 0x7fc678003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 0x7fc678004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678005000 0x7fc67800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c1ef0 con 0x7fc678004690 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67800be80 con 0x7fc678003a70 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67800c040 con 0x7fc678005000 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 0x7fc678004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68effd700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc678003a70 0x7fc678003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68f7fe700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678005000 0x7fc67800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 -- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678005000 msgr2=0x7fc67800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:12.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678005000 0x7fc67800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 -- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc678003a70 msgr2=0x7fc678003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:12.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc678003a70 0x7fc678003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 -- 172.21.15.98:0/3279294475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780033f0 con 0x7fc678004690 2023-08-22T00:25:12.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68f7fe700 1 -- 172.21.15.98:0/3279294475 reap_dead start 2023-08-22T00:25:12.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 0x7fc678004b10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fc680006d80 tx=0x7fc68000a200).ready entity=mon.0 client_cookie=15572b0046340730 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000a5d0 con 0x7fc678004690 2023-08-22T00:25:12.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68000f820 con 0x7fc678004690 2023-08-22T00:25:12.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.557+0000 7fc68dffb700 1 -- 172.21.15.98:0/3279294475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000f990 con 0x7fc678004690 2023-08-22T00:25:12.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 -- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 msgr2=0x7fc678004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 0x7fc678004b10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fc680006d80 tx=0x7fc68000a200).stop 2023-08-22T00:25:12.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 -- 172.21.15.98:0/3279294475 shutdown_connections 2023-08-22T00:25:12.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 --2- 172.21.15.98:0/3279294475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc678004690 0x7fc678004b10 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 -- 172.21.15.98:0/3279294475 >> 172.21.15.98:0/3279294475 conn(0x7fc6900c7140 msgr2=0x7fc6900c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:12.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 -- 172.21.15.98:0/3279294475 shutdown_connections 2023-08-22T00:25:12.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.558+0000 7fc6959ea700 1 -- 172.21.15.98:0/3279294475 wait complete. 2023-08-22T00:25:12.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.559+0000 7fc6959ea700 1 Processor -- start 2023-08-22T00:25:12.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.559+0000 7fc6959ea700 1 -- start start 2023-08-22T00:25:12.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678004690 0x7fc690151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 0x7fc69014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690165220 con 0x7fc690161d00 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900bfc80 con 0x7fc6900ab300 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc6959ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900bff60 con 0x7fc678004690 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35782/0 (socket says 172.21.15.98:35782) 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 -- 172.21.15.98:0/2191909724 learned_addr learned my addr 172.21.15.98:0/2191909724 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68effd700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678004690 0x7fc690151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68f7fe700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 0x7fc69014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 -- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678004690 msgr2=0x7fc690151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678004690 0x7fc690151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 -- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 msgr2=0x7fc69014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 0x7fc69014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:12.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 -- 172.21.15.98:0/2191909724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c0240 con 0x7fc690161d00 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68f7fe700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 0x7fc69014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.560+0000 7fc68e7fc700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fc680006d50 tx=0x7fc68000a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.561+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680020070 con 0x7fc690161d00 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.561+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68000fd00 con 0x7fc690161d00 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.561+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900c0520 con 0x7fc690161d00 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.561+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68001b680 con 0x7fc690161d00 2023-08-22T00:25:12.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.561+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900bf8a0 con 0x7fc690161d00 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.562+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900c0710 con 0x7fc690161d00 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.562+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc68001ba70 con 0x7fc690161d00 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.562+0000 7fc676ffd700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 0x7fc67c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.562+0000 7fc68effd700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 0x7fc67c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.562+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fc68007b710 con 0x7fc690161d00 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.563+0000 7fc68effd700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 0x7fc67c0613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc684007cd0 tx=0x7fc684001e10).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:12.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.567+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc68004c9d0 con 0x7fc690161d00 2023-08-22T00:25:12.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:12.792+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fc690047480 con 0x7fc690161d00 2023-08-22T00:25:13.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.424+0000 7fc676ffd700 1 -- 172.21.15.98:0/2191909724 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v715) v1 ==== 177+0+0 (secure 0 0 0) 0x7fc68002a0f0 con 0x7fc690161d00 2023-08-22T00:25:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 msgr2=0x7fc67c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 0x7fc67c0613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc684007cd0 tx=0x7fc684001e10).stop 2023-08-22T00:25:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 msgr2=0x7fc6900aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fc680006d50 tx=0x7fc68000a200).stop 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 shutdown_connections 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fc67c05ef30 0x7fc67c0613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc678004690 0x7fc690151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6900ab300 0x7fc69014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 --2- 172.21.15.98:0/2191909724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc690161d00 0x7fc6900aae10 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 >> 172.21.15.98:0/2191909724 conn(0x7fc6900c7140 msgr2=0x7fc690062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 shutdown_connections 2023-08-22T00:25:13.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.426+0000 7fc6959ea700 1 -- 172.21.15.98:0/2191909724 wait complete. 2023-08-22T00:25:13.441 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:25:13.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.562+0000 7ff3b567a700 1 Processor -- start 2023-08-22T00:25:13.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.562+0000 7ff3b567a700 1 -- start start 2023-08-22T00:25:13.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.562+0000 7ff3b567a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff3b0155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.562+0000 7ff3b567a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00654a0 con 0x7ff3b00641b0 2023-08-22T00:25:13.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3b567a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b0064920 con 0x7ff3b0067d00 2023-08-22T00:25:13.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3b567a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0064c00 con 0x7ff3b014e720 2023-08-22T00:25:13.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3ae7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff3b00641b0 0x7ff3b00675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48160/0 (socket says 172.21.15.98:48160) 2023-08-22T00:25:13.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2349698608 learned_addr learned my addr 172.21.15.98:0/2349698608 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:13.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff3b0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934440696 0 0) 0x7ff3b00654a0 con 0x7ff3b00641b0 2023-08-22T00:25:13.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3980033f0 con 0x7ff3b00641b0 2023-08-22T00:25:13.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1544116302 0 0) 0x7ff3980033f0 con 0x7ff3b00641b0 2023-08-22T00:25:13.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 msgr2=0x7ff3b0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:13.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff3b0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 >> v1:172.21.15.118:6789/0 conn(0x7ff3b0067d00 legacy=0x7ff3b00c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0064ee0 con 0x7ff3b00641b0 2023-08-22T00:25:13.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff3a4001470 con 0x7ff3b00641b0 2023-08-22T00:25:13.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 >> v1:172.21.15.98:6789/0 conn(0x7ff3b00641b0 legacy=0x7ff3b00675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff398003910 0x7ff398003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff398004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398004b80 0x7ff398005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0064c00 con 0x7ff398003910 2023-08-22T00:25:13.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39800b8e0 con 0x7ff398004b80 2023-08-22T00:25:13.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39800ba50 con 0x7ff3b014e720 2023-08-22T00:25:13.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff398003910 0x7ff398003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3ae7fc700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff398004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.563+0000 7ff3af7fe700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398004b80 0x7ff398005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 -- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 msgr2=0x7ff398004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:13.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b014e720 0x7ff398004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 -- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398004b80 msgr2=0x7ff398005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:13.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398004b80 0x7ff398005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 -- 172.21.15.98:0/2349698608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980033f0 con 0x7ff398003910 2023-08-22T00:25:13.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff398003910 0x7ff398003cf0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7ff3a0009a60 tx=0x7ff3a0009060).ready entity=mon.0 client_cookie=6ebaff8bb2d3faa6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0009ea0 con 0x7ff398003910 2023-08-22T00:25:13.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0009430 con 0x7ff398003910 2023-08-22T00:25:13.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3adffb700 1 -- 172.21.15.98:0/2349698608 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000e810 con 0x7ff398003910 2023-08-22T00:25:13.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 -- 172.21.15.98:0/2349698608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff398003910 msgr2=0x7ff398003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 --2- 172.21.15.98:0/2349698608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff398003910 0x7ff398003cf0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7ff3a0009a60 tx=0x7ff3a0009060).stop 2023-08-22T00:25:13.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3af7fe700 1 -- 172.21.15.98:0/2349698608 reap_dead start 2023-08-22T00:25:13.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 -- 172.21.15.98:0/2349698608 shutdown_connections 2023-08-22T00:25:13.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 -- 172.21.15.98:0/2349698608 >> 172.21.15.98:0/2349698608 conn(0x7ff3b00c8950 msgr2=0x7ff3b00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:13.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 -- 172.21.15.98:0/2349698608 shutdown_connections 2023-08-22T00:25:13.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.564+0000 7ff3b567a700 1 -- 172.21.15.98:0/2349698608 wait complete. 2023-08-22T00:25:13.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 Processor -- start 2023-08-22T00:25:13.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 -- start start 2023-08-22T00:25:13.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398003910 0x7ff3b00c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b00c0310 0x7ff3b00c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00c4450 con 0x7ff3b00bfe90 2023-08-22T00:25:13.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01654b0 con 0x7ff398003910 2023-08-22T00:25:13.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3b567a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00c0850 con 0x7ff3b00c0310 2023-08-22T00:25:13.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3ae7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3ae7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35804/0 (socket says 172.21.15.98:35804) 2023-08-22T00:25:13.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.566+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/3204571990 learned_addr learned my addr 172.21.15.98:0/3204571990 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:13.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b00c0310 msgr2=0x7ff3b00c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b00c0310 0x7ff3b00c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:13.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398003910 msgr2=0x7ff3b00c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398003910 0x7ff3b00c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:13.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/3204571990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0164e60 con 0x7ff3b00bfe90 2023-08-22T00:25:13.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3ae7fc700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7ff3a400e830 tx=0x7ff3a4000f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4010520 con 0x7ff3b00bfe90 2023-08-22T00:25:13.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4010680 con 0x7ff3b00bfe90 2023-08-22T00:25:13.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4010a00 con 0x7ff3b00bfe90 2023-08-22T00:25:13.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b0165140 con 0x7ff3b00bfe90 2023-08-22T00:25:13.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.567+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b0165940 con 0x7ff3b00bfe90 2023-08-22T00:25:13.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.568+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b00ab3a0 con 0x7ff3b00bfe90 2023-08-22T00:25:13.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.569+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff3a4014430 con 0x7ff3b00bfe90 2023-08-22T00:25:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.569+0000 7ff396ffd700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 0x7ff39c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.569+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7ff3a407a2a0 con 0x7ff3b00bfe90 2023-08-22T00:25:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.569+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 0x7ff39c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.569+0000 7ff3aeffd700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 0x7ff39c0613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff3b014cf00 tx=0x7ff3a001a000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.573+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3a404b5c0 con 0x7ff3b00bfe90 2023-08-22T00:25:13.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.733+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff3b0069d50 con 0x7ff3b00bfe90 2023-08-22T00:25:13.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.737+0000 7ff396ffd700 1 -- 172.21.15.98:0/3204571990 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3a40220c0 con 0x7ff3b00bfe90 2023-08-22T00:25:13.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.738+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 msgr2=0x7ff39c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.738+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 0x7ff39c0613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff3b014cf00 tx=0x7ff3a001a000).stop 2023-08-22T00:25:13.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 msgr2=0x7ff3b00c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7ff3a400e830 tx=0x7ff3a4000f60).stop 2023-08-22T00:25:13.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 shutdown_connections 2023-08-22T00:25:13.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff39c05ef00 0x7ff39c0613c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3b00c0310 0x7ff3b00c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:13.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff398003910 0x7ff3b00c25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:13.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 --2- 172.21.15.98:0/3204571990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b00bfe90 0x7ff3b00c3a70 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 >> 172.21.15.98:0/3204571990 conn(0x7ff3b00c8950 msgr2=0x7ff3b00c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:13.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 shutdown_connections 2023-08-22T00:25:13.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.739+0000 7ff3b567a700 1 -- 172.21.15.98:0/3204571990 wait complete. 2023-08-22T00:25:13.752 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:25:13.753 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:13.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:13.853 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:25:13.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:25:13.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:13.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.973+0000 7f7b7a6c7700 1 Processor -- start 2023-08-22T00:25:13.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.973+0000 7f7b7a6c7700 1 -- start start 2023-08-22T00:25:13.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.973+0000 7f7b7a6c7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.973+0000 7f7b7a6c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.973+0000 7f7b7a6c7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b74063f60 con 0x7f7b740c24d0 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b7a6c7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b740bd3b0 con 0x7f7b740a89a0 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b7a6c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74154830 con 0x7f7b74155310 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b73fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b78c64700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7b740c24d0 0x7f7b740c2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:38006/0 (socket says 172.21.15.98:38006) 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b78c64700 1 -- 172.21.15.98:0/307244409 learned_addr learned my addr 172.21.15.98:0/307244409 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b73fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:60464/0 (socket says 172.21.15.98:60464) 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:52194/0 (socket says 172.21.15.98:52194) 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 -- 172.21.15.98:0/307244409 >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 msgr2=0x7f7b740bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 --2- 172.21.15.98:0/307244409 >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 -- 172.21.15.98:0/307244409 >> v1:172.21.15.118:6789/0 conn(0x7f7b740c24d0 legacy=0x7f7b740c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 -- 172.21.15.98:0/307244409 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74154b10 con 0x7f7b74155310 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b73fff700 1 --2- 172.21.15.98:0/307244409 >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.974+0000 7f7b737fe700 1 --2- 172.21.15.98:0/307244409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7b68009760 tx=0x7f7b68009060).ready entity=mon.2 client_cookie=8301e1c1d513985b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b72ffd700 1 -- 172.21.15.98:0/307244409 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800f510 con 0x7f7b74155310 2023-08-22T00:25:13.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b72ffd700 1 -- 172.21.15.98:0/307244409 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6800f670 con 0x7f7b74155310 2023-08-22T00:25:13.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b72ffd700 1 -- 172.21.15.98:0/307244409 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800f9f0 con 0x7f7b74155310 2023-08-22T00:25:13.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/307244409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 msgr2=0x7f7b74063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/307244409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7b68009760 tx=0x7f7b68009060).stop 2023-08-22T00:25:13.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/307244409 shutdown_connections 2023-08-22T00:25:13.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/307244409 >> v2:172.21.15.118:3300/0 conn(0x7f7b740a89a0 0x7f7b740bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/307244409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b74155310 0x7f7b74063a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/307244409 >> 172.21.15.98:0/307244409 conn(0x7f7b740c7140 msgr2=0x7f7b740c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:13.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/307244409 shutdown_connections 2023-08-22T00:25:13.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.975+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/307244409 wait complete. 2023-08-22T00:25:13.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.976+0000 7f7b7a6c7700 1 Processor -- start 2023-08-22T00:25:13.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.976+0000 7f7b7a6c7700 1 -- start start 2023-08-22T00:25:13.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740c24d0 0x7f7b740695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b74155310 0x7f7b74069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74069f80 con 0x7f7b740a89a0 2023-08-22T00:25:13.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74153d50 con 0x7f7b74155310 2023-08-22T00:25:13.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b7a6c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740bda30 con 0x7f7b740c24d0 2023-08-22T00:25:13.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b73fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b73fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35814/0 (socket says 172.21.15.98:35814) 2023-08-22T00:25:13.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b73fff700 1 -- 172.21.15.98:0/212631696 learned_addr learned my addr 172.21.15.98:0/212631696 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:13.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b78c64700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b74155310 0x7f7b74069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.977+0000 7f7b737fe700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740c24d0 0x7f7b740695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 -- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740c24d0 msgr2=0x7f7b740695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740c24d0 0x7f7b740695a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 -- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b74155310 msgr2=0x7f7b74069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:13.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b74155310 0x7f7b74069a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:13.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 -- 172.21.15.98:0/212631696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640092a0 con 0x7f7b740a89a0 2023-08-22T00:25:13.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b73fff700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f7b6400ea20 tx=0x7f7b64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400ee60 con 0x7f7b740a89a0 2023-08-22T00:25:13.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400c850 con 0x7f7b740a89a0 2023-08-22T00:25:13.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680092a0 con 0x7f7b740a89a0 2023-08-22T00:25:13.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400cbd0 con 0x7f7b740a89a0 2023-08-22T00:25:13.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.978+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b741534a0 con 0x7f7b740a89a0 2023-08-22T00:25:13.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.979+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b74047480 con 0x7f7b740a89a0 2023-08-22T00:25:13.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.979+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7b6401b400 con 0x7f7b740a89a0 2023-08-22T00:25:13.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.980+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 0x7f7b600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:13.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.980+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f7b6407a520 con 0x7f7b740a89a0 2023-08-22T00:25:13.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.980+0000 7f7b737fe700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 0x7f7b600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:13.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.980+0000 7f7b737fe700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 0x7f7b600613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b74155770 tx=0x7f7b68017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:13.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:13.984+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b6404b8f0 con 0x7f7b740a89a0 2023-08-22T00:25:14.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.185+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b74154df0 con 0x7f7b740a89a0 2023-08-22T00:25:14.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.186+0000 7f7b5bfff700 1 -- 172.21.15.98:0/212631696 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7b6404ef10 con 0x7f7b740a89a0 2023-08-22T00:25:14.189 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:14.189 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2429614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2429614311},{"type":"v1","addr":"172.21.15.98:6836","nonce":2429614311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2847712979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2847712979},{"type":"v1","addr":"172.21.15.118:6834","nonce":2847712979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/210900875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":210900875},{"type":"v1","addr":"172.21.15.118:6835","nonce":210900875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1906219255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1906219255},{"type":"v1","addr":"172.21.15.98:6837","nonce":1906219255}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-08-22T00:25:14.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 msgr2=0x7f7b600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 0x7f7b600613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b74155770 tx=0x7f7b68017000).stop 2023-08-22T00:25:14.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 msgr2=0x7f7b740bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f7b6400ea20 tx=0x7f7b64009060).stop 2023-08-22T00:25:14.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 shutdown_connections 2023-08-22T00:25:14.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b74155310 0x7f7b74069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b740a89a0 0x7f7b740bf4e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7b6005ef30 0x7f7b600613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 --2- 172.21.15.98:0/212631696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740c24d0 0x7f7b740695a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 >> 172.21.15.98:0/212631696 conn(0x7f7b740c7140 msgr2=0x7f7b740c2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:14.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 shutdown_connections 2023-08-22T00:25:14.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.188+0000 7f7b7a6c7700 1 -- 172.21.15.98:0/212631696 wait complete. 2023-08-22T00:25:14.192 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 51 2023-08-22T00:25:14.206 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:25:14.206 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:25:14.207 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:25:14.207 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:14.207 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:25:14.207 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:25:14.208 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:25:14.208 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:14.208 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:25:14.208 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:25:14.209 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:25:14.209 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:14.209 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:25:14.209 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:25:14.210 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:25:14.210 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:14.216 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:25:14.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:25:14.217 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:25:14.217 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:25:14.220 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:25:14.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:25:14.221 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:25:14.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:25:14.259 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:25:14.259 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:14.260 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:25:14.260 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:14.263 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:25:14.263 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:14.266 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:25:14.266 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:14.266 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:25:14.334 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:25:14.334 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:25:14.349 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:25:14.350 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:25:14.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.389+0000 7fd2942f8700 1 Processor -- start 2023-08-22T00:25:14.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.389+0000 7fd2942f8700 1 -- start start 2023-08-22T00:25:14.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.390+0000 7fd2942f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.390+0000 7fd2942f8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd28c154040 0x7fd28c0bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.390+0000 7fd2942f8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c0c3d00 con 0x7fd28c0bf2c0 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.390+0000 7fd2942f8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c0c3fe0 con 0x7fd28c154040 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.390+0000 7fd2942f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c42c0 con 0x7fd28c153c60 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd28c154040 0x7fd28c0bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd292895700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd28c0bf2c0 0x7fd28c0aa980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48166/0 (socket says 172.21.15.98:48166) 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd28c154040 0x7fd28c0bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35848/0 (socket says 172.21.15.98:35848) 2023-08-22T00:25:14.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd292895700 1 -- 172.21.15.98:0/4198248463 learned_addr learned my addr 172.21.15.98:0/4198248463 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd292094700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 -- 172.21.15.98:0/4198248463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 msgr2=0x7fd28c0c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 -- 172.21.15.98:0/4198248463 >> v1:172.21.15.98:6789/0 conn(0x7fd28c0bf2c0 legacy=0x7fd28c0aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 -- 172.21.15.98:0/4198248463 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0c45a0 con 0x7fd28c154040 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291092700 1 -- 172.21.15.98:0/4198248463 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127797933 0 0) 0x7fd28c0c3d00 con 0x7fd28c0bf2c0 2023-08-22T00:25:14.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291893700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0bedd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd288009760 tx=0x7fd288009060).ready entity=mon.0 client_cookie=9ad53a6cde8b14df server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291092700 1 -- 172.21.15.98:0/4198248463 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800b580 con 0x7fd28c154040 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291092700 1 -- 172.21.15.98:0/4198248463 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800b6e0 con 0x7fd28c154040 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.391+0000 7fd291092700 1 -- 172.21.15.98:0/4198248463 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800ba60 con 0x7fd28c154040 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 -- 172.21.15.98:0/4198248463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 msgr2=0x7fd28c0bedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0bedd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd288009760 tx=0x7fd288009060).stop 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 -- 172.21.15.98:0/4198248463 shutdown_connections 2023-08-22T00:25:14.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 --2- 172.21.15.98:0/4198248463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0bedd0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 -- 172.21.15.98:0/4198248463 >> 172.21.15.98:0/4198248463 conn(0x7fd28c0c93e0 msgr2=0x7fd28c0c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:14.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 -- 172.21.15.98:0/4198248463 shutdown_connections 2023-08-22T00:25:14.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.392+0000 7fd2942f8700 1 -- 172.21.15.98:0/4198248463 wait complete. 2023-08-22T00:25:14.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.393+0000 7fd2942f8700 1 Processor -- start 2023-08-22T00:25:14.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.393+0000 7fd2942f8700 1 -- start start 2023-08-22T00:25:14.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c0bf2c0 0x7fd28c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c147970 con 0x7fd28c154040 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c0dd0 con 0x7fd28c0bf2c0 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c10b0 con 0x7fd28c153c60 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35850/0 (socket says 172.21.15.98:35850) 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 -- 172.21.15.98:0/966867747 learned_addr learned my addr 172.21.15.98:0/966867747 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:14.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292094700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c0bf2c0 0x7fd28c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd291893700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 -- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 msgr2=0x7fd28c0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 -- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c0bf2c0 msgr2=0x7fd28c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c0bf2c0 0x7fd28c147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:14.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 -- 172.21.15.98:0/966867747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880092a0 con 0x7fd28c154040 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd292895700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd28400c730 tx=0x7fd284001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284005d30 con 0x7fd28c154040 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284005e90 con 0x7fd28c154040 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0c1390 con 0x7fd28c154040 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284007340 con 0x7fd28c154040 2023-08-22T00:25:14.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.394+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c0c1950 con 0x7fd28c154040 2023-08-22T00:25:14.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.395+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c06b180 con 0x7fd28c154040 2023-08-22T00:25:14.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.396+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd2840076f0 con 0x7fd28c154040 2023-08-22T00:25:14.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.396+0000 7fd2827fc700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 0x7fd2700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:14.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.396+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6138+0+0 (secure 0 0 0) 0x7fd28407a050 con 0x7fd28c154040 2023-08-22T00:25:14.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.396+0000 7fd292094700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 0x7fd2700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:14.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.396+0000 7fd292094700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 0x7fd2700613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd27c006fd0 tx=0x7fd27c008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:14.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.400+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd28c06b180 con 0x7fd28c154040 2023-08-22T00:25:14.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:14.576+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd28c069a90 con 0x7fd28c154040 2023-08-22T00:25:15.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.428+0000 7fd2827fc700 1 -- 172.21.15.98:0/966867747 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v148) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd28404b330 con 0x7fd28c154040 2023-08-22T00:25:15.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 msgr2=0x7fd2700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 0x7fd2700613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd27c006fd0 tx=0x7fd27c008040).stop 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 msgr2=0x7fd28c0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd28400c730 tx=0x7fd284001520).stop 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 shutdown_connections 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28c154040 0x7fd28c0c7580 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c0bf2c0 0x7fd28c147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd27005ef30 0x7fd2700613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 --2- 172.21.15.98:0/966867747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd28c153c60 0x7fd28c0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 >> 172.21.15.98:0/966867747 conn(0x7fd28c0c93e0 msgr2=0x7fd28c0a80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:15.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 shutdown_connections 2023-08-22T00:25:15.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.431+0000 7fd2942f8700 1 -- 172.21.15.98:0/966867747 wait complete. 2023-08-22T00:25:15.434 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:25:15.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:25:15.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.567+0000 7f761a5e6700 1 Processor -- start 2023-08-22T00:25:15.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.567+0000 7f761a5e6700 1 -- start start 2023-08-22T00:25:15.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f761a5e6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f761414bf70 0x7f7614152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f761a5e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f76140c3e50 0x7f76141556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f761a5e6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7614153080 con 0x7f761414c350 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f761a5e6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7614066510 con 0x7f761414bf70 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f761a5e6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76140667b0 con 0x7f76140c3e50 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.568+0000 7f7613fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f761414bf70 0x7f7614152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f761414bf70 0x7f7614152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35858/0 (socket says 172.21.15.98:35858) 2023-08-22T00:25:15.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 -- 172.21.15.98:0/3169805508 learned_addr learned my addr 172.21.15.98:0/3169805508 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:15.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 -- 172.21.15.98:0/3169805508 >> v2:172.21.15.118:3300/0 conn(0x7f76140c3e50 msgr2=0x7f76141556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:15.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 --2- 172.21.15.98:0/3169805508 >> v2:172.21.15.118:3300/0 conn(0x7f76140c3e50 0x7f76141556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:15.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 -- 172.21.15.98:0/3169805508 >> v1:172.21.15.118:6789/0 conn(0x7f761414c350 legacy=0x7f76140c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:15.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 -- 172.21.15.98:0/3169805508 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614155ba0 con 0x7f761414bf70 2023-08-22T00:25:15.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7613fff700 1 --2- 172.21.15.98:0/3169805508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f761414bf70 0x7f7614152b90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f76140a8280 tx=0x7f76040090f0).ready entity=mon.0 client_cookie=55c9e5089c90ec8d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7612ffd700 1 -- 172.21.15.98:0/3169805508 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400b5a0 con 0x7f761414bf70 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7612ffd700 1 -- 172.21.15.98:0/3169805508 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400b700 con 0x7f761414bf70 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f7612ffd700 1 -- 172.21.15.98:0/3169805508 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400ba80 con 0x7f761414bf70 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f761a5e6700 1 -- 172.21.15.98:0/3169805508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f761414bf70 msgr2=0x7f7614152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.569+0000 7f761a5e6700 1 --2- 172.21.15.98:0/3169805508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f761414bf70 0x7f7614152b90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f76140a8280 tx=0x7f76040090f0).stop 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 -- 172.21.15.98:0/3169805508 shutdown_connections 2023-08-22T00:25:15.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 --2- 172.21.15.98:0/3169805508 >> v2:172.21.15.118:3300/0 conn(0x7f76140c3e50 0x7f76141556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:15.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 --2- 172.21.15.98:0/3169805508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f761414bf70 0x7f7614152b90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 -- 172.21.15.98:0/3169805508 >> 172.21.15.98:0/3169805508 conn(0x7f76140c5dc0 msgr2=0x7f7614068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:15.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 -- 172.21.15.98:0/3169805508 shutdown_connections 2023-08-22T00:25:15.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.570+0000 7f761a5e6700 1 -- 172.21.15.98:0/3169805508 wait complete. 2023-08-22T00:25:15.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.571+0000 7f761a5e6700 1 Processor -- start 2023-08-22T00:25:15.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.571+0000 7f761a5e6700 1 -- start start 2023-08-22T00:25:15.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f761414bf70 0x7f761414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761414c350 0x7f76140aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761414f020 con 0x7f76140c3e50 2023-08-22T00:25:15.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614149960 con 0x7f761414c350 2023-08-22T00:25:15.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761414e410 con 0x7f761414bf70 2023-08-22T00:25:15.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35870/0 (socket says 172.21.15.98:35870) 2023-08-22T00:25:15.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 -- 172.21.15.98:0/1886980394 learned_addr learned my addr 172.21.15.98:0/1886980394 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:15.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 -- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f761414bf70 msgr2=0x7f761414dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f761414bf70 0x7f761414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:15.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 -- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761414c350 msgr2=0x7f76140aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7618b83700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761414c350 0x7f76140aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761414c350 0x7f76140aa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 -- 172.21.15.98:0/1886980394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604009370 con 0x7f76140c3e50 2023-08-22T00:25:15.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f7613fff700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f7604006df0 tx=0x7f7604015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400b870 con 0x7f76140c3e50 2023-08-22T00:25:15.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761414e6f0 con 0x7f76140c3e50 2023-08-22T00:25:15.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400b9d0 con 0x7f76140c3e50 2023-08-22T00:25:15.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760401c630 con 0x7f76140c3e50 2023-08-22T00:25:15.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.572+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761414ecb0 con 0x7f76140c3e50 2023-08-22T00:25:15.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.573+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7614047480 con 0x7f76140c3e50 2023-08-22T00:25:15.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.574+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f760401ca20 con 0x7f76140c3e50 2023-08-22T00:25:15.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.574+0000 7f75fbfff700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 0x7f76000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.574+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f760407bc20 con 0x7f76140c3e50 2023-08-22T00:25:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.574+0000 7f76137fe700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 0x7f76000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.575+0000 7f76137fe700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 0x7f76000613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f76140a6c40 tx=0x7f7608006ac0).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.578+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f760404d100 con 0x7f76140c3e50 2023-08-22T00:25:15.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.805+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7614155e00 con 0x7f76140c3e50 2023-08-22T00:25:15.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.806+0000 7f75fbfff700 1 -- 172.21.15.98:0/1886980394 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f760402a030 con 0x7f76140c3e50 2023-08-22T00:25:15.808 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:15.808 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:25:15.808 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:25:15.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.809 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:25:15.809 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:25:15.809 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.809 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.811 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:25:15.811 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:25:15.811 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.811 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.812 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:15.812 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:15.812 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.815 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:25:15.815 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:15.817 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.818 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:25:15.819 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.820 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.823 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:25:15.823 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:25:15.823 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.824 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:25:15.828 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:25:15.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:15.830 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.831 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:15.833 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:25:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.837 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:25:15.837 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:25:15.837 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:25:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:15.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:25:15.840 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:25:15.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 msgr2=0x7f76000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 0x7f76000613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f76140a6c40 tx=0x7f7608006ac0).stop 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 msgr2=0x7f7614149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f7604006df0 tx=0x7f7604015000).stop 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 shutdown_connections 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761414c350 0x7f76140aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76140c3e50 0x7f7614149470 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f760005ef30 0x7f76000613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 --2- 172.21.15.98:0/1886980394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f761414bf70 0x7f761414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:15.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.807+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 >> 172.21.15.98:0/1886980394 conn(0x7f76140c5dc0 msgr2=0x7f7614149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:15.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.808+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 shutdown_connections 2023-08-22T00:25:15.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.808+0000 7f761a5e6700 1 -- 172.21.15.98:0/1886980394 wait complete. 2023-08-22T00:25:15.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.960+0000 7f889052e700 1 Processor -- start 2023-08-22T00:25:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.960+0000 7f889052e700 1 -- start start 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f889052e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88880bd870 0x7f88880c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f889052e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88880bd3e0 con 0x7f8888065f10 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f889052e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88880bd0c0 con 0x7f8888150e40 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f889052e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88880c3bb0 con 0x7f88880bd870 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f888eacb700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8888065f10 0x7f8888066340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48178/0 (socket says 172.21.15.98:48178) 2023-08-22T00:25:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.961+0000 7f888eacb700 1 -- 172.21.15.98:0/2279853806 learned_addr learned my addr 172.21.15.98:0/2279853806 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888dac9700 1 --2- 172.21.15.98:0/2279853806 >> v2:172.21.15.118:3300/0 conn(0x7f88880bd870 0x7f88880c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023554213 0 0) 0x7f88880bd3e0 con 0x7f8888065f10 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88740033f0 con 0x7f8888065f10 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982308374 0 0) 0x7f88880bd0c0 con 0x7f8888150e40 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88880bd3e0 con 0x7f8888150e40 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061497978 0 0) 0x7f88740033f0 con 0x7f8888065f10 2023-08-22T00:25:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 >> v2:172.21.15.118:3300/0 conn(0x7f88880bd870 msgr2=0x7f88880c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 --2- 172.21.15.98:0/2279853806 >> v2:172.21.15.118:3300/0 conn(0x7f88880bd870 0x7f88880c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 >> v1:172.21.15.118:6789/0 conn(0x7f8888150e40 legacy=0x7f88880a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88880c3e90 con 0x7f8888065f10 2023-08-22T00:25:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f88800017f0 con 0x7f8888065f10 2023-08-22T00:25:15.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 >> v1:172.21.15.98:6789/0 conn(0x7f8888065f10 legacy=0x7f8888066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8874003ac0 0x7f8874003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874004690 0x7f8874004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 0x7f887400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88880c3bb0 con 0x7f8874005070 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887400c010 con 0x7f8874003ac0 2023-08-22T00:25:15.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887400c1d0 con 0x7f8874004690 2023-08-22T00:25:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888eacb700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 0x7f887400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8874003ac0 0x7f8874003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.962+0000 7f888dac9700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874004690 0x7f8874004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 -- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874004690 msgr2=0x7f8874004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874004690 0x7f8874004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 -- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8874003ac0 msgr2=0x7f8874003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8874003ac0 0x7f8874003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 -- 172.21.15.98:0/2279853806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740033f0 con 0x7f8874005070 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8874003ac0 0x7f8874003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 -- 172.21.15.98:0/2279853806 reap_dead start 2023-08-22T00:25:15.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888eacb700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 0x7f887400b8e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f888000c410 tx=0x7f8880007f40).ready entity=mon.0 client_cookie=17e5454e3abd8e5b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000cce0 con 0x7f8874005070 2023-08-22T00:25:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000ce40 con 0x7f8874005070 2023-08-22T00:25:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f888d2c8700 1 -- 172.21.15.98:0/2279853806 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880005d50 con 0x7f8874005070 2023-08-22T00:25:15.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 -- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 msgr2=0x7f887400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 0x7f887400b8e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f888000c410 tx=0x7f8880007f40).stop 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 -- 172.21.15.98:0/2279853806 shutdown_connections 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 --2- 172.21.15.98:0/2279853806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8874005070 0x7f887400b8e0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 -- 172.21.15.98:0/2279853806 >> 172.21.15.98:0/2279853806 conn(0x7f888806a980 msgr2=0x7f88880c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 -- 172.21.15.98:0/2279853806 shutdown_connections 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.963+0000 7f889052e700 1 -- 172.21.15.98:0/2279853806 wait complete. 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.964+0000 7f889052e700 1 Processor -- start 2023-08-22T00:25:15.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 -- start start 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 0x7f8888151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 0x7f88880662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888152410 con 0x7f88881528a0 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888151800 con 0x7f8888147410 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f889052e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888151ae0 con 0x7f8874005070 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f888dac9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f888dac9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35880/0 (socket says 172.21.15.98:35880) 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f888dac9700 1 -- 172.21.15.98:0/2901176373 learned_addr learned my addr 172.21.15.98:0/2901176373 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.965+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 0x7f8888151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888eacb700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 0x7f88880662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 -- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 msgr2=0x7f8888151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 0x7f8888151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 -- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 msgr2=0x7f88880662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:15.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 0x7f88880662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 -- 172.21.15.98:0/2901176373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888151dc0 con 0x7f88881528a0 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888eacb700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 0x7f88880662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 0x7f8888151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f888dac9700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f887c006940 tx=0x7f887c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c011ed0 con 0x7f88881528a0 2023-08-22T00:25:15.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c00f940 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88881520a0 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c00fd00 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.966+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8888147870 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.967+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88881525c0 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.967+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f887c014650 con 0x7f88881528a0 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.968+0000 7f887a7fc700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 0x7f886c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:15.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.968+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f887c07a700 con 0x7f88881528a0 2023-08-22T00:25:15.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.968+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 0x7f886c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.968+0000 7f888e2ca700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 0x7f886c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8884001120 tx=0x7f8884009040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:15.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:15.972+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88881525c0 con 0x7f88881528a0 2023-08-22T00:25:16.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.133+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8888047480 con 0x7f88881528a0 2023-08-22T00:25:16.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.134+0000 7f887a7fc700 1 -- 172.21.15.98:0/2901176373 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+14055 (secure 0 0 0) 0x7f887c022070 con 0x7f88881528a0 2023-08-22T00:25:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:16.136 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":148,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:15.424908+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:16.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 msgr2=0x7f886c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 0x7f886c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8884001120 tx=0x7f8884009040).stop 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 msgr2=0x7f888814eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f887c006940 tx=0x7f887c009060).stop 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 shutdown_connections 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f886c05ef30 0x7f886c0613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8874005070 0x7f8888151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888147410 0x7f88880662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 --2- 172.21.15.98:0/2901176373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88881528a0 0x7f888814eb80 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 >> 172.21.15.98:0/2901176373 conn(0x7f888806a980 msgr2=0x7f8888062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 shutdown_connections 2023-08-22T00:25:16.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.136+0000 7f889052e700 1 -- 172.21.15.98:0/2901176373 wait complete. 2023-08-22T00:25:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:25:16.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:25:16.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.271+0000 7fba9339d700 1 Processor -- start 2023-08-22T00:25:16.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.271+0000 7fba9339d700 1 -- start start 2023-08-22T00:25:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba9339d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba8c153e90 0x7fba8c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba9339d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c158260 con 0x7fba8c157a80 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba9339d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c063d20 con 0x7fba8c157e60 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba9339d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0c8d30 con 0x7fba8c153e90 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba91139700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fba8c157a80 0x7fba8c153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48188/0 (socket says 172.21.15.98:48188) 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.272+0000 7fba91139700 1 -- 172.21.15.98:0/3019168513 learned_addr learned my addr 172.21.15.98:0/3019168513 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba90938700 1 --2- 172.21.15.98:0/3019168513 >> v2:172.21.15.118:3300/0 conn(0x7fba8c153e90 0x7fba8c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934186529 0 0) 0x7fba7c001110 con 0x7fba8c157a80 2023-08-22T00:25:16.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba780033f0 con 0x7fba8c157a80 2023-08-22T00:25:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464112639 0 0) 0x7fba8c063d20 con 0x7fba8c157e60 2023-08-22T00:25:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba7c001110 con 0x7fba8c157e60 2023-08-22T00:25:16.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba90938700 1 -- 172.21.15.98:0/3019168513 >> v1:172.21.15.118:6789/0 conn(0x7fba8c157e60 legacy=0x7fba8c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba90938700 1 -- 172.21.15.98:0/3019168513 >> v1:172.21.15.98:6789/0 conn(0x7fba8c157a80 legacy=0x7fba8c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386204790 0 0) 0x7fba780033f0 con 0x7fba8c157a80 2023-08-22T00:25:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba90938700 1 -- 172.21.15.98:0/3019168513 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c0c9010 con 0x7fba8c153e90 2023-08-22T00:25:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba90938700 1 --2- 172.21.15.98:0/3019168513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c0aa920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fba88009760 tx=0x7fba88009060).ready entity=mon.1 client_cookie=949c14e253d054f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c001600 con 0x7fba8c153e90 2023-08-22T00:25:16.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88011400 con 0x7fba8c153e90 2023-08-22T00:25:16.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.273+0000 7fba83fff700 1 -- 172.21.15.98:0/3019168513 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88011780 con 0x7fba8c153e90 2023-08-22T00:25:16.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 -- 172.21.15.98:0/3019168513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 msgr2=0x7fba8c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 --2- 172.21.15.98:0/3019168513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c0aa920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fba88009760 tx=0x7fba88009060).stop 2023-08-22T00:25:16.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 -- 172.21.15.98:0/3019168513 shutdown_connections 2023-08-22T00:25:16.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 --2- 172.21.15.98:0/3019168513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c0aa920 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 -- 172.21.15.98:0/3019168513 >> 172.21.15.98:0/3019168513 conn(0x7fba8c0cb5f0 msgr2=0x7fba8c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 -- 172.21.15.98:0/3019168513 shutdown_connections 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.274+0000 7fba9339d700 1 -- 172.21.15.98:0/3019168513 wait complete. 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.275+0000 7fba9339d700 1 Processor -- start 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.275+0000 7fba9339d700 1 -- start start 2023-08-22T00:25:16.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba8c157e60 0x7fba8c062600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c14dd30 con 0x7fba8c157a80 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c14d120 con 0x7fba8c153e90 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9339d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c14d400 con 0x7fba8c157e60 2023-08-22T00:25:16.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35884/0 (socket says 172.21.15.98:35884) 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 -- 172.21.15.98:0/3109534535 learned_addr learned my addr 172.21.15.98:0/3109534535 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba91139700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba9193a700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba8c157e60 0x7fba8c062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 -- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba8c157e60 msgr2=0x7fba8c062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba8c157e60 0x7fba8c062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 -- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 msgr2=0x7fba8c14b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c14b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 -- 172.21.15.98:0/3109534535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880092a0 con 0x7fba8c157a80 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba91139700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba90938700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fba88009d50 tx=0x7fba88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.276+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba880108e0 con 0x7fba8c157a80 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.277+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88010a40 con 0x7fba8c157a80 2023-08-22T00:25:16.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.277+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c14d6e0 con 0x7fba8c157a80 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.277+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88010dc0 con 0x7fba8c157a80 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.277+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c14bc10 con 0x7fba8c157a80 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.278+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c083630 con 0x7fba8c157a80 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.278+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fba8801d640 con 0x7fba8c157a80 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.278+0000 7fba817fa700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 0x7fba700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.278+0000 7fba91139700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 0x7fba700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.278+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fba8807a890 con 0x7fba8c157a80 2023-08-22T00:25:16.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.279+0000 7fba91139700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 0x7fba700613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fba7c0010e0 tx=0x7fba7c001330).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.283+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba8804be20 con 0x7fba8c157a80 2023-08-22T00:25:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.446+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fba8c0c92f0 con 0x7fba8c157a80 2023-08-22T00:25:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.446+0000 7fba817fa700 1 -- 172.21.15.98:0/3109534535 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7fba88022030 con 0x7fba8c157a80 2023-08-22T00:25:16.451 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:25:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.448+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 msgr2=0x7fba700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.448+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 0x7fba700613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fba7c0010e0 tx=0x7fba7c001330).stop 2023-08-22T00:25:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.448+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 msgr2=0x7fba8c14c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.448+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fba88009d50 tx=0x7fba88016000).stop 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 shutdown_connections 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba7005ef30 0x7fba700613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba8c157e60 0x7fba8c062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba8c153e90 0x7fba8c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 --2- 172.21.15.98:0/3109534535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba8c157a80 0x7fba8c14c6f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 >> 172.21.15.98:0/3109534535 conn(0x7fba8c0cb5f0 msgr2=0x7fba8c14e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 shutdown_connections 2023-08-22T00:25:16.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.449+0000 7fba9339d700 1 -- 172.21.15.98:0/3109534535 wait complete. 2023-08-22T00:25:16.462 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:25:16.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.585+0000 7f713081f700 1 Processor -- start 2023-08-22T00:25:16.587 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.585+0000 7f713081f700 1 -- start start 2023-08-22T00:25:16.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.586+0000 7f713081f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f712c0c5b30 0x7f712c063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.586+0000 7f713081f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c064280 con 0x7f712c1579e0 2023-08-22T00:25:16.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.586+0000 7f713081f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0c4c20 con 0x7f712c0c5750 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.586+0000 7f713081f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0c1850 con 0x7f712c0c5b30 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712ad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f712c0c5b30 0x7f712c063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f7129d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f712c1579e0 0x7f712c154a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48194/0 (socket says 172.21.15.98:48194) 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f7129d9b700 1 -- 172.21.15.98:0/182679705 learned_addr learned my addr 172.21.15.98:0/182679705 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712ad9d700 1 -- 172.21.15.98:0/182679705 >> v1:172.21.15.118:6789/0 conn(0x7f712c0c5750 legacy=0x7f712c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712ad9d700 1 -- 172.21.15.98:0/182679705 >> v1:172.21.15.98:6789/0 conn(0x7f712c1579e0 legacy=0x7f712c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712ad9d700 1 -- 172.21.15.98:0/182679705 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c063670 con 0x7f712c0c5b30 2023-08-22T00:25:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712959a700 1 -- 172.21.15.98:0/182679705 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378104425 0 0) 0x7f712c064280 con 0x7f712c1579e0 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712ad9d700 1 --2- 172.21.15.98:0/182679705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5b30 0x7f712c063000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f7124009e60 tx=0x7f7124009780).ready entity=mon.0 client_cookie=170585937af37067 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712959a700 1 -- 172.21.15.98:0/182679705 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400e070 con 0x7f712c0c5b30 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712959a700 1 -- 172.21.15.98:0/182679705 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400bbf0 con 0x7f712c0c5b30 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f712959a700 1 -- 172.21.15.98:0/182679705 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124012410 con 0x7f712c0c5b30 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f713081f700 1 -- 172.21.15.98:0/182679705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5b30 msgr2=0x7f712c063000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.587+0000 7f713081f700 1 --2- 172.21.15.98:0/182679705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5b30 0x7f712c063000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f7124009e60 tx=0x7f7124009780).stop 2023-08-22T00:25:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.588+0000 7f713081f700 1 -- 172.21.15.98:0/182679705 shutdown_connections 2023-08-22T00:25:16.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.588+0000 7f713081f700 1 --2- 172.21.15.98:0/182679705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5b30 0x7f712c063000 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.588+0000 7f713081f700 1 -- 172.21.15.98:0/182679705 >> 172.21.15.98:0/182679705 conn(0x7f712c0c3a60 msgr2=0x7f712c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.588+0000 7f713081f700 1 -- 172.21.15.98:0/182679705 shutdown_connections 2023-08-22T00:25:16.597 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.588+0000 7f713081f700 1 -- 172.21.15.98:0/182679705 wait complete. 2023-08-22T00:25:16.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 Processor -- start 2023-08-22T00:25:16.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 -- start start 2023-08-22T00:25:16.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f712c0c5b30 0x7f712c0bea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f712c1579e0 0x7f712c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c155fa0 con 0x7f712c0c5750 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c156280 con 0x7f712c0c5b30 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.589+0000 7f713081f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c156560 con 0x7f712c1579e0 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35910/0 (socket says 172.21.15.98:35910) 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 -- 172.21.15.98:0/2362841589 learned_addr learned my addr 172.21.15.98:0/2362841589 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 -- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f712c1579e0 msgr2=0x7f712c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f712c1579e0 0x7f712c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 -- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f712c0c5b30 msgr2=0x7f712c0bea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f712c0c5b30 0x7f712c0bea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 -- 172.21.15.98:0/2362841589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009a20 con 0x7f712c0c5750 2023-08-22T00:25:16.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f712a59c700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f712000b490 tx=0x7f7120006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120012450 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71200125f0 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200129b0 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c156840 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.590+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c154070 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.591+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c156d60 con 0x7f712c0c5750 2023-08-22T00:25:16.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.591+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7120012d20 con 0x7f712c0c5750 2023-08-22T00:25:16.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.592+0000 7f711a7fc700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 0x7f710c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.592+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7120079560 con 0x7f712c0c5750 2023-08-22T00:25:16.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.592+0000 7f7129d9b700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 0x7f710c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.592+0000 7f7129d9b700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 0x7f710c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f711c0011e0 tx=0x7f711c007850).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.596+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f712004aaf0 con 0x7f712c0c5750 2023-08-22T00:25:16.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.755+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f712c0c6d00 con 0x7f712c0c5750 2023-08-22T00:25:16.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.756+0000 7f711a7fc700 1 -- 172.21.15.98:0/2362841589 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7120017020 con 0x7f712c0c5750 2023-08-22T00:25:16.757 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:25:16.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 msgr2=0x7f710c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 0x7f710c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f711c0011e0 tx=0x7f711c007850).stop 2023-08-22T00:25:16.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 msgr2=0x7f712c157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f712000b490 tx=0x7f7120006f00).stop 2023-08-22T00:25:16.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 shutdown_connections 2023-08-22T00:25:16.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f710c05ef30 0x7f710c0613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f712c1579e0 0x7f712c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:16.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f712c0c5750 0x7f712c157040 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 --2- 172.21.15.98:0/2362841589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f712c0c5b30 0x7f712c0bea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:16.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 >> 172.21.15.98:0/2362841589 conn(0x7f712c0c3a60 msgr2=0x7f712c0bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.757+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 shutdown_connections 2023-08-22T00:25:16.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.758+0000 7f713081f700 1 -- 172.21.15.98:0/2362841589 wait complete. 2023-08-22T00:25:16.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:25:16.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 Processor -- start 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 -- start start 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9f00bd870 0x7fa9f00a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f00bd3e0 con 0x7fa9f0065f10 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00bd0c0 con 0x7fa9f00bd870 2023-08-22T00:25:16.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.887+0000 7fa9f6847700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00c3bb0 con 0x7fa9f0150e40 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9ef7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9f00bd870 0x7fa9f00a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:52306/0 (socket says 172.21.15.98:52306) 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 -- 172.21.15.98:0/2947368746 learned_addr learned my addr 172.21.15.98:0/2947368746 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9f4de4700 1 --1- 172.21.15.98:0/2947368746 >> v1:172.21.15.118:6789/0 conn(0x7fa9f0065f10 0x7fa9f0154aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:38088/0 (socket says 172.21.15.98:38088) 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9eeffd700 1 -- 172.21.15.98:0/2947368746 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278264688 0 0) 0x7fa9f00bd3e0 con 0x7fa9f0065f10 2023-08-22T00:25:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 -- 172.21.15.98:0/2947368746 >> v2:172.21.15.118:3300/0 conn(0x7fa9f00bd870 msgr2=0x7fa9f00a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 --2- 172.21.15.98:0/2947368746 >> v2:172.21.15.118:3300/0 conn(0x7fa9f00bd870 0x7fa9f00a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 -- 172.21.15.98:0/2947368746 >> v1:172.21.15.118:6789/0 conn(0x7fa9f0065f10 legacy=0x7fa9f0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 -- 172.21.15.98:0/2947368746 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00c3e90 con 0x7fa9f0150e40 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.888+0000 7fa9effff700 1 --2- 172.21.15.98:0/2947368746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa9e0006fd0 tx=0x7fa9e00090f0).ready entity=mon.2 client_cookie=98f660114a632201 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9eeffd700 1 -- 172.21.15.98:0/2947368746 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000b580 con 0x7fa9f0150e40 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9eeffd700 1 -- 172.21.15.98:0/2947368746 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b6e0 con 0x7fa9f0150e40 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9eeffd700 1 -- 172.21.15.98:0/2947368746 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000ba80 con 0x7fa9f0150e40 2023-08-22T00:25:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 -- 172.21.15.98:0/2947368746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 msgr2=0x7fa9f00c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 --2- 172.21.15.98:0/2947368746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa9e0006fd0 tx=0x7fa9e00090f0).stop 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 -- 172.21.15.98:0/2947368746 shutdown_connections 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 --2- 172.21.15.98:0/2947368746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0150e40 0x7fa9f00c2050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 --2- 172.21.15.98:0/2947368746 >> v2:172.21.15.118:3300/0 conn(0x7fa9f00bd870 0x7fa9f00a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 -- 172.21.15.98:0/2947368746 >> 172.21.15.98:0/2947368746 conn(0x7fa9f006a980 msgr2=0x7fa9f00c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 -- 172.21.15.98:0/2947368746 shutdown_connections 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.889+0000 7fa9f6847700 1 -- 172.21.15.98:0/2947368746 wait complete. 2023-08-22T00:25:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.890+0000 7fa9f6847700 1 Processor -- start 2023-08-22T00:25:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.890+0000 7fa9f6847700 1 -- start start 2023-08-22T00:25:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0065f10 0x7fa9f014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f00bd870 0x7fa9f0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00bf100 con 0x7fa9f0150e40 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00ac0c0 con 0x7fa9f00bd870 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f6847700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00ac680 con 0x7fa9f0065f10 2023-08-22T00:25:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f4de4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f4de4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35914/0 (socket says 172.21.15.98:35914) 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9f4de4700 1 -- 172.21.15.98:0/843634292 learned_addr learned my addr 172.21.15.98:0/843634292 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9ef7fe700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f00bd870 0x7fa9f0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.891+0000 7fa9effff700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0065f10 0x7fa9f014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 -- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0065f10 msgr2=0x7fa9f014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0065f10 0x7fa9f014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 -- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f00bd870 msgr2=0x7fa9f0153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f00bd870 0x7fa9f0153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 -- 172.21.15.98:0/843634292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009370 con 0x7fa9f0150e40 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f4de4700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa9e800c810 tx=0x7fa9e8007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8005c70 con 0x7fa9f0150e40 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8005dd0 con 0x7fa9f0150e40 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00beb40 con 0x7fa9f0150e40 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8007320 con 0x7fa9f0150e40 2023-08-22T00:25:16.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.892+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f00be830 con 0x7fa9f0150e40 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.893+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0047480 con 0x7fa9f0150e40 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.894+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa9e8007710 con 0x7fa9f0150e40 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.894+0000 7fa9d7fff700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 0x7fa9dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.894+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fa9e8079d50 con 0x7fa9f0150e40 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.894+0000 7fa9effff700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 0x7fa9dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.894+0000 7fa9effff700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 0x7fa9dc0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa9e000b340 tx=0x7fa9e0017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:16.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:16.898+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9e804b290 con 0x7fa9f0150e40 2023-08-22T00:25:17.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.059+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa9f00ac7c0 con 0x7fa9f0150e40 2023-08-22T00:25:17.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.060+0000 7fa9d7fff700 1 -- 172.21.15.98:0/843634292 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa9e804e8b0 con 0x7fa9f0150e40 2023-08-22T00:25:17.066 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:25:17.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:17.066 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:25:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 msgr2=0x7fa9dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 0x7fa9dc0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa9e000b340 tx=0x7fa9e0017000).stop 2023-08-22T00:25:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 msgr2=0x7fa9f00acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa9e800c810 tx=0x7fa9e8007f60).stop 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 shutdown_connections 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa9dc05ef30 0x7fa9dc0613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9f0065f10 0x7fa9f014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0150e40 0x7fa9f00acb10 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 --2- 172.21.15.98:0/843634292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f00bd870 0x7fa9f0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 >> 172.21.15.98:0/843634292 conn(0x7fa9f006a980 msgr2=0x7fa9f00c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:17.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 shutdown_connections 2023-08-22T00:25:17.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.061+0000 7fa9f6847700 1 -- 172.21.15.98:0/843634292 wait complete. 2023-08-22T00:25:17.075 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:25:17.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:25:17.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.196+0000 7f230781b700 1 Processor -- start 2023-08-22T00:25:17.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.196+0000 7f230781b700 1 -- start start 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f230781b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2300064610 0x7f23001555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f230781b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2300151ff0 con 0x7f23000675b0 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f230781b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000c2150 con 0x7f23000649f0 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f230781b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000c2cd0 con 0x7f2300064610 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f23055b7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2300064610 0x7f23001555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f2305db8700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f23000675b0 0x7f2300152420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48198/0 (socket says 172.21.15.98:48198) 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.197+0000 7f2305db8700 1 -- 172.21.15.98:0/3581214686 learned_addr learned my addr 172.21.15.98:0/3581214686 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f23055b7700 1 -- 172.21.15.98:0/3581214686 >> v1:172.21.15.118:6789/0 conn(0x7f23000649f0 legacy=0x7f23000c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f23055b7700 1 -- 172.21.15.98:0/3581214686 >> v1:172.21.15.98:6789/0 conn(0x7f23000675b0 legacy=0x7f2300152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f23055b7700 1 -- 172.21.15.98:0/3581214686 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000c2430 con 0x7f2300064610 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f22f7fff700 1 -- 172.21.15.98:0/3581214686 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034633877 0 0) 0x7f2300151ff0 con 0x7f23000675b0 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f23055b7700 1 --2- 172.21.15.98:0/3581214686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300064610 0x7f23001555e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f22f0009790 tx=0x7f22f0009060).ready entity=mon.0 client_cookie=16ecc855caf64407 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f22f7fff700 1 -- 172.21.15.98:0/3581214686 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000b520 con 0x7f2300064610 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f22f7fff700 1 -- 172.21.15.98:0/3581214686 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000b680 con 0x7f2300064610 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f22f7fff700 1 -- 172.21.15.98:0/3581214686 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000ba00 con 0x7f2300064610 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 -- 172.21.15.98:0/3581214686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300064610 msgr2=0x7f23001555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 --2- 172.21.15.98:0/3581214686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300064610 0x7f23001555e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f22f0009790 tx=0x7f22f0009060).stop 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 -- 172.21.15.98:0/3581214686 shutdown_connections 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 --2- 172.21.15.98:0/3581214686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300064610 0x7f23001555e0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 -- 172.21.15.98:0/3581214686 >> 172.21.15.98:0/3581214686 conn(0x7f2300066a70 msgr2=0x7f23000c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:17.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 -- 172.21.15.98:0/3581214686 shutdown_connections 2023-08-22T00:25:17.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.198+0000 7f230781b700 1 -- 172.21.15.98:0/3581214686 wait complete. 2023-08-22T00:25:17.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.200+0000 7f230781b700 1 Processor -- start 2023-08-22T00:25:17.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.200+0000 7f230781b700 1 -- start start 2023-08-22T00:25:17.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2300064610 0x7f23000be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23000649f0 0x7f23000aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000aade0 con 0x7f23000675b0 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c1350 con 0x7f2300064610 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f230781b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c1630 con 0x7f23000649f0 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35932/0 (socket says 172.21.15.98:35932) 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 -- 172.21.15.98:0/2666760960 learned_addr learned my addr 172.21.15.98:0/2666760960 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f23055b7700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2300064610 0x7f23000be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2304db6700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23000649f0 0x7f23000aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 -- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23000649f0 msgr2=0x7f23000aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23000649f0 0x7f23000aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 -- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2300064610 msgr2=0x7f23000be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.201+0000 7f2305db8700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2300064610 0x7f23000be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f2305db8700 1 -- 172.21.15.98:0/2666760960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00092a0 con 0x7f23000675b0 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f2305db8700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f22f800c7e0 tx=0x7f22f8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8005d30 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8005e90 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8007320 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000c1910 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.202+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23000acf50 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.203+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23000c1b50 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.204+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f22f8007710 con 0x7f23000675b0 2023-08-22T00:25:17.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.204+0000 7f22f57fa700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 0x7f22e4061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.204+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f22f8079cc0 con 0x7f23000675b0 2023-08-22T00:25:17.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.204+0000 7f23055b7700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 0x7f22e4061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.204+0000 7f23055b7700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 0x7f22e4061420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f22f0009760 tx=0x7f22f0015000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.208+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22f804b1a0 con 0x7f23000675b0 2023-08-22T00:25:17.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.369+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f2300047480 con 0x7f23000675b0 2023-08-22T00:25:17.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.441+0000 7f22f57fa700 1 -- 172.21.15.98:0/2666760960 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v149) v1 ==== 152+0+0 (secure 0 0 0) 0x7f22f804e7c0 con 0x7f23000675b0 2023-08-22T00:25:17.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.444+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 msgr2=0x7f22e4061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.444+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 0x7f22e4061420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f22f0009760 tx=0x7f22f0015000).stop 2023-08-22T00:25:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.444+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 msgr2=0x7f23000bd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.444+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f22f800c7e0 tx=0x7f22f8007f90).stop 2023-08-22T00:25:17.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 shutdown_connections 2023-08-22T00:25:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000675b0 0x7f23000bd340 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2300064610 0x7f23000be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f22e405ef60 0x7f22e4061420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 --2- 172.21.15.98:0/2666760960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23000649f0 0x7f23000aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.446+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 >> 172.21.15.98:0/2666760960 conn(0x7f2300066a70 msgr2=0x7f23000a7820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.448+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 shutdown_connections 2023-08-22T00:25:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.448+0000 7f230781b700 1 -- 172.21.15.98:0/2666760960 wait complete. 2023-08-22T00:25:17.458 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:25:17.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:25:17.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.587+0000 7fde37bb4700 1 Processor -- start 2023-08-22T00:25:17.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.587+0000 7fde37bb4700 1 -- start start 2023-08-22T00:25:17.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde37bb4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde30066150 0x7fde30066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde37bb4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300c69b0 con 0x7fde30157890 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde37bb4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde301542c0 con 0x7fde300c5360 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde37bb4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300c57f0 con 0x7fde30066150 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde36151700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fde30157890 0x7fde300c33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48200/0 (socket says 172.21.15.98:48200) 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.588+0000 7fde36151700 1 -- 172.21.15.98:0/3222144554 learned_addr learned my addr 172.21.15.98:0/3222144554 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 --2- 172.21.15.98:0/3222144554 >> v2:172.21.15.118:3300/0 conn(0x7fde30066150 0x7fde30066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557546879 0 0) 0x7fde300c69b0 con 0x7fde30157890 2023-08-22T00:25:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1c0033f0 con 0x7fde30157890 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725975913 0 0) 0x7fde1c0033f0 con 0x7fde30157890 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 >> v2:172.21.15.118:3300/0 conn(0x7fde30066150 msgr2=0x7fde30066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 --2- 172.21.15.98:0/3222144554 >> v2:172.21.15.118:3300/0 conn(0x7fde30066150 0x7fde30066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 >> v1:172.21.15.118:6789/0 conn(0x7fde300c5360 legacy=0x7fde300c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300c5ad0 con 0x7fde30157890 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fde280017f0 con 0x7fde30157890 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 >> v1:172.21.15.98:6789/0 conn(0x7fde30157890 legacy=0x7fde300c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde1c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde1c004690 0x7fde1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1c005000 0x7fde1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300c57f0 con 0x7fde1c0038e0 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c00beb0 con 0x7fde1c005000 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c00c070 con 0x7fde1c004690 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde1c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3514f700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde1c004690 0x7fde1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde36151700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1c005000 0x7fde1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 -- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde1c004690 msgr2=0x7fde1c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde1c004690 0x7fde1c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 -- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1c005000 msgr2=0x7fde1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1c005000 0x7fde1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 -- 172.21.15.98:0/3222144554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0033f0 con 0x7fde1c0038e0 2023-08-22T00:25:17.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde3514f700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde1c004690 0x7fde1c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde36151700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1c005000 0x7fde1c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde36151700 1 -- 172.21.15.98:0/3222144554 reap_dead start 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.589+0000 7fde35950700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde1c003cc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fde20009a60 tx=0x7fde20009060).ready entity=mon.0 client_cookie=7b752f80a732d41 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20009ea0 con 0x7fde1c0038e0 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20009430 con 0x7fde1c0038e0 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde3494e700 1 -- 172.21.15.98:0/3222144554 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000e870 con 0x7fde1c0038e0 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 -- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 msgr2=0x7fde1c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde1c003cc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fde20009a60 tx=0x7fde20009060).stop 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 -- 172.21.15.98:0/3222144554 shutdown_connections 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 --2- 172.21.15.98:0/3222144554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde1c003cc0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 -- 172.21.15.98:0/3222144554 >> 172.21.15.98:0/3222144554 conn(0x7fde300c7800 msgr2=0x7fde300c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 -- 172.21.15.98:0/3222144554 shutdown_connections 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.590+0000 7fde37bb4700 1 -- 172.21.15.98:0/3222144554 wait complete. 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.591+0000 7fde37bb4700 1 Processor -- start 2023-08-22T00:25:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.591+0000 7fde37bb4700 1 -- start start 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 0x7fde301558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 0x7fde30156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30167320 con 0x7fde1c0038e0 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300ac590 con 0x7fde30155470 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde37bb4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde300ad3d0 con 0x7fde301561e0 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35954/0 (socket says 172.21.15.98:35954) 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 -- 172.21.15.98:0/2852048165 learned_addr learned my addr 172.21.15.98:0/2852048165 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde3514f700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 0x7fde301558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde36151700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 0x7fde30156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 -- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 msgr2=0x7fde30156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 0x7fde30156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 -- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 msgr2=0x7fde301558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 0x7fde301558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 -- 172.21.15.98:0/2852048165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30155de0 con 0x7fde1c0038e0 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde3514f700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 0x7fde301558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde36151700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 0x7fde30156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.592+0000 7fde35950700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fde2000e4b0 tx=0x7fde2001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.593+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2001ba50 con 0x7fde1c0038e0 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.593+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2001bbd0 con 0x7fde1c0038e0 2023-08-22T00:25:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.593+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30156b50 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.593+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20025440 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.593+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde300acaa0 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.594+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde30069220 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.594+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fde2002e440 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.595+0000 7fde25ffb700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 0x7fde140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.595+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fde2007b810 con 0x7fde1c0038e0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.595+0000 7fde3514f700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 0x7fde140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.595+0000 7fde3514f700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 0x7fde140613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fde2c007fd0 tx=0x7fde2c009040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.599+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde2004cb20 con 0x7fde1c0038e0 2023-08-22T00:25:17.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:17.760+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fde300c5db0 con 0x7fde1c0038e0 2023-08-22T00:25:18.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.452+0000 7fde25ffb700 1 -- 172.21.15.98:0/2852048165 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v150) v1 ==== 170+0+0 (secure 0 0 0) 0x7fde20016070 con 0x7fde1c0038e0 2023-08-22T00:25:18.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 msgr2=0x7fde140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 0x7fde140613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fde2c007fd0 tx=0x7fde2c009040).stop 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 msgr2=0x7fde30166e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fde2000e4b0 tx=0x7fde2001a000).stop 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 shutdown_connections 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fde1405ef30 0x7fde140613f0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fde2c007fd0 tx=0x7fde2c009040).stop 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde301561e0 0x7fde30156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde1c0038e0 0x7fde30166e30 secure :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0x7fde2000e4b0 tx=0x7fde2001a000).stop 2023-08-22T00:25:18.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 --2- 172.21.15.98:0/2852048165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde30155470 0x7fde301558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.460+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 >> 172.21.15.98:0/2852048165 conn(0x7fde300c7800 msgr2=0x7fde3014f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:18.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.464+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 shutdown_connections 2023-08-22T00:25:18.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.466+0000 7fde37bb4700 1 -- 172.21.15.98:0/2852048165 wait complete. 2023-08-22T00:25:18.478 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:25:18.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:25:18.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.619+0000 7fb30f17b700 1 Processor -- start 2023-08-22T00:25:18.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.620+0000 7fb30f17b700 1 -- start start 2023-08-22T00:25:18.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.620+0000 7fb30f17b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb308067260 0x7fb308063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:18.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.620+0000 7fb30f17b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30814ad80 con 0x7fb308064390 2023-08-22T00:25:18.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.620+0000 7fb30f17b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3080647b0 con 0x7fb3080c5d40 2023-08-22T00:25:18.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.620+0000 7fb30f17b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb308154e30 con 0x7fb308067260 2023-08-22T00:25:18.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb307fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb308067260 0x7fb308063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:18.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb30d718700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb308064390 0x7fb308153e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48202/0 (socket says 172.21.15.98:48202) 2023-08-22T00:25:18.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb30d718700 1 -- 172.21.15.98:0/238310256 learned_addr learned my addr 172.21.15.98:0/238310256 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:18.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb307fff700 1 -- 172.21.15.98:0/238310256 >> v1:172.21.15.118:6789/0 conn(0x7fb3080c5d40 legacy=0x7fb3080c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:18.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb307fff700 1 -- 172.21.15.98:0/238310256 >> v1:172.21.15.98:6789/0 conn(0x7fb308064390 legacy=0x7fb308153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb3077fe700 1 -- 172.21.15.98:0/238310256 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226556582 0 0) 0x7fb30814ad80 con 0x7fb308064390 2023-08-22T00:25:18.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb307fff700 1 -- 172.21.15.98:0/238310256 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308154b50 con 0x7fb308067260 2023-08-22T00:25:18.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb307fff700 1 --2- 172.21.15.98:0/238310256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb308067260 0x7fb308063ea0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb30814af70 tx=0x7fb2f4009060).ready entity=mon.0 client_cookie=4a316bb6bc68d8f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb3077fe700 1 -- 172.21.15.98:0/238310256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40090d0 con 0x7fb308067260 2023-08-22T00:25:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb3077fe700 1 -- 172.21.15.98:0/238310256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f400b580 con 0x7fb308067260 2023-08-22T00:25:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.621+0000 7fb3077fe700 1 -- 172.21.15.98:0/238310256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400b900 con 0x7fb308067260 2023-08-22T00:25:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 -- 172.21.15.98:0/238310256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb308067260 msgr2=0x7fb308063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 --2- 172.21.15.98:0/238310256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb308067260 0x7fb308063ea0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb30814af70 tx=0x7fb2f4009060).stop 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 -- 172.21.15.98:0/238310256 shutdown_connections 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 --2- 172.21.15.98:0/238310256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb308067260 0x7fb308063ea0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 -- 172.21.15.98:0/238310256 >> 172.21.15.98:0/238310256 conn(0x7fb3080c3a60 msgr2=0x7fb3080c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 -- 172.21.15.98:0/238310256 shutdown_connections 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.622+0000 7fb30f17b700 1 -- 172.21.15.98:0/238310256 wait complete. 2023-08-22T00:25:18.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.623+0000 7fb30f17b700 1 Processor -- start 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.623+0000 7fb30f17b700 1 -- start start 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb308064390 0x7fb308141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb308067260 0x7fb3080aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080ab870 con 0x7fb3080c5d40 2023-08-22T00:25:18.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081523a0 con 0x7fb308067260 2023-08-22T00:25:18.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30f17b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080be220 con 0x7fb308064390 2023-08-22T00:25:18.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:18.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35974/0 (socket says 172.21.15.98:35974) 2023-08-22T00:25:18.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 -- 172.21.15.98:0/2124364367 learned_addr learned my addr 172.21.15.98:0/2124364367 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:18.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb307fff700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb308067260 0x7fb3080aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:18.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30cf17700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb308064390 0x7fb308141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:18.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 -- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb308064390 msgr2=0x7fb308141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb308064390 0x7fb308141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 -- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb308067260 msgr2=0x7fb3080aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb308067260 0x7fb3080aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 -- 172.21.15.98:0/2124364367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f40092a0 con 0x7fb3080c5d40 2023-08-22T00:25:18.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.624+0000 7fb30d718700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fb30000c760 tx=0x7fb300001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:18.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.625+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300005d30 con 0x7fb3080c5d40 2023-08-22T00:25:18.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.625+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300005e90 con 0x7fb3080c5d40 2023-08-22T00:25:18.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.625+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb308142060 con 0x7fb3080c5d40 2023-08-22T00:25:18.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.625+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300007300 con 0x7fb3080c5d40 2023-08-22T00:25:18.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.625+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308151b00 con 0x7fb3080c5d40 2023-08-22T00:25:18.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.626+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308068970 con 0x7fb3080c5d40 2023-08-22T00:25:18.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.626+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb3000076b0 con 0x7fb3080c5d40 2023-08-22T00:25:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.626+0000 7fb304ff9700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 0x7fb2ec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.626+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fb300079b40 con 0x7fb3080c5d40 2023-08-22T00:25:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.626+0000 7fb30cf17700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 0x7fb2ec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.627+0000 7fb30cf17700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 0x7fb2ec0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb2fc003900 tx=0x7fb2fc007d40).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.631+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb30004ad30 con 0x7fb3080c5d40 2023-08-22T00:25:18.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.832+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb3080be360 con 0x7fb3080c5d40 2023-08-22T00:25:18.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.840+0000 7fb304ff9700 1 -- 172.21.15.98:0/2124364367 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb300018070 con 0x7fb3080c5d40 2023-08-22T00:25:18.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 msgr2=0x7fb2ec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 0x7fb2ec0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb2fc003900 tx=0x7fb2fc007d40).stop 2023-08-22T00:25:18.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 msgr2=0x7fb3080ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:18.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fb30000c760 tx=0x7fb300001520).stop 2023-08-22T00:25:18.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 shutdown_connections 2023-08-22T00:25:18.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb2ec05ef30 0x7fb2ec0613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb308064390 0x7fb308141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3080c5d40 0x7fb3080ab380 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 --2- 172.21.15.98:0/2124364367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb308067260 0x7fb3080aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:18.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.848+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 >> 172.21.15.98:0/2124364367 conn(0x7fb3080c3a60 msgr2=0x7fb308063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:18.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.850+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 shutdown_connections 2023-08-22T00:25:18.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.850+0000 7fb30f17b700 1 -- 172.21.15.98:0/2124364367 wait complete. 2023-08-22T00:25:18.863 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 18 and data pool 19 2023-08-22T00:25:18.872 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:19.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.995+0000 7fdbc2b35700 1 Processor -- start 2023-08-22T00:25:19.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.995+0000 7fdbc2b35700 1 -- start start 2023-08-22T00:25:19.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc2b35700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc150c50 0x7fdbbc0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc2b35700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdbbc151030 0x7fdbbc1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc2b35700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0645b0 con 0x7fdbbc0bc6d0 2023-08-22T00:25:19.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc2b35700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc063fa0 con 0x7fdbbc151030 2023-08-22T00:25:19.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc2b35700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc151f30 con 0x7fdbbc150c50 2023-08-22T00:25:19.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc10d2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdbbc151030 0x7fdbbc1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc10d2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdbbc151030 0x7fdbbc1514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35982/0 (socket says 172.21.15.98:35982) 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbc10d2700 1 -- 172.21.15.98:0/366454226 learned_addr learned my addr 172.21.15.98:0/366454226 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.996+0000 7fdbbbfff700 1 --1- 172.21.15.98:0/366454226 >> v1:172.21.15.98:6789/0 conn(0x7fdbbc0bc6d0 0x7fdbbc0c39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48204/0 (socket says 172.21.15.98:48204) 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc08d1700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc150c50 0x7fdbbc0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc10d2700 1 -- 172.21.15.98:0/366454226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc150c50 msgr2=0x7fdbbc0c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc10d2700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc150c50 0x7fdbbc0c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc10d2700 1 -- 172.21.15.98:0/366454226 >> v1:172.21.15.98:6789/0 conn(0x7fdbbc0bc6d0 legacy=0x7fdbbc0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbbb7fe700 1 -- 172.21.15.98:0/366454226 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991339437 0 0) 0x7fdbbc0645b0 con 0x7fdbbc0bc6d0 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc10d2700 1 -- 172.21.15.98:0/366454226 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc152210 con 0x7fdbbc151030 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc10d2700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc151030 0x7fdbbc1514c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fdbb4009f20 tx=0x7fdbb4009840).ready entity=mon.0 client_cookie=452f47d0316b7fb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbbb7fe700 1 -- 172.21.15.98:0/366454226 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400e070 con 0x7fdbbc151030 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbbb7fe700 1 -- 172.21.15.98:0/366454226 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400ba80 con 0x7fdbbc151030 2023-08-22T00:25:19.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbbb7fe700 1 -- 172.21.15.98:0/366454226 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400be00 con 0x7fdbbc151030 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc2b35700 1 -- 172.21.15.98:0/366454226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc151030 msgr2=0x7fdbbc1514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc151030 0x7fdbbc1514c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fdbb4009f20 tx=0x7fdbb4009840).stop 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc2b35700 1 -- 172.21.15.98:0/366454226 shutdown_connections 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc151030 0x7fdbbc1514c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.997+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/366454226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc150c50 0x7fdbbc0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.998+0000 7fdbc2b35700 1 -- 172.21.15.98:0/366454226 >> 172.21.15.98:0/366454226 conn(0x7fdbbc0c7770 msgr2=0x7fdbbc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.998+0000 7fdbc2b35700 1 -- 172.21.15.98:0/366454226 shutdown_connections 2023-08-22T00:25:19.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.998+0000 7fdbc2b35700 1 -- 172.21.15.98:0/366454226 wait complete. 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.999+0000 7fdbc2b35700 1 Processor -- start 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:18.999+0000 7fdbc2b35700 1 -- start start 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 0x7fdbbc0a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbbc151030 0x7fdbbc0bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0aa850 con 0x7fdbbc150c50 2023-08-22T00:25:19.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc150a90 con 0x7fdbbc151030 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc2b35700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0a8560 con 0x7fdbbc0bc6d0 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbbbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbbbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35988/0 (socket says 172.21.15.98:35988) 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbbbfff700 1 -- 172.21.15.98:0/3711785711 learned_addr learned my addr 172.21.15.98:0/3711785711 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc08d1700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 0x7fdbbc0a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbc10d2700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbbc151030 0x7fdbbc0bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.000+0000 7fdbbbfff700 1 -- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 msgr2=0x7fdbbc0a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbbbfff700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 0x7fdbbc0a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbbbfff700 1 -- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbbc151030 msgr2=0x7fdbbc0bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbbbfff700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbbc151030 0x7fdbbc0bfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbbbfff700 1 -- 172.21.15.98:0/3711785711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009ae0 con 0x7fdbbc150c50 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbc08d1700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 0x7fdbbc0a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbbbfff700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fdba800e770 tx=0x7fdba8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8007320 con 0x7fdbbc150c50 2023-08-22T00:25:19.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8007480 con 0x7fdbbc150c50 2023-08-22T00:25:19.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc0a8840 con 0x7fdbbc150c50 2023-08-22T00:25:19.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8005930 con 0x7fdbbc150c50 2023-08-22T00:25:19.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.001+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc0a8e00 con 0x7fdbbc150c50 2023-08-22T00:25:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.002+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc0aaa00 con 0x7fdbbc150c50 2023-08-22T00:25:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.002+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdba8005d20 con 0x7fdbbc150c50 2023-08-22T00:25:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.002+0000 7fdbb8ff9700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 0x7fdba00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.002+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdba807c480 con 0x7fdbbc150c50 2023-08-22T00:25:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.003+0000 7fdbc08d1700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 0x7fdba00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.003+0000 7fdbc08d1700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 0x7fdba00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdbb0008900 tx=0x7fdbb0008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.006+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdbbc0aaa00 con 0x7fdbbc150c50 2023-08-22T00:25:19.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.168+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbbc047480 con 0x7fdbbc150c50 2023-08-22T00:25:19.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.168+0000 7fdbb8ff9700 1 -- 172.21.15.98:0/3711785711 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+17288 (secure 0 0 0) 0x7fdba804d610 con 0x7fdbbc150c50 2023-08-22T00:25:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:19.173 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":151,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:18.833776+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:19.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 msgr2=0x7fdba00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 0x7fdba00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdbb0008900 tx=0x7fdbb0008040).stop 2023-08-22T00:25:19.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 msgr2=0x7fdbbc0bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fdba800e770 tx=0x7fdba8007c90).stop 2023-08-22T00:25:19.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 shutdown_connections 2023-08-22T00:25:19.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fdba005ef30 0x7fdba00613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbbc0bc6d0 0x7fdbbc0a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbbc151030 0x7fdbbc0bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 --2- 172.21.15.98:0/3711785711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbbc150c50 0x7fdbbc0bf600 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 >> 172.21.15.98:0/3711785711 conn(0x7fdbbc0c7770 msgr2=0x7fdbbc0c56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 shutdown_connections 2023-08-22T00:25:19.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.170+0000 7fdbc2b35700 1 -- 172.21.15.98:0/3711785711 wait complete. 2023-08-22T00:25:19.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:19.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.302+0000 7f2883408700 1 Processor -- start 2023-08-22T00:25:19.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.302+0000 7f2883408700 1 -- start start 2023-08-22T00:25:19.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f2883408700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f287c158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f2883408700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f287c0bc8d0 0x7f287c0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f2883408700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c1541b0 con 0x7f287c0c2870 2023-08-22T00:25:19.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f2883408700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0bc440 con 0x7f287c0bc8d0 2023-08-22T00:25:19.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f2883408700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0bbb50 con 0x7f287c158030 2023-08-22T00:25:19.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.303+0000 7f28819a5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f287c0c2870 0x7f287c063610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48212/0 (socket says 172.21.15.98:48212) 2023-08-22T00:25:19.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28819a5700 1 -- 172.21.15.98:0/4112101437 learned_addr learned my addr 172.21.15.98:0/4112101437 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:19.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f287c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28809a3700 1 --2- 172.21.15.98:0/4112101437 >> v2:172.21.15.118:3300/0 conn(0x7f287c0bc8d0 0x7f287c0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450779336 0 0) 0x7f2874001490 con 0x7f287c0c2870 2023-08-22T00:25:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28680033f0 con 0x7f287c0c2870 2023-08-22T00:25:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824903362 0 0) 0x7f28680033f0 con 0x7f287c0c2870 2023-08-22T00:25:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 msgr2=0x7f287c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f287c158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 >> v2:172.21.15.118:3300/0 conn(0x7f287c0bc8d0 msgr2=0x7f287c0c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 --2- 172.21.15.98:0/4112101437 >> v2:172.21.15.118:3300/0 conn(0x7f287c0bc8d0 0x7f287c0c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0bbdf0 con 0x7f287c0c2870 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f2874001980 con 0x7f287c0c2870 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 >> v1:172.21.15.98:6789/0 conn(0x7f287c0c2870 legacy=0x7f287c063610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f2868003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f2868004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2868004b80 0x7f2868005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0bc440 con 0x7f2868003960 2023-08-22T00:25:19.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0bbb50 con 0x7f2868004b80 2023-08-22T00:25:19.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286800b960 con 0x7f287c158030 2023-08-22T00:25:19.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f2868003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28809a3700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f2868004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28819a5700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2868004b80 0x7f2868005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 -- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 msgr2=0x7f2868004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f2868004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 -- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2868004b80 msgr2=0x7f2868005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2868004b80 0x7f2868005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28811a4700 1 -- 172.21.15.98:0/4112101437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680033f0 con 0x7f2868003960 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.304+0000 7f28809a3700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c158030 0x7f2868004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:19.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f28811a4700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f2868003d80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f2870006fd0 tx=0x7f2870006f40).ready entity=mon.0 client_cookie=393821fb439e4331 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870009e90 con 0x7f2868003960 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870009430 con 0x7f2868003960 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f286ffff700 1 -- 172.21.15.98:0/4112101437 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000e870 con 0x7f2868003960 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 -- 172.21.15.98:0/4112101437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 msgr2=0x7f2868003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 --2- 172.21.15.98:0/4112101437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f2868003d80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f2870006fd0 tx=0x7f2870006f40).stop 2023-08-22T00:25:19.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f28819a5700 1 -- 172.21.15.98:0/4112101437 reap_dead start 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 -- 172.21.15.98:0/4112101437 shutdown_connections 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 -- 172.21.15.98:0/4112101437 >> 172.21.15.98:0/4112101437 conn(0x7f287c0691b0 msgr2=0x7f287c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 -- 172.21.15.98:0/4112101437 shutdown_connections 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.305+0000 7f2883408700 1 -- 172.21.15.98:0/4112101437 wait complete. 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.306+0000 7f2883408700 1 Processor -- start 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.306+0000 7f2883408700 1 -- start start 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287c152d20 0x7f287c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c1531a0 0x7f287c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c151a30 con 0x7f2868003960 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c152890 con 0x7f287c152d20 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.307+0000 7f2883408700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c151c80 con 0x7f287c1531a0 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36014/0 (socket says 172.21.15.98:36014) 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 -- 172.21.15.98:0/1866086623 learned_addr learned my addr 172.21.15.98:0/1866086623 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28819a5700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c1531a0 0x7f287c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28809a3700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287c152d20 0x7f287c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 -- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c1531a0 msgr2=0x7f287c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c1531a0 0x7f287c156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 -- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287c152d20 msgr2=0x7f287c156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287c152d20 0x7f287c156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 -- 172.21.15.98:0/1866086623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c151f60 con 0x7f2868003960 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f28811a4700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f2870014000 tx=0x7f287001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870006040 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28700061a0 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c152240 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870006540 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.308+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0a9570 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.309+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c047480 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.310+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f28700066a0 con 0x7f2868003960 2023-08-22T00:25:19.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.310+0000 7f286d7fa700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 0x7f28600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.310+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f287007b820 con 0x7f2868003960 2023-08-22T00:25:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.310+0000 7f28809a3700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 0x7f28600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.310+0000 7f28809a3700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 0x7f28600613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2878006c40 tx=0x7f2878008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.314+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f287004c9b0 con 0x7f2868003960 2023-08-22T00:25:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.477+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c06a320 con 0x7f2868003960 2023-08-22T00:25:19.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.478+0000 7f286d7fa700 1 -- 172.21.15.98:0/1866086623 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f2870079e60 con 0x7f2868003960 2023-08-22T00:25:19.481 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:19.482 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":151,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:18.833776+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 msgr2=0x7f28600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 0x7f28600613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2878006c40 tx=0x7f2878008040).stop 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 msgr2=0x7f287c0a9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f2870014000 tx=0x7f287001a000).stop 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 shutdown_connections 2023-08-22T00:25:19.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f286005ef30 0x7f28600613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f287c1531a0 0x7f287c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2868003960 0x7f287c0a9080 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 --2- 172.21.15.98:0/1866086623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287c152d20 0x7f287c156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 >> 172.21.15.98:0/1866086623 conn(0x7f287c0691b0 msgr2=0x7f287c0a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 shutdown_connections 2023-08-22T00:25:19.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.480+0000 7f2883408700 1 -- 172.21.15.98:0/1866086623 wait complete. 2023-08-22T00:25:19.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:25:19.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.613+0000 7f77db2b1700 1 Processor -- start 2023-08-22T00:25:19.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.613+0000 7f77db2b1700 1 -- start start 2023-08-22T00:25:19.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77db2b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d414b250 0x7f77d40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77db2b1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f77d40c39f0 0x7f77d4154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77db2b1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d4151e80 con 0x7f77d414ae70 2023-08-22T00:25:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77db2b1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d4066b90 con 0x7f77d40c39f0 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77db2b1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4065560 con 0x7f77d414b250 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f77d40c39f0 0x7f77d4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f77d40c39f0 0x7f77d4154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36018/0 (socket says 172.21.15.98:36018) 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 -- 172.21.15.98:0/3477093603 learned_addr learned my addr 172.21.15.98:0/3477093603 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d884c700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d414b250 0x7f77d40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 -- 172.21.15.98:0/3477093603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d414b250 msgr2=0x7f77d40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d414b250 0x7f77d40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 -- 172.21.15.98:0/3477093603 >> v1:172.21.15.118:6789/0 conn(0x7f77d414ae70 legacy=0x7f77d40c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.614+0000 7f77d984e700 1 -- 172.21.15.98:0/3477093603 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40c7590 con 0x7f77d40c39f0 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77d984e700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d40c39f0 0x7f77d4154730 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f77cc009f20 tx=0x7f77cc009840).ready entity=mon.0 client_cookie=7b4a854c45c27453 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77cbfff700 1 -- 172.21.15.98:0/3477093603 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00e070 con 0x7f77d40c39f0 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77cbfff700 1 -- 172.21.15.98:0/3477093603 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00b9d0 con 0x7f77d40c39f0 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77cbfff700 1 -- 172.21.15.98:0/3477093603 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00bd50 con 0x7f77d40c39f0 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 -- 172.21.15.98:0/3477093603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d40c39f0 msgr2=0x7f77d4154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d40c39f0 0x7f77d4154730 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f77cc009f20 tx=0x7f77cc009840).stop 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 -- 172.21.15.98:0/3477093603 shutdown_connections 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d40c39f0 0x7f77d4154730 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 --2- 172.21.15.98:0/3477093603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d414b250 0x7f77d40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 -- 172.21.15.98:0/3477093603 >> 172.21.15.98:0/3477093603 conn(0x7f77d40c7800 msgr2=0x7f77d40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 -- 172.21.15.98:0/3477093603 shutdown_connections 2023-08-22T00:25:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.615+0000 7f77db2b1700 1 -- 172.21.15.98:0/3477093603 wait complete. 2023-08-22T00:25:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.616+0000 7f77db2b1700 1 Processor -- start 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.616+0000 7f77db2b1700 1 -- start start 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d40c39f0 0x7f77d40a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 0x7f77d414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4161f80 con 0x7f77d414ae70 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4161650 con 0x7f77d414b250 2023-08-22T00:25:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77db2b1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4161930 con 0x7f77d40c39f0 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.617+0000 7f77d884c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36024/0 (socket says 172.21.15.98:36024) 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 -- 172.21.15.98:0/4000813846 learned_addr learned my addr 172.21.15.98:0/4000813846 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d904d700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d40c39f0 0x7f77d40a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d984e700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 0x7f77d414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 -- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d40c39f0 msgr2=0x7f77d40a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d40c39f0 0x7f77d40a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 -- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 msgr2=0x7f77d414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 0x7f77d414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 -- 172.21.15.98:0/4000813846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc009ae0 con 0x7f77d414ae70 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d984e700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 0x7f77d414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77d884c700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f77d000e900 tx=0x7f77d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000eea0 con 0x7f77d414ae70 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000c8e0 con 0x7f77d414ae70 2023-08-22T00:25:19.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4161c10 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000cc60 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.618+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d41612c0 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.619+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d41620f0 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.619+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f77d001b400 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.620+0000 7f77c97fa700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 0x7f77b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.620+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f77d007a710 con 0x7f77d414ae70 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.620+0000 7f77d904d700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 0x7f77b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.620+0000 7f77d904d700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 0x7f77b80613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f77c4003750 tx=0x7f77c4009040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.624+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77d004b840 con 0x7f77d414ae70 2023-08-22T00:25:19.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.827+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f77d4150fb0 con 0x7f77d414ae70 2023-08-22T00:25:19.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.837+0000 7f77c97fa700 1 -- 172.21.15.98:0/4000813846 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f77d00160b0 con 0x7f77d414ae70 2023-08-22T00:25:19.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 msgr2=0x7f77b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 0x7f77b80613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f77c4003750 tx=0x7f77c4009040).stop 2023-08-22T00:25:19.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 msgr2=0x7f77d40a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f77d000e900 tx=0x7f77d0009060).stop 2023-08-22T00:25:19.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 shutdown_connections 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f77b805ef30 0x7f77b80613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77d40c39f0 0x7f77d40a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d414b250 0x7f77d414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 --2- 172.21.15.98:0/4000813846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d414ae70 0x7f77d40a85c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 >> 172.21.15.98:0/4000813846 conn(0x7f77d40c7800 msgr2=0x7f77d40c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 shutdown_connections 2023-08-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.839+0000 7f77db2b1700 1 -- 172.21.15.98:0/4000813846 wait complete. 2023-08-22T00:25:19.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:25:19.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.975+0000 7fbd420c5700 1 Processor -- start 2023-08-22T00:25:19.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.975+0000 7fbd420c5700 1 -- start start 2023-08-22T00:25:19.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd420c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd3c0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd420c5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3c0c69b0 con 0x7fbd3c0c5360 2023-08-22T00:25:19.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd420c5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3c1542c0 con 0x7fbd3c066150 2023-08-22T00:25:19.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd420c5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c57f0 con 0x7fbd3c066530 2023-08-22T00:25:19.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbd3c0c5360 0x7fbd3c157890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48226/0 (socket says 172.21.15.98:48226) 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3affd700 1 -- 172.21.15.98:0/1788464393 learned_addr learned my addr 172.21.15.98:0/1788464393 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640323052 0 0) 0x7fbd3c0c69b0 con 0x7fbd3c0c5360 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd3c0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd240033f0 con 0x7fbd3c0c5360 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512834756 0 0) 0x7fbd240033f0 con 0x7fbd3c0c5360 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 msgr2=0x7fbd3c0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd3c0c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 >> v1:172.21.15.118:6789/0 conn(0x7fbd3c066150 legacy=0x7fbd3c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0c5ad0 con 0x7fbd3c0c5360 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fbd2c001470 con 0x7fbd3c0c5360 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 >> v1:172.21.15.98:6789/0 conn(0x7fbd3c0c5360 legacy=0x7fbd3c157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd24003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.976+0000 7fbd3a7fc700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd24003e90 0x7fbd24004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd24004b80 0x7fbd24005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c57f0 con 0x7fbd24004b80 2023-08-22T00:25:19.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2400b9c0 con 0x7fbd24003e90 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2400bb80 con 0x7fbd3c066530 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd24004b80 0x7fbd24005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3b7fe700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd24003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3affd700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd24003e90 0x7fbd24004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 -- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 msgr2=0x7fbd24003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd3c066530 0x7fbd24003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 -- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd24003e90 msgr2=0x7fbd24004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd24003e90 0x7fbd24004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 -- 172.21.15.98:0/1788464393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240033f0 con 0x7fbd24004b80 2023-08-22T00:25:19.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd24004b80 0x7fbd24005000 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fbd3400e210 tx=0x7fbd3400b040).ready entity=mon.0 client_cookie=8d00c6d827fead8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34009ac0 con 0x7fbd24004b80 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3400f040 con 0x7fbd24004b80 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.977+0000 7fbd3a7fc700 1 -- 172.21.15.98:0/1788464393 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400ecd0 con 0x7fbd24004b80 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 -- 172.21.15.98:0/1788464393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd24004b80 msgr2=0x7fbd24005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 --2- 172.21.15.98:0/1788464393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd24004b80 0x7fbd24005000 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fbd3400e210 tx=0x7fbd3400b040).stop 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd3bfff700 1 -- 172.21.15.98:0/1788464393 reap_dead start 2023-08-22T00:25:19.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 -- 172.21.15.98:0/1788464393 shutdown_connections 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 -- 172.21.15.98:0/1788464393 >> 172.21.15.98:0/1788464393 conn(0x7fbd3c0c7800 msgr2=0x7fbd3c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 -- 172.21.15.98:0/1788464393 shutdown_connections 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.978+0000 7fbd420c5700 1 -- 172.21.15.98:0/1788464393 wait complete. 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.979+0000 7fbd420c5700 1 Processor -- start 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.979+0000 7fbd420c5700 1 -- start start 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd24004b80 0x7fbd3c0a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3c0aba00 0x7fbd3c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0a5130 con 0x7fbd3c165080 2023-08-22T00:25:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0a4220 con 0x7fbd3c0aba00 2023-08-22T00:25:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0a4500 con 0x7fbd24004b80 2023-08-22T00:25:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36036/0 (socket says 172.21.15.98:36036) 2023-08-22T00:25:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 -- 172.21.15.98:0/325352807 learned_addr learned my addr 172.21.15.98:0/325352807 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3b7fe700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd24004b80 0x7fbd3c0a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3bfff700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3c0aba00 0x7fbd3c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 -- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd24004b80 msgr2=0x7fbd3c0a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd24004b80 0x7fbd3c0a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 -- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3c0aba00 msgr2=0x7fbd3c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3c0aba00 0x7fbd3c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 -- 172.21.15.98:0/325352807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0a47e0 con 0x7fbd3c165080 2023-08-22T00:25:19.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd3affd700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fbd2c000fd0 tx=0x7fbd2c001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0114c0 con 0x7fbd3c165080 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c011620 con 0x7fbd3c165080 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c0a4ac0 con 0x7fbd3c165080 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0119c0 con 0x7fbd3c165080 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.980+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c0bdd10 con 0x7fbd3c165080 2023-08-22T00:25:19.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.981+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c069220 con 0x7fbd3c165080 2023-08-22T00:25:20.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.982+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbd2c011d30 con 0x7fbd3c165080 2023-08-22T00:25:20.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.982+0000 7fbd237fe700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 0x7fbd280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.982+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbd2c0798a0 con 0x7fbd3c165080 2023-08-22T00:25:20.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.982+0000 7fbd3b7fe700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 0x7fbd280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.982+0000 7fbd3b7fe700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 0x7fbd280613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbd30007fd0 tx=0x7fbd30007bb0).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:20.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:19.986+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd2c04a9d0 con 0x7fbd3c165080 2023-08-22T00:25:20.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.187+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd3c0c6790 con 0x7fbd3c165080 2023-08-22T00:25:20.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.844+0000 7fbd237fe700 1 -- 172.21.15.98:0/325352807 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd2c019030 con 0x7fbd3c165080 2023-08-22T00:25:20.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.846+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 msgr2=0x7fbd280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.846+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 0x7fbd280613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbd30007fd0 tx=0x7fbd30007bb0).stop 2023-08-22T00:25:20.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.846+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 msgr2=0x7fbd3c0bd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.846+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fbd2c000fd0 tx=0x7fbd2c001d80).stop 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 shutdown_connections 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fbd2805ef30 0x7fbd280613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd24004b80 0x7fbd3c0a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3c0aba00 0x7fbd3c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 --2- 172.21.15.98:0/325352807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd3c165080 0x7fbd3c0bd820 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 >> 172.21.15.98:0/325352807 conn(0x7fbd3c0c7800 msgr2=0x7fbd3c1577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:20.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 shutdown_connections 2023-08-22T00:25:20.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.847+0000 7fbd420c5700 1 -- 172.21.15.98:0/325352807 wait complete. 2023-08-22T00:25:20.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.983+0000 7effa3cc0700 1 Processor -- start 2023-08-22T00:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 -- start start 2023-08-22T00:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7eff9c153b60 0x7eff9c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0a9140 0x7eff9c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0a8410 con 0x7eff9c153f40 2023-08-22T00:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0a8cb0 con 0x7eff9c0a9140 2023-08-22T00:25:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.984+0000 7effa3cc0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c1586a0 con 0x7eff9c153b60 2023-08-22T00:25:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0a9140 0x7eff9c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0a9140 0x7eff9c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39784/0 (socket says 172.21.15.98:39784) 2023-08-22T00:25:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 -- 172.21.15.98:0/2095605523 learned_addr learned my addr 172.21.15.98:0/2095605523 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa125b700 1 --1- 172.21.15.98:0/2095605523 >> v1:172.21.15.98:6789/0 conn(0x7eff9c153f40 0x7eff9c157930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55024/0 (socket says 172.21.15.98:55024) 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa1a5c700 1 --2- 172.21.15.98:0/2095605523 >> v2:172.21.15.118:3300/0 conn(0x7eff9c153b60 0x7eff9c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 -- 172.21.15.98:0/2095605523 >> v2:172.21.15.118:3300/0 conn(0x7eff9c153b60 msgr2=0x7eff9c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 --2- 172.21.15.98:0/2095605523 >> v2:172.21.15.118:3300/0 conn(0x7eff9c153b60 0x7eff9c068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 -- 172.21.15.98:0/2095605523 >> v1:172.21.15.98:6789/0 conn(0x7eff9c153f40 legacy=0x7eff9c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa0a5a700 1 -- 172.21.15.98:0/2095605523 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604701007 0 0) 0x7eff9c0a8410 con 0x7eff9c153f40 2023-08-22T00:25:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 -- 172.21.15.98:0/2095605523 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0a8660 con 0x7eff9c0a9140 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa225d700 1 --2- 172.21.15.98:0/2095605523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0a9140 0x7eff9c158040 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7eff9c05fcb0 tx=0x7eff94009840).ready entity=mon.0 client_cookie=86600753fb846fa9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa0a5a700 1 -- 172.21.15.98:0/2095605523 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400e070 con 0x7eff9c0a9140 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa0a5a700 1 -- 172.21.15.98:0/2095605523 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400ba50 con 0x7eff9c0a9140 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.985+0000 7effa0a5a700 1 -- 172.21.15.98:0/2095605523 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400bdd0 con 0x7eff9c0a9140 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 -- 172.21.15.98:0/2095605523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0a9140 msgr2=0x7eff9c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 --2- 172.21.15.98:0/2095605523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0a9140 0x7eff9c158040 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7eff9c05fcb0 tx=0x7eff94009840).stop 2023-08-22T00:25:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 -- 172.21.15.98:0/2095605523 shutdown_connections 2023-08-22T00:25:20.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 --2- 172.21.15.98:0/2095605523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0a9140 0x7eff9c158040 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 --2- 172.21.15.98:0/2095605523 >> v2:172.21.15.118:3300/0 conn(0x7eff9c153b60 0x7eff9c068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 -- 172.21.15.98:0/2095605523 >> 172.21.15.98:0/2095605523 conn(0x7eff9c0c5dc0 msgr2=0x7eff9c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:20.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 -- 172.21.15.98:0/2095605523 shutdown_connections 2023-08-22T00:25:20.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.986+0000 7effa3cc0700 1 -- 172.21.15.98:0/2095605523 wait complete. 2023-08-22T00:25:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.987+0000 7effa3cc0700 1 Processor -- start 2023-08-22T00:25:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.987+0000 7effa3cc0700 1 -- start start 2023-08-22T00:25:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 0x7eff9c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 0x7eff9c0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c24a0 con 0x7eff9c153f40 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c7eb0 con 0x7eff9c0a9140 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c154730 con 0x7eff9c153b60 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39796/0 (socket says 172.21.15.98:39796) 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 -- 172.21.15.98:0/1579802205 learned_addr learned my addr 172.21.15.98:0/1579802205 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa125b700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 0x7eff9c0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa1a5c700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 0x7eff9c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 -- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 msgr2=0x7eff9c0c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 0x7eff9c0c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 -- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 msgr2=0x7eff9c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:20.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 0x7eff9c14fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 -- 172.21.15.98:0/1579802205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94009ae0 con 0x7eff9c153f40 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa1a5c700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 0x7eff9c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa125b700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 0x7eff9c0c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa225d700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7eff94010000 tx=0x7eff9c0a8df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940092e0 con 0x7eff9c153f40 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9401d410 con 0x7eff9c153f40 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c0c1440 con 0x7eff9c153f40 2023-08-22T00:25:20.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.988+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9401d790 con 0x7eff9c153f40 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.989+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0c1a00 con 0x7eff9c153f40 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.990+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c047480 con 0x7eff9c153f40 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.990+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7eff9401db80 con 0x7eff9c153f40 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.990+0000 7eff8dffb700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 0x7eff800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.990+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7eff9407bd80 con 0x7eff9c153f40 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.990+0000 7effa1a5c700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 0x7eff800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.991+0000 7effa1a5c700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 0x7eff800613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7eff980098c0 tx=0x7eff98008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:20.994+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff9404cf10 con 0x7eff9c153f40 2023-08-22T00:25:21.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:25:21.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:25:21.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.198+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff9c0a8940 con 0x7eff9c153f40 2023-08-22T00:25:21.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.199+0000 7eff8dffb700 1 -- 172.21.15.98:0/1579802205 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7eff94050530 con 0x7eff9c153f40 2023-08-22T00:25:21.205 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:21.206 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:21.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 msgr2=0x7eff800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 0x7eff800613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7eff980098c0 tx=0x7eff98008040).stop 2023-08-22T00:25:21.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 msgr2=0x7eff9c0c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7eff94010000 tx=0x7eff9c0a8df0).stop 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 shutdown_connections 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c153f40 0x7eff9c0c79c0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0a9140 0x7eff9c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7eff8005ef30 0x7eff800613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 --2- 172.21.15.98:0/1579802205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c153b60 0x7eff9c0c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 >> 172.21.15.98:0/1579802205 conn(0x7eff9c0c5dc0 msgr2=0x7eff9c0c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 shutdown_connections 2023-08-22T00:25:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.201+0000 7effa3cc0700 1 -- 172.21.15.98:0/1579802205 wait complete. 2023-08-22T00:25:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:21.214 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.369+0000 7fe1f08b8700 1 Processor -- start 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.369+0000 7fe1f08b8700 1 -- start start 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.370+0000 7fe1f08b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1ec155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.370+0000 7fe1f08b8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0c4ec0 con 0x7fe1ec1519e0 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.370+0000 7fe1f08b8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec156110 con 0x7fe1ec155c80 2023-08-22T00:25:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.370+0000 7fe1f08b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0bc720 con 0x7fe1ec151dc0 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.370+0000 7fe1ea59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe1ec1519e0 0x7fe1ec0bc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55028/0 (socket says 172.21.15.98:55028) 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1ea59c700 1 -- 172.21.15.98:0/3781088119 learned_addr learned my addr 172.21.15.98:0/3781088119 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1ec155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268901356 0 0) 0x7fe1ec0c4ec0 con 0x7fe1ec1519e0 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d40033f0 con 0x7fe1ec1519e0 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057562025 0 0) 0x7fe1d40033f0 con 0x7fe1ec1519e0 2023-08-22T00:25:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 msgr2=0x7fe1ec155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1ec155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 >> v1:172.21.15.118:6789/0 conn(0x7fe1ec155c80 legacy=0x7fe1ec062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec063a80 con 0x7fe1ec1519e0 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe1dc001470 con 0x7fe1ec1519e0 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 >> v1:172.21.15.98:6789/0 conn(0x7fe1ec1519e0 legacy=0x7fe1ec0bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d4003910 0x7fe1d4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1d4004690 0x7fe1d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0bc720 con 0x7fe1d4004690 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d400b930 con 0x7fe1d4003910 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d400baf0 con 0x7fe1ec151dc0 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1d4004690 0x7fe1d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1ea59c700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d4003910 0x7fe1d4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1ead9d700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 msgr2=0x7fe1d4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1ec151dc0 0x7fe1d4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d4003910 msgr2=0x7fe1d4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d4003910 0x7fe1d4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.371+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/3781088119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40033f0 con 0x7fe1d4004690 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1d4004690 0x7fe1d4004b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fe1ec152200 tx=0x7fe1e0009060).ready entity=mon.0 client_cookie=3155d23bad63ed9a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0009e90 con 0x7fe1d4004690 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0009430 con 0x7fe1d4004690 2023-08-22T00:25:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1e959a700 1 -- 172.21.15.98:0/3781088119 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000e850 con 0x7fe1d4004690 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 -- 172.21.15.98:0/3781088119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1d4004690 msgr2=0x7fe1d4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/3781088119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1d4004690 0x7fe1d4004b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fe1ec152200 tx=0x7fe1e0009060).stop 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1ead9d700 1 -- 172.21.15.98:0/3781088119 reap_dead start 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 -- 172.21.15.98:0/3781088119 shutdown_connections 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 -- 172.21.15.98:0/3781088119 >> 172.21.15.98:0/3781088119 conn(0x7fe1ec0c7140 msgr2=0x7fe1ec0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 -- 172.21.15.98:0/3781088119 shutdown_connections 2023-08-22T00:25:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.372+0000 7fe1f08b8700 1 -- 172.21.15.98:0/3781088119 wait complete. 2023-08-22T00:25:21.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.373+0000 7fe1f08b8700 1 Processor -- start 2023-08-22T00:25:21.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 -- start start 2023-08-22T00:25:21.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d4004690 0x7fe1ec153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 0x7fe1ec0bda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1536f0 con 0x7fe1ec0c0220 2023-08-22T00:25:21.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0bdf30 con 0x7fe1ec0bd5c0 2023-08-22T00:25:21.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1f08b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec153930 con 0x7fe1d4004690 2023-08-22T00:25:21.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1e9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1e9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39824/0 (socket says 172.21.15.98:39824) 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.374+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/2395668083 learned_addr learned my addr 172.21.15.98:0/2395668083 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1ea59c700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d4004690 0x7fe1ec153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1ead9d700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 0x7fe1ec0bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d4004690 msgr2=0x7fe1ec153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d4004690 0x7fe1ec153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 msgr2=0x7fe1ec0bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 0x7fe1ec0bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 -- 172.21.15.98:0/2395668083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec153c10 con 0x7fe1ec0c0220 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1ead9d700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 0x7fe1ec0bda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1e9d9b700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fe1e000e4b0 tx=0x7fe1e001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e001d900 con 0x7fe1ec0c0220 2023-08-22T00:25:21.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e001da80 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec153ef0 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e001de40 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.375+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec1544b0 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.376+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec047480 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.376+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe1e002f440 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.377+0000 7fe1da7fc700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 0x7fe1cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.377+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe1e007bf00 con 0x7fe1ec0c0220 2023-08-22T00:25:21.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.377+0000 7fe1ea59c700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 0x7fe1cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.377+0000 7fe1ea59c700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 0x7fe1cc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe1dc0015a0 tx=0x7fe1dc009040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.381+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1e004cf70 con 0x7fe1ec0c0220 2023-08-22T00:25:21.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.543+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ec063d60 con 0x7fe1ec0c0220 2023-08-22T00:25:21.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.544+0000 7fe1da7fc700 1 -- 172.21.15.98:0/2395668083 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+17275 (secure 0 0 0) 0x7fe1e0050e60 con 0x7fe1ec0c0220 2023-08-22T00:25:21.548 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:21.549 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":152,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:19.835833+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:21.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 msgr2=0x7fe1cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 0x7fe1cc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe1dc0015a0 tx=0x7fe1dc009040).stop 2023-08-22T00:25:21.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 msgr2=0x7fe1ec1397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fe1e000e4b0 tx=0x7fe1e001a000).stop 2023-08-22T00:25:21.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 shutdown_connections 2023-08-22T00:25:21.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe1cc05ef30 0x7fe1cc0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d4004690 0x7fe1ec153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ec0bd5c0 0x7fe1ec0bda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 --2- 172.21.15.98:0/2395668083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1ec0c0220 0x7fe1ec1397f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.552 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 >> 172.21.15.98:0/2395668083 conn(0x7fe1ec0c7140 msgr2=0x7fe1ec0a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:21.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 shutdown_connections 2023-08-22T00:25:21.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.546+0000 7fe1f08b8700 1 -- 172.21.15.98:0/2395668083 wait complete. 2023-08-22T00:25:21.559 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:25:21.560 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:21.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.675+0000 7f8fdfd70700 1 Processor -- start 2023-08-22T00:25:21.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.675+0000 7f8fdfd70700 1 -- start start 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fdfd70700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8fd814e0d0 0x7f8fd814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fdfd70700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fdfd70700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd8155260 con 0x7f8fd81544f0 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fdfd70700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80c17b0 con 0x7f8fd814e0d0 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fdfd70700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80bf9e0 con 0x7f8fd80c5a90 2023-08-22T00:25:21.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fddb0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8fd814e0d0 0x7f8fd814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fddb0c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8fd814e0d0 0x7f8fd814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39826/0 (socket says 172.21.15.98:39826) 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.676+0000 7f8fddb0c700 1 -- 172.21.15.98:0/4221576757 learned_addr learned my addr 172.21.15.98:0/4221576757 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdd30b700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fddb0c700 1 -- 172.21.15.98:0/4221576757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 msgr2=0x7f8fd80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fddb0c700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fddb0c700 1 -- 172.21.15.98:0/4221576757 >> v1:172.21.15.118:6789/0 conn(0x7f8fd81544f0 legacy=0x7f8fd8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fddb0c700 1 -- 172.21.15.98:0/4221576757 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80bfcc0 con 0x7f8fd814e0d0 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fddb0c700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd814e0d0 0x7f8fd814e4b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f8fc8006fd0 tx=0x7f8fc80090f0).ready entity=mon.0 client_cookie=38534276631496d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdcb0a700 1 -- 172.21.15.98:0/4221576757 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800b600 con 0x7f8fd814e0d0 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdcb0a700 1 -- 172.21.15.98:0/4221576757 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800b760 con 0x7f8fd814e0d0 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdcb0a700 1 -- 172.21.15.98:0/4221576757 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800bae0 con 0x7f8fd814e0d0 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 -- 172.21.15.98:0/4221576757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd814e0d0 msgr2=0x7f8fd814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd814e0d0 0x7f8fd814e4b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f8fc8006fd0 tx=0x7f8fc80090f0).stop 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 -- 172.21.15.98:0/4221576757 shutdown_connections 2023-08-22T00:25:21.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd814e0d0 0x7f8fd814e4b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/4221576757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.677+0000 7f8fdfd70700 1 -- 172.21.15.98:0/4221576757 >> 172.21.15.98:0/4221576757 conn(0x7f8fd80caa80 msgr2=0x7f8fd80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.678+0000 7f8fdfd70700 1 -- 172.21.15.98:0/4221576757 shutdown_connections 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.678+0000 7f8fdfd70700 1 -- 172.21.15.98:0/4221576757 wait complete. 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 Processor -- start 2023-08-22T00:25:21.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 -- start start 2023-08-22T00:25:21.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 0x7f8fd80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814eab0 con 0x7f8fd81544f0 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80c99d0 con 0x7f8fd814e0d0 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.679+0000 7f8fdfd70700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814f5c0 con 0x7f8fd80c5a90 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39828/0 (socket says 172.21.15.98:39828) 2023-08-22T00:25:21.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 -- 172.21.15.98:0/2957584335 learned_addr learned my addr 172.21.15.98:0/2957584335 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fddb0c700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fdd30b700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 0x7f8fd80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 -- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 msgr2=0x7f8fd80c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 -- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 msgr2=0x7f8fd80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 0x7f8fd80c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 -- 172.21.15.98:0/2957584335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009370 con 0x7f8fd81544f0 2023-08-22T00:25:21.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fdd30b700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 0x7f8fd80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fde30d700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f8fd000b810 tx=0x7f8fd0009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000d600 con 0x7f8fd81544f0 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000d780 con 0x7f8fd81544f0 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000db40 con 0x7f8fd81544f0 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd814ec90 con 0x7f8fd81544f0 2023-08-22T00:25:21.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.680+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd814f250 con 0x7f8fd81544f0 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.681+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd80acdb0 con 0x7f8fd81544f0 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.682+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8fd0019460 con 0x7f8fd81544f0 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.682+0000 7f8fcdffb700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 0x7f8fbc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.682+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8fd007a230 con 0x7f8fd81544f0 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.682+0000 7f8fddb0c700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 0x7f8fbc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:21.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.682+0000 7f8fddb0c700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 0x7f8fbc0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fd80c9b50 tx=0x7f8fc8017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:21.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.686+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fd004b360 con 0x7f8fd81544f0 2023-08-22T00:25:21.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.846+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fd8047480 con 0x7f8fbc05ef30 2023-08-22T00:25:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.856+0000 7f8fcdffb700 1 -- 172.21.15.98:0/2957584335 <== mgr.8181 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362194 (secure 0 0 0) 0x7f8fd8047480 con 0x7f8fbc05ef30 2023-08-22T00:25:21.864 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:21.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.859+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 msgr2=0x7f8fbc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.859+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 0x7f8fbc0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fd80c9b50 tx=0x7f8fc8017000).stop 2023-08-22T00:25:21.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.859+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 msgr2=0x7f8fd80c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:21.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.859+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f8fd000b810 tx=0x7f8fd0009290).stop 2023-08-22T00:25:21.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 shutdown_connections 2023-08-22T00:25:21.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8fbc05ef30 0x7f8fbc0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fd80c5a90 0x7f8fd80c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fd81544f0 0x7f8fd80c94e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 --2- 172.21.15.98:0/2957584335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fd814e0d0 0x7f8fd80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:21.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 >> 172.21.15.98:0/2957584335 conn(0x7f8fd80caa80 msgr2=0x7f8fd80c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:21.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 shutdown_connections 2023-08-22T00:25:21.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:21.860+0000 7f8fdfd70700 1 -- 172.21.15.98:0/2957584335 wait complete. 2023-08-22T00:25:21.871 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:21.874 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-22T00:25:19.894072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432240,"kb_used_data":14512,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752542480,"statfs":{"total":773094113280,"available":770603499520,"internally_reserved":0,"allocated":14860288,"data_stored":7873624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18279,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.052106"},"pg_stats":[{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859634+0000","last_change":"2023-08-22T00:25:18.859634+0000","last_active":"2023-08-22T00:25:18.859634+0000","last_peered":"2023-08-22T00:25:18.859634+0000","last_clean":"2023-08-22T00:25:18.859634+0000","last_became_active":"2023-08-22T00:25:18.859163+0000","last_became_peered":"2023-08-22T00:25:18.859163+0000","last_unstale":"2023-08-22T00:25:18.859634+0000","last_undegraded":"2023-08-22T00:25:18.859634+0000","last_fullsized":"2023-08-22T00:25:18.859634+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"151'3","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852595+0000","last_change":"2023-08-22T00:25:18.474389+0000","last_active":"2023-08-22T00:25:18.852595+0000","last_peered":"2023-08-22T00:25:18.852595+0000","last_clean":"2023-08-22T00:25:18.852595+0000","last_became_active":"2023-08-22T00:25:18.474108+0000","last_became_peered":"2023-08-22T00:25:18.474108+0000","last_unstale":"2023-08-22T00:25:18.852595+0000","last_undegraded":"2023-08-22T00:25:18.852595+0000","last_fullsized":"2023-08-22T00:25:18.852595+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857018+0000","last_change":"2023-08-22T00:25:18.857018+0000","last_active":"2023-08-22T00:25:18.857018+0000","last_peered":"2023-08-22T00:25:18.857018+0000","last_clean":"2023-08-22T00:25:18.857018+0000","last_became_active":"2023-08-22T00:25:18.856767+0000","last_became_peered":"2023-08-22T00:25:18.856767+0000","last_unstale":"2023-08-22T00:25:18.857018+0000","last_undegraded":"2023-08-22T00:25:18.857018+0000","last_fullsized":"2023-08-22T00:25:18.857018+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477714+0000","last_change":"2023-08-22T00:25:18.472415+0000","last_active":"2023-08-22T00:25:18.477714+0000","last_peered":"2023-08-22T00:25:18.477714+0000","last_clean":"2023-08-22T00:25:18.477714+0000","last_became_active":"2023-08-22T00:25:18.472158+0000","last_became_peered":"2023-08-22T00:25:18.472158+0000","last_unstale":"2023-08-22T00:25:18.477714+0000","last_undegraded":"2023-08-22T00:25:18.477714+0000","last_fullsized":"2023-08-22T00:25:18.477714+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853534+0000","last_change":"2023-08-22T00:25:18.853534+0000","last_active":"2023-08-22T00:25:18.853534+0000","last_peered":"2023-08-22T00:25:18.853534+0000","last_clean":"2023-08-22T00:25:18.853534+0000","last_became_active":"2023-08-22T00:25:18.853259+0000","last_became_peered":"2023-08-22T00:25:18.853259+0000","last_unstale":"2023-08-22T00:25:18.853534+0000","last_undegraded":"2023-08-22T00:25:18.853534+0000","last_fullsized":"2023-08-22T00:25:18.853534+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468759+0000","last_change":"2023-08-22T00:25:18.463489+0000","last_active":"2023-08-22T00:25:18.468759+0000","last_peered":"2023-08-22T00:25:18.468759+0000","last_clean":"2023-08-22T00:25:18.468759+0000","last_became_active":"2023-08-22T00:25:18.462227+0000","last_became_peered":"2023-08-22T00:25:18.462227+0000","last_unstale":"2023-08-22T00:25:18.468759+0000","last_undegraded":"2023-08-22T00:25:18.468759+0000","last_fullsized":"2023-08-22T00:25:18.468759+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855126+0000","last_change":"2023-08-22T00:25:18.855126+0000","last_active":"2023-08-22T00:25:18.855126+0000","last_peered":"2023-08-22T00:25:18.855126+0000","last_clean":"2023-08-22T00:25:18.855126+0000","last_became_active":"2023-08-22T00:25:18.854853+0000","last_became_peered":"2023-08-22T00:25:18.854853+0000","last_unstale":"2023-08-22T00:25:18.855126+0000","last_undegraded":"2023-08-22T00:25:18.855126+0000","last_fullsized":"2023-08-22T00:25:18.855126+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3c","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856593+0000","last_change":"2023-08-22T00:25:18.478254+0000","last_active":"2023-08-22T00:25:18.856593+0000","last_peered":"2023-08-22T00:25:18.856593+0000","last_clean":"2023-08-22T00:25:18.856593+0000","last_became_active":"2023-08-22T00:25:18.477963+0000","last_became_peered":"2023-08-22T00:25:18.477963+0000","last_unstale":"2023-08-22T00:25:18.856593+0000","last_undegraded":"2023-08-22T00:25:18.856593+0000","last_fullsized":"2023-08-22T00:25:18.856593+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855744+0000","last_change":"2023-08-22T00:25:18.855744+0000","last_active":"2023-08-22T00:25:18.855744+0000","last_peered":"2023-08-22T00:25:18.855744+0000","last_clean":"2023-08-22T00:25:18.855744+0000","last_became_active":"2023-08-22T00:25:18.855446+0000","last_became_peered":"2023-08-22T00:25:18.855446+0000","last_unstale":"2023-08-22T00:25:18.855744+0000","last_undegraded":"2023-08-22T00:25:18.855744+0000","last_fullsized":"2023-08-22T00:25:18.855744+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.839300+0000","last_change":"2023-08-22T00:25:18.462573+0000","last_active":"2023-08-22T00:25:18.839300+0000","last_peered":"2023-08-22T00:25:18.839300+0000","last_clean":"2023-08-22T00:25:18.839300+0000","last_became_active":"2023-08-22T00:25:18.462312+0000","last_became_peered":"2023-08-22T00:25:18.462312+0000","last_unstale":"2023-08-22T00:25:18.839300+0000","last_undegraded":"2023-08-22T00:25:18.839300+0000","last_fullsized":"2023-08-22T00:25:18.839300+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853024+0000","last_change":"2023-08-22T00:25:18.853024+0000","last_active":"2023-08-22T00:25:18.853024+0000","last_peered":"2023-08-22T00:25:18.853024+0000","last_clean":"2023-08-22T00:25:18.853024+0000","last_became_active":"2023-08-22T00:25:18.852754+0000","last_became_peered":"2023-08-22T00:25:18.852754+0000","last_unstale":"2023-08-22T00:25:18.853024+0000","last_undegraded":"2023-08-22T00:25:18.853024+0000","last_fullsized":"2023-08-22T00:25:18.853024+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3a","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.838342+0000","last_change":"2023-08-22T00:25:18.476770+0000","last_active":"2023-08-22T00:25:18.838342+0000","last_peered":"2023-08-22T00:25:18.838342+0000","last_clean":"2023-08-22T00:25:18.838342+0000","last_became_active":"2023-08-22T00:25:18.474096+0000","last_became_peered":"2023-08-22T00:25:18.474096+0000","last_unstale":"2023-08-22T00:25:18.838342+0000","last_undegraded":"2023-08-22T00:25:18.838342+0000","last_fullsized":"2023-08-22T00:25:18.838342+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862309+0000","last_change":"2023-08-22T00:25:18.862309+0000","last_active":"2023-08-22T00:25:18.862309+0000","last_peered":"2023-08-22T00:25:18.862309+0000","last_clean":"2023-08-22T00:25:18.862309+0000","last_became_active":"2023-08-22T00:25:18.862020+0000","last_became_peered":"2023-08-22T00:25:18.862020+0000","last_unstale":"2023-08-22T00:25:18.862309+0000","last_undegraded":"2023-08-22T00:25:18.862309+0000","last_fullsized":"2023-08-22T00:25:18.862309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483764+0000","last_change":"2023-08-22T00:25:18.470544+0000","last_active":"2023-08-22T00:25:18.483764+0000","last_peered":"2023-08-22T00:25:18.483764+0000","last_clean":"2023-08-22T00:25:18.483764+0000","last_became_active":"2023-08-22T00:25:18.470255+0000","last_became_peered":"2023-08-22T00:25:18.470255+0000","last_unstale":"2023-08-22T00:25:18.483764+0000","last_undegraded":"2023-08-22T00:25:18.483764+0000","last_fullsized":"2023-08-22T00:25:18.483764+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857917+0000","last_change":"2023-08-22T00:25:18.857917+0000","last_active":"2023-08-22T00:25:18.857917+0000","last_peered":"2023-08-22T00:25:18.857917+0000","last_clean":"2023-08-22T00:25:18.857917+0000","last_became_active":"2023-08-22T00:25:18.857618+0000","last_became_peered":"2023-08-22T00:25:18.857618+0000","last_unstale":"2023-08-22T00:25:18.857917+0000","last_undegraded":"2023-08-22T00:25:18.857917+0000","last_fullsized":"2023-08-22T00:25:18.857917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470394+0000","last_change":"2023-08-22T00:25:18.465203+0000","last_active":"2023-08-22T00:25:18.470394+0000","last_peered":"2023-08-22T00:25:18.470394+0000","last_clean":"2023-08-22T00:25:18.470394+0000","last_became_active":"2023-08-22T00:25:18.461943+0000","last_became_peered":"2023-08-22T00:25:18.461943+0000","last_unstale":"2023-08-22T00:25:18.470394+0000","last_undegraded":"2023-08-22T00:25:18.470394+0000","last_fullsized":"2023-08-22T00:25:18.470394+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859468+0000","last_change":"2023-08-22T00:25:18.859468+0000","last_active":"2023-08-22T00:25:18.859468+0000","last_peered":"2023-08-22T00:25:18.859468+0000","last_clean":"2023-08-22T00:25:18.859468+0000","last_became_active":"2023-08-22T00:25:18.858790+0000","last_became_peered":"2023-08-22T00:25:18.858790+0000","last_unstale":"2023-08-22T00:25:18.859468+0000","last_undegraded":"2023-08-22T00:25:18.859468+0000","last_fullsized":"2023-08-22T00:25:18.859468+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.482070+0000","last_change":"2023-08-22T00:25:18.481574+0000","last_active":"2023-08-22T00:25:18.482070+0000","last_peered":"2023-08-22T00:25:18.482070+0000","last_clean":"2023-08-22T00:25:18.482070+0000","last_became_active":"2023-08-22T00:25:18.481298+0000","last_became_peered":"2023-08-22T00:25:18.481298+0000","last_unstale":"2023-08-22T00:25:18.482070+0000","last_undegraded":"2023-08-22T00:25:18.482070+0000","last_fullsized":"2023-08-22T00:25:18.482070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856680+0000","last_change":"2023-08-22T00:25:18.856680+0000","last_active":"2023-08-22T00:25:18.856680+0000","last_peered":"2023-08-22T00:25:18.856680+0000","last_clean":"2023-08-22T00:25:18.856680+0000","last_became_active":"2023-08-22T00:25:18.856377+0000","last_became_peered":"2023-08-22T00:25:18.856377+0000","last_unstale":"2023-08-22T00:25:18.856680+0000","last_undegraded":"2023-08-22T00:25:18.856680+0000","last_fullsized":"2023-08-22T00:25:18.856680+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480763+0000","last_change":"2023-08-22T00:25:18.474329+0000","last_active":"2023-08-22T00:25:18.480763+0000","last_peered":"2023-08-22T00:25:18.480763+0000","last_clean":"2023-08-22T00:25:18.480763+0000","last_became_active":"2023-08-22T00:25:18.474008+0000","last_became_peered":"2023-08-22T00:25:18.474008+0000","last_unstale":"2023-08-22T00:25:18.480763+0000","last_undegraded":"2023-08-22T00:25:18.480763+0000","last_fullsized":"2023-08-22T00:25:18.480763+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862399+0000","last_change":"2023-08-22T00:25:18.862399+0000","last_active":"2023-08-22T00:25:18.862399+0000","last_peered":"2023-08-22T00:25:18.862399+0000","last_clean":"2023-08-22T00:25:18.862399+0000","last_became_active":"2023-08-22T00:25:18.862117+0000","last_became_peered":"2023-08-22T00:25:18.862117+0000","last_unstale":"2023-08-22T00:25:18.862399+0000","last_undegraded":"2023-08-22T00:25:18.862399+0000","last_fullsized":"2023-08-22T00:25:18.862399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466970+0000","last_change":"2023-08-22T00:25:18.465216+0000","last_active":"2023-08-22T00:25:18.466970+0000","last_peered":"2023-08-22T00:25:18.466970+0000","last_clean":"2023-08-22T00:25:18.466970+0000","last_became_active":"2023-08-22T00:25:18.464938+0000","last_became_peered":"2023-08-22T00:25:18.464938+0000","last_unstale":"2023-08-22T00:25:18.466970+0000","last_undegraded":"2023-08-22T00:25:18.466970+0000","last_fullsized":"2023-08-22T00:25:18.466970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853402+0000","last_change":"2023-08-22T00:25:18.853402+0000","last_active":"2023-08-22T00:25:18.853402+0000","last_peered":"2023-08-22T00:25:18.853402+0000","last_clean":"2023-08-22T00:25:18.853402+0000","last_became_active":"2023-08-22T00:25:18.852954+0000","last_became_peered":"2023-08-22T00:25:18.852954+0000","last_unstale":"2023-08-22T00:25:18.853402+0000","last_undegraded":"2023-08-22T00:25:18.853402+0000","last_fullsized":"2023-08-22T00:25:18.853402+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.34","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857876+0000","last_change":"2023-08-22T00:25:18.471218+0000","last_active":"2023-08-22T00:25:18.857876+0000","last_peered":"2023-08-22T00:25:18.857876+0000","last_clean":"2023-08-22T00:25:18.857876+0000","last_became_active":"2023-08-22T00:25:18.470638+0000","last_became_peered":"2023-08-22T00:25:18.470638+0000","last_unstale":"2023-08-22T00:25:18.857876+0000","last_undegraded":"2023-08-22T00:25:18.857876+0000","last_fullsized":"2023-08-22T00:25:18.857876+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863536+0000","last_change":"2023-08-22T00:25:18.863536+0000","last_active":"2023-08-22T00:25:18.863536+0000","last_peered":"2023-08-22T00:25:18.863536+0000","last_clean":"2023-08-22T00:25:18.863536+0000","last_became_active":"2023-08-22T00:25:18.863266+0000","last_became_peered":"2023-08-22T00:25:18.863266+0000","last_unstale":"2023-08-22T00:25:18.863536+0000","last_undegraded":"2023-08-22T00:25:18.863536+0000","last_fullsized":"2023-08-22T00:25:18.863536+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843734+0000","last_change":"2023-08-22T00:25:18.471562+0000","last_active":"2023-08-22T00:25:18.843734+0000","last_peered":"2023-08-22T00:25:18.843734+0000","last_clean":"2023-08-22T00:25:18.843734+0000","last_became_active":"2023-08-22T00:25:18.471273+0000","last_became_peered":"2023-08-22T00:25:18.471273+0000","last_unstale":"2023-08-22T00:25:18.843734+0000","last_undegraded":"2023-08-22T00:25:18.843734+0000","last_fullsized":"2023-08-22T00:25:18.843734+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851464+0000","last_change":"2023-08-22T00:25:18.851464+0000","last_active":"2023-08-22T00:25:18.851464+0000","last_peered":"2023-08-22T00:25:18.851464+0000","last_clean":"2023-08-22T00:25:18.851464+0000","last_became_active":"2023-08-22T00:25:18.848996+0000","last_became_peered":"2023-08-22T00:25:18.848996+0000","last_unstale":"2023-08-22T00:25:18.851464+0000","last_undegraded":"2023-08-22T00:25:18.851464+0000","last_fullsized":"2023-08-22T00:25:18.851464+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.469428+0000","last_change":"2023-08-22T00:25:18.464568+0000","last_active":"2023-08-22T00:25:18.469428+0000","last_peered":"2023-08-22T00:25:18.469428+0000","last_clean":"2023-08-22T00:25:18.469428+0000","last_became_active":"2023-08-22T00:25:18.462536+0000","last_became_peered":"2023-08-22T00:25:18.462536+0000","last_unstale":"2023-08-22T00:25:18.469428+0000","last_undegraded":"2023-08-22T00:25:18.469428+0000","last_fullsized":"2023-08-22T00:25:18.469428+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865493+0000","last_change":"2023-08-22T00:25:18.865493+0000","last_active":"2023-08-22T00:25:18.865493+0000","last_peered":"2023-08-22T00:25:18.865493+0000","last_clean":"2023-08-22T00:25:18.865493+0000","last_became_active":"2023-08-22T00:25:18.864545+0000","last_became_peered":"2023-08-22T00:25:18.864545+0000","last_unstale":"2023-08-22T00:25:18.865493+0000","last_undegraded":"2023-08-22T00:25:18.865493+0000","last_fullsized":"2023-08-22T00:25:18.865493+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466858+0000","last_change":"2023-08-22T00:25:18.465150+0000","last_active":"2023-08-22T00:25:18.466858+0000","last_peered":"2023-08-22T00:25:18.466858+0000","last_clean":"2023-08-22T00:25:18.466858+0000","last_became_active":"2023-08-22T00:25:18.464853+0000","last_became_peered":"2023-08-22T00:25:18.464853+0000","last_unstale":"2023-08-22T00:25:18.466858+0000","last_undegraded":"2023-08-22T00:25:18.466858+0000","last_fullsized":"2023-08-22T00:25:18.466858+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860560+0000","last_change":"2023-08-22T00:25:18.860560+0000","last_active":"2023-08-22T00:25:18.860560+0000","last_peered":"2023-08-22T00:25:18.860560+0000","last_clean":"2023-08-22T00:25:18.860560+0000","last_became_active":"2023-08-22T00:25:18.860296+0000","last_became_peered":"2023-08-22T00:25:18.860296+0000","last_unstale":"2023-08-22T00:25:18.860560+0000","last_undegraded":"2023-08-22T00:25:18.860560+0000","last_fullsized":"2023-08-22T00:25:18.860560+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.30","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864998+0000","last_change":"2023-08-22T00:25:18.469548+0000","last_active":"2023-08-22T00:25:18.864998+0000","last_peered":"2023-08-22T00:25:18.864998+0000","last_clean":"2023-08-22T00:25:18.864998+0000","last_became_active":"2023-08-22T00:25:18.469272+0000","last_became_peered":"2023-08-22T00:25:18.469272+0000","last_unstale":"2023-08-22T00:25:18.864998+0000","last_undegraded":"2023-08-22T00:25:18.864998+0000","last_fullsized":"2023-08-22T00:25:18.864998+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858623+0000","last_change":"2023-08-22T00:25:18.858623+0000","last_active":"2023-08-22T00:25:18.858623+0000","last_peered":"2023-08-22T00:25:18.858623+0000","last_clean":"2023-08-22T00:25:18.858623+0000","last_became_active":"2023-08-22T00:25:18.858371+0000","last_became_peered":"2023-08-22T00:25:18.858371+0000","last_unstale":"2023-08-22T00:25:18.858623+0000","last_undegraded":"2023-08-22T00:25:18.858623+0000","last_fullsized":"2023-08-22T00:25:18.858623+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474316+0000","last_change":"2023-08-22T00:25:18.470476+0000","last_active":"2023-08-22T00:25:18.474316+0000","last_peered":"2023-08-22T00:25:18.474316+0000","last_clean":"2023-08-22T00:25:18.474316+0000","last_became_active":"2023-08-22T00:25:18.470178+0000","last_became_peered":"2023-08-22T00:25:18.470178+0000","last_unstale":"2023-08-22T00:25:18.474316+0000","last_undegraded":"2023-08-22T00:25:18.474316+0000","last_fullsized":"2023-08-22T00:25:18.474316+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856936+0000","last_change":"2023-08-22T00:25:18.856936+0000","last_active":"2023-08-22T00:25:18.856936+0000","last_peered":"2023-08-22T00:25:18.856936+0000","last_clean":"2023-08-22T00:25:18.856936+0000","last_became_active":"2023-08-22T00:25:18.856659+0000","last_became_peered":"2023-08-22T00:25:18.856659+0000","last_unstale":"2023-08-22T00:25:18.856936+0000","last_undegraded":"2023-08-22T00:25:18.856936+0000","last_fullsized":"2023-08-22T00:25:18.856936+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476352+0000","last_change":"2023-08-22T00:25:18.471244+0000","last_active":"2023-08-22T00:25:18.476352+0000","last_peered":"2023-08-22T00:25:18.476352+0000","last_clean":"2023-08-22T00:25:18.476352+0000","last_became_active":"2023-08-22T00:25:18.470967+0000","last_became_peered":"2023-08-22T00:25:18.470967+0000","last_unstale":"2023-08-22T00:25:18.476352+0000","last_undegraded":"2023-08-22T00:25:18.476352+0000","last_fullsized":"2023-08-22T00:25:18.476352+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853936+0000","last_change":"2023-08-22T00:25:18.853936+0000","last_active":"2023-08-22T00:25:18.853936+0000","last_peered":"2023-08-22T00:25:18.853936+0000","last_clean":"2023-08-22T00:25:18.853936+0000","last_became_active":"2023-08-22T00:25:18.853619+0000","last_became_peered":"2023-08-22T00:25:18.853619+0000","last_unstale":"2023-08-22T00:25:18.853936+0000","last_undegraded":"2023-08-22T00:25:18.853936+0000","last_fullsized":"2023-08-22T00:25:18.853936+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.841706+0000","last_change":"2023-08-22T00:25:18.476070+0000","last_active":"2023-08-22T00:25:18.841706+0000","last_peered":"2023-08-22T00:25:18.841706+0000","last_clean":"2023-08-22T00:25:18.841706+0000","last_became_active":"2023-08-22T00:25:18.473014+0000","last_became_peered":"2023-08-22T00:25:18.473014+0000","last_unstale":"2023-08-22T00:25:18.841706+0000","last_undegraded":"2023-08-22T00:25:18.841706+0000","last_fullsized":"2023-08-22T00:25:18.841706+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851424+0000","last_change":"2023-08-22T00:25:18.851424+0000","last_active":"2023-08-22T00:25:18.851424+0000","last_peered":"2023-08-22T00:25:18.851424+0000","last_clean":"2023-08-22T00:25:18.851424+0000","last_became_active":"2023-08-22T00:25:18.851157+0000","last_became_peered":"2023-08-22T00:25:18.851157+0000","last_unstale":"2023-08-22T00:25:18.851424+0000","last_undegraded":"2023-08-22T00:25:18.851424+0000","last_fullsized":"2023-08-22T00:25:18.851424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480340+0000","last_change":"2023-08-22T00:25:18.472381+0000","last_active":"2023-08-22T00:25:18.480340+0000","last_peered":"2023-08-22T00:25:18.480340+0000","last_clean":"2023-08-22T00:25:18.480340+0000","last_became_active":"2023-08-22T00:25:18.472124+0000","last_became_peered":"2023-08-22T00:25:18.472124+0000","last_unstale":"2023-08-22T00:25:18.480340+0000","last_undegraded":"2023-08-22T00:25:18.480340+0000","last_fullsized":"2023-08-22T00:25:18.480340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853273+0000","last_change":"2023-08-22T00:25:18.853273+0000","last_active":"2023-08-22T00:25:18.853273+0000","last_peered":"2023-08-22T00:25:18.853273+0000","last_clean":"2023-08-22T00:25:18.853273+0000","last_became_active":"2023-08-22T00:25:18.852979+0000","last_became_peered":"2023-08-22T00:25:18.852979+0000","last_unstale":"2023-08-22T00:25:18.853273+0000","last_undegraded":"2023-08-22T00:25:18.853273+0000","last_fullsized":"2023-08-22T00:25:18.853273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843068+0000","last_change":"2023-08-22T00:25:18.480958+0000","last_active":"2023-08-22T00:25:18.843068+0000","last_peered":"2023-08-22T00:25:18.843068+0000","last_clean":"2023-08-22T00:25:18.843068+0000","last_became_active":"2023-08-22T00:25:18.480660+0000","last_became_peered":"2023-08-22T00:25:18.480660+0000","last_unstale":"2023-08-22T00:25:18.843068+0000","last_undegraded":"2023-08-22T00:25:18.843068+0000","last_fullsized":"2023-08-22T00:25:18.843068+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854160+0000","last_change":"2023-08-22T00:25:18.854160+0000","last_active":"2023-08-22T00:25:18.854160+0000","last_peered":"2023-08-22T00:25:18.854160+0000","last_clean":"2023-08-22T00:25:18.854160+0000","last_became_active":"2023-08-22T00:25:18.852443+0000","last_became_peered":"2023-08-22T00:25:18.852443+0000","last_unstale":"2023-08-22T00:25:18.854160+0000","last_undegraded":"2023-08-22T00:25:18.854160+0000","last_fullsized":"2023-08-22T00:25:18.854160+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477485+0000","last_change":"2023-08-22T00:25:18.473695+0000","last_active":"2023-08-22T00:25:18.477485+0000","last_peered":"2023-08-22T00:25:18.477485+0000","last_clean":"2023-08-22T00:25:18.477485+0000","last_became_active":"2023-08-22T00:25:18.473358+0000","last_became_peered":"2023-08-22T00:25:18.473358+0000","last_unstale":"2023-08-22T00:25:18.477485+0000","last_undegraded":"2023-08-22T00:25:18.477485+0000","last_fullsized":"2023-08-22T00:25:18.477485+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851171+0000","last_change":"2023-08-22T00:25:18.851171+0000","last_active":"2023-08-22T00:25:18.851171+0000","last_peered":"2023-08-22T00:25:18.851171+0000","last_clean":"2023-08-22T00:25:18.851171+0000","last_became_active":"2023-08-22T00:25:18.850892+0000","last_became_peered":"2023-08-22T00:25:18.850892+0000","last_unstale":"2023-08-22T00:25:18.851171+0000","last_undegraded":"2023-08-22T00:25:18.851171+0000","last_fullsized":"2023-08-22T00:25:18.851171+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.479316+0000","last_change":"2023-08-22T00:25:18.478544+0000","last_active":"2023-08-22T00:25:18.479316+0000","last_peered":"2023-08-22T00:25:18.479316+0000","last_clean":"2023-08-22T00:25:18.479316+0000","last_became_active":"2023-08-22T00:25:18.478225+0000","last_became_peered":"2023-08-22T00:25:18.478225+0000","last_unstale":"2023-08-22T00:25:18.479316+0000","last_undegraded":"2023-08-22T00:25:18.479316+0000","last_fullsized":"2023-08-22T00:25:18.479316+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857064+0000","last_change":"2023-08-22T00:25:18.857064+0000","last_active":"2023-08-22T00:25:18.857064+0000","last_peered":"2023-08-22T00:25:18.857064+0000","last_clean":"2023-08-22T00:25:18.857064+0000","last_became_active":"2023-08-22T00:25:18.856798+0000","last_became_peered":"2023-08-22T00:25:18.856798+0000","last_unstale":"2023-08-22T00:25:18.857064+0000","last_undegraded":"2023-08-22T00:25:18.857064+0000","last_fullsized":"2023-08-22T00:25:18.857064+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476394+0000","last_change":"2023-08-22T00:25:18.473824+0000","last_active":"2023-08-22T00:25:18.476394+0000","last_peered":"2023-08-22T00:25:18.476394+0000","last_clean":"2023-08-22T00:25:18.476394+0000","last_became_active":"2023-08-22T00:25:18.473538+0000","last_became_peered":"2023-08-22T00:25:18.473538+0000","last_unstale":"2023-08-22T00:25:18.476394+0000","last_undegraded":"2023-08-22T00:25:18.476394+0000","last_fullsized":"2023-08-22T00:25:18.476394+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863898+0000","last_change":"2023-08-22T00:25:18.863898+0000","last_active":"2023-08-22T00:25:18.863898+0000","last_peered":"2023-08-22T00:25:18.863898+0000","last_clean":"2023-08-22T00:25:18.863898+0000","last_became_active":"2023-08-22T00:25:18.863666+0000","last_became_peered":"2023-08-22T00:25:18.863666+0000","last_unstale":"2023-08-22T00:25:18.863898+0000","last_undegraded":"2023-08-22T00:25:18.863898+0000","last_fullsized":"2023-08-22T00:25:18.863898+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.467376+0000","last_change":"2023-08-22T00:25:18.465824+0000","last_active":"2023-08-22T00:25:18.467376+0000","last_peered":"2023-08-22T00:25:18.467376+0000","last_clean":"2023-08-22T00:25:18.467376+0000","last_became_active":"2023-08-22T00:25:18.465313+0000","last_became_peered":"2023-08-22T00:25:18.465313+0000","last_unstale":"2023-08-22T00:25:18.467376+0000","last_undegraded":"2023-08-22T00:25:18.467376+0000","last_fullsized":"2023-08-22T00:25:18.467376+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852028+0000","last_change":"2023-08-22T00:25:18.852028+0000","last_active":"2023-08-22T00:25:18.852028+0000","last_peered":"2023-08-22T00:25:18.852028+0000","last_clean":"2023-08-22T00:25:18.852028+0000","last_became_active":"2023-08-22T00:25:18.851765+0000","last_became_peered":"2023-08-22T00:25:18.851765+0000","last_unstale":"2023-08-22T00:25:18.852028+0000","last_undegraded":"2023-08-22T00:25:18.852028+0000","last_fullsized":"2023-08-22T00:25:18.852028+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480550+0000","last_change":"2023-08-22T00:25:18.475084+0000","last_active":"2023-08-22T00:25:18.480550+0000","last_peered":"2023-08-22T00:25:18.480550+0000","last_clean":"2023-08-22T00:25:18.480550+0000","last_became_active":"2023-08-22T00:25:18.474787+0000","last_became_peered":"2023-08-22T00:25:18.474787+0000","last_unstale":"2023-08-22T00:25:18.480550+0000","last_undegraded":"2023-08-22T00:25:18.480550+0000","last_fullsized":"2023-08-22T00:25:18.480550+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863730+0000","last_change":"2023-08-22T00:25:18.863730+0000","last_active":"2023-08-22T00:25:18.863730+0000","last_peered":"2023-08-22T00:25:18.863730+0000","last_clean":"2023-08-22T00:25:18.863730+0000","last_became_active":"2023-08-22T00:25:18.861781+0000","last_became_peered":"2023-08-22T00:25:18.861781+0000","last_unstale":"2023-08-22T00:25:18.863730+0000","last_undegraded":"2023-08-22T00:25:18.863730+0000","last_fullsized":"2023-08-22T00:25:18.863730+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477717+0000","last_change":"2023-08-22T00:25:18.472772+0000","last_active":"2023-08-22T00:25:18.477717+0000","last_peered":"2023-08-22T00:25:18.477717+0000","last_clean":"2023-08-22T00:25:18.477717+0000","last_became_active":"2023-08-22T00:25:18.471692+0000","last_became_peered":"2023-08-22T00:25:18.471692+0000","last_unstale":"2023-08-22T00:25:18.477717+0000","last_undegraded":"2023-08-22T00:25:18.477717+0000","last_fullsized":"2023-08-22T00:25:18.477717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852289+0000","last_change":"2023-08-22T00:25:18.852289+0000","last_active":"2023-08-22T00:25:18.852289+0000","last_peered":"2023-08-22T00:25:18.852289+0000","last_clean":"2023-08-22T00:25:18.852289+0000","last_became_active":"2023-08-22T00:25:18.851986+0000","last_became_peered":"2023-08-22T00:25:18.851986+0000","last_unstale":"2023-08-22T00:25:18.852289+0000","last_undegraded":"2023-08-22T00:25:18.852289+0000","last_fullsized":"2023-08-22T00:25:18.852289+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483791+0000","last_change":"2023-08-22T00:25:18.471031+0000","last_active":"2023-08-22T00:25:18.483791+0000","last_peered":"2023-08-22T00:25:18.483791+0000","last_clean":"2023-08-22T00:25:18.483791+0000","last_became_active":"2023-08-22T00:25:18.470357+0000","last_became_peered":"2023-08-22T00:25:18.470357+0000","last_unstale":"2023-08-22T00:25:18.483791+0000","last_undegraded":"2023-08-22T00:25:18.483791+0000","last_fullsized":"2023-08-22T00:25:18.483791+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860744+0000","last_change":"2023-08-22T00:25:18.860744+0000","last_active":"2023-08-22T00:25:18.860744+0000","last_peered":"2023-08-22T00:25:18.860744+0000","last_clean":"2023-08-22T00:25:18.860744+0000","last_became_active":"2023-08-22T00:25:18.860008+0000","last_became_peered":"2023-08-22T00:25:18.860008+0000","last_unstale":"2023-08-22T00:25:18.860744+0000","last_undegraded":"2023-08-22T00:25:18.860744+0000","last_fullsized":"2023-08-22T00:25:18.860744+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476535+0000","last_change":"2023-08-22T00:25:18.467988+0000","last_active":"2023-08-22T00:25:18.476535+0000","last_peered":"2023-08-22T00:25:18.476535+0000","last_clean":"2023-08-22T00:25:18.476535+0000","last_became_active":"2023-08-22T00:25:18.467756+0000","last_became_peered":"2023-08-22T00:25:18.467756+0000","last_unstale":"2023-08-22T00:25:18.476535+0000","last_undegraded":"2023-08-22T00:25:18.476535+0000","last_fullsized":"2023-08-22T00:25:18.476535+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860473+0000","last_change":"2023-08-22T00:25:18.860473+0000","last_active":"2023-08-22T00:25:18.860473+0000","last_peered":"2023-08-22T00:25:18.860473+0000","last_clean":"2023-08-22T00:25:18.860473+0000","last_became_active":"2023-08-22T00:25:18.860188+0000","last_became_peered":"2023-08-22T00:25:18.860188+0000","last_unstale":"2023-08-22T00:25:18.860473+0000","last_undegraded":"2023-08-22T00:25:18.860473+0000","last_fullsized":"2023-08-22T00:25:18.860473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474977+0000","last_change":"2023-08-22T00:25:18.469752+0000","last_active":"2023-08-22T00:25:18.474977+0000","last_peered":"2023-08-22T00:25:18.474977+0000","last_clean":"2023-08-22T00:25:18.474977+0000","last_became_active":"2023-08-22T00:25:18.469243+0000","last_became_peered":"2023-08-22T00:25:18.469243+0000","last_unstale":"2023-08-22T00:25:18.474977+0000","last_undegraded":"2023-08-22T00:25:18.474977+0000","last_fullsized":"2023-08-22T00:25:18.474977+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861628+0000","last_change":"2023-08-22T00:25:18.861628+0000","last_active":"2023-08-22T00:25:18.861628+0000","last_peered":"2023-08-22T00:25:18.861628+0000","last_clean":"2023-08-22T00:25:18.861628+0000","last_became_active":"2023-08-22T00:25:18.861344+0000","last_became_peered":"2023-08-22T00:25:18.861344+0000","last_unstale":"2023-08-22T00:25:18.861628+0000","last_undegraded":"2023-08-22T00:25:18.861628+0000","last_fullsized":"2023-08-22T00:25:18.861628+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.465956+0000","last_change":"2023-08-22T00:25:18.464138+0000","last_active":"2023-08-22T00:25:18.465956+0000","last_peered":"2023-08-22T00:25:18.465956+0000","last_clean":"2023-08-22T00:25:18.465956+0000","last_became_active":"2023-08-22T00:25:18.463862+0000","last_became_peered":"2023-08-22T00:25:18.463862+0000","last_unstale":"2023-08-22T00:25:18.465956+0000","last_undegraded":"2023-08-22T00:25:18.465956+0000","last_fullsized":"2023-08-22T00:25:18.465956+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865559+0000","last_change":"2023-08-22T00:25:18.865559+0000","last_active":"2023-08-22T00:25:18.865559+0000","last_peered":"2023-08-22T00:25:18.865559+0000","last_clean":"2023-08-22T00:25:18.865559+0000","last_became_active":"2023-08-22T00:25:18.865318+0000","last_became_peered":"2023-08-22T00:25:18.865318+0000","last_unstale":"2023-08-22T00:25:18.865559+0000","last_undegraded":"2023-08-22T00:25:18.865559+0000","last_fullsized":"2023-08-22T00:25:18.865559+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476377+0000","last_change":"2023-08-22T00:25:18.473716+0000","last_active":"2023-08-22T00:25:18.476377+0000","last_peered":"2023-08-22T00:25:18.476377+0000","last_clean":"2023-08-22T00:25:18.476377+0000","last_became_active":"2023-08-22T00:25:18.473392+0000","last_became_peered":"2023-08-22T00:25:18.473392+0000","last_unstale":"2023-08-22T00:25:18.476377+0000","last_undegraded":"2023-08-22T00:25:18.476377+0000","last_fullsized":"2023-08-22T00:25:18.476377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861672+0000","last_change":"2023-08-22T00:25:18.861672+0000","last_active":"2023-08-22T00:25:18.861672+0000","last_peered":"2023-08-22T00:25:18.861672+0000","last_clean":"2023-08-22T00:25:18.861672+0000","last_became_active":"2023-08-22T00:25:18.861453+0000","last_became_peered":"2023-08-22T00:25:18.861453+0000","last_unstale":"2023-08-22T00:25:18.861672+0000","last_undegraded":"2023-08-22T00:25:18.861672+0000","last_fullsized":"2023-08-22T00:25:18.861672+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843677+0000","last_change":"2023-08-22T00:25:18.481009+0000","last_active":"2023-08-22T00:25:18.843677+0000","last_peered":"2023-08-22T00:25:18.843677+0000","last_clean":"2023-08-22T00:25:18.843677+0000","last_became_active":"2023-08-22T00:25:18.480729+0000","last_became_peered":"2023-08-22T00:25:18.480729+0000","last_unstale":"2023-08-22T00:25:18.843677+0000","last_undegraded":"2023-08-22T00:25:18.843677+0000","last_fullsized":"2023-08-22T00:25:18.843677+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858614+0000","last_change":"2023-08-22T00:25:18.858614+0000","last_active":"2023-08-22T00:25:18.858614+0000","last_peered":"2023-08-22T00:25:18.858614+0000","last_clean":"2023-08-22T00:25:18.858614+0000","last_became_active":"2023-08-22T00:25:18.858353+0000","last_became_peered":"2023-08-22T00:25:18.858353+0000","last_unstale":"2023-08-22T00:25:18.858614+0000","last_undegraded":"2023-08-22T00:25:18.858614+0000","last_fullsized":"2023-08-22T00:25:18.858614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854282+0000","last_change":"2023-08-22T00:25:18.474718+0000","last_active":"2023-08-22T00:25:18.854282+0000","last_peered":"2023-08-22T00:25:18.854282+0000","last_clean":"2023-08-22T00:25:18.854282+0000","last_became_active":"2023-08-22T00:25:18.474446+0000","last_became_peered":"2023-08-22T00:25:18.474446+0000","last_unstale":"2023-08-22T00:25:18.854282+0000","last_undegraded":"2023-08-22T00:25:18.854282+0000","last_fullsized":"2023-08-22T00:25:18.854282+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857705+0000","last_change":"2023-08-22T00:25:18.857705+0000","last_active":"2023-08-22T00:25:18.857705+0000","last_peered":"2023-08-22T00:25:18.857705+0000","last_clean":"2023-08-22T00:25:18.857705+0000","last_became_active":"2023-08-22T00:25:18.857423+0000","last_became_peered":"2023-08-22T00:25:18.857423+0000","last_unstale":"2023-08-22T00:25:18.857705+0000","last_undegraded":"2023-08-22T00:25:18.857705+0000","last_fullsized":"2023-08-22T00:25:18.857705+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853176+0000","last_change":"2023-08-22T00:25:18.471076+0000","last_active":"2023-08-22T00:25:18.853176+0000","last_peered":"2023-08-22T00:25:18.853176+0000","last_clean":"2023-08-22T00:25:18.853176+0000","last_became_active":"2023-08-22T00:25:18.470821+0000","last_became_peered":"2023-08-22T00:25:18.470821+0000","last_unstale":"2023-08-22T00:25:18.853176+0000","last_undegraded":"2023-08-22T00:25:18.853176+0000","last_fullsized":"2023-08-22T00:25:18.853176+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853938+0000","last_change":"2023-08-22T00:25:18.853938+0000","last_active":"2023-08-22T00:25:18.853938+0000","last_peered":"2023-08-22T00:25:18.853938+0000","last_clean":"2023-08-22T00:25:18.853938+0000","last_became_active":"2023-08-22T00:25:18.853652+0000","last_became_peered":"2023-08-22T00:25:18.853652+0000","last_unstale":"2023-08-22T00:25:18.853938+0000","last_undegraded":"2023-08-22T00:25:18.853938+0000","last_fullsized":"2023-08-22T00:25:18.853938+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478034+0000","last_change":"2023-08-22T00:25:18.472695+0000","last_active":"2023-08-22T00:25:18.478034+0000","last_peered":"2023-08-22T00:25:18.478034+0000","last_clean":"2023-08-22T00:25:18.478034+0000","last_became_active":"2023-08-22T00:25:18.472426+0000","last_became_peered":"2023-08-22T00:25:18.472426+0000","last_unstale":"2023-08-22T00:25:18.478034+0000","last_undegraded":"2023-08-22T00:25:18.478034+0000","last_fullsized":"2023-08-22T00:25:18.478034+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853989+0000","last_change":"2023-08-22T00:25:18.853989+0000","last_active":"2023-08-22T00:25:18.853989+0000","last_peered":"2023-08-22T00:25:18.853989+0000","last_clean":"2023-08-22T00:25:18.853989+0000","last_became_active":"2023-08-22T00:25:18.853712+0000","last_became_peered":"2023-08-22T00:25:18.853712+0000","last_unstale":"2023-08-22T00:25:18.853989+0000","last_undegraded":"2023-08-22T00:25:18.853989+0000","last_fullsized":"2023-08-22T00:25:18.853989+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480534+0000","last_change":"2023-08-22T00:25:18.473026+0000","last_active":"2023-08-22T00:25:18.480534+0000","last_peered":"2023-08-22T00:25:18.480534+0000","last_clean":"2023-08-22T00:25:18.480534+0000","last_became_active":"2023-08-22T00:25:18.472743+0000","last_became_peered":"2023-08-22T00:25:18.472743+0000","last_unstale":"2023-08-22T00:25:18.480534+0000","last_undegraded":"2023-08-22T00:25:18.480534+0000","last_fullsized":"2023-08-22T00:25:18.480534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855359+0000","last_change":"2023-08-22T00:25:18.855359+0000","last_active":"2023-08-22T00:25:18.855359+0000","last_peered":"2023-08-22T00:25:18.855359+0000","last_clean":"2023-08-22T00:25:18.855359+0000","last_became_active":"2023-08-22T00:25:18.855095+0000","last_became_peered":"2023-08-22T00:25:18.855095+0000","last_unstale":"2023-08-22T00:25:18.855359+0000","last_undegraded":"2023-08-22T00:25:18.855359+0000","last_fullsized":"2023-08-22T00:25:18.855359+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480903+0000","last_change":"2023-08-22T00:25:18.475420+0000","last_active":"2023-08-22T00:25:18.480903+0000","last_peered":"2023-08-22T00:25:18.480903+0000","last_clean":"2023-08-22T00:25:18.480903+0000","last_became_active":"2023-08-22T00:25:18.474887+0000","last_became_peered":"2023-08-22T00:25:18.474887+0000","last_unstale":"2023-08-22T00:25:18.480903+0000","last_undegraded":"2023-08-22T00:25:18.480903+0000","last_fullsized":"2023-08-22T00:25:18.480903+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858190+0000","last_change":"2023-08-22T00:25:18.858190+0000","last_active":"2023-08-22T00:25:18.858190+0000","last_peered":"2023-08-22T00:25:18.858190+0000","last_clean":"2023-08-22T00:25:18.858190+0000","last_became_active":"2023-08-22T00:25:18.857917+0000","last_became_peered":"2023-08-22T00:25:18.857917+0000","last_unstale":"2023-08-22T00:25:18.858190+0000","last_undegraded":"2023-08-22T00:25:18.858190+0000","last_fullsized":"2023-08-22T00:25:18.858190+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477017+0000","last_change":"2023-08-22T00:25:18.471910+0000","last_active":"2023-08-22T00:25:18.477017+0000","last_peered":"2023-08-22T00:25:18.477017+0000","last_clean":"2023-08-22T00:25:18.477017+0000","last_became_active":"2023-08-22T00:25:18.471612+0000","last_became_peered":"2023-08-22T00:25:18.471612+0000","last_unstale":"2023-08-22T00:25:18.477017+0000","last_undegraded":"2023-08-22T00:25:18.477017+0000","last_fullsized":"2023-08-22T00:25:18.477017+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855146+0000","last_change":"2023-08-22T00:25:18.855146+0000","last_active":"2023-08-22T00:25:18.855146+0000","last_peered":"2023-08-22T00:25:18.855146+0000","last_clean":"2023-08-22T00:25:18.855146+0000","last_became_active":"2023-08-22T00:25:18.854758+0000","last_became_peered":"2023-08-22T00:25:18.854758+0000","last_unstale":"2023-08-22T00:25:18.855146+0000","last_undegraded":"2023-08-22T00:25:18.855146+0000","last_fullsized":"2023-08-22T00:25:18.855146+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478071+0000","last_change":"2023-08-22T00:25:18.472951+0000","last_active":"2023-08-22T00:25:18.478071+0000","last_peered":"2023-08-22T00:25:18.478071+0000","last_clean":"2023-08-22T00:25:18.478071+0000","last_became_active":"2023-08-22T00:25:18.469845+0000","last_became_peered":"2023-08-22T00:25:18.469845+0000","last_unstale":"2023-08-22T00:25:18.478071+0000","last_undegraded":"2023-08-22T00:25:18.478071+0000","last_fullsized":"2023-08-22T00:25:18.478071+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853819+0000","last_change":"2023-08-22T00:25:18.853819+0000","last_active":"2023-08-22T00:25:18.853819+0000","last_peered":"2023-08-22T00:25:18.853819+0000","last_clean":"2023-08-22T00:25:18.853819+0000","last_became_active":"2023-08-22T00:25:18.853534+0000","last_became_peered":"2023-08-22T00:25:18.853534+0000","last_unstale":"2023-08-22T00:25:18.853819+0000","last_undegraded":"2023-08-22T00:25:18.853819+0000","last_fullsized":"2023-08-22T00:25:18.853819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854849+0000","last_change":"2023-08-22T00:25:18.470219+0000","last_active":"2023-08-22T00:25:18.854849+0000","last_peered":"2023-08-22T00:25:18.854849+0000","last_clean":"2023-08-22T00:25:18.854849+0000","last_became_active":"2023-08-22T00:25:18.469933+0000","last_became_peered":"2023-08-22T00:25:18.469933+0000","last_unstale":"2023-08-22T00:25:18.854849+0000","last_undegraded":"2023-08-22T00:25:18.854849+0000","last_fullsized":"2023-08-22T00:25:18.854849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863031+0000","last_change":"2023-08-22T00:25:18.863031+0000","last_active":"2023-08-22T00:25:18.863031+0000","last_peered":"2023-08-22T00:25:18.863031+0000","last_clean":"2023-08-22T00:25:18.863031+0000","last_became_active":"2023-08-22T00:25:18.862749+0000","last_became_peered":"2023-08-22T00:25:18.862749+0000","last_unstale":"2023-08-22T00:25:18.863031+0000","last_undegraded":"2023-08-22T00:25:18.863031+0000","last_fullsized":"2023-08-22T00:25:18.863031+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857614+0000","last_change":"2023-08-22T00:25:18.476302+0000","last_active":"2023-08-22T00:25:18.857614+0000","last_peered":"2023-08-22T00:25:18.857614+0000","last_clean":"2023-08-22T00:25:18.857614+0000","last_became_active":"2023-08-22T00:25:18.471489+0000","last_became_peered":"2023-08-22T00:25:18.471489+0000","last_unstale":"2023-08-22T00:25:18.857614+0000","last_undegraded":"2023-08-22T00:25:18.857614+0000","last_fullsized":"2023-08-22T00:25:18.857614+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864619+0000","last_change":"2023-08-22T00:25:18.864619+0000","last_active":"2023-08-22T00:25:18.864619+0000","last_peered":"2023-08-22T00:25:18.864619+0000","last_clean":"2023-08-22T00:25:18.864619+0000","last_became_active":"2023-08-22T00:25:18.864360+0000","last_became_peered":"2023-08-22T00:25:18.864360+0000","last_unstale":"2023-08-22T00:25:18.864619+0000","last_undegraded":"2023-08-22T00:25:18.864619+0000","last_fullsized":"2023-08-22T00:25:18.864619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477066+0000","last_change":"2023-08-22T00:25:18.472942+0000","last_active":"2023-08-22T00:25:18.477066+0000","last_peered":"2023-08-22T00:25:18.477066+0000","last_clean":"2023-08-22T00:25:18.477066+0000","last_became_active":"2023-08-22T00:25:18.472628+0000","last_became_peered":"2023-08-22T00:25:18.472628+0000","last_unstale":"2023-08-22T00:25:18.477066+0000","last_undegraded":"2023-08-22T00:25:18.477066+0000","last_fullsized":"2023-08-22T00:25:18.477066+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855075+0000","last_change":"2023-08-22T00:25:18.855075+0000","last_active":"2023-08-22T00:25:18.855075+0000","last_peered":"2023-08-22T00:25:18.855075+0000","last_clean":"2023-08-22T00:25:18.855075+0000","last_became_active":"2023-08-22T00:25:18.854805+0000","last_became_peered":"2023-08-22T00:25:18.854805+0000","last_unstale":"2023-08-22T00:25:18.855075+0000","last_undegraded":"2023-08-22T00:25:18.855075+0000","last_fullsized":"2023-08-22T00:25:18.855075+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.475732+0000","last_change":"2023-08-22T00:25:18.473474+0000","last_active":"2023-08-22T00:25:18.475732+0000","last_peered":"2023-08-22T00:25:18.475732+0000","last_clean":"2023-08-22T00:25:18.475732+0000","last_became_active":"2023-08-22T00:25:18.472205+0000","last_became_peered":"2023-08-22T00:25:18.472205+0000","last_unstale":"2023-08-22T00:25:18.475732+0000","last_undegraded":"2023-08-22T00:25:18.475732+0000","last_fullsized":"2023-08-22T00:25:18.475732+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851532+0000","last_change":"2023-08-22T00:25:18.851532+0000","last_active":"2023-08-22T00:25:18.851532+0000","last_peered":"2023-08-22T00:25:18.851532+0000","last_clean":"2023-08-22T00:25:18.851532+0000","last_became_active":"2023-08-22T00:25:18.849094+0000","last_became_peered":"2023-08-22T00:25:18.849094+0000","last_unstale":"2023-08-22T00:25:18.851532+0000","last_undegraded":"2023-08-22T00:25:18.851532+0000","last_fullsized":"2023-08-22T00:25:18.851532+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853018+0000","last_change":"2023-08-22T00:25:18.465375+0000","last_active":"2023-08-22T00:25:18.853018+0000","last_peered":"2023-08-22T00:25:18.853018+0000","last_clean":"2023-08-22T00:25:18.853018+0000","last_became_active":"2023-08-22T00:25:18.465088+0000","last_became_peered":"2023-08-22T00:25:18.465088+0000","last_unstale":"2023-08-22T00:25:18.853018+0000","last_undegraded":"2023-08-22T00:25:18.853018+0000","last_fullsized":"2023-08-22T00:25:18.853018+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.849675+0000","last_change":"2023-08-22T00:25:18.849675+0000","last_active":"2023-08-22T00:25:18.849675+0000","last_peered":"2023-08-22T00:25:18.849675+0000","last_clean":"2023-08-22T00:25:18.849675+0000","last_became_active":"2023-08-22T00:25:18.849407+0000","last_became_peered":"2023-08-22T00:25:18.849407+0000","last_unstale":"2023-08-22T00:25:18.849675+0000","last_undegraded":"2023-08-22T00:25:18.849675+0000","last_fullsized":"2023-08-22T00:25:18.849675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.469447+0000","last_change":"2023-08-22T00:25:18.464748+0000","last_active":"2023-08-22T00:25:18.469447+0000","last_peered":"2023-08-22T00:25:18.469447+0000","last_clean":"2023-08-22T00:25:18.469447+0000","last_became_active":"2023-08-22T00:25:18.462935+0000","last_became_peered":"2023-08-22T00:25:18.462935+0000","last_unstale":"2023-08-22T00:25:18.469447+0000","last_undegraded":"2023-08-22T00:25:18.469447+0000","last_fullsized":"2023-08-22T00:25:18.469447+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856842+0000","last_change":"2023-08-22T00:25:18.856842+0000","last_active":"2023-08-22T00:25:18.856842+0000","last_peered":"2023-08-22T00:25:18.856842+0000","last_clean":"2023-08-22T00:25:18.856842+0000","last_became_active":"2023-08-22T00:25:18.856571+0000","last_became_peered":"2023-08-22T00:25:18.856571+0000","last_unstale":"2023-08-22T00:25:18.856842+0000","last_undegraded":"2023-08-22T00:25:18.856842+0000","last_fullsized":"2023-08-22T00:25:18.856842+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468723+0000","last_change":"2023-08-22T00:25:18.464428+0000","last_active":"2023-08-22T00:25:18.468723+0000","last_peered":"2023-08-22T00:25:18.468723+0000","last_clean":"2023-08-22T00:25:18.468723+0000","last_became_active":"2023-08-22T00:25:18.464155+0000","last_became_peered":"2023-08-22T00:25:18.464155+0000","last_unstale":"2023-08-22T00:25:18.468723+0000","last_undegraded":"2023-08-22T00:25:18.468723+0000","last_fullsized":"2023-08-22T00:25:18.468723+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865712+0000","last_change":"2023-08-22T00:25:18.865712+0000","last_active":"2023-08-22T00:25:18.865712+0000","last_peered":"2023-08-22T00:25:18.865712+0000","last_clean":"2023-08-22T00:25:18.865712+0000","last_became_active":"2023-08-22T00:25:18.865032+0000","last_became_peered":"2023-08-22T00:25:18.865032+0000","last_unstale":"2023-08-22T00:25:18.865712+0000","last_undegraded":"2023-08-22T00:25:18.865712+0000","last_fullsized":"2023-08-22T00:25:18.865712+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.481029+0000","last_change":"2023-08-22T00:25:18.469856+0000","last_active":"2023-08-22T00:25:18.481029+0000","last_peered":"2023-08-22T00:25:18.481029+0000","last_clean":"2023-08-22T00:25:18.481029+0000","last_became_active":"2023-08-22T00:25:18.468661+0000","last_became_peered":"2023-08-22T00:25:18.468661+0000","last_unstale":"2023-08-22T00:25:18.481029+0000","last_undegraded":"2023-08-22T00:25:18.481029+0000","last_fullsized":"2023-08-22T00:25:18.481029+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856890+0000","last_change":"2023-08-22T00:25:18.856890+0000","last_active":"2023-08-22T00:25:18.856890+0000","last_peered":"2023-08-22T00:25:18.856890+0000","last_clean":"2023-08-22T00:25:18.856890+0000","last_became_active":"2023-08-22T00:25:18.856519+0000","last_became_peered":"2023-08-22T00:25:18.856519+0000","last_unstale":"2023-08-22T00:25:18.856890+0000","last_undegraded":"2023-08-22T00:25:18.856890+0000","last_fullsized":"2023-08-22T00:25:18.856890+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857090+0000","last_change":"2023-08-22T00:25:18.467011+0000","last_active":"2023-08-22T00:25:18.857090+0000","last_peered":"2023-08-22T00:25:18.857090+0000","last_clean":"2023-08-22T00:25:18.857090+0000","last_became_active":"2023-08-22T00:25:18.466731+0000","last_became_peered":"2023-08-22T00:25:18.466731+0000","last_unstale":"2023-08-22T00:25:18.857090+0000","last_undegraded":"2023-08-22T00:25:18.857090+0000","last_fullsized":"2023-08-22T00:25:18.857090+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861155+0000","last_change":"2023-08-22T00:25:18.861155+0000","last_active":"2023-08-22T00:25:18.861155+0000","last_peered":"2023-08-22T00:25:18.861155+0000","last_clean":"2023-08-22T00:25:18.861155+0000","last_became_active":"2023-08-22T00:25:18.860870+0000","last_became_peered":"2023-08-22T00:25:18.860870+0000","last_unstale":"2023-08-22T00:25:18.861155+0000","last_undegraded":"2023-08-22T00:25:18.861155+0000","last_fullsized":"2023-08-22T00:25:18.861155+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.479263+0000","last_change":"2023-08-22T00:25:18.478338+0000","last_active":"2023-08-22T00:25:18.479263+0000","last_peered":"2023-08-22T00:25:18.479263+0000","last_clean":"2023-08-22T00:25:18.479263+0000","last_became_active":"2023-08-22T00:25:18.477990+0000","last_became_peered":"2023-08-22T00:25:18.477990+0000","last_unstale":"2023-08-22T00:25:18.479263+0000","last_undegraded":"2023-08-22T00:25:18.479263+0000","last_fullsized":"2023-08-22T00:25:18.479263+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.850535+0000","last_change":"2023-08-22T00:25:18.850535+0000","last_active":"2023-08-22T00:25:18.850535+0000","last_peered":"2023-08-22T00:25:18.850535+0000","last_clean":"2023-08-22T00:25:18.850535+0000","last_became_active":"2023-08-22T00:25:18.850249+0000","last_became_peered":"2023-08-22T00:25:18.850249+0000","last_unstale":"2023-08-22T00:25:18.850535+0000","last_undegraded":"2023-08-22T00:25:18.850535+0000","last_fullsized":"2023-08-22T00:25:18.850535+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474404+0000","last_change":"2023-08-22T00:25:18.469767+0000","last_active":"2023-08-22T00:25:18.474404+0000","last_peered":"2023-08-22T00:25:18.474404+0000","last_clean":"2023-08-22T00:25:18.474404+0000","last_became_active":"2023-08-22T00:25:18.469167+0000","last_became_peered":"2023-08-22T00:25:18.469167+0000","last_unstale":"2023-08-22T00:25:18.474404+0000","last_undegraded":"2023-08-22T00:25:18.474404+0000","last_fullsized":"2023-08-22T00:25:18.474404+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855247+0000","last_change":"2023-08-22T00:25:18.855247+0000","last_active":"2023-08-22T00:25:18.855247+0000","last_peered":"2023-08-22T00:25:18.855247+0000","last_clean":"2023-08-22T00:25:18.855247+0000","last_became_active":"2023-08-22T00:25:18.854854+0000","last_became_peered":"2023-08-22T00:25:18.854854+0000","last_unstale":"2023-08-22T00:25:18.855247+0000","last_undegraded":"2023-08-22T00:25:18.855247+0000","last_fullsized":"2023-08-22T00:25:18.855247+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483964+0000","last_change":"2023-08-22T00:25:18.477414+0000","last_active":"2023-08-22T00:25:18.483964+0000","last_peered":"2023-08-22T00:25:18.483964+0000","last_clean":"2023-08-22T00:25:18.483964+0000","last_became_active":"2023-08-22T00:25:18.476913+0000","last_became_peered":"2023-08-22T00:25:18.476913+0000","last_unstale":"2023-08-22T00:25:18.483964+0000","last_undegraded":"2023-08-22T00:25:18.483964+0000","last_fullsized":"2023-08-22T00:25:18.483964+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856028+0000","last_change":"2023-08-22T00:25:18.856028+0000","last_active":"2023-08-22T00:25:18.856028+0000","last_peered":"2023-08-22T00:25:18.856028+0000","last_clean":"2023-08-22T00:25:18.856028+0000","last_became_active":"2023-08-22T00:25:18.855748+0000","last_became_peered":"2023-08-22T00:25:18.855748+0000","last_unstale":"2023-08-22T00:25:18.856028+0000","last_undegraded":"2023-08-22T00:25:18.856028+0000","last_fullsized":"2023-08-22T00:25:18.856028+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478011+0000","last_change":"2023-08-22T00:25:18.472538+0000","last_active":"2023-08-22T00:25:18.478011+0000","last_peered":"2023-08-22T00:25:18.478011+0000","last_clean":"2023-08-22T00:25:18.478011+0000","last_became_active":"2023-08-22T00:25:18.472260+0000","last_became_peered":"2023-08-22T00:25:18.472260+0000","last_unstale":"2023-08-22T00:25:18.478011+0000","last_undegraded":"2023-08-22T00:25:18.478011+0000","last_fullsized":"2023-08-22T00:25:18.478011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865553+0000","last_change":"2023-08-22T00:25:18.865553+0000","last_active":"2023-08-22T00:25:18.865553+0000","last_peered":"2023-08-22T00:25:18.865553+0000","last_clean":"2023-08-22T00:25:18.865553+0000","last_became_active":"2023-08-22T00:25:18.865282+0000","last_became_peered":"2023-08-22T00:25:18.865282+0000","last_unstale":"2023-08-22T00:25:18.865553+0000","last_undegraded":"2023-08-22T00:25:18.865553+0000","last_fullsized":"2023-08-22T00:25:18.865553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.484919+0000","last_change":"2023-08-22T00:25:18.484585+0000","last_active":"2023-08-22T00:25:18.484919+0000","last_peered":"2023-08-22T00:25:18.484919+0000","last_clean":"2023-08-22T00:25:18.484919+0000","last_became_active":"2023-08-22T00:25:18.484306+0000","last_became_peered":"2023-08-22T00:25:18.484306+0000","last_unstale":"2023-08-22T00:25:18.484919+0000","last_undegraded":"2023-08-22T00:25:18.484919+0000","last_fullsized":"2023-08-22T00:25:18.484919+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862242+0000","last_change":"2023-08-22T00:25:18.862242+0000","last_active":"2023-08-22T00:25:18.862242+0000","last_peered":"2023-08-22T00:25:18.862242+0000","last_clean":"2023-08-22T00:25:18.862242+0000","last_became_active":"2023-08-22T00:25:18.861985+0000","last_became_peered":"2023-08-22T00:25:18.861985+0000","last_unstale":"2023-08-22T00:25:18.862242+0000","last_undegraded":"2023-08-22T00:25:18.862242+0000","last_fullsized":"2023-08-22T00:25:18.862242+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468703+0000","last_change":"2023-08-22T00:25:18.463788+0000","last_active":"2023-08-22T00:25:18.468703+0000","last_peered":"2023-08-22T00:25:18.468703+0000","last_clean":"2023-08-22T00:25:18.468703+0000","last_became_active":"2023-08-22T00:25:18.462142+0000","last_became_peered":"2023-08-22T00:25:18.462142+0000","last_unstale":"2023-08-22T00:25:18.468703+0000","last_undegraded":"2023-08-22T00:25:18.468703+0000","last_fullsized":"2023-08-22T00:25:18.468703+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852037+0000","last_change":"2023-08-22T00:25:18.852037+0000","last_active":"2023-08-22T00:25:18.852037+0000","last_peered":"2023-08-22T00:25:18.852037+0000","last_clean":"2023-08-22T00:25:18.852037+0000","last_became_active":"2023-08-22T00:25:18.851830+0000","last_became_peered":"2023-08-22T00:25:18.851830+0000","last_unstale":"2023-08-22T00:25:18.852037+0000","last_undegraded":"2023-08-22T00:25:18.852037+0000","last_fullsized":"2023-08-22T00:25:18.852037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480957+0000","last_change":"2023-08-22T00:25:18.468479+0000","last_active":"2023-08-22T00:25:18.480957+0000","last_peered":"2023-08-22T00:25:18.480957+0000","last_clean":"2023-08-22T00:25:18.480957+0000","last_became_active":"2023-08-22T00:25:18.468212+0000","last_became_peered":"2023-08-22T00:25:18.468212+0000","last_unstale":"2023-08-22T00:25:18.480957+0000","last_undegraded":"2023-08-22T00:25:18.480957+0000","last_fullsized":"2023-08-22T00:25:18.480957+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860762+0000","last_change":"2023-08-22T00:25:18.860762+0000","last_active":"2023-08-22T00:25:18.860762+0000","last_peered":"2023-08-22T00:25:18.860762+0000","last_clean":"2023-08-22T00:25:18.860762+0000","last_became_active":"2023-08-22T00:25:18.860463+0000","last_became_peered":"2023-08-22T00:25:18.860463+0000","last_unstale":"2023-08-22T00:25:18.860762+0000","last_undegraded":"2023-08-22T00:25:18.860762+0000","last_fullsized":"2023-08-22T00:25:18.860762+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855729+0000","last_change":"2023-08-22T00:25:18.472105+0000","last_active":"2023-08-22T00:25:18.855729+0000","last_peered":"2023-08-22T00:25:18.855729+0000","last_clean":"2023-08-22T00:25:18.855729+0000","last_became_active":"2023-08-22T00:25:18.471807+0000","last_became_peered":"2023-08-22T00:25:18.471807+0000","last_unstale":"2023-08-22T00:25:18.855729+0000","last_undegraded":"2023-08-22T00:25:18.855729+0000","last_fullsized":"2023-08-22T00:25:18.855729+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466519+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:18.466519+0000","last_peered":"2023-08-22T00:25:18.466519+0000","last_clean":"2023-08-22T00:25:18.466519+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:18.466519+0000","last_undegraded":"2023-08-22T00:25:18.466519+0000","last_fullsized":"2023-08-22T00:25:18.466519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855738+0000","last_change":"2023-08-22T00:25:18.855738+0000","last_active":"2023-08-22T00:25:18.855738+0000","last_peered":"2023-08-22T00:25:18.855738+0000","last_clean":"2023-08-22T00:25:18.855738+0000","last_became_active":"2023-08-22T00:25:18.855497+0000","last_became_peered":"2023-08-22T00:25:18.855497+0000","last_unstale":"2023-08-22T00:25:18.855738+0000","last_undegraded":"2023-08-22T00:25:18.855738+0000","last_fullsized":"2023-08-22T00:25:18.855738+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.473680+0000","last_change":"2023-08-22T00:25:18.467107+0000","last_active":"2023-08-22T00:25:18.473680+0000","last_peered":"2023-08-22T00:25:18.473680+0000","last_clean":"2023-08-22T00:25:18.473680+0000","last_became_active":"2023-08-22T00:25:18.466826+0000","last_became_peered":"2023-08-22T00:25:18.466826+0000","last_unstale":"2023-08-22T00:25:18.473680+0000","last_undegraded":"2023-08-22T00:25:18.473680+0000","last_fullsized":"2023-08-22T00:25:18.473680+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.452369+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:18.452369+0000","last_peered":"2023-08-22T00:25:18.452369+0000","last_clean":"2023-08-22T00:25:18.452369+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:18.452369+0000","last_undegraded":"2023-08-22T00:25:18.452369+0000","last_fullsized":"2023-08-22T00:25:18.452369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860386+0000","last_change":"2023-08-22T00:25:18.860386+0000","last_active":"2023-08-22T00:25:18.860386+0000","last_peered":"2023-08-22T00:25:18.860386+0000","last_clean":"2023-08-22T00:25:18.860386+0000","last_became_active":"2023-08-22T00:25:18.860141+0000","last_became_peered":"2023-08-22T00:25:18.860141+0000","last_unstale":"2023-08-22T00:25:18.860386+0000","last_undegraded":"2023-08-22T00:25:18.860386+0000","last_fullsized":"2023-08-22T00:25:18.860386+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480703+0000","last_change":"2023-08-22T00:25:18.473729+0000","last_active":"2023-08-22T00:25:18.480703+0000","last_peered":"2023-08-22T00:25:18.480703+0000","last_clean":"2023-08-22T00:25:18.480703+0000","last_became_active":"2023-08-22T00:25:18.473433+0000","last_became_peered":"2023-08-22T00:25:18.473433+0000","last_unstale":"2023-08-22T00:25:18.480703+0000","last_undegraded":"2023-08-22T00:25:18.480703+0000","last_fullsized":"2023-08-22T00:25:18.480703+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.456982+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:18.456982+0000","last_peered":"2023-08-22T00:25:18.456982+0000","last_clean":"2023-08-22T00:25:18.456982+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:18.456982+0000","last_undegraded":"2023-08-22T00:25:18.456982+0000","last_fullsized":"2023-08-22T00:25:18.456982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857586+0000","last_change":"2023-08-22T00:25:18.857586+0000","last_active":"2023-08-22T00:25:18.857586+0000","last_peered":"2023-08-22T00:25:18.857586+0000","last_clean":"2023-08-22T00:25:18.857586+0000","last_became_active":"2023-08-22T00:25:18.857282+0000","last_became_peered":"2023-08-22T00:25:18.857282+0000","last_unstale":"2023-08-22T00:25:18.857586+0000","last_undegraded":"2023-08-22T00:25:18.857586+0000","last_fullsized":"2023-08-22T00:25:18.857586+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843164+0000","last_change":"2023-08-22T00:25:18.479201+0000","last_active":"2023-08-22T00:25:18.843164+0000","last_peered":"2023-08-22T00:25:18.843164+0000","last_clean":"2023-08-22T00:25:18.843164+0000","last_became_active":"2023-08-22T00:25:18.478960+0000","last_became_peered":"2023-08-22T00:25:18.478960+0000","last_unstale":"2023-08-22T00:25:18.843164+0000","last_undegraded":"2023-08-22T00:25:18.843164+0000","last_fullsized":"2023-08-22T00:25:18.843164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.452628+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:18.452628+0000","last_peered":"2023-08-22T00:25:18.452628+0000","last_clean":"2023-08-22T00:25:18.452628+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:18.452628+0000","last_undegraded":"2023-08-22T00:25:18.452628+0000","last_fullsized":"2023-08-22T00:25:18.452628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470484+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:18.470484+0000","last_peered":"2023-08-22T00:25:18.470484+0000","last_clean":"2023-08-22T00:25:18.470484+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:18.470484+0000","last_undegraded":"2023-08-22T00:25:18.470484+0000","last_fullsized":"2023-08-22T00:25:18.470484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856854+0000","last_change":"2023-08-22T00:25:18.856854+0000","last_active":"2023-08-22T00:25:18.856854+0000","last_peered":"2023-08-22T00:25:18.856854+0000","last_clean":"2023-08-22T00:25:18.856854+0000","last_became_active":"2023-08-22T00:25:18.856565+0000","last_became_peered":"2023-08-22T00:25:18.856565+0000","last_unstale":"2023-08-22T00:25:18.856854+0000","last_undegraded":"2023-08-22T00:25:18.856854+0000","last_fullsized":"2023-08-22T00:25:18.856854+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861992+0000","last_change":"2023-08-22T00:25:18.456503+0000","last_active":"2023-08-22T00:25:18.861992+0000","last_peered":"2023-08-22T00:25:18.861992+0000","last_clean":"2023-08-22T00:25:18.861992+0000","last_became_active":"2023-08-22T00:25:18.455882+0000","last_became_peered":"2023-08-22T00:25:18.455882+0000","last_unstale":"2023-08-22T00:25:18.861992+0000","last_undegraded":"2023-08-22T00:25:18.861992+0000","last_fullsized":"2023-08-22T00:25:18.861992+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470392+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:18.470392+0000","last_peered":"2023-08-22T00:25:18.470392+0000","last_clean":"2023-08-22T00:25:18.470392+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:18.470392+0000","last_undegraded":"2023-08-22T00:25:18.470392+0000","last_fullsized":"2023-08-22T00:25:18.470392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856427+0000","last_change":"2023-08-22T00:25:18.856427+0000","last_active":"2023-08-22T00:25:18.856427+0000","last_peered":"2023-08-22T00:25:18.856427+0000","last_clean":"2023-08-22T00:25:18.856427+0000","last_became_active":"2023-08-22T00:25:18.855920+0000","last_became_peered":"2023-08-22T00:25:18.855920+0000","last_unstale":"2023-08-22T00:25:18.856427+0000","last_undegraded":"2023-08-22T00:25:18.856427+0000","last_fullsized":"2023-08-22T00:25:18.856427+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"151'3","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864770+0000","last_change":"2023-08-22T00:25:18.460499+0000","last_active":"2023-08-22T00:25:18.864770+0000","last_peered":"2023-08-22T00:25:18.864770+0000","last_clean":"2023-08-22T00:25:18.864770+0000","last_became_active":"2023-08-22T00:25:18.459752+0000","last_became_peered":"2023-08-22T00:25:18.459752+0000","last_unstale":"2023-08-22T00:25:18.864770+0000","last_undegraded":"2023-08-22T00:25:18.864770+0000","last_fullsized":"2023-08-22T00:25:18.864770+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.472309+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:18.472309+0000","last_peered":"2023-08-22T00:25:18.472309+0000","last_clean":"2023-08-22T00:25:18.472309+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:18.472309+0000","last_undegraded":"2023-08-22T00:25:18.472309+0000","last_fullsized":"2023-08-22T00:25:18.472309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859737+0000","last_change":"2023-08-22T00:25:18.859737+0000","last_active":"2023-08-22T00:25:18.859737+0000","last_peered":"2023-08-22T00:25:18.859737+0000","last_clean":"2023-08-22T00:25:18.859737+0000","last_became_active":"2023-08-22T00:25:18.859440+0000","last_became_peered":"2023-08-22T00:25:18.859440+0000","last_unstale":"2023-08-22T00:25:18.859737+0000","last_undegraded":"2023-08-22T00:25:18.859737+0000","last_fullsized":"2023-08-22T00:25:18.859737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.472612+0000","last_change":"2023-08-22T00:25:18.464907+0000","last_active":"2023-08-22T00:25:18.472612+0000","last_peered":"2023-08-22T00:25:18.472612+0000","last_clean":"2023-08-22T00:25:18.472612+0000","last_became_active":"2023-08-22T00:25:18.464645+0000","last_became_peered":"2023-08-22T00:25:18.464645+0000","last_unstale":"2023-08-22T00:25:18.472612+0000","last_undegraded":"2023-08-22T00:25:18.472612+0000","last_fullsized":"2023-08-22T00:25:18.472612+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468843+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:18.468843+0000","last_peered":"2023-08-22T00:25:18.468843+0000","last_clean":"2023-08-22T00:25:18.468843+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:18.468843+0000","last_undegraded":"2023-08-22T00:25:18.468843+0000","last_fullsized":"2023-08-22T00:25:18.468843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855250+0000","last_change":"2023-08-22T00:25:18.855250+0000","last_active":"2023-08-22T00:25:18.855250+0000","last_peered":"2023-08-22T00:25:18.855250+0000","last_clean":"2023-08-22T00:25:18.855250+0000","last_became_active":"2023-08-22T00:25:18.854981+0000","last_became_peered":"2023-08-22T00:25:18.854981+0000","last_unstale":"2023-08-22T00:25:18.855250+0000","last_undegraded":"2023-08-22T00:25:18.855250+0000","last_fullsized":"2023-08-22T00:25:18.855250+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.467355+0000","last_change":"2023-08-22T00:25:18.465597+0000","last_active":"2023-08-22T00:25:18.467355+0000","last_peered":"2023-08-22T00:25:18.467355+0000","last_clean":"2023-08-22T00:25:18.467355+0000","last_became_active":"2023-08-22T00:25:18.464920+0000","last_became_peered":"2023-08-22T00:25:18.464920+0000","last_unstale":"2023-08-22T00:25:18.467355+0000","last_undegraded":"2023-08-22T00:25:18.467355+0000","last_fullsized":"2023-08-22T00:25:18.467355+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.455967+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:18.455967+0000","last_peered":"2023-08-22T00:25:18.455967+0000","last_clean":"2023-08-22T00:25:18.455967+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:18.455967+0000","last_undegraded":"2023-08-22T00:25:18.455967+0000","last_fullsized":"2023-08-22T00:25:18.455967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67100000000000004,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.69199999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.68500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.66300000000000003,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69599999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.63500000000000001,"5min":0.75,"15min":0.75},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.308},"max":{"1min":0.65700000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.70299999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307096,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064744,"statfs":{"total":96636764160,"available":96322297856,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.248,"15min":0.248},"max":{"1min":0.62,"5min":0.81499999999999995,"15min":0.871},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67200000000000004,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.748}]},{"osd":3,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65600000000000003,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.35399999999999998,"15min":0.34000000000000002},"max":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.78700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.40400000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.77100000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.498}]},{"osd":7,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35399999999999998,"15min":0.371},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.38300000000000001,"15min":0.40100000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":1.2849999999999999,"15min":2.504},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36699999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.56200000000000006,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.42599999999999999},"min":{"1min":0.26800000000000002,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.66800000000000004,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42999999999999999,"15min":0.45800000000000002},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.625,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.318},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40500000000000003,"15min":0.42599999999999999},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.22},"max":{"1min":0.626,"5min":1.302,"15min":1.3280000000000001},"last":0.32900000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":1.381,"15min":2.9620000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80500000000000005,"5min":1.24,"15min":1.24},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":1.175,"15min":2.2730000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84199999999999997,"5min":1.266,"15min":2.298},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78400000000000003,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.749}]},{"osd":7,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.626,"15min":0.65200000000000002},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":1.4199999999999999,"15min":2.992},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":1.2190000000000001,"15min":2.323},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575074,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.247,"5min":0.218,"15min":0.19400000000000001},"max":{"1min":0.499,"5min":0.57399999999999995,"15min":0.76000000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.65700000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34799999999999998,"15min":0.37},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.47199999999999998,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.318},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.379,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23699999999999999},"max":{"1min":0.52700000000000002,"5min":0.58099999999999996,"15min":0.77900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.64200000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72599999999999998,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575075,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.35899999999999999},"min":{"1min":0.23899999999999999,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.44700000000000001,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38800000000000001,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.46700000000000003,"5min":1.216,"15min":1.216},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51500000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.38700000000000001},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47899999999999998,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.28199999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":0.53000000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.38,"15min":0.40899999999999997},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.753,"15min":0.753},"last":0.33600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.81100000000000005,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.42799999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.998},"last":0.501},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.871,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78100000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.35299999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47399999999999998,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.309,"5min":0.34999999999999998,"15min":0.374},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41999999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.20300000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.45700000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.42499999999999999},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.45000000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32500000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.41699999999999998,"15min":0.438},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":0.52600000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35999999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.98499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85999999999999999,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.439}]},{"osd":5,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.50700000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.95999999999999996},"last":0.46999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81000000000000005,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.47599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307108,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.432}]},{"osd":2,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.746},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.34899999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72299999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.29599999999999999},"max":{"1min":0.69899999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.32700000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66400000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40000000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.47699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.54600000000000004},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.505},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":0.81899999999999995,"15min":0.88},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.80300000000000005},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.496}]},{"osd":6,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.441},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:21.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:22.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.030+0000 7fef4b02f700 1 Processor -- start 2023-08-22T00:25:22.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.030+0000 7fef4b02f700 1 -- start start 2023-08-22T00:25:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef4b02f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fef440c64a0 0x7fef44154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef4b02f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440c4fb0 con 0x7fef440c2030 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef4b02f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440bcfc0 con 0x7fef44154260 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef4b02f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4414e7b0 con 0x7fef440c64a0 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef495cc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fef440c2030 0x7fef4415d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55038/0 (socket says 172.21.15.98:55038) 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef495cc700 1 -- 172.21.15.98:0/1198928073 learned_addr learned my addr 172.21.15.98:0/1198928073 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:22.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513567375 0 0) 0x7fef440c4fb0 con 0x7fef440c2030 2023-08-22T00:25:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef340033f0 con 0x7fef440c2030 2023-08-22T00:25:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef43fff700 1 --2- 172.21.15.98:0/1198928073 >> v2:172.21.15.118:3300/0 conn(0x7fef440c64a0 0x7fef44154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033383476 0 0) 0x7fef340033f0 con 0x7fef440c2030 2023-08-22T00:25:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 >> v2:172.21.15.118:3300/0 conn(0x7fef440c64a0 msgr2=0x7fef44154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 --2- 172.21.15.98:0/1198928073 >> v2:172.21.15.118:3300/0 conn(0x7fef440c64a0 0x7fef44154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 >> v1:172.21.15.118:6789/0 conn(0x7fef44154260 legacy=0x7fef44154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440bd2a0 con 0x7fef440c2030 2023-08-22T00:25:22.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fef3c0017f0 con 0x7fef440c2030 2023-08-22T00:25:22.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 >> v1:172.21.15.98:6789/0 conn(0x7fef440c2030 legacy=0x7fef4415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 0x7fef34003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef34004690 0x7fef34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34005000 0x7fef3400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400be80 con 0x7fef340038e0 2023-08-22T00:25:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400bff0 con 0x7fef34005000 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.031+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400c1b0 con 0x7fef34004690 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 0x7fef34003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef495cc700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34005000 0x7fef3400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef43fff700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef34004690 0x7fef34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 -- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef34004690 msgr2=0x7fef34004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef34004690 0x7fef34004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 -- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34005000 msgr2=0x7fef3400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34005000 0x7fef3400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 -- 172.21.15.98:0/1198928073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340033f0 con 0x7fef340038e0 2023-08-22T00:25:22.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef495cc700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34005000 0x7fef3400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:22.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef495cc700 1 -- 172.21.15.98:0/1198928073 reap_dead start 2023-08-22T00:25:22.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef48dcb700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 0x7fef34003d00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fef38001730 tx=0x7fef38007bb0).ready entity=mon.0 client_cookie=88977437fc4297d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38007020 con 0x7fef340038e0 2023-08-22T00:25:22.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38007180 con 0x7fef340038e0 2023-08-22T00:25:22.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef437fe700 1 -- 172.21.15.98:0/1198928073 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38007520 con 0x7fef340038e0 2023-08-22T00:25:22.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef4b02f700 1 -- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 msgr2=0x7fef34003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.032+0000 7fef4b02f700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 0x7fef34003d00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fef38001730 tx=0x7fef38007bb0).stop 2023-08-22T00:25:22.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.033+0000 7fef4b02f700 1 -- 172.21.15.98:0/1198928073 shutdown_connections 2023-08-22T00:25:22.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.033+0000 7fef4b02f700 1 --2- 172.21.15.98:0/1198928073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef340038e0 0x7fef34003d00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.033+0000 7fef4b02f700 1 -- 172.21.15.98:0/1198928073 >> 172.21.15.98:0/1198928073 conn(0x7fef440c3980 msgr2=0x7fef440c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.033+0000 7fef4b02f700 1 -- 172.21.15.98:0/1198928073 shutdown_connections 2023-08-22T00:25:22.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.033+0000 7fef4b02f700 1 -- 172.21.15.98:0/1198928073 wait complete. 2023-08-22T00:25:22.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.034+0000 7fef4b02f700 1 Processor -- start 2023-08-22T00:25:22.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.034+0000 7fef4b02f700 1 -- start start 2023-08-22T00:25:22.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef340038e0 0x7fef44164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef440a9630 0x7fef44063b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef441675e0 con 0x7fef4414c800 2023-08-22T00:25:22.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef440a6450 con 0x7fef440a9630 2023-08-22T00:25:22.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef44164800 con 0x7fef340038e0 2023-08-22T00:25:22.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39832/0 (socket says 172.21.15.98:39832) 2023-08-22T00:25:22.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 -- 172.21.15.98:0/2811830932 learned_addr learned my addr 172.21.15.98:0/2811830932 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:22.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef495cc700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef440a9630 0x7fef44063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef48dcb700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef340038e0 0x7fef44164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 -- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef340038e0 msgr2=0x7fef44164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef340038e0 0x7fef44164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 -- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef440a9630 msgr2=0x7fef44063b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef440a9630 0x7fef44063b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 -- 172.21.15.98:0/2811830932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440a5e90 con 0x7fef4414c800 2023-08-22T00:25:22.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef43fff700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fef300116c0 tx=0x7fef30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30013620 con 0x7fef4414c800 2023-08-22T00:25:22.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30013780 con 0x7fef4414c800 2023-08-22T00:25:22.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef440a6170 con 0x7fef4414c800 2023-08-22T00:25:22.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30013b20 con 0x7fef4414c800 2023-08-22T00:25:22.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.035+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef44167270 con 0x7fef4414c800 2023-08-22T00:25:22.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.036+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef44167790 con 0x7fef4414c800 2023-08-22T00:25:22.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.037+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fef30015480 con 0x7fef4414c800 2023-08-22T00:25:22.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.037+0000 7fef40ff9700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 0x7fef280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.037+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fef3007a750 con 0x7fef4414c800 2023-08-22T00:25:22.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.037+0000 7fef48dcb700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 0x7fef280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.037+0000 7fef48dcb700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 0x7fef280613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fef38000fd0 tx=0x7fef38015000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.041+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef3004b880 con 0x7fef4414c800 2023-08-22T00:25:22.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.197+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef44047480 con 0x7fef2805ef30 2023-08-22T00:25:22.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.207+0000 7fef40ff9700 1 -- 172.21.15.98:0/2811830932 <== mgr.8181 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362194 (secure 0 0 0) 0x7fef44047480 con 0x7fef2805ef30 2023-08-22T00:25:22.221 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:22.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 msgr2=0x7fef280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 0x7fef280613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fef38000fd0 tx=0x7fef38015000).stop 2023-08-22T00:25:22.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 msgr2=0x7fef440a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fef300116c0 tx=0x7fef30008040).stop 2023-08-22T00:25:22.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 shutdown_connections 2023-08-22T00:25:22.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fef2805ef30 0x7fef280613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef340038e0 0x7fef44164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef440a9630 0x7fef44063b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 --2- 172.21.15.98:0/2811830932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef4414c800 0x7fef440a9140 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.210+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 >> 172.21.15.98:0/2811830932 conn(0x7fef440c3980 msgr2=0x7fef4414d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.211+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 shutdown_connections 2023-08-22T00:25:22.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.211+0000 7fef4b02f700 1 -- 172.21.15.98:0/2811830932 wait complete. 2023-08-22T00:25:22.232 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:22.232 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:25:21.894381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432240,"kb_used_data":14512,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752542480,"statfs":{"total":773094113280,"available":770603499520,"internally_reserved":0,"allocated":14860288,"data_stored":7873624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18279,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052415"},"pg_stats":[{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859634+0000","last_change":"2023-08-22T00:25:18.859634+0000","last_active":"2023-08-22T00:25:18.859634+0000","last_peered":"2023-08-22T00:25:18.859634+0000","last_clean":"2023-08-22T00:25:18.859634+0000","last_became_active":"2023-08-22T00:25:18.859163+0000","last_became_peered":"2023-08-22T00:25:18.859163+0000","last_unstale":"2023-08-22T00:25:18.859634+0000","last_undegraded":"2023-08-22T00:25:18.859634+0000","last_fullsized":"2023-08-22T00:25:18.859634+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"151'3","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852595+0000","last_change":"2023-08-22T00:25:18.474389+0000","last_active":"2023-08-22T00:25:18.852595+0000","last_peered":"2023-08-22T00:25:18.852595+0000","last_clean":"2023-08-22T00:25:18.852595+0000","last_became_active":"2023-08-22T00:25:18.474108+0000","last_became_peered":"2023-08-22T00:25:18.474108+0000","last_unstale":"2023-08-22T00:25:18.852595+0000","last_undegraded":"2023-08-22T00:25:18.852595+0000","last_fullsized":"2023-08-22T00:25:18.852595+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857018+0000","last_change":"2023-08-22T00:25:18.857018+0000","last_active":"2023-08-22T00:25:18.857018+0000","last_peered":"2023-08-22T00:25:18.857018+0000","last_clean":"2023-08-22T00:25:18.857018+0000","last_became_active":"2023-08-22T00:25:18.856767+0000","last_became_peered":"2023-08-22T00:25:18.856767+0000","last_unstale":"2023-08-22T00:25:18.857018+0000","last_undegraded":"2023-08-22T00:25:18.857018+0000","last_fullsized":"2023-08-22T00:25:18.857018+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477714+0000","last_change":"2023-08-22T00:25:18.472415+0000","last_active":"2023-08-22T00:25:18.477714+0000","last_peered":"2023-08-22T00:25:18.477714+0000","last_clean":"2023-08-22T00:25:18.477714+0000","last_became_active":"2023-08-22T00:25:18.472158+0000","last_became_peered":"2023-08-22T00:25:18.472158+0000","last_unstale":"2023-08-22T00:25:18.477714+0000","last_undegraded":"2023-08-22T00:25:18.477714+0000","last_fullsized":"2023-08-22T00:25:18.477714+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853534+0000","last_change":"2023-08-22T00:25:18.853534+0000","last_active":"2023-08-22T00:25:18.853534+0000","last_peered":"2023-08-22T00:25:18.853534+0000","last_clean":"2023-08-22T00:25:18.853534+0000","last_became_active":"2023-08-22T00:25:18.853259+0000","last_became_peered":"2023-08-22T00:25:18.853259+0000","last_unstale":"2023-08-22T00:25:18.853534+0000","last_undegraded":"2023-08-22T00:25:18.853534+0000","last_fullsized":"2023-08-22T00:25:18.853534+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468759+0000","last_change":"2023-08-22T00:25:18.463489+0000","last_active":"2023-08-22T00:25:18.468759+0000","last_peered":"2023-08-22T00:25:18.468759+0000","last_clean":"2023-08-22T00:25:18.468759+0000","last_became_active":"2023-08-22T00:25:18.462227+0000","last_became_peered":"2023-08-22T00:25:18.462227+0000","last_unstale":"2023-08-22T00:25:18.468759+0000","last_undegraded":"2023-08-22T00:25:18.468759+0000","last_fullsized":"2023-08-22T00:25:18.468759+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855126+0000","last_change":"2023-08-22T00:25:18.855126+0000","last_active":"2023-08-22T00:25:18.855126+0000","last_peered":"2023-08-22T00:25:18.855126+0000","last_clean":"2023-08-22T00:25:18.855126+0000","last_became_active":"2023-08-22T00:25:18.854853+0000","last_became_peered":"2023-08-22T00:25:18.854853+0000","last_unstale":"2023-08-22T00:25:18.855126+0000","last_undegraded":"2023-08-22T00:25:18.855126+0000","last_fullsized":"2023-08-22T00:25:18.855126+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3c","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856593+0000","last_change":"2023-08-22T00:25:18.478254+0000","last_active":"2023-08-22T00:25:18.856593+0000","last_peered":"2023-08-22T00:25:18.856593+0000","last_clean":"2023-08-22T00:25:18.856593+0000","last_became_active":"2023-08-22T00:25:18.477963+0000","last_became_peered":"2023-08-22T00:25:18.477963+0000","last_unstale":"2023-08-22T00:25:18.856593+0000","last_undegraded":"2023-08-22T00:25:18.856593+0000","last_fullsized":"2023-08-22T00:25:18.856593+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855744+0000","last_change":"2023-08-22T00:25:18.855744+0000","last_active":"2023-08-22T00:25:18.855744+0000","last_peered":"2023-08-22T00:25:18.855744+0000","last_clean":"2023-08-22T00:25:18.855744+0000","last_became_active":"2023-08-22T00:25:18.855446+0000","last_became_peered":"2023-08-22T00:25:18.855446+0000","last_unstale":"2023-08-22T00:25:18.855744+0000","last_undegraded":"2023-08-22T00:25:18.855744+0000","last_fullsized":"2023-08-22T00:25:18.855744+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.839300+0000","last_change":"2023-08-22T00:25:18.462573+0000","last_active":"2023-08-22T00:25:18.839300+0000","last_peered":"2023-08-22T00:25:18.839300+0000","last_clean":"2023-08-22T00:25:18.839300+0000","last_became_active":"2023-08-22T00:25:18.462312+0000","last_became_peered":"2023-08-22T00:25:18.462312+0000","last_unstale":"2023-08-22T00:25:18.839300+0000","last_undegraded":"2023-08-22T00:25:18.839300+0000","last_fullsized":"2023-08-22T00:25:18.839300+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853024+0000","last_change":"2023-08-22T00:25:18.853024+0000","last_active":"2023-08-22T00:25:18.853024+0000","last_peered":"2023-08-22T00:25:18.853024+0000","last_clean":"2023-08-22T00:25:18.853024+0000","last_became_active":"2023-08-22T00:25:18.852754+0000","last_became_peered":"2023-08-22T00:25:18.852754+0000","last_unstale":"2023-08-22T00:25:18.853024+0000","last_undegraded":"2023-08-22T00:25:18.853024+0000","last_fullsized":"2023-08-22T00:25:18.853024+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3a","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.838342+0000","last_change":"2023-08-22T00:25:18.476770+0000","last_active":"2023-08-22T00:25:18.838342+0000","last_peered":"2023-08-22T00:25:18.838342+0000","last_clean":"2023-08-22T00:25:18.838342+0000","last_became_active":"2023-08-22T00:25:18.474096+0000","last_became_peered":"2023-08-22T00:25:18.474096+0000","last_unstale":"2023-08-22T00:25:18.838342+0000","last_undegraded":"2023-08-22T00:25:18.838342+0000","last_fullsized":"2023-08-22T00:25:18.838342+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862309+0000","last_change":"2023-08-22T00:25:18.862309+0000","last_active":"2023-08-22T00:25:18.862309+0000","last_peered":"2023-08-22T00:25:18.862309+0000","last_clean":"2023-08-22T00:25:18.862309+0000","last_became_active":"2023-08-22T00:25:18.862020+0000","last_became_peered":"2023-08-22T00:25:18.862020+0000","last_unstale":"2023-08-22T00:25:18.862309+0000","last_undegraded":"2023-08-22T00:25:18.862309+0000","last_fullsized":"2023-08-22T00:25:18.862309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483764+0000","last_change":"2023-08-22T00:25:18.470544+0000","last_active":"2023-08-22T00:25:18.483764+0000","last_peered":"2023-08-22T00:25:18.483764+0000","last_clean":"2023-08-22T00:25:18.483764+0000","last_became_active":"2023-08-22T00:25:18.470255+0000","last_became_peered":"2023-08-22T00:25:18.470255+0000","last_unstale":"2023-08-22T00:25:18.483764+0000","last_undegraded":"2023-08-22T00:25:18.483764+0000","last_fullsized":"2023-08-22T00:25:18.483764+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857917+0000","last_change":"2023-08-22T00:25:18.857917+0000","last_active":"2023-08-22T00:25:18.857917+0000","last_peered":"2023-08-22T00:25:18.857917+0000","last_clean":"2023-08-22T00:25:18.857917+0000","last_became_active":"2023-08-22T00:25:18.857618+0000","last_became_peered":"2023-08-22T00:25:18.857618+0000","last_unstale":"2023-08-22T00:25:18.857917+0000","last_undegraded":"2023-08-22T00:25:18.857917+0000","last_fullsized":"2023-08-22T00:25:18.857917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470394+0000","last_change":"2023-08-22T00:25:18.465203+0000","last_active":"2023-08-22T00:25:18.470394+0000","last_peered":"2023-08-22T00:25:18.470394+0000","last_clean":"2023-08-22T00:25:18.470394+0000","last_became_active":"2023-08-22T00:25:18.461943+0000","last_became_peered":"2023-08-22T00:25:18.461943+0000","last_unstale":"2023-08-22T00:25:18.470394+0000","last_undegraded":"2023-08-22T00:25:18.470394+0000","last_fullsized":"2023-08-22T00:25:18.470394+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859468+0000","last_change":"2023-08-22T00:25:18.859468+0000","last_active":"2023-08-22T00:25:18.859468+0000","last_peered":"2023-08-22T00:25:18.859468+0000","last_clean":"2023-08-22T00:25:18.859468+0000","last_became_active":"2023-08-22T00:25:18.858790+0000","last_became_peered":"2023-08-22T00:25:18.858790+0000","last_unstale":"2023-08-22T00:25:18.859468+0000","last_undegraded":"2023-08-22T00:25:18.859468+0000","last_fullsized":"2023-08-22T00:25:18.859468+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.482070+0000","last_change":"2023-08-22T00:25:18.481574+0000","last_active":"2023-08-22T00:25:18.482070+0000","last_peered":"2023-08-22T00:25:18.482070+0000","last_clean":"2023-08-22T00:25:18.482070+0000","last_became_active":"2023-08-22T00:25:18.481298+0000","last_became_peered":"2023-08-22T00:25:18.481298+0000","last_unstale":"2023-08-22T00:25:18.482070+0000","last_undegraded":"2023-08-22T00:25:18.482070+0000","last_fullsized":"2023-08-22T00:25:18.482070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856680+0000","last_change":"2023-08-22T00:25:18.856680+0000","last_active":"2023-08-22T00:25:18.856680+0000","last_peered":"2023-08-22T00:25:18.856680+0000","last_clean":"2023-08-22T00:25:18.856680+0000","last_became_active":"2023-08-22T00:25:18.856377+0000","last_became_peered":"2023-08-22T00:25:18.856377+0000","last_unstale":"2023-08-22T00:25:18.856680+0000","last_undegraded":"2023-08-22T00:25:18.856680+0000","last_fullsized":"2023-08-22T00:25:18.856680+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480763+0000","last_change":"2023-08-22T00:25:18.474329+0000","last_active":"2023-08-22T00:25:18.480763+0000","last_peered":"2023-08-22T00:25:18.480763+0000","last_clean":"2023-08-22T00:25:18.480763+0000","last_became_active":"2023-08-22T00:25:18.474008+0000","last_became_peered":"2023-08-22T00:25:18.474008+0000","last_unstale":"2023-08-22T00:25:18.480763+0000","last_undegraded":"2023-08-22T00:25:18.480763+0000","last_fullsized":"2023-08-22T00:25:18.480763+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862399+0000","last_change":"2023-08-22T00:25:18.862399+0000","last_active":"2023-08-22T00:25:18.862399+0000","last_peered":"2023-08-22T00:25:18.862399+0000","last_clean":"2023-08-22T00:25:18.862399+0000","last_became_active":"2023-08-22T00:25:18.862117+0000","last_became_peered":"2023-08-22T00:25:18.862117+0000","last_unstale":"2023-08-22T00:25:18.862399+0000","last_undegraded":"2023-08-22T00:25:18.862399+0000","last_fullsized":"2023-08-22T00:25:18.862399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466970+0000","last_change":"2023-08-22T00:25:18.465216+0000","last_active":"2023-08-22T00:25:18.466970+0000","last_peered":"2023-08-22T00:25:18.466970+0000","last_clean":"2023-08-22T00:25:18.466970+0000","last_became_active":"2023-08-22T00:25:18.464938+0000","last_became_peered":"2023-08-22T00:25:18.464938+0000","last_unstale":"2023-08-22T00:25:18.466970+0000","last_undegraded":"2023-08-22T00:25:18.466970+0000","last_fullsized":"2023-08-22T00:25:18.466970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853402+0000","last_change":"2023-08-22T00:25:18.853402+0000","last_active":"2023-08-22T00:25:18.853402+0000","last_peered":"2023-08-22T00:25:18.853402+0000","last_clean":"2023-08-22T00:25:18.853402+0000","last_became_active":"2023-08-22T00:25:18.852954+0000","last_became_peered":"2023-08-22T00:25:18.852954+0000","last_unstale":"2023-08-22T00:25:18.853402+0000","last_undegraded":"2023-08-22T00:25:18.853402+0000","last_fullsized":"2023-08-22T00:25:18.853402+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.34","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857876+0000","last_change":"2023-08-22T00:25:18.471218+0000","last_active":"2023-08-22T00:25:18.857876+0000","last_peered":"2023-08-22T00:25:18.857876+0000","last_clean":"2023-08-22T00:25:18.857876+0000","last_became_active":"2023-08-22T00:25:18.470638+0000","last_became_peered":"2023-08-22T00:25:18.470638+0000","last_unstale":"2023-08-22T00:25:18.857876+0000","last_undegraded":"2023-08-22T00:25:18.857876+0000","last_fullsized":"2023-08-22T00:25:18.857876+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863536+0000","last_change":"2023-08-22T00:25:18.863536+0000","last_active":"2023-08-22T00:25:18.863536+0000","last_peered":"2023-08-22T00:25:18.863536+0000","last_clean":"2023-08-22T00:25:18.863536+0000","last_became_active":"2023-08-22T00:25:18.863266+0000","last_became_peered":"2023-08-22T00:25:18.863266+0000","last_unstale":"2023-08-22T00:25:18.863536+0000","last_undegraded":"2023-08-22T00:25:18.863536+0000","last_fullsized":"2023-08-22T00:25:18.863536+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843734+0000","last_change":"2023-08-22T00:25:18.471562+0000","last_active":"2023-08-22T00:25:18.843734+0000","last_peered":"2023-08-22T00:25:18.843734+0000","last_clean":"2023-08-22T00:25:18.843734+0000","last_became_active":"2023-08-22T00:25:18.471273+0000","last_became_peered":"2023-08-22T00:25:18.471273+0000","last_unstale":"2023-08-22T00:25:18.843734+0000","last_undegraded":"2023-08-22T00:25:18.843734+0000","last_fullsized":"2023-08-22T00:25:18.843734+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851464+0000","last_change":"2023-08-22T00:25:18.851464+0000","last_active":"2023-08-22T00:25:18.851464+0000","last_peered":"2023-08-22T00:25:18.851464+0000","last_clean":"2023-08-22T00:25:18.851464+0000","last_became_active":"2023-08-22T00:25:18.848996+0000","last_became_peered":"2023-08-22T00:25:18.848996+0000","last_unstale":"2023-08-22T00:25:18.851464+0000","last_undegraded":"2023-08-22T00:25:18.851464+0000","last_fullsized":"2023-08-22T00:25:18.851464+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.469428+0000","last_change":"2023-08-22T00:25:18.464568+0000","last_active":"2023-08-22T00:25:18.469428+0000","last_peered":"2023-08-22T00:25:18.469428+0000","last_clean":"2023-08-22T00:25:18.469428+0000","last_became_active":"2023-08-22T00:25:18.462536+0000","last_became_peered":"2023-08-22T00:25:18.462536+0000","last_unstale":"2023-08-22T00:25:18.469428+0000","last_undegraded":"2023-08-22T00:25:18.469428+0000","last_fullsized":"2023-08-22T00:25:18.469428+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865493+0000","last_change":"2023-08-22T00:25:18.865493+0000","last_active":"2023-08-22T00:25:18.865493+0000","last_peered":"2023-08-22T00:25:18.865493+0000","last_clean":"2023-08-22T00:25:18.865493+0000","last_became_active":"2023-08-22T00:25:18.864545+0000","last_became_peered":"2023-08-22T00:25:18.864545+0000","last_unstale":"2023-08-22T00:25:18.865493+0000","last_undegraded":"2023-08-22T00:25:18.865493+0000","last_fullsized":"2023-08-22T00:25:18.865493+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466858+0000","last_change":"2023-08-22T00:25:18.465150+0000","last_active":"2023-08-22T00:25:18.466858+0000","last_peered":"2023-08-22T00:25:18.466858+0000","last_clean":"2023-08-22T00:25:18.466858+0000","last_became_active":"2023-08-22T00:25:18.464853+0000","last_became_peered":"2023-08-22T00:25:18.464853+0000","last_unstale":"2023-08-22T00:25:18.466858+0000","last_undegraded":"2023-08-22T00:25:18.466858+0000","last_fullsized":"2023-08-22T00:25:18.466858+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860560+0000","last_change":"2023-08-22T00:25:18.860560+0000","last_active":"2023-08-22T00:25:18.860560+0000","last_peered":"2023-08-22T00:25:18.860560+0000","last_clean":"2023-08-22T00:25:18.860560+0000","last_became_active":"2023-08-22T00:25:18.860296+0000","last_became_peered":"2023-08-22T00:25:18.860296+0000","last_unstale":"2023-08-22T00:25:18.860560+0000","last_undegraded":"2023-08-22T00:25:18.860560+0000","last_fullsized":"2023-08-22T00:25:18.860560+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.30","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864998+0000","last_change":"2023-08-22T00:25:18.469548+0000","last_active":"2023-08-22T00:25:18.864998+0000","last_peered":"2023-08-22T00:25:18.864998+0000","last_clean":"2023-08-22T00:25:18.864998+0000","last_became_active":"2023-08-22T00:25:18.469272+0000","last_became_peered":"2023-08-22T00:25:18.469272+0000","last_unstale":"2023-08-22T00:25:18.864998+0000","last_undegraded":"2023-08-22T00:25:18.864998+0000","last_fullsized":"2023-08-22T00:25:18.864998+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858623+0000","last_change":"2023-08-22T00:25:18.858623+0000","last_active":"2023-08-22T00:25:18.858623+0000","last_peered":"2023-08-22T00:25:18.858623+0000","last_clean":"2023-08-22T00:25:18.858623+0000","last_became_active":"2023-08-22T00:25:18.858371+0000","last_became_peered":"2023-08-22T00:25:18.858371+0000","last_unstale":"2023-08-22T00:25:18.858623+0000","last_undegraded":"2023-08-22T00:25:18.858623+0000","last_fullsized":"2023-08-22T00:25:18.858623+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474316+0000","last_change":"2023-08-22T00:25:18.470476+0000","last_active":"2023-08-22T00:25:18.474316+0000","last_peered":"2023-08-22T00:25:18.474316+0000","last_clean":"2023-08-22T00:25:18.474316+0000","last_became_active":"2023-08-22T00:25:18.470178+0000","last_became_peered":"2023-08-22T00:25:18.470178+0000","last_unstale":"2023-08-22T00:25:18.474316+0000","last_undegraded":"2023-08-22T00:25:18.474316+0000","last_fullsized":"2023-08-22T00:25:18.474316+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856936+0000","last_change":"2023-08-22T00:25:18.856936+0000","last_active":"2023-08-22T00:25:18.856936+0000","last_peered":"2023-08-22T00:25:18.856936+0000","last_clean":"2023-08-22T00:25:18.856936+0000","last_became_active":"2023-08-22T00:25:18.856659+0000","last_became_peered":"2023-08-22T00:25:18.856659+0000","last_unstale":"2023-08-22T00:25:18.856936+0000","last_undegraded":"2023-08-22T00:25:18.856936+0000","last_fullsized":"2023-08-22T00:25:18.856936+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476352+0000","last_change":"2023-08-22T00:25:18.471244+0000","last_active":"2023-08-22T00:25:18.476352+0000","last_peered":"2023-08-22T00:25:18.476352+0000","last_clean":"2023-08-22T00:25:18.476352+0000","last_became_active":"2023-08-22T00:25:18.470967+0000","last_became_peered":"2023-08-22T00:25:18.470967+0000","last_unstale":"2023-08-22T00:25:18.476352+0000","last_undegraded":"2023-08-22T00:25:18.476352+0000","last_fullsized":"2023-08-22T00:25:18.476352+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853936+0000","last_change":"2023-08-22T00:25:18.853936+0000","last_active":"2023-08-22T00:25:18.853936+0000","last_peered":"2023-08-22T00:25:18.853936+0000","last_clean":"2023-08-22T00:25:18.853936+0000","last_became_active":"2023-08-22T00:25:18.853619+0000","last_became_peered":"2023-08-22T00:25:18.853619+0000","last_unstale":"2023-08-22T00:25:18.853936+0000","last_undegraded":"2023-08-22T00:25:18.853936+0000","last_fullsized":"2023-08-22T00:25:18.853936+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.841706+0000","last_change":"2023-08-22T00:25:18.476070+0000","last_active":"2023-08-22T00:25:18.841706+0000","last_peered":"2023-08-22T00:25:18.841706+0000","last_clean":"2023-08-22T00:25:18.841706+0000","last_became_active":"2023-08-22T00:25:18.473014+0000","last_became_peered":"2023-08-22T00:25:18.473014+0000","last_unstale":"2023-08-22T00:25:18.841706+0000","last_undegraded":"2023-08-22T00:25:18.841706+0000","last_fullsized":"2023-08-22T00:25:18.841706+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851424+0000","last_change":"2023-08-22T00:25:18.851424+0000","last_active":"2023-08-22T00:25:18.851424+0000","last_peered":"2023-08-22T00:25:18.851424+0000","last_clean":"2023-08-22T00:25:18.851424+0000","last_became_active":"2023-08-22T00:25:18.851157+0000","last_became_peered":"2023-08-22T00:25:18.851157+0000","last_unstale":"2023-08-22T00:25:18.851424+0000","last_undegraded":"2023-08-22T00:25:18.851424+0000","last_fullsized":"2023-08-22T00:25:18.851424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480340+0000","last_change":"2023-08-22T00:25:18.472381+0000","last_active":"2023-08-22T00:25:18.480340+0000","last_peered":"2023-08-22T00:25:18.480340+0000","last_clean":"2023-08-22T00:25:18.480340+0000","last_became_active":"2023-08-22T00:25:18.472124+0000","last_became_peered":"2023-08-22T00:25:18.472124+0000","last_unstale":"2023-08-22T00:25:18.480340+0000","last_undegraded":"2023-08-22T00:25:18.480340+0000","last_fullsized":"2023-08-22T00:25:18.480340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853273+0000","last_change":"2023-08-22T00:25:18.853273+0000","last_active":"2023-08-22T00:25:18.853273+0000","last_peered":"2023-08-22T00:25:18.853273+0000","last_clean":"2023-08-22T00:25:18.853273+0000","last_became_active":"2023-08-22T00:25:18.852979+0000","last_became_peered":"2023-08-22T00:25:18.852979+0000","last_unstale":"2023-08-22T00:25:18.853273+0000","last_undegraded":"2023-08-22T00:25:18.853273+0000","last_fullsized":"2023-08-22T00:25:18.853273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843068+0000","last_change":"2023-08-22T00:25:18.480958+0000","last_active":"2023-08-22T00:25:18.843068+0000","last_peered":"2023-08-22T00:25:18.843068+0000","last_clean":"2023-08-22T00:25:18.843068+0000","last_became_active":"2023-08-22T00:25:18.480660+0000","last_became_peered":"2023-08-22T00:25:18.480660+0000","last_unstale":"2023-08-22T00:25:18.843068+0000","last_undegraded":"2023-08-22T00:25:18.843068+0000","last_fullsized":"2023-08-22T00:25:18.843068+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854160+0000","last_change":"2023-08-22T00:25:18.854160+0000","last_active":"2023-08-22T00:25:18.854160+0000","last_peered":"2023-08-22T00:25:18.854160+0000","last_clean":"2023-08-22T00:25:18.854160+0000","last_became_active":"2023-08-22T00:25:18.852443+0000","last_became_peered":"2023-08-22T00:25:18.852443+0000","last_unstale":"2023-08-22T00:25:18.854160+0000","last_undegraded":"2023-08-22T00:25:18.854160+0000","last_fullsized":"2023-08-22T00:25:18.854160+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477485+0000","last_change":"2023-08-22T00:25:18.473695+0000","last_active":"2023-08-22T00:25:18.477485+0000","last_peered":"2023-08-22T00:25:18.477485+0000","last_clean":"2023-08-22T00:25:18.477485+0000","last_became_active":"2023-08-22T00:25:18.473358+0000","last_became_peered":"2023-08-22T00:25:18.473358+0000","last_unstale":"2023-08-22T00:25:18.477485+0000","last_undegraded":"2023-08-22T00:25:18.477485+0000","last_fullsized":"2023-08-22T00:25:18.477485+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851171+0000","last_change":"2023-08-22T00:25:18.851171+0000","last_active":"2023-08-22T00:25:18.851171+0000","last_peered":"2023-08-22T00:25:18.851171+0000","last_clean":"2023-08-22T00:25:18.851171+0000","last_became_active":"2023-08-22T00:25:18.850892+0000","last_became_peered":"2023-08-22T00:25:18.850892+0000","last_unstale":"2023-08-22T00:25:18.851171+0000","last_undegraded":"2023-08-22T00:25:18.851171+0000","last_fullsized":"2023-08-22T00:25:18.851171+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.479316+0000","last_change":"2023-08-22T00:25:18.478544+0000","last_active":"2023-08-22T00:25:18.479316+0000","last_peered":"2023-08-22T00:25:18.479316+0000","last_clean":"2023-08-22T00:25:18.479316+0000","last_became_active":"2023-08-22T00:25:18.478225+0000","last_became_peered":"2023-08-22T00:25:18.478225+0000","last_unstale":"2023-08-22T00:25:18.479316+0000","last_undegraded":"2023-08-22T00:25:18.479316+0000","last_fullsized":"2023-08-22T00:25:18.479316+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857064+0000","last_change":"2023-08-22T00:25:18.857064+0000","last_active":"2023-08-22T00:25:18.857064+0000","last_peered":"2023-08-22T00:25:18.857064+0000","last_clean":"2023-08-22T00:25:18.857064+0000","last_became_active":"2023-08-22T00:25:18.856798+0000","last_became_peered":"2023-08-22T00:25:18.856798+0000","last_unstale":"2023-08-22T00:25:18.857064+0000","last_undegraded":"2023-08-22T00:25:18.857064+0000","last_fullsized":"2023-08-22T00:25:18.857064+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476394+0000","last_change":"2023-08-22T00:25:18.473824+0000","last_active":"2023-08-22T00:25:18.476394+0000","last_peered":"2023-08-22T00:25:18.476394+0000","last_clean":"2023-08-22T00:25:18.476394+0000","last_became_active":"2023-08-22T00:25:18.473538+0000","last_became_peered":"2023-08-22T00:25:18.473538+0000","last_unstale":"2023-08-22T00:25:18.476394+0000","last_undegraded":"2023-08-22T00:25:18.476394+0000","last_fullsized":"2023-08-22T00:25:18.476394+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863898+0000","last_change":"2023-08-22T00:25:18.863898+0000","last_active":"2023-08-22T00:25:18.863898+0000","last_peered":"2023-08-22T00:25:18.863898+0000","last_clean":"2023-08-22T00:25:18.863898+0000","last_became_active":"2023-08-22T00:25:18.863666+0000","last_became_peered":"2023-08-22T00:25:18.863666+0000","last_unstale":"2023-08-22T00:25:18.863898+0000","last_undegraded":"2023-08-22T00:25:18.863898+0000","last_fullsized":"2023-08-22T00:25:18.863898+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.467376+0000","last_change":"2023-08-22T00:25:18.465824+0000","last_active":"2023-08-22T00:25:18.467376+0000","last_peered":"2023-08-22T00:25:18.467376+0000","last_clean":"2023-08-22T00:25:18.467376+0000","last_became_active":"2023-08-22T00:25:18.465313+0000","last_became_peered":"2023-08-22T00:25:18.465313+0000","last_unstale":"2023-08-22T00:25:18.467376+0000","last_undegraded":"2023-08-22T00:25:18.467376+0000","last_fullsized":"2023-08-22T00:25:18.467376+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852028+0000","last_change":"2023-08-22T00:25:18.852028+0000","last_active":"2023-08-22T00:25:18.852028+0000","last_peered":"2023-08-22T00:25:18.852028+0000","last_clean":"2023-08-22T00:25:18.852028+0000","last_became_active":"2023-08-22T00:25:18.851765+0000","last_became_peered":"2023-08-22T00:25:18.851765+0000","last_unstale":"2023-08-22T00:25:18.852028+0000","last_undegraded":"2023-08-22T00:25:18.852028+0000","last_fullsized":"2023-08-22T00:25:18.852028+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480550+0000","last_change":"2023-08-22T00:25:18.475084+0000","last_active":"2023-08-22T00:25:18.480550+0000","last_peered":"2023-08-22T00:25:18.480550+0000","last_clean":"2023-08-22T00:25:18.480550+0000","last_became_active":"2023-08-22T00:25:18.474787+0000","last_became_peered":"2023-08-22T00:25:18.474787+0000","last_unstale":"2023-08-22T00:25:18.480550+0000","last_undegraded":"2023-08-22T00:25:18.480550+0000","last_fullsized":"2023-08-22T00:25:18.480550+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863730+0000","last_change":"2023-08-22T00:25:18.863730+0000","last_active":"2023-08-22T00:25:18.863730+0000","last_peered":"2023-08-22T00:25:18.863730+0000","last_clean":"2023-08-22T00:25:18.863730+0000","last_became_active":"2023-08-22T00:25:18.861781+0000","last_became_peered":"2023-08-22T00:25:18.861781+0000","last_unstale":"2023-08-22T00:25:18.863730+0000","last_undegraded":"2023-08-22T00:25:18.863730+0000","last_fullsized":"2023-08-22T00:25:18.863730+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477717+0000","last_change":"2023-08-22T00:25:18.472772+0000","last_active":"2023-08-22T00:25:18.477717+0000","last_peered":"2023-08-22T00:25:18.477717+0000","last_clean":"2023-08-22T00:25:18.477717+0000","last_became_active":"2023-08-22T00:25:18.471692+0000","last_became_peered":"2023-08-22T00:25:18.471692+0000","last_unstale":"2023-08-22T00:25:18.477717+0000","last_undegraded":"2023-08-22T00:25:18.477717+0000","last_fullsized":"2023-08-22T00:25:18.477717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852289+0000","last_change":"2023-08-22T00:25:18.852289+0000","last_active":"2023-08-22T00:25:18.852289+0000","last_peered":"2023-08-22T00:25:18.852289+0000","last_clean":"2023-08-22T00:25:18.852289+0000","last_became_active":"2023-08-22T00:25:18.851986+0000","last_became_peered":"2023-08-22T00:25:18.851986+0000","last_unstale":"2023-08-22T00:25:18.852289+0000","last_undegraded":"2023-08-22T00:25:18.852289+0000","last_fullsized":"2023-08-22T00:25:18.852289+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483791+0000","last_change":"2023-08-22T00:25:18.471031+0000","last_active":"2023-08-22T00:25:18.483791+0000","last_peered":"2023-08-22T00:25:18.483791+0000","last_clean":"2023-08-22T00:25:18.483791+0000","last_became_active":"2023-08-22T00:25:18.470357+0000","last_became_peered":"2023-08-22T00:25:18.470357+0000","last_unstale":"2023-08-22T00:25:18.483791+0000","last_undegraded":"2023-08-22T00:25:18.483791+0000","last_fullsized":"2023-08-22T00:25:18.483791+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860744+0000","last_change":"2023-08-22T00:25:18.860744+0000","last_active":"2023-08-22T00:25:18.860744+0000","last_peered":"2023-08-22T00:25:18.860744+0000","last_clean":"2023-08-22T00:25:18.860744+0000","last_became_active":"2023-08-22T00:25:18.860008+0000","last_became_peered":"2023-08-22T00:25:18.860008+0000","last_unstale":"2023-08-22T00:25:18.860744+0000","last_undegraded":"2023-08-22T00:25:18.860744+0000","last_fullsized":"2023-08-22T00:25:18.860744+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476535+0000","last_change":"2023-08-22T00:25:18.467988+0000","last_active":"2023-08-22T00:25:18.476535+0000","last_peered":"2023-08-22T00:25:18.476535+0000","last_clean":"2023-08-22T00:25:18.476535+0000","last_became_active":"2023-08-22T00:25:18.467756+0000","last_became_peered":"2023-08-22T00:25:18.467756+0000","last_unstale":"2023-08-22T00:25:18.476535+0000","last_undegraded":"2023-08-22T00:25:18.476535+0000","last_fullsized":"2023-08-22T00:25:18.476535+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860473+0000","last_change":"2023-08-22T00:25:18.860473+0000","last_active":"2023-08-22T00:25:18.860473+0000","last_peered":"2023-08-22T00:25:18.860473+0000","last_clean":"2023-08-22T00:25:18.860473+0000","last_became_active":"2023-08-22T00:25:18.860188+0000","last_became_peered":"2023-08-22T00:25:18.860188+0000","last_unstale":"2023-08-22T00:25:18.860473+0000","last_undegraded":"2023-08-22T00:25:18.860473+0000","last_fullsized":"2023-08-22T00:25:18.860473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474977+0000","last_change":"2023-08-22T00:25:18.469752+0000","last_active":"2023-08-22T00:25:18.474977+0000","last_peered":"2023-08-22T00:25:18.474977+0000","last_clean":"2023-08-22T00:25:18.474977+0000","last_became_active":"2023-08-22T00:25:18.469243+0000","last_became_peered":"2023-08-22T00:25:18.469243+0000","last_unstale":"2023-08-22T00:25:18.474977+0000","last_undegraded":"2023-08-22T00:25:18.474977+0000","last_fullsized":"2023-08-22T00:25:18.474977+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861628+0000","last_change":"2023-08-22T00:25:18.861628+0000","last_active":"2023-08-22T00:25:18.861628+0000","last_peered":"2023-08-22T00:25:18.861628+0000","last_clean":"2023-08-22T00:25:18.861628+0000","last_became_active":"2023-08-22T00:25:18.861344+0000","last_became_peered":"2023-08-22T00:25:18.861344+0000","last_unstale":"2023-08-22T00:25:18.861628+0000","last_undegraded":"2023-08-22T00:25:18.861628+0000","last_fullsized":"2023-08-22T00:25:18.861628+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.465956+0000","last_change":"2023-08-22T00:25:18.464138+0000","last_active":"2023-08-22T00:25:18.465956+0000","last_peered":"2023-08-22T00:25:18.465956+0000","last_clean":"2023-08-22T00:25:18.465956+0000","last_became_active":"2023-08-22T00:25:18.463862+0000","last_became_peered":"2023-08-22T00:25:18.463862+0000","last_unstale":"2023-08-22T00:25:18.465956+0000","last_undegraded":"2023-08-22T00:25:18.465956+0000","last_fullsized":"2023-08-22T00:25:18.465956+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865559+0000","last_change":"2023-08-22T00:25:18.865559+0000","last_active":"2023-08-22T00:25:18.865559+0000","last_peered":"2023-08-22T00:25:18.865559+0000","last_clean":"2023-08-22T00:25:18.865559+0000","last_became_active":"2023-08-22T00:25:18.865318+0000","last_became_peered":"2023-08-22T00:25:18.865318+0000","last_unstale":"2023-08-22T00:25:18.865559+0000","last_undegraded":"2023-08-22T00:25:18.865559+0000","last_fullsized":"2023-08-22T00:25:18.865559+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.476377+0000","last_change":"2023-08-22T00:25:18.473716+0000","last_active":"2023-08-22T00:25:18.476377+0000","last_peered":"2023-08-22T00:25:18.476377+0000","last_clean":"2023-08-22T00:25:18.476377+0000","last_became_active":"2023-08-22T00:25:18.473392+0000","last_became_peered":"2023-08-22T00:25:18.473392+0000","last_unstale":"2023-08-22T00:25:18.476377+0000","last_undegraded":"2023-08-22T00:25:18.476377+0000","last_fullsized":"2023-08-22T00:25:18.476377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861672+0000","last_change":"2023-08-22T00:25:18.861672+0000","last_active":"2023-08-22T00:25:18.861672+0000","last_peered":"2023-08-22T00:25:18.861672+0000","last_clean":"2023-08-22T00:25:18.861672+0000","last_became_active":"2023-08-22T00:25:18.861453+0000","last_became_peered":"2023-08-22T00:25:18.861453+0000","last_unstale":"2023-08-22T00:25:18.861672+0000","last_undegraded":"2023-08-22T00:25:18.861672+0000","last_fullsized":"2023-08-22T00:25:18.861672+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843677+0000","last_change":"2023-08-22T00:25:18.481009+0000","last_active":"2023-08-22T00:25:18.843677+0000","last_peered":"2023-08-22T00:25:18.843677+0000","last_clean":"2023-08-22T00:25:18.843677+0000","last_became_active":"2023-08-22T00:25:18.480729+0000","last_became_peered":"2023-08-22T00:25:18.480729+0000","last_unstale":"2023-08-22T00:25:18.843677+0000","last_undegraded":"2023-08-22T00:25:18.843677+0000","last_fullsized":"2023-08-22T00:25:18.843677+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858614+0000","last_change":"2023-08-22T00:25:18.858614+0000","last_active":"2023-08-22T00:25:18.858614+0000","last_peered":"2023-08-22T00:25:18.858614+0000","last_clean":"2023-08-22T00:25:18.858614+0000","last_became_active":"2023-08-22T00:25:18.858353+0000","last_became_peered":"2023-08-22T00:25:18.858353+0000","last_unstale":"2023-08-22T00:25:18.858614+0000","last_undegraded":"2023-08-22T00:25:18.858614+0000","last_fullsized":"2023-08-22T00:25:18.858614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854282+0000","last_change":"2023-08-22T00:25:18.474718+0000","last_active":"2023-08-22T00:25:18.854282+0000","last_peered":"2023-08-22T00:25:18.854282+0000","last_clean":"2023-08-22T00:25:18.854282+0000","last_became_active":"2023-08-22T00:25:18.474446+0000","last_became_peered":"2023-08-22T00:25:18.474446+0000","last_unstale":"2023-08-22T00:25:18.854282+0000","last_undegraded":"2023-08-22T00:25:18.854282+0000","last_fullsized":"2023-08-22T00:25:18.854282+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857705+0000","last_change":"2023-08-22T00:25:18.857705+0000","last_active":"2023-08-22T00:25:18.857705+0000","last_peered":"2023-08-22T00:25:18.857705+0000","last_clean":"2023-08-22T00:25:18.857705+0000","last_became_active":"2023-08-22T00:25:18.857423+0000","last_became_peered":"2023-08-22T00:25:18.857423+0000","last_unstale":"2023-08-22T00:25:18.857705+0000","last_undegraded":"2023-08-22T00:25:18.857705+0000","last_fullsized":"2023-08-22T00:25:18.857705+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853176+0000","last_change":"2023-08-22T00:25:18.471076+0000","last_active":"2023-08-22T00:25:18.853176+0000","last_peered":"2023-08-22T00:25:18.853176+0000","last_clean":"2023-08-22T00:25:18.853176+0000","last_became_active":"2023-08-22T00:25:18.470821+0000","last_became_peered":"2023-08-22T00:25:18.470821+0000","last_unstale":"2023-08-22T00:25:18.853176+0000","last_undegraded":"2023-08-22T00:25:18.853176+0000","last_fullsized":"2023-08-22T00:25:18.853176+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853938+0000","last_change":"2023-08-22T00:25:18.853938+0000","last_active":"2023-08-22T00:25:18.853938+0000","last_peered":"2023-08-22T00:25:18.853938+0000","last_clean":"2023-08-22T00:25:18.853938+0000","last_became_active":"2023-08-22T00:25:18.853652+0000","last_became_peered":"2023-08-22T00:25:18.853652+0000","last_unstale":"2023-08-22T00:25:18.853938+0000","last_undegraded":"2023-08-22T00:25:18.853938+0000","last_fullsized":"2023-08-22T00:25:18.853938+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478034+0000","last_change":"2023-08-22T00:25:18.472695+0000","last_active":"2023-08-22T00:25:18.478034+0000","last_peered":"2023-08-22T00:25:18.478034+0000","last_clean":"2023-08-22T00:25:18.478034+0000","last_became_active":"2023-08-22T00:25:18.472426+0000","last_became_peered":"2023-08-22T00:25:18.472426+0000","last_unstale":"2023-08-22T00:25:18.478034+0000","last_undegraded":"2023-08-22T00:25:18.478034+0000","last_fullsized":"2023-08-22T00:25:18.478034+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853989+0000","last_change":"2023-08-22T00:25:18.853989+0000","last_active":"2023-08-22T00:25:18.853989+0000","last_peered":"2023-08-22T00:25:18.853989+0000","last_clean":"2023-08-22T00:25:18.853989+0000","last_became_active":"2023-08-22T00:25:18.853712+0000","last_became_peered":"2023-08-22T00:25:18.853712+0000","last_unstale":"2023-08-22T00:25:18.853989+0000","last_undegraded":"2023-08-22T00:25:18.853989+0000","last_fullsized":"2023-08-22T00:25:18.853989+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480534+0000","last_change":"2023-08-22T00:25:18.473026+0000","last_active":"2023-08-22T00:25:18.480534+0000","last_peered":"2023-08-22T00:25:18.480534+0000","last_clean":"2023-08-22T00:25:18.480534+0000","last_became_active":"2023-08-22T00:25:18.472743+0000","last_became_peered":"2023-08-22T00:25:18.472743+0000","last_unstale":"2023-08-22T00:25:18.480534+0000","last_undegraded":"2023-08-22T00:25:18.480534+0000","last_fullsized":"2023-08-22T00:25:18.480534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855359+0000","last_change":"2023-08-22T00:25:18.855359+0000","last_active":"2023-08-22T00:25:18.855359+0000","last_peered":"2023-08-22T00:25:18.855359+0000","last_clean":"2023-08-22T00:25:18.855359+0000","last_became_active":"2023-08-22T00:25:18.855095+0000","last_became_peered":"2023-08-22T00:25:18.855095+0000","last_unstale":"2023-08-22T00:25:18.855359+0000","last_undegraded":"2023-08-22T00:25:18.855359+0000","last_fullsized":"2023-08-22T00:25:18.855359+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480903+0000","last_change":"2023-08-22T00:25:18.475420+0000","last_active":"2023-08-22T00:25:18.480903+0000","last_peered":"2023-08-22T00:25:18.480903+0000","last_clean":"2023-08-22T00:25:18.480903+0000","last_became_active":"2023-08-22T00:25:18.474887+0000","last_became_peered":"2023-08-22T00:25:18.474887+0000","last_unstale":"2023-08-22T00:25:18.480903+0000","last_undegraded":"2023-08-22T00:25:18.480903+0000","last_fullsized":"2023-08-22T00:25:18.480903+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.858190+0000","last_change":"2023-08-22T00:25:18.858190+0000","last_active":"2023-08-22T00:25:18.858190+0000","last_peered":"2023-08-22T00:25:18.858190+0000","last_clean":"2023-08-22T00:25:18.858190+0000","last_became_active":"2023-08-22T00:25:18.857917+0000","last_became_peered":"2023-08-22T00:25:18.857917+0000","last_unstale":"2023-08-22T00:25:18.858190+0000","last_undegraded":"2023-08-22T00:25:18.858190+0000","last_fullsized":"2023-08-22T00:25:18.858190+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477017+0000","last_change":"2023-08-22T00:25:18.471910+0000","last_active":"2023-08-22T00:25:18.477017+0000","last_peered":"2023-08-22T00:25:18.477017+0000","last_clean":"2023-08-22T00:25:18.477017+0000","last_became_active":"2023-08-22T00:25:18.471612+0000","last_became_peered":"2023-08-22T00:25:18.471612+0000","last_unstale":"2023-08-22T00:25:18.477017+0000","last_undegraded":"2023-08-22T00:25:18.477017+0000","last_fullsized":"2023-08-22T00:25:18.477017+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855146+0000","last_change":"2023-08-22T00:25:18.855146+0000","last_active":"2023-08-22T00:25:18.855146+0000","last_peered":"2023-08-22T00:25:18.855146+0000","last_clean":"2023-08-22T00:25:18.855146+0000","last_became_active":"2023-08-22T00:25:18.854758+0000","last_became_peered":"2023-08-22T00:25:18.854758+0000","last_unstale":"2023-08-22T00:25:18.855146+0000","last_undegraded":"2023-08-22T00:25:18.855146+0000","last_fullsized":"2023-08-22T00:25:18.855146+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478071+0000","last_change":"2023-08-22T00:25:18.472951+0000","last_active":"2023-08-22T00:25:18.478071+0000","last_peered":"2023-08-22T00:25:18.478071+0000","last_clean":"2023-08-22T00:25:18.478071+0000","last_became_active":"2023-08-22T00:25:18.469845+0000","last_became_peered":"2023-08-22T00:25:18.469845+0000","last_unstale":"2023-08-22T00:25:18.478071+0000","last_undegraded":"2023-08-22T00:25:18.478071+0000","last_fullsized":"2023-08-22T00:25:18.478071+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853819+0000","last_change":"2023-08-22T00:25:18.853819+0000","last_active":"2023-08-22T00:25:18.853819+0000","last_peered":"2023-08-22T00:25:18.853819+0000","last_clean":"2023-08-22T00:25:18.853819+0000","last_became_active":"2023-08-22T00:25:18.853534+0000","last_became_peered":"2023-08-22T00:25:18.853534+0000","last_unstale":"2023-08-22T00:25:18.853819+0000","last_undegraded":"2023-08-22T00:25:18.853819+0000","last_fullsized":"2023-08-22T00:25:18.853819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.854849+0000","last_change":"2023-08-22T00:25:18.470219+0000","last_active":"2023-08-22T00:25:18.854849+0000","last_peered":"2023-08-22T00:25:18.854849+0000","last_clean":"2023-08-22T00:25:18.854849+0000","last_became_active":"2023-08-22T00:25:18.469933+0000","last_became_peered":"2023-08-22T00:25:18.469933+0000","last_unstale":"2023-08-22T00:25:18.854849+0000","last_undegraded":"2023-08-22T00:25:18.854849+0000","last_fullsized":"2023-08-22T00:25:18.854849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.863031+0000","last_change":"2023-08-22T00:25:18.863031+0000","last_active":"2023-08-22T00:25:18.863031+0000","last_peered":"2023-08-22T00:25:18.863031+0000","last_clean":"2023-08-22T00:25:18.863031+0000","last_became_active":"2023-08-22T00:25:18.862749+0000","last_became_peered":"2023-08-22T00:25:18.862749+0000","last_unstale":"2023-08-22T00:25:18.863031+0000","last_undegraded":"2023-08-22T00:25:18.863031+0000","last_fullsized":"2023-08-22T00:25:18.863031+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857614+0000","last_change":"2023-08-22T00:25:18.476302+0000","last_active":"2023-08-22T00:25:18.857614+0000","last_peered":"2023-08-22T00:25:18.857614+0000","last_clean":"2023-08-22T00:25:18.857614+0000","last_became_active":"2023-08-22T00:25:18.471489+0000","last_became_peered":"2023-08-22T00:25:18.471489+0000","last_unstale":"2023-08-22T00:25:18.857614+0000","last_undegraded":"2023-08-22T00:25:18.857614+0000","last_fullsized":"2023-08-22T00:25:18.857614+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864619+0000","last_change":"2023-08-22T00:25:18.864619+0000","last_active":"2023-08-22T00:25:18.864619+0000","last_peered":"2023-08-22T00:25:18.864619+0000","last_clean":"2023-08-22T00:25:18.864619+0000","last_became_active":"2023-08-22T00:25:18.864360+0000","last_became_peered":"2023-08-22T00:25:18.864360+0000","last_unstale":"2023-08-22T00:25:18.864619+0000","last_undegraded":"2023-08-22T00:25:18.864619+0000","last_fullsized":"2023-08-22T00:25:18.864619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.477066+0000","last_change":"2023-08-22T00:25:18.472942+0000","last_active":"2023-08-22T00:25:18.477066+0000","last_peered":"2023-08-22T00:25:18.477066+0000","last_clean":"2023-08-22T00:25:18.477066+0000","last_became_active":"2023-08-22T00:25:18.472628+0000","last_became_peered":"2023-08-22T00:25:18.472628+0000","last_unstale":"2023-08-22T00:25:18.477066+0000","last_undegraded":"2023-08-22T00:25:18.477066+0000","last_fullsized":"2023-08-22T00:25:18.477066+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855075+0000","last_change":"2023-08-22T00:25:18.855075+0000","last_active":"2023-08-22T00:25:18.855075+0000","last_peered":"2023-08-22T00:25:18.855075+0000","last_clean":"2023-08-22T00:25:18.855075+0000","last_became_active":"2023-08-22T00:25:18.854805+0000","last_became_peered":"2023-08-22T00:25:18.854805+0000","last_unstale":"2023-08-22T00:25:18.855075+0000","last_undegraded":"2023-08-22T00:25:18.855075+0000","last_fullsized":"2023-08-22T00:25:18.855075+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.475732+0000","last_change":"2023-08-22T00:25:18.473474+0000","last_active":"2023-08-22T00:25:18.475732+0000","last_peered":"2023-08-22T00:25:18.475732+0000","last_clean":"2023-08-22T00:25:18.475732+0000","last_became_active":"2023-08-22T00:25:18.472205+0000","last_became_peered":"2023-08-22T00:25:18.472205+0000","last_unstale":"2023-08-22T00:25:18.475732+0000","last_undegraded":"2023-08-22T00:25:18.475732+0000","last_fullsized":"2023-08-22T00:25:18.475732+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.851532+0000","last_change":"2023-08-22T00:25:18.851532+0000","last_active":"2023-08-22T00:25:18.851532+0000","last_peered":"2023-08-22T00:25:18.851532+0000","last_clean":"2023-08-22T00:25:18.851532+0000","last_became_active":"2023-08-22T00:25:18.849094+0000","last_became_peered":"2023-08-22T00:25:18.849094+0000","last_unstale":"2023-08-22T00:25:18.851532+0000","last_undegraded":"2023-08-22T00:25:18.851532+0000","last_fullsized":"2023-08-22T00:25:18.851532+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.853018+0000","last_change":"2023-08-22T00:25:18.465375+0000","last_active":"2023-08-22T00:25:18.853018+0000","last_peered":"2023-08-22T00:25:18.853018+0000","last_clean":"2023-08-22T00:25:18.853018+0000","last_became_active":"2023-08-22T00:25:18.465088+0000","last_became_peered":"2023-08-22T00:25:18.465088+0000","last_unstale":"2023-08-22T00:25:18.853018+0000","last_undegraded":"2023-08-22T00:25:18.853018+0000","last_fullsized":"2023-08-22T00:25:18.853018+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.849675+0000","last_change":"2023-08-22T00:25:18.849675+0000","last_active":"2023-08-22T00:25:18.849675+0000","last_peered":"2023-08-22T00:25:18.849675+0000","last_clean":"2023-08-22T00:25:18.849675+0000","last_became_active":"2023-08-22T00:25:18.849407+0000","last_became_peered":"2023-08-22T00:25:18.849407+0000","last_unstale":"2023-08-22T00:25:18.849675+0000","last_undegraded":"2023-08-22T00:25:18.849675+0000","last_fullsized":"2023-08-22T00:25:18.849675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.469447+0000","last_change":"2023-08-22T00:25:18.464748+0000","last_active":"2023-08-22T00:25:18.469447+0000","last_peered":"2023-08-22T00:25:18.469447+0000","last_clean":"2023-08-22T00:25:18.469447+0000","last_became_active":"2023-08-22T00:25:18.462935+0000","last_became_peered":"2023-08-22T00:25:18.462935+0000","last_unstale":"2023-08-22T00:25:18.469447+0000","last_undegraded":"2023-08-22T00:25:18.469447+0000","last_fullsized":"2023-08-22T00:25:18.469447+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856842+0000","last_change":"2023-08-22T00:25:18.856842+0000","last_active":"2023-08-22T00:25:18.856842+0000","last_peered":"2023-08-22T00:25:18.856842+0000","last_clean":"2023-08-22T00:25:18.856842+0000","last_became_active":"2023-08-22T00:25:18.856571+0000","last_became_peered":"2023-08-22T00:25:18.856571+0000","last_unstale":"2023-08-22T00:25:18.856842+0000","last_undegraded":"2023-08-22T00:25:18.856842+0000","last_fullsized":"2023-08-22T00:25:18.856842+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468723+0000","last_change":"2023-08-22T00:25:18.464428+0000","last_active":"2023-08-22T00:25:18.468723+0000","last_peered":"2023-08-22T00:25:18.468723+0000","last_clean":"2023-08-22T00:25:18.468723+0000","last_became_active":"2023-08-22T00:25:18.464155+0000","last_became_peered":"2023-08-22T00:25:18.464155+0000","last_unstale":"2023-08-22T00:25:18.468723+0000","last_undegraded":"2023-08-22T00:25:18.468723+0000","last_fullsized":"2023-08-22T00:25:18.468723+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865712+0000","last_change":"2023-08-22T00:25:18.865712+0000","last_active":"2023-08-22T00:25:18.865712+0000","last_peered":"2023-08-22T00:25:18.865712+0000","last_clean":"2023-08-22T00:25:18.865712+0000","last_became_active":"2023-08-22T00:25:18.865032+0000","last_became_peered":"2023-08-22T00:25:18.865032+0000","last_unstale":"2023-08-22T00:25:18.865712+0000","last_undegraded":"2023-08-22T00:25:18.865712+0000","last_fullsized":"2023-08-22T00:25:18.865712+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.481029+0000","last_change":"2023-08-22T00:25:18.469856+0000","last_active":"2023-08-22T00:25:18.481029+0000","last_peered":"2023-08-22T00:25:18.481029+0000","last_clean":"2023-08-22T00:25:18.481029+0000","last_became_active":"2023-08-22T00:25:18.468661+0000","last_became_peered":"2023-08-22T00:25:18.468661+0000","last_unstale":"2023-08-22T00:25:18.481029+0000","last_undegraded":"2023-08-22T00:25:18.481029+0000","last_fullsized":"2023-08-22T00:25:18.481029+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856890+0000","last_change":"2023-08-22T00:25:18.856890+0000","last_active":"2023-08-22T00:25:18.856890+0000","last_peered":"2023-08-22T00:25:18.856890+0000","last_clean":"2023-08-22T00:25:18.856890+0000","last_became_active":"2023-08-22T00:25:18.856519+0000","last_became_peered":"2023-08-22T00:25:18.856519+0000","last_unstale":"2023-08-22T00:25:18.856890+0000","last_undegraded":"2023-08-22T00:25:18.856890+0000","last_fullsized":"2023-08-22T00:25:18.856890+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857090+0000","last_change":"2023-08-22T00:25:18.467011+0000","last_active":"2023-08-22T00:25:18.857090+0000","last_peered":"2023-08-22T00:25:18.857090+0000","last_clean":"2023-08-22T00:25:18.857090+0000","last_became_active":"2023-08-22T00:25:18.466731+0000","last_became_peered":"2023-08-22T00:25:18.466731+0000","last_unstale":"2023-08-22T00:25:18.857090+0000","last_undegraded":"2023-08-22T00:25:18.857090+0000","last_fullsized":"2023-08-22T00:25:18.857090+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861155+0000","last_change":"2023-08-22T00:25:18.861155+0000","last_active":"2023-08-22T00:25:18.861155+0000","last_peered":"2023-08-22T00:25:18.861155+0000","last_clean":"2023-08-22T00:25:18.861155+0000","last_became_active":"2023-08-22T00:25:18.860870+0000","last_became_peered":"2023-08-22T00:25:18.860870+0000","last_unstale":"2023-08-22T00:25:18.861155+0000","last_undegraded":"2023-08-22T00:25:18.861155+0000","last_fullsized":"2023-08-22T00:25:18.861155+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.479263+0000","last_change":"2023-08-22T00:25:18.478338+0000","last_active":"2023-08-22T00:25:18.479263+0000","last_peered":"2023-08-22T00:25:18.479263+0000","last_clean":"2023-08-22T00:25:18.479263+0000","last_became_active":"2023-08-22T00:25:18.477990+0000","last_became_peered":"2023-08-22T00:25:18.477990+0000","last_unstale":"2023-08-22T00:25:18.479263+0000","last_undegraded":"2023-08-22T00:25:18.479263+0000","last_fullsized":"2023-08-22T00:25:18.479263+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.850535+0000","last_change":"2023-08-22T00:25:18.850535+0000","last_active":"2023-08-22T00:25:18.850535+0000","last_peered":"2023-08-22T00:25:18.850535+0000","last_clean":"2023-08-22T00:25:18.850535+0000","last_became_active":"2023-08-22T00:25:18.850249+0000","last_became_peered":"2023-08-22T00:25:18.850249+0000","last_unstale":"2023-08-22T00:25:18.850535+0000","last_undegraded":"2023-08-22T00:25:18.850535+0000","last_fullsized":"2023-08-22T00:25:18.850535+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.474404+0000","last_change":"2023-08-22T00:25:18.469767+0000","last_active":"2023-08-22T00:25:18.474404+0000","last_peered":"2023-08-22T00:25:18.474404+0000","last_clean":"2023-08-22T00:25:18.474404+0000","last_became_active":"2023-08-22T00:25:18.469167+0000","last_became_peered":"2023-08-22T00:25:18.469167+0000","last_unstale":"2023-08-22T00:25:18.474404+0000","last_undegraded":"2023-08-22T00:25:18.474404+0000","last_fullsized":"2023-08-22T00:25:18.474404+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855247+0000","last_change":"2023-08-22T00:25:18.855247+0000","last_active":"2023-08-22T00:25:18.855247+0000","last_peered":"2023-08-22T00:25:18.855247+0000","last_clean":"2023-08-22T00:25:18.855247+0000","last_became_active":"2023-08-22T00:25:18.854854+0000","last_became_peered":"2023-08-22T00:25:18.854854+0000","last_unstale":"2023-08-22T00:25:18.855247+0000","last_undegraded":"2023-08-22T00:25:18.855247+0000","last_fullsized":"2023-08-22T00:25:18.855247+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.483964+0000","last_change":"2023-08-22T00:25:18.477414+0000","last_active":"2023-08-22T00:25:18.483964+0000","last_peered":"2023-08-22T00:25:18.483964+0000","last_clean":"2023-08-22T00:25:18.483964+0000","last_became_active":"2023-08-22T00:25:18.476913+0000","last_became_peered":"2023-08-22T00:25:18.476913+0000","last_unstale":"2023-08-22T00:25:18.483964+0000","last_undegraded":"2023-08-22T00:25:18.483964+0000","last_fullsized":"2023-08-22T00:25:18.483964+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856028+0000","last_change":"2023-08-22T00:25:18.856028+0000","last_active":"2023-08-22T00:25:18.856028+0000","last_peered":"2023-08-22T00:25:18.856028+0000","last_clean":"2023-08-22T00:25:18.856028+0000","last_became_active":"2023-08-22T00:25:18.855748+0000","last_became_peered":"2023-08-22T00:25:18.855748+0000","last_unstale":"2023-08-22T00:25:18.856028+0000","last_undegraded":"2023-08-22T00:25:18.856028+0000","last_fullsized":"2023-08-22T00:25:18.856028+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.478011+0000","last_change":"2023-08-22T00:25:18.472538+0000","last_active":"2023-08-22T00:25:18.478011+0000","last_peered":"2023-08-22T00:25:18.478011+0000","last_clean":"2023-08-22T00:25:18.478011+0000","last_became_active":"2023-08-22T00:25:18.472260+0000","last_became_peered":"2023-08-22T00:25:18.472260+0000","last_unstale":"2023-08-22T00:25:18.478011+0000","last_undegraded":"2023-08-22T00:25:18.478011+0000","last_fullsized":"2023-08-22T00:25:18.478011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.865553+0000","last_change":"2023-08-22T00:25:18.865553+0000","last_active":"2023-08-22T00:25:18.865553+0000","last_peered":"2023-08-22T00:25:18.865553+0000","last_clean":"2023-08-22T00:25:18.865553+0000","last_became_active":"2023-08-22T00:25:18.865282+0000","last_became_peered":"2023-08-22T00:25:18.865282+0000","last_unstale":"2023-08-22T00:25:18.865553+0000","last_undegraded":"2023-08-22T00:25:18.865553+0000","last_fullsized":"2023-08-22T00:25:18.865553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.484919+0000","last_change":"2023-08-22T00:25:18.484585+0000","last_active":"2023-08-22T00:25:18.484919+0000","last_peered":"2023-08-22T00:25:18.484919+0000","last_clean":"2023-08-22T00:25:18.484919+0000","last_became_active":"2023-08-22T00:25:18.484306+0000","last_became_peered":"2023-08-22T00:25:18.484306+0000","last_unstale":"2023-08-22T00:25:18.484919+0000","last_undegraded":"2023-08-22T00:25:18.484919+0000","last_fullsized":"2023-08-22T00:25:18.484919+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.862242+0000","last_change":"2023-08-22T00:25:18.862242+0000","last_active":"2023-08-22T00:25:18.862242+0000","last_peered":"2023-08-22T00:25:18.862242+0000","last_clean":"2023-08-22T00:25:18.862242+0000","last_became_active":"2023-08-22T00:25:18.861985+0000","last_became_peered":"2023-08-22T00:25:18.861985+0000","last_unstale":"2023-08-22T00:25:18.862242+0000","last_undegraded":"2023-08-22T00:25:18.862242+0000","last_fullsized":"2023-08-22T00:25:18.862242+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468703+0000","last_change":"2023-08-22T00:25:18.463788+0000","last_active":"2023-08-22T00:25:18.468703+0000","last_peered":"2023-08-22T00:25:18.468703+0000","last_clean":"2023-08-22T00:25:18.468703+0000","last_became_active":"2023-08-22T00:25:18.462142+0000","last_became_peered":"2023-08-22T00:25:18.462142+0000","last_unstale":"2023-08-22T00:25:18.468703+0000","last_undegraded":"2023-08-22T00:25:18.468703+0000","last_fullsized":"2023-08-22T00:25:18.468703+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.852037+0000","last_change":"2023-08-22T00:25:18.852037+0000","last_active":"2023-08-22T00:25:18.852037+0000","last_peered":"2023-08-22T00:25:18.852037+0000","last_clean":"2023-08-22T00:25:18.852037+0000","last_became_active":"2023-08-22T00:25:18.851830+0000","last_became_peered":"2023-08-22T00:25:18.851830+0000","last_unstale":"2023-08-22T00:25:18.852037+0000","last_undegraded":"2023-08-22T00:25:18.852037+0000","last_fullsized":"2023-08-22T00:25:18.852037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480957+0000","last_change":"2023-08-22T00:25:18.468479+0000","last_active":"2023-08-22T00:25:18.480957+0000","last_peered":"2023-08-22T00:25:18.480957+0000","last_clean":"2023-08-22T00:25:18.480957+0000","last_became_active":"2023-08-22T00:25:18.468212+0000","last_became_peered":"2023-08-22T00:25:18.468212+0000","last_unstale":"2023-08-22T00:25:18.480957+0000","last_undegraded":"2023-08-22T00:25:18.480957+0000","last_fullsized":"2023-08-22T00:25:18.480957+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860762+0000","last_change":"2023-08-22T00:25:18.860762+0000","last_active":"2023-08-22T00:25:18.860762+0000","last_peered":"2023-08-22T00:25:18.860762+0000","last_clean":"2023-08-22T00:25:18.860762+0000","last_became_active":"2023-08-22T00:25:18.860463+0000","last_became_peered":"2023-08-22T00:25:18.860463+0000","last_unstale":"2023-08-22T00:25:18.860762+0000","last_undegraded":"2023-08-22T00:25:18.860762+0000","last_fullsized":"2023-08-22T00:25:18.860762+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"151'2","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855729+0000","last_change":"2023-08-22T00:25:18.472105+0000","last_active":"2023-08-22T00:25:18.855729+0000","last_peered":"2023-08-22T00:25:18.855729+0000","last_clean":"2023-08-22T00:25:18.855729+0000","last_became_active":"2023-08-22T00:25:18.471807+0000","last_became_peered":"2023-08-22T00:25:18.471807+0000","last_unstale":"2023-08-22T00:25:18.855729+0000","last_undegraded":"2023-08-22T00:25:18.855729+0000","last_fullsized":"2023-08-22T00:25:18.855729+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.466519+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:18.466519+0000","last_peered":"2023-08-22T00:25:18.466519+0000","last_clean":"2023-08-22T00:25:18.466519+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:18.466519+0000","last_undegraded":"2023-08-22T00:25:18.466519+0000","last_fullsized":"2023-08-22T00:25:18.466519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855738+0000","last_change":"2023-08-22T00:25:18.855738+0000","last_active":"2023-08-22T00:25:18.855738+0000","last_peered":"2023-08-22T00:25:18.855738+0000","last_clean":"2023-08-22T00:25:18.855738+0000","last_became_active":"2023-08-22T00:25:18.855497+0000","last_became_peered":"2023-08-22T00:25:18.855497+0000","last_unstale":"2023-08-22T00:25:18.855738+0000","last_undegraded":"2023-08-22T00:25:18.855738+0000","last_fullsized":"2023-08-22T00:25:18.855738+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.473680+0000","last_change":"2023-08-22T00:25:18.467107+0000","last_active":"2023-08-22T00:25:18.473680+0000","last_peered":"2023-08-22T00:25:18.473680+0000","last_clean":"2023-08-22T00:25:18.473680+0000","last_became_active":"2023-08-22T00:25:18.466826+0000","last_became_peered":"2023-08-22T00:25:18.466826+0000","last_unstale":"2023-08-22T00:25:18.473680+0000","last_undegraded":"2023-08-22T00:25:18.473680+0000","last_fullsized":"2023-08-22T00:25:18.473680+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.452369+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:18.452369+0000","last_peered":"2023-08-22T00:25:18.452369+0000","last_clean":"2023-08-22T00:25:18.452369+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:18.452369+0000","last_undegraded":"2023-08-22T00:25:18.452369+0000","last_fullsized":"2023-08-22T00:25:18.452369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.860386+0000","last_change":"2023-08-22T00:25:18.860386+0000","last_active":"2023-08-22T00:25:18.860386+0000","last_peered":"2023-08-22T00:25:18.860386+0000","last_clean":"2023-08-22T00:25:18.860386+0000","last_became_active":"2023-08-22T00:25:18.860141+0000","last_became_peered":"2023-08-22T00:25:18.860141+0000","last_unstale":"2023-08-22T00:25:18.860386+0000","last_undegraded":"2023-08-22T00:25:18.860386+0000","last_fullsized":"2023-08-22T00:25:18.860386+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.480703+0000","last_change":"2023-08-22T00:25:18.473729+0000","last_active":"2023-08-22T00:25:18.480703+0000","last_peered":"2023-08-22T00:25:18.480703+0000","last_clean":"2023-08-22T00:25:18.480703+0000","last_became_active":"2023-08-22T00:25:18.473433+0000","last_became_peered":"2023-08-22T00:25:18.473433+0000","last_unstale":"2023-08-22T00:25:18.480703+0000","last_undegraded":"2023-08-22T00:25:18.480703+0000","last_fullsized":"2023-08-22T00:25:18.480703+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.456982+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:18.456982+0000","last_peered":"2023-08-22T00:25:18.456982+0000","last_clean":"2023-08-22T00:25:18.456982+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:18.456982+0000","last_undegraded":"2023-08-22T00:25:18.456982+0000","last_fullsized":"2023-08-22T00:25:18.456982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.857586+0000","last_change":"2023-08-22T00:25:18.857586+0000","last_active":"2023-08-22T00:25:18.857586+0000","last_peered":"2023-08-22T00:25:18.857586+0000","last_clean":"2023-08-22T00:25:18.857586+0000","last_became_active":"2023-08-22T00:25:18.857282+0000","last_became_peered":"2023-08-22T00:25:18.857282+0000","last_unstale":"2023-08-22T00:25:18.857586+0000","last_undegraded":"2023-08-22T00:25:18.857586+0000","last_fullsized":"2023-08-22T00:25:18.857586+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"151'1","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.843164+0000","last_change":"2023-08-22T00:25:18.479201+0000","last_active":"2023-08-22T00:25:18.843164+0000","last_peered":"2023-08-22T00:25:18.843164+0000","last_clean":"2023-08-22T00:25:18.843164+0000","last_became_active":"2023-08-22T00:25:18.478960+0000","last_became_peered":"2023-08-22T00:25:18.478960+0000","last_unstale":"2023-08-22T00:25:18.843164+0000","last_undegraded":"2023-08-22T00:25:18.843164+0000","last_fullsized":"2023-08-22T00:25:18.843164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.452628+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:18.452628+0000","last_peered":"2023-08-22T00:25:18.452628+0000","last_clean":"2023-08-22T00:25:18.452628+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:18.452628+0000","last_undegraded":"2023-08-22T00:25:18.452628+0000","last_fullsized":"2023-08-22T00:25:18.452628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470484+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:18.470484+0000","last_peered":"2023-08-22T00:25:18.470484+0000","last_clean":"2023-08-22T00:25:18.470484+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:18.470484+0000","last_undegraded":"2023-08-22T00:25:18.470484+0000","last_fullsized":"2023-08-22T00:25:18.470484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856854+0000","last_change":"2023-08-22T00:25:18.856854+0000","last_active":"2023-08-22T00:25:18.856854+0000","last_peered":"2023-08-22T00:25:18.856854+0000","last_clean":"2023-08-22T00:25:18.856854+0000","last_became_active":"2023-08-22T00:25:18.856565+0000","last_became_peered":"2023-08-22T00:25:18.856565+0000","last_unstale":"2023-08-22T00:25:18.856854+0000","last_undegraded":"2023-08-22T00:25:18.856854+0000","last_fullsized":"2023-08-22T00:25:18.856854+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"151'4","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.861992+0000","last_change":"2023-08-22T00:25:18.456503+0000","last_active":"2023-08-22T00:25:18.861992+0000","last_peered":"2023-08-22T00:25:18.861992+0000","last_clean":"2023-08-22T00:25:18.861992+0000","last_became_active":"2023-08-22T00:25:18.455882+0000","last_became_peered":"2023-08-22T00:25:18.455882+0000","last_unstale":"2023-08-22T00:25:18.861992+0000","last_undegraded":"2023-08-22T00:25:18.861992+0000","last_fullsized":"2023-08-22T00:25:18.861992+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.470392+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:18.470392+0000","last_peered":"2023-08-22T00:25:18.470392+0000","last_clean":"2023-08-22T00:25:18.470392+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:18.470392+0000","last_undegraded":"2023-08-22T00:25:18.470392+0000","last_fullsized":"2023-08-22T00:25:18.470392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.856427+0000","last_change":"2023-08-22T00:25:18.856427+0000","last_active":"2023-08-22T00:25:18.856427+0000","last_peered":"2023-08-22T00:25:18.856427+0000","last_clean":"2023-08-22T00:25:18.856427+0000","last_became_active":"2023-08-22T00:25:18.855920+0000","last_became_peered":"2023-08-22T00:25:18.855920+0000","last_unstale":"2023-08-22T00:25:18.856427+0000","last_undegraded":"2023-08-22T00:25:18.856427+0000","last_fullsized":"2023-08-22T00:25:18.856427+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"151'3","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.864770+0000","last_change":"2023-08-22T00:25:18.460499+0000","last_active":"2023-08-22T00:25:18.864770+0000","last_peered":"2023-08-22T00:25:18.864770+0000","last_clean":"2023-08-22T00:25:18.864770+0000","last_became_active":"2023-08-22T00:25:18.459752+0000","last_became_peered":"2023-08-22T00:25:18.459752+0000","last_unstale":"2023-08-22T00:25:18.864770+0000","last_undegraded":"2023-08-22T00:25:18.864770+0000","last_fullsized":"2023-08-22T00:25:18.864770+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.472309+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:18.472309+0000","last_peered":"2023-08-22T00:25:18.472309+0000","last_clean":"2023-08-22T00:25:18.472309+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:18.472309+0000","last_undegraded":"2023-08-22T00:25:18.472309+0000","last_fullsized":"2023-08-22T00:25:18.472309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.859737+0000","last_change":"2023-08-22T00:25:18.859737+0000","last_active":"2023-08-22T00:25:18.859737+0000","last_peered":"2023-08-22T00:25:18.859737+0000","last_clean":"2023-08-22T00:25:18.859737+0000","last_became_active":"2023-08-22T00:25:18.859440+0000","last_became_peered":"2023-08-22T00:25:18.859440+0000","last_unstale":"2023-08-22T00:25:18.859737+0000","last_undegraded":"2023-08-22T00:25:18.859737+0000","last_fullsized":"2023-08-22T00:25:18.859737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.472612+0000","last_change":"2023-08-22T00:25:18.464907+0000","last_active":"2023-08-22T00:25:18.472612+0000","last_peered":"2023-08-22T00:25:18.472612+0000","last_clean":"2023-08-22T00:25:18.472612+0000","last_became_active":"2023-08-22T00:25:18.464645+0000","last_became_peered":"2023-08-22T00:25:18.464645+0000","last_unstale":"2023-08-22T00:25:18.472612+0000","last_undegraded":"2023-08-22T00:25:18.472612+0000","last_fullsized":"2023-08-22T00:25:18.472612+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.468843+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:18.468843+0000","last_peered":"2023-08-22T00:25:18.468843+0000","last_clean":"2023-08-22T00:25:18.468843+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:18.468843+0000","last_undegraded":"2023-08-22T00:25:18.468843+0000","last_fullsized":"2023-08-22T00:25:18.468843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.855250+0000","last_change":"2023-08-22T00:25:18.855250+0000","last_active":"2023-08-22T00:25:18.855250+0000","last_peered":"2023-08-22T00:25:18.855250+0000","last_clean":"2023-08-22T00:25:18.855250+0000","last_became_active":"2023-08-22T00:25:18.854981+0000","last_became_peered":"2023-08-22T00:25:18.854981+0000","last_unstale":"2023-08-22T00:25:18.855250+0000","last_undegraded":"2023-08-22T00:25:18.855250+0000","last_fullsized":"2023-08-22T00:25:18.855250+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:18.441163+0000","last_clean_scrub_stamp":"2023-08-22T00:25:18.441163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.467355+0000","last_change":"2023-08-22T00:25:18.465597+0000","last_active":"2023-08-22T00:25:18.467355+0000","last_peered":"2023-08-22T00:25:18.467355+0000","last_clean":"2023-08-22T00:25:18.467355+0000","last_became_active":"2023-08-22T00:25:18.464920+0000","last_became_peered":"2023-08-22T00:25:18.464920+0000","last_unstale":"2023-08-22T00:25:18.467355+0000","last_undegraded":"2023-08-22T00:25:18.467355+0000","last_fullsized":"2023-08-22T00:25:18.467355+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:17.436089+0000","last_clean_scrub_stamp":"2023-08-22T00:25:17.436089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-08-22T00:25:18.455967+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:18.455967+0000","last_peered":"2023-08-22T00:25:18.455967+0000","last_clean":"2023-08-22T00:25:18.455967+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:18.455967+0000","last_undegraded":"2023-08-22T00:25:18.455967+0000","last_fullsized":"2023-08-22T00:25:18.455967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67100000000000004,"5min":0.79600000000000004,"15min":0.82199999999999995},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.69199999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.68500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.66300000000000003,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69599999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.63500000000000001,"5min":0.75,"15min":0.75},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.308},"max":{"1min":0.65700000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.70299999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307096,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064744,"statfs":{"total":96636764160,"available":96322297856,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.248,"15min":0.248},"max":{"1min":0.62,"5min":0.81499999999999995,"15min":0.871},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67200000000000004,"5min":0.75900000000000001,"15min":0.77500000000000002},"last":0.748}]},{"osd":3,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65600000000000003,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.35399999999999998,"15min":0.34000000000000002},"max":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.78700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.76800000000000002},"last":0.40400000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.77100000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.498}]},{"osd":7,"last update":"Tue Aug 22 00:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35399999999999998,"15min":0.371},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.38300000000000001,"15min":0.40100000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":1.2849999999999999,"15min":2.504},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36699999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.56200000000000006,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.42599999999999999},"min":{"1min":0.26800000000000002,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.66800000000000004,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42999999999999999,"15min":0.45800000000000002},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.625,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.318},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40500000000000003,"15min":0.42599999999999999},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.22},"max":{"1min":0.626,"5min":1.302,"15min":1.3280000000000001},"last":0.32900000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":1.381,"15min":2.9620000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80500000000000005,"5min":1.24,"15min":1.24},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":1.175,"15min":2.2730000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84199999999999997,"5min":1.266,"15min":2.298},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78400000000000003,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.749}]},{"osd":7,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.626,"15min":0.65200000000000002},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":1.4199999999999999,"15min":2.992},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":1.2190000000000001,"15min":2.323},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575074,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.247,"5min":0.218,"15min":0.19400000000000001},"max":{"1min":0.499,"5min":0.57399999999999995,"15min":0.76000000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.65700000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34799999999999998,"15min":0.37},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.47199999999999998,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.318},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.379,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23699999999999999},"max":{"1min":0.52700000000000002,"5min":0.58099999999999996,"15min":0.77900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.64200000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72599999999999998,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575075,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.35899999999999999},"min":{"1min":0.23899999999999999,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.44700000000000001,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38800000000000001,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.46700000000000003,"5min":1.216,"15min":1.216},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51500000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.38700000000000001},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47899999999999998,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.28199999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":0.53000000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.38,"15min":0.40899999999999997},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.753,"15min":0.753},"last":0.33600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":1.0169999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.81100000000000005,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.42799999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.998},"last":0.501},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.871,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78100000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1851392,"data_stored":980687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.35299999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47399999999999998,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.309,"5min":0.34999999999999998,"15min":0.374},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41999999999999998,"5min":0.56100000000000005,"15min":0.56799999999999995},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.20300000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.45700000000000002,"5min":0.59199999999999997,"15min":0.61799999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.42499999999999999},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.45000000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32500000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.41699999999999998,"15min":0.438},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.61799999999999999,"15min":0.66600000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.44900000000000001},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":0.52600000000000002,"5min":0.66100000000000003,"15min":0.69199999999999995},"last":0.35999999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.98499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85999999999999999,"5min":0.90500000000000003,"15min":0.92200000000000004},"last":0.439}]},{"osd":5,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.88400000000000001,"15min":0.94799999999999995},"last":0.50700000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.95699999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.95999999999999996},"last":0.46999999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81000000000000005,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.47599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307108,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.432}]},{"osd":2,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.746},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.34899999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72299999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.29599999999999999},"max":{"1min":0.69899999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.32700000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66400000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40000000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.47699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":987719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.54600000000000004},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.505},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":0.81899999999999995,"15min":0.88},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.80300000000000005},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.496}]},{"osd":6,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.441},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:22.244 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:25:22.245 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:25:22.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.366+0000 7ff499e78700 1 Processor -- start 2023-08-22T00:25:22.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.366+0000 7ff499e78700 1 -- start start 2023-08-22T00:25:22.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff499e78700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff49414e720 0x7ff494155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff499e78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff499e78700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940654a0 con 0x7ff4940641b0 2023-08-22T00:25:22.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff499e78700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff494064660 con 0x7ff49414e720 2023-08-22T00:25:22.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff499e78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff494064920 con 0x7ff494067d00 2023-08-22T00:25:22.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff49414e720 0x7ff494155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff49414e720 0x7ff494155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39848/0 (socket says 172.21.15.98:39848) 2023-08-22T00:25:22.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 -- 172.21.15.98:0/3171998030 learned_addr learned my addr 172.21.15.98:0/3171998030 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:22.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 -- 172.21.15.98:0/3171998030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 msgr2=0x7ff4940c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 --2- 172.21.15.98:0/3171998030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:22.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 -- 172.21.15.98:0/3171998030 >> v1:172.21.15.118:6789/0 conn(0x7ff4940641b0 legacy=0x7ff4940675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.367+0000 7ff4937fe700 1 -- 172.21.15.98:0/3171998030 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494064c00 con 0x7ff49414e720 2023-08-22T00:25:22.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff4937fe700 1 --2- 172.21.15.98:0/3171998030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff494155290 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7ff488006fd0 tx=0x7ff4880090f0).ready entity=mon.0 client_cookie=65f98e8e2e178fe4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff4927fc700 1 -- 172.21.15.98:0/3171998030 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800b600 con 0x7ff49414e720 2023-08-22T00:25:22.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff4927fc700 1 -- 172.21.15.98:0/3171998030 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48800b760 con 0x7ff49414e720 2023-08-22T00:25:22.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff4927fc700 1 -- 172.21.15.98:0/3171998030 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800bae0 con 0x7ff49414e720 2023-08-22T00:25:22.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 -- 172.21.15.98:0/3171998030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 msgr2=0x7ff494155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 --2- 172.21.15.98:0/3171998030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff494155290 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7ff488006fd0 tx=0x7ff4880090f0).stop 2023-08-22T00:25:22.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 -- 172.21.15.98:0/3171998030 shutdown_connections 2023-08-22T00:25:22.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 --2- 172.21.15.98:0/3171998030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:22.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 --2- 172.21.15.98:0/3171998030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff494155290 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 -- 172.21.15.98:0/3171998030 >> 172.21.15.98:0/3171998030 conn(0x7ff4940c8950 msgr2=0x7ff4940c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 -- 172.21.15.98:0/3171998030 shutdown_connections 2023-08-22T00:25:22.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.368+0000 7ff499e78700 1 -- 172.21.15.98:0/3171998030 wait complete. 2023-08-22T00:25:22.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 Processor -- start 2023-08-22T00:25:22.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 -- start start 2023-08-22T00:25:22.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 0x7ff4941642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49413c0b0 con 0x7ff49414e720 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940a95d0 con 0x7ff4940641b0 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff499e78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940a98b0 con 0x7ff494067d00 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.370+0000 7ff493fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39858/0 (socket says 172.21.15.98:39858) 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 -- 172.21.15.98:0/1746596139 learned_addr learned my addr 172.21.15.98:0/1746596139 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff4937fe700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 0x7ff4941642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff492ffd700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 -- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 msgr2=0x7ff4940aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 -- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 msgr2=0x7ff4941642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 0x7ff4941642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 -- 172.21.15.98:0/1746596139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009370 con 0x7ff49414e720 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff4937fe700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 0x7ff4941642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff492ffd700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff493fff700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7ff48c00bb60 tx=0x7ff48c009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00c940 con 0x7ff49414e720 2023-08-22T00:25:22.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00cac0 con 0x7ff49414e720 2023-08-22T00:25:22.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00cc70 con 0x7ff49414e720 2023-08-22T00:25:22.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940a9b90 con 0x7ff49414e720 2023-08-22T00:25:22.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.371+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4940aa150 con 0x7ff49414e720 2023-08-22T00:25:22.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.372+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4940aa370 con 0x7ff49414e720 2023-08-22T00:25:22.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.373+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff48c012020 con 0x7ff49414e720 2023-08-22T00:25:22.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.373+0000 7ff47b7fe700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 0x7ff4800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.373+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff48c07a120 con 0x7ff49414e720 2023-08-22T00:25:22.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.373+0000 7ff4937fe700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 0x7ff4800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.373+0000 7ff4937fe700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 0x7ff4800613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff4940c0fc0 tx=0x7ff488017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.377+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff48c04b2b0 con 0x7ff49414e720 2023-08-22T00:25:22.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.598+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff494069d50 con 0x7ff49414e720 2023-08-22T00:25:22.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.602+0000 7ff47b7fe700 1 -- 172.21.15.98:0/1746596139 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff48c009910 con 0x7ff49414e720 2023-08-22T00:25:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 msgr2=0x7ff4800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 0x7ff4800613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff4940c0fc0 tx=0x7ff488017000).stop 2023-08-22T00:25:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 msgr2=0x7ff4940ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7ff48c00bb60 tx=0x7ff48c009810).stop 2023-08-22T00:25:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 shutdown_connections 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff49414e720 0x7ff4940ae2e0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4940641b0 0x7ff4941642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7ff48005ef30 0x7ff4800613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 --2- 172.21.15.98:0/1746596139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff494067d00 0x7ff4940aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 >> 172.21.15.98:0/1746596139 conn(0x7ff4940c8950 msgr2=0x7ff4940be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 shutdown_connections 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.604+0000 7ff499e78700 1 -- 172.21.15.98:0/1746596139 wait complete. 2023-08-22T00:25:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:25:22.618 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:22.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.745+0000 7f8b4abd5700 1 Processor -- start 2023-08-22T00:25:22.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.745+0000 7f8b4abd5700 1 -- start start 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b4abd5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b44151d60 0x7f8b44155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b4abd5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b44066620 0x7f8b440643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b4abd5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b44158bf0 con 0x7f8b440a6e50 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b4abd5700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b44157d90 con 0x7f8b44151d60 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b4abd5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b44157fe0 con 0x7f8b44066620 2023-08-22T00:25:22.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.746+0000 7f8b48971700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b44151d60 0x7f8b44155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b44151d60 0x7f8b44155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39864/0 (socket says 172.21.15.98:39864) 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 -- 172.21.15.98:0/1893365114 learned_addr learned my addr 172.21.15.98:0/1893365114 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b49172700 1 --2- 172.21.15.98:0/1893365114 >> v2:172.21.15.118:3300/0 conn(0x7f8b44066620 0x7f8b440643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 -- 172.21.15.98:0/1893365114 >> v2:172.21.15.118:3300/0 conn(0x7f8b44066620 msgr2=0x7f8b440643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 --2- 172.21.15.98:0/1893365114 >> v2:172.21.15.118:3300/0 conn(0x7f8b44066620 0x7f8b440643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 -- 172.21.15.98:0/1893365114 >> v1:172.21.15.118:6789/0 conn(0x7f8b440a6e50 legacy=0x7f8b44065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:22.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 -- 172.21.15.98:0/1893365114 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b441582c0 con 0x7f8b44151d60 2023-08-22T00:25:22.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b48971700 1 --2- 172.21.15.98:0/1893365114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b44155240 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f8b44046dc0 tx=0x7f8b380090f0).ready entity=mon.0 client_cookie=c051b37e667ab22e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b437fe700 1 -- 172.21.15.98:0/1893365114 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800b5a0 con 0x7f8b44151d60 2023-08-22T00:25:22.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b437fe700 1 -- 172.21.15.98:0/1893365114 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800b700 con 0x7f8b44151d60 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b437fe700 1 -- 172.21.15.98:0/1893365114 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800ba80 con 0x7f8b44151d60 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1893365114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 msgr2=0x7f8b44155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.747+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1893365114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b44155240 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f8b44046dc0 tx=0x7f8b380090f0).stop 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1893365114 shutdown_connections 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1893365114 >> v2:172.21.15.118:3300/0 conn(0x7f8b44066620 0x7f8b440643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1893365114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b44155240 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1893365114 >> 172.21.15.98:0/1893365114 conn(0x7f8b4406a980 msgr2=0x7f8b440c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1893365114 shutdown_connections 2023-08-22T00:25:22.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.748+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1893365114 wait complete. 2023-08-22T00:25:22.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.749+0000 7f8b4abd5700 1 Processor -- start 2023-08-22T00:25:22.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.749+0000 7f8b4abd5700 1 -- start start 2023-08-22T00:25:22.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b44066620 0x7f8b44149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b440a6e50 0x7f8b440ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440a38d0 con 0x7f8b44151d60 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440ac2b0 con 0x7f8b440a6e50 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440ac590 con 0x7f8b44066620 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39870/0 (socket says 172.21.15.98:39870) 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 -- 172.21.15.98:0/1042807705 learned_addr learned my addr 172.21.15.98:0/1042807705 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b48971700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b44066620 0x7f8b44149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 -- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b44066620 msgr2=0x7f8b44149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b43fff700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b440a6e50 0x7f8b440ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b44066620 0x7f8b44149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 -- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b440a6e50 msgr2=0x7f8b440ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b440a6e50 0x7f8b440ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 -- 172.21.15.98:0/1042807705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009370 con 0x7f8b44151d60 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b49172700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8b3c00ceb0 tx=0x7f8b3c007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00ae40 con 0x7f8b44151d60 2023-08-22T00:25:22.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c016400 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440ac870 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c016780 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.750+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b44149940 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.751+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44047480 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.752+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8b3c009030 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.752+0000 7f8b40ff9700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 0x7f8b280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.752+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8b3c07a930 con 0x7f8b44151d60 2023-08-22T00:25:22.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.752+0000 7f8b48971700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 0x7f8b280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:22.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.752+0000 7f8b48971700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 0x7f8b280613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8b38006df0 tx=0x7f8b38015000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:22.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.756+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b3c04bac0 con 0x7f8b44151d60 2023-08-22T00:25:22.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.961+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b441585a0 con 0x7f8b44151d60 2023-08-22T00:25:22.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.961+0000 7f8b40ff9700 1 -- 172.21.15.98:0/1042807705 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f8b3c04f0e0 con 0x7f8b44151d60 2023-08-22T00:25:22.964 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:22.964 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:22.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 msgr2=0x7f8b280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 0x7f8b280613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8b38006df0 tx=0x7f8b38015000).stop 2023-08-22T00:25:22.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 msgr2=0x7f8b440abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:22.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8b3c00ceb0 tx=0x7f8b3c007870).stop 2023-08-22T00:25:22.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 shutdown_connections 2023-08-22T00:25:22.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8b2805ef30 0x7f8b280613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b44066620 0x7f8b44149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b44151d60 0x7f8b440abd00 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 --2- 172.21.15.98:0/1042807705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b440a6e50 0x7f8b440ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 >> 172.21.15.98:0/1042807705 conn(0x7f8b4406a980 msgr2=0x7f8b4414c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 shutdown_connections 2023-08-22T00:25:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:22.963+0000 7f8b4abd5700 1 -- 172.21.15.98:0/1042807705 wait complete. 2023-08-22T00:25:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:23.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:25:18.834110+0000', 'modified': '2023-08-22T00:25:20.840303+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8361': {'gid': 8361, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/1960772363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6835', 'nonce': 1960772363}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 1960772363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:25:23.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:25:23.380 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-22T00:25:23.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.501+0000 7fd52d5e2700 1 Processor -- start 2023-08-22T00:25:23.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.501+0000 7fd52d5e2700 1 -- start start 2023-08-22T00:25:23.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.501+0000 7fd52d5e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd528062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.501+0000 7fd52d5e2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd528154d30 con 0x7fd528150030 2023-08-22T00:25:23.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd52d5e2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5280c2570 con 0x7fd528150410 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd52d5e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280c2850 con 0x7fd5280c2020 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd526ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd528150030 0x7fd5280bc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55054/0 (socket says 172.21.15.98:55054) 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd526ffd700 1 -- 172.21.15.98:0/1869019962 learned_addr learned my addr 172.21.15.98:0/1869019962 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd5277fe700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd528062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217911597 0 0) 0x7fd528154d30 con 0x7fd528150030 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5100033f0 con 0x7fd528150030 2023-08-22T00:25:23.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4257676145 0 0) 0x7fd5100033f0 con 0x7fd528150030 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 msgr2=0x7fd528062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd528062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 >> v1:172.21.15.118:6789/0 conn(0x7fd528150410 legacy=0x7fd528154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528153e20 con 0x7fd528150030 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd518001470 con 0x7fd528150030 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 >> v1:172.21.15.98:6789/0 conn(0x7fd528150030 legacy=0x7fd5280bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd510003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd510004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510004b80 0x7fd510005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280c2850 con 0x7fd510003e00 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000c9f0 con 0x7fd510004b80 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000cbb0 con 0x7fd5280c2020 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd5267fc700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd510004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.502+0000 7fd526ffd700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd510003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5277fe700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510004b80 0x7fd510005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 -- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 msgr2=0x7fd510003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5280c2020 0x7fd510003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 -- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510004b80 msgr2=0x7fd510005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510004b80 0x7fd510005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 -- 172.21.15.98:0/1869019962 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100033f0 con 0x7fd510003e00 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5267fc700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd510004690 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd51c001820 tx=0x7fd51c007b90).ready entity=mon.0 client_cookie=475701fb252b5354 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c007ea0 con 0x7fd510003e00 2023-08-22T00:25:23.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c012400 con 0x7fd510003e00 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd525ffb700 1 -- 172.21.15.98:0/1869019962 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0127a0 con 0x7fd510003e00 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 -- 172.21.15.98:0/1869019962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 msgr2=0x7fd510004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/1869019962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd510004690 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd51c001820 tx=0x7fd51c007b90).stop 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd5277fe700 1 -- 172.21.15.98:0/1869019962 reap_dead start 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 -- 172.21.15.98:0/1869019962 shutdown_connections 2023-08-22T00:25:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 -- 172.21.15.98:0/1869019962 >> 172.21.15.98:0/1869019962 conn(0x7fd5280c3170 msgr2=0x7fd5280c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 -- 172.21.15.98:0/1869019962 shutdown_connections 2023-08-22T00:25:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.503+0000 7fd52d5e2700 1 -- 172.21.15.98:0/1869019962 wait complete. 2023-08-22T00:25:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 Processor -- start 2023-08-22T00:25:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 -- start start 2023-08-22T00:25:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd528153160 0x7fd528149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 0x7fd5280a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528151b10 con 0x7fd510003e00 2023-08-22T00:25:23.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280be3f0 con 0x7fd5280a6030 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd52d5e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528151830 con 0x7fd528153160 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39898/0 (socket says 172.21.15.98:39898) 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.505+0000 7fd526ffd700 1 -- 172.21.15.98:0/615729753 learned_addr learned my addr 172.21.15.98:0/615729753 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd5277fe700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 0x7fd5280a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd5267fc700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd528153160 0x7fd528149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 -- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd528153160 msgr2=0x7fd528149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd528153160 0x7fd528149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 -- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 msgr2=0x7fd5280a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 0x7fd5280a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 -- 172.21.15.98:0/615729753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5280be640 con 0x7fd510003e00 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd5277fe700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 0x7fd5280a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd526ffd700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fd518004760 tx=0x7fd518001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd50effd700 1 -- 172.21.15.98:0/615729753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518011590 con 0x7fd510003e00 2023-08-22T00:25:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd50effd700 1 -- 172.21.15.98:0/615729753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5180116f0 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd50effd700 1 -- 172.21.15.98:0/615729753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518011a70 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5280be920 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.506+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5281535e0 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.509+0000 7fd50effd700 1 -- 172.21.15.98:0/615729753 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd51801c360 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.509+0000 7fd50effd700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 0x7fd5140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.509+0000 7fd50effd700 1 -- 172.21.15.98:0/615729753 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd518079770 con 0x7fd510003e00 2023-08-22T00:25:23.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.509+0000 7fd5267fc700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 0x7fd5140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.509+0000 7fd5267fc700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 0x7fd5140613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd5280ac960 tx=0x7fd51c016000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.510+0000 7fd53ef96b80 1 Processor -- start 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.510+0000 7fd53ef96b80 1 -- start start 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 0x56466672f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466672ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666670db0 con 0x5646667342c0 2023-08-22T00:25:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666686030 con 0x56466677cf60 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x564666686170 con 0x56466672faf0 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39900/0 (socket says 172.21.15.98:39900) 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 -- 172.21.15.98:0/621575824 learned_addr learned my addr 172.21.15.98:0/621575824 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 -- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 msgr2=0x56466672ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466672ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 -- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 msgr2=0x56466672f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd5267fc700 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 0x56466672f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 0x56466672f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 -- 172.21.15.98:0/621575824 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564666658b00 con 0x5646667342c0 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd5267fc700 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 0x56466672f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd526ffd700 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fd518077990 tx=0x7fd518012000).ready entity=mon.0 client_cookie=7d5eb9feb691098e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd507fff700 1 -- 172.21.15.98:0/621575824 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518053ca0 con 0x5646667342c0 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd507fff700 1 -- 172.21.15.98:0/621575824 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51804c6a0 con 0x5646667342c0 2023-08-22T00:25:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.511+0000 7fd507fff700 1 -- 172.21.15.98:0/621575824 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180775e0 con 0x5646667342c0 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 -- 172.21.15.98:0/621575824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 msgr2=0x5646667346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fd518077990 tx=0x7fd518012000).stop 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 -- 172.21.15.98:0/621575824 shutdown_connections 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466672ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646667342c0 0x5646667346a0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/621575824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56466677cf60 0x56466672f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 -- 172.21.15.98:0/621575824 >> 172.21.15.98:0/621575824 conn(0x56466659e940 msgr2=0x56466677d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 -- 172.21.15.98:0/621575824 shutdown_connections 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.512+0000 7fd53ef96b80 1 -- 172.21.15.98:0/621575824 wait complete. 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.513+0000 7fd53ef96b80 1 -- start start 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.513+0000 7fd53ef96b80 1 Processor -- start 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466675f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x5646667779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646666863f0 con 0x56466677cf60 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666651920 con 0x5646667342c0 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646667796d0 con 0x56466672faf0 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 10 client.0 ll_register_callbacks cb 0x564666626ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39904/0 (socket says 172.21.15.98:39904) 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 -- 172.21.15.98:0/3283799370 learned_addr learned my addr 172.21.15.98:0/3283799370 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466675f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5267fc700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x5646667779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 -- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 msgr2=0x56466675f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466675f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 -- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 msgr2=0x5646667779d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x5646667779d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 -- 172.21.15.98:0/3283799370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5281535e0 con 0x56466677cf60 2023-08-22T00:25:23.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466675f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5267fc700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x5646667779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5277fe700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd528068a30 tx=0x7fd52000b040).ready entity=mon.0 client_cookie=c602e45e37b578c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5057fa700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000e070 con 0x56466677cf60 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd520009d80 con 0x56466677cf60 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56466672eaa0 con 0x56466677cf60 2023-08-22T00:25:23.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd520002d10 con 0x56466677cf60 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.514+0000 7fd53ef96b80 10 client.8517 fetch_fsmap learned FSMap version 55 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x56466667ef70 con 0x56466677cf60 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56466672eaa0 con 0x56466677cf60 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd520014040 con 0x56466677cf60 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 10 client.8517 fetch_fsmap finished waiting for FSMap version 55 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 10 client.8517 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 20 client.8517 populate_metadata read hostname 'smithi098' 2023-08-22T00:25:23.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666762ef0 0x564666757d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 4 client.8517 mds_command: new command op to 8361 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 --> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646664eeef0 con 0x564666762ef0 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666762ef0 0x564666757d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd5057fa700 10 client.8517 ms_handle_connect on v2:172.21.15.98:6835/1960772363 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.515+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666762ef0 0x564666757d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=90121f7c6b5c2ed0 server_cookie=a8cb4ae9521b9cae in_seq=0 out_seq=0 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd5057fa700 1 -- 172.21.15.98:0/3283799370 <== mds.0 v2:172.21.15.98:6835/1960772363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5646664eeef0 con 0x564666762ef0 2023-08-22T00:25:23.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd5057fa700 10 client.8517 handle_command_reply: tid=0 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 client.8517 shutdown 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 msgr2=0x56466675afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd528068a30 tx=0x7fd52000b040).stop 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 shutdown_connections 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666762ef0 0x564666757d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466672faf0 0x56466675f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd5057fa700 0 client.8517 ms_handle_reset on v2:172.21.15.98:6835/1960772363 2023-08-22T00:25:23.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466677cf60 0x56466675afd0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3283799370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x5646667779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 >> 172.21.15.98:0/3283799370 conn(0x56466659e940 msgr2=0x564666732330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 shutdown_connections 2023-08-22T00:25:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3283799370 wait complete. 2023-08-22T00:25:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.516+0000 7fd53ef96b80 20 client.8517 trim_cache size 0 max 16384 2023-08-22T00:25:23.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.532+0000 7fd53ef96b80 1 Processor -- start 2023-08-22T00:25:23.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.532+0000 7fd53ef96b80 1 -- start start 2023-08-22T00:25:23.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466677d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x56466677d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666779470 con 0x56466672faf0 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666762ca0 con 0x5646667342c0 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x564666762880 con 0x56466677cf60 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39910/0 (socket says 172.21.15.98:39910) 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 -- 172.21.15.98:0/3037019957 learned_addr learned my addr 172.21.15.98:0/3037019957 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 -- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 msgr2=0x56466677d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x56466677d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 -- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 msgr2=0x56466677d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.533+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466677d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd526ffd700 1 -- 172.21.15.98:0/3037019957 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56466667a580 con 0x56466672faf0 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd518077960 tx=0x7fd51801f070).ready entity=mon.0 client_cookie=d98749f69bf83605 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd50cff9700 1 -- 172.21.15.98:0/3037019957 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518053ca0 con 0x56466672faf0 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd50cff9700 1 -- 172.21.15.98:0/3037019957 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518011bd0 con 0x56466672faf0 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd50cff9700 1 -- 172.21.15.98:0/3037019957 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51804c900 con 0x56466672faf0 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3037019957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 msgr2=0x564666762390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd518077960 tx=0x7fd51801f070).stop 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3037019957 shutdown_connections 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x56466677d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666762390 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3037019957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466677d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3037019957 >> 172.21.15.98:0/3037019957 conn(0x56466659e940 msgr2=0x564666778610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3037019957 shutdown_connections 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.534+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3037019957 wait complete. 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.535+0000 7fd53ef96b80 1 -- start start 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.535+0000 7fd53ef96b80 1 Processor -- start 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466675a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x564666778540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x564666776150 con 0x56466672faf0 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56466675ad60 con 0x5646667342c0 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646667dedd0 con 0x56466677cf60 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.536+0000 7fd53ef96b80 10 client.0 ll_register_callbacks cb 0x564666626ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39926/0 (socket says 172.21.15.98:39926) 2023-08-22T00:25:23.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 -- 172.21.15.98:0/3754370003 learned_addr learned my addr 172.21.15.98:0/3754370003 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 -- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 msgr2=0x564666778540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x564666778540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 -- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 msgr2=0x56466675a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466675a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 -- 172.21.15.98:0/3754370003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518057040 con 0x56466672faf0 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd526ffd700 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fd518016040 tx=0x7fd51805f000).ready entity=mon.0 client_cookie=ee4f846313beb433 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:25:23.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180775e0 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd518077740 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd51804c6a0 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd51804dc60 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 10 client.8523 fetch_fsmap learned FSMap version 55 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x56466667a2d0 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51806e070 con 0x56466672faf0 2023-08-22T00:25:23.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd518067020 con 0x56466672faf0 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 10 client.8523 fetch_fsmap finished waiting for FSMap version 55 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 10 client.8523 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 20 client.8523 populate_metadata read hostname 'smithi098' 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666778c20 0x5646667df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 4 client.8523 mds_command: new command op to 8361 tid=0[{"prefix": "status"}] 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.537+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 --> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564666524040 con 0x564666778c20 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5267fc700 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666778c20 0x5646667df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5057fa700 10 client.8523 ms_handle_connect on v2:172.21.15.98:6835/1960772363 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5267fc700 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666778c20 0x5646667df260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=afd94ba88689d9c6 server_cookie=ef1606f1e1ef9f55 in_seq=0 out_seq=0 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5057fa700 1 -- 172.21.15.98:0/3754370003 <== mds.0 v2:172.21.15.98:6835/1960772363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x564666524040 con 0x564666778c20 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5057fa700 10 client.8523 handle_command_reply: tid=0 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 client.8523 shutdown 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 msgr2=0x564666775970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fd518016040 tx=0x7fd51805f000).stop 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 shutdown_connections 2023-08-22T00:25:23.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:6835/1960772363,v1:172.21.15.98:6837/1960772363] conn(0x564666778c20 0x5646667df260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56466677cf60 0x564666778540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56466672faf0 0x564666775970 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd5057fa700 0 client.8523 ms_handle_reset on v2:172.21.15.98:6835/1960772363 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 --2- 172.21.15.98:0/3754370003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5646667342c0 0x56466675a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 >> 172.21.15.98:0/3754370003 conn(0x56466659e940 msgr2=0x56466678b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 shutdown_connections 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 1 -- 172.21.15.98:0/3754370003 wait complete. 2023-08-22T00:25:23.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.538+0000 7fd53ef96b80 20 client.8523 trim_cache size 0 max 16384 2023-08-22T00:25:23.552 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:25:23.552 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:25:23.552 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:25:23.552 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 8361, 2023-08-22T00:25:23.552 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 4.7036745370000004, 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 55, 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 152, 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 152, 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 9.2040578800000006 2023-08-22T00:25:23.553 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 msgr2=0x7fd5140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 0x7fd5140613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd5280ac960 tx=0x7fd51c016000).stop 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 msgr2=0x7fd528151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fd518004760 tx=0x7fd518001e70).stop 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 shutdown_connections 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5280a6030 0x7fd5280a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003e00 0x7fd528151210 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fd51405ef30 0x7fd5140613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 --2- 172.21.15.98:0/615729753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd528153160 0x7fd528149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 >> 172.21.15.98:0/615729753 conn(0x7fd5280c3170 msgr2=0x7fd5280c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 shutdown_connections 2023-08-22T00:25:23.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.539+0000 7fd52d5e2700 1 -- 172.21.15.98:0/615729753 wait complete. 2023-08-22T00:25:23.556 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:25:23.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.659+0000 7f83df6c4700 1 Processor -- start 2023-08-22T00:25:23.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.659+0000 7f83df6c4700 1 -- start start 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f83d8067200 0x7f83d80675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d81578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83d8157d90 0x7f83d81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80c6930 con 0x7f83d8067200 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80c7750 con 0x7f83d8157d90 2023-08-22T00:25:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83df6c4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8068060 con 0x7f83d80c64b0 2023-08-22T00:25:23.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f83d8067200 0x7f83d80675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f83d8067200 0x7f83d80675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39936/0 (socket says 172.21.15.98:39936) 2023-08-22T00:25:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 -- 172.21.15.98:0/4190462954 learned_addr learned my addr 172.21.15.98:0/4190462954 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dcc5f700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d81578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 -- 172.21.15.98:0/4190462954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 msgr2=0x7f83d81578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d81578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 -- 172.21.15.98:0/4190462954 >> v2:172.21.15.118:3300/0 conn(0x7f83d8157d90 msgr2=0x7f83d81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 --2- 172.21.15.98:0/4190462954 >> v2:172.21.15.118:3300/0 conn(0x7f83d8157d90 0x7f83d81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.660+0000 7f83dd460700 1 -- 172.21.15.98:0/4190462954 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d81586b0 con 0x7f83d8067200 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83dd460700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8067200 0x7f83d80675e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f83d80c32e0 tx=0x7f83c80090f0).ready entity=mon.0 client_cookie=56ec29fd79c23b89 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83cffff700 1 -- 172.21.15.98:0/4190462954 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800b600 con 0x7f83d8067200 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83cffff700 1 -- 172.21.15.98:0/4190462954 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800b760 con 0x7f83d8067200 2023-08-22T00:25:23.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83cffff700 1 -- 172.21.15.98:0/4190462954 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800bb00 con 0x7f83d8067200 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 -- 172.21.15.98:0/4190462954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8067200 msgr2=0x7f83d80675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8067200 0x7f83d80675e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f83d80c32e0 tx=0x7f83c80090f0).stop 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 -- 172.21.15.98:0/4190462954 shutdown_connections 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 --2- 172.21.15.98:0/4190462954 >> v2:172.21.15.118:3300/0 conn(0x7f83d8157d90 0x7f83d81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8067200 0x7f83d80675e0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 --2- 172.21.15.98:0/4190462954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d81578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 -- 172.21.15.98:0/4190462954 >> 172.21.15.98:0/4190462954 conn(0x7f83d8063080 msgr2=0x7f83d80c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 -- 172.21.15.98:0/4190462954 shutdown_connections 2023-08-22T00:25:23.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.661+0000 7f83df6c4700 1 -- 172.21.15.98:0/4190462954 wait complete. 2023-08-22T00:25:23.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.662+0000 7f83df6c4700 1 Processor -- start 2023-08-22T00:25:23.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.662+0000 7f83df6c4700 1 -- start start 2023-08-22T00:25:23.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8067200 0x7f83d8144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d80ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80acbb0 con 0x7f83d8157d90 2023-08-22T00:25:23.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80ade60 con 0x7f83d8067200 2023-08-22T00:25:23.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83df6c4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8144bf0 con 0x7f83d80c64b0 2023-08-22T00:25:23.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83ddc61700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83ddc61700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39948/0 (socket says 172.21.15.98:39948) 2023-08-22T00:25:23.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.663+0000 7f83ddc61700 1 -- 172.21.15.98:0/412020855 learned_addr learned my addr 172.21.15.98:0/412020855 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83dcc5f700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d80ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 -- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 msgr2=0x7f83d80ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d80ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 -- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8067200 msgr2=0x7f83d8144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8067200 0x7f83d8144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 -- 172.21.15.98:0/412020855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009370 con 0x7f83d8157d90 2023-08-22T00:25:23.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83dcc5f700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d80ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:23.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83ddc61700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f83d000b7f0 tx=0x7f83d0009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000d600 con 0x7f83d8157d90 2023-08-22T00:25:23.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d000d780 con 0x7f83d8157d90 2023-08-22T00:25:23.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d80ad9d0 con 0x7f83d8157d90 2023-08-22T00:25:23.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000db40 con 0x7f83d8157d90 2023-08-22T00:25:23.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.664+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d80acdc0 con 0x7f83d8157d90 2023-08-22T00:25:23.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.665+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8047480 con 0x7f83d8157d90 2023-08-22T00:25:23.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.665+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f83d0019460 con 0x7f83d8157d90 2023-08-22T00:25:23.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.666+0000 7f83cd7fa700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:23.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.666+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f83d007a2c0 con 0x7f83d8157d90 2023-08-22T00:25:23.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.666+0000 7f83dd460700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:23.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.666+0000 7f83dd460700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 0x7f83bc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f83c800b3c0 tx=0x7f83c8017000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:23.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.670+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83d004b3f0 con 0x7f83d8157d90 2023-08-22T00:25:23.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.873+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83d80adb60 con 0x7f83d8157d90 2023-08-22T00:25:23.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.873+0000 7f83cd7fa700 1 -- 172.21.15.98:0/412020855 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f83d004ea10 con 0x7f83d8157d90 2023-08-22T00:25:23.875 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:25:23.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 msgr2=0x7f83bc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 0x7f83bc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f83c800b3c0 tx=0x7f83c8017000).stop 2023-08-22T00:25:23.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 msgr2=0x7f83d80c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:23.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f83d000b7f0 tx=0x7f83d0009330).stop 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 shutdown_connections 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d8157d90 0x7f83d80c4530 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8067200 0x7f83d8144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 --2- 172.21.15.98:0/412020855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d80c64b0 0x7f83d80ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 >> 172.21.15.98:0/412020855 conn(0x7f83d8063080 msgr2=0x7f83d80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:23.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 shutdown_connections 2023-08-22T00:25:23.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:23.875+0000 7f83df6c4700 1 -- 172.21.15.98:0/412020855 wait complete. 2023-08-22T00:25:23.888 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:25:23.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:25:23.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:25:23.889 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:25:23.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:23.890 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:25:23.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:25:23.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:25:23.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:25:23.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:23.892 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:25:23.911 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:25:23.911 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:25:23.911 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:25:23.912 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:25:23.913 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41382sec preferred_lft 41382sec 2023-08-22T00:25:23.914 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:25:23.914 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.915 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:25:23.915 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:25:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:25:23.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:23.918 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:25:23.977 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:25:23.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:23.980 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:25:24.044 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:25:24.045 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:25:24.045 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:25:24.045 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:25:24.045 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:25:24.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:24.047 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:25:24.047 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:25:24.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:25:24.049 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:25:24.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:25:24.051 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:25:24.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:24.155 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:25:24.176 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:25:24.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:24.177 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:25:24.243 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:25:24.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:24.244 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:24.302 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:25:24.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:25:24.372 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:25:24.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:25:24.439 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:25:24.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:25:24.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:24.441 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:25:24.499 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:25:24.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:24.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:25:24.568 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:25:24.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:25:24.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:25:24.622+0000 7f9208c6a3c0 -1 init, newargv = 0x55623f5129c0 newargc=15 2023-08-22T00:25:24.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[164302]: starting ceph client 2023-08-22T00:25:24.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[164302]: starting fuse 2023-08-22T00:25:24.636 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:25:24.637 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:25:24.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:24.638 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:25:24.699 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:25:24.700 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:25:24.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:25:24.701 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:25:24.701 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:25:24.706 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:25:24.711 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:25:24.712 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:25:24.712 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:25:24.713 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:25:24.713 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:25:24.713 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:25:24.713 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:25:24.714 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:25:24.714 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:25:24.714 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:25:24.715 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:25:24.715 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:25:24.715 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:25:24.716 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:25:24.716 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:25:24.716 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:25:24.717 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:25:24.717 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:25:24.717 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:25:24.718 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:25:24.718 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:25:24.718 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:25:24.719 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:25:24.749 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:25:24.744+0000 7fb2603b5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:25:24.821 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.164302.asok 2023-08-22T00:25:25.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.164302.asok 2023-08-22T00:25:25.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:25.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.164302.asok status 2023-08-22T00:25:25.157 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:25:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:25:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:25:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:25:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "164302", 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:25:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 8535, 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 8535 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:25:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:25:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:25:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 468899261 2023-08-22T00:25:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:25:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:25:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:25:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 468899261 2023-08-22T00:25:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.8535 192.168.0.1:0/468899261", 2023-08-22T00:25:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/468899261", 2023-08-22T00:25:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:25:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 55, 2023-08-22T00:25:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 152, 2023-08-22T00:25:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:25:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:25:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:25:25.169 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:25:25.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:25.171 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:25:25.172 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:25.192 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:25:25.193 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:25.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:25.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:25.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:25:25.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.417+0000 7f140e964700 1 Processor -- start 2023-08-22T00:25:25.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.417+0000 7f140e964700 1 -- start start 2023-08-22T00:25:25.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140e964700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14080a6e60 0x7f1408067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140e964700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1408154fc0 0x7f1408064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140e964700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1408154b30 con 0x7f14080a6a80 2023-08-22T00:25:25.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140e964700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1408066820 con 0x7f1408154fc0 2023-08-22T00:25:25.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140e964700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14081547e0 con 0x7f14080a6e60 2023-08-22T00:25:25.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1408154fc0 0x7f1408064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1408154fc0 0x7f1408064fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39964/0 (socket says 172.21.15.98:39964) 2023-08-22T00:25:25.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 -- 172.21.15.98:0/1674013038 learned_addr learned my addr 172.21.15.98:0/1674013038 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:25.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 -- 172.21.15.98:0/1674013038 >> v2:172.21.15.118:3300/0 conn(0x7f14080a6e60 msgr2=0x7f1408067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 --2- 172.21.15.98:0/1674013038 >> v2:172.21.15.118:3300/0 conn(0x7f14080a6e60 0x7f1408067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:25.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 -- 172.21.15.98:0/1674013038 >> v1:172.21.15.118:6789/0 conn(0x7f14080a6a80 legacy=0x7f1408066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 -- 172.21.15.98:0/1674013038 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408068260 con 0x7f1408154fc0 2023-08-22T00:25:25.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.418+0000 7f140cf01700 1 --2- 172.21.15.98:0/1674013038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1408154fc0 0x7f1408064fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f14080c1b40 tx=0x7f1400009840).ready entity=mon.0 client_cookie=ecfb39e20f41268c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f1406ffd700 1 -- 172.21.15.98:0/1674013038 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000e070 con 0x7f1408154fc0 2023-08-22T00:25:25.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f1406ffd700 1 -- 172.21.15.98:0/1674013038 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000ba10 con 0x7f1408154fc0 2023-08-22T00:25:25.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f1406ffd700 1 -- 172.21.15.98:0/1674013038 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000bd90 con 0x7f1408154fc0 2023-08-22T00:25:25.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 -- 172.21.15.98:0/1674013038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1408154fc0 msgr2=0x7f1408064fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 --2- 172.21.15.98:0/1674013038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1408154fc0 0x7f1408064fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f14080c1b40 tx=0x7f1400009840).stop 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 -- 172.21.15.98:0/1674013038 shutdown_connections 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 --2- 172.21.15.98:0/1674013038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1408154fc0 0x7f1408064fb0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 --2- 172.21.15.98:0/1674013038 >> v2:172.21.15.118:3300/0 conn(0x7f14080a6e60 0x7f1408067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 -- 172.21.15.98:0/1674013038 >> 172.21.15.98:0/1674013038 conn(0x7f14080c42e0 msgr2=0x7f14080c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 -- 172.21.15.98:0/1674013038 shutdown_connections 2023-08-22T00:25:25.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.419+0000 7f140e964700 1 -- 172.21.15.98:0/1674013038 wait complete. 2023-08-22T00:25:25.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.420+0000 7f140e964700 1 Processor -- start 2023-08-22T00:25:25.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.420+0000 7f140e964700 1 -- start start 2023-08-22T00:25:25.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 0x7f14080a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 0x7f14080a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a7c40 con 0x7f14080a6a80 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408165280 con 0x7f1408154fc0 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140e964700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a92d0 con 0x7f14080a6e60 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f1407fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f1407fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39970/0 (socket says 172.21.15.98:39970) 2023-08-22T00:25:25.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f1407fff700 1 -- 172.21.15.98:0/1390364993 learned_addr learned my addr 172.21.15.98:0/1390364993 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:25.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f140cf01700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 0x7f14080a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.421+0000 7f14077fe700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 0x7f14080a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 -- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 msgr2=0x7f14080a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 0x7f14080a7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 -- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 msgr2=0x7f14080a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 0x7f14080a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 -- 172.21.15.98:0/1390364993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009ae0 con 0x7f14080a6a80 2023-08-22T00:25:25.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f14077fe700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 0x7f14080a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:25.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f140cf01700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 0x7f14080a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:25.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f1407fff700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f13fc00b490 tx=0x7f13fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012410 con 0x7f14080a6a80 2023-08-22T00:25:25.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc0125b0 con 0x7f14080a6a80 2023-08-22T00:25:25.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080a95b0 con 0x7f14080a6a80 2023-08-22T00:25:25.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012970 con 0x7f14080a6a80 2023-08-22T00:25:25.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.422+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080a9b70 con 0x7f14080a6a80 2023-08-22T00:25:25.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.423+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408069460 con 0x7f14080a6a80 2023-08-22T00:25:25.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.423+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f13fc012d20 con 0x7f14080a6a80 2023-08-22T00:25:25.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.424+0000 7f13effff700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 0x7f13f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.424+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f13fc079f60 con 0x7f14080a6a80 2023-08-22T00:25:25.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.424+0000 7f14077fe700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 0x7f13f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.424+0000 7f14077fe700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 0x7f13f40613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f14080a8f20 tx=0x7f13f8008040).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.428+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13fc04b0f0 con 0x7f14080a6a80 2023-08-22T00:25:25.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.616+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1408068540 con 0x7f13f405ef30 2023-08-22T00:25:25.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.617+0000 7f13effff700 1 -- 172.21.15.98:0/1390364993 <== mgr.8181 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1408068540 con 0x7f13f405ef30 2023-08-22T00:25:25.624 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:25:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:25:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:25.625 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:25:25.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 msgr2=0x7f13f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 0x7f13f40613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f14080a8f20 tx=0x7f13f8008040).stop 2023-08-22T00:25:25.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 msgr2=0x7f1408063280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f13fc00b490 tx=0x7f13fc009060).stop 2023-08-22T00:25:25.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 shutdown_connections 2023-08-22T00:25:25.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1408154fc0 0x7f14080a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14080a6a80 0x7f1408063280 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f13f405ef30 0x7f13f40613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 --2- 172.21.15.98:0/1390364993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14080a6e60 0x7f14080a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 >> 172.21.15.98:0/1390364993 conn(0x7f14080c42e0 msgr2=0x7f14080c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:25.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 shutdown_connections 2023-08-22T00:25:25.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.619+0000 7f140e964700 1 -- 172.21.15.98:0/1390364993 wait complete. 2023-08-22T00:25:25.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:25:25.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.753+0000 7f0b893f6700 1 Processor -- start 2023-08-22T00:25:25.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.753+0000 7f0b893f6700 1 -- start start 2023-08-22T00:25:25.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b893f6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b84062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b893f6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b84063380 0x7f0b840c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b893f6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b84063f90 con 0x7f0b840c2400 2023-08-22T00:25:25.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b893f6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b840656f0 con 0x7f0b84063380 2023-08-22T00:25:25.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b893f6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840637e0 con 0x7f0b841505e0 2023-08-22T00:25:25.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b837fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0b840c2400 0x7f0b840bb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55068/0 (socket says 172.21.15.98:55068) 2023-08-22T00:25:25.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b837fe700 1 -- 172.21.15.98:0/375809619 learned_addr learned my addr 172.21.15.98:0/375809619 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:25.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801326025 0 0) 0x7f0b84063f90 con 0x7f0b840c2400 2023-08-22T00:25:25.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c004500 con 0x7f0b840c2400 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b82ffd700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b84062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b827fc700 1 --2- 172.21.15.98:0/375809619 >> v2:172.21.15.118:3300/0 conn(0x7f0b84063380 0x7f0b840c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949874334 0 0) 0x7f0b6c004500 con 0x7f0b840c2400 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 msgr2=0x7f0b84062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b84062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 >> v2:172.21.15.118:3300/0 conn(0x7f0b84063380 msgr2=0x7f0b840c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 --2- 172.21.15.98:0/375809619 >> v2:172.21.15.118:3300/0 conn(0x7f0b84063380 0x7f0b840c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b841509c0 con 0x7f0b840c2400 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f0b7c0017f0 con 0x7f0b840c2400 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.754+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 >> v1:172.21.15.98:6789/0 conn(0x7f0b840c2400 legacy=0x7f0b840bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b6c0049f0 0x7f0b6c004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b6c005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b6c006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840656f0 con 0x7f0b6c0057a0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840637e0 con 0x7f0b6c0049f0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c00c9f0 con 0x7f0b841505e0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b6c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b82ffd700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b6c0049f0 0x7f0b6c004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b837fe700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b6c006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 -- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 msgr2=0x7f0b6c006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b6c006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 -- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b6c0049f0 msgr2=0x7f0b6c004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b6c0049f0 0x7f0b6c004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 -- 172.21.15.98:0/375809619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c004500 con 0x7f0b6c0057a0 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b837fe700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b841505e0 0x7f0b6c006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b827fc700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b6c005c20 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f0b840688c0 tx=0x7f0b74009060).ready entity=mon.0 client_cookie=22f19bfabca8ed0d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74009e90 con 0x7f0b6c0057a0 2023-08-22T00:25:25.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74009430 con 0x7f0b6c0057a0 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.755+0000 7f0b81ffb700 1 -- 172.21.15.98:0/375809619 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400e850 con 0x7f0b6c0057a0 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 -- 172.21.15.98:0/375809619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 msgr2=0x7f0b6c005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 --2- 172.21.15.98:0/375809619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b6c005c20 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f0b840688c0 tx=0x7f0b74009060).stop 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b837fe700 1 -- 172.21.15.98:0/375809619 reap_dead start 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 -- 172.21.15.98:0/375809619 shutdown_connections 2023-08-22T00:25:25.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 -- 172.21.15.98:0/375809619 >> 172.21.15.98:0/375809619 conn(0x7f0b840c31d0 msgr2=0x7f0b840c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:25.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 -- 172.21.15.98:0/375809619 shutdown_connections 2023-08-22T00:25:25.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.756+0000 7f0b893f6700 1 -- 172.21.15.98:0/375809619 wait complete. 2023-08-22T00:25:25.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.757+0000 7f0b893f6700 1 Processor -- start 2023-08-22T00:25:25.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.757+0000 7f0b893f6700 1 -- start start 2023-08-22T00:25:25.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b84153e20 0x7f0b8415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b84065f60 0x7f0b840663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840bd850 con 0x7f0b6c0057a0 2023-08-22T00:25:25.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840bdb30 con 0x7f0b84065f60 2023-08-22T00:25:25.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b893f6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84066890 con 0x7f0b84153e20 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b82ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b82ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39984/0 (socket says 172.21.15.98:39984) 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.758+0000 7f0b82ffd700 1 -- 172.21.15.98:0/914008754 learned_addr learned my addr 172.21.15.98:0/914008754 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b837fe700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b84065f60 0x7f0b840663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b827fc700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b84153e20 0x7f0b8415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 -- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b84153e20 msgr2=0x7f0b8415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b84153e20 0x7f0b8415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 -- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b84065f60 msgr2=0x7f0b840663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b84065f60 0x7f0b840663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 -- 172.21.15.98:0/914008754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84154650 con 0x7f0b6c0057a0 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b82ffd700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f0b780119f0 tx=0x7f0b78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800f940 con 0x7f0b6c0057a0 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7800faa0 con 0x7f0b6c0057a0 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b84154930 con 0x7f0b6c0057a0 2023-08-22T00:25:25.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800fe20 con 0x7f0b6c0057a0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.759+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841542a0 con 0x7f0b6c0057a0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.760+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84063d70 con 0x7f0b6c0057a0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.760+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 63) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0b78014650 con 0x7f0b6c0057a0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.761+0000 7f0b6affd700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 0x7f0b700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.761+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0b7807ad20 con 0x7f0b6c0057a0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.761+0000 7f0b827fc700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 0x7f0b700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.761+0000 7f0b827fc700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 0x7f0b700613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0b740095a0 tx=0x7f0b7401a000).ready entity=mgr.8181 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:25.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.765+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b7804beb0 con 0x7f0b6c0057a0 2023-08-22T00:25:25.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:25.968+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0b84046c20 con 0x7f0b6c0057a0 2023-08-22T00:25:26.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.956+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 64) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f0b78078810 con 0x7f0b6c0057a0 2023-08-22T00:25:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.958+0000 7f0b6affd700 1 -- 172.21.15.98:0/914008754 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v64) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0b78070a50 con 0x7f0b6c0057a0 2023-08-22T00:25:26.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 msgr2=0x7f0b700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:26.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 0x7f0b700613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0b740095a0 tx=0x7f0b7401a000).stop 2023-08-22T00:25:26.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 msgr2=0x7f0b84160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:26.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f0b780119f0 tx=0x7f0b78009060).stop 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 shutdown_connections 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b84065f60 0x7f0b840663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b6c0057a0 0x7f0b84160890 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f0b7005ef30 0x7f0b700613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 --2- 172.21.15.98:0/914008754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b84153e20 0x7f0b8415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 >> 172.21.15.98:0/914008754 conn(0x7f0b840c31d0 msgr2=0x7f0b84062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:26.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 shutdown_connections 2023-08-22T00:25:26.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:26.961+0000 7f0b893f6700 1 -- 172.21.15.98:0/914008754 wait complete. 2023-08-22T00:25:26.976 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:25:27.099 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:27.098+0000 7f324ae44680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:27.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.102+0000 7f6197663700 1 Processor -- start 2023-08-22T00:25:27.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.103+0000 7f6197663700 1 -- start start 2023-08-22T00:25:27.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6197663700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6190155270 0x7f61900a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6197663700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 0x7f61900c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6197663700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61901560a0 con 0x7f6190154e90 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6197663700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61900a7070 con 0x7f6190155270 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6197663700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6190155770 con 0x7f61900a6c30 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6190155270 0x7f61900a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6190155270 0x7f61900a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40000/0 (socket says 172.21.15.98:40000) 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 -- 172.21.15.98:0/2894891361 learned_addr learned my addr 172.21.15.98:0/2894891361 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:27.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6195c00700 1 --2- 172.21.15.98:0/2894891361 >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 0x7f61900c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.107 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f5a8e282680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:27.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 -- 172.21.15.98:0/2894891361 >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 msgr2=0x7f61900c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:27.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 --2- 172.21.15.98:0/2894891361 >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 0x7f61900c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 -- 172.21.15.98:0/2894891361 >> v1:172.21.15.118:6789/0 conn(0x7f6190154e90 legacy=0x7f61900640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 -- 172.21.15.98:0/2894891361 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190155a50 con 0x7f6190155270 2023-08-22T00:25:27.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6195c00700 1 --2- 172.21.15.98:0/2894891361 >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 0x7f61900c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6194bfe700 1 --2- 172.21.15.98:0/2894891361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190155270 0x7f61900a6740 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f61900c1ad0 tx=0x7f618c0090f0).ready entity=mon.0 client_cookie=142a6769872d3755 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.104+0000 7f6187fff700 1 -- 172.21.15.98:0/2894891361 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00b600 con 0x7f6190155270 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6187fff700 1 -- 172.21.15.98:0/2894891361 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c00b760 con 0x7f6190155270 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6187fff700 1 -- 172.21.15.98:0/2894891361 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00bb00 con 0x7f6190155270 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 -- 172.21.15.98:0/2894891361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190155270 msgr2=0x7f61900a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 --2- 172.21.15.98:0/2894891361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190155270 0x7f61900a6740 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f61900c1ad0 tx=0x7f618c0090f0).stop 2023-08-22T00:25:27.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 -- 172.21.15.98:0/2894891361 shutdown_connections 2023-08-22T00:25:27.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 --2- 172.21.15.98:0/2894891361 >> v2:172.21.15.118:3300/0 conn(0x7f61900a6c30 0x7f61900c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 --2- 172.21.15.98:0/2894891361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190155270 0x7f61900a6740 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 -- 172.21.15.98:0/2894891361 >> 172.21.15.98:0/2894891361 conn(0x7f61900c7800 msgr2=0x7f61900c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:27.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 -- 172.21.15.98:0/2894891361 shutdown_connections 2023-08-22T00:25:27.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.105+0000 7f6197663700 1 -- 172.21.15.98:0/2894891361 wait complete. 2023-08-22T00:25:27.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.106+0000 7f6197663700 1 Processor -- start 2023-08-22T00:25:27.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.106+0000 7f6197663700 1 -- start start 2023-08-22T00:25:27.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61900a6c30 0x7f61900c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61900a94b0 0x7f6190164340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900c71b0 con 0x7f6190154e90 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900c5dc0 con 0x7f61900a6c30 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6197663700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61900a9930 con 0x7f61900a94b0 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6194bfe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6194bfe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40010/0 (socket says 172.21.15.98:40010) 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f6194bfe700 1 -- 172.21.15.98:0/4229573717 learned_addr learned my addr 172.21.15.98:0/4229573717 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.107+0000 7f61953ff700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61900a6c30 0x7f61900c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6195c00700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61900a94b0 0x7f6190164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 -- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61900a94b0 msgr2=0x7f6190164340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61900a94b0 0x7f6190164340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 -- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61900a6c30 msgr2=0x7f61900c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61900a6c30 0x7f61900c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 -- 172.21.15.98:0/4229573717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009370 con 0x7f6190154e90 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6194bfe700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f618c006fd0 tx=0x7f618c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c006d90 con 0x7f6190154e90 2023-08-22T00:25:27.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c00bec0 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c002f30 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61900c6f30 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.108+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61900c5770 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61900c5f70 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 64) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f618c021070 con 0x7f6190154e90 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f61857fa700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 0x7f6174061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f61953ff700 1 -- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 msgr2=0x7f6174061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:27.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f618c07bba0 con 0x7f6190154e90 2023-08-22T00:25:27.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.110+0000 7f61953ff700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 0x7f6174061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:27.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.114+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61900c5f70 con 0x7f6190154e90 2023-08-22T00:25:27.162 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:27.161+0000 7f324ae44680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:27.172 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:27.170+0000 7f5a8e282680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:27.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.282+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f61900c5f70 con 0x7f6190154e90 2023-08-22T00:25:27.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.285+0000 7f61857fa700 1 -- 172.21.15.98:0/4229573717 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f61900c5f70 con 0x7f6190154e90 2023-08-22T00:25:27.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.287+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 msgr2=0x7f6174061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:27.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.287+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 0x7f6174061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:27.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.287+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 msgr2=0x7f61900a8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.287+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f618c006fd0 tx=0x7f618c017000).stop 2023-08-22T00:25:27.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 shutdown_connections 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f617405ef50 0x7f6174061410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61900a94b0 0x7f6190164340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61900a6c30 0x7f61900c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 --2- 172.21.15.98:0/4229573717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190154e90 0x7f61900a8fc0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 >> 172.21.15.98:0/4229573717 conn(0x7f61900c7800 msgr2=0x7f61900c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:27.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 shutdown_connections 2023-08-22T00:25:27.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.288+0000 7f6197663700 1 -- 172.21.15.98:0/4229573717 wait complete. 2023-08-22T00:25:27.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:27.302 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:25:27.327 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-08-22T00:25:27.434 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:27.434+0000 7f324ae44680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:27.456 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:27.455+0000 7f5a8e282680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.489+0000 7f28b09fc700 1 Processor -- start 2023-08-22T00:25:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.489+0000 7f28b09fc700 1 -- start start 2023-08-22T00:25:27.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.490+0000 7f28b09fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac154f60 0x7f28ac068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.490+0000 7f28b09fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f28ac067600 0x7f28ac0a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.490+0000 7f28b09fc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0a8c70 con 0x7f28ac069210 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.490+0000 7f28b09fc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0a86f0 con 0x7f28ac067600 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.490+0000 7f28b09fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac068210 con 0x7f28ac154f60 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f28ac067600 0x7f28ac0a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a9d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f28ac069210 0x7f28ac066ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55084/0 (socket says 172.21.15.98:55084) 2023-08-22T00:25:27.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a9d9b700 1 -- 172.21.15.98:0/803670170 learned_addr learned my addr 172.21.15.98:0/803670170 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aa59c700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac154f60 0x7f28ac068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a959a700 1 -- 172.21.15.98:0/803670170 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032554543 0 0) 0x7f28ac0a8c70 con 0x7f28ac069210 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a959a700 1 -- 172.21.15.98:0/803670170 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28940033f0 con 0x7f28ac069210 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 -- 172.21.15.98:0/803670170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac154f60 msgr2=0x7f28ac068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac154f60 0x7f28ac068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 -- 172.21.15.98:0/803670170 >> v1:172.21.15.98:6789/0 conn(0x7f28ac069210 legacy=0x7f28ac066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 -- 172.21.15.98:0/803670170 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac069690 con 0x7f28ac067600 2023-08-22T00:25:27.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28aad9d700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac067600 0x7f28ac0a9100 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f28a4009e60 tx=0x7f28a4009780).ready entity=mon.0 client_cookie=13b619e5e1e4845b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:27.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a959a700 1 -- 172.21.15.98:0/803670170 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400e070 con 0x7f28ac067600 2023-08-22T00:25:27.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a959a700 1 -- 172.21.15.98:0/803670170 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400bab0 con 0x7f28ac067600 2023-08-22T00:25:27.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.491+0000 7f28a959a700 1 -- 172.21.15.98:0/803670170 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400be30 con 0x7f28ac067600 2023-08-22T00:25:27.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 -- 172.21.15.98:0/803670170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac067600 msgr2=0x7f28ac0a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac067600 0x7f28ac0a9100 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f28a4009e60 tx=0x7f28a4009780).stop 2023-08-22T00:25:27.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 -- 172.21.15.98:0/803670170 shutdown_connections 2023-08-22T00:25:27.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac067600 0x7f28ac0a9100 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 --2- 172.21.15.98:0/803670170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac154f60 0x7f28ac068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 -- 172.21.15.98:0/803670170 >> 172.21.15.98:0/803670170 conn(0x7f28ac0c5dd0 msgr2=0x7f28ac068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:27.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 -- 172.21.15.98:0/803670170 shutdown_connections 2023-08-22T00:25:27.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.492+0000 7f28b09fc700 1 -- 172.21.15.98:0/803670170 wait complete. 2023-08-22T00:25:27.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.493+0000 7f28b09fc700 1 Processor -- start 2023-08-22T00:25:27.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.493+0000 7f28b09fc700 1 -- start start 2023-08-22T00:25:27.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac067600 0x7f28ac0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ac154f60 0x7f28ac152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0aca30 con 0x7f28ac069210 2023-08-22T00:25:27.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c08d0 con 0x7f28ac154f60 2023-08-22T00:25:27.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28b09fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c1130 con 0x7f28ac067600 2023-08-22T00:25:27.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28a9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28a9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40034/0 (socket says 172.21.15.98:40034) 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.494+0000 7f28a9d9b700 1 -- 172.21.15.98:0/4168135261 learned_addr learned my addr 172.21.15.98:0/4168135261 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac067600 0x7f28ac0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28aad9d700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ac154f60 0x7f28ac152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac067600 msgr2=0x7f28ac0ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac067600 0x7f28ac0ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ac154f60 msgr2=0x7f28ac152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:27.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ac154f60 0x7f28ac152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:27.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4009a20 con 0x7f28ac069210 2023-08-22T00:25:27.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28a9d9b700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f28a000c4c0 tx=0x7f28a0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:27.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000ce30 con 0x7f28ac069210 2023-08-22T00:25:27.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00072e0 con 0x7f28ac069210 2023-08-22T00:25:27.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0ac750 con 0x7f28ac069210 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00057a0 con 0x7f28ac069210 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.495+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac0c0dc0 con 0x7f28ac069210 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.496+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac047480 con 0x7f28ac069210 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.496+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 64) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f28a0005b50 con 0x7f28ac069210 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.497+0000 7f289a7fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.497+0000 7f28aa59c700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:27.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.497+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f28a0079880 con 0x7f28ac069210 2023-08-22T00:25:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.497+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:27.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.501+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28a004a980 con 0x7f28ac069210 2023-08-22T00:25:27.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.695+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f28ac06b0a0 con 0x7f288c05ef80 2023-08-22T00:25:27.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.698+0000 7f28aa59c700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:27.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:27.698+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:28.045 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.044+0000 7f324ae44680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:28.076 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:28.072+0000 7f5a8e282680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:28.099+0000 7f28aa59c700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:28.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:28.099+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:25:28.117 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.116+0000 7f324ae44680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:28.148 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:28.144+0000 7f5a8e282680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:28.302 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.301+0000 7f324ae44680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:28.330 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:28.328+0000 7f5a8e282680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:28.719 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.719+0000 7f324ae44680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:28.747 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:28.746+0000 7f5a8e282680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:28.823 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.822+0000 7f324ae44680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:28.850 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:28.848+0000 7f5a8e282680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:28.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:28.900+0000 7f28aa59c700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:28.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:28.900+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:25:28.975 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:28.974+0000 7f324ae44680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:29.002 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:29.001+0000 7f5a8e282680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:29.049 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:29.048+0000 7f324ae44680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:29.076 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:29.075+0000 7f5a8e282680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:29.118 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:29.116+0000 7f324ae44680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:29.143 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:29.142+0000 7f5a8e282680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:29.371 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:29.369+0000 7f324ae44680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:29.397 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:29.395+0000 7f5a8e282680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:29.556 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:29.551+0000 7f324ae44680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:29.580 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:29.579+0000 7f5a8e282680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:30.200 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.199+0000 7f324ae44680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:30.229 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.228+0000 7f5a8e282680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:30.271 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.268+0000 7f324ae44680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:30.299 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.297+0000 7f5a8e282680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:30.346 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.344+0000 7f324ae44680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:30.373 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.372+0000 7f5a8e282680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:30.493 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.492+0000 7f324ae44680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:30.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:30.501+0000 7f28aa59c700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:30.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:30.501+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:25:30.520 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.518+0000 7f5a8e282680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:30.563 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.563+0000 7f324ae44680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:30.590 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.589+0000 7f5a8e282680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:30.678 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.677+0000 7f324ae44680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:30.706 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.704+0000 7f5a8e282680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:30.786 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:30.785+0000 7f324ae44680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:30.813 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:30.812+0000 7f5a8e282680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:31.075 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:31.074+0000 7f324ae44680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:31.109 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.102+0000 7f5a8e282680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:31.146 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:31.146+0000 7f324ae44680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:31.176 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.173+0000 7f5a8e282680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:31.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:31.192+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 65) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f28a00772e0 con 0x7f28ac069210 2023-08-22T00:25:31.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:31.192+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:31.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:31.192+0000 7f289a7fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:31.243 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a0bd32700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.243 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a0bd32700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.243 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a0bd32700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a0bd32700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a0bd32700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a07d2a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a07d2a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a07d2a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.245 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a07d2a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:31.245 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:31.242+0000 7f5a07d2a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:32.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.196+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 66) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f28a0077660 con 0x7f28ac069210 2023-08-22T00:25:32.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.196+0000 7f289a7fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.196+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f28ac06b0a0 con 0x7f288c05ef80 2023-08-22T00:25:32.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.197+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.198+0000 7f28aa59c700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c0613c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f289c009510 tx=0x7f289c009060).ready entity=mgr.8562 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.212+0000 7f289a7fc700 1 -- 172.21.15.98:0/4168135261 <== mgr.8562 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f28ac06b0a0 con 0x7f288c05ef80 2023-08-22T00:25:32.214 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:25:32.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 msgr2=0x7f288c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c0613c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f289c009510 tx=0x7f289c009060).stop 2023-08-22T00:25:32.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 msgr2=0x7f28ac0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f28a000c4c0 tx=0x7f28a0007c10).stop 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 shutdown_connections 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f288c05ef80 0x7f288c0613c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28ac067600 0x7f28ac0ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ac154f60 0x7f28ac152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 --2- 172.21.15.98:0/4168135261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28ac069210 0x7f28ac0ab8f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 >> 172.21.15.98:0/4168135261 conn(0x7f28ac0c5dd0 msgr2=0x7f28ac153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:32.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 shutdown_connections 2023-08-22T00:25:32.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.214+0000 7f28b09fc700 1 -- 172.21.15.98:0/4168135261 wait complete. 2023-08-22T00:25:32.232 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:25:32.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-22T00:25:32.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.358+0000 7f9dcb482700 1 Processor -- start 2023-08-22T00:25:32.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.358+0000 7f9dcb482700 1 -- start start 2023-08-22T00:25:32.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dcb482700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dc4153ae0 0x7f9dc40c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dcb482700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dcb482700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc4155360 con 0x7f9dc4157fe0 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dcb482700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc4157b50 con 0x7f9dc4153ae0 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dcb482700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c6390 con 0x7f9dc40bfd80 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dc921e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dc4153ae0 0x7f9dc40c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dc9a1f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9dc4157fe0 0x7f9dc40645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53280/0 (socket says 172.21.15.98:53280) 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dc9a1f700 1 -- 172.21.15.98:0/4052157091 learned_addr learned my addr 172.21.15.98:0/4052157091 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:32.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.359+0000 7f9dc8a1d700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc921e700 1 -- 172.21.15.98:0/4052157091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 msgr2=0x7f9dc40c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc921e700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc921e700 1 -- 172.21.15.98:0/4052157091 >> v1:172.21.15.98:6789/0 conn(0x7f9dc4157fe0 legacy=0x7f9dc40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc3fff700 1 -- 172.21.15.98:0/4052157091 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653178088 0 0) 0x7f9db4001490 con 0x7f9dc4157fe0 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc921e700 1 -- 172.21.15.98:0/4052157091 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4154ac0 con 0x7f9dc4153ae0 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc921e700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40c5ea0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f9dbc009760 tx=0x7f9dbc009060).ready entity=mon.0 client_cookie=6002e53b3c251ec8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc3fff700 1 -- 172.21.15.98:0/4052157091 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00f510 con 0x7f9dc4153ae0 2023-08-22T00:25:32.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc3fff700 1 -- 172.21.15.98:0/4052157091 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00f670 con 0x7f9dc4153ae0 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dc3fff700 1 -- 172.21.15.98:0/4052157091 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00f9f0 con 0x7f9dc4153ae0 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 -- 172.21.15.98:0/4052157091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 msgr2=0x7f9dc40c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40c5ea0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f9dbc009760 tx=0x7f9dbc009060).stop 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 -- 172.21.15.98:0/4052157091 shutdown_connections 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40c5ea0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 --2- 172.21.15.98:0/4052157091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 -- 172.21.15.98:0/4052157091 >> 172.21.15.98:0/4052157091 conn(0x7f9dc40caa50 msgr2=0x7f9dc40cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:32.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.360+0000 7f9dcb482700 1 -- 172.21.15.98:0/4052157091 shutdown_connections 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.361+0000 7f9dcb482700 1 -- 172.21.15.98:0/4052157091 wait complete. 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 Processor -- start 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 -- start start 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc4157fe0 0x7f9dc40ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.362+0000 7f9dcb482700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c3680 con 0x7f9dc4153ae0 2023-08-22T00:25:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dcb482700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c2a70 con 0x7f9dc4157fe0 2023-08-22T00:25:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dcb482700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c2d50 con 0x7f9dc40bfd80 2023-08-22T00:25:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49770/0 (socket says 172.21.15.98:49770) 2023-08-22T00:25:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 -- 172.21.15.98:0/2186750458 learned_addr learned my addr 172.21.15.98:0/2186750458 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:32.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc921e700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc9a1f700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc4157fe0 0x7f9dc40ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 -- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 msgr2=0x7f9dc40c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 -- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc4157fe0 msgr2=0x7f9dc40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc4157fe0 0x7f9dc40ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 -- 172.21.15.98:0/2186750458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0092a0 con 0x7f9dc4153ae0 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc8a1d700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f9db800e900 tx=0x7f9db8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8012600 con 0x7f9dc4153ae0 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db8012760 con 0x7f9dc4153ae0 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc40c3030 con 0x7f9dc4153ae0 2023-08-22T00:25:32.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8012ae0 con 0x7f9dc4153ae0 2023-08-22T00:25:32.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.363+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc40c3b10 con 0x7f9dc4153ae0 2023-08-22T00:25:32.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.364+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4047480 con 0x7f9dc4153ae0 2023-08-22T00:25:32.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.365+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 66) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f9db801b400 con 0x7f9dc4153ae0 2023-08-22T00:25:32.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.365+0000 7f9dc17fa700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 0x7f9db0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.365+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f9db807a220 con 0x7f9dc4153ae0 2023-08-22T00:25:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.365+0000 7f9dc921e700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 0x7f9db0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.365+0000 7f9dc921e700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 0x7f9db0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dbc009fd0 tx=0x7f9dbc017000).ready entity=mgr.8562 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.369+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9db804b5a0 con 0x7f9dc4153ae0 2023-08-22T00:25:32.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.554+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dc40c4900 con 0x7f9db005ed40 2023-08-22T00:25:32.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.558+0000 7f9dc17fa700 1 -- 172.21.15.98:0/2186750458 <== mgr.8562 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9dc40c4900 con 0x7f9db005ed40 2023-08-22T00:25:32.560 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path snap_test_dir1 2023-08-22T00:25:32.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 msgr2=0x7f9db0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 0x7f9db0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dbc009fd0 tx=0x7f9dbc017000).stop 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 msgr2=0x7f9dc40aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f9db800e900 tx=0x7f9db8009060).stop 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 shutdown_connections 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9db005ed40 0x7f9db0061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dc40bfd80 0x7f9dc40c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dc4157fe0 0x7f9dc40ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 --2- 172.21.15.98:0/2186750458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc4153ae0 0x7f9dc40aee80 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 >> 172.21.15.98:0/2186750458 conn(0x7f9dc40caa50 msgr2=0x7f9dc4155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:32.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 shutdown_connections 2023-08-22T00:25:32.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.560+0000 7f9dcb482700 1 -- 172.21.15.98:0/2186750458 wait complete. 2023-08-22T00:25:32.576 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-22T00:25:32.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-22T00:25:32.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.697+0000 7fe820a0c700 1 Processor -- start 2023-08-22T00:25:32.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.697+0000 7fe820a0c700 1 -- start start 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.698+0000 7fe820a0c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c5ea0 0x7fe81c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.698+0000 7fe820a0c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c155360 con 0x7fe81c153ae0 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.698+0000 7fe820a0c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c157b50 con 0x7fe81c1584d0 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe820a0c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0c6320 con 0x7fe81c0c5ea0 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81a59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe81c153ae0 0x7fe81c0bfd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53288/0 (socket says 172.21.15.98:53288) 2023-08-22T00:25:32.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81a59c700 1 -- 172.21.15.98:0/244311590 learned_addr learned my addr 172.21.15.98:0/244311590 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe819d9b700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c5ea0 0x7fe81c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000836442 0 0) 0x7fe80c001110 con 0x7fe81c153ae0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8040033f0 con 0x7fe81c153ae0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9568976 0 0) 0x7fe81c157b50 con 0x7fe81c1584d0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c001110 con 0x7fe81c1584d0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044509317 0 0) 0x7fe8040033f0 con 0x7fe81c153ae0 2023-08-22T00:25:32.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c5ea0 msgr2=0x7fe81c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c5ea0 0x7fe81c157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 >> v1:172.21.15.118:6789/0 conn(0x7fe81c1584d0 legacy=0x7fe81c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c154ac0 con 0x7fe81c153ae0 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe80c001600 con 0x7fe81c153ae0 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 >> v1:172.21.15.98:6789/0 conn(0x7fe81c153ae0 legacy=0x7fe81c0bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe804003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe804004690 0x7fe804004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe804005000 0x7fe80400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0c6320 con 0x7fe804003aa0 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400be30 con 0x7fe804004690 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400bff0 con 0x7fe804005000 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe819d9b700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c5ea0 0x7fe81c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81a59c700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe804003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.699+0000 7fe81ad9d700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe804005000 0x7fe80400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe819d9b700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe804004690 0x7fe804004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 -- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe804005000 msgr2=0x7fe80400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe804005000 0x7fe80400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 -- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe804004690 msgr2=0x7fe804004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe804004690 0x7fe804004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 -- 172.21.15.98:0/244311590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040033f0 con 0x7fe804003aa0 2023-08-22T00:25:32.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe819d9b700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe804004690 0x7fe804004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81a59c700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe804003ea0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe80c00c1e0 tx=0x7fe80c0077c0).ready entity=mon.0 client_cookie=73cd617a92419bf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00cb00 con 0x7fe804003aa0 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c00cc60 con 0x7fe804003aa0 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81959a700 1 -- 172.21.15.98:0/244311590 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0070d0 con 0x7fe804003aa0 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe820a0c700 1 -- 172.21.15.98:0/244311590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 msgr2=0x7fe804003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe820a0c700 1 --2- 172.21.15.98:0/244311590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe804003ea0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe80c00c1e0 tx=0x7fe80c0077c0).stop 2023-08-22T00:25:32.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.700+0000 7fe81ad9d700 1 -- 172.21.15.98:0/244311590 reap_dead start 2023-08-22T00:25:32.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.701+0000 7fe820a0c700 1 -- 172.21.15.98:0/244311590 shutdown_connections 2023-08-22T00:25:32.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.701+0000 7fe820a0c700 1 -- 172.21.15.98:0/244311590 >> 172.21.15.98:0/244311590 conn(0x7fe81c0caa50 msgr2=0x7fe81c0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:32.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.701+0000 7fe820a0c700 1 -- 172.21.15.98:0/244311590 shutdown_connections 2023-08-22T00:25:32.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.701+0000 7fe820a0c700 1 -- 172.21.15.98:0/244311590 wait complete. 2023-08-22T00:25:32.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 Processor -- start 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 -- start start 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe81c0c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81c168560 0x7fe81c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c9d20 0x7fe81c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0c1fe0 con 0x7fe804003aa0 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0ca180 con 0x7fe81c168560 2023-08-22T00:25:32.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe820a0c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c13fef0 con 0x7fe81c0c9d20 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.702+0000 7fe81a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe81c0c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe81c0c1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49782/0 (socket says 172.21.15.98:49782) 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 -- 172.21.15.98:0/2409213891 learned_addr learned my addr 172.21.15.98:0/2409213891 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe819d9b700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81c168560 0x7fe81c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81ad9d700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c9d20 0x7fe81c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 -- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c9d20 msgr2=0x7fe81c152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81c0c9d20 0x7fe81c152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 -- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81c168560 msgr2=0x7fe81c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81c168560 0x7fe81c0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 -- 172.21.15.98:0/2409213891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c1689e0 con 0x7fe804003aa0 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe819d9b700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81c168560 0x7fe81c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe81a59c700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe804003aa0 0x7fe81c0c1af0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fe80400be00 tx=0x7fe80c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c001500 con 0x7fe804003aa0 2023-08-22T00:25:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0046b0 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe820a0c700 1 -- 172.21.15.98:0/2409213891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0c21f0 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c004a50 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.703+0000 7fe820a0c700 1 -- 172.21.15.98:0/2409213891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0c27b0 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.704+0000 7fe820a0c700 1 -- 172.21.15.98:0/2409213891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c047480 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.704+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 66) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fe80c013450 con 0x7fe804003aa0 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.705+0000 7fe80a7fc700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7fc05ed10 0x7fe7fc0611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.705+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fe80c07ad20 con 0x7fe804003aa0 2023-08-22T00:25:32.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.705+0000 7fe819d9b700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7fc05ed10 0x7fe7fc0611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:32.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.705+0000 7fe819d9b700 1 --2- 172.21.15.98:0/2409213891 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fe7fc05ed10 0x7fe7fc0611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe810009270 tx=0x7fe810008040).ready entity=mgr.8562 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:32.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.709+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe80c04c0a0 con 0x7fe804003aa0 2023-08-22T00:25:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.892+0000 7fe820a0c700 1 -- 172.21.15.98:0/2409213891 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe81c0c1fe0 con 0x7fe7fc05ed10 2023-08-22T00:25:32.895 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:32.893+0000 7f5a3afdb700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-22T00:25:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:32.893+0000 7fe80a7fc700 1 -- 172.21.15.98:0/2409213891 <== mgr.8562 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fe81c0c1fe0 con 0x7fe7fc05ed10 2023-08-22T00:25:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-22T00:25:32.904 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-22T00:25:32.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:25:32.906 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:25:32.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:25:33.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.089+0000 7f93e0a61700 1 Processor -- start 2023-08-22T00:25:33.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.090+0000 7f93e0a61700 1 -- start start 2023-08-22T00:25:33.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.090+0000 7f93e0a61700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc065a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.090+0000 7f93e0a61700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc0672d0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.090+0000 7f93e0a61700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc0c1a00 con 0x7f93dc150990 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.090+0000 7f93e0a61700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0666c0 con 0x7f93dc150d70 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93dad9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f93dc0c6b80 0x7f93dc0aa1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53292/0 (socket says 172.21.15.98:53292) 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93dad9d700 1 -- 172.21.15.98:0/4172906785 learned_addr learned my addr 172.21.15.98:0/4172906785 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:33.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d9d9b700 1 --2- 172.21.15.98:0/4172906785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc065a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129935935 0 0) 0x7f93dc0672d0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c40033f0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162840817 0 0) 0x7f93dc0c1a00 con 0x7f93dc150990 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93dc0672d0 con 0x7f93dc150990 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107783507 0 0) 0x7f93c40033f0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d9d9b700 1 -- 172.21.15.98:0/4172906785 >> v1:172.21.15.118:6789/0 conn(0x7f93dc150990 legacy=0x7f93dc0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d9d9b700 1 -- 172.21.15.98:0/4172906785 >> v1:172.21.15.98:6789/0 conn(0x7f93dc0c6b80 legacy=0x7f93dc0aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d9d9b700 1 -- 172.21.15.98:0/4172906785 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0669a0 con 0x7f93dc150d70 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d9d9b700 1 --2- 172.21.15.98:0/4172906785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc065a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f93dc0c1b90 tx=0x7f93cc009060).ready entity=mon.2 client_cookie=6acbcbde283d3df6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.091+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40017f0 con 0x7f93dc150d70 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc011400 con 0x7f93dc150d70 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93d959a700 1 -- 172.21.15.98:0/4172906785 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011780 con 0x7f93dc150d70 2023-08-22T00:25:33.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 -- 172.21.15.98:0/4172906785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 msgr2=0x7f93dc065a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 --2- 172.21.15.98:0/4172906785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc065a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f93dc0c1b90 tx=0x7f93cc009060).stop 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 -- 172.21.15.98:0/4172906785 shutdown_connections 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 --2- 172.21.15.98:0/4172906785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc065a40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 -- 172.21.15.98:0/4172906785 >> 172.21.15.98:0/4172906785 conn(0x7f93dc0c3a60 msgr2=0x7f93dc0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 -- 172.21.15.98:0/4172906785 shutdown_connections 2023-08-22T00:25:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.092+0000 7f93e0a61700 1 -- 172.21.15.98:0/4172906785 wait complete. 2023-08-22T00:25:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.093+0000 7f93e0a61700 1 Processor -- start 2023-08-22T00:25:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.093+0000 7f93e0a61700 1 -- start start 2023-08-22T00:25:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93dc150990 0x7f93dc1454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc152d40 con 0x7f93dc0c6b80 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc152430 con 0x7f93dc150990 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93e0a61700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc1526f0 con 0x7f93dc150d70 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:33.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49794/0 (socket says 172.21.15.98:49794) 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 -- 172.21.15.98:0/124589116 learned_addr learned my addr 172.21.15.98:0/124589116 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93d9d9b700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93dc150990 0x7f93dc1454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93dad9d700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 -- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 msgr2=0x7f93dc149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 -- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93dc150990 msgr2=0x7f93dc1454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.094+0000 7f93da59c700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93dc150990 0x7f93dc1454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:33.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93da59c700 1 -- 172.21.15.98:0/124589116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0092a0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93da59c700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f93d000c490 tx=0x7f93d0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000ce40 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000f470 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000f810 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc1529d0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.095+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc147480 con 0x7f93dc0c6b80 2023-08-22T00:25:33.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.096+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc068970 con 0x7f93dc0c6b80 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.096+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 66) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f93d000fbc0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.096+0000 7f93ca7fc700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 0x7f93bc061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.097+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f93d0079380 con 0x7f93dc0c6b80 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.097+0000 7f93d9d9b700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 0x7f93bc061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.097+0000 7f93d9d9b700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 0x7f93bc061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f93dc151150 tx=0x7f93cc016000).ready entity=mgr.8562 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:33.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.101+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93d004a760 con 0x7f93dc0c6b80 2023-08-22T00:25:33.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.221+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 67) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f93d00770c0 con 0x7f93dc0c6b80 2023-08-22T00:25:33.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:33.307+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f93dc066c80 con 0x7f93dc0c6b80 2023-08-22T00:25:34.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.225+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f93d0077440 con 0x7f93dc0c6b80 2023-08-22T00:25:34.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.226+0000 7f93ca7fc700 1 -- 172.21.15.98:0/124589116 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v68) v1 ==== 93+0+0 (secure 0 0 0) 0x7f93d004b770 con 0x7f93dc0c6b80 2023-08-22T00:25:34.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 msgr2=0x7f93bc061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 0x7f93bc061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f93dc151150 tx=0x7f93cc016000).stop 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 msgr2=0x7f93dc14a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f93d000c490 tx=0x7f93d0007c90).stop 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 shutdown_connections 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f93bc05ed40 0x7f93bc061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93dc150d70 0x7f93dc149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93dc0c6b80 0x7f93dc14a980 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.228+0000 7f93e0a61700 1 --2- 172.21.15.98:0/124589116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93dc150990 0x7f93dc1454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.229+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 >> 172.21.15.98:0/124589116 conn(0x7f93dc0c3a60 msgr2=0x7f93dc0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.229+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 shutdown_connections 2023-08-22T00:25:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.229+0000 7f93e0a61700 1 -- 172.21.15.98:0/124589116 wait complete. 2023-08-22T00:25:34.245 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:25:34.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:34.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:34.339 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:25:34.339 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:25:34.340 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:25:34.340 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:25:34.372 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:34.371+0000 7f9137f8f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:34.381 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:34.377+0000 7fd50920b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:25:34.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[164302]: fuse finished with error 0 and tester_r 0 2023-08-22T00:25:34.384 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:25:34.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:34.385 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:25:34.435 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:34.434+0000 7f9137f8f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:34.444 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:34.442+0000 7fd50920b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:25:34.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:25:34.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:34.446 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:25:34.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:34.465 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:25:34.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:25:34.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:34.466 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:25:34.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:34.508 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:25:34.508 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:25:34.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:25:34.509 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:25:34.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:25:34.528 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:25:34.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:34.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.666+0000 7f5f7f7dc700 1 Processor -- start 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.667+0000 7f5f7f7dc700 1 -- start start 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.667+0000 7f5f7f7dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f78152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7f7dc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5f780c3e50 0x7f5f781556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7f7dc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f78153080 con 0x7f5f7814bf70 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7f7dc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f78066510 con 0x7f5f780c3e50 2023-08-22T00:25:34.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7f7dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780667b0 con 0x7f5f7814c350 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5f780c3e50 0x7f5f781556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7d578700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5f7814bf70 0x7f5f780c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53306/0 (socket says 172.21.15.98:53306) 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7d578700 1 -- 172.21.15.98:0/2611095480 learned_addr learned my addr 172.21.15.98:0/2611095480 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7cd77700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f78152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 -- 172.21.15.98:0/2611095480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 msgr2=0x7f5f78152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f78152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 -- 172.21.15.98:0/2611095480 >> v1:172.21.15.98:6789/0 conn(0x7f5f7814bf70 legacy=0x7f5f780c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f6ffff700 1 -- 172.21.15.98:0/2611095480 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285009081 0 0) 0x7f5f78153080 con 0x7f5f7814bf70 2023-08-22T00:25:34.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 -- 172.21.15.98:0/2611095480 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78155ba0 con 0x7f5f780c3e50 2023-08-22T00:25:34.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f7dd79700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780c3e50 0x7f5f781556b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5f70009e60 tx=0x7f5f70009780).ready entity=mon.0 client_cookie=487101f344ab3a25 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f6ffff700 1 -- 172.21.15.98:0/2611095480 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000e070 con 0x7f5f780c3e50 2023-08-22T00:25:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f6ffff700 1 -- 172.21.15.98:0/2611095480 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000bb60 con 0x7f5f780c3e50 2023-08-22T00:25:34.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.668+0000 7f5f6ffff700 1 -- 172.21.15.98:0/2611095480 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70012410 con 0x7f5f780c3e50 2023-08-22T00:25:34.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2611095480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780c3e50 msgr2=0x7f5f781556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780c3e50 0x7f5f781556b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5f70009e60 tx=0x7f5f70009780).stop 2023-08-22T00:25:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2611095480 shutdown_connections 2023-08-22T00:25:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780c3e50 0x7f5f781556b0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2611095480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f78152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2611095480 >> 172.21.15.98:0/2611095480 conn(0x7f5f780c5dc0 msgr2=0x7f5f78068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2611095480 shutdown_connections 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.669+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2611095480 wait complete. 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.670+0000 7f5f7f7dc700 1 Processor -- start 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.670+0000 7f5f7f7dc700 1 -- start start 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f780c3e50 0x7f5f781497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f7813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780a9270 con 0x7f5f7814bf70 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780a9480 con 0x7f5f780c3e50 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7f7dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780a9760 con 0x7f5f7814c350 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49840/0 (socket says 172.21.15.98:49840) 2023-08-22T00:25:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 -- 172.21.15.98:0/2438975336 learned_addr learned my addr 172.21.15.98:0/2438975336 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7d578700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f780c3e50 0x7f5f781497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7dd79700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f7813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 msgr2=0x7f5f7813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f7813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f780c3e50 msgr2=0x7f5f781497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f780c3e50 0x7f5f781497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.671+0000 7f5f7cd77700 1 -- 172.21.15.98:0/2438975336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009a20 con 0x7f5f7814bf70 2023-08-22T00:25:34.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f7cd77700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5f6800e900 tx=0x7f5f68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:34.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68012600 con 0x7f5f7814bf70 2023-08-22T00:25:34.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68012760 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f780a9a40 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68012ae0 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.672+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f780aa000 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.673+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f780aa1f0 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.673+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5f6801b400 con 0x7f5f7814bf70 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.673+0000 7f5f6d7fa700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 0x7f5f5c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:34.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.674+0000 7f5f7d578700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 msgr2=0x7f5f5c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:34.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.674+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f5f6807a5d0 con 0x7f5f7814bf70 2023-08-22T00:25:34.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.674+0000 7f5f7d578700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 0x7f5f5c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:34.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.678+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f6804b580 con 0x7f5f7814bf70 2023-08-22T00:25:34.717 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:34.716+0000 7f9137f8f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:34.734 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:34.732+0000 7fd50920b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:25:34.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.875+0000 7f5f7d578700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 msgr2=0x7f5f5c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:34.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.875+0000 7f5f7d578700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 0x7f5f5c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:34.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.895+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f78047480 con 0x7f5f7814bf70 2023-08-22T00:25:34.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.896+0000 7f5f6d7fa700 1 -- 172.21.15.98:0/2438975336 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f5f6804eba0 con 0x7f5f7814bf70 2023-08-22T00:25:34.898 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:34.898 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:34.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 msgr2=0x7f5f5c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:34.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 0x7f5f5c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:34.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 msgr2=0x7f5f780a8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:34.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5f6800e900 tx=0x7f5f68009060).stop 2023-08-22T00:25:34.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 shutdown_connections 2023-08-22T00:25:34.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5f5c05efc0 0x7f5f5c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f7814c350 0x7f5f7813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f780c3e50 0x7f5f781497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 --2- 172.21.15.98:0/2438975336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7814bf70 0x7f5f780a8d80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 >> 172.21.15.98:0/2438975336 conn(0x7f5f780c5dc0 msgr2=0x7f5f780c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 shutdown_connections 2023-08-22T00:25:34.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:34.898+0000 7f5f7f7dc700 1 -- 172.21.15.98:0/2438975336 wait complete. 2023-08-22T00:25:34.902 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:34.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:35.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.048+0000 7f3ffb858700 1 Processor -- start 2023-08-22T00:25:35.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.048+0000 7f3ffb858700 1 -- start start 2023-08-22T00:25:35.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ffb858700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3ff414e0d0 0x7f3ff414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ffb858700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 0x7f3ff41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ffb858700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff4155260 con 0x7f3ff40c5a90 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ffb858700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40c17b0 con 0x7f3ff414e0d0 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ffb858700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40bf9e0 con 0x7f3ff41544f0 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3ff414e0d0 0x7f3ff414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3ff414e0d0 0x7f3ff414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49842/0 (socket says 172.21.15.98:49842) 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 -- 172.21.15.98:0/4107859001 learned_addr learned my addr 172.21.15.98:0/4107859001 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff9df5700 1 --2- 172.21.15.98:0/4107859001 >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 0x7f3ff41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 -- 172.21.15.98:0/4107859001 >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 msgr2=0x7f3ff41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 --2- 172.21.15.98:0/4107859001 >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 0x7f3ff41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 -- 172.21.15.98:0/4107859001 >> v1:172.21.15.118:6789/0 conn(0x7f3ff40c5a90 legacy=0x7f3ff40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 -- 172.21.15.98:0/4107859001 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40bfcc0 con 0x7f3ff414e0d0 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff9df5700 1 --2- 172.21.15.98:0/4107859001 >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 0x7f3ff41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:35.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3ff95f4700 1 --2- 172.21.15.98:0/4107859001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff414e4b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f3ff40c68f0 tx=0x7f3ff00090f0).ready entity=mon.0 client_cookie=a81b7c44a88bb2ed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3febfff700 1 -- 172.21.15.98:0/4107859001 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000b600 con 0x7f3ff414e0d0 2023-08-22T00:25:35.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3febfff700 1 -- 172.21.15.98:0/4107859001 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff000b760 con 0x7f3ff414e0d0 2023-08-22T00:25:35.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.050+0000 7f3febfff700 1 -- 172.21.15.98:0/4107859001 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000bae0 con 0x7f3ff414e0d0 2023-08-22T00:25:35.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 -- 172.21.15.98:0/4107859001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 msgr2=0x7f3ff414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 --2- 172.21.15.98:0/4107859001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff414e4b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f3ff40c68f0 tx=0x7f3ff00090f0).stop 2023-08-22T00:25:35.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 -- 172.21.15.98:0/4107859001 shutdown_connections 2023-08-22T00:25:35.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 --2- 172.21.15.98:0/4107859001 >> v2:172.21.15.118:3300/0 conn(0x7f3ff41544f0 0x7f3ff41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 --2- 172.21.15.98:0/4107859001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff414e4b0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 -- 172.21.15.98:0/4107859001 >> 172.21.15.98:0/4107859001 conn(0x7f3ff40caa80 msgr2=0x7f3ff40cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 -- 172.21.15.98:0/4107859001 shutdown_connections 2023-08-22T00:25:35.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.051+0000 7f3ffb858700 1 -- 172.21.15.98:0/4107859001 wait complete. 2023-08-22T00:25:35.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.053+0000 7f3ffb858700 1 Processor -- start 2023-08-22T00:25:35.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.053+0000 7f3ffb858700 1 -- start start 2023-08-22T00:25:35.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.054+0000 7f3ffb858700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff40c5a90 0x7f3ff414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.054+0000 7f3ffb858700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.054+0000 7f3ffb858700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ff41544f0 0x7f3ff40c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.054+0000 7f3ffb858700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40c9c80 con 0x7f3ff414e0d0 2023-08-22T00:25:35.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ffb858700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4165470 con 0x7f3ff40c5a90 2023-08-22T00:25:35.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ffb858700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4150f40 con 0x7f3ff41544f0 2023-08-22T00:25:35.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49844/0 (socket says 172.21.15.98:49844) 2023-08-22T00:25:35.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 -- 172.21.15.98:0/1392197528 learned_addr learned my addr 172.21.15.98:0/1392197528 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff95f4700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff40c5a90 0x7f3ff414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff9df5700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ff41544f0 0x7f3ff40c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 -- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ff41544f0 msgr2=0x7f3ff40c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ff41544f0 0x7f3ff40c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 -- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff40c5a90 msgr2=0x7f3ff414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff40c5a90 0x7f3ff414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 -- 172.21.15.98:0/1392197528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0009370 con 0x7f3ff414e0d0 2023-08-22T00:25:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ff8df3700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f3fe400c440 tx=0x7f3fe4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4007020 con 0x7f3ff414e0d0 2023-08-22T00:25:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe4007180 con 0x7f3ff414e0d0 2023-08-22T00:25:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff4151220 con 0x7f3ff414e0d0 2023-08-22T00:25:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4007520 con 0x7f3ff414e0d0 2023-08-22T00:25:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.055+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4150c70 con 0x7f3ff414e0d0 2023-08-22T00:25:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.056+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff4151740 con 0x7f3ff414e0d0 2023-08-22T00:25:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.057+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f3fe40068b0 con 0x7f3ff414e0d0 2023-08-22T00:25:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.057+0000 7f3fe97fa700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 0x7f3fd8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.057+0000 7f3ff95f4700 1 -- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 msgr2=0x7f3fd8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.057+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f3fe4079c40 con 0x7f3ff414e0d0 2023-08-22T00:25:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.057+0000 7f3ff95f4700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 0x7f3fd8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:35.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.061+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ff4151740 con 0x7f3ff414e0d0 2023-08-22T00:25:35.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.228+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ff4151710 con 0x7f3ff414e0d0 2023-08-22T00:25:35.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.229+0000 7f3fe97fa700 1 -- 172.21.15.98:0/1392197528 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+17644 (secure 0 0 0) 0x7f3fe404ac50 con 0x7f3ff414e0d0 2023-08-22T00:25:35.233 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:35.233 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":153,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:31.187309+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3271729389":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6833/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6832/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/2741359280":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/3064880461":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/4252953891":"2023-08-23T00:25:31.187262+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 msgr2=0x7f3fd8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 0x7f3fd8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 msgr2=0x7f3ff40c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f3fe400c440 tx=0x7f3fe4007dd0).stop 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 shutdown_connections 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f3fd805efc0 0x7f3fd8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ff41544f0 0x7f3ff40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff40c5a90 0x7f3ff414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 --2- 172.21.15.98:0/1392197528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ff414e0d0 0x7f3ff40c92a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 >> 172.21.15.98:0/1392197528 conn(0x7f3ff40caa80 msgr2=0x7f3ff41533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 shutdown_connections 2023-08-22T00:25:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.232+0000 7f3ffb858700 1 -- 172.21.15.98:0/1392197528 wait complete. 2023-08-22T00:25:35.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:25:17.394168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:25:17.784773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:25:35.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:25:35.332 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:35.330+0000 7f9137f8f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:35.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.390+0000 7f78c89eb700 1 Processor -- start 2023-08-22T00:25:35.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.390+0000 7f78c89eb700 1 -- start start 2023-08-22T00:25:35.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.391+0000 7f78c89eb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 0x7f78c41500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.391+0000 7f78c89eb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 0x7f78c40bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.391+0000 7f78c89eb700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c4065fe0 con 0x7f78c414fcf0 2023-08-22T00:25:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.391+0000 7f78c89eb700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c4065df0 con 0x7f78c4062600 2023-08-22T00:25:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.391+0000 7f78c89eb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40c1cc0 con 0x7f78c40a9070 2023-08-22T00:25:35.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c259c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f78c414fcf0 0x7f78c40656e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53322/0 (socket says 172.21.15.98:53322) 2023-08-22T00:25:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c259c700 1 -- 172.21.15.98:0/3908876605 learned_addr learned my addr 172.21.15.98:0/3908876605 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 --2- 172.21.15.98:0/3908876605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 0x7f78c41500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/3908876605 >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 0x7f78c40bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 -- 172.21.15.98:0/3908876605 >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 msgr2=0x7f78c40bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 --2- 172.21.15.98:0/3908876605 >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 0x7f78c40bc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 -- 172.21.15.98:0/3908876605 >> v1:172.21.15.98:6789/0 conn(0x7f78c414fcf0 legacy=0x7f78c40656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c159a700 1 -- 172.21.15.98:0/3908876605 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895019797 0 0) 0x7f78c4065fe0 con 0x7f78c414fcf0 2023-08-22T00:25:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 -- 172.21.15.98:0/3908876605 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40662c0 con 0x7f78c40a9070 2023-08-22T00:25:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/3908876605 >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 0x7f78c40bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c1d9b700 1 --2- 172.21.15.98:0/3908876605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 0x7f78c41500d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f78b8009060 tx=0x7f78b80098f0).ready entity=mon.2 client_cookie=7d097ac6fe931b06 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.392+0000 7f78c159a700 1 -- 172.21.15.98:0/3908876605 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8009960 con 0x7f78c40a9070 2023-08-22T00:25:35.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c159a700 1 -- 172.21.15.98:0/3908876605 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8010620 con 0x7f78c40a9070 2023-08-22T00:25:35.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c159a700 1 -- 172.21.15.98:0/3908876605 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80109a0 con 0x7f78c40a9070 2023-08-22T00:25:35.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 -- 172.21.15.98:0/3908876605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 msgr2=0x7f78c41500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 --2- 172.21.15.98:0/3908876605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 0x7f78c41500d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f78b8009060 tx=0x7f78b80098f0).stop 2023-08-22T00:25:35.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 -- 172.21.15.98:0/3908876605 shutdown_connections 2023-08-22T00:25:35.404 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 --2- 172.21.15.98:0/3908876605 >> v2:172.21.15.98:3300/0 conn(0x7f78c4062600 0x7f78c40bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 --2- 172.21.15.98:0/3908876605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c40a9070 0x7f78c41500d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 -- 172.21.15.98:0/3908876605 >> 172.21.15.98:0/3908876605 conn(0x7f78c40c31d0 msgr2=0x7f78c40c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 -- 172.21.15.98:0/3908876605 shutdown_connections 2023-08-22T00:25:35.405 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.393+0000 7f78c89eb700 1 -- 172.21.15.98:0/3908876605 wait complete. 2023-08-22T00:25:35.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.395+0000 7f78c89eb700 1 Processor -- start 2023-08-22T00:25:35.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.395+0000 7f78c89eb700 1 -- start start 2023-08-22T00:25:35.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c4062600 0x7f78c4143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 0x7f78c4063370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40aa990 con 0x7f78c40a9070 2023-08-22T00:25:35.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414c0b0 con 0x7f78c4062600 2023-08-22T00:25:35.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.396+0000 7f78c89eb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414cbf0 con 0x7f78c414fcf0 2023-08-22T00:25:35.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c4062600 0x7f78c4143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49862/0 (socket says 172.21.15.98:49862) 2023-08-22T00:25:35.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c1d9b700 1 -- 172.21.15.98:0/2737690887 learned_addr learned my addr 172.21.15.98:0/2737690887 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:35.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 0x7f78c4063370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 -- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c4062600 msgr2=0x7f78c4143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c4062600 0x7f78c4143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 -- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 msgr2=0x7f78c40a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 -- 172.21.15.98:0/2737690887 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009b30 con 0x7f78c414fcf0 2023-08-22T00:25:35.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c1d9b700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:35.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.397+0000 7f78c2d9d700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 0x7f78c4063370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f78bc00cf30 tx=0x7f78bc007840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.398+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc016470 con 0x7f78c414fcf0 2023-08-22T00:25:35.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.398+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc0165d0 con 0x7f78c414fcf0 2023-08-22T00:25:35.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.398+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc016950 con 0x7f78c414fcf0 2023-08-22T00:25:35.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.398+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c414c2c0 con 0x7f78c414fcf0 2023-08-22T00:25:35.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.398+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c414c880 con 0x7f78c414fcf0 2023-08-22T00:25:35.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.399+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f78bc013070 con 0x7f78c414fcf0 2023-08-22T00:25:35.414 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:35.396+0000 7fd50920b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:25:35.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.399+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c414cd80 con 0x7f78c414fcf0 2023-08-22T00:25:35.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.400+0000 7f78b27fc700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 0x7f78a4061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.400+0000 7f78c259c700 1 -- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 msgr2=0x7f78a4061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:35.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.400+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f78bc07af50 con 0x7f78c414fcf0 2023-08-22T00:25:35.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.400+0000 7f78c259c700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 0x7f78a4061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:35.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.404+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78bc04bf60 con 0x7f78c414fcf0 2023-08-22T00:25:35.417 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:35.402+0000 7f9137f8f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:35.471 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:35.470+0000 7fd50920b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:25:35.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.575+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78c40665a0 con 0x7f78c414fcf0 2023-08-22T00:25:35.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.576+0000 7f78b27fc700 1 -- 172.21.15.98:0/2737690887 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v153) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78bc04f580 con 0x7f78c414fcf0 2023-08-22T00:25:35.579 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:25:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.577+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 msgr2=0x7f78a4061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.577+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 0x7f78a4061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.577+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 msgr2=0x7f78c4063370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.577+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 0x7f78c4063370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f78bc00cf30 tx=0x7f78bc007840).stop 2023-08-22T00:25:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 shutdown_connections 2023-08-22T00:25:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f78a405ef90 0x7f78a4061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78c414fcf0 0x7f78c4063370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c4062600 0x7f78c4143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 --2- 172.21.15.98:0/2737690887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78c40a9070 0x7f78c40a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 >> 172.21.15.98:0/2737690887 conn(0x7f78c40c31d0 msgr2=0x7f78c40c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 shutdown_connections 2023-08-22T00:25:35.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.578+0000 7f78c89eb700 1 -- 172.21.15.98:0/2737690887 wait complete. 2023-08-22T00:25:35.592 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:35.589+0000 7f9137f8f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:35.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:25:35.668 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:35.667+0000 7fd50920b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:25:35.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.714+0000 7f7cf2b22700 1 Processor -- start 2023-08-22T00:25:35.716 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.714+0000 7f7cf2b22700 1 -- start start 2023-08-22T00:25:35.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf2b22700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cec0645b0 0x7f7cec158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf2b22700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7cec0666a0 0x7f7cec066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf2b22700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec0bcf30 con 0x7f7cec154170 2023-08-22T00:25:35.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf2b22700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cec154550 con 0x7f7cec0645b0 2023-08-22T00:25:35.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf2b22700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cec158b00 con 0x7f7cec0666a0 2023-08-22T00:25:35.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cec0645b0 0x7f7cec158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cec0645b0 0x7f7cec158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49864/0 (socket says 172.21.15.98:49864) 2023-08-22T00:25:35.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 -- 172.21.15.98:0/4274931159 learned_addr learned my addr 172.21.15.98:0/4274931159 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:35.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cf10bf700 1 --2- 172.21.15.98:0/4274931159 >> v2:172.21.15.118:3300/0 conn(0x7f7cec0666a0 0x7f7cec066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 -- 172.21.15.98:0/4274931159 >> v2:172.21.15.118:3300/0 conn(0x7f7cec0666a0 msgr2=0x7f7cec066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:35.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 --2- 172.21.15.98:0/4274931159 >> v2:172.21.15.118:3300/0 conn(0x7f7cec0666a0 0x7f7cec066ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 -- 172.21.15.98:0/4274931159 >> v1:172.21.15.118:6789/0 conn(0x7f7cec154170 legacy=0x7f7cec063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 -- 172.21.15.98:0/4274931159 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0c2990 con 0x7f7cec0645b0 2023-08-22T00:25:35.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7cebfff700 1 --2- 172.21.15.98:0/4274931159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec0645b0 0x7f7cec158610 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f7cec06b570 tx=0x7f7cd80090f0).ready entity=mon.0 client_cookie=ad2b35952aeb7ae3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7ceb7fe700 1 -- 172.21.15.98:0/4274931159 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800b520 con 0x7f7cec0645b0 2023-08-22T00:25:35.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.715+0000 7f7ceb7fe700 1 -- 172.21.15.98:0/4274931159 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800b680 con 0x7f7cec0645b0 2023-08-22T00:25:35.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7ceb7fe700 1 -- 172.21.15.98:0/4274931159 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800ba00 con 0x7f7cec0645b0 2023-08-22T00:25:35.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 -- 172.21.15.98:0/4274931159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec0645b0 msgr2=0x7f7cec158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/4274931159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec0645b0 0x7f7cec158610 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f7cec06b570 tx=0x7f7cd80090f0).stop 2023-08-22T00:25:35.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 -- 172.21.15.98:0/4274931159 shutdown_connections 2023-08-22T00:25:35.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/4274931159 >> v2:172.21.15.118:3300/0 conn(0x7f7cec0666a0 0x7f7cec066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/4274931159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec0645b0 0x7f7cec158610 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 -- 172.21.15.98:0/4274931159 >> 172.21.15.98:0/4274931159 conn(0x7f7cec069680 msgr2=0x7f7cec069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 -- 172.21.15.98:0/4274931159 shutdown_connections 2023-08-22T00:25:35.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.716+0000 7f7cf2b22700 1 -- 172.21.15.98:0/4274931159 wait complete. 2023-08-22T00:25:35.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.717+0000 7f7cf2b22700 1 Processor -- start 2023-08-22T00:25:35.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.717+0000 7f7cf2b22700 1 -- start start 2023-08-22T00:25:35.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cec0645b0 0x7f7cec146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 0x7f7cec156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec147370 con 0x7f7cec154170 2023-08-22T00:25:35.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0a9f90 con 0x7f7cec0666a0 2023-08-22T00:25:35.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf2b22700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0a5240 con 0x7f7cec0645b0 2023-08-22T00:25:35.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf10bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf10bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49868/0 (socket says 172.21.15.98:49868) 2023-08-22T00:25:35.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf10bf700 1 -- 172.21.15.98:0/3966817011 learned_addr learned my addr 172.21.15.98:0/3966817011 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:35.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cebfff700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 0x7f7cec156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.718+0000 7f7cf08be700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cec0645b0 0x7f7cec146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:35.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 -- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cec0645b0 msgr2=0x7f7cec146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cec0645b0 0x7f7cec146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 -- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 msgr2=0x7f7cec157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 -- 172.21.15.98:0/3966817011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8009370 con 0x7f7cec0666a0 2023-08-22T00:25:35.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cf10bf700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:35.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cebfff700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 0x7f7cec156810 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7cec06b5c0 tx=0x7f7cd8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:35.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8006d90 con 0x7f7cec0666a0 2023-08-22T00:25:35.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8000bc0 con 0x7f7cec0666a0 2023-08-22T00:25:35.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801c420 con 0x7f7cec0666a0 2023-08-22T00:25:35.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec0a6d60 con 0x7f7cec0666a0 2023-08-22T00:25:35.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.719+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec0a4910 con 0x7f7cec0666a0 2023-08-22T00:25:35.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.720+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f7cd801c810 con 0x7f7cec0666a0 2023-08-22T00:25:35.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.720+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec068600 con 0x7f7cec0666a0 2023-08-22T00:25:35.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.721+0000 7f7ce8ff9700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 0x7f7cd0061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:35.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.721+0000 7f7cf08be700 1 -- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 msgr2=0x7f7cd0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:35.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.721+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f7cd807bd10 con 0x7f7cec0666a0 2023-08-22T00:25:35.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.721+0000 7f7cf08be700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 0x7f7cd0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:35.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.725+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cd804ccc0 con 0x7f7cec0666a0 2023-08-22T00:25:35.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.892+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7cec0a5380 con 0x7f7cec0666a0 2023-08-22T00:25:35.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.893+0000 7f7ce8ff9700 1 -- 172.21.15.98:0/3966817011 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cd802a020 con 0x7f7cec0666a0 2023-08-22T00:25:35.895 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:25:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 msgr2=0x7f7cd0061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 0x7f7cd0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 msgr2=0x7f7cec156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 0x7f7cec156810 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7cec06b5c0 tx=0x7f7cd8017000).stop 2023-08-22T00:25:35.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 shutdown_connections 2023-08-22T00:25:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f7cd005efc0 0x7f7cd0061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cec0645b0 0x7f7cec146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cec154170 0x7f7cec157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 --2- 172.21.15.98:0/3966817011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cec0666a0 0x7f7cec156810 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 >> 172.21.15.98:0/3966817011 conn(0x7f7cec069680 msgr2=0x7f7cec066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 shutdown_connections 2023-08-22T00:25:35.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:35.896+0000 7f7cf2b22700 1 -- 172.21.15.98:0/3966817011 wait complete. 2023-08-22T00:25:35.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:25:36.009 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.008+0000 7f9137f8f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:36.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.040+0000 7fb3e155e700 1 Processor -- start 2023-08-22T00:25:36.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3e155e700 1 -- start start 2023-08-22T00:25:36.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3e155e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3dc155290 0x7fb3dc0641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3e155e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0646a0 con 0x7fb3dc067d00 2023-08-22T00:25:36.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3e155e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc155690 con 0x7fb3dc14e720 2023-08-22T00:25:36.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3e155e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0654a0 con 0x7fb3dc155290 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.041+0000 7fb3db7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3dc155290 0x7fb3dc0641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3da7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb3dc067d00 0x7fb3dc0c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53330/0 (socket says 172.21.15.98:53330) 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3db7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3dc155290 0x7fb3dc0641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49874/0 (socket says 172.21.15.98:49874) 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3da7fc700 1 -- 172.21.15.98:0/542509732 learned_addr learned my addr 172.21.15.98:0/542509732 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3db7fe700 1 -- 172.21.15.98:0/542509732 >> v1:172.21.15.118:6789/0 conn(0x7fb3dc14e720 legacy=0x7fb3dc0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3db7fe700 1 -- 172.21.15.98:0/542509732 >> v1:172.21.15.98:6789/0 conn(0x7fb3dc067d00 legacy=0x7fb3dc0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3d9ffb700 1 -- 172.21.15.98:0/542509732 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234341170 0 0) 0x7fb3dc0646a0 con 0x7fb3dc067d00 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3db7fe700 1 -- 172.21.15.98:0/542509732 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc064920 con 0x7fb3dc155290 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3db7fe700 1 --2- 172.21.15.98:0/542509732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc155290 0x7fb3dc0641b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fb3d4009e60 tx=0x7fb3d4009780).ready entity=mon.0 client_cookie=96573d2c19879879 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3d9ffb700 1 -- 172.21.15.98:0/542509732 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400e070 con 0x7fb3dc155290 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3d9ffb700 1 -- 172.21.15.98:0/542509732 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bc30 con 0x7fb3dc155290 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.042+0000 7fb3d9ffb700 1 -- 172.21.15.98:0/542509732 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012410 con 0x7fb3dc155290 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 -- 172.21.15.98:0/542509732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc155290 msgr2=0x7fb3dc0641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 --2- 172.21.15.98:0/542509732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc155290 0x7fb3dc0641b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fb3d4009e60 tx=0x7fb3d4009780).stop 2023-08-22T00:25:36.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 -- 172.21.15.98:0/542509732 shutdown_connections 2023-08-22T00:25:36.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 --2- 172.21.15.98:0/542509732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc155290 0x7fb3dc0641b0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 -- 172.21.15.98:0/542509732 >> 172.21.15.98:0/542509732 conn(0x7fb3dc0c8950 msgr2=0x7fb3dc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 -- 172.21.15.98:0/542509732 shutdown_connections 2023-08-22T00:25:36.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.043+0000 7fb3e155e700 1 -- 172.21.15.98:0/542509732 wait complete. 2023-08-22T00:25:36.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.044+0000 7fb3e155e700 1 Processor -- start 2023-08-22T00:25:36.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.044+0000 7fb3e155e700 1 -- start start 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3dc14e720 0x7fb3dc0c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3dc155290 0x7fb3dc0ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0adb40 con 0x7fb3dc067d00 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c1770 con 0x7fb3dc155290 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3e155e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c0b60 con 0x7fb3dc14e720 2023-08-22T00:25:36.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49878/0 (socket says 172.21.15.98:49878) 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 -- 172.21.15.98:0/2707723937 learned_addr learned my addr 172.21.15.98:0/2707723937 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3db7fe700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3dc155290 0x7fb3dc0ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3da7fc700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3dc14e720 0x7fb3dc0c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 -- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3dc14e720 msgr2=0x7fb3dc0c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3dc14e720 0x7fb3dc0c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 -- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3dc155290 msgr2=0x7fb3dc0ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3dc155290 0x7fb3dc0ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 -- 172.21.15.98:0/2707723937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009a20 con 0x7fb3dc067d00 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3daffd700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fb3cc00c490 tx=0x7fb3cc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.045+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00ce40 con 0x7fb3dc067d00 2023-08-22T00:25:36.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.046+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00f470 con 0x7fb3dc067d00 2023-08-22T00:25:36.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.046+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0c0e40 con 0x7fb3dc067d00 2023-08-22T00:25:36.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.046+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00f7f0 con 0x7fb3dc067d00 2023-08-22T00:25:36.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.046+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0c1400 con 0x7fb3dc067d00 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.047+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0c1a50 con 0x7fb3dc067d00 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.047+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fb3cc00fbe0 con 0x7fb3dc067d00 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.048+0000 7fb3c2ffd700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 0x7fb3c8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.048+0000 7fb3da7fc700 1 -- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 msgr2=0x7fb3c8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.048+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fb3cc079770 con 0x7fb3dc067d00 2023-08-22T00:25:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.048+0000 7fb3da7fc700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 0x7fb3c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:36.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.052+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3cc0488f0 con 0x7fb3dc067d00 2023-08-22T00:25:36.113 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.112+0000 7f9137f8f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:36.124 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.116+0000 7fd50920b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:25:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.220+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3dc0acc20 con 0x7fb3dc067d00 2023-08-22T00:25:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.220+0000 7fb3c2ffd700 1 -- 172.21.15.98:0/2707723937 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3cc04a850 con 0x7fb3dc067d00 2023-08-22T00:25:36.222 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:25:36.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 msgr2=0x7fb3c8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 0x7fb3c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 msgr2=0x7fb3dc14d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fb3cc00c490 tx=0x7fb3cc007de0).stop 2023-08-22T00:25:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 shutdown_connections 2023-08-22T00:25:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3dc155290 0x7fb3dc0ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3dc067d00 0x7fb3dc14d0f0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3c805efc0 0x7fb3c8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 --2- 172.21.15.98:0/2707723937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3dc14e720 0x7fb3dc0c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 >> 172.21.15.98:0/2707723937 conn(0x7fb3dc0c8950 msgr2=0x7fb3dc153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 shutdown_connections 2023-08-22T00:25:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.222+0000 7fb3e155e700 1 -- 172.21.15.98:0/2707723937 wait complete. 2023-08-22T00:25:36.226 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.223+0000 7fd50920b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:36.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:25:36.268 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.264+0000 7f9137f8f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:36.339 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.338+0000 7f9137f8f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.363+0000 7efed95ec700 1 Processor -- start 2023-08-22T00:25:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.363+0000 7efed95ec700 1 -- start start 2023-08-22T00:25:36.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efed414e720 0x7efed4155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 0x7efed4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed4067f30 con 0x7efed414e720 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40654a0 con 0x7efed4067ae0 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed95ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed4064920 con 0x7efed40641b0 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efed414e720 0x7efed4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed2ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efed414e720 0x7efed4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49888/0 (socket says 172.21.15.98:49888) 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed2ffd700 1 -- 172.21.15.98:0/1428703699 learned_addr learned my addr 172.21.15.98:0/1428703699 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed27fc700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.364+0000 7efed37fe700 1 --2- 172.21.15.98:0/1428703699 >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 0x7efed4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 -- 172.21.15.98:0/1428703699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 msgr2=0x7efed40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 -- 172.21.15.98:0/1428703699 >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 msgr2=0x7efed4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:36.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 --2- 172.21.15.98:0/1428703699 >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 0x7efed4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 -- 172.21.15.98:0/1428703699 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4064c00 con 0x7efed414e720 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed37fe700 1 --2- 172.21.15.98:0/1428703699 >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 0x7efed4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed27fc700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed2ffd700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed414e720 0x7efed4155290 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7efed4063c50 tx=0x7efec40090f0).ready entity=mon.0 client_cookie=f0277ffb21ec3807 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed1ffb700 1 -- 172.21.15.98:0/1428703699 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400f510 con 0x7efed414e720 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed1ffb700 1 -- 172.21.15.98:0/1428703699 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400f670 con 0x7efed414e720 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.365+0000 7efed1ffb700 1 -- 172.21.15.98:0/1428703699 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400fa10 con 0x7efed414e720 2023-08-22T00:25:36.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 -- 172.21.15.98:0/1428703699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed414e720 msgr2=0x7efed4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed414e720 0x7efed4155290 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7efed4063c50 tx=0x7efec40090f0).stop 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 -- 172.21.15.98:0/1428703699 shutdown_connections 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 --2- 172.21.15.98:0/1428703699 >> v2:172.21.15.118:3300/0 conn(0x7efed4067ae0 0x7efed4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed414e720 0x7efed4155290 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 --2- 172.21.15.98:0/1428703699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 -- 172.21.15.98:0/1428703699 >> 172.21.15.98:0/1428703699 conn(0x7efed40c8950 msgr2=0x7efed40c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 -- 172.21.15.98:0/1428703699 shutdown_connections 2023-08-22T00:25:36.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.366+0000 7efed95ec700 1 -- 172.21.15.98:0/1428703699 wait complete. 2023-08-22T00:25:36.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.367+0000 7efed95ec700 1 Processor -- start 2023-08-22T00:25:36.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.367+0000 7efed95ec700 1 -- start start 2023-08-22T00:25:36.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed414e720 0x7efed40aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40c2590 con 0x7efed4067ae0 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40a8580 con 0x7efed414e720 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed95ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed414a860 con 0x7efed40641b0 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49896/0 (socket says 172.21.15.98:49896) 2023-08-22T00:25:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 -- 172.21.15.98:0/1057576068 learned_addr learned my addr 172.21.15.98:0/1057576068 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:36.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed37fe700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed414e720 0x7efed40aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed2ffd700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 -- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 msgr2=0x7efed40a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 -- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed414e720 msgr2=0x7efed40aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed414e720 0x7efed40aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.368+0000 7efed27fc700 1 -- 172.21.15.98:0/1057576068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec80092a0 con 0x7efed4067ae0 2023-08-22T00:25:36.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efed27fc700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7efec800ea50 tx=0x7efec8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800c7f0 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800c950 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc009a20 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800ccd0 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.369+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec4009370 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed4069d50 con 0x7efed4067ae0 2023-08-22T00:25:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7efec8012600 con 0x7efed4067ae0 2023-08-22T00:25:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efebaffd700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 0x7efec0061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efed2ffd700 1 -- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 msgr2=0x7efec0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7efec807a860 con 0x7efed4067ae0 2023-08-22T00:25:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.370+0000 7efed2ffd700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 0x7efec0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.375+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efec804b870 con 0x7efed4067ae0 2023-08-22T00:25:36.391 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.389+0000 7fd50920b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:36.408 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.407+0000 7f9137f8f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:36.468 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.466+0000 7fd50920b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:25:36.537 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.536+0000 7fd50920b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:25:36.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.540+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efed4046c20 con 0x7efed4067ae0 2023-08-22T00:25:36.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.540+0000 7efebaffd700 1 -- 172.21.15.98:0/1057576068 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7efec804ee90 con 0x7efed4067ae0 2023-08-22T00:25:36.543 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:25:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 msgr2=0x7efec0061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 0x7efec0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 msgr2=0x7efed414a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7efec800ea50 tx=0x7efec8009060).stop 2023-08-22T00:25:36.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 shutdown_connections 2023-08-22T00:25:36.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efec005efc0 0x7efec0061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40641b0 0x7efed40a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed414e720 0x7efed40aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 --2- 172.21.15.98:0/1057576068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efed4067ae0 0x7efed414a370 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 >> 172.21.15.98:0/1057576068 conn(0x7efed40c8950 msgr2=0x7efed40bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 shutdown_connections 2023-08-22T00:25:36.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.542+0000 7efed95ec700 1 -- 172.21.15.98:0/1057576068 wait complete. 2023-08-22T00:25:36.556 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:36.662 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.660+0000 7f9137f8f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:36.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.673+0000 7fcc5c327700 1 Processor -- start 2023-08-22T00:25:36.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.674+0000 7fcc5c327700 1 -- start start 2023-08-22T00:25:36.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.674+0000 7fcc5c327700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcc54151970 0x7fcc54151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5c327700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5c327700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc54066580 con 0x7fcc540c3ff0 2023-08-22T00:25:36.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5c327700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc54155cb0 con 0x7fcc54151970 2023-08-22T00:25:36.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5c327700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54155f90 con 0x7fcc541557f0 2023-08-22T00:25:36.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcc54151970 0x7fcc54151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc598c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcc54151970 0x7fcc54151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38946/0 (socket says 172.21.15.98:38946) 2023-08-22T00:25:36.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a8c4700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fcc540c3ff0 0x7fcc54068db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:48490/0 (socket says 172.21.15.98:48490) 2023-08-22T00:25:36.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc598c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:55492/0 (socket says 172.21.15.98:55492) 2023-08-22T00:25:36.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/2127353238 learned_addr learned my addr 172.21.15.98:0/2127353238 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:36.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 msgr2=0x7fcc540c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:36.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/2127353238 >> v1:172.21.15.118:6789/0 conn(0x7fcc540c3ff0 legacy=0x7fcc54068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/2127353238 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54156270 con 0x7fcc54151970 2023-08-22T00:25:36.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc590c1700 1 -- 172.21.15.98:0/2127353238 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821651882 0 0) 0x7fcc54066580 con 0x7fcc540c3ff0 2023-08-22T00:25:36.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc598c2700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:36.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc5a0c3700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc54151970 0x7fcc54151d50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fcc50006fd0 tx=0x7fcc500090f0).ready entity=mon.1 client_cookie=e81e4a3b98c1a7ee server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.675+0000 7fcc590c1700 1 -- 172.21.15.98:0/2127353238 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000b580 con 0x7fcc54151970 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc590c1700 1 -- 172.21.15.98:0/2127353238 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5000b6e0 con 0x7fcc54151970 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc590c1700 1 -- 172.21.15.98:0/2127353238 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000ba80 con 0x7fcc54151970 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 -- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc54151970 msgr2=0x7fcc54151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc54151970 0x7fcc54151d50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fcc50006fd0 tx=0x7fcc500090f0).stop 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 -- 172.21.15.98:0/2127353238 shutdown_connections 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc54151970 0x7fcc54151d50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 --2- 172.21.15.98:0/2127353238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc540c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 -- 172.21.15.98:0/2127353238 >> 172.21.15.98:0/2127353238 conn(0x7fcc540c5e60 msgr2=0x7fcc540686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 -- 172.21.15.98:0/2127353238 shutdown_connections 2023-08-22T00:25:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.676+0000 7fcc5c327700 1 -- 172.21.15.98:0/2127353238 wait complete. 2023-08-22T00:25:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.677+0000 7fcc5c327700 1 Processor -- start 2023-08-22T00:25:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.677+0000 7fcc5c327700 1 -- start start 2023-08-22T00:25:36.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc54151970 0x7fcc54149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc5414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c0260 con 0x7fcc54151970 2023-08-22T00:25:36.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54165770 con 0x7fcc540c3ff0 2023-08-22T00:25:36.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5c327700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541659d0 con 0x7fcc541557f0 2023-08-22T00:25:36.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38948/0 (socket says 172.21.15.98:38948) 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/666635960 learned_addr learned my addr 172.21.15.98:0/666635960 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc598c2700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc54151970 0x7fcc54149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a8c4700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc5414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 msgr2=0x7fcc5414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc5414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc54151970 msgr2=0x7fcc54149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc54151970 0x7fcc54149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a0c3700 1 -- 172.21.15.98:0/666635960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440092a0 con 0x7fcc540c3ff0 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.678+0000 7fcc5a8c4700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc5414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc5a0c3700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fcc50009ea0 tx=0x7fcc50017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50006d90 con 0x7fcc540c3ff0 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5000be40 con 0x7fcc540c3ff0 2023-08-22T00:25:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc50009370 con 0x7fcc540c3ff0 2023-08-22T00:25:36.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000ba80 con 0x7fcc540c3ff0 2023-08-22T00:25:36.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.679+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc54165f90 con 0x7fcc540c3ff0 2023-08-22T00:25:36.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc54047480 con 0x7fcc540c3ff0 2023-08-22T00:25:36.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fcc5001c630 con 0x7fcc540c3ff0 2023-08-22T00:25:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc4a7fc700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 0x7fcc38061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc598c2700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 msgr2=0x7fcc38061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fcc5007bca0 con 0x7fcc540c3ff0 2023-08-22T00:25:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.680+0000 7fcc598c2700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 0x7fcc38061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:36.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.685+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc50080070 con 0x7fcc540c3ff0 2023-08-22T00:25:36.808 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.806+0000 7fd50920b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:25:36.844 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:36.844+0000 7f9137f8f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:36.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.881+0000 7fcc598c2700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 msgr2=0x7fcc38061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:36.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.881+0000 7fcc598c2700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 0x7fcc38061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.895+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc54156550 con 0x7fcc540c3ff0 2023-08-22T00:25:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.896+0000 7fcc4a7fc700 1 -- 172.21.15.98:0/666635960 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fcc5002a020 con 0x7fcc540c3ff0 2023-08-22T00:25:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:36.898 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 msgr2=0x7fcc38061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 0x7fcc38061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 msgr2=0x7fcc54165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fcc50009ea0 tx=0x7fcc50017000).stop 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 shutdown_connections 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcc3805efc0 0x7fcc38061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc541557f0 0x7fcc5414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc540c3ff0 0x7fcc54165280 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 --2- 172.21.15.98:0/666635960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc54151970 0x7fcc54149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 >> 172.21.15.98:0/666635960 conn(0x7fcc540c5e60 msgr2=0x7fcc540c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 shutdown_connections 2023-08-22T00:25:36.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:36.898+0000 7fcc5c327700 1 -- 172.21.15.98:0/666635960 wait complete. 2023-08-22T00:25:36.905 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:36.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:37.004 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:36.999+0000 7fd50920b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:25:37.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.032+0000 7f5b8d8a5700 1 Processor -- start 2023-08-22T00:25:37.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.032+0000 7f5b8d8a5700 1 -- start start 2023-08-22T00:25:37.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b8d8a5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88150c50 0x7f5b880c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b8d8a5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b880bc6d0 0x7f5b880c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b8d8a5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880645b0 con 0x7f5b88151030 2023-08-22T00:25:37.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b8d8a5700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b88063fa0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b8d8a5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88151f30 con 0x7f5b88150c50 2023-08-22T00:25:37.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b867fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b880bc6d0 0x7f5b880c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b867fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b880bc6d0 0x7f5b880c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49904/0 (socket says 172.21.15.98:49904) 2023-08-22T00:25:37.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b867fc700 1 -- 172.21.15.98:0/3126677004 learned_addr learned my addr 172.21.15.98:0/3126677004 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.033+0000 7f5b86ffd700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88150c50 0x7f5b880c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b867fc700 1 -- 172.21.15.98:0/3126677004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88150c50 msgr2=0x7f5b880c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:37.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b867fc700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88150c50 0x7f5b880c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b867fc700 1 -- 172.21.15.98:0/3126677004 >> v1:172.21.15.118:6789/0 conn(0x7f5b88151030 legacy=0x7f5b881514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b867fc700 1 -- 172.21.15.98:0/3126677004 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88152210 con 0x7f5b880bc6d0 2023-08-22T00:25:37.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b867fc700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b880bc6d0 0x7f5b880c39d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f5b7c006fd0 tx=0x7f5b7c00b3b0).ready entity=mon.0 client_cookie=c942824d35ea7030 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b85ffb700 1 -- 172.21.15.98:0/3126677004 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00da70 con 0x7f5b880bc6d0 2023-08-22T00:25:37.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b85ffb700 1 -- 172.21.15.98:0/3126677004 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00dbd0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b85ffb700 1 -- 172.21.15.98:0/3126677004 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c010470 con 0x7f5b880bc6d0 2023-08-22T00:25:37.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/3126677004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b880bc6d0 msgr2=0x7f5b880c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b880bc6d0 0x7f5b880c39d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f5b7c006fd0 tx=0x7f5b7c00b3b0).stop 2023-08-22T00:25:37.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.034+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/3126677004 shutdown_connections 2023-08-22T00:25:37.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.035+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88150c50 0x7f5b880c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.035+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/3126677004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b880bc6d0 0x7f5b880c39d0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.035+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/3126677004 >> 172.21.15.98:0/3126677004 conn(0x7f5b880c7770 msgr2=0x7f5b880c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.035+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/3126677004 shutdown_connections 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.035+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/3126677004 wait complete. 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.036+0000 7f5b8d8a5700 1 Processor -- start 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.036+0000 7f5b8d8a5700 1 -- start start 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 0x7f5b880c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 0x7f5b880c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88160160 con 0x7f5b88150c50 2023-08-22T00:25:37.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c6610 con 0x7f5b880bc6d0 2023-08-22T00:25:37.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b8d8a5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880a8200 con 0x7f5b88151030 2023-08-22T00:25:37.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b877fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 0x7f5b880c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:38956/0 (socket says 172.21.15.98:38956) 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 -- 172.21.15.98:0/4262325344 learned_addr learned my addr 172.21.15.98:0/4262325344 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b867fc700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 0x7f5b880c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 -- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 msgr2=0x7f5b880c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 0x7f5b880c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 -- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 msgr2=0x7f5b880c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 0x7f5b880c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 -- 172.21.15.98:0/4262325344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c00b610 con 0x7f5b880bc6d0 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b877fe700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 0x7f5b880c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b867fc700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 0x7f5b880c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b86ffd700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f5b7800e930 tx=0x7f5b78009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78012600 con 0x7f5b880bc6d0 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.037+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78012760 con 0x7f5b880bc6d0 2023-08-22T00:25:37.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.038+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78012ae0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.038+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880a75f0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.038+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b880a7bb0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.039+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880a8dc0 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.039+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5b7801b400 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.039+0000 7f5b6effd700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 0x7f5b74061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.040+0000 7f5b867fc700 1 -- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 msgr2=0x7f5b74061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.040+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f5b7807a760 con 0x7f5b880bc6d0 2023-08-22T00:25:37.053 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.040+0000 7f5b867fc700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 0x7f5b74061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:37.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.044+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b7804b710 con 0x7f5b880bc6d0 2023-08-22T00:25:37.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.214+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b88047480 con 0x7f5b880bc6d0 2023-08-22T00:25:37.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.215+0000 7f5b6effd700 1 -- 172.21.15.98:0/4262325344 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+17644 (secure 0 0 0) 0x7f5b7804ed30 con 0x7f5b880bc6d0 2023-08-22T00:25:37.218 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:37.218 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":153,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:31.187309+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3271729389":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6833/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6832/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/2741359280":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/3064880461":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/4252953891":"2023-08-23T00:25:31.187262+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:37.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 msgr2=0x7f5b74061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 0x7f5b74061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 msgr2=0x7f5b880a83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f5b7800e930 tx=0x7f5b78009060).stop 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 shutdown_connections 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b7405ef90 0x7f5b74061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b88151030 0x7f5b880c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b880bc6d0 0x7f5b880a83f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 --2- 172.21.15.98:0/4262325344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b88150c50 0x7f5b880c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 >> 172.21.15.98:0/4262325344 conn(0x7f5b880c7770 msgr2=0x7f5b880a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 shutdown_connections 2023-08-22T00:25:37.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.218+0000 7f5b8d8a5700 1 -- 172.21.15.98:0/4262325344 wait complete. 2023-08-22T00:25:37.232 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:25:37.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.350+0000 7fae23e8b700 1 Processor -- start 2023-08-22T00:25:37.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.351+0000 7fae23e8b700 1 -- start start 2023-08-22T00:25:37.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.351+0000 7fae23e8b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fae1c14bf70 0x7fae1c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.351+0000 7fae23e8b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.351+0000 7fae23e8b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c153080 con 0x7fae1c14c350 2023-08-22T00:25:37.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae23e8b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c066510 con 0x7fae1c0c3e50 2023-08-22T00:25:37.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae23e8b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0667b0 con 0x7fae1c14bf70 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae22428700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fae1c14bf70 0x7fae1c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae22428700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49932/0 (socket says 172.21.15.98:49932) 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae22428700 1 -- 172.21.15.98:0/4255573613 learned_addr learned my addr 172.21.15.98:0/4255573613 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 -- 172.21.15.98:0/4255573613 >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 msgr2=0x7fae1c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 --2- 172.21.15.98:0/4255573613 >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 -- 172.21.15.98:0/4255573613 >> v1:172.21.15.118:6789/0 conn(0x7fae1c14c350 legacy=0x7fae1c0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 -- 172.21.15.98:0/4255573613 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c155ba0 con 0x7fae1c14bf70 2023-08-22T00:25:37.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae22428700 1 --2- 172.21.15.98:0/4255573613 >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:37.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae21c27700 1 --2- 172.21.15.98:0/4255573613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14bf70 0x7fae1c152b90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fae1c153280 tx=0x7fae1800d500).ready entity=mon.1 client_cookie=3b97cbb3e71ebe75 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae20c25700 1 -- 172.21.15.98:0/4255573613 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18012070 con 0x7fae1c14bf70 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae20c25700 1 -- 172.21.15.98:0/4255573613 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800d2e0 con 0x7fae1c14bf70 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.352+0000 7fae20c25700 1 -- 172.21.15.98:0/4255573613 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800f8a0 con 0x7fae1c14bf70 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 -- 172.21.15.98:0/4255573613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14bf70 msgr2=0x7fae1c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 --2- 172.21.15.98:0/4255573613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14bf70 0x7fae1c152b90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fae1c153280 tx=0x7fae1800d500).stop 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 -- 172.21.15.98:0/4255573613 shutdown_connections 2023-08-22T00:25:37.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 --2- 172.21.15.98:0/4255573613 >> v2:172.21.15.98:3300/0 conn(0x7fae1c0c3e50 0x7fae1c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 --2- 172.21.15.98:0/4255573613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14bf70 0x7fae1c152b90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 -- 172.21.15.98:0/4255573613 >> 172.21.15.98:0/4255573613 conn(0x7fae1c0c5dc0 msgr2=0x7fae1c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 -- 172.21.15.98:0/4255573613 shutdown_connections 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.353+0000 7fae23e8b700 1 -- 172.21.15.98:0/4255573613 wait complete. 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.354+0000 7fae23e8b700 1 Processor -- start 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.354+0000 7fae23e8b700 1 -- start start 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae1c14bf70 0x7fae1c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 0x7fae1c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c14db70 con 0x7fae1c0c3e50 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c14e000 con 0x7fae1c14c350 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae23e8b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c14cf60 con 0x7fae1c14bf70 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49946/0 (socket says 172.21.15.98:49946) 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21426700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae1c14bf70 0x7fae1c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 -- 172.21.15.98:0/3621321846 learned_addr learned my addr 172.21.15.98:0/3621321846 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae22428700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 0x7fae1c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae1c14bf70 msgr2=0x7fae1c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae1c14bf70 0x7fae1c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 msgr2=0x7fae1c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 0x7fae1c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae21c27700 1 -- 172.21.15.98:0/3621321846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009ae0 con 0x7fae1c0c3e50 2023-08-22T00:25:37.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.355+0000 7fae22428700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 0x7fae1c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae21c27700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fae1800d540 tx=0x7fae1c0668f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18000d10 con 0x7fae1c0c3e50 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800c910 con 0x7fae1c0c3e50 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1800d740 con 0x7fae1c0c3e50 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800ccb0 con 0x7fae1c0c3e50 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.356+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c14d520 con 0x7fae1c0c3e50 2023-08-22T00:25:37.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.357+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c047480 con 0x7fae1c0c3e50 2023-08-22T00:25:37.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.357+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fae18017630 con 0x7fae1c0c3e50 2023-08-22T00:25:37.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.358+0000 7fae11ffb700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 0x7fae00061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.358+0000 7fae21426700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 msgr2=0x7fae00061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:37.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.358+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fae1807f9b0 con 0x7fae1c0c3e50 2023-08-22T00:25:37.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.358+0000 7fae21426700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 0x7fae00061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:37.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.365+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae180508b0 con 0x7fae1c0c3e50 2023-08-22T00:25:37.493 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.492+0000 7f9137f8f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:37.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.559+0000 7fae21426700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 msgr2=0x7fae00061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:37.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.559+0000 7fae21426700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 0x7fae00061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:37.561 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.560+0000 7f9137f8f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:37.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.576+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae1c155e00 con 0x7fae1c0c3e50 2023-08-22T00:25:37.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.577+0000 7fae11ffb700 1 -- 172.21.15.98:0/3621321846 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fae18053ed0 con 0x7fae1c0c3e50 2023-08-22T00:25:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:37.578 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:37.584 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 msgr2=0x7fae00061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 0x7fae00061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 msgr2=0x7fae1c14b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fae1800d540 tx=0x7fae1c0668f0).stop 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 shutdown_connections 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae1c14c350 0x7fae1c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae1c0c3e50 0x7fae1c14b620 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fae0005efc0 0x7fae00061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 --2- 172.21.15.98:0/3621321846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae1c14bf70 0x7fae1c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 >> 172.21.15.98:0/3621321846 conn(0x7fae1c0c5dc0 msgr2=0x7fae1c150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 shutdown_connections 2023-08-22T00:25:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.579+0000 7fae23e8b700 1 -- 172.21.15.98:0/3621321846 wait complete. 2023-08-22T00:25:37.586 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:37.594 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:37.635 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.634+0000 7f9137f8f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:37.695 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:37.693+0000 7fd50920b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:25:37.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 Processor -- start 2023-08-22T00:25:37.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 -- start start 2023-08-22T00:25:37.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcbc814e0d0 0x7fcbc814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcbc81544f0 0x7fcbc8154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc8155260 con 0x7fcbc81544f0 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80bf9e0 con 0x7fcbc814e0d0 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.714+0000 7fcbcd5dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80bfcc0 con 0x7fcbc80c5a90 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcbc81544f0 0x7fcbc8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcbc81544f0 0x7fcbc8154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49958/0 (socket says 172.21.15.98:49958) 2023-08-22T00:25:37.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3137179525 learned_addr learned my addr 172.21.15.98:0/3137179525 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc6ffd700 1 --2- 172.21.15.98:0/3137179525 >> v2:172.21.15.118:3300/0 conn(0x7fcbc814e0d0 0x7fcbc814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc67fc700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3137179525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 msgr2=0x7fcbc80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:37.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3137179525 >> v2:172.21.15.118:3300/0 conn(0x7fcbc814e0d0 msgr2=0x7fcbc814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3137179525 >> v2:172.21.15.118:3300/0 conn(0x7fcbc814e0d0 0x7fcbc814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3137179525 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80bffa0 con 0x7fcbc81544f0 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc8154980 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fcbc806ab50 tx=0x7fcbc0009840).ready entity=mon.0 client_cookie=e1510d4d9b42cab server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc5ffb700 1 -- 172.21.15.98:0/3137179525 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000e070 con 0x7fcbc81544f0 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc5ffb700 1 -- 172.21.15.98:0/3137179525 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000b970 con 0x7fcbc81544f0 2023-08-22T00:25:37.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.715+0000 7fcbc5ffb700 1 -- 172.21.15.98:0/3137179525 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000bcf0 con 0x7fcbc81544f0 2023-08-22T00:25:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3137179525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 msgr2=0x7fcbc8154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc8154980 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fcbc806ab50 tx=0x7fcbc0009840).stop 2023-08-22T00:25:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3137179525 shutdown_connections 2023-08-22T00:25:37.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc8154980 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3137179525 >> v2:172.21.15.118:3300/0 conn(0x7fcbc814e0d0 0x7fcbc814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3137179525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3137179525 >> 172.21.15.98:0/3137179525 conn(0x7fcbc80caa80 msgr2=0x7fcbc80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3137179525 shutdown_connections 2023-08-22T00:25:37.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.716+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3137179525 wait complete. 2023-08-22T00:25:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.718+0000 7fcbcd5dd700 1 Processor -- start 2023-08-22T00:25:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.718+0000 7fcbcd5dd700 1 -- start start 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbc814e0d0 0x7fcbc81649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80aab40 con 0x7fcbc81544f0 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc814cbe0 con 0x7fcbc814e0d0 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbcd5dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8164ea0 con 0x7fcbc80c5a90 2023-08-22T00:25:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbc77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbc77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49970/0 (socket says 172.21.15.98:49970) 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3182676088 learned_addr learned my addr 172.21.15.98:0/3182676088 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.719+0000 7fcbc6ffd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc67fc700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbc814e0d0 0x7fcbc81649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 msgr2=0x7fcbc80c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbc814e0d0 msgr2=0x7fcbc81649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbc814e0d0 0x7fcbc81649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 -- 172.21.15.98:0/3182676088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0009ae0 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbc77fe700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fcbc000b610 tx=0x7fcbc0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000bee0 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0013e60 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80c4110 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc001e6c0 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.720+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc80c46d0 con 0x7fcbc81544f0 2023-08-22T00:25:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.721+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8047480 con 0x7fcbc81544f0 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.721+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fcbc0003040 con 0x7fcbc81544f0 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.722+0000 7fcbaeffd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 0x7fcbb4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.722+0000 7fcbc6ffd700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 msgr2=0x7fcbb4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.722+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7fcbc007b7b0 con 0x7fcbc81544f0 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.722+0000 7fcbc6ffd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 0x7fcbb4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.726+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbc004c760 con 0x7fcbc81544f0 2023-08-22T00:25:37.771 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:37.770+0000 7fd50920b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:25:37.781 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.780+0000 7f9137f8f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:37.849 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:37.848+0000 7fd50920b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:25:37.851 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.850+0000 7f9137f8f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:37.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.923+0000 7fcbc6ffd700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 msgr2=0x7fcbb4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:37.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.923+0000 7fcbc6ffd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 0x7fcbb4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:37.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.934+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc80aac80 con 0x7fcbc81544f0 2023-08-22T00:25:37.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.935+0000 7fcbaeffd700 1 -- 172.21.15.98:0/3182676088 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fcbc0023070 con 0x7fcbc81544f0 2023-08-22T00:25:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:37.939 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:18.834110+0000","modified":"2023-08-22T00:25:20.840303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8361":{"gid":8361,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/1960772363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1960772363},{"type":"v1","addr":"172.21.15.98:6837","nonce":1960772363}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-22T00:25:37.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 msgr2=0x7fcbb4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:37.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 0x7fcbb4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 msgr2=0x7fcbc80c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:37.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fcbc000b610 tx=0x7fcbc0009840).stop 2023-08-22T00:25:37.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 shutdown_connections 2023-08-22T00:25:37.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fcbb405efc0 0x7fcbb4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:37.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcbc80c5a90 0x7fcbc80c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc81544f0 0x7fcbc80c1b20 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 --2- 172.21.15.98:0/3182676088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbc814e0d0 0x7fcbc81649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 >> 172.21.15.98:0/3182676088 conn(0x7fcbc80caa80 msgr2=0x7fcbc80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.936+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 shutdown_connections 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:37.937+0000 7fcbcd5dd700 1 -- 172.21.15.98:0/3182676088 wait complete. 2023-08-22T00:25:37.943 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 55 2023-08-22T00:25:37.951 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:37.968 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:37.964+0000 7f9137f8f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:38.005 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.004+0000 7fd50920b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:25:38.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.070+0000 7f090608e700 1 Processor -- start 2023-08-22T00:25:38.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.070+0000 7f090608e700 1 -- start start 2023-08-22T00:25:38.073 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:38.071+0000 7f9137f8f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:38.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f090608e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0900150e40 0x7f09000c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f090608e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0900065f10 0x7f0900066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f090608e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000bd3e0 con 0x7f09000bd870 2023-08-22T00:25:38.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f090608e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000bd0c0 con 0x7f0900065f10 2023-08-22T00:25:38.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f090608e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0900066830 con 0x7f0900150e40 2023-08-22T00:25:38.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f08fffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0900065f10 0x7f0900066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f08feffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f09000bd870 0x7f09000a6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53340/0 (socket says 172.21.15.98:53340) 2023-08-22T00:25:38.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f08fffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0900065f10 0x7f0900066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49974/0 (socket says 172.21.15.98:49974) 2023-08-22T00:25:38.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f08feffd700 1 -- 172.21.15.98:0/1620566718 learned_addr learned my addr 172.21.15.98:0/1620566718 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:38.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.071+0000 7f08ff7fe700 1 --2- 172.21.15.98:0/1620566718 >> v2:172.21.15.118:3300/0 conn(0x7f0900150e40 0x7f09000c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fffff700 1 -- 172.21.15.98:0/1620566718 >> v2:172.21.15.118:3300/0 conn(0x7f0900150e40 msgr2=0x7f09000c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:38.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fffff700 1 --2- 172.21.15.98:0/1620566718 >> v2:172.21.15.118:3300/0 conn(0x7f0900150e40 0x7f09000c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fffff700 1 -- 172.21.15.98:0/1620566718 >> v1:172.21.15.98:6789/0 conn(0x7f09000bd870 legacy=0x7f09000a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fe7fc700 1 -- 172.21.15.98:0/1620566718 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807215605 0 0) 0x7f09000bd3e0 con 0x7f09000bd870 2023-08-22T00:25:38.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fffff700 1 -- 172.21.15.98:0/1620566718 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000c3bb0 con 0x7f0900065f10 2023-08-22T00:25:38.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fffff700 1 --2- 172.21.15.98:0/1620566718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f0900066340 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f09000c52a0 tx=0x7f08f8009060).ready entity=mon.0 client_cookie=911f1a8b5d956f3a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:38.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fe7fc700 1 -- 172.21.15.98:0/1620566718 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80090d0 con 0x7f0900065f10 2023-08-22T00:25:38.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fe7fc700 1 -- 172.21.15.98:0/1620566718 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800f510 con 0x7f0900065f10 2023-08-22T00:25:38.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f08fe7fc700 1 -- 172.21.15.98:0/1620566718 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800f890 con 0x7f0900065f10 2023-08-22T00:25:38.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 -- 172.21.15.98:0/1620566718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 msgr2=0x7f0900066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 --2- 172.21.15.98:0/1620566718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f0900066340 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f09000c52a0 tx=0x7f08f8009060).stop 2023-08-22T00:25:38.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 -- 172.21.15.98:0/1620566718 shutdown_connections 2023-08-22T00:25:38.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 --2- 172.21.15.98:0/1620566718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f0900066340 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 --2- 172.21.15.98:0/1620566718 >> v2:172.21.15.118:3300/0 conn(0x7f0900150e40 0x7f09000c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.072+0000 7f090608e700 1 -- 172.21.15.98:0/1620566718 >> 172.21.15.98:0/1620566718 conn(0x7f090006a980 msgr2=0x7f09000c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:38.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.073+0000 7f090608e700 1 -- 172.21.15.98:0/1620566718 shutdown_connections 2023-08-22T00:25:38.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.073+0000 7f090608e700 1 -- 172.21.15.98:0/1620566718 wait complete. 2023-08-22T00:25:38.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.074+0000 7f090608e700 1 Processor -- start 2023-08-22T00:25:38.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.074+0000 7f090608e700 1 -- start start 2023-08-22T00:25:38.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09000bd870 0x7f090014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0900150e40 0x7f0900153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000ac0c0 con 0x7f0900065f10 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900151d10 con 0x7f09000bd870 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000aba70 con 0x7f0900150e40 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49980/0 (socket says 172.21.15.98:49980) 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 -- 172.21.15.98:0/3252284619 learned_addr learned my addr 172.21.15.98:0/3252284619 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:38.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08feffd700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09000bd870 0x7f090014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08fffff700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0900150e40 0x7f0900153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 -- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0900150e40 msgr2=0x7f0900153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0900150e40 0x7f0900153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 -- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09000bd870 msgr2=0x7f090014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09000bd870 0x7f090014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 -- 172.21.15.98:0/3252284619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80092a0 con 0x7f0900065f10 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08ff7fe700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f08f000e380 tx=0x7f08f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:38.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000ee60 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0012430 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000abd50 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00127b0 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.075+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09001507c0 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f08f0012b20 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09000ab8b0 con 0x7f0900065f10 2023-08-22T00:25:38.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f08e77fe700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 0x7f08ec061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f08feffd700 1 -- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 msgr2=0x7f08ec061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:38.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f08f007d070 con 0x7f0900065f10 2023-08-22T00:25:38.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.077+0000 7f08feffd700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 0x7f08ec061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:38.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.081+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08f004df70 con 0x7f0900065f10 2023-08-22T00:25:38.093 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.083+0000 7fd50920b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:25:38.223 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.212+0000 7fd50920b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:25:38.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.261+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0900047480 con 0x7f0900065f10 2023-08-22T00:25:38.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.262+0000 7f08e77fe700 1 -- 172.21.15.98:0/3252284619 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+17644 (secure 0 0 0) 0x7f08f0051e60 con 0x7f0900065f10 2023-08-22T00:25:38.264 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:38.265 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":153,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:31.187309+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:17.394168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:17.784773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3271729389":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6833/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:6832/118203":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/2741359280":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/3064880461":"2023-08-23T00:25:31.187262+0000","172.21.15.98:0/4252953891":"2023-08-23T00:25:31.187262+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:38.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 msgr2=0x7f08ec061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 0x7f08ec061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 msgr2=0x7f09000ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f08f000e380 tx=0x7f08f000b040).stop 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 shutdown_connections 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f08ec05ef90 0x7f08ec061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:38.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0900150e40 0x7f0900153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0900065f10 0x7f09000ac550 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 --2- 172.21.15.98:0/3252284619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09000bd870 0x7f090014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 >> 172.21.15.98:0/3252284619 conn(0x7f090006a980 msgr2=0x7f09000c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:38.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 shutdown_connections 2023-08-22T00:25:38.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.265+0000 7f090608e700 1 -- 172.21.15.98:0/3252284619 wait complete. 2023-08-22T00:25:38.280 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:25:38.328 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.327+0000 7fd50920b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:25:38.368 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:38.363+0000 7f9137f8f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:38.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 Processor -- start 2023-08-22T00:25:38.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 -- start start 2023-08-22T00:25:38.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6728154040 0x7f67280bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67280c3d00 con 0x7f67280bf2c0 2023-08-22T00:25:38.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280c3fe0 con 0x7f6728154040 2023-08-22T00:25:38.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.400+0000 7f672e11f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280c42c0 con 0x7f6728153c60 2023-08-22T00:25:38.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6728154040 0x7f67280bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67277fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67277fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:55558/0 (socket says 172.21.15.98:55558) 2023-08-22T00:25:38.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6728154040 0x7f67280bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:39028/0 (socket says 172.21.15.98:39028) 2023-08-22T00:25:38.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67277fe700 1 -- 172.21.15.98:0/3439695549 learned_addr learned my addr 172.21.15.98:0/3439695549 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:38.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6727fff700 1 --1- 172.21.15.98:0/3439695549 >> v1:172.21.15.118:6789/0 conn(0x7f67280bf2c0 0x7f67280aa980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:48538/0 (socket says 172.21.15.98:48538) 2023-08-22T00:25:38.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 -- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 msgr2=0x7f67280c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:38.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 -- 172.21.15.98:0/3439695549 >> v1:172.21.15.118:6789/0 conn(0x7f67280bf2c0 legacy=0x7f67280aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 -- 172.21.15.98:0/3439695549 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280c45a0 con 0x7f6728154040 2023-08-22T00:25:38.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67267fc700 1 -- 172.21.15.98:0/3439695549 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596909722 0 0) 0x7f67280c3d00 con 0x7f67280bf2c0 2023-08-22T00:25:38.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67277fe700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:38.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f6726ffd700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f67280bedd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f671c009760 tx=0x7f671c009060).ready entity=mon.1 client_cookie=924eadf68dc5ce5f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:38.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67267fc700 1 -- 172.21.15.98:0/3439695549 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c00f510 con 0x7f6728154040 2023-08-22T00:25:38.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67267fc700 1 -- 172.21.15.98:0/3439695549 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c00f670 con 0x7f6728154040 2023-08-22T00:25:38.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.401+0000 7f67267fc700 1 -- 172.21.15.98:0/3439695549 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c00f9f0 con 0x7f6728154040 2023-08-22T00:25:38.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 -- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 msgr2=0x7f67280bedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f67280bedd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f671c009760 tx=0x7f671c009060).stop 2023-08-22T00:25:38.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 -- 172.21.15.98:0/3439695549 shutdown_connections 2023-08-22T00:25:38.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6728153c60 0x7f67280c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 --2- 172.21.15.98:0/3439695549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f67280bedd0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 -- 172.21.15.98:0/3439695549 >> 172.21.15.98:0/3439695549 conn(0x7f67280c93e0 msgr2=0x7f67280c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:38.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 -- 172.21.15.98:0/3439695549 shutdown_connections 2023-08-22T00:25:38.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.402+0000 7f672e11f700 1 -- 172.21.15.98:0/3439695549 wait complete. 2023-08-22T00:25:38.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.403+0000 7f672e11f700 1 Processor -- start 2023-08-22T00:25:38.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 -- start start 2023-08-22T00:25:38.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 0x7f67281443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f6728064be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6728067b50 con 0x7f6728153c60 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6728063e20 con 0x7f6728154040 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f672e11f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6728064100 con 0x7f67280bf2c0 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f6726ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f6726ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49994/0 (socket says 172.21.15.98:49994) 2023-08-22T00:25:38.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f6726ffd700 1 -- 172.21.15.98:0/474350943 learned_addr learned my addr 172.21.15.98:0/474350943 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f67277fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 0x7f67281443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.404+0000 7f6727fff700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f6728064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 msgr2=0x7f6728064be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f6728064be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 msgr2=0x7f6728067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:38.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 -- 172.21.15.98:0/474350943 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009370 con 0x7f67280bf2c0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f6726ffd700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f67277fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 0x7f67281443c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f671800ea00 tx=0x7f67180090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800c850 con 0x7f67280bf2c0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671800c9b0 con 0x7f67280bf2c0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c0092a0 con 0x7f67280bf2c0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800cd30 con 0x7f67280bf2c0 2023-08-22T00:25:38.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.405+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67280646c0 con 0x7f67280bf2c0 2023-08-22T00:25:38.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.406+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672806a030 con 0x7f67280bf2c0 2023-08-22T00:25:38.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.406+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 68) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f6718012600 con 0x7f67280bf2c0 2023-08-22T00:25:38.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.407+0000 7f670f7fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 0x7f6714061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:38.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.407+0000 7f6726ffd700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 msgr2=0x7f6714061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:38.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.407+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f671807a8d0 con 0x7f67280bf2c0 2023-08-22T00:25:38.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.407+0000 7f6726ffd700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 0x7f6714061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:25:38.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.411+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f671804b8e0 con 0x7f67280bf2c0 2023-08-22T00:25:38.437 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:25:38.436+0000 7f9137f8f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:38.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.608+0000 7f6726ffd700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 msgr2=0x7f6714061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:25:38.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.608+0000 7f6726ffd700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 0x7f6714061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:25:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.624+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6728067dc0 con 0x7f67280bf2c0 2023-08-22T00:25:38.636 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.635+0000 7fd50920b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:25:38.709 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.708+0000 7fd50920b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:25:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.729+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mgrmap(e 69) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f6718078240 con 0x7f67280bf2c0 2023-08-22T00:25:38.733 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:25:38.733 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:25:38.733 INFO:tasks.ceph.mds.c.smithi098.stderr:2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:25:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.729+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 msgr2=0x7f6714061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:25:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:38.729+0000 7f670f7fe700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 0x7f6714061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:38.735 INFO:tasks.ceph.mds.c.smithi098.stderr: -2252> 2023-08-22T00:25:24.744+0000 7fb2603b5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:25:38.738 INFO:tasks.ceph.mds.c.smithi098.stderr: -5> 2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-22T00:25:38.738 INFO:tasks.ceph.mds.c.smithi098.stderr: -4> 2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-22T00:25:38.739 INFO:tasks.ceph.mds.c.smithi098.stderr: -1> 2023-08-22T00:25:38.730+0000 7fb25cbae700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-22T00:25:38.759 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:25:38.789 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.784+0000 7fd487cbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.789 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.784+0000 7fd487cbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.789 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.784+0000 7fd487cbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.789 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.784+0000 7fd487cbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.784+0000 7fd487cbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.785+0000 7fd48acc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.785+0000 7fd48acc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.785+0000 7fd48acc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.785+0000 7fd48acc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:38.790 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:25:38.785+0000 7fd48acc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:25:39.348 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:25:39.345+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:25:39.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.351+0000 7f670f7fe700 1 -- 172.21.15.98:0/474350943 <== mon.2 v2:172.21.15.118:3301/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f671806e2c0 con 0x7f67280bf2c0 2023-08-22T00:25:39.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 msgr2=0x7f67281443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 0x7f67281443c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f671800ea00 tx=0x7f67180090f0).stop 2023-08-22T00:25:39.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 shutdown_connections 2023-08-22T00:25:39.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f671405efc0 0x7f6714061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:39.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67280bf2c0 0x7f67281443c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728154040 0x7f6728064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 --2- 172.21.15.98:0/474350943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6728153c60 0x7f6728067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 >> 172.21.15.98:0/474350943 conn(0x7f67280c93e0 msgr2=0x7f67280a80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:39.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 shutdown_connections 2023-08-22T00:25:39.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.354+0000 7f672e11f700 1 -- 172.21.15.98:0/474350943 wait complete. 2023-08-22T00:25:39.362 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:25:39.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:25:39.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.490+0000 7f8e7ace3700 1 Processor -- start 2023-08-22T00:25:39.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.490+0000 7f8e7ace3700 1 -- start start 2023-08-22T00:25:39.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.491+0000 7f8e7ace3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e7415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:39.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.491+0000 7f8e7ace3700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e740672d0 con 0x7f8e74150990 2023-08-22T00:25:39.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.491+0000 7f8e7ace3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e740c1a00 con 0x7f8e74150d70 2023-08-22T00:25:39.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.491+0000 7f8e7ace3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740666c0 con 0x7f8e740c6b80 2023-08-22T00:25:39.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e78a7f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8e74150990 0x7f8e740c6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:53354/0 (socket says 172.21.15.98:53354) 2023-08-22T00:25:39.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e78a7f700 1 -- 172.21.15.98:0/4178105868 learned_addr learned my addr 172.21.15.98:0/4178105868 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:39.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e79280700 1 --2- 172.21.15.98:0/4178105868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e7415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:39.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462053907 0 0) 0x7f8e740672d0 con 0x7f8e74150990 2023-08-22T00:25:39.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e640033f0 con 0x7f8e74150990 2023-08-22T00:25:39.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249817950 0 0) 0x7f8e740c1a00 con 0x7f8e74150d70 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e740672d0 con 0x7f8e74150d70 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e79280700 1 -- 172.21.15.98:0/4178105868 >> v1:172.21.15.118:6789/0 conn(0x7f8e74150d70 legacy=0x7f8e74065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e79280700 1 -- 172.21.15.98:0/4178105868 >> v1:172.21.15.98:6789/0 conn(0x7f8e74150990 legacy=0x7f8e740c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e79280700 1 -- 172.21.15.98:0/4178105868 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740669a0 con 0x7f8e740c6b80 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e79280700 1 --2- 172.21.15.98:0/4178105868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e7415b720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8e6c009e90 tx=0x7f8e6c009780).ready entity=mon.2 client_cookie=b84035f79e300a3a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:39.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00e070 con 0x7f8e740c6b80 2023-08-22T00:25:39.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00bab0 con 0x7f8e740c6b80 2023-08-22T00:25:39.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.492+0000 7f8e737fe700 1 -- 172.21.15.98:0/4178105868 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00be30 con 0x7f8e740c6b80 2023-08-22T00:25:39.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 -- 172.21.15.98:0/4178105868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 msgr2=0x7f8e7415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/4178105868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e7415b720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8e6c009e90 tx=0x7f8e6c009780).stop 2023-08-22T00:25:39.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 -- 172.21.15.98:0/4178105868 shutdown_connections 2023-08-22T00:25:39.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/4178105868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e7415b720 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 -- 172.21.15.98:0/4178105868 >> 172.21.15.98:0/4178105868 conn(0x7f8e740c3a60 msgr2=0x7f8e740c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:39.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 -- 172.21.15.98:0/4178105868 shutdown_connections 2023-08-22T00:25:39.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.493+0000 7f8e7ace3700 1 -- 172.21.15.98:0/4178105868 wait complete. 2023-08-22T00:25:39.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.494+0000 7f8e7ace3700 1 Processor -- start 2023-08-22T00:25:39.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 -- start start 2023-08-22T00:25:39.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e740be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e74150990 0x7f8e74143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74149d40 con 0x7f8e74150d70 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74144080 con 0x7f8e74150990 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.495+0000 7f8e7ace3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740be620 con 0x7f8e740c6b80 2023-08-22T00:25:39.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50060/0 (socket says 172.21.15.98:50060) 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 -- 172.21.15.98:0/3538613807 learned_addr learned my addr 172.21.15.98:0/3538613807 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e78a7f700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e740be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e73fff700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e74150990 0x7f8e74143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 -- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 msgr2=0x7f8e740be060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e740be060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 -- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e74150990 msgr2=0x7f8e74143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e74150990 0x7f8e74143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 -- 172.21.15.98:0/3538613807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009a20 con 0x7f8e74150d70 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e79280700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8e6c011000 tx=0x7f8e74067240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c01c660 con 0x7f8e74150d70 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c01c7c0 con 0x7f8e74150d70 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e740be900 con 0x7f8e74150d70 2023-08-22T00:25:39.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c01cb80 con 0x7f8e74150d70 2023-08-22T00:25:39.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.496+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e740beec0 con 0x7f8e74150d70 2023-08-22T00:25:39.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.497+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e74149e80 con 0x7f8e74150d70 2023-08-22T00:25:39.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.498+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 69) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f8e6c003040 con 0x7f8e74150d70 2023-08-22T00:25:39.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.498+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 7033+0+0 (secure 0 0 0) 0x7f8e6c07bd70 con 0x7f8e74150d70 2023-08-22T00:25:39.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.502+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e6c04d020 con 0x7f8e74150d70 2023-08-22T00:25:39.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.705+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e74066c80 con 0x7f8e74150d70 2023-08-22T00:25:39.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.730+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 70) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f8e6c079980 con 0x7f8e74150d70 2023-08-22T00:25:39.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.730+0000 7f8e70ff9700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 0x7f8e58067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:39.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.731+0000 7f8e78a7f700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 0x7f8e58067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:39.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:39.732+0000 7f8e78a7f700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 0x7f8e58067e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8e68005750 tx=0x7f8e68009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:40.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.352+0000 7f8e70ff9700 1 -- 172.21.15.98:0/3538613807 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e6c054a90 con 0x7f8e74150d70 2023-08-22T00:25:40.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 msgr2=0x7f8e58067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 0x7f8e58067e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8e68005750 tx=0x7f8e68009040).stop 2023-08-22T00:25:40.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 msgr2=0x7f8e74155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8e6c011000 tx=0x7f8e74067240).stop 2023-08-22T00:25:40.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 shutdown_connections 2023-08-22T00:25:40.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f8e58030180 0x7f8e58067e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e740c6b80 0x7f8e740be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74150d70 0x7f8e74155ff0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 --2- 172.21.15.98:0/3538613807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e74150990 0x7f8e74143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.354+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 >> 172.21.15.98:0/3538613807 conn(0x7f8e740c3a60 msgr2=0x7f8e74145850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:40.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.355+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 shutdown_connections 2023-08-22T00:25:40.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.355+0000 7f8e7ace3700 1 -- 172.21.15.98:0/3538613807 wait complete. 2023-08-22T00:25:40.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:25:40.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.490+0000 7f79a3619700 1 Processor -- start 2023-08-22T00:25:40.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.490+0000 7f79a3619700 1 -- start start 2023-08-22T00:25:40.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a3619700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f799c14e360 0x7f799c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a3619700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f799c067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a3619700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0c6580 con 0x7f799c0c5ce0 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a3619700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0c6190 con 0x7f799c14e360 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a3619700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0645a0 con 0x7f799c0675b0 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a0bb4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f799c0c5ce0 0x7f799c063e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36798/0 (socket says 172.21.15.98:36798) 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a0bb4700 1 -- 172.21.15.98:0/3522360030 learned_addr learned my addr 172.21.15.98:0/3522360030 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:40.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a1bb6700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f799c067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a13b5700 1 --2- 172.21.15.98:0/3522360030 >> v2:172.21.15.118:3300/0 conn(0x7f799c14e360 0x7f799c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39652903 0 0) 0x7f799c0c6580 con 0x7f799c0c5ce0 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79880033f0 con 0x7f799c0c5ce0 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096410052 0 0) 0x7f79880033f0 con 0x7f799c0c5ce0 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 msgr2=0x7f799c067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f799c067a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 >> v2:172.21.15.118:3300/0 conn(0x7f799c14e360 msgr2=0x7f799c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:40.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 --2- 172.21.15.98:0/3522360030 >> v2:172.21.15.118:3300/0 conn(0x7f799c14e360 0x7f799c1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c067f30 con 0x7f799c0c5ce0 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7998001470 con 0x7f799c0c5ce0 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 >> v1:172.21.15.98:6789/0 conn(0x7f799c0c5ce0 legacy=0x7f799c063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f7988003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988004690 0x7f7988004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f7988005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0645a0 con 0x7f79880038e0 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880044b0 con 0x7f7988004690 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798800b910 con 0x7f799c0675b0 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.491+0000 7f79a13b5700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f7988003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a0bb4700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988004690 0x7f7988004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a1bb6700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f7988005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 -- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 msgr2=0x7f7988005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f7988005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 -- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988004690 msgr2=0x7f7988004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988004690 0x7f7988004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 -- 172.21.15.98:0/3522360030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880033f0 con 0x7f79880038e0 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a1bb6700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0675b0 0x7f7988005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a13b5700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f7988003d00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f798c009a80 tx=0x7f798c009060).ready entity=mon.0 client_cookie=4cdfb1cb30a59b21 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c009430 con 0x7f79880038e0 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00e640 con 0x7f79880038e0 2023-08-22T00:25:40.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f7993fff700 1 -- 172.21.15.98:0/3522360030 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00e9c0 con 0x7f79880038e0 2023-08-22T00:25:40.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a3619700 1 -- 172.21.15.98:0/3522360030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 msgr2=0x7f7988003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a3619700 1 --2- 172.21.15.98:0/3522360030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f7988003d00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f798c009a80 tx=0x7f798c009060).stop 2023-08-22T00:25:40.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a1bb6700 1 -- 172.21.15.98:0/3522360030 reap_dead start 2023-08-22T00:25:40.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a3619700 1 -- 172.21.15.98:0/3522360030 shutdown_connections 2023-08-22T00:25:40.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.492+0000 7f79a3619700 1 -- 172.21.15.98:0/3522360030 >> 172.21.15.98:0/3522360030 conn(0x7f799c066a70 msgr2=0x7f799c0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:40.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.493+0000 7f79a3619700 1 -- 172.21.15.98:0/3522360030 shutdown_connections 2023-08-22T00:25:40.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.493+0000 7f79a3619700 1 -- 172.21.15.98:0/3522360030 wait complete. 2023-08-22T00:25:40.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.494+0000 7f79a3619700 1 Processor -- start 2023-08-22T00:25:40.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.494+0000 7f79a3619700 1 -- start start 2023-08-22T00:25:40.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34592/0 (socket says 172.21.15.98:34592) 2023-08-22T00:25:40.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0a38d0 0x7f799c151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 -- 172.21.15.98:0/618030848 learned_addr learned my addr 172.21.15.98:0/618030848 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:40.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 0x7f799c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ab6a0 con 0x7f79880038e0 2023-08-22T00:25:40.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ac4c0 con 0x7f799c151530 2023-08-22T00:25:40.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c13f760 con 0x7f799c0a38d0 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a1bb6700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 0x7f799c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 -- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0a38d0 msgr2=0x7f799c151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0a38d0 0x7f799c151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 -- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 msgr2=0x7f799c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 0x7f799c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0ab8b0 con 0x7f79880038e0 2023-08-22T00:25:40.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a1bb6700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 0x7f799c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a13b5700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f798c006d30 tx=0x7f798c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00ed30 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00eeb0 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c01b450 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.495+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0abb90 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.496+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c0ac150 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.496+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c047480 con 0x7f79880038e0 2023-08-22T00:25:40.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.497+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 70) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f798c01b840 con 0x7f79880038e0 2023-08-22T00:25:40.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.497+0000 7f79917fa700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 0x7f79800611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:40.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.497+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 7033+0+0 (secure 0 0 0) 0x7f798c07baa0 con 0x7f79880038e0 2023-08-22T00:25:40.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.497+0000 7f79a0bb4700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 0x7f79800611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:40.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.498+0000 7f79a0bb4700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 0x7f79800611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7998001d20 tx=0x7f7998001e90).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:40.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.501+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f798c04cc40 con 0x7f79880038e0 2023-08-22T00:25:40.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:40.664+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f799c0c7220 con 0x7f79880038e0 2023-08-22T00:25:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.354+0000 7f79917fa700 1 -- 172.21.15.98:0/618030848 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) v1 ==== 181+0+0 (secure 0 0 0) 0x7f798c02b0d0 con 0x7f79880038e0 2023-08-22T00:25:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.358+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 msgr2=0x7f79800611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.358+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 0x7f79800611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7998001d20 tx=0x7f7998001e90).stop 2023-08-22T00:25:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.358+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 msgr2=0x7f799c13f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.358+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f798c006d30 tx=0x7f798c01a000).stop 2023-08-22T00:25:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 shutdown_connections 2023-08-22T00:25:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f799c151530 0x7f799c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79880038e0 0x7f799c13f270 secure :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0x7f798c006d30 tx=0x7f798c01a000).stop 2023-08-22T00:25:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f798005ecf0 0x7f79800611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 --2- 172.21.15.98:0/618030848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f799c0a38d0 0x7f799c151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 >> 172.21.15.98:0/618030848 conn(0x7f799c066a70 msgr2=0x7f799c153600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 shutdown_connections 2023-08-22T00:25:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.359+0000 7f79a3619700 1 -- 172.21.15.98:0/618030848 wait complete. 2023-08-22T00:25:41.363 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:25:41.375 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:25:41.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.500+0000 7f574e447700 1 Processor -- start 2023-08-22T00:25:41.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.500+0000 7f574e447700 1 -- start start 2023-08-22T00:25:41.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574e447700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5748154830 0x7f57480c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574e447700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5748062600 con 0x7f5748153c80 2023-08-22T00:25:41.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574e447700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57480c2a60 con 0x7f57480a5910 2023-08-22T00:25:41.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574e447700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5748062f10 con 0x7f5748154830 2023-08-22T00:25:41.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574c9e4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f5748153c80 0x7f5748063330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36814/0 (socket says 172.21.15.98:36814) 2023-08-22T00:25:41.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.501+0000 7f574c9e4700 1 -- 172.21.15.98:0/2416838743 learned_addr learned my addr 172.21.15.98:0/2416838743 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:41.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 --2- 172.21.15.98:0/2416838743 >> v2:172.21.15.118:3300/0 conn(0x7f5748154830 0x7f57480c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473193888 0 0) 0x7f5748062600 con 0x7f5748153c80 2023-08-22T00:25:41.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5734004500 con 0x7f5748153c80 2023-08-22T00:25:41.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706426303 0 0) 0x7f5734004500 con 0x7f5748153c80 2023-08-22T00:25:41.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 >> v2:172.21.15.118:3300/0 conn(0x7f5748154830 msgr2=0x7f57480c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 --2- 172.21.15.98:0/2416838743 >> v2:172.21.15.118:3300/0 conn(0x7f5748154830 0x7f57480c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 >> v1:172.21.15.118:6789/0 conn(0x7f57480a5910 legacy=0x7f57480c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57480c2d30 con 0x7f5748153c80 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f57400017f0 con 0x7f5748153c80 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 >> v1:172.21.15.98:6789/0 conn(0x7f5748153c80 legacy=0x7f5748063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57340049f0 0x7f5734004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f5734005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5734006110 0x7f5734003310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5748062f10 con 0x7f57340057a0 2023-08-22T00:25:41.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5734003830 con 0x7f57340049f0 2023-08-22T00:25:41.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57340039f0 con 0x7f5734006110 2023-08-22T00:25:41.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f5734005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5747fff700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57340049f0 0x7f5734004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f574c9e4700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5734006110 0x7f5734003310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 -- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5734006110 msgr2=0x7f5734003310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:41.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5734006110 0x7f5734003310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 -- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57340049f0 msgr2=0x7f5734004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57340049f0 0x7f5734004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 -- 172.21.15.98:0/2416838743 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734004500 con 0x7f57340057a0 2023-08-22T00:25:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f574c9e4700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5734006110 0x7f5734003310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f5747fff700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57340049f0 0x7f5734004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f574c9e4700 1 -- 172.21.15.98:0/2416838743 reap_dead start 2023-08-22T00:25:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.502+0000 7f57477fe700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f5734005c20 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5738009a80 tx=0x7f5738009060).ready entity=mon.0 client_cookie=823f498008ea1025 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738009430 con 0x7f57340057a0 2023-08-22T00:25:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800e640 con 0x7f57340057a0 2023-08-22T00:25:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f5746ffd700 1 -- 172.21.15.98:0/2416838743 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e9c0 con 0x7f57340057a0 2023-08-22T00:25:41.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 -- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 msgr2=0x7f5734005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f5734005c20 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5738009a80 tx=0x7f5738009060).stop 2023-08-22T00:25:41.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 -- 172.21.15.98:0/2416838743 shutdown_connections 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 --2- 172.21.15.98:0/2416838743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f5734005c20 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 -- 172.21.15.98:0/2416838743 >> 172.21.15.98:0/2416838743 conn(0x7f57480c7170 msgr2=0x7f57480c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 -- 172.21.15.98:0/2416838743 shutdown_connections 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.503+0000 7f574e447700 1 -- 172.21.15.98:0/2416838743 wait complete. 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.504+0000 7f574e447700 1 Processor -- start 2023-08-22T00:25:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.504+0000 7f574e447700 1 -- start start 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 0x7f57480abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5748163070 0x7f57481634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5748164040 con 0x7f57340057a0 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5748150d20 con 0x7f57480ab760 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574e447700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57480ac0d0 con 0x7f5748163070 2023-08-22T00:25:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f5747fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f5747fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34600/0 (socket says 172.21.15.98:34600) 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f5747fff700 1 -- 172.21.15.98:0/3884189874 learned_addr learned my addr 172.21.15.98:0/3884189874 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f574c9e4700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5748163070 0x7f57481634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.505+0000 7f57477fe700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 0x7f57480abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 -- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5748163070 msgr2=0x7f57481634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5748163070 0x7f57481634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 -- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 msgr2=0x7f57480abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 0x7f57480abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 -- 172.21.15.98:0/3884189874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748163d60 con 0x7f57340057a0 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f57477fe700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 0x7f57480abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f5747fff700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f57300078e0 tx=0x7f5730009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000ee90 con 0x7f57340057a0 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730010450 con 0x7f57340057a0 2023-08-22T00:25:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57481506d0 con 0x7f57340057a0 2023-08-22T00:25:41.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300107f0 con 0x7f57340057a0 2023-08-22T00:25:41.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.506+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57481639e0 con 0x7f57340057a0 2023-08-22T00:25:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.507+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5748150530 con 0x7f57340057a0 2023-08-22T00:25:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.507+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 70) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f5730010ba0 con 0x7f57340057a0 2023-08-22T00:25:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.507+0000 7f573ffff700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 0x7f57280611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.508+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f5730079d10 con 0x7f57340057a0 2023-08-22T00:25:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.508+0000 7f57477fe700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 0x7f57280611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:41.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.508+0000 7f57477fe700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 0x7f57280611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5748063be0 tx=0x7f573801a000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:41.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.512+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5748150530 con 0x7f57340057a0 2023-08-22T00:25:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.673+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5748150530 con 0x7f57340057a0 2023-08-22T00:25:41.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:41.733+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f573007f020 con 0x7f57340057a0 2023-08-22T00:25:42.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.358+0000 7f573ffff700 1 -- 172.21.15.98:0/3884189874 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5730073210 con 0x7f57340057a0 2023-08-22T00:25:42.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.362+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 msgr2=0x7f57280611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.362+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 0x7f57280611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5748063be0 tx=0x7f573801a000).stop 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.362+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 msgr2=0x7f57481511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.362+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f57300078e0 tx=0x7f5730009040).stop 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 shutdown_connections 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f572805ecf0 0x7f57280611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5748163070 0x7f57481634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57340057a0 0x7f57481511b0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 --2- 172.21.15.98:0/3884189874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57480ab760 0x7f57480abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 >> 172.21.15.98:0/3884189874 conn(0x7f57480c7170 msgr2=0x7f5748065530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 shutdown_connections 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.363+0000 7f574e447700 1 -- 172.21.15.98:0/3884189874 wait complete. 2023-08-22T00:25:42.368 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:25:42.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:25:42.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.500+0000 7f2976dba700 1 Processor -- start 2023-08-22T00:25:42.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.500+0000 7f2976dba700 1 -- start start 2023-08-22T00:25:42.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2976dba700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29700a9d80 0x7f2970065f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2976dba700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2970066480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2976dba700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2970063b50 con 0x7f2970062ff0 2023-08-22T00:25:42.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2976dba700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2970066970 con 0x7f29700a9d80 2023-08-22T00:25:42.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2976dba700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970064990 con 0x7f29700aa160 2023-08-22T00:25:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2975357700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2970062ff0 0x7f2970063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36824/0 (socket says 172.21.15.98:36824) 2023-08-22T00:25:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2975357700 1 -- 172.21.15.98:0/2892016584 learned_addr learned my addr 172.21.15.98:0/2892016584 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296ffff700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2970066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f2974b56700 1 --2- 172.21.15.98:0/2892016584 >> v2:172.21.15.118:3300/0 conn(0x7f29700a9d80 0x7f2970065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661306836 0 0) 0x7f2970063b50 con 0x7f2970062ff0 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29600033f0 con 0x7f2970062ff0 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3872804506 0 0) 0x7f29600033f0 con 0x7f2970062ff0 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 msgr2=0x7f2970066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2970066480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 >> v2:172.21.15.118:3300/0 conn(0x7f29700a9d80 msgr2=0x7f2970065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 --2- 172.21.15.98:0/2892016584 >> v2:172.21.15.118:3300/0 conn(0x7f29700a9d80 0x7f2970065f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970063d80 con 0x7f2970062ff0 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.501+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f29680017f0 con 0x7f2970062ff0 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 >> v1:172.21.15.98:6789/0 conn(0x7f2970062ff0 legacy=0x7f2970063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29600038e0 0x7f2960003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f2960004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2960005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970066970 con 0x7f2960004690 2023-08-22T00:25:42.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970064990 con 0x7f29600038e0 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296000b8e0 con 0x7f29700aa160 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f2960004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f2974b56700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29600038e0 0x7f2960003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f2975357700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2960005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 -- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 msgr2=0x7f2960005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29700aa160 0x7f2960005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 -- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29600038e0 msgr2=0x7f2960003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29600038e0 0x7f2960003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 -- 172.21.15.98:0/2892016584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600033f0 con 0x7f2960004690 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296ffff700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f2960004b10 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f295c009a80 tx=0x7f295c009060).ready entity=mon.0 client_cookie=f41d419a890ad2b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c009430 con 0x7f2960004690 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00e640 con 0x7f2960004690 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.502+0000 7f296f7fe700 1 -- 172.21.15.98:0/2892016584 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00e9c0 con 0x7f2960004690 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 -- 172.21.15.98:0/2892016584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 msgr2=0x7f2960004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 --2- 172.21.15.98:0/2892016584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f2960004b10 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f295c009a80 tx=0x7f295c009060).stop 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2975357700 1 -- 172.21.15.98:0/2892016584 reap_dead start 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 -- 172.21.15.98:0/2892016584 shutdown_connections 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 -- 172.21.15.98:0/2892016584 >> 172.21.15.98:0/2892016584 conn(0x7f29700c7800 msgr2=0x7f29700c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 -- 172.21.15.98:0/2892016584 shutdown_connections 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.503+0000 7f2976dba700 1 -- 172.21.15.98:0/2892016584 wait complete. 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.504+0000 7f2976dba700 1 Processor -- start 2023-08-22T00:25:42.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.505+0000 7f2976dba700 1 -- start start 2023-08-22T00:25:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f297013a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 0x7f2970154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29700ac6f0 0x7f29700acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ac090 con 0x7f2960004690 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ad060 con 0x7f29700ac6f0 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2976dba700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ab510 con 0x7f2970154870 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f296ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 0x7f2970154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f296ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 0x7f2970154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:55302/0 (socket says 172.21.15.98:55302) 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f296ffff700 1 -- 172.21.15.98:0/3129876076 learned_addr learned my addr 172.21.15.98:0/3129876076 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2974b56700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f297013a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.506+0000 7f2975357700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29700ac6f0 0x7f29700acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 -- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 msgr2=0x7f2970154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 0x7f2970154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 -- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29700ac6f0 msgr2=0x7f29700acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29700ac6f0 0x7f29700acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 -- 172.21.15.98:0/3129876076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700ab7f0 con 0x7f2960004690 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.507+0000 7f2974b56700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f297013a1c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f2964009f40 tx=0x7f2964009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.508+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964011e50 con 0x7f2960004690 2023-08-22T00:25:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.508+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964016950 con 0x7f2960004690 2023-08-22T00:25:42.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.508+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964016ac0 con 0x7f2960004690 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.508+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700abad0 con 0x7f2960004690 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.508+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700ab1c0 con 0x7f2960004690 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.509+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970152190 con 0x7f2960004690 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.510+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f296401c020 con 0x7f2960004690 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.511+0000 7f296cff9700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 0x7f2954061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.511+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f296407e310 con 0x7f2960004690 2023-08-22T00:25:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.512+0000 7f296ffff700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 0x7f2954061320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.514+0000 7f296ffff700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 0x7f2954061320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f295c006d50 tx=0x7f295c01a000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.518+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2970152190 con 0x7f2960004690 2023-08-22T00:25:42.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.682+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2970152190 con 0x7f2960004690 2023-08-22T00:25:42.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.686+0000 7f296cff9700 1 -- 172.21.15.98:0/3129876076 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2970152190 con 0x7f2960004690 2023-08-22T00:25:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 msgr2=0x7f2954061320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 0x7f2954061320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f295c006d50 tx=0x7f295c01a000).stop 2023-08-22T00:25:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 msgr2=0x7f297013a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f297013a1c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f2964009f40 tx=0x7f2964009060).stop 2023-08-22T00:25:42.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 shutdown_connections 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29700ac6f0 0x7f29700acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2960004690 0x7f297013a1c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.687+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f295405ee60 0x7f2954061320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.688+0000 7f2976dba700 1 --2- 172.21.15.98:0/3129876076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2970154870 0x7f2970154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.688+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 >> 172.21.15.98:0/3129876076 conn(0x7f29700c7800 msgr2=0x7f29700a7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.688+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 shutdown_connections 2023-08-22T00:25:42.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.688+0000 7f2976dba700 1 -- 172.21.15.98:0/3129876076 wait complete. 2023-08-22T00:25:42.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:25:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.820+0000 7fed78e19700 1 Processor -- start 2023-08-22T00:25:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.820+0000 7fed78e19700 1 -- start start 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.821+0000 7fed78e19700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed740ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.821+0000 7fed78e19700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740c6330 con 0x7fed741578b0 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.821+0000 7fed78e19700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed741541e0 con 0x7fed740acee0 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.821+0000 7fed78e19700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c9420 con 0x7fed740c8ef0 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed72d9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fed741578b0 0x7fed740aa8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36840/0 (socket says 172.21.15.98:36840) 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed72d9d700 1 -- 172.21.15.98:0/2614758881 learned_addr learned my addr 172.21.15.98:0/2614758881 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:42.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed740ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668247069 0 0) 0x7fed740c6330 con 0x7fed741578b0 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c0033f0 con 0x7fed741578b0 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053012441 0 0) 0x7fed5c0033f0 con 0x7fed741578b0 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 msgr2=0x7fed740ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed740ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 >> v1:172.21.15.118:6789/0 conn(0x7fed740acee0 legacy=0x7fed740c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740c9700 con 0x7fed741578b0 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fed6c0017f0 con 0x7fed741578b0 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 >> v1:172.21.15.98:6789/0 conn(0x7fed741578b0 legacy=0x7fed740aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed5c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed5c004690 0x7fed5c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed5c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c9420 con 0x7fed5c003910 2023-08-22T00:25:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c00b910 con 0x7fed5c004690 2023-08-22T00:25:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c00bad0 con 0x7fed740c8ef0 2023-08-22T00:25:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed7259c700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed5c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed5c004690 0x7fed5c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.822+0000 7fed72d9d700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed5c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 -- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 msgr2=0x7fed5c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed5c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 -- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed5c004690 msgr2=0x7fed5c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed5c004690 0x7fed5c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 -- 172.21.15.98:0/2614758881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0033f0 con 0x7fed5c003910 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed72d9d700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed740c8ef0 0x7fed5c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed5c004690 0x7fed5c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7259c700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed5c003d30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fed64001730 tx=0x7fed64007bb0).ready entity=mon.0 client_cookie=ecd6c1d75b4913de server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64007020 con 0x7fed5c003910 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64007180 con 0x7fed5c003910 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed7159a700 1 -- 172.21.15.98:0/2614758881 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64007500 con 0x7fed5c003910 2023-08-22T00:25:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 -- 172.21.15.98:0/2614758881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 msgr2=0x7fed5c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 --2- 172.21.15.98:0/2614758881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed5c003d30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fed64001730 tx=0x7fed64007bb0).stop 2023-08-22T00:25:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed72d9d700 1 -- 172.21.15.98:0/2614758881 reap_dead start 2023-08-22T00:25:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 -- 172.21.15.98:0/2614758881 shutdown_connections 2023-08-22T00:25:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 -- 172.21.15.98:0/2614758881 >> 172.21.15.98:0/2614758881 conn(0x7fed740cb600 msgr2=0x7fed740c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:42.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 -- 172.21.15.98:0/2614758881 shutdown_connections 2023-08-22T00:25:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.823+0000 7fed78e19700 1 -- 172.21.15.98:0/2614758881 wait complete. 2023-08-22T00:25:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.825+0000 7fed78e19700 1 Processor -- start 2023-08-22T00:25:42.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.825+0000 7fed78e19700 1 -- start start 2023-08-22T00:25:42.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74141620 0x7fed74156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed74156bf0 0x7fed740c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c2ac0 con 0x7fed5c003910 2023-08-22T00:25:42.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c1bd0 con 0x7fed74141620 2023-08-22T00:25:42.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed78e19700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c1eb0 con 0x7fed74156bf0 2023-08-22T00:25:42.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34644/0 (socket says 172.21.15.98:34644) 2023-08-22T00:25:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 -- 172.21.15.98:0/2543214043 learned_addr learned my addr 172.21.15.98:0/2543214043 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:42.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed72d9d700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed74156bf0 0x7fed740c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74141620 0x7fed74156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 -- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed74156bf0 msgr2=0x7fed740c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed74156bf0 0x7fed740c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 -- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74141620 msgr2=0x7fed74156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74141620 0x7fed74156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 -- 172.21.15.98:0/2543214043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740c2190 con 0x7fed5c003910 2023-08-22T00:25:42.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed7259c700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fed5c00b8e0 tx=0x7fed64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.826+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64013670 con 0x7fed5c003910 2023-08-22T00:25:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.827+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed640137d0 con 0x7fed5c003910 2023-08-22T00:25:42.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.827+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740c2470 con 0x7fed5c003910 2023-08-22T00:25:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.827+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64013b50 con 0x7fed5c003910 2023-08-22T00:25:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.827+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74141aa0 con 0x7fed5c003910 2023-08-22T00:25:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.828+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed740c2da0 con 0x7fed5c003910 2023-08-22T00:25:42.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.828+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fed6401f400 con 0x7fed5c003910 2023-08-22T00:25:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.828+0000 7fed627fc700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 0x7fed540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.828+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fed6407a940 con 0x7fed5c003910 2023-08-22T00:25:42.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.828+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 0x7fed540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:42.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.829+0000 7fed71d9b700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 0x7fed540612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed68006c20 tx=0x7fed68008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:42.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.832+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed6404bd10 con 0x7fed5c003910 2023-08-22T00:25:42.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.995+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fed740c2910 con 0x7fed5c003910 2023-08-22T00:25:43.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:42.999+0000 7fed627fc700 1 -- 172.21.15.98:0/2543214043 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fed64024070 con 0x7fed5c003910 2023-08-22T00:25:43.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 msgr2=0x7fed540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 0x7fed540612d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed68006c20 tx=0x7fed68008040).stop 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 msgr2=0x7fed740c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fed5c00b8e0 tx=0x7fed64015000).stop 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 shutdown_connections 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed5405ee10 0x7fed540612d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed74156bf0 0x7fed740c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed5c003910 0x7fed740c2f50 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 --2- 172.21.15.98:0/2543214043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74141620 0x7fed74156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 >> 172.21.15.98:0/2543214043 conn(0x7fed740cb600 msgr2=0x7fed741529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:43.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 shutdown_connections 2023-08-22T00:25:43.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.001+0000 7fed78e19700 1 -- 172.21.15.98:0/2543214043 wait complete. 2023-08-22T00:25:43.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-22T00:25:43.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 Processor -- start 2023-08-22T00:25:43.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 -- start start 2023-08-22T00:25:43.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f342414e0d0 0x7f342414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 0x7f34240c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3424155260 con 0x7f34241544f0 2023-08-22T00:25:43.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240c17b0 con 0x7f342414e0d0 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.131+0000 7f3429a53700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240bf9e0 con 0x7f34240c5a90 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f342414e0d0 0x7f342414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f342414e0d0 0x7f342414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34650/0 (socket says 172.21.15.98:34650) 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 -- 172.21.15.98:0/1848738964 learned_addr learned my addr 172.21.15.98:0/1848738964 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f34227fc700 1 --2- 172.21.15.98:0/1848738964 >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 0x7f34240c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 -- 172.21.15.98:0/1848738964 >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 msgr2=0x7f34240c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 --2- 172.21.15.98:0/1848738964 >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 0x7f34240c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 -- 172.21.15.98:0/1848738964 >> v1:172.21.15.118:6789/0 conn(0x7f34241544f0 legacy=0x7f34241549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 -- 172.21.15.98:0/1848738964 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240bfcc0 con 0x7f342414e0d0 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f34227fc700 1 --2- 172.21.15.98:0/1848738964 >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 0x7f34240c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3422ffd700 1 --2- 172.21.15.98:0/1848738964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f342414e0d0 0x7f342414e4b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f3414006fd0 tx=0x7f34140090f0).ready entity=mon.0 client_cookie=fa91c73407170430 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3421ffb700 1 -- 172.21.15.98:0/1848738964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400b600 con 0x7f342414e0d0 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3421ffb700 1 -- 172.21.15.98:0/1848738964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400b760 con 0x7f342414e0d0 2023-08-22T00:25:43.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.132+0000 7f3421ffb700 1 -- 172.21.15.98:0/1848738964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400bae0 con 0x7f342414e0d0 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 -- 172.21.15.98:0/1848738964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f342414e0d0 msgr2=0x7f342414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 --2- 172.21.15.98:0/1848738964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f342414e0d0 0x7f342414e4b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f3414006fd0 tx=0x7f34140090f0).stop 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 -- 172.21.15.98:0/1848738964 shutdown_connections 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 --2- 172.21.15.98:0/1848738964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f342414e0d0 0x7f342414e4b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 --2- 172.21.15.98:0/1848738964 >> v2:172.21.15.118:3300/0 conn(0x7f34240c5a90 0x7f34240c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 -- 172.21.15.98:0/1848738964 >> 172.21.15.98:0/1848738964 conn(0x7f34240caa80 msgr2=0x7f34240cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:43.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 -- 172.21.15.98:0/1848738964 shutdown_connections 2023-08-22T00:25:43.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.133+0000 7f3429a53700 1 -- 172.21.15.98:0/1848738964 wait complete. 2023-08-22T00:25:43.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.134+0000 7f3429a53700 1 Processor -- start 2023-08-22T00:25:43.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.134+0000 7f3429a53700 1 -- start start 2023-08-22T00:25:43.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f342414e0d0 0x7f3424151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241544f0 0x7f34240c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c2ed0 con 0x7f34240c5a90 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c31b0 con 0x7f34241544f0 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.135+0000 7f3429a53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c3490 con 0x7f342414e0d0 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34654/0 (socket says 172.21.15.98:34654) 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 -- 172.21.15.98:0/1191868907 learned_addr learned my addr 172.21.15.98:0/1191868907 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f34227fc700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f342414e0d0 0x7f3424151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f34237fe700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241544f0 0x7f34240c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 -- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f342414e0d0 msgr2=0x7f3424151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f342414e0d0 0x7f3424151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 -- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241544f0 msgr2=0x7f34240c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241544f0 0x7f34240c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 -- 172.21.15.98:0/1191868907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009370 con 0x7f34240c5a90 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3422ffd700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f34240ca9e0 tx=0x7f3414017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400b8d0 con 0x7f34240c5a90 2023-08-22T00:25:43.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400ba30 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34240c3770 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341401b660 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.136+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34241641c0 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.137+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240c3c10 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.137+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f341401b9d0 con 0x7f34240c5a90 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.138+0000 7f340affd700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 0x7f34100612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:43.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.138+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f341407b780 con 0x7f34240c5a90 2023-08-22T00:25:43.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.138+0000 7f34227fc700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 0x7f34100612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:43.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.138+0000 7f34227fc700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 0x7f34100612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3418006d80 tx=0x7f3418008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:43.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.142+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f341404cbb0 con 0x7f34240c5a90 2023-08-22T00:25:43.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:43.368+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f34240c3dc0 con 0x7f34240c5a90 2023-08-22T00:25:44.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.361+0000 7f340affd700 1 -- 172.21.15.98:0/1191868907 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v742) v1 ==== 174+0+0 (secure 0 0 0) 0x7f341401f020 con 0x7f34240c5a90 2023-08-22T00:25:44.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 msgr2=0x7f34100612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 0x7f34100612d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3418006d80 tx=0x7f3418008040).stop 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 msgr2=0x7f3424163cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f34240ca9e0 tx=0x7f3414017000).stop 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 shutdown_connections 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241544f0 0x7f34240c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34240c5a90 0x7f3424163cd0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f341005ee10 0x7f34100612d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 --2- 172.21.15.98:0/1191868907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f342414e0d0 0x7f3424151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 >> 172.21.15.98:0/1191868907 conn(0x7f34240caa80 msgr2=0x7f34240cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:44.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 shutdown_connections 2023-08-22T00:25:44.367 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.364+0000 7f3429a53700 1 -- 172.21.15.98:0/1191868907 wait complete. 2023-08-22T00:25:44.380 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-08-22T00:25:44.381 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-08-22T00:25:44.382 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:25:44.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-22T00:25:44.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.509+0000 7f2d3aa1c700 1 Processor -- start 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.509+0000 7f2d3aa1c700 1 -- start start 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d3aa1c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d340a6e50 0x7f2d34065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d3aa1c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2d34066400 0x7f2d340643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d3aa1c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d34158bf0 con 0x7f2d34151d60 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d3aa1c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34157d90 con 0x7f2d340a6e50 2023-08-22T00:25:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d3aa1c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34066830 con 0x7f2d34066400 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d340a6e50 0x7f2d34065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d33fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2d34151d60 0x7f2d34155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36844/0 (socket says 172.21.15.98:36844) 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d33fff700 1 -- 172.21.15.98:0/999256567 learned_addr learned my addr 172.21.15.98:0/999256567 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d38fb9700 1 --2- 172.21.15.98:0/999256567 >> v2:172.21.15.118:3300/0 conn(0x7f2d34066400 0x7f2d340643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 -- 172.21.15.98:0/999256567 >> v2:172.21.15.118:3300/0 conn(0x7f2d34066400 msgr2=0x7f2d340643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 --2- 172.21.15.98:0/999256567 >> v2:172.21.15.118:3300/0 conn(0x7f2d34066400 0x7f2d340643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 -- 172.21.15.98:0/999256567 >> v1:172.21.15.98:6789/0 conn(0x7f2d34151d60 legacy=0x7f2d34155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d32ffd700 1 -- 172.21.15.98:0/999256567 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218354240 0 0) 0x7f2d34158bf0 con 0x7f2d34151d60 2023-08-22T00:25:44.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 -- 172.21.15.98:0/999256567 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34157fe0 con 0x7f2d340a6e50 2023-08-22T00:25:44.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d337fe700 1 --2- 172.21.15.98:0/999256567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d340a6e50 0x7f2d34065f10 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f2d340c87e0 tx=0x7f2d28009060).ready entity=mon.0 client_cookie=48d47c6ec919d4be server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:44.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d32ffd700 1 -- 172.21.15.98:0/999256567 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800b580 con 0x7f2d340a6e50 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d32ffd700 1 -- 172.21.15.98:0/999256567 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2800b6e0 con 0x7f2d340a6e50 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.510+0000 7f2d32ffd700 1 -- 172.21.15.98:0/999256567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800ba60 con 0x7f2d340a6e50 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/999256567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d340a6e50 msgr2=0x7f2d34065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/999256567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d340a6e50 0x7f2d34065f10 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f2d340c87e0 tx=0x7f2d28009060).stop 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/999256567 shutdown_connections 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/999256567 >> v2:172.21.15.118:3300/0 conn(0x7f2d34066400 0x7f2d340643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/999256567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d340a6e50 0x7f2d34065f10 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/999256567 >> 172.21.15.98:0/999256567 conn(0x7f2d3406a980 msgr2=0x7f2d340c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:44.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/999256567 shutdown_connections 2023-08-22T00:25:44.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.511+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/999256567 wait complete. 2023-08-22T00:25:44.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.512+0000 7f2d3aa1c700 1 Processor -- start 2023-08-22T00:25:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.513+0000 7f2d3aa1c700 1 -- start start 2023-08-22T00:25:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 0x7f2d340a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d34151d60 0x7f2d34153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340a5910 con 0x7f2d34066400 2023-08-22T00:25:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340a5bf0 con 0x7f2d340a6e50 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340a5ed0 con 0x7f2d34151d60 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34666/0 (socket says 172.21.15.98:34666) 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 -- 172.21.15.98:0/3537496838 learned_addr learned my addr 172.21.15.98:0/3537496838 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d38fb9700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d34151d60 0x7f2d34153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d337fe700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 0x7f2d340a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 -- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d34151d60 msgr2=0x7f2d34153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d34151d60 0x7f2d34153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 -- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 msgr2=0x7f2d340a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:44.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 0x7f2d340a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:44.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 -- 172.21.15.98:0/3537496838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280092a0 con 0x7f2d34066400 2023-08-22T00:25:44.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d337fe700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 0x7f2d340a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:44.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d33fff700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f2d24001eb0 tx=0x7f2d24007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:44.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240072e0 con 0x7f2d34066400 2023-08-22T00:25:44.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24007440 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340a61b0 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240057a0 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.514+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d340a5570 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.515+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2d24005bd0 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.516+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34047480 con 0x7f2d34066400 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.516+0000 7f2d1bfff700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 0x7f2d200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:44.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.516+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f2d24079600 con 0x7f2d34066400 2023-08-22T00:25:44.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.516+0000 7f2d337fe700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 0x7f2d200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:44.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.516+0000 7f2d337fe700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 0x7f2d200612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2d2800b340 tx=0x7f2d28017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:44.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.520+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d2404aa30 con 0x7f2d34066400 2023-08-22T00:25:44.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:44.744+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f2d341582c0 con 0x7f2d34066400 2023-08-22T00:25:45.366 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.365+0000 7f2d1bfff700 1 -- 172.21.15.98:0/3537496838 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v743) v1 ==== 168+0+0 (secure 0 0 0) 0x7f2d2404e050 con 0x7f2d34066400 2023-08-22T00:25:45.369 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 msgr2=0x7f2d200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 0x7f2d200612d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2d2800b340 tx=0x7f2d28017000).stop 2023-08-22T00:25:45.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 msgr2=0x7f2d34150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f2d24001eb0 tx=0x7f2d24007e90).stop 2023-08-22T00:25:45.370 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 shutdown_connections 2023-08-22T00:25:45.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2d2005ee10 0x7f2d200612d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d34151d60 0x7f2d34153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.371 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d34066400 0x7f2d34150f10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 --2- 172.21.15.98:0/3537496838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d340a6e50 0x7f2d340a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 >> 172.21.15.98:0/3537496838 conn(0x7f2d3406a980 msgr2=0x7f2d3414c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:45.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 shutdown_connections 2023-08-22T00:25:45.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.367+0000 7f2d3aa1c700 1 -- 172.21.15.98:0/3537496838 wait complete. 2023-08-22T00:25:45.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:25:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.501+0000 7fcd15284700 1 Processor -- start 2023-08-22T00:25:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.501+0000 7fcd15284700 1 -- start start 2023-08-22T00:25:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd15284700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd10064110 0x7fcd10064590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd15284700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd10066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd15284700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd10158970 con 0x7fcd10153dd0 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd15284700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100c28b0 con 0x7fcd10064110 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd15284700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10064a80 con 0x7fcd10066000 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd0e7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd10064110 0x7fcd10064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd0f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd10066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd0e7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd10064110 0x7fcd10064590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40788/0 (socket says 172.21.15.98:40788) 2023-08-22T00:25:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.502+0000 7fcd0e7fc700 1 -- 172.21.15.98:0/3753503144 learned_addr learned my addr 172.21.15.98:0/3753503144 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0e7fc700 1 -- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 msgr2=0x7fcd10066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0e7fc700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd10066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0e7fc700 1 -- 172.21.15.98:0/3753503144 >> v1:172.21.15.118:6789/0 conn(0x7fcd10153dd0 legacy=0x7fcd100c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0e7fc700 1 -- 172.21.15.98:0/3753503144 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10066980 con 0x7fcd10064110 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0f7fe700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd10066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0e7fc700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd10064590 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fcd00006fd0 tx=0x7fcd000090f0).ready entity=mon.1 client_cookie=f4911f2374e5f7c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0dffb700 1 -- 172.21.15.98:0/3753503144 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000b580 con 0x7fcd10064110 2023-08-22T00:25:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0dffb700 1 -- 172.21.15.98:0/3753503144 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000b6e0 con 0x7fcd10064110 2023-08-22T00:25:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.503+0000 7fcd0dffb700 1 -- 172.21.15.98:0/3753503144 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000ba60 con 0x7fcd10064110 2023-08-22T00:25:45.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 -- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 msgr2=0x7fcd10064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd10064590 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fcd00006fd0 tx=0x7fcd000090f0).stop 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 -- 172.21.15.98:0/3753503144 shutdown_connections 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd10066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 --2- 172.21.15.98:0/3753503144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd10064590 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 -- 172.21.15.98:0/3753503144 >> 172.21.15.98:0/3753503144 conn(0x7fcd100c7820 msgr2=0x7fcd100c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 -- 172.21.15.98:0/3753503144 shutdown_connections 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.504+0000 7fcd15284700 1 -- 172.21.15.98:0/3753503144 wait complete. 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.505+0000 7fcd15284700 1 Processor -- start 2023-08-22T00:25:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.505+0000 7fcd15284700 1 -- start start 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd100aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd100ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd101647b0 con 0x7fcd10153dd0 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1014dc70 con 0x7fcd10064110 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.506+0000 7fcd15284700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100ac700 con 0x7fcd10066000 2023-08-22T00:25:45.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34682/0 (socket says 172.21.15.98:34682) 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/1970103512 learned_addr learned my addr 172.21.15.98:0/1970103512 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0effd700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd100aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0e7fc700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd100ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 msgr2=0x7fcd100ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd100ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 msgr2=0x7fcd100aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd100aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/1970103512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009a20 con 0x7fcd10153dd0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd0f7fe700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fcd0800c0f0 tx=0x7fcd0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800cd90 con 0x7fcd10153dd0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0800f040 con 0x7fcd10153dd0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00009370 con 0x7fcd10153dd0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08013610 con 0x7fcd10153dd0 2023-08-22T00:25:45.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.507+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd100ac140 con 0x7fcd10153dd0 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.508+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd100be8c0 con 0x7fcd10153dd0 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.508+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcd08013a00 con 0x7fcd10153dd0 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.509+0000 7fccf6ffd700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 0x7fccfc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.509+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fcd0807a890 con 0x7fcd10153dd0 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.509+0000 7fcd0effd700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 0x7fccfc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.509+0000 7fcd0effd700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 0x7fccfc0612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fcd04000c00 tx=0x7fcd04009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.513+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd100be8c0 con 0x7fcd10153dd0 2023-08-22T00:25:45.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.675+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd100be8c0 con 0x7fcd10153dd0 2023-08-22T00:25:45.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.678+0000 7fccf6ffd700 1 -- 172.21.15.98:0/1970103512 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd100be8c0 con 0x7fcd10153dd0 2023-08-22T00:25:45.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 msgr2=0x7fccfc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 0x7fccfc0612d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fcd04000c00 tx=0x7fcd04009040).stop 2023-08-22T00:25:45.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 msgr2=0x7fcd100a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fcd0800c0f0 tx=0x7fcd0800b040).stop 2023-08-22T00:25:45.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 shutdown_connections 2023-08-22T00:25:45.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd10153dd0 0x7fcd100a5230 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd10064110 0x7fcd100aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fccfc05ee10 0x7fccfc0612d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 --2- 172.21.15.98:0/1970103512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd10066000 0x7fcd100ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 >> 172.21.15.98:0/1970103512 conn(0x7fcd100c7820 msgr2=0x7fcd100c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 shutdown_connections 2023-08-22T00:25:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.680+0000 7fcd15284700 1 -- 172.21.15.98:0/1970103512 wait complete. 2023-08-22T00:25:45.693 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:25:45.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:45.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:25:45.783 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:25:45.783 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:25:45.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.898+0000 7fb3d201b700 1 Processor -- start 2023-08-22T00:25:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.898+0000 7fb3d201b700 1 -- start start 2023-08-22T00:25:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3d201b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb3cc153f10 0x7fb3cc150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3d201b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3d201b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0c2220 con 0x7fb3cc150040 2023-08-22T00:25:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3d201b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c5bd0 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3d201b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c1ef0 con 0x7fb3cc153f10 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.899+0000 7fb3cbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34698/0 (socket says 172.21.15.98:34698) 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 -- 172.21.15.98:0/491187328 learned_addr learned my addr 172.21.15.98:0/491187328 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3caffd700 1 --2- 172.21.15.98:0/491187328 >> v2:172.21.15.118:3300/0 conn(0x7fb3cc153f10 0x7fb3cc150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 -- 172.21.15.98:0/491187328 >> v2:172.21.15.118:3300/0 conn(0x7fb3cc153f10 msgr2=0x7fb3cc150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 --2- 172.21.15.98:0/491187328 >> v2:172.21.15.118:3300/0 conn(0x7fb3cc153f10 0x7fb3cc150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 -- 172.21.15.98:0/491187328 >> v1:172.21.15.118:6789/0 conn(0x7fb3cc150040 legacy=0x7fb3cc0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 -- 172.21.15.98:0/491187328 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0c5e30 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3cbfff700 1 --2- 172.21.15.98:0/491187328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb3cc0a86c0 tx=0x7fb3c4009840).ready entity=mon.0 client_cookie=1cb42567fb376728 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3ca7fc700 1 -- 172.21.15.98:0/491187328 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400e070 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3ca7fc700 1 -- 172.21.15.98:0/491187328 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400ba10 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3ca7fc700 1 -- 172.21.15.98:0/491187328 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400bd90 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.900+0000 7fb3d201b700 1 -- 172.21.15.98:0/491187328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc0c26b0 msgr2=0x7fb3cc0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 --2- 172.21.15.98:0/491187328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb3cc0a86c0 tx=0x7fb3c4009840).stop 2023-08-22T00:25:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 -- 172.21.15.98:0/491187328 shutdown_connections 2023-08-22T00:25:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 --2- 172.21.15.98:0/491187328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc0c26b0 0x7fb3cc0c2b00 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 --2- 172.21.15.98:0/491187328 >> v2:172.21.15.118:3300/0 conn(0x7fb3cc153f10 0x7fb3cc150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 -- 172.21.15.98:0/491187328 >> 172.21.15.98:0/491187328 conn(0x7fb3cc0c7140 msgr2=0x7fb3cc0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 -- 172.21.15.98:0/491187328 shutdown_connections 2023-08-22T00:25:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.901+0000 7fb3d201b700 1 -- 172.21.15.98:0/491187328 wait complete. 2023-08-22T00:25:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.902+0000 7fb3d201b700 1 Processor -- start 2023-08-22T00:25:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.902+0000 7fb3d201b700 1 -- start start 2023-08-22T00:25:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 0x7fb3cc0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 0x7fb3cc09f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1665b0 con 0x7fb3cc153f10 2023-08-22T00:25:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc152110 con 0x7fb3cc150040 2023-08-22T00:25:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1523f0 con 0x7fb3cc0c26b0 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34712/0 (socket says 172.21.15.98:34712) 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 -- 172.21.15.98:0/4219250256 learned_addr learned my addr 172.21.15.98:0/4219250256 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3caffd700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 0x7fb3cc09f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cb7fe700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 0x7fb3cc0a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 -- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 msgr2=0x7fb3cc0a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 0x7fb3cc0a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 -- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 msgr2=0x7fb3cc09f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:45.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 0x7fb3cc09f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 -- 172.21.15.98:0/4219250256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4009ae0 con 0x7fb3cc153f10 2023-08-22T00:25:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3caffd700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 0x7fb3cc09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cb7fe700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 0x7fb3cc0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3cbfff700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fb3cc0c4140 tx=0x7fb3c4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c401d410 con 0x7fb3cc153f10 2023-08-22T00:25:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c401d570 con 0x7fb3cc153f10 2023-08-22T00:25:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc1526d0 con 0x7fb3cc153f10 2023-08-22T00:25:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c401d910 con 0x7fb3cc153f10 2023-08-22T00:25:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.903+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc152c90 con 0x7fb3cc153f10 2023-08-22T00:25:45.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.904+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc047480 con 0x7fb3cc153f10 2023-08-22T00:25:45.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.905+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb3c401dd40 con 0x7fb3cc153f10 2023-08-22T00:25:45.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.905+0000 7fb3b37fe700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 0x7fb3b80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:45.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.905+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fb3c407bc60 con 0x7fb3cc153f10 2023-08-22T00:25:45.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.905+0000 7fb3cb7fe700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 0x7fb3b80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:45.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.906+0000 7fb3cb7fe700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 0x7fb3b80612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb3c00026f0 tx=0x7fb3c0009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:45.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:45.909+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3c404d090 con 0x7fb3cc153f10 2023-08-22T00:25:46.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.111+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3cc047480 con 0x7fb3cc153f10 2023-08-22T00:25:46.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.111+0000 7fb3b37fe700 1 -- 172.21.15.98:0/4219250256 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fb3c40506b0 con 0x7fb3cc153f10 2023-08-22T00:25:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:46.114 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/62227227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":62227227},{"type":"v1","addr":"172.21.15.98:6836","nonce":62227227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/719255829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":719255829},{"type":"v1","addr":"172.21.15.118:6834","nonce":719255829}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1993643706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1993643706},{"type":"v1","addr":"172.21.15.118:6835","nonce":1993643706}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3900717847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3900717847},{"type":"v1","addr":"172.21.15.98:6837","nonce":3900717847}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-08-22T00:25:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 msgr2=0x7fb3b80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 0x7fb3b80612d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb3c00026f0 tx=0x7fb3c0009040).stop 2023-08-22T00:25:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 msgr2=0x7fb3cc165790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fb3cc0c4140 tx=0x7fb3c4009840).stop 2023-08-22T00:25:46.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 shutdown_connections 2023-08-22T00:25:46.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb3b805ee10 0x7fb3b80612d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3cc0c26b0 0x7fb3cc0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3cc153f10 0x7fb3cc165790 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 --2- 172.21.15.98:0/4219250256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3cc150040 0x7fb3cc09f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 >> 172.21.15.98:0/4219250256 conn(0x7fb3cc0c7140 msgr2=0x7fb3cc0ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 shutdown_connections 2023-08-22T00:25:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.113+0000 7fb3d201b700 1 -- 172.21.15.98:0/4219250256 wait complete. 2023-08-22T00:25:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 57 2023-08-22T00:25:46.127 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:25:46.128 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:25:46.128 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:25:46.129 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:46.129 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:25:46.129 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:25:46.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:25:46.130 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:46.130 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:25:46.131 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:25:46.132 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:25:46.132 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:46.133 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:25:46.133 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:25:46.133 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:25:46.134 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:25:46.138 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:25:46.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:25:46.140 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:25:46.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:25:46.143 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:25:46.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:25:46.146 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:25:46.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:25:46.181 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:25:46.181 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:46.182 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:25:46.183 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:46.189 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:25:46.190 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:46.191 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:25:46.192 DEBUG:teuthology.parallel:result is None 2023-08-22T00:25:46.192 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:25:46.256 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:25:46.256 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:25:46.272 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:25:46.272 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:25:46.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.320+0000 7f2ca829d700 1 Processor -- start 2023-08-22T00:25:46.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.320+0000 7f2ca829d700 1 -- start start 2023-08-22T00:25:46.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca829d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ca0150030 0x7f2ca00bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca829d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2ca0150410 0x7f2ca0154620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca829d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00c2570 con 0x7f2ca00c2020 2023-08-22T00:25:46.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca829d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca00c2850 con 0x7f2ca0150410 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca829d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca0153e20 con 0x7f2ca0150030 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2ca0150410 0x7f2ca0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2ca0150410 0x7f2ca0154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34776/0 (socket says 172.21.15.98:34776) 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 -- 172.21.15.98:0/152932695 learned_addr learned my addr 172.21.15.98:0/152932695 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca6039700 1 --2- 172.21.15.98:0/152932695 >> v2:172.21.15.118:3300/0 conn(0x7f2ca0150030 0x7f2ca00bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 -- 172.21.15.98:0/152932695 >> v2:172.21.15.118:3300/0 conn(0x7f2ca0150030 msgr2=0x7f2ca00bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:46.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 --2- 172.21.15.98:0/152932695 >> v2:172.21.15.118:3300/0 conn(0x7f2ca0150030 0x7f2ca00bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 -- 172.21.15.98:0/152932695 >> v1:172.21.15.118:6789/0 conn(0x7f2ca00c2020 legacy=0x7f2ca0062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.321+0000 7f2ca5838700 1 -- 172.21.15.98:0/152932695 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0154100 con 0x7f2ca0150410 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca5838700 1 --2- 172.21.15.98:0/152932695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca0150410 0x7f2ca0154620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f2ca0068210 tx=0x7f2c940090f0).ready entity=mon.0 client_cookie=11184f6ee1ad1646 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca5037700 1 -- 172.21.15.98:0/152932695 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400b600 con 0x7f2ca0150410 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca5037700 1 -- 172.21.15.98:0/152932695 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9400b760 con 0x7f2ca0150410 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca5037700 1 -- 172.21.15.98:0/152932695 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400bae0 con 0x7f2ca0150410 2023-08-22T00:25:46.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 -- 172.21.15.98:0/152932695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca0150410 msgr2=0x7f2ca0154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 --2- 172.21.15.98:0/152932695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca0150410 0x7f2ca0154620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f2ca0068210 tx=0x7f2c940090f0).stop 2023-08-22T00:25:46.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 -- 172.21.15.98:0/152932695 shutdown_connections 2023-08-22T00:25:46.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 --2- 172.21.15.98:0/152932695 >> v2:172.21.15.118:3300/0 conn(0x7f2ca0150030 0x7f2ca00bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 --2- 172.21.15.98:0/152932695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca0150410 0x7f2ca0154620 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 -- 172.21.15.98:0/152932695 >> 172.21.15.98:0/152932695 conn(0x7f2ca00c3170 msgr2=0x7f2ca00c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:46.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 -- 172.21.15.98:0/152932695 shutdown_connections 2023-08-22T00:25:46.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.322+0000 7f2ca829d700 1 -- 172.21.15.98:0/152932695 wait complete. 2023-08-22T00:25:46.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.324+0000 7f2ca829d700 1 Processor -- start 2023-08-22T00:25:46.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.324+0000 7f2ca829d700 1 -- start start 2023-08-22T00:25:46.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ca0150030 0x7f2ca0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ca0150410 0x7f2ca00a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00aa7c0 con 0x7f2ca00c2020 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00a9ed0 con 0x7f2ca0150030 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0153990 con 0x7f2ca0150410 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34778/0 (socket says 172.21.15.98:34778) 2023-08-22T00:25:46.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 -- 172.21.15.98:0/3749501757 learned_addr learned my addr 172.21.15.98:0/3749501757 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:46.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca5838700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ca0150030 0x7f2ca0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca683a700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ca0150410 0x7f2ca00a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 -- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ca0150410 msgr2=0x7f2ca00a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ca0150410 0x7f2ca00a7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 -- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ca0150030 msgr2=0x7f2ca0149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ca0150030 0x7f2ca0149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 -- 172.21.15.98:0/3749501757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94009370 con 0x7f2ca00c2020 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca6039700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f2c9800d890 tx=0x7f2c98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980125f0 con 0x7f2ca00c2020 2023-08-22T00:25:46.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98012750 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca00aa170 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98012ad0 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.325+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00aa500 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.326+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0067d20 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.327+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2c98013480 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.327+0000 7f2c9e7fc700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 0x7f2c8c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.328+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f2c9807a5a0 con 0x7f2ca00c2020 2023-08-22T00:25:46.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.328+0000 7f2ca5838700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 0x7f2c8c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:46.335 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.328+0000 7f2ca5838700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 0x7f2c8c061300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2ca0068210 tx=0x7f2c94017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:46.337 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.331+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c9804b930 con 0x7f2ca00c2020 2023-08-22T00:25:46.510 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:46.508+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2ca00bc890 con 0x7f2ca00c2020 2023-08-22T00:25:47.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.372+0000 7f2c9e7fc700 1 -- 172.21.15.98:0/3749501757 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v162) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2c9804ef50 con 0x7f2ca00c2020 2023-08-22T00:25:47.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 msgr2=0x7f2c8c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 0x7f2c8c061300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2ca0068210 tx=0x7f2c94017000).stop 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 msgr2=0x7f2ca0150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f2c9800d890 tx=0x7f2c98008040).stop 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 shutdown_connections 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2c8c05ee40 0x7f2c8c061300 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ca0150410 0x7f2ca00a7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca00c2020 0x7f2ca0150c30 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 --2- 172.21.15.98:0/3749501757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ca0150030 0x7f2ca0149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 >> 172.21.15.98:0/3749501757 conn(0x7f2ca00c3170 msgr2=0x7f2ca00c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:47.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 shutdown_connections 2023-08-22T00:25:47.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.374+0000 7f2ca829d700 1 -- 172.21.15.98:0/3749501757 wait complete. 2023-08-22T00:25:47.378 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:25:47.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:25:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.508+0000 7f92923d9700 1 Processor -- start 2023-08-22T00:25:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.508+0000 7f92923d9700 1 -- start start 2023-08-22T00:25:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f92923d9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f928c14e660 0x7f928c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f92923d9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f928c066620 0x7f928c064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f92923d9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c063fd0 con 0x7f928c0c52d0 2023-08-22T00:25:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f92923d9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0c62e0 con 0x7f928c066620 2023-08-22T00:25:47.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f92923d9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c064290 con 0x7f928c14e660 2023-08-22T00:25:47.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f928c066620 0x7f928c064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f928c066620 0x7f928c064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34794/0 (socket says 172.21.15.98:34794) 2023-08-22T00:25:47.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f928c0c52d0 0x7f928c065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36884/0 (socket says 172.21.15.98:36884) 2023-08-22T00:25:47.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 -- 172.21.15.98:0/3789949568 learned_addr learned my addr 172.21.15.98:0/3789949568 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 -- 172.21.15.98:0/3789949568 >> v2:172.21.15.118:3300/0 conn(0x7f928c14e660 msgr2=0x7f928c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928bfff700 1 --2- 172.21.15.98:0/3789949568 >> v2:172.21.15.118:3300/0 conn(0x7f928c14e660 0x7f928c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 --2- 172.21.15.98:0/3789949568 >> v2:172.21.15.118:3300/0 conn(0x7f928c14e660 0x7f928c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 -- 172.21.15.98:0/3789949568 >> v1:172.21.15.98:6789/0 conn(0x7f928c0c52d0 legacy=0x7f928c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928affd700 1 -- 172.21.15.98:0/3789949568 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424708163 0 0) 0x7f928c063fd0 con 0x7f928c0c52d0 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 -- 172.21.15.98:0/3789949568 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c0c5780 con 0x7f928c066620 2023-08-22T00:25:47.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f9290976700 1 --2- 172.21.15.98:0/3789949568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c066620 0x7f928c064720 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f928c0692b0 tx=0x7f9284009840).ready entity=mon.0 client_cookie=4b8f51e3ae566a5d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928affd700 1 -- 172.21.15.98:0/3789949568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400e070 con 0x7f928c066620 2023-08-22T00:25:47.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928affd700 1 -- 172.21.15.98:0/3789949568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400ba50 con 0x7f928c066620 2023-08-22T00:25:47.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.509+0000 7f928affd700 1 -- 172.21.15.98:0/3789949568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400bdd0 con 0x7f928c066620 2023-08-22T00:25:47.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 -- 172.21.15.98:0/3789949568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c066620 msgr2=0x7f928c064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 --2- 172.21.15.98:0/3789949568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c066620 0x7f928c064720 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f928c0692b0 tx=0x7f9284009840).stop 2023-08-22T00:25:47.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 -- 172.21.15.98:0/3789949568 shutdown_connections 2023-08-22T00:25:47.519 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 --2- 172.21.15.98:0/3789949568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c066620 0x7f928c064720 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 --2- 172.21.15.98:0/3789949568 >> v2:172.21.15.118:3300/0 conn(0x7f928c14e660 0x7f928c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 -- 172.21.15.98:0/3789949568 >> 172.21.15.98:0/3789949568 conn(0x7f928c06a960 msgr2=0x7f928c0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:47.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 -- 172.21.15.98:0/3789949568 shutdown_connections 2023-08-22T00:25:47.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.510+0000 7f92923d9700 1 -- 172.21.15.98:0/3789949568 wait complete. 2023-08-22T00:25:47.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.511+0000 7f92923d9700 1 Processor -- start 2023-08-22T00:25:47.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 -- start start 2023-08-22T00:25:47.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 0x7f928c0a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f928c14e660 0x7f928c0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0aba80 con 0x7f928c0c52d0 2023-08-22T00:25:47.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0aac10 con 0x7f928c066620 2023-08-22T00:25:47.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.512+0000 7f92923d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0aae70 con 0x7f928c14e660 2023-08-22T00:25:47.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34804/0 (socket says 172.21.15.98:34804) 2023-08-22T00:25:47.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 -- 172.21.15.98:0/2501283780 learned_addr learned my addr 172.21.15.98:0/2501283780 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:47.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f9290976700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f928c14e660 0x7f928c0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928bfff700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 0x7f928c0a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 -- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f928c14e660 msgr2=0x7f928c0abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f928c14e660 0x7f928c0abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 -- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 msgr2=0x7f928c0a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 0x7f928c0a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 -- 172.21.15.98:0/2501283780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009ae0 con 0x7f928c0c52d0 2023-08-22T00:25:47.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928bfff700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 0x7f928c0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:47.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f928b7fe700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f927c00c490 tx=0x7f927c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c0072e0 con 0x7f928c0c52d0 2023-08-22T00:25:47.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c007440 con 0x7f928c0c52d0 2023-08-22T00:25:47.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c0058a0 con 0x7f928c0c52d0 2023-08-22T00:25:47.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c0ab150 con 0x7f928c0c52d0 2023-08-22T00:25:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.513+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0ab710 con 0x7f928c0c52d0 2023-08-22T00:25:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.514+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c0abc30 con 0x7f928c0c52d0 2023-08-22T00:25:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.515+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f927c005c90 con 0x7f928c0c52d0 2023-08-22T00:25:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.515+0000 7f9273fff700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 0x7f92780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.515+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f927c0792a0 con 0x7f928c0c52d0 2023-08-22T00:25:47.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.515+0000 7f928bfff700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 0x7f92780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.515+0000 7f928bfff700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 0x7f92780612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f928000aa10 tx=0x7f9280008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.519+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f928c0abc30 con 0x7f928c0c52d0 2023-08-22T00:25:47.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.744+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f928c047480 con 0x7f928c0c52d0 2023-08-22T00:25:47.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.745+0000 7f9273fff700 1 -- 172.21.15.98:0/2501283780 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f927c04a900 con 0x7f928c0c52d0 2023-08-22T00:25:47.747 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:47.747 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:25:47.747 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:25:47.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.747 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:47.749 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.750 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.751 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.754 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.756 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:25:47.757 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:25:47.758 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.761 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.764 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:25:47.765 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:47.767 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.769 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:25:47.770 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:25:47.770 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.770 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:47.771 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:25:47.771 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:25:47.771 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:25:47.772 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:47.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:47.775 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:25:47.775 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:25:47.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 msgr2=0x7f92780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 0x7f92780612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f928000aa10 tx=0x7f9280008040).stop 2023-08-22T00:25:47.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 msgr2=0x7f928c0aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f927c00c490 tx=0x7f927c007dc0).stop 2023-08-22T00:25:47.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 shutdown_connections 2023-08-22T00:25:47.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f927805ee10 0x7f92780612d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f928c14e660 0x7f928c0abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c066620 0x7f928c0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 --2- 172.21.15.98:0/2501283780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0c52d0 0x7f928c0aa720 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 >> 172.21.15.98:0/2501283780 conn(0x7f928c06a960 msgr2=0x7f928c154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:47.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 shutdown_connections 2023-08-22T00:25:47.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.747+0000 7f92923d9700 1 -- 172.21.15.98:0/2501283780 wait complete. 2023-08-22T00:25:47.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:47.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.895+0000 7f48e28cb700 1 Processor -- start 2023-08-22T00:25:47.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.895+0000 7f48e28cb700 1 -- start start 2023-08-22T00:25:47.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e28cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc154200 0x7f48dc0bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e28cb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48dc0bd8c0 0x7f48dc062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e28cb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0c4cf0 con 0x7f48dc153e20 2023-08-22T00:25:47.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e28cb700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0c5870 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e28cb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc154a30 con 0x7f48dc154200 2023-08-22T00:25:47.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e0e68700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48dc0bd8c0 0x7f48dc062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e0e68700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48dc0bd8c0 0x7f48dc062e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34818/0 (socket says 172.21.15.98:34818) 2023-08-22T00:25:47.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.896+0000 7f48e0e68700 1 -- 172.21.15.98:0/1558371600 learned_addr learned my addr 172.21.15.98:0/1558371600 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:47.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48db7fe700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc154200 0x7f48dc0bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e0e68700 1 -- 172.21.15.98:0/1558371600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc154200 msgr2=0x7f48dc0bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:47.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e0e68700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc154200 0x7f48dc0bd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e0e68700 1 -- 172.21.15.98:0/1558371600 >> v1:172.21.15.118:6789/0 conn(0x7f48dc153e20 legacy=0x7f48dc0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e0e68700 1 -- 172.21.15.98:0/1558371600 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0c6410 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e0e68700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc062e90 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f48d400d1d0 tx=0x7f48d400ba50).ready entity=mon.0 client_cookie=2839aef12535a51 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48daffd700 1 -- 172.21.15.98:0/1558371600 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4010070 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48daffd700 1 -- 172.21.15.98:0/1558371600 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4015470 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48daffd700 1 -- 172.21.15.98:0/1558371600 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40157f0 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e28cb700 1 -- 172.21.15.98:0/1558371600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc0bd8c0 msgr2=0x7f48dc062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e28cb700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc062e90 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f48d400d1d0 tx=0x7f48d400ba50).stop 2023-08-22T00:25:47.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e28cb700 1 -- 172.21.15.98:0/1558371600 shutdown_connections 2023-08-22T00:25:47.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e28cb700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc062e90 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.897+0000 7f48e28cb700 1 --2- 172.21.15.98:0/1558371600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc154200 0x7f48dc0bd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.898+0000 7f48e28cb700 1 -- 172.21.15.98:0/1558371600 >> 172.21.15.98:0/1558371600 conn(0x7f48dc0c3980 msgr2=0x7f48dc0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:47.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.898+0000 7f48e28cb700 1 -- 172.21.15.98:0/1558371600 shutdown_connections 2023-08-22T00:25:47.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.898+0000 7f48e28cb700 1 -- 172.21.15.98:0/1558371600 wait complete. 2023-08-22T00:25:47.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.899+0000 7f48e28cb700 1 Processor -- start 2023-08-22T00:25:47.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.899+0000 7f48e28cb700 1 -- start start 2023-08-22T00:25:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc0a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc153e20 0x7f48dc147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0a7de0 con 0x7f48dc154200 2023-08-22T00:25:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0a8f10 con 0x7f48dc0bd8c0 2023-08-22T00:25:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0be3a0 con 0x7f48dc153e20 2023-08-22T00:25:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34820/0 (socket says 172.21.15.98:34820) 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 -- 172.21.15.98:0/392839328 learned_addr learned my addr 172.21.15.98:0/392839328 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48db7fe700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc153e20 0x7f48dc147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48dbfff700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc0a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 -- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc153e20 msgr2=0x7f48dc147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc153e20 0x7f48dc147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 -- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48dc0bd8c0 msgr2=0x7f48dc0a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc0a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 -- 172.21.15.98:0/392839328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d400bcf0 con 0x7f48dc154200 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e0e68700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f48d400ba90 tx=0x7f48dc0c6690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400deb0 con 0x7f48dc154200 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4014bf0 con 0x7f48dc154200 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400b020 con 0x7f48dc154200 2023-08-22T00:25:47.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc0be680 con 0x7f48dc154200 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.900+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc0bec40 con 0x7f48dc154200 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.901+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc047480 con 0x7f48dc154200 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.902+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f48d401c040 con 0x7f48dc154200 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.902+0000 7f48d3fff700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 0x7f48bc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.902+0000 7f48dbfff700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 0x7f48bc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:47.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.902+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f48d407d9f0 con 0x7f48dc154200 2023-08-22T00:25:47.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.902+0000 7f48dbfff700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 0x7f48bc0612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f48c40036d0 tx=0x7f48c4009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:47.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:47.906+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48d407fe60 con 0x7f48dc154200 2023-08-22T00:25:48.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.068+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48dc0c6cc0 con 0x7f48dc154200 2023-08-22T00:25:48.071 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.069+0000 7f48d3fff700 1 -- 172.21.15.98:0/392839328 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+14055 (secure 0 0 0) 0x7f48d4022070 con 0x7f48dc154200 2023-08-22T00:25:48.071 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:48.072 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":162,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:47.366931+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 msgr2=0x7f48bc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 0x7f48bc0612d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f48c40036d0 tx=0x7f48c4009040).stop 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 msgr2=0x7f48dc063aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f48d400ba90 tx=0x7f48dc0c6690).stop 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 shutdown_connections 2023-08-22T00:25:48.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48dc154200 0x7f48dc063aa0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48dc0bd8c0 0x7f48dc0a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f48bc05ee10 0x7f48bc0612d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 --2- 172.21.15.98:0/392839328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48dc153e20 0x7f48dc147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 >> 172.21.15.98:0/392839328 conn(0x7f48dc0c3980 msgr2=0x7f48dc069650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 shutdown_connections 2023-08-22T00:25:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.071+0000 7f48e28cb700 1 -- 172.21.15.98:0/392839328 wait complete. 2023-08-22T00:25:48.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:25:48.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:25:48.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.205+0000 7f9c0fe24700 1 Processor -- start 2023-08-22T00:25:48.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 -- start start 2023-08-22T00:25:48.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c081525d0 con 0x7f9c0814fd90 2023-08-22T00:25:48.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c08152b80 con 0x7f9c080675f0 2023-08-22T00:25:48.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.206+0000 7f9c0fe24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c4330 con 0x7f9c080c39d0 2023-08-22T00:25:48.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0d3bf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:55416/0 (socket says 172.21.15.98:55416) 2023-08-22T00:25:48.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0d3bf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40892/0 (socket says 172.21.15.98:40892) 2023-08-22T00:25:48.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/3097777809 learned_addr learned my addr 172.21.15.98:0/3097777809 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:48.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/3097777809 >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 msgr2=0x7f9c080a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 --2- 172.21.15.98:0/3097777809 >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/3097777809 >> v1:172.21.15.118:6789/0 conn(0x7f9c0814fd90 legacy=0x7f9c08153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/3097777809 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08067bd0 con 0x7f9c080c39d0 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0d3bf700 1 --2- 172.21.15.98:0/3097777809 >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0e3c1700 1 --2- 172.21.15.98:0/3097777809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9c00009f20 tx=0x7f9c00009840).ready entity=mon.2 client_cookie=ced1d30327a4ec80 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0cbbe700 1 -- 172.21.15.98:0/3097777809 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000e070 con 0x7f9c080c39d0 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0cbbe700 1 -- 172.21.15.98:0/3097777809 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000b9d0 con 0x7f9c080c39d0 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.207+0000 7f9c0cbbe700 1 -- 172.21.15.98:0/3097777809 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000bd50 con 0x7f9c080c39d0 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 -- 172.21.15.98:0/3097777809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 msgr2=0x7f9c080c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/3097777809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9c00009f20 tx=0x7f9c00009840).stop 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 -- 172.21.15.98:0/3097777809 shutdown_connections 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/3097777809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080c39d0 0x7f9c080c3e40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/3097777809 >> v2:172.21.15.118:3300/0 conn(0x7f9c080675f0 0x7f9c080a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 -- 172.21.15.98:0/3097777809 >> 172.21.15.98:0/3097777809 conn(0x7f9c080c8950 msgr2=0x7f9c080c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 -- 172.21.15.98:0/3097777809 shutdown_connections 2023-08-22T00:25:48.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.208+0000 7f9c0fe24700 1 -- 172.21.15.98:0/3097777809 wait complete. 2023-08-22T00:25:48.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.209+0000 7f9c0fe24700 1 Processor -- start 2023-08-22T00:25:48.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.209+0000 7f9c0fe24700 1 -- start start 2023-08-22T00:25:48.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080675f0 0x7f9c080c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c080c39d0 0x7f9c08166620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0814f520 con 0x7f9c0814fd90 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0814ef10 con 0x7f9c080c39d0 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0fe24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0814cb60 con 0x7f9c080675f0 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34822/0 (socket says 172.21.15.98:34822) 2023-08-22T00:25:48.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/410712980 learned_addr learned my addr 172.21.15.98:0/410712980 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0d3bf700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c080c39d0 0x7f9c08166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0dbc0700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080675f0 0x7f9c080c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080675f0 msgr2=0x7f9c080c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080675f0 0x7f9c080c1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c080c39d0 msgr2=0x7f9c08166620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.210+0000 7f9c0e3c1700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c080c39d0 0x7f9c08166620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9c0e3c1700 1 -- 172.21.15.98:0/410712980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040092a0 con 0x7f9c0814fd90 2023-08-22T00:25:48.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9c0e3c1700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f9c0000b610 tx=0x7f9c00009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000bd50 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000b640 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001d6b0 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c00009ae0 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.211+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0814f1b0 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.212+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0814f690 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.212+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9c00003040 con 0x7f9c0814fd90 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.213+0000 7f9bfdffb700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 0x7f9bec061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.213+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9c0007aeb0 con 0x7f9c0814fd90 2023-08-22T00:25:48.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.213+0000 7f9c0dbc0700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 0x7f9bec061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.213+0000 7f9c0dbc0700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 0x7f9bec061300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9bf8003920 tx=0x7f9bf8000bc0).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.217+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c0004c5c0 con 0x7f9c0814fd90 2023-08-22T00:25:48.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.378+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9c08069d50 con 0x7f9c0814fd90 2023-08-22T00:25:48.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.379+0000 7f9bfdffb700 1 -- 172.21.15.98:0/410712980 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v162) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9c00022030 con 0x7f9c0814fd90 2023-08-22T00:25:48.381 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:25:48.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 msgr2=0x7f9bec061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 0x7f9bec061300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9bf8003920 tx=0x7f9bf8000bc0).stop 2023-08-22T00:25:48.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 msgr2=0x7f9c0814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f9c0000b610 tx=0x7f9c00009840).stop 2023-08-22T00:25:48.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 shutdown_connections 2023-08-22T00:25:48.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9bec05ee40 0x7f9bec061300 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c080675f0 0x7f9c080c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c0814fd90 0x7f9c0814a790 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 --2- 172.21.15.98:0/410712980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c080c39d0 0x7f9c08166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 >> 172.21.15.98:0/410712980 conn(0x7f9c080c8950 msgr2=0x7f9c080c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 shutdown_connections 2023-08-22T00:25:48.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.381+0000 7f9c0fe24700 1 -- 172.21.15.98:0/410712980 wait complete. 2023-08-22T00:25:48.394 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:25:48.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.513+0000 7f46b372b700 1 Processor -- start 2023-08-22T00:25:48.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.513+0000 7f46b372b700 1 -- start start 2023-08-22T00:25:48.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b372b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46ac0c5360 0x7f46ac066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b372b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f46ac157890 0x7f46ac0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b372b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0c69b0 con 0x7f46ac066150 2023-08-22T00:25:48.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b372b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac1542c0 con 0x7f46ac157890 2023-08-22T00:25:48.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b372b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0c57f0 con 0x7f46ac0c5360 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f46ac157890 0x7f46ac0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f46ac157890 0x7f46ac0c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34824/0 (socket says 172.21.15.98:34824) 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 -- 172.21.15.98:0/4243647918 learned_addr learned my addr 172.21.15.98:0/4243647918 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 -- 172.21.15.98:0/4243647918 >> v2:172.21.15.118:3300/0 conn(0x7f46ac0c5360 msgr2=0x7f46ac066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 --2- 172.21.15.98:0/4243647918 >> v2:172.21.15.118:3300/0 conn(0x7f46ac0c5360 0x7f46ac066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 -- 172.21.15.98:0/4243647918 >> v1:172.21.15.118:6789/0 conn(0x7f46ac066150 legacy=0x7f46ac0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.514+0000 7f46b1cc8700 1 -- 172.21.15.98:0/4243647918 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0c5ad0 con 0x7f46ac157890 2023-08-22T00:25:48.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b1cc8700 1 --2- 172.21.15.98:0/4243647918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac157890 0x7f46ac0c33f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f46ac0c4180 tx=0x7f46a4009840).ready entity=mon.0 client_cookie=50fd17e6ec657772 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46a3fff700 1 -- 172.21.15.98:0/4243647918 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400e070 con 0x7f46ac157890 2023-08-22T00:25:48.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46a3fff700 1 -- 172.21.15.98:0/4243647918 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400ba10 con 0x7f46ac157890 2023-08-22T00:25:48.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46a3fff700 1 -- 172.21.15.98:0/4243647918 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400bd90 con 0x7f46ac157890 2023-08-22T00:25:48.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 -- 172.21.15.98:0/4243647918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac157890 msgr2=0x7f46ac0c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 --2- 172.21.15.98:0/4243647918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac157890 0x7f46ac0c33f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f46ac0c4180 tx=0x7f46a4009840).stop 2023-08-22T00:25:48.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 -- 172.21.15.98:0/4243647918 shutdown_connections 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 --2- 172.21.15.98:0/4243647918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac157890 0x7f46ac0c33f0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 --2- 172.21.15.98:0/4243647918 >> v2:172.21.15.118:3300/0 conn(0x7f46ac0c5360 0x7f46ac066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 -- 172.21.15.98:0/4243647918 >> 172.21.15.98:0/4243647918 conn(0x7f46ac0c7800 msgr2=0x7f46ac0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 -- 172.21.15.98:0/4243647918 shutdown_connections 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.515+0000 7f46b372b700 1 -- 172.21.15.98:0/4243647918 wait complete. 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.517+0000 7f46b372b700 1 Processor -- start 2023-08-22T00:25:48.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.517+0000 7f46b372b700 1 -- start start 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ac066150 0x7f46ac14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 0x7f46ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac14e580 con 0x7f46ac0acde0 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0a38d0 con 0x7f46ac066150 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b372b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0a3e90 con 0x7f46ac157890 2023-08-22T00:25:48.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34830/0 (socket says 172.21.15.98:34830) 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 -- 172.21.15.98:0/922466149 learned_addr learned my addr 172.21.15.98:0/922466149 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b14c7700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ac066150 0x7f46ac14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b0cc6700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 0x7f46ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 -- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 msgr2=0x7f46ac0a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 0x7f46ac0a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 -- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ac066150 msgr2=0x7f46ac14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ac066150 0x7f46ac14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 -- 172.21.15.98:0/922466149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009ae0 con 0x7f46ac0acde0 2023-08-22T00:25:48.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b0cc6700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 0x7f46ac0a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:48.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.518+0000 7f46b1cc8700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f46a4009540 tx=0x7f46a4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.519+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4013e70 con 0x7f46ac0acde0 2023-08-22T00:25:48.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.519+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a401c400 con 0x7f46ac0acde0 2023-08-22T00:25:48.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.519+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac0a5530 con 0x7f46ac0acde0 2023-08-22T00:25:48.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.519+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a401c7a0 con 0x7f46ac0acde0 2023-08-22T00:25:48.525 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.519+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac0a5a90 con 0x7f46ac0acde0 2023-08-22T00:25:48.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.520+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac069220 con 0x7f46ac0acde0 2023-08-22T00:25:48.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.520+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f46a401cb50 con 0x7f46ac0acde0 2023-08-22T00:25:48.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.520+0000 7f46a17fa700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 0x7f46900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.520+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f46a407b600 con 0x7f46ac0acde0 2023-08-22T00:25:48.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.520+0000 7f46b14c7700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 0x7f46900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.521+0000 7f46b14c7700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 0x7f46900612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f46a800b890 tx=0x7f46a8008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.524+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46a404cc60 con 0x7f46ac0acde0 2023-08-22T00:25:48.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.684+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46ac069220 con 0x7f46ac0acde0 2023-08-22T00:25:48.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.685+0000 7f46a17fa700 1 -- 172.21.15.98:0/922466149 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46a4050280 con 0x7f46ac0acde0 2023-08-22T00:25:48.687 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:25:48.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 msgr2=0x7f46900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 0x7f46900612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f46a800b890 tx=0x7f46a8008040).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 msgr2=0x7f46ac0ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f46a4009540 tx=0x7f46a4009840).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 shutdown_connections 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46ac0acde0 0x7f46ac0ab050 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ac066150 0x7f46ac14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f469005ee10 0x7f46900612d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 --2- 172.21.15.98:0/922466149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ac157890 0x7f46ac0a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 >> 172.21.15.98:0/922466149 conn(0x7f46ac0c7800 msgr2=0x7f46ac0be040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 shutdown_connections 2023-08-22T00:25:48.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.687+0000 7f46b372b700 1 -- 172.21.15.98:0/922466149 wait complete. 2023-08-22T00:25:48.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:25:48.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.817+0000 7f2e22004700 1 Processor -- start 2023-08-22T00:25:48.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.817+0000 7f2e22004700 1 -- start start 2023-08-22T00:25:48.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e22004700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2e1c066620 0x7f2e1c0c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e22004700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0bd3e0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e22004700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0bd0c0 con 0x7f2e1c150e40 2023-08-22T00:25:48.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e22004700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0c3bb0 con 0x7f2e1c066620 2023-08-22T00:25:48.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e1bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2e1c066620 0x7f2e1c0c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e1affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2e1c0bd870 0x7f2e1c065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36886/0 (socket says 172.21.15.98:36886) 2023-08-22T00:25:48.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.818+0000 7f2e1affd700 1 -- 172.21.15.98:0/2120943031 learned_addr learned my addr 172.21.15.98:0/2120943031 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:48.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1bfff700 1 -- 172.21.15.98:0/2120943031 >> v1:172.21.15.118:6789/0 conn(0x7f2e1c150e40 legacy=0x7f2e1c0a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1bfff700 1 -- 172.21.15.98:0/2120943031 >> v1:172.21.15.98:6789/0 conn(0x7f2e1c0bd870 legacy=0x7f2e1c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1a7fc700 1 -- 172.21.15.98:0/2120943031 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945233287 0 0) 0x7f2e1c0bd3e0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1bfff700 1 -- 172.21.15.98:0/2120943031 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0c3e90 con 0x7f2e1c066620 2023-08-22T00:25:48.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1bfff700 1 --2- 172.21.15.98:0/2120943031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c066620 0x7f2e1c0c2050 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f2e14009e60 tx=0x7f2e14009780).ready entity=mon.0 client_cookie=4b816aea0d1ff9b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1a7fc700 1 -- 172.21.15.98:0/2120943031 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400e070 con 0x7f2e1c066620 2023-08-22T00:25:48.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1a7fc700 1 -- 172.21.15.98:0/2120943031 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1400bc30 con 0x7f2e1c066620 2023-08-22T00:25:48.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.819+0000 7f2e1a7fc700 1 -- 172.21.15.98:0/2120943031 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14012410 con 0x7f2e1c066620 2023-08-22T00:25:48.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 -- 172.21.15.98:0/2120943031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c066620 msgr2=0x7f2e1c0c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 --2- 172.21.15.98:0/2120943031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c066620 0x7f2e1c0c2050 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f2e14009e60 tx=0x7f2e14009780).stop 2023-08-22T00:25:48.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 -- 172.21.15.98:0/2120943031 shutdown_connections 2023-08-22T00:25:48.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 --2- 172.21.15.98:0/2120943031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c066620 0x7f2e1c0c2050 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 -- 172.21.15.98:0/2120943031 >> 172.21.15.98:0/2120943031 conn(0x7f2e1c06a980 msgr2=0x7f2e1c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:48.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 -- 172.21.15.98:0/2120943031 shutdown_connections 2023-08-22T00:25:48.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.820+0000 7f2e22004700 1 -- 172.21.15.98:0/2120943031 wait complete. 2023-08-22T00:25:48.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.821+0000 7f2e22004700 1 Processor -- start 2023-08-22T00:25:48.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.821+0000 7f2e22004700 1 -- start start 2023-08-22T00:25:48.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 0x7f2e1c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e1c150e40 0x7f2e1c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0c70f0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0c7580 con 0x7f2e1c066620 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e22004700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0bef90 con 0x7f2e1c150e40 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34848/0 (socket says 172.21.15.98:34848) 2023-08-22T00:25:48.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e1affd700 1 -- 172.21.15.98:0/1589163946 learned_addr learned my addr 172.21.15.98:0/1589163946 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.822+0000 7f2e1b7fe700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 0x7f2e1c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1bfff700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e1c150e40 0x7f2e1c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 -- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e1c150e40 msgr2=0x7f2e1c1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e1c150e40 0x7f2e1c1646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 -- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 msgr2=0x7f2e1c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 0x7f2e1c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 -- 172.21.15.98:0/1589163946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14009a20 con 0x7f2e1c0bd870 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1b7fe700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 0x7f2e1c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e1affd700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f2e0c00e7f0 tx=0x7f2e0c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007320 con 0x7f2e1c0bd870 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c007480 con 0x7f2e1c0bd870 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0c6aa0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0059b0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.823+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c154030 con 0x7f2e1c0bd870 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.824+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c0c72a0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.824+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2e0c00c520 con 0x7f2e1c0bd870 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.824+0000 7f2e037fe700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 0x7f2e080612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.825+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2e0c07bfb0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.825+0000 7f2e1b7fe700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 0x7f2e080612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:48.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.825+0000 7f2e1b7fe700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 0x7f2e080612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2e10001770 tx=0x7f2e10009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:48.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.829+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e1c0c72a0 con 0x7f2e1c0bd870 2023-08-22T00:25:48.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.991+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2e1c047480 con 0x7f2e1c0bd870 2023-08-22T00:25:48.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.992+0000 7f2e037fe700 1 -- 172.21.15.98:0/1589163946 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2e0c04d610 con 0x7f2e1c0bd870 2023-08-22T00:25:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:48.994 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:25:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:25:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:25:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:25:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:25:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:25:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:25:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:25:48.997 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:25:48.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.993+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 msgr2=0x7f2e080612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 0x7f2e080612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2e10001770 tx=0x7f2e10009040).stop 2023-08-22T00:25:48.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 msgr2=0x7f2e1c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:48.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f2e0c00e7f0 tx=0x7f2e0c007d00).stop 2023-08-22T00:25:49.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 shutdown_connections 2023-08-22T00:25:49.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f2e0805ee10 0x7f2e080612d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e1c150e40 0x7f2e1c1646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e1c066620 0x7f2e1c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 --2- 172.21.15.98:0/1589163946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1c0bd870 0x7f2e1c1530e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 >> 172.21.15.98:0/1589163946 conn(0x7f2e1c06a980 msgr2=0x7f2e1c0a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:49.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 shutdown_connections 2023-08-22T00:25:49.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:48.994+0000 7f2e22004700 1 -- 172.21.15.98:0/1589163946 wait complete. 2023-08-22T00:25:49.007 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:25:49.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:25:49.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.130+0000 7efda48fb700 1 Processor -- start 2023-08-22T00:25:49.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.130+0000 7efda48fb700 1 -- start start 2023-08-22T00:25:49.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efda48fb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efda0153c30 0x7efda00a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efda48fb700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda00c38d0 con 0x7efda00c3360 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efda48fb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda00c3bb0 con 0x7efda0154010 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efda48fb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda00aad70 con 0x7efda0153c30 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efd9ed9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efda00c3360 0x7efda0068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:36888/0 (socket says 172.21.15.98:36888) 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efd9ed9d700 1 -- 172.21.15.98:0/99680626 learned_addr learned my addr 172.21.15.98:0/99680626 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efd9e59c700 1 --2- 172.21.15.98:0/99680626 >> v2:172.21.15.118:3300/0 conn(0x7efda0153c30 0x7efda00a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150784216 0 0) 0x7efda00c38d0 con 0x7efda00c3360 2023-08-22T00:25:49.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.131+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd880033f0 con 0x7efda00c3360 2023-08-22T00:25:49.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710178822 0 0) 0x7efd880033f0 con 0x7efda00c3360 2023-08-22T00:25:49.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 >> v2:172.21.15.118:3300/0 conn(0x7efda0153c30 msgr2=0x7efda00a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:49.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 --2- 172.21.15.98:0/99680626 >> v2:172.21.15.118:3300/0 conn(0x7efda0153c30 0x7efda00a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 >> v1:172.21.15.118:6789/0 conn(0x7efda0154010 legacy=0x7efda00c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00c3e90 con 0x7efda00c3360 2023-08-22T00:25:49.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7efd980017f0 con 0x7efda00c3360 2023-08-22T00:25:49.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 >> v1:172.21.15.98:6789/0 conn(0x7efda00c3360 legacy=0x7efda0068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd880038e0 0x7efd88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 0x7efd88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd88005000 0x7efd8800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00aad70 con 0x7efd88004690 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8800beb0 con 0x7efd88005000 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8800c070 con 0x7efd880038e0 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 0x7efd88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9ed9d700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd88005000 0x7efd8800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9e59c700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd880038e0 0x7efd88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 -- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd880038e0 msgr2=0x7efd88003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd880038e0 0x7efd88003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 -- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd88005000 msgr2=0x7efd8800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd88005000 0x7efd8800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9ed9d700 1 -- 172.21.15.98:0/99680626 reap_dead start 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 -- 172.21.15.98:0/99680626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880033f0 con 0x7efd88004690 2023-08-22T00:25:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9e59c700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd880038e0 0x7efd88003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 0x7efd88004b10 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7efd90001730 tx=0x7efd90007bb0).ready entity=mon.0 client_cookie=d09b9034e7c634ca server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90007020 con 0x7efd88004690 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90007180 con 0x7efd88004690 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.132+0000 7efd9d59a700 1 -- 172.21.15.98:0/99680626 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90007520 con 0x7efd88004690 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 -- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 msgr2=0x7efd88004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 0x7efd88004b10 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7efd90001730 tx=0x7efd90007bb0).stop 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 -- 172.21.15.98:0/99680626 shutdown_connections 2023-08-22T00:25:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 --2- 172.21.15.98:0/99680626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88004690 0x7efd88004b10 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 -- 172.21.15.98:0/99680626 >> 172.21.15.98:0/99680626 conn(0x7efda00c5dd0 msgr2=0x7efda0068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 -- 172.21.15.98:0/99680626 shutdown_connections 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.133+0000 7efda48fb700 1 -- 172.21.15.98:0/99680626 wait complete. 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.134+0000 7efda48fb700 1 Processor -- start 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.135+0000 7efda48fb700 1 -- start start 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.135+0000 7efda48fb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd88004690 0x7efda0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.135+0000 7efda48fb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.135+0000 7efda48fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 0x7efda00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efda48fb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00c0690 con 0x7efda00672e0 2023-08-22T00:25:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efda48fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00c7790 con 0x7efda00c6e20 2023-08-22T00:25:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efda48fb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda00bfa80 con 0x7efd88004690 2023-08-22T00:25:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34874/0 (socket says 172.21.15.98:34874) 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 -- 172.21.15.98:0/2081511630 learned_addr learned my addr 172.21.15.98:0/2081511630 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9e59c700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd88004690 0x7efda0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9ed9d700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 0x7efda00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 -- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd88004690 msgr2=0x7efda0067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd88004690 0x7efda0067830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 -- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 msgr2=0x7efda00c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 0x7efda00c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 -- 172.21.15.98:0/2081511630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00bfd60 con 0x7efda00672e0 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9ed9d700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 0x7efda00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd9dd9b700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7efd90001d20 tx=0x7efd90015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90013460 con 0x7efda00672e0 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900135c0 con 0x7efda00672e0 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda00c0040 con 0x7efda00672e0 2023-08-22T00:25:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90013980 con 0x7efda00672e0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.136+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda0067d20 con 0x7efda00672e0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.137+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda0047480 con 0x7efda00672e0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.138+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7efd9001f430 con 0x7efda00672e0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.138+0000 7efd8e7fc700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 0x7efd800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.138+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5622+0+0 (secure 0 0 0) 0x7efd9007a620 con 0x7efda00672e0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.138+0000 7efd9e59c700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 0x7efd800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.138+0000 7efd9e59c700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 0x7efd800612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7efda00619f0 tx=0x7efd94008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.142+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd9004bc20 con 0x7efda00672e0 2023-08-22T00:25:49.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.307+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7efda00c4170 con 0x7efda00672e0 2023-08-22T00:25:49.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.378+0000 7efd8e7fc700 1 -- 172.21.15.98:0/2081511630 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) v1 ==== 152+0+0 (secure 0 0 0) 0x7efd9004f240 con 0x7efda00672e0 2023-08-22T00:25:49.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.381+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 msgr2=0x7efd800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.381+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 0x7efd800612d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7efda00619f0 tx=0x7efd94008040).stop 2023-08-22T00:25:49.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.381+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 msgr2=0x7efda013f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.381+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7efd90001d20 tx=0x7efd90015000).stop 2023-08-22T00:25:49.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 shutdown_connections 2023-08-22T00:25:49.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7efd8005ee10 0x7efd800612d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd88004690 0x7efda0067830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda00c6e20 0x7efda00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 --2- 172.21.15.98:0/2081511630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efda00672e0 0x7efda013f260 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.382+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 >> 172.21.15.98:0/2081511630 conn(0x7efda00c5dd0 msgr2=0x7efda0068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:49.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.383+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 shutdown_connections 2023-08-22T00:25:49.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.383+0000 7efda48fb700 1 -- 172.21.15.98:0/2081511630 wait complete. 2023-08-22T00:25:49.389 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:25:49.399 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:25:49.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.520+0000 7fa79c24c700 1 Processor -- start 2023-08-22T00:25:49.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.521+0000 7fa79c24c700 1 -- start start 2023-08-22T00:25:49.526 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.521+0000 7fa79c24c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 0x7fa794066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79c24c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 0x7fa7940c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79c24c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa794157890 0x7fa7940c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79c24c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940c69b0 con 0x7fa794157890 2023-08-22T00:25:49.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79c24c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7941542c0 con 0x7fa794066150 2023-08-22T00:25:49.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79c24c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c57f0 con 0x7fa7940c5360 2023-08-22T00:25:49.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa794157890 0x7fa7940c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa794157890 0x7fa7940c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34886/0 (socket says 172.21.15.98:34886) 2023-08-22T00:25:49.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 -- 172.21.15.98:0/1257551325 learned_addr learned my addr 172.21.15.98:0/1257551325 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:49.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa799fe8700 1 --2- 172.21.15.98:0/1257551325 >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 0x7fa794066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa7997e7700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 0x7fa7940c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 -- 172.21.15.98:0/1257551325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 msgr2=0x7fa7940c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:49.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 0x7fa7940c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 -- 172.21.15.98:0/1257551325 >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 msgr2=0x7fa794066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:49.531 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/1257551325 >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 0x7fa794066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 -- 172.21.15.98:0/1257551325 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940c5ad0 con 0x7fa794157890 2023-08-22T00:25:49.532 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa799fe8700 1 --2- 172.21.15.98:0/1257551325 >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 0x7fa794066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa7997e7700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 0x7fa7940c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa794157890 0x7fa7940c33f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fa79406b600 tx=0x7fa78c009840).ready entity=mon.0 client_cookie=c3ec1a3c73afe472 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa798fe6700 1 -- 172.21.15.98:0/1257551325 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00e070 con 0x7fa794157890 2023-08-22T00:25:49.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa798fe6700 1 -- 172.21.15.98:0/1257551325 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00ba50 con 0x7fa794157890 2023-08-22T00:25:49.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.522+0000 7fa798fe6700 1 -- 172.21.15.98:0/1257551325 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00bdd0 con 0x7fa794157890 2023-08-22T00:25:49.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 -- 172.21.15.98:0/1257551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa794157890 msgr2=0x7fa7940c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa794157890 0x7fa7940c33f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fa79406b600 tx=0x7fa78c009840).stop 2023-08-22T00:25:49.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 -- 172.21.15.98:0/1257551325 shutdown_connections 2023-08-22T00:25:49.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa794157890 0x7fa7940c33f0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 --2- 172.21.15.98:0/1257551325 >> v2:172.21.15.118:3300/0 conn(0x7fa794066150 0x7fa794066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 --2- 172.21.15.98:0/1257551325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7940c5360 0x7fa7940c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 -- 172.21.15.98:0/1257551325 >> 172.21.15.98:0/1257551325 conn(0x7fa7940c7800 msgr2=0x7fa7940c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:49.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 -- 172.21.15.98:0/1257551325 shutdown_connections 2023-08-22T00:25:49.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.523+0000 7fa79c24c700 1 -- 172.21.15.98:0/1257551325 wait complete. 2023-08-22T00:25:49.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.524+0000 7fa79c24c700 1 Processor -- start 2023-08-22T00:25:49.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.524+0000 7fa79c24c700 1 -- start start 2023-08-22T00:25:49.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 0x7fa794150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa794157890 0x7fa7940aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ac930 con 0x7fa7940aafd0 2023-08-22T00:25:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ab4c0 con 0x7fa794157890 2023-08-22T00:25:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79c24c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ab7a0 con 0x7fa794066150 2023-08-22T00:25:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34892/0 (socket says 172.21.15.98:34892) 2023-08-22T00:25:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 -- 172.21.15.98:0/3565739380 learned_addr learned my addr 172.21.15.98:0/3565739380 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa799fe8700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 0x7fa794150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa7997e7700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa794157890 0x7fa7940aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 -- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 msgr2=0x7fa794150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 0x7fa794150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 -- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa794157890 msgr2=0x7fa7940aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa794157890 0x7fa7940aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 -- 172.21.15.98:0/3565739380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c009ae0 con 0x7fa7940aafd0 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa799fe8700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 0x7fa794150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa79a7e9700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fa78c009fd0 tx=0x7fa78c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.525+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0032f0 con 0x7fa7940aafd0 2023-08-22T00:25:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.526+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c009500 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.526+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c007840 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.526+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940aba80 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.526+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa794150c20 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.527+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940acaa0 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.527+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa78c003040 con 0x7fa7940aafd0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.528+0000 7fa789ffb700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 0x7fa7780612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.528+0000 7fa799fe8700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 0x7fa7780612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.528+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fa78c07bbb0 con 0x7fa7940aafd0 2023-08-22T00:25:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.528+0000 7fa799fe8700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 0x7fa7780612d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa784006fd0 tx=0x7fa784008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.532+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa78c04d090 con 0x7fa7940aafd0 2023-08-22T00:25:49.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:49.693+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa7940c5db0 con 0x7fa7940aafd0 2023-08-22T00:25:50.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.390+0000 7fa789ffb700 1 -- 172.21.15.98:0/3565739380 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa78c02d030 con 0x7fa7940aafd0 2023-08-22T00:25:50.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 msgr2=0x7fa7780612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 0x7fa7780612d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa784006fd0 tx=0x7fa784008040).stop 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 msgr2=0x7fa7940a8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fa78c009fd0 tx=0x7fa78c009840).stop 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 shutdown_connections 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fa77805ee10 0x7fa7780612d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa794066150 0x7fa794150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7940aafd0 0x7fa7940a8600 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 --2- 172.21.15.98:0/3565739380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa794157890 0x7fa7940aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.396+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 >> 172.21.15.98:0/3565739380 conn(0x7fa7940c7800 msgr2=0x7fa7941515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:50.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.397+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 shutdown_connections 2023-08-22T00:25:50.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.400+0000 7fa79c24c700 1 -- 172.21.15.98:0/3565739380 wait complete. 2023-08-22T00:25:50.407 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:25:50.425 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:25:50.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.550+0000 7f3a18ed6700 1 Processor -- start 2023-08-22T00:25:50.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.550+0000 7f3a18ed6700 1 -- start start 2023-08-22T00:25:50.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a18ed6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3a14153e90 0x7f3a140aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a18ed6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a14158260 con 0x7f3a14157a80 2023-08-22T00:25:50.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a18ed6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a14063d20 con 0x7f3a14157e60 2023-08-22T00:25:50.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a18ed6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140c8d30 con 0x7f3a14153e90 2023-08-22T00:25:50.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a11d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3a14153e90 0x7f3a140aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a11d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3a14153e90 0x7f3a140aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48368/0 (socket says 172.21.15.98:48368) 2023-08-22T00:25:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a11d9b700 1 -- 172.21.15.98:0/134669241 learned_addr learned my addr 172.21.15.98:0/134669241 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a1259c700 1 --1- 172.21.15.98:0/134669241 >> v1:172.21.15.98:6789/0 conn(0x7f3a14157a80 0x7f3a14153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58412/0 (socket says 172.21.15.98:58412) 2023-08-22T00:25:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a11d9b700 1 -- 172.21.15.98:0/134669241 >> v1:172.21.15.118:6789/0 conn(0x7f3a14157e60 legacy=0x7f3a14062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a11d9b700 1 -- 172.21.15.98:0/134669241 >> v1:172.21.15.98:6789/0 conn(0x7f3a14157a80 legacy=0x7f3a14153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.551+0000 7f3a1159a700 1 -- 172.21.15.98:0/134669241 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960404103 0 0) 0x7f3a08001110 con 0x7f3a14157a80 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a11d9b700 1 -- 172.21.15.98:0/134669241 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140c9010 con 0x7f3a14153e90 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a11d9b700 1 --2- 172.21.15.98:0/134669241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140aa920 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f3a04006fd0 tx=0x7f3a040090f0).ready entity=mon.0 client_cookie=aa89669e9b3d816f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a1159a700 1 -- 172.21.15.98:0/134669241 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400b600 con 0x7f3a14153e90 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a1159a700 1 -- 172.21.15.98:0/134669241 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400b760 con 0x7f3a14153e90 2023-08-22T00:25:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a1159a700 1 -- 172.21.15.98:0/134669241 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400bae0 con 0x7f3a14153e90 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 -- 172.21.15.98:0/134669241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 msgr2=0x7f3a140aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/134669241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140aa920 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f3a04006fd0 tx=0x7f3a040090f0).stop 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 -- 172.21.15.98:0/134669241 shutdown_connections 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/134669241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140aa920 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 -- 172.21.15.98:0/134669241 >> 172.21.15.98:0/134669241 conn(0x7f3a140cb5f0 msgr2=0x7f3a140c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 -- 172.21.15.98:0/134669241 shutdown_connections 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.552+0000 7f3a18ed6700 1 -- 172.21.15.98:0/134669241 wait complete. 2023-08-22T00:25:50.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.553+0000 7f3a18ed6700 1 Processor -- start 2023-08-22T00:25:50.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 -- start start 2023-08-22T00:25:50.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a14157a80 0x7f3a140c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a14157e60 0x7f3a14164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c1770 con 0x7f3a14153e90 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14151fb0 con 0x7f3a14157e60 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a18ed6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a141513a0 con 0x7f3a14157a80 2023-08-22T00:25:50.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a1259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a1259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48376/0 (socket says 172.21.15.98:48376) 2023-08-22T00:25:50.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.554+0000 7f3a1259c700 1 -- 172.21.15.98:0/3130041114 learned_addr learned my addr 172.21.15.98:0/3130041114 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:50.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 -- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a14157a80 msgr2=0x7f3a140c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a14157a80 0x7f3a140c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:50.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 -- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a14157e60 msgr2=0x7f3a14164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a14157e60 0x7f3a14164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 -- 172.21.15.98:0/3130041114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04009370 con 0x7f3a14153e90 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a1259c700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f3a0800c4f0 tx=0x7f3a08007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080072e0 con 0x7f3a14153e90 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08007440 con 0x7f3a14153e90 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14151680 con 0x7f3a14153e90 2023-08-22T00:25:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08005930 con 0x7f3a14153e90 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.555+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14151c40 con 0x7f3a14153e90 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.556+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14083630 con 0x7f3a14153e90 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.556+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3a08005ce0 con 0x7f3a14153e90 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.557+0000 7f3a027fc700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 0x7f39f40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.557+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f3a080796c0 con 0x7f3a14153e90 2023-08-22T00:25:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.557+0000 7f3a11d9b700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 0x7f39f40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.557+0000 7f3a11d9b700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 0x7f39f40612a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3a1414d400 tx=0x7f3a04017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.561+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3a0804aa30 con 0x7f3a14153e90 2023-08-22T00:25:50.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.764+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3a14158260 con 0x7f3a14153e90 2023-08-22T00:25:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.771+0000 7f3a027fc700 1 -- 172.21.15.98:0/3130041114 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3a14158260 con 0x7f3a14153e90 2023-08-22T00:25:50.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 msgr2=0x7f39f40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 0x7f39f40612a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3a1414d400 tx=0x7f3a04017000).stop 2023-08-22T00:25:50.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 msgr2=0x7f3a140c0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f3a0800c4f0 tx=0x7f3a08007a90).stop 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 shutdown_connections 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a14157e60 0x7f3a14164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a14153e90 0x7f3a140c0d90 secure :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0x7f3a0800c4f0 tx=0x7f3a08007a90).stop 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f39f405ede0 0x7f39f40612a0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f3a1414d400 tx=0x7f3a04017000).stop 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 --2- 172.21.15.98:0/3130041114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a14157a80 0x7f3a140c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.775+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 >> 172.21.15.98:0/3130041114 conn(0x7f3a140cb5f0 msgr2=0x7f3a140c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:50.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.776+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 shutdown_connections 2023-08-22T00:25:50.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.776+0000 7f3a18ed6700 1 -- 172.21.15.98:0/3130041114 wait complete. 2023-08-22T00:25:50.782 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 20 and data pool 21 2023-08-22T00:25:50.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:50.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.925+0000 7f9cf41b2700 1 Processor -- start 2023-08-22T00:25:50.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 -- start start 2023-08-22T00:25:50.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 0x7f9cec14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 0x7f9cec1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec155260 con 0x7f9cec14e0d0 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0c17b0 con 0x7f9cec0c61a0 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.926+0000 7f9cf41b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0bf9e0 con 0x7f9cec1544f0 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf1f4e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9cec14e0d0 0x7f9cec0c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58418/0 (socket says 172.21.15.98:58418) 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf1f4e700 1 -- 172.21.15.98:0/461949175 learned_addr learned my addr 172.21.15.98:0/461949175 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:50.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 --2- 172.21.15.98:0/461949175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 0x7f9cec1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf174d700 1 --2- 172.21.15.98:0/461949175 >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 0x7f9cec14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf0f4c700 1 -- 172.21.15.98:0/461949175 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338649068 0 0) 0x7f9cec155260 con 0x7f9cec14e0d0 2023-08-22T00:25:50.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf0f4c700 1 -- 172.21.15.98:0/461949175 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd80033f0 con 0x7f9cec14e0d0 2023-08-22T00:25:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 -- 172.21.15.98:0/461949175 >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 msgr2=0x7f9cec14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 --2- 172.21.15.98:0/461949175 >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 0x7f9cec14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 -- 172.21.15.98:0/461949175 >> v1:172.21.15.98:6789/0 conn(0x7f9cec14e0d0 legacy=0x7f9cec0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 -- 172.21.15.98:0/461949175 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0bfcc0 con 0x7f9cec1544f0 2023-08-22T00:25:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf174d700 1 --2- 172.21.15.98:0/461949175 >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 0x7f9cec14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf274f700 1 --2- 172.21.15.98:0/461949175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 0x7f9cec1549a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f9ce4009e60 tx=0x7f9ce4009780).ready entity=mon.2 client_cookie=c47c4c98672345f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf0f4c700 1 -- 172.21.15.98:0/461949175 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400e070 con 0x7f9cec1544f0 2023-08-22T00:25:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf0f4c700 1 -- 172.21.15.98:0/461949175 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce400bab0 con 0x7f9cec1544f0 2023-08-22T00:25:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.927+0000 7f9cf0f4c700 1 -- 172.21.15.98:0/461949175 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400be30 con 0x7f9cec1544f0 2023-08-22T00:25:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 -- 172.21.15.98:0/461949175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 msgr2=0x7f9cec1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/461949175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 0x7f9cec1549a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f9ce4009e60 tx=0x7f9ce4009780).stop 2023-08-22T00:25:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 -- 172.21.15.98:0/461949175 shutdown_connections 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/461949175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec1544f0 0x7f9cec1549a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/461949175 >> v2:172.21.15.118:3300/0 conn(0x7f9cec0c61a0 0x7f9cec14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 -- 172.21.15.98:0/461949175 >> 172.21.15.98:0/461949175 conn(0x7f9cec0caa80 msgr2=0x7f9cec0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 -- 172.21.15.98:0/461949175 shutdown_connections 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.928+0000 7f9cf41b2700 1 -- 172.21.15.98:0/461949175 wait complete. 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.929+0000 7f9cf41b2700 1 Processor -- start 2023-08-22T00:25:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.929+0000 7f9cf41b2700 1 -- start start 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 0x7f9cec14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14e0d0 0x7f9cec150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec14cf50 con 0x7f9cec1544f0 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0c4820 con 0x7f9cec14e0d0 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0c3cf0 con 0x7f9cec0c61a0 2023-08-22T00:25:50.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48384/0 (socket says 172.21.15.98:48384) 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 -- 172.21.15.98:0/839098322 learned_addr learned my addr 172.21.15.98:0/839098322 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf174d700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14e0d0 0x7f9cec150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf1f4e700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 0x7f9cec14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 -- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 msgr2=0x7f9cec14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 0x7f9cec14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 -- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14e0d0 msgr2=0x7f9cec150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14e0d0 0x7f9cec150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 -- 172.21.15.98:0/839098322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0092a0 con 0x7f9cec1544f0 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf1f4e700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 0x7f9cec14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf274f700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f9ce400b610 tx=0x7f9ce4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce401d630 con 0x7f9cec1544f0 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce401d790 con 0x7f9cec1544f0 2023-08-22T00:25:50.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.930+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4009a20 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.931+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce401db50 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.931+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0c4260 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.932+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec047480 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.932+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9ce4003040 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.932+0000 7f9ce1ffb700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 0x7f9cd00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.932+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9ce407bde0 con 0x7f9cec1544f0 2023-08-22T00:25:50.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.932+0000 7f9cf1f4e700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 0x7f9cd00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:50.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.933+0000 7f9cf1f4e700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 0x7f9cd00612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9ce8007fd0 tx=0x7f9ce8009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:50.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:50.937+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ce404d0f0 con 0x7f9cec1544f0 2023-08-22T00:25:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.101+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cec151770 con 0x7f9cec1544f0 2023-08-22T00:25:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.102+0000 7f9ce1ffb700 1 -- 172.21.15.98:0/839098322 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f9ce4050710 con 0x7f9cec1544f0 2023-08-22T00:25:51.104 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:51.104 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":165,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:50.766460+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 msgr2=0x7f9cd00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 0x7f9cd00612d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9ce8007fd0 tx=0x7f9ce8009040).stop 2023-08-22T00:25:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 msgr2=0x7f9cec150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f9ce400b610 tx=0x7f9ce4009780).stop 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 shutdown_connections 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9cd005ee10 0x7f9cd00612d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cec0c61a0 0x7f9cec14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cec1544f0 0x7f9cec150e60 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 --2- 172.21.15.98:0/839098322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14e0d0 0x7f9cec150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 >> 172.21.15.98:0/839098322 conn(0x7f9cec0caa80 msgr2=0x7f9cec0c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 shutdown_connections 2023-08-22T00:25:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.104+0000 7f9cf41b2700 1 -- 172.21.15.98:0/839098322 wait complete. 2023-08-22T00:25:51.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:51.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:25:51.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:25:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.237+0000 7f5b6c594700 1 Processor -- start 2023-08-22T00:25:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.237+0000 7f5b6c594700 1 -- start start 2023-08-22T00:25:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6c594700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b640c61a0 0x7f5b6414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6c594700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b641544f0 0x7f5b641549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6c594700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b64155260 con 0x7f5b6414e0d0 2023-08-22T00:25:51.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6c594700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640c17b0 con 0x7f5b641544f0 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6c594700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640bf9e0 con 0x7f5b640c61a0 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b641544f0 0x7f5b641549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b641544f0 0x7f5b641549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48394/0 (socket says 172.21.15.98:48394) 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 -- 172.21.15.98:0/1276151428 learned_addr learned my addr 172.21.15.98:0/1276151428 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b69b2f700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b640c61a0 0x7f5b6414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 -- 172.21.15.98:0/1276151428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b640c61a0 msgr2=0x7f5b6414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b640c61a0 0x7f5b6414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 -- 172.21.15.98:0/1276151428 >> v1:172.21.15.118:6789/0 conn(0x7f5b6414e0d0 legacy=0x7f5b640c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 -- 172.21.15.98:0/1276151428 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640bfcc0 con 0x7f5b641544f0 2023-08-22T00:25:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6ab31700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b641544f0 0x7f5b641549a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f5b5c009f20 tx=0x7f5b5c009840).ready entity=mon.0 client_cookie=335a31b27f816d12 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6932e700 1 -- 172.21.15.98:0/1276151428 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00e070 con 0x7f5b641544f0 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.238+0000 7f5b6932e700 1 -- 172.21.15.98:0/1276151428 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00ba80 con 0x7f5b641544f0 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6932e700 1 -- 172.21.15.98:0/1276151428 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00be00 con 0x7f5b641544f0 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 -- 172.21.15.98:0/1276151428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b641544f0 msgr2=0x7f5b641549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b641544f0 0x7f5b641549a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f5b5c009f20 tx=0x7f5b5c009840).stop 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 -- 172.21.15.98:0/1276151428 shutdown_connections 2023-08-22T00:25:51.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b641544f0 0x7f5b641549a0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1276151428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b640c61a0 0x7f5b6414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 -- 172.21.15.98:0/1276151428 >> 172.21.15.98:0/1276151428 conn(0x7f5b640caa80 msgr2=0x7f5b640cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 -- 172.21.15.98:0/1276151428 shutdown_connections 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.239+0000 7f5b6c594700 1 -- 172.21.15.98:0/1276151428 wait complete. 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.241+0000 7f5b6c594700 1 Processor -- start 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.241+0000 7f5b6c594700 1 -- start start 2023-08-22T00:25:51.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b640c61a0 0x7f5b6414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b641544f0 0x7f5b640ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640b0340 con 0x7f5b6414e0d0 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64146900 con 0x7f5b640c61a0 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640af730 con 0x7f5b641544f0 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48404/0 (socket says 172.21.15.98:48404) 2023-08-22T00:25:51.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 -- 172.21.15.98:0/1314116560 learned_addr learned my addr 172.21.15.98:0/1314116560 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6ab31700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b641544f0 0x7f5b640ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6a330700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b640c61a0 0x7f5b6414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 -- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b641544f0 msgr2=0x7f5b640ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b641544f0 0x7f5b640ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 -- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b640c61a0 msgr2=0x7f5b6414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b640c61a0 0x7f5b6414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 -- 172.21.15.98:0/1314116560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009ae0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b69b2f700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f5b54006980 tx=0x7f5b54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011590 con 0x7f5b6414e0d0 2023-08-22T00:25:51.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b540116f0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b640afa10 con 0x7f5b6414e0d0 2023-08-22T00:25:51.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011a90 con 0x7f5b6414e0d0 2023-08-22T00:25:51.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.242+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b640affd0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.244+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64047480 con 0x7f5b6414e0d0 2023-08-22T00:25:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.244+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5b5401c460 con 0x7f5b6414e0d0 2023-08-22T00:25:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.244+0000 7f5b5a7fc700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 0x7f5b480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.244+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5b54079be0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.244+0000 7f5b6a330700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 0x7f5b480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.245+0000 7f5b6a330700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 0x7f5b480612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b60003920 tx=0x7f5b60000bc0).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.248+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b5404ae90 con 0x7f5b6414e0d0 2023-08-22T00:25:51.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.415+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b6414dbf0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.416+0000 7f5b5a7fc700 1 -- 172.21.15.98:0/1314116560 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f5b5404e4b0 con 0x7f5b6414e0d0 2023-08-22T00:25:51.419 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:51.420 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":165,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:50.766460+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:51.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 msgr2=0x7f5b480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 0x7f5b480612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b60003920 tx=0x7f5b60000bc0).stop 2023-08-22T00:25:51.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 msgr2=0x7f5b640aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f5b54006980 tx=0x7f5b54008040).stop 2023-08-22T00:25:51.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 shutdown_connections 2023-08-22T00:25:51.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f5b4805ee10 0x7f5b480612d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b641544f0 0x7f5b640ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b640c61a0 0x7f5b6414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 --2- 172.21.15.98:0/1314116560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b6414e0d0 0x7f5b640aede0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 >> 172.21.15.98:0/1314116560 conn(0x7f5b640caa80 msgr2=0x7f5b64151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:51.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 shutdown_connections 2023-08-22T00:25:51.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.418+0000 7f5b6c594700 1 -- 172.21.15.98:0/1314116560 wait complete. 2023-08-22T00:25:51.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:25:51.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.556+0000 7f4e5e2cd700 1 Processor -- start 2023-08-22T00:25:51.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.556+0000 7f4e5e2cd700 1 -- start start 2023-08-22T00:25:51.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5e2cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4e580c5d40 0x7f4e58067260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5e2cd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e580c6120 0x7f4e58063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5e2cd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5814ad80 con 0x7f4e58064390 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5e2cd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e58154e30 con 0x7f4e580c6120 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5e2cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580647b0 con 0x7f4e580c5d40 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e577fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e580c6120 0x7f4e58063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e577fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e580c6120 0x7f4e58063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48410/0 (socket says 172.21.15.98:48410) 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e577fe700 1 -- 172.21.15.98:0/416167837 learned_addr learned my addr 172.21.15.98:0/416167837 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:51.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e5c86a700 1 --1- 172.21.15.98:0/416167837 >> v1:172.21.15.98:6789/0 conn(0x7f4e58064390 0x7f4e58153e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58422/0 (socket says 172.21.15.98:58422) 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e57fff700 1 --2- 172.21.15.98:0/416167837 >> v2:172.21.15.118:3300/0 conn(0x7f4e580c5d40 0x7f4e58067260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e577fe700 1 -- 172.21.15.98:0/416167837 >> v2:172.21.15.118:3300/0 conn(0x7f4e580c5d40 msgr2=0x7f4e58067260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.557+0000 7f4e577fe700 1 --2- 172.21.15.98:0/416167837 >> v2:172.21.15.118:3300/0 conn(0x7f4e580c5d40 0x7f4e58067260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e577fe700 1 -- 172.21.15.98:0/416167837 >> v1:172.21.15.98:6789/0 conn(0x7f4e58064390 legacy=0x7f4e58153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e56ffd700 1 -- 172.21.15.98:0/416167837 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35049151 0 0) 0x7f4e5814ad80 con 0x7f4e58064390 2023-08-22T00:25:51.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e577fe700 1 -- 172.21.15.98:0/416167837 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58154b50 con 0x7f4e580c6120 2023-08-22T00:25:51.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e577fe700 1 --2- 172.21.15.98:0/416167837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c6120 0x7f4e58063ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f4e58068e10 tx=0x7f4e4800b3b0).ready entity=mon.0 client_cookie=e29473d8763500a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e56ffd700 1 -- 172.21.15.98:0/416167837 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800db10 con 0x7f4e580c6120 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e56ffd700 1 -- 172.21.15.98:0/416167837 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4800dc70 con 0x7f4e580c6120 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e56ffd700 1 -- 172.21.15.98:0/416167837 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48010470 con 0x7f4e580c6120 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/416167837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c6120 msgr2=0x7f4e58063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/416167837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c6120 0x7f4e58063ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f4e58068e10 tx=0x7f4e4800b3b0).stop 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/416167837 shutdown_connections 2023-08-22T00:25:51.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/416167837 >> v2:172.21.15.118:3300/0 conn(0x7f4e580c5d40 0x7f4e58067260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/416167837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c6120 0x7f4e58063ea0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/416167837 >> 172.21.15.98:0/416167837 conn(0x7f4e580c3a60 msgr2=0x7f4e580c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:51.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/416167837 shutdown_connections 2023-08-22T00:25:51.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.558+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/416167837 wait complete. 2023-08-22T00:25:51.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.559+0000 7f4e5e2cd700 1 Processor -- start 2023-08-22T00:25:51.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 -- start start 2023-08-22T00:25:51.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e58064390 0x7f4e58152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c6120 0x7f4e58069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580ab330 con 0x7f4e580c5d40 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580ac150 con 0x7f4e580c6120 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e5e2cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580ab540 con 0x7f4e58064390 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.560+0000 7f4e577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48414/0 (socket says 172.21.15.98:48414) 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 -- 172.21.15.98:0/2259978348 learned_addr learned my addr 172.21.15.98:0/2259978348 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e57fff700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e58064390 0x7f4e58152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e5c86a700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c6120 0x7f4e58069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 -- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e58064390 msgr2=0x7f4e58152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e58064390 0x7f4e58152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 -- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c6120 msgr2=0x7f4e58069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:51.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c6120 0x7f4e58069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 -- 172.21.15.98:0/2259978348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4800b610 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e577fe700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f4e4800bf90 tx=0x7f4e4800b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48020070 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e48019450 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e580ab820 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48019810 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.561+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e580abde0 con 0x7f4e580c5d40 2023-08-22T00:25:51.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.562+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e580ac2e0 con 0x7f4e580c5d40 2023-08-22T00:25:51.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.562+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4e48019b80 con 0x7f4e580c5d40 2023-08-22T00:25:51.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.563+0000 7f4e3ffff700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 0x7f4e440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:51.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.563+0000 7f4e57fff700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 0x7f4e440612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:51.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.563+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4e4807dc10 con 0x7f4e580c5d40 2023-08-22T00:25:51.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.563+0000 7f4e57fff700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 0x7f4e440612a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4e4c006fd0 tx=0x7f4e4c008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:51.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.567+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e4804ef20 con 0x7f4e580c5d40 2023-08-22T00:25:51.685 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-08-22T00:25:51.684+0000 7fd64845c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:25:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:51.771+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4e580ac4e0 con 0x7f4e580c5d40 2023-08-22T00:25:52.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.772+0000 7f4e3ffff700 1 -- 172.21.15.98:0/2259978348 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4e4802a070 con 0x7f4e580c5d40 2023-08-22T00:25:52.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 msgr2=0x7f4e440612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 0x7f4e440612a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4e4c006fd0 tx=0x7f4e4c008040).stop 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 msgr2=0x7f4e58147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f4e4800bf90 tx=0x7f4e4800b3b0).stop 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 shutdown_connections 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4e4405ede0 0x7f4e440612a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e58064390 0x7f4e58152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e580c6120 0x7f4e58069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 --2- 172.21.15.98:0/2259978348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e580c5d40 0x7f4e58147620 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 >> 172.21.15.98:0/2259978348 conn(0x7f4e580c3a60 msgr2=0x7f4e580636e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:52.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 shutdown_connections 2023-08-22T00:25:52.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.775+0000 7f4e5e2cd700 1 -- 172.21.15.98:0/2259978348 wait complete. 2023-08-22T00:25:52.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:25:52.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.915+0000 7f947d5b6700 1 Processor -- start 2023-08-22T00:25:52.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.915+0000 7f947d5b6700 1 -- start start 2023-08-22T00:25:52.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f947d5b6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 0x7f94780a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f947d5b6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f94780c39d0 0x7f94780c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f947d5b6700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94781525d0 con 0x7f947814fd90 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f947d5b6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9478152b80 con 0x7f94780c39d0 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f947d5b6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94780c42f0 con 0x7f94780675f0 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f94780c39d0 0x7f94780c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f94780c39d0 0x7f94780c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48416/0 (socket says 172.21.15.98:48416) 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 -- 172.21.15.98:0/980466931 learned_addr learned my addr 172.21.15.98:0/980466931 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f9476ffd700 1 --1- 172.21.15.98:0/980466931 >> v1:172.21.15.98:6789/0 conn(0x7f947814fd90 0x7f9478153010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58432/0 (socket says 172.21.15.98:58432) 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94767fc700 1 --2- 172.21.15.98:0/980466931 >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 0x7f94780a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 -- 172.21.15.98:0/980466931 >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 msgr2=0x7f94780a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 --2- 172.21.15.98:0/980466931 >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 0x7f94780a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 -- 172.21.15.98:0/980466931 >> v1:172.21.15.98:6789/0 conn(0x7f947814fd90 legacy=0x7f9478153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 -- 172.21.15.98:0/980466931 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478067bd0 con 0x7f94780c39d0 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94767fc700 1 --2- 172.21.15.98:0/980466931 >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 0x7f94780a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f94777fe700 1 --2- 172.21.15.98:0/980466931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f94780c3e00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f94780ab120 tx=0x7f9470009840).ready entity=mon.0 client_cookie=ac9d6172ee5ec27e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f9475ffb700 1 -- 172.21.15.98:0/980466931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000e070 con 0x7f94780c39d0 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f9475ffb700 1 -- 172.21.15.98:0/980466931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947000ba50 con 0x7f94780c39d0 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.916+0000 7f9475ffb700 1 -- 172.21.15.98:0/980466931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000bdd0 con 0x7f94780c39d0 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 -- 172.21.15.98:0/980466931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 msgr2=0x7f94780c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 --2- 172.21.15.98:0/980466931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f94780c3e00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f94780ab120 tx=0x7f9470009840).stop 2023-08-22T00:25:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 -- 172.21.15.98:0/980466931 shutdown_connections 2023-08-22T00:25:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 --2- 172.21.15.98:0/980466931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f94780c3e00 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 --2- 172.21.15.98:0/980466931 >> v2:172.21.15.118:3300/0 conn(0x7f94780675f0 0x7f94780a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 -- 172.21.15.98:0/980466931 >> 172.21.15.98:0/980466931 conn(0x7f94780c8950 msgr2=0x7f94780c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 -- 172.21.15.98:0/980466931 shutdown_connections 2023-08-22T00:25:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.917+0000 7f947d5b6700 1 -- 172.21.15.98:0/980466931 wait complete. 2023-08-22T00:25:52.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.918+0000 7f947d5b6700 1 Processor -- start 2023-08-22T00:25:52.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.918+0000 7f947d5b6700 1 -- start start 2023-08-22T00:25:52.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94780675f0 0x7f9478164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f947814fd90 0x7f947814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947814c2a0 con 0x7f94780c39d0 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947814c580 con 0x7f94780675f0 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f947d5b6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947814c860 con 0x7f947814fd90 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48426/0 (socket says 172.21.15.98:48426) 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 -- 172.21.15.98:0/3744733006 learned_addr learned my addr 172.21.15.98:0/3744733006 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:52.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94777fe700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f947814fd90 0x7f947814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f9476ffd700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94780675f0 0x7f9478164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 -- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f947814fd90 msgr2=0x7f947814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f947814fd90 0x7f947814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 -- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94780675f0 msgr2=0x7f9478164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94780675f0 0x7f9478164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:52.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 -- 172.21.15.98:0/3744733006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470009ae0 con 0x7f94780c39d0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.919+0000 7f94767fc700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f946c00c880 tx=0x7f946c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.920+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c010580 con 0x7f94780c39d0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.920+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0106e0 con 0x7f94780c39d0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.920+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c010a60 con 0x7f94780c39d0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.920+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947814cb40 con 0x7f94780c39d0 2023-08-22T00:25:52.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.920+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9478065e20 con 0x7f94780c39d0 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.921+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947814cfe0 con 0x7f94780c39d0 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.921+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f946c01b460 con 0x7f94780c39d0 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.921+0000 7f945effd700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 0x7f94640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.921+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f946c07a060 con 0x7f94780c39d0 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.921+0000 7f9476ffd700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 0x7f94640612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:52.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.922+0000 7f9476ffd700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 0x7f94640612a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9468000c00 tx=0x7f9468007b90).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:52.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:52.925+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f946c04b250 con 0x7f94780c39d0 2023-08-22T00:25:53.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.127+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f947814d190 con 0x7f94780c39d0 2023-08-22T00:25:53.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.776+0000 7f945effd700 1 -- 172.21.15.98:0/3744733006 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f946c04e870 con 0x7f94780c39d0 2023-08-22T00:25:53.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.778+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 msgr2=0x7f94640612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.778+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 0x7f94640612a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9468000c00 tx=0x7f9468007b90).stop 2023-08-22T00:25:53.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.778+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 msgr2=0x7f9478065930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.778+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f946c00c880 tx=0x7f946c008040).stop 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 shutdown_connections 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f946405ede0 0x7f94640612a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f947814fd90 0x7f947814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94780675f0 0x7f9478164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 --2- 172.21.15.98:0/3744733006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94780c39d0 0x7f9478065930 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 >> 172.21.15.98:0/3744733006 conn(0x7f94780c8950 msgr2=0x7f94780bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 shutdown_connections 2023-08-22T00:25:53.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.779+0000 7f947d5b6700 1 -- 172.21.15.98:0/3744733006 wait complete. 2023-08-22T00:25:53.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:25:53.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.915+0000 7f080d17e700 1 Processor -- start 2023-08-22T00:25:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.915+0000 7f080d17e700 1 -- start start 2023-08-22T00:25:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080d17e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08080bd870 0x7f08080c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080d17e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0808065f10 0x7f08080663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080d17e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08080bd3e0 con 0x7f0808150e40 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080d17e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0808066890 con 0x7f0808065f10 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080d17e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080bd0c0 con 0x7f08080bd870 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080759e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0808065f10 0x7f08080663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080759e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0808065f10 0x7f08080663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48434/0 (socket says 172.21.15.98:48434) 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080759e700 1 -- 172.21.15.98:0/1345061818 learned_addr learned my addr 172.21.15.98:0/1345061818 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.916+0000 7f080659c700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08080bd870 0x7f08080c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080759e700 1 -- 172.21.15.98:0/1345061818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08080bd870 msgr2=0x7f08080c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080759e700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08080bd870 0x7f08080c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080759e700 1 -- 172.21.15.98:0/1345061818 >> v1:172.21.15.118:6789/0 conn(0x7f0808150e40 legacy=0x7f08080a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080759e700 1 -- 172.21.15.98:0/1345061818 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080c3bb0 con 0x7f0808065f10 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080759e700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f08080663a0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0800009f20 tx=0x7f0800009840).ready entity=mon.0 client_cookie=e1bb38c48e2eaffb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f0805d9b700 1 -- 172.21.15.98:0/1345061818 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000ba80 con 0x7f0808065f10 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f0805d9b700 1 -- 172.21.15.98:0/1345061818 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000bbe0 con 0x7f0808065f10 2023-08-22T00:25:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f0805d9b700 1 -- 172.21.15.98:0/1345061818 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011480 con 0x7f0808065f10 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 -- 172.21.15.98:0/1345061818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 msgr2=0x7f08080663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f08080663a0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0800009f20 tx=0x7f0800009840).stop 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 -- 172.21.15.98:0/1345061818 shutdown_connections 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f08080663a0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 --2- 172.21.15.98:0/1345061818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08080bd870 0x7f08080c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 -- 172.21.15.98:0/1345061818 >> 172.21.15.98:0/1345061818 conn(0x7f080806a980 msgr2=0x7f08080c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 -- 172.21.15.98:0/1345061818 shutdown_connections 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.917+0000 7f080d17e700 1 -- 172.21.15.98:0/1345061818 wait complete. 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 Processor -- start 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 -- start start 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08080bd870 0x7f08081472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0808150e40 0x7f08080c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080ac6c0 con 0x7f0808065f10 2023-08-22T00:25:53.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080abab0 con 0x7f08080bd870 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f080d17e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080abd90 con 0x7f0808150e40 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.919+0000 7f0806d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48442/0 (socket says 172.21.15.98:48442) 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 -- 172.21.15.98:0/2284944803 learned_addr learned my addr 172.21.15.98:0/2284944803 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f080659c700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08080bd870 0x7f08081472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f080759e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0808150e40 0x7f08080c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 -- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0808150e40 msgr2=0x7f08080c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0808150e40 0x7f08080c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 -- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08080bd870 msgr2=0x7f08081472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08080bd870 0x7f08081472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 -- 172.21.15.98:0/2284944803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009ae0 con 0x7f0808065f10 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f0806d9d700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f07f800c4c0 tx=0x7f07f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:53.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8007020 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8001e90 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80073b0 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08080ac070 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.920+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0808164360 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.921+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0808047480 con 0x7f0808065f10 2023-08-22T00:25:53.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.921+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f07f80068b0 con 0x7f0808065f10 2023-08-22T00:25:53.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.922+0000 7f07feffd700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 0x7f07e80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:53.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.922+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f07f80798d0 con 0x7f0808065f10 2023-08-22T00:25:53.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.922+0000 7f080659c700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 0x7f07e80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:53.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.922+0000 7f080659c700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 0x7f07e80612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f07f000bb20 tx=0x7f07f0008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:53.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:53.926+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07f804abe0 con 0x7f0808065f10 2023-08-22T00:25:54.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.126+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08080c3990 con 0x7f0808065f10 2023-08-22T00:25:54.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.126+0000 7f07feffd700 1 -- 172.21.15.98:0/2284944803 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f07f804e200 con 0x7f0808065f10 2023-08-22T00:25:54.128 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:54.129 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:25:54.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 msgr2=0x7f07e80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 0x7f07e80612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f07f000bb20 tx=0x7f07f0008040).stop 2023-08-22T00:25:54.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 msgr2=0x7f0808163e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f07f800c4c0 tx=0x7f07f8007e00).stop 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 shutdown_connections 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f07e805ee10 0x7f07e80612d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0808150e40 0x7f08080c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808065f10 0x7f0808163e70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 --2- 172.21.15.98:0/2284944803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08080bd870 0x7f08081472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 >> 172.21.15.98:0/2284944803 conn(0x7f080806a980 msgr2=0x7f08080a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 shutdown_connections 2023-08-22T00:25:54.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.128+0000 7f080d17e700 1 -- 172.21.15.98:0/2284944803 wait complete. 2023-08-22T00:25:54.132 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:25:54.142 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:25:54.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.257+0000 7fba6d84a700 1 Processor -- start 2023-08-22T00:25:54.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.257+0000 7fba6d84a700 1 -- start start 2023-08-22T00:25:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba6d84a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba680bce60 0x7fba680bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba6d84a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680bd800 con 0x7fba68157ad0 2023-08-22T00:25:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba6d84a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680c6a80 con 0x7fba680a4db0 2023-08-22T00:25:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba6d84a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680c2150 con 0x7fba680bce60 2023-08-22T00:25:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba66ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fba68157ad0 0x7fba680c1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58436/0 (socket says 172.21.15.98:58436) 2023-08-22T00:25:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.258+0000 7fba66ffd700 1 -- 172.21.15.98:0/3877119962 learned_addr learned my addr 172.21.15.98:0/3877119962 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba677fe700 1 --2- 172.21.15.98:0/3877119962 >> v2:172.21.15.118:3300/0 conn(0x7fba680bce60 0x7fba680bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627674355 0 0) 0x7fba58001110 con 0x7fba68157ad0 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba500033f0 con 0x7fba68157ad0 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343384345 0 0) 0x7fba680c6a80 con 0x7fba680a4db0 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba58001110 con 0x7fba680a4db0 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192061519 0 0) 0x7fba500033f0 con 0x7fba68157ad0 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 >> v2:172.21.15.118:3300/0 conn(0x7fba680bce60 msgr2=0x7fba680bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 --2- 172.21.15.98:0/3877119962 >> v2:172.21.15.118:3300/0 conn(0x7fba680bce60 0x7fba680bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 >> v1:172.21.15.118:6789/0 conn(0x7fba680a4db0 legacy=0x7fba68157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680c5e70 con 0x7fba68157ad0 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fba58001600 con 0x7fba68157ad0 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 >> v1:172.21.15.98:6789/0 conn(0x7fba68157ad0 legacy=0x7fba680c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50004690 0x7fba50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005000 0x7fba5000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680c2150 con 0x7fba50003a70 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5000be80 con 0x7fba50005000 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5000c040 con 0x7fba50004690 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba677fe700 1 --2- 172.21.15.98:0/3877119962 >> v2:172.21.15.118:3300/0 conn(0x7fba680bce60 0x7fba680bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba667fc700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50004690 0x7fba50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba677fe700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005000 0x7fba5000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 -- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50004690 msgr2=0x7fba50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50004690 0x7fba50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 -- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005000 msgr2=0x7fba5000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005000 0x7fba5000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba66ffd700 1 -- 172.21.15.98:0/3877119962 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500033f0 con 0x7fba50003a70 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba677fe700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005000 0x7fba5000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba677fe700 1 -- 172.21.15.98:0/3877119962 reap_dead start 2023-08-22T00:25:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.259+0000 7fba667fc700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50004690 0x7fba50004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba66ffd700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba50003e70 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fba5800c2a0 tx=0x7fba58007880).ready entity=mon.0 client_cookie=8a841b9ba452e713 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58007b70 con 0x7fba50003a70 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800cbd0 con 0x7fba50003a70 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba65ffb700 1 -- 172.21.15.98:0/3877119962 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba580070d0 con 0x7fba50003a70 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 -- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 msgr2=0x7fba50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba50003e70 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fba5800c2a0 tx=0x7fba58007880).stop 2023-08-22T00:25:54.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 -- 172.21.15.98:0/3877119962 shutdown_connections 2023-08-22T00:25:54.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 --2- 172.21.15.98:0/3877119962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba50003e70 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 -- 172.21.15.98:0/3877119962 >> 172.21.15.98:0/3877119962 conn(0x7fba680c3990 msgr2=0x7fba680c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 -- 172.21.15.98:0/3877119962 shutdown_connections 2023-08-22T00:25:54.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.260+0000 7fba6d84a700 1 -- 172.21.15.98:0/3877119962 wait complete. 2023-08-22T00:25:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 Processor -- start 2023-08-22T00:25:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 -- start start 2023-08-22T00:25:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68156970 0x7fba68154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba68151b90 0x7fba680a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba681570e0 con 0x7fba50003a70 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680a6810 con 0x7fba68151b90 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba6d84a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba681575d0 con 0x7fba68156970 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.262+0000 7fba66ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48462/0 (socket says 172.21.15.98:48462) 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 -- 172.21.15.98:0/1640991993 learned_addr learned my addr 172.21.15.98:0/1640991993 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba667fc700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68156970 0x7fba68154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba677fe700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba68151b90 0x7fba680a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 -- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68156970 msgr2=0x7fba68154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68156970 0x7fba68154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 -- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba68151b90 msgr2=0x7fba680a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba68151b90 0x7fba680a7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 -- 172.21.15.98:0/1640991993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68164970 con 0x7fba50003a70 2023-08-22T00:25:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba66ffd700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fba58007150 tx=0x7fba58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58007650 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba580046b0 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba68156e00 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58004a30 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.263+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba680a64a0 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.264+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba68047480 con 0x7fba50003a70 2023-08-22T00:25:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.264+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fba58013450 con 0x7fba50003a70 2023-08-22T00:25:54.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.265+0000 7fba4effd700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.265+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fba5807a830 con 0x7fba50003a70 2023-08-22T00:25:54.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.265+0000 7fba667fc700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.265+0000 7fba667fc700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fba5c007fd0 tx=0x7fba5c009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.269+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba5804bae0 con 0x7fba50003a70 2023-08-22T00:25:54.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.430+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba680bd800 con 0x7fba50003a70 2023-08-22T00:25:54.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.431+0000 7fba4effd700 1 -- 172.21.15.98:0/1640991993 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+17275 (secure 0 0 0) 0x7fba680bd800 con 0x7fba50003a70 2023-08-22T00:25:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:54.433 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":166,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:25:51.768490+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:25:54.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 msgr2=0x7fba540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fba5c007fd0 tx=0x7fba5c009040).stop 2023-08-22T00:25:54.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 msgr2=0x7fba68164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fba58007150 tx=0x7fba58015000).stop 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 shutdown_connections 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba68151b90 0x7fba680a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba50003a70 0x7fba68164480 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fba5405ee10 0x7fba540612d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 --2- 172.21.15.98:0/1640991993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba68156970 0x7fba68154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 >> 172.21.15.98:0/1640991993 conn(0x7fba680c3990 msgr2=0x7fba68066f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 shutdown_connections 2023-08-22T00:25:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.433+0000 7fba6d84a700 1 -- 172.21.15.98:0/1640991993 wait complete. 2023-08-22T00:25:54.446 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:25:54.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:54.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.562+0000 7f8573acf700 1 Processor -- start 2023-08-22T00:25:54.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.562+0000 7f8573acf700 1 -- start start 2023-08-22T00:25:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f8573acf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f856c0660d0 0x7f856c0664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f8573acf700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0634b0 con 0x7f856c0a6a40 2023-08-22T00:25:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f8573acf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0bd680 con 0x7f856c152150 2023-08-22T00:25:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f8573acf700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0bde30 con 0x7f856c0660d0 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f857186b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f856c0660d0 0x7f856c0664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f857186b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f856c0660d0 0x7f856c0664b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48464/0 (socket says 172.21.15.98:48464) 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f857186b700 1 -- 172.21.15.98:0/441797950 learned_addr learned my addr 172.21.15.98:0/441797950 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.563+0000 7f857106a700 1 --1- 172.21.15.98:0/441797950 >> v1:172.21.15.98:6789/0 conn(0x7f856c0a6a40 0x7f856c151a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58446/0 (socket says 172.21.15.98:58446) 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f857186b700 1 -- 172.21.15.98:0/441797950 >> v1:172.21.15.118:6789/0 conn(0x7f856c152150 legacy=0x7f856c063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f857186b700 1 -- 172.21.15.98:0/441797950 >> v1:172.21.15.98:6789/0 conn(0x7f856c0a6a40 legacy=0x7f856c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f857186b700 1 -- 172.21.15.98:0/441797950 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0be110 con 0x7f856c0660d0 2023-08-22T00:25:54.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f857186b700 1 --2- 172.21.15.98:0/441797950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0664b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f8568006fd0 tx=0x7f85680090f0).ready entity=mon.0 client_cookie=ced4e892bc91d83 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8570869700 1 -- 172.21.15.98:0/441797950 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800f510 con 0x7f856c0660d0 2023-08-22T00:25:54.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8570869700 1 -- 172.21.15.98:0/441797950 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800f670 con 0x7f856c0660d0 2023-08-22T00:25:54.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8570869700 1 -- 172.21.15.98:0/441797950 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800fa10 con 0x7f856c0660d0 2023-08-22T00:25:54.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 -- 172.21.15.98:0/441797950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 msgr2=0x7f856c0664b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 --2- 172.21.15.98:0/441797950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0664b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f8568006fd0 tx=0x7f85680090f0).stop 2023-08-22T00:25:54.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 -- 172.21.15.98:0/441797950 shutdown_connections 2023-08-22T00:25:54.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 --2- 172.21.15.98:0/441797950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0664b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 -- 172.21.15.98:0/441797950 >> 172.21.15.98:0/441797950 conn(0x7f856c06a980 msgr2=0x7f856c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 -- 172.21.15.98:0/441797950 shutdown_connections 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.564+0000 7f8573acf700 1 -- 172.21.15.98:0/441797950 wait complete. 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.566+0000 7f8573acf700 1 Processor -- start 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.566+0000 7f8573acf700 1 -- start start 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856c0a6a40 0x7f856c162470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c152150 0x7f856c162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c09a0 con 0x7f856c0660d0 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c14e340 con 0x7f856c152150 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f8573acf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c14d4e0 con 0x7f856c0a6a40 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48480/0 (socket says 172.21.15.98:48480) 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 -- 172.21.15.98:0/1667264801 learned_addr learned my addr 172.21.15.98:0/1667264801 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 -- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856c0a6a40 msgr2=0x7f856c162470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856c0a6a40 0x7f856c162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 -- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c152150 msgr2=0x7f856c162960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857206c700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c152150 0x7f856c162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c152150 0x7f856c162960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 -- 172.21.15.98:0/1667264801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009370 con 0x7f856c0660d0 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.567+0000 7f857186b700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f8568009f50 tx=0x7f8568017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.568+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800f7e0 con 0x7f856c0660d0 2023-08-22T00:25:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.568+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800f940 con 0x7f856c0660d0 2023-08-22T00:25:54.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.568+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c14d730 con 0x7f856c0660d0 2023-08-22T00:25:54.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.568+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680246c0 con 0x7f856c0660d0 2023-08-22T00:25:54.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.568+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c14dcf0 con 0x7f856c0660d0 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.569+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c14e620 con 0x7f856c0660d0 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.569+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8568021070 con 0x7f856c0660d0 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.569+0000 7f8561ffb700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 0x7f85500612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.570+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f856807bbd0 con 0x7f856c0660d0 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.570+0000 7f857106a700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 0x7f85500612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.570+0000 7f857106a700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 0x7f85500612a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f855c007fd0 tx=0x7f855c007970).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.574+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f856804ce20 con 0x7f856c0660d0 2023-08-22T00:25:54.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.731+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f856c047480 con 0x7f855005ede0 2023-08-22T00:25:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.741+0000 7f8561ffb700 1 -- 172.21.15.98:0/1667264801 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353157 (secure 0 0 0) 0x7f856c047480 con 0x7f855005ede0 2023-08-22T00:25:54.749 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:54.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 msgr2=0x7f85500612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 0x7f85500612a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f855c007fd0 tx=0x7f855c007970).stop 2023-08-22T00:25:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 msgr2=0x7f856c0c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f8568009f50 tx=0x7f8568017000).stop 2023-08-22T00:25:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 shutdown_connections 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c152150 0x7f856c162960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f856c0660d0 0x7f856c0c0c40 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f855005ede0 0x7f85500612a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 --2- 172.21.15.98:0/1667264801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856c0a6a40 0x7f856c162470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 >> 172.21.15.98:0/1667264801 conn(0x7f856c06a980 msgr2=0x7f856c150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 shutdown_connections 2023-08-22T00:25:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.745+0000 7f8573acf700 1 -- 172.21.15.98:0/1667264801 wait complete. 2023-08-22T00:25:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:54.758 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-22T00:25:52.737070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437624,"kb_used_data":15800,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752537096,"statfs":{"total":773094113280,"available":770597986304,"internally_reserved":0,"allocated":16179200,"data_stored":8575420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10176,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.617926"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385403+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385513+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383223+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383847+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386232+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381249+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386256+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381200+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381645+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383205+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384212+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385642+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384356+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383114+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381278+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380947+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387266+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387935+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384675+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383983+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384629+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380937+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380794+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381334+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384444+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383694+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382359+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382093+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381007+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384715+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383819+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383495+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384978+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386607+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385140+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383180+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385331+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385835+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383610+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385012+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380342+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382845+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384951+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381618+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386156+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381314+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667396+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:47.667396+0000","last_peered":"2023-08-22T00:25:47.667396+0000","last_clean":"2023-08-22T00:25:47.667396+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:47.667396+0000","last_undegraded":"2023-08-22T00:25:47.667396+0000","last_fullsized":"2023-08-22T00:25:47.667396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382729+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806977+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:47.806977+0000","last_peered":"2023-08-22T00:25:47.806977+0000","last_clean":"2023-08-22T00:25:47.806977+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:47.806977+0000","last_undegraded":"2023-08-22T00:25:47.806977+0000","last_fullsized":"2023-08-22T00:25:47.806977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386244+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806714+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:47.806714+0000","last_peered":"2023-08-22T00:25:47.806714+0000","last_clean":"2023-08-22T00:25:47.806714+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:47.806714+0000","last_undegraded":"2023-08-22T00:25:47.806714+0000","last_fullsized":"2023-08-22T00:25:47.806714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806989+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:47.806989+0000","last_peered":"2023-08-22T00:25:47.806989+0000","last_clean":"2023-08-22T00:25:47.806989+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:47.806989+0000","last_undegraded":"2023-08-22T00:25:47.806989+0000","last_fullsized":"2023-08-22T00:25:47.806989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807086+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:47.807086+0000","last_peered":"2023-08-22T00:25:47.807086+0000","last_clean":"2023-08-22T00:25:47.807086+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:47.807086+0000","last_undegraded":"2023-08-22T00:25:47.807086+0000","last_fullsized":"2023-08-22T00:25:47.807086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384358+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807028+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:47.807028+0000","last_peered":"2023-08-22T00:25:47.807028+0000","last_clean":"2023-08-22T00:25:47.807028+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:47.807028+0000","last_undegraded":"2023-08-22T00:25:47.807028+0000","last_fullsized":"2023-08-22T00:25:47.807028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382022+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807051+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:47.807051+0000","last_peered":"2023-08-22T00:25:47.807051+0000","last_clean":"2023-08-22T00:25:47.807051+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:47.807051+0000","last_undegraded":"2023-08-22T00:25:47.807051+0000","last_fullsized":"2023-08-22T00:25:47.807051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382659+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667398+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:47.667398+0000","last_peered":"2023-08-22T00:25:47.667398+0000","last_clean":"2023-08-22T00:25:47.667398+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:47.667398+0000","last_undegraded":"2023-08-22T00:25:47.667398+0000","last_fullsized":"2023-08-22T00:25:47.667398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.373555+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:47.373555+0000","last_peered":"2023-08-22T00:25:47.373555+0000","last_clean":"2023-08-22T00:25:47.373555+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:47.373555+0000","last_undegraded":"2023-08-22T00:25:47.373555+0000","last_fullsized":"2023-08-22T00:25:47.373555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.54600000000000004},"min":{"1min":0.312,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.80000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.78100000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.75},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.308},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.871},"last":0.443},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85299999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.29199999999999998},"max":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.37},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.81200000000000006},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34499999999999997,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.443,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48299999999999998,"5min":1.2849999999999999,"15min":2.504},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35599999999999998,"15min":0.373},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.502,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.49199999999999999,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.45600000000000002},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.443},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.22},"max":{"1min":0.52600000000000002,"5min":1.302,"15min":1.3280000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.67800000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":1.381,"15min":2.9620000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.24,"15min":1.24},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71899999999999997,"5min":1.175,"15min":2.2730000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":1.266,"15min":2.298},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.80400000000000005,"5min":1.4199999999999999,"15min":2.992},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86699999999999999,"5min":1.2190000000000001,"15min":2.323},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.65700000000000003},"last":0.371}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.373,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.871,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.35799999999999998},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.42599999999999999,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.371,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.55400000000000005,"5min":1.216,"15min":1.216},"last":0.26600000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.38300000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42999999999999999,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.254}]},{"osd":3,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26500000000000001},"max":{"1min":0.46200000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.46200000000000002,"5min":0.753,"15min":0.753},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":1.0169999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68799999999999994,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.495}]},{"osd":6,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60599999999999998,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77400000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.182,"15min":0.182},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.34200000000000003,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.315},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.64900000000000002},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.92200000000000004},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.95699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51600000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.94399999999999995},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.56799999999999995},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.746},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.56999999999999995},"min":{"1min":0.35199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.68700000000000006,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.749,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50600000000000001,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.54300000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.61499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.88},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.80300000000000005},"last":0.63}]},{"osd":4,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:54.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:54.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.912+0000 7f54c8059700 1 Processor -- start 2023-08-22T00:25:54.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.912+0000 7f54c8059700 1 -- start start 2023-08-22T00:25:54.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c8059700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 0x7f54c00bc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c8059700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 0x7f54c0155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c8059700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c00c4ec0 con 0x7f54c0151dc0 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c8059700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c0063a80 con 0x7f54c00bc500 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c8059700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c0063d60 con 0x7f54c01519e0 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c65f6700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f54c0151dc0 0x7f54c00c5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58450/0 (socket says 172.21.15.98:58450) 2023-08-22T00:25:54.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.913+0000 7f54c65f6700 1 -- 172.21.15.98:0/49679466 learned_addr learned my addr 172.21.15.98:0/49679466 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c55f4700 1 --2- 172.21.15.98:0/49679466 >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 0x7f54c0155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 --2- 172.21.15.98:0/49679466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 0x7f54c00bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832489637 0 0) 0x7f54c00c4ec0 con 0x7f54c0151dc0 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54ac0033f0 con 0x7f54c0151dc0 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623831600 0 0) 0x7f54ac0033f0 con 0x7f54c0151dc0 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 -- 172.21.15.98:0/49679466 >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 msgr2=0x7f54c0155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 --2- 172.21.15.98:0/49679466 >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 0x7f54c0155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 -- 172.21.15.98:0/49679466 >> v1:172.21.15.98:6789/0 conn(0x7f54c0151dc0 legacy=0x7f54c00c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 -- 172.21.15.98:0/49679466 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00c4b50 con 0x7f54c01519e0 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c55f4700 1 --2- 172.21.15.98:0/49679466 >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 0x7f54c0155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c5df5700 1 --2- 172.21.15.98:0/49679466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 0x7f54c00bc010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f54b4009760 tx=0x7f54b4009060).ready entity=mon.2 client_cookie=2bb00270b220f621 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80017f0 con 0x7f54c01519e0 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40090d0 con 0x7f54c01519e0 2023-08-22T00:25:54.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.914+0000 7f54c4df3700 1 -- 172.21.15.98:0/49679466 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4011610 con 0x7f54c01519e0 2023-08-22T00:25:54.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 -- 172.21.15.98:0/49679466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 msgr2=0x7f54c00bc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 --2- 172.21.15.98:0/49679466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 0x7f54c00bc010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f54b4009760 tx=0x7f54b4009060).stop 2023-08-22T00:25:54.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 -- 172.21.15.98:0/49679466 shutdown_connections 2023-08-22T00:25:54.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 --2- 172.21.15.98:0/49679466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c01519e0 0x7f54c00bc010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 --2- 172.21.15.98:0/49679466 >> v2:172.21.15.118:3300/0 conn(0x7f54c00bc500 0x7f54c0155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 -- 172.21.15.98:0/49679466 >> 172.21.15.98:0/49679466 conn(0x7f54c00c7140 msgr2=0x7f54c00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:54.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 -- 172.21.15.98:0/49679466 shutdown_connections 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.915+0000 7f54c8059700 1 -- 172.21.15.98:0/49679466 wait complete. 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.916+0000 7f54c8059700 1 Processor -- start 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.916+0000 7f54c8059700 1 -- start start 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c01519e0 0x7f54c013df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c0151dc0 0x7f54c0065120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01546c0 con 0x7f54c00bc500 2023-08-22T00:25:54.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01549a0 con 0x7f54c01519e0 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c0154c80 con 0x7f54c0151dc0 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48490/0 (socket says 172.21.15.98:48490) 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 -- 172.21.15.98:0/2486360602 learned_addr learned my addr 172.21.15.98:0/2486360602 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c55f4700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c01519e0 0x7f54c013df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c65f6700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c0151dc0 0x7f54c0065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 -- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c0151dc0 msgr2=0x7f54c0065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c0151dc0 0x7f54c0065120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 -- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c01519e0 msgr2=0x7f54c013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:54.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c01519e0 0x7f54c013df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:54.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 -- 172.21.15.98:0/2486360602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0092a0 con 0x7f54c00bc500 2023-08-22T00:25:54.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c5df5700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f54c0063ea0 tx=0x7f54b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010870 con 0x7f54c00bc500 2023-08-22T00:25:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40109d0 con 0x7f54c00bc500 2023-08-22T00:25:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40092a0 con 0x7f54c00bc500 2023-08-22T00:25:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.917+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010d70 con 0x7f54c00bc500 2023-08-22T00:25:54.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.918+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c0155240 con 0x7f54c00bc500 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.919+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c00a6380 con 0x7f54c00bc500 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.919+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f54b401d640 con 0x7f54c00bc500 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.919+0000 7f54b1ffb700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 0x7f54a40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.920+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f54b407b550 con 0x7f54c00bc500 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.920+0000 7f54c55f4700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 0x7f54a40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:54.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.920+0000 7f54c55f4700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 0x7f54a40612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f54bc009270 tx=0x7f54bc008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:54.924+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54b404c860 con 0x7f54c00bc500 2023-08-22T00:25:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.080+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54c0047480 con 0x7f54a405ee10 2023-08-22T00:25:55.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.089+0000 7f54b1ffb700 1 -- 172.21.15.98:0/2486360602 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353157 (secure 0 0 0) 0x7f54c0047480 con 0x7f54a405ee10 2023-08-22T00:25:55.094 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 msgr2=0x7f54a40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 0x7f54a40612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f54bc009270 tx=0x7f54bc008040).stop 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 msgr2=0x7f54c0152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f54c0063ea0 tx=0x7f54b4016000).stop 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 shutdown_connections 2023-08-22T00:25:55.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f54a405ee10 0x7f54a40612d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c0151dc0 0x7f54c0065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54c00bc500 0x7f54c0152860 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 --2- 172.21.15.98:0/2486360602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c01519e0 0x7f54c013df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 >> 172.21.15.98:0/2486360602 conn(0x7f54c00c7140 msgr2=0x7f54c0069810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 shutdown_connections 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.092+0000 7f54c8059700 1 -- 172.21.15.98:0/2486360602 wait complete. 2023-08-22T00:25:55.097 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:55.105 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-22T00:25:54.742331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437624,"kb_used_data":15800,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752537096,"statfs":{"total":773094113280,"available":770597986304,"internally_reserved":0,"allocated":16179200,"data_stored":8575420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10176,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.617926"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385403+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385513+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383223+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383847+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386232+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381249+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386256+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381200+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381645+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383205+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384212+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385642+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384356+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383114+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381278+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380947+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387266+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387935+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384675+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383983+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384629+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380937+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380794+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381334+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384444+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383694+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382359+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382093+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381007+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384715+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383819+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383495+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384978+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386607+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385140+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383180+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385331+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385835+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383610+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385012+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380342+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382845+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384951+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381618+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386156+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381314+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667396+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:47.667396+0000","last_peered":"2023-08-22T00:25:47.667396+0000","last_clean":"2023-08-22T00:25:47.667396+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:47.667396+0000","last_undegraded":"2023-08-22T00:25:47.667396+0000","last_fullsized":"2023-08-22T00:25:47.667396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382729+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806977+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:47.806977+0000","last_peered":"2023-08-22T00:25:47.806977+0000","last_clean":"2023-08-22T00:25:47.806977+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:47.806977+0000","last_undegraded":"2023-08-22T00:25:47.806977+0000","last_fullsized":"2023-08-22T00:25:47.806977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386244+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806714+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:47.806714+0000","last_peered":"2023-08-22T00:25:47.806714+0000","last_clean":"2023-08-22T00:25:47.806714+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:47.806714+0000","last_undegraded":"2023-08-22T00:25:47.806714+0000","last_fullsized":"2023-08-22T00:25:47.806714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806989+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:47.806989+0000","last_peered":"2023-08-22T00:25:47.806989+0000","last_clean":"2023-08-22T00:25:47.806989+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:47.806989+0000","last_undegraded":"2023-08-22T00:25:47.806989+0000","last_fullsized":"2023-08-22T00:25:47.806989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807086+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:47.807086+0000","last_peered":"2023-08-22T00:25:47.807086+0000","last_clean":"2023-08-22T00:25:47.807086+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:47.807086+0000","last_undegraded":"2023-08-22T00:25:47.807086+0000","last_fullsized":"2023-08-22T00:25:47.807086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384358+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807028+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:47.807028+0000","last_peered":"2023-08-22T00:25:47.807028+0000","last_clean":"2023-08-22T00:25:47.807028+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:47.807028+0000","last_undegraded":"2023-08-22T00:25:47.807028+0000","last_fullsized":"2023-08-22T00:25:47.807028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382022+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807051+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:47.807051+0000","last_peered":"2023-08-22T00:25:47.807051+0000","last_clean":"2023-08-22T00:25:47.807051+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:47.807051+0000","last_undegraded":"2023-08-22T00:25:47.807051+0000","last_fullsized":"2023-08-22T00:25:47.807051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382659+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667398+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:47.667398+0000","last_peered":"2023-08-22T00:25:47.667398+0000","last_clean":"2023-08-22T00:25:47.667398+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:47.667398+0000","last_undegraded":"2023-08-22T00:25:47.667398+0000","last_fullsized":"2023-08-22T00:25:47.667398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.373555+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:47.373555+0000","last_peered":"2023-08-22T00:25:47.373555+0000","last_clean":"2023-08-22T00:25:47.373555+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:47.373555+0000","last_undegraded":"2023-08-22T00:25:47.373555+0000","last_fullsized":"2023-08-22T00:25:47.373555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.54600000000000004},"min":{"1min":0.312,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.80000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.78100000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.75},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.308},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.871},"last":0.443},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85299999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.29199999999999998},"max":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.37},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.81200000000000006},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34499999999999997,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.443,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48299999999999998,"5min":1.2849999999999999,"15min":2.504},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35599999999999998,"15min":0.373},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.502,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.49199999999999999,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.45600000000000002},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.443},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.22},"max":{"1min":0.52600000000000002,"5min":1.302,"15min":1.3280000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.67800000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":1.381,"15min":2.9620000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.24,"15min":1.24},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71899999999999997,"5min":1.175,"15min":2.2730000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":1.266,"15min":2.298},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.80400000000000005,"5min":1.4199999999999999,"15min":2.992},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86699999999999999,"5min":1.2190000000000001,"15min":2.323},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.65700000000000003},"last":0.371}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.373,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.871,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.35799999999999998},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.42599999999999999,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.371,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.55400000000000005,"5min":1.216,"15min":1.216},"last":0.26600000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.38300000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42999999999999999,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.254}]},{"osd":3,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26500000000000001},"max":{"1min":0.46200000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.46200000000000002,"5min":0.753,"15min":0.753},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":1.0169999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68799999999999994,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.495}]},{"osd":6,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60599999999999998,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77400000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.182,"15min":0.182},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.34200000000000003,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.315},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.64900000000000002},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.92200000000000004},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.95699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51600000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.94399999999999995},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.56799999999999995},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.746},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.56999999999999995},"min":{"1min":0.35199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.68700000000000006,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.749,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50600000000000001,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.54300000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.61499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.88},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.80300000000000005},"last":0.63}]},{"osd":4,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:55.114 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:55.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.260+0000 7fed43d97700 1 Processor -- start 2023-08-22T00:25:55.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.260+0000 7fed43d97700 1 -- start start 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.261+0000 7fed43d97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed3c15f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.261+0000 7fed43d97700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c158bf0 con 0x7fed3c0a6e50 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.261+0000 7fed43d97700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c157d90 con 0x7fed3c151d60 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.261+0000 7fed43d97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c157fe0 con 0x7fed3c0653d0 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed41332700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fed3c0a6e50 0x7fed3c065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58464/0 (socket says 172.21.15.98:58464) 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed41332700 1 -- 172.21.15.98:0/780837696 learned_addr learned my addr 172.21.15.98:0/780837696 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:55.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed3c15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770264458 0 0) 0x7fed3c158bf0 con 0x7fed3c0a6e50 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed280033f0 con 0x7fed3c0a6e50 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477543230 0 0) 0x7fed280033f0 con 0x7fed3c0a6e50 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 msgr2=0x7fed3c15f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed3c15f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 >> v1:172.21.15.118:6789/0 conn(0x7fed3c151d60 legacy=0x7fed3c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c1582c0 con 0x7fed3c0a6e50 2023-08-22T00:25:55.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fed38001470 con 0x7fed3c0a6e50 2023-08-22T00:25:55.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 >> v1:172.21.15.98:6789/0 conn(0x7fed3c0a6e50 legacy=0x7fed3c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed28003910 0x7fed28003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed28004b80 0x7fed28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c157fe0 con 0x7fed28004b80 2023-08-22T00:25:55.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2800b910 con 0x7fed28003910 2023-08-22T00:25:55.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2800bad0 con 0x7fed3c0653d0 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed28004b80 0x7fed28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed41332700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed41b33700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed28003910 0x7fed28003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 -- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 msgr2=0x7fed28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed3c0653d0 0x7fed28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 -- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed28003910 msgr2=0x7fed28003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:55.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed28003910 0x7fed28003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.262+0000 7fed42334700 1 -- 172.21.15.98:0/780837696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280033f0 con 0x7fed28004b80 2023-08-22T00:25:55.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed42334700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed28004b80 0x7fed28005000 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fed3c0c8800 tx=0x7fed3400b040).ready entity=mon.0 client_cookie=c37ccf8ee04d43b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34009ac0 con 0x7fed28004b80 2023-08-22T00:25:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3400f040 con 0x7fed28004b80 2023-08-22T00:25:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed40b31700 1 -- 172.21.15.98:0/780837696 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3400eca0 con 0x7fed28004b80 2023-08-22T00:25:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 -- 172.21.15.98:0/780837696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed28004b80 msgr2=0x7fed28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 --2- 172.21.15.98:0/780837696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed28004b80 0x7fed28005000 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fed3c0c8800 tx=0x7fed3400b040).stop 2023-08-22T00:25:55.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed42334700 1 -- 172.21.15.98:0/780837696 reap_dead start 2023-08-22T00:25:55.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 -- 172.21.15.98:0/780837696 shutdown_connections 2023-08-22T00:25:55.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 -- 172.21.15.98:0/780837696 >> 172.21.15.98:0/780837696 conn(0x7fed3c06a980 msgr2=0x7fed3c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:55.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 -- 172.21.15.98:0/780837696 shutdown_connections 2023-08-22T00:25:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.263+0000 7fed43d97700 1 -- 172.21.15.98:0/780837696 wait complete. 2023-08-22T00:25:55.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.264+0000 7fed43d97700 1 Processor -- start 2023-08-22T00:25:55.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 -- start start 2023-08-22T00:25:55.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed28004b80 0x7fed3c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 0x7fed3c0bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0bd0d0 con 0x7fed3c0a6160 2023-08-22T00:25:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0aaae0 con 0x7fed3c0a65e0 2023-08-22T00:25:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed43d97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0aadc0 con 0x7fed28004b80 2023-08-22T00:25:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed41332700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed41332700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48516/0 (socket says 172.21.15.98:48516) 2023-08-22T00:25:55.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.265+0000 7fed41332700 1 -- 172.21.15.98:0/97148337 learned_addr learned my addr 172.21.15.98:0/97148337 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:55.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41b33700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed28004b80 0x7fed3c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed42334700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 0x7fed3c0bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 -- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed28004b80 msgr2=0x7fed3c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed28004b80 0x7fed3c14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 -- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 msgr2=0x7fed3c0bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 0x7fed3c0bcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 -- 172.21.15.98:0/97148337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0ab0a0 con 0x7fed3c0a6160 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed42334700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 0x7fed3c0bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed41332700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fed38004760 tx=0x7fed38001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011590 con 0x7fed3c0a6160 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380116f0 con 0x7fed3c0a6160 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c0ab380 con 0x7fed3c0a6160 2023-08-22T00:25:55.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011a70 con 0x7fed3c0a6160 2023-08-22T00:25:55.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.266+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c0aa720 con 0x7fed3c0a6160 2023-08-22T00:25:55.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.267+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c0ab8a0 con 0x7fed3c0a6160 2023-08-22T00:25:55.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.267+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fed3801d3b0 con 0x7fed3c0a6160 2023-08-22T00:25:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.268+0000 7fed31ffb700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 0x7fed200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.268+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fed380799c0 con 0x7fed3c0a6160 2023-08-22T00:25:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.268+0000 7fed41b33700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 0x7fed200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.268+0000 7fed41b33700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 0x7fed200612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fed2c000f60 tx=0x7fed2c009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.272+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed3c0ab8a0 con 0x7fed3c0a6160 2023-08-22T00:25:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.428+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed3c0ab8a0 con 0x7fed2005ee10 2023-08-22T00:25:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.437+0000 7fed31ffb700 1 -- 172.21.15.98:0/97148337 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353157 (secure 0 0 0) 0x7fed3c0ab8a0 con 0x7fed2005ee10 2023-08-22T00:25:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:55.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.440+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 msgr2=0x7fed200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.440+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 0x7fed200612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fed2c000f60 tx=0x7fed2c009040).stop 2023-08-22T00:25:55.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 msgr2=0x7fed3c0bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fed38004760 tx=0x7fed38001e50).stop 2023-08-22T00:25:55.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 shutdown_connections 2023-08-22T00:25:55.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fed2005ee10 0x7fed200612d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed28004b80 0x7fed3c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c0a65e0 0x7fed3c0bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 --2- 172.21.15.98:0/97148337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3c0a6160 0x7fed3c0bc6f0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 >> 172.21.15.98:0/97148337 conn(0x7fed3c06a980 msgr2=0x7fed3c150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:55.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 shutdown_connections 2023-08-22T00:25:55.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.441+0000 7fed43d97700 1 -- 172.21.15.98:0/97148337 wait complete. 2023-08-22T00:25:55.450 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:55.454 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-22T00:25:54.742331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437624,"kb_used_data":15800,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752537096,"statfs":{"total":773094113280,"available":770597986304,"internally_reserved":0,"allocated":16179200,"data_stored":8575420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10176,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.617926"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385403+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385513+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383223+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383847+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386232+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381249+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386256+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381200+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381645+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383205+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384212+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385642+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384356+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383114+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381278+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380947+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387266+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387935+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384675+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383983+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384629+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380937+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380794+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381334+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384444+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383694+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382359+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382093+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381007+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384715+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383819+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383495+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384978+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386607+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385140+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383180+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385331+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385835+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383610+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385012+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380342+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382845+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384951+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381618+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386156+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381314+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667396+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:47.667396+0000","last_peered":"2023-08-22T00:25:47.667396+0000","last_clean":"2023-08-22T00:25:47.667396+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:47.667396+0000","last_undegraded":"2023-08-22T00:25:47.667396+0000","last_fullsized":"2023-08-22T00:25:47.667396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382729+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806977+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:47.806977+0000","last_peered":"2023-08-22T00:25:47.806977+0000","last_clean":"2023-08-22T00:25:47.806977+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:47.806977+0000","last_undegraded":"2023-08-22T00:25:47.806977+0000","last_fullsized":"2023-08-22T00:25:47.806977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386244+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806714+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:47.806714+0000","last_peered":"2023-08-22T00:25:47.806714+0000","last_clean":"2023-08-22T00:25:47.806714+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:47.806714+0000","last_undegraded":"2023-08-22T00:25:47.806714+0000","last_fullsized":"2023-08-22T00:25:47.806714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806989+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:47.806989+0000","last_peered":"2023-08-22T00:25:47.806989+0000","last_clean":"2023-08-22T00:25:47.806989+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:47.806989+0000","last_undegraded":"2023-08-22T00:25:47.806989+0000","last_fullsized":"2023-08-22T00:25:47.806989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807086+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:47.807086+0000","last_peered":"2023-08-22T00:25:47.807086+0000","last_clean":"2023-08-22T00:25:47.807086+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:47.807086+0000","last_undegraded":"2023-08-22T00:25:47.807086+0000","last_fullsized":"2023-08-22T00:25:47.807086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384358+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807028+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:47.807028+0000","last_peered":"2023-08-22T00:25:47.807028+0000","last_clean":"2023-08-22T00:25:47.807028+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:47.807028+0000","last_undegraded":"2023-08-22T00:25:47.807028+0000","last_fullsized":"2023-08-22T00:25:47.807028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382022+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807051+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:47.807051+0000","last_peered":"2023-08-22T00:25:47.807051+0000","last_clean":"2023-08-22T00:25:47.807051+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:47.807051+0000","last_undegraded":"2023-08-22T00:25:47.807051+0000","last_fullsized":"2023-08-22T00:25:47.807051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382659+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667398+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:47.667398+0000","last_peered":"2023-08-22T00:25:47.667398+0000","last_clean":"2023-08-22T00:25:47.667398+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:47.667398+0000","last_undegraded":"2023-08-22T00:25:47.667398+0000","last_fullsized":"2023-08-22T00:25:47.667398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.373555+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:47.373555+0000","last_peered":"2023-08-22T00:25:47.373555+0000","last_clean":"2023-08-22T00:25:47.373555+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:47.373555+0000","last_undegraded":"2023-08-22T00:25:47.373555+0000","last_fullsized":"2023-08-22T00:25:47.373555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.54600000000000004},"min":{"1min":0.312,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.80000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.78100000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.75},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.308},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.871},"last":0.443},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85299999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.29199999999999998},"max":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.37},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.81200000000000006},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34499999999999997,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.443,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48299999999999998,"5min":1.2849999999999999,"15min":2.504},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35599999999999998,"15min":0.373},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.502,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.49199999999999999,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.45600000000000002},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.443},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.22},"max":{"1min":0.52600000000000002,"5min":1.302,"15min":1.3280000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.67800000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":1.381,"15min":2.9620000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.24,"15min":1.24},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71899999999999997,"5min":1.175,"15min":2.2730000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":1.266,"15min":2.298},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.80400000000000005,"5min":1.4199999999999999,"15min":2.992},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86699999999999999,"5min":1.2190000000000001,"15min":2.323},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.65700000000000003},"last":0.371}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.373,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.871,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.35799999999999998},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.42599999999999999,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.371,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.55400000000000005,"5min":1.216,"15min":1.216},"last":0.26600000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.38300000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42999999999999999,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.254}]},{"osd":3,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26500000000000001},"max":{"1min":0.46200000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.46200000000000002,"5min":0.753,"15min":0.753},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":1.0169999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68799999999999994,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.495}]},{"osd":6,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60599999999999998,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77400000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.182,"15min":0.182},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.34200000000000003,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.315},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.64900000000000002},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.92200000000000004},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.95699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51600000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.94399999999999995},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.56799999999999995},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.746},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.56999999999999995},"min":{"1min":0.35199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.68700000000000006,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.749,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50600000000000001,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.54300000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.61499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.88},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.80300000000000005},"last":0.63}]},{"osd":4,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:55.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-08-22T00:25:55.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-08-22T00:25:55.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385403+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-08-22T00:25:55.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-08-22T00:25:55.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385513+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-08-22T00:25:55.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-08-22T00:25:55.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383223+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-08-22T00:25:55.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-08-22T00:25:55.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383847+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-08-22T00:25:55.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-08-22T00:25:55.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386232+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-08-22T00:25:55.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-08-22T00:25:55.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381249+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-08-22T00:25:55.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-08-22T00:25:55.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386256+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-08-22T00:25:55.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-08-22T00:25:55.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381200+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:25:55.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-08-22T00:25:55.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-08-22T00:25:55.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381645+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-08-22T00:25:55.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-08-22T00:25:55.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383205+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-08-22T00:25:55.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-08-22T00:25:55.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384212+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-08-22T00:25:55.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-08-22T00:25:55.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385642+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-08-22T00:25:55.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-08-22T00:25:55.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380377+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-08-22T00:25:55.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-08-22T00:25:55.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384356+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-08-22T00:25:55.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-08-22T00:25:55.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383114+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-08-22T00:25:55.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-08-22T00:25:55.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381278+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-08-22T00:25:55.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-08-22T00:25:55.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380947+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-08-22T00:25:55.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-08-22T00:25:55.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.387266+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-08-22T00:25:55.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-08-22T00:25:55.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385615+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-08-22T00:25:55.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-08-22T00:25:55.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.387935+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-08-22T00:25:55.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-08-22T00:25:55.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384675+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-08-22T00:25:55.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-08-22T00:25:55.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383983+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-08-22T00:25:55.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-08-22T00:25:55.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384629+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-08-22T00:25:55.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-08-22T00:25:55.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380937+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-08-22T00:25:55.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-08-22T00:25:55.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380794+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-08-22T00:25:55.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-08-22T00:25:55.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381334+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-08-22T00:25:55.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-08-22T00:25:55.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384444+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-08-22T00:25:55.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-08-22T00:25:55.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383694+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-08-22T00:25:55.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-08-22T00:25:55.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382359+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-08-22T00:25:55.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-08-22T00:25:55.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382093+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-08-22T00:25:55.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-08-22T00:25:55.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380615+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:25:55.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-08-22T00:25:55.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-08-22T00:25:55.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382772+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-08-22T00:25:55.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-08-22T00:25:55.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385377+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-08-22T00:25:55.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-08-22T00:25:55.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386942+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-08-22T00:25:55.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-08-22T00:25:55.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380656+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:25:55.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-08-22T00:25:55.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-08-22T00:25:55.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381007+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:25:55.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-08-22T00:25:55.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-08-22T00:25:55.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384715+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-08-22T00:25:55.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-08-22T00:25:55.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383819+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-08-22T00:25:55.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-08-22T00:25:55.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383495+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-08-22T00:25:55.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-08-22T00:25:55.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380615+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-22T00:25:55.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-08-22T00:25:55.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-08-22T00:25:55.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384978+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-22T00:25:55.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-08-22T00:25:55.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-08-22T00:25:55.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386607+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-08-22T00:25:55.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-08-22T00:25:55.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385140+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-08-22T00:25:55.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-08-22T00:25:55.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.387656+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-08-22T00:25:55.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-08-22T00:25:55.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383180+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-08-22T00:25:55.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-08-22T00:25:55.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385331+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-08-22T00:25:55.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-08-22T00:25:55.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385835+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-08-22T00:25:55.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-08-22T00:25:55.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.383610+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-08-22T00:25:55.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-08-22T00:25:55.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.385012+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-08-22T00:25:55.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-08-22T00:25:55.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380307+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-08-22T00:25:55.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-08-22T00:25:55.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380342+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-08-22T00:25:55.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-08-22T00:25:55.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380307+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-08-22T00:25:55.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-08-22T00:25:55.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382845+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-08-22T00:25:55.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-08-22T00:25:55.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384951+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-08-22T00:25:55.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-08-22T00:25:55.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381618+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-08-22T00:25:55.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-08-22T00:25:55.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386156+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-08-22T00:25:55.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-08-22T00:25:55.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.381314+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-08-22T00:25:55.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-08-22T00:25:55.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382729+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-22T00:25:55.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-08-22T00:25:55.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-08-22T00:25:55.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.386244+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-22T00:25:55.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-08-22T00:25:55.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-08-22T00:25:55.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382772+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-08-22T00:25:55.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-08-22T00:25:55.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.384358+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-22T00:25:55.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-08-22T00:25:55.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-08-22T00:25:55.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382022+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-22T00:25:55.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-08-22T00:25:55.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-08-22T00:25:55.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.382659+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-22T00:25:55.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-08-22T00:25:55.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:25:50.378083+0000', 'last_change': '2023-08-22T00:25:50.378083+0000', 'last_active': '2023-08-22T00:25:50.378083+0000', 'last_peered': '2023-08-22T00:25:50.378083+0000', 'last_clean': '2023-08-22T00:25:50.378083+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:50.378083+0000', 'last_undegraded': '2023-08-22T00:25:50.378083+0000', 'last_fullsized': '2023-08-22T00:25:50.378083+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:50.378083+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:25:55.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-08-22T00:25:55.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-22T00:25:49.373424+0000', 'last_change': '2023-08-22T00:25:49.380942+0000', 'last_active': '2023-08-22T00:25:49.373424+0000', 'last_peered': '2023-08-22T00:25:49.373424+0000', 'last_clean': '2023-08-22T00:25:49.373424+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:25:49.373424+0000', 'last_undegraded': '2023-08-22T00:25:49.373424+0000', 'last_fullsized': '2023-08-22T00:25:49.373424+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'last_clean_scrub_stamp': '2023-08-22T00:25:49.373424+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-22T00:25:55.561 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:25:55.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.676+0000 7f38b8a74700 1 Processor -- start 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.676+0000 7f38b8a74700 1 -- start start 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.677+0000 7f38b8a74700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 0x7f38b40c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.677+0000 7f38b8a74700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38b40bd870 0x7f38b40a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b8a74700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 0x7f38b4066380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b8a74700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b40bd3e0 con 0x7f38b40bd870 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b8a74700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b4066870 con 0x7f38b4065f10 2023-08-22T00:25:55.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b8a74700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40bd0c0 con 0x7f38b4150e40 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38b40bd870 0x7f38b40a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f38b40bd870 0x7f38b40a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48530/0 (socket says 172.21.15.98:48530) 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 -- 172.21.15.98:0/3419862443 learned_addr learned my addr 172.21.15.98:0/3419862443 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b2d9d700 1 --2- 172.21.15.98:0/3419862443 >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 0x7f38b4066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b259c700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 0x7f38b40c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 -- 172.21.15.98:0/3419862443 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 msgr2=0x7f38b40c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 0x7f38b40c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 -- 172.21.15.98:0/3419862443 >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 msgr2=0x7f38b4066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 --2- 172.21.15.98:0/3419862443 >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 0x7f38b4066380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 -- 172.21.15.98:0/3419862443 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40c3bb0 con 0x7f38b40bd870 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b2d9d700 1 --2- 172.21.15.98:0/3419862443 >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 0x7f38b4066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b259c700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 0x7f38b40c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b1d9b700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b40bd870 0x7f38b40a6950 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f38b40c84c0 tx=0x7f38a40090f0).ready entity=mon.0 client_cookie=66ebbc9061a3e370 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b159a700 1 -- 172.21.15.98:0/3419862443 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400b600 con 0x7f38b40bd870 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b159a700 1 -- 172.21.15.98:0/3419862443 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a400b760 con 0x7f38b40bd870 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.678+0000 7f38b159a700 1 -- 172.21.15.98:0/3419862443 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400bb00 con 0x7f38b40bd870 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 -- 172.21.15.98:0/3419862443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b40bd870 msgr2=0x7f38b40a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b40bd870 0x7f38b40a6950 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f38b40c84c0 tx=0x7f38a40090f0).stop 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 -- 172.21.15.98:0/3419862443 shutdown_connections 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b4150e40 0x7f38b40c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 --2- 172.21.15.98:0/3419862443 >> v2:172.21.15.118:3300/0 conn(0x7f38b4065f10 0x7f38b4066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 --2- 172.21.15.98:0/3419862443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b40bd870 0x7f38b40a6950 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 -- 172.21.15.98:0/3419862443 >> 172.21.15.98:0/3419862443 conn(0x7f38b406a980 msgr2=0x7f38b40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:55.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 -- 172.21.15.98:0/3419862443 shutdown_connections 2023-08-22T00:25:55.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.679+0000 7f38b8a74700 1 -- 172.21.15.98:0/3419862443 wait complete. 2023-08-22T00:25:55.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.680+0000 7f38b8a74700 1 Processor -- start 2023-08-22T00:25:55.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.680+0000 7f38b8a74700 1 -- start start 2023-08-22T00:25:55.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 0x7f38b41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b40bd870 0x7f38b40bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4153ed0 con 0x7f38b4150e40 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4162440 con 0x7f38b4065f10 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b8a74700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4162720 con 0x7f38b40bd870 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48544/0 (socket says 172.21.15.98:48544) 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 -- 172.21.15.98:0/1228524985 learned_addr learned my addr 172.21.15.98:0/1228524985 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b259c700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 0x7f38b41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 -- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b40bd870 msgr2=0x7f38b40bf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b1d9b700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b40bd870 0x7f38b40bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b40bd870 0x7f38b40bf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 -- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 msgr2=0x7f38b41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 0x7f38b41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 -- 172.21.15.98:0/1228524985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009370 con 0x7f38b4150e40 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b259c700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 0x7f38b41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38b2d9d700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f38ac00d180 tx=0x7f38ac009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.681+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00de20 con 0x7f38b4150e40 2023-08-22T00:25:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.682+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00f040 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.682+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b4162a00 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.682+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac013620 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.682+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b4161ff0 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.682+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b4047480 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.684+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f38ac013a10 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.684+0000 7f38a27fc700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 0x7f38940612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.684+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f38ac07b4e0 con 0x7f38b4150e40 2023-08-22T00:25:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.684+0000 7f38b259c700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 0x7f38940612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.684+0000 7f38b259c700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 0x7f38940612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f38a8006fd0 tx=0x7f38a8008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.688+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38ac04c750 con 0x7f38b4150e40 2023-08-22T00:25:55.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.913+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f38b40c3e90 con 0x7f38b4150e40 2023-08-22T00:25:55.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.913+0000 7f38a27fc700 1 -- 172.21.15.98:0/1228524985 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7f38ac04fd70 con 0x7f38b4150e40 2023-08-22T00:25:55.915 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:55.916 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1204,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2496126976,"bytes_avail":770597986304,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":62,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8826}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-22T00:23:49.836015+0000","services":{}},"progress_events":{}} 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 msgr2=0x7f38940612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 0x7f38940612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f38a8006fd0 tx=0x7f38a8008040).stop 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 msgr2=0x7f38b40bf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f38ac00d180 tx=0x7f38ac009a50).stop 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 shutdown_connections 2023-08-22T00:25:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b4150e40 0x7f38b40bf810 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b4065f10 0x7f38b41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f389405ee10 0x7f38940612d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 --2- 172.21.15.98:0/1228524985 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38b40bd870 0x7f38b40bf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 >> 172.21.15.98:0/1228524985 conn(0x7f38b406a980 msgr2=0x7f38b40c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 shutdown_connections 2023-08-22T00:25:55.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:55.915+0000 7f38b8a74700 1 -- 172.21.15.98:0/1228524985 wait complete. 2023-08-22T00:25:55.928 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:25:55.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:56.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.044+0000 7f183736a700 1 Processor -- start 2023-08-22T00:25:56.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.044+0000 7f183736a700 1 -- start start 2023-08-22T00:25:56.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f183736a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f183736a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f183736a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300bcb10 con 0x7f1830062e30 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f183736a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300bcdf0 con 0x7f183014c2d0 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f183736a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300bd0d0 con 0x7f18300bbe40 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1834905700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:56824/0 (socket says 172.21.15.98:56824) 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1834905700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:53028/0 (socket says 172.21.15.98:53028) 2023-08-22T00:25:56.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 -- 172.21.15.98:0/105210396 learned_addr learned my addr 172.21.15.98:0/105210396 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835106700 1 --1- 172.21.15.98:0/105210396 >> v1:172.21.15.118:6789/0 conn(0x7f1830062e30 0x7f183014bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:34560/0 (socket says 172.21.15.98:34560) 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 -- 172.21.15.98:0/105210396 >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 msgr2=0x7f1830063210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 --2- 172.21.15.98:0/105210396 >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 -- 172.21.15.98:0/105210396 >> v1:172.21.15.118:6789/0 conn(0x7f1830062e30 legacy=0x7f183014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 -- 172.21.15.98:0/105210396 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300bd3b0 con 0x7f18300bbe40 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1834905700 1 --2- 172.21.15.98:0/105210396 >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.045+0000 7f1835907700 1 --2- 172.21.15.98:0/105210396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1828009f20 tx=0x7f1828009840).ready entity=mon.2 client_cookie=7866a83855c34d94 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f1827fff700 1 -- 172.21.15.98:0/105210396 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800e070 con 0x7f18300bbe40 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f1827fff700 1 -- 172.21.15.98:0/105210396 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800ba60 con 0x7f18300bbe40 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f1827fff700 1 -- 172.21.15.98:0/105210396 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800bde0 con 0x7f18300bbe40 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 -- 172.21.15.98:0/105210396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 msgr2=0x7f18300bc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 --2- 172.21.15.98:0/105210396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1828009f20 tx=0x7f1828009840).stop 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 -- 172.21.15.98:0/105210396 shutdown_connections 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 --2- 172.21.15.98:0/105210396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f18300bc2b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 --2- 172.21.15.98:0/105210396 >> v2:172.21.15.118:3300/0 conn(0x7f183014c2d0 0x7f1830063210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 -- 172.21.15.98:0/105210396 >> 172.21.15.98:0/105210396 conn(0x7f18300c3980 msgr2=0x7f18300c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:56.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 -- 172.21.15.98:0/105210396 shutdown_connections 2023-08-22T00:25:56.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.046+0000 7f183736a700 1 -- 172.21.15.98:0/105210396 wait complete. 2023-08-22T00:25:56.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.047+0000 7f183736a700 1 Processor -- start 2023-08-22T00:25:56.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.047+0000 7f183736a700 1 -- start start 2023-08-22T00:25:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f183014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f183014c2d0 0x7f183014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301511e0 con 0x7f1830062e30 2023-08-22T00:25:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830152040 con 0x7f183014c2d0 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f183736a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830151430 con 0x7f18300bbe40 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f1835106700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.048+0000 7f1835106700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48556/0 (socket says 172.21.15.98:48556) 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 -- 172.21.15.98:0/1213798595 learned_addr learned my addr 172.21.15.98:0/1213798595 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1834905700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f183014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835907700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f183014c2d0 0x7f183014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 -- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 msgr2=0x7f183014a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f183014a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 -- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f183014c2d0 msgr2=0x7f183014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f183014c2d0 0x7f183014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 -- 172.21.15.98:0/1213798595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200092a0 con 0x7f1830062e30 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f1835106700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f182c00c4c0 tx=0x7f182c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00ce10 con 0x7f1830062e30 2023-08-22T00:25:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828009ae0 con 0x7f1830062e30 2023-08-22T00:25:56.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c0072e0 con 0x7f1830062e30 2023-08-22T00:25:56.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0056e0 con 0x7f1830062e30 2023-08-22T00:25:56.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.049+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18301519f0 con 0x7f1830062e30 2023-08-22T00:25:56.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.050+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830152320 con 0x7f1830062e30 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.050+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f182c005ad0 con 0x7f1830062e30 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.051+0000 7f18257fa700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 0x7f18140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.051+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f182c079560 con 0x7f1830062e30 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.051+0000 7f1834905700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 0x7f18140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.051+0000 7f1834905700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 0x7f18140612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1820009d20 tx=0x7f1820009060).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.055+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f182c04a870 con 0x7f1830062e30 2023-08-22T00:25:56.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.211+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1830047480 con 0x7f181405ee10 2023-08-22T00:25:56.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.221+0000 7f18257fa700 1 -- 172.21.15.98:0/1213798595 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353157 (secure 0 0 0) 0x7f1830047480 con 0x7f181405ee10 2023-08-22T00:25:56.226 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:56.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 msgr2=0x7f18140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 0x7f18140612d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1820009d20 tx=0x7f1820009060).stop 2023-08-22T00:25:56.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 msgr2=0x7f18301524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:56.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f182c00c4c0 tx=0x7f182c007db0).stop 2023-08-22T00:25:56.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 shutdown_connections 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f183014c2d0 0x7f183014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1830062e30 0x7f18301524d0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f181405ee10 0x7f18140612d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 --2- 172.21.15.98:0/1213798595 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18300bbe40 0x7f183014a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 >> 172.21.15.98:0/1213798595 conn(0x7f18300c3980 msgr2=0x7f1830066790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 shutdown_connections 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:56.224+0000 7f183736a700 1 -- 172.21.15.98:0/1213798595 wait complete. 2023-08-22T00:25:56.230 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:56.237 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-22T00:25:54.742331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437624,"kb_used_data":15800,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752537096,"statfs":{"total":773094113280,"available":770597986304,"internally_reserved":0,"allocated":16179200,"data_stored":8575420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10176,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.617926"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385403+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385513+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383223+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383847+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386232+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381249+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386256+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381200+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381645+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383205+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384212+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385642+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384356+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383114+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381278+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380947+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387266+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387935+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384675+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383983+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384629+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380937+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380794+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381334+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384444+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383694+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382359+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382093+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385377+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381007+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384715+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383819+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383495+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380615+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384978+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386607+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385140+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.387656+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383180+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385331+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385835+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.383610+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.385012+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380342+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380307+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382845+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384951+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381618+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386156+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.381314+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667396+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:47.667396+0000","last_peered":"2023-08-22T00:25:47.667396+0000","last_clean":"2023-08-22T00:25:47.667396+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:47.667396+0000","last_undegraded":"2023-08-22T00:25:47.667396+0000","last_fullsized":"2023-08-22T00:25:47.667396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382729+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806977+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:47.806977+0000","last_peered":"2023-08-22T00:25:47.806977+0000","last_clean":"2023-08-22T00:25:47.806977+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:47.806977+0000","last_undegraded":"2023-08-22T00:25:47.806977+0000","last_fullsized":"2023-08-22T00:25:47.806977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.386244+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806714+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:47.806714+0000","last_peered":"2023-08-22T00:25:47.806714+0000","last_clean":"2023-08-22T00:25:47.806714+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:47.806714+0000","last_undegraded":"2023-08-22T00:25:47.806714+0000","last_fullsized":"2023-08-22T00:25:47.806714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382772+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.806989+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:47.806989+0000","last_peered":"2023-08-22T00:25:47.806989+0000","last_clean":"2023-08-22T00:25:47.806989+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:47.806989+0000","last_undegraded":"2023-08-22T00:25:47.806989+0000","last_fullsized":"2023-08-22T00:25:47.806989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807086+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:47.807086+0000","last_peered":"2023-08-22T00:25:47.807086+0000","last_clean":"2023-08-22T00:25:47.807086+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:47.807086+0000","last_undegraded":"2023-08-22T00:25:47.807086+0000","last_fullsized":"2023-08-22T00:25:47.807086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.384358+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807028+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:47.807028+0000","last_peered":"2023-08-22T00:25:47.807028+0000","last_clean":"2023-08-22T00:25:47.807028+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:47.807028+0000","last_undegraded":"2023-08-22T00:25:47.807028+0000","last_fullsized":"2023-08-22T00:25:47.807028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382022+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.807051+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:47.807051+0000","last_peered":"2023-08-22T00:25:47.807051+0000","last_clean":"2023-08-22T00:25:47.807051+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:47.807051+0000","last_undegraded":"2023-08-22T00:25:47.807051+0000","last_fullsized":"2023-08-22T00:25:47.807051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.382659+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.667398+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:47.667398+0000","last_peered":"2023-08-22T00:25:47.667398+0000","last_clean":"2023-08-22T00:25:47.667398+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:47.667398+0000","last_undegraded":"2023-08-22T00:25:47.667398+0000","last_fullsized":"2023-08-22T00:25:47.667398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:25:50.378083+0000","last_change":"2023-08-22T00:25:50.378083+0000","last_active":"2023-08-22T00:25:50.378083+0000","last_peered":"2023-08-22T00:25:50.378083+0000","last_clean":"2023-08-22T00:25:50.378083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:50.378083+0000","last_undegraded":"2023-08-22T00:25:50.378083+0000","last_fullsized":"2023-08-22T00:25:50.378083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:25:49.373424+0000","last_change":"2023-08-22T00:25:49.380942+0000","last_active":"2023-08-22T00:25:49.373424+0000","last_peered":"2023-08-22T00:25:49.373424+0000","last_clean":"2023-08-22T00:25:49.373424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:25:49.373424+0000","last_undegraded":"2023-08-22T00:25:49.373424+0000","last_fullsized":"2023-08-22T00:25:49.373424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-22T00:25:47.373555+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:47.373555+0000","last_peered":"2023-08-22T00:25:47.373555+0000","last_clean":"2023-08-22T00:25:47.373555+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:47.373555+0000","last_undegraded":"2023-08-22T00:25:47.373555+0000","last_fullsized":"2023-08-22T00:25:47.373555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.54600000000000004},"min":{"1min":0.312,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.496}]},{"osd":1,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.80000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.78100000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.75},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.308},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.871},"last":0.443},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85299999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.29199999999999998},"max":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.37},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.81200000000000006},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34499999999999997,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.443,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48299999999999998,"5min":1.2849999999999999,"15min":2.504},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35599999999999998,"15min":0.373},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.502,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.49199999999999999,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.45600000000000002},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.443},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.22},"max":{"1min":0.52600000000000002,"5min":1.302,"15min":1.3280000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.67800000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":1.381,"15min":2.9620000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.24,"15min":1.24},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71899999999999997,"5min":1.175,"15min":2.2730000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":1.266,"15min":2.298},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.80400000000000005,"5min":1.4199999999999999,"15min":2.992},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86699999999999999,"5min":1.2190000000000001,"15min":2.323},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":2031616,"data_stored":1076858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.65700000000000003},"last":0.371}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.77900000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.373,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.871,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.35799999999999998},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.42599999999999999,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.318},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.371,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.55400000000000005,"5min":1.216,"15min":1.216},"last":0.26600000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.38300000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42999999999999999,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.254}]},{"osd":3,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26500000000000001},"max":{"1min":0.46200000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.46200000000000002,"5min":0.753,"15min":0.753},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":1.0169999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68799999999999994,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.495}]},{"osd":6,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60599999999999998,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77400000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.182,"15min":0.182},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.34200000000000003,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.315},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.64900000000000002},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.92200000000000004},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.95699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51600000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.94399999999999995},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.56799999999999995},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.746},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1972,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":2019328,"data_stored":1070284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.56999999999999995},"min":{"1min":0.35199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.68700000000000006,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.749,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50600000000000001,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.54300000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.61499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.88},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.80300000000000005},"last":0.63}]},{"osd":4,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:59.247 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:25:59.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.376+0000 7f73fe71b700 1 Processor -- start 2023-08-22T00:25:59.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.376+0000 7f73fe71b700 1 -- start start 2023-08-22T00:25:59.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.376+0000 7f73fe71b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73f80a9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.376+0000 7f73fe71b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73f80aad10 0x7f73f80bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.376+0000 7f73fe71b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80a8440 con 0x7f73f8157ae0 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73fe71b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80a8ce0 con 0x7f73f80aad10 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73fe71b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80c45b0 con 0x7f73f80c3f90 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f73f8157ae0 0x7f73f8157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58468/0 (socket says 172.21.15.98:58468) 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f7fff700 1 -- 172.21.15.98:0/4292199016 learned_addr learned my addr 172.21.15.98:0/4292199016 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f77fe700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73f80a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73fccb8700 1 --2- 172.21.15.98:0/4292199016 >> v2:172.21.15.118:3300/0 conn(0x7f73f80aad10 0x7f73f80bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299381405 0 0) 0x7f73f80a8440 con 0x7f73f8157ae0 2023-08-22T00:25:59.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e40033f0 con 0x7f73f8157ae0 2023-08-22T00:25:59.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836676438 0 0) 0x7f73e40033f0 con 0x7f73f8157ae0 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 msgr2=0x7f73f80a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73f80a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 >> v2:172.21.15.118:3300/0 conn(0x7f73f80aad10 msgr2=0x7f73f80bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 --2- 172.21.15.98:0/4292199016 >> v2:172.21.15.118:3300/0 conn(0x7f73f80aad10 0x7f73f80bd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80a8690 con 0x7f73f8157ae0 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f73e8001470 con 0x7f73f8157ae0 2023-08-22T00:25:59.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 >> v1:172.21.15.98:6789/0 conn(0x7f73f8157ae0 legacy=0x7f73f8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80a8ce0 con 0x7f73e4004690 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80c45b0 con 0x7f73e40038e0 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400b8e0 con 0x7f73f80c3f90 2023-08-22T00:25:59.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f77fe700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.377+0000 7f73f7fff700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fccb8700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 -- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 msgr2=0x7f73e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c3f90 0x7f73e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 -- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73e40038e0 msgr2=0x7f73e4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:59.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 -- 172.21.15.98:0/4292199016 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40033f0 con 0x7f73e4004690 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f77fe700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73e4004b10 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f73e0009a80 tx=0x7f73e0009060).ready entity=mon.0 client_cookie=38788f748442d266 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0009430 con 0x7f73e4004690 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000e640 con 0x7f73e4004690 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73f6ffd700 1 -- 172.21.15.98:0/4292199016 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000e9c0 con 0x7f73e4004690 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 -- 172.21.15.98:0/4292199016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 msgr2=0x7f73e4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 --2- 172.21.15.98:0/4292199016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73e4004b10 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f73e0009a80 tx=0x7f73e0009060).stop 2023-08-22T00:25:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fccb8700 1 -- 172.21.15.98:0/4292199016 reap_dead start 2023-08-22T00:25:59.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 -- 172.21.15.98:0/4292199016 shutdown_connections 2023-08-22T00:25:59.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 -- 172.21.15.98:0/4292199016 >> 172.21.15.98:0/4292199016 conn(0x7f73f80c5330 msgr2=0x7f73f80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:59.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 -- 172.21.15.98:0/4292199016 shutdown_connections 2023-08-22T00:25:59.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.378+0000 7f73fe71b700 1 -- 172.21.15.98:0/4292199016 wait complete. 2023-08-22T00:25:59.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.380+0000 7f73fe71b700 1 Processor -- start 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.380+0000 7f73fe71b700 1 -- start start 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f80c1a70 0x7f73f8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c1ef0 0x7f73f81540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81545c0 con 0x7f73e4004690 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8168510 con 0x7f73f80c1a70 2023-08-22T00:25:59.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fe71b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8167900 con 0x7f73f80c1ef0 2023-08-22T00:25:59.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48566/0 (socket says 172.21.15.98:48566) 2023-08-22T00:25:59.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73f7fff700 1 -- 172.21.15.98:0/162789460 learned_addr learned my addr 172.21.15.98:0/162789460 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73f77fe700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f80c1a70 0x7f73f8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.381+0000 7f73fccb8700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c1ef0 0x7f73f81540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 -- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c1ef0 msgr2=0x7f73f81540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c1ef0 0x7f73f81540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 -- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f80c1a70 msgr2=0x7f73f8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f80c1a70 0x7f73f8153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 -- 172.21.15.98:0/162789460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8167be0 con 0x7f73e4004690 2023-08-22T00:25:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73f7fff700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f73e8007fd0 tx=0x7f73e8001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8011590 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80116f0 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8167ec0 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8011a70 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.382+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8146ad0 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.383+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8047480 con 0x7f73e4004690 2023-08-22T00:25:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.383+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f73e801d3b0 con 0x7f73e4004690 2023-08-22T00:25:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.384+0000 7f73effff700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 0x7f73d80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.384+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f73e8079700 con 0x7f73e4004690 2023-08-22T00:25:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.384+0000 7f73f77fe700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 0x7f73d80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.384+0000 7f73f77fe700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 0x7f73d80612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f73e0006d50 tx=0x7f73e001a000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.388+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73e804aa60 con 0x7f73e4004690 2023-08-22T00:25:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.544+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73f8168650 con 0x7f73d805ee10 2023-08-22T00:25:59.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.554+0000 7f73effff700 1 -- 172.21.15.98:0/162789460 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361992 (secure 0 0 0) 0x7f73e0000bc0 con 0x7f73d805ee10 2023-08-22T00:25:59.559 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:25:59.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 msgr2=0x7f73d80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 0x7f73d80612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f73e0006d50 tx=0x7f73e001a000).stop 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 msgr2=0x7f73f81465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f73e8007fd0 tx=0x7f73e8001e90).stop 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 shutdown_connections 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f73d805ee10 0x7f73d80612d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73f80c1ef0 0x7f73f81540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.562 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e4004690 0x7f73f81465e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 --2- 172.21.15.98:0/162789460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f80c1a70 0x7f73f8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.557+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 >> 172.21.15.98:0/162789460 conn(0x7f73f80c5330 msgr2=0x7f73f80c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.558+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 shutdown_connections 2023-08-22T00:25:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.558+0000 7f73fe71b700 1 -- 172.21.15.98:0/162789460 wait complete. 2023-08-22T00:25:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:25:59.571 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:25:58.743404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438048,"kb_used_data":16224,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752536672,"statfs":{"total":773094113280,"available":770597552128,"internally_reserved":0,"allocated":16613376,"data_stored":8792444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10176,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.618647"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.795145+0000","last_change":"2023-08-22T00:25:50.793328+0000","last_active":"2023-08-22T00:25:50.795145+0000","last_peered":"2023-08-22T00:25:50.795145+0000","last_clean":"2023-08-22T00:25:50.795145+0000","last_became_active":"2023-08-22T00:25:50.792831+0000","last_became_peered":"2023-08-22T00:25:50.792831+0000","last_unstale":"2023-08-22T00:25:50.795145+0000","last_undegraded":"2023-08-22T00:25:50.795145+0000","last_fullsized":"2023-08-22T00:25:50.795145+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3f","version":"165'3","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796676+0000","last_change":"2023-08-22T00:25:50.408163+0000","last_active":"2023-08-22T00:25:50.796676+0000","last_peered":"2023-08-22T00:25:50.796676+0000","last_clean":"2023-08-22T00:25:50.796676+0000","last_became_active":"2023-08-22T00:25:50.407910+0000","last_became_peered":"2023-08-22T00:25:50.407910+0000","last_unstale":"2023-08-22T00:25:50.796676+0000","last_undegraded":"2023-08-22T00:25:50.796676+0000","last_fullsized":"2023-08-22T00:25:50.796676+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.788989+0000","last_change":"2023-08-22T00:25:50.784907+0000","last_active":"2023-08-22T00:25:50.788989+0000","last_peered":"2023-08-22T00:25:50.788989+0000","last_clean":"2023-08-22T00:25:50.788989+0000","last_became_active":"2023-08-22T00:25:50.784648+0000","last_became_peered":"2023-08-22T00:25:50.784648+0000","last_unstale":"2023-08-22T00:25:50.788989+0000","last_undegraded":"2023-08-22T00:25:50.788989+0000","last_fullsized":"2023-08-22T00:25:50.788989+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.777577+0000","last_change":"2023-08-22T00:25:50.402512+0000","last_active":"2023-08-22T00:25:50.777577+0000","last_peered":"2023-08-22T00:25:50.777577+0000","last_clean":"2023-08-22T00:25:50.777577+0000","last_became_active":"2023-08-22T00:25:50.402219+0000","last_became_peered":"2023-08-22T00:25:50.402219+0000","last_unstale":"2023-08-22T00:25:50.777577+0000","last_undegraded":"2023-08-22T00:25:50.777577+0000","last_fullsized":"2023-08-22T00:25:50.777577+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.799839+0000","last_change":"2023-08-22T00:25:50.798329+0000","last_active":"2023-08-22T00:25:50.799839+0000","last_peered":"2023-08-22T00:25:50.799839+0000","last_clean":"2023-08-22T00:25:50.799839+0000","last_became_active":"2023-08-22T00:25:50.797962+0000","last_became_peered":"2023-08-22T00:25:50.797962+0000","last_unstale":"2023-08-22T00:25:50.799839+0000","last_undegraded":"2023-08-22T00:25:50.799839+0000","last_fullsized":"2023-08-22T00:25:50.799839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774103+0000","last_change":"2023-08-22T00:25:50.411891+0000","last_active":"2023-08-22T00:25:50.774103+0000","last_peered":"2023-08-22T00:25:50.774103+0000","last_clean":"2023-08-22T00:25:50.774103+0000","last_became_active":"2023-08-22T00:25:50.411593+0000","last_became_peered":"2023-08-22T00:25:50.411593+0000","last_unstale":"2023-08-22T00:25:50.774103+0000","last_undegraded":"2023-08-22T00:25:50.774103+0000","last_fullsized":"2023-08-22T00:25:50.774103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.786158+0000","last_change":"2023-08-22T00:25:50.779439+0000","last_active":"2023-08-22T00:25:50.786158+0000","last_peered":"2023-08-22T00:25:50.786158+0000","last_clean":"2023-08-22T00:25:50.786158+0000","last_became_active":"2023-08-22T00:25:50.778807+0000","last_became_peered":"2023-08-22T00:25:50.778807+0000","last_unstale":"2023-08-22T00:25:50.786158+0000","last_undegraded":"2023-08-22T00:25:50.786158+0000","last_fullsized":"2023-08-22T00:25:50.786158+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.787506+0000","last_change":"2023-08-22T00:25:50.409332+0000","last_active":"2023-08-22T00:25:50.787506+0000","last_peered":"2023-08-22T00:25:50.787506+0000","last_clean":"2023-08-22T00:25:50.787506+0000","last_became_active":"2023-08-22T00:25:50.409051+0000","last_became_peered":"2023-08-22T00:25:50.409051+0000","last_unstale":"2023-08-22T00:25:50.787506+0000","last_undegraded":"2023-08-22T00:25:50.787506+0000","last_fullsized":"2023-08-22T00:25:50.787506+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.789091+0000","last_change":"2023-08-22T00:25:50.785915+0000","last_active":"2023-08-22T00:25:50.789091+0000","last_peered":"2023-08-22T00:25:50.789091+0000","last_clean":"2023-08-22T00:25:50.789091+0000","last_became_active":"2023-08-22T00:25:50.785666+0000","last_became_peered":"2023-08-22T00:25:50.785666+0000","last_unstale":"2023-08-22T00:25:50.789091+0000","last_undegraded":"2023-08-22T00:25:50.789091+0000","last_fullsized":"2023-08-22T00:25:50.789091+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.785713+0000","last_change":"2023-08-22T00:25:50.411111+0000","last_active":"2023-08-22T00:25:50.785713+0000","last_peered":"2023-08-22T00:25:50.785713+0000","last_clean":"2023-08-22T00:25:50.785713+0000","last_became_active":"2023-08-22T00:25:50.410852+0000","last_became_peered":"2023-08-22T00:25:50.410852+0000","last_unstale":"2023-08-22T00:25:50.785713+0000","last_undegraded":"2023-08-22T00:25:50.785713+0000","last_fullsized":"2023-08-22T00:25:50.785713+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.792658+0000","last_change":"2023-08-22T00:25:50.784678+0000","last_active":"2023-08-22T00:25:50.792658+0000","last_peered":"2023-08-22T00:25:50.792658+0000","last_clean":"2023-08-22T00:25:50.792658+0000","last_became_active":"2023-08-22T00:25:50.784400+0000","last_became_peered":"2023-08-22T00:25:50.784400+0000","last_unstale":"2023-08-22T00:25:50.792658+0000","last_undegraded":"2023-08-22T00:25:50.792658+0000","last_fullsized":"2023-08-22T00:25:50.792658+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3a","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791046+0000","last_change":"2023-08-22T00:25:50.411048+0000","last_active":"2023-08-22T00:25:50.791046+0000","last_peered":"2023-08-22T00:25:50.791046+0000","last_clean":"2023-08-22T00:25:50.791046+0000","last_became_active":"2023-08-22T00:25:50.410722+0000","last_became_peered":"2023-08-22T00:25:50.410722+0000","last_unstale":"2023-08-22T00:25:50.791046+0000","last_undegraded":"2023-08-22T00:25:50.791046+0000","last_fullsized":"2023-08-22T00:25:50.791046+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.789014+0000","last_change":"2023-08-22T00:25:50.784269+0000","last_active":"2023-08-22T00:25:50.789014+0000","last_peered":"2023-08-22T00:25:50.789014+0000","last_clean":"2023-08-22T00:25:50.789014+0000","last_became_active":"2023-08-22T00:25:50.784001+0000","last_became_peered":"2023-08-22T00:25:50.784001+0000","last_unstale":"2023-08-22T00:25:50.789014+0000","last_undegraded":"2023-08-22T00:25:50.789014+0000","last_fullsized":"2023-08-22T00:25:50.789014+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782460+0000","last_change":"2023-08-22T00:25:50.409924+0000","last_active":"2023-08-22T00:25:50.782460+0000","last_peered":"2023-08-22T00:25:50.782460+0000","last_clean":"2023-08-22T00:25:50.782460+0000","last_became_active":"2023-08-22T00:25:50.409583+0000","last_became_peered":"2023-08-22T00:25:50.409583+0000","last_unstale":"2023-08-22T00:25:50.782460+0000","last_undegraded":"2023-08-22T00:25:50.782460+0000","last_fullsized":"2023-08-22T00:25:50.782460+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.797700+0000","last_change":"2023-08-22T00:25:50.792312+0000","last_active":"2023-08-22T00:25:50.797700+0000","last_peered":"2023-08-22T00:25:50.797700+0000","last_clean":"2023-08-22T00:25:50.797700+0000","last_became_active":"2023-08-22T00:25:50.792052+0000","last_became_peered":"2023-08-22T00:25:50.792052+0000","last_unstale":"2023-08-22T00:25:50.797700+0000","last_undegraded":"2023-08-22T00:25:50.797700+0000","last_fullsized":"2023-08-22T00:25:50.797700+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.786408+0000","last_change":"2023-08-22T00:25:50.407957+0000","last_active":"2023-08-22T00:25:50.786408+0000","last_peered":"2023-08-22T00:25:50.786408+0000","last_clean":"2023-08-22T00:25:50.786408+0000","last_became_active":"2023-08-22T00:25:50.407650+0000","last_became_peered":"2023-08-22T00:25:50.407650+0000","last_unstale":"2023-08-22T00:25:50.786408+0000","last_undegraded":"2023-08-22T00:25:50.786408+0000","last_fullsized":"2023-08-22T00:25:50.786408+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804152+0000","last_change":"2023-08-22T00:25:50.801536+0000","last_active":"2023-08-22T00:25:50.804152+0000","last_peered":"2023-08-22T00:25:50.804152+0000","last_clean":"2023-08-22T00:25:50.804152+0000","last_became_active":"2023-08-22T00:25:50.800741+0000","last_became_peered":"2023-08-22T00:25:50.800741+0000","last_unstale":"2023-08-22T00:25:50.804152+0000","last_undegraded":"2023-08-22T00:25:50.804152+0000","last_fullsized":"2023-08-22T00:25:50.804152+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.775276+0000","last_change":"2023-08-22T00:25:50.411377+0000","last_active":"2023-08-22T00:25:50.775276+0000","last_peered":"2023-08-22T00:25:50.775276+0000","last_clean":"2023-08-22T00:25:50.775276+0000","last_became_active":"2023-08-22T00:25:50.411071+0000","last_became_peered":"2023-08-22T00:25:50.411071+0000","last_unstale":"2023-08-22T00:25:50.775276+0000","last_undegraded":"2023-08-22T00:25:50.775276+0000","last_fullsized":"2023-08-22T00:25:50.775276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.793201+0000","last_change":"2023-08-22T00:25:50.782098+0000","last_active":"2023-08-22T00:25:50.793201+0000","last_peered":"2023-08-22T00:25:50.793201+0000","last_clean":"2023-08-22T00:25:50.793201+0000","last_became_active":"2023-08-22T00:25:50.781832+0000","last_became_peered":"2023-08-22T00:25:50.781832+0000","last_unstale":"2023-08-22T00:25:50.793201+0000","last_undegraded":"2023-08-22T00:25:50.793201+0000","last_fullsized":"2023-08-22T00:25:50.793201+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.779586+0000","last_change":"2023-08-22T00:25:50.397042+0000","last_active":"2023-08-22T00:25:50.779586+0000","last_peered":"2023-08-22T00:25:50.779586+0000","last_clean":"2023-08-22T00:25:50.779586+0000","last_became_active":"2023-08-22T00:25:50.396761+0000","last_became_peered":"2023-08-22T00:25:50.396761+0000","last_unstale":"2023-08-22T00:25:50.779586+0000","last_undegraded":"2023-08-22T00:25:50.779586+0000","last_fullsized":"2023-08-22T00:25:50.779586+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.802441+0000","last_change":"2023-08-22T00:25:50.793975+0000","last_active":"2023-08-22T00:25:50.802441+0000","last_peered":"2023-08-22T00:25:50.802441+0000","last_clean":"2023-08-22T00:25:50.802441+0000","last_became_active":"2023-08-22T00:25:50.793581+0000","last_became_peered":"2023-08-22T00:25:50.793581+0000","last_unstale":"2023-08-22T00:25:50.802441+0000","last_undegraded":"2023-08-22T00:25:50.802441+0000","last_fullsized":"2023-08-22T00:25:50.802441+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778878+0000","last_change":"2023-08-22T00:25:50.410214+0000","last_active":"2023-08-22T00:25:50.778878+0000","last_peered":"2023-08-22T00:25:50.778878+0000","last_clean":"2023-08-22T00:25:50.778878+0000","last_became_active":"2023-08-22T00:25:50.409952+0000","last_became_peered":"2023-08-22T00:25:50.409952+0000","last_unstale":"2023-08-22T00:25:50.778878+0000","last_undegraded":"2023-08-22T00:25:50.778878+0000","last_fullsized":"2023-08-22T00:25:50.778878+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.786853+0000","last_change":"2023-08-22T00:25:50.781911+0000","last_active":"2023-08-22T00:25:50.786853+0000","last_peered":"2023-08-22T00:25:50.786853+0000","last_clean":"2023-08-22T00:25:50.786853+0000","last_became_active":"2023-08-22T00:25:50.781641+0000","last_became_peered":"2023-08-22T00:25:50.781641+0000","last_unstale":"2023-08-22T00:25:50.786853+0000","last_undegraded":"2023-08-22T00:25:50.786853+0000","last_fullsized":"2023-08-22T00:25:50.786853+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.34","version":"165'4","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.800762+0000","last_change":"2023-08-22T00:25:50.418483+0000","last_active":"2023-08-22T00:25:50.800762+0000","last_peered":"2023-08-22T00:25:50.800762+0000","last_clean":"2023-08-22T00:25:50.800762+0000","last_became_active":"2023-08-22T00:25:50.418229+0000","last_became_peered":"2023-08-22T00:25:50.418229+0000","last_unstale":"2023-08-22T00:25:50.800762+0000","last_undegraded":"2023-08-22T00:25:50.800762+0000","last_fullsized":"2023-08-22T00:25:50.800762+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804970+0000","last_change":"2023-08-22T00:25:50.804473+0000","last_active":"2023-08-22T00:25:50.804970+0000","last_peered":"2023-08-22T00:25:50.804970+0000","last_clean":"2023-08-22T00:25:50.804970+0000","last_became_active":"2023-08-22T00:25:50.804176+0000","last_became_peered":"2023-08-22T00:25:50.804176+0000","last_unstale":"2023-08-22T00:25:50.804970+0000","last_undegraded":"2023-08-22T00:25:50.804970+0000","last_fullsized":"2023-08-22T00:25:50.804970+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.33","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791343+0000","last_change":"2023-08-22T00:25:50.410819+0000","last_active":"2023-08-22T00:25:50.791343+0000","last_peered":"2023-08-22T00:25:50.791343+0000","last_clean":"2023-08-22T00:25:50.791343+0000","last_became_active":"2023-08-22T00:25:50.410534+0000","last_became_peered":"2023-08-22T00:25:50.410534+0000","last_unstale":"2023-08-22T00:25:50.791343+0000","last_undegraded":"2023-08-22T00:25:50.791343+0000","last_fullsized":"2023-08-22T00:25:50.791343+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.792676+0000","last_change":"2023-08-22T00:25:50.784758+0000","last_active":"2023-08-22T00:25:50.792676+0000","last_peered":"2023-08-22T00:25:50.792676+0000","last_clean":"2023-08-22T00:25:50.792676+0000","last_became_active":"2023-08-22T00:25:50.784462+0000","last_became_peered":"2023-08-22T00:25:50.784462+0000","last_unstale":"2023-08-22T00:25:50.792676+0000","last_undegraded":"2023-08-22T00:25:50.792676+0000","last_fullsized":"2023-08-22T00:25:50.792676+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778862+0000","last_change":"2023-08-22T00:25:50.409306+0000","last_active":"2023-08-22T00:25:50.778862+0000","last_peered":"2023-08-22T00:25:50.778862+0000","last_clean":"2023-08-22T00:25:50.778862+0000","last_became_active":"2023-08-22T00:25:50.408675+0000","last_became_peered":"2023-08-22T00:25:50.408675+0000","last_unstale":"2023-08-22T00:25:50.778862+0000","last_undegraded":"2023-08-22T00:25:50.778862+0000","last_fullsized":"2023-08-22T00:25:50.778862+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.790218+0000","last_change":"2023-08-22T00:25:50.788896+0000","last_active":"2023-08-22T00:25:50.790218+0000","last_peered":"2023-08-22T00:25:50.790218+0000","last_clean":"2023-08-22T00:25:50.790218+0000","last_became_active":"2023-08-22T00:25:50.788623+0000","last_became_peered":"2023-08-22T00:25:50.788623+0000","last_unstale":"2023-08-22T00:25:50.790218+0000","last_undegraded":"2023-08-22T00:25:50.790218+0000","last_fullsized":"2023-08-22T00:25:50.790218+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781403+0000","last_change":"2023-08-22T00:25:50.416443+0000","last_active":"2023-08-22T00:25:50.781403+0000","last_peered":"2023-08-22T00:25:50.781403+0000","last_clean":"2023-08-22T00:25:50.781403+0000","last_became_active":"2023-08-22T00:25:50.409717+0000","last_became_peered":"2023-08-22T00:25:50.409717+0000","last_unstale":"2023-08-22T00:25:50.781403+0000","last_undegraded":"2023-08-22T00:25:50.781403+0000","last_fullsized":"2023-08-22T00:25:50.781403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.802936+0000","last_change":"2023-08-22T00:25:50.796264+0000","last_active":"2023-08-22T00:25:50.802936+0000","last_peered":"2023-08-22T00:25:50.802936+0000","last_clean":"2023-08-22T00:25:50.802936+0000","last_became_active":"2023-08-22T00:25:50.796009+0000","last_became_peered":"2023-08-22T00:25:50.796009+0000","last_unstale":"2023-08-22T00:25:50.802936+0000","last_undegraded":"2023-08-22T00:25:50.802936+0000","last_fullsized":"2023-08-22T00:25:50.802936+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.30","version":"165'4","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.788140+0000","last_change":"2023-08-22T00:25:50.413688+0000","last_active":"2023-08-22T00:25:50.788140+0000","last_peered":"2023-08-22T00:25:50.788140+0000","last_clean":"2023-08-22T00:25:50.788140+0000","last_became_active":"2023-08-22T00:25:50.413425+0000","last_became_peered":"2023-08-22T00:25:50.413425+0000","last_unstale":"2023-08-22T00:25:50.788140+0000","last_undegraded":"2023-08-22T00:25:50.788140+0000","last_fullsized":"2023-08-22T00:25:50.788140+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794024+0000","last_change":"2023-08-22T00:25:50.787932+0000","last_active":"2023-08-22T00:25:50.794024+0000","last_peered":"2023-08-22T00:25:50.794024+0000","last_clean":"2023-08-22T00:25:50.794024+0000","last_became_active":"2023-08-22T00:25:50.787626+0000","last_became_peered":"2023-08-22T00:25:50.787626+0000","last_unstale":"2023-08-22T00:25:50.794024+0000","last_undegraded":"2023-08-22T00:25:50.794024+0000","last_fullsized":"2023-08-22T00:25:50.794024+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.775181+0000","last_change":"2023-08-22T00:25:50.413079+0000","last_active":"2023-08-22T00:25:50.775181+0000","last_peered":"2023-08-22T00:25:50.775181+0000","last_clean":"2023-08-22T00:25:50.775181+0000","last_became_active":"2023-08-22T00:25:50.412793+0000","last_became_peered":"2023-08-22T00:25:50.412793+0000","last_unstale":"2023-08-22T00:25:50.775181+0000","last_undegraded":"2023-08-22T00:25:50.775181+0000","last_fullsized":"2023-08-22T00:25:50.775181+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804426+0000","last_change":"2023-08-22T00:25:50.803127+0000","last_active":"2023-08-22T00:25:50.804426+0000","last_peered":"2023-08-22T00:25:50.804426+0000","last_clean":"2023-08-22T00:25:50.804426+0000","last_became_active":"2023-08-22T00:25:50.802594+0000","last_became_peered":"2023-08-22T00:25:50.802594+0000","last_unstale":"2023-08-22T00:25:50.804426+0000","last_undegraded":"2023-08-22T00:25:50.804426+0000","last_fullsized":"2023-08-22T00:25:50.804426+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.770856+0000","last_change":"2023-08-22T00:25:50.412015+0000","last_active":"2023-08-22T00:25:50.770856+0000","last_peered":"2023-08-22T00:25:50.770856+0000","last_clean":"2023-08-22T00:25:50.770856+0000","last_became_active":"2023-08-22T00:25:50.411722+0000","last_became_peered":"2023-08-22T00:25:50.411722+0000","last_unstale":"2023-08-22T00:25:50.770856+0000","last_undegraded":"2023-08-22T00:25:50.770856+0000","last_fullsized":"2023-08-22T00:25:50.770856+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.797811+0000","last_change":"2023-08-22T00:25:50.794633+0000","last_active":"2023-08-22T00:25:50.797811+0000","last_peered":"2023-08-22T00:25:50.797811+0000","last_clean":"2023-08-22T00:25:50.797811+0000","last_became_active":"2023-08-22T00:25:50.794362+0000","last_became_peered":"2023-08-22T00:25:50.794362+0000","last_unstale":"2023-08-22T00:25:50.797811+0000","last_undegraded":"2023-08-22T00:25:50.797811+0000","last_fullsized":"2023-08-22T00:25:50.797811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2d","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.800489+0000","last_change":"2023-08-22T00:25:50.409758+0000","last_active":"2023-08-22T00:25:50.800489+0000","last_peered":"2023-08-22T00:25:50.800489+0000","last_clean":"2023-08-22T00:25:50.800489+0000","last_became_active":"2023-08-22T00:25:50.409451+0000","last_became_peered":"2023-08-22T00:25:50.409451+0000","last_unstale":"2023-08-22T00:25:50.800489+0000","last_undegraded":"2023-08-22T00:25:50.800489+0000","last_fullsized":"2023-08-22T00:25:50.800489+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791806+0000","last_change":"2023-08-22T00:25:50.788067+0000","last_active":"2023-08-22T00:25:50.791806+0000","last_peered":"2023-08-22T00:25:50.791806+0000","last_clean":"2023-08-22T00:25:50.791806+0000","last_became_active":"2023-08-22T00:25:50.787803+0000","last_became_peered":"2023-08-22T00:25:50.787803+0000","last_unstale":"2023-08-22T00:25:50.791806+0000","last_undegraded":"2023-08-22T00:25:50.791806+0000","last_fullsized":"2023-08-22T00:25:50.791806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.770913+0000","last_change":"2023-08-22T00:25:50.417723+0000","last_active":"2023-08-22T00:25:50.770913+0000","last_peered":"2023-08-22T00:25:50.770913+0000","last_clean":"2023-08-22T00:25:50.770913+0000","last_became_active":"2023-08-22T00:25:50.417420+0000","last_became_peered":"2023-08-22T00:25:50.417420+0000","last_unstale":"2023-08-22T00:25:50.770913+0000","last_undegraded":"2023-08-22T00:25:50.770913+0000","last_fullsized":"2023-08-22T00:25:50.770913+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.799144+0000","last_change":"2023-08-22T00:25:50.797261+0000","last_active":"2023-08-22T00:25:50.799144+0000","last_peered":"2023-08-22T00:25:50.799144+0000","last_clean":"2023-08-22T00:25:50.799144+0000","last_became_active":"2023-08-22T00:25:50.796453+0000","last_became_peered":"2023-08-22T00:25:50.796453+0000","last_unstale":"2023-08-22T00:25:50.799144+0000","last_undegraded":"2023-08-22T00:25:50.799144+0000","last_fullsized":"2023-08-22T00:25:50.799144+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.792106+0000","last_change":"2023-08-22T00:25:50.413672+0000","last_active":"2023-08-22T00:25:50.792106+0000","last_peered":"2023-08-22T00:25:50.792106+0000","last_clean":"2023-08-22T00:25:50.792106+0000","last_became_active":"2023-08-22T00:25:50.413426+0000","last_became_peered":"2023-08-22T00:25:50.413426+0000","last_unstale":"2023-08-22T00:25:50.792106+0000","last_undegraded":"2023-08-22T00:25:50.792106+0000","last_fullsized":"2023-08-22T00:25:50.792106+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804065+0000","last_change":"2023-08-22T00:25:50.797233+0000","last_active":"2023-08-22T00:25:50.804065+0000","last_peered":"2023-08-22T00:25:50.804065+0000","last_clean":"2023-08-22T00:25:50.804065+0000","last_became_active":"2023-08-22T00:25:50.796947+0000","last_became_peered":"2023-08-22T00:25:50.796947+0000","last_unstale":"2023-08-22T00:25:50.804065+0000","last_undegraded":"2023-08-22T00:25:50.804065+0000","last_fullsized":"2023-08-22T00:25:50.804065+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778972+0000","last_change":"2023-08-22T00:25:50.409442+0000","last_active":"2023-08-22T00:25:50.778972+0000","last_peered":"2023-08-22T00:25:50.778972+0000","last_clean":"2023-08-22T00:25:50.778972+0000","last_became_active":"2023-08-22T00:25:50.409016+0000","last_became_peered":"2023-08-22T00:25:50.409016+0000","last_unstale":"2023-08-22T00:25:50.778972+0000","last_undegraded":"2023-08-22T00:25:50.778972+0000","last_fullsized":"2023-08-22T00:25:50.778972+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804114+0000","last_change":"2023-08-22T00:25:50.799621+0000","last_active":"2023-08-22T00:25:50.804114+0000","last_peered":"2023-08-22T00:25:50.804114+0000","last_clean":"2023-08-22T00:25:50.804114+0000","last_became_active":"2023-08-22T00:25:50.799367+0000","last_became_peered":"2023-08-22T00:25:50.799367+0000","last_unstale":"2023-08-22T00:25:50.804114+0000","last_undegraded":"2023-08-22T00:25:50.804114+0000","last_fullsized":"2023-08-22T00:25:50.804114+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.777535+0000","last_change":"2023-08-22T00:25:50.414858+0000","last_active":"2023-08-22T00:25:50.777535+0000","last_peered":"2023-08-22T00:25:50.777535+0000","last_clean":"2023-08-22T00:25:50.777535+0000","last_became_active":"2023-08-22T00:25:50.413770+0000","last_became_peered":"2023-08-22T00:25:50.413770+0000","last_unstale":"2023-08-22T00:25:50.777535+0000","last_undegraded":"2023-08-22T00:25:50.777535+0000","last_fullsized":"2023-08-22T00:25:50.777535+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.799183+0000","last_change":"2023-08-22T00:25:50.797607+0000","last_active":"2023-08-22T00:25:50.799183+0000","last_peered":"2023-08-22T00:25:50.799183+0000","last_clean":"2023-08-22T00:25:50.799183+0000","last_became_active":"2023-08-22T00:25:50.797385+0000","last_became_peered":"2023-08-22T00:25:50.797385+0000","last_unstale":"2023-08-22T00:25:50.799183+0000","last_undegraded":"2023-08-22T00:25:50.799183+0000","last_fullsized":"2023-08-22T00:25:50.799183+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774057+0000","last_change":"2023-08-22T00:25:50.411700+0000","last_active":"2023-08-22T00:25:50.774057+0000","last_peered":"2023-08-22T00:25:50.774057+0000","last_clean":"2023-08-22T00:25:50.774057+0000","last_became_active":"2023-08-22T00:25:50.410640+0000","last_became_peered":"2023-08-22T00:25:50.410640+0000","last_unstale":"2023-08-22T00:25:50.774057+0000","last_undegraded":"2023-08-22T00:25:50.774057+0000","last_fullsized":"2023-08-22T00:25:50.774057+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.792171+0000","last_change":"2023-08-22T00:25:50.788326+0000","last_active":"2023-08-22T00:25:50.792171+0000","last_peered":"2023-08-22T00:25:50.792171+0000","last_clean":"2023-08-22T00:25:50.792171+0000","last_became_active":"2023-08-22T00:25:50.787653+0000","last_became_peered":"2023-08-22T00:25:50.787653+0000","last_unstale":"2023-08-22T00:25:50.792171+0000","last_undegraded":"2023-08-22T00:25:50.792171+0000","last_fullsized":"2023-08-22T00:25:50.792171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774543+0000","last_change":"2023-08-22T00:25:50.395122+0000","last_active":"2023-08-22T00:25:50.774543+0000","last_peered":"2023-08-22T00:25:50.774543+0000","last_clean":"2023-08-22T00:25:50.774543+0000","last_became_active":"2023-08-22T00:25:50.394754+0000","last_became_peered":"2023-08-22T00:25:50.394754+0000","last_unstale":"2023-08-22T00:25:50.774543+0000","last_undegraded":"2023-08-22T00:25:50.774543+0000","last_fullsized":"2023-08-22T00:25:50.774543+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.790229+0000","last_change":"2023-08-22T00:25:50.789042+0000","last_active":"2023-08-22T00:25:50.790229+0000","last_peered":"2023-08-22T00:25:50.790229+0000","last_clean":"2023-08-22T00:25:50.790229+0000","last_became_active":"2023-08-22T00:25:50.788789+0000","last_became_peered":"2023-08-22T00:25:50.788789+0000","last_unstale":"2023-08-22T00:25:50.790229+0000","last_undegraded":"2023-08-22T00:25:50.790229+0000","last_fullsized":"2023-08-22T00:25:50.790229+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.775006+0000","last_change":"2023-08-22T00:25:50.414603+0000","last_active":"2023-08-22T00:25:50.775006+0000","last_peered":"2023-08-22T00:25:50.775006+0000","last_clean":"2023-08-22T00:25:50.775006+0000","last_became_active":"2023-08-22T00:25:50.414293+0000","last_became_peered":"2023-08-22T00:25:50.414293+0000","last_unstale":"2023-08-22T00:25:50.775006+0000","last_undegraded":"2023-08-22T00:25:50.775006+0000","last_fullsized":"2023-08-22T00:25:50.775006+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794357+0000","last_change":"2023-08-22T00:25:50.786897+0000","last_active":"2023-08-22T00:25:50.794357+0000","last_peered":"2023-08-22T00:25:50.794357+0000","last_clean":"2023-08-22T00:25:50.794357+0000","last_became_active":"2023-08-22T00:25:50.786652+0000","last_became_peered":"2023-08-22T00:25:50.786652+0000","last_unstale":"2023-08-22T00:25:50.794357+0000","last_undegraded":"2023-08-22T00:25:50.794357+0000","last_fullsized":"2023-08-22T00:25:50.794357+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782657+0000","last_change":"2023-08-22T00:25:50.412834+0000","last_active":"2023-08-22T00:25:50.782657+0000","last_peered":"2023-08-22T00:25:50.782657+0000","last_clean":"2023-08-22T00:25:50.782657+0000","last_became_active":"2023-08-22T00:25:50.412535+0000","last_became_peered":"2023-08-22T00:25:50.412535+0000","last_unstale":"2023-08-22T00:25:50.782657+0000","last_undegraded":"2023-08-22T00:25:50.782657+0000","last_fullsized":"2023-08-22T00:25:50.782657+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.800300+0000","last_change":"2023-08-22T00:25:50.795633+0000","last_active":"2023-08-22T00:25:50.800300+0000","last_peered":"2023-08-22T00:25:50.800300+0000","last_clean":"2023-08-22T00:25:50.800300+0000","last_became_active":"2023-08-22T00:25:50.795356+0000","last_became_peered":"2023-08-22T00:25:50.795356+0000","last_unstale":"2023-08-22T00:25:50.800300+0000","last_undegraded":"2023-08-22T00:25:50.800300+0000","last_fullsized":"2023-08-22T00:25:50.800300+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.779252+0000","last_change":"2023-08-22T00:25:50.395925+0000","last_active":"2023-08-22T00:25:50.779252+0000","last_peered":"2023-08-22T00:25:50.779252+0000","last_clean":"2023-08-22T00:25:50.779252+0000","last_became_active":"2023-08-22T00:25:50.395653+0000","last_became_peered":"2023-08-22T00:25:50.395653+0000","last_unstale":"2023-08-22T00:25:50.779252+0000","last_undegraded":"2023-08-22T00:25:50.779252+0000","last_fullsized":"2023-08-22T00:25:50.779252+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.801183+0000","last_change":"2023-08-22T00:25:50.800162+0000","last_active":"2023-08-22T00:25:50.801183+0000","last_peered":"2023-08-22T00:25:50.801183+0000","last_clean":"2023-08-22T00:25:50.801183+0000","last_became_active":"2023-08-22T00:25:50.799750+0000","last_became_peered":"2023-08-22T00:25:50.799750+0000","last_unstale":"2023-08-22T00:25:50.801183+0000","last_undegraded":"2023-08-22T00:25:50.801183+0000","last_fullsized":"2023-08-22T00:25:50.801183+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.773722+0000","last_change":"2023-08-22T00:25:50.413118+0000","last_active":"2023-08-22T00:25:50.773722+0000","last_peered":"2023-08-22T00:25:50.773722+0000","last_clean":"2023-08-22T00:25:50.773722+0000","last_became_active":"2023-08-22T00:25:50.412841+0000","last_became_peered":"2023-08-22T00:25:50.412841+0000","last_unstale":"2023-08-22T00:25:50.773722+0000","last_undegraded":"2023-08-22T00:25:50.773722+0000","last_fullsized":"2023-08-22T00:25:50.773722+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791749+0000","last_change":"2023-08-22T00:25:50.788664+0000","last_active":"2023-08-22T00:25:50.791749+0000","last_peered":"2023-08-22T00:25:50.791749+0000","last_clean":"2023-08-22T00:25:50.791749+0000","last_became_active":"2023-08-22T00:25:50.787516+0000","last_became_peered":"2023-08-22T00:25:50.787516+0000","last_unstale":"2023-08-22T00:25:50.791749+0000","last_undegraded":"2023-08-22T00:25:50.791749+0000","last_fullsized":"2023-08-22T00:25:50.791749+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778017+0000","last_change":"2023-08-22T00:25:50.396078+0000","last_active":"2023-08-22T00:25:50.778017+0000","last_peered":"2023-08-22T00:25:50.778017+0000","last_clean":"2023-08-22T00:25:50.778017+0000","last_became_active":"2023-08-22T00:25:50.395820+0000","last_became_peered":"2023-08-22T00:25:50.395820+0000","last_unstale":"2023-08-22T00:25:50.778017+0000","last_undegraded":"2023-08-22T00:25:50.778017+0000","last_fullsized":"2023-08-22T00:25:50.778017+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.790159+0000","last_change":"2023-08-22T00:25:50.786331+0000","last_active":"2023-08-22T00:25:50.790159+0000","last_peered":"2023-08-22T00:25:50.790159+0000","last_clean":"2023-08-22T00:25:50.790159+0000","last_became_active":"2023-08-22T00:25:50.786074+0000","last_became_peered":"2023-08-22T00:25:50.786074+0000","last_unstale":"2023-08-22T00:25:50.790159+0000","last_undegraded":"2023-08-22T00:25:50.790159+0000","last_fullsized":"2023-08-22T00:25:50.790159+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.785750+0000","last_change":"2023-08-22T00:25:50.414494+0000","last_active":"2023-08-22T00:25:50.785750+0000","last_peered":"2023-08-22T00:25:50.785750+0000","last_clean":"2023-08-22T00:25:50.785750+0000","last_became_active":"2023-08-22T00:25:50.414227+0000","last_became_peered":"2023-08-22T00:25:50.414227+0000","last_unstale":"2023-08-22T00:25:50.785750+0000","last_undegraded":"2023-08-22T00:25:50.785750+0000","last_fullsized":"2023-08-22T00:25:50.785750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796831+0000","last_change":"2023-08-22T00:25:50.793995+0000","last_active":"2023-08-22T00:25:50.796831+0000","last_peered":"2023-08-22T00:25:50.796831+0000","last_clean":"2023-08-22T00:25:50.796831+0000","last_became_active":"2023-08-22T00:25:50.793064+0000","last_became_peered":"2023-08-22T00:25:50.793064+0000","last_unstale":"2023-08-22T00:25:50.796831+0000","last_undegraded":"2023-08-22T00:25:50.796831+0000","last_fullsized":"2023-08-22T00:25:50.796831+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.777209+0000","last_change":"2023-08-22T00:25:50.411680+0000","last_active":"2023-08-22T00:25:50.777209+0000","last_peered":"2023-08-22T00:25:50.777209+0000","last_clean":"2023-08-22T00:25:50.777209+0000","last_became_active":"2023-08-22T00:25:50.411407+0000","last_became_peered":"2023-08-22T00:25:50.411407+0000","last_unstale":"2023-08-22T00:25:50.777209+0000","last_undegraded":"2023-08-22T00:25:50.777209+0000","last_fullsized":"2023-08-22T00:25:50.777209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804176+0000","last_change":"2023-08-22T00:25:50.801655+0000","last_active":"2023-08-22T00:25:50.804176+0000","last_peered":"2023-08-22T00:25:50.804176+0000","last_clean":"2023-08-22T00:25:50.804176+0000","last_became_active":"2023-08-22T00:25:50.801054+0000","last_became_peered":"2023-08-22T00:25:50.801054+0000","last_unstale":"2023-08-22T00:25:50.804176+0000","last_undegraded":"2023-08-22T00:25:50.804176+0000","last_fullsized":"2023-08-22T00:25:50.804176+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.803208+0000","last_change":"2023-08-22T00:25:50.416477+0000","last_active":"2023-08-22T00:25:50.803208+0000","last_peered":"2023-08-22T00:25:50.803208+0000","last_clean":"2023-08-22T00:25:50.803208+0000","last_became_active":"2023-08-22T00:25:50.416053+0000","last_became_peered":"2023-08-22T00:25:50.416053+0000","last_unstale":"2023-08-22T00:25:50.803208+0000","last_undegraded":"2023-08-22T00:25:50.803208+0000","last_fullsized":"2023-08-22T00:25:50.803208+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796353+0000","last_change":"2023-08-22T00:25:50.793111+0000","last_active":"2023-08-22T00:25:50.796353+0000","last_peered":"2023-08-22T00:25:50.796353+0000","last_clean":"2023-08-22T00:25:50.796353+0000","last_became_active":"2023-08-22T00:25:50.792796+0000","last_became_peered":"2023-08-22T00:25:50.792796+0000","last_unstale":"2023-08-22T00:25:50.796353+0000","last_undegraded":"2023-08-22T00:25:50.796353+0000","last_fullsized":"2023-08-22T00:25:50.796353+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781650+0000","last_change":"2023-08-22T00:25:50.417650+0000","last_active":"2023-08-22T00:25:50.781650+0000","last_peered":"2023-08-22T00:25:50.781650+0000","last_clean":"2023-08-22T00:25:50.781650+0000","last_became_active":"2023-08-22T00:25:50.417440+0000","last_became_peered":"2023-08-22T00:25:50.417440+0000","last_unstale":"2023-08-22T00:25:50.781650+0000","last_undegraded":"2023-08-22T00:25:50.781650+0000","last_fullsized":"2023-08-22T00:25:50.781650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.799173+0000","last_change":"2023-08-22T00:25:50.793652+0000","last_active":"2023-08-22T00:25:50.799173+0000","last_peered":"2023-08-22T00:25:50.799173+0000","last_clean":"2023-08-22T00:25:50.799173+0000","last_became_active":"2023-08-22T00:25:50.793344+0000","last_became_peered":"2023-08-22T00:25:50.793344+0000","last_unstale":"2023-08-22T00:25:50.799173+0000","last_undegraded":"2023-08-22T00:25:50.799173+0000","last_fullsized":"2023-08-22T00:25:50.799173+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.798011+0000","last_change":"2023-08-22T00:25:50.407310+0000","last_active":"2023-08-22T00:25:50.798011+0000","last_peered":"2023-08-22T00:25:50.798011+0000","last_clean":"2023-08-22T00:25:50.798011+0000","last_became_active":"2023-08-22T00:25:50.407020+0000","last_became_peered":"2023-08-22T00:25:50.407020+0000","last_unstale":"2023-08-22T00:25:50.798011+0000","last_undegraded":"2023-08-22T00:25:50.798011+0000","last_fullsized":"2023-08-22T00:25:50.798011+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804057+0000","last_change":"2023-08-22T00:25:50.796941+0000","last_active":"2023-08-22T00:25:50.804057+0000","last_peered":"2023-08-22T00:25:50.804057+0000","last_clean":"2023-08-22T00:25:50.804057+0000","last_became_active":"2023-08-22T00:25:50.796400+0000","last_became_peered":"2023-08-22T00:25:50.796400+0000","last_unstale":"2023-08-22T00:25:50.804057+0000","last_undegraded":"2023-08-22T00:25:50.804057+0000","last_fullsized":"2023-08-22T00:25:50.804057+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.789698+0000","last_change":"2023-08-22T00:25:50.411135+0000","last_active":"2023-08-22T00:25:50.789698+0000","last_peered":"2023-08-22T00:25:50.789698+0000","last_clean":"2023-08-22T00:25:50.789698+0000","last_became_active":"2023-08-22T00:25:50.410908+0000","last_became_peered":"2023-08-22T00:25:50.410908+0000","last_unstale":"2023-08-22T00:25:50.789698+0000","last_undegraded":"2023-08-22T00:25:50.789698+0000","last_fullsized":"2023-08-22T00:25:50.789698+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796863+0000","last_change":"2023-08-22T00:25:50.793557+0000","last_active":"2023-08-22T00:25:50.796863+0000","last_peered":"2023-08-22T00:25:50.796863+0000","last_clean":"2023-08-22T00:25:50.796863+0000","last_became_active":"2023-08-22T00:25:50.793287+0000","last_became_peered":"2023-08-22T00:25:50.793287+0000","last_unstale":"2023-08-22T00:25:50.796863+0000","last_undegraded":"2023-08-22T00:25:50.796863+0000","last_fullsized":"2023-08-22T00:25:50.796863+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778622+0000","last_change":"2023-08-22T00:25:50.416914+0000","last_active":"2023-08-22T00:25:50.778622+0000","last_peered":"2023-08-22T00:25:50.778622+0000","last_clean":"2023-08-22T00:25:50.778622+0000","last_became_active":"2023-08-22T00:25:50.416639+0000","last_became_peered":"2023-08-22T00:25:50.416639+0000","last_unstale":"2023-08-22T00:25:50.778622+0000","last_undegraded":"2023-08-22T00:25:50.778622+0000","last_fullsized":"2023-08-22T00:25:50.778622+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.800652+0000","last_change":"2023-08-22T00:25:50.799126+0000","last_active":"2023-08-22T00:25:50.800652+0000","last_peered":"2023-08-22T00:25:50.800652+0000","last_clean":"2023-08-22T00:25:50.800652+0000","last_became_active":"2023-08-22T00:25:50.798449+0000","last_became_peered":"2023-08-22T00:25:50.798449+0000","last_unstale":"2023-08-22T00:25:50.800652+0000","last_undegraded":"2023-08-22T00:25:50.800652+0000","last_fullsized":"2023-08-22T00:25:50.800652+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.776075+0000","last_change":"2023-08-22T00:25:50.407551+0000","last_active":"2023-08-22T00:25:50.776075+0000","last_peered":"2023-08-22T00:25:50.776075+0000","last_clean":"2023-08-22T00:25:50.776075+0000","last_became_active":"2023-08-22T00:25:50.407207+0000","last_became_peered":"2023-08-22T00:25:50.407207+0000","last_unstale":"2023-08-22T00:25:50.776075+0000","last_undegraded":"2023-08-22T00:25:50.776075+0000","last_fullsized":"2023-08-22T00:25:50.776075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.787240+0000","last_change":"2023-08-22T00:25:50.779129+0000","last_active":"2023-08-22T00:25:50.787240+0000","last_peered":"2023-08-22T00:25:50.787240+0000","last_clean":"2023-08-22T00:25:50.787240+0000","last_became_active":"2023-08-22T00:25:50.778841+0000","last_became_peered":"2023-08-22T00:25:50.778841+0000","last_unstale":"2023-08-22T00:25:50.787240+0000","last_undegraded":"2023-08-22T00:25:50.787240+0000","last_fullsized":"2023-08-22T00:25:50.787240+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781309+0000","last_change":"2023-08-22T00:25:50.408730+0000","last_active":"2023-08-22T00:25:50.781309+0000","last_peered":"2023-08-22T00:25:50.781309+0000","last_clean":"2023-08-22T00:25:50.781309+0000","last_became_active":"2023-08-22T00:25:50.408441+0000","last_became_peered":"2023-08-22T00:25:50.408441+0000","last_unstale":"2023-08-22T00:25:50.781309+0000","last_undegraded":"2023-08-22T00:25:50.781309+0000","last_fullsized":"2023-08-22T00:25:50.781309+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791740+0000","last_change":"2023-08-22T00:25:50.787846+0000","last_active":"2023-08-22T00:25:50.791740+0000","last_peered":"2023-08-22T00:25:50.791740+0000","last_clean":"2023-08-22T00:25:50.791740+0000","last_became_active":"2023-08-22T00:25:50.787550+0000","last_became_peered":"2023-08-22T00:25:50.787550+0000","last_unstale":"2023-08-22T00:25:50.791740+0000","last_undegraded":"2023-08-22T00:25:50.791740+0000","last_fullsized":"2023-08-22T00:25:50.791740+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.786514+0000","last_change":"2023-08-22T00:25:50.406125+0000","last_active":"2023-08-22T00:25:50.786514+0000","last_peered":"2023-08-22T00:25:50.786514+0000","last_clean":"2023-08-22T00:25:50.786514+0000","last_became_active":"2023-08-22T00:25:50.405823+0000","last_became_peered":"2023-08-22T00:25:50.405823+0000","last_unstale":"2023-08-22T00:25:50.786514+0000","last_undegraded":"2023-08-22T00:25:50.786514+0000","last_fullsized":"2023-08-22T00:25:50.786514+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804193+0000","last_change":"2023-08-22T00:25:50.801822+0000","last_active":"2023-08-22T00:25:50.804193+0000","last_peered":"2023-08-22T00:25:50.804193+0000","last_clean":"2023-08-22T00:25:50.804193+0000","last_became_active":"2023-08-22T00:25:50.801326+0000","last_became_peered":"2023-08-22T00:25:50.801326+0000","last_unstale":"2023-08-22T00:25:50.804193+0000","last_undegraded":"2023-08-22T00:25:50.804193+0000","last_fullsized":"2023-08-22T00:25:50.804193+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.790876+0000","last_change":"2023-08-22T00:25:50.410469+0000","last_active":"2023-08-22T00:25:50.790876+0000","last_peered":"2023-08-22T00:25:50.790876+0000","last_clean":"2023-08-22T00:25:50.790876+0000","last_became_active":"2023-08-22T00:25:50.410188+0000","last_became_peered":"2023-08-22T00:25:50.410188+0000","last_unstale":"2023-08-22T00:25:50.790876+0000","last_undegraded":"2023-08-22T00:25:50.790876+0000","last_fullsized":"2023-08-22T00:25:50.790876+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.807869+0000","last_change":"2023-08-22T00:25:50.802995+0000","last_active":"2023-08-22T00:25:50.807869+0000","last_peered":"2023-08-22T00:25:50.807869+0000","last_clean":"2023-08-22T00:25:50.807869+0000","last_became_active":"2023-08-22T00:25:50.802736+0000","last_became_peered":"2023-08-22T00:25:50.802736+0000","last_unstale":"2023-08-22T00:25:50.807869+0000","last_undegraded":"2023-08-22T00:25:50.807869+0000","last_fullsized":"2023-08-22T00:25:50.807869+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.793332+0000","last_change":"2023-08-22T00:25:50.411663+0000","last_active":"2023-08-22T00:25:50.793332+0000","last_peered":"2023-08-22T00:25:50.793332+0000","last_clean":"2023-08-22T00:25:50.793332+0000","last_became_active":"2023-08-22T00:25:50.411322+0000","last_became_peered":"2023-08-22T00:25:50.411322+0000","last_unstale":"2023-08-22T00:25:50.793332+0000","last_undegraded":"2023-08-22T00:25:50.793332+0000","last_fullsized":"2023-08-22T00:25:50.793332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.795661+0000","last_change":"2023-08-22T00:25:50.793853+0000","last_active":"2023-08-22T00:25:50.795661+0000","last_peered":"2023-08-22T00:25:50.795661+0000","last_clean":"2023-08-22T00:25:50.795661+0000","last_became_active":"2023-08-22T00:25:50.793600+0000","last_became_peered":"2023-08-22T00:25:50.793600+0000","last_unstale":"2023-08-22T00:25:50.795661+0000","last_undegraded":"2023-08-22T00:25:50.795661+0000","last_fullsized":"2023-08-22T00:25:50.795661+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781490+0000","last_change":"2023-08-22T00:25:50.409043+0000","last_active":"2023-08-22T00:25:50.781490+0000","last_peered":"2023-08-22T00:25:50.781490+0000","last_clean":"2023-08-22T00:25:50.781490+0000","last_became_active":"2023-08-22T00:25:50.408630+0000","last_became_peered":"2023-08-22T00:25:50.408630+0000","last_unstale":"2023-08-22T00:25:50.781490+0000","last_undegraded":"2023-08-22T00:25:50.781490+0000","last_fullsized":"2023-08-22T00:25:50.781490+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791787+0000","last_change":"2023-08-22T00:25:50.788048+0000","last_active":"2023-08-22T00:25:50.791787+0000","last_peered":"2023-08-22T00:25:50.791787+0000","last_clean":"2023-08-22T00:25:50.791787+0000","last_became_active":"2023-08-22T00:25:50.787774+0000","last_became_peered":"2023-08-22T00:25:50.787774+0000","last_unstale":"2023-08-22T00:25:50.791787+0000","last_undegraded":"2023-08-22T00:25:50.791787+0000","last_fullsized":"2023-08-22T00:25:50.791787+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.771006+0000","last_change":"2023-08-22T00:25:50.422814+0000","last_active":"2023-08-22T00:25:50.771006+0000","last_peered":"2023-08-22T00:25:50.771006+0000","last_clean":"2023-08-22T00:25:50.771006+0000","last_became_active":"2023-08-22T00:25:50.422545+0000","last_became_peered":"2023-08-22T00:25:50.422545+0000","last_unstale":"2023-08-22T00:25:50.771006+0000","last_undegraded":"2023-08-22T00:25:50.771006+0000","last_fullsized":"2023-08-22T00:25:50.771006+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796857+0000","last_change":"2023-08-22T00:25:50.793788+0000","last_active":"2023-08-22T00:25:50.796857+0000","last_peered":"2023-08-22T00:25:50.796857+0000","last_clean":"2023-08-22T00:25:50.796857+0000","last_became_active":"2023-08-22T00:25:50.793489+0000","last_became_peered":"2023-08-22T00:25:50.793489+0000","last_unstale":"2023-08-22T00:25:50.796857+0000","last_undegraded":"2023-08-22T00:25:50.796857+0000","last_fullsized":"2023-08-22T00:25:50.796857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791378+0000","last_change":"2023-08-22T00:25:50.396618+0000","last_active":"2023-08-22T00:25:50.791378+0000","last_peered":"2023-08-22T00:25:50.791378+0000","last_clean":"2023-08-22T00:25:50.791378+0000","last_became_active":"2023-08-22T00:25:50.396326+0000","last_became_peered":"2023-08-22T00:25:50.396326+0000","last_unstale":"2023-08-22T00:25:50.791378+0000","last_undegraded":"2023-08-22T00:25:50.791378+0000","last_fullsized":"2023-08-22T00:25:50.791378+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.803168+0000","last_change":"2023-08-22T00:25:50.797752+0000","last_active":"2023-08-22T00:25:50.803168+0000","last_peered":"2023-08-22T00:25:50.803168+0000","last_clean":"2023-08-22T00:25:50.803168+0000","last_became_active":"2023-08-22T00:25:50.797452+0000","last_became_peered":"2023-08-22T00:25:50.797452+0000","last_unstale":"2023-08-22T00:25:50.803168+0000","last_undegraded":"2023-08-22T00:25:50.803168+0000","last_fullsized":"2023-08-22T00:25:50.803168+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781746+0000","last_change":"2023-08-22T00:25:50.413494+0000","last_active":"2023-08-22T00:25:50.781746+0000","last_peered":"2023-08-22T00:25:50.781746+0000","last_clean":"2023-08-22T00:25:50.781746+0000","last_became_active":"2023-08-22T00:25:50.412986+0000","last_became_peered":"2023-08-22T00:25:50.412986+0000","last_unstale":"2023-08-22T00:25:50.781746+0000","last_undegraded":"2023-08-22T00:25:50.781746+0000","last_fullsized":"2023-08-22T00:25:50.781746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.799794+0000","last_change":"2023-08-22T00:25:50.798179+0000","last_active":"2023-08-22T00:25:50.799794+0000","last_peered":"2023-08-22T00:25:50.799794+0000","last_clean":"2023-08-22T00:25:50.799794+0000","last_became_active":"2023-08-22T00:25:50.797914+0000","last_became_peered":"2023-08-22T00:25:50.797914+0000","last_unstale":"2023-08-22T00:25:50.799794+0000","last_undegraded":"2023-08-22T00:25:50.799794+0000","last_fullsized":"2023-08-22T00:25:50.799794+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782554+0000","last_change":"2023-08-22T00:25:50.413718+0000","last_active":"2023-08-22T00:25:50.782554+0000","last_peered":"2023-08-22T00:25:50.782554+0000","last_clean":"2023-08-22T00:25:50.782554+0000","last_became_active":"2023-08-22T00:25:50.413311+0000","last_became_peered":"2023-08-22T00:25:50.413311+0000","last_unstale":"2023-08-22T00:25:50.782554+0000","last_undegraded":"2023-08-22T00:25:50.782554+0000","last_fullsized":"2023-08-22T00:25:50.782554+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794239+0000","last_change":"2023-08-22T00:25:50.791170+0000","last_active":"2023-08-22T00:25:50.794239+0000","last_peered":"2023-08-22T00:25:50.794239+0000","last_clean":"2023-08-22T00:25:50.794239+0000","last_became_active":"2023-08-22T00:25:50.790910+0000","last_became_peered":"2023-08-22T00:25:50.790910+0000","last_unstale":"2023-08-22T00:25:50.794239+0000","last_undegraded":"2023-08-22T00:25:50.794239+0000","last_fullsized":"2023-08-22T00:25:50.794239+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.773532+0000","last_change":"2023-08-22T00:25:50.412009+0000","last_active":"2023-08-22T00:25:50.773532+0000","last_peered":"2023-08-22T00:25:50.773532+0000","last_clean":"2023-08-22T00:25:50.773532+0000","last_became_active":"2023-08-22T00:25:50.411693+0000","last_became_peered":"2023-08-22T00:25:50.411693+0000","last_unstale":"2023-08-22T00:25:50.773532+0000","last_undegraded":"2023-08-22T00:25:50.773532+0000","last_fullsized":"2023-08-22T00:25:50.773532+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791610+0000","last_change":"2023-08-22T00:25:50.786708+0000","last_active":"2023-08-22T00:25:50.791610+0000","last_peered":"2023-08-22T00:25:50.791610+0000","last_clean":"2023-08-22T00:25:50.791610+0000","last_became_active":"2023-08-22T00:25:50.786408+0000","last_became_peered":"2023-08-22T00:25:50.786408+0000","last_unstale":"2023-08-22T00:25:50.791610+0000","last_undegraded":"2023-08-22T00:25:50.791610+0000","last_fullsized":"2023-08-22T00:25:50.791610+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.803423+0000","last_change":"2023-08-22T00:25:50.410017+0000","last_active":"2023-08-22T00:25:50.803423+0000","last_peered":"2023-08-22T00:25:50.803423+0000","last_clean":"2023-08-22T00:25:50.803423+0000","last_became_active":"2023-08-22T00:25:50.409726+0000","last_became_peered":"2023-08-22T00:25:50.409726+0000","last_unstale":"2023-08-22T00:25:50.803423+0000","last_undegraded":"2023-08-22T00:25:50.803423+0000","last_fullsized":"2023-08-22T00:25:50.803423+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794655+0000","last_change":"2023-08-22T00:25:50.792959+0000","last_active":"2023-08-22T00:25:50.794655+0000","last_peered":"2023-08-22T00:25:50.794655+0000","last_clean":"2023-08-22T00:25:50.794655+0000","last_became_active":"2023-08-22T00:25:50.792639+0000","last_became_peered":"2023-08-22T00:25:50.792639+0000","last_unstale":"2023-08-22T00:25:50.794655+0000","last_undegraded":"2023-08-22T00:25:50.794655+0000","last_fullsized":"2023-08-22T00:25:50.794655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774388+0000","last_change":"2023-08-22T00:25:50.417078+0000","last_active":"2023-08-22T00:25:50.774388+0000","last_peered":"2023-08-22T00:25:50.774388+0000","last_clean":"2023-08-22T00:25:50.774388+0000","last_became_active":"2023-08-22T00:25:50.416841+0000","last_became_peered":"2023-08-22T00:25:50.416841+0000","last_unstale":"2023-08-22T00:25:50.774388+0000","last_undegraded":"2023-08-22T00:25:50.774388+0000","last_fullsized":"2023-08-22T00:25:50.774388+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.802687+0000","last_change":"2023-08-22T00:25:50.798355+0000","last_active":"2023-08-22T00:25:50.802687+0000","last_peered":"2023-08-22T00:25:50.802687+0000","last_clean":"2023-08-22T00:25:50.802687+0000","last_became_active":"2023-08-22T00:25:50.798130+0000","last_became_peered":"2023-08-22T00:25:50.798130+0000","last_unstale":"2023-08-22T00:25:50.802687+0000","last_undegraded":"2023-08-22T00:25:50.802687+0000","last_fullsized":"2023-08-22T00:25:50.802687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.775423+0000","last_change":"2023-08-22T00:25:50.420005+0000","last_active":"2023-08-22T00:25:50.775423+0000","last_peered":"2023-08-22T00:25:50.775423+0000","last_clean":"2023-08-22T00:25:50.775423+0000","last_became_active":"2023-08-22T00:25:50.419732+0000","last_became_peered":"2023-08-22T00:25:50.419732+0000","last_unstale":"2023-08-22T00:25:50.775423+0000","last_undegraded":"2023-08-22T00:25:50.775423+0000","last_fullsized":"2023-08-22T00:25:50.775423+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796282+0000","last_change":"2023-08-22T00:25:50.791570+0000","last_active":"2023-08-22T00:25:50.796282+0000","last_peered":"2023-08-22T00:25:50.796282+0000","last_clean":"2023-08-22T00:25:50.796282+0000","last_became_active":"2023-08-22T00:25:50.791302+0000","last_became_peered":"2023-08-22T00:25:50.791302+0000","last_unstale":"2023-08-22T00:25:50.796282+0000","last_undegraded":"2023-08-22T00:25:50.796282+0000","last_fullsized":"2023-08-22T00:25:50.796282+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774819+0000","last_change":"2023-08-22T00:25:50.420026+0000","last_active":"2023-08-22T00:25:50.774819+0000","last_peered":"2023-08-22T00:25:50.774819+0000","last_clean":"2023-08-22T00:25:50.774819+0000","last_became_active":"2023-08-22T00:25:50.419701+0000","last_became_peered":"2023-08-22T00:25:50.419701+0000","last_unstale":"2023-08-22T00:25:50.774819+0000","last_undegraded":"2023-08-22T00:25:50.774819+0000","last_fullsized":"2023-08-22T00:25:50.774819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.800736+0000","last_change":"2023-08-22T00:25:50.796372+0000","last_active":"2023-08-22T00:25:50.800736+0000","last_peered":"2023-08-22T00:25:50.800736+0000","last_clean":"2023-08-22T00:25:50.800736+0000","last_became_active":"2023-08-22T00:25:50.796164+0000","last_became_peered":"2023-08-22T00:25:50.796164+0000","last_unstale":"2023-08-22T00:25:50.800736+0000","last_undegraded":"2023-08-22T00:25:50.800736+0000","last_fullsized":"2023-08-22T00:25:50.800736+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.779503+0000","last_change":"2023-08-22T00:25:50.397883+0000","last_active":"2023-08-22T00:25:50.779503+0000","last_peered":"2023-08-22T00:25:50.779503+0000","last_clean":"2023-08-22T00:25:50.779503+0000","last_became_active":"2023-08-22T00:25:50.397209+0000","last_became_peered":"2023-08-22T00:25:50.397209+0000","last_unstale":"2023-08-22T00:25:50.779503+0000","last_undegraded":"2023-08-22T00:25:50.779503+0000","last_fullsized":"2023-08-22T00:25:50.779503+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794493+0000","last_change":"2023-08-22T00:25:50.792573+0000","last_active":"2023-08-22T00:25:50.794493+0000","last_peered":"2023-08-22T00:25:50.794493+0000","last_clean":"2023-08-22T00:25:50.794493+0000","last_became_active":"2023-08-22T00:25:50.792280+0000","last_became_peered":"2023-08-22T00:25:50.792280+0000","last_unstale":"2023-08-22T00:25:50.794493+0000","last_undegraded":"2023-08-22T00:25:50.794493+0000","last_fullsized":"2023-08-22T00:25:50.794493+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.783773+0000","last_change":"2023-08-22T00:25:50.409868+0000","last_active":"2023-08-22T00:25:50.783773+0000","last_peered":"2023-08-22T00:25:50.783773+0000","last_clean":"2023-08-22T00:25:50.783773+0000","last_became_active":"2023-08-22T00:25:50.409606+0000","last_became_peered":"2023-08-22T00:25:50.409606+0000","last_unstale":"2023-08-22T00:25:50.783773+0000","last_undegraded":"2023-08-22T00:25:50.783773+0000","last_fullsized":"2023-08-22T00:25:50.783773+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.802485+0000","last_change":"2023-08-22T00:25:50.794191+0000","last_active":"2023-08-22T00:25:50.802485+0000","last_peered":"2023-08-22T00:25:50.802485+0000","last_clean":"2023-08-22T00:25:50.802485+0000","last_became_active":"2023-08-22T00:25:50.793919+0000","last_became_peered":"2023-08-22T00:25:50.793919+0000","last_unstale":"2023-08-22T00:25:50.802485+0000","last_undegraded":"2023-08-22T00:25:50.802485+0000","last_fullsized":"2023-08-22T00:25:50.802485+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.775789+0000","last_change":"2023-08-22T00:25:50.398613+0000","last_active":"2023-08-22T00:25:50.775789+0000","last_peered":"2023-08-22T00:25:50.775789+0000","last_clean":"2023-08-22T00:25:50.775789+0000","last_became_active":"2023-08-22T00:25:50.398318+0000","last_became_peered":"2023-08-22T00:25:50.398318+0000","last_unstale":"2023-08-22T00:25:50.775789+0000","last_undegraded":"2023-08-22T00:25:50.775789+0000","last_fullsized":"2023-08-22T00:25:50.775789+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794328+0000","last_change":"2023-08-22T00:25:50.791436+0000","last_active":"2023-08-22T00:25:50.794328+0000","last_peered":"2023-08-22T00:25:50.794328+0000","last_clean":"2023-08-22T00:25:50.794328+0000","last_became_active":"2023-08-22T00:25:50.791126+0000","last_became_peered":"2023-08-22T00:25:50.791126+0000","last_unstale":"2023-08-22T00:25:50.794328+0000","last_undegraded":"2023-08-22T00:25:50.794328+0000","last_fullsized":"2023-08-22T00:25:50.794328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.770662+0000","last_change":"2023-08-22T00:25:50.415559+0000","last_active":"2023-08-22T00:25:50.770662+0000","last_peered":"2023-08-22T00:25:50.770662+0000","last_clean":"2023-08-22T00:25:50.770662+0000","last_became_active":"2023-08-22T00:25:50.415295+0000","last_became_peered":"2023-08-22T00:25:50.415295+0000","last_unstale":"2023-08-22T00:25:50.770662+0000","last_undegraded":"2023-08-22T00:25:50.770662+0000","last_fullsized":"2023-08-22T00:25:50.770662+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.796852+0000","last_change":"2023-08-22T00:25:50.793790+0000","last_active":"2023-08-22T00:25:50.796852+0000","last_peered":"2023-08-22T00:25:50.796852+0000","last_clean":"2023-08-22T00:25:50.796852+0000","last_became_active":"2023-08-22T00:25:50.792976+0000","last_became_peered":"2023-08-22T00:25:50.792976+0000","last_unstale":"2023-08-22T00:25:50.796852+0000","last_undegraded":"2023-08-22T00:25:50.796852+0000","last_fullsized":"2023-08-22T00:25:50.796852+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.778090+0000","last_change":"2023-08-22T00:25:50.405704+0000","last_active":"2023-08-22T00:25:50.778090+0000","last_peered":"2023-08-22T00:25:50.778090+0000","last_clean":"2023-08-22T00:25:50.778090+0000","last_became_active":"2023-08-22T00:25:50.405435+0000","last_became_peered":"2023-08-22T00:25:50.405435+0000","last_unstale":"2023-08-22T00:25:50.778090+0000","last_undegraded":"2023-08-22T00:25:50.778090+0000","last_fullsized":"2023-08-22T00:25:50.778090+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774895+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:25:50.774895+0000","last_peered":"2023-08-22T00:25:50.774895+0000","last_clean":"2023-08-22T00:25:50.774895+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:25:50.774895+0000","last_undegraded":"2023-08-22T00:25:50.774895+0000","last_fullsized":"2023-08-22T00:25:50.774895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.790192+0000","last_change":"2023-08-22T00:25:50.788298+0000","last_active":"2023-08-22T00:25:50.790192+0000","last_peered":"2023-08-22T00:25:50.790192+0000","last_clean":"2023-08-22T00:25:50.790192+0000","last_became_active":"2023-08-22T00:25:50.788024+0000","last_became_peered":"2023-08-22T00:25:50.788024+0000","last_unstale":"2023-08-22T00:25:50.790192+0000","last_undegraded":"2023-08-22T00:25:50.790192+0000","last_fullsized":"2023-08-22T00:25:50.790192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791901+0000","last_change":"2023-08-22T00:25:50.409563+0000","last_active":"2023-08-22T00:25:50.791901+0000","last_peered":"2023-08-22T00:25:50.791901+0000","last_clean":"2023-08-22T00:25:50.791901+0000","last_became_active":"2023-08-22T00:25:50.409270+0000","last_became_peered":"2023-08-22T00:25:50.409270+0000","last_unstale":"2023-08-22T00:25:50.791901+0000","last_undegraded":"2023-08-22T00:25:50.791901+0000","last_fullsized":"2023-08-22T00:25:50.791901+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.776102+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:25:50.776102+0000","last_peered":"2023-08-22T00:25:50.776102+0000","last_clean":"2023-08-22T00:25:50.776102+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:25:50.776102+0000","last_undegraded":"2023-08-22T00:25:50.776102+0000","last_fullsized":"2023-08-22T00:25:50.776102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.791629+0000","last_change":"2023-08-22T00:25:50.787267+0000","last_active":"2023-08-22T00:25:50.791629+0000","last_peered":"2023-08-22T00:25:50.791629+0000","last_clean":"2023-08-22T00:25:50.791629+0000","last_became_active":"2023-08-22T00:25:50.786979+0000","last_became_peered":"2023-08-22T00:25:50.786979+0000","last_unstale":"2023-08-22T00:25:50.791629+0000","last_undegraded":"2023-08-22T00:25:50.791629+0000","last_fullsized":"2023-08-22T00:25:50.791629+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.771536+0000","last_change":"2023-08-22T00:25:50.413254+0000","last_active":"2023-08-22T00:25:50.771536+0000","last_peered":"2023-08-22T00:25:50.771536+0000","last_clean":"2023-08-22T00:25:50.771536+0000","last_became_active":"2023-08-22T00:25:50.412869+0000","last_became_peered":"2023-08-22T00:25:50.412869+0000","last_unstale":"2023-08-22T00:25:50.771536+0000","last_undegraded":"2023-08-22T00:25:50.771536+0000","last_fullsized":"2023-08-22T00:25:50.771536+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.781392+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:25:50.781392+0000","last_peered":"2023-08-22T00:25:50.781392+0000","last_clean":"2023-08-22T00:25:50.781392+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:25:50.781392+0000","last_undegraded":"2023-08-22T00:25:50.781392+0000","last_fullsized":"2023-08-22T00:25:50.781392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.797751+0000","last_change":"2023-08-22T00:25:50.792491+0000","last_active":"2023-08-22T00:25:50.797751+0000","last_peered":"2023-08-22T00:25:50.797751+0000","last_clean":"2023-08-22T00:25:50.797751+0000","last_became_active":"2023-08-22T00:25:50.792221+0000","last_became_peered":"2023-08-22T00:25:50.792221+0000","last_unstale":"2023-08-22T00:25:50.797751+0000","last_undegraded":"2023-08-22T00:25:50.797751+0000","last_fullsized":"2023-08-22T00:25:50.797751+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"165'3","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.795377+0000","last_change":"2023-08-22T00:25:50.411962+0000","last_active":"2023-08-22T00:25:50.795377+0000","last_peered":"2023-08-22T00:25:50.795377+0000","last_clean":"2023-08-22T00:25:50.795377+0000","last_became_active":"2023-08-22T00:25:50.411654+0000","last_became_peered":"2023-08-22T00:25:50.411654+0000","last_unstale":"2023-08-22T00:25:50.795377+0000","last_undegraded":"2023-08-22T00:25:50.795377+0000","last_fullsized":"2023-08-22T00:25:50.795377+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.777375+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:25:50.777375+0000","last_peered":"2023-08-22T00:25:50.777375+0000","last_clean":"2023-08-22T00:25:50.777375+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:25:50.777375+0000","last_undegraded":"2023-08-22T00:25:50.777375+0000","last_fullsized":"2023-08-22T00:25:50.777375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782119+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:25:50.782119+0000","last_peered":"2023-08-22T00:25:50.782119+0000","last_clean":"2023-08-22T00:25:50.782119+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:25:50.782119+0000","last_undegraded":"2023-08-22T00:25:50.782119+0000","last_fullsized":"2023-08-22T00:25:50.782119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.804445+0000","last_change":"2023-08-22T00:25:50.803713+0000","last_active":"2023-08-22T00:25:50.804445+0000","last_peered":"2023-08-22T00:25:50.804445+0000","last_clean":"2023-08-22T00:25:50.804445+0000","last_became_active":"2023-08-22T00:25:50.802847+0000","last_became_peered":"2023-08-22T00:25:50.802847+0000","last_unstale":"2023-08-22T00:25:50.804445+0000","last_undegraded":"2023-08-22T00:25:50.804445+0000","last_fullsized":"2023-08-22T00:25:50.804445+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.783871+0000","last_change":"2023-08-22T00:25:50.413789+0000","last_active":"2023-08-22T00:25:50.783871+0000","last_peered":"2023-08-22T00:25:50.783871+0000","last_clean":"2023-08-22T00:25:50.783871+0000","last_became_active":"2023-08-22T00:25:50.413432+0000","last_became_peered":"2023-08-22T00:25:50.413432+0000","last_unstale":"2023-08-22T00:25:50.783871+0000","last_undegraded":"2023-08-22T00:25:50.783871+0000","last_fullsized":"2023-08-22T00:25:50.783871+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782036+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:25:50.782036+0000","last_peered":"2023-08-22T00:25:50.782036+0000","last_clean":"2023-08-22T00:25:50.782036+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:25:50.782036+0000","last_undegraded":"2023-08-22T00:25:50.782036+0000","last_fullsized":"2023-08-22T00:25:50.782036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.798497+0000","last_change":"2023-08-22T00:25:50.796123+0000","last_active":"2023-08-22T00:25:50.798497+0000","last_peered":"2023-08-22T00:25:50.798497+0000","last_clean":"2023-08-22T00:25:50.798497+0000","last_became_active":"2023-08-22T00:25:50.795810+0000","last_became_peered":"2023-08-22T00:25:50.795810+0000","last_unstale":"2023-08-22T00:25:50.798497+0000","last_undegraded":"2023-08-22T00:25:50.798497+0000","last_fullsized":"2023-08-22T00:25:50.798497+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.788155+0000","last_change":"2023-08-22T00:25:50.399144+0000","last_active":"2023-08-22T00:25:50.788155+0000","last_peered":"2023-08-22T00:25:50.788155+0000","last_clean":"2023-08-22T00:25:50.788155+0000","last_became_active":"2023-08-22T00:25:50.398654+0000","last_became_peered":"2023-08-22T00:25:50.398654+0000","last_unstale":"2023-08-22T00:25:50.788155+0000","last_undegraded":"2023-08-22T00:25:50.788155+0000","last_fullsized":"2023-08-22T00:25:50.788155+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.782727+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:25:50.782727+0000","last_peered":"2023-08-22T00:25:50.782727+0000","last_clean":"2023-08-22T00:25:50.782727+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:25:50.782727+0000","last_undegraded":"2023-08-22T00:25:50.782727+0000","last_fullsized":"2023-08-22T00:25:50.782727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.794766+0000","last_change":"2023-08-22T00:25:50.793142+0000","last_active":"2023-08-22T00:25:50.794766+0000","last_peered":"2023-08-22T00:25:50.794766+0000","last_clean":"2023-08-22T00:25:50.794766+0000","last_became_active":"2023-08-22T00:25:50.792825+0000","last_became_peered":"2023-08-22T00:25:50.792825+0000","last_unstale":"2023-08-22T00:25:50.794766+0000","last_undegraded":"2023-08-22T00:25:50.794766+0000","last_fullsized":"2023-08-22T00:25:50.794766+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"165'4","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.795672+0000","last_change":"2023-08-22T00:25:50.405142+0000","last_active":"2023-08-22T00:25:50.795672+0000","last_peered":"2023-08-22T00:25:50.795672+0000","last_clean":"2023-08-22T00:25:50.795672+0000","last_became_active":"2023-08-22T00:25:50.404853+0000","last_became_peered":"2023-08-22T00:25:50.404853+0000","last_unstale":"2023-08-22T00:25:50.795672+0000","last_undegraded":"2023-08-22T00:25:50.795672+0000","last_fullsized":"2023-08-22T00:25:50.795672+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774463+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:25:50.774463+0000","last_peered":"2023-08-22T00:25:50.774463+0000","last_clean":"2023-08-22T00:25:50.774463+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:25:50.774463+0000","last_undegraded":"2023-08-22T00:25:50.774463+0000","last_fullsized":"2023-08-22T00:25:50.774463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.789042+0000","last_change":"2023-08-22T00:25:50.783591+0000","last_active":"2023-08-22T00:25:50.789042+0000","last_peered":"2023-08-22T00:25:50.789042+0000","last_clean":"2023-08-22T00:25:50.789042+0000","last_became_active":"2023-08-22T00:25:50.783325+0000","last_became_peered":"2023-08-22T00:25:50.783325+0000","last_unstale":"2023-08-22T00:25:50.789042+0000","last_undegraded":"2023-08-22T00:25:50.789042+0000","last_fullsized":"2023-08-22T00:25:50.789042+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:50.378083+0000","last_clean_scrub_stamp":"2023-08-22T00:25:50.378083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774287+0000","last_change":"2023-08-22T00:25:50.410614+0000","last_active":"2023-08-22T00:25:50.774287+0000","last_peered":"2023-08-22T00:25:50.774287+0000","last_clean":"2023-08-22T00:25:50.774287+0000","last_became_active":"2023-08-22T00:25:50.410320+0000","last_became_peered":"2023-08-22T00:25:50.410320+0000","last_unstale":"2023-08-22T00:25:50.774287+0000","last_undegraded":"2023-08-22T00:25:50.774287+0000","last_fullsized":"2023-08-22T00:25:50.774287+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:25:49.373424+0000","last_clean_scrub_stamp":"2023-08-22T00:25:49.373424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-22T00:25:50.774628+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:25:50.774628+0000","last_peered":"2023-08-22T00:25:50.774628+0000","last_clean":"2023-08-22T00:25:50.774628+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:25:50.774628+0000","last_undegraded":"2023-08-22T00:25:50.774628+0000","last_fullsized":"2023-08-22T00:25:50.774628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1098549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.54600000000000004},"min":{"1min":0.312,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.33000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82799999999999996},"last":0.433}]},{"osd":2,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.80500000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.26500000000000001},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79000000000000004},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.80000000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.78100000000000003},"last":0.76900000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.75},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.308},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.85599999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307320,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064520,"statfs":{"total":96636764160,"available":96322068480,"internally_reserved":0,"allocated":2080768,"data_stored":1098625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.871},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.23499999999999999},"max":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.26300000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.35199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85299999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.29199999999999998},"max":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.432}]},{"osd":3,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.85699999999999998},"last":0.41399999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.26500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.47799999999999998,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47399999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.81200000000000006},"last":0.51100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":2068480,"data_stored":1098479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34499999999999997,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.443,"5min":1.4019999999999999,"15min":2.4470000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48299999999999998,"5min":1.2849999999999999,"15min":2.504},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35599999999999998,"15min":0.373},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.193},"max":{"1min":0.502,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.20200000000000001},"max":{"1min":0.49199999999999999,"5min":1.4379999999999999,"15min":2.4780000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.45600000000000002},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":1.4550000000000001,"15min":2.3460000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.22},"max":{"1min":0.52600000000000002,"5min":1.302,"15min":1.3280000000000001},"last":0.376}]},{"osd":4,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.67800000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":1.381,"15min":2.9620000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.24,"15min":1.24},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71899999999999997,"5min":1.175,"15min":2.2730000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":1.266,"15min":2.298},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":1.1559999999999999,"15min":2.3159999999999998},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"max":{"1min":0.80400000000000005,"5min":1.4199999999999999,"15min":2.992},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86699999999999999,"5min":1.2190000000000001,"15min":2.323},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575080,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303228,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":2084864,"data_stored":1099711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.76000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.65700000000000003},"last":0.28499999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":1.1850000000000001},"last":0.308},{"interface":"front","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.77900000000000003},"last":0.32000000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.373,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.67400000000000004},"last":0.38800000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":0.83299999999999996,"15min":0.88100000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":0.85199999999999998,"15min":0.89200000000000002},"last":0.63}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.871,"5min":0.95699999999999996,"15min":0.96399999999999997},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575081,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":2084864,"data_stored":1100569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.35799999999999998},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.42599999999999999,"5min":0.55900000000000005,"15min":0.56200000000000006},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.371,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":0.55400000000000005,"5min":1.216,"15min":1.216},"last":0.32500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.38300000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42999999999999999,"5min":0.57499999999999996,"15min":0.66900000000000004},"last":0.246}]},{"osd":3,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26500000000000001},"max":{"1min":0.46200000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.46200000000000002,"5min":0.753,"15min":0.753},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.0580000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":1.0169999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68799999999999994,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.624},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.88200000000000001,"15min":0.95199999999999996},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60599999999999998,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77400000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575080,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303220,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068620,"statfs":{"total":96636764160,"available":96326266880,"internally_reserved":0,"allocated":2076672,"data_stored":1099461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.182,"15min":0.182},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.252},{"interface":"front","average":{"1min":0.372,"5min":0.34200000000000003,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.28499999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.309},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.252},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.64900000000000002},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.92200000000000004},"last":0.64700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.96799999999999997},"last":0.624},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.90500000000000003,"15min":0.95699999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.63200000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.94399999999999995},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575080,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307312,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064528,"statfs":{"total":96636764160,"available":96322076672,"internally_reserved":0,"allocated":2072576,"data_stored":1098549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.505}]},{"osd":1,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.56799999999999995},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.746},"last":0.438},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47899999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.495}]},{"osd":5,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.38300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42499999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1098501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.56999999999999995},"min":{"1min":0.35199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.68700000000000006,"5min":0.78400000000000003,"15min":0.80600000000000005},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.749,"15min":0.78700000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50600000000000001,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.71399999999999997,"15min":0.81000000000000005},"last":0.45700000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.54300000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79100000000000004,"15min":0.79300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.314},"max":{"1min":0.61499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.88},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.80300000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.76500000000000001},"last":0.307}]},{"osd":6,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.78500000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":0.84199999999999997,"15min":0.84999999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.83299999999999996},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:25:59.580 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:25:59.581 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:25:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.734+0000 7f448a00a700 1 Processor -- start 2023-08-22T00:25:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.734+0000 7f448a00a700 1 -- start start 2023-08-22T00:25:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f448a00a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 0x7f44840c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f448a00a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 0x7f4484063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f448a00a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484063fb0 con 0x7f44840ad420 2023-08-22T00:25:59.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f448a00a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840c9040 con 0x7f44841548f0 2023-08-22T00:25:59.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f448a00a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484063500 con 0x7f44840ad040 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f4482ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f44840ad420 0x7f44841541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58484/0 (socket says 172.21.15.98:58484) 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f4482ffd700 1 -- 172.21.15.98:0/2034089529 learned_addr learned my addr 172.21.15.98:0/2034089529 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44837fe700 1 --2- 172.21.15.98:0/2034089529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 0x7f44840c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f4483fff700 1 --2- 172.21.15.98:0/2034089529 >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 0x7f4484063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44837fe700 1 -- 172.21.15.98:0/2034089529 >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 msgr2=0x7f4484063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44837fe700 1 --2- 172.21.15.98:0/2034089529 >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 0x7f4484063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44837fe700 1 -- 172.21.15.98:0/2034089529 >> v1:172.21.15.98:6789/0 conn(0x7f44840ad420 legacy=0x7f44841541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44827fc700 1 -- 172.21.15.98:0/2034089529 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288963042 0 0) 0x7f4484063fb0 con 0x7f44840ad420 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.735+0000 7f44837fe700 1 -- 172.21.15.98:0/2034089529 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484063710 con 0x7f44840ad040 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f4483fff700 1 --2- 172.21.15.98:0/2034089529 >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 0x7f4484063010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f44837fe700 1 --2- 172.21.15.98:0/2034089529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 0x7f44840c5df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4474009e60 tx=0x7f4474009780).ready entity=mon.2 client_cookie=942c9adda825fcd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f44827fc700 1 -- 172.21.15.98:0/2034089529 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400e070 con 0x7f44840ad040 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f44827fc700 1 -- 172.21.15.98:0/2034089529 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400bb60 con 0x7f44840ad040 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f44827fc700 1 -- 172.21.15.98:0/2034089529 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474012410 con 0x7f44840ad040 2023-08-22T00:25:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 -- 172.21.15.98:0/2034089529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 msgr2=0x7f44840c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 --2- 172.21.15.98:0/2034089529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 0x7f44840c5df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4474009e60 tx=0x7f4474009780).stop 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 -- 172.21.15.98:0/2034089529 shutdown_connections 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 --2- 172.21.15.98:0/2034089529 >> v2:172.21.15.118:3300/0 conn(0x7f44841548f0 0x7f4484063010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 --2- 172.21.15.98:0/2034089529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44840ad040 0x7f44840c5df0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 -- 172.21.15.98:0/2034089529 >> 172.21.15.98:0/2034089529 conn(0x7f44840cb600 msgr2=0x7f44840c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 -- 172.21.15.98:0/2034089529 shutdown_connections 2023-08-22T00:25:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.736+0000 7f448a00a700 1 -- 172.21.15.98:0/2034089529 wait complete. 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 Processor -- start 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 -- start start 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 0x7f44841553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 0x7f44841652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484156760 con 0x7f44840ad040 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44841558d0 con 0x7f44840ad420 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f448a00a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484155b50 con 0x7f44841548f0 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f44837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.738+0000 7f44837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48574/0 (socket says 172.21.15.98:48574) 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 -- 172.21.15.98:0/2958234242 learned_addr learned my addr 172.21.15.98:0/2958234242 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f4483fff700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 0x7f44841652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f4482ffd700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 0x7f44841553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 -- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 msgr2=0x7f44841652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 0x7f44841652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 -- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 msgr2=0x7f44841553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 0x7f44841553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 -- 172.21.15.98:0/2958234242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0092a0 con 0x7f44840ad040 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f4483fff700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 0x7f44841652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f4482ffd700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 0x7f44841553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:25:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f44837fe700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f44840c9180 tx=0x7f4474009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474007000 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447401d420 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447401d7e0 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4474009a20 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.739+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4484156110 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.740+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484083670 con 0x7f44840ad040 2023-08-22T00:25:59.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.740+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4474003040 con 0x7f44840ad040 2023-08-22T00:25:59.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.741+0000 7f447b7fe700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 0x7f44640612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:25:59.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.741+0000 7f4482ffd700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 0x7f44640612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:25:59.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.741+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f447407bd00 con 0x7f44840ad040 2023-08-22T00:25:59.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.741+0000 7f4482ffd700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 0x7f44640612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f446c007fd0 tx=0x7f446c009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:25:59.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.745+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f447404d010 con 0x7f44840ad040 2023-08-22T00:25:59.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.972+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4484156e60 con 0x7f44840ad040 2023-08-22T00:25:59.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.976+0000 7f447b7fe700 1 -- 172.21.15.98:0/2958234242 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4474050630 con 0x7f44840ad040 2023-08-22T00:25:59.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 msgr2=0x7f44640612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 0x7f44640612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f446c007fd0 tx=0x7f446c009040).stop 2023-08-22T00:25:59.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 msgr2=0x7f44840a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:25:59.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f44840c9180 tx=0x7f4474009780).stop 2023-08-22T00:25:59.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 shutdown_connections 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f446405ee10 0x7f44640612d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44841548f0 0x7f44841652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44840ad040 0x7f44840a9e30 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 --2- 172.21.15.98:0/2958234242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44840ad420 0x7f44841553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 >> 172.21.15.98:0/2958234242 conn(0x7f44840cb600 msgr2=0x7f4484152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 shutdown_connections 2023-08-22T00:25:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:25:59.978+0000 7f448a00a700 1 -- 172.21.15.98:0/2958234242 wait complete. 2023-08-22T00:25:59.982 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:25:59.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:26:00.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.110+0000 7f106b8e3700 1 Processor -- start 2023-08-22T00:26:00.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.110+0000 7f106b8e3700 1 -- start start 2023-08-22T00:26:00.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106b8e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106b8e3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1064153f10 0x7f10640c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106b8e3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10640c2220 con 0x7f10640c59b0 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106b8e3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640c1ef0 con 0x7f1064153f10 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106b8e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640c5e30 con 0x7f1064150040 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.111+0000 7f106967f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1064153f10 0x7f10640c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f106967f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:56910/0 (socket says 172.21.15.98:56910) 2023-08-22T00:26:00.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1069e80700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f10640c59b0 0x7f10640c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:34562/0 (socket says 172.21.15.98:34562) 2023-08-22T00:26:00.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f106967f700 1 -- 172.21.15.98:0/2718409650 learned_addr learned my addr 172.21.15.98:0/2718409650 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 -- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 msgr2=0x7f1064150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 -- 172.21.15.98:0/2718409650 >> v1:172.21.15.118:6789/0 conn(0x7f10640c59b0 legacy=0x7f10640c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f105bfff700 1 -- 172.21.15.98:0/2718409650 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265957136 0 0) 0x7f10640c2220 con 0x7f10640c59b0 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 -- 172.21.15.98:0/2718409650 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640c6110 con 0x7f1064153f10 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f106967f700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f1068e7e700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064153f10 0x7f10640c54c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f1060009790 tx=0x7f1060009060).ready entity=mon.1 client_cookie=cc494a4a8e36fb12 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f105bfff700 1 -- 172.21.15.98:0/2718409650 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000f510 con 0x7f1064153f10 2023-08-22T00:26:00.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f105bfff700 1 -- 172.21.15.98:0/2718409650 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000f670 con 0x7f1064153f10 2023-08-22T00:26:00.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.112+0000 7f105bfff700 1 -- 172.21.15.98:0/2718409650 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000f9f0 con 0x7f1064153f10 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 -- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064153f10 msgr2=0x7f10640c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064153f10 0x7f10640c54c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f1060009790 tx=0x7f1060009060).stop 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 -- 172.21.15.98:0/2718409650 shutdown_connections 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1064150040 0x7f1064150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2718409650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064153f10 0x7f10640c54c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 -- 172.21.15.98:0/2718409650 >> 172.21.15.98:0/2718409650 conn(0x7f10640c7140 msgr2=0x7f10640c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 -- 172.21.15.98:0/2718409650 shutdown_connections 2023-08-22T00:26:00.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.113+0000 7f106b8e3700 1 -- 172.21.15.98:0/2718409650 wait complete. 2023-08-22T00:26:00.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.114+0000 7f106b8e3700 1 Processor -- start 2023-08-22T00:26:00.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.114+0000 7f106b8e3700 1 -- start start 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10640c59b0 0x7f106414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 0x7f10640a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106414dfd0 con 0x7f1064153f10 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106414edc0 con 0x7f1064150040 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106414e1b0 con 0x7f10640c59b0 2023-08-22T00:26:00.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48586/0 (socket says 172.21.15.98:48586) 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 -- 172.21.15.98:0/2961538101 learned_addr learned my addr 172.21.15.98:0/2961538101 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106967f700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10640c59b0 0x7f106414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1068e7e700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 0x7f10640a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 -- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10640c59b0 msgr2=0x7f106414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10640c59b0 0x7f106414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 -- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 msgr2=0x7f10640a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 0x7f10640a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 -- 172.21.15.98:0/2961538101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009370 con 0x7f1064153f10 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1068e7e700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 0x7f10640a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f1069e80700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f105c00c840 tx=0x7f105c0014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c005c70 con 0x7f1064153f10 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c005dd0 con 0x7f1064153f10 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600092a0 con 0x7f1064153f10 2023-08-22T00:26:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.115+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c007360 con 0x7f1064153f10 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.116+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106414e7f0 con 0x7f1064153f10 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.116+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106414eb70 con 0x7f1064153f10 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.117+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f105c007750 con 0x7f1064153f10 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.117+0000 7f10597fa700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 0x7f10480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.117+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f105c079f00 con 0x7f1064153f10 2023-08-22T00:26:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.117+0000 7f106967f700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 0x7f10480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.118+0000 7f106967f700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 0x7f10480612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1054009340 tx=0x7f1054008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.121+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f105c04b210 con 0x7f1064153f10 2023-08-22T00:26:00.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.322+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f106414ef50 con 0x7f1064153f10 2023-08-22T00:26:00.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.323+0000 7f10597fa700 1 -- 172.21.15.98:0/2961538101 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f105c04e830 con 0x7f1064153f10 2023-08-22T00:26:00.325 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:26:00.325 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:26:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 msgr2=0x7f10480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 0x7f10480612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1054009340 tx=0x7f1054008040).stop 2023-08-22T00:26:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 msgr2=0x7f10640a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f105c00c840 tx=0x7f105c0014d0).stop 2023-08-22T00:26:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 shutdown_connections 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f104805ee10 0x7f10480612d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10640c59b0 0x7f106414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1064153f10 0x7f10640a5280 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 --2- 172.21.15.98:0/2961538101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1064150040 0x7f10640a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 >> 172.21.15.98:0/2961538101 conn(0x7f10640c7140 msgr2=0x7f10640bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 shutdown_connections 2023-08-22T00:26:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.325+0000 7f106b8e3700 1 -- 172.21.15.98:0/2961538101 wait complete. 2023-08-22T00:26:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:26:00.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:25:50.766928+0000', 'modified': '2023-08-22T00:25:53.771885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8826}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8826': {'gid': 8826, 'name': 'd', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/4180158445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 4180158445}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 4180158445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:26:00.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:26:00.747 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-22T00:26:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.865+0000 7f6cd7d78700 1 Processor -- start 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.865+0000 7f6cd7d78700 1 -- start start 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd7d78700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6cd014e280 0x7f6cd00654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd7d78700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6cd014e660 0x7f6cd00bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd7d78700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd0065050 con 0x7f6cd00be430 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd7d78700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd0064440 con 0x7f6cd014e280 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd7d78700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd0064720 con 0x7f6cd014e660 2023-08-22T00:26:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd5b14700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6cd014e280 0x7f6cd00654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd5b14700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6cd014e280 0x7f6cd00654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55026/0 (socket says 172.21.15.98:55026) 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd6315700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6cd00be430 0x7f6cd0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44742/0 (socket says 172.21.15.98:44742) 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.866+0000 7f6cd5b14700 1 -- 172.21.15.98:0/3765119101 learned_addr learned my addr 172.21.15.98:0/3765119101 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5313700 1 --2- 172.21.15.98:0/3765119101 >> v2:172.21.15.118:3300/0 conn(0x7f6cd014e660 0x7f6cd00bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5b14700 1 -- 172.21.15.98:0/3765119101 >> v2:172.21.15.118:3300/0 conn(0x7f6cd014e660 msgr2=0x7f6cd00bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/3765119101 >> v2:172.21.15.118:3300/0 conn(0x7f6cd014e660 0x7f6cd00bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5b14700 1 -- 172.21.15.98:0/3765119101 >> v1:172.21.15.98:6789/0 conn(0x7f6cd00be430 legacy=0x7f6cd0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5b14700 1 -- 172.21.15.98:0/3765119101 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0064a00 con 0x7f6cd014e280 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd4b12700 1 -- 172.21.15.98:0/3765119101 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951501656 0 0) 0x7f6cd0065050 con 0x7f6cd00be430 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/3765119101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e280 0x7f6cd00654e0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f6cd00682a0 tx=0x7f6cc00090f0).ready entity=mon.0 client_cookie=3d3bc9d1cb8f8ed0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd4b12700 1 -- 172.21.15.98:0/3765119101 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000b600 con 0x7f6cd014e280 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd4b12700 1 -- 172.21.15.98:0/3765119101 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc000b760 con 0x7f6cd014e280 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd4b12700 1 -- 172.21.15.98:0/3765119101 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000bae0 con 0x7f6cd014e280 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd7d78700 1 -- 172.21.15.98:0/3765119101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e280 msgr2=0x7f6cd00654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/3765119101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e280 0x7f6cd00654e0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f6cd00682a0 tx=0x7f6cc00090f0).stop 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.867+0000 7f6cd7d78700 1 -- 172.21.15.98:0/3765119101 shutdown_connections 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.868+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/3765119101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e280 0x7f6cd00654e0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.868+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/3765119101 >> v2:172.21.15.118:3300/0 conn(0x7f6cd014e660 0x7f6cd00bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.868+0000 7f6cd7d78700 1 -- 172.21.15.98:0/3765119101 >> 172.21.15.98:0/3765119101 conn(0x7f6cd00c7800 msgr2=0x7f6cd00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.868+0000 7f6cd7d78700 1 -- 172.21.15.98:0/3765119101 shutdown_connections 2023-08-22T00:26:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.868+0000 7f6cd7d78700 1 -- 172.21.15.98:0/3765119101 wait complete. 2023-08-22T00:26:00.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 Processor -- start 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 -- start start 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 0x7f6cd00bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6cd014e280 0x7f6cd00acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0168760 con 0x7f6cd014e660 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00aa8c0 con 0x7f6cd00be430 2023-08-22T00:26:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.869+0000 7f6cd7d78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00aaba0 con 0x7f6cd014e280 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55038/0 (socket says 172.21.15.98:55038) 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 -- 172.21.15.98:0/315600400 learned_addr learned my addr 172.21.15.98:0/315600400 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 0x7f6cd00bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd5313700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6cd014e280 0x7f6cd00acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 -- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6cd014e280 msgr2=0x7f6cd00acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6cd014e280 0x7f6cd00acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 -- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 msgr2=0x7f6cd00bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 0x7f6cd00bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 -- 172.21.15.98:0/315600400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0009370 con 0x7f6cd014e660 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 0x7f6cd00bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd6315700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f6cc800c810 tx=0x7f6cc8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cc5ffb700 1 -- 172.21.15.98:0/315600400 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8005c70 con 0x7f6cd014e660 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cc5ffb700 1 -- 172.21.15.98:0/315600400 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8005df0 con 0x7f6cd014e660 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd00aae80 con 0x7f6cd014e660 2023-08-22T00:26:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cc5ffb700 1 -- 172.21.15.98:0/315600400 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8007360 con 0x7f6cd014e660 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.870+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd00bf670 con 0x7f6cd014e660 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.871+0000 7f6cc5ffb700 1 -- 172.21.15.98:0/315600400 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6cc8007710 con 0x7f6cd014e660 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.872+0000 7f6cc5ffb700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 0x7f6cb40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.872+0000 7f6cc5ffb700 1 -- 172.21.15.98:0/315600400 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6cc8079f10 con 0x7f6cd014e660 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.872+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 0x7f6cb40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.872+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 0x7f6cb40612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6cc0009130 tx=0x7f6cc0017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.874+0000 7f6ce972cb80 1 Processor -- start 2023-08-22T00:26:00.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.874+0000 7f6ce972cb80 1 -- start start 2023-08-22T00:26:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64a2ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6496fdb0 con 0x557a64a7bf60 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64985030 con 0x557a64a332c0 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a64985170 con 0x557a64a2eaf0 2023-08-22T00:26:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55040/0 (socket says 172.21.15.98:55040) 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 -- 172.21.15.98:0/32573003 learned_addr learned my addr 172.21.15.98:0/32573003 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd6315700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64a2ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 -- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 msgr2=0x557a64a2ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64a2ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 -- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a332c0 msgr2=0x557a64a336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 -- 172.21.15.98:0/32573003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a64957b00 con 0x557a64a7bf60 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd6315700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64a2ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cd5313700 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f6ccc00d8e0 tx=0x7f6ccc008040).ready entity=mon.0 client_cookie=c784f4e835c4e035 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cbaffd700 1 -- 172.21.15.98:0/32573003 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00de80 con 0x557a64a7bf60 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cbaffd700 1 -- 172.21.15.98:0/32573003 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc00f6d0 con 0x557a64a7bf60 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.875+0000 7f6cbaffd700 1 -- 172.21.15.98:0/32573003 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00fa50 con 0x557a64a7bf60 2023-08-22T00:26:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 -- 172.21.15.98:0/32573003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 msgr2=0x557a64a2e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f6ccc00d8e0 tx=0x7f6ccc008040).stop 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 -- 172.21.15.98:0/32573003 shutdown_connections 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64a2ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/32573003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a7bf60 0x557a64a2e600 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 -- 172.21.15.98:0/32573003 >> 172.21.15.98:0/32573003 conn(0x557a6489d940 msgr2=0x557a64a7c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 -- 172.21.15.98:0/32573003 shutdown_connections 2023-08-22T00:26:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.876+0000 7f6ce972cb80 1 -- 172.21.15.98:0/32573003 wait complete. 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.877+0000 7f6ce972cb80 1 -- start start 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.877+0000 7f6ce972cb80 1 Processor -- start 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a649853f0 con 0x557a64a2eaf0 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64950920 con 0x557a64a7bf60 2023-08-22T00:26:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a64a5c190 con 0x557a64a332c0 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 10 client.0 ll_register_callbacks cb 0x557a64925ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55050/0 (socket says 172.21.15.98:55050) 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 -- 172.21.15.98:0/340788721 learned_addr learned my addr 172.21.15.98:0/340788721 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 -- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 msgr2=0x557a64a773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 -- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 msgr2=0x557a64a778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd6315700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a778d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 -- 172.21.15.98:0/340788721 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc00e040 con 0x557a64a2eaf0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f6cd0062b90 tx=0x7f6cc001f070).ready entity=mon.0 client_cookie=9cedb6708114ba88 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6caffff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0027610 con 0x557a64a2eaf0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6cc0027770 con 0x557a64a2eaf0 2023-08-22T00:26:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a64a2daa0 con 0x557a64a2eaf0 2023-08-22T00:26:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc0027930 con 0x557a64a2eaf0 2023-08-22T00:26:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 10 client.8988 fetch_fsmap learned FSMap version 62 2023-08-22T00:26:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.878+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x557a6497df70 con 0x557a64a2eaf0 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a64a2daa0 con 0x557a64a2eaf0 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6cc0027a90 con 0x557a64a2eaf0 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 10 client.8988 fetch_fsmap finished waiting for FSMap version 62 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 10 client.8988 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 20 client.8988 populate_metadata read hostname 'smithi098' 2023-08-22T00:26:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a5a880 0x557a64a5ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 4 client.8988 mds_command: new command op to 8826 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:26:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 --> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a647edef0 con 0x557a64a5a880 2023-08-22T00:26:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.879+0000 7f6cd5313700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a5a880 0x557a64a5ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6caffff700 10 client.8988 ms_handle_connect on v2:172.21.15.118:6833/4180158445 2023-08-22T00:26:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6cd5313700 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a5a880 0x557a64a5ac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=806fde16defe054a server_cookie=f26c4fe9803760cc in_seq=0 out_seq=0 2023-08-22T00:26:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6caffff700 1 -- 172.21.15.98:0/340788721 <== mds.0 v2:172.21.15.118:6833/4180158445 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557a647edef0 con 0x557a64a5a880 2023-08-22T00:26:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6caffff700 10 client.8988 handle_command_reply: tid=0 2023-08-22T00:26:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 client.8988 shutdown 2023-08-22T00:26:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 msgr2=0x557a64a536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f6cd0062b90 tx=0x7f6cc001f070).stop 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 shutdown_connections 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a5a880 0x557a64a5ac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a536e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6caffff700 0 client.8988 ms_handle_reset on v2:172.21.15.118:6833/4180158445 2023-08-22T00:26:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/340788721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 >> 172.21.15.98:0/340788721 conn(0x557a6489d940 msgr2=0x557a64a336a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 shutdown_connections 2023-08-22T00:26:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.880+0000 7f6ce972cb80 1 -- 172.21.15.98:0/340788721 wait complete. 2023-08-22T00:26:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.881+0000 7f6ce972cb80 20 client.8988 trim_cache size 0 max 16384 2023-08-22T00:26:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 Processor -- start 2023-08-22T00:26:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 -- start start 2023-08-22T00:26:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a33b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64a54f90 con 0x557a64a2eaf0 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64a34080 con 0x557a64a7bf60 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.897+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a64a87c20 con 0x557a64a332c0 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55052/0 (socket says 172.21.15.98:55052) 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 -- 172.21.15.98:0/139204880 learned_addr learned my addr 172.21.15.98:0/139204880 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd6315700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a33b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5313700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 -- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 msgr2=0x557a64a336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 -- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 msgr2=0x557a64a33b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a33b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 -- 172.21.15.98:0/139204880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a64979580 con 0x557a64a2eaf0 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5313700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f6cc00091e0 tx=0x7f6cc0029070).ready entity=mon.0 client_cookie=e029b9e12631961c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cbb7fe700 1 -- 172.21.15.98:0/139204880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000bcb0 con 0x557a64a2eaf0 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cbb7fe700 1 -- 172.21.15.98:0/139204880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0027610 con 0x557a64a2eaf0 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.898+0000 7f6cbb7fe700 1 -- 172.21.15.98:0/139204880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0027990 con 0x557a64a2eaf0 2023-08-22T00:26:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- 172.21.15.98:0/139204880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 msgr2=0x557a64a533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f6cc00091e0 tx=0x7f6cc0029070).stop 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- 172.21.15.98:0/139204880 shutdown_connections 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a33b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a2eaf0 0x557a64a533d0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/139204880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a332c0 0x557a64a336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- 172.21.15.98:0/139204880 >> 172.21.15.98:0/139204880 conn(0x557a6489d940 msgr2=0x557a64a7c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- 172.21.15.98:0/139204880 shutdown_connections 2023-08-22T00:26:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- 172.21.15.98:0/139204880 wait complete. 2023-08-22T00:26:00.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 -- start start 2023-08-22T00:26:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.899+0000 7f6ce972cb80 1 Processor -- start 2023-08-22T00:26:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64adccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a75590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64a75a80 con 0x557a64a332c0 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a64a565c0 con 0x557a64a7bf60 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a64a913f0 con 0x557a64a2eaf0 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6ce972cb80 10 client.0 ll_register_callbacks cb 0x557a64925ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6cd5313700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6cd5313700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55068/0 (socket says 172.21.15.98:55068) 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6cd5313700 1 -- 172.21.15.98:0/3718114641 learned_addr learned my addr 172.21.15.98:0/3718114641 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64adccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.900+0000 7f6cd6315700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a75590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 -- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 msgr2=0x557a64adccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64adccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 -- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 msgr2=0x557a64a75590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a75590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 -- 172.21.15.98:0/3718114641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a6497df70 con 0x557a64a332c0 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5313700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f6ccc00d750 tx=0x7f6ccc025280).ready entity=mon.0 client_cookie=834301a73b394175 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc025070 con 0x557a64a332c0 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6ccc01d400 con 0x557a64a332c0 2023-08-22T00:26:00.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ccc00f6d0 con 0x557a64a332c0 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ccc01d7d0 con 0x557a64a332c0 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 10 client.8994 fetch_fsmap learned FSMap version 62 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x557a649792d0 con 0x557a64a332c0 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc00f6d0 con 0x557a64a332c0 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6ccc01d930 con 0x557a64a332c0 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 10 client.8994 fetch_fsmap finished waiting for FSMap version 62 2023-08-22T00:26:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 10 client.8994 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:26:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 20 client.8994 populate_metadata read hostname 'smithi098' 2023-08-22T00:26:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a555d0 0x557a64a559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 4 client.8994 mds_command: new command op to 8826 tid=0[{"prefix": "status"}] 2023-08-22T00:26:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 --> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a64823040 con 0x557a64a555d0 2023-08-22T00:26:00.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.901+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a555d0 0x557a64a559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6caffff700 10 client.8994 ms_handle_connect on v2:172.21.15.118:6833/4180158445 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6cd5b14700 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a555d0 0x557a64a559b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb63a6d1892f30a5 server_cookie=be8a6fbceb34d445 in_seq=0 out_seq=0 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6caffff700 1 -- 172.21.15.98:0/3718114641 <== mds.0 v2:172.21.15.118:6833/4180158445 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557a64823040 con 0x557a64a555d0 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6caffff700 10 client.8994 handle_command_reply: tid=0 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 client.8994 shutdown 2023-08-22T00:26:00.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 msgr2=0x557a64a750a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f6ccc00d750 tx=0x7f6ccc025280).stop 2023-08-22T00:26:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 shutdown_connections 2023-08-22T00:26:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:6833/4180158445,v1:172.21.15.118:6835/4180158445] conn(0x557a64a555d0 0x557a64a559b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557a64a2eaf0 0x557a64adccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a64a7bf60 0x557a64a75590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6caffff700 0 client.8994 ms_handle_reset on v2:172.21.15.118:6833/4180158445 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 --2- 172.21.15.98:0/3718114641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a64a332c0 0x557a64a750a0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 >> 172.21.15.98:0/3718114641 conn(0x557a6489d940 msgr2=0x557a64a7c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 shutdown_connections 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 1 -- 172.21.15.98:0/3718114641 wait complete. 2023-08-22T00:26:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.902+0000 7f6ce972cb80 20 client.8994 trim_cache size 0 max 16384 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 8826, 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:26:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 10.134403819999999, 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 62, 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 166, 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 166, 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.630381435 2023-08-22T00:26:00.922 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:26:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 msgr2=0x7f6cb40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 0x7f6cb40612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6cc0009130 tx=0x7f6cc0017000).stop 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 msgr2=0x7f6cd01491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f6cc800c810 tx=0x7f6cc8007f30).stop 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 shutdown_connections 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd014e660 0x7f6cd01491c0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd00be430 0x7f6cd00bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f6cb405ee10 0x7f6cb40612d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 --2- 172.21.15.98:0/315600400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6cd014e280 0x7f6cd00acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 >> 172.21.15.98:0/315600400 conn(0x7f6cd00c7800 msgr2=0x7f6cd0149f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 shutdown_connections 2023-08-22T00:26:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:00.903+0000 7f6cd7d78700 1 -- 172.21.15.98:0/315600400 wait complete. 2023-08-22T00:26:00.928 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:26:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.031+0000 7f7457c3c700 1 Processor -- start 2023-08-22T00:26:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.031+0000 7f7457c3c700 1 -- start start 2023-08-22T00:26:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f7457c3c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f7457c3c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74500c4180 0x7f74500c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f7457c3c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500c37d0 con 0x7f7450154540 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f7457c3c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500c4ad0 con 0x7f74500c4180 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f7457c3c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500c2bc0 con 0x7f7450150960 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74551d7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74500c4180 0x7f74500c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74561d9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7450154540 0x7f74501549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44754/0 (socket says 172.21.15.98:44754) 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74551d7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74500c4180 0x7f74500c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55082/0 (socket says 172.21.15.98:55082) 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74561d9700 1 -- 172.21.15.98:0/2567322866 learned_addr learned my addr 172.21.15.98:0/2567322866 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:26:01.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74559d8700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74551d7700 1 -- 172.21.15.98:0/2567322866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 msgr2=0x7f74501519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74551d7700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74551d7700 1 -- 172.21.15.98:0/2567322866 >> v1:172.21.15.98:6789/0 conn(0x7f7450154540 legacy=0x7f74501549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.032+0000 7f74549d6700 1 -- 172.21.15.98:0/2567322866 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738943523 0 0) 0x7f74500c37d0 con 0x7f7450154540 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f74551d7700 1 -- 172.21.15.98:0/2567322866 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500c2ea0 con 0x7f74500c4180 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f74551d7700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f74500c45e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f744c009760 tx=0x7f744c009060).ready entity=mon.0 client_cookie=b0d49cafe9a61d73 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f74549d6700 1 -- 172.21.15.98:0/2567322866 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00b580 con 0x7f74500c4180 2023-08-22T00:26:01.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f74549d6700 1 -- 172.21.15.98:0/2567322866 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00b6e0 con 0x7f74500c4180 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f74549d6700 1 -- 172.21.15.98:0/2567322866 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00ba60 con 0x7f74500c4180 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 -- 172.21.15.98:0/2567322866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 msgr2=0x7f74500c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f74500c45e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f744c009760 tx=0x7f744c009060).stop 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 -- 172.21.15.98:0/2567322866 shutdown_connections 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 --2- 172.21.15.98:0/2567322866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f74500c45e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 -- 172.21.15.98:0/2567322866 >> 172.21.15.98:0/2567322866 conn(0x7f7450063ee0 msgr2=0x7f7450090a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:01.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 -- 172.21.15.98:0/2567322866 shutdown_connections 2023-08-22T00:26:01.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.033+0000 7f7457c3c700 1 -- 172.21.15.98:0/2567322866 wait complete. 2023-08-22T00:26:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.035+0000 7f7457c3c700 1 Processor -- start 2023-08-22T00:26:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.035+0000 7f7457c3c700 1 -- start start 2023-08-22T00:26:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 0x7f74500a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450149580 con 0x7f74500c4180 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501490b0 con 0x7f7450154540 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f7457c3c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500a4810 con 0x7f7450150960 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55090/0 (socket says 172.21.15.98:55090) 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 -- 172.21.15.98:0/1785408186 learned_addr learned my addr 172.21.15.98:0/1785408186 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74561d9700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 0x7f74500a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74551d7700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 -- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 msgr2=0x7f74501606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 -- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 msgr2=0x7f74500a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 0x7f74500a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 -- 172.21.15.98:0/1785408186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0092a0 con 0x7f74500c4180 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74561d9700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 0x7f74500a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:26:01.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.036+0000 7f74559d8700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f744000d890 tx=0x7f7440008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.037+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400125f0 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.037+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440012750 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.037+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7450160b90 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.037+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440012ad0 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.037+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74500a76a0 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.038+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7450047480 con 0x7f74500c4180 2023-08-22T00:26:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.038+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7440013480 con 0x7f74500c4180 2023-08-22T00:26:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.038+0000 7f7445ffb700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 0x7f74340612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.039+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7440079d50 con 0x7f74500c4180 2023-08-22T00:26:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.039+0000 7f74551d7700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 0x7f74340612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.039+0000 7f74551d7700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 0x7f74340612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f744c009760 tx=0x7f744c017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.043+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f744007d030 con 0x7f74500c4180 2023-08-22T00:26:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.242+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74500c3180 con 0x7f74500c4180 2023-08-22T00:26:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.242+0000 7f7445ffb700 1 -- 172.21.15.98:0/1785408186 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f744004b000 con 0x7f74500c4180 2023-08-22T00:26:01.244 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:26:01.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 msgr2=0x7f74340612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 0x7f74340612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f744c009760 tx=0x7f744c017000).stop 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 msgr2=0x7f7450148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f744000d890 tx=0x7f7440008040).stop 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 shutdown_connections 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7450154540 0x7f74500a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74500c4180 0x7f7450148bc0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f743405ee10 0x7f74340612d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 --2- 172.21.15.98:0/1785408186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7450150960 0x7f74501606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 >> 172.21.15.98:0/1785408186 conn(0x7f7450063ee0 msgr2=0x7f74500c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 shutdown_connections 2023-08-22T00:26:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:01.244+0000 7f7457c3c700 1 -- 172.21.15.98:0/1785408186 wait complete. 2023-08-22T00:26:01.265 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:26:01.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:26:01.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:26:01.266 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:26:01.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:01.266 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:26:01.267 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:26:01.267 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:26:01.267 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:26:01.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.268 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:26:01.289 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:26:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:26:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:26:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:26:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41344sec preferred_lft 41344sec 2023-08-22T00:26:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:26:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:26:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:26:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:26:01.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.294 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:26:01.357 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:26:01.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.358 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:26:01.420 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:26:01.420 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:26:01.421 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:26:01.421 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:26:01.421 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:26:01.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.422 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:26:01.422 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:26:01.422 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:26:01.422 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:26:01.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:26:01.423 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:26:01.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.526 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:26:01.547 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:26:01.547 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:26:01.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:26:01.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:26:01.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:26:01.619 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:26:01.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:01.620 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:01.681 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:26:01.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:26:01.752 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:26:01.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:26:01.819 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:26:01.820 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:26:01.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:01.821 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:26:01.880 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:26:01.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:01.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:26:01.951 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:26:01.952 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:26:02.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:26:02.005+0000 7f18173af3c0 -1 init, newargv = 0x555eacb45a10 newargc=15 2023-08-22T00:26:02.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[168033]: starting ceph client 2023-08-22T00:26:02.013 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[168033]: starting fuse 2023-08-22T00:26:02.020 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:26:02.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:26:02.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:02.022 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:26:02.082 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:26:02.083 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:26:02.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:26:02.086 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:26:02.087 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:26:02.088 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:26:02.089 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:26:02.091 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:26:02.092 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:26:02.092 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:26:02.092 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:26:02.093 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:26:02.093 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:26:02.093 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:26:02.094 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:26:02.094 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:26:02.094 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:26:02.094 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:26:02.095 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:26:02.095 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:26:02.095 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:26:02.096 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:26:02.096 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:26:02.096 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:26:02.097 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:26:02.097 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:26:02.097 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:26:02.097 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:26:02.098 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:26:02.206 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.168033.asok 2023-08-22T00:26:02.388 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.168033.asok 2023-08-22T00:26:02.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:02.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.168033.asok status 2023-08-22T00:26:02.542 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:26:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:26:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "168033", 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:26:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 9006, 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:26:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 9006 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1821731923 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:26:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1821731923 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.9006 192.168.0.1:0/1821731923", 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/1821731923", 2023-08-22T00:26:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 62, 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 166, 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:26:02.547 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:26:02.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:02.549 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:26:02.549 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:02.568 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:26:02.569 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:02.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:02.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:26:02.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:26:02.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 Processor -- start 2023-08-22T00:26:02.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 -- start start 2023-08-22T00:26:02.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81ac150750 0x7f81ac150b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81ac065870 0x7f81ac0a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac067590 con 0x7f81ac065870 2023-08-22T00:26:02.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac067870 con 0x7f81ac150750 2023-08-22T00:26:02.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.793+0000 7f81b1d57700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac067b50 con 0x7f81ac0bdec0 2023-08-22T00:26:02.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81ac065870 0x7f81ac0a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81ac065870 0x7f81ac0a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55092/0 (socket says 172.21.15.98:55092) 2023-08-22T00:26:02.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 -- 172.21.15.98:0/276812581 learned_addr learned my addr 172.21.15.98:0/276812581 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81ab7fe700 1 --2- 172.21.15.98:0/276812581 >> v2:172.21.15.118:3300/0 conn(0x7f81ac150750 0x7f81ac150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81abfff700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 -- 172.21.15.98:0/276812581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 msgr2=0x7f81ac0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 -- 172.21.15.98:0/276812581 >> v2:172.21.15.118:3300/0 conn(0x7f81ac150750 msgr2=0x7f81ac150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 --2- 172.21.15.98:0/276812581 >> v2:172.21.15.118:3300/0 conn(0x7f81ac150750 0x7f81ac150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 -- 172.21.15.98:0/276812581 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac067e30 con 0x7f81ac065870 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81abfff700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aaffd700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac065870 0x7f81ac0a73b0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f81ac069320 tx=0x7f81a00090f0).ready entity=mon.0 client_cookie=b0fe75bfdfd20c3e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aa7fc700 1 -- 172.21.15.98:0/276812581 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a000b520 con 0x7f81ac065870 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aa7fc700 1 -- 172.21.15.98:0/276812581 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a000b680 con 0x7f81ac065870 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.794+0000 7f81aa7fc700 1 -- 172.21.15.98:0/276812581 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a000ba00 con 0x7f81ac065870 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 -- 172.21.15.98:0/276812581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac065870 msgr2=0x7f81ac0a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:02.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac065870 0x7f81ac0a73b0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f81ac069320 tx=0x7f81a00090f0).stop 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 -- 172.21.15.98:0/276812581 shutdown_connections 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 --2- 172.21.15.98:0/276812581 >> v2:172.21.15.118:3300/0 conn(0x7f81ac150750 0x7f81ac150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 --2- 172.21.15.98:0/276812581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac065870 0x7f81ac0a73b0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 -- 172.21.15.98:0/276812581 >> 172.21.15.98:0/276812581 conn(0x7f81ac0c7800 msgr2=0x7f81ac0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 -- 172.21.15.98:0/276812581 shutdown_connections 2023-08-22T00:26:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.795+0000 7f81b1d57700 1 -- 172.21.15.98:0/276812581 wait complete. 2023-08-22T00:26:02.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.796+0000 7f81b1d57700 1 Processor -- start 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.796+0000 7f81b1d57700 1 -- start start 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81ac065870 0x7f81ac160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0abfc0 con 0x7f81ac150750 2023-08-22T00:26:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0ac450 con 0x7f81ac065870 2023-08-22T00:26:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81b1d57700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0ab0e0 con 0x7f81ac0bdec0 2023-08-22T00:26:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55102/0 (socket says 172.21.15.98:55102) 2023-08-22T00:26:02.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.797+0000 7f81abfff700 1 -- 172.21.15.98:0/569936122 learned_addr learned my addr 172.21.15.98:0/569936122 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:02.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81ab7fe700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81ac065870 0x7f81ac160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81aaffd700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 -- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 msgr2=0x7f81ac0aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:02.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 -- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81ac065870 msgr2=0x7f81ac160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:02.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81ac065870 0x7f81ac160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 -- 172.21.15.98:0/569936122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0009370 con 0x7f81ac150750 2023-08-22T00:26:02.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81abfff700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f81a400d180 tx=0x7f81a4009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:02.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400de20 con 0x7f81ac150750 2023-08-22T00:26:02.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a400f040 con 0x7f81ac150750 2023-08-22T00:26:02.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac0ab3b0 con 0x7f81ac150750 2023-08-22T00:26:02.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4013600 con 0x7f81ac150750 2023-08-22T00:26:02.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.798+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac0ab970 con 0x7f81ac150750 2023-08-22T00:26:02.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.799+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac0ac170 con 0x7f81ac150750 2023-08-22T00:26:02.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.799+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f81a40139f0 con 0x7f81ac150750 2023-08-22T00:26:02.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.800+0000 7f81937fe700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 0x7f81980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:02.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.800+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f81a407a710 con 0x7f81ac150750 2023-08-22T00:26:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.800+0000 7f81ab7fe700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 0x7f81980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:02.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.800+0000 7f81ab7fe700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 0x7f81980612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f81ac0c0c10 tx=0x7f819c008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:02.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.804+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81a404b9c0 con 0x7f81ac150750 2023-08-22T00:26:02.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.991+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f81ac0a78a0 con 0x7f819805ee10 2023-08-22T00:26:02.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.992+0000 7f81937fe700 1 -- 172.21.15.98:0/569936122 <== mgr.6914 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f81ac0a78a0 con 0x7f819805ee10 2023-08-22T00:26:02.993 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:26:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:26:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:26:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:26:02.994 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 msgr2=0x7f81980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 0x7f81980612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f81ac0c0c10 tx=0x7f819c008040).stop 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 msgr2=0x7f81ac14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f81a400d180 tx=0x7f81a4009a50).stop 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 shutdown_connections 2023-08-22T00:26:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac150750 0x7f81ac14e040 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81ac065870 0x7f81ac160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f819805ee10 0x7f81980612d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 --2- 172.21.15.98:0/569936122 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81ac0bdec0 0x7f81ac0aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 >> 172.21.15.98:0/569936122 conn(0x7f81ac0c7800 msgr2=0x7f81ac0a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 shutdown_connections 2023-08-22T00:26:02.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:02.994+0000 7f81b1d57700 1 -- 172.21.15.98:0/569936122 wait complete. 2023-08-22T00:26:03.009 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:26:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.126+0000 7fb23f395700 1 Processor -- start 2023-08-22T00:26:03.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 -- start start 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb238139c60 0x7fb2380c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb238062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380c6770 con 0x7fb238139880 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2380c3610 con 0x7fb238139c60 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.127+0000 7fb23f395700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c2990 con 0x7fb2380c62c0 2023-08-22T00:26:03.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23d131700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb238139880 0x7fb238154850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44756/0 (socket says 172.21.15.98:44756) 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23d131700 1 -- 172.21.15.98:0/3783174146 learned_addr learned my addr 172.21.15.98:0/3783174146 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23c930700 1 --2- 172.21.15.98:0/3783174146 >> v2:172.21.15.118:3300/0 conn(0x7fb238139c60 0x7fb2380c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23d932700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb238062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127360058 0 0) 0x7fb228001110 con 0x7fb238139880 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2240033f0 con 0x7fb238139880 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2822361500 0 0) 0x7fb2240033f0 con 0x7fb238139880 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 msgr2=0x7fb238062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:03.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb238062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 >> v2:172.21.15.118:3300/0 conn(0x7fb238139c60 msgr2=0x7fb2380c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 --2- 172.21.15.98:0/3783174146 >> v2:172.21.15.118:3300/0 conn(0x7fb238139c60 0x7fb2380c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380c2c70 con 0x7fb238139880 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb228001600 con 0x7fb238139880 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 >> v1:172.21.15.98:6789/0 conn(0x7fb238139880 legacy=0x7fb238154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb224003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb224004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb224004b80 0x7fb224005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c3610 con 0x7fb2240038e0 2023-08-22T00:26:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c2990 con 0x7fb224004b80 2023-08-22T00:26:03.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22400b8e0 con 0x7fb2380c62c0 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23d131700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb224003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23d932700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb224004b80 0x7fb224005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.128+0000 7fb23c930700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb224004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 -- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 msgr2=0x7fb224004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb224004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 -- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb224004b80 msgr2=0x7fb224005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:03.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb224004b80 0x7fb224005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 -- 172.21.15.98:0/3783174146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240033f0 con 0x7fb2240038e0 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23c930700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2380c62c0 0x7fb224004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d131700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb224003d00 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fb22800c340 tx=0x7fb228007900).ready entity=mon.0 client_cookie=57fb2e47f74b99a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228007bf0 con 0x7fb2240038e0 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800cc70 con 0x7fb2240038e0 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb22ffff700 1 -- 172.21.15.98:0/3783174146 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280070d0 con 0x7fb2240038e0 2023-08-22T00:26:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 -- 172.21.15.98:0/3783174146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 msgr2=0x7fb224003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 --2- 172.21.15.98:0/3783174146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb224003d00 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fb22800c340 tx=0x7fb228007900).stop 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23d932700 1 -- 172.21.15.98:0/3783174146 reap_dead start 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 -- 172.21.15.98:0/3783174146 shutdown_connections 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 -- 172.21.15.98:0/3783174146 >> 172.21.15.98:0/3783174146 conn(0x7fb2380c3a60 msgr2=0x7fb2380c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 -- 172.21.15.98:0/3783174146 shutdown_connections 2023-08-22T00:26:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.129+0000 7fb23f395700 1 -- 172.21.15.98:0/3783174146 wait complete. 2023-08-22T00:26:03.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.130+0000 7fb23f395700 1 Processor -- start 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 -- start start 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 0x7fb2381686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 0x7fb2380ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380a46a0 con 0x7fb2240038e0 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238168bd0 con 0x7fb2380abf30 2023-08-22T00:26:03.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.131+0000 7fb23f395700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381522f0 con 0x7fb238135b40 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55114/0 (socket says 172.21.15.98:55114) 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 -- 172.21.15.98:0/3616774531 learned_addr learned my addr 172.21.15.98:0/3616774531 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d932700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 0x7fb2380ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23c930700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 0x7fb2381686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 -- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 msgr2=0x7fb2381686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 0x7fb2381686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 -- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 msgr2=0x7fb2380ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 0x7fb2380ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 -- 172.21.15.98:0/3616774531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238135fc0 con 0x7fb2240038e0 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d932700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 0x7fb2380ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23c930700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 0x7fb2381686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23d131700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fb22800c930 tx=0x7fb228015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228001920 con 0x7fb2240038e0 2023-08-22T00:26:03.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280046b0 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380ac8a0 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228004a30 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.132+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380a4b70 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.133+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380aceb0 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.133+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 71) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb228020450 con 0x7fb2240038e0 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.134+0000 7fb22d7fa700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 0x7fb21c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:03.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.134+0000 7fb23c930700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 0x7fb21c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:03.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.134+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb22807aa60 con 0x7fb2240038e0 2023-08-22T00:26:03.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.134+0000 7fb23c930700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 0x7fb21c0612f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb234006c20 tx=0x7fb234008040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:03.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.138+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb22804bd10 con 0x7fb2240038e0 2023-08-22T00:26:03.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.340+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb2380c6770 con 0x7fb2240038e0 2023-08-22T00:26:03.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.985+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 72) v1 ==== 75289+0+0 (secure 0 0 0) 0x7fb2280786d0 con 0x7fb2240038e0 2023-08-22T00:26:03.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.987+0000 7fb22d7fa700 1 -- 172.21.15.98:0/3616774531 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v72) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb2280421a0 con 0x7fb2240038e0 2023-08-22T00:26:03.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 msgr2=0x7fb21c0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 0x7fb21c0612f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb234006c20 tx=0x7fb234008040).stop 2023-08-22T00:26:03.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 msgr2=0x7fb2380a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:03.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fb22800c930 tx=0x7fb228015000).stop 2023-08-22T00:26:03.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 shutdown_connections 2023-08-22T00:26:03.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2380abf30 0x7fb2380ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2240038e0 0x7fb2380a41b0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7fb21c05ee30 0x7fb21c0612f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 --2- 172.21.15.98:0/3616774531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb238135b40 0x7fb2381686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 >> 172.21.15.98:0/3616774531 conn(0x7fb2380c3a60 msgr2=0x7fb238062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 shutdown_connections 2023-08-22T00:26:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:03.989+0000 7fb23f395700 1 -- 172.21.15.98:0/3616774531 wait complete. 2023-08-22T00:26:04.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:26:04.129 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:04.126+0000 7ff47b0b0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:26:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.133+0000 7f9e35e54700 1 Processor -- start 2023-08-22T00:26:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.133+0000 7f9e35e54700 1 -- start start 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e35e54700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e3014fd90 0x7f9e300675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e35e54700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e35e54700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e301525d0 con 0x7f9e30153010 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e35e54700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e30152b80 con 0x7f9e3014fd90 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e35e54700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c4330 con 0x7f9e300c39d0 2023-08-22T00:26:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e3014fd90 0x7f9e300675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9e3014fd90 0x7f9e300675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55134/0 (socket says 172.21.15.98:55134) 2023-08-22T00:26:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 -- 172.21.15.98:0/3571265742 learned_addr learned my addr 172.21.15.98:0/3571265742 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2ffff700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.138 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:04.134+0000 7fe391c17680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:26:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 -- 172.21.15.98:0/3571265742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 msgr2=0x7f9e300c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 -- 172.21.15.98:0/3571265742 >> v1:172.21.15.118:6789/0 conn(0x7f9e30153010 legacy=0x7f9e300a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 -- 172.21.15.98:0/3571265742 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30067bd0 con 0x7f9e3014fd90 2023-08-22T00:26:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2f7fe700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e300675f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f9e20009f20 tx=0x7f9e20009840).ready entity=mon.0 client_cookie=5ec7312c53bf642e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.134+0000 7f9e2e7fc700 1 -- 172.21.15.98:0/3571265742 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000e070 con 0x7f9e3014fd90 2023-08-22T00:26:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e2e7fc700 1 -- 172.21.15.98:0/3571265742 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2000b9d0 con 0x7f9e3014fd90 2023-08-22T00:26:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e2e7fc700 1 -- 172.21.15.98:0/3571265742 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000bd50 con 0x7f9e3014fd90 2023-08-22T00:26:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 -- 172.21.15.98:0/3571265742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 msgr2=0x7f9e300675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e300675f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f9e20009f20 tx=0x7f9e20009840).stop 2023-08-22T00:26:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 -- 172.21.15.98:0/3571265742 shutdown_connections 2023-08-22T00:26:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 --2- 172.21.15.98:0/3571265742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e300675f0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 -- 172.21.15.98:0/3571265742 >> 172.21.15.98:0/3571265742 conn(0x7f9e300c8950 msgr2=0x7f9e300c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 -- 172.21.15.98:0/3571265742 shutdown_connections 2023-08-22T00:26:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.135+0000 7f9e35e54700 1 -- 172.21.15.98:0/3571265742 wait complete. 2023-08-22T00:26:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 Processor -- start 2023-08-22T00:26:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 -- start start 2023-08-22T00:26:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 0x7f9e300c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c23e0 con 0x7f9e3014fd90 2023-08-22T00:26:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3014bf40 con 0x7f9e30153010 2023-08-22T00:26:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e35e54700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c25d0 con 0x7f9e300c39d0 2023-08-22T00:26:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.137+0000 7f9e2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55140/0 (socket says 172.21.15.98:55140) 2023-08-22T00:26:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 -- 172.21.15.98:0/202641882 learned_addr learned my addr 172.21.15.98:0/202641882 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2ffff700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 0x7f9e300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 -- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 msgr2=0x7f9e300c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 -- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 msgr2=0x7f9e300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 0x7f9e300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 -- 172.21.15.98:0/202641882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20009ae0 con 0x7f9e3014fd90 2023-08-22T00:26:04.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2ffff700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 0x7f9e300c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:26:04.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e2effd700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f9e1800c440 tx=0x7f9e18007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:04.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18007020 con 0x7f9e3014fd90 2023-08-22T00:26:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e300c28b0 con 0x7f9e3014fd90 2023-08-22T00:26:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18007180 con 0x7f9e3014fd90 2023-08-22T00:26:04.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18007520 con 0x7f9e3014fd90 2023-08-22T00:26:04.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.138+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30168420 con 0x7f9e3014fd90 2023-08-22T00:26:04.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.139+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e30168640 con 0x7f9e3014fd90 2023-08-22T00:26:04.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.140+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 72) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f9e180068b0 con 0x7f9e3014fd90 2023-08-22T00:26:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.140+0000 7f9e277fe700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 0x7f9e100612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.141+0000 7f9e2f7fe700 1 -- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 msgr2=0x7f9e100612f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.141+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9e18079090 con 0x7f9e3014fd90 2023-08-22T00:26:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.141+0000 7f9e2f7fe700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 0x7f9e100612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:26:04.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.148+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e180478f0 con 0x7f9e3014fd90 2023-08-22T00:26:04.192 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:04.190+0000 7ff47b0b0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:26:04.205 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:04.204+0000 7fe391c17680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:26:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.318+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f9e301525d0 con 0x7f9e3014fd90 2023-08-22T00:26:04.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.322+0000 7f9e277fe700 1 -- 172.21.15.98:0/202641882 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9e301525d0 con 0x7f9e3014fd90 2023-08-22T00:26:04.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.323+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 msgr2=0x7f9e100612f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:26:04.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.323+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 0x7f9e100612f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 msgr2=0x7f9e3014ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f9e1800c440 tx=0x7f9e18007e00).stop 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 shutdown_connections 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f9e1005ee30 0x7f9e100612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e300c39d0 0x7f9e300c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e30153010 0x7f9e300c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 --2- 172.21.15.98:0/202641882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e3014fd90 0x7f9e3014ba50 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 >> 172.21.15.98:0/202641882 conn(0x7f9e300c8950 msgr2=0x7f9e30150200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:04.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 shutdown_connections 2023-08-22T00:26:04.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.324+0000 7f9e35e54700 1 -- 172.21.15.98:0/202641882 wait complete. 2023-08-22T00:26:04.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:04.344 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:26:04.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:26:04.368 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-08-22T00:26:04.429 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-22T00:26:04.468 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:04.466+0000 7ff47b0b0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:26:04.491 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:04.490+0000 7fe391c17680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:26:04.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.594+0000 7f88cf911700 1 Processor -- start 2023-08-22T00:26:04.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.594+0000 7f88cf911700 1 -- start start 2023-08-22T00:26:04.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cf911700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88c80c1230 0x7f88c80c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cf911700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88c80c7a70 0x7f88c8154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.598 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cf911700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c8157dd0 con 0x7f88c8158260 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cf911700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8155610 con 0x7f88c80c1230 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cf911700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80c7ef0 con 0x7f88c80c7a70 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cd6ad700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88c80c1230 0x7f88c80c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cd6ad700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88c80c1230 0x7f88c80c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55148/0 (socket says 172.21.15.98:55148) 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cd6ad700 1 -- 172.21.15.98:0/660652524 learned_addr learned my addr 172.21.15.98:0/660652524 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.595+0000 7f88cceac700 1 --2- 172.21.15.98:0/660652524 >> v2:172.21.15.118:3300/0 conn(0x7f88c80c7a70 0x7f88c8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cd6ad700 1 -- 172.21.15.98:0/660652524 >> v2:172.21.15.118:3300/0 conn(0x7f88c80c7a70 msgr2=0x7f88c8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:04.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/660652524 >> v2:172.21.15.118:3300/0 conn(0x7f88c80c7a70 0x7f88c8154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cd6ad700 1 -- 172.21.15.98:0/660652524 >> v1:172.21.15.118:6789/0 conn(0x7f88c8158260 legacy=0x7f88c80c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cd6ad700 1 -- 172.21.15.98:0/660652524 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8154d70 con 0x7f88c80c1230 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/660652524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c80c1230 0x7f88c80c1610 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f88c80642b0 tx=0x7f88c40090f0).ready entity=mon.0 client_cookie=c02341ed14f0ab15 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88bffff700 1 -- 172.21.15.98:0/660652524 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400b520 con 0x7f88c80c1230 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88bffff700 1 -- 172.21.15.98:0/660652524 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400b680 con 0x7f88c80c1230 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88bffff700 1 -- 172.21.15.98:0/660652524 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400ba00 con 0x7f88c80c1230 2023-08-22T00:26:04.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 -- 172.21.15.98:0/660652524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c80c1230 msgr2=0x7f88c80c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 --2- 172.21.15.98:0/660652524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c80c1230 0x7f88c80c1610 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f88c80642b0 tx=0x7f88c40090f0).stop 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 -- 172.21.15.98:0/660652524 shutdown_connections 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 --2- 172.21.15.98:0/660652524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c80c1230 0x7f88c80c1610 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 --2- 172.21.15.98:0/660652524 >> v2:172.21.15.118:3300/0 conn(0x7f88c80c7a70 0x7f88c8154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.596+0000 7f88cf911700 1 -- 172.21.15.98:0/660652524 >> 172.21.15.98:0/660652524 conn(0x7f88c80645e0 msgr2=0x7f88c80649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.597+0000 7f88cf911700 1 -- 172.21.15.98:0/660652524 shutdown_connections 2023-08-22T00:26:04.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.597+0000 7f88cf911700 1 -- 172.21.15.98:0/660652524 wait complete. 2023-08-22T00:26:04.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.598+0000 7f88cf911700 1 Processor -- start 2023-08-22T00:26:04.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.598+0000 7f88cf911700 1 -- start start 2023-08-22T00:26:04.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 0x7f88c80b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 0x7f88c80aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80b0070 con 0x7f88c8158260 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80af460 con 0x7f88c80c7a70 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cf911700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80af740 con 0x7f88c80c1230 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cdeae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cdeae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55158/0 (socket says 172.21.15.98:55158) 2023-08-22T00:26:04.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cdeae700 1 -- 172.21.15.98:0/1074550580 learned_addr learned my addr 172.21.15.98:0/1074550580 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 0x7f88c80b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 0x7f88c80aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 msgr2=0x7f88c80b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 0x7f88c80b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 msgr2=0x7f88c80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:04.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cceac700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4009370 con 0x7f88c80c7a70 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cdeae700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.600+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 0x7f88c80b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88cceac700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 0x7f88c80aa030 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f88b800e850 tx=0x7f88b8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8009430 con 0x7f88c80c7a70 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8012600 con 0x7f88c80c7a70 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80afa20 con 0x7f88c80c7a70 2023-08-22T00:26:04.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8012980 con 0x7f88c80c7a70 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.601+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80c48c0 con 0x7f88c80c7a70 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80aa520 con 0x7f88c80c7a70 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 72) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f88b8012cf0 con 0x7f88c80c7a70 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88bd7fa700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88cd6ad700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f88b807a360 con 0x7f88c80c7a70 2023-08-22T00:26:04.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.602+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:26:04.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.607+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88b804b670 con 0x7f88c80c7a70 2023-08-22T00:26:04.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.801+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f88c8155050 con 0x7f88ac05ee60 2023-08-22T00:26:04.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.803+0000 7f88cd6ad700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:04.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:04.803+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:26:05.079 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:05.077+0000 7ff47b0b0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:26:05.120 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:05.116+0000 7fe391c17680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:26:05.150 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:05.148+0000 7ff47b0b0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:26:05.189 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:05.188+0000 7fe391c17680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:26:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:05.204+0000 7f88cd6ad700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:05.204+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:26:05.334 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:05.333+0000 7ff47b0b0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:26:05.376 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:05.374+0000 7fe391c17680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:26:05.753 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:05.752+0000 7ff47b0b0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:26:05.794 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:05.793+0000 7fe391c17680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:26:05.856 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:05.855+0000 7ff47b0b0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:26:05.897 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:05.895+0000 7fe391c17680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:26:06.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:06.005+0000 7f88cd6ad700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:06.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:06.005+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:26:06.008 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:06.006+0000 7ff47b0b0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:26:06.049 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:06.048+0000 7fe391c17680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:26:06.083 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:06.081+0000 7ff47b0b0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:26:06.124 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:06.123+0000 7fe391c17680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:26:06.150 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:06.148+0000 7ff47b0b0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:26:06.191 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:06.190+0000 7fe391c17680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:26:06.405 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:06.404+0000 7ff47b0b0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:26:06.450 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:06.448+0000 7fe391c17680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:26:06.590 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:06.588+0000 7ff47b0b0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:26:06.635 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:06.633+0000 7fe391c17680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:26:07.239 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.239+0000 7ff47b0b0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:26:07.285 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.284+0000 7fe391c17680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:26:07.309 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.308+0000 7ff47b0b0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:26:07.355 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.353+0000 7fe391c17680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:26:07.384 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.383+0000 7ff47b0b0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:26:07.431 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.430+0000 7fe391c17680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:26:07.531 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.530+0000 7ff47b0b0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:26:07.584 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.578+0000 7fe391c17680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:26:07.601 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.600+0000 7ff47b0b0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:26:07.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:07.606+0000 7f88cd6ad700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/118203 2023-08-22T00:26:07.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:07.606+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:26:07.651 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.650+0000 7fe391c17680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:26:07.716 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.715+0000 7ff47b0b0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:26:07.767 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.766+0000 7fe391c17680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:26:07.824 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:07.823+0000 7ff47b0b0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:26:07.877 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:07.875+0000 7fe391c17680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:26:08.117 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:08.113+0000 7ff47b0b0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:26:08.167 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.166+0000 7fe391c17680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:26:08.186 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:26:08.185+0000 7ff47b0b0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:26:08.238 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.237+0000 7fe391c17680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:26:08.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:08.254+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 73) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f88b8077fd0 con 0x7f88c80c7a70 2023-08-22T00:26:08.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:08.265+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 8 ==== mgrmap(e 74) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f88b8078350 con 0x7f88c80c7a70 2023-08-22T00:26:08.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:08.265+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:26:08.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:08.265+0000 7f88bd7fa700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:08.331 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30e6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.331 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30e6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.331 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30e6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.332 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30e6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.332 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30e6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.332 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30bec0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.333 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30bec0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.333 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30bec0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.333 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30bec0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:08.334 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:26:08.329+0000 7fe30bec0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:26:09.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.270+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mon.1 v2:172.21.15.118:3300/0 9 ==== mgrmap(e 75) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f88b8046260 con 0x7f88c80c7a70 2023-08-22T00:26:09.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.270+0000 7f88bd7fa700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.270+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f88c8155050 con 0x7f88ac05ee60 2023-08-22T00:26:09.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.271+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:09.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.272+0000 7f88cd6ad700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac0612a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f88c4009130 tx=0x7f88c4017000).ready entity=mgr.9033 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:09.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.284+0000 7f88bd7fa700 1 -- 172.21.15.98:0/1074550580 <== mgr.9033 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f88c8155050 con 0x7f88ac05ee60 2023-08-22T00:26:09.286 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-08-22T00:26:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.286+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 msgr2=0x7f88ac0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.286+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac0612a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f88c4009130 tx=0x7f88c4017000).stop 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.286+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 msgr2=0x7f88c80aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.286+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 0x7f88c80aa030 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f88b800e850 tx=0x7f88b8009060).stop 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 shutdown_connections 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f88ac05ee60 0x7f88ac0612a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88c80c1230 0x7f88c80b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88c8158260 0x7f88c80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 --2- 172.21.15.98:0/1074550580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c80c7a70 0x7f88c80aa030 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 >> 172.21.15.98:0/1074550580 conn(0x7f88c80645e0 msgr2=0x7f88c8062600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 shutdown_connections 2023-08-22T00:26:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.287+0000 7f88cf911700 1 -- 172.21.15.98:0/1074550580 wait complete. 2023-08-22T00:26:09.303 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-08-22T00:26:09.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-22T00:26:09.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.471+0000 7f01d9998700 1 Processor -- start 2023-08-22T00:26:09.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d9998700 1 -- start start 2023-08-22T00:26:09.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d9998700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f01d40c5460 0x7f01d40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d9998700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d4066770 con 0x7f01d4066c00 2023-08-22T00:26:09.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d9998700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d40c4f40 con 0x7f01d4153a40 2023-08-22T00:26:09.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d9998700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40639b0 con 0x7f01d40c5460 2023-08-22T00:26:09.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.472+0000 7f01d37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f01d40c5460 0x7f01d40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f01d40c5460 0x7f01d40c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55278/0 (socket says 172.21.15.98:55278) 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d27fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f01d4066c00 0x7f01d40632a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44768/0 (socket says 172.21.15.98:44768) 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 -- 172.21.15.98:0/3641994474 learned_addr learned my addr 172.21.15.98:0/3641994474 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 -- 172.21.15.98:0/3641994474 >> v1:172.21.15.118:6789/0 conn(0x7f01d4153a40 legacy=0x7f01d4062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 -- 172.21.15.98:0/3641994474 >> v1:172.21.15.98:6789/0 conn(0x7f01d4066c00 legacy=0x7f01d40632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 -- 172.21.15.98:0/3641994474 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40c59e0 con 0x7f01d40c5460 2023-08-22T00:26:09.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d1ffb700 1 -- 172.21.15.98:0/3641994474 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623176798 0 0) 0x7f01d4066770 con 0x7f01d4066c00 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d37fe700 1 --2- 172.21.15.98:0/3641994474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d40c4a50 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f01cc009f20 tx=0x7f01cc009840).ready entity=mon.0 client_cookie=733172d31a0ee865 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d1ffb700 1 -- 172.21.15.98:0/3641994474 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00e070 con 0x7f01d40c5460 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d1ffb700 1 -- 172.21.15.98:0/3641994474 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00ba40 con 0x7f01d40c5460 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.473+0000 7f01d1ffb700 1 -- 172.21.15.98:0/3641994474 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00bdc0 con 0x7f01d40c5460 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 -- 172.21.15.98:0/3641994474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 msgr2=0x7f01d40c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 --2- 172.21.15.98:0/3641994474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d40c4a50 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f01cc009f20 tx=0x7f01cc009840).stop 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 -- 172.21.15.98:0/3641994474 shutdown_connections 2023-08-22T00:26:09.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 --2- 172.21.15.98:0/3641994474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d40c4a50 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 -- 172.21.15.98:0/3641994474 >> 172.21.15.98:0/3641994474 conn(0x7f01d40c3990 msgr2=0x7f01d40c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:09.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 -- 172.21.15.98:0/3641994474 shutdown_connections 2023-08-22T00:26:09.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.474+0000 7f01d9998700 1 -- 172.21.15.98:0/3641994474 wait complete. 2023-08-22T00:26:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.475+0000 7f01d9998700 1 Processor -- start 2023-08-22T00:26:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.475+0000 7f01d9998700 1 -- start start 2023-08-22T00:26:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01d4066c00 0x7f01d40c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4153a40 0x7f01d41449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41586a0 con 0x7f01d40c5460 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40c17f0 con 0x7f01d4153a40 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41588b0 con 0x7f01d4066c00 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55288/0 (socket says 172.21.15.98:55288) 2023-08-22T00:26:09.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 -- 172.21.15.98:0/3490134953 learned_addr learned my addr 172.21.15.98:0/3490134953 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 -- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01d4066c00 msgr2=0x7f01d40c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01d4066c00 0x7f01d40c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 -- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4153a40 msgr2=0x7f01d41449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4153a40 0x7f01d41449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 -- 172.21.15.98:0/3490134953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009ae0 con 0x7f01d40c5460 2023-08-22T00:26:09.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d27fc700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f01c400c560 tx=0x7f01c4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40072e0 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4007440 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d4158b90 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40058f0 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.476+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4144ea0 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.477+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d40c19f0 con 0x7f01d40c5460 2023-08-22T00:26:09.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.478+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 75) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f01c4005ce0 con 0x7f01d40c5460 2023-08-22T00:26:09.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.478+0000 7f01baffd700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 0x7f01c0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:26:09.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.478+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6646+0+0 (secure 0 0 0) 0x7f01c4079710 con 0x7f01d40c5460 2023-08-22T00:26:09.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.478+0000 7f01d2ffd700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 0x7f01c0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:26:09.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.479+0000 7f01d2ffd700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 0x7f01c0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f01d4065df0 tx=0x7f01c8006ae0).ready entity=mgr.9033 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:26:09.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.482+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01d40c19f0 con 0x7f01d40c5460 2023-08-22T00:26:09.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.667+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d40c19b0 con 0x7f01c005ed40 2023-08-22T00:26:09.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.671+0000 7f01baffd700 1 -- 172.21.15.98:0/3490134953 <== mgr.9033 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f01d40c19b0 con 0x7f01c005ed40 2023-08-22T00:26:09.673 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-08-22T00:26:09.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 msgr2=0x7f01c0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 0x7f01c0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f01d4065df0 tx=0x7f01c8006ae0).stop 2023-08-22T00:26:09.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 msgr2=0x7f01d41581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f01c400c560 tx=0x7f01c4007c90).stop 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 shutdown_connections 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f01c005ed40 0x7f01c0061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01d4066c00 0x7f01d40c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4153a40 0x7f01d41449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 --2- 172.21.15.98:0/3490134953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01d40c5460 0x7f01d41581b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:26:09.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 >> 172.21.15.98:0/3490134953 conn(0x7f01d40c3990 msgr2=0x7f01d4152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:26:09.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 shutdown_connections 2023-08-22T00:26:09.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:26:09.673+0000 7f01d9998700 1 -- 172.21.15.98:0/3490134953 wait complete. 2023-08-22T00:26:09.687 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-08-22T00:26:21.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:26:21.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:26:51.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:26:51.373 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:27:00.677 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:27:00.676+0000 7fe2fe6a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:27:00.678 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:27:00.676+0000 7fe2fe6a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:27:00.678 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:27:00.676+0000 7fe2fe6a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:27:00.679 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:27:00.676+0000 7fe2fe6a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:27:00.679 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:27:00.676+0000 7fe2fe6a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:27:21.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:27:21.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:27:51.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:27:51.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:28:21.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:28:21.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:28:51.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:28:51.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:29:21.750 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:29:21.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:29:51.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:29:51.871 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:30:21.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:30:21.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:30:52.049 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:30:52.052 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:31:22.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:31:22.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:31:52.193 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:31:52.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:32:22.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:32:22.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:32:52.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:32:52.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:33:22.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:33:22.460 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:33:52.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:33:52.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:34:22.619 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:34:22.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:34:52.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:34:52.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:35:22.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:35:22.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:35:52.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:35:52.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:36:22.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:36:22.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:36:53.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:36:53.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:37:15.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:37:15.690 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-22T00:37:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_27_00_UTC 2023-08-22T00:37:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_28_00_UTC 2023-08-22T00:37:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_29_00_UTC 2023-08-22T00:37:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_30_00_UTC 2023-08-22T00:37:15.721 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_31_00_UTC 2023-08-22T00:37:15.721 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_32_00_UTC 2023-08-22T00:37:15.721 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_33_00_UTC 2023-08-22T00:37:15.721 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_34_00_UTC 2023-08-22T00:37:15.722 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_35_00_UTC 2023-08-22T00:37:15.722 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_36_00_UTC 2023-08-22T00:37:15.722 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_37_00_UTC 2023-08-22T00:37:15.722 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_27_00_UTC', 'scheduled-2023-08-22-00_28_00_UTC', 'scheduled-2023-08-22-00_29_00_UTC', 'scheduled-2023-08-22-00_30_00_UTC', 'scheduled-2023-08-22-00_31_00_UTC', 'scheduled-2023-08-22-00_32_00_UTC', 'scheduled-2023-08-22-00_33_00_UTC', 'scheduled-2023-08-22-00_34_00_UTC', 'scheduled-2023-08-22-00_35_00_UTC', 'scheduled-2023-08-22-00_36_00_UTC', 'scheduled-2023-08-22-00_37_00_UTC'] 2023-08-22T00:37:15.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-22T00:37:15.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.891+0000 7f03bb947700 1 Processor -- start 2023-08-22T00:37:15.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.891+0000 7f03bb947700 1 -- start start 2023-08-22T00:37:15.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03bb947700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f03b40c48d0 0x7f03b415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03bb947700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4064050 con 0x7f03b41519f0 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03bb947700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4151dd0 con 0x7f03b4065490 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03bb947700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b40bd6e0 con 0x7f03b40c48d0 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f03b40c48d0 0x7f03b415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f03b40c48d0 0x7f03b415e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45756/0 (socket says 172.21.15.98:45756) 2023-08-22T00:37:15.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 -- 172.21.15.98:0/2910089630 learned_addr learned my addr 172.21.15.98:0/2910089630 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:37:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 -- 172.21.15.98:0/2910089630 >> v1:172.21.15.118:6789/0 conn(0x7f03b4065490 legacy=0x7f03b40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:37:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 -- 172.21.15.98:0/2910089630 >> v1:172.21.15.98:6789/0 conn(0x7f03b41519f0 legacy=0x7f03b40be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 -- 172.21.15.98:0/2910089630 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40bcad0 con 0x7f03b40c48d0 2023-08-22T00:37:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.892+0000 7f03b9ee4700 1 --2- 172.21.15.98:0/2910089630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b40c48d0 0x7f03b415e9d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f03ac009f20 tx=0x7f03ac009840).ready entity=mon.0 client_cookie=8a23d43a43f76001 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03abfff700 1 -- 172.21.15.98:0/2910089630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00e070 con 0x7f03b40c48d0 2023-08-22T00:37:15.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03abfff700 1 -- 172.21.15.98:0/2910089630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00ba40 con 0x7f03b40c48d0 2023-08-22T00:37:15.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03abfff700 1 -- 172.21.15.98:0/2910089630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00bdc0 con 0x7f03b40c48d0 2023-08-22T00:37:15.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 -- 172.21.15.98:0/2910089630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b40c48d0 msgr2=0x7f03b415e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:15.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 --2- 172.21.15.98:0/2910089630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b40c48d0 0x7f03b415e9d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f03ac009f20 tx=0x7f03ac009840).stop 2023-08-22T00:37:15.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 -- 172.21.15.98:0/2910089630 shutdown_connections 2023-08-22T00:37:15.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 --2- 172.21.15.98:0/2910089630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b40c48d0 0x7f03b415e9d0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:15.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 -- 172.21.15.98:0/2910089630 >> 172.21.15.98:0/2910089630 conn(0x7f03b406a910 msgr2=0x7f03b4065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:37:15.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 -- 172.21.15.98:0/2910089630 shutdown_connections 2023-08-22T00:37:15.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.893+0000 7f03bb947700 1 -- 172.21.15.98:0/2910089630 wait complete. 2023-08-22T00:37:15.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.895+0000 7f03bb947700 1 Processor -- start 2023-08-22T00:37:15.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.895+0000 7f03bb947700 1 -- start start 2023-08-22T00:37:15.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:15.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 0x7f03b40a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:15.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 0x7f03b413c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:15.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40a38d0 con 0x7f03b4065490 2023-08-22T00:37:15.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40a46f0 con 0x7f03b41519f0 2023-08-22T00:37:15.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03bb947700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40a3ae0 con 0x7f03b40c48d0 2023-08-22T00:37:15.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:15.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45766/0 (socket says 172.21.15.98:45766) 2023-08-22T00:37:15.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 -- 172.21.15.98:0/2535998857 learned_addr learned my addr 172.21.15.98:0/2535998857 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:37:15.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b9ee4700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 0x7f03b413c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:15.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b8ee2700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 0x7f03b40a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:15.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 -- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 msgr2=0x7f03b40a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 0x7f03b40a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 -- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 msgr2=0x7f03b413c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 0x7f03b413c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b96e3700 1 -- 172.21.15.98:0/2535998857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009ae0 con 0x7f03b4065490 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b8ee2700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 0x7f03b40a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.896+0000 7f03b9ee4700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 0x7f03b413c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:37:15.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03b96e3700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f03a400c440 tx=0x7f03a4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4007020 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4007180 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4007520 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40a3dc0 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.897+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b40a4380 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.898+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4047480 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.898+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 78) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f03a40068b0 con 0x7f03b4065490 2023-08-22T00:37:15.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.898+0000 7f03a97fa700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 0x7f0398061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:15.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.899+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f03a4079cc0 con 0x7f03b4065490 2023-08-22T00:37:15.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.899+0000 7f03b8ee2700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 0x7f0398061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:15.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.899+0000 7f03b8ee2700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 0x7f0398061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f03b0006fd0 tx=0x7f03b0008040).ready entity=mgr.9033 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:15.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:15.903+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03a404ad80 con 0x7f03b4065490 2023-08-22T00:37:16.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.085+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 --> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03b40bcdb0 con 0x7f039805ef80 2023-08-22T00:37:16.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.087+0000 7f03a97fa700 1 -- 172.21.15.98:0/2535998857 <== mgr.9033 v2:172.21.15.98:6832/118203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f03b40bcdb0 con 0x7f039805ef80 2023-08-22T00:37:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:37:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:26:09", "first": "2023-08-22T00:27:00", "last": "2023-08-22T00:37:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-22T00:37:16.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 msgr2=0x7f0398061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 0x7f0398061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f03b0006fd0 tx=0x7f03b0008040).stop 2023-08-22T00:37:16.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 msgr2=0x7f03b40a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f03a400c440 tx=0x7f03a4007dd0).stop 2023-08-22T00:37:16.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 shutdown_connections 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b41519f0 0x7f03b413c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03b4065490 0x7f03b40a9d30 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f039805ef80 0x7f0398061440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 --2- 172.21.15.98:0/2535998857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03b40c48d0 0x7f03b40a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 >> 172.21.15.98:0/2535998857 conn(0x7f03b406a910 msgr2=0x7f03b40ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 shutdown_connections 2023-08-22T00:37:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.089+0000 7f03bb947700 1 -- 172.21.15.98:0/2535998857 wait complete. 2023-08-22T00:37:16.101 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:26:09", "first": "2023-08-22T00:27:00", "last": "2023-08-22T00:37:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-22T00:37:16.102 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:26:09', 'first': '2023-08-22T00:27:00', 'last': '2023-08-22T00:37:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-08-22T00:37:16.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-22T00:37:16.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.216+0000 7f4df3a97700 1 Processor -- start 2023-08-22T00:37:16.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.216+0000 7f4df3a97700 1 -- start start 2023-08-22T00:37:16.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df3a97700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4dec14e0d0 0x7f4dec14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df3a97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 0x7f4dec1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df3a97700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec155260 con 0x7f4dec0c5a90 2023-08-22T00:37:16.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df3a97700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0c17b0 con 0x7f4dec14e0d0 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df3a97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0bf9e0 con 0x7f4dec1544f0 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df1833700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4dec14e0d0 0x7f4dec14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df1833700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4dec14e0d0 0x7f4dec14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45778/0 (socket says 172.21.15.98:45778) 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.217+0000 7f4df1833700 1 -- 172.21.15.98:0/2102074864 learned_addr learned my addr 172.21.15.98:0/2102074864 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df2034700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 0x7f4dec1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df1833700 1 -- 172.21.15.98:0/2102074864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 msgr2=0x7f4dec1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:37:16.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df1833700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 0x7f4dec1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df1833700 1 -- 172.21.15.98:0/2102074864 >> v1:172.21.15.98:6789/0 conn(0x7f4dec0c5a90 legacy=0x7f4dec0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df1833700 1 -- 172.21.15.98:0/2102074864 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0bfcc0 con 0x7f4dec14e0d0 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df2034700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 0x7f4dec1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df1833700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec14e0d0 0x7f4dec14e4b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f4de4006fd0 tx=0x7f4de40090f0).ready entity=mon.0 client_cookie=c7e737261a11c086 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df0831700 1 -- 172.21.15.98:0/2102074864 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400b600 con 0x7f4dec14e0d0 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df0831700 1 -- 172.21.15.98:0/2102074864 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400b760 con 0x7f4dec14e0d0 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df0831700 1 -- 172.21.15.98:0/2102074864 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bae0 con 0x7f4dec14e0d0 2023-08-22T00:37:16.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df3a97700 1 -- 172.21.15.98:0/2102074864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec14e0d0 msgr2=0x7f4dec14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df3a97700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec14e0d0 0x7f4dec14e4b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f4de4006fd0 tx=0x7f4de40090f0).stop 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.218+0000 7f4df3a97700 1 -- 172.21.15.98:0/2102074864 shutdown_connections 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.219+0000 7f4df3a97700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec1544f0 0x7f4dec1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.219+0000 7f4df3a97700 1 --2- 172.21.15.98:0/2102074864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec14e0d0 0x7f4dec14e4b0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.219+0000 7f4df3a97700 1 -- 172.21.15.98:0/2102074864 >> 172.21.15.98:0/2102074864 conn(0x7f4dec0caa80 msgr2=0x7f4dec0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.219+0000 7f4df3a97700 1 -- 172.21.15.98:0/2102074864 shutdown_connections 2023-08-22T00:37:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.219+0000 7f4df3a97700 1 -- 172.21.15.98:0/2102074864 wait complete. 2023-08-22T00:37:16.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 Processor -- start 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 -- start start 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec14e0d0 0x7f4dec0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 0x7f4dec0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec14f9f0 con 0x7f4dec0c5a90 2023-08-22T00:37:16.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0c1e20 con 0x7f4dec1544f0 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.220+0000 7f4df3a97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0c4ee0 con 0x7f4dec14e0d0 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45788/0 (socket says 172.21.15.98:45788) 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 -- 172.21.15.98:0/3282513836 learned_addr learned my addr 172.21.15.98:0/3282513836 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df2034700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 0x7f4dec0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1032700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec14e0d0 0x7f4dec0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 -- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec14e0d0 msgr2=0x7f4dec0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec14e0d0 0x7f4dec0c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 -- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 msgr2=0x7f4dec0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 0x7f4dec0c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 -- 172.21.15.98:0/3282513836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009370 con 0x7f4dec0c5a90 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df2034700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 0x7f4dec0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df1833700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f4de4009f50 tx=0x7f4de4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:16.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bae0 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4000c90 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec14ede0 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de401c670 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.221+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec14f3a0 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.222+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec047480 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.223+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 78) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f4de401ca20 con 0x7f4dec0c5a90 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.223+0000 7f4de9ffb700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 0x7f4dd8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:37:16.229 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.223+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f4de407c060 con 0x7f4dec0c5a90 2023-08-22T00:37:16.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.223+0000 7f4df1032700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 0x7f4dd8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:37:16.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.224+0000 7f4df1032700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 0x7f4dd8061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4dec0ac990 tx=0x7f4de0009040).ready entity=mgr.9033 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:37:16.230 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.227+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4de404d120 con 0x7f4dec0c5a90 2023-08-22T00:37:16.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.429+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4dec0ca510 con 0x7f4dec0c5a90 2023-08-22T00:37:16.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.432+0000 7f4de9ffb700 1 -- 172.21.15.98:0/3282513836 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v78) v1 ==== 74+0+148765 (secure 0 0 0) 0x7f4de402a070 con 0x7f4dec0c5a90 2023-08-22T00:37:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 msgr2=0x7f4dd8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 0x7f4dd8061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4dec0ac990 tx=0x7f4de0009040).stop 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 msgr2=0x7f4dec14fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f4de4009f50 tx=0x7f4de4017000).stop 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 shutdown_connections 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec1544f0 0x7f4dec0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dec0c5a90 0x7f4dec14fe80 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.98:6832/118203,v1:172.21.15.98:6833/118203] conn(0x7f4dd805ef80 0x7f4dd8061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 --2- 172.21.15.98:0/3282513836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dec14e0d0 0x7f4dec0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:37:16.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 >> 172.21.15.98:0/3282513836 conn(0x7f4dec0caa80 msgr2=0x7f4dec0c0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:37:16.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 shutdown_connections 2023-08-22T00:37:16.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:37:16.435+0000 7f4df3a97700 1 -- 172.21.15.98:0/3282513836 wait complete. 2023-08-22T00:37:16.447 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":78,"active_gid":9033,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":118203},{"type":"v1","addr":"172.21.15.98:6833","nonce":118203}]},"active_addr":"172.21.15.98:6833/118203","active_change":"2023-08-22T00:26:08.256490+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":8113,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":167,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1797843422}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":834321445}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1248643734}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1637765333}]}]} 2023-08-22T00:37:16.451 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-08-22T00:37:16.452 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-22T00:37:16.452 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-08-22T00:37:16.453 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-22T00:37:16.453 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:37:16.477 INFO:tasks.ceph.mgr.y:Stopped 2023-08-22T00:37:16.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-22T00:37:16.522 INFO:tasks.ceph.mgr.y:Started 2023-08-22T00:37:16.699 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:16.698+0000 7ffa8ac00680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:37:16.761 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:16.760+0000 7ffa8ac00680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:37:17.032 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:17.030+0000 7ffa8ac00680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:37:17.638 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:17.636+0000 7ffa8ac00680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:37:17.709 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:17.708+0000 7ffa8ac00680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:37:17.895 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:17.894+0000 7ffa8ac00680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:37:18.313 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.312+0000 7ffa8ac00680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:37:18.416 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.415+0000 7ffa8ac00680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:37:18.571 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.570+0000 7ffa8ac00680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:37:18.645 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.644+0000 7ffa8ac00680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:37:18.712 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.711+0000 7ffa8ac00680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:37:18.968 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:18.966+0000 7ffa8ac00680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:37:19.150 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:19.149+0000 7ffa8ac00680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:37:19.798 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:19.796+0000 7ffa8ac00680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:37:19.867 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:19.867+0000 7ffa8ac00680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:37:19.943 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:19.943+0000 7ffa8ac00680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:37:20.090 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.090+0000 7ffa8ac00680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:37:20.161 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.161+0000 7ffa8ac00680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:37:20.277 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.277+0000 7ffa8ac00680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:37:20.386 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.386+0000 7ffa8ac00680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:37:20.676 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.676+0000 7ffa8ac00680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:37:20.748 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.746+0000 7ffa8ac00680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:37:20.831 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.830+0000 7ffa03ea7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.831 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.830+0000 7ffa03ea7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.832 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.830+0000 7ffa03ea7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.832 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.830+0000 7ffa03ea7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.832 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.830+0000 7ffa03ea7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.833 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.831+0000 7ffa076ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.833 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.831+0000 7ffa076ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.833 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.831+0000 7ffa076ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.833 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.831+0000 7ffa076ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:20.834 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:37:20.831+0000 7ffa076ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:37:23.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:37:23.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:37:53.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:37:53.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:38:00.823 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:38:00.822+0000 7ffa0debb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:38:00.824 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:38:00.822+0000 7ffa0debb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:38:00.824 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:38:00.822+0000 7ffa0debb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:38:00.824 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:38:00.822+0000 7ffa0debb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:38:00.824 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:38:00.822+0000 7ffa0debb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:38:23.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:38:23.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:38:53.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:38:53.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:39:23.483 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:39:23.487 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:39:53.565 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:39:53.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:40:23.646 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:40:23.649 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:40:53.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:40:53.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:41:23.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:41:23.834 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:41:53.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:41:53.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:42:16.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-22T00:42:16.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.656+0000 7fa387f7d700 1 Processor -- start 2023-08-22T00:42:16.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.657+0000 7fa387f7d700 1 -- start start 2023-08-22T00:42:16.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.657+0000 7fa387f7d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa380153ae0 0x7fa3800c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:16.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.657+0000 7fa387f7d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380155360 con 0x7fa3800bfd80 2023-08-22T00:42:16.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.657+0000 7fa387f7d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3800c0670 con 0x7fa3800c0200 2023-08-22T00:42:16.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.657+0000 7fa387f7d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa380157b50 con 0x7fa380153ae0 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa380153ae0 0x7fa3800c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa380153ae0 0x7fa3800c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46326/0 (socket says 172.21.15.98:46326) 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385518700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa3800bfd80 0x7fa380157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60116/0 (socket says 172.21.15.98:60116) 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 -- 172.21.15.98:0/2874469362 learned_addr learned my addr 172.21.15.98:0/2874469362 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 -- 172.21.15.98:0/2874469362 >> v1:172.21.15.118:6789/0 conn(0x7fa3800c0200 legacy=0x7fa3800645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 -- 172.21.15.98:0/2874469362 >> v1:172.21.15.98:6789/0 conn(0x7fa3800bfd80 legacy=0x7fa380157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa384d17700 1 -- 172.21.15.98:0/2874469362 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660838540 0 0) 0x7fa37c001110 con 0x7fa3800bfd80 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 -- 172.21.15.98:0/2874469362 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800c6390 con 0x7fa380153ae0 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa385d19700 1 --2- 172.21.15.98:0/2874469362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa380153ae0 0x7fa3800c5ea0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7fa370006fd0 tx=0x7fa3700090f0).ready entity=mon.0 client_cookie=b8034d3361787554 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa384d17700 1 -- 172.21.15.98:0/2874469362 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000b600 con 0x7fa380153ae0 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa384d17700 1 -- 172.21.15.98:0/2874469362 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000b760 con 0x7fa380153ae0 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.658+0000 7fa384d17700 1 -- 172.21.15.98:0/2874469362 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000bae0 con 0x7fa380153ae0 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 -- 172.21.15.98:0/2874469362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa380153ae0 msgr2=0x7fa3800c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2874469362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa380153ae0 0x7fa3800c5ea0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7fa370006fd0 tx=0x7fa3700090f0).stop 2023-08-22T00:42:16.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 -- 172.21.15.98:0/2874469362 shutdown_connections 2023-08-22T00:42:16.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2874469362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa380153ae0 0x7fa3800c5ea0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 -- 172.21.15.98:0/2874469362 >> 172.21.15.98:0/2874469362 conn(0x7fa3800caa50 msgr2=0x7fa3800cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:16.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 -- 172.21.15.98:0/2874469362 shutdown_connections 2023-08-22T00:42:16.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.659+0000 7fa387f7d700 1 -- 172.21.15.98:0/2874469362 wait complete. 2023-08-22T00:42:16.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.660+0000 7fa387f7d700 1 Processor -- start 2023-08-22T00:42:16.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.660+0000 7fa387f7d700 1 -- start start 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3800c0200 0x7fa3800adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 0x7fa3801433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c32a0 con 0x7fa3800bfd80 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c3580 con 0x7fa380153ae0 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c3860 con 0x7fa3800c0200 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:16.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46340/0 (socket says 172.21.15.98:46340) 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 -- 172.21.15.98:0/2318598953 learned_addr learned my addr 172.21.15.98:0/2318598953 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385518700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3800c0200 0x7fa3800adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 -- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3800c0200 msgr2=0x7fa3800adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa38651a700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 0x7fa3801433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3800c0200 0x7fa3800adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 -- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 msgr2=0x7fa3801433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 0x7fa3801433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 -- 172.21.15.98:0/2318598953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009370 con 0x7fa3800bfd80 2023-08-22T00:42:16.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa38651a700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 0x7fa3801433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:16.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa385d19700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7fa380065120 tx=0x7fa370017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:16.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000bae0 con 0x7fa3800bfd80 2023-08-22T00:42:16.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370000c90 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37001b660 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.661+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3800c3b40 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.662+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3800c4830 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.663+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380047480 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.663+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 83) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fa37001ba10 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.663+0000 7fa375ffb700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 0x7fa364061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.663+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fa37007ba50 con 0x7fa3800bfd80 2023-08-22T00:42:16.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.663+0000 7fa385518700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 0x7fa364061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:16.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.664+0000 7fa385518700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 0x7fa364061440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa37c001370 tx=0x7fa37c009040).ready entity=mgr.9111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:16.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.668+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa37004cb30 con 0x7fa3800bfd80 2023-08-22T00:42:16.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.855+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3800c36f0 con 0x7fa36405ef80 2023-08-22T00:42:16.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.858+0000 7fa375ffb700 1 -- 172.21.15.98:0/2318598953 <== mgr.9111 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fa3800c36f0 con 0x7fa36405ef80 2023-08-22T00:42:16.859 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-22T00:42:16.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 msgr2=0x7fa364061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 0x7fa364061440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa37c001370 tx=0x7fa37c009040).stop 2023-08-22T00:42:16.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 msgr2=0x7fa3800c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7fa380065120 tx=0x7fa370017000).stop 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 shutdown_connections 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa36405ef80 0x7fa364061440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa380153ae0 0x7fa3801433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3800bfd80 0x7fa3800c4340 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 --2- 172.21.15.98:0/2318598953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3800c0200 0x7fa3800adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:16.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 >> 172.21.15.98:0/2318598953 conn(0x7fa3800caa50 msgr2=0x7fa380152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:16.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 shutdown_connections 2023-08-22T00:42:16.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:16.860+0000 7fa387f7d700 1 -- 172.21.15.98:0/2318598953 wait complete. 2023-08-22T00:42:16.872 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-22T00:42:16.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:16.873 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-22T00:42:16.896 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_27_00_UTC 2023-08-22T00:42:16.896 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_28_00_UTC 2023-08-22T00:42:16.897 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_29_00_UTC 2023-08-22T00:42:16.897 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_30_00_UTC 2023-08-22T00:42:16.897 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_31_00_UTC 2023-08-22T00:42:16.897 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_32_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_33_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_34_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_35_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_36_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_37_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_38_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_39_00_UTC 2023-08-22T00:42:16.898 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_40_00_UTC 2023-08-22T00:42:16.899 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_41_00_UTC 2023-08-22T00:42:16.899 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_42_00_UTC 2023-08-22T00:42:16.899 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-22-00_27_00_UTC', 'scheduled-2023-08-22-00_28_00_UTC', 'scheduled-2023-08-22-00_29_00_UTC', 'scheduled-2023-08-22-00_30_00_UTC', 'scheduled-2023-08-22-00_31_00_UTC', 'scheduled-2023-08-22-00_32_00_UTC', 'scheduled-2023-08-22-00_33_00_UTC', 'scheduled-2023-08-22-00_34_00_UTC', 'scheduled-2023-08-22-00_35_00_UTC', 'scheduled-2023-08-22-00_36_00_UTC', 'scheduled-2023-08-22-00_37_00_UTC', 'scheduled-2023-08-22-00_38_00_UTC', 'scheduled-2023-08-22-00_39_00_UTC', 'scheduled-2023-08-22-00_40_00_UTC', 'scheduled-2023-08-22-00_41_00_UTC', 'scheduled-2023-08-22-00_42_00_UTC'] 2023-08-22T00:42:16.900 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-22T00:42:17.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 Processor -- start 2023-08-22T00:42:17.059 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 -- start start 2023-08-22T00:42:17.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b241541d0 0x7f9b240c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b240675b0 0x7f9b24067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b240c6580 con 0x7f9b2414e360 2023-08-22T00:42:17.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b240645a0 con 0x7f9b240675b0 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.058+0000 7f9b2a2aa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2414e740 con 0x7f9b241541d0 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9b240675b0 0x7f9b24067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b23fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9b2414e360 0x7f9b24063e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60130/0 (socket says 172.21.15.98:60130) 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b23fff700 1 -- 172.21.15.98:0/965394330 learned_addr learned my addr 172.21.15.98:0/965394330 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b237fe700 1 --2- 172.21.15.98:0/965394330 >> v2:172.21.15.118:3300/0 conn(0x7f9b241541d0 0x7f9b240c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 -- 172.21.15.98:0/965394330 >> v2:172.21.15.118:3300/0 conn(0x7f9b241541d0 msgr2=0x7f9b240c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 --2- 172.21.15.98:0/965394330 >> v2:172.21.15.118:3300/0 conn(0x7f9b241541d0 0x7f9b240c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.062 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 -- 172.21.15.98:0/965394330 >> v1:172.21.15.98:6789/0 conn(0x7f9b2414e360 legacy=0x7f9b24063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 -- 172.21.15.98:0/965394330 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240c3270 con 0x7f9b240675b0 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b22ffd700 1 -- 172.21.15.98:0/965394330 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573854099 0 0) 0x7f9b240c6580 con 0x7f9b2414e360 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b28847700 1 --2- 172.21.15.98:0/965394330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b240675b0 0x7f9b24067a00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f9b2413da20 tx=0x7f9b1c009780).ready entity=mon.0 client_cookie=f06434bd43f7ffff server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b22ffd700 1 -- 172.21.15.98:0/965394330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00e070 con 0x7f9b240675b0 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b22ffd700 1 -- 172.21.15.98:0/965394330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00bc30 con 0x7f9b240675b0 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.059+0000 7f9b22ffd700 1 -- 172.21.15.98:0/965394330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c012410 con 0x7f9b240675b0 2023-08-22T00:42:17.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/965394330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b240675b0 msgr2=0x7f9b24067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/965394330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b240675b0 0x7f9b24067a00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f9b2413da20 tx=0x7f9b1c009780).stop 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/965394330 shutdown_connections 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/965394330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b240675b0 0x7f9b24067a00 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/965394330 >> v2:172.21.15.118:3300/0 conn(0x7f9b241541d0 0x7f9b240c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/965394330 >> 172.21.15.98:0/965394330 conn(0x7f9b24066a70 msgr2=0x7f9b240c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/965394330 shutdown_connections 2023-08-22T00:42:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.060+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/965394330 wait complete. 2023-08-22T00:42:17.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.061+0000 7f9b2a2aa700 1 Processor -- start 2023-08-22T00:42:17.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.061+0000 7f9b2a2aa700 1 -- start start 2023-08-22T00:42:17.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b240675b0 0x7f9b2413bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2414e360 0x7f9b240a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2414dd10 con 0x7f9b241541d0 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240aca00 con 0x7f9b240675b0 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24158ea0 con 0x7f9b2414e360 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46364/0 (socket says 172.21.15.98:46364) 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 -- 172.21.15.98:0/3750811702 learned_addr learned my addr 172.21.15.98:0/3750811702 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 -- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2414e360 msgr2=0x7f9b240a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2414e360 0x7f9b240a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 -- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b240675b0 msgr2=0x7f9b2413bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b240675b0 0x7f9b2413bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 -- 172.21.15.98:0/3750811702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c009a20 con 0x7f9b241541d0 2023-08-22T00:42:17.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b28847700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f9b1c009fd0 tx=0x7f9b1c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c012410 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00b6f0 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.062+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b24159180 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.063+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c011dc0 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.063+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b24158bb0 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.063+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24047480 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.064+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 83) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f9b1c003040 con 0x7f9b241541d0 2023-08-22T00:42:17.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.064+0000 7f9b0bfff700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 0x7f9b10061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.064+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f9b1c07c490 con 0x7f9b241541d0 2023-08-22T00:42:17.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.064+0000 7f9b23fff700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 0x7f9b10061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.065+0000 7f9b23fff700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 0x7f9b10061440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9b180011e0 tx=0x7f9b18007850).ready entity=mgr.9111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.068+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b1c04d4b0 con 0x7f9b241541d0 2023-08-22T00:42:17.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.251+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b240acb70 con 0x7f9b1005ef80 2023-08-22T00:42:17.253 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.252+0000 7f9b0bfff700 1 -- 172.21.15.98:0/3750811702 <== mgr.9111 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f9b240acb70 con 0x7f9b1005ef80 2023-08-22T00:42:17.253 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:17.254 INFO:teuthology.orchestra.run.smithi098.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:26:09", "first": "2023-08-22T00:27:00", "last": "2023-08-22T00:42:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-22T00:42:17.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 msgr2=0x7f9b10061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 0x7f9b10061440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9b180011e0 tx=0x7f9b18007850).stop 2023-08-22T00:42:17.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 msgr2=0x7f9b241586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f9b1c009fd0 tx=0x7f9b1c009780).stop 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 shutdown_connections 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b1005ef80 0x7f9b10061440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b241541d0 0x7f9b241586c0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b240675b0 0x7f9b2413bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 --2- 172.21.15.98:0/3750811702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2414e360 0x7f9b240a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:17.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 >> 172.21.15.98:0/3750811702 conn(0x7f9b24066a70 msgr2=0x7f9b24065570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:17.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 shutdown_connections 2023-08-22T00:42:17.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.254+0000 7f9b2a2aa700 1 -- 172.21.15.98:0/3750811702 wait complete. 2023-08-22T00:42:17.266 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-22T00:00:00", "created": "2023-08-22T00:26:09", "first": "2023-08-22T00:27:00", "last": "2023-08-22T00:42:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-22T00:42:17.267 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-22T00:00:00', 'created': '2023-08-22T00:26:09', 'first': '2023-08-22T00:27:00', 'last': '2023-08-22T00:42:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-08-22T00:42:17.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-22T00:42:17.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.386+0000 7fc9262f0700 1 Processor -- start 2023-08-22T00:42:17.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.386+0000 7fc9262f0700 1 -- start start 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc9262f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc920151bf0 0x7fc920064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc9262f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc9200bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc9262f0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc920064f50 con 0x7fc920151100 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc9262f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200aa190 con 0x7fc920151bf0 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc9262f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200bdfe0 con 0x7fc920065530 2023-08-22T00:42:17.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc91ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc920151100 0x7fc9201514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60140/0 (socket says 172.21.15.98:60140) 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc91ffff700 1 -- 172.21.15.98:0/296029988 learned_addr learned my addr 172.21.15.98:0/296029988 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc92488d700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc9200bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934473030 0 0) 0x7fc914001110 con 0x7fc920151100 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9080033f0 con 0x7fc920151100 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.387+0000 7fc91f7fe700 1 --2- 172.21.15.98:0/296029988 >> v2:172.21.15.118:3300/0 conn(0x7fc920151bf0 0x7fc920064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219862124 0 0) 0x7fc9080033f0 con 0x7fc920151100 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 msgr2=0x7fc9200bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:17.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc9200bc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 >> v2:172.21.15.118:3300/0 conn(0x7fc920151bf0 msgr2=0x7fc920064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 --2- 172.21.15.98:0/296029988 >> v2:172.21.15.118:3300/0 conn(0x7fc920151bf0 0x7fc920064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200645d0 con 0x7fc920151100 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc914001600 con 0x7fc920151100 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 >> v1:172.21.15.98:6789/0 conn(0x7fc920151100 legacy=0x7fc9201514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9080038e0 0x7fc908003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc908004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc908004b80 0x7fc908005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200aa190 con 0x7fc9080038e0 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200bdfe0 con 0x7fc908004b80 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90800b8e0 con 0x7fc920065530 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9080038e0 0x7fc908003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91f7fe700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc908004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc92488d700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc908004b80 0x7fc908005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 -- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 msgr2=0x7fc908004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc920065530 0x7fc908004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 -- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc908004b80 msgr2=0x7fc908005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc908004b80 0x7fc908005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 -- 172.21.15.98:0/296029988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9080033f0 con 0x7fc9080038e0 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91ffff700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9080038e0 0x7fc908003d00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fc91400c3c0 tx=0x7fc920064540).ready entity=mon.0 client_cookie=c5153fe557da01d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914007be0 con 0x7fc9080038e0 2023-08-22T00:42:17.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400cc90 con 0x7fc9080038e0 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.388+0000 7fc91effd700 1 -- 172.21.15.98:0/296029988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140072e0 con 0x7fc9080038e0 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 -- 172.21.15.98:0/296029988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9080038e0 msgr2=0x7fc908003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 --2- 172.21.15.98:0/296029988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9080038e0 0x7fc908003d00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fc91400c3c0 tx=0x7fc920064540).stop 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc92488d700 1 -- 172.21.15.98:0/296029988 reap_dead start 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 -- 172.21.15.98:0/296029988 shutdown_connections 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 -- 172.21.15.98:0/296029988 >> 172.21.15.98:0/296029988 conn(0x7fc92006a910 msgr2=0x7fc920065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 -- 172.21.15.98:0/296029988 shutdown_connections 2023-08-22T00:42:17.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.389+0000 7fc9262f0700 1 -- 172.21.15.98:0/296029988 wait complete. 2023-08-22T00:42:17.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.390+0000 7fc9262f0700 1 Processor -- start 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.391+0000 7fc9262f0700 1 -- start start 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.391+0000 7fc9262f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 0x7fc9201410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 0x7fc9200c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200bf840 con 0x7fc9201415b0 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c00b0 con 0x7fc9200bed20 2023-08-22T00:42:17.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201611b0 con 0x7fc9080038e0 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46384/0 (socket says 172.21.15.98:46384) 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 -- 172.21.15.98:0/1787529163 learned_addr learned my addr 172.21.15.98:0/1787529163 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc92488d700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 0x7fc9200c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91ffff700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 0x7fc9201410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 -- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 msgr2=0x7fc9201410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.400 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 0x7fc9201410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 -- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 msgr2=0x7fc9200c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 0x7fc9200c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 -- 172.21.15.98:0/1787529163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200bf280 con 0x7fc9201415b0 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91ffff700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 0x7fc9201410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc92488d700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 0x7fc9200c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc91f7fe700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7fc9100119f0 tx=0x7fc910009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000f940 con 0x7fc9201415b0 2023-08-22T00:42:17.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000faa0 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9200bf560 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000fc10 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.392+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200aa900 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.393+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9200c0220 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.394+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 83) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fc91001a020 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.394+0000 7fc907fff700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 0x7fc90c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.394+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fc91007c3a0 con 0x7fc9201415b0 2023-08-22T00:42:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.394+0000 7fc91ffff700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 0x7fc90c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:17.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.394+0000 7fc91ffff700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 0x7fc90c061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc914000fd0 tx=0x7fc914015000).ready entity=mgr.9111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:17.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.398+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc91004d3c0 con 0x7fc9201415b0 2023-08-22T00:42:17.585 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.583+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc920047480 con 0x7fc90c05ef80 2023-08-22T00:42:17.588 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.587+0000 7fc907fff700 1 -- 172.21.15.98:0/1787529163 <== mgr.9111 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fc920047480 con 0x7fc90c05ef80 2023-08-22T00:42:17.588 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-08-22T00:42:17.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 msgr2=0x7fc90c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 0x7fc90c061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc914000fd0 tx=0x7fc914015000).stop 2023-08-22T00:42:17.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 msgr2=0x7fc9200be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7fc9100119f0 tx=0x7fc910009060).stop 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 shutdown_connections 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc90c05ef80 0x7fc90c061440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9080038e0 0x7fc9201410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9200bed20 0x7fc9200c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 --2- 172.21.15.98:0/1787529163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9201415b0 0x7fc9200be830 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:17.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 >> 172.21.15.98:0/1787529163 conn(0x7fc92006a910 msgr2=0x7fc920152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:17.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 shutdown_connections 2023-08-22T00:42:17.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:17.589+0000 7fc9262f0700 1 -- 172.21.15.98:0/1787529163 wait complete. 2023-08-22T00:42:17.602 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-08-22T00:42:17.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.603 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-22T00:42:17.627 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_27_00_UTC 2023-08-22T00:42:17.627 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_28_00_UTC 2023-08-22T00:42:17.627 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_29_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_30_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_31_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_32_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_33_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_34_00_UTC 2023-08-22T00:42:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_35_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_36_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_37_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_38_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_39_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_40_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_41_00_UTC 2023-08-22T00:42:17.629 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_42_00_UTC 2023-08-22T00:42:17.630 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_27_00_UTC 2023-08-22T00:42:17.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.631 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_27_00_UTC) 2023-08-22T00:42:17.693 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_28_00_UTC 2023-08-22T00:42:17.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.694 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_28_00_UTC) 2023-08-22T00:42:17.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_29_00_UTC 2023-08-22T00:42:17.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.759 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_29_00_UTC) 2023-08-22T00:42:17.824 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_30_00_UTC 2023-08-22T00:42:17.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.825 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_30_00_UTC) 2023-08-22T00:42:17.891 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_31_00_UTC 2023-08-22T00:42:17.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.892 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_31_00_UTC) 2023-08-22T00:42:17.956 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_32_00_UTC 2023-08-22T00:42:17.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:17.957 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_32_00_UTC) 2023-08-22T00:42:18.021 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_33_00_UTC 2023-08-22T00:42:18.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.022 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_33_00_UTC) 2023-08-22T00:42:18.086 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_34_00_UTC 2023-08-22T00:42:18.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.087 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_34_00_UTC) 2023-08-22T00:42:18.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_35_00_UTC 2023-08-22T00:42:18.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.153 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_35_00_UTC) 2023-08-22T00:42:18.217 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_36_00_UTC 2023-08-22T00:42:18.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.217 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_36_00_UTC) 2023-08-22T00:42:18.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_37_00_UTC 2023-08-22T00:42:18.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.283 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_37_00_UTC) 2023-08-22T00:42:18.347 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_38_00_UTC 2023-08-22T00:42:18.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.347 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_38_00_UTC) 2023-08-22T00:42:18.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_39_00_UTC 2023-08-22T00:42:18.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.413 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_39_00_UTC) 2023-08-22T00:42:18.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_40_00_UTC 2023-08-22T00:42:18.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.478 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_40_00_UTC) 2023-08-22T00:42:18.542 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_41_00_UTC 2023-08-22T00:42:18.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.543 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_41_00_UTC) 2023-08-22T00:42:18.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_42_00_UTC 2023-08-22T00:42:18.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.610 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-22-00_42_00_UTC) 2023-08-22T00:42:18.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:18.676 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-08-22T00:42:18.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:42:18.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.896+0000 7f7b156a7700 1 Processor -- start 2023-08-22T00:42:18.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.897+0000 7f7b156a7700 1 -- start start 2023-08-22T00:42:18.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.897+0000 7f7b156a7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b10151da0 0x7f7b100a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.897+0000 7f7b156a7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b10155380 con 0x7f7b100a8ac0 2023-08-22T00:42:18.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.897+0000 7f7b156a7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b10155620 con 0x7f7b100bc780 2023-08-22T00:42:18.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.897+0000 7f7b156a7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b100c2ae0 con 0x7f7b10151da0 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7b100a8ac0 0x7f7b100c0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60152/0 (socket says 172.21.15.98:60152) 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0effd700 1 -- 172.21.15.98:0/4055714776 learned_addr learned my addr 172.21.15.98:0/4055714776 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0f7fe700 1 --2- 172.21.15.98:0/4055714776 >> v2:172.21.15.118:3300/0 conn(0x7f7b10151da0 0x7f7b100a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651152187 0 0) 0x7f7b10155380 con 0x7f7b100a8ac0 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af80033f0 con 0x7f7b100a8ac0 2023-08-22T00:42:18.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427384105 0 0) 0x7f7af80033f0 con 0x7f7b100a8ac0 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 >> v2:172.21.15.118:3300/0 conn(0x7f7b10151da0 msgr2=0x7f7b100a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 --2- 172.21.15.98:0/4055714776 >> v2:172.21.15.118:3300/0 conn(0x7f7b10151da0 0x7f7b100a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 >> v1:172.21.15.118:6789/0 conn(0x7f7b100bc780 legacy=0x7f7b10150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100c2dc0 con 0x7f7b100a8ac0 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7b00001470 con 0x7f7b100a8ac0 2023-08-22T00:42:18.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 >> v1:172.21.15.98:6789/0 conn(0x7f7b100a8ac0 legacy=0x7f7b100c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7af80038e0 0x7f7af8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7af8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af8005000 0x7f7af800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100c2ae0 con 0x7f7af8004690 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af800bf60 con 0x7f7af8005000 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af800c0f0 con 0x7f7af80038e0 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0f7fe700 1 --2- 172.21.15.98:0/4055714776 >> v2:172.21.15.118:3300/0 conn(0x7f7b10151da0 0x7f7b100a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:18.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7af8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0effd700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7af80038e0 0x7f7af8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.898+0000 7f7b0f7fe700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af8005000 0x7f7af800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7af80038e0 msgr2=0x7f7af8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7af80038e0 0x7f7af8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af8005000 msgr2=0x7f7af800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af8005000 0x7f7af800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 -- 172.21.15.98:0/4055714776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80033f0 con 0x7f7af8004690 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0f7fe700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af8005000 0x7f7af800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0f7fe700 1 -- 172.21.15.98:0/4055714776 reap_dead start 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7af8004b10 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f7b04001760 tx=0x7f7b04007bb0).ready entity=mon.0 client_cookie=80430bb9e2639f3a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04007020 con 0x7f7af8004690 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04007180 con 0x7f7af8004690 2023-08-22T00:42:18.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b0dffb700 1 -- 172.21.15.98:0/4055714776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04007520 con 0x7f7af8004690 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 -- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 msgr2=0x7f7af8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7af8004b10 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f7b04001760 tx=0x7f7b04007bb0).stop 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 -- 172.21.15.98:0/4055714776 shutdown_connections 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 --2- 172.21.15.98:0/4055714776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7af8004b10 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 -- 172.21.15.98:0/4055714776 >> 172.21.15.98:0/4055714776 conn(0x7f7b100c31d0 msgr2=0x7f7b100c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:18.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 -- 172.21.15.98:0/4055714776 shutdown_connections 2023-08-22T00:42:18.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.899+0000 7f7b156a7700 1 -- 172.21.15.98:0/4055714776 wait complete. 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 Processor -- start 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 -- start start 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 0x7f7b100a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b100be840 0x7f7b100becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100bd7a0 con 0x7f7af8004690 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100bda80 con 0x7f7b100bd000 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.901+0000 7f7b156a7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100bdd60 con 0x7f7b100be840 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46412/0 (socket says 172.21.15.98:46412) 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 -- 172.21.15.98:0/3830726543 learned_addr learned my addr 172.21.15.98:0/3830726543 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:18.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0f7fe700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b100be840 0x7f7b100becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 0x7f7b100a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 -- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b100be840 msgr2=0x7f7b100becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b100be840 0x7f7b100becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 -- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 msgr2=0x7f7b100a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 0x7f7b100a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 -- 172.21.15.98:0/3830726543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100be040 con 0x7f7af8004690 2023-08-22T00:42:18.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 0x7f7b100a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b0effd700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f7b00007790 tx=0x7f7b00001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011590 con 0x7f7af8004690 2023-08-22T00:42:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b000116f0 con 0x7f7af8004690 2023-08-22T00:42:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b100be320 con 0x7f7af8004690 2023-08-22T00:42:18.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011a70 con 0x7f7af8004690 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.902+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b100a8120 con 0x7f7af8004690 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.903+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b100c2760 con 0x7f7af8004690 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.903+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 83) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f7b0001d3b0 con 0x7f7af8004690 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.904+0000 7f7af6ffd700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 0x7f7afc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.904+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f7b00079bf0 con 0x7f7af8004690 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.904+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 0x7f7afc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.904+0000 7f7b0e7fc700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 0x7f7afc061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7b10141fa0 tx=0x7f7b04016000).ready entity=mgr.9111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:18.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:18.908+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b00080080 con 0x7f7af8004690 2023-08-22T00:42:19.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.113+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f7b10046c20 con 0x7f7af8004690 2023-08-22T00:42:19.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.607+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f7b00077570 con 0x7f7af8004690 2023-08-22T00:42:19.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.608+0000 7f7af6ffd700 1 -- 172.21.15.98:0/3830726543 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v84) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7b00072430 con 0x7f7af8004690 2023-08-22T00:42:19.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 msgr2=0x7f7afc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:19.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 0x7f7afc061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7b10141fa0 tx=0x7f7b04016000).stop 2023-08-22T00:42:19.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 msgr2=0x7f7b1014bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:19.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f7b00007790 tx=0x7f7b00001e50).stop 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 shutdown_connections 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7afc05ef80 0x7f7afc061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b100be840 0x7f7b100becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7af8004690 0x7f7b1014bcb0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 --2- 172.21.15.98:0/3830726543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b100bd000 0x7f7b100a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.610+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 >> 172.21.15.98:0/3830726543 conn(0x7f7b100c31d0 msgr2=0x7f7b100c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.611+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 shutdown_connections 2023-08-22T00:42:19.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:19.611+0000 7f7b156a7700 1 -- 172.21.15.98:0/3830726543 wait complete. 2023-08-22T00:42:19.624 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:42:19.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:42:19.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:42:19.706 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:42:19.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:42:19.707 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:42:19.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:19.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[168033]: fuse finished with error 0 and tester_r 0 2023-08-22T00:42:19.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:42:19.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:19.741 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:42:19.755 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:19.753+0000 7f8b3fd3a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:42:19.755 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:19.754+0000 7f19abb3b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:42:19.817 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:19.815+0000 7f8b3fd3a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:42:19.820 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:19.819+0000 7f19abb3b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:42:19.883 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:42:19.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:19.885 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:42:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:42:19.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:42:19.905 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:42:19.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:19.906 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:42:19.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:42:19.942 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:42:19.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:42:19.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:19.943 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:42:19.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:42:19.967 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:42:19.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:20.096 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:20.094+0000 7f8b3fd3a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:42:20.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.098+0000 7f8b205d6700 1 Processor -- start 2023-08-22T00:42:20.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.098+0000 7f8b205d6700 1 -- start start 2023-08-22T00:42:20.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b205d6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b18150c50 0x7f8b180c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b205d6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b180bc6d0 0x7f8b180c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b205d6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180645b0 con 0x7f8b18151030 2023-08-22T00:42:20.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b205d6700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b18063fa0 con 0x7f8b18150c50 2023-08-22T00:42:20.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b205d6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b18151f30 con 0x7f8b180bc6d0 2023-08-22T00:42:20.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b1e372700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b18150c50 0x7f8b180c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b1e372700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8b18150c50 0x7f8b180c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46448/0 (socket says 172.21.15.98:46448) 2023-08-22T00:42:20.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b1e372700 1 -- 172.21.15.98:0/2997680645 learned_addr learned my addr 172.21.15.98:0/2997680645 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:20.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.099+0000 7f8b1db71700 1 --2- 172.21.15.98:0/2997680645 >> v2:172.21.15.118:3300/0 conn(0x7f8b180bc6d0 0x7f8b180c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1e372700 1 -- 172.21.15.98:0/2997680645 >> v2:172.21.15.118:3300/0 conn(0x7f8b180bc6d0 msgr2=0x7f8b180c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:20.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1e372700 1 --2- 172.21.15.98:0/2997680645 >> v2:172.21.15.118:3300/0 conn(0x7f8b180bc6d0 0x7f8b180c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1e372700 1 -- 172.21.15.98:0/2997680645 >> v1:172.21.15.118:6789/0 conn(0x7f8b18151030 legacy=0x7f8b18151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1e372700 1 -- 172.21.15.98:0/2997680645 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18152210 con 0x7f8b18150c50 2023-08-22T00:42:20.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1e372700 1 --2- 172.21.15.98:0/2997680645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b18150c50 0x7f8b180c34e0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f8b180666c0 tx=0x7f8b140090f0).ready entity=mon.0 client_cookie=fe998244260c8c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1d370700 1 -- 172.21.15.98:0/2997680645 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400b520 con 0x7f8b18150c50 2023-08-22T00:42:20.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1d370700 1 -- 172.21.15.98:0/2997680645 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400b680 con 0x7f8b18150c50 2023-08-22T00:42:20.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b1d370700 1 -- 172.21.15.98:0/2997680645 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400ba00 con 0x7f8b18150c50 2023-08-22T00:42:20.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b205d6700 1 -- 172.21.15.98:0/2997680645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b18150c50 msgr2=0x7f8b180c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.100+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2997680645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b18150c50 0x7f8b180c34e0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f8b180666c0 tx=0x7f8b140090f0).stop 2023-08-22T00:42:20.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 -- 172.21.15.98:0/2997680645 shutdown_connections 2023-08-22T00:42:20.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2997680645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b18150c50 0x7f8b180c34e0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2997680645 >> v2:172.21.15.118:3300/0 conn(0x7f8b180bc6d0 0x7f8b180c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 -- 172.21.15.98:0/2997680645 >> 172.21.15.98:0/2997680645 conn(0x7f8b180c7770 msgr2=0x7f8b180c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 -- 172.21.15.98:0/2997680645 shutdown_connections 2023-08-22T00:42:20.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.101+0000 7f8b205d6700 1 -- 172.21.15.98:0/2997680645 wait complete. 2023-08-22T00:42:20.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.102+0000 7f8b205d6700 1 Processor -- start 2023-08-22T00:42:20.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.102+0000 7f8b205d6700 1 -- start start 2023-08-22T00:42:20.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b18150c50 0x7f8b181648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b18151030 0x7f8b180a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180ac710 con 0x7f8b180bc6d0 2023-08-22T00:42:20.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1814bdd0 con 0x7f8b18151030 2023-08-22T00:42:20.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180abb00 con 0x7f8b18150c50 2023-08-22T00:42:20.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46456/0 (socket says 172.21.15.98:46456) 2023-08-22T00:42:20.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 -- 172.21.15.98:0/2725071253 learned_addr learned my addr 172.21.15.98:0/2725071253 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:20.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1eb73700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b18151030 0x7f8b180a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1db71700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b18150c50 0x7f8b181648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b18150c50 msgr2=0x7f8b181648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b18150c50 0x7f8b181648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b18151030 msgr2=0x7f8b180a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b18151030 0x7f8b180a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 -- 172.21.15.98:0/2725071253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14009370 con 0x7f8b180bc6d0 2023-08-22T00:42:20.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b1e372700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f8b14009130 tx=0x7f8b14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14000bc0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400b7f0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180abde0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.104+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14000d20 con 0x7f8b180bc6d0 2023-08-22T00:42:20.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.105+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180ac3a0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.119 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f19abb3b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:42:20.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18047480 con 0x7f8b180bc6d0 2023-08-22T00:42:20.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f8b1401c8c0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f8b0e7fc700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 0x7f8afc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f8b1db71700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 msgr2=0x7f8afc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:20.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.106+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f8b1407bfc0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.107+0000 7f8b1db71700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 0x7f8afc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:20.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.110+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b1404cfe0 con 0x7f8b180bc6d0 2023-08-22T00:42:20.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.308+0000 7f8b1db71700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 msgr2=0x7f8afc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:20.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.308+0000 7f8b1db71700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 0x7f8afc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:20.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.320+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b18064240 con 0x7f8b180bc6d0 2023-08-22T00:42:20.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.320+0000 7f8b0e7fc700 1 -- 172.21.15.98:0/2725071253 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f8b1402a020 con 0x7f8b180bc6d0 2023-08-22T00:42:20.322 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:20.322 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:42:20.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 msgr2=0x7f8afc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 0x7f8afc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 msgr2=0x7f8b1814b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f8b14009130 tx=0x7f8b14017000).stop 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 shutdown_connections 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8afc05ef30 0x7f8afc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b18151030 0x7f8b180a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b180bc6d0 0x7f8b1814b8e0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 --2- 172.21.15.98:0/2725071253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b18150c50 0x7f8b181648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 >> 172.21.15.98:0/2725071253 conn(0x7f8b180c7770 msgr2=0x7f8b180c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 shutdown_connections 2023-08-22T00:42:20.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.322+0000 7f8b205d6700 1 -- 172.21.15.98:0/2725071253 wait complete. 2023-08-22T00:42:20.325 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:42:20.336 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:20.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.453+0000 7f513644a700 1 Processor -- start 2023-08-22T00:42:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.453+0000 7f513644a700 1 -- start start 2023-08-22T00:42:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.454+0000 7f513644a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51300c61a0 0x7f513014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.454+0000 7f513644a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51300c17b0 con 0x7f513014e0d0 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.454+0000 7f513644a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5130155260 con 0x7f51301544f0 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.454+0000 7f513644a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51300bf9e0 con 0x7f51300c61a0 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.454+0000 7f512ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f513014e0d0 0x7f51300c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52618/0 (socket says 172.21.15.98:52618) 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512ffff700 1 -- 172.21.15.98:0/2309854031 learned_addr learned my addr 172.21.15.98:0/2309854031 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512f7fe700 1 --2- 172.21.15.98:0/2309854031 >> v2:172.21.15.118:3300/0 conn(0x7f51300c61a0 0x7f513014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818475303 0 0) 0x7f51300c17b0 con 0x7f513014e0d0 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51180033f0 con 0x7f513014e0d0 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512f7fe700 1 -- 172.21.15.98:0/2309854031 >> v1:172.21.15.118:6789/0 conn(0x7f51301544f0 legacy=0x7f51301549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329277595 0 0) 0x7f5130155260 con 0x7f51301544f0 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512f7fe700 1 -- 172.21.15.98:0/2309854031 >> v1:172.21.15.98:6789/0 conn(0x7f513014e0d0 legacy=0x7f51300c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512f7fe700 1 -- 172.21.15.98:0/2309854031 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300bfcc0 con 0x7f51300c61a0 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512f7fe700 1 --2- 172.21.15.98:0/2309854031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51300c61a0 0x7f513014e4b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f5124009760 tx=0x7f5124009060).ready entity=mon.1 client_cookie=d92b4c896eb1eb7f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400f510 con 0x7f51300c61a0 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512400f670 con 0x7f51300c61a0 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.455+0000 7f512effd700 1 -- 172.21.15.98:0/2309854031 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400f9f0 con 0x7f51300c61a0 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 -- 172.21.15.98:0/2309854031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51300c61a0 msgr2=0x7f513014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 --2- 172.21.15.98:0/2309854031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51300c61a0 0x7f513014e4b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f5124009760 tx=0x7f5124009060).stop 2023-08-22T00:42:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 -- 172.21.15.98:0/2309854031 shutdown_connections 2023-08-22T00:42:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 --2- 172.21.15.98:0/2309854031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51300c61a0 0x7f513014e4b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 -- 172.21.15.98:0/2309854031 >> 172.21.15.98:0/2309854031 conn(0x7f51300caa80 msgr2=0x7f51300cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 -- 172.21.15.98:0/2309854031 shutdown_connections 2023-08-22T00:42:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.456+0000 7f513644a700 1 -- 172.21.15.98:0/2309854031 wait complete. 2023-08-22T00:42:20.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.457+0000 7f513644a700 1 Processor -- start 2023-08-22T00:42:20.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.457+0000 7f513644a700 1 -- start start 2023-08-22T00:42:20.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51300c61a0 0x7f51300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f513014e0d0 0x7f51300c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513014fef0 con 0x7f51301544f0 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51301501d0 con 0x7f513014e0d0 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f513644a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51301504b0 con 0x7f51300c61a0 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f51349e7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f512ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51300c61a0 0x7f51300b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f51349e7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55420/0 (socket says 172.21.15.98:55420) 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f51349e7700 1 -- 172.21.15.98:0/4144051869 learned_addr learned my addr 172.21.15.98:0/4144051869 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.458+0000 7f512f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f513014e0d0 0x7f51300c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 -- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51300c61a0 msgr2=0x7f51300b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51300c61a0 0x7f51300b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 -- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f513014e0d0 msgr2=0x7f51300c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f513014e0d0 0x7f51300c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 -- 172.21.15.98:0/4144051869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240092a0 con 0x7f51301544f0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f51349e7700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f5128002230 tx=0x7f5128007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128010510 con 0x7f51301544f0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130150790 con 0x7f51301544f0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128010670 con 0x7f51301544f0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128010a10 con 0x7f51301544f0 2023-08-22T00:42:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.459+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513014fa80 con 0x7f51301544f0 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.460+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5130047480 con 0x7f51301544f0 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.460+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f512801b400 con 0x7f51301544f0 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.461+0000 7f5117fff700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 0x7f511c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.461+0000 7f512ffff700 1 -- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 msgr2=0x7f511c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.461+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f512807a090 con 0x7f51301544f0 2023-08-22T00:42:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.461+0000 7f512ffff700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 0x7f511c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.465+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f512804b050 con 0x7f51301544f0 2023-08-22T00:42:20.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.634+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51300c6680 con 0x7f51301544f0 2023-08-22T00:42:20.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.635+0000 7f5117fff700 1 -- 172.21.15.98:0/4144051869 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17816 (secure 0 0 0) 0x7f512804e670 con 0x7f51301544f0 2023-08-22T00:42:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:20.637 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":170,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:37:20.759282+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1797843422":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1248643734":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/834321445":"2023-08-23T00:37:20.759247+0000","172.21.15.98:6833/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:6832/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/1637765333":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1090399856":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/436321134":"2023-08-23T00:26:08.256325+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:20.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 msgr2=0x7f511c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:20.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 0x7f511c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 msgr2=0x7f5130150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f5128002230 tx=0x7f5128007f70).stop 2023-08-22T00:42:20.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 shutdown_connections 2023-08-22T00:42:20.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f511c05ef30 0x7f511c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51300c61a0 0x7f51300b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51301544f0 0x7f5130150f90 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 --2- 172.21.15.98:0/4144051869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f513014e0d0 0x7f51300c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 >> 172.21.15.98:0/4144051869 conn(0x7f51300caa80 msgr2=0x7f51301549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 shutdown_connections 2023-08-22T00:42:20.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.637+0000 7f513644a700 1 -- 172.21.15.98:0/4144051869 wait complete. 2023-08-22T00:42:20.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:25:49.331360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:25:49.717913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:42:20.652 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:42:20.706 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:20.704+0000 7f8b3fd3a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:42:20.750 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:20.748+0000 7f19abb3b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:42:20.777 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:20.776+0000 7f8b3fd3a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:42:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.796+0000 7f0685c4a700 1 Processor -- start 2023-08-22T00:42:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.796+0000 7f0685c4a700 1 -- start start 2023-08-22T00:42:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0685c4a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f06800c5360 0x7f0680066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0685c4a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800c69b0 con 0x7f0680157890 2023-08-22T00:42:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0685c4a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06801542c0 con 0x7f0680066150 2023-08-22T00:42:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0685c4a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800c57f0 con 0x7f06800c5360 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0680157890 0x7f06800c33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52624/0 (socket says 172.21.15.98:52624) 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067ffff700 1 -- 172.21.15.98:0/2641286088 learned_addr learned my addr 172.21.15.98:0/2641286088 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0676ffd700 1 --2- 172.21.15.98:0/2641286088 >> v2:172.21.15.118:3300/0 conn(0x7f06800c5360 0x7f0680066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770649618 0 0) 0x7f06800c69b0 con 0x7f0680157890 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c0033f0 con 0x7f0680157890 2023-08-22T00:42:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085687470 0 0) 0x7f06801542c0 con 0x7f0680066150 2023-08-22T00:42:20.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06800c69b0 con 0x7f0680066150 2023-08-22T00:42:20.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0676ffd700 1 -- 172.21.15.98:0/2641286088 >> v1:172.21.15.118:6789/0 conn(0x7f0680066150 legacy=0x7f06800c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0676ffd700 1 -- 172.21.15.98:0/2641286088 >> v1:172.21.15.98:6789/0 conn(0x7f0680157890 legacy=0x7f06800c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.797+0000 7f0676ffd700 1 -- 172.21.15.98:0/2641286088 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800c5ad0 con 0x7f06800c5360 2023-08-22T00:42:20.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0676ffd700 1 --2- 172.21.15.98:0/2641286088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06800c5360 0x7f0680066530 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0668009760 tx=0x7f0668009060).ready entity=mon.1 client_cookie=67880fb58d601d68 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800d4a0 con 0x7f06800c5360 2023-08-22T00:42:20.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800d600 con 0x7f06800c5360 2023-08-22T00:42:20.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f067effd700 1 -- 172.21.15.98:0/2641286088 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800d980 con 0x7f06800c5360 2023-08-22T00:42:20.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 -- 172.21.15.98:0/2641286088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06800c5360 msgr2=0x7f0680066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 --2- 172.21.15.98:0/2641286088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06800c5360 0x7f0680066530 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0668009760 tx=0x7f0668009060).stop 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 -- 172.21.15.98:0/2641286088 shutdown_connections 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 --2- 172.21.15.98:0/2641286088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06800c5360 0x7f0680066530 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 -- 172.21.15.98:0/2641286088 >> 172.21.15.98:0/2641286088 conn(0x7f06800c7800 msgr2=0x7f06800c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 -- 172.21.15.98:0/2641286088 shutdown_connections 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.798+0000 7f0685c4a700 1 -- 172.21.15.98:0/2641286088 wait complete. 2023-08-22T00:42:20.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.800+0000 7f0685c4a700 1 Processor -- start 2023-08-22T00:42:20.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.800+0000 7f0685c4a700 1 -- start start 2023-08-22T00:42:20.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.800+0000 7f0685c4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0680066150 0x7f0680144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.800+0000 7f0685c4a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06800a3dc0 0x7f0680156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800a4f00 con 0x7f0680157890 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800a4b10 con 0x7f0680066150 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800a4270 con 0x7f06800a3dc0 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55430/0 (socket says 172.21.15.98:55430) 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 -- 172.21.15.98:0/4244384753 learned_addr learned my addr 172.21.15.98:0/4244384753 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f067f7fe700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0680066150 0x7f0680144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f067ffff700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06800a3dc0 0x7f0680156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 -- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06800a3dc0 msgr2=0x7f0680156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06800a3dc0 0x7f0680156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 -- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0680066150 msgr2=0x7f0680144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0680066150 0x7f0680144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 -- 172.21.15.98:0/4244384753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680092a0 con 0x7f0680157890 2023-08-22T00:42:20.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0676ffd700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f06800696c0 tx=0x7f0668016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668000bc0 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800d770 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668000d20 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800a4550 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.801+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0680144840 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.802+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06800a5070 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.803+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f066801d8d0 con 0x7f0680157890 2023-08-22T00:42:20.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.803+0000 7f0677fff700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 0x7f0660061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:20.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.803+0000 7f067f7fe700 1 -- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 msgr2=0x7f0660061420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:20.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.803+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f066807b000 con 0x7f0680157890 2023-08-22T00:42:20.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.803+0000 7f067f7fe700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 0x7f0660061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:20.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.807+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f066804c0d0 con 0x7f0680157890 2023-08-22T00:42:20.826 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:20.824+0000 7f19abb3b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:42:20.964 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:20.962+0000 7f8b3fd3a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:42:20.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.970+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f06800c5db0 con 0x7f0680157890 2023-08-22T00:42:20.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.971+0000 7f0677fff700 1 -- 172.21.15.98:0/4244384753 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v170) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0668022020 con 0x7f0680157890 2023-08-22T00:42:20.973 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:42:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 msgr2=0x7f0660061420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 0x7f0660061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 msgr2=0x7f06800a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f06800696c0 tx=0x7f0668016000).stop 2023-08-22T00:42:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 shutdown_connections 2023-08-22T00:42:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f066005ef60 0x7f0660061420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06800a3dc0 0x7f0680156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0680066150 0x7f0680144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 --2- 172.21.15.98:0/4244384753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0680157890 0x7f06800a38d0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 >> 172.21.15.98:0/4244384753 conn(0x7f06800c7800 msgr2=0x7f06800c41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 shutdown_connections 2023-08-22T00:42:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:20.973+0000 7f0685c4a700 1 -- 172.21.15.98:0/4244384753 wait complete. 2023-08-22T00:42:20.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:42:21.019 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.018+0000 7f19abb3b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:42:21.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.108+0000 7f06ad86a700 1 Processor -- start 2023-08-22T00:42:21.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.108+0000 7f06ad86a700 1 -- start start 2023-08-22T00:42:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06ad86a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8157ab0 0x7f06a8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06ad86a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06a8062600 0x7f06a8063b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06ad86a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a81541c0 con 0x7f06a80ca150 2023-08-22T00:42:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06ad86a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a8064000 con 0x7f06a8062600 2023-08-22T00:42:21.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06ad86a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8062a90 con 0x7f06a8157ab0 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06a67fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06a8062600 0x7f06a8063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06a67fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06a8062600 0x7f06a8063b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55446/0 (socket says 172.21.15.98:55446) 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06a67fc700 1 -- 172.21.15.98:0/2632552843 learned_addr learned my addr 172.21.15.98:0/2632552843 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.109+0000 7f06a6ffd700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8157ab0 0x7f06a8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a67fc700 1 -- 172.21.15.98:0/2632552843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8157ab0 msgr2=0x7f06a8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a67fc700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8157ab0 0x7f06a8157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a67fc700 1 -- 172.21.15.98:0/2632552843 >> v1:172.21.15.118:6789/0 conn(0x7f06a80ca150 legacy=0x7f06a80acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a67fc700 1 -- 172.21.15.98:0/2632552843 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8062d70 con 0x7f06a8062600 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a67fc700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a8062600 0x7f06a8063b10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f069c006fd0 tx=0x7f069c0090f0).ready entity=mon.0 client_cookie=5cb00bf66103fe6d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a5ffb700 1 -- 172.21.15.98:0/2632552843 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00b580 con 0x7f06a8062600 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a5ffb700 1 -- 172.21.15.98:0/2632552843 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00b6e0 con 0x7f06a8062600 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06a5ffb700 1 -- 172.21.15.98:0/2632552843 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ba60 con 0x7f06a8062600 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.110+0000 7f06ad86a700 1 -- 172.21.15.98:0/2632552843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a8062600 msgr2=0x7f06a8063b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a8062600 0x7f06a8063b10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f069c006fd0 tx=0x7f069c0090f0).stop 2023-08-22T00:42:21.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 -- 172.21.15.98:0/2632552843 shutdown_connections 2023-08-22T00:42:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8157ab0 0x7f06a8157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2632552843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a8062600 0x7f06a8063b10 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 -- 172.21.15.98:0/2632552843 >> 172.21.15.98:0/2632552843 conn(0x7f06a80cb600 msgr2=0x7f06a80c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 -- 172.21.15.98:0/2632552843 shutdown_connections 2023-08-22T00:42:21.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.111+0000 7f06ad86a700 1 -- 172.21.15.98:0/2632552843 wait complete. 2023-08-22T00:42:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.112+0000 7f06ad86a700 1 Processor -- start 2023-08-22T00:42:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.112+0000 7f06ad86a700 1 -- start start 2023-08-22T00:42:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06a8157ab0 0x7f06a81518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8156480 0x7f06a81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80adae0 con 0x7f06a80ca150 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80ae660 con 0x7f06a8157ab0 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8156db0 con 0x7f06a8156480 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55452/0 (socket says 172.21.15.98:55452) 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 -- 172.21.15.98:0/2531861052 learned_addr learned my addr 172.21.15.98:0/2531861052 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:21.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a67fc700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06a8157ab0 0x7f06a81518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a77fe700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8156480 0x7f06a81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 -- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8156480 msgr2=0x7f06a81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8156480 0x7f06a81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 -- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06a8157ab0 msgr2=0x7f06a81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06a8157ab0 0x7f06a81518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 -- 172.21.15.98:0/2531861052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c009370 con 0x7f06a80ca150 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06a6ffd700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f069800e930 tx=0x7f0698009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012600 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698012760 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a80add30 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012ae0 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.113+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a80ae2f0 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.114+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a8083670 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.115+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f069801b400 con 0x7f06a80ca150 2023-08-22T00:42:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.115+0000 7f068effd700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 0x7f06940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.115+0000 7f06a67fc700 1 -- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 msgr2=0x7f06940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:21.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.115+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f069807a550 con 0x7f06a80ca150 2023-08-22T00:42:21.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.116+0000 7f06a67fc700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 0x7f06940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:21.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.120+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f069804b510 con 0x7f06a80ca150 2023-08-22T00:42:21.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.286+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06a8063050 con 0x7f06a80ca150 2023-08-22T00:42:21.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.286+0000 7f068effd700 1 -- 172.21.15.98:0/2531861052 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f069804eb30 con 0x7f06a80ca150 2023-08-22T00:42:21.288 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:42:21.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 msgr2=0x7f06940613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:21.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 0x7f06940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 msgr2=0x7f06a80aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f069800e930 tx=0x7f0698009060).stop 2023-08-22T00:42:21.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 shutdown_connections 2023-08-22T00:42:21.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f069405ef30 0x7f06940613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06a8156480 0x7f06a81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06a80ca150 0x7f06a80aeaf0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 --2- 172.21.15.98:0/2531861052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06a8157ab0 0x7f06a81518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.288+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 >> 172.21.15.98:0/2531861052 conn(0x7f06a80cb600 msgr2=0x7f06a80bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:21.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.289+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 shutdown_connections 2023-08-22T00:42:21.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.289+0000 7f06ad86a700 1 -- 172.21.15.98:0/2531861052 wait complete. 2023-08-22T00:42:21.302 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:42:21.383 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:21.381+0000 7f8b3fd3a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:42:21.463 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.462+0000 7f19abb3b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:42:21.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.462+0000 7f25310d9700 1 Processor -- start 2023-08-22T00:42:21.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.462+0000 7f25310d9700 1 -- start start 2023-08-22T00:42:21.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f25310d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c064110 0x7f252c064590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f25310d9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f252c066000 0x7f252c066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f25310d9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c158970 con 0x7f252c153dd0 2023-08-22T00:42:21.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f25310d9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c0c28b0 con 0x7f252c066000 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f25310d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c064a80 con 0x7f252c064110 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252b59e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f252c066000 0x7f252c066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252ad9d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f252c153dd0 0x7f252c0c2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52626/0 (socket says 172.21.15.98:52626) 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252ad9d700 1 -- 172.21.15.98:0/1138555973 learned_addr learned my addr 172.21.15.98:0/1138555973 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252a59c700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c064110 0x7f252c064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252b59e700 1 -- 172.21.15.98:0/1138555973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c064110 msgr2=0x7f252c064590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252b59e700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c064110 0x7f252c064590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f252b59e700 1 -- 172.21.15.98:0/1138555973 >> v1:172.21.15.98:6789/0 conn(0x7f252c153dd0 legacy=0x7f252c0c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.463+0000 7f2529d9b700 1 -- 172.21.15.98:0/1138555973 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882570858 0 0) 0x7f252c158970 con 0x7f252c153dd0 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f252b59e700 1 -- 172.21.15.98:0/1138555973 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c066980 con 0x7f252c066000 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f252b59e700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c066000 0x7f252c066490 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f2524009e60 tx=0x7f2524009780).ready entity=mon.0 client_cookie=1eda9b7bc8c1c725 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f2529d9b700 1 -- 172.21.15.98:0/1138555973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252400e070 con 0x7f252c066000 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f2529d9b700 1 -- 172.21.15.98:0/1138555973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252400bb60 con 0x7f252c066000 2023-08-22T00:42:21.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f2529d9b700 1 -- 172.21.15.98:0/1138555973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524012410 con 0x7f252c066000 2023-08-22T00:42:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 -- 172.21.15.98:0/1138555973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c066000 msgr2=0x7f252c066490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c066000 0x7f252c066490 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f2524009e60 tx=0x7f2524009780).stop 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 -- 172.21.15.98:0/1138555973 shutdown_connections 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c066000 0x7f252c066490 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 --2- 172.21.15.98:0/1138555973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c064110 0x7f252c064590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 -- 172.21.15.98:0/1138555973 >> 172.21.15.98:0/1138555973 conn(0x7f252c0c7820 msgr2=0x7f252c0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 -- 172.21.15.98:0/1138555973 shutdown_connections 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.464+0000 7f25310d9700 1 -- 172.21.15.98:0/1138555973 wait complete. 2023-08-22T00:42:21.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 Processor -- start 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 -- start start 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 0x7f252c1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c153dd0 0x7f252c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0a7910 con 0x7f252c064110 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c154b90 con 0x7f252c153dd0 2023-08-22T00:42:21.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.466+0000 7f25310d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c14c740 con 0x7f252c066000 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55472/0 (socket says 172.21.15.98:55472) 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 0x7f252c1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252ad9d700 1 -- 172.21.15.98:0/2801465240 learned_addr learned my addr 172.21.15.98:0/2801465240 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252b59e700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c153dd0 0x7f252c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 -- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c153dd0 msgr2=0x7f252c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c153dd0 0x7f252c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 -- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 msgr2=0x7f252c14be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 -- 172.21.15.98:0/2801465240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524009a20 con 0x7f252c066000 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252ad9d700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f252a59c700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 0x7f252c1541b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f252000e850 tx=0x7f2520009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520009430 con 0x7f252c066000 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520012600 con 0x7f252c066000 2023-08-22T00:42:21.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c1559a0 con 0x7f252c066000 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520012980 con 0x7f252c066000 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.467+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c155070 con 0x7f252c066000 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.468+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c0c3d60 con 0x7f252c066000 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.469+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f252001b400 con 0x7f252c066000 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.469+0000 7f2512ffd700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 0x7f25180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.469+0000 7f252ad9d700 1 -- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 msgr2=0x7f25180613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:21.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.469+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f252007a660 con 0x7f252c066000 2023-08-22T00:42:21.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.469+0000 7f252ad9d700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 0x7f25180613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:21.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.477+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f252004b620 con 0x7f252c066000 2023-08-22T00:42:21.490 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:21.488+0000 7f8b3fd3a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:21.579 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.578+0000 7f19abb3b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.656+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f252c064860 con 0x7f252c066000 2023-08-22T00:42:21.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.658+0000 7f2512ffd700 1 -- 172.21.15.98:0/2801465240 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v171) v1 ==== 104+0+11 (secure 0 0 0) 0x7f252004ec40 con 0x7f252c066000 2023-08-22T00:42:21.659 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:42:21.660 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:21.659+0000 7f8b3fd3a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:21.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 msgr2=0x7f25180613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:21.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 0x7f25180613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 msgr2=0x7f252c1541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 0x7f252c1541b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f252000e850 tx=0x7f2520009060).stop 2023-08-22T00:42:21.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 shutdown_connections 2023-08-22T00:42:21.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f251805ef30 0x7f25180613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c153dd0 0x7f252c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c064110 0x7f252c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 --2- 172.21.15.98:0/2801465240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c066000 0x7f252c1541b0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0x7f252000e850 tx=0x7f2520009060).stop 2023-08-22T00:42:21.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.661+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 >> 172.21.15.98:0/2801465240 conn(0x7f252c0c7820 msgr2=0x7f252c0c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:21.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.662+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 shutdown_connections 2023-08-22T00:42:21.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.663+0000 7f25310d9700 1 -- 172.21.15.98:0/2801465240 wait complete. 2023-08-22T00:42:21.683 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:42:21.748 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:21.746+0000 7f8b3fd3a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:42:21.754 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.753+0000 7f19abb3b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:21.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.837+0000 7fe9f3266700 1 Processor -- start 2023-08-22T00:42:21.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.837+0000 7fe9f3266700 1 -- start start 2023-08-22T00:42:21.839 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:21.833+0000 7f8b3fd3a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:42:21.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9ec14c330 0x7fe9ec062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9ec062af0 0x7fe9ec066240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec066730 0x7fe9ec0bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec066ba0 con 0x7fe9ec062af0 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec065db0 con 0x7fe9ec14c330 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f3266700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec153370 con 0x7fe9ec066730 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f1002700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9ec14c330 0x7fe9ec062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f1002700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9ec14c330 0x7fe9ec062600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:43966/0 (socket says 172.21.15.98:43966) 2023-08-22T00:42:21.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.839+0000 7fe9f1002700 1 -- 172.21.15.98:0/3972439657 learned_addr learned my addr 172.21.15.98:0/3972439657 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:21.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 -- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec066730 msgr2=0x7fe9ec0bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:21.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 --2- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec066730 0x7fe9ec0bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 -- 172.21.15.98:0/3972439657 >> v2:172.21.15.98:3300/0 conn(0x7fe9ec062af0 msgr2=0x7fe9ec066240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 --2- 172.21.15.98:0/3972439657 >> v2:172.21.15.98:3300/0 conn(0x7fe9ec062af0 0x7fe9ec066240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 -- 172.21.15.98:0/3972439657 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec065480 con 0x7fe9ec14c330 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.840+0000 7fe9f1002700 1 --2- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec062600 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe9ec067ca0 tx=0x7fe9e4009840).ready entity=mon.1 client_cookie=2285c77a6fbfbdf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.841+0000 7fe9e3fff700 1 -- 172.21.15.98:0/3972439657 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e070 con 0x7fe9ec14c330 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.841+0000 7fe9e3fff700 1 -- 172.21.15.98:0/3972439657 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400ba50 con 0x7fe9ec14c330 2023-08-22T00:42:21.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.841+0000 7fe9e3fff700 1 -- 172.21.15.98:0/3972439657 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400bdd0 con 0x7fe9ec14c330 2023-08-22T00:42:21.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 -- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 msgr2=0x7fe9ec062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 --2- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec062600 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe9ec067ca0 tx=0x7fe9e4009840).stop 2023-08-22T00:42:21.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 -- 172.21.15.98:0/3972439657 shutdown_connections 2023-08-22T00:42:21.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 --2- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec066730 0x7fe9ec0bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 --2- 172.21.15.98:0/3972439657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec062600 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 --2- 172.21.15.98:0/3972439657 >> v2:172.21.15.98:3300/0 conn(0x7fe9ec062af0 0x7fe9ec066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 -- 172.21.15.98:0/3972439657 >> 172.21.15.98:0/3972439657 conn(0x7fe9ec0c31d0 msgr2=0x7fe9ec0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:21.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.842+0000 7fe9f3266700 1 -- 172.21.15.98:0/3972439657 shutdown_connections 2023-08-22T00:42:21.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.843+0000 7fe9f3266700 1 -- 172.21.15.98:0/3972439657 wait complete. 2023-08-22T00:42:21.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.844+0000 7fe9f3266700 1 Processor -- start 2023-08-22T00:42:21.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.845+0000 7fe9f3266700 1 -- start start 2023-08-22T00:42:21.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec062af0 0x7fe9ec0c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 0x7fe9ec14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0c0820 con 0x7fe9ec066730 2023-08-22T00:42:21.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0aaa70 con 0x7fe9ec14c330 2023-08-22T00:42:21.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.847+0000 7fe9f3266700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0aad50 con 0x7fe9ec062af0 2023-08-22T00:42:21.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:43970/0 (socket says 172.21.15.98:43970) 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 -- 172.21.15.98:0/2680345974 learned_addr learned my addr 172.21.15.98:0/2680345974 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 -- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec062af0 msgr2=0x7fe9ec0c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f0801700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 0x7fe9ec14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec062af0 0x7fe9ec0c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:21.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 -- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 msgr2=0x7fe9ec14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 0x7fe9ec14e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f1803700 1 -- 172.21.15.98:0/2680345974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009ae0 con 0x7fe9ec14c330 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.848+0000 7fe9f0801700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 0x7fe9ec14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9f1803700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe9dc00b460 tx=0x7fe9dc006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc012410 con 0x7fe9ec14c330 2023-08-22T00:42:21.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc012570 con 0x7fe9ec14c330 2023-08-22T00:42:21.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc012910 con 0x7fe9ec14c330 2023-08-22T00:42:21.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0ab030 con 0x7fe9ec14c330 2023-08-22T00:42:21.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.849+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec14b980 con 0x7fe9ec14c330 2023-08-22T00:42:21.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.851+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc005120 con 0x7fe9ec14c330 2023-08-22T00:42:21.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.852+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe9dc012d00 con 0x7fe9ec14c330 2023-08-22T00:42:21.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.852+0000 7fe9e17fa700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 0x7fe9d0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:21.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.853+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7fe9dc07a000 con 0x7fe9ec14c330 2023-08-22T00:42:21.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.853+0000 7fe9f1002700 1 -- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 msgr2=0x7fe9d0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:21.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.853+0000 7fe9f1002700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 0x7fe9d0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:21.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:21.861+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe9dc04afa0 con 0x7fe9ec14c330 2023-08-22T00:42:21.875 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.870+0000 7f19abb3b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:42:21.945 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:21.944+0000 7f19abb3b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:42:22.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.041+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9cc005d70 con 0x7fe9ec14c330 2023-08-22T00:42:22.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.042+0000 7fe9e17fa700 1 -- 172.21.15.98:0/2680345974 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v171) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe9dc04e5c0 con 0x7fe9ec14c330 2023-08-22T00:42:22.043 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:42:22.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 msgr2=0x7fe9d0061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:22.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 0x7fe9d0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 msgr2=0x7fe9ec14e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe9dc00b460 tx=0x7fe9dc006f40).stop 2023-08-22T00:42:22.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 shutdown_connections 2023-08-22T00:42:22.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9d005ef80 0x7fe9d0061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9ec062af0 0x7fe9ec0c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9ec14c330 0x7fe9ec14e4f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 --2- 172.21.15.98:0/2680345974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9ec066730 0x7fe9ec14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 >> 172.21.15.98:0/2680345974 conn(0x7fe9ec0c31d0 msgr2=0x7fe9ec1516d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 shutdown_connections 2023-08-22T00:42:22.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.044+0000 7fe9f3266700 1 -- 172.21.15.98:0/2680345974 wait complete. 2023-08-22T00:42:22.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:22.112 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:22.110+0000 7f8b3fd3a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:42:22.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.174+0000 7fc3ae2ad700 1 Processor -- start 2023-08-22T00:42:22.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.175+0000 7fc3ae2ad700 1 -- start start 2023-08-22T00:42:22.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.175+0000 7fc3ae2ad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3a80a9140 0x7fc3a8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.175+0000 7fc3ae2ad700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80a8410 con 0x7fc3a8153b60 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.175+0000 7fc3ae2ad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80a8cb0 con 0x7fc3a8153f40 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.175+0000 7fc3ae2ad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a81586a0 con 0x7fc3a80a9140 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc3a8153b60 0x7fc3a8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52628/0 (socket says 172.21.15.98:52628) 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a7fff700 1 -- 172.21.15.98:0/1475354942 learned_addr learned my addr 172.21.15.98:0/1475354942 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:22.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3ac84a700 1 --2- 172.21.15.98:0/1475354942 >> v2:172.21.15.118:3300/0 conn(0x7fc3a80a9140 0x7fc3a8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699824029 0 0) 0x7fc3a80a8410 con 0x7fc3a8153b60 2023-08-22T00:42:22.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3900033f0 con 0x7fc3a8153b60 2023-08-22T00:42:22.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610201484 0 0) 0x7fc3a80a8cb0 con 0x7fc3a8153f40 2023-08-22T00:42:22.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a80a8410 con 0x7fc3a8153f40 2023-08-22T00:42:22.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591838629 0 0) 0x7fc3900033f0 con 0x7fc3a8153b60 2023-08-22T00:42:22.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 >> v2:172.21.15.118:3300/0 conn(0x7fc3a80a9140 msgr2=0x7fc3a8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 --2- 172.21.15.98:0/1475354942 >> v2:172.21.15.118:3300/0 conn(0x7fc3a80a9140 0x7fc3a8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 >> v1:172.21.15.118:6789/0 conn(0x7fc3a8153f40 legacy=0x7fc3a8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80a8660 con 0x7fc3a8153b60 2023-08-22T00:42:22.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc398001470 con 0x7fc3a8153b60 2023-08-22T00:42:22.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 >> v1:172.21.15.98:6789/0 conn(0x7fc3a8153b60 legacy=0x7fc3a8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc390003a70 0x7fc390003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 0x7fc390004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390005000 0x7fc39000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81586a0 con 0x7fc390004690 2023-08-22T00:42:22.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39000be80 con 0x7fc390005000 2023-08-22T00:42:22.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39000c040 con 0x7fc390003a70 2023-08-22T00:42:22.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 0x7fc390004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a7fff700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc390003a70 0x7fc390003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3ac84a700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390005000 0x7fc39000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.176+0000 7fc3a77fe700 1 -- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc390003a70 msgr2=0x7fc390003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc390003a70 0x7fc390003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a77fe700 1 -- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390005000 msgr2=0x7fc39000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390005000 0x7fc39000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a77fe700 1 -- 172.21.15.98:0/1475354942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900033f0 con 0x7fc390004690 2023-08-22T00:42:22.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ac84a700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390005000 0x7fc39000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:22.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ac84a700 1 -- 172.21.15.98:0/1475354942 reap_dead start 2023-08-22T00:42:22.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 0x7fc390004b10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fc39c001860 tx=0x7fc39c007bb0).ready entity=mon.0 client_cookie=219bf81d870d76cd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c007020 con 0x7fc390004690 2023-08-22T00:42:22.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c007180 con 0x7fc390004690 2023-08-22T00:42:22.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3a6ffd700 1 -- 172.21.15.98:0/1475354942 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c007520 con 0x7fc390004690 2023-08-22T00:42:22.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 msgr2=0x7fc390004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 0x7fc390004b10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fc39c001860 tx=0x7fc39c007bb0).stop 2023-08-22T00:42:22.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/1475354942 shutdown_connections 2023-08-22T00:42:22.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/1475354942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc390004690 0x7fc390004b10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/1475354942 >> 172.21.15.98:0/1475354942 conn(0x7fc3a80c5dc0 msgr2=0x7fc3a8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/1475354942 shutdown_connections 2023-08-22T00:42:22.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.177+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/1475354942 wait complete. 2023-08-22T00:42:22.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.178+0000 7fc3ae2ad700 1 Processor -- start 2023-08-22T00:42:22.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 -- start start 2023-08-22T00:42:22.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 0x7fc3a80bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 0x7fc3a8146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c01a0 con 0x7fc3a8146730 2023-08-22T00:42:22.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c1b50 con 0x7fc390004690 2023-08-22T00:42:22.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.179+0000 7fc3ae2ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c2b60 con 0x7fc3a80c26e0 2023-08-22T00:42:22.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ac84a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 0x7fc3a80bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ac84a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55514/0 (socket says 172.21.15.98:55514) 2023-08-22T00:42:22.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ac84a700 1 -- 172.21.15.98:0/4274106674 learned_addr learned my addr 172.21.15.98:0/4274106674 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:22.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 0x7fc3a8146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 msgr2=0x7fc3a8146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 0x7fc3a8146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 msgr2=0x7fc3a80c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 -- 172.21.15.98:0/4274106674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80c0390 con 0x7fc390004690 2023-08-22T00:42:22.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ac84a700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:22.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 0x7fc3a8146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:22.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3a7fff700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 0x7fc3a80bfcb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fc3980011d0 tx=0x7fc398001df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980114c0 con 0x7fc390004690 2023-08-22T00:42:22.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011620 con 0x7fc390004690 2023-08-22T00:42:22.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980119c0 con 0x7fc390004690 2023-08-22T00:42:22.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a80c1220 con 0x7fc390004690 2023-08-22T00:42:22.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.180+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a80c17e0 con 0x7fc390004690 2023-08-22T00:42:22.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.181+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8047480 con 0x7fc390004690 2023-08-22T00:42:22.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.182+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fc39801d3b0 con 0x7fc390004690 2023-08-22T00:42:22.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.182+0000 7fc38ffff700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 0x7fc3940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.182+0000 7fc3a77fe700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 msgr2=0x7fc3940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:22.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.182+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7fc3980798c0 con 0x7fc390004690 2023-08-22T00:42:22.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.182+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 0x7fc3940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:22.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.186+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc39804a8f0 con 0x7fc390004690 2023-08-22T00:42:22.215 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:22.214+0000 7f19abb3b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:42:22.296 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:22.294+0000 7f8b3fd3a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.383+0000 7fc3a77fe700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 msgr2=0x7fc3940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:22.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.383+0000 7fc3a77fe700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 0x7fc3940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:22.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.397+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a80a8940 con 0x7fc390004690 2023-08-22T00:42:22.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.398+0000 7fc38ffff700 1 -- 172.21.15.98:0/4274106674 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc398019020 con 0x7fc390004690 2023-08-22T00:42:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:22.400 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:42:22.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 msgr2=0x7fc3940613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 0x7fc3940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 msgr2=0x7fc3a80bfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 0x7fc3a80bfcb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fc3980011d0 tx=0x7fc398001df0).stop 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 shutdown_connections 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc39405ef30 0x7fc3940613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3a8146730 0x7fc3a80c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390004690 0x7fc3a80bfcb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 --2- 172.21.15.98:0/4274106674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a80c26e0 0x7fc3a8146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 >> 172.21.15.98:0/4274106674 conn(0x7fc3a80c5dc0 msgr2=0x7fc3a8152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 shutdown_connections 2023-08-22T00:42:22.403 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.400+0000 7fc3ae2ad700 1 -- 172.21.15.98:0/4274106674 wait complete. 2023-08-22T00:42:22.403 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:42:22.406 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:22.405+0000 7f19abb3b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:22.414 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:22.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.533+0000 7f256c37f700 1 Processor -- start 2023-08-22T00:42:22.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.533+0000 7f256c37f700 1 -- start start 2023-08-22T00:42:22.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.534+0000 7f256c37f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 0x7f25640c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.534+0000 7f256c37f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2564151030 0x7f25641514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.534+0000 7f256c37f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25640645b0 con 0x7f2564150c50 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.534+0000 7f256c37f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2564063fa0 con 0x7f2564151030 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.534+0000 7f256c37f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2564151f30 con 0x7f25640bc6d0 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a11b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2564150c50 0x7f25640c34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52632/0 (socket says 172.21.15.98:52632) 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a11b700 1 -- 172.21.15.98:0/1520910589 learned_addr learned my addr 172.21.15.98:0/1520910589 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 --2- 172.21.15.98:0/1520910589 >> v2:172.21.15.118:3300/0 conn(0x7f2564151030 0x7f25641514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256991a700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 0x7f25640c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f2569119700 1 -- 172.21.15.98:0/1520910589 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198053276 0 0) 0x7f25640645b0 con 0x7f2564150c50 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f2569119700 1 -- 172.21.15.98:0/1520910589 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25500033f0 con 0x7f2564150c50 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 -- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 msgr2=0x7f25640c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 0x7f25640c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 -- 172.21.15.98:0/1520910589 >> v1:172.21.15.98:6789/0 conn(0x7f2564150c50 legacy=0x7f25640c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 -- 172.21.15.98:0/1520910589 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564152210 con 0x7f2564151030 2023-08-22T00:42:22.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256991a700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 0x7f25640c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:22.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f256a91c700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2564151030 0x7f25641514e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f255c009e60 tx=0x7f255c009780).ready entity=mon.1 client_cookie=8403a4890641fd8f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f2569119700 1 -- 172.21.15.98:0/1520910589 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00e070 con 0x7f2564151030 2023-08-22T00:42:22.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f2569119700 1 -- 172.21.15.98:0/1520910589 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00bab0 con 0x7f2564151030 2023-08-22T00:42:22.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.535+0000 7f2569119700 1 -- 172.21.15.98:0/1520910589 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00be30 con 0x7f2564151030 2023-08-22T00:42:22.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 -- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2564151030 msgr2=0x7f25641514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2564151030 0x7f25641514e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f255c009e60 tx=0x7f255c009780).stop 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 -- 172.21.15.98:0/1520910589 shutdown_connections 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2564151030 0x7f25641514e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 --2- 172.21.15.98:0/1520910589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25640bc6d0 0x7f25640c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 -- 172.21.15.98:0/1520910589 >> 172.21.15.98:0/1520910589 conn(0x7f25640c7770 msgr2=0x7f25640c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 -- 172.21.15.98:0/1520910589 shutdown_connections 2023-08-22T00:42:22.543 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.536+0000 7f256c37f700 1 -- 172.21.15.98:0/1520910589 wait complete. 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.538+0000 7f256c37f700 1 Processor -- start 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.538+0000 7f256c37f700 1 -- start start 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640bc6d0 0x7f2564160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 0x7f25640aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256414fe70 con 0x7f2564151030 2023-08-22T00:42:22.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640ab6c0 con 0x7f25640bc6d0 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640aac10 con 0x7f2564150c50 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55518/0 (socket says 172.21.15.98:55518) 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a11b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640bc6d0 0x7f2564160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 -- 172.21.15.98:0/1832138890 learned_addr learned my addr 172.21.15.98:0/1832138890 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256991a700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 0x7f25640aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 -- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 msgr2=0x7f25640aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 0x7f25640aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 -- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640bc6d0 msgr2=0x7f2564160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640bc6d0 0x7f2564160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 -- 172.21.15.98:0/1832138890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540092a0 con 0x7f2564151030 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256991a700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 0x7f25640aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256a91c700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f255c00b610 tx=0x7f255c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c013e70 con 0x7f2564151030 2023-08-22T00:42:22.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c011580 con 0x7f2564151030 2023-08-22T00:42:22.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c009a20 con 0x7f2564151030 2023-08-22T00:42:22.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c011940 con 0x7f2564151030 2023-08-22T00:42:22.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.539+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25640aced0 con 0x7f2564151030 2023-08-22T00:42:22.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.540+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2564047480 con 0x7f2564151030 2023-08-22T00:42:22.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.541+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f255c003040 con 0x7f2564151030 2023-08-22T00:42:22.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.541+0000 7f255a7fc700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 0x7f25480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.541+0000 7f256a11b700 1 -- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 msgr2=0x7f25480613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:22.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.541+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f255c07bbb0 con 0x7f2564151030 2023-08-22T00:42:22.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.541+0000 7f256a11b700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 0x7f25480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:22.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.549+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f255c04cb90 con 0x7f2564151030 2023-08-22T00:42:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.718+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25640ab520 con 0x7f2564151030 2023-08-22T00:42:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.719+0000 7f255a7fc700 1 -- 172.21.15.98:0/1832138890 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+17930 (secure 0 0 0) 0x7f25640ab520 con 0x7f2564151030 2023-08-22T00:42:22.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:22.721 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":171,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:21.620809+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":171,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1797843422":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1248643734":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/834321445":"2023-08-23T00:37:20.759247+0000","172.21.15.98:6833/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:6832/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/1637765333":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1090399856":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/436321134":"2023-08-23T00:26:08.256325+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:22.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 msgr2=0x7f25480613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:22.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 0x7f25480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 msgr2=0x7f25640ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f255c00b610 tx=0x7f255c009780).stop 2023-08-22T00:42:22.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 shutdown_connections 2023-08-22T00:42:22.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f254805ef30 0x7f25480613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:22.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2564151030 0x7f25640ac9e0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640bc6d0 0x7f2564160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 --2- 172.21.15.98:0/1832138890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2564150c50 0x7f25640aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 >> 172.21.15.98:0/1832138890 conn(0x7f25640c7770 msgr2=0x7f2564156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 shutdown_connections 2023-08-22T00:42:22.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.721+0000 7f256c37f700 1 -- 172.21.15.98:0/1832138890 wait complete. 2023-08-22T00:42:22.735 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:42:22.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:22.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.854+0000 7f0a13935700 1 Processor -- start 2023-08-22T00:42:22.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.854+0000 7f0a13935700 1 -- start start 2023-08-22T00:42:22.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0a0c153b60 0x7f0a0c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c153f40 0x7f0a0c069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0a0c0a9140 0x7f0a0c157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c069720 con 0x7f0a0c0a9140 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c0a8410 con 0x7f0a0c153b60 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a13935700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0a8cb0 con 0x7f0a0c153f40 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a11ed2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0a0c0a9140 0x7f0a0c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a11ed2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0a0c0a9140 0x7f0a0c157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55534/0 (socket says 172.21.15.98:55534) 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a11ed2700 1 -- 172.21.15.98:0/4094972829 learned_addr learned my addr 172.21.15.98:0/4094972829 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a116d1700 1 --2- 172.21.15.98:0/4094972829 >> v2:172.21.15.118:3300/0 conn(0x7f0a0c153b60 0x7f0a0c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.855+0000 7f0a10ed0700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c153f40 0x7f0a0c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 -- 172.21.15.98:0/4094972829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c153f40 msgr2=0x7f0a0c069230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c153f40 0x7f0a0c069230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 -- 172.21.15.98:0/4094972829 >> v2:172.21.15.118:3300/0 conn(0x7f0a0c153b60 msgr2=0x7f0a0c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 --2- 172.21.15.98:0/4094972829 >> v2:172.21.15.118:3300/0 conn(0x7f0a0c153b60 0x7f0a0c068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 -- 172.21.15.98:0/4094972829 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c1586a0 con 0x7f0a0c0a9140 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a11ed2700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c0a9140 0x7f0a0c157930 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f0a0c05fcb0 tx=0x7f0a04009840).ready entity=mon.0 client_cookie=cc551e159f0314cc server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a03fff700 1 -- 172.21.15.98:0/4094972829 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400e070 con 0x7f0a0c0a9140 2023-08-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a03fff700 1 -- 172.21.15.98:0/4094972829 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400b970 con 0x7f0a0c0a9140 2023-08-22T00:42:22.860 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.856+0000 7f0a03fff700 1 -- 172.21.15.98:0/4094972829 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400bcf0 con 0x7f0a0c0a9140 2023-08-22T00:42:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 -- 172.21.15.98:0/4094972829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c0a9140 msgr2=0x7f0a0c157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c0a9140 0x7f0a0c157930 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f0a0c05fcb0 tx=0x7f0a04009840).stop 2023-08-22T00:42:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 -- 172.21.15.98:0/4094972829 shutdown_connections 2023-08-22T00:42:22.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c0a9140 0x7f0a0c157930 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 --2- 172.21.15.98:0/4094972829 >> v2:172.21.15.118:3300/0 conn(0x7f0a0c153b60 0x7f0a0c068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 --2- 172.21.15.98:0/4094972829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c153f40 0x7f0a0c069230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 -- 172.21.15.98:0/4094972829 >> 172.21.15.98:0/4094972829 conn(0x7f0a0c0c5dc0 msgr2=0x7f0a0c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 -- 172.21.15.98:0/4094972829 shutdown_connections 2023-08-22T00:42:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.857+0000 7f0a13935700 1 -- 172.21.15.98:0/4094972829 wait complete. 2023-08-22T00:42:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.858+0000 7f0a13935700 1 Processor -- start 2023-08-22T00:42:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.858+0000 7f0a13935700 1 -- start start 2023-08-22T00:42:22.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c0a9140 0x7f0a0c14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a0c153f40 0x7f0a0c0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c067b10 con 0x7f0a0c153b60 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c18c0 con 0x7f0a0c153f40 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a13935700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c0cb0 con 0x7f0a0c0a9140 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55548/0 (socket says 172.21.15.98:55548) 2023-08-22T00:42:22.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 -- 172.21.15.98:0/3895600659 learned_addr learned my addr 172.21.15.98:0/3895600659 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a11ed2700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a0c153f40 0x7f0a0c0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a116d1700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c0a9140 0x7f0a0c14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c0a9140 msgr2=0x7f0a0c14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c0a9140 0x7f0a0c14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a0c153f40 msgr2=0x7f0a0c0ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a0c153f40 0x7f0a0c0ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:22.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 -- 172.21.15.98:0/3895600659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009ae0 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.859+0000 7f0a10ed0700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f09fc00e900 tx=0x7f09fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.860+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc012600 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.860+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc012760 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.860+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0c0f90 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.860+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc012ae0 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.860+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0c1550 con 0x7f0a0c153b60 2023-08-22T00:42:22.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c047480 con 0x7f0a0c153b60 2023-08-22T00:42:22.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f09fc01b400 con 0x7f0a0c153b60 2023-08-22T00:42:22.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a017fa700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 0x7f09f00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:22.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a116d1700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 msgr2=0x7f09f00613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:22.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f09fc07a600 con 0x7f0a0c153b60 2023-08-22T00:42:22.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.861+0000 7f0a116d1700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 0x7f09f00613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:22.866+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09fc04b580 con 0x7f0a0c153b60 2023-08-22T00:42:22.947 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:22.945+0000 7f8b3fd3a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:42:23.016 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.014+0000 7f8b3fd3a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:42:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.062+0000 7f0a116d1700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 msgr2=0x7f09f00613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.062+0000 7f0a116d1700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 0x7f09f00613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:23.072 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.071+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a0c0c1a00 con 0x7f0a0c153b60 2023-08-22T00:42:23.073 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.071+0000 7f0a017fa700 1 -- 172.21.15.98:0/3895600659 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f09fc04eba0 con 0x7f0a0c153b60 2023-08-22T00:42:23.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:23.074 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:42:23.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 msgr2=0x7f09f00613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:23.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 0x7f09f00613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 msgr2=0x7f0a0c163cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f09fc00e900 tx=0x7f09fc009060).stop 2023-08-22T00:42:23.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 shutdown_connections 2023-08-22T00:42:23.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f09f005ef30 0x7f09f00613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a0c0a9140 0x7f0a0c14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a0c153f40 0x7f0a0c0ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 --2- 172.21.15.98:0/3895600659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a0c153b60 0x7f0a0c163cc0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 >> 172.21.15.98:0/3895600659 conn(0x7f0a0c0c5dc0 msgr2=0x7f0a0c150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 shutdown_connections 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.073+0000 7f0a13935700 1 -- 172.21.15.98:0/3895600659 wait complete. 2023-08-22T00:42:23.077 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:42:23.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:23.090 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.089+0000 7f8b3fd3a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:42:23.104 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.103+0000 7f19abb3b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:42:23.181 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.180+0000 7f19abb3b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:42:23.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.205+0000 7efe8a811700 1 Processor -- start 2023-08-22T00:42:23.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.205+0000 7efe8a811700 1 -- start start 2023-08-22T00:42:23.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe8a811700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efe84157ad0 0x7efe840c1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe8a811700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840c6a80 con 0x7efe84158340 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe8a811700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840c2150 con 0x7efe84157eb0 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe8a811700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe841587d0 con 0x7efe84157ad0 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe83fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efe84157ad0 0x7efe840c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe88dae700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efe84158340 0x7efe840bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52648/0 (socket says 172.21.15.98:52648) 2023-08-22T00:42:23.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe88dae700 1 -- 172.21.15.98:0/2485405649 learned_addr learned my addr 172.21.15.98:0/2485405649 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe83fff700 1 -- 172.21.15.98:0/2485405649 >> v1:172.21.15.118:6789/0 conn(0x7efe84157eb0 legacy=0x7efe840a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe83fff700 1 -- 172.21.15.98:0/2485405649 >> v1:172.21.15.98:6789/0 conn(0x7efe84158340 legacy=0x7efe840bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe83fff700 1 -- 172.21.15.98:0/2485405649 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840c5e70 con 0x7efe84157ad0 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe83fff700 1 --2- 172.21.15.98:0/2485405649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157ad0 0x7efe840c1590 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7efe74009790 tx=0x7efe74009060).ready entity=mon.0 client_cookie=151575cf937d93c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.206+0000 7efe82ffd700 1 -- 172.21.15.98:0/2485405649 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400f510 con 0x7efe84157ad0 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe82ffd700 1 -- 172.21.15.98:0/2485405649 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400f670 con 0x7efe84157ad0 2023-08-22T00:42:23.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe82ffd700 1 -- 172.21.15.98:0/2485405649 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400f9f0 con 0x7efe84157ad0 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 -- 172.21.15.98:0/2485405649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157ad0 msgr2=0x7efe840c1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 --2- 172.21.15.98:0/2485405649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157ad0 0x7efe840c1590 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7efe74009790 tx=0x7efe74009060).stop 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 -- 172.21.15.98:0/2485405649 shutdown_connections 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 --2- 172.21.15.98:0/2485405649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157ad0 0x7efe840c1590 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 -- 172.21.15.98:0/2485405649 >> 172.21.15.98:0/2485405649 conn(0x7efe840c3990 msgr2=0x7efe840c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 -- 172.21.15.98:0/2485405649 shutdown_connections 2023-08-22T00:42:23.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.207+0000 7efe8a811700 1 -- 172.21.15.98:0/2485405649 wait complete. 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.208+0000 7efe8a811700 1 Processor -- start 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.208+0000 7efe8a811700 1 -- start start 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe84157ad0 0x7efe840a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe84158340 0x7efe84146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840a7620 con 0x7efe84157eb0 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840bbe50 con 0x7efe84158340 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe8a811700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840a95d0 con 0x7efe84157ad0 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe88dae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe84158340 0x7efe84146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe83fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe84157ad0 0x7efe840a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55574/0 (socket says 172.21.15.98:55574) 2023-08-22T00:42:23.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.209+0000 7efe837fe700 1 -- 172.21.15.98:0/1474870348 learned_addr learned my addr 172.21.15.98:0/1474870348 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe84157ad0 msgr2=0x7efe840a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe84157ad0 0x7efe840a7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe84158340 msgr2=0x7efe84146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe84158340 0x7efe84146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 -- 172.21.15.98:0/1474870348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740092a0 con 0x7efe84157eb0 2023-08-22T00:42:23.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe837fe700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7efe7800c4c0 tx=0x7efe78007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800ce70 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78001e90 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84146f30 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78007250 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.210+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe840a78e0 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.211+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe840bc000 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.211+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7efe780066a0 con 0x7efe84157eb0 2023-08-22T00:42:23.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.212+0000 7efe6bfff700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 0x7efe700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.212+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7efe78079b20 con 0x7efe84157eb0 2023-08-22T00:42:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.212+0000 7efe83fff700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 msgr2=0x7efe700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.212+0000 7efe83fff700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 0x7efe700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:23.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.216+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe840bc000 con 0x7efe84157eb0 2023-08-22T00:42:23.237 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.235+0000 7f8b3fd3a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:42:23.263 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.262+0000 7f19abb3b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:42:23.307 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.306+0000 7f8b3fd3a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:42:23.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.413+0000 7efe83fff700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 msgr2=0x7efe700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:23.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.413+0000 7efe83fff700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 0x7efe700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:23.416 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.415+0000 7f19abb3b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:42:23.421 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.420+0000 7f8b3fd3a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:42:23.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.424+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe840bc000 con 0x7efe84157eb0 2023-08-22T00:42:23.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.425+0000 7efe6bfff700 1 -- 172.21.15.98:0/1474870348 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4494 (secure 0 0 0) 0x7efe840bc000 con 0x7efe84157eb0 2023-08-22T00:42:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:23.426 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:25:50.766928+0000","modified":"2023-08-22T00:25:53.771885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4180158445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4180158445},{"type":"v1","addr":"172.21.15.118:6835","nonce":4180158445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-22T00:42:23.428 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 msgr2=0x7efe700613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:23.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 0x7efe700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 msgr2=0x7efe840a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7efe7800c4c0 tx=0x7efe78007e00).stop 2023-08-22T00:42:23.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 shutdown_connections 2023-08-22T00:42:23.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7efe7005ef30 0x7efe700613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe84157ad0 0x7efe840a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe84158340 0x7efe84146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 --2- 172.21.15.98:0/1474870348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe84157eb0 0x7efe840a90e0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 >> 172.21.15.98:0/1474870348 conn(0x7efe840c3990 msgr2=0x7efe840c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 shutdown_connections 2023-08-22T00:42:23.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.427+0000 7efe8a811700 1 -- 172.21.15.98:0/1474870348 wait complete. 2023-08-22T00:42:23.433 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 62 2023-08-22T00:42:23.440 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:23.491 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.490+0000 7f19abb3b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:42:23.529 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.527+0000 7f8b3fd3a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.599+0000 7f20fc2f9700 1 Processor -- start 2023-08-22T00:42:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.599+0000 7f20fc2f9700 1 -- start start 2023-08-22T00:42:23.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fc2f9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20f4154c00 0x7f20f414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fc2f9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f40c17b0 con 0x7f20f414e0d0 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fc2f9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f4155260 con 0x7f20f40c61a0 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fc2f9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40bf9e0 con 0x7f20f4154c00 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fa095700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f20f414e0d0 0x7f20f40c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52662/0 (socket says 172.21.15.98:52662) 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fa095700 1 -- 172.21.15.98:0/3423949746 learned_addr learned my addr 172.21.15.98:0/3423949746 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.600+0000 7f20fa896700 1 --2- 172.21.15.98:0/3423949746 >> v2:172.21.15.118:3300/0 conn(0x7f20f4154c00 0x7f20f414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028010223 0 0) 0x7f20f40c17b0 con 0x7f20f414e0d0 2023-08-22T00:42:23.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e00033f0 con 0x7f20f414e0d0 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958299901 0 0) 0x7f20f4155260 con 0x7f20f40c61a0 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f40c17b0 con 0x7f20f40c61a0 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20fa896700 1 -- 172.21.15.98:0/3423949746 >> v1:172.21.15.118:6789/0 conn(0x7f20f40c61a0 legacy=0x7f20f41544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20fa896700 1 -- 172.21.15.98:0/3423949746 >> v1:172.21.15.98:6789/0 conn(0x7f20f414e0d0 legacy=0x7f20f40c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20fa896700 1 -- 172.21.15.98:0/3423949746 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40bfcc0 con 0x7f20f4154c00 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20fa896700 1 --2- 172.21.15.98:0/3423949746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f4154c00 0x7f20f414e4b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f20ec009e60 tx=0x7f20ec009780).ready entity=mon.1 client_cookie=bf7061fcd8a39bb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00e070 con 0x7f20f4154c00 2023-08-22T00:42:23.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec00bab0 con 0x7f20f4154c00 2023-08-22T00:42:23.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.601+0000 7f20f9093700 1 -- 172.21.15.98:0/3423949746 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00be30 con 0x7f20f4154c00 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3423949746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f4154c00 msgr2=0x7f20f414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3423949746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f4154c00 0x7f20f414e4b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f20ec009e60 tx=0x7f20ec009780).stop 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3423949746 shutdown_connections 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3423949746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f4154c00 0x7f20f414e4b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3423949746 >> 172.21.15.98:0/3423949746 conn(0x7f20f40caa80 msgr2=0x7f20f40cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3423949746 shutdown_connections 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.602+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3423949746 wait complete. 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.603+0000 7f20fc2f9700 1 Processor -- start 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.603+0000 7f20fc2f9700 1 -- start start 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f40c61a0 0x7f20f413f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20f414e0d0 0x7f20f41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4150070 con 0x7f20f4154c00 2023-08-22T00:42:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f413fa20 con 0x7f20f40c61a0 2023-08-22T00:42:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f414f1c0 con 0x7f20f414e0d0 2023-08-22T00:42:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55590/0 (socket says 172.21.15.98:55590) 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 -- 172.21.15.98:0/3686574290 learned_addr learned my addr 172.21.15.98:0/3686574290 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa095700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f40c61a0 0x7f20f413f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20f9894700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20f414e0d0 0x7f20f41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 -- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20f414e0d0 msgr2=0x7f20f41565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20f414e0d0 0x7f20f41565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 -- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f40c61a0 msgr2=0x7f20f413f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f40c61a0 0x7f20f413f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 -- 172.21.15.98:0/3686574290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec009a20 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fa896700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f20ec0070a0 tx=0x7f20ec009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec01d630 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec01d790 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec01db30 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f414f460 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.604+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f414fa20 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f20ec003040 con 0x7f20f4154c00 2023-08-22T00:42:23.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f4150220 con 0x7f20f4154c00 2023-08-22T00:42:23.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20ea7fc700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20fa095700 1 -- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 msgr2=0x7f20d80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:23.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f20ec07c060 con 0x7f20f4154c00 2023-08-22T00:42:23.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.606+0000 7f20fa095700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:23.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.610+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20f4150220 con 0x7f20f4154c00 2023-08-22T00:42:23.616 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.615+0000 7f19abb3b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:42:23.729 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:23.728+0000 7f19abb3b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:23.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.778+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20f4150220 con 0x7f20f4154c00 2023-08-22T00:42:23.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.779+0000 7f20ea7fc700 1 -- 172.21.15.98:0/3686574290 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+17930 (secure 0 0 0) 0x7f20f4150220 con 0x7f20f4154c00 2023-08-22T00:42:23.780 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:23.781 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":171,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:21.620809+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:25:49.331360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-08-22T00:25:49.717913+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":171,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1797843422":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1248643734":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/834321445":"2023-08-23T00:37:20.759247+0000","172.21.15.98:6833/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:6832/118203":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/1637765333":"2023-08-23T00:37:20.759247+0000","172.21.15.98:0/1090399856":"2023-08-23T00:26:08.256325+0000","172.21.15.98:0/436321134":"2023-08-23T00:26:08.256325+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:23.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 msgr2=0x7f20d80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:23.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 msgr2=0x7f20f4156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f20ec0070a0 tx=0x7f20ec009780).stop 2023-08-22T00:42:23.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 shutdown_connections 2023-08-22T00:42:23.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:23.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f4154c00 0x7f20f4156ae0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20f40c61a0 0x7f20f413f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 --2- 172.21.15.98:0/3686574290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20f414e0d0 0x7f20f41565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 >> 172.21.15.98:0/3686574290 conn(0x7f20f40caa80 msgr2=0x7f20f40cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 shutdown_connections 2023-08-22T00:42:23.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.781+0000 7f20fc2f9700 1 -- 172.21.15.98:0/3686574290 wait complete. 2023-08-22T00:42:23.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:42:23.820 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.819+0000 7f8b3fd3a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:42:23.892 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:23.890+0000 7f8b3fd3a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:42:23.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.960+0000 7f174e566700 1 Processor -- start 2023-08-22T00:42:23.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.960+0000 7f174e566700 1 -- start start 2023-08-22T00:42:23.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174e566700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174e566700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480c3d00 con 0x7f17480aa980 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174e566700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480c3fe0 con 0x7f1748154040 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174e566700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c42c0 con 0x7f1748153c60 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174cb03700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f17480aa980 0x7f17480aada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52664/0 (socket says 172.21.15.98:52664) 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f174cb03700 1 -- 172.21.15.98:0/1544238763 learned_addr learned my addr 172.21.15.98:0/1544238763 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1747fff700 1 --2- 172.21.15.98:0/1544238763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515225918 0 0) 0x7f17480c3d00 con 0x7f17480aa980 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17300033f0 con 0x7f17480aa980 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898552345 0 0) 0x7f17480c3fe0 con 0x7f1748154040 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17480c3d00 con 0x7f1748154040 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1747fff700 1 -- 172.21.15.98:0/1544238763 >> v1:172.21.15.118:6789/0 conn(0x7f1748154040 legacy=0x7f17480bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1747fff700 1 -- 172.21.15.98:0/1544238763 >> v1:172.21.15.98:6789/0 conn(0x7f17480aa980 legacy=0x7f17480aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1747fff700 1 -- 172.21.15.98:0/1544238763 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480c45a0 con 0x7f1748153c60 2023-08-22T00:42:23.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.961+0000 7f1747fff700 1 --2- 172.21.15.98:0/1544238763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480c4da0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1738009790 tx=0x7f1738009060).ready entity=mon.2 client_cookie=13e793744165933f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800f510 con 0x7f1748153c60 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173800f670 con 0x7f1748153c60 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f1746ffd700 1 -- 172.21.15.98:0/1544238763 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800f9f0 con 0x7f1748153c60 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 -- 172.21.15.98:0/1544238763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 msgr2=0x7f17480c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 --2- 172.21.15.98:0/1544238763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480c4da0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1738009790 tx=0x7f1738009060).stop 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 -- 172.21.15.98:0/1544238763 shutdown_connections 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 --2- 172.21.15.98:0/1544238763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480c4da0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 -- 172.21.15.98:0/1544238763 >> 172.21.15.98:0/1544238763 conn(0x7f17480c93e0 msgr2=0x7f17480c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:23.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 -- 172.21.15.98:0/1544238763 shutdown_connections 2023-08-22T00:42:23.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.962+0000 7f174e566700 1 -- 172.21.15.98:0/1544238763 wait complete. 2023-08-22T00:42:23.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.964+0000 7f174e566700 1 Processor -- start 2023-08-22T00:42:23.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.964+0000 7f174e566700 1 -- start start 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1748154040 0x7f174814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480a5ea0 con 0x7f17480aa980 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480a60d0 con 0x7f1748154040 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f174e566700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480a63b0 con 0x7f1748153c60 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f1747fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f1747fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55598/0 (socket says 172.21.15.98:55598) 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.965+0000 7f1747fff700 1 -- 172.21.15.98:0/1184259733 learned_addr learned my addr 172.21.15.98:0/1184259733 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f174cb03700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1748154040 0x7f174814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f17477fe700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 msgr2=0x7f17480a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1748154040 msgr2=0x7f174814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:23.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1748154040 0x7f174814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 -- 172.21.15.98:0/1184259733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380092a0 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f1747fff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f1748060cf0 tx=0x7f1738017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800fe80 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173800f7e0 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480a6690 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173801b640 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.966+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480a6c50 con 0x7f17480aa980 2023-08-22T00:42:23.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.967+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480a6e10 con 0x7f17480aa980 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.968+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 84) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f173801ba30 con 0x7f17480aa980 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.968+0000 7f172ffff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f17340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.968+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f173807bc10 con 0x7f17480aa980 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.968+0000 7f17477fe700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 msgr2=0x7f17340613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.968+0000 7f17477fe700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f17340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:23.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:23.972+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f173804cbf0 con 0x7f17480aa980 2023-08-22T00:42:24.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:42:24.019 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:42:24.056 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.055+0000 7f19abb3b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:42:24.131 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.130+0000 7f19abb3b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:42:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:24.148+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 85) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f173801bce0 con 0x7f17480aa980 2023-08-22T00:42:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:24.148+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 msgr2=0x7f17340613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:24.148+0000 7f172ffff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f17340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:24.208 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192ddf4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192ddf4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192ddf4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192ddf4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192ddf4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192a5ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.209 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192a5ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.210 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192a5ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.210 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192a5ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.210 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:24.207+0000 7f192a5ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:24.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:24.213+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17480a6fa0 con 0x7f17480aa980 2023-08-22T00:42:25.147 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:42:25.146+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:42:25.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.152+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 86) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f17380798d0 con 0x7f17480aa980 2023-08-22T00:42:25.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.152+0000 7f172ffff700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f1734061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.153+0000 7f17477fe700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f1734061370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.154+0000 7f17477fe700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f1734061370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f17481502e0 tx=0x7f173c007bd0).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:25.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.159+0000 7f172ffff700 1 -- 172.21.15.98:0/1184259733 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f173804dc00 con 0x7f17480aa980 2023-08-22T00:42:25.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 msgr2=0x7f1734061370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f1734061370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f17481502e0 tx=0x7f173c007bd0).stop 2023-08-22T00:42:25.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 msgr2=0x7f17480a7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f1748060cf0 tx=0x7f1738017000).stop 2023-08-22T00:42:25.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 shutdown_connections 2023-08-22T00:42:25.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f173405ef30 0x7f1734061370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1748154040 0x7f174814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17480aa980 0x7f17480a7170 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 --2- 172.21.15.98:0/1184259733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1748153c60 0x7f17480a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 >> 172.21.15.98:0/1184259733 conn(0x7f17480c93e0 msgr2=0x7f1748151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.161+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 shutdown_connections 2023-08-22T00:42:25.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.162+0000 7f174e566700 1 -- 172.21.15.98:0/1184259733 wait complete. 2023-08-22T00:42:25.165 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:42:25.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:42:25.195 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:42:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.295+0000 7faee3cd9700 1 Processor -- start 2023-08-22T00:42:25.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.296+0000 7faee3cd9700 1 -- start start 2023-08-22T00:42:25.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.296+0000 7faee3cd9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 0x7faedc0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.296+0000 7faee3cd9700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0c3f00 con 0x7faedc0bea40 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.296+0000 7faee3cd9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0c32f0 con 0x7faedc0c4390 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.296+0000 7faee3cd9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c4820 con 0x7faedc153f10 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1a75700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7faedc0bea40 0x7faedc153800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52674/0 (socket says 172.21.15.98:52674) 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1a75700 1 -- 172.21.15.98:0/3183321952 learned_addr learned my addr 172.21.15.98:0/3183321952 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1274700 1 --2- 172.21.15.98:0/3183321952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 0x7faedc0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382207772 0 0) 0x7faedc0c3f00 con 0x7faedc0bea40 2023-08-22T00:42:25.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec80033f0 con 0x7faedc0bea40 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202762145 0 0) 0x7faedc0c32f0 con 0x7faedc0c4390 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faedc0c3f00 con 0x7faedc0c4390 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1274700 1 -- 172.21.15.98:0/3183321952 >> v1:172.21.15.118:6789/0 conn(0x7faedc0c4390 legacy=0x7faedc068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1274700 1 -- 172.21.15.98:0/3183321952 >> v1:172.21.15.98:6789/0 conn(0x7faedc0bea40 legacy=0x7faedc153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2470147710 0 0) 0x7faec80033f0 con 0x7faedc0bea40 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1274700 1 -- 172.21.15.98:0/3183321952 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0c35d0 con 0x7faedc153f10 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee1274700 1 --2- 172.21.15.98:0/3183321952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 0x7faedc0bee20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faed8009790 tx=0x7faed8009060).ready entity=mon.2 client_cookie=d6969fc09b4d1bbf server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:25.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc001470 con 0x7faedc153f10 2023-08-22T00:42:25.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80090d0 con 0x7faedc153f10 2023-08-22T00:42:25.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.297+0000 7faee0a73700 1 -- 172.21.15.98:0/3183321952 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8011610 con 0x7faedc153f10 2023-08-22T00:42:25.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 -- 172.21.15.98:0/3183321952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 msgr2=0x7faedc0bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 --2- 172.21.15.98:0/3183321952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 0x7faedc0bee20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faed8009790 tx=0x7faed8009060).stop 2023-08-22T00:42:25.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 -- 172.21.15.98:0/3183321952 shutdown_connections 2023-08-22T00:42:25.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 --2- 172.21.15.98:0/3183321952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc153f10 0x7faedc0bee20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 -- 172.21.15.98:0/3183321952 >> 172.21.15.98:0/3183321952 conn(0x7faedc0c5e80 msgr2=0x7faedc0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 -- 172.21.15.98:0/3183321952 shutdown_connections 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.298+0000 7faee3cd9700 1 -- 172.21.15.98:0/3183321952 wait complete. 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.299+0000 7faee3cd9700 1 Processor -- start 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.299+0000 7faee3cd9700 1 -- start start 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc0bea40 0x7faedc151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faedc153f10 0x7faedc0654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc065990 con 0x7faedc0c4390 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc157a20 con 0x7faedc153f10 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc164830 con 0x7faedc0bea40 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55706/0 (socket says 172.21.15.98:55706) 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 -- 172.21.15.98:0/2414240281 learned_addr learned my addr 172.21.15.98:0/2414240281 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:25.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1a75700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc0bea40 0x7faedc151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee2276700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faedc153f10 0x7faedc0654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 -- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc0bea40 msgr2=0x7faedc151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc0bea40 0x7faedc151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 -- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faedc153f10 msgr2=0x7faedc0654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faedc153f10 0x7faedc0654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 -- 172.21.15.98:0/2414240281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80092a0 con 0x7faedc0c4390 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee1274700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7faed8009d80 tx=0x7faed8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:25.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8021070 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80107f0 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc156440 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.300+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8010b90 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.301+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc156a00 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.302+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc06a2f0 con 0x7faedc0c4390 2023-08-22T00:42:25.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.302+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 86) v1 ==== 75166+0+0 (secure 0 0 0) 0x7faed801d430 con 0x7faedc0c4390 2023-08-22T00:42:25.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.302+0000 7faed1ffb700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 0x7faec00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:25.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.302+0000 7faee1a75700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 0x7faec00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:25.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.302+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 7219+0+0 (secure 0 0 0) 0x7faed807b140 con 0x7faedc0c4390 2023-08-22T00:42:25.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.303+0000 7faee1a75700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 0x7faec00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7faecc001660 tx=0x7faecc001520).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:25.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.307+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faed804c2d0 con 0x7faedc0c4390 2023-08-22T00:42:25.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:25.510+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faedc164970 con 0x7faedc0c4390 2023-08-22T00:42:26.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.162+0000 7faed1ffb700 1 -- 172.21.15.98:0/2414240281 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7faed804f8f0 con 0x7faedc0c4390 2023-08-22T00:42:26.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.164+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 msgr2=0x7faec00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.164+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 0x7faec00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7faecc001660 tx=0x7faecc001520).stop 2023-08-22T00:42:26.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.164+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 msgr2=0x7faedc064fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.164+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7faed8009d80 tx=0x7faed8016000).stop 2023-08-22T00:42:26.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.164+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 shutdown_connections 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faec005ecf0 0x7faec00611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faedc0bea40 0x7faedc151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faedc153f10 0x7faedc0654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 --2- 172.21.15.98:0/2414240281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc0c4390 0x7faedc064fb0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 >> 172.21.15.98:0/2414240281 conn(0x7faedc0c5e80 msgr2=0x7faedc152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 shutdown_connections 2023-08-22T00:42:26.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.165+0000 7faee3cd9700 1 -- 172.21.15.98:0/2414240281 wait complete. 2023-08-22T00:42:26.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:42:26.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.303+0000 7ff18b0ed700 1 Processor -- start 2023-08-22T00:42:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.303+0000 7ff18b0ed700 1 -- start start 2023-08-22T00:42:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.304+0000 7ff18b0ed700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff184153ae0 0x7ff1840c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.304+0000 7ff18b0ed700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 0x7ff1840645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.304+0000 7ff18b0ed700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff184155360 con 0x7ff1840bfd80 2023-08-22T00:42:26.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.304+0000 7ff18b0ed700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840c0670 con 0x7ff184153ae0 2023-08-22T00:42:26.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.304+0000 7ff18b0ed700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff184157b50 con 0x7ff1840c0200 2023-08-22T00:42:26.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff184153ae0 0x7ff1840c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff184153ae0 0x7ff1840c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55714/0 (socket says 172.21.15.98:55714) 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 -- 172.21.15.98:0/2034030993 learned_addr learned my addr 172.21.15.98:0/2034030993 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff183fff700 1 --1- 172.21.15.98:0/2034030993 >> v1:172.21.15.98:6789/0 conn(0x7ff1840bfd80 0x7ff184157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52690/0 (socket says 172.21.15.98:52690) 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 -- 172.21.15.98:0/2034030993 >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 msgr2=0x7ff1840645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff18968a700 1 --2- 172.21.15.98:0/2034030993 >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 0x7ff1840645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff1837fe700 1 -- 172.21.15.98:0/2034030993 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153468949 0 0) 0x7ff178001110 con 0x7ff1840bfd80 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 --2- 172.21.15.98:0/2034030993 >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 0x7ff1840645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 -- 172.21.15.98:0/2034030993 >> v1:172.21.15.98:6789/0 conn(0x7ff1840bfd80 legacy=0x7ff184157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 -- 172.21.15.98:0/2034030993 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840c6390 con 0x7ff184153ae0 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff18968a700 1 --2- 172.21.15.98:0/2034030993 >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 0x7ff1840645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff188e89700 1 --2- 172.21.15.98:0/2034030993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff184153ae0 0x7ff1840c5ea0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7ff1840c5250 tx=0x7ff17c009840).ready entity=mon.0 client_cookie=91a08f84c1dcec5e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff1837fe700 1 -- 172.21.15.98:0/2034030993 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00e070 con 0x7ff184153ae0 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff1837fe700 1 -- 172.21.15.98:0/2034030993 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00ba50 con 0x7ff184153ae0 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.305+0000 7ff1837fe700 1 -- 172.21.15.98:0/2034030993 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00bdd0 con 0x7ff184153ae0 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 -- 172.21.15.98:0/2034030993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff184153ae0 msgr2=0x7ff1840c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/2034030993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff184153ae0 0x7ff1840c5ea0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7ff1840c5250 tx=0x7ff17c009840).stop 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 -- 172.21.15.98:0/2034030993 shutdown_connections 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/2034030993 >> v2:172.21.15.118:3300/0 conn(0x7ff1840c0200 0x7ff1840645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/2034030993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff184153ae0 0x7ff1840c5ea0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 -- 172.21.15.98:0/2034030993 >> 172.21.15.98:0/2034030993 conn(0x7ff1840caa50 msgr2=0x7ff1840cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 -- 172.21.15.98:0/2034030993 shutdown_connections 2023-08-22T00:42:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.306+0000 7ff18b0ed700 1 -- 172.21.15.98:0/2034030993 wait complete. 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.307+0000 7ff18b0ed700 1 Processor -- start 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.307+0000 7ff18b0ed700 1 -- start start 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 0x7ff1841646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 0x7ff1840aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff184164b90 con 0x7ff1840bfd80 2023-08-22T00:42:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840aee50 con 0x7ff1840c0200 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840ae560 con 0x7ff184153ae0 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55722/0 (socket says 172.21.15.98:55722) 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 -- 172.21.15.98:0/1140767203 learned_addr learned my addr 172.21.15.98:0/1140767203 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff183fff700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 0x7ff1841646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18968a700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 0x7ff1840aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 -- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 msgr2=0x7ff1840aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 0x7ff1840aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 -- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 msgr2=0x7ff1841646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 0x7ff1841646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 -- 172.21.15.98:0/1140767203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009ae0 con 0x7ff1840bfd80 2023-08-22T00:42:26.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff183fff700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 0x7ff1841646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:26.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18968a700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 0x7ff1840aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:26.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff188e89700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7ff17c007280 tx=0x7ff17c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00bdd0 con 0x7ff1840bfd80 2023-08-22T00:42:26.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c001010 con 0x7ff1840bfd80 2023-08-22T00:42:26.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c01c630 con 0x7ff1840bfd80 2023-08-22T00:42:26.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1840ae800 con 0x7ff1840bfd80 2023-08-22T00:42:26.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.308+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1840ae220 con 0x7ff1840bfd80 2023-08-22T00:42:26.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.309+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff184047480 con 0x7ff1840bfd80 2023-08-22T00:42:26.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.310+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 86) v1 ==== 75166+0+0 (secure 0 0 0) 0x7ff17c01c9a0 con 0x7ff1840bfd80 2023-08-22T00:42:26.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.310+0000 7ff180ff9700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 0x7ff1700611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.310+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 7219+0+0 (secure 0 0 0) 0x7ff17c07ba80 con 0x7ff1840bfd80 2023-08-22T00:42:26.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.310+0000 7ff183fff700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 0x7ff1700611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.310+0000 7ff183fff700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 0x7ff1700611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff1840a9fc0 tx=0x7ff178009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.314+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff17c04cc70 con 0x7ff1840bfd80 2023-08-22T00:42:26.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.476+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff184154ac0 con 0x7ff1840bfd80 2023-08-22T00:42:26.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.574+0000 7ff180ff9700 1 -- 172.21.15.98:0/1140767203 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v175) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff17c050290 con 0x7ff1840bfd80 2023-08-22T00:42:26.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 msgr2=0x7ff1700611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 0x7ff1700611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff1840a9fc0 tx=0x7ff178009040).stop 2023-08-22T00:42:26.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 msgr2=0x7ff1840adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7ff17c007280 tx=0x7ff17c009840).stop 2023-08-22T00:42:26.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 shutdown_connections 2023-08-22T00:42:26.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff17005ecf0 0x7ff1700611b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff184153ae0 0x7ff1840aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1840bfd80 0x7ff1840adb90 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 --2- 172.21.15.98:0/1140767203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1840c0200 0x7ff1841646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 >> 172.21.15.98:0/1140767203 conn(0x7ff1840caa50 msgr2=0x7ff1840c0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:26.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 shutdown_connections 2023-08-22T00:42:26.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.577+0000 7ff18b0ed700 1 -- 172.21.15.98:0/1140767203 wait complete. 2023-08-22T00:42:26.580 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:42:26.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:42:26.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.716+0000 7fb1fd900700 1 Processor -- start 2023-08-22T00:42:26.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.716+0000 7fb1fd900700 1 -- start start 2023-08-22T00:42:26.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1fd900700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f8153d30 0x7fb1f8154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1fd900700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f80bce10 0x7fb1f806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1fd900700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80c1a40 con 0x7fb1f80bc020 2023-08-22T00:42:26.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1fd900700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80c31f0 con 0x7fb1f8153d30 2023-08-22T00:42:26.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1fd900700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80bd260 con 0x7fb1f80bce10 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f8153d30 0x7fb1f8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1f8153d30 0x7fb1f8154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55734/0 (socket says 172.21.15.98:55734) 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 -- 172.21.15.98:0/853061852 learned_addr learned my addr 172.21.15.98:0/853061852 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f77fe700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f80bce10 0x7fb1f806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 -- 172.21.15.98:0/853061852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f80bce10 msgr2=0x7fb1f806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f80bce10 0x7fb1f806a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 -- 172.21.15.98:0/853061852 >> v1:172.21.15.118:6789/0 conn(0x7fb1f80bc020 legacy=0x7fb1f80c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.717+0000 7fb1f6ffd700 1 -- 172.21.15.98:0/853061852 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80c1d20 con 0x7fb1f8153d30 2023-08-22T00:42:26.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f8153d30 0x7fb1f8154110 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fb1e8006fd0 tx=0x7fb1e80090f0).ready entity=mon.0 client_cookie=9f228c292db82f46 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1f5ffb700 1 -- 172.21.15.98:0/853061852 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800b580 con 0x7fb1f8153d30 2023-08-22T00:42:26.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1f5ffb700 1 -- 172.21.15.98:0/853061852 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800b6e0 con 0x7fb1f8153d30 2023-08-22T00:42:26.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1f5ffb700 1 -- 172.21.15.98:0/853061852 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800ba60 con 0x7fb1f8153d30 2023-08-22T00:42:26.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1fd900700 1 -- 172.21.15.98:0/853061852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f8153d30 msgr2=0x7fb1f8154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.718+0000 7fb1fd900700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f8153d30 0x7fb1f8154110 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fb1e8006fd0 tx=0x7fb1e80090f0).stop 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 -- 172.21.15.98:0/853061852 shutdown_connections 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f80bce10 0x7fb1f806a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 --2- 172.21.15.98:0/853061852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f8153d30 0x7fb1f8154110 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 -- 172.21.15.98:0/853061852 >> 172.21.15.98:0/853061852 conn(0x7fb1f80696a0 msgr2=0x7fb1f8069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 -- 172.21.15.98:0/853061852 shutdown_connections 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.719+0000 7fb1fd900700 1 -- 172.21.15.98:0/853061852 wait complete. 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.720+0000 7fb1fd900700 1 Processor -- start 2023-08-22T00:42:26.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.720+0000 7fb1fd900700 1 -- start start 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 0x7fb1f80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f8153d30 0x7fb1f81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80c0650 con 0x7fb1f80bce10 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8150d90 con 0x7fb1f80bc020 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80bfa40 con 0x7fb1f8153d30 2023-08-22T00:42:26.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55748/0 (socket says 172.21.15.98:55748) 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 -- 172.21.15.98:0/2145593483 learned_addr learned my addr 172.21.15.98:0/2145593483 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 0x7fb1f80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f77fe700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f8153d30 0x7fb1f81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 -- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f8153d30 msgr2=0x7fb1f81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f8153d30 0x7fb1f81565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 -- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 msgr2=0x7fb1f80bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:26.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 0x7fb1f80bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 -- 172.21.15.98:0/2145593483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8009370 con 0x7fb1f80bce10 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 0x7fb1f80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1f67fc700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fb1ec00c4c0 tx=0x7fb1ec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec007020 con 0x7fb1f80bce10 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec001e90 con 0x7fb1f80bce10 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80bfd20 con 0x7fb1f80bce10 2023-08-22T00:42:26.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.721+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0073b0 con 0x7fb1f80bce10 2023-08-22T00:42:26.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.722+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f80c02e0 con 0x7fb1f80bce10 2023-08-22T00:42:26.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.723+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f8068340 con 0x7fb1f80bce10 2023-08-22T00:42:26.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.723+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb1ec0068b0 con 0x7fb1f80bce10 2023-08-22T00:42:26.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.723+0000 7fb1deffd700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 0x7fb1e40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:26.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.724+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb1ec079be0 con 0x7fb1f80bce10 2023-08-22T00:42:26.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.728+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 0x7fb1e40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:26.729 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.729+0000 7fb1f6ffd700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 0x7fb1e40613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb1e8009130 tx=0x7fb1e8017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:26.732 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.731+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1ec04ac40 con 0x7fb1f80bce10 2023-08-22T00:42:26.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:26.899+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1f80c2e90 con 0x7fb1f80bce10 2023-08-22T00:42:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.654+0000 7fb1deffd700 1 -- 172.21.15.98:0/2145593483 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v176) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1ec04e260 con 0x7fb1f80bce10 2023-08-22T00:42:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 msgr2=0x7fb1e40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 0x7fb1e40613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb1e8009130 tx=0x7fb1e8017000).stop 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 msgr2=0x7fb1f81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fb1ec00c4c0 tx=0x7fb1ec007e00).stop 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 shutdown_connections 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb1e405ef00 0x7fb1e40613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f8153d30 0x7fb1f81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f80bc020 0x7fb1f80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 --2- 172.21.15.98:0/2145593483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1f80bce10 0x7fb1f81560f0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 >> 172.21.15.98:0/2145593483 conn(0x7fb1f80696a0 msgr2=0x7fb1f80a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 shutdown_connections 2023-08-22T00:42:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.657+0000 7fb1fd900700 1 -- 172.21.15.98:0/2145593483 wait complete. 2023-08-22T00:42:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:42:27.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:42:27.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.797+0000 7ff276174700 1 Processor -- start 2023-08-22T00:42:27.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 -- start start 2023-08-22T00:42:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff2701507e0 0x7ff270065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff2700c3940 0x7ff270150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff270066780 con 0x7ff2700c34c0 2023-08-22T00:42:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700c2100 con 0x7ff2700c3940 2023-08-22T00:42:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.798+0000 7ff276174700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700c40b0 con 0x7ff2701507e0 2023-08-22T00:42:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff2700c3940 0x7ff270150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff2700c3940 0x7ff270150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55762/0 (socket says 172.21.15.98:55762) 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 -- 172.21.15.98:0/586220764 learned_addr learned my addr 172.21.15.98:0/586220764 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26f7fe700 1 --2- 172.21.15.98:0/586220764 >> v2:172.21.15.118:3300/0 conn(0x7ff2701507e0 0x7ff270065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 -- 172.21.15.98:0/586220764 >> v2:172.21.15.118:3300/0 conn(0x7ff2701507e0 msgr2=0x7ff270065730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 --2- 172.21.15.98:0/586220764 >> v2:172.21.15.118:3300/0 conn(0x7ff2701507e0 0x7ff270065730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 -- 172.21.15.98:0/586220764 >> v1:172.21.15.118:6789/0 conn(0x7ff2700c34c0 legacy=0x7ff2700c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 -- 172.21.15.98:0/586220764 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700c3dd0 con 0x7ff2700c3940 2023-08-22T00:42:27.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26ffff700 1 --2- 172.21.15.98:0/586220764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2700c3940 0x7ff270150bc0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7ff2700696c0 tx=0x7ff268009840).ready entity=mon.0 client_cookie=e262f09111b77744 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:27.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26e7fc700 1 -- 172.21.15.98:0/586220764 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800e070 con 0x7ff2700c3940 2023-08-22T00:42:27.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26e7fc700 1 -- 172.21.15.98:0/586220764 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800ba40 con 0x7ff2700c3940 2023-08-22T00:42:27.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.799+0000 7ff26e7fc700 1 -- 172.21.15.98:0/586220764 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800bdc0 con 0x7ff2700c3940 2023-08-22T00:42:27.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 -- 172.21.15.98:0/586220764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2700c3940 msgr2=0x7ff270150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 --2- 172.21.15.98:0/586220764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2700c3940 0x7ff270150bc0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7ff2700696c0 tx=0x7ff268009840).stop 2023-08-22T00:42:27.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 -- 172.21.15.98:0/586220764 shutdown_connections 2023-08-22T00:42:27.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 --2- 172.21.15.98:0/586220764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2700c3940 0x7ff270150bc0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 --2- 172.21.15.98:0/586220764 >> v2:172.21.15.118:3300/0 conn(0x7ff2701507e0 0x7ff270065730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 -- 172.21.15.98:0/586220764 >> 172.21.15.98:0/586220764 conn(0x7ff2700c7800 msgr2=0x7ff2700c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:27.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 -- 172.21.15.98:0/586220764 shutdown_connections 2023-08-22T00:42:27.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.800+0000 7ff276174700 1 -- 172.21.15.98:0/586220764 wait complete. 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.801+0000 7ff276174700 1 Processor -- start 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.801+0000 7ff276174700 1 -- start start 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 0x7ff270153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff270146670 0x7ff27014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270153170 con 0x7ff2701507e0 2023-08-22T00:42:27.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270152560 con 0x7ff270146670 2023-08-22T00:42:27.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270152840 con 0x7ff2700c34c0 2023-08-22T00:42:27.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55770/0 (socket says 172.21.15.98:55770) 2023-08-22T00:42:27.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 -- 172.21.15.98:0/1899227558 learned_addr learned my addr 172.21.15.98:0/1899227558 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26ffff700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff270146670 0x7ff27014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26f7fe700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 0x7ff270153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 -- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 msgr2=0x7ff270153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 0x7ff270153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 -- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff270146670 msgr2=0x7ff27014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff270146670 0x7ff27014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 -- 172.21.15.98:0/1899227558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009ae0 con 0x7ff2701507e0 2023-08-22T00:42:27.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26f7fe700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 0x7ff270153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:27.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff26effd700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff26000c4c0 tx=0x7ff260007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:27.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260007020 con 0x7ff2701507e0 2023-08-22T00:42:27.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260001e90 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270152b20 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.802+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2600073b0 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.803+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27014de50 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.803+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2701532e0 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.804+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff2600068b0 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.804+0000 7ff2577fe700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 0x7ff25c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.804+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7ff260079970 con 0x7ff2701507e0 2023-08-22T00:42:27.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.804+0000 7ff26f7fe700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 0x7ff25c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:27.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.805+0000 7ff26f7fe700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 0x7ff25c0613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff264006fd0 tx=0x7ff264008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:27.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.808+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff26004aba0 con 0x7ff2701507e0 2023-08-22T00:42:27.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.970+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff270066130 con 0x7ff2701507e0 2023-08-22T00:42:27.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.974+0000 7ff2577fe700 1 -- 172.21.15.98:0/1899227558 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff26004e1c0 con 0x7ff2701507e0 2023-08-22T00:42:27.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 msgr2=0x7ff25c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 0x7ff25c0613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff264006fd0 tx=0x7ff264008040).stop 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 msgr2=0x7ff270146180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff26000c4c0 tx=0x7ff260007e00).stop 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 shutdown_connections 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff25c05ef30 0x7ff25c0613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2700c34c0 0x7ff270153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff270146670 0x7ff27014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 --2- 172.21.15.98:0/1899227558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2701507e0 0x7ff270146180 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 >> 172.21.15.98:0/1899227558 conn(0x7ff2700c7800 msgr2=0x7ff2700a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 shutdown_connections 2023-08-22T00:42:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:27.976+0000 7ff276174700 1 -- 172.21.15.98:0/1899227558 wait complete. 2023-08-22T00:42:27.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:42:28.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.107+0000 7fba22300700 1 Processor -- start 2023-08-22T00:42:28.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.107+0000 7fba22300700 1 -- start start 2023-08-22T00:42:28.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.107+0000 7fba22300700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c1505e0 0x7fba1c062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba22300700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba1c063380 0x7fba1c0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba22300700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba1c0c2400 0x7fba1c0bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba22300700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c063f90 con 0x7fba1c0c2400 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba22300700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c0656f0 con 0x7fba1c063380 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba22300700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0637e0 con 0x7fba1c1505e0 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba1c0c2400 0x7fba1c0bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba1c0c2400 0x7fba1c0bb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55780/0 (socket says 172.21.15.98:55780) 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 -- 172.21.15.98:0/4116552642 learned_addr learned my addr 172.21.15.98:0/4116552642 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:28.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba1b7fe700 1 --2- 172.21.15.98:0/4116552642 >> v2:172.21.15.118:3300/0 conn(0x7fba1c063380 0x7fba1c0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba1bfff700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c1505e0 0x7fba1c062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 -- 172.21.15.98:0/4116552642 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c1505e0 msgr2=0x7fba1c062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c1505e0 0x7fba1c062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 -- 172.21.15.98:0/4116552642 >> v2:172.21.15.118:3300/0 conn(0x7fba1c063380 msgr2=0x7fba1c0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 --2- 172.21.15.98:0/4116552642 >> v2:172.21.15.118:3300/0 conn(0x7fba1c063380 0x7fba1c0c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 -- 172.21.15.98:0/4116552642 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c1509c0 con 0x7fba1c0c2400 2023-08-22T00:42:28.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba2089d700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c0bb690 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7fba1c068b00 tx=0x7fba14009840).ready entity=mon.0 client_cookie=26685f7983077051 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba1affd700 1 -- 172.21.15.98:0/4116552642 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400e070 con 0x7fba1c0c2400 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba1affd700 1 -- 172.21.15.98:0/4116552642 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400ba50 con 0x7fba1c0c2400 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.108+0000 7fba1affd700 1 -- 172.21.15.98:0/4116552642 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400bdd0 con 0x7fba1c0c2400 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 -- 172.21.15.98:0/4116552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 msgr2=0x7fba1c0bb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c0bb690 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7fba1c068b00 tx=0x7fba14009840).stop 2023-08-22T00:42:28.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 -- 172.21.15.98:0/4116552642 shutdown_connections 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c1505e0 0x7fba1c062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 --2- 172.21.15.98:0/4116552642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c0bb690 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 --2- 172.21.15.98:0/4116552642 >> v2:172.21.15.118:3300/0 conn(0x7fba1c063380 0x7fba1c0c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 -- 172.21.15.98:0/4116552642 >> 172.21.15.98:0/4116552642 conn(0x7fba1c0c31d0 msgr2=0x7fba1c0c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 -- 172.21.15.98:0/4116552642 shutdown_connections 2023-08-22T00:42:28.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.109+0000 7fba22300700 1 -- 172.21.15.98:0/4116552642 wait complete. 2023-08-22T00:42:28.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.110+0000 7fba22300700 1 Processor -- start 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.110+0000 7fba22300700 1 -- start start 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c063380 0x7fba1c0a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 0x7fba1c0be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0a9010 con 0x7fba1c0c2400 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0a7370 con 0x7fba1c1505e0 2023-08-22T00:42:28.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba22300700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c153930 con 0x7fba1c063380 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55790/0 (socket says 172.21.15.98:55790) 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 -- 172.21.15.98:0/2891334818 learned_addr learned my addr 172.21.15.98:0/2891334818 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1bfff700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c063380 0x7fba1c0a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba2089d700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 0x7fba1c0be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 -- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c063380 msgr2=0x7fba1c0a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c063380 0x7fba1c0a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 -- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 msgr2=0x7fba1c0be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 0x7fba1c0be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 -- 172.21.15.98:0/2891334818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009ae0 con 0x7fba1c0c2400 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba2089d700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 0x7fba1c0be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.111+0000 7fba1b7fe700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fba1000d8c0 tx=0x7fba10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.112+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000f520 con 0x7fba1c0c2400 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.112+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000f680 con 0x7fba1c0c2400 2023-08-22T00:42:28.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.112+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0a6d60 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.112+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000fa00 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.112+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0a8d30 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.113+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c0a7520 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.113+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fba10013480 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.113+0000 7fba03fff700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 0x7fba080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.113+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fba10079b50 con 0x7fba1c0c2400 2023-08-22T00:42:28.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.113+0000 7fba1bfff700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 0x7fba080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.114+0000 7fba1bfff700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 0x7fba080613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fba0c00bbc0 tx=0x7fba0c008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.117+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba1c0a7520 con 0x7fba1c0c2400 2023-08-22T00:42:28.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.287+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fba1c0a7520 con 0x7fba1c0c2400 2023-08-22T00:42:28.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.290+0000 7fba03fff700 1 -- 172.21.15.98:0/2891334818 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7fba1c0a7520 con 0x7fba1c0c2400 2023-08-22T00:42:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 msgr2=0x7fba080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 0x7fba080613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fba0c00bbc0 tx=0x7fba0c008040).stop 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 msgr2=0x7fba1c1423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fba1000d8c0 tx=0x7fba10008040).stop 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 shutdown_connections 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fba0805ef30 0x7fba080613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba1c063380 0x7fba1c0a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba1c1505e0 0x7fba1c0be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 --2- 172.21.15.98:0/2891334818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba1c0c2400 0x7fba1c1423e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 >> 172.21.15.98:0/2891334818 conn(0x7fba1c0c31d0 msgr2=0x7fba1c0c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 shutdown_connections 2023-08-22T00:42:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.292+0000 7fba22300700 1 -- 172.21.15.98:0/2891334818 wait complete. 2023-08-22T00:42:28.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-22T00:42:28.421 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.420+0000 7fedc46e2700 1 Processor -- start 2023-08-22T00:42:28.422 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.420+0000 7fedc46e2700 1 -- start start 2023-08-22T00:42:28.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc46e2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fedbc153cf0 0x7fedbc1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc46e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 0x7fedbc066370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc46e2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedbc0bd750 con 0x7fedbc0bdbe0 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc46e2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedbc0a7030 con 0x7fedbc153cf0 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc46e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc0c2010 con 0x7fedbc065f10 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc247e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fedbc153cf0 0x7fedbc1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.424 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc2c7f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fedbc0bdbe0 0x7fedbc0c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52702/0 (socket says 172.21.15.98:52702) 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc2c7f700 1 -- 172.21.15.98:0/2111155123 learned_addr learned my addr 172.21.15.98:0/2111155123 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc1c7d700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 0x7fedbc066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc247e700 1 -- 172.21.15.98:0/2111155123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 msgr2=0x7fedbc066370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.421+0000 7fedc247e700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 0x7fedbc066370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc247e700 1 -- 172.21.15.98:0/2111155123 >> v1:172.21.15.98:6789/0 conn(0x7fedbc0bdbe0 legacy=0x7fedbc0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc247e700 1 -- 172.21.15.98:0/2111155123 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0a6d50 con 0x7fedbc153cf0 2023-08-22T00:42:28.425 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc1c7d700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 0x7fedbc066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc247e700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1584e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7fedac009760 tx=0x7fedac009060).ready entity=mon.0 client_cookie=19e4ffa42b036f44 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc147c700 1 -- 172.21.15.98:0/2111155123 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00b580 con 0x7fedbc153cf0 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc147c700 1 -- 172.21.15.98:0/2111155123 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00b6e0 con 0x7fedbc153cf0 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc147c700 1 -- 172.21.15.98:0/2111155123 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00ba60 con 0x7fedbc153cf0 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 -- 172.21.15.98:0/2111155123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 msgr2=0x7fedbc1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1584e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7fedac009760 tx=0x7fedac009060).stop 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 -- 172.21.15.98:0/2111155123 shutdown_connections 2023-08-22T00:42:28.426 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1584e0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 --2- 172.21.15.98:0/2111155123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc065f10 0x7fedbc066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 -- 172.21.15.98:0/2111155123 >> 172.21.15.98:0/2111155123 conn(0x7fedbc0c7770 msgr2=0x7fedbc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:28.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 -- 172.21.15.98:0/2111155123 shutdown_connections 2023-08-22T00:42:28.427 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.422+0000 7fedc46e2700 1 -- 172.21.15.98:0/2111155123 wait complete. 2023-08-22T00:42:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.423+0000 7fedc46e2700 1 Processor -- start 2023-08-22T00:42:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 -- start start 2023-08-22T00:42:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc065f10 0x7fedbc0a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc0bdbe0 0x7fedbc14bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc167a70 con 0x7fedbc153cf0 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc168890 con 0x7fedbc065f10 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc46e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc167c80 con 0x7fedbc0bdbe0 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc2c7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc2c7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55822/0 (socket says 172.21.15.98:55822) 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc2c7f700 1 -- 172.21.15.98:0/366182459 learned_addr learned my addr 172.21.15.98:0/366182459 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc1c7d700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc0bdbe0 0x7fedbc14bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.424+0000 7fedc247e700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc065f10 0x7fedbc0a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 -- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc0bdbe0 msgr2=0x7fedbc14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc0bdbe0 0x7fedbc14bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 -- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc065f10 msgr2=0x7fedbc0a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc065f10 0x7fedbc0a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 -- 172.21.15.98:0/366182459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0092a0 con 0x7fedbc153cf0 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc2c7f700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fedb400c790 tx=0x7fedb40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4005d30 con 0x7fedbc153cf0 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4005e90 con 0x7fedbc153cf0 2023-08-22T00:42:28.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc167f60 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4007320 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.425+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc168520 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.426+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc047480 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.426+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fedb40076d0 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.427+0000 7fedb27fc700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 0x7feda00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.427+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fedb4079ee0 con 0x7fedbc153cf0 2023-08-22T00:42:28.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.427+0000 7fedc247e700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 0x7feda00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:28.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.427+0000 7fedc247e700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 0x7feda00613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fedac00b340 tx=0x7fedac017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:28.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.431+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedb404b110 con 0x7fedbc153cf0 2023-08-22T00:42:28.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:28.653+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fedbc0bd100 con 0x7fedbc153cf0 2023-08-22T00:42:29.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.654+0000 7fedb27fc700 1 -- 172.21.15.98:0/366182459 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1265) v1 ==== 165+0+0 (secure 0 0 0) 0x7fedb404e730 con 0x7fedbc153cf0 2023-08-22T00:42:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 msgr2=0x7feda00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 0x7feda00613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fedac00b340 tx=0x7fedac017000).stop 2023-08-22T00:42:29.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 msgr2=0x7fedbc1566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fedb400c790 tx=0x7fedb40015e0).stop 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 shutdown_connections 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feda005ef30 0x7feda00613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedbc153cf0 0x7fedbc1566c0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc065f10 0x7fedbc0a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 --2- 172.21.15.98:0/366182459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedbc0bdbe0 0x7fedbc14bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 >> 172.21.15.98:0/366182459 conn(0x7fedbc0c7770 msgr2=0x7fedbc0a5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:29.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 shutdown_connections 2023-08-22T00:42:29.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.657+0000 7fedc46e2700 1 -- 172.21.15.98:0/366182459 wait complete. 2023-08-22T00:42:29.672 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-08-22T00:42:29.673 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-08-22T00:42:29.673 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-22T00:42:29.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-22T00:42:29.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.795+0000 7f9d9539c700 1 Processor -- start 2023-08-22T00:42:29.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.795+0000 7f9d9539c700 1 -- start start 2023-08-22T00:42:29.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d9539c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9d900befd0 0x7f9d900aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:29.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d9539c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900c4050 con 0x7f9d90157250 2023-08-22T00:42:29.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d9539c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900c3440 con 0x7f9d90157630 2023-08-22T00:42:29.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d9539c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c3720 con 0x7f9d900befd0 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9d900befd0 0x7f9d900aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8effd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9d90157250 0x7f9d900be8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:52716/0 (socket says 172.21.15.98:52716) 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8effd700 1 -- 172.21.15.98:0/3076736470 learned_addr learned my addr 172.21.15.98:0/3076736470 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8f7fe700 1 -- 172.21.15.98:0/3076736470 >> v1:172.21.15.118:6789/0 conn(0x7f9d90157630 legacy=0x7f9d900aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8f7fe700 1 -- 172.21.15.98:0/3076736470 >> v1:172.21.15.98:6789/0 conn(0x7f9d90157250 legacy=0x7f9d900be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8f7fe700 1 -- 172.21.15.98:0/3076736470 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900c3a00 con 0x7f9d900befd0 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8dffb700 1 -- 172.21.15.98:0/3076736470 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760995314 0 0) 0x7f9d900c4050 con 0x7f9d90157250 2023-08-22T00:42:29.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8f7fe700 1 --2- 172.21.15.98:0/3076736470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900befd0 0x7f9d900aaf20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f9d88009e60 tx=0x7f9d88009780).ready entity=mon.0 client_cookie=28739dd55b304b5c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.796+0000 7f9d8dffb700 1 -- 172.21.15.98:0/3076736470 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e070 con 0x7f9d900befd0 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d8dffb700 1 -- 172.21.15.98:0/3076736470 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800bbf0 con 0x7f9d900befd0 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d8dffb700 1 -- 172.21.15.98:0/3076736470 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88012410 con 0x7f9d900befd0 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 -- 172.21.15.98:0/3076736470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900befd0 msgr2=0x7f9d900aaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 --2- 172.21.15.98:0/3076736470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900befd0 0x7f9d900aaf20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f9d88009e60 tx=0x7f9d88009780).stop 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 -- 172.21.15.98:0/3076736470 shutdown_connections 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 --2- 172.21.15.98:0/3076736470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d900befd0 0x7f9d900aaf20 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 -- 172.21.15.98:0/3076736470 >> 172.21.15.98:0/3076736470 conn(0x7f9d900c5320 msgr2=0x7f9d900c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:29.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 -- 172.21.15.98:0/3076736470 shutdown_connections 2023-08-22T00:42:29.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.797+0000 7f9d9539c700 1 -- 172.21.15.98:0/3076736470 wait complete. 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.798+0000 7f9d9539c700 1 Processor -- start 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.798+0000 7f9d9539c700 1 -- start start 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 0x7f9d900c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90157630 0x7f9d9015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90168120 con 0x7f9d90157250 2023-08-22T00:42:29.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c22f0 con 0x7f9d900befd0 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d9539c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90149eb0 con 0x7f9d90157630 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55830/0 (socket says 172.21.15.98:55830) 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 -- 172.21.15.98:0/407865664 learned_addr learned my addr 172.21.15.98:0/407865664 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8effd700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 0x7f9d900c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 -- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90157630 msgr2=0x7f9d9015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90157630 0x7f9d9015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 -- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 msgr2=0x7f9d900c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 0x7f9d900c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8e7fc700 1 -- 172.21.15.98:0/407865664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009a20 con 0x7f9d90157250 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.799+0000 7f9d8effd700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 0x7f9d900c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d8e7fc700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f9d8000b490 tx=0x7f9d80006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80012410 con 0x7f9d90157250 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80012590 con 0x7f9d90157250 2023-08-22T00:42:29.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d90167620 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80012950 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.800+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d90167b60 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.801+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d90047480 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.801+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9d80012d40 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.801+0000 7f9d76ffd700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 0x7f9d7c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.801+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f9d80079f00 con 0x7f9d90157250 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.802+0000 7f9d8effd700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 0x7f9d7c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:29.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.802+0000 7f9d8effd700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 0x7f9d7c0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9d84001750 tx=0x7f9d84009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:29.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:29.805+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d8004b070 con 0x7f9d90157250 2023-08-22T00:42:30.031 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.030+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f9d900ae760 con 0x7f9d90157250 2023-08-22T00:42:30.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.658+0000 7f9d76ffd700 1 -- 172.21.15.98:0/407865664 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1266) v1 ==== 166+0+0 (secure 0 0 0) 0x7f9d8004e690 con 0x7f9d90157250 2023-08-22T00:42:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 msgr2=0x7f9d7c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 0x7f9d7c0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9d84001750 tx=0x7f9d84009040).stop 2023-08-22T00:42:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 msgr2=0x7f9d90167130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f9d8000b490 tx=0x7f9d80006ef0).stop 2023-08-22T00:42:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 shutdown_connections 2023-08-22T00:42:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9d7c05ef30 0x7f9d7c0613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d90157630 0x7f9d9015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d900befd0 0x7f9d900c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 --2- 172.21.15.98:0/407865664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d90157250 0x7f9d90167130 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 >> 172.21.15.98:0/407865664 conn(0x7f9d900c5320 msgr2=0x7f9d900c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 shutdown_connections 2023-08-22T00:42:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.661+0000 7f9d9539c700 1 -- 172.21.15.98:0/407865664 wait complete. 2023-08-22T00:42:30.676 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:42:30.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.799+0000 7f24424c5700 1 Processor -- start 2023-08-22T00:42:30.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.799+0000 7f24424c5700 1 -- start start 2023-08-22T00:42:30.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f24424c5700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f243c151dd0 0x7f243c0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f24424c5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 0x7f243c068410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f24424c5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0c3c00 con 0x7f243c1519f0 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f24424c5700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c0c4780 con 0x7f243c151dd0 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f24424c5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c0c3ee0 con 0x7f243c0bedd0 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f243b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f243c151dd0 0x7f243c0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f243b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f243c151dd0 0x7f243c0be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40704/0 (socket says 172.21.15.98:40704) 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f243b7fe700 1 -- 172.21.15.98:0/2949946284 learned_addr learned my addr 172.21.15.98:0/2949946284 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.800+0000 7f243bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f243c1519f0 0x7f243c0c3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48010/0 (socket says 172.21.15.98:48010) 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f2440a62700 1 --2- 172.21.15.98:0/2949946284 >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 0x7f243c068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243b7fe700 1 -- 172.21.15.98:0/2949946284 >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 msgr2=0x7f243c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243b7fe700 1 --2- 172.21.15.98:0/2949946284 >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 0x7f243c068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243b7fe700 1 -- 172.21.15.98:0/2949946284 >> v1:172.21.15.98:6789/0 conn(0x7f243c1519f0 legacy=0x7f243c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243b7fe700 1 -- 172.21.15.98:0/2949946284 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0c41c0 con 0x7f243c151dd0 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243affd700 1 -- 172.21.15.98:0/2949946284 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718553023 0 0) 0x7f243c0c3c00 con 0x7f243c1519f0 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f2440a62700 1 --2- 172.21.15.98:0/2949946284 >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 0x7f243c068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243b7fe700 1 --2- 172.21.15.98:0/2949946284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c0be8e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f243c06c5d0 tx=0x7f242c0090f0).ready entity=mon.0 client_cookie=eee66b677794c99b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243affd700 1 -- 172.21.15.98:0/2949946284 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00b600 con 0x7f243c151dd0 2023-08-22T00:42:30.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243affd700 1 -- 172.21.15.98:0/2949946284 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00b760 con 0x7f243c151dd0 2023-08-22T00:42:30.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f243affd700 1 -- 172.21.15.98:0/2949946284 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00bae0 con 0x7f243c151dd0 2023-08-22T00:42:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f24424c5700 1 -- 172.21.15.98:0/2949946284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 msgr2=0x7f243c0be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.801+0000 7f24424c5700 1 --2- 172.21.15.98:0/2949946284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c0be8e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f243c06c5d0 tx=0x7f242c0090f0).stop 2023-08-22T00:42:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 -- 172.21.15.98:0/2949946284 shutdown_connections 2023-08-22T00:42:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 --2- 172.21.15.98:0/2949946284 >> v2:172.21.15.118:3300/0 conn(0x7f243c0bedd0 0x7f243c068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 --2- 172.21.15.98:0/2949946284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c0be8e0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 -- 172.21.15.98:0/2949946284 >> 172.21.15.98:0/2949946284 conn(0x7f243c0c5ea0 msgr2=0x7f243c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 -- 172.21.15.98:0/2949946284 shutdown_connections 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.802+0000 7f24424c5700 1 -- 172.21.15.98:0/2949946284 wait complete. 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.803+0000 7f24424c5700 1 Processor -- start 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.803+0000 7f24424c5700 1 -- start start 2023-08-22T00:42:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 0x7f243c0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243c1519f0 0x7f243c0655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c142f10 con 0x7f243c151dd0 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c1654e0 con 0x7f243c0bedd0 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c065f80 con 0x7f243c1519f0 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40720/0 (socket says 172.21.15.98:40720) 2023-08-22T00:42:30.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 -- 172.21.15.98:0/2293947299 learned_addr learned my addr 172.21.15.98:0/2293947299 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f243bfff700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 0x7f243c0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 -- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243c1519f0 msgr2=0x7f243c0655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243c1519f0 0x7f243c0655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 -- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 msgr2=0x7f243c0aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 0x7f243c0aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 -- 172.21.15.98:0/2293947299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009370 con 0x7f243c151dd0 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f243bfff700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 0x7f243c0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:30.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2440a62700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f2434009fb0 tx=0x7f2434009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:30.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400dd90 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400f040 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c164e90 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434013600 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.804+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c164b90 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.805+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c05eb50 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.805+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f24340139f0 con 0x7f243c151dd0 2023-08-22T00:42:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.806+0000 7f2433fff700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 0x7f241c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.806+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f243407a7f0 con 0x7f243c151dd0 2023-08-22T00:42:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.806+0000 7f243bfff700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 0x7f241c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.806+0000 7f243bfff700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 0x7f241c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f243c1514a0 tx=0x7f2424009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.810+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f243c05eb50 con 0x7f243c151dd0 2023-08-22T00:42:30.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.973+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f243c05eb50 con 0x7f243c151dd0 2023-08-22T00:42:30.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.979+0000 7f2433fff700 1 -- 172.21.15.98:0/2293947299 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f243c05eb50 con 0x7f243c151dd0 2023-08-22T00:42:30.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 msgr2=0x7f241c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 0x7f241c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f243c1514a0 tx=0x7f2424009040).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 msgr2=0x7f243c1532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f2434009fb0 tx=0x7f2434009a50).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 shutdown_connections 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f241c05ef30 0x7f241c0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c151dd0 0x7f243c1532f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243c0bedd0 0x7f243c0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 --2- 172.21.15.98:0/2293947299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243c1519f0 0x7f243c0655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:30.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 >> 172.21.15.98:0/2293947299 conn(0x7f243c0c5ea0 msgr2=0x7f243c155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:30.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 shutdown_connections 2023-08-22T00:42:30.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:30.981+0000 7f24424c5700 1 -- 172.21.15.98:0/2293947299 wait complete. 2023-08-22T00:42:30.994 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:42:30.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:42:31.036 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:42:31.086 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:42:31.087 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:42:31.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:31.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 Processor -- start 2023-08-22T00:42:31.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 -- start start 2023-08-22T00:42:31.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb84155a80 0x7fcb84155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb840bd860 0x7fcb840bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb8414bd20 0x7fcb8414c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.202+0000 7fcb8a288700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb840be5d0 con 0x7fcb84155a80 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb8a288700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb840be8b0 con 0x7fcb8414bd20 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb8a288700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840beb90 con 0x7fcb840bd860 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb84155a80 0x7fcb84155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb84155a80 0x7fcb84155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40732/0 (socket says 172.21.15.98:40732) 2023-08-22T00:42:31.205 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 -- 172.21.15.98:0/2050664978 learned_addr learned my addr 172.21.15.98:0/2050664978 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb837fe700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb840bd860 0x7fcb840bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb88825700 1 --2- 172.21.15.98:0/2050664978 >> v2:172.21.15.118:3300/0 conn(0x7fcb8414bd20 0x7fcb8414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 -- 172.21.15.98:0/2050664978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb840bd860 msgr2=0x7fcb840bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb840bd860 0x7fcb840bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 -- 172.21.15.98:0/2050664978 >> v2:172.21.15.118:3300/0 conn(0x7fcb8414bd20 msgr2=0x7fcb8414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2050664978 >> v2:172.21.15.118:3300/0 conn(0x7fcb8414bd20 0x7fcb8414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 -- 172.21.15.98:0/2050664978 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb840bee70 con 0x7fcb84155a80 2023-08-22T00:42:31.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb84155a80 0x7fcb84155e60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7fcb840bf700 tx=0x7fcb740090f0).ready entity=mon.0 client_cookie=1205474969018be2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb82ffd700 1 -- 172.21.15.98:0/2050664978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400b600 con 0x7fcb84155a80 2023-08-22T00:42:31.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb82ffd700 1 -- 172.21.15.98:0/2050664978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7400b760 con 0x7fcb84155a80 2023-08-22T00:42:31.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.203+0000 7fcb82ffd700 1 -- 172.21.15.98:0/2050664978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400bae0 con 0x7fcb84155a80 2023-08-22T00:42:31.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 -- 172.21.15.98:0/2050664978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb84155a80 msgr2=0x7fcb84155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb84155a80 0x7fcb84155e60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7fcb840bf700 tx=0x7fcb740090f0).stop 2023-08-22T00:42:31.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 -- 172.21.15.98:0/2050664978 shutdown_connections 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2050664978 >> v2:172.21.15.118:3300/0 conn(0x7fcb8414bd20 0x7fcb8414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb84155a80 0x7fcb84155e60 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2050664978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb840bd860 0x7fcb840bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 -- 172.21.15.98:0/2050664978 >> 172.21.15.98:0/2050664978 conn(0x7fcb840c5330 msgr2=0x7fcb840c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 -- 172.21.15.98:0/2050664978 shutdown_connections 2023-08-22T00:42:31.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.204+0000 7fcb8a288700 1 -- 172.21.15.98:0/2050664978 wait complete. 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.205+0000 7fcb8a288700 1 Processor -- start 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.205+0000 7fcb8a288700 1 -- start start 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 0x7fcb840ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb84155a80 0x7fcb8413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840adc40 con 0x7fcb8414bd20 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840adf20 con 0x7fcb840bd860 2023-08-22T00:42:31.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb8a288700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840ae200 con 0x7fcb84155a80 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40746/0 (socket says 172.21.15.98:40746) 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 -- 172.21.15.98:0/2322892041 learned_addr learned my addr 172.21.15.98:0/2322892041 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb88825700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb84155a80 0x7fcb8413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 0x7fcb840ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 -- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb84155a80 msgr2=0x7fcb8413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb84155a80 0x7fcb8413ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 -- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 msgr2=0x7fcb840ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 0x7fcb840ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 -- 172.21.15.98:0/2322892041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009370 con 0x7fcb8414bd20 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 0x7fcb840ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb837fe700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fcb7800d890 tx=0x7fcb78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.206+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780125f0 con 0x7fcb8414bd20 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.207+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb78012750 con 0x7fcb8414bd20 2023-08-22T00:42:31.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.207+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb840ae4e0 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.207+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78012ad0 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.207+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb840abfd0 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.207+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb840ae980 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.208+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcb78013480 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.208+0000 7fcb6bfff700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 0x7fcb700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.208+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fcb78079d70 con 0x7fcb8414bd20 2023-08-22T00:42:31.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.208+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 0x7fcb700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.209+0000 7fcb83fff700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 0x7fcb700613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb74009130 tx=0x7fcb74017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.212+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb7804af40 con 0x7fcb8414bd20 2023-08-22T00:42:31.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.412+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb84047480 con 0x7fcb8414bd20 2023-08-22T00:42:31.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.413+0000 7fcb6bfff700 1 -- 172.21.15.98:0/2322892041 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fcb7804e560 con 0x7fcb8414bd20 2023-08-22T00:42:31.414 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:31.414 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7343,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2873360143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2873360143},{"type":"v1","addr":"172.21.15.118:6835","nonce":2873360143}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7939,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3014731571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":3014731571},{"type":"v1","addr":"172.21.15.98:6837","nonce":3014731571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/127392089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":127392089},{"type":"v1","addr":"172.21.15.118:6834","nonce":127392089}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/3672050025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3672050025},{"type":"v1","addr":"172.21.15.98:6836","nonce":3672050025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-08-22T00:42:31.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 msgr2=0x7fcb700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 0x7fcb700613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb74009130 tx=0x7fcb74017000).stop 2023-08-22T00:42:31.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 msgr2=0x7fcb840abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fcb7800d890 tx=0x7fcb78008040).stop 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 shutdown_connections 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcb7005ef30 0x7fcb700613f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb84155a80 0x7fcb8413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb840bd860 0x7fcb840ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 --2- 172.21.15.98:0/2322892041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb8414bd20 0x7fcb840abae0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 >> 172.21.15.98:0/2322892041 conn(0x7fcb840c5330 msgr2=0x7fcb8414a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:31.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 shutdown_connections 2023-08-22T00:42:31.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.415+0000 7fcb8a288700 1 -- 172.21.15.98:0/2322892041 wait complete. 2023-08-22T00:42:31.418 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 64 2023-08-22T00:42:31.428 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:42:31.428 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:42:31.428 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:42:31.429 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:42:31.429 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:42:31.429 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:42:31.429 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:42:31.429 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:42:31.430 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:42:31.430 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:42:31.430 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:42:31.430 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:42:31.431 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:42:31.431 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:42:31.431 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:42:31.431 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:42:31.437 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:42:31.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:42:31.438 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:42:31.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:42:31.441 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:42:31.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:42:31.442 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:42:31.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:42:31.479 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:42:31.480 DEBUG:teuthology.parallel:result is None 2023-08-22T00:42:31.480 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:42:31.481 DEBUG:teuthology.parallel:result is None 2023-08-22T00:42:31.483 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:42:31.484 DEBUG:teuthology.parallel:result is None 2023-08-22T00:42:31.484 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:42:31.485 DEBUG:teuthology.parallel:result is None 2023-08-22T00:42:31.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:42:31.556 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:42:31.556 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:42:31.577 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:42:31.578 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:42:31.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.610+0000 7fbbdcf64700 1 Processor -- start 2023-08-22T00:42:31.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.610+0000 7fbbdcf64700 1 -- start start 2023-08-22T00:42:31.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd8153c60 0x7fbbd80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 0x7fbbd80bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd80bf2c0 0x7fbbd80aa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80c3d00 con 0x7fbbd8153c60 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80c3fe0 con 0x7fbbd8154040 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbdcf64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80c42c0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbd659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd8153c60 0x7fbbd80c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbd659c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbbd8153c60 0x7fbbd80c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40786/0 (socket says 172.21.15.98:40786) 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbd659c700 1 -- 172.21.15.98:0/2717290613 learned_addr learned my addr 172.21.15.98:0/2717290613 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbd5d9b700 1 --2- 172.21.15.98:0/2717290613 >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 0x7fbbd80bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.611+0000 7fbbd6d9d700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd80bf2c0 0x7fbbd80aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 -- 172.21.15.98:0/2717290613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd80bf2c0 msgr2=0x7fbbd80aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd80bf2c0 0x7fbbd80aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 -- 172.21.15.98:0/2717290613 >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 msgr2=0x7fbbd80bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 --2- 172.21.15.98:0/2717290613 >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 0x7fbbd80bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 -- 172.21.15.98:0/2717290613 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80c45a0 con 0x7fbbd8153c60 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd5d9b700 1 --2- 172.21.15.98:0/2717290613 >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 0x7fbbd80bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd659c700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd8153c60 0x7fbbd80c4da0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fbbd8047bc0 tx=0x7fbbd0009840).ready entity=mon.0 client_cookie=1cc71b98b4ada466 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd559a700 1 -- 172.21.15.98:0/2717290613 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000e070 con 0x7fbbd8153c60 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd559a700 1 -- 172.21.15.98:0/2717290613 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000b970 con 0x7fbbd8153c60 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.612+0000 7fbbd559a700 1 -- 172.21.15.98:0/2717290613 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000bcf0 con 0x7fbbd8153c60 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 -- 172.21.15.98:0/2717290613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd8153c60 msgr2=0x7fbbd80c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd8153c60 0x7fbbd80c4da0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fbbd8047bc0 tx=0x7fbbd0009840).stop 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 -- 172.21.15.98:0/2717290613 shutdown_connections 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd80bf2c0 0x7fbbd80aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/2717290613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd8153c60 0x7fbbd80c4da0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/2717290613 >> v2:172.21.15.118:3300/0 conn(0x7fbbd8154040 0x7fbbd80bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 -- 172.21.15.98:0/2717290613 >> 172.21.15.98:0/2717290613 conn(0x7fbbd80c93e0 msgr2=0x7fbbd80c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:31.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 -- 172.21.15.98:0/2717290613 shutdown_connections 2023-08-22T00:42:31.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.613+0000 7fbbdcf64700 1 -- 172.21.15.98:0/2717290613 wait complete. 2023-08-22T00:42:31.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.614+0000 7fbbdcf64700 1 Processor -- start 2023-08-22T00:42:31.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.614+0000 7fbbdcf64700 1 -- start start 2023-08-22T00:42:31.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd8153c60 0x7fbbd80bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd8154040 0x7fbbd80bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80c0390 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8155d80 con 0x7fbbd8154040 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbdcf64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8155170 con 0x7fbbd8153c60 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbd659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbd659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40798/0 (socket says 172.21.15.98:40798) 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbd659c700 1 -- 172.21.15.98:0/3864019965 learned_addr learned my addr 172.21.15.98:0/3864019965 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:31.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbd5d9b700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd8153c60 0x7fbbd80bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.615+0000 7fbbd6d9d700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd8154040 0x7fbbd80bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 -- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd8153c60 msgr2=0x7fbbd80bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd8153c60 0x7fbbd80bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 -- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd8154040 msgr2=0x7fbbd80bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd8154040 0x7fbbd80bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 -- 172.21.15.98:0/3864019965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0092a0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbd659c700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fbbd000b610 tx=0x7fbbd0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000bee0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00092e0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd0009ae0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000bcf0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.616+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd8155730 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.617+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd806a030 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.617+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbbd0003040 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.617+0000 7fbbc67fc700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 0x7fbbb80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:31.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.618+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fbbd007b1b0 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.618+0000 7fbbd5d9b700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 0x7fbbb80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:31.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.618+0000 7fbbd5d9b700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 0x7fbbb80613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbbd8157210 tx=0x7fbbcc009060).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:31.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.622+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbbd004c490 con 0x7fbbd80bf2c0 2023-08-22T00:42:31.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:31.796+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbbd80c2ca0 con 0x7fbbd80bf2c0 2023-08-22T00:42:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.665+0000 7fbbc67fc700 1 -- 172.21.15.98:0/3864019965 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v181) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbbd0023020 con 0x7fbbd80bf2c0 2023-08-22T00:42:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 msgr2=0x7fbbb80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 0x7fbbb80613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbbd8157210 tx=0x7fbbcc009060).stop 2023-08-22T00:42:32.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 msgr2=0x7fbbd8139a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fbbd000b610 tx=0x7fbbd0009840).stop 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 shutdown_connections 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbbb805ef30 0x7fbbb80613f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbd8154040 0x7fbbd80bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbd80bf2c0 0x7fbbd8139a70 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 --2- 172.21.15.98:0/3864019965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbd8153c60 0x7fbbd80bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 >> 172.21.15.98:0/3864019965 conn(0x7fbbd80c93e0 msgr2=0x7fbbd8151650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:32.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 shutdown_connections 2023-08-22T00:42:32.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.668+0000 7fbbdcf64700 1 -- 172.21.15.98:0/3864019965 wait complete. 2023-08-22T00:42:32.671 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:42:32.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:42:32.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.805+0000 7f60a8b26700 1 Processor -- start 2023-08-22T00:42:32.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.805+0000 7f60a8b26700 1 -- start start 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a8b26700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f60a40be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a8b26700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a40bd750 con 0x7f60a4153cf0 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a8b26700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a40a7030 con 0x7f60a41550e0 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a8b26700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c2010 con 0x7f60a40bdbe0 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a259c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f60a4153cf0 0x7f60a41584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48028/0 (socket says 172.21.15.98:48028) 2023-08-22T00:42:32.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a259c700 1 -- 172.21.15.98:0/1560963359 learned_addr learned my addr 172.21.15.98:0/1560963359 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583564417 0 0) 0x7f60a40bd750 con 0x7f60a4153cf0 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c0033f0 con 0x7f60a4153cf0 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a2d9d700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f60a40be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596828013 0 0) 0x7f608c0033f0 con 0x7f60a4153cf0 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 msgr2=0x7f60a40be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f60a40be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 >> v1:172.21.15.118:6789/0 conn(0x7f60a41550e0 legacy=0x7f60a4065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40a6d50 con 0x7f60a4153cf0 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f6094001470 con 0x7f60a4153cf0 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 >> v1:172.21.15.98:6789/0 conn(0x7f60a4153cf0 legacy=0x7f60a41584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f608c003910 0x7f608c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f608c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.806+0000 7f60a159a700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f608c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c2010 con 0x7f608c004690 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c00b940 con 0x7f608c003910 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c00bb00 con 0x7f60a40bdbe0 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f608c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a259c700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f608c003910 0x7f608c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a2d9d700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f608c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 -- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 msgr2=0x7f608c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a40bdbe0 0x7f608c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 -- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f608c003910 msgr2=0x7f608c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f608c003910 0x7f608c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 -- 172.21.15.98:0/1560963359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0033f0 con 0x7f608c004690 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f608c004b10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f6098001760 tx=0x7f6098007bb0).ready entity=mon.0 client_cookie=c0e9df1c70c92876 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098007020 con 0x7f608c004690 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098007180 con 0x7f608c004690 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.807+0000 7f60a159a700 1 -- 172.21.15.98:0/1560963359 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098007500 con 0x7f608c004690 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 -- 172.21.15.98:0/1560963359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 msgr2=0x7f608c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1560963359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f608c004b10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f6098001760 tx=0x7f6098007bb0).stop 2023-08-22T00:42:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a2d9d700 1 -- 172.21.15.98:0/1560963359 reap_dead start 2023-08-22T00:42:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 -- 172.21.15.98:0/1560963359 shutdown_connections 2023-08-22T00:42:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 -- 172.21.15.98:0/1560963359 >> 172.21.15.98:0/1560963359 conn(0x7f60a40c7770 msgr2=0x7f60a40c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:32.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 -- 172.21.15.98:0/1560963359 shutdown_connections 2023-08-22T00:42:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.808+0000 7f60a8b26700 1 -- 172.21.15.98:0/1560963359 wait complete. 2023-08-22T00:42:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.809+0000 7f60a8b26700 1 Processor -- start 2023-08-22T00:42:32.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.809+0000 7f60a8b26700 1 -- start start 2023-08-22T00:42:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 0x7f60a40a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60a4066df0 0x7f60a4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40a85d0 con 0x7f608c004690 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4067760 con 0x7f60a4066df0 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a414f120 con 0x7f60a414eca0 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40814/0 (socket says 172.21.15.98:40814) 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 -- 172.21.15.98:0/1322013536 learned_addr learned my addr 172.21.15.98:0/1322013536 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 0x7f60a40a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a2d9d700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60a4066df0 0x7f60a4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 -- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 msgr2=0x7f60a40a7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 0x7f60a40a7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 -- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60a4066df0 msgr2=0x7f60a4067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60a4066df0 0x7f60a4067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 -- 172.21.15.98:0/1322013536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40a7740 con 0x7f608c004690 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 0x7f60a40a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a259c700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f6094004790 tx=0x7f60a40bd6c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011590 con 0x7f608c004690 2023-08-22T00:42:32.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940116f0 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011a90 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a40a79c0 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.810+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40a7f80 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.811+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a4047480 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.812+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6094015410 con 0x7f608c004690 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.812+0000 7f60927fc700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 0x7f60840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:32.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.812+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6094079fd0 con 0x7f608c004690 2023-08-22T00:42:32.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.812+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 0x7f60840613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:32.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.813+0000 7f60a1d9b700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 0x7f60840613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f60a40be110 tx=0x7f6098016000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:32.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:32.816+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f609404b450 con 0x7f608c004690 2023-08-22T00:42:33.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.037+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f60a40bd100 con 0x7f608c004690 2023-08-22T00:42:33.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.037+0000 7f60927fc700 1 -- 172.21.15.98:0/1322013536 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f609404ea70 con 0x7f608c004690 2023-08-22T00:42:33.039 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:33.039 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:42:33.039 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:42:33.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.039 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.041 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:42:33.042 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:42:33.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.045 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.046 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:42:33.047 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.048 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.051 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:42:33.052 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.053 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:42:33.056 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.057 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:42:33.058 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.059 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:42:33.061 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:42:33.062 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:42:33.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:42:33.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:33.063 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:42:33.063 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:42:33.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 msgr2=0x7f60840613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 0x7f60840613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f60a40be110 tx=0x7f6098016000).stop 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 msgr2=0x7f60a40a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f6094004790 tx=0x7f60a40bd6c0).stop 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 shutdown_connections 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f608405ef30 0x7f60840613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60a4066df0 0x7f60a4067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f608c004690 0x7f60a40a9ee0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 --2- 172.21.15.98:0/1322013536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60a414eca0 0x7f60a40a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 >> 172.21.15.98:0/1322013536 conn(0x7f60a40c7770 msgr2=0x7f60a414f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 shutdown_connections 2023-08-22T00:42:33.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.039+0000 7f60a8b26700 1 -- 172.21.15.98:0/1322013536 wait complete. 2023-08-22T00:42:33.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:33.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.181+0000 7fd33cf14700 1 Processor -- start 2023-08-22T00:42:33.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.181+0000 7fd33cf14700 1 -- start start 2023-08-22T00:42:33.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33cf14700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd33814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33cf14700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd3381544f0 0x7fd3381549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33cf14700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd338155260 con 0x7fd33814e0d0 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33cf14700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380c17b0 con 0x7fd3381544f0 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33cf14700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380bf9e0 con 0x7fd3380c61a0 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd33814e0d0 0x7fd3380c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48036/0 (socket says 172.21.15.98:48036) 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.182+0000 7fd33659c700 1 -- 172.21.15.98:0/1976134187 learned_addr learned my addr 172.21.15.98:0/1976134187 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> v2:172.21.15.118:3300/0 conn(0x7fd3381544f0 0x7fd3381549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd335d9b700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd33814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231364908 0 0) 0x7fd338155260 con 0x7fd33814e0d0 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3240033f0 con 0x7fd33814e0d0 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883515853 0 0) 0x7fd3240033f0 con 0x7fd33814e0d0 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 msgr2=0x7fd33814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd33814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 >> v2:172.21.15.118:3300/0 conn(0x7fd3381544f0 msgr2=0x7fd3381549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 --2- 172.21.15.98:0/1976134187 >> v2:172.21.15.118:3300/0 conn(0x7fd3381544f0 0x7fd3381549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380bfcc0 con 0x7fd33814e0d0 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fd328001470 con 0x7fd33814e0d0 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> v2:172.21.15.118:3300/0 conn(0x7fd3381544f0 0x7fd3381549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 >> v1:172.21.15.98:6789/0 conn(0x7fd33814e0d0 legacy=0x7fd3380c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd3240038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324003e10 0x7fd324004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd324004b80 0x7fd324005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c17b0 con 0x7fd324004b80 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380bf9e0 con 0x7fd324003e10 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400b8e0 con 0x7fd3380c61a0 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd324004b80 0x7fd324005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd33659c700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd3240038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd335d9b700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324003e10 0x7fd324004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 -- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 msgr2=0x7fd3240038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c61a0 0x7fd3240038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 -- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324003e10 msgr2=0x7fd324004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324003e10 0x7fd324004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.183+0000 7fd336d9d700 1 -- 172.21.15.98:0/1976134187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240033f0 con 0x7fd324004b80 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd324004b80 0x7fd324005000 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fd33000e3f0 tx=0x7fd33000b040).ready entity=mon.0 client_cookie=ddf79c80deacb476 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330009c50 con 0x7fd324004b80 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33000f040 con 0x7fd324004b80 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33559a700 1 -- 172.21.15.98:0/1976134187 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000eeb0 con 0x7fd324004b80 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 -- 172.21.15.98:0/1976134187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd324004b80 msgr2=0x7fd324005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1976134187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd324004b80 0x7fd324005000 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fd33000e3f0 tx=0x7fd33000b040).stop 2023-08-22T00:42:33.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd336d9d700 1 -- 172.21.15.98:0/1976134187 reap_dead start 2023-08-22T00:42:33.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 -- 172.21.15.98:0/1976134187 shutdown_connections 2023-08-22T00:42:33.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 -- 172.21.15.98:0/1976134187 >> 172.21.15.98:0/1976134187 conn(0x7fd3380caa80 msgr2=0x7fd3380cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 -- 172.21.15.98:0/1976134187 shutdown_connections 2023-08-22T00:42:33.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.184+0000 7fd33cf14700 1 -- 172.21.15.98:0/1976134187 wait complete. 2023-08-22T00:42:33.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.185+0000 7fd33cf14700 1 Processor -- start 2023-08-22T00:42:33.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.185+0000 7fd33cf14700 1 -- start start 2023-08-22T00:42:33.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324004b80 0x7fd33814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 0x7fd3380c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33814d3a0 con 0x7fd3380b0480 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338164850 con 0x7fd324004b80 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33cf14700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380af500 con 0x7fd3380c38c0 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd335d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd335d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40830/0 (socket says 172.21.15.98:40830) 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd335d9b700 1 -- 172.21.15.98:0/1625852350 learned_addr learned my addr 172.21.15.98:0/1625852350 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd33659c700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324004b80 0x7fd33814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.186+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 0x7fd3380c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 -- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 msgr2=0x7fd3380c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 0x7fd3380c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 -- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324004b80 msgr2=0x7fd33814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324004b80 0x7fd33814ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 -- 172.21.15.98:0/1625852350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380c1100 con 0x7fd3380b0480 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd336d9d700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 0x7fd3380c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd335d9b700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fd3200119f0 tx=0x7fd320009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320011e80 con 0x7fd3380b0480 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000f940 con 0x7fd3380b0480 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000fcc0 con 0x7fd3380b0480 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380c4230 con 0x7fd3380b0480 2023-08-22T00:42:33.196 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.187+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380aebd0 con 0x7fd3380b0480 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.188+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338047480 con 0x7fd3380b0480 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.188+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd320014650 con 0x7fd3380b0480 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.188+0000 7fd32e7fc700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 0x7fd3180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.189+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd32007a9d0 con 0x7fd3380b0480 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.189+0000 7fd33659c700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 0x7fd3180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.189+0000 7fd33659c700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 0x7fd3180613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd328007860 tx=0x7fd3380c68f0).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.193+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd32004beb0 con 0x7fd3380b0480 2023-08-22T00:42:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.354+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3380bffa0 con 0x7fd3380b0480 2023-08-22T00:42:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.355+0000 7fd32e7fc700 1 -- 172.21.15.98:0/1625852350 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+14055 (secure 0 0 0) 0x7fd320022070 con 0x7fd3380b0480 2023-08-22T00:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":181,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:32.660214+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 msgr2=0x7fd3180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 0x7fd3180613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd328007860 tx=0x7fd3380c68f0).stop 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 msgr2=0x7fd338164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fd3200119f0 tx=0x7fd320009060).stop 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 shutdown_connections 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31805ef30 0x7fd3180613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3380c38c0 0x7fd3380c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd324004b80 0x7fd33814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 --2- 172.21.15.98:0/1625852350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3380b0480 0x7fd338164360 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 >> 172.21.15.98:0/1625852350 conn(0x7fd3380caa80 msgr2=0x7fd3380c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.356+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 shutdown_connections 2023-08-22T00:42:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.357+0000 7fd33cf14700 1 -- 172.21.15.98:0/1625852350 wait complete. 2023-08-22T00:42:33.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:42:33.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:42:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.488+0000 7f41e181b700 1 Processor -- start 2023-08-22T00:42:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.488+0000 7f41e181b700 1 -- start start 2023-08-22T00:42:33.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41e181b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f41dc154170 0x7f41dc158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41e181b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0bcf30 con 0x7f41dc064320 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41e181b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc154550 con 0x7f41dc063ea0 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41e181b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc158b00 con 0x7f41dc154170 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f41dc154170 0x7f41dc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f41dc154170 0x7f41dc158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40844/0 (socket says 172.21.15.98:40844) 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 -- 172.21.15.98:0/1615961755 learned_addr learned my addr 172.21.15.98:0/1615961755 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41db7fe700 1 --1- 172.21.15.98:0/1615961755 >> v1:172.21.15.98:6789/0 conn(0x7f41dc064320 0x7f41dc0c1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48042/0 (socket says 172.21.15.98:48042) 2023-08-22T00:42:33.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 -- 172.21.15.98:0/1615961755 >> v1:172.21.15.118:6789/0 conn(0x7f41dc063ea0 legacy=0x7f41dc0c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 -- 172.21.15.98:0/1615961755 >> v1:172.21.15.98:6789/0 conn(0x7f41dc064320 legacy=0x7f41dc0c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41d9ffb700 1 -- 172.21.15.98:0/1615961755 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492055191 0 0) 0x7f41dc0bcf30 con 0x7f41dc064320 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 -- 172.21.15.98:0/1615961755 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0676b0 con 0x7f41dc154170 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41daffd700 1 --2- 172.21.15.98:0/1615961755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc158610 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f41cc006fd0 tx=0x7f41cc0090f0).ready entity=mon.0 client_cookie=f94d60c928e8e89b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41d9ffb700 1 -- 172.21.15.98:0/1615961755 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00b600 con 0x7f41dc154170 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41d9ffb700 1 -- 172.21.15.98:0/1615961755 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00b760 con 0x7f41dc154170 2023-08-22T00:42:33.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.489+0000 7f41d9ffb700 1 -- 172.21.15.98:0/1615961755 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00bae0 con 0x7f41dc154170 2023-08-22T00:42:33.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 -- 172.21.15.98:0/1615961755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 msgr2=0x7f41dc158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 --2- 172.21.15.98:0/1615961755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc158610 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f41cc006fd0 tx=0x7f41cc0090f0).stop 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 -- 172.21.15.98:0/1615961755 shutdown_connections 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 --2- 172.21.15.98:0/1615961755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc158610 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 -- 172.21.15.98:0/1615961755 >> 172.21.15.98:0/1615961755 conn(0x7f41dc069680 msgr2=0x7f41dc069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 -- 172.21.15.98:0/1615961755 shutdown_connections 2023-08-22T00:42:33.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.490+0000 7f41e181b700 1 -- 172.21.15.98:0/1615961755 wait complete. 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.491+0000 7f41e181b700 1 Processor -- start 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.491+0000 7f41e181b700 1 -- start start 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41dc063ea0 0x7f41dc14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc064320 0x7f41dc0a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0a94d0 con 0x7f41dc154170 2023-08-22T00:42:33.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc14b320 con 0x7f41dc064320 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41e181b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0a8620 con 0x7f41dc063ea0 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40860/0 (socket says 172.21.15.98:40860) 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 -- 172.21.15.98:0/4215836471 learned_addr learned my addr 172.21.15.98:0/4215836471 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41daffd700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41dc063ea0 0x7f41dc14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41da7fc700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc064320 0x7f41dc0a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 -- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41dc063ea0 msgr2=0x7f41dc14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41dc063ea0 0x7f41dc14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 -- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc064320 msgr2=0x7f41dc0a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc064320 0x7f41dc0a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 -- 172.21.15.98:0/4215836471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009370 con 0x7f41dc154170 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.492+0000 7f41db7fe700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f41d400c840 tx=0x7f41d4007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.493+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4005c70 con 0x7f41dc154170 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.493+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4005dd0 con 0x7f41dc154170 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.493+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4007320 con 0x7f41dc154170 2023-08-22T00:42:33.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.493+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc0a88c0 con 0x7f41dc154170 2023-08-22T00:42:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.493+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc0a8e80 con 0x7f41dc154170 2023-08-22T00:42:33.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f41d4007710 con 0x7f41dc154170 2023-08-22T00:42:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc0a9640 con 0x7f41dc154170 2023-08-22T00:42:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41c2ffd700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 0x7f41c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f41d4079820 con 0x7f41dc154170 2023-08-22T00:42:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41daffd700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 0x7f41c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.495+0000 7f41daffd700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 0x7f41c80613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f41cc009130 tx=0x7f41cc017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.499+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41d404adb0 con 0x7f41dc154170 2023-08-22T00:42:33.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.660+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41dc046c20 con 0x7f41dc154170 2023-08-22T00:42:33.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.661+0000 7f41c2ffd700 1 -- 172.21.15.98:0/4215836471 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v181) v1 ==== 110+0+10 (secure 0 0 0) 0x7f41d404e3d0 con 0x7f41dc154170 2023-08-22T00:42:33.662 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:42:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 msgr2=0x7f41c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 0x7f41c80613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f41cc009130 tx=0x7f41cc017000).stop 2023-08-22T00:42:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 msgr2=0x7f41dc0c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f41d400c840 tx=0x7f41d4007f10).stop 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 shutdown_connections 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f41c805ef30 0x7f41c80613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41dc063ea0 0x7f41dc14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41dc154170 0x7f41dc0c6370 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 --2- 172.21.15.98:0/4215836471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc064320 0x7f41dc0a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 >> 172.21.15.98:0/4215836471 conn(0x7f41dc069680 msgr2=0x7f41dc14df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 shutdown_connections 2023-08-22T00:42:33.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.663+0000 7f41e181b700 1 -- 172.21.15.98:0/4215836471 wait complete. 2023-08-22T00:42:33.676 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:42:33.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.794+0000 7f8eac26d700 1 Processor -- start 2023-08-22T00:42:33.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.794+0000 7f8eac26d700 1 -- start start 2023-08-22T00:42:33.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8eac26d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8ea4154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8eac26d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea4151e80 con 0x7f8ea414b250 2023-08-22T00:42:33.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8eac26d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea4065560 con 0x7f8ea414ae70 2023-08-22T00:42:33.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8eac26d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4066b90 con 0x7f8ea40c3c10 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8ea9808700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8ea414b250 0x7f8ea40c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48056/0 (socket says 172.21.15.98:48056) 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8ea9808700 1 -- 172.21.15.98:0/2915742503 learned_addr learned my addr 172.21.15.98:0/2915742503 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8ea4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052289157 0 0) 0x7f8ea4151e80 con 0x7f8ea414b250 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.795+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e900033f0 con 0x7f8ea414b250 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322323911 0 0) 0x7f8ea4065560 con 0x7f8ea414ae70 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea4151e80 con 0x7f8ea414ae70 2023-08-22T00:42:33.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141283740 0 0) 0x7f8e900033f0 con 0x7f8ea414b250 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 msgr2=0x7f8ea4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8ea4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 >> v1:172.21.15.118:6789/0 conn(0x7f8ea414ae70 legacy=0x7f8ea40c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40c7590 con 0x7f8ea414b250 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8ea0001470 con 0x7f8ea414b250 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 >> v1:172.21.15.98:6789/0 conn(0x7f8ea414b250 legacy=0x7f8ea40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90003aa0 0x7f8e90003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8e90004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90004b80 0x7f8e90005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4066b90 con 0x7f8e90004b80 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9000b910 con 0x7f8e90003aa0 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9000bad0 con 0x7f8ea40c3c10 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90004b80 0x7f8e90005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9808700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8e90004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa009700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90003aa0 0x7f8e90003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 -- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 msgr2=0x7f8e90004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c3c10 0x7f8e90004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 -- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90003aa0 msgr2=0x7f8e90003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90003aa0 0x7f8e90003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 -- 172.21.15.98:0/2915742503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900033f0 con 0x7f8e90004b80 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa009700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90003aa0 0x7f8e90003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:33.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90004b80 0x7f8e90005000 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f8e9c00e1c0 tx=0x7f8e9c00b040).ready entity=mon.0 client_cookie=ba327400a3f4d779 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c009ac0 con 0x7f8e90004b80 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c00f040 con 0x7f8e90004b80 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.796+0000 7f8ea9007700 1 -- 172.21.15.98:0/2915742503 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00eca0 con 0x7f8e90004b80 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 -- 172.21.15.98:0/2915742503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90004b80 msgr2=0x7f8e90005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 --2- 172.21.15.98:0/2915742503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90004b80 0x7f8e90005000 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f8e9c00e1c0 tx=0x7f8e9c00b040).stop 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eaa80a700 1 -- 172.21.15.98:0/2915742503 reap_dead start 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 -- 172.21.15.98:0/2915742503 shutdown_connections 2023-08-22T00:42:33.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 -- 172.21.15.98:0/2915742503 >> 172.21.15.98:0/2915742503 conn(0x7f8ea40c7800 msgr2=0x7f8ea40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 -- 172.21.15.98:0/2915742503 shutdown_connections 2023-08-22T00:42:33.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.797+0000 7f8eac26d700 1 -- 172.21.15.98:0/2915742503 wait complete. 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.798+0000 7f8eac26d700 1 Processor -- start 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.798+0000 7f8eac26d700 1 -- start start 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90004b80 0x7f8ea4164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c09f0 0x7f8ea40c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40ad7a0 con 0x7f8ea40a7780 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40a8a90 con 0x7f8e90004b80 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c1360 con 0x7f8ea40c09f0 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40874/0 (socket says 172.21.15.98:40874) 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 -- 172.21.15.98:0/4015391130 learned_addr learned my addr 172.21.15.98:0/4015391130 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eaa80a700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c09f0 0x7f8ea40c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eaa009700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90004b80 0x7f8ea4164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 -- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c09f0 msgr2=0x7f8ea40c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c09f0 0x7f8ea40c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 -- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90004b80 msgr2=0x7f8ea4164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90004b80 0x7f8ea4164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 -- 172.21.15.98:0/4015391130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40a7c00 con 0x7f8ea40a7780 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8ea9808700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f8ea0007840 tx=0x7f8ea0001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011590 con 0x7f8ea40a7780 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00116f0 con 0x7f8ea40a7780 2023-08-22T00:42:33.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40a7e80 con 0x7f8ea40a7780 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011a90 con 0x7f8ea40a7780 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.799+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea40a8440 con 0x7f8ea40a7780 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.800+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea40c1fe0 con 0x7f8ea40a7780 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.801+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8ea0015410 con 0x7f8ea40a7780 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.801+0000 7f8e9a7fc700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 0x7f8e880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.801+0000 7f8eaa009700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 0x7f8e880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:33.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.801+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8ea0079e90 con 0x7f8ea40a7780 2023-08-22T00:42:33.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.802+0000 7f8eaa009700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 0x7f8e880613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8e940010e0 tx=0x7f8e9400c040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:33.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.805+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ea004b310 con 0x7f8ea40a7780 2023-08-22T00:42:33.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.965+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ea414aaf0 con 0x7f8ea40a7780 2023-08-22T00:42:33.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.966+0000 7f8e9a7fc700 1 -- 172.21.15.98:0/4015391130 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v181) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ea004e930 con 0x7f8ea40a7780 2023-08-22T00:42:33.967 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:42:33.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 msgr2=0x7f8e880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 0x7f8e880613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8e940010e0 tx=0x7f8e9400c040).stop 2023-08-22T00:42:33.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 msgr2=0x7f8ea40ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:33.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f8ea0007840 tx=0x7f8ea0001e10).stop 2023-08-22T00:42:33.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 shutdown_connections 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8e8805ef30 0x7f8e880613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ea40c09f0 0x7f8ea40c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90004b80 0x7f8ea4164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 --2- 172.21.15.98:0/4015391130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea40a7780 0x7f8ea40ad2b0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 >> 172.21.15.98:0/4015391130 conn(0x7f8ea40c7800 msgr2=0x7f8ea41532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 shutdown_connections 2023-08-22T00:42:33.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:33.968+0000 7f8eac26d700 1 -- 172.21.15.98:0/4015391130 wait complete. 2023-08-22T00:42:33.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:42:34.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.095+0000 7fd6c7532700 1 Processor -- start 2023-08-22T00:42:34.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.095+0000 7fd6c7532700 1 -- start start 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c7532700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c00bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c7532700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd6c00c2be0 0x7fd6c0063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c7532700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c0063f60 con 0x7fd6c0155310 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c7532700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00bd3b0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c7532700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0154830 con 0x7fd6c00a89a0 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd6c00c2be0 0x7fd6c0063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd6c00c2be0 0x7fd6c0063a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40884/0 (socket says 172.21.15.98:40884) 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 -- 172.21.15.98:0/572656126 learned_addr learned my addr 172.21.15.98:0/572656126 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c52ce700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c00bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 -- 172.21.15.98:0/572656126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 msgr2=0x7fd6c00bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c00bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 -- 172.21.15.98:0/572656126 >> v1:172.21.15.118:6789/0 conn(0x7fd6c0155310 legacy=0x7fd6c00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.096+0000 7fd6c5acf700 1 -- 172.21.15.98:0/572656126 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0154b10 con 0x7fd6c00c2be0 2023-08-22T00:42:34.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c5acf700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0063a70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7fd6b8009f20 tx=0x7fd6b8009840).ready entity=mon.0 client_cookie=7d4f52a8d03c28a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6b3fff700 1 -- 172.21.15.98:0/572656126 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800e070 con 0x7fd6c00c2be0 2023-08-22T00:42:34.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6b3fff700 1 -- 172.21.15.98:0/572656126 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800ba80 con 0x7fd6c00c2be0 2023-08-22T00:42:34.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6b3fff700 1 -- 172.21.15.98:0/572656126 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800be00 con 0x7fd6c00c2be0 2023-08-22T00:42:34.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 -- 172.21.15.98:0/572656126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 msgr2=0x7fd6c0063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0063a70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7fd6b8009f20 tx=0x7fd6b8009840).stop 2023-08-22T00:42:34.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 -- 172.21.15.98:0/572656126 shutdown_connections 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0063a70 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 --2- 172.21.15.98:0/572656126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c00bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 -- 172.21.15.98:0/572656126 >> 172.21.15.98:0/572656126 conn(0x7fd6c00c7140 msgr2=0x7fd6c00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 -- 172.21.15.98:0/572656126 shutdown_connections 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.097+0000 7fd6c7532700 1 -- 172.21.15.98:0/572656126 wait complete. 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.098+0000 7fd6c7532700 1 Processor -- start 2023-08-22T00:42:34.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.098+0000 7fd6c7532700 1 -- start start 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c0154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 0x7fd6c00ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0151c20 con 0x7fd6c00c2be0 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0164ef0 con 0x7fd6c0155310 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c7532700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0151e30 con 0x7fd6c00a89a0 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c4acd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.099+0000 7fd6c4acd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40890/0 (socket says 172.21.15.98:40890) 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 -- 172.21.15.98:0/31600303 learned_addr learned my addr 172.21.15.98:0/31600303 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c5acf700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 0x7fd6c00ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c52ce700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c0154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 -- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 msgr2=0x7fd6c0154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c0154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 -- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 msgr2=0x7fd6c00ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 0x7fd6c00ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 -- 172.21.15.98:0/31600303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009ae0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c5acf700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 0x7fd6c00ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c4acd700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fd6b400c6f0 tx=0x7fd6b4007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40106b0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4010810 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c01648a0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4010bb0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.100+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0152110 con 0x7fd6c00c2be0 2023-08-22T00:42:34.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.101+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c01650a0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.101+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd6b4011470 con 0x7fd6c00c2be0 2023-08-22T00:42:34.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.102+0000 7fd6b17fa700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 0x7fd6a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.102+0000 7fd6c52ce700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 0x7fd6a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.102+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd6b407c690 con 0x7fd6c00c2be0 2023-08-22T00:42:34.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.102+0000 7fd6c52ce700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 0x7fd6a40613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd6bc00bb20 tx=0x7fd6bc008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.106+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6c01650a0 con 0x7fd6c00c2be0 2023-08-22T00:42:34.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.270+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd6c0165060 con 0x7fd6c00c2be0 2023-08-22T00:42:34.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.271+0000 7fd6b17fa700 1 -- 172.21.15.98:0/31600303 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v181) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd6b404db70 con 0x7fd6c00c2be0 2023-08-22T00:42:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:34.272 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:42:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:42:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:34.274 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:42:34.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.272+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 msgr2=0x7fd6a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.272+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 0x7fd6a40613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd6bc00bb20 tx=0x7fd6bc008040).stop 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 msgr2=0x7fd6c0151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fd6b400c6f0 tx=0x7fd6b4007e30).stop 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 shutdown_connections 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd6a405ef30 0x7fd6a40613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6c00a89a0 0x7fd6c0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c0155310 0x7fd6c00ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 --2- 172.21.15.98:0/31600303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6c00c2be0 0x7fd6c0151730 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 >> 172.21.15.98:0/31600303 conn(0x7fd6c00c7140 msgr2=0x7fd6c014f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:34.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 shutdown_connections 2023-08-22T00:42:34.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.273+0000 7fd6c7532700 1 -- 172.21.15.98:0/31600303 wait complete. 2023-08-22T00:42:34.285 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:42:34.286 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:42:34.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.405+0000 7f11f11bf700 1 Processor -- start 2023-08-22T00:42:34.406 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.405+0000 7f11f11bf700 1 -- start start 2023-08-22T00:42:34.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f11ec154f60 0x7f11ec068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.408 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 0x7f11ec0be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec0a86f0 con 0x7f11ec154f60 2023-08-22T00:42:34.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec0a8c70 con 0x7f11ec0673e0 2023-08-22T00:42:34.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11f11bf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec068210 con 0x7f11ec069210 2023-08-22T00:42:34.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f11ec154f60 0x7f11ec068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f11ec154f60 0x7f11ec068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40892/0 (socket says 172.21.15.98:40892) 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 -- 172.21.15.98:0/887720696 learned_addr learned my addr 172.21.15.98:0/887720696 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ea59c700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11eb59e700 1 --2- 172.21.15.98:0/887720696 >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 0x7f11ec0be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 -- 172.21.15.98:0/887720696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 msgr2=0x7f11ec066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 -- 172.21.15.98:0/887720696 >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 msgr2=0x7f11ec0be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 --2- 172.21.15.98:0/887720696 >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 0x7f11ec0be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 -- 172.21.15.98:0/887720696 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec069690 con 0x7f11ec154f60 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11eb59e700 1 --2- 172.21.15.98:0/887720696 >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 0x7f11ec0be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ea59c700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11ead9d700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec068d20 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f11ec0c52d0 tx=0x7f11dc0090f0).ready entity=mon.0 client_cookie=bfa7838e9ec1061e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11e9d9b700 1 -- 172.21.15.98:0/887720696 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00b600 con 0x7f11ec154f60 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11e9d9b700 1 -- 172.21.15.98:0/887720696 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc00b760 con 0x7f11ec154f60 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.406+0000 7f11e9d9b700 1 -- 172.21.15.98:0/887720696 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00bb00 con 0x7f11ec154f60 2023-08-22T00:42:34.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 -- 172.21.15.98:0/887720696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 msgr2=0x7f11ec068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec068d20 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f11ec0c52d0 tx=0x7f11dc0090f0).stop 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 -- 172.21.15.98:0/887720696 shutdown_connections 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 --2- 172.21.15.98:0/887720696 >> v2:172.21.15.118:3300/0 conn(0x7f11ec0673e0 0x7f11ec0be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec068d20 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 --2- 172.21.15.98:0/887720696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 -- 172.21.15.98:0/887720696 >> 172.21.15.98:0/887720696 conn(0x7f11ec0c5dd0 msgr2=0x7f11ec068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 -- 172.21.15.98:0/887720696 shutdown_connections 2023-08-22T00:42:34.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.407+0000 7f11f11bf700 1 -- 172.21.15.98:0/887720696 wait complete. 2023-08-22T00:42:34.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.409+0000 7f11f11bf700 1 Processor -- start 2023-08-22T00:42:34.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.409+0000 7f11f11bf700 1 -- start start 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 0x7f11ec0c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec0c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0c16d0 con 0x7f11ec154f60 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0c0ac0 con 0x7f11ec0673e0 2023-08-22T00:42:34.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0c0da0 con 0x7f11ec069210 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40906/0 (socket says 172.21.15.98:40906) 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 -- 172.21.15.98:0/2166958116 learned_addr learned my addr 172.21.15.98:0/2166958116 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11ead9d700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 0x7f11ec0c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 -- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 msgr2=0x7f11ec0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11ea59c700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec0c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec0c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 -- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 msgr2=0x7f11ec0c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 0x7f11ec0c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 -- 172.21.15.98:0/2166958116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009370 con 0x7f11ec154f60 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11ead9d700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 0x7f11ec0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11eb59e700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f11e400a380 tx=0x7f11e4007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400ae10 con 0x7f11ec154f60 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e400d650 con 0x7f11ec154f60 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec0c1080 con 0x7f11ec154f60 2023-08-22T00:42:34.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400d9d0 con 0x7f11ec154f60 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.410+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec14aa20 con 0x7f11ec154f60 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.411+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec0c1840 con 0x7f11ec154f60 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.412+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f11e4013070 con 0x7f11ec154f60 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.412+0000 7f11d2ffd700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 0x7f11d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.412+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f11e407a850 con 0x7f11ec154f60 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.412+0000 7f11ead9d700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 0x7f11d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.412+0000 7f11ead9d700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 0x7f11d80613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f11ec0c0470 tx=0x7f11dc017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.416+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11e404bd30 con 0x7f11ec154f60 2023-08-22T00:42:34.578 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.577+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f11ec067c50 con 0x7f11ec154f60 2023-08-22T00:42:34.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.672+0000 7f11d2ffd700 1 -- 172.21.15.98:0/2166958116 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v182) v1 ==== 152+0+0 (secure 0 0 0) 0x7f11e404f350 con 0x7f11ec154f60 2023-08-22T00:42:34.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 msgr2=0x7f11d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 0x7f11d80613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f11ec0c0470 tx=0x7f11dc017000).stop 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 msgr2=0x7f11ec153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f11e400a380 tx=0x7f11e4007900).stop 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 shutdown_connections 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f11d805ef30 0x7f11d80613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ec154f60 0x7f11ec153be0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ec0673e0 0x7f11ec0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 --2- 172.21.15.98:0/2166958116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ec069210 0x7f11ec0c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 >> 172.21.15.98:0/2166958116 conn(0x7f11ec0c5dd0 msgr2=0x7f11ec0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 shutdown_connections 2023-08-22T00:42:34.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.675+0000 7f11f11bf700 1 -- 172.21.15.98:0/2166958116 wait complete. 2023-08-22T00:42:34.680 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:42:34.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:42:34.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.814+0000 7f6033221700 1 Processor -- start 2023-08-22T00:42:34.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.814+0000 7f6033221700 1 -- start start 2023-08-22T00:42:34.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f6033221700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f602c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f6033221700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c1541c0 con 0x7f602c063b10 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f6033221700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c063fc0 con 0x7f602c062600 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f6033221700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0ca860 con 0x7f602c157ab0 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f60317be700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f602c063b10 0x7f602c0acbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48062/0 (socket says 172.21.15.98:48062) 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.815+0000 7f60317be700 1 -- 172.21.15.98:0/917434893 learned_addr learned my addr 172.21.15.98:0/917434893 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:34.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095549429 0 0) 0x7f602c1541c0 con 0x7f602c063b10 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f6030fbd700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f602c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c0033f0 con 0x7f602c063b10 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3970734676 0 0) 0x7f601c0033f0 con 0x7f602c063b10 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 msgr2=0x7f602c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f602c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 >> v1:172.21.15.118:6789/0 conn(0x7f602c062600 legacy=0x7f602c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c062a90 con 0x7f602c063b10 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f60240017f0 con 0x7f602c063b10 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 >> v1:172.21.15.98:6789/0 conn(0x7f602c063b10 legacy=0x7f602c0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c003910 0x7f601c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c004690 0x7f601c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f601c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0ca860 con 0x7f601c004690 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00b910 con 0x7f601c003910 2023-08-22T00:42:34.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00bad0 con 0x7f602c157ab0 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602bfff700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c004690 0x7f601c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f6030fbd700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c003910 0x7f601c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f60317be700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f601c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602bfff700 1 -- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 msgr2=0x7f601c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602bfff700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f602c157ab0 0x7f601c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602bfff700 1 -- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c003910 msgr2=0x7f601c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:34.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.816+0000 7f602bfff700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c003910 0x7f601c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f602bfff700 1 -- 172.21.15.98:0/917434893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0033f0 con 0x7f601c004690 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f602bfff700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c004690 0x7f601c004b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f6018001700 tx=0x7f6018007bb0).ready entity=mon.0 client_cookie=ec794d656daf148a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018007020 con 0x7f601c004690 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018007180 con 0x7f601c004690 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f602b7fe700 1 -- 172.21.15.98:0/917434893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018007500 con 0x7f601c004690 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 -- 172.21.15.98:0/917434893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c004690 msgr2=0x7f601c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 --2- 172.21.15.98:0/917434893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c004690 0x7f601c004b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f6018001700 tx=0x7f6018007bb0).stop 2023-08-22T00:42:34.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f60317be700 1 -- 172.21.15.98:0/917434893 reap_dead start 2023-08-22T00:42:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 -- 172.21.15.98:0/917434893 shutdown_connections 2023-08-22T00:42:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 -- 172.21.15.98:0/917434893 >> 172.21.15.98:0/917434893 conn(0x7f602c0cb600 msgr2=0x7f602c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 -- 172.21.15.98:0/917434893 shutdown_connections 2023-08-22T00:42:34.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.817+0000 7f6033221700 1 -- 172.21.15.98:0/917434893 wait complete. 2023-08-22T00:42:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.818+0000 7f6033221700 1 Processor -- start 2023-08-22T00:42:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 -- start start 2023-08-22T00:42:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f601c004690 0x7f602c1475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f602c152880 0x7f602c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c155140 con 0x7f602c151c10 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c1531d0 con 0x7f602c152880 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f6033221700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c154530 con 0x7f601c004690 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.819+0000 7f602bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40930/0 (socket says 172.21.15.98:40930) 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 -- 172.21.15.98:0/1254454727 learned_addr learned my addr 172.21.15.98:0/1254454727 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:34.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6030fbd700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f601c004690 0x7f602c1475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f60317be700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f602c152880 0x7f602c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 -- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f601c004690 msgr2=0x7f602c1475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f601c004690 0x7f602c1475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 -- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f602c152880 msgr2=0x7f602c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f602c152880 0x7f602c152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 -- 172.21.15.98:0/1254454727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c154810 con 0x7f602c151c10 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f602bfff700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f6018001010 tx=0x7f6018016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801d440 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601801d5a0 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c155140 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801d960 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.820+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c154dd0 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.821+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c1552d0 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.822+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6018012400 con 0x7f602c151c10 2023-08-22T00:42:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.822+0000 7f6028ff9700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 0x7f60100613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:34.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.822+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f601807ac10 con 0x7f602c151c10 2023-08-22T00:42:34.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.822+0000 7f6030fbd700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 0x7f60100613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:34.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.822+0000 7f6030fbd700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 0x7f60100613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6020006d80 tx=0x7f6020009060).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:34.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.826+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f601804bfd0 con 0x7f602c151c10 2023-08-22T00:42:34.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:34.988+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f602c147b30 con 0x7f602c151c10 2023-08-22T00:42:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.678+0000 7f6028ff9700 1 -- 172.21.15.98:0/1254454727 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v183) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6018022020 con 0x7f602c151c10 2023-08-22T00:42:35.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 msgr2=0x7f60100613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 0x7f60100613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6020006d80 tx=0x7f6020009060).stop 2023-08-22T00:42:35.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 msgr2=0x7f602c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f6018001010 tx=0x7f6018016000).stop 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 shutdown_connections 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f601005ef30 0x7f60100613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f601c004690 0x7f602c1475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f602c152880 0x7f602c152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 --2- 172.21.15.98:0/1254454727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f602c151c10 0x7f602c156390 secure :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0x7f6018001010 tx=0x7f6018016000).stop 2023-08-22T00:42:35.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.695+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 >> 172.21.15.98:0/1254454727 conn(0x7f602c0cb600 msgr2=0x7f602c0a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:35.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.698+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 shutdown_connections 2023-08-22T00:42:35.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.699+0000 7f6033221700 1 -- 172.21.15.98:0/1254454727 wait complete. 2023-08-22T00:42:35.701 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:42:35.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:42:35.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.839+0000 7f6efb85e700 1 Processor -- start 2023-08-22T00:42:35.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 -- start start 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 0x7f6ef40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 0x7f6ef4062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef40c8d30 con 0x7f6ef4157e60 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef40c9010 con 0x7f6ef4157a80 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.840+0000 7f6efb85e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40c92f0 con 0x7f6ef4153e90 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef95fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 0x7f6ef40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 0x7f6ef4062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef8df9700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6ef4157e60 0x7f6ef4153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:52650/0 (socket says 172.21.15.98:52650) 2023-08-22T00:42:35.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef8df9700 1 -- 172.21.15.98:0/777574499 learned_addr learned my addr 172.21.15.98:0/777574499 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:35.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 -- 172.21.15.98:0/777574499 >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 msgr2=0x7f6ef40aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:35.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 --2- 172.21.15.98:0/777574499 >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 0x7f6ef40aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.844 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 -- 172.21.15.98:0/777574499 >> v1:172.21.15.118:6789/0 conn(0x7f6ef4157e60 legacy=0x7f6ef4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 -- 172.21.15.98:0/777574499 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40c95d0 con 0x7f6ef4153e90 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef95fa700 1 --2- 172.21.15.98:0/777574499 >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 0x7f6ef40aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6ef9dfb700 1 --2- 172.21.15.98:0/777574499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 0x7f6ef4062600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6eec009e60 tx=0x7f6eec009780).ready entity=mon.2 client_cookie=c03211d92d9e895c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6eebfff700 1 -- 172.21.15.98:0/777574499 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00e070 con 0x7f6ef4153e90 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6eebfff700 1 -- 172.21.15.98:0/777574499 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00bb60 con 0x7f6ef4153e90 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.841+0000 7f6eebfff700 1 -- 172.21.15.98:0/777574499 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec012410 con 0x7f6ef4153e90 2023-08-22T00:42:35.845 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 -- 172.21.15.98:0/777574499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 msgr2=0x7f6ef4062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 --2- 172.21.15.98:0/777574499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 0x7f6ef4062600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6eec009e60 tx=0x7f6eec009780).stop 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 -- 172.21.15.98:0/777574499 shutdown_connections 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 --2- 172.21.15.98:0/777574499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4153e90 0x7f6ef4062600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 --2- 172.21.15.98:0/777574499 >> v2:172.21.15.118:3300/0 conn(0x7f6ef4157a80 0x7f6ef40aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 -- 172.21.15.98:0/777574499 >> 172.21.15.98:0/777574499 conn(0x7f6ef40cb5f0 msgr2=0x7f6ef40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 -- 172.21.15.98:0/777574499 shutdown_connections 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.842+0000 7f6efb85e700 1 -- 172.21.15.98:0/777574499 wait complete. 2023-08-22T00:42:35.846 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.843+0000 7f6efb85e700 1 Processor -- start 2023-08-22T00:42:35.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.843+0000 7f6efb85e700 1 -- start start 2023-08-22T00:42:35.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4157a80 0x7f6ef4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 0x7f6ef40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4164f90 con 0x7f6ef4153e90 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4164400 con 0x7f6ef4157e60 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6efb85e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef41653b0 con 0x7f6ef4157a80 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6ef95fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6ef95fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40936/0 (socket says 172.21.15.98:40936) 2023-08-22T00:42:35.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6ef95fa700 1 -- 172.21.15.98:0/52972748 learned_addr learned my addr 172.21.15.98:0/52972748 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6ef9dfb700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 0x7f6ef40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.844+0000 7f6ef8df9700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4157a80 0x7f6ef4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 -- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4157a80 msgr2=0x7f6ef4156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4157a80 0x7f6ef4156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 -- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 msgr2=0x7f6ef40b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 0x7f6ef40b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:35.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 -- 172.21.15.98:0/52972748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40092a0 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef9dfb700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 0x7f6ef40b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ef95fa700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f6ee400ea50 tx=0x7f6ee4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400c850 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400c9b0 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400cd30 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec009a20 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.845+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef41648d0 con 0x7f6ef4153e90 2023-08-22T00:42:35.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.846+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef4165200 con 0x7f6ef4153e90 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.846+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6ee4012600 con 0x7f6ef4153e90 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.847+0000 7f6ee97fa700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 0x7f6ed80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.847+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f6ee407a7e0 con 0x7f6ef4153e90 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.847+0000 7f6ef8df9700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 0x7f6ed80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.847+0000 7f6ef8df9700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 0x7f6ed80613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6ef0007fd0 tx=0x7f6ef0009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:35.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:35.851+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ee404f400 con 0x7f6ef4153e90 2023-08-22T00:42:36.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.055+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ef40c48f0 con 0x7f6ef4153e90 2023-08-22T00:42:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.060+0000 7f6ee97fa700 1 -- 172.21.15.98:0/52972748 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6ee404eff0 con 0x7f6ef4153e90 2023-08-22T00:42:36.064 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.063+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 msgr2=0x7f6ed80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.063+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 0x7f6ed80613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6ef0007fd0 tx=0x7f6ef0009040).stop 2023-08-22T00:42:36.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.063+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 msgr2=0x7f6ef40ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.063+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f6ee400ea50 tx=0x7f6ee4009060).stop 2023-08-22T00:42:36.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 shutdown_connections 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6ed805ef30 0x7f6ed80613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4157e60 0x7f6ef40b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ef4153e90 0x7f6ef40ae4a0 secure :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0x7f6ee400ea50 tx=0x7f6ee4009060).stop 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 --2- 172.21.15.98:0/52972748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ef4157a80 0x7f6ef4156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 >> 172.21.15.98:0/52972748 conn(0x7f6ef40cb5f0 msgr2=0x7f6ef4062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 shutdown_connections 2023-08-22T00:42:36.066 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.064+0000 7f6efb85e700 1 -- 172.21.15.98:0/52972748 wait complete. 2023-08-22T00:42:36.067 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 22 and data pool 23 2023-08-22T00:42:36.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:36.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.202+0000 7ff291d53700 1 Processor -- start 2023-08-22T00:42:36.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.202+0000 7ff291d53700 1 -- start start 2023-08-22T00:42:36.206 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff291d53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff28c0664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff291d53700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0634b0 con 0x7ff28c152150 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff291d53700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0bd680 con 0x7ff28c0a6a40 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff291d53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0bde30 con 0x7ff28c0660d0 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff28bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff28c152150 0x7ff28c063940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48078/0 (socket says 172.21.15.98:48078) 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.203+0000 7ff28bfff700 1 -- 172.21.15.98:0/3384812369 learned_addr learned my addr 172.21.15.98:0/3384812369 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101318516 0 0) 0x7ff28c0634b0 con 0x7ff28c152150 2023-08-22T00:42:36.207 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2740033f0 con 0x7ff28c152150 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28b7fe700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff28c0664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058618477 0 0) 0x7ff2740033f0 con 0x7ff28c152150 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 msgr2=0x7ff28c0664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff28c0664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 >> v1:172.21.15.118:6789/0 conn(0x7ff28c0a6a40 legacy=0x7ff28c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0be110 con 0x7ff28c152150 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff2840017f0 con 0x7ff28c152150 2023-08-22T00:42:36.208 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 >> v1:172.21.15.98:6789/0 conn(0x7ff28c152150 legacy=0x7ff28c063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff274003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274003ef0 0x7ff274004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff274004b80 0x7ff274005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0bde30 con 0x7ff274003ef0 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27400bb20 con 0x7ff274004b80 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27400bce0 con 0x7ff28c0660d0 2023-08-22T00:42:36.209 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274003ef0 0x7ff274004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28b7fe700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff274003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28bfff700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff274004b80 0x7ff274005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 -- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 msgr2=0x7ff274003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff28c0660d0 0x7ff274003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 -- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff274004b80 msgr2=0x7ff274005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff274004b80 0x7ff274005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.204+0000 7ff28affd700 1 -- 172.21.15.98:0/3384812369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2740033f0 con 0x7ff274003ef0 2023-08-22T00:42:36.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff28affd700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274003ef0 0x7ff274004690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7ff280001700 tx=0x7ff280007bb0).ready entity=mon.0 client_cookie=ec828286a688531d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280007020 con 0x7ff274003ef0 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280007180 con 0x7ff274003ef0 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff28a7fc700 1 -- 172.21.15.98:0/3384812369 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280007500 con 0x7ff274003ef0 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 -- 172.21.15.98:0/3384812369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274003ef0 msgr2=0x7ff274004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 --2- 172.21.15.98:0/3384812369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274003ef0 0x7ff274004690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7ff280001700 tx=0x7ff280007bb0).stop 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff28bfff700 1 -- 172.21.15.98:0/3384812369 reap_dead start 2023-08-22T00:42:36.211 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 -- 172.21.15.98:0/3384812369 shutdown_connections 2023-08-22T00:42:36.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 -- 172.21.15.98:0/3384812369 >> 172.21.15.98:0/3384812369 conn(0x7ff28c06a980 msgr2=0x7ff28c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 -- 172.21.15.98:0/3384812369 shutdown_connections 2023-08-22T00:42:36.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.205+0000 7ff291d53700 1 -- 172.21.15.98:0/3384812369 wait complete. 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 Processor -- start 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 -- start start 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff274003ef0 0x7ff28c165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff28c14a5d0 0x7ff28c0c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c13c0 con 0x7ff28c14aa50 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c162860 con 0x7ff28c14a5d0 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff291d53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1619d0 con 0x7ff274003ef0 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff28bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff28bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40952/0 (socket says 172.21.15.98:40952) 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.207+0000 7ff28bfff700 1 -- 172.21.15.98:0/2372833584 learned_addr learned my addr 172.21.15.98:0/2372833584 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28affd700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff28c14a5d0 0x7ff28c0c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28b7fe700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff274003ef0 0x7ff28c165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 -- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff274003ef0 msgr2=0x7ff28c165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff274003ef0 0x7ff28c165810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 -- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff28c14a5d0 msgr2=0x7ff28c0c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff28c14a5d0 0x7ff28c0c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 -- 172.21.15.98:0/2372833584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c161c50 con 0x7ff28c14aa50 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff28bfff700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7ff28c067210 tx=0x7ff28c0a7650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284007a10 con 0x7ff28c14aa50 2023-08-22T00:42:36.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28400f8a0 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400fc40 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c161f30 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.208+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1624f0 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.209+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c047480 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.209+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff28401d3b0 con 0x7ff28c14aa50 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.210+0000 7ff2737fe700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 0x7ff2780613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.210+0000 7ff28b7fe700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 0x7ff2780613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.210+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff284079bf0 con 0x7ff28c14aa50 2023-08-22T00:42:36.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.210+0000 7ff28b7fe700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 0x7ff2780613c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff28c064050 tx=0x7ff27c008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.214+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff284080080 con 0x7ff28c14aa50 2023-08-22T00:42:36.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.377+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff28c1629f0 con 0x7ff28c14aa50 2023-08-22T00:42:36.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.378+0000 7ff2737fe700 1 -- 172.21.15.98:0/2372833584 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17288 (secure 0 0 0) 0x7ff284019020 con 0x7ff28c14aa50 2023-08-22T00:42:36.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:36.380 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":184,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:36.056996+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 msgr2=0x7ff2780613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 0x7ff2780613c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff28c064050 tx=0x7ff27c008040).stop 2023-08-22T00:42:36.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 msgr2=0x7ff28c0c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7ff28c067210 tx=0x7ff28c0a7650).stop 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 shutdown_connections 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff27805ef00 0x7ff2780613c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff274003ef0 0x7ff28c165810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28c14aa50 0x7ff28c0c0ed0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 --2- 172.21.15.98:0/2372833584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff28c14a5d0 0x7ff28c0c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 >> 172.21.15.98:0/2372833584 conn(0x7ff28c06a980 msgr2=0x7ff28c14b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 shutdown_connections 2023-08-22T00:42:36.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.380+0000 7ff291d53700 1 -- 172.21.15.98:0/2372833584 wait complete. 2023-08-22T00:42:36.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:36.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.508+0000 7f2c37d83700 1 Processor -- start 2023-08-22T00:42:36.509 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.508+0000 7f2c37d83700 1 -- start start 2023-08-22T00:42:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c37d83700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c30150ba0 0x7f2c300c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c37d83700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c300c58e0 con 0x7f2c300c1e60 2023-08-22T00:42:36.512 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c37d83700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c300c5bc0 con 0x7f2c300646b0 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c37d83700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c300ab630 con 0x7f2c30150ba0 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c3531e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2c300c1e60 0x7f2c30063fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48086/0 (socket says 172.21.15.98:48086) 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c3531e700 1 -- 172.21.15.98:0/4248392782 learned_addr learned my addr 172.21.15.98:0/4248392782 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925372360 0 0) 0x7f2c300c58e0 con 0x7f2c300c1e60 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c35b1f700 1 --2- 172.21.15.98:0/4248392782 >> v2:172.21.15.118:3300/0 conn(0x7f2c30150ba0 0x7f2c300c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.509+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c1c0033f0 con 0x7f2c300c1e60 2023-08-22T00:42:36.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939161481 0 0) 0x7f2c1c0033f0 con 0x7f2c300c1e60 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 >> v2:172.21.15.118:3300/0 conn(0x7f2c30150ba0 msgr2=0x7f2c300c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 --2- 172.21.15.98:0/4248392782 >> v2:172.21.15.118:3300/0 conn(0x7f2c30150ba0 0x7f2c300c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 >> v1:172.21.15.118:6789/0 conn(0x7f2c300646b0 legacy=0x7f2c300ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30065580 con 0x7f2c300c1e60 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f2c2c0015f0 con 0x7f2c300c1e60 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 >> v1:172.21.15.98:6789/0 conn(0x7f2c300c1e60 legacy=0x7f2c30063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c1c0038e0 0x7f2c1c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.514 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 0x7f2c1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c005000 0x7f2c1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c00bf00 con 0x7f2c1c004690 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c00c070 con 0x7f2c1c0038e0 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c00c230 con 0x7f2c1c005000 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 0x7f2c1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c35b1f700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c1c0038e0 0x7f2c1c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.515 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c36320700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c005000 0x7f2c1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 -- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c005000 msgr2=0x7f2c1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c005000 0x7f2c1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 -- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c1c0038e0 msgr2=0x7f2c1c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c1c0038e0 0x7f2c1c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c36320700 1 -- 172.21.15.98:0/4248392782 reap_dead start 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 -- 172.21.15.98:0/4248392782 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0033f0 con 0x7f2c1c004690 2023-08-22T00:42:36.516 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c3531e700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 0x7f2c1c004b10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f2c2c00c190 tx=0x7f2c2c0077a0).ready entity=mon.0 client_cookie=823147e15a093b20 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.510+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0079b0 con 0x7f2c1c004690 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00ca80 con 0x7f2c1c004690 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c34b1d700 1 -- 172.21.15.98:0/4248392782 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00ce00 con 0x7f2c1c004690 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 -- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 msgr2=0x7f2c1c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 0x7f2c1c004b10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f2c2c00c190 tx=0x7f2c2c0077a0).stop 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 -- 172.21.15.98:0/4248392782 shutdown_connections 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 --2- 172.21.15.98:0/4248392782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c1c004690 0x7f2c1c004b10 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.517 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 -- 172.21.15.98:0/4248392782 >> 172.21.15.98:0/4248392782 conn(0x7f2c300aa8e0 msgr2=0x7f2c300aacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 -- 172.21.15.98:0/4248392782 shutdown_connections 2023-08-22T00:42:36.518 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.511+0000 7f2c37d83700 1 -- 172.21.15.98:0/4248392782 wait complete. 2023-08-22T00:42:36.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.512+0000 7f2c37d83700 1 Processor -- start 2023-08-22T00:42:36.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.512+0000 7f2c37d83700 1 -- start start 2023-08-22T00:42:36.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c004690 0x7f2c301501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.520 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 0x7f2c300a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3014fd30 con 0x7f2c3014eae0 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c301506b0 con 0x7f2c30144240 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c37d83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3014f160 con 0x7f2c1c004690 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40966/0 (socket says 172.21.15.98:40966) 2023-08-22T00:42:36.521 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 -- 172.21.15.98:0/3312504310 learned_addr learned my addr 172.21.15.98:0/3312504310 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c35b1f700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c004690 0x7f2c301501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c36320700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 0x7f2c300a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 -- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c004690 msgr2=0x7f2c301501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c004690 0x7f2c301501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 -- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 msgr2=0x7f2c300a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 0x7f2c300a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 -- 172.21.15.98:0/3312504310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3014f400 con 0x7f2c3014eae0 2023-08-22T00:42:36.522 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c36320700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 0x7f2c300a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.513+0000 7f2c3531e700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f2c2c001ac0 tx=0x7f2c2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.514+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c005670 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.514+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c0057d0 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.514+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3014f6e0 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.514+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c005b70 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.514+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3014db90 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.515+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c30150010 con 0x7f2c3014eae0 2023-08-22T00:42:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.515+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2c2c013450 con 0x7f2c3014eae0 2023-08-22T00:42:36.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.516+0000 7f2c25ffb700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 0x7f2c140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.516+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c2c07af90 con 0x7f2c3014eae0 2023-08-22T00:42:36.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.516+0000 7f2c35b1f700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 0x7f2c140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.516+0000 7f2c35b1f700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 0x7f2c140613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c300619f0 tx=0x7f2c20006f40).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.524 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.520+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c2c0a98f0 con 0x7f2c3014eae0 2023-08-22T00:42:36.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.683+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c30047480 con 0x7f2c3014eae0 2023-08-22T00:42:36.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.684+0000 7f2c25ffb700 1 -- 172.21.15.98:0/3312504310 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17288 (secure 0 0 0) 0x7f2c2c025030 con 0x7f2c3014eae0 2023-08-22T00:42:36.685 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:36.685 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":184,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:36.056996+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 msgr2=0x7f2c140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 0x7f2c140613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c300619f0 tx=0x7f2c20006f40).stop 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 msgr2=0x7f2c3014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f2c2c001ac0 tx=0x7f2c2c015000).stop 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 shutdown_connections 2023-08-22T00:42:36.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c1405ef30 0x7f2c140613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c1c004690 0x7f2c301501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c30144240 0x7f2c300a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 --2- 172.21.15.98:0/3312504310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c3014eae0 0x7f2c3014d6a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.685+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 >> 172.21.15.98:0/3312504310 conn(0x7f2c300aa8e0 msgr2=0x7f2c300c31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.686+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 shutdown_connections 2023-08-22T00:42:36.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.686+0000 7f2c37d83700 1 -- 172.21.15.98:0/3312504310 wait complete. 2023-08-22T00:42:36.699 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:42:36.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.816+0000 7ff15a47c700 1 Processor -- start 2023-08-22T00:42:36.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.816+0000 7ff15a47c700 1 -- start start 2023-08-22T00:42:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff15a47c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1540c5b30 0x7ff154063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff15a47c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff154064280 con 0x7ff1541579e0 2023-08-22T00:42:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff15a47c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1540c4c20 con 0x7ff1540c5750 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff15a47c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1540c1850 con 0x7ff1540c5b30 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff1537fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff1541579e0 0x7ff154154a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48100/0 (socket says 172.21.15.98:48100) 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.817+0000 7ff1537fe700 1 -- 172.21.15.98:0/3840229712 learned_addr learned my addr 172.21.15.98:0/3840229712 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000875779 0 0) 0x7ff154064280 con 0x7ff1541579e0 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff158a19700 1 --2- 172.21.15.98:0/3840229712 >> v2:172.21.15.118:3300/0 conn(0x7ff1540c5b30 0x7ff154063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff13c0033f0 con 0x7ff1541579e0 2023-08-22T00:42:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498496552 0 0) 0x7ff13c0033f0 con 0x7ff1541579e0 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 >> v2:172.21.15.118:3300/0 conn(0x7ff1540c5b30 msgr2=0x7ff154063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 --2- 172.21.15.98:0/3840229712 >> v2:172.21.15.118:3300/0 conn(0x7ff1540c5b30 0x7ff154063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 >> v1:172.21.15.118:6789/0 conn(0x7ff1540c5750 legacy=0x7ff1540c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154063670 con 0x7ff1541579e0 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff144001470 con 0x7ff1541579e0 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 >> v1:172.21.15.98:6789/0 conn(0x7ff1541579e0 legacy=0x7ff154154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c0038e0 0x7ff13c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 0x7ff13c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c005000 0x7ff13c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c1850 con 0x7ff13c004690 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00bf60 con 0x7ff13c0038e0 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00c0f0 con 0x7ff13c005000 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 0x7ff13c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff153fff700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c0038e0 0x7ff13c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff158a19700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c005000 0x7ff13c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 -- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c005000 msgr2=0x7ff13c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c005000 0x7ff13c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 -- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c0038e0 msgr2=0x7ff13c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c0038e0 0x7ff13c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff158a19700 1 -- 172.21.15.98:0/3840229712 reap_dead start 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 -- 172.21.15.98:0/3840229712 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0033f0 con 0x7ff13c004690 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.818+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 0x7ff13c004b10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7ff14400c160 tx=0x7ff144001e50).ready entity=mon.0 client_cookie=e399b5bdf2727e85 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144007a20 con 0x7ff13c004690 2023-08-22T00:42:36.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400ca10 con 0x7ff13c004690 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff152ffd700 1 -- 172.21.15.98:0/3840229712 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400cd90 con 0x7ff13c004690 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 -- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 msgr2=0x7ff13c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 0x7ff13c004b10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7ff14400c160 tx=0x7ff144001e50).stop 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 -- 172.21.15.98:0/3840229712 shutdown_connections 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3840229712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff13c004690 0x7ff13c004b10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 -- 172.21.15.98:0/3840229712 >> 172.21.15.98:0/3840229712 conn(0x7ff1540c3a60 msgr2=0x7ff1540c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 -- 172.21.15.98:0/3840229712 shutdown_connections 2023-08-22T00:42:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.819+0000 7ff15a47c700 1 -- 172.21.15.98:0/3840229712 wait complete. 2023-08-22T00:42:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.820+0000 7ff15a47c700 1 Processor -- start 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 -- start start 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 0x7ff1540bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1540c09f0 0x7ff154167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c0e70 con 0x7ff1540bf790 2023-08-22T00:42:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540bee10 con 0x7ff1540c09f0 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff15a47c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540be200 con 0x7ff13c004690 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff1537fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff1537fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40988/0 (socket says 172.21.15.98:40988) 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.821+0000 7ff1537fe700 1 -- 172.21.15.98:0/3804129398 learned_addr learned my addr 172.21.15.98:0/3804129398 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff158a19700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1540c09f0 0x7ff154167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff153fff700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 0x7ff1540bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 -- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 msgr2=0x7ff1540bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 0x7ff1540bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 -- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1540c09f0 msgr2=0x7ff154167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1540c09f0 0x7ff154167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 -- 172.21.15.98:0/3804129398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540be4e0 con 0x7ff1540bf790 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff153fff700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 0x7ff1540bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff1537fe700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7ff13c005640 tx=0x7ff144015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440073b0 con 0x7ff1540bf790 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff144007510 con 0x7ff1540bf790 2023-08-22T00:42:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540be7c0 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440048c0 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.822+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff154168460 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.823+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff154068970 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.823+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff14401c070 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.823+0000 7ff13bfff700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 0x7ff1400613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.824+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff14407a770 con 0x7ff1540bf790 2023-08-22T00:42:36.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.824+0000 7ff153fff700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 0x7ff1400613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.824+0000 7ff153fff700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 0x7ff1400613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff148000c00 tx=0x7ff148009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:36.828+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff14404b900 con 0x7ff1540bf790 2023-08-22T00:42:36.986 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-08-22T00:42:36.985+0000 7f3e78647700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:42:37.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.029+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff1540c4e60 con 0x7ff1540bf790 2023-08-22T00:42:37.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.685+0000 7ff13bfff700 1 -- 172.21.15.98:0/3804129398 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff14404ef20 con 0x7ff1540bf790 2023-08-22T00:42:37.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 msgr2=0x7ff1400613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 0x7ff1400613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff148000c00 tx=0x7ff148009040).stop 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 msgr2=0x7ff1540c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7ff13c005640 tx=0x7ff144015000).stop 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 shutdown_connections 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14005ef00 0x7ff1400613c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff13c004690 0x7ff1540bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1540c09f0 0x7ff154167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 --2- 172.21.15.98:0/3804129398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1540bf790 0x7ff1540c0500 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 >> 172.21.15.98:0/3804129398 conn(0x7ff1540c3a60 msgr2=0x7ff154153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:37.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 shutdown_connections 2023-08-22T00:42:37.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.687+0000 7ff15a47c700 1 -- 172.21.15.98:0/3804129398 wait complete. 2023-08-22T00:42:37.705 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:42:37.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.827+0000 7fd9ae4f2700 1 Processor -- start 2023-08-22T00:42:37.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.827+0000 7fd9ae4f2700 1 -- start start 2023-08-22T00:42:37.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd9a8153dd0 0x7fd9a80c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a8064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9a8064600 0x7fd9a8066000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a8064a90 con 0x7fd9a8153dd0 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a8158970 con 0x7fd9a8064600 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9ae4f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80c28b0 con 0x7fd9a80c3230 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd9a8153dd0 0x7fd9a80c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd9a8153dd0 0x7fd9a80c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40994/0 (socket says 172.21.15.98:40994) 2023-08-22T00:42:37.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 -- 172.21.15.98:0/2417128598 learned_addr learned my addr 172.21.15.98:0/2417128598 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a77fe700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a8064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9aca8f700 1 --2- 172.21.15.98:0/2417128598 >> v2:172.21.15.118:3300/0 conn(0x7fd9a8064600 0x7fd9a8066000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 -- 172.21.15.98:0/2417128598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 msgr2=0x7fd9a8064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a8064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 -- 172.21.15.98:0/2417128598 >> v2:172.21.15.118:3300/0 conn(0x7fd9a8064600 msgr2=0x7fd9a8066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/2417128598 >> v2:172.21.15.118:3300/0 conn(0x7fd9a8064600 0x7fd9a8066000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 -- 172.21.15.98:0/2417128598 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8158690 con 0x7fd9a8153dd0 2023-08-22T00:42:37.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.828+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80c2d40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fd9a8063ee0 tx=0x7fd99c0090f0).ready entity=mon.0 client_cookie=92be6389d7fac5f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9a6ffd700 1 -- 172.21.15.98:0/2417128598 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00b600 con 0x7fd9a8153dd0 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9a6ffd700 1 -- 172.21.15.98:0/2417128598 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00b760 con 0x7fd9a8153dd0 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9a6ffd700 1 -- 172.21.15.98:0/2417128598 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00bae0 con 0x7fd9a8153dd0 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/2417128598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8153dd0 msgr2=0x7fd9a80c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80c2d40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fd9a8063ee0 tx=0x7fd99c0090f0).stop 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/2417128598 shutdown_connections 2023-08-22T00:42:37.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/2417128598 >> v2:172.21.15.118:3300/0 conn(0x7fd9a8064600 0x7fd9a8066000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80c2d40 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/2417128598 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a8064110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/2417128598 >> 172.21.15.98:0/2417128598 conn(0x7fd9a80c7820 msgr2=0x7fd9a80c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:37.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/2417128598 shutdown_connections 2023-08-22T00:42:37.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.829+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/2417128598 wait complete. 2023-08-22T00:42:37.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.830+0000 7fd9ae4f2700 1 Processor -- start 2023-08-22T00:42:37.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 -- start start 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a80abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80a5390 con 0x7fd9a8064600 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8165210 con 0x7fd9a8153dd0 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9ae4f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80a4d40 con 0x7fd9a80c3230 2023-08-22T00:42:37.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40996/0 (socket says 172.21.15.98:40996) 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.831+0000 7fd9a7fff700 1 -- 172.21.15.98:0/3221535648 learned_addr learned my addr 172.21.15.98:0/3221535648 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9aca8f700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a77fe700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a80abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 -- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 msgr2=0x7fd9a80abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a80abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 -- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 msgr2=0x7fd9a80a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 -- 172.21.15.98:0/3221535648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c009370 con 0x7fd9a8064600 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9aca8f700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a77fe700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a80abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9a7fff700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7fd99c009130 tx=0x7fd99c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00b8d0 con 0x7fd9a8064600 2023-08-22T00:42:37.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00ba50 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a80a5020 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c01b660 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.832+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a80a5d10 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.833+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a80a4bb0 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.833+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd99c01b9d0 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.834+0000 7fd98ffff700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 0x7fd9940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.834+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd99c07b5c0 con 0x7fd9a8064600 2023-08-22T00:42:37.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.834+0000 7fd9a77fe700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 0x7fd9940613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:37.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.834+0000 7fd9a77fe700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 0x7fd9940613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd9a80a47e0 tx=0x7fd998008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:37.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:37.838+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd99c050180 con 0x7fd9a8064600 2023-08-22T00:42:38.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.044+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd9a80a51b0 con 0x7fd9a8064600 2023-08-22T00:42:38.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.689+0000 7fd98ffff700 1 -- 172.21.15.98:0/3221535648 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd99c04fd70 con 0x7fd9a8064600 2023-08-22T00:42:38.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 msgr2=0x7fd9940613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 0x7fd9940613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd9a80a47e0 tx=0x7fd998008040).stop 2023-08-22T00:42:38.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 msgr2=0x7fd9a80a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7fd99c009130 tx=0x7fd99c017000).stop 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 shutdown_connections 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd99405ef30 0x7fd9940613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a8153dd0 0x7fd9a80a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a8064600 0x7fd9a80a5820 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 --2- 172.21.15.98:0/3221535648 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9a80c3230 0x7fd9a80abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 >> 172.21.15.98:0/3221535648 conn(0x7fd9a80c7820 msgr2=0x7fd9a814ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 shutdown_connections 2023-08-22T00:42:38.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.692+0000 7fd9ae4f2700 1 -- 172.21.15.98:0/3221535648 wait complete. 2023-08-22T00:42:38.705 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:38.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.823+0000 7f79b25dd700 1 Processor -- start 2023-08-22T00:42:38.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.823+0000 7f79b25dd700 1 -- start start 2023-08-22T00:42:38.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b25dd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79ac150040 0x7f79ac150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b25dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79ac0c26b0 0x7f79ac0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b25dd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0c2220 con 0x7f79ac153f10 2023-08-22T00:42:38.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b25dd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0c5bd0 con 0x7f79ac150040 2023-08-22T00:42:38.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b25dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0c1ef0 con 0x7f79ac0c26b0 2023-08-22T00:42:38.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79ac150040 0x7f79ac150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79ac150040 0x7f79ac150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41006/0 (socket says 172.21.15.98:41006) 2023-08-22T00:42:38.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 -- 172.21.15.98:0/1428330740 learned_addr learned my addr 172.21.15.98:0/1428330740 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79b0b7a700 1 --2- 172.21.15.98:0/1428330740 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0c26b0 0x7f79ac0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 -- 172.21.15.98:0/1428330740 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0c26b0 msgr2=0x7f79ac0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 --2- 172.21.15.98:0/1428330740 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0c26b0 0x7f79ac0c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 -- 172.21.15.98:0/1428330740 >> v1:172.21.15.118:6789/0 conn(0x7f79ac153f10 legacy=0x7f79ac0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.824+0000 7f79abfff700 1 -- 172.21.15.98:0/1428330740 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0c5e30 con 0x7f79ac150040 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79abfff700 1 --2- 172.21.15.98:0/1428330740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac150040 0x7f79ac150420 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f79ac0c4cd0 tx=0x7f799400a2b0).ready entity=mon.0 client_cookie=c85355f90d18a2f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:38.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79aaffd700 1 -- 172.21.15.98:0/1428330740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799400ae90 con 0x7f79ac150040 2023-08-22T00:42:38.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79aaffd700 1 -- 172.21.15.98:0/1428330740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799400c940 con 0x7f79ac150040 2023-08-22T00:42:38.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79aaffd700 1 -- 172.21.15.98:0/1428330740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799400ccc0 con 0x7f79ac150040 2023-08-22T00:42:38.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79b25dd700 1 -- 172.21.15.98:0/1428330740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac150040 msgr2=0x7f79ac150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.825+0000 7f79b25dd700 1 --2- 172.21.15.98:0/1428330740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac150040 0x7f79ac150420 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f79ac0c4cd0 tx=0x7f799400a2b0).stop 2023-08-22T00:42:38.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.826+0000 7f79b25dd700 1 -- 172.21.15.98:0/1428330740 shutdown_connections 2023-08-22T00:42:38.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.826+0000 7f79b25dd700 1 --2- 172.21.15.98:0/1428330740 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0c26b0 0x7f79ac0c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.826+0000 7f79b25dd700 1 --2- 172.21.15.98:0/1428330740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac150040 0x7f79ac150420 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.826+0000 7f79b25dd700 1 -- 172.21.15.98:0/1428330740 >> 172.21.15.98:0/1428330740 conn(0x7f79ac0c7140 msgr2=0x7f79ac0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.827+0000 7f79b25dd700 1 -- 172.21.15.98:0/1428330740 shutdown_connections 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.827+0000 7f79b25dd700 1 -- 172.21.15.98:0/1428330740 wait complete. 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.828+0000 7f79b25dd700 1 Processor -- start 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 -- start start 2023-08-22T00:42:38.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac150040 0x7f79ac0becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 0x7f79ac14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0be840 con 0x7f79ac0c26b0 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0bdc30 con 0x7f79ac150040 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79b25dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0bdf10 con 0x7f79ac153f10 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.829+0000 7f79abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41020/0 (socket says 172.21.15.98:41020) 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 -- 172.21.15.98:0/3146360557 learned_addr learned my addr 172.21.15.98:0/3146360557 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79ab7fe700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac150040 0x7f79ac0becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79b0b7a700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 0x7f79ac14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 -- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 msgr2=0x7f79ac14f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 0x7f79ac14f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 -- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac150040 msgr2=0x7f79ac0becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac150040 0x7f79ac0becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:38.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 -- 172.21.15.98:0/3146360557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799400a510 con 0x7f79ac0c26b0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79b0b7a700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 0x7f79ac14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79abfff700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f7994006fd0 tx=0x7f799400a2b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994020070 con 0x7f79ac0c26b0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994000c90 con 0x7f79ac0c26b0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0be1f0 con 0x7f79ac0c26b0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799400ccc0 con 0x7f79ac0c26b0 2023-08-22T00:42:38.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.830+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac14f610 con 0x7f79ac0c26b0 2023-08-22T00:42:38.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.831+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac047480 con 0x7f79ac0c26b0 2023-08-22T00:42:38.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.832+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7994010a40 con 0x7f79ac0c26b0 2023-08-22T00:42:38.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.832+0000 7f79a3fff700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 0x7f798c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:38.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.832+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f799407d9c0 con 0x7f79ac0c26b0 2023-08-22T00:42:38.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.832+0000 7f79ab7fe700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 0x7f798c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:38.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.833+0000 7f79ab7fe700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 0x7f798c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79ac151400 tx=0x7f799c009040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:38.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:38.836+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f799404ec10 con 0x7f79ac0c26b0 2023-08-22T00:42:39.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.037+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79ac153720 con 0x7f79ac0c26b0 2023-08-22T00:42:39.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.037+0000 7f79a3fff700 1 -- 172.21.15.98:0/3146360557 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f7994014090 con 0x7f79ac0c26b0 2023-08-22T00:42:39.039 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:39.039 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:42:39.040 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 msgr2=0x7f798c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 0x7f798c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79ac151400 tx=0x7f799c009040).stop 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 msgr2=0x7f79ac0bd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f7994006fd0 tx=0x7f799400a2b0).stop 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 shutdown_connections 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f798c05ef30 0x7f798c0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac153f10 0x7f79ac14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79ac0c26b0 0x7f79ac0bd690 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 --2- 172.21.15.98:0/3146360557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac150040 0x7f79ac0becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 >> 172.21.15.98:0/3146360557 conn(0x7f79ac0c7140 msgr2=0x7f79ac0661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 shutdown_connections 2023-08-22T00:42:39.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.039+0000 7f79b25dd700 1 -- 172.21.15.98:0/3146360557 wait complete. 2023-08-22T00:42:39.042 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:42:39.052 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:42:39.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.167+0000 7f7c5770b700 1 Processor -- start 2023-08-22T00:42:39.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 -- start start 2023-08-22T00:42:39.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c50154260 0x7f7c500c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c500c64a0 0x7f7c50154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500c4fb0 con 0x7f7c500bc850 2023-08-22T00:42:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5014e7b0 con 0x7f7c50154260 2023-08-22T00:42:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.168+0000 7f7c5770b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500bcfc0 con 0x7f7c500c64a0 2023-08-22T00:42:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c50154260 0x7f7c500c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c55ca8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c500c64a0 0x7f7c50154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c54ca6700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7c500bc850 0x7f7c50154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:52696/0 (socket says 172.21.15.98:52696) 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c54ca6700 1 -- 172.21.15.98:0/3705066499 learned_addr learned my addr 172.21.15.98:0/3705066499 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 -- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c500c64a0 msgr2=0x7f7c50154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 --2- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c500c64a0 0x7f7c50154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 -- 172.21.15.98:0/3705066499 >> v1:172.21.15.118:6789/0 conn(0x7f7c500bc850 legacy=0x7f7c50154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 -- 172.21.15.98:0/3705066499 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500bd2a0 con 0x7f7c50154260 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c554a7700 1 --2- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c50154260 0x7f7c500c2030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f7c48009760 tx=0x7f7c48009060).ready entity=mon.1 client_cookie=228b1c4aabb0f3c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c4ffff700 1 -- 172.21.15.98:0/3705066499 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800b590 con 0x7f7c50154260 2023-08-22T00:42:39.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c4ffff700 1 -- 172.21.15.98:0/3705066499 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800b6f0 con 0x7f7c50154260 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.169+0000 7f7c4ffff700 1 -- 172.21.15.98:0/3705066499 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800ba70 con 0x7f7c50154260 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 -- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c50154260 msgr2=0x7f7c500c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 --2- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c50154260 0x7f7c500c2030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f7c48009760 tx=0x7f7c48009060).stop 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 -- 172.21.15.98:0/3705066499 shutdown_connections 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 --2- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c500c64a0 0x7f7c50154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 --2- 172.21.15.98:0/3705066499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c50154260 0x7f7c500c2030 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 -- 172.21.15.98:0/3705066499 >> 172.21.15.98:0/3705066499 conn(0x7f7c500c3980 msgr2=0x7f7c500c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 -- 172.21.15.98:0/3705066499 shutdown_connections 2023-08-22T00:42:39.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.170+0000 7f7c5770b700 1 -- 172.21.15.98:0/3705066499 wait complete. 2023-08-22T00:42:39.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.171+0000 7f7c5770b700 1 Processor -- start 2023-08-22T00:42:39.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.171+0000 7f7c5770b700 1 -- start start 2023-08-22T00:42:39.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 0x7f7c500beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c50154260 0x7f7c50066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50067320 con 0x7f7c500c64a0 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500bff50 con 0x7f7c500bc850 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c5770b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500bf070 con 0x7f7c50154260 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c54ca6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c54ca6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41028/0 (socket says 172.21.15.98:41028) 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c54ca6700 1 -- 172.21.15.98:0/996653157 learned_addr learned my addr 172.21.15.98:0/996653157 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:39.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c554a7700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 0x7f7c500beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.172+0000 7f7c55ca8700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c50154260 0x7f7c50066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 -- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c50154260 msgr2=0x7f7c50066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c50154260 0x7f7c50066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 -- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 msgr2=0x7f7c500beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 0x7f7c500beb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 -- 172.21.15.98:0/996653157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480092a0 con 0x7f7c500c64a0 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c554a7700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 0x7f7c500beb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:39.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c54ca6700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f7c44007fd0 tx=0x7f7c44007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400ce10 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440072e0 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c500bf340 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44007660 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.173+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c500bf900 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.174+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50047480 con 0x7f7c500c64a0 2023-08-22T00:42:39.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.174+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7c440059b0 con 0x7f7c500c64a0 2023-08-22T00:42:39.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.175+0000 7f7c4d7fa700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 0x7f7c3c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.175+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7c44079820 con 0x7f7c500c64a0 2023-08-22T00:42:39.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.175+0000 7f7c554a7700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 0x7f7c3c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.175+0000 7f7c554a7700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 0x7f7c3c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7c4800b350 tx=0x7f7c48017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.179+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c4404a9b0 con 0x7f7c500c64a0 2023-08-22T00:42:39.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.342+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c500c0520 con 0x7f7c500c64a0 2023-08-22T00:42:39.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.343+0000 7f7c4d7fa700 1 -- 172.21.15.98:0/996653157 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+17275 (secure 0 0 0) 0x7f7c44077e60 con 0x7f7c500c64a0 2023-08-22T00:42:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:39.345 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":185,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:42:37.058922+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:42:39.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 msgr2=0x7f7c3c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 0x7f7c3c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7c4800b350 tx=0x7f7c48017000).stop 2023-08-22T00:42:39.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 msgr2=0x7f7c50066940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f7c44007fd0 tx=0x7f7c44007df0).stop 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 shutdown_connections 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c3c05ef30 0x7f7c3c0613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c50154260 0x7f7c50066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c500bc850 0x7f7c500beb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 --2- 172.21.15.98:0/996653157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c500c64a0 0x7f7c50066940 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 >> 172.21.15.98:0/996653157 conn(0x7f7c500c3980 msgr2=0x7f7c501599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 shutdown_connections 2023-08-22T00:42:39.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.345+0000 7f7c5770b700 1 -- 172.21.15.98:0/996653157 wait complete. 2023-08-22T00:42:39.358 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:42:39.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:42:39.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.473+0000 7f9b31a43700 1 Processor -- start 2023-08-22T00:42:39.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.473+0000 7f9b31a43700 1 -- start start 2023-08-22T00:42:39.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b31a43700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 0x7f9b2c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b31a43700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b2c0a9140 0x7f9b2c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b31a43700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c0a8410 con 0x7f9b2c153f40 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b31a43700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c0a8cb0 con 0x7f9b2c0a9140 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b31a43700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c1586a0 con 0x7f9b2c153b60 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b2b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b2c0a9140 0x7f9b2c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b2affd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 0x7f9b2c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b2affd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 0x7f9b2c068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:52774/0 (socket says 172.21.15.98:52774) 2023-08-22T00:42:39.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b2affd700 1 -- 172.21.15.98:0/1225757997 learned_addr learned my addr 172.21.15.98:0/1225757997 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:39.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.474+0000 7f9b2b7fe700 1 --2- 172.21.15.98:0/1225757997 >> v2:172.21.15.118:3300/0 conn(0x7f9b2c0a9140 0x7f9b2c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:34642/0 (socket says 172.21.15.98:34642) 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b2b7fe700 1 -- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 msgr2=0x7f9b2c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b2b7fe700 1 --2- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 0x7f9b2c068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b2b7fe700 1 -- 172.21.15.98:0/1225757997 >> v1:172.21.15.118:6789/0 conn(0x7f9b2c153f40 legacy=0x7f9b2c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b2b7fe700 1 -- 172.21.15.98:0/1225757997 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0a8660 con 0x7f9b2c0a9140 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b29ffb700 1 -- 172.21.15.98:0/1225757997 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792807437 0 0) 0x7f9b2c0a8410 con 0x7f9b2c153f40 2023-08-22T00:42:39.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b2b7fe700 1 --2- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c158040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9b24009e90 tx=0x7f9b24009780).ready entity=mon.1 client_cookie=cd2428e8cd667144 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b29ffb700 1 -- 172.21.15.98:0/1225757997 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400e070 con 0x7f9b2c0a9140 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b29ffb700 1 -- 172.21.15.98:0/1225757997 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2400bb20 con 0x7f9b2c0a9140 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.475+0000 7f9b29ffb700 1 -- 172.21.15.98:0/1225757997 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400bea0 con 0x7f9b2c0a9140 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 -- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 msgr2=0x7f9b2c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 --2- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c158040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9b24009e90 tx=0x7f9b24009780).stop 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 -- 172.21.15.98:0/1225757997 shutdown_connections 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 --2- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c158040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 --2- 172.21.15.98:0/1225757997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153b60 0x7f9b2c068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 -- 172.21.15.98:0/1225757997 >> 172.21.15.98:0/1225757997 conn(0x7f9b2c0c5dc0 msgr2=0x7f9b2c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 -- 172.21.15.98:0/1225757997 shutdown_connections 2023-08-22T00:42:39.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.476+0000 7f9b31a43700 1 -- 172.21.15.98:0/1225757997 wait complete. 2023-08-22T00:42:39.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.477+0000 7f9b31a43700 1 Processor -- start 2023-08-22T00:42:39.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.477+0000 7f9b31a43700 1 -- start start 2023-08-22T00:42:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153f40 0x7f9b2c0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c157240 con 0x7f9b2c153b60 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c1569e0 con 0x7f9b2c0a9140 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c14f9f0 con 0x7f9b2c153f40 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41036/0 (socket says 172.21.15.98:41036) 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 -- 172.21.15.98:0/2575396173 learned_addr learned my addr 172.21.15.98:0/2575396173 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2affd700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2b7fe700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153f40 0x7f9b2c0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 -- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153f40 msgr2=0x7f9b2c0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153f40 0x7f9b2c0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 -- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 msgr2=0x7f9b2c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c1405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 -- 172.21.15.98:0/2575396173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24009a20 con 0x7f9b2c153b60 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b2a7fc700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f9b1c00c460 tx=0x7f9b1c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c007020 con 0x7f9b2c153b60 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c007180 con 0x7f9b2c153b60 2023-08-22T00:42:39.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c007540 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c156c80 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.478+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c154890 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.480+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c047480 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.480+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9b1c0068b0 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.480+0000 7f9b22ffd700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 0x7f9b0c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.480+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9b1c0796e0 con 0x7f9b2c153b60 2023-08-22T00:42:39.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.480+0000 7f9b2affd700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 0x7f9b0c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.481+0000 7f9b2affd700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 0x7f9b0c0613c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9b14006bc0 tx=0x7f9b140090f0).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.484+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b1c04a810 con 0x7f9b2c153b60 2023-08-22T00:42:39.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.640+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b2c0a8940 con 0x7f9b0c05ef00 2023-08-22T00:42:39.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.651+0000 7f9b22ffd700 1 -- 172.21.15.98:0/2575396173 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353237 (secure 0 0 0) 0x7f9b2c0a8940 con 0x7f9b0c05ef00 2023-08-22T00:42:39.657 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:39.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 msgr2=0x7f9b0c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 0x7f9b0c0613c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9b14006bc0 tx=0x7f9b140090f0).stop 2023-08-22T00:42:39.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 msgr2=0x7f9b2c153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f9b1c00c460 tx=0x7f9b1c007d40).stop 2023-08-22T00:42:39.662 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 shutdown_connections 2023-08-22T00:42:39.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b0c05ef00 0x7f9b0c0613c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b2c153f40 0x7f9b2c0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2c0a9140 0x7f9b2c1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.663 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 --2- 172.21.15.98:0/2575396173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b2c153b60 0x7f9b2c153430 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.664 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 >> 172.21.15.98:0/2575396173 conn(0x7f9b2c0c5dc0 msgr2=0x7f9b2c0ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 shutdown_connections 2023-08-22T00:42:39.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.654+0000 7f9b31a43700 1 -- 172.21.15.98:0/2575396173 wait complete. 2023-08-22T00:42:39.666 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:42:39.667 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:42:38.161119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451812,"kb_used_data":17700,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752522908,"statfs":{"total":773094113280,"available":770583457792,"internally_reserved":0,"allocated":18124800,"data_stored":9652506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553192,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-211,"num_write_kb":-681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.414038"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680285+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675999+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677465+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675089+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.681183+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.682441+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679353+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675916+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680245+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679543+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678586+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674546+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680898+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674564+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677858+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.681794+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676180+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679730+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679017+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674517+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680605+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678959+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675239+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676706+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679851+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680007+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679045+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676755+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675097+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679025+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679104+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675514+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678417+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674991+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676029+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675999+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679074+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677707+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675308+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674257+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679386+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679142+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678270+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678556+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677388+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678255+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675978+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678294+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679920+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678654+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675720+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679069+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674581+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677363+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674858+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674286+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674854+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561262+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:42:33.561262+0000","last_peered":"2023-08-22T00:42:33.561262+0000","last_clean":"2023-08-22T00:42:33.561262+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:42:33.561262+0000","last_undegraded":"2023-08-22T00:42:33.561262+0000","last_fullsized":"2023-08-22T00:42:33.561262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679376+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561502+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:42:33.561502+0000","last_peered":"2023-08-22T00:42:33.561502+0000","last_clean":"2023-08-22T00:42:33.561502+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:42:33.561502+0000","last_undegraded":"2023-08-22T00:42:33.561502+0000","last_fullsized":"2023-08-22T00:42:33.561502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676724+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.495864+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:42:33.495864+0000","last_peered":"2023-08-22T00:42:33.495864+0000","last_clean":"2023-08-22T00:42:33.495864+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:42:33.495864+0000","last_undegraded":"2023-08-22T00:42:33.495864+0000","last_fullsized":"2023-08-22T00:42:33.495864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674309+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561474+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:42:33.561474+0000","last_peered":"2023-08-22T00:42:33.561474+0000","last_clean":"2023-08-22T00:42:33.561474+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:42:33.561474+0000","last_undegraded":"2023-08-22T00:42:33.561474+0000","last_fullsized":"2023-08-22T00:42:33.561474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561503+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:42:33.561503+0000","last_peered":"2023-08-22T00:42:33.561503+0000","last_clean":"2023-08-22T00:42:33.561503+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:42:33.561503+0000","last_undegraded":"2023-08-22T00:42:33.561503+0000","last_fullsized":"2023-08-22T00:42:33.561503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674958+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561432+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:42:33.561432+0000","last_peered":"2023-08-22T00:42:33.561432+0000","last_clean":"2023-08-22T00:42:33.561432+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:42:33.561432+0000","last_undegraded":"2023-08-22T00:42:33.561432+0000","last_fullsized":"2023-08-22T00:42:33.561432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677492+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561438+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:42:33.561438+0000","last_peered":"2023-08-22T00:42:33.561438+0000","last_clean":"2023-08-22T00:42:33.561438+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:42:33.561438+0000","last_undegraded":"2023-08-22T00:42:33.561438+0000","last_fullsized":"2023-08-22T00:42:33.561438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.682092+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561239+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:42:33.561239+0000","last_peered":"2023-08-22T00:42:33.561239+0000","last_clean":"2023-08-22T00:42:33.561239+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:42:33.561239+0000","last_undegraded":"2023-08-22T00:42:33.561239+0000","last_fullsized":"2023-08-22T00:42:33.561239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677753+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:32.667221+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:42:32.667221+0000","last_peered":"2023-08-22T00:42:32.667221+0000","last_clean":"2023-08-22T00:42:32.667221+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:42:32.667221+0000","last_undegraded":"2023-08-22T00:42:32.667221+0000","last_fullsized":"2023-08-22T00:42:32.667221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575278,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.28699999999999998},"max":{"1min":0.69899999999999995,"5min":0.71799999999999997,"15min":0.79700000000000004},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.32800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.753,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83899999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.80300000000000005,"15min":0.879},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.42999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83199999999999996},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.48099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311592,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060248,"statfs":{"total":96636764160,"available":96317693952,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.83699999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.82299999999999995},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.81200000000000006},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.505}]},{"osd":2,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.77400000000000002,"15min":0.81599999999999995},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.501},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.79100000000000004},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.63500000000000001,"5min":0.66900000000000004,"15min":0.77300000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80400000000000005,"15min":1.234},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.80600000000000005},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575278,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59299999999999997,"15min":0.61599999999999999},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54800000000000004,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.34100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.376},{"interface":"front","average":{"1min":0.438,"5min":0.44,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.69199999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.875,"15min":0.92500000000000004},"last":0.435}]},{"osd":5,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.01},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":0.53500000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":1.004,"15min":1.014},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.95899999999999996},"last":0.496}]},{"osd":7,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.97199999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.98599999999999999},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.63800000000000001},"last":0.315},{"interface":"front","average":{"1min":0.44,"5min":0.434,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.627},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.65300000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.29899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.496},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.78600000000000003,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.47999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.64500000000000002},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.89000000000000001,"15min":1.0249999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.79800000000000004,"5min":0.89400000000000002,"15min":0.98699999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":1.0389999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575279,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307508,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064332,"statfs":{"total":96636764160,"available":96321875968,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47099999999999997,"5min":0.60499999999999998,"15min":0.64000000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.622,"15min":0.72099999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.254},"max":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.626},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54400000000000004,"5min":0.65500000000000003,"15min":0.748},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51500000000000001,"5min":0.64200000000000002,"15min":0.78400000000000003},"last":0.315}]},{"osd":4,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.436},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.434,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0069999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.93300000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":0.88,"15min":1.1120000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":0.92300000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.82199999999999995,"5min":0.87,"15min":1.0549999999999999},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.60299999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.311}]},{"osd":2,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46100000000000002},"min":{"1min":0.36799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.73099999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.378,"15min":0.378},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.95699999999999996,"15min":1.026},"last":0.64400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.034},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.79500000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64900000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.81299999999999994},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":2,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.77500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.373},"max":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81200000000000006},"last":0.75},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78200000000000003,"15min":0.79700000000000004},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.748,"5min":0.748,"15min":0.79900000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575277,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.499},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.376}]},{"osd":4,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.745},"last":0.35199999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.57499999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:42:39.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:42:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.824+0000 7f9e00f35700 1 Processor -- start 2023-08-22T00:42:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.824+0000 7f9e00f35700 1 -- start start 2023-08-22T00:42:39.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9e00f35700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9dfc1517f0 0x7f9dfc0c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9e00f35700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dfc151bd0 0x7f9dfc062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9e00f35700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0bbe50 con 0x7f9dfc0c1db0 2023-08-22T00:42:39.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9e00f35700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c30e0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9e00f35700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0bc0a0 con 0x7f9dfc1517f0 2023-08-22T00:42:39.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dfc151bd0 0x7f9dfc062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9dfc151bd0 0x7f9dfc062c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41050/0 (socket says 172.21.15.98:41050) 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 -- 172.21.15.98:0/1239320390 learned_addr learned my addr 172.21.15.98:0/1239320390 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfa59c700 1 --2- 172.21.15.98:0/1239320390 >> v2:172.21.15.118:3300/0 conn(0x7f9dfc1517f0 0x7f9dfc0c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 -- 172.21.15.98:0/1239320390 >> v2:172.21.15.118:3300/0 conn(0x7f9dfc1517f0 msgr2=0x7f9dfc0c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 --2- 172.21.15.98:0/1239320390 >> v2:172.21.15.118:3300/0 conn(0x7f9dfc1517f0 0x7f9dfc0c2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 -- 172.21.15.98:0/1239320390 >> v1:172.21.15.118:6789/0 conn(0x7f9dfc0c1db0 legacy=0x7f9dfc0bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 -- 172.21.15.98:0/1239320390 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0bc380 con 0x7f9dfc151bd0 2023-08-22T00:42:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9dfad9d700 1 --2- 172.21.15.98:0/1239320390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc062c00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f9df4009f20 tx=0x7f9df4009840).ready entity=mon.0 client_cookie=71111dabf12353f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.825+0000 7f9df959a700 1 -- 172.21.15.98:0/1239320390 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400e070 con 0x7f9dfc151bd0 2023-08-22T00:42:39.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9df959a700 1 -- 172.21.15.98:0/1239320390 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400b990 con 0x7f9dfc151bd0 2023-08-22T00:42:39.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9df959a700 1 -- 172.21.15.98:0/1239320390 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400bd10 con 0x7f9dfc151bd0 2023-08-22T00:42:39.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 -- 172.21.15.98:0/1239320390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 msgr2=0x7f9dfc062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 --2- 172.21.15.98:0/1239320390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc062c00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f9df4009f20 tx=0x7f9df4009840).stop 2023-08-22T00:42:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 -- 172.21.15.98:0/1239320390 shutdown_connections 2023-08-22T00:42:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 --2- 172.21.15.98:0/1239320390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc062c00 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 --2- 172.21.15.98:0/1239320390 >> v2:172.21.15.118:3300/0 conn(0x7f9dfc1517f0 0x7f9dfc0c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 -- 172.21.15.98:0/1239320390 >> 172.21.15.98:0/1239320390 conn(0x7f9dfc0c3990 msgr2=0x7f9dfc0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 -- 172.21.15.98:0/1239320390 shutdown_connections 2023-08-22T00:42:39.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.826+0000 7f9e00f35700 1 -- 172.21.15.98:0/1239320390 wait complete. 2023-08-22T00:42:39.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.827+0000 7f9e00f35700 1 Processor -- start 2023-08-22T00:42:39.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.827+0000 7f9e00f35700 1 -- start start 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dfc0c1db0 0x7f9dfc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc1517f0 0x7f9dfc0bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c5a90 con 0x7f9dfc151bd0 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0be3a0 con 0x7f9dfc1517f0 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9e00f35700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c54d0 con 0x7f9dfc0c1db0 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9dfad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9dfad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41062/0 (socket says 172.21.15.98:41062) 2023-08-22T00:42:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9dfad9d700 1 -- 172.21.15.98:0/2314157568 learned_addr learned my addr 172.21.15.98:0/2314157568 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9dfa59c700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dfc0c1db0 0x7f9dfc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9df9d9b700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc1517f0 0x7f9dfc0bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.828+0000 7f9dfad9d700 1 -- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dfc0c1db0 msgr2=0x7f9dfc14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dfad9d700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dfc0c1db0 0x7f9dfc14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dfad9d700 1 -- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc1517f0 msgr2=0x7f9dfc0bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dfad9d700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc1517f0 0x7f9dfc0bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dfad9d700 1 -- 172.21.15.98:0/2314157568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009ae0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dfad9d700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f9df400b610 tx=0x7f9df4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40092e0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df401d410 con 0x7f9dfc151bd0 2023-08-22T00:42:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0c57b0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df401d7b0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.829+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc14ff90 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.830+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0a9a70 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.830+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9df401dba0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.830+0000 7f9dea7fc700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 0x7f9ddc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.830+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9df407bcb0 con 0x7f9dfc151bd0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.830+0000 7f9dfa59c700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 0x7f9ddc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:39.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.831+0000 7f9dfa59c700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 0x7f9ddc0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9dfc1511b0 tx=0x7f9dec009060).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:39.839 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.835+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9df404ce40 con 0x7f9dfc151bd0 2023-08-22T00:42:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:39.992+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dfc0bdeb0 con 0x7f9ddc05ef30 2023-08-22T00:42:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.002+0000 7f9dea7fc700 1 -- 172.21.15.98:0/2314157568 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353237 (secure 0 0 0) 0x7f9dec009970 con 0x7f9ddc05ef30 2023-08-22T00:42:40.007 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 msgr2=0x7f9ddc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 0x7f9ddc0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9dfc1511b0 tx=0x7f9dec009060).stop 2023-08-22T00:42:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 msgr2=0x7f9dfc0c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f9df400b610 tx=0x7f9df4009840).stop 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 shutdown_connections 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9ddc05ef30 0x7f9ddc0613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dfc0c1db0 0x7f9dfc14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dfc151bd0 0x7f9dfc0c4af0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 --2- 172.21.15.98:0/2314157568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc1517f0 0x7f9dfc0bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 >> 172.21.15.98:0/2314157568 conn(0x7f9dfc0c3990 msgr2=0x7f9dfc065630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 shutdown_connections 2023-08-22T00:42:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.005+0000 7f9e00f35700 1 -- 172.21.15.98:0/2314157568 wait complete. 2023-08-22T00:42:40.011 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:42:40.018 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:42:38.161119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451812,"kb_used_data":17700,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752522908,"statfs":{"total":773094113280,"available":770583457792,"internally_reserved":0,"allocated":18124800,"data_stored":9652506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553192,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-211,"num_write_kb":-681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.414038"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680285+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675999+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677465+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675089+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.681183+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.682441+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679353+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675916+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680245+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679543+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678586+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674546+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680898+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674564+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677858+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.681794+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676180+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679730+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679017+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674517+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680605+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678959+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675239+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676706+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679851+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.680007+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679045+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676755+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675097+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679025+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679104+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675514+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678417+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674991+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676029+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675999+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679074+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677707+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675308+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674257+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679386+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679142+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678270+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678556+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677388+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678255+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675978+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678294+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679920+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.678654+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.675720+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679069+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674581+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677363+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674858+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674286+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674854+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561262+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:42:33.561262+0000","last_peered":"2023-08-22T00:42:33.561262+0000","last_clean":"2023-08-22T00:42:33.561262+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:42:33.561262+0000","last_undegraded":"2023-08-22T00:42:33.561262+0000","last_fullsized":"2023-08-22T00:42:33.561262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.679376+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561502+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:42:33.561502+0000","last_peered":"2023-08-22T00:42:33.561502+0000","last_clean":"2023-08-22T00:42:33.561502+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:42:33.561502+0000","last_undegraded":"2023-08-22T00:42:33.561502+0000","last_fullsized":"2023-08-22T00:42:33.561502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.676724+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.495864+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:42:33.495864+0000","last_peered":"2023-08-22T00:42:33.495864+0000","last_clean":"2023-08-22T00:42:33.495864+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:42:33.495864+0000","last_undegraded":"2023-08-22T00:42:33.495864+0000","last_fullsized":"2023-08-22T00:42:33.495864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674309+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561474+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:42:33.561474+0000","last_peered":"2023-08-22T00:42:33.561474+0000","last_clean":"2023-08-22T00:42:33.561474+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:42:33.561474+0000","last_undegraded":"2023-08-22T00:42:33.561474+0000","last_fullsized":"2023-08-22T00:42:33.561474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561503+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:42:33.561503+0000","last_peered":"2023-08-22T00:42:33.561503+0000","last_clean":"2023-08-22T00:42:33.561503+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:42:33.561503+0000","last_undegraded":"2023-08-22T00:42:33.561503+0000","last_fullsized":"2023-08-22T00:42:33.561503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.674958+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561432+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:42:33.561432+0000","last_peered":"2023-08-22T00:42:33.561432+0000","last_clean":"2023-08-22T00:42:33.561432+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:42:33.561432+0000","last_undegraded":"2023-08-22T00:42:33.561432+0000","last_fullsized":"2023-08-22T00:42:33.561432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677492+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561438+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:42:33.561438+0000","last_peered":"2023-08-22T00:42:33.561438+0000","last_clean":"2023-08-22T00:42:33.561438+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:42:33.561438+0000","last_undegraded":"2023-08-22T00:42:33.561438+0000","last_fullsized":"2023-08-22T00:42:33.561438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.682092+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:33.561239+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:42:33.561239+0000","last_peered":"2023-08-22T00:42:33.561239+0000","last_clean":"2023-08-22T00:42:33.561239+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:42:33.561239+0000","last_undegraded":"2023-08-22T00:42:33.561239+0000","last_fullsized":"2023-08-22T00:42:33.561239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:42:35.671652+0000","last_change":"2023-08-22T00:42:35.671652+0000","last_active":"2023-08-22T00:42:35.671652+0000","last_peered":"2023-08-22T00:42:35.671652+0000","last_clean":"2023-08-22T00:42:35.671652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:35.671652+0000","last_undegraded":"2023-08-22T00:42:35.671652+0000","last_fullsized":"2023-08-22T00:42:35.671652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-22T00:42:34.666777+0000","last_change":"2023-08-22T00:42:34.677753+0000","last_active":"2023-08-22T00:42:34.666777+0000","last_peered":"2023-08-22T00:42:34.666777+0000","last_clean":"2023-08-22T00:42:34.666777+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:42:34.666777+0000","last_undegraded":"2023-08-22T00:42:34.666777+0000","last_fullsized":"2023-08-22T00:42:34.666777+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-08-22T00:42:32.667221+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:42:32.667221+0000","last_peered":"2023-08-22T00:42:32.667221+0000","last_clean":"2023-08-22T00:42:32.667221+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:42:32.667221+0000","last_undegraded":"2023-08-22T00:42:32.667221+0000","last_fullsized":"2023-08-22T00:42:32.667221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575278,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.28699999999999998},"max":{"1min":0.69899999999999995,"5min":0.71799999999999997,"15min":0.79700000000000004},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.32800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.753,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83899999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.80300000000000005,"15min":0.879},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.42999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83199999999999996},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.48099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311592,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060248,"statfs":{"total":96636764160,"available":96317693952,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.83699999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.82299999999999995},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.81200000000000006},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.505}]},{"osd":2,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.77400000000000002,"15min":0.81599999999999995},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.501},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.79100000000000004},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.63500000000000001,"5min":0.66900000000000004,"15min":0.77300000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80400000000000005,"15min":1.234},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.80600000000000005},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575278,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59299999999999997,"15min":0.61599999999999999},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54800000000000004,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.34100000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.376},{"interface":"front","average":{"1min":0.438,"5min":0.44,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.69199999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.875,"15min":0.92500000000000004},"last":0.435}]},{"osd":5,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.01},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":0.53500000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":1.004,"15min":1.014},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.95899999999999996},"last":0.496}]},{"osd":7,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.97199999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.98599999999999999},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.63800000000000001},"last":0.315},{"interface":"front","average":{"1min":0.44,"5min":0.434,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.627},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.65300000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.29899999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.496},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.78600000000000003,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.47999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.64500000000000002},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.89000000000000001,"15min":1.0249999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.79800000000000004,"5min":0.89400000000000002,"15min":0.98699999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":1.0389999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575279,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307508,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064332,"statfs":{"total":96636764160,"available":96321875968,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47099999999999997,"5min":0.60499999999999998,"15min":0.64000000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.622,"15min":0.72099999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.254},"max":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.626},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54400000000000004,"5min":0.65500000000000003,"15min":0.748},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51500000000000001,"5min":0.64200000000000002,"15min":0.78400000000000003},"last":0.315}]},{"osd":4,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.436},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.434,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0069999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.93300000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":0.88,"15min":1.1120000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":0.92300000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.82199999999999995,"5min":0.87,"15min":1.0549999999999999},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2273280,"data_stored":1210672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.60299999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.311}]},{"osd":2,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46100000000000002},"min":{"1min":0.36799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.73099999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.378,"15min":0.378},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.95699999999999996,"15min":1.026},"last":0.64400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.034},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.79500000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64900000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.81299999999999994},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":2,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.77500000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.373},"max":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81200000000000006},"last":0.75},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78200000000000003,"15min":0.79700000000000004},"last":0.82299999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.748,"5min":0.748,"15min":0.79900000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575277,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307496,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064344,"statfs":{"total":96636764160,"available":96321888256,"internally_reserved":0,"allocated":2260992,"data_stored":1204098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.499},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.376}]},{"osd":4,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.745},"last":0.35199999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.57499999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:42:40.026 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:42:40.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 Processor -- start 2023-08-22T00:42:40.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 -- start start 2023-08-22T00:42:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f1650152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f165014c350 0x7f16501556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650153080 con 0x7f16500c3740 2023-08-22T00:42:40.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1650066510 con 0x7f165014c350 2023-08-22T00:42:40.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.174+0000 7f1655e6a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500667b0 con 0x7f165014bf70 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f165014c350 0x7f16501556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f165014c350 0x7f16501556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41064/0 (socket says 172.21.15.98:41064) 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 -- 172.21.15.98:0/4110071202 learned_addr learned my addr 172.21.15.98:0/4110071202 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164f7fe700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f1650152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 -- 172.21.15.98:0/4110071202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 msgr2=0x7f1650152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:40.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f1650152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 -- 172.21.15.98:0/4110071202 >> v1:172.21.15.98:6789/0 conn(0x7f16500c3740 legacy=0x7f16500aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 -- 172.21.15.98:0/4110071202 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650155ba0 con 0x7f165014c350 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164e7fc700 1 -- 172.21.15.98:0/4110071202 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684221243 0 0) 0x7f1650153080 con 0x7f16500c3740 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164effd700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f165014c350 0x7f16501556b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f1638006fd0 tx=0x7f16380090f0).ready entity=mon.0 client_cookie=42ce865c7e75775d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164e7fc700 1 -- 172.21.15.98:0/4110071202 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800b600 con 0x7f165014c350 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164e7fc700 1 -- 172.21.15.98:0/4110071202 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800b760 con 0x7f165014c350 2023-08-22T00:42:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.175+0000 7f164e7fc700 1 -- 172.21.15.98:0/4110071202 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800bae0 con 0x7f165014c350 2023-08-22T00:42:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 -- 172.21.15.98:0/4110071202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f165014c350 msgr2=0x7f16501556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f165014c350 0x7f16501556b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f1638006fd0 tx=0x7f16380090f0).stop 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 -- 172.21.15.98:0/4110071202 shutdown_connections 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f1650152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 --2- 172.21.15.98:0/4110071202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f165014c350 0x7f16501556b0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 -- 172.21.15.98:0/4110071202 >> 172.21.15.98:0/4110071202 conn(0x7f16500c5dc0 msgr2=0x7f1650068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 -- 172.21.15.98:0/4110071202 shutdown_connections 2023-08-22T00:42:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.176+0000 7f1655e6a700 1 -- 172.21.15.98:0/4110071202 wait complete. 2023-08-22T00:42:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.177+0000 7f1655e6a700 1 Processor -- start 2023-08-22T00:42:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.177+0000 7f1655e6a700 1 -- start start 2023-08-22T00:42:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f165014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f165014c350 0x7f1650164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650150170 con 0x7f16500c3740 2023-08-22T00:42:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650150450 con 0x7f165014c350 2023-08-22T00:42:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650150730 con 0x7f165014bf70 2023-08-22T00:42:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41070/0 (socket says 172.21.15.98:41070) 2023-08-22T00:42:40.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 -- 172.21.15.98:0/1737993322 learned_addr learned my addr 172.21.15.98:0/1737993322 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 -- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 msgr2=0x7f165014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f165014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 -- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f165014c350 msgr2=0x7f1650164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164ffff700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f165014c350 0x7f1650164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f165014c350 0x7f1650164770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 -- 172.21.15.98:0/1737993322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009370 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f164f7fe700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f164000c850 tx=0x7f1640008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640010580 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16400106e0 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640010a60 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.178+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650164250 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.179+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165014fe80 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.179+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650164490 con 0x7f16500c3740 2023-08-22T00:42:40.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.180+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f164001b460 con 0x7f16500c3740 2023-08-22T00:42:40.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.180+0000 7f16477fe700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 0x7f16300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.180+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f164007a0d0 con 0x7f16500c3740 2023-08-22T00:42:40.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.180+0000 7f164effd700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 0x7f16300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.181+0000 7f164effd700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 0x7f16300613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f165014b4f0 tx=0x7f1638017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.184+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1650164490 con 0x7f16500c3740 2023-08-22T00:42:40.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.344+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16501505c0 con 0x7f163005ef30 2023-08-22T00:42:40.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.354+0000 7f16477fe700 1 -- 172.21.15.98:0/1737993322 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362129 (secure 0 0 0) 0x7f16501505c0 con 0x7f163005ef30 2023-08-22T00:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:40.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 msgr2=0x7f16300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 0x7f16300613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f165014b4f0 tx=0x7f1638017000).stop 2023-08-22T00:42:40.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 msgr2=0x7f1650151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f164000c850 tx=0x7f1640008040).stop 2023-08-22T00:42:40.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 shutdown_connections 2023-08-22T00:42:40.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f163005ef30 0x7f16300613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f165014c350 0x7f1650164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16500c3740 0x7f1650151200 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 --2- 172.21.15.98:0/1737993322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f165014bf70 0x7f165014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 >> 172.21.15.98:0/1737993322 conn(0x7f16500c5dc0 msgr2=0x7f1650068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 shutdown_connections 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.358+0000 7f1655e6a700 1 -- 172.21.15.98:0/1737993322 wait complete. 2023-08-22T00:42:40.363 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:42:40.371 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:42:40.161422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2452224,"kb_used_data":18112,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752522496,"statfs":{"total":773094113280,"available":770583035904,"internally_reserved":0,"allocated":18546688,"data_stored":9862956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553192,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-211,"num_write_kb":-681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.414038"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085893+0000","last_change":"2023-08-22T00:42:36.082577+0000","last_active":"2023-08-22T00:42:36.085893+0000","last_peered":"2023-08-22T00:42:36.085893+0000","last_clean":"2023-08-22T00:42:36.085893+0000","last_became_active":"2023-08-22T00:42:36.082062+0000","last_became_peered":"2023-08-22T00:42:36.082062+0000","last_unstale":"2023-08-22T00:42:36.085893+0000","last_undegraded":"2023-08-22T00:42:36.085893+0000","last_fullsized":"2023-08-22T00:42:36.085893+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093238+0000","last_change":"2023-08-22T00:42:35.705579+0000","last_active":"2023-08-22T00:42:36.093238+0000","last_peered":"2023-08-22T00:42:36.093238+0000","last_clean":"2023-08-22T00:42:36.093238+0000","last_became_active":"2023-08-22T00:42:35.705289+0000","last_became_peered":"2023-08-22T00:42:35.705289+0000","last_unstale":"2023-08-22T00:42:36.093238+0000","last_undegraded":"2023-08-22T00:42:36.093238+0000","last_fullsized":"2023-08-22T00:42:36.093238+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085065+0000","last_change":"2023-08-22T00:42:36.082780+0000","last_active":"2023-08-22T00:42:36.085065+0000","last_peered":"2023-08-22T00:42:36.085065+0000","last_clean":"2023-08-22T00:42:36.085065+0000","last_became_active":"2023-08-22T00:42:36.082504+0000","last_became_peered":"2023-08-22T00:42:36.082504+0000","last_unstale":"2023-08-22T00:42:36.085065+0000","last_undegraded":"2023-08-22T00:42:36.085065+0000","last_fullsized":"2023-08-22T00:42:36.085065+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075903+0000","last_change":"2023-08-22T00:42:35.697663+0000","last_active":"2023-08-22T00:42:36.075903+0000","last_peered":"2023-08-22T00:42:36.075903+0000","last_clean":"2023-08-22T00:42:36.075903+0000","last_became_active":"2023-08-22T00:42:35.697372+0000","last_became_peered":"2023-08-22T00:42:35.697372+0000","last_unstale":"2023-08-22T00:42:36.075903+0000","last_undegraded":"2023-08-22T00:42:36.075903+0000","last_fullsized":"2023-08-22T00:42:36.075903+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083251+0000","last_change":"2023-08-22T00:42:36.079736+0000","last_active":"2023-08-22T00:42:36.083251+0000","last_peered":"2023-08-22T00:42:36.083251+0000","last_clean":"2023-08-22T00:42:36.083251+0000","last_became_active":"2023-08-22T00:42:36.079462+0000","last_became_peered":"2023-08-22T00:42:36.079462+0000","last_unstale":"2023-08-22T00:42:36.083251+0000","last_undegraded":"2023-08-22T00:42:36.083251+0000","last_fullsized":"2023-08-22T00:42:36.083251+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075462+0000","last_change":"2023-08-22T00:42:35.699456+0000","last_active":"2023-08-22T00:42:36.075462+0000","last_peered":"2023-08-22T00:42:36.075462+0000","last_clean":"2023-08-22T00:42:36.075462+0000","last_became_active":"2023-08-22T00:42:35.698113+0000","last_became_peered":"2023-08-22T00:42:35.698113+0000","last_unstale":"2023-08-22T00:42:36.075462+0000","last_undegraded":"2023-08-22T00:42:36.075462+0000","last_fullsized":"2023-08-22T00:42:36.075462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094154+0000","last_change":"2023-08-22T00:42:36.092961+0000","last_active":"2023-08-22T00:42:36.094154+0000","last_peered":"2023-08-22T00:42:36.094154+0000","last_clean":"2023-08-22T00:42:36.094154+0000","last_became_active":"2023-08-22T00:42:36.092700+0000","last_became_peered":"2023-08-22T00:42:36.092700+0000","last_unstale":"2023-08-22T00:42:36.094154+0000","last_undegraded":"2023-08-22T00:42:36.094154+0000","last_fullsized":"2023-08-22T00:42:36.094154+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088314+0000","last_change":"2023-08-22T00:42:35.701261+0000","last_active":"2023-08-22T00:42:36.088314+0000","last_peered":"2023-08-22T00:42:36.088314+0000","last_clean":"2023-08-22T00:42:36.088314+0000","last_became_active":"2023-08-22T00:42:35.700959+0000","last_became_peered":"2023-08-22T00:42:35.700959+0000","last_unstale":"2023-08-22T00:42:36.088314+0000","last_undegraded":"2023-08-22T00:42:36.088314+0000","last_fullsized":"2023-08-22T00:42:36.088314+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089405+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089405+0000","last_peered":"2023-08-22T00:42:36.089405+0000","last_clean":"2023-08-22T00:42:36.089405+0000","last_became_active":"2023-08-22T00:42:36.084721+0000","last_became_peered":"2023-08-22T00:42:36.084721+0000","last_unstale":"2023-08-22T00:42:36.089405+0000","last_undegraded":"2023-08-22T00:42:36.089405+0000","last_fullsized":"2023-08-22T00:42:36.089405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084085+0000","last_change":"2023-08-22T00:42:35.707988+0000","last_active":"2023-08-22T00:42:36.084085+0000","last_peered":"2023-08-22T00:42:36.084085+0000","last_clean":"2023-08-22T00:42:36.084085+0000","last_became_active":"2023-08-22T00:42:35.707664+0000","last_became_peered":"2023-08-22T00:42:35.707664+0000","last_unstale":"2023-08-22T00:42:36.084085+0000","last_undegraded":"2023-08-22T00:42:36.084085+0000","last_fullsized":"2023-08-22T00:42:36.084085+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093119+0000","last_change":"2023-08-22T00:42:36.091419+0000","last_active":"2023-08-22T00:42:36.093119+0000","last_peered":"2023-08-22T00:42:36.093119+0000","last_clean":"2023-08-22T00:42:36.093119+0000","last_became_active":"2023-08-22T00:42:36.091194+0000","last_became_peered":"2023-08-22T00:42:36.091194+0000","last_unstale":"2023-08-22T00:42:36.093119+0000","last_undegraded":"2023-08-22T00:42:36.093119+0000","last_fullsized":"2023-08-22T00:42:36.093119+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083032+0000","last_change":"2023-08-22T00:42:35.707959+0000","last_active":"2023-08-22T00:42:36.083032+0000","last_peered":"2023-08-22T00:42:36.083032+0000","last_clean":"2023-08-22T00:42:36.083032+0000","last_became_active":"2023-08-22T00:42:35.707645+0000","last_became_peered":"2023-08-22T00:42:35.707645+0000","last_unstale":"2023-08-22T00:42:36.083032+0000","last_undegraded":"2023-08-22T00:42:36.083032+0000","last_fullsized":"2023-08-22T00:42:36.083032+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093078+0000","last_change":"2023-08-22T00:42:36.091614+0000","last_active":"2023-08-22T00:42:36.093078+0000","last_peered":"2023-08-22T00:42:36.093078+0000","last_clean":"2023-08-22T00:42:36.093078+0000","last_became_active":"2023-08-22T00:42:36.091327+0000","last_became_peered":"2023-08-22T00:42:36.091327+0000","last_unstale":"2023-08-22T00:42:36.093078+0000","last_undegraded":"2023-08-22T00:42:36.093078+0000","last_fullsized":"2023-08-22T00:42:36.093078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.066427+0000","last_change":"2023-08-22T00:42:35.704629+0000","last_active":"2023-08-22T00:42:36.066427+0000","last_peered":"2023-08-22T00:42:36.066427+0000","last_clean":"2023-08-22T00:42:36.066427+0000","last_became_active":"2023-08-22T00:42:35.702144+0000","last_became_peered":"2023-08-22T00:42:35.702144+0000","last_unstale":"2023-08-22T00:42:36.066427+0000","last_undegraded":"2023-08-22T00:42:36.066427+0000","last_fullsized":"2023-08-22T00:42:36.066427+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095260+0000","last_change":"2023-08-22T00:42:36.090719+0000","last_active":"2023-08-22T00:42:36.095260+0000","last_peered":"2023-08-22T00:42:36.095260+0000","last_clean":"2023-08-22T00:42:36.095260+0000","last_became_active":"2023-08-22T00:42:36.090442+0000","last_became_peered":"2023-08-22T00:42:36.090442+0000","last_unstale":"2023-08-22T00:42:36.095260+0000","last_undegraded":"2023-08-22T00:42:36.095260+0000","last_fullsized":"2023-08-22T00:42:36.095260+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078704+0000","last_change":"2023-08-22T00:42:35.693901+0000","last_active":"2023-08-22T00:42:36.078704+0000","last_peered":"2023-08-22T00:42:36.078704+0000","last_clean":"2023-08-22T00:42:36.078704+0000","last_became_active":"2023-08-22T00:42:35.693533+0000","last_became_peered":"2023-08-22T00:42:35.693533+0000","last_unstale":"2023-08-22T00:42:36.078704+0000","last_undegraded":"2023-08-22T00:42:36.078704+0000","last_fullsized":"2023-08-22T00:42:36.078704+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084584+0000","last_change":"2023-08-22T00:42:36.078221+0000","last_active":"2023-08-22T00:42:36.084584+0000","last_peered":"2023-08-22T00:42:36.084584+0000","last_clean":"2023-08-22T00:42:36.084584+0000","last_became_active":"2023-08-22T00:42:36.077909+0000","last_became_peered":"2023-08-22T00:42:36.077909+0000","last_unstale":"2023-08-22T00:42:36.084584+0000","last_undegraded":"2023-08-22T00:42:36.084584+0000","last_fullsized":"2023-08-22T00:42:36.084584+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061876+0000","last_change":"2023-08-22T00:42:35.701212+0000","last_active":"2023-08-22T00:42:36.061876+0000","last_peered":"2023-08-22T00:42:36.061876+0000","last_clean":"2023-08-22T00:42:36.061876+0000","last_became_active":"2023-08-22T00:42:35.700553+0000","last_became_peered":"2023-08-22T00:42:35.700553+0000","last_unstale":"2023-08-22T00:42:36.061876+0000","last_undegraded":"2023-08-22T00:42:36.061876+0000","last_fullsized":"2023-08-22T00:42:36.061876+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085924+0000","last_change":"2023-08-22T00:42:36.084212+0000","last_active":"2023-08-22T00:42:36.085924+0000","last_peered":"2023-08-22T00:42:36.085924+0000","last_clean":"2023-08-22T00:42:36.085924+0000","last_became_active":"2023-08-22T00:42:36.083903+0000","last_became_peered":"2023-08-22T00:42:36.083903+0000","last_unstale":"2023-08-22T00:42:36.085924+0000","last_undegraded":"2023-08-22T00:42:36.085924+0000","last_fullsized":"2023-08-22T00:42:36.085924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.062512+0000","last_change":"2023-08-22T00:42:35.703201+0000","last_active":"2023-08-22T00:42:36.062512+0000","last_peered":"2023-08-22T00:42:36.062512+0000","last_clean":"2023-08-22T00:42:36.062512+0000","last_became_active":"2023-08-22T00:42:35.702927+0000","last_became_peered":"2023-08-22T00:42:35.702927+0000","last_unstale":"2023-08-22T00:42:36.062512+0000","last_undegraded":"2023-08-22T00:42:36.062512+0000","last_fullsized":"2023-08-22T00:42:36.062512+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:36.082169+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:36.081332+0000","last_became_peered":"2023-08-22T00:42:36.081332+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065442+0000","last_change":"2023-08-22T00:42:35.699127+0000","last_active":"2023-08-22T00:42:36.065442+0000","last_peered":"2023-08-22T00:42:36.065442+0000","last_clean":"2023-08-22T00:42:36.065442+0000","last_became_active":"2023-08-22T00:42:35.698702+0000","last_became_peered":"2023-08-22T00:42:35.698702+0000","last_unstale":"2023-08-22T00:42:36.065442+0000","last_undegraded":"2023-08-22T00:42:36.065442+0000","last_fullsized":"2023-08-22T00:42:36.065442+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093184+0000","last_change":"2023-08-22T00:42:36.092072+0000","last_active":"2023-08-22T00:42:36.093184+0000","last_peered":"2023-08-22T00:42:36.093184+0000","last_clean":"2023-08-22T00:42:36.093184+0000","last_became_active":"2023-08-22T00:42:36.091789+0000","last_became_peered":"2023-08-22T00:42:36.091789+0000","last_unstale":"2023-08-22T00:42:36.093184+0000","last_undegraded":"2023-08-22T00:42:36.093184+0000","last_fullsized":"2023-08-22T00:42:36.093184+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.34","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092770+0000","last_change":"2023-08-22T00:42:35.704055+0000","last_active":"2023-08-22T00:42:36.092770+0000","last_peered":"2023-08-22T00:42:36.092770+0000","last_clean":"2023-08-22T00:42:36.092770+0000","last_became_active":"2023-08-22T00:42:35.702958+0000","last_became_peered":"2023-08-22T00:42:35.702958+0000","last_unstale":"2023-08-22T00:42:36.092770+0000","last_undegraded":"2023-08-22T00:42:36.092770+0000","last_fullsized":"2023-08-22T00:42:36.092770+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082212+0000","last_change":"2023-08-22T00:42:36.072913+0000","last_active":"2023-08-22T00:42:36.082212+0000","last_peered":"2023-08-22T00:42:36.082212+0000","last_clean":"2023-08-22T00:42:36.082212+0000","last_became_active":"2023-08-22T00:42:36.072655+0000","last_became_peered":"2023-08-22T00:42:36.072655+0000","last_unstale":"2023-08-22T00:42:36.082212+0000","last_undegraded":"2023-08-22T00:42:36.082212+0000","last_fullsized":"2023-08-22T00:42:36.082212+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.33","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080392+0000","last_change":"2023-08-22T00:42:35.692030+0000","last_active":"2023-08-22T00:42:36.080392+0000","last_peered":"2023-08-22T00:42:36.080392+0000","last_clean":"2023-08-22T00:42:36.080392+0000","last_became_active":"2023-08-22T00:42:35.691766+0000","last_became_peered":"2023-08-22T00:42:35.691766+0000","last_unstale":"2023-08-22T00:42:36.080392+0000","last_undegraded":"2023-08-22T00:42:36.080392+0000","last_fullsized":"2023-08-22T00:42:36.080392+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083938+0000","last_change":"2023-08-22T00:42:36.081908+0000","last_active":"2023-08-22T00:42:36.083938+0000","last_peered":"2023-08-22T00:42:36.083938+0000","last_clean":"2023-08-22T00:42:36.083938+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.083938+0000","last_undegraded":"2023-08-22T00:42:36.083938+0000","last_fullsized":"2023-08-22T00:42:36.083938+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073379+0000","last_change":"2023-08-22T00:42:35.703347+0000","last_active":"2023-08-22T00:42:36.073379+0000","last_peered":"2023-08-22T00:42:36.073379+0000","last_clean":"2023-08-22T00:42:36.073379+0000","last_became_active":"2023-08-22T00:42:35.703000+0000","last_became_peered":"2023-08-22T00:42:35.703000+0000","last_unstale":"2023-08-22T00:42:36.073379+0000","last_undegraded":"2023-08-22T00:42:36.073379+0000","last_fullsized":"2023-08-22T00:42:36.073379+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088953+0000","last_change":"2023-08-22T00:42:36.083796+0000","last_active":"2023-08-22T00:42:36.088953+0000","last_peered":"2023-08-22T00:42:36.088953+0000","last_clean":"2023-08-22T00:42:36.088953+0000","last_became_active":"2023-08-22T00:42:36.083529+0000","last_became_peered":"2023-08-22T00:42:36.083529+0000","last_unstale":"2023-08-22T00:42:36.088953+0000","last_undegraded":"2023-08-22T00:42:36.088953+0000","last_fullsized":"2023-08-22T00:42:36.088953+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075331+0000","last_change":"2023-08-22T00:42:35.698174+0000","last_active":"2023-08-22T00:42:36.075331+0000","last_peered":"2023-08-22T00:42:36.075331+0000","last_clean":"2023-08-22T00:42:36.075331+0000","last_became_active":"2023-08-22T00:42:35.697278+0000","last_became_peered":"2023-08-22T00:42:35.697278+0000","last_unstale":"2023-08-22T00:42:36.075331+0000","last_undegraded":"2023-08-22T00:42:36.075331+0000","last_fullsized":"2023-08-22T00:42:36.075331+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085074+0000","last_change":"2023-08-22T00:42:36.081658+0000","last_active":"2023-08-22T00:42:36.085074+0000","last_peered":"2023-08-22T00:42:36.085074+0000","last_clean":"2023-08-22T00:42:36.085074+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.085074+0000","last_undegraded":"2023-08-22T00:42:36.085074+0000","last_fullsized":"2023-08-22T00:42:36.085074+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089151+0000","last_change":"2023-08-22T00:42:35.694698+0000","last_active":"2023-08-22T00:42:36.089151+0000","last_peered":"2023-08-22T00:42:36.089151+0000","last_clean":"2023-08-22T00:42:36.089151+0000","last_became_active":"2023-08-22T00:42:35.694410+0000","last_became_peered":"2023-08-22T00:42:35.694410+0000","last_unstale":"2023-08-22T00:42:36.089151+0000","last_undegraded":"2023-08-22T00:42:36.089151+0000","last_fullsized":"2023-08-22T00:42:36.089151+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089792+0000","last_change":"2023-08-22T00:42:36.087220+0000","last_active":"2023-08-22T00:42:36.089792+0000","last_peered":"2023-08-22T00:42:36.089792+0000","last_clean":"2023-08-22T00:42:36.089792+0000","last_became_active":"2023-08-22T00:42:36.086988+0000","last_became_peered":"2023-08-22T00:42:36.086988+0000","last_unstale":"2023-08-22T00:42:36.089792+0000","last_undegraded":"2023-08-22T00:42:36.089792+0000","last_fullsized":"2023-08-22T00:42:36.089792+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077513+0000","last_change":"2023-08-22T00:42:35.695029+0000","last_active":"2023-08-22T00:42:36.077513+0000","last_peered":"2023-08-22T00:42:36.077513+0000","last_clean":"2023-08-22T00:42:36.077513+0000","last_became_active":"2023-08-22T00:42:35.694732+0000","last_became_peered":"2023-08-22T00:42:35.694732+0000","last_unstale":"2023-08-22T00:42:36.077513+0000","last_undegraded":"2023-08-22T00:42:36.077513+0000","last_fullsized":"2023-08-22T00:42:36.077513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089382+0000","last_change":"2023-08-22T00:42:36.085368+0000","last_active":"2023-08-22T00:42:36.089382+0000","last_peered":"2023-08-22T00:42:36.089382+0000","last_clean":"2023-08-22T00:42:36.089382+0000","last_became_active":"2023-08-22T00:42:36.084691+0000","last_became_peered":"2023-08-22T00:42:36.084691+0000","last_unstale":"2023-08-22T00:42:36.089382+0000","last_undegraded":"2023-08-22T00:42:36.089382+0000","last_fullsized":"2023-08-22T00:42:36.089382+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067122+0000","last_change":"2023-08-22T00:42:35.708165+0000","last_active":"2023-08-22T00:42:36.067122+0000","last_peered":"2023-08-22T00:42:36.067122+0000","last_clean":"2023-08-22T00:42:36.067122+0000","last_became_active":"2023-08-22T00:42:35.707717+0000","last_became_peered":"2023-08-22T00:42:35.707717+0000","last_unstale":"2023-08-22T00:42:36.067122+0000","last_undegraded":"2023-08-22T00:42:36.067122+0000","last_fullsized":"2023-08-22T00:42:36.067122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082237+0000","last_change":"2023-08-22T00:42:36.073104+0000","last_active":"2023-08-22T00:42:36.082237+0000","last_peered":"2023-08-22T00:42:36.082237+0000","last_clean":"2023-08-22T00:42:36.082237+0000","last_became_active":"2023-08-22T00:42:36.072850+0000","last_became_peered":"2023-08-22T00:42:36.072850+0000","last_unstale":"2023-08-22T00:42:36.082237+0000","last_undegraded":"2023-08-22T00:42:36.082237+0000","last_fullsized":"2023-08-22T00:42:36.082237+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091024+0000","last_change":"2023-08-22T00:42:35.697336+0000","last_active":"2023-08-22T00:42:36.091024+0000","last_peered":"2023-08-22T00:42:36.091024+0000","last_clean":"2023-08-22T00:42:36.091024+0000","last_became_active":"2023-08-22T00:42:35.696771+0000","last_became_peered":"2023-08-22T00:42:35.696771+0000","last_unstale":"2023-08-22T00:42:36.091024+0000","last_undegraded":"2023-08-22T00:42:36.091024+0000","last_fullsized":"2023-08-22T00:42:36.091024+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095025+0000","last_change":"2023-08-22T00:42:36.091242+0000","last_active":"2023-08-22T00:42:36.095025+0000","last_peered":"2023-08-22T00:42:36.095025+0000","last_clean":"2023-08-22T00:42:36.095025+0000","last_became_active":"2023-08-22T00:42:36.090867+0000","last_became_peered":"2023-08-22T00:42:36.090867+0000","last_unstale":"2023-08-22T00:42:36.095025+0000","last_undegraded":"2023-08-22T00:42:36.095025+0000","last_fullsized":"2023-08-22T00:42:36.095025+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068842+0000","last_change":"2023-08-22T00:42:35.698537+0000","last_active":"2023-08-22T00:42:36.068842+0000","last_peered":"2023-08-22T00:42:36.068842+0000","last_clean":"2023-08-22T00:42:36.068842+0000","last_became_active":"2023-08-22T00:42:35.698261+0000","last_became_peered":"2023-08-22T00:42:35.698261+0000","last_unstale":"2023-08-22T00:42:36.068842+0000","last_undegraded":"2023-08-22T00:42:36.068842+0000","last_fullsized":"2023-08-22T00:42:36.068842+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084714+0000","last_change":"2023-08-22T00:42:36.078204+0000","last_active":"2023-08-22T00:42:36.084714+0000","last_peered":"2023-08-22T00:42:36.084714+0000","last_clean":"2023-08-22T00:42:36.084714+0000","last_became_active":"2023-08-22T00:42:36.077938+0000","last_became_peered":"2023-08-22T00:42:36.077938+0000","last_unstale":"2023-08-22T00:42:36.084714+0000","last_undegraded":"2023-08-22T00:42:36.084714+0000","last_fullsized":"2023-08-22T00:42:36.084714+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086257+0000","last_change":"2023-08-22T00:42:35.700351+0000","last_active":"2023-08-22T00:42:36.086257+0000","last_peered":"2023-08-22T00:42:36.086257+0000","last_clean":"2023-08-22T00:42:36.086257+0000","last_became_active":"2023-08-22T00:42:35.699937+0000","last_became_peered":"2023-08-22T00:42:35.699937+0000","last_unstale":"2023-08-22T00:42:36.086257+0000","last_undegraded":"2023-08-22T00:42:36.086257+0000","last_fullsized":"2023-08-22T00:42:36.086257+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089331+0000","last_change":"2023-08-22T00:42:36.084919+0000","last_active":"2023-08-22T00:42:36.089331+0000","last_peered":"2023-08-22T00:42:36.089331+0000","last_clean":"2023-08-22T00:42:36.089331+0000","last_became_active":"2023-08-22T00:42:36.084626+0000","last_became_peered":"2023-08-22T00:42:36.084626+0000","last_unstale":"2023-08-22T00:42:36.089331+0000","last_undegraded":"2023-08-22T00:42:36.089331+0000","last_fullsized":"2023-08-22T00:42:36.089331+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.697644+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.696923+0000","last_became_peered":"2023-08-22T00:42:35.696923+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084871+0000","last_change":"2023-08-22T00:42:36.079869+0000","last_active":"2023-08-22T00:42:36.084871+0000","last_peered":"2023-08-22T00:42:36.084871+0000","last_clean":"2023-08-22T00:42:36.084871+0000","last_became_active":"2023-08-22T00:42:36.079596+0000","last_became_peered":"2023-08-22T00:42:36.079596+0000","last_unstale":"2023-08-22T00:42:36.084871+0000","last_undegraded":"2023-08-22T00:42:36.084871+0000","last_fullsized":"2023-08-22T00:42:36.084871+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078456+0000","last_change":"2023-08-22T00:42:35.693985+0000","last_active":"2023-08-22T00:42:36.078456+0000","last_peered":"2023-08-22T00:42:36.078456+0000","last_clean":"2023-08-22T00:42:36.078456+0000","last_became_active":"2023-08-22T00:42:35.693441+0000","last_became_peered":"2023-08-22T00:42:35.693441+0000","last_unstale":"2023-08-22T00:42:36.078456+0000","last_undegraded":"2023-08-22T00:42:36.078456+0000","last_fullsized":"2023-08-22T00:42:36.078456+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089396+0000","last_change":"2023-08-22T00:42:36.086123+0000","last_active":"2023-08-22T00:42:36.089396+0000","last_peered":"2023-08-22T00:42:36.089396+0000","last_clean":"2023-08-22T00:42:36.089396+0000","last_became_active":"2023-08-22T00:42:36.085879+0000","last_became_peered":"2023-08-22T00:42:36.085879+0000","last_unstale":"2023-08-22T00:42:36.089396+0000","last_undegraded":"2023-08-22T00:42:36.089396+0000","last_fullsized":"2023-08-22T00:42:36.089396+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065509+0000","last_change":"2023-08-22T00:42:35.696870+0000","last_active":"2023-08-22T00:42:36.065509+0000","last_peered":"2023-08-22T00:42:36.065509+0000","last_clean":"2023-08-22T00:42:36.065509+0000","last_became_active":"2023-08-22T00:42:35.696586+0000","last_became_peered":"2023-08-22T00:42:35.696586+0000","last_unstale":"2023-08-22T00:42:36.065509+0000","last_undegraded":"2023-08-22T00:42:36.065509+0000","last_fullsized":"2023-08-22T00:42:36.065509+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082403+0000","last_change":"2023-08-22T00:42:36.079739+0000","last_active":"2023-08-22T00:42:36.082403+0000","last_peered":"2023-08-22T00:42:36.082403+0000","last_clean":"2023-08-22T00:42:36.082403+0000","last_became_active":"2023-08-22T00:42:36.079533+0000","last_became_peered":"2023-08-22T00:42:36.079533+0000","last_unstale":"2023-08-22T00:42:36.082403+0000","last_undegraded":"2023-08-22T00:42:36.082403+0000","last_fullsized":"2023-08-22T00:42:36.082403+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065547+0000","last_change":"2023-08-22T00:42:35.703851+0000","last_active":"2023-08-22T00:42:36.065547+0000","last_peered":"2023-08-22T00:42:36.065547+0000","last_clean":"2023-08-22T00:42:36.065547+0000","last_became_active":"2023-08-22T00:42:35.703351+0000","last_became_peered":"2023-08-22T00:42:35.703351+0000","last_unstale":"2023-08-22T00:42:36.065547+0000","last_undegraded":"2023-08-22T00:42:36.065547+0000","last_fullsized":"2023-08-22T00:42:36.065547+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094006+0000","last_change":"2023-08-22T00:42:36.093092+0000","last_active":"2023-08-22T00:42:36.094006+0000","last_peered":"2023-08-22T00:42:36.094006+0000","last_clean":"2023-08-22T00:42:36.094006+0000","last_became_active":"2023-08-22T00:42:36.092838+0000","last_became_peered":"2023-08-22T00:42:36.092838+0000","last_unstale":"2023-08-22T00:42:36.094006+0000","last_undegraded":"2023-08-22T00:42:36.094006+0000","last_fullsized":"2023-08-22T00:42:36.094006+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.585513+0000","last_change":"2023-08-22T00:42:35.707578+0000","last_active":"2023-08-22T00:42:36.585513+0000","last_peered":"2023-08-22T00:42:36.585513+0000","last_clean":"2023-08-22T00:42:36.585513+0000","last_became_active":"2023-08-22T00:42:35.707312+0000","last_became_peered":"2023-08-22T00:42:35.707312+0000","last_unstale":"2023-08-22T00:42:36.585513+0000","last_undegraded":"2023-08-22T00:42:36.585513+0000","last_fullsized":"2023-08-22T00:42:36.585513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092444+0000","last_change":"2023-08-22T00:42:36.091325+0000","last_active":"2023-08-22T00:42:36.092444+0000","last_peered":"2023-08-22T00:42:36.092444+0000","last_clean":"2023-08-22T00:42:36.092444+0000","last_became_active":"2023-08-22T00:42:36.091084+0000","last_became_peered":"2023-08-22T00:42:36.091084+0000","last_unstale":"2023-08-22T00:42:36.092444+0000","last_undegraded":"2023-08-22T00:42:36.092444+0000","last_fullsized":"2023-08-22T00:42:36.092444+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061715+0000","last_change":"2023-08-22T00:42:35.700601+0000","last_active":"2023-08-22T00:42:36.061715+0000","last_peered":"2023-08-22T00:42:36.061715+0000","last_clean":"2023-08-22T00:42:36.061715+0000","last_became_active":"2023-08-22T00:42:35.699913+0000","last_became_peered":"2023-08-22T00:42:35.699913+0000","last_unstale":"2023-08-22T00:42:36.061715+0000","last_undegraded":"2023-08-22T00:42:36.061715+0000","last_fullsized":"2023-08-22T00:42:36.061715+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081847+0000","last_change":"2023-08-22T00:42:36.071045+0000","last_active":"2023-08-22T00:42:36.081847+0000","last_peered":"2023-08-22T00:42:36.081847+0000","last_clean":"2023-08-22T00:42:36.081847+0000","last_became_active":"2023-08-22T00:42:36.070755+0000","last_became_peered":"2023-08-22T00:42:36.070755+0000","last_unstale":"2023-08-22T00:42:36.081847+0000","last_undegraded":"2023-08-22T00:42:36.081847+0000","last_fullsized":"2023-08-22T00:42:36.081847+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065363+0000","last_change":"2023-08-22T00:42:35.693184+0000","last_active":"2023-08-22T00:42:36.065363+0000","last_peered":"2023-08-22T00:42:36.065363+0000","last_clean":"2023-08-22T00:42:36.065363+0000","last_became_active":"2023-08-22T00:42:35.692904+0000","last_became_peered":"2023-08-22T00:42:35.692904+0000","last_unstale":"2023-08-22T00:42:36.065363+0000","last_undegraded":"2023-08-22T00:42:36.065363+0000","last_fullsized":"2023-08-22T00:42:36.065363+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090607+0000","last_change":"2023-08-22T00:42:36.089844+0000","last_active":"2023-08-22T00:42:36.090607+0000","last_peered":"2023-08-22T00:42:36.090607+0000","last_clean":"2023-08-22T00:42:36.090607+0000","last_became_active":"2023-08-22T00:42:36.089541+0000","last_became_peered":"2023-08-22T00:42:36.089541+0000","last_unstale":"2023-08-22T00:42:36.090607+0000","last_undegraded":"2023-08-22T00:42:36.090607+0000","last_fullsized":"2023-08-22T00:42:36.090607+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078362+0000","last_change":"2023-08-22T00:42:35.702784+0000","last_active":"2023-08-22T00:42:36.078362+0000","last_peered":"2023-08-22T00:42:36.078362+0000","last_clean":"2023-08-22T00:42:36.078362+0000","last_became_active":"2023-08-22T00:42:35.702330+0000","last_became_peered":"2023-08-22T00:42:35.702330+0000","last_unstale":"2023-08-22T00:42:36.078362+0000","last_undegraded":"2023-08-22T00:42:36.078362+0000","last_fullsized":"2023-08-22T00:42:36.078362+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082483+0000","last_change":"2023-08-22T00:42:36.074647+0000","last_active":"2023-08-22T00:42:36.082483+0000","last_peered":"2023-08-22T00:42:36.082483+0000","last_clean":"2023-08-22T00:42:36.082483+0000","last_became_active":"2023-08-22T00:42:36.074358+0000","last_became_peered":"2023-08-22T00:42:36.074358+0000","last_unstale":"2023-08-22T00:42:36.082483+0000","last_undegraded":"2023-08-22T00:42:36.082483+0000","last_fullsized":"2023-08-22T00:42:36.082483+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065098+0000","last_change":"2023-08-22T00:42:35.692314+0000","last_active":"2023-08-22T00:42:36.065098+0000","last_peered":"2023-08-22T00:42:36.065098+0000","last_clean":"2023-08-22T00:42:36.065098+0000","last_became_active":"2023-08-22T00:42:35.692025+0000","last_became_peered":"2023-08-22T00:42:35.692025+0000","last_unstale":"2023-08-22T00:42:36.065098+0000","last_undegraded":"2023-08-22T00:42:36.065098+0000","last_fullsized":"2023-08-22T00:42:36.065098+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076235+0000","last_change":"2023-08-22T00:42:36.069799+0000","last_active":"2023-08-22T00:42:36.076235+0000","last_peered":"2023-08-22T00:42:36.076235+0000","last_clean":"2023-08-22T00:42:36.076235+0000","last_became_active":"2023-08-22T00:42:36.069542+0000","last_became_peered":"2023-08-22T00:42:36.069542+0000","last_unstale":"2023-08-22T00:42:36.076235+0000","last_undegraded":"2023-08-22T00:42:36.076235+0000","last_fullsized":"2023-08-22T00:42:36.076235+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.060768+0000","last_change":"2023-08-22T00:42:35.692998+0000","last_active":"2023-08-22T00:42:36.060768+0000","last_peered":"2023-08-22T00:42:36.060768+0000","last_clean":"2023-08-22T00:42:36.060768+0000","last_became_active":"2023-08-22T00:42:35.692737+0000","last_became_peered":"2023-08-22T00:42:35.692737+0000","last_unstale":"2023-08-22T00:42:36.060768+0000","last_undegraded":"2023-08-22T00:42:36.060768+0000","last_fullsized":"2023-08-22T00:42:36.060768+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091739+0000","last_change":"2023-08-22T00:42:36.091030+0000","last_active":"2023-08-22T00:42:36.091739+0000","last_peered":"2023-08-22T00:42:36.091739+0000","last_clean":"2023-08-22T00:42:36.091739+0000","last_became_active":"2023-08-22T00:42:36.090750+0000","last_became_peered":"2023-08-22T00:42:36.090750+0000","last_unstale":"2023-08-22T00:42:36.091739+0000","last_undegraded":"2023-08-22T00:42:36.091739+0000","last_fullsized":"2023-08-22T00:42:36.091739+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078352+0000","last_change":"2023-08-22T00:42:35.694202+0000","last_active":"2023-08-22T00:42:36.078352+0000","last_peered":"2023-08-22T00:42:36.078352+0000","last_clean":"2023-08-22T00:42:36.078352+0000","last_became_active":"2023-08-22T00:42:35.693927+0000","last_became_peered":"2023-08-22T00:42:35.693927+0000","last_unstale":"2023-08-22T00:42:36.078352+0000","last_undegraded":"2023-08-22T00:42:36.078352+0000","last_fullsized":"2023-08-22T00:42:36.078352+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082420+0000","last_change":"2023-08-22T00:42:36.080889+0000","last_active":"2023-08-22T00:42:36.082420+0000","last_peered":"2023-08-22T00:42:36.082420+0000","last_clean":"2023-08-22T00:42:36.082420+0000","last_became_active":"2023-08-22T00:42:36.080670+0000","last_became_peered":"2023-08-22T00:42:36.080670+0000","last_unstale":"2023-08-22T00:42:36.082420+0000","last_undegraded":"2023-08-22T00:42:36.082420+0000","last_fullsized":"2023-08-22T00:42:36.082420+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083383+0000","last_change":"2023-08-22T00:42:35.706207+0000","last_active":"2023-08-22T00:42:36.083383+0000","last_peered":"2023-08-22T00:42:36.083383+0000","last_clean":"2023-08-22T00:42:36.083383+0000","last_became_active":"2023-08-22T00:42:35.705967+0000","last_became_peered":"2023-08-22T00:42:35.705967+0000","last_unstale":"2023-08-22T00:42:36.083383+0000","last_undegraded":"2023-08-22T00:42:36.083383+0000","last_fullsized":"2023-08-22T00:42:36.083383+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091687+0000","last_change":"2023-08-22T00:42:36.090343+0000","last_active":"2023-08-22T00:42:36.091687+0000","last_peered":"2023-08-22T00:42:36.091687+0000","last_clean":"2023-08-22T00:42:36.091687+0000","last_became_active":"2023-08-22T00:42:36.090065+0000","last_became_peered":"2023-08-22T00:42:36.090065+0000","last_unstale":"2023-08-22T00:42:36.091687+0000","last_undegraded":"2023-08-22T00:42:36.091687+0000","last_fullsized":"2023-08-22T00:42:36.091687+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089588+0000","last_change":"2023-08-22T00:42:35.694428+0000","last_active":"2023-08-22T00:42:36.089588+0000","last_peered":"2023-08-22T00:42:36.089588+0000","last_clean":"2023-08-22T00:42:36.089588+0000","last_became_active":"2023-08-22T00:42:35.694058+0000","last_became_peered":"2023-08-22T00:42:35.694058+0000","last_unstale":"2023-08-22T00:42:36.089588+0000","last_undegraded":"2023-08-22T00:42:36.089588+0000","last_fullsized":"2023-08-22T00:42:36.089588+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089328+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089328+0000","last_peered":"2023-08-22T00:42:36.089328+0000","last_clean":"2023-08-22T00:42:36.089328+0000","last_became_active":"2023-08-22T00:42:36.084713+0000","last_became_peered":"2023-08-22T00:42:36.084713+0000","last_unstale":"2023-08-22T00:42:36.089328+0000","last_undegraded":"2023-08-22T00:42:36.089328+0000","last_fullsized":"2023-08-22T00:42:36.089328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085648+0000","last_change":"2023-08-22T00:42:35.693957+0000","last_active":"2023-08-22T00:42:36.085648+0000","last_peered":"2023-08-22T00:42:36.085648+0000","last_clean":"2023-08-22T00:42:36.085648+0000","last_became_active":"2023-08-22T00:42:35.693519+0000","last_became_peered":"2023-08-22T00:42:35.693519+0000","last_unstale":"2023-08-22T00:42:36.085648+0000","last_undegraded":"2023-08-22T00:42:36.085648+0000","last_fullsized":"2023-08-22T00:42:36.085648+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087699+0000","last_change":"2023-08-22T00:42:36.087113+0000","last_active":"2023-08-22T00:42:36.087699+0000","last_peered":"2023-08-22T00:42:36.087699+0000","last_clean":"2023-08-22T00:42:36.087699+0000","last_became_active":"2023-08-22T00:42:36.086845+0000","last_became_peered":"2023-08-22T00:42:36.086845+0000","last_unstale":"2023-08-22T00:42:36.087699+0000","last_undegraded":"2023-08-22T00:42:36.087699+0000","last_fullsized":"2023-08-22T00:42:36.087699+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075543+0000","last_change":"2023-08-22T00:42:35.698989+0000","last_active":"2023-08-22T00:42:36.075543+0000","last_peered":"2023-08-22T00:42:36.075543+0000","last_clean":"2023-08-22T00:42:36.075543+0000","last_became_active":"2023-08-22T00:42:35.698572+0000","last_became_peered":"2023-08-22T00:42:35.698572+0000","last_unstale":"2023-08-22T00:42:36.075543+0000","last_undegraded":"2023-08-22T00:42:36.075543+0000","last_fullsized":"2023-08-22T00:42:36.075543+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082405+0000","last_change":"2023-08-22T00:42:36.077109+0000","last_active":"2023-08-22T00:42:36.082405+0000","last_peered":"2023-08-22T00:42:36.082405+0000","last_clean":"2023-08-22T00:42:36.082405+0000","last_became_active":"2023-08-22T00:42:36.076846+0000","last_became_peered":"2023-08-22T00:42:36.076846+0000","last_unstale":"2023-08-22T00:42:36.082405+0000","last_undegraded":"2023-08-22T00:42:36.082405+0000","last_fullsized":"2023-08-22T00:42:36.082405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.703193+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.702916+0000","last_became_peered":"2023-08-22T00:42:35.702916+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081698+0000","last_change":"2023-08-22T00:42:36.077408+0000","last_active":"2023-08-22T00:42:36.081698+0000","last_peered":"2023-08-22T00:42:36.081698+0000","last_clean":"2023-08-22T00:42:36.081698+0000","last_became_active":"2023-08-22T00:42:36.077181+0000","last_became_peered":"2023-08-22T00:42:36.077181+0000","last_unstale":"2023-08-22T00:42:36.081698+0000","last_undegraded":"2023-08-22T00:42:36.081698+0000","last_fullsized":"2023-08-22T00:42:36.081698+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075565+0000","last_change":"2023-08-22T00:42:35.694331+0000","last_active":"2023-08-22T00:42:36.075565+0000","last_peered":"2023-08-22T00:42:36.075565+0000","last_clean":"2023-08-22T00:42:36.075565+0000","last_became_active":"2023-08-22T00:42:35.693957+0000","last_became_peered":"2023-08-22T00:42:35.693957+0000","last_unstale":"2023-08-22T00:42:36.075565+0000","last_undegraded":"2023-08-22T00:42:36.075565+0000","last_fullsized":"2023-08-22T00:42:36.075565+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080328+0000","last_change":"2023-08-22T00:42:36.074405+0000","last_active":"2023-08-22T00:42:36.080328+0000","last_peered":"2023-08-22T00:42:36.080328+0000","last_clean":"2023-08-22T00:42:36.080328+0000","last_became_active":"2023-08-22T00:42:36.074139+0000","last_became_peered":"2023-08-22T00:42:36.074139+0000","last_unstale":"2023-08-22T00:42:36.080328+0000","last_undegraded":"2023-08-22T00:42:36.080328+0000","last_fullsized":"2023-08-22T00:42:36.080328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076266+0000","last_change":"2023-08-22T00:42:35.696055+0000","last_active":"2023-08-22T00:42:36.076266+0000","last_peered":"2023-08-22T00:42:36.076266+0000","last_clean":"2023-08-22T00:42:36.076266+0000","last_became_active":"2023-08-22T00:42:35.695791+0000","last_became_peered":"2023-08-22T00:42:35.695791+0000","last_unstale":"2023-08-22T00:42:36.076266+0000","last_undegraded":"2023-08-22T00:42:36.076266+0000","last_fullsized":"2023-08-22T00:42:36.076266+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086658+0000","last_change":"2023-08-22T00:42:36.070358+0000","last_active":"2023-08-22T00:42:36.086658+0000","last_peered":"2023-08-22T00:42:36.086658+0000","last_clean":"2023-08-22T00:42:36.086658+0000","last_became_active":"2023-08-22T00:42:36.070096+0000","last_became_peered":"2023-08-22T00:42:36.070096+0000","last_unstale":"2023-08-22T00:42:36.086658+0000","last_undegraded":"2023-08-22T00:42:36.086658+0000","last_fullsized":"2023-08-22T00:42:36.086658+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068690+0000","last_change":"2023-08-22T00:42:35.694037+0000","last_active":"2023-08-22T00:42:36.068690+0000","last_peered":"2023-08-22T00:42:36.068690+0000","last_clean":"2023-08-22T00:42:36.068690+0000","last_became_active":"2023-08-22T00:42:35.693656+0000","last_became_peered":"2023-08-22T00:42:35.693656+0000","last_unstale":"2023-08-22T00:42:36.068690+0000","last_undegraded":"2023-08-22T00:42:36.068690+0000","last_fullsized":"2023-08-22T00:42:36.068690+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089457+0000","last_change":"2023-08-22T00:42:36.087233+0000","last_active":"2023-08-22T00:42:36.089457+0000","last_peered":"2023-08-22T00:42:36.089457+0000","last_clean":"2023-08-22T00:42:36.089457+0000","last_became_active":"2023-08-22T00:42:36.086969+0000","last_became_peered":"2023-08-22T00:42:36.086969+0000","last_unstale":"2023-08-22T00:42:36.089457+0000","last_undegraded":"2023-08-22T00:42:36.089457+0000","last_fullsized":"2023-08-22T00:42:36.089457+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085670+0000","last_change":"2023-08-22T00:42:35.703653+0000","last_active":"2023-08-22T00:42:36.085670+0000","last_peered":"2023-08-22T00:42:36.085670+0000","last_clean":"2023-08-22T00:42:36.085670+0000","last_became_active":"2023-08-22T00:42:35.703058+0000","last_became_peered":"2023-08-22T00:42:35.703058+0000","last_unstale":"2023-08-22T00:42:36.085670+0000","last_undegraded":"2023-08-22T00:42:36.085670+0000","last_fullsized":"2023-08-22T00:42:36.085670+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095258+0000","last_change":"2023-08-22T00:42:36.090905+0000","last_active":"2023-08-22T00:42:36.095258+0000","last_peered":"2023-08-22T00:42:36.095258+0000","last_clean":"2023-08-22T00:42:36.095258+0000","last_became_active":"2023-08-22T00:42:36.090604+0000","last_became_peered":"2023-08-22T00:42:36.090604+0000","last_unstale":"2023-08-22T00:42:36.095258+0000","last_undegraded":"2023-08-22T00:42:36.095258+0000","last_fullsized":"2023-08-22T00:42:36.095258+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082438+0000","last_change":"2023-08-22T00:42:35.707915+0000","last_active":"2023-08-22T00:42:36.082438+0000","last_peered":"2023-08-22T00:42:36.082438+0000","last_clean":"2023-08-22T00:42:36.082438+0000","last_became_active":"2023-08-22T00:42:35.707622+0000","last_became_peered":"2023-08-22T00:42:35.707622+0000","last_unstale":"2023-08-22T00:42:36.082438+0000","last_undegraded":"2023-08-22T00:42:36.082438+0000","last_fullsized":"2023-08-22T00:42:36.082438+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083264+0000","last_change":"2023-08-22T00:42:36.081027+0000","last_active":"2023-08-22T00:42:36.083264+0000","last_peered":"2023-08-22T00:42:36.083264+0000","last_clean":"2023-08-22T00:42:36.083264+0000","last_became_active":"2023-08-22T00:42:36.080704+0000","last_became_peered":"2023-08-22T00:42:36.080704+0000","last_unstale":"2023-08-22T00:42:36.083264+0000","last_undegraded":"2023-08-22T00:42:36.083264+0000","last_fullsized":"2023-08-22T00:42:36.083264+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069133+0000","last_change":"2023-08-22T00:42:35.697534+0000","last_active":"2023-08-22T00:42:36.069133+0000","last_peered":"2023-08-22T00:42:36.069133+0000","last_clean":"2023-08-22T00:42:36.069133+0000","last_became_active":"2023-08-22T00:42:35.697068+0000","last_became_peered":"2023-08-22T00:42:35.697068+0000","last_unstale":"2023-08-22T00:42:36.069133+0000","last_undegraded":"2023-08-22T00:42:36.069133+0000","last_fullsized":"2023-08-22T00:42:36.069133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095317+0000","last_change":"2023-08-22T00:42:36.090976+0000","last_active":"2023-08-22T00:42:36.095317+0000","last_peered":"2023-08-22T00:42:36.095317+0000","last_clean":"2023-08-22T00:42:36.095317+0000","last_became_active":"2023-08-22T00:42:36.090706+0000","last_became_peered":"2023-08-22T00:42:36.090706+0000","last_unstale":"2023-08-22T00:42:36.095317+0000","last_undegraded":"2023-08-22T00:42:36.095317+0000","last_fullsized":"2023-08-22T00:42:36.095317+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068926+0000","last_change":"2023-08-22T00:42:35.703709+0000","last_active":"2023-08-22T00:42:36.068926+0000","last_peered":"2023-08-22T00:42:36.068926+0000","last_clean":"2023-08-22T00:42:36.068926+0000","last_became_active":"2023-08-22T00:42:35.703366+0000","last_became_peered":"2023-08-22T00:42:35.703366+0000","last_unstale":"2023-08-22T00:42:36.068926+0000","last_undegraded":"2023-08-22T00:42:36.068926+0000","last_fullsized":"2023-08-22T00:42:36.068926+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082189+0000","last_change":"2023-08-22T00:42:36.072341+0000","last_active":"2023-08-22T00:42:36.082189+0000","last_peered":"2023-08-22T00:42:36.082189+0000","last_clean":"2023-08-22T00:42:36.082189+0000","last_became_active":"2023-08-22T00:42:36.072023+0000","last_became_peered":"2023-08-22T00:42:36.072023+0000","last_unstale":"2023-08-22T00:42:36.082189+0000","last_undegraded":"2023-08-22T00:42:36.082189+0000","last_fullsized":"2023-08-22T00:42:36.082189+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085393+0000","last_change":"2023-08-22T00:42:35.694175+0000","last_active":"2023-08-22T00:42:36.085393+0000","last_peered":"2023-08-22T00:42:36.085393+0000","last_clean":"2023-08-22T00:42:36.085393+0000","last_became_active":"2023-08-22T00:42:35.693860+0000","last_became_peered":"2023-08-22T00:42:35.693860+0000","last_unstale":"2023-08-22T00:42:36.085393+0000","last_undegraded":"2023-08-22T00:42:36.085393+0000","last_fullsized":"2023-08-22T00:42:36.085393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079353+0000","last_change":"2023-08-22T00:42:36.072895+0000","last_active":"2023-08-22T00:42:36.079353+0000","last_peered":"2023-08-22T00:42:36.079353+0000","last_clean":"2023-08-22T00:42:36.079353+0000","last_became_active":"2023-08-22T00:42:36.072645+0000","last_became_peered":"2023-08-22T00:42:36.072645+0000","last_unstale":"2023-08-22T00:42:36.079353+0000","last_undegraded":"2023-08-22T00:42:36.079353+0000","last_fullsized":"2023-08-22T00:42:36.079353+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068322+0000","last_change":"2023-08-22T00:42:35.698710+0000","last_active":"2023-08-22T00:42:36.068322+0000","last_peered":"2023-08-22T00:42:36.068322+0000","last_clean":"2023-08-22T00:42:36.068322+0000","last_became_active":"2023-08-22T00:42:35.697888+0000","last_became_peered":"2023-08-22T00:42:35.697888+0000","last_unstale":"2023-08-22T00:42:36.068322+0000","last_undegraded":"2023-08-22T00:42:36.068322+0000","last_fullsized":"2023-08-22T00:42:36.068322+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083294+0000","last_change":"2023-08-22T00:42:36.074593+0000","last_active":"2023-08-22T00:42:36.083294+0000","last_peered":"2023-08-22T00:42:36.083294+0000","last_clean":"2023-08-22T00:42:36.083294+0000","last_became_active":"2023-08-22T00:42:36.074298+0000","last_became_peered":"2023-08-22T00:42:36.074298+0000","last_unstale":"2023-08-22T00:42:36.083294+0000","last_undegraded":"2023-08-22T00:42:36.083294+0000","last_fullsized":"2023-08-22T00:42:36.083294+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075522+0000","last_change":"2023-08-22T00:42:35.705084+0000","last_active":"2023-08-22T00:42:36.075522+0000","last_peered":"2023-08-22T00:42:36.075522+0000","last_clean":"2023-08-22T00:42:36.075522+0000","last_became_active":"2023-08-22T00:42:35.704800+0000","last_became_peered":"2023-08-22T00:42:35.704800+0000","last_unstale":"2023-08-22T00:42:36.075522+0000","last_undegraded":"2023-08-22T00:42:36.075522+0000","last_fullsized":"2023-08-22T00:42:36.075522+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086678+0000","last_change":"2023-08-22T00:42:36.079855+0000","last_active":"2023-08-22T00:42:36.086678+0000","last_peered":"2023-08-22T00:42:36.086678+0000","last_clean":"2023-08-22T00:42:36.086678+0000","last_became_active":"2023-08-22T00:42:36.079573+0000","last_became_peered":"2023-08-22T00:42:36.079573+0000","last_unstale":"2023-08-22T00:42:36.086678+0000","last_undegraded":"2023-08-22T00:42:36.086678+0000","last_fullsized":"2023-08-22T00:42:36.086678+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068516+0000","last_change":"2023-08-22T00:42:35.698450+0000","last_active":"2023-08-22T00:42:36.068516+0000","last_peered":"2023-08-22T00:42:36.068516+0000","last_clean":"2023-08-22T00:42:36.068516+0000","last_became_active":"2023-08-22T00:42:35.697970+0000","last_became_peered":"2023-08-22T00:42:35.697970+0000","last_unstale":"2023-08-22T00:42:36.068516+0000","last_undegraded":"2023-08-22T00:42:36.068516+0000","last_fullsized":"2023-08-22T00:42:36.068516+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081694+0000","last_change":"2023-08-22T00:42:36.077800+0000","last_active":"2023-08-22T00:42:36.081694+0000","last_peered":"2023-08-22T00:42:36.081694+0000","last_clean":"2023-08-22T00:42:36.081694+0000","last_became_active":"2023-08-22T00:42:36.077548+0000","last_became_peered":"2023-08-22T00:42:36.077548+0000","last_unstale":"2023-08-22T00:42:36.081694+0000","last_undegraded":"2023-08-22T00:42:36.081694+0000","last_fullsized":"2023-08-22T00:42:36.081694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:35.701893+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:35.701618+0000","last_became_peered":"2023-08-22T00:42:35.701618+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079412+0000","last_change":"2023-08-22T00:42:36.071437+0000","last_active":"2023-08-22T00:42:36.079412+0000","last_peered":"2023-08-22T00:42:36.079412+0000","last_clean":"2023-08-22T00:42:36.079412+0000","last_became_active":"2023-08-22T00:42:36.071073+0000","last_became_peered":"2023-08-22T00:42:36.071073+0000","last_unstale":"2023-08-22T00:42:36.079412+0000","last_undegraded":"2023-08-22T00:42:36.079412+0000","last_fullsized":"2023-08-22T00:42:36.079412+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065786+0000","last_change":"2023-08-22T00:42:35.705325+0000","last_active":"2023-08-22T00:42:36.065786+0000","last_peered":"2023-08-22T00:42:36.065786+0000","last_clean":"2023-08-22T00:42:36.065786+0000","last_became_active":"2023-08-22T00:42:35.705040+0000","last_became_peered":"2023-08-22T00:42:35.705040+0000","last_unstale":"2023-08-22T00:42:36.065786+0000","last_undegraded":"2023-08-22T00:42:36.065786+0000","last_fullsized":"2023-08-22T00:42:36.065786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089348+0000","last_change":"2023-08-22T00:42:36.085076+0000","last_active":"2023-08-22T00:42:36.089348+0000","last_peered":"2023-08-22T00:42:36.089348+0000","last_clean":"2023-08-22T00:42:36.089348+0000","last_became_active":"2023-08-22T00:42:36.084805+0000","last_became_peered":"2023-08-22T00:42:36.084805+0000","last_unstale":"2023-08-22T00:42:36.089348+0000","last_undegraded":"2023-08-22T00:42:36.089348+0000","last_fullsized":"2023-08-22T00:42:36.089348+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073875+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.073875+0000","last_peered":"2023-08-22T00:42:36.073875+0000","last_clean":"2023-08-22T00:42:36.073875+0000","last_became_active":"2023-08-22T00:42:35.703299+0000","last_became_peered":"2023-08-22T00:42:35.703299+0000","last_unstale":"2023-08-22T00:42:36.073875+0000","last_undegraded":"2023-08-22T00:42:36.073875+0000","last_fullsized":"2023-08-22T00:42:36.073875+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077821+0000","last_change":"2023-08-22T00:42:36.073011+0000","last_active":"2023-08-22T00:42:36.077821+0000","last_peered":"2023-08-22T00:42:36.077821+0000","last_clean":"2023-08-22T00:42:36.077821+0000","last_became_active":"2023-08-22T00:42:36.072748+0000","last_became_peered":"2023-08-22T00:42:36.072748+0000","last_unstale":"2023-08-22T00:42:36.077821+0000","last_undegraded":"2023-08-22T00:42:36.077821+0000","last_fullsized":"2023-08-22T00:42:36.077821+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061097+0000","last_change":"2023-08-22T00:42:35.707981+0000","last_active":"2023-08-22T00:42:36.061097+0000","last_peered":"2023-08-22T00:42:36.061097+0000","last_clean":"2023-08-22T00:42:36.061097+0000","last_became_active":"2023-08-22T00:42:35.707707+0000","last_became_peered":"2023-08-22T00:42:35.707707+0000","last_unstale":"2023-08-22T00:42:36.061097+0000","last_undegraded":"2023-08-22T00:42:36.061097+0000","last_fullsized":"2023-08-22T00:42:36.061097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077525+0000","last_change":"2023-08-22T00:42:36.070339+0000","last_active":"2023-08-22T00:42:36.077525+0000","last_peered":"2023-08-22T00:42:36.077525+0000","last_clean":"2023-08-22T00:42:36.077525+0000","last_became_active":"2023-08-22T00:42:36.070079+0000","last_became_peered":"2023-08-22T00:42:36.070079+0000","last_unstale":"2023-08-22T00:42:36.077525+0000","last_undegraded":"2023-08-22T00:42:36.077525+0000","last_fullsized":"2023-08-22T00:42:36.077525+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078460+0000","last_change":"2023-08-22T00:42:35.702589+0000","last_active":"2023-08-22T00:42:36.078460+0000","last_peered":"2023-08-22T00:42:36.078460+0000","last_clean":"2023-08-22T00:42:36.078460+0000","last_became_active":"2023-08-22T00:42:35.701994+0000","last_became_peered":"2023-08-22T00:42:35.701994+0000","last_unstale":"2023-08-22T00:42:36.078460+0000","last_undegraded":"2023-08-22T00:42:36.078460+0000","last_fullsized":"2023-08-22T00:42:36.078460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091462+0000","last_change":"2023-08-22T00:42:36.089972+0000","last_active":"2023-08-22T00:42:36.091462+0000","last_peered":"2023-08-22T00:42:36.091462+0000","last_clean":"2023-08-22T00:42:36.091462+0000","last_became_active":"2023-08-22T00:42:36.089495+0000","last_became_peered":"2023-08-22T00:42:36.089495+0000","last_unstale":"2023-08-22T00:42:36.091462+0000","last_undegraded":"2023-08-22T00:42:36.091462+0000","last_fullsized":"2023-08-22T00:42:36.091462+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075343+0000","last_change":"2023-08-22T00:42:35.693692+0000","last_active":"2023-08-22T00:42:36.075343+0000","last_peered":"2023-08-22T00:42:36.075343+0000","last_clean":"2023-08-22T00:42:36.075343+0000","last_became_active":"2023-08-22T00:42:35.693368+0000","last_became_peered":"2023-08-22T00:42:35.693368+0000","last_unstale":"2023-08-22T00:42:36.075343+0000","last_undegraded":"2023-08-22T00:42:36.075343+0000","last_fullsized":"2023-08-22T00:42:36.075343+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088974+0000","last_change":"2023-08-22T00:42:36.084024+0000","last_active":"2023-08-22T00:42:36.088974+0000","last_peered":"2023-08-22T00:42:36.088974+0000","last_clean":"2023-08-22T00:42:36.088974+0000","last_became_active":"2023-08-22T00:42:36.083758+0000","last_became_peered":"2023-08-22T00:42:36.083758+0000","last_unstale":"2023-08-22T00:42:36.088974+0000","last_undegraded":"2023-08-22T00:42:36.088974+0000","last_fullsized":"2023-08-22T00:42:36.088974+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076319+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.076319+0000","last_peered":"2023-08-22T00:42:36.076319+0000","last_clean":"2023-08-22T00:42:36.076319+0000","last_became_active":"2023-08-22T00:42:35.703273+0000","last_became_peered":"2023-08-22T00:42:35.703273+0000","last_unstale":"2023-08-22T00:42:36.076319+0000","last_undegraded":"2023-08-22T00:42:36.076319+0000","last_fullsized":"2023-08-22T00:42:36.076319+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087627+0000","last_change":"2023-08-22T00:42:36.086483+0000","last_active":"2023-08-22T00:42:36.087627+0000","last_peered":"2023-08-22T00:42:36.087627+0000","last_clean":"2023-08-22T00:42:36.087627+0000","last_became_active":"2023-08-22T00:42:36.086162+0000","last_became_peered":"2023-08-22T00:42:36.086162+0000","last_unstale":"2023-08-22T00:42:36.087627+0000","last_undegraded":"2023-08-22T00:42:36.087627+0000","last_fullsized":"2023-08-22T00:42:36.087627+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078081+0000","last_change":"2023-08-22T00:42:35.693579+0000","last_active":"2023-08-22T00:42:36.078081+0000","last_peered":"2023-08-22T00:42:36.078081+0000","last_clean":"2023-08-22T00:42:36.078081+0000","last_became_active":"2023-08-22T00:42:35.693213+0000","last_became_peered":"2023-08-22T00:42:35.693213+0000","last_unstale":"2023-08-22T00:42:36.078081+0000","last_undegraded":"2023-08-22T00:42:36.078081+0000","last_fullsized":"2023-08-22T00:42:36.078081+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082872+0000","last_change":"2023-08-22T00:42:36.079973+0000","last_active":"2023-08-22T00:42:36.082872+0000","last_peered":"2023-08-22T00:42:36.082872+0000","last_clean":"2023-08-22T00:42:36.082872+0000","last_became_active":"2023-08-22T00:42:36.079730+0000","last_became_peered":"2023-08-22T00:42:36.079730+0000","last_unstale":"2023-08-22T00:42:36.082872+0000","last_undegraded":"2023-08-22T00:42:36.082872+0000","last_fullsized":"2023-08-22T00:42:36.082872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090735+0000","last_change":"2023-08-22T00:42:35.697425+0000","last_active":"2023-08-22T00:42:36.090735+0000","last_peered":"2023-08-22T00:42:36.090735+0000","last_clean":"2023-08-22T00:42:36.090735+0000","last_became_active":"2023-08-22T00:42:35.697041+0000","last_became_peered":"2023-08-22T00:42:35.697041+0000","last_unstale":"2023-08-22T00:42:36.090735+0000","last_undegraded":"2023-08-22T00:42:36.090735+0000","last_fullsized":"2023-08-22T00:42:36.090735+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075613+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:42:36.075613+0000","last_peered":"2023-08-22T00:42:36.075613+0000","last_clean":"2023-08-22T00:42:36.075613+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:42:36.075613+0000","last_undegraded":"2023-08-22T00:42:36.075613+0000","last_fullsized":"2023-08-22T00:42:36.075613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086586+0000","last_change":"2023-08-22T00:42:36.080857+0000","last_active":"2023-08-22T00:42:36.086586+0000","last_peered":"2023-08-22T00:42:36.086586+0000","last_clean":"2023-08-22T00:42:36.086586+0000","last_became_active":"2023-08-22T00:42:36.080591+0000","last_became_peered":"2023-08-22T00:42:36.080591+0000","last_unstale":"2023-08-22T00:42:36.086586+0000","last_undegraded":"2023-08-22T00:42:36.086586+0000","last_fullsized":"2023-08-22T00:42:36.086586+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067217+0000","last_change":"2023-08-22T00:42:35.708363+0000","last_active":"2023-08-22T00:42:36.067217+0000","last_peered":"2023-08-22T00:42:36.067217+0000","last_clean":"2023-08-22T00:42:36.067217+0000","last_became_active":"2023-08-22T00:42:35.707698+0000","last_became_peered":"2023-08-22T00:42:35.707698+0000","last_unstale":"2023-08-22T00:42:36.067217+0000","last_undegraded":"2023-08-22T00:42:36.067217+0000","last_fullsized":"2023-08-22T00:42:36.067217+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064884+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:42:36.064884+0000","last_peered":"2023-08-22T00:42:36.064884+0000","last_clean":"2023-08-22T00:42:36.064884+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:42:36.064884+0000","last_undegraded":"2023-08-22T00:42:36.064884+0000","last_fullsized":"2023-08-22T00:42:36.064884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081502+0000","last_change":"2023-08-22T00:42:36.078160+0000","last_active":"2023-08-22T00:42:36.081502+0000","last_peered":"2023-08-22T00:42:36.081502+0000","last_clean":"2023-08-22T00:42:36.081502+0000","last_became_active":"2023-08-22T00:42:36.077878+0000","last_became_peered":"2023-08-22T00:42:36.077878+0000","last_unstale":"2023-08-22T00:42:36.081502+0000","last_undegraded":"2023-08-22T00:42:36.081502+0000","last_fullsized":"2023-08-22T00:42:36.081502+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086834+0000","last_change":"2023-08-22T00:42:35.698960+0000","last_active":"2023-08-22T00:42:36.086834+0000","last_peered":"2023-08-22T00:42:36.086834+0000","last_clean":"2023-08-22T00:42:36.086834+0000","last_became_active":"2023-08-22T00:42:35.698356+0000","last_became_peered":"2023-08-22T00:42:35.698356+0000","last_unstale":"2023-08-22T00:42:36.086834+0000","last_undegraded":"2023-08-22T00:42:36.086834+0000","last_fullsized":"2023-08-22T00:42:36.086834+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065764+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:42:36.065764+0000","last_peered":"2023-08-22T00:42:36.065764+0000","last_clean":"2023-08-22T00:42:36.065764+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:42:36.065764+0000","last_undegraded":"2023-08-22T00:42:36.065764+0000","last_fullsized":"2023-08-22T00:42:36.065764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086872+0000","last_change":"2023-08-22T00:42:36.081803+0000","last_active":"2023-08-22T00:42:36.086872+0000","last_peered":"2023-08-22T00:42:36.086872+0000","last_clean":"2023-08-22T00:42:36.086872+0000","last_became_active":"2023-08-22T00:42:36.081517+0000","last_became_peered":"2023-08-22T00:42:36.081517+0000","last_unstale":"2023-08-22T00:42:36.086872+0000","last_undegraded":"2023-08-22T00:42:36.086872+0000","last_fullsized":"2023-08-22T00:42:36.086872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078807+0000","last_change":"2023-08-22T00:42:35.696843+0000","last_active":"2023-08-22T00:42:36.078807+0000","last_peered":"2023-08-22T00:42:36.078807+0000","last_clean":"2023-08-22T00:42:36.078807+0000","last_became_active":"2023-08-22T00:42:35.696492+0000","last_became_peered":"2023-08-22T00:42:35.696492+0000","last_unstale":"2023-08-22T00:42:36.078807+0000","last_undegraded":"2023-08-22T00:42:36.078807+0000","last_fullsized":"2023-08-22T00:42:36.078807+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064888+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:42:36.064888+0000","last_peered":"2023-08-22T00:42:36.064888+0000","last_clean":"2023-08-22T00:42:36.064888+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:42:36.064888+0000","last_undegraded":"2023-08-22T00:42:36.064888+0000","last_fullsized":"2023-08-22T00:42:36.064888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068613+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:42:36.068613+0000","last_peered":"2023-08-22T00:42:36.068613+0000","last_clean":"2023-08-22T00:42:36.068613+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:42:36.068613+0000","last_undegraded":"2023-08-22T00:42:36.068613+0000","last_fullsized":"2023-08-22T00:42:36.068613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091836+0000","last_change":"2023-08-22T00:42:36.090141+0000","last_active":"2023-08-22T00:42:36.091836+0000","last_peered":"2023-08-22T00:42:36.091836+0000","last_clean":"2023-08-22T00:42:36.091836+0000","last_became_active":"2023-08-22T00:42:36.089871+0000","last_became_peered":"2023-08-22T00:42:36.089871+0000","last_unstale":"2023-08-22T00:42:36.091836+0000","last_undegraded":"2023-08-22T00:42:36.091836+0000","last_fullsized":"2023-08-22T00:42:36.091836+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089810+0000","last_change":"2023-08-22T00:42:35.699372+0000","last_active":"2023-08-22T00:42:36.089810+0000","last_peered":"2023-08-22T00:42:36.089810+0000","last_clean":"2023-08-22T00:42:36.089810+0000","last_became_active":"2023-08-22T00:42:35.699107+0000","last_became_peered":"2023-08-22T00:42:35.699107+0000","last_unstale":"2023-08-22T00:42:36.089810+0000","last_undegraded":"2023-08-22T00:42:36.089810+0000","last_fullsized":"2023-08-22T00:42:36.089810+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068527+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:42:36.068527+0000","last_peered":"2023-08-22T00:42:36.068527+0000","last_clean":"2023-08-22T00:42:36.068527+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:42:36.068527+0000","last_undegraded":"2023-08-22T00:42:36.068527+0000","last_fullsized":"2023-08-22T00:42:36.068527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082150+0000","last_change":"2023-08-22T00:42:36.074900+0000","last_active":"2023-08-22T00:42:36.082150+0000","last_peered":"2023-08-22T00:42:36.082150+0000","last_clean":"2023-08-22T00:42:36.082150+0000","last_became_active":"2023-08-22T00:42:36.074649+0000","last_became_peered":"2023-08-22T00:42:36.074649+0000","last_unstale":"2023-08-22T00:42:36.082150+0000","last_undegraded":"2023-08-22T00:42:36.082150+0000","last_fullsized":"2023-08-22T00:42:36.082150+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075428+0000","last_change":"2023-08-22T00:42:35.698369+0000","last_active":"2023-08-22T00:42:36.075428+0000","last_peered":"2023-08-22T00:42:36.075428+0000","last_clean":"2023-08-22T00:42:36.075428+0000","last_became_active":"2023-08-22T00:42:35.697801+0000","last_became_peered":"2023-08-22T00:42:35.697801+0000","last_unstale":"2023-08-22T00:42:36.075428+0000","last_undegraded":"2023-08-22T00:42:36.075428+0000","last_fullsized":"2023-08-22T00:42:36.075428+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069143+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:42:36.069143+0000","last_peered":"2023-08-22T00:42:36.069143+0000","last_clean":"2023-08-22T00:42:36.069143+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:42:36.069143+0000","last_undegraded":"2023-08-22T00:42:36.069143+0000","last_fullsized":"2023-08-22T00:42:36.069143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081865+0000","last_change":"2023-08-22T00:42:36.076581+0000","last_active":"2023-08-22T00:42:36.081865+0000","last_peered":"2023-08-22T00:42:36.081865+0000","last_clean":"2023-08-22T00:42:36.081865+0000","last_became_active":"2023-08-22T00:42:36.076315+0000","last_became_peered":"2023-08-22T00:42:36.076315+0000","last_unstale":"2023-08-22T00:42:36.081865+0000","last_undegraded":"2023-08-22T00:42:36.081865+0000","last_fullsized":"2023-08-22T00:42:36.081865+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061347+0000","last_change":"2023-08-22T00:42:35.705930+0000","last_active":"2023-08-22T00:42:36.061347+0000","last_peered":"2023-08-22T00:42:36.061347+0000","last_clean":"2023-08-22T00:42:36.061347+0000","last_became_active":"2023-08-22T00:42:35.705653+0000","last_became_peered":"2023-08-22T00:42:35.705653+0000","last_unstale":"2023-08-22T00:42:36.061347+0000","last_undegraded":"2023-08-22T00:42:36.061347+0000","last_fullsized":"2023-08-22T00:42:36.061347+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075976+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:42:36.075976+0000","last_peered":"2023-08-22T00:42:36.075976+0000","last_clean":"2023-08-22T00:42:36.075976+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:42:36.075976+0000","last_undegraded":"2023-08-22T00:42:36.075976+0000","last_fullsized":"2023-08-22T00:42:36.075976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076103+0000","last_change":"2023-08-22T00:42:36.068690+0000","last_active":"2023-08-22T00:42:36.076103+0000","last_peered":"2023-08-22T00:42:36.076103+0000","last_clean":"2023-08-22T00:42:36.076103+0000","last_became_active":"2023-08-22T00:42:36.068425+0000","last_became_peered":"2023-08-22T00:42:36.068425+0000","last_unstale":"2023-08-22T00:42:36.076103+0000","last_undegraded":"2023-08-22T00:42:36.076103+0000","last_fullsized":"2023-08-22T00:42:36.076103+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084337+0000","last_change":"2023-08-22T00:42:35.703353+0000","last_active":"2023-08-22T00:42:36.084337+0000","last_peered":"2023-08-22T00:42:36.084337+0000","last_clean":"2023-08-22T00:42:36.084337+0000","last_became_active":"2023-08-22T00:42:35.703030+0000","last_became_peered":"2023-08-22T00:42:35.703030+0000","last_unstale":"2023-08-22T00:42:36.084337+0000","last_undegraded":"2023-08-22T00:42:36.084337+0000","last_fullsized":"2023-08-22T00:42:36.084337+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077594+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:42:36.077594+0000","last_peered":"2023-08-22T00:42:36.077594+0000","last_clean":"2023-08-22T00:42:36.077594+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:42:36.077594+0000","last_undegraded":"2023-08-22T00:42:36.077594+0000","last_fullsized":"2023-08-22T00:42:36.077594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.85999999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.28699999999999998},"max":{"1min":0.69899999999999995,"5min":0.71799999999999997,"15min":0.79700000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.32800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.753,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.80300000000000005,"15min":0.879},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83199999999999996},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.875},"last":0.751},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575279,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060192,"statfs":{"total":96636764160,"available":96317636608,"internally_reserved":0,"allocated":2318336,"data_stored":1233207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.83699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.82299999999999995},"last":0.627}]},{"osd":1,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.81200000000000006},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.77400000000000002,"15min":0.81599999999999995},"last":0.53800000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.501},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.79100000000000004},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.63500000000000001,"5min":0.66900000000000004,"15min":0.77300000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80400000000000005,"15min":1.234},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.79200000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.80600000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2314240,"data_stored":1232327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59299999999999997,"15min":0.61599999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54800000000000004,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.44,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.69199999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.25700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.875,"15min":0.92500000000000004},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.01},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":1.004,"15min":1.014},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.95899999999999996},"last":0.69299999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.97199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.98599999999999999},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575279,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2310144,"data_stored":1232293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.63800000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.434,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.627},"last":0.29399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.65300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.371}]},{"osd":4,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.40300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.78600000000000003,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.40699999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.64500000000000002},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.89000000000000001,"15min":1.0249999999999999},"last":0.495},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.79800000000000004,"5min":0.89400000000000002,"15min":0.98699999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":1.0389999999999999},"last":0.502},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575280,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064292,"statfs":{"total":96636764160,"available":96321835008,"internally_reserved":0,"allocated":2314240,"data_stored":1232383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47099999999999997,"5min":0.60499999999999998,"15min":0.64000000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.373}]},{"osd":1,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.622,"15min":0.72099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.254},"max":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.626},"last":0.24299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54400000000000004,"5min":0.65500000000000003,"15min":0.748},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51500000000000001,"5min":0.64200000000000002,"15min":0.78400000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.434,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0069999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.40899999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.93300000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":0.88,"15min":1.1120000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":0.92300000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.82199999999999995,"5min":0.87,"15min":1.0549999999999999},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575279,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2318336,"data_stored":1233219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.60299999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.308},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46100000000000002},"min":{"1min":0.36799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.373},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.73099999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.378,"15min":0.378},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.95699999999999996,"15min":1.026},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.034},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575279,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.79500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.81299999999999994},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.373},"max":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78200000000000003,"15min":0.79700000000000004},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.748,"5min":0.748,"15min":0.79900000000000004},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575278,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064288,"statfs":{"total":96636764160,"available":96321830912,"internally_reserved":0,"allocated":2318336,"data_stored":1232869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.745},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:42:40.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:42:40.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.525+0000 7ff95f89d700 1 Processor -- start 2023-08-22T00:42:40.527 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.526+0000 7ff95f89d700 1 -- start start 2023-08-22T00:42:40.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.526+0000 7ff95f89d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff95814bf70 0x7ff958152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.528 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95f89d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff95814c350 0x7ff9581556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95f89d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff958153080 con 0x7ff9580c3740 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95f89d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff958066510 con 0x7ff95814bf70 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95f89d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580667b0 con 0x7ff95814c350 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff95814bf70 0x7ff958152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff95814bf70 0x7ff958152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51438/0 (socket says 172.21.15.98:51438) 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 -- 172.21.15.98:0/1125145203 learned_addr learned my addr 172.21.15.98:0/1125145203 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.529 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95ce38700 1 --2- 172.21.15.98:0/1125145203 >> v2:172.21.15.118:3300/0 conn(0x7ff95814c350 0x7ff9581556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 -- 172.21.15.98:0/1125145203 >> v2:172.21.15.118:3300/0 conn(0x7ff95814c350 msgr2=0x7ff9581556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 --2- 172.21.15.98:0/1125145203 >> v2:172.21.15.118:3300/0 conn(0x7ff95814c350 0x7ff9581556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 -- 172.21.15.98:0/1125145203 >> v1:172.21.15.118:6789/0 conn(0x7ff9580c3740 legacy=0x7ff9580c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 -- 172.21.15.98:0/1125145203 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958155ba0 con 0x7ff95814bf70 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff95d639700 1 --2- 172.21.15.98:0/1125145203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff95814bf70 0x7ff958152b90 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7ff9580c2df0 tx=0x7ff9540090f0).ready entity=mon.0 client_cookie=503e51c995df19a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff94ffff700 1 -- 172.21.15.98:0/1125145203 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400b520 con 0x7ff95814bf70 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff94ffff700 1 -- 172.21.15.98:0/1125145203 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95400b680 con 0x7ff95814bf70 2023-08-22T00:42:40.530 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.527+0000 7ff94ffff700 1 -- 172.21.15.98:0/1125145203 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400ba00 con 0x7ff95814bf70 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 -- 172.21.15.98:0/1125145203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff95814bf70 msgr2=0x7ff958152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 --2- 172.21.15.98:0/1125145203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff95814bf70 0x7ff958152b90 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7ff9580c2df0 tx=0x7ff9540090f0).stop 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 -- 172.21.15.98:0/1125145203 shutdown_connections 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 --2- 172.21.15.98:0/1125145203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff95814bf70 0x7ff958152b90 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 --2- 172.21.15.98:0/1125145203 >> v2:172.21.15.118:3300/0 conn(0x7ff95814c350 0x7ff9581556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 -- 172.21.15.98:0/1125145203 >> 172.21.15.98:0/1125145203 conn(0x7ff9580c5dc0 msgr2=0x7ff958068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 -- 172.21.15.98:0/1125145203 shutdown_connections 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.528+0000 7ff95f89d700 1 -- 172.21.15.98:0/1125145203 wait complete. 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.529+0000 7ff95f89d700 1 Processor -- start 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.529+0000 7ff95f89d700 1 -- start start 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff95814bf70 0x7ff9580a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95814c350 0x7ff95814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580a96a0 con 0x7ff9580c3740 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580a9960 con 0x7ff95814c350 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95f89d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff958063fa0 con 0x7ff95814bf70 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51446/0 (socket says 172.21.15.98:51446) 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 -- 172.21.15.98:0/2780843657 learned_addr learned my addr 172.21.15.98:0/2780843657 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95de3a700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95814c350 0x7ff95814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95ce38700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff95814bf70 0x7ff9580a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 -- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff95814bf70 msgr2=0x7ff9580a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff95814bf70 0x7ff9580a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 -- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95814c350 msgr2=0x7ff95814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95814c350 0x7ff95814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 -- 172.21.15.98:0/2780843657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954009370 con 0x7ff9580c3740 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.530+0000 7ff95d639700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7ff954009130 tx=0x7ff954017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.531+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400be90 con 0x7ff9580c3740 2023-08-22T00:42:40.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.531+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95400b7f0 con 0x7ff9580c3740 2023-08-22T00:42:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.531+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958064280 con 0x7ff9580c3740 2023-08-22T00:42:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.531+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401c670 con 0x7ff9580c3740 2023-08-22T00:42:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.531+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff958064840 con 0x7ff9580c3740 2023-08-22T00:42:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.532+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958064a60 con 0x7ff9580c3740 2023-08-22T00:42:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.532+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff95401c9e0 con 0x7ff9580c3740 2023-08-22T00:42:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.532+0000 7ff94d7fa700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 0x7ff93c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.532+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff95407be30 con 0x7ff9580c3740 2023-08-22T00:42:40.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.532+0000 7ff95ce38700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 0x7ff93c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.533+0000 7ff95ce38700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 0x7ff93c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff9580a9c40 tx=0x7ff948008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.536+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff95404cfc0 con 0x7ff9580c3740 2023-08-22T00:42:40.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.764+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff958047480 con 0x7ff9580c3740 2023-08-22T00:42:40.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.765+0000 7ff94d7fa700 1 -- 172.21.15.98:0/2780843657 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3152 (secure 0 0 0) 0x7ff95402a020 con 0x7ff9580c3740 2023-08-22T00:42:40.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:40.767 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2209,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":185,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":22,"data_bytes":2306,"bytes_used":2511077376,"bytes_avail":770583035904,"bytes_total":773094113280},"fsmap":{"epoch":69,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":9360}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-08-22T00:42:25.159367+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-22T00:42:40.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 msgr2=0x7ff93c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 0x7ff93c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff9580a9c40 tx=0x7ff948008040).stop 2023-08-22T00:42:40.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 msgr2=0x7ff958151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7ff954009130 tx=0x7ff954017000).stop 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 shutdown_connections 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff93c05ef30 0x7ff93c0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95814c350 0x7ff95814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9580c3740 0x7ff958151180 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 --2- 172.21.15.98:0/2780843657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff95814bf70 0x7ff9580a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 >> 172.21.15.98:0/2780843657 conn(0x7ff9580c5dc0 msgr2=0x7ff958149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 shutdown_connections 2023-08-22T00:42:40.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.766+0000 7ff95f89d700 1 -- 172.21.15.98:0/2780843657 wait complete. 2023-08-22T00:42:40.779 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:42:40.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:42:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.896+0000 7febd5f78700 1 Processor -- start 2023-08-22T00:42:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.896+0000 7febd5f78700 1 -- start start 2023-08-22T00:42:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febd5f78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febd5f78700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7febd00bcd60 0x7febd0063a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febd5f78700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd0063f60 con 0x7febd00a89a0 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febd5f78700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00bd3b0 con 0x7febd00bcd60 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febd5f78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0154830 con 0x7febd0155310 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7febd00bcd60 0x7febd0063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7febd00bcd60 0x7febd0063a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51456/0 (socket says 172.21.15.98:51456) 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 -- 172.21.15.98:0/2395086110 learned_addr learned my addr 172.21.15.98:0/2395086110 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febceffd700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 -- 172.21.15.98:0/2395086110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 msgr2=0x7febd00c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 -- 172.21.15.98:0/2395086110 >> v1:172.21.15.118:6789/0 conn(0x7febd00a89a0 legacy=0x7febd00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 -- 172.21.15.98:0/2395086110 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd0154b10 con 0x7febd00bcd60 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.897+0000 7febcffff700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd0063a70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7febc0009f50 tx=0x7febc0009840).ready entity=mon.0 client_cookie=8120ac3e0b97d3eb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febce7fc700 1 -- 172.21.15.98:0/2395086110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000e070 con 0x7febd00bcd60 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febce7fc700 1 -- 172.21.15.98:0/2395086110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000ba70 con 0x7febd00bcd60 2023-08-22T00:42:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febce7fc700 1 -- 172.21.15.98:0/2395086110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000bdf0 con 0x7febd00bcd60 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 -- 172.21.15.98:0/2395086110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 msgr2=0x7febd0063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd0063a70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7febc0009f50 tx=0x7febc0009840).stop 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 -- 172.21.15.98:0/2395086110 shutdown_connections 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd0063a70 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 --2- 172.21.15.98:0/2395086110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 -- 172.21.15.98:0/2395086110 >> 172.21.15.98:0/2395086110 conn(0x7febd00c7140 msgr2=0x7febd00c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 -- 172.21.15.98:0/2395086110 shutdown_connections 2023-08-22T00:42:40.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.898+0000 7febd5f78700 1 -- 172.21.15.98:0/2395086110 wait complete. 2023-08-22T00:42:40.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.899+0000 7febd5f78700 1 Processor -- start 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.899+0000 7febd5f78700 1 -- start start 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd00a89a0 0x7febd00a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0167d30 con 0x7febd00bcd60 2023-08-22T00:42:40.905 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd00a3db0 con 0x7febd00a89a0 2023-08-22T00:42:40.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febd5f78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd00a4090 con 0x7febd0155310 2023-08-22T00:42:40.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51472/0 (socket says 172.21.15.98:51472) 2023-08-22T00:42:40.906 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febceffd700 1 -- 172.21.15.98:0/2786933125 learned_addr learned my addr 172.21.15.98:0/2786933125 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febcf7fe700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd00a89a0 0x7febd00a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.900+0000 7febcffff700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 -- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 msgr2=0x7febd00bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 -- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd00a89a0 msgr2=0x7febd00a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd00a89a0 0x7febd00a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 -- 172.21.15.98:0/2786933125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0009ae0 con 0x7febd00bcd60 2023-08-22T00:42:40.907 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febceffd700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7febc800d860 tx=0x7febc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011590 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80116f0 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd00a4370 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011a70 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.901+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd00a5710 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.902+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0167ee0 con 0x7febd00bcd60 2023-08-22T00:42:40.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.902+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7febc8012420 con 0x7febd00bcd60 2023-08-22T00:42:40.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.903+0000 7febc77fe700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 0x7febb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:40.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.903+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7febc8079a80 con 0x7febd00bcd60 2023-08-22T00:42:40.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.903+0000 7febcf7fe700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 0x7febb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:40.909 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.903+0000 7febcf7fe700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 0x7febb00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7febb8003860 tx=0x7febb8007d40).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:40.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:40.907+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febc804abb0 con 0x7febd00bcd60 2023-08-22T00:42:41.065 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.064+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febd00a5930 con 0x7febb005ef30 2023-08-22T00:42:41.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.073+0000 7febc77fe700 1 -- 172.21.15.98:0/2786933125 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362129 (secure 0 0 0) 0x7febb80034f0 con 0x7febb005ef30 2023-08-22T00:42:41.081 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 msgr2=0x7febb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:41.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 0x7febb00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7febb8003860 tx=0x7febb8007d40).stop 2023-08-22T00:42:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 msgr2=0x7febd00aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7febc800d860 tx=0x7febc8008040).stop 2023-08-22T00:42:41.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 shutdown_connections 2023-08-22T00:42:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7febb005ef30 0x7febb00613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febd0155310 0x7febd00bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd00a89a0 0x7febd00a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:41.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 --2- 172.21.15.98:0/2786933125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd00bcd60 0x7febd00aaef0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 >> 172.21.15.98:0/2786933125 conn(0x7febd00c7140 msgr2=0x7febd00c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 shutdown_connections 2023-08-22T00:42:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:41.077+0000 7febd5f78700 1 -- 172.21.15.98:0/2786933125 wait complete. 2023-08-22T00:42:41.087 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:42:41.090 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:42:40.161422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2452224,"kb_used_data":18112,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752522496,"statfs":{"total":773094113280,"available":770583035904,"internally_reserved":0,"allocated":18546688,"data_stored":9862956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553192,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-211,"num_write_kb":-681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.414038"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085893+0000","last_change":"2023-08-22T00:42:36.082577+0000","last_active":"2023-08-22T00:42:36.085893+0000","last_peered":"2023-08-22T00:42:36.085893+0000","last_clean":"2023-08-22T00:42:36.085893+0000","last_became_active":"2023-08-22T00:42:36.082062+0000","last_became_peered":"2023-08-22T00:42:36.082062+0000","last_unstale":"2023-08-22T00:42:36.085893+0000","last_undegraded":"2023-08-22T00:42:36.085893+0000","last_fullsized":"2023-08-22T00:42:36.085893+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093238+0000","last_change":"2023-08-22T00:42:35.705579+0000","last_active":"2023-08-22T00:42:36.093238+0000","last_peered":"2023-08-22T00:42:36.093238+0000","last_clean":"2023-08-22T00:42:36.093238+0000","last_became_active":"2023-08-22T00:42:35.705289+0000","last_became_peered":"2023-08-22T00:42:35.705289+0000","last_unstale":"2023-08-22T00:42:36.093238+0000","last_undegraded":"2023-08-22T00:42:36.093238+0000","last_fullsized":"2023-08-22T00:42:36.093238+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085065+0000","last_change":"2023-08-22T00:42:36.082780+0000","last_active":"2023-08-22T00:42:36.085065+0000","last_peered":"2023-08-22T00:42:36.085065+0000","last_clean":"2023-08-22T00:42:36.085065+0000","last_became_active":"2023-08-22T00:42:36.082504+0000","last_became_peered":"2023-08-22T00:42:36.082504+0000","last_unstale":"2023-08-22T00:42:36.085065+0000","last_undegraded":"2023-08-22T00:42:36.085065+0000","last_fullsized":"2023-08-22T00:42:36.085065+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075903+0000","last_change":"2023-08-22T00:42:35.697663+0000","last_active":"2023-08-22T00:42:36.075903+0000","last_peered":"2023-08-22T00:42:36.075903+0000","last_clean":"2023-08-22T00:42:36.075903+0000","last_became_active":"2023-08-22T00:42:35.697372+0000","last_became_peered":"2023-08-22T00:42:35.697372+0000","last_unstale":"2023-08-22T00:42:36.075903+0000","last_undegraded":"2023-08-22T00:42:36.075903+0000","last_fullsized":"2023-08-22T00:42:36.075903+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083251+0000","last_change":"2023-08-22T00:42:36.079736+0000","last_active":"2023-08-22T00:42:36.083251+0000","last_peered":"2023-08-22T00:42:36.083251+0000","last_clean":"2023-08-22T00:42:36.083251+0000","last_became_active":"2023-08-22T00:42:36.079462+0000","last_became_peered":"2023-08-22T00:42:36.079462+0000","last_unstale":"2023-08-22T00:42:36.083251+0000","last_undegraded":"2023-08-22T00:42:36.083251+0000","last_fullsized":"2023-08-22T00:42:36.083251+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075462+0000","last_change":"2023-08-22T00:42:35.699456+0000","last_active":"2023-08-22T00:42:36.075462+0000","last_peered":"2023-08-22T00:42:36.075462+0000","last_clean":"2023-08-22T00:42:36.075462+0000","last_became_active":"2023-08-22T00:42:35.698113+0000","last_became_peered":"2023-08-22T00:42:35.698113+0000","last_unstale":"2023-08-22T00:42:36.075462+0000","last_undegraded":"2023-08-22T00:42:36.075462+0000","last_fullsized":"2023-08-22T00:42:36.075462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094154+0000","last_change":"2023-08-22T00:42:36.092961+0000","last_active":"2023-08-22T00:42:36.094154+0000","last_peered":"2023-08-22T00:42:36.094154+0000","last_clean":"2023-08-22T00:42:36.094154+0000","last_became_active":"2023-08-22T00:42:36.092700+0000","last_became_peered":"2023-08-22T00:42:36.092700+0000","last_unstale":"2023-08-22T00:42:36.094154+0000","last_undegraded":"2023-08-22T00:42:36.094154+0000","last_fullsized":"2023-08-22T00:42:36.094154+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088314+0000","last_change":"2023-08-22T00:42:35.701261+0000","last_active":"2023-08-22T00:42:36.088314+0000","last_peered":"2023-08-22T00:42:36.088314+0000","last_clean":"2023-08-22T00:42:36.088314+0000","last_became_active":"2023-08-22T00:42:35.700959+0000","last_became_peered":"2023-08-22T00:42:35.700959+0000","last_unstale":"2023-08-22T00:42:36.088314+0000","last_undegraded":"2023-08-22T00:42:36.088314+0000","last_fullsized":"2023-08-22T00:42:36.088314+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089405+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089405+0000","last_peered":"2023-08-22T00:42:36.089405+0000","last_clean":"2023-08-22T00:42:36.089405+0000","last_became_active":"2023-08-22T00:42:36.084721+0000","last_became_peered":"2023-08-22T00:42:36.084721+0000","last_unstale":"2023-08-22T00:42:36.089405+0000","last_undegraded":"2023-08-22T00:42:36.089405+0000","last_fullsized":"2023-08-22T00:42:36.089405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084085+0000","last_change":"2023-08-22T00:42:35.707988+0000","last_active":"2023-08-22T00:42:36.084085+0000","last_peered":"2023-08-22T00:42:36.084085+0000","last_clean":"2023-08-22T00:42:36.084085+0000","last_became_active":"2023-08-22T00:42:35.707664+0000","last_became_peered":"2023-08-22T00:42:35.707664+0000","last_unstale":"2023-08-22T00:42:36.084085+0000","last_undegraded":"2023-08-22T00:42:36.084085+0000","last_fullsized":"2023-08-22T00:42:36.084085+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093119+0000","last_change":"2023-08-22T00:42:36.091419+0000","last_active":"2023-08-22T00:42:36.093119+0000","last_peered":"2023-08-22T00:42:36.093119+0000","last_clean":"2023-08-22T00:42:36.093119+0000","last_became_active":"2023-08-22T00:42:36.091194+0000","last_became_peered":"2023-08-22T00:42:36.091194+0000","last_unstale":"2023-08-22T00:42:36.093119+0000","last_undegraded":"2023-08-22T00:42:36.093119+0000","last_fullsized":"2023-08-22T00:42:36.093119+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083032+0000","last_change":"2023-08-22T00:42:35.707959+0000","last_active":"2023-08-22T00:42:36.083032+0000","last_peered":"2023-08-22T00:42:36.083032+0000","last_clean":"2023-08-22T00:42:36.083032+0000","last_became_active":"2023-08-22T00:42:35.707645+0000","last_became_peered":"2023-08-22T00:42:35.707645+0000","last_unstale":"2023-08-22T00:42:36.083032+0000","last_undegraded":"2023-08-22T00:42:36.083032+0000","last_fullsized":"2023-08-22T00:42:36.083032+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093078+0000","last_change":"2023-08-22T00:42:36.091614+0000","last_active":"2023-08-22T00:42:36.093078+0000","last_peered":"2023-08-22T00:42:36.093078+0000","last_clean":"2023-08-22T00:42:36.093078+0000","last_became_active":"2023-08-22T00:42:36.091327+0000","last_became_peered":"2023-08-22T00:42:36.091327+0000","last_unstale":"2023-08-22T00:42:36.093078+0000","last_undegraded":"2023-08-22T00:42:36.093078+0000","last_fullsized":"2023-08-22T00:42:36.093078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.066427+0000","last_change":"2023-08-22T00:42:35.704629+0000","last_active":"2023-08-22T00:42:36.066427+0000","last_peered":"2023-08-22T00:42:36.066427+0000","last_clean":"2023-08-22T00:42:36.066427+0000","last_became_active":"2023-08-22T00:42:35.702144+0000","last_became_peered":"2023-08-22T00:42:35.702144+0000","last_unstale":"2023-08-22T00:42:36.066427+0000","last_undegraded":"2023-08-22T00:42:36.066427+0000","last_fullsized":"2023-08-22T00:42:36.066427+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095260+0000","last_change":"2023-08-22T00:42:36.090719+0000","last_active":"2023-08-22T00:42:36.095260+0000","last_peered":"2023-08-22T00:42:36.095260+0000","last_clean":"2023-08-22T00:42:36.095260+0000","last_became_active":"2023-08-22T00:42:36.090442+0000","last_became_peered":"2023-08-22T00:42:36.090442+0000","last_unstale":"2023-08-22T00:42:36.095260+0000","last_undegraded":"2023-08-22T00:42:36.095260+0000","last_fullsized":"2023-08-22T00:42:36.095260+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078704+0000","last_change":"2023-08-22T00:42:35.693901+0000","last_active":"2023-08-22T00:42:36.078704+0000","last_peered":"2023-08-22T00:42:36.078704+0000","last_clean":"2023-08-22T00:42:36.078704+0000","last_became_active":"2023-08-22T00:42:35.693533+0000","last_became_peered":"2023-08-22T00:42:35.693533+0000","last_unstale":"2023-08-22T00:42:36.078704+0000","last_undegraded":"2023-08-22T00:42:36.078704+0000","last_fullsized":"2023-08-22T00:42:36.078704+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084584+0000","last_change":"2023-08-22T00:42:36.078221+0000","last_active":"2023-08-22T00:42:36.084584+0000","last_peered":"2023-08-22T00:42:36.084584+0000","last_clean":"2023-08-22T00:42:36.084584+0000","last_became_active":"2023-08-22T00:42:36.077909+0000","last_became_peered":"2023-08-22T00:42:36.077909+0000","last_unstale":"2023-08-22T00:42:36.084584+0000","last_undegraded":"2023-08-22T00:42:36.084584+0000","last_fullsized":"2023-08-22T00:42:36.084584+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061876+0000","last_change":"2023-08-22T00:42:35.701212+0000","last_active":"2023-08-22T00:42:36.061876+0000","last_peered":"2023-08-22T00:42:36.061876+0000","last_clean":"2023-08-22T00:42:36.061876+0000","last_became_active":"2023-08-22T00:42:35.700553+0000","last_became_peered":"2023-08-22T00:42:35.700553+0000","last_unstale":"2023-08-22T00:42:36.061876+0000","last_undegraded":"2023-08-22T00:42:36.061876+0000","last_fullsized":"2023-08-22T00:42:36.061876+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085924+0000","last_change":"2023-08-22T00:42:36.084212+0000","last_active":"2023-08-22T00:42:36.085924+0000","last_peered":"2023-08-22T00:42:36.085924+0000","last_clean":"2023-08-22T00:42:36.085924+0000","last_became_active":"2023-08-22T00:42:36.083903+0000","last_became_peered":"2023-08-22T00:42:36.083903+0000","last_unstale":"2023-08-22T00:42:36.085924+0000","last_undegraded":"2023-08-22T00:42:36.085924+0000","last_fullsized":"2023-08-22T00:42:36.085924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.062512+0000","last_change":"2023-08-22T00:42:35.703201+0000","last_active":"2023-08-22T00:42:36.062512+0000","last_peered":"2023-08-22T00:42:36.062512+0000","last_clean":"2023-08-22T00:42:36.062512+0000","last_became_active":"2023-08-22T00:42:35.702927+0000","last_became_peered":"2023-08-22T00:42:35.702927+0000","last_unstale":"2023-08-22T00:42:36.062512+0000","last_undegraded":"2023-08-22T00:42:36.062512+0000","last_fullsized":"2023-08-22T00:42:36.062512+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:36.082169+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:36.081332+0000","last_became_peered":"2023-08-22T00:42:36.081332+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065442+0000","last_change":"2023-08-22T00:42:35.699127+0000","last_active":"2023-08-22T00:42:36.065442+0000","last_peered":"2023-08-22T00:42:36.065442+0000","last_clean":"2023-08-22T00:42:36.065442+0000","last_became_active":"2023-08-22T00:42:35.698702+0000","last_became_peered":"2023-08-22T00:42:35.698702+0000","last_unstale":"2023-08-22T00:42:36.065442+0000","last_undegraded":"2023-08-22T00:42:36.065442+0000","last_fullsized":"2023-08-22T00:42:36.065442+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093184+0000","last_change":"2023-08-22T00:42:36.092072+0000","last_active":"2023-08-22T00:42:36.093184+0000","last_peered":"2023-08-22T00:42:36.093184+0000","last_clean":"2023-08-22T00:42:36.093184+0000","last_became_active":"2023-08-22T00:42:36.091789+0000","last_became_peered":"2023-08-22T00:42:36.091789+0000","last_unstale":"2023-08-22T00:42:36.093184+0000","last_undegraded":"2023-08-22T00:42:36.093184+0000","last_fullsized":"2023-08-22T00:42:36.093184+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.34","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092770+0000","last_change":"2023-08-22T00:42:35.704055+0000","last_active":"2023-08-22T00:42:36.092770+0000","last_peered":"2023-08-22T00:42:36.092770+0000","last_clean":"2023-08-22T00:42:36.092770+0000","last_became_active":"2023-08-22T00:42:35.702958+0000","last_became_peered":"2023-08-22T00:42:35.702958+0000","last_unstale":"2023-08-22T00:42:36.092770+0000","last_undegraded":"2023-08-22T00:42:36.092770+0000","last_fullsized":"2023-08-22T00:42:36.092770+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082212+0000","last_change":"2023-08-22T00:42:36.072913+0000","last_active":"2023-08-22T00:42:36.082212+0000","last_peered":"2023-08-22T00:42:36.082212+0000","last_clean":"2023-08-22T00:42:36.082212+0000","last_became_active":"2023-08-22T00:42:36.072655+0000","last_became_peered":"2023-08-22T00:42:36.072655+0000","last_unstale":"2023-08-22T00:42:36.082212+0000","last_undegraded":"2023-08-22T00:42:36.082212+0000","last_fullsized":"2023-08-22T00:42:36.082212+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.33","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080392+0000","last_change":"2023-08-22T00:42:35.692030+0000","last_active":"2023-08-22T00:42:36.080392+0000","last_peered":"2023-08-22T00:42:36.080392+0000","last_clean":"2023-08-22T00:42:36.080392+0000","last_became_active":"2023-08-22T00:42:35.691766+0000","last_became_peered":"2023-08-22T00:42:35.691766+0000","last_unstale":"2023-08-22T00:42:36.080392+0000","last_undegraded":"2023-08-22T00:42:36.080392+0000","last_fullsized":"2023-08-22T00:42:36.080392+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083938+0000","last_change":"2023-08-22T00:42:36.081908+0000","last_active":"2023-08-22T00:42:36.083938+0000","last_peered":"2023-08-22T00:42:36.083938+0000","last_clean":"2023-08-22T00:42:36.083938+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.083938+0000","last_undegraded":"2023-08-22T00:42:36.083938+0000","last_fullsized":"2023-08-22T00:42:36.083938+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073379+0000","last_change":"2023-08-22T00:42:35.703347+0000","last_active":"2023-08-22T00:42:36.073379+0000","last_peered":"2023-08-22T00:42:36.073379+0000","last_clean":"2023-08-22T00:42:36.073379+0000","last_became_active":"2023-08-22T00:42:35.703000+0000","last_became_peered":"2023-08-22T00:42:35.703000+0000","last_unstale":"2023-08-22T00:42:36.073379+0000","last_undegraded":"2023-08-22T00:42:36.073379+0000","last_fullsized":"2023-08-22T00:42:36.073379+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088953+0000","last_change":"2023-08-22T00:42:36.083796+0000","last_active":"2023-08-22T00:42:36.088953+0000","last_peered":"2023-08-22T00:42:36.088953+0000","last_clean":"2023-08-22T00:42:36.088953+0000","last_became_active":"2023-08-22T00:42:36.083529+0000","last_became_peered":"2023-08-22T00:42:36.083529+0000","last_unstale":"2023-08-22T00:42:36.088953+0000","last_undegraded":"2023-08-22T00:42:36.088953+0000","last_fullsized":"2023-08-22T00:42:36.088953+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075331+0000","last_change":"2023-08-22T00:42:35.698174+0000","last_active":"2023-08-22T00:42:36.075331+0000","last_peered":"2023-08-22T00:42:36.075331+0000","last_clean":"2023-08-22T00:42:36.075331+0000","last_became_active":"2023-08-22T00:42:35.697278+0000","last_became_peered":"2023-08-22T00:42:35.697278+0000","last_unstale":"2023-08-22T00:42:36.075331+0000","last_undegraded":"2023-08-22T00:42:36.075331+0000","last_fullsized":"2023-08-22T00:42:36.075331+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085074+0000","last_change":"2023-08-22T00:42:36.081658+0000","last_active":"2023-08-22T00:42:36.085074+0000","last_peered":"2023-08-22T00:42:36.085074+0000","last_clean":"2023-08-22T00:42:36.085074+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.085074+0000","last_undegraded":"2023-08-22T00:42:36.085074+0000","last_fullsized":"2023-08-22T00:42:36.085074+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089151+0000","last_change":"2023-08-22T00:42:35.694698+0000","last_active":"2023-08-22T00:42:36.089151+0000","last_peered":"2023-08-22T00:42:36.089151+0000","last_clean":"2023-08-22T00:42:36.089151+0000","last_became_active":"2023-08-22T00:42:35.694410+0000","last_became_peered":"2023-08-22T00:42:35.694410+0000","last_unstale":"2023-08-22T00:42:36.089151+0000","last_undegraded":"2023-08-22T00:42:36.089151+0000","last_fullsized":"2023-08-22T00:42:36.089151+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089792+0000","last_change":"2023-08-22T00:42:36.087220+0000","last_active":"2023-08-22T00:42:36.089792+0000","last_peered":"2023-08-22T00:42:36.089792+0000","last_clean":"2023-08-22T00:42:36.089792+0000","last_became_active":"2023-08-22T00:42:36.086988+0000","last_became_peered":"2023-08-22T00:42:36.086988+0000","last_unstale":"2023-08-22T00:42:36.089792+0000","last_undegraded":"2023-08-22T00:42:36.089792+0000","last_fullsized":"2023-08-22T00:42:36.089792+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077513+0000","last_change":"2023-08-22T00:42:35.695029+0000","last_active":"2023-08-22T00:42:36.077513+0000","last_peered":"2023-08-22T00:42:36.077513+0000","last_clean":"2023-08-22T00:42:36.077513+0000","last_became_active":"2023-08-22T00:42:35.694732+0000","last_became_peered":"2023-08-22T00:42:35.694732+0000","last_unstale":"2023-08-22T00:42:36.077513+0000","last_undegraded":"2023-08-22T00:42:36.077513+0000","last_fullsized":"2023-08-22T00:42:36.077513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089382+0000","last_change":"2023-08-22T00:42:36.085368+0000","last_active":"2023-08-22T00:42:36.089382+0000","last_peered":"2023-08-22T00:42:36.089382+0000","last_clean":"2023-08-22T00:42:36.089382+0000","last_became_active":"2023-08-22T00:42:36.084691+0000","last_became_peered":"2023-08-22T00:42:36.084691+0000","last_unstale":"2023-08-22T00:42:36.089382+0000","last_undegraded":"2023-08-22T00:42:36.089382+0000","last_fullsized":"2023-08-22T00:42:36.089382+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067122+0000","last_change":"2023-08-22T00:42:35.708165+0000","last_active":"2023-08-22T00:42:36.067122+0000","last_peered":"2023-08-22T00:42:36.067122+0000","last_clean":"2023-08-22T00:42:36.067122+0000","last_became_active":"2023-08-22T00:42:35.707717+0000","last_became_peered":"2023-08-22T00:42:35.707717+0000","last_unstale":"2023-08-22T00:42:36.067122+0000","last_undegraded":"2023-08-22T00:42:36.067122+0000","last_fullsized":"2023-08-22T00:42:36.067122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082237+0000","last_change":"2023-08-22T00:42:36.073104+0000","last_active":"2023-08-22T00:42:36.082237+0000","last_peered":"2023-08-22T00:42:36.082237+0000","last_clean":"2023-08-22T00:42:36.082237+0000","last_became_active":"2023-08-22T00:42:36.072850+0000","last_became_peered":"2023-08-22T00:42:36.072850+0000","last_unstale":"2023-08-22T00:42:36.082237+0000","last_undegraded":"2023-08-22T00:42:36.082237+0000","last_fullsized":"2023-08-22T00:42:36.082237+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091024+0000","last_change":"2023-08-22T00:42:35.697336+0000","last_active":"2023-08-22T00:42:36.091024+0000","last_peered":"2023-08-22T00:42:36.091024+0000","last_clean":"2023-08-22T00:42:36.091024+0000","last_became_active":"2023-08-22T00:42:35.696771+0000","last_became_peered":"2023-08-22T00:42:35.696771+0000","last_unstale":"2023-08-22T00:42:36.091024+0000","last_undegraded":"2023-08-22T00:42:36.091024+0000","last_fullsized":"2023-08-22T00:42:36.091024+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095025+0000","last_change":"2023-08-22T00:42:36.091242+0000","last_active":"2023-08-22T00:42:36.095025+0000","last_peered":"2023-08-22T00:42:36.095025+0000","last_clean":"2023-08-22T00:42:36.095025+0000","last_became_active":"2023-08-22T00:42:36.090867+0000","last_became_peered":"2023-08-22T00:42:36.090867+0000","last_unstale":"2023-08-22T00:42:36.095025+0000","last_undegraded":"2023-08-22T00:42:36.095025+0000","last_fullsized":"2023-08-22T00:42:36.095025+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068842+0000","last_change":"2023-08-22T00:42:35.698537+0000","last_active":"2023-08-22T00:42:36.068842+0000","last_peered":"2023-08-22T00:42:36.068842+0000","last_clean":"2023-08-22T00:42:36.068842+0000","last_became_active":"2023-08-22T00:42:35.698261+0000","last_became_peered":"2023-08-22T00:42:35.698261+0000","last_unstale":"2023-08-22T00:42:36.068842+0000","last_undegraded":"2023-08-22T00:42:36.068842+0000","last_fullsized":"2023-08-22T00:42:36.068842+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084714+0000","last_change":"2023-08-22T00:42:36.078204+0000","last_active":"2023-08-22T00:42:36.084714+0000","last_peered":"2023-08-22T00:42:36.084714+0000","last_clean":"2023-08-22T00:42:36.084714+0000","last_became_active":"2023-08-22T00:42:36.077938+0000","last_became_peered":"2023-08-22T00:42:36.077938+0000","last_unstale":"2023-08-22T00:42:36.084714+0000","last_undegraded":"2023-08-22T00:42:36.084714+0000","last_fullsized":"2023-08-22T00:42:36.084714+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086257+0000","last_change":"2023-08-22T00:42:35.700351+0000","last_active":"2023-08-22T00:42:36.086257+0000","last_peered":"2023-08-22T00:42:36.086257+0000","last_clean":"2023-08-22T00:42:36.086257+0000","last_became_active":"2023-08-22T00:42:35.699937+0000","last_became_peered":"2023-08-22T00:42:35.699937+0000","last_unstale":"2023-08-22T00:42:36.086257+0000","last_undegraded":"2023-08-22T00:42:36.086257+0000","last_fullsized":"2023-08-22T00:42:36.086257+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089331+0000","last_change":"2023-08-22T00:42:36.084919+0000","last_active":"2023-08-22T00:42:36.089331+0000","last_peered":"2023-08-22T00:42:36.089331+0000","last_clean":"2023-08-22T00:42:36.089331+0000","last_became_active":"2023-08-22T00:42:36.084626+0000","last_became_peered":"2023-08-22T00:42:36.084626+0000","last_unstale":"2023-08-22T00:42:36.089331+0000","last_undegraded":"2023-08-22T00:42:36.089331+0000","last_fullsized":"2023-08-22T00:42:36.089331+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.697644+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.696923+0000","last_became_peered":"2023-08-22T00:42:35.696923+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084871+0000","last_change":"2023-08-22T00:42:36.079869+0000","last_active":"2023-08-22T00:42:36.084871+0000","last_peered":"2023-08-22T00:42:36.084871+0000","last_clean":"2023-08-22T00:42:36.084871+0000","last_became_active":"2023-08-22T00:42:36.079596+0000","last_became_peered":"2023-08-22T00:42:36.079596+0000","last_unstale":"2023-08-22T00:42:36.084871+0000","last_undegraded":"2023-08-22T00:42:36.084871+0000","last_fullsized":"2023-08-22T00:42:36.084871+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078456+0000","last_change":"2023-08-22T00:42:35.693985+0000","last_active":"2023-08-22T00:42:36.078456+0000","last_peered":"2023-08-22T00:42:36.078456+0000","last_clean":"2023-08-22T00:42:36.078456+0000","last_became_active":"2023-08-22T00:42:35.693441+0000","last_became_peered":"2023-08-22T00:42:35.693441+0000","last_unstale":"2023-08-22T00:42:36.078456+0000","last_undegraded":"2023-08-22T00:42:36.078456+0000","last_fullsized":"2023-08-22T00:42:36.078456+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089396+0000","last_change":"2023-08-22T00:42:36.086123+0000","last_active":"2023-08-22T00:42:36.089396+0000","last_peered":"2023-08-22T00:42:36.089396+0000","last_clean":"2023-08-22T00:42:36.089396+0000","last_became_active":"2023-08-22T00:42:36.085879+0000","last_became_peered":"2023-08-22T00:42:36.085879+0000","last_unstale":"2023-08-22T00:42:36.089396+0000","last_undegraded":"2023-08-22T00:42:36.089396+0000","last_fullsized":"2023-08-22T00:42:36.089396+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065509+0000","last_change":"2023-08-22T00:42:35.696870+0000","last_active":"2023-08-22T00:42:36.065509+0000","last_peered":"2023-08-22T00:42:36.065509+0000","last_clean":"2023-08-22T00:42:36.065509+0000","last_became_active":"2023-08-22T00:42:35.696586+0000","last_became_peered":"2023-08-22T00:42:35.696586+0000","last_unstale":"2023-08-22T00:42:36.065509+0000","last_undegraded":"2023-08-22T00:42:36.065509+0000","last_fullsized":"2023-08-22T00:42:36.065509+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082403+0000","last_change":"2023-08-22T00:42:36.079739+0000","last_active":"2023-08-22T00:42:36.082403+0000","last_peered":"2023-08-22T00:42:36.082403+0000","last_clean":"2023-08-22T00:42:36.082403+0000","last_became_active":"2023-08-22T00:42:36.079533+0000","last_became_peered":"2023-08-22T00:42:36.079533+0000","last_unstale":"2023-08-22T00:42:36.082403+0000","last_undegraded":"2023-08-22T00:42:36.082403+0000","last_fullsized":"2023-08-22T00:42:36.082403+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065547+0000","last_change":"2023-08-22T00:42:35.703851+0000","last_active":"2023-08-22T00:42:36.065547+0000","last_peered":"2023-08-22T00:42:36.065547+0000","last_clean":"2023-08-22T00:42:36.065547+0000","last_became_active":"2023-08-22T00:42:35.703351+0000","last_became_peered":"2023-08-22T00:42:35.703351+0000","last_unstale":"2023-08-22T00:42:36.065547+0000","last_undegraded":"2023-08-22T00:42:36.065547+0000","last_fullsized":"2023-08-22T00:42:36.065547+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094006+0000","last_change":"2023-08-22T00:42:36.093092+0000","last_active":"2023-08-22T00:42:36.094006+0000","last_peered":"2023-08-22T00:42:36.094006+0000","last_clean":"2023-08-22T00:42:36.094006+0000","last_became_active":"2023-08-22T00:42:36.092838+0000","last_became_peered":"2023-08-22T00:42:36.092838+0000","last_unstale":"2023-08-22T00:42:36.094006+0000","last_undegraded":"2023-08-22T00:42:36.094006+0000","last_fullsized":"2023-08-22T00:42:36.094006+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.585513+0000","last_change":"2023-08-22T00:42:35.707578+0000","last_active":"2023-08-22T00:42:36.585513+0000","last_peered":"2023-08-22T00:42:36.585513+0000","last_clean":"2023-08-22T00:42:36.585513+0000","last_became_active":"2023-08-22T00:42:35.707312+0000","last_became_peered":"2023-08-22T00:42:35.707312+0000","last_unstale":"2023-08-22T00:42:36.585513+0000","last_undegraded":"2023-08-22T00:42:36.585513+0000","last_fullsized":"2023-08-22T00:42:36.585513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092444+0000","last_change":"2023-08-22T00:42:36.091325+0000","last_active":"2023-08-22T00:42:36.092444+0000","last_peered":"2023-08-22T00:42:36.092444+0000","last_clean":"2023-08-22T00:42:36.092444+0000","last_became_active":"2023-08-22T00:42:36.091084+0000","last_became_peered":"2023-08-22T00:42:36.091084+0000","last_unstale":"2023-08-22T00:42:36.092444+0000","last_undegraded":"2023-08-22T00:42:36.092444+0000","last_fullsized":"2023-08-22T00:42:36.092444+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061715+0000","last_change":"2023-08-22T00:42:35.700601+0000","last_active":"2023-08-22T00:42:36.061715+0000","last_peered":"2023-08-22T00:42:36.061715+0000","last_clean":"2023-08-22T00:42:36.061715+0000","last_became_active":"2023-08-22T00:42:35.699913+0000","last_became_peered":"2023-08-22T00:42:35.699913+0000","last_unstale":"2023-08-22T00:42:36.061715+0000","last_undegraded":"2023-08-22T00:42:36.061715+0000","last_fullsized":"2023-08-22T00:42:36.061715+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081847+0000","last_change":"2023-08-22T00:42:36.071045+0000","last_active":"2023-08-22T00:42:36.081847+0000","last_peered":"2023-08-22T00:42:36.081847+0000","last_clean":"2023-08-22T00:42:36.081847+0000","last_became_active":"2023-08-22T00:42:36.070755+0000","last_became_peered":"2023-08-22T00:42:36.070755+0000","last_unstale":"2023-08-22T00:42:36.081847+0000","last_undegraded":"2023-08-22T00:42:36.081847+0000","last_fullsized":"2023-08-22T00:42:36.081847+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065363+0000","last_change":"2023-08-22T00:42:35.693184+0000","last_active":"2023-08-22T00:42:36.065363+0000","last_peered":"2023-08-22T00:42:36.065363+0000","last_clean":"2023-08-22T00:42:36.065363+0000","last_became_active":"2023-08-22T00:42:35.692904+0000","last_became_peered":"2023-08-22T00:42:35.692904+0000","last_unstale":"2023-08-22T00:42:36.065363+0000","last_undegraded":"2023-08-22T00:42:36.065363+0000","last_fullsized":"2023-08-22T00:42:36.065363+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090607+0000","last_change":"2023-08-22T00:42:36.089844+0000","last_active":"2023-08-22T00:42:36.090607+0000","last_peered":"2023-08-22T00:42:36.090607+0000","last_clean":"2023-08-22T00:42:36.090607+0000","last_became_active":"2023-08-22T00:42:36.089541+0000","last_became_peered":"2023-08-22T00:42:36.089541+0000","last_unstale":"2023-08-22T00:42:36.090607+0000","last_undegraded":"2023-08-22T00:42:36.090607+0000","last_fullsized":"2023-08-22T00:42:36.090607+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078362+0000","last_change":"2023-08-22T00:42:35.702784+0000","last_active":"2023-08-22T00:42:36.078362+0000","last_peered":"2023-08-22T00:42:36.078362+0000","last_clean":"2023-08-22T00:42:36.078362+0000","last_became_active":"2023-08-22T00:42:35.702330+0000","last_became_peered":"2023-08-22T00:42:35.702330+0000","last_unstale":"2023-08-22T00:42:36.078362+0000","last_undegraded":"2023-08-22T00:42:36.078362+0000","last_fullsized":"2023-08-22T00:42:36.078362+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082483+0000","last_change":"2023-08-22T00:42:36.074647+0000","last_active":"2023-08-22T00:42:36.082483+0000","last_peered":"2023-08-22T00:42:36.082483+0000","last_clean":"2023-08-22T00:42:36.082483+0000","last_became_active":"2023-08-22T00:42:36.074358+0000","last_became_peered":"2023-08-22T00:42:36.074358+0000","last_unstale":"2023-08-22T00:42:36.082483+0000","last_undegraded":"2023-08-22T00:42:36.082483+0000","last_fullsized":"2023-08-22T00:42:36.082483+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065098+0000","last_change":"2023-08-22T00:42:35.692314+0000","last_active":"2023-08-22T00:42:36.065098+0000","last_peered":"2023-08-22T00:42:36.065098+0000","last_clean":"2023-08-22T00:42:36.065098+0000","last_became_active":"2023-08-22T00:42:35.692025+0000","last_became_peered":"2023-08-22T00:42:35.692025+0000","last_unstale":"2023-08-22T00:42:36.065098+0000","last_undegraded":"2023-08-22T00:42:36.065098+0000","last_fullsized":"2023-08-22T00:42:36.065098+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076235+0000","last_change":"2023-08-22T00:42:36.069799+0000","last_active":"2023-08-22T00:42:36.076235+0000","last_peered":"2023-08-22T00:42:36.076235+0000","last_clean":"2023-08-22T00:42:36.076235+0000","last_became_active":"2023-08-22T00:42:36.069542+0000","last_became_peered":"2023-08-22T00:42:36.069542+0000","last_unstale":"2023-08-22T00:42:36.076235+0000","last_undegraded":"2023-08-22T00:42:36.076235+0000","last_fullsized":"2023-08-22T00:42:36.076235+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.060768+0000","last_change":"2023-08-22T00:42:35.692998+0000","last_active":"2023-08-22T00:42:36.060768+0000","last_peered":"2023-08-22T00:42:36.060768+0000","last_clean":"2023-08-22T00:42:36.060768+0000","last_became_active":"2023-08-22T00:42:35.692737+0000","last_became_peered":"2023-08-22T00:42:35.692737+0000","last_unstale":"2023-08-22T00:42:36.060768+0000","last_undegraded":"2023-08-22T00:42:36.060768+0000","last_fullsized":"2023-08-22T00:42:36.060768+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091739+0000","last_change":"2023-08-22T00:42:36.091030+0000","last_active":"2023-08-22T00:42:36.091739+0000","last_peered":"2023-08-22T00:42:36.091739+0000","last_clean":"2023-08-22T00:42:36.091739+0000","last_became_active":"2023-08-22T00:42:36.090750+0000","last_became_peered":"2023-08-22T00:42:36.090750+0000","last_unstale":"2023-08-22T00:42:36.091739+0000","last_undegraded":"2023-08-22T00:42:36.091739+0000","last_fullsized":"2023-08-22T00:42:36.091739+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078352+0000","last_change":"2023-08-22T00:42:35.694202+0000","last_active":"2023-08-22T00:42:36.078352+0000","last_peered":"2023-08-22T00:42:36.078352+0000","last_clean":"2023-08-22T00:42:36.078352+0000","last_became_active":"2023-08-22T00:42:35.693927+0000","last_became_peered":"2023-08-22T00:42:35.693927+0000","last_unstale":"2023-08-22T00:42:36.078352+0000","last_undegraded":"2023-08-22T00:42:36.078352+0000","last_fullsized":"2023-08-22T00:42:36.078352+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082420+0000","last_change":"2023-08-22T00:42:36.080889+0000","last_active":"2023-08-22T00:42:36.082420+0000","last_peered":"2023-08-22T00:42:36.082420+0000","last_clean":"2023-08-22T00:42:36.082420+0000","last_became_active":"2023-08-22T00:42:36.080670+0000","last_became_peered":"2023-08-22T00:42:36.080670+0000","last_unstale":"2023-08-22T00:42:36.082420+0000","last_undegraded":"2023-08-22T00:42:36.082420+0000","last_fullsized":"2023-08-22T00:42:36.082420+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083383+0000","last_change":"2023-08-22T00:42:35.706207+0000","last_active":"2023-08-22T00:42:36.083383+0000","last_peered":"2023-08-22T00:42:36.083383+0000","last_clean":"2023-08-22T00:42:36.083383+0000","last_became_active":"2023-08-22T00:42:35.705967+0000","last_became_peered":"2023-08-22T00:42:35.705967+0000","last_unstale":"2023-08-22T00:42:36.083383+0000","last_undegraded":"2023-08-22T00:42:36.083383+0000","last_fullsized":"2023-08-22T00:42:36.083383+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091687+0000","last_change":"2023-08-22T00:42:36.090343+0000","last_active":"2023-08-22T00:42:36.091687+0000","last_peered":"2023-08-22T00:42:36.091687+0000","last_clean":"2023-08-22T00:42:36.091687+0000","last_became_active":"2023-08-22T00:42:36.090065+0000","last_became_peered":"2023-08-22T00:42:36.090065+0000","last_unstale":"2023-08-22T00:42:36.091687+0000","last_undegraded":"2023-08-22T00:42:36.091687+0000","last_fullsized":"2023-08-22T00:42:36.091687+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089588+0000","last_change":"2023-08-22T00:42:35.694428+0000","last_active":"2023-08-22T00:42:36.089588+0000","last_peered":"2023-08-22T00:42:36.089588+0000","last_clean":"2023-08-22T00:42:36.089588+0000","last_became_active":"2023-08-22T00:42:35.694058+0000","last_became_peered":"2023-08-22T00:42:35.694058+0000","last_unstale":"2023-08-22T00:42:36.089588+0000","last_undegraded":"2023-08-22T00:42:36.089588+0000","last_fullsized":"2023-08-22T00:42:36.089588+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089328+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089328+0000","last_peered":"2023-08-22T00:42:36.089328+0000","last_clean":"2023-08-22T00:42:36.089328+0000","last_became_active":"2023-08-22T00:42:36.084713+0000","last_became_peered":"2023-08-22T00:42:36.084713+0000","last_unstale":"2023-08-22T00:42:36.089328+0000","last_undegraded":"2023-08-22T00:42:36.089328+0000","last_fullsized":"2023-08-22T00:42:36.089328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085648+0000","last_change":"2023-08-22T00:42:35.693957+0000","last_active":"2023-08-22T00:42:36.085648+0000","last_peered":"2023-08-22T00:42:36.085648+0000","last_clean":"2023-08-22T00:42:36.085648+0000","last_became_active":"2023-08-22T00:42:35.693519+0000","last_became_peered":"2023-08-22T00:42:35.693519+0000","last_unstale":"2023-08-22T00:42:36.085648+0000","last_undegraded":"2023-08-22T00:42:36.085648+0000","last_fullsized":"2023-08-22T00:42:36.085648+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087699+0000","last_change":"2023-08-22T00:42:36.087113+0000","last_active":"2023-08-22T00:42:36.087699+0000","last_peered":"2023-08-22T00:42:36.087699+0000","last_clean":"2023-08-22T00:42:36.087699+0000","last_became_active":"2023-08-22T00:42:36.086845+0000","last_became_peered":"2023-08-22T00:42:36.086845+0000","last_unstale":"2023-08-22T00:42:36.087699+0000","last_undegraded":"2023-08-22T00:42:36.087699+0000","last_fullsized":"2023-08-22T00:42:36.087699+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075543+0000","last_change":"2023-08-22T00:42:35.698989+0000","last_active":"2023-08-22T00:42:36.075543+0000","last_peered":"2023-08-22T00:42:36.075543+0000","last_clean":"2023-08-22T00:42:36.075543+0000","last_became_active":"2023-08-22T00:42:35.698572+0000","last_became_peered":"2023-08-22T00:42:35.698572+0000","last_unstale":"2023-08-22T00:42:36.075543+0000","last_undegraded":"2023-08-22T00:42:36.075543+0000","last_fullsized":"2023-08-22T00:42:36.075543+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082405+0000","last_change":"2023-08-22T00:42:36.077109+0000","last_active":"2023-08-22T00:42:36.082405+0000","last_peered":"2023-08-22T00:42:36.082405+0000","last_clean":"2023-08-22T00:42:36.082405+0000","last_became_active":"2023-08-22T00:42:36.076846+0000","last_became_peered":"2023-08-22T00:42:36.076846+0000","last_unstale":"2023-08-22T00:42:36.082405+0000","last_undegraded":"2023-08-22T00:42:36.082405+0000","last_fullsized":"2023-08-22T00:42:36.082405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.703193+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.702916+0000","last_became_peered":"2023-08-22T00:42:35.702916+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081698+0000","last_change":"2023-08-22T00:42:36.077408+0000","last_active":"2023-08-22T00:42:36.081698+0000","last_peered":"2023-08-22T00:42:36.081698+0000","last_clean":"2023-08-22T00:42:36.081698+0000","last_became_active":"2023-08-22T00:42:36.077181+0000","last_became_peered":"2023-08-22T00:42:36.077181+0000","last_unstale":"2023-08-22T00:42:36.081698+0000","last_undegraded":"2023-08-22T00:42:36.081698+0000","last_fullsized":"2023-08-22T00:42:36.081698+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075565+0000","last_change":"2023-08-22T00:42:35.694331+0000","last_active":"2023-08-22T00:42:36.075565+0000","last_peered":"2023-08-22T00:42:36.075565+0000","last_clean":"2023-08-22T00:42:36.075565+0000","last_became_active":"2023-08-22T00:42:35.693957+0000","last_became_peered":"2023-08-22T00:42:35.693957+0000","last_unstale":"2023-08-22T00:42:36.075565+0000","last_undegraded":"2023-08-22T00:42:36.075565+0000","last_fullsized":"2023-08-22T00:42:36.075565+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080328+0000","last_change":"2023-08-22T00:42:36.074405+0000","last_active":"2023-08-22T00:42:36.080328+0000","last_peered":"2023-08-22T00:42:36.080328+0000","last_clean":"2023-08-22T00:42:36.080328+0000","last_became_active":"2023-08-22T00:42:36.074139+0000","last_became_peered":"2023-08-22T00:42:36.074139+0000","last_unstale":"2023-08-22T00:42:36.080328+0000","last_undegraded":"2023-08-22T00:42:36.080328+0000","last_fullsized":"2023-08-22T00:42:36.080328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076266+0000","last_change":"2023-08-22T00:42:35.696055+0000","last_active":"2023-08-22T00:42:36.076266+0000","last_peered":"2023-08-22T00:42:36.076266+0000","last_clean":"2023-08-22T00:42:36.076266+0000","last_became_active":"2023-08-22T00:42:35.695791+0000","last_became_peered":"2023-08-22T00:42:35.695791+0000","last_unstale":"2023-08-22T00:42:36.076266+0000","last_undegraded":"2023-08-22T00:42:36.076266+0000","last_fullsized":"2023-08-22T00:42:36.076266+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086658+0000","last_change":"2023-08-22T00:42:36.070358+0000","last_active":"2023-08-22T00:42:36.086658+0000","last_peered":"2023-08-22T00:42:36.086658+0000","last_clean":"2023-08-22T00:42:36.086658+0000","last_became_active":"2023-08-22T00:42:36.070096+0000","last_became_peered":"2023-08-22T00:42:36.070096+0000","last_unstale":"2023-08-22T00:42:36.086658+0000","last_undegraded":"2023-08-22T00:42:36.086658+0000","last_fullsized":"2023-08-22T00:42:36.086658+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068690+0000","last_change":"2023-08-22T00:42:35.694037+0000","last_active":"2023-08-22T00:42:36.068690+0000","last_peered":"2023-08-22T00:42:36.068690+0000","last_clean":"2023-08-22T00:42:36.068690+0000","last_became_active":"2023-08-22T00:42:35.693656+0000","last_became_peered":"2023-08-22T00:42:35.693656+0000","last_unstale":"2023-08-22T00:42:36.068690+0000","last_undegraded":"2023-08-22T00:42:36.068690+0000","last_fullsized":"2023-08-22T00:42:36.068690+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089457+0000","last_change":"2023-08-22T00:42:36.087233+0000","last_active":"2023-08-22T00:42:36.089457+0000","last_peered":"2023-08-22T00:42:36.089457+0000","last_clean":"2023-08-22T00:42:36.089457+0000","last_became_active":"2023-08-22T00:42:36.086969+0000","last_became_peered":"2023-08-22T00:42:36.086969+0000","last_unstale":"2023-08-22T00:42:36.089457+0000","last_undegraded":"2023-08-22T00:42:36.089457+0000","last_fullsized":"2023-08-22T00:42:36.089457+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085670+0000","last_change":"2023-08-22T00:42:35.703653+0000","last_active":"2023-08-22T00:42:36.085670+0000","last_peered":"2023-08-22T00:42:36.085670+0000","last_clean":"2023-08-22T00:42:36.085670+0000","last_became_active":"2023-08-22T00:42:35.703058+0000","last_became_peered":"2023-08-22T00:42:35.703058+0000","last_unstale":"2023-08-22T00:42:36.085670+0000","last_undegraded":"2023-08-22T00:42:36.085670+0000","last_fullsized":"2023-08-22T00:42:36.085670+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095258+0000","last_change":"2023-08-22T00:42:36.090905+0000","last_active":"2023-08-22T00:42:36.095258+0000","last_peered":"2023-08-22T00:42:36.095258+0000","last_clean":"2023-08-22T00:42:36.095258+0000","last_became_active":"2023-08-22T00:42:36.090604+0000","last_became_peered":"2023-08-22T00:42:36.090604+0000","last_unstale":"2023-08-22T00:42:36.095258+0000","last_undegraded":"2023-08-22T00:42:36.095258+0000","last_fullsized":"2023-08-22T00:42:36.095258+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082438+0000","last_change":"2023-08-22T00:42:35.707915+0000","last_active":"2023-08-22T00:42:36.082438+0000","last_peered":"2023-08-22T00:42:36.082438+0000","last_clean":"2023-08-22T00:42:36.082438+0000","last_became_active":"2023-08-22T00:42:35.707622+0000","last_became_peered":"2023-08-22T00:42:35.707622+0000","last_unstale":"2023-08-22T00:42:36.082438+0000","last_undegraded":"2023-08-22T00:42:36.082438+0000","last_fullsized":"2023-08-22T00:42:36.082438+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083264+0000","last_change":"2023-08-22T00:42:36.081027+0000","last_active":"2023-08-22T00:42:36.083264+0000","last_peered":"2023-08-22T00:42:36.083264+0000","last_clean":"2023-08-22T00:42:36.083264+0000","last_became_active":"2023-08-22T00:42:36.080704+0000","last_became_peered":"2023-08-22T00:42:36.080704+0000","last_unstale":"2023-08-22T00:42:36.083264+0000","last_undegraded":"2023-08-22T00:42:36.083264+0000","last_fullsized":"2023-08-22T00:42:36.083264+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069133+0000","last_change":"2023-08-22T00:42:35.697534+0000","last_active":"2023-08-22T00:42:36.069133+0000","last_peered":"2023-08-22T00:42:36.069133+0000","last_clean":"2023-08-22T00:42:36.069133+0000","last_became_active":"2023-08-22T00:42:35.697068+0000","last_became_peered":"2023-08-22T00:42:35.697068+0000","last_unstale":"2023-08-22T00:42:36.069133+0000","last_undegraded":"2023-08-22T00:42:36.069133+0000","last_fullsized":"2023-08-22T00:42:36.069133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095317+0000","last_change":"2023-08-22T00:42:36.090976+0000","last_active":"2023-08-22T00:42:36.095317+0000","last_peered":"2023-08-22T00:42:36.095317+0000","last_clean":"2023-08-22T00:42:36.095317+0000","last_became_active":"2023-08-22T00:42:36.090706+0000","last_became_peered":"2023-08-22T00:42:36.090706+0000","last_unstale":"2023-08-22T00:42:36.095317+0000","last_undegraded":"2023-08-22T00:42:36.095317+0000","last_fullsized":"2023-08-22T00:42:36.095317+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068926+0000","last_change":"2023-08-22T00:42:35.703709+0000","last_active":"2023-08-22T00:42:36.068926+0000","last_peered":"2023-08-22T00:42:36.068926+0000","last_clean":"2023-08-22T00:42:36.068926+0000","last_became_active":"2023-08-22T00:42:35.703366+0000","last_became_peered":"2023-08-22T00:42:35.703366+0000","last_unstale":"2023-08-22T00:42:36.068926+0000","last_undegraded":"2023-08-22T00:42:36.068926+0000","last_fullsized":"2023-08-22T00:42:36.068926+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082189+0000","last_change":"2023-08-22T00:42:36.072341+0000","last_active":"2023-08-22T00:42:36.082189+0000","last_peered":"2023-08-22T00:42:36.082189+0000","last_clean":"2023-08-22T00:42:36.082189+0000","last_became_active":"2023-08-22T00:42:36.072023+0000","last_became_peered":"2023-08-22T00:42:36.072023+0000","last_unstale":"2023-08-22T00:42:36.082189+0000","last_undegraded":"2023-08-22T00:42:36.082189+0000","last_fullsized":"2023-08-22T00:42:36.082189+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085393+0000","last_change":"2023-08-22T00:42:35.694175+0000","last_active":"2023-08-22T00:42:36.085393+0000","last_peered":"2023-08-22T00:42:36.085393+0000","last_clean":"2023-08-22T00:42:36.085393+0000","last_became_active":"2023-08-22T00:42:35.693860+0000","last_became_peered":"2023-08-22T00:42:35.693860+0000","last_unstale":"2023-08-22T00:42:36.085393+0000","last_undegraded":"2023-08-22T00:42:36.085393+0000","last_fullsized":"2023-08-22T00:42:36.085393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079353+0000","last_change":"2023-08-22T00:42:36.072895+0000","last_active":"2023-08-22T00:42:36.079353+0000","last_peered":"2023-08-22T00:42:36.079353+0000","last_clean":"2023-08-22T00:42:36.079353+0000","last_became_active":"2023-08-22T00:42:36.072645+0000","last_became_peered":"2023-08-22T00:42:36.072645+0000","last_unstale":"2023-08-22T00:42:36.079353+0000","last_undegraded":"2023-08-22T00:42:36.079353+0000","last_fullsized":"2023-08-22T00:42:36.079353+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068322+0000","last_change":"2023-08-22T00:42:35.698710+0000","last_active":"2023-08-22T00:42:36.068322+0000","last_peered":"2023-08-22T00:42:36.068322+0000","last_clean":"2023-08-22T00:42:36.068322+0000","last_became_active":"2023-08-22T00:42:35.697888+0000","last_became_peered":"2023-08-22T00:42:35.697888+0000","last_unstale":"2023-08-22T00:42:36.068322+0000","last_undegraded":"2023-08-22T00:42:36.068322+0000","last_fullsized":"2023-08-22T00:42:36.068322+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083294+0000","last_change":"2023-08-22T00:42:36.074593+0000","last_active":"2023-08-22T00:42:36.083294+0000","last_peered":"2023-08-22T00:42:36.083294+0000","last_clean":"2023-08-22T00:42:36.083294+0000","last_became_active":"2023-08-22T00:42:36.074298+0000","last_became_peered":"2023-08-22T00:42:36.074298+0000","last_unstale":"2023-08-22T00:42:36.083294+0000","last_undegraded":"2023-08-22T00:42:36.083294+0000","last_fullsized":"2023-08-22T00:42:36.083294+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075522+0000","last_change":"2023-08-22T00:42:35.705084+0000","last_active":"2023-08-22T00:42:36.075522+0000","last_peered":"2023-08-22T00:42:36.075522+0000","last_clean":"2023-08-22T00:42:36.075522+0000","last_became_active":"2023-08-22T00:42:35.704800+0000","last_became_peered":"2023-08-22T00:42:35.704800+0000","last_unstale":"2023-08-22T00:42:36.075522+0000","last_undegraded":"2023-08-22T00:42:36.075522+0000","last_fullsized":"2023-08-22T00:42:36.075522+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086678+0000","last_change":"2023-08-22T00:42:36.079855+0000","last_active":"2023-08-22T00:42:36.086678+0000","last_peered":"2023-08-22T00:42:36.086678+0000","last_clean":"2023-08-22T00:42:36.086678+0000","last_became_active":"2023-08-22T00:42:36.079573+0000","last_became_peered":"2023-08-22T00:42:36.079573+0000","last_unstale":"2023-08-22T00:42:36.086678+0000","last_undegraded":"2023-08-22T00:42:36.086678+0000","last_fullsized":"2023-08-22T00:42:36.086678+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068516+0000","last_change":"2023-08-22T00:42:35.698450+0000","last_active":"2023-08-22T00:42:36.068516+0000","last_peered":"2023-08-22T00:42:36.068516+0000","last_clean":"2023-08-22T00:42:36.068516+0000","last_became_active":"2023-08-22T00:42:35.697970+0000","last_became_peered":"2023-08-22T00:42:35.697970+0000","last_unstale":"2023-08-22T00:42:36.068516+0000","last_undegraded":"2023-08-22T00:42:36.068516+0000","last_fullsized":"2023-08-22T00:42:36.068516+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081694+0000","last_change":"2023-08-22T00:42:36.077800+0000","last_active":"2023-08-22T00:42:36.081694+0000","last_peered":"2023-08-22T00:42:36.081694+0000","last_clean":"2023-08-22T00:42:36.081694+0000","last_became_active":"2023-08-22T00:42:36.077548+0000","last_became_peered":"2023-08-22T00:42:36.077548+0000","last_unstale":"2023-08-22T00:42:36.081694+0000","last_undegraded":"2023-08-22T00:42:36.081694+0000","last_fullsized":"2023-08-22T00:42:36.081694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:35.701893+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:35.701618+0000","last_became_peered":"2023-08-22T00:42:35.701618+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079412+0000","last_change":"2023-08-22T00:42:36.071437+0000","last_active":"2023-08-22T00:42:36.079412+0000","last_peered":"2023-08-22T00:42:36.079412+0000","last_clean":"2023-08-22T00:42:36.079412+0000","last_became_active":"2023-08-22T00:42:36.071073+0000","last_became_peered":"2023-08-22T00:42:36.071073+0000","last_unstale":"2023-08-22T00:42:36.079412+0000","last_undegraded":"2023-08-22T00:42:36.079412+0000","last_fullsized":"2023-08-22T00:42:36.079412+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065786+0000","last_change":"2023-08-22T00:42:35.705325+0000","last_active":"2023-08-22T00:42:36.065786+0000","last_peered":"2023-08-22T00:42:36.065786+0000","last_clean":"2023-08-22T00:42:36.065786+0000","last_became_active":"2023-08-22T00:42:35.705040+0000","last_became_peered":"2023-08-22T00:42:35.705040+0000","last_unstale":"2023-08-22T00:42:36.065786+0000","last_undegraded":"2023-08-22T00:42:36.065786+0000","last_fullsized":"2023-08-22T00:42:36.065786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089348+0000","last_change":"2023-08-22T00:42:36.085076+0000","last_active":"2023-08-22T00:42:36.089348+0000","last_peered":"2023-08-22T00:42:36.089348+0000","last_clean":"2023-08-22T00:42:36.089348+0000","last_became_active":"2023-08-22T00:42:36.084805+0000","last_became_peered":"2023-08-22T00:42:36.084805+0000","last_unstale":"2023-08-22T00:42:36.089348+0000","last_undegraded":"2023-08-22T00:42:36.089348+0000","last_fullsized":"2023-08-22T00:42:36.089348+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073875+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.073875+0000","last_peered":"2023-08-22T00:42:36.073875+0000","last_clean":"2023-08-22T00:42:36.073875+0000","last_became_active":"2023-08-22T00:42:35.703299+0000","last_became_peered":"2023-08-22T00:42:35.703299+0000","last_unstale":"2023-08-22T00:42:36.073875+0000","last_undegraded":"2023-08-22T00:42:36.073875+0000","last_fullsized":"2023-08-22T00:42:36.073875+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077821+0000","last_change":"2023-08-22T00:42:36.073011+0000","last_active":"2023-08-22T00:42:36.077821+0000","last_peered":"2023-08-22T00:42:36.077821+0000","last_clean":"2023-08-22T00:42:36.077821+0000","last_became_active":"2023-08-22T00:42:36.072748+0000","last_became_peered":"2023-08-22T00:42:36.072748+0000","last_unstale":"2023-08-22T00:42:36.077821+0000","last_undegraded":"2023-08-22T00:42:36.077821+0000","last_fullsized":"2023-08-22T00:42:36.077821+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061097+0000","last_change":"2023-08-22T00:42:35.707981+0000","last_active":"2023-08-22T00:42:36.061097+0000","last_peered":"2023-08-22T00:42:36.061097+0000","last_clean":"2023-08-22T00:42:36.061097+0000","last_became_active":"2023-08-22T00:42:35.707707+0000","last_became_peered":"2023-08-22T00:42:35.707707+0000","last_unstale":"2023-08-22T00:42:36.061097+0000","last_undegraded":"2023-08-22T00:42:36.061097+0000","last_fullsized":"2023-08-22T00:42:36.061097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077525+0000","last_change":"2023-08-22T00:42:36.070339+0000","last_active":"2023-08-22T00:42:36.077525+0000","last_peered":"2023-08-22T00:42:36.077525+0000","last_clean":"2023-08-22T00:42:36.077525+0000","last_became_active":"2023-08-22T00:42:36.070079+0000","last_became_peered":"2023-08-22T00:42:36.070079+0000","last_unstale":"2023-08-22T00:42:36.077525+0000","last_undegraded":"2023-08-22T00:42:36.077525+0000","last_fullsized":"2023-08-22T00:42:36.077525+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078460+0000","last_change":"2023-08-22T00:42:35.702589+0000","last_active":"2023-08-22T00:42:36.078460+0000","last_peered":"2023-08-22T00:42:36.078460+0000","last_clean":"2023-08-22T00:42:36.078460+0000","last_became_active":"2023-08-22T00:42:35.701994+0000","last_became_peered":"2023-08-22T00:42:35.701994+0000","last_unstale":"2023-08-22T00:42:36.078460+0000","last_undegraded":"2023-08-22T00:42:36.078460+0000","last_fullsized":"2023-08-22T00:42:36.078460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091462+0000","last_change":"2023-08-22T00:42:36.089972+0000","last_active":"2023-08-22T00:42:36.091462+0000","last_peered":"2023-08-22T00:42:36.091462+0000","last_clean":"2023-08-22T00:42:36.091462+0000","last_became_active":"2023-08-22T00:42:36.089495+0000","last_became_peered":"2023-08-22T00:42:36.089495+0000","last_unstale":"2023-08-22T00:42:36.091462+0000","last_undegraded":"2023-08-22T00:42:36.091462+0000","last_fullsized":"2023-08-22T00:42:36.091462+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075343+0000","last_change":"2023-08-22T00:42:35.693692+0000","last_active":"2023-08-22T00:42:36.075343+0000","last_peered":"2023-08-22T00:42:36.075343+0000","last_clean":"2023-08-22T00:42:36.075343+0000","last_became_active":"2023-08-22T00:42:35.693368+0000","last_became_peered":"2023-08-22T00:42:35.693368+0000","last_unstale":"2023-08-22T00:42:36.075343+0000","last_undegraded":"2023-08-22T00:42:36.075343+0000","last_fullsized":"2023-08-22T00:42:36.075343+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088974+0000","last_change":"2023-08-22T00:42:36.084024+0000","last_active":"2023-08-22T00:42:36.088974+0000","last_peered":"2023-08-22T00:42:36.088974+0000","last_clean":"2023-08-22T00:42:36.088974+0000","last_became_active":"2023-08-22T00:42:36.083758+0000","last_became_peered":"2023-08-22T00:42:36.083758+0000","last_unstale":"2023-08-22T00:42:36.088974+0000","last_undegraded":"2023-08-22T00:42:36.088974+0000","last_fullsized":"2023-08-22T00:42:36.088974+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076319+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.076319+0000","last_peered":"2023-08-22T00:42:36.076319+0000","last_clean":"2023-08-22T00:42:36.076319+0000","last_became_active":"2023-08-22T00:42:35.703273+0000","last_became_peered":"2023-08-22T00:42:35.703273+0000","last_unstale":"2023-08-22T00:42:36.076319+0000","last_undegraded":"2023-08-22T00:42:36.076319+0000","last_fullsized":"2023-08-22T00:42:36.076319+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087627+0000","last_change":"2023-08-22T00:42:36.086483+0000","last_active":"2023-08-22T00:42:36.087627+0000","last_peered":"2023-08-22T00:42:36.087627+0000","last_clean":"2023-08-22T00:42:36.087627+0000","last_became_active":"2023-08-22T00:42:36.086162+0000","last_became_peered":"2023-08-22T00:42:36.086162+0000","last_unstale":"2023-08-22T00:42:36.087627+0000","last_undegraded":"2023-08-22T00:42:36.087627+0000","last_fullsized":"2023-08-22T00:42:36.087627+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078081+0000","last_change":"2023-08-22T00:42:35.693579+0000","last_active":"2023-08-22T00:42:36.078081+0000","last_peered":"2023-08-22T00:42:36.078081+0000","last_clean":"2023-08-22T00:42:36.078081+0000","last_became_active":"2023-08-22T00:42:35.693213+0000","last_became_peered":"2023-08-22T00:42:35.693213+0000","last_unstale":"2023-08-22T00:42:36.078081+0000","last_undegraded":"2023-08-22T00:42:36.078081+0000","last_fullsized":"2023-08-22T00:42:36.078081+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082872+0000","last_change":"2023-08-22T00:42:36.079973+0000","last_active":"2023-08-22T00:42:36.082872+0000","last_peered":"2023-08-22T00:42:36.082872+0000","last_clean":"2023-08-22T00:42:36.082872+0000","last_became_active":"2023-08-22T00:42:36.079730+0000","last_became_peered":"2023-08-22T00:42:36.079730+0000","last_unstale":"2023-08-22T00:42:36.082872+0000","last_undegraded":"2023-08-22T00:42:36.082872+0000","last_fullsized":"2023-08-22T00:42:36.082872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090735+0000","last_change":"2023-08-22T00:42:35.697425+0000","last_active":"2023-08-22T00:42:36.090735+0000","last_peered":"2023-08-22T00:42:36.090735+0000","last_clean":"2023-08-22T00:42:36.090735+0000","last_became_active":"2023-08-22T00:42:35.697041+0000","last_became_peered":"2023-08-22T00:42:35.697041+0000","last_unstale":"2023-08-22T00:42:36.090735+0000","last_undegraded":"2023-08-22T00:42:36.090735+0000","last_fullsized":"2023-08-22T00:42:36.090735+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075613+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:42:36.075613+0000","last_peered":"2023-08-22T00:42:36.075613+0000","last_clean":"2023-08-22T00:42:36.075613+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:42:36.075613+0000","last_undegraded":"2023-08-22T00:42:36.075613+0000","last_fullsized":"2023-08-22T00:42:36.075613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086586+0000","last_change":"2023-08-22T00:42:36.080857+0000","last_active":"2023-08-22T00:42:36.086586+0000","last_peered":"2023-08-22T00:42:36.086586+0000","last_clean":"2023-08-22T00:42:36.086586+0000","last_became_active":"2023-08-22T00:42:36.080591+0000","last_became_peered":"2023-08-22T00:42:36.080591+0000","last_unstale":"2023-08-22T00:42:36.086586+0000","last_undegraded":"2023-08-22T00:42:36.086586+0000","last_fullsized":"2023-08-22T00:42:36.086586+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067217+0000","last_change":"2023-08-22T00:42:35.708363+0000","last_active":"2023-08-22T00:42:36.067217+0000","last_peered":"2023-08-22T00:42:36.067217+0000","last_clean":"2023-08-22T00:42:36.067217+0000","last_became_active":"2023-08-22T00:42:35.707698+0000","last_became_peered":"2023-08-22T00:42:35.707698+0000","last_unstale":"2023-08-22T00:42:36.067217+0000","last_undegraded":"2023-08-22T00:42:36.067217+0000","last_fullsized":"2023-08-22T00:42:36.067217+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064884+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:42:36.064884+0000","last_peered":"2023-08-22T00:42:36.064884+0000","last_clean":"2023-08-22T00:42:36.064884+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:42:36.064884+0000","last_undegraded":"2023-08-22T00:42:36.064884+0000","last_fullsized":"2023-08-22T00:42:36.064884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081502+0000","last_change":"2023-08-22T00:42:36.078160+0000","last_active":"2023-08-22T00:42:36.081502+0000","last_peered":"2023-08-22T00:42:36.081502+0000","last_clean":"2023-08-22T00:42:36.081502+0000","last_became_active":"2023-08-22T00:42:36.077878+0000","last_became_peered":"2023-08-22T00:42:36.077878+0000","last_unstale":"2023-08-22T00:42:36.081502+0000","last_undegraded":"2023-08-22T00:42:36.081502+0000","last_fullsized":"2023-08-22T00:42:36.081502+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086834+0000","last_change":"2023-08-22T00:42:35.698960+0000","last_active":"2023-08-22T00:42:36.086834+0000","last_peered":"2023-08-22T00:42:36.086834+0000","last_clean":"2023-08-22T00:42:36.086834+0000","last_became_active":"2023-08-22T00:42:35.698356+0000","last_became_peered":"2023-08-22T00:42:35.698356+0000","last_unstale":"2023-08-22T00:42:36.086834+0000","last_undegraded":"2023-08-22T00:42:36.086834+0000","last_fullsized":"2023-08-22T00:42:36.086834+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065764+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:42:36.065764+0000","last_peered":"2023-08-22T00:42:36.065764+0000","last_clean":"2023-08-22T00:42:36.065764+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:42:36.065764+0000","last_undegraded":"2023-08-22T00:42:36.065764+0000","last_fullsized":"2023-08-22T00:42:36.065764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086872+0000","last_change":"2023-08-22T00:42:36.081803+0000","last_active":"2023-08-22T00:42:36.086872+0000","last_peered":"2023-08-22T00:42:36.086872+0000","last_clean":"2023-08-22T00:42:36.086872+0000","last_became_active":"2023-08-22T00:42:36.081517+0000","last_became_peered":"2023-08-22T00:42:36.081517+0000","last_unstale":"2023-08-22T00:42:36.086872+0000","last_undegraded":"2023-08-22T00:42:36.086872+0000","last_fullsized":"2023-08-22T00:42:36.086872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078807+0000","last_change":"2023-08-22T00:42:35.696843+0000","last_active":"2023-08-22T00:42:36.078807+0000","last_peered":"2023-08-22T00:42:36.078807+0000","last_clean":"2023-08-22T00:42:36.078807+0000","last_became_active":"2023-08-22T00:42:35.696492+0000","last_became_peered":"2023-08-22T00:42:35.696492+0000","last_unstale":"2023-08-22T00:42:36.078807+0000","last_undegraded":"2023-08-22T00:42:36.078807+0000","last_fullsized":"2023-08-22T00:42:36.078807+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064888+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:42:36.064888+0000","last_peered":"2023-08-22T00:42:36.064888+0000","last_clean":"2023-08-22T00:42:36.064888+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:42:36.064888+0000","last_undegraded":"2023-08-22T00:42:36.064888+0000","last_fullsized":"2023-08-22T00:42:36.064888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068613+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:42:36.068613+0000","last_peered":"2023-08-22T00:42:36.068613+0000","last_clean":"2023-08-22T00:42:36.068613+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:42:36.068613+0000","last_undegraded":"2023-08-22T00:42:36.068613+0000","last_fullsized":"2023-08-22T00:42:36.068613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091836+0000","last_change":"2023-08-22T00:42:36.090141+0000","last_active":"2023-08-22T00:42:36.091836+0000","last_peered":"2023-08-22T00:42:36.091836+0000","last_clean":"2023-08-22T00:42:36.091836+0000","last_became_active":"2023-08-22T00:42:36.089871+0000","last_became_peered":"2023-08-22T00:42:36.089871+0000","last_unstale":"2023-08-22T00:42:36.091836+0000","last_undegraded":"2023-08-22T00:42:36.091836+0000","last_fullsized":"2023-08-22T00:42:36.091836+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089810+0000","last_change":"2023-08-22T00:42:35.699372+0000","last_active":"2023-08-22T00:42:36.089810+0000","last_peered":"2023-08-22T00:42:36.089810+0000","last_clean":"2023-08-22T00:42:36.089810+0000","last_became_active":"2023-08-22T00:42:35.699107+0000","last_became_peered":"2023-08-22T00:42:35.699107+0000","last_unstale":"2023-08-22T00:42:36.089810+0000","last_undegraded":"2023-08-22T00:42:36.089810+0000","last_fullsized":"2023-08-22T00:42:36.089810+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068527+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:42:36.068527+0000","last_peered":"2023-08-22T00:42:36.068527+0000","last_clean":"2023-08-22T00:42:36.068527+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:42:36.068527+0000","last_undegraded":"2023-08-22T00:42:36.068527+0000","last_fullsized":"2023-08-22T00:42:36.068527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082150+0000","last_change":"2023-08-22T00:42:36.074900+0000","last_active":"2023-08-22T00:42:36.082150+0000","last_peered":"2023-08-22T00:42:36.082150+0000","last_clean":"2023-08-22T00:42:36.082150+0000","last_became_active":"2023-08-22T00:42:36.074649+0000","last_became_peered":"2023-08-22T00:42:36.074649+0000","last_unstale":"2023-08-22T00:42:36.082150+0000","last_undegraded":"2023-08-22T00:42:36.082150+0000","last_fullsized":"2023-08-22T00:42:36.082150+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075428+0000","last_change":"2023-08-22T00:42:35.698369+0000","last_active":"2023-08-22T00:42:36.075428+0000","last_peered":"2023-08-22T00:42:36.075428+0000","last_clean":"2023-08-22T00:42:36.075428+0000","last_became_active":"2023-08-22T00:42:35.697801+0000","last_became_peered":"2023-08-22T00:42:35.697801+0000","last_unstale":"2023-08-22T00:42:36.075428+0000","last_undegraded":"2023-08-22T00:42:36.075428+0000","last_fullsized":"2023-08-22T00:42:36.075428+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069143+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:42:36.069143+0000","last_peered":"2023-08-22T00:42:36.069143+0000","last_clean":"2023-08-22T00:42:36.069143+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:42:36.069143+0000","last_undegraded":"2023-08-22T00:42:36.069143+0000","last_fullsized":"2023-08-22T00:42:36.069143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081865+0000","last_change":"2023-08-22T00:42:36.076581+0000","last_active":"2023-08-22T00:42:36.081865+0000","last_peered":"2023-08-22T00:42:36.081865+0000","last_clean":"2023-08-22T00:42:36.081865+0000","last_became_active":"2023-08-22T00:42:36.076315+0000","last_became_peered":"2023-08-22T00:42:36.076315+0000","last_unstale":"2023-08-22T00:42:36.081865+0000","last_undegraded":"2023-08-22T00:42:36.081865+0000","last_fullsized":"2023-08-22T00:42:36.081865+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061347+0000","last_change":"2023-08-22T00:42:35.705930+0000","last_active":"2023-08-22T00:42:36.061347+0000","last_peered":"2023-08-22T00:42:36.061347+0000","last_clean":"2023-08-22T00:42:36.061347+0000","last_became_active":"2023-08-22T00:42:35.705653+0000","last_became_peered":"2023-08-22T00:42:35.705653+0000","last_unstale":"2023-08-22T00:42:36.061347+0000","last_undegraded":"2023-08-22T00:42:36.061347+0000","last_fullsized":"2023-08-22T00:42:36.061347+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075976+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:42:36.075976+0000","last_peered":"2023-08-22T00:42:36.075976+0000","last_clean":"2023-08-22T00:42:36.075976+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:42:36.075976+0000","last_undegraded":"2023-08-22T00:42:36.075976+0000","last_fullsized":"2023-08-22T00:42:36.075976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076103+0000","last_change":"2023-08-22T00:42:36.068690+0000","last_active":"2023-08-22T00:42:36.076103+0000","last_peered":"2023-08-22T00:42:36.076103+0000","last_clean":"2023-08-22T00:42:36.076103+0000","last_became_active":"2023-08-22T00:42:36.068425+0000","last_became_peered":"2023-08-22T00:42:36.068425+0000","last_unstale":"2023-08-22T00:42:36.076103+0000","last_undegraded":"2023-08-22T00:42:36.076103+0000","last_fullsized":"2023-08-22T00:42:36.076103+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084337+0000","last_change":"2023-08-22T00:42:35.703353+0000","last_active":"2023-08-22T00:42:36.084337+0000","last_peered":"2023-08-22T00:42:36.084337+0000","last_clean":"2023-08-22T00:42:36.084337+0000","last_became_active":"2023-08-22T00:42:35.703030+0000","last_became_peered":"2023-08-22T00:42:35.703030+0000","last_unstale":"2023-08-22T00:42:36.084337+0000","last_undegraded":"2023-08-22T00:42:36.084337+0000","last_fullsized":"2023-08-22T00:42:36.084337+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077594+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:42:36.077594+0000","last_peered":"2023-08-22T00:42:36.077594+0000","last_clean":"2023-08-22T00:42:36.077594+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:42:36.077594+0000","last_undegraded":"2023-08-22T00:42:36.077594+0000","last_fullsized":"2023-08-22T00:42:36.077594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.85999999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.28699999999999998},"max":{"1min":0.69899999999999995,"5min":0.71799999999999997,"15min":0.79700000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.32800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.753,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.80300000000000005,"15min":0.879},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83199999999999996},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.875},"last":0.751},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575279,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060192,"statfs":{"total":96636764160,"available":96317636608,"internally_reserved":0,"allocated":2318336,"data_stored":1233207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.83699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.82299999999999995},"last":0.627}]},{"osd":1,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.81200000000000006},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.77400000000000002,"15min":0.81599999999999995},"last":0.53800000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.501},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.79100000000000004},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.63500000000000001,"5min":0.66900000000000004,"15min":0.77300000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80400000000000005,"15min":1.234},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.79200000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.80600000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2314240,"data_stored":1232327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59299999999999997,"15min":0.61599999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54800000000000004,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.44,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.69199999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.25700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.875,"15min":0.92500000000000004},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.01},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":1.004,"15min":1.014},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.95899999999999996},"last":0.69299999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.97199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.98599999999999999},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575279,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2310144,"data_stored":1232293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.63800000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.434,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.627},"last":0.29399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.65300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.371}]},{"osd":4,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.40300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.78600000000000003,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.40699999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.64500000000000002},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.89000000000000001,"15min":1.0249999999999999},"last":0.495},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.79800000000000004,"5min":0.89400000000000002,"15min":0.98699999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":1.0389999999999999},"last":0.502},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575280,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064292,"statfs":{"total":96636764160,"available":96321835008,"internally_reserved":0,"allocated":2314240,"data_stored":1232383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47099999999999997,"5min":0.60499999999999998,"15min":0.64000000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.373}]},{"osd":1,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.622,"15min":0.72099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.254},"max":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.626},"last":0.24299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54400000000000004,"5min":0.65500000000000003,"15min":0.748},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51500000000000001,"5min":0.64200000000000002,"15min":0.78400000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.434,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0069999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.40899999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.93300000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":0.88,"15min":1.1120000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":0.92300000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.82199999999999995,"5min":0.87,"15min":1.0549999999999999},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575279,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2318336,"data_stored":1233219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.60299999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.308},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46100000000000002},"min":{"1min":0.36799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.373},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.73099999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.378,"15min":0.378},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.95699999999999996,"15min":1.026},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.034},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575279,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.79500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.81299999999999994},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.373},"max":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78200000000000003,"15min":0.79700000000000004},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.748,"5min":0.748,"15min":0.79900000000000004},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575278,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064288,"statfs":{"total":96636764160,"available":96321830912,"internally_reserved":0,"allocated":2318336,"data_stored":1232869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.745},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:42:44.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:42:44.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.231+0000 7f9567934700 1 Processor -- start 2023-08-22T00:42:44.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 -- start start 2023-08-22T00:42:44.235 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f9560157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f95600a9140 0x7f9560157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95600a8410 con 0x7f9560153b60 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600a8cb0 con 0x7f95600a9140 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.232+0000 7f9567934700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95601586a0 con 0x7f9560153f40 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f95656d0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9560153b60 0x7f9560068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55596/0 (socket says 172.21.15.98:55596) 2023-08-22T00:42:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f95656d0700 1 -- 172.21.15.98:0/2153903481 learned_addr learned my addr 172.21.15.98:0/2153903481 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9565ed1700 1 --2- 172.21.15.98:0/2153903481 >> v2:172.21.15.118:3300/0 conn(0x7f95600a9140 0x7f9560157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9564ecf700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f9560157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215272519 0 0) 0x7f95600a8410 con 0x7f9560153b60 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c0033f0 con 0x7f9560153b60 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1582953657 0 0) 0x7f954c0033f0 con 0x7f9560153b60 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 msgr2=0x7f9560157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f9560157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 >> v2:172.21.15.118:3300/0 conn(0x7f95600a9140 msgr2=0x7f9560157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 --2- 172.21.15.98:0/2153903481 >> v2:172.21.15.118:3300/0 conn(0x7f95600a9140 0x7f9560157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600a8660 con 0x7f9560153b60 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9558001470 con 0x7f9560153b60 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9565ed1700 1 --2- 172.21.15.98:0/2153903481 >> v2:172.21.15.118:3300/0 conn(0x7f95600a9140 0x7f9560157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9564ecf700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f9560157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 >> v1:172.21.15.98:6789/0 conn(0x7f9560153b60 legacy=0x7f9560068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f954c0038e0 0x7f954c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c004690 0x7f954c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f954c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600a8cb0 con 0x7f954c0038e0 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95601586a0 con 0x7f954c004690 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0044f0 con 0x7f9560153f40 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f95656d0700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f954c0038e0 0x7f954c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9565ed1700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f954c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.233+0000 7f9564ecf700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c004690 0x7f954c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 -- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 msgr2=0x7f954c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9560153f40 0x7f954c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 -- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c004690 msgr2=0x7f954c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c004690 0x7f954c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 -- 172.21.15.98:0/2153903481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500092a0 con 0x7f954c0038e0 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f95656d0700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f954c0038e0 0x7f954c003d00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f955800c210 tx=0x7f9558001e90).ready entity=mon.0 client_cookie=43951a30d581af70 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558007a60 con 0x7f954c0038e0 2023-08-22T00:42:44.240 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955800cae0 con 0x7f954c0038e0 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9557fff700 1 -- 172.21.15.98:0/2153903481 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800ce80 con 0x7f954c0038e0 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 -- 172.21.15.98:0/2153903481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f954c0038e0 msgr2=0x7f954c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 --2- 172.21.15.98:0/2153903481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f954c0038e0 0x7f954c003d00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f955800c210 tx=0x7f9558001e90).stop 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9565ed1700 1 -- 172.21.15.98:0/2153903481 reap_dead start 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 -- 172.21.15.98:0/2153903481 shutdown_connections 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 -- 172.21.15.98:0/2153903481 >> 172.21.15.98:0/2153903481 conn(0x7f95600c5dc0 msgr2=0x7f9560068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 -- 172.21.15.98:0/2153903481 shutdown_connections 2023-08-22T00:42:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.234+0000 7f9567934700 1 -- 172.21.15.98:0/2153903481 wait complete. 2023-08-22T00:42:44.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.235+0000 7f9567934700 1 Processor -- start 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.235+0000 7f9567934700 1 -- start start 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c0038e0 0x7f9560154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95600bf900 0x7f9560167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600c1600 con 0x7f9560147640 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560167b50 con 0x7f954c0038e0 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9567934700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9560167e30 con 0x7f95600bf900 2023-08-22T00:42:44.244 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.236+0000 7f9565ed1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51502/0 (socket says 172.21.15.98:51502) 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 -- 172.21.15.98:0/1926619990 learned_addr learned my addr 172.21.15.98:0/1926619990 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9564ecf700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95600bf900 0x7f9560167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f95656d0700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c0038e0 0x7f9560154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 -- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95600bf900 msgr2=0x7f9560167570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95600bf900 0x7f9560167570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 -- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c0038e0 msgr2=0x7f9560154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c0038e0 0x7f9560154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 -- 172.21.15.98:0/1926619990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560168110 con 0x7f9560147640 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9565ed1700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f956006add0 tx=0x7f955c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00e040 con 0x7f9560147640 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00f040 con 0x7f9560147640 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95601683f0 con 0x7f9560147640 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00fd70 con 0x7f9560147640 2023-08-22T00:42:44.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.237+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9560147ac0 con 0x7f9560147640 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.238+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95600c1460 con 0x7f9560147640 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.238+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f955c015660 con 0x7f9560147640 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.239+0000 7f95557fa700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 0x7f9544061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.239+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f955c07abe0 con 0x7f9560147640 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.239+0000 7f95656d0700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 0x7f9544061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.247 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.239+0000 7f95656d0700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 0x7f9544061420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9558001ed0 tx=0x7f9558015000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.243+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95600c1460 con 0x7f9560147640 2023-08-22T00:42:44.402 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.401+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95600c1460 con 0x7f954405ef60 2023-08-22T00:42:44.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.411+0000 7f95557fa700 1 -- 172.21.15.98:0/1926619990 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362129 (secure 0 0 0) 0x7f95600c1460 con 0x7f954405ef60 2023-08-22T00:42:44.415 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:44.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.414+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 msgr2=0x7f9544061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.414+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 0x7f9544061420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9558001ed0 tx=0x7f9558015000).stop 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.414+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 msgr2=0x7f9560068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.414+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f956006add0 tx=0x7f955c00b040).stop 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 shutdown_connections 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f954405ef60 0x7f9544061420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9560147640 0x7f9560068c90 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c0038e0 0x7f9560154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 --2- 172.21.15.98:0/1926619990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95600bf900 0x7f9560167570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 >> 172.21.15.98:0/1926619990 conn(0x7f95600c5dc0 msgr2=0x7f95600aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:44.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 shutdown_connections 2023-08-22T00:42:44.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.415+0000 7f9567934700 1 -- 172.21.15.98:0/1926619990 wait complete. 2023-08-22T00:42:44.419 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:42:44.427 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-22T00:42:44.162281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2452224,"kb_used_data":18112,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752522496,"statfs":{"total":773094113280,"available":770583035904,"internally_reserved":0,"allocated":18546688,"data_stored":9862956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553192,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-211,"num_write_kb":-681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.414898"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085893+0000","last_change":"2023-08-22T00:42:36.082577+0000","last_active":"2023-08-22T00:42:36.085893+0000","last_peered":"2023-08-22T00:42:36.085893+0000","last_clean":"2023-08-22T00:42:36.085893+0000","last_became_active":"2023-08-22T00:42:36.082062+0000","last_became_peered":"2023-08-22T00:42:36.082062+0000","last_unstale":"2023-08-22T00:42:36.085893+0000","last_undegraded":"2023-08-22T00:42:36.085893+0000","last_fullsized":"2023-08-22T00:42:36.085893+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093238+0000","last_change":"2023-08-22T00:42:35.705579+0000","last_active":"2023-08-22T00:42:36.093238+0000","last_peered":"2023-08-22T00:42:36.093238+0000","last_clean":"2023-08-22T00:42:36.093238+0000","last_became_active":"2023-08-22T00:42:35.705289+0000","last_became_peered":"2023-08-22T00:42:35.705289+0000","last_unstale":"2023-08-22T00:42:36.093238+0000","last_undegraded":"2023-08-22T00:42:36.093238+0000","last_fullsized":"2023-08-22T00:42:36.093238+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085065+0000","last_change":"2023-08-22T00:42:36.082780+0000","last_active":"2023-08-22T00:42:36.085065+0000","last_peered":"2023-08-22T00:42:36.085065+0000","last_clean":"2023-08-22T00:42:36.085065+0000","last_became_active":"2023-08-22T00:42:36.082504+0000","last_became_peered":"2023-08-22T00:42:36.082504+0000","last_unstale":"2023-08-22T00:42:36.085065+0000","last_undegraded":"2023-08-22T00:42:36.085065+0000","last_fullsized":"2023-08-22T00:42:36.085065+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075903+0000","last_change":"2023-08-22T00:42:35.697663+0000","last_active":"2023-08-22T00:42:36.075903+0000","last_peered":"2023-08-22T00:42:36.075903+0000","last_clean":"2023-08-22T00:42:36.075903+0000","last_became_active":"2023-08-22T00:42:35.697372+0000","last_became_peered":"2023-08-22T00:42:35.697372+0000","last_unstale":"2023-08-22T00:42:36.075903+0000","last_undegraded":"2023-08-22T00:42:36.075903+0000","last_fullsized":"2023-08-22T00:42:36.075903+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083251+0000","last_change":"2023-08-22T00:42:36.079736+0000","last_active":"2023-08-22T00:42:36.083251+0000","last_peered":"2023-08-22T00:42:36.083251+0000","last_clean":"2023-08-22T00:42:36.083251+0000","last_became_active":"2023-08-22T00:42:36.079462+0000","last_became_peered":"2023-08-22T00:42:36.079462+0000","last_unstale":"2023-08-22T00:42:36.083251+0000","last_undegraded":"2023-08-22T00:42:36.083251+0000","last_fullsized":"2023-08-22T00:42:36.083251+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075462+0000","last_change":"2023-08-22T00:42:35.699456+0000","last_active":"2023-08-22T00:42:36.075462+0000","last_peered":"2023-08-22T00:42:36.075462+0000","last_clean":"2023-08-22T00:42:36.075462+0000","last_became_active":"2023-08-22T00:42:35.698113+0000","last_became_peered":"2023-08-22T00:42:35.698113+0000","last_unstale":"2023-08-22T00:42:36.075462+0000","last_undegraded":"2023-08-22T00:42:36.075462+0000","last_fullsized":"2023-08-22T00:42:36.075462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094154+0000","last_change":"2023-08-22T00:42:36.092961+0000","last_active":"2023-08-22T00:42:36.094154+0000","last_peered":"2023-08-22T00:42:36.094154+0000","last_clean":"2023-08-22T00:42:36.094154+0000","last_became_active":"2023-08-22T00:42:36.092700+0000","last_became_peered":"2023-08-22T00:42:36.092700+0000","last_unstale":"2023-08-22T00:42:36.094154+0000","last_undegraded":"2023-08-22T00:42:36.094154+0000","last_fullsized":"2023-08-22T00:42:36.094154+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088314+0000","last_change":"2023-08-22T00:42:35.701261+0000","last_active":"2023-08-22T00:42:36.088314+0000","last_peered":"2023-08-22T00:42:36.088314+0000","last_clean":"2023-08-22T00:42:36.088314+0000","last_became_active":"2023-08-22T00:42:35.700959+0000","last_became_peered":"2023-08-22T00:42:35.700959+0000","last_unstale":"2023-08-22T00:42:36.088314+0000","last_undegraded":"2023-08-22T00:42:36.088314+0000","last_fullsized":"2023-08-22T00:42:36.088314+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089405+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089405+0000","last_peered":"2023-08-22T00:42:36.089405+0000","last_clean":"2023-08-22T00:42:36.089405+0000","last_became_active":"2023-08-22T00:42:36.084721+0000","last_became_peered":"2023-08-22T00:42:36.084721+0000","last_unstale":"2023-08-22T00:42:36.089405+0000","last_undegraded":"2023-08-22T00:42:36.089405+0000","last_fullsized":"2023-08-22T00:42:36.089405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084085+0000","last_change":"2023-08-22T00:42:35.707988+0000","last_active":"2023-08-22T00:42:36.084085+0000","last_peered":"2023-08-22T00:42:36.084085+0000","last_clean":"2023-08-22T00:42:36.084085+0000","last_became_active":"2023-08-22T00:42:35.707664+0000","last_became_peered":"2023-08-22T00:42:35.707664+0000","last_unstale":"2023-08-22T00:42:36.084085+0000","last_undegraded":"2023-08-22T00:42:36.084085+0000","last_fullsized":"2023-08-22T00:42:36.084085+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093119+0000","last_change":"2023-08-22T00:42:36.091419+0000","last_active":"2023-08-22T00:42:36.093119+0000","last_peered":"2023-08-22T00:42:36.093119+0000","last_clean":"2023-08-22T00:42:36.093119+0000","last_became_active":"2023-08-22T00:42:36.091194+0000","last_became_peered":"2023-08-22T00:42:36.091194+0000","last_unstale":"2023-08-22T00:42:36.093119+0000","last_undegraded":"2023-08-22T00:42:36.093119+0000","last_fullsized":"2023-08-22T00:42:36.093119+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083032+0000","last_change":"2023-08-22T00:42:35.707959+0000","last_active":"2023-08-22T00:42:36.083032+0000","last_peered":"2023-08-22T00:42:36.083032+0000","last_clean":"2023-08-22T00:42:36.083032+0000","last_became_active":"2023-08-22T00:42:35.707645+0000","last_became_peered":"2023-08-22T00:42:35.707645+0000","last_unstale":"2023-08-22T00:42:36.083032+0000","last_undegraded":"2023-08-22T00:42:36.083032+0000","last_fullsized":"2023-08-22T00:42:36.083032+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093078+0000","last_change":"2023-08-22T00:42:36.091614+0000","last_active":"2023-08-22T00:42:36.093078+0000","last_peered":"2023-08-22T00:42:36.093078+0000","last_clean":"2023-08-22T00:42:36.093078+0000","last_became_active":"2023-08-22T00:42:36.091327+0000","last_became_peered":"2023-08-22T00:42:36.091327+0000","last_unstale":"2023-08-22T00:42:36.093078+0000","last_undegraded":"2023-08-22T00:42:36.093078+0000","last_fullsized":"2023-08-22T00:42:36.093078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.066427+0000","last_change":"2023-08-22T00:42:35.704629+0000","last_active":"2023-08-22T00:42:36.066427+0000","last_peered":"2023-08-22T00:42:36.066427+0000","last_clean":"2023-08-22T00:42:36.066427+0000","last_became_active":"2023-08-22T00:42:35.702144+0000","last_became_peered":"2023-08-22T00:42:35.702144+0000","last_unstale":"2023-08-22T00:42:36.066427+0000","last_undegraded":"2023-08-22T00:42:36.066427+0000","last_fullsized":"2023-08-22T00:42:36.066427+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095260+0000","last_change":"2023-08-22T00:42:36.090719+0000","last_active":"2023-08-22T00:42:36.095260+0000","last_peered":"2023-08-22T00:42:36.095260+0000","last_clean":"2023-08-22T00:42:36.095260+0000","last_became_active":"2023-08-22T00:42:36.090442+0000","last_became_peered":"2023-08-22T00:42:36.090442+0000","last_unstale":"2023-08-22T00:42:36.095260+0000","last_undegraded":"2023-08-22T00:42:36.095260+0000","last_fullsized":"2023-08-22T00:42:36.095260+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078704+0000","last_change":"2023-08-22T00:42:35.693901+0000","last_active":"2023-08-22T00:42:36.078704+0000","last_peered":"2023-08-22T00:42:36.078704+0000","last_clean":"2023-08-22T00:42:36.078704+0000","last_became_active":"2023-08-22T00:42:35.693533+0000","last_became_peered":"2023-08-22T00:42:35.693533+0000","last_unstale":"2023-08-22T00:42:36.078704+0000","last_undegraded":"2023-08-22T00:42:36.078704+0000","last_fullsized":"2023-08-22T00:42:36.078704+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084584+0000","last_change":"2023-08-22T00:42:36.078221+0000","last_active":"2023-08-22T00:42:36.084584+0000","last_peered":"2023-08-22T00:42:36.084584+0000","last_clean":"2023-08-22T00:42:36.084584+0000","last_became_active":"2023-08-22T00:42:36.077909+0000","last_became_peered":"2023-08-22T00:42:36.077909+0000","last_unstale":"2023-08-22T00:42:36.084584+0000","last_undegraded":"2023-08-22T00:42:36.084584+0000","last_fullsized":"2023-08-22T00:42:36.084584+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061876+0000","last_change":"2023-08-22T00:42:35.701212+0000","last_active":"2023-08-22T00:42:36.061876+0000","last_peered":"2023-08-22T00:42:36.061876+0000","last_clean":"2023-08-22T00:42:36.061876+0000","last_became_active":"2023-08-22T00:42:35.700553+0000","last_became_peered":"2023-08-22T00:42:35.700553+0000","last_unstale":"2023-08-22T00:42:36.061876+0000","last_undegraded":"2023-08-22T00:42:36.061876+0000","last_fullsized":"2023-08-22T00:42:36.061876+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085924+0000","last_change":"2023-08-22T00:42:36.084212+0000","last_active":"2023-08-22T00:42:36.085924+0000","last_peered":"2023-08-22T00:42:36.085924+0000","last_clean":"2023-08-22T00:42:36.085924+0000","last_became_active":"2023-08-22T00:42:36.083903+0000","last_became_peered":"2023-08-22T00:42:36.083903+0000","last_unstale":"2023-08-22T00:42:36.085924+0000","last_undegraded":"2023-08-22T00:42:36.085924+0000","last_fullsized":"2023-08-22T00:42:36.085924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.062512+0000","last_change":"2023-08-22T00:42:35.703201+0000","last_active":"2023-08-22T00:42:36.062512+0000","last_peered":"2023-08-22T00:42:36.062512+0000","last_clean":"2023-08-22T00:42:36.062512+0000","last_became_active":"2023-08-22T00:42:35.702927+0000","last_became_peered":"2023-08-22T00:42:35.702927+0000","last_unstale":"2023-08-22T00:42:36.062512+0000","last_undegraded":"2023-08-22T00:42:36.062512+0000","last_fullsized":"2023-08-22T00:42:36.062512+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:36.082169+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:36.081332+0000","last_became_peered":"2023-08-22T00:42:36.081332+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065442+0000","last_change":"2023-08-22T00:42:35.699127+0000","last_active":"2023-08-22T00:42:36.065442+0000","last_peered":"2023-08-22T00:42:36.065442+0000","last_clean":"2023-08-22T00:42:36.065442+0000","last_became_active":"2023-08-22T00:42:35.698702+0000","last_became_peered":"2023-08-22T00:42:35.698702+0000","last_unstale":"2023-08-22T00:42:36.065442+0000","last_undegraded":"2023-08-22T00:42:36.065442+0000","last_fullsized":"2023-08-22T00:42:36.065442+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.093184+0000","last_change":"2023-08-22T00:42:36.092072+0000","last_active":"2023-08-22T00:42:36.093184+0000","last_peered":"2023-08-22T00:42:36.093184+0000","last_clean":"2023-08-22T00:42:36.093184+0000","last_became_active":"2023-08-22T00:42:36.091789+0000","last_became_peered":"2023-08-22T00:42:36.091789+0000","last_unstale":"2023-08-22T00:42:36.093184+0000","last_undegraded":"2023-08-22T00:42:36.093184+0000","last_fullsized":"2023-08-22T00:42:36.093184+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.34","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092770+0000","last_change":"2023-08-22T00:42:35.704055+0000","last_active":"2023-08-22T00:42:36.092770+0000","last_peered":"2023-08-22T00:42:36.092770+0000","last_clean":"2023-08-22T00:42:36.092770+0000","last_became_active":"2023-08-22T00:42:35.702958+0000","last_became_peered":"2023-08-22T00:42:35.702958+0000","last_unstale":"2023-08-22T00:42:36.092770+0000","last_undegraded":"2023-08-22T00:42:36.092770+0000","last_fullsized":"2023-08-22T00:42:36.092770+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082212+0000","last_change":"2023-08-22T00:42:36.072913+0000","last_active":"2023-08-22T00:42:36.082212+0000","last_peered":"2023-08-22T00:42:36.082212+0000","last_clean":"2023-08-22T00:42:36.082212+0000","last_became_active":"2023-08-22T00:42:36.072655+0000","last_became_peered":"2023-08-22T00:42:36.072655+0000","last_unstale":"2023-08-22T00:42:36.082212+0000","last_undegraded":"2023-08-22T00:42:36.082212+0000","last_fullsized":"2023-08-22T00:42:36.082212+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.33","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080392+0000","last_change":"2023-08-22T00:42:35.692030+0000","last_active":"2023-08-22T00:42:36.080392+0000","last_peered":"2023-08-22T00:42:36.080392+0000","last_clean":"2023-08-22T00:42:36.080392+0000","last_became_active":"2023-08-22T00:42:35.691766+0000","last_became_peered":"2023-08-22T00:42:35.691766+0000","last_unstale":"2023-08-22T00:42:36.080392+0000","last_undegraded":"2023-08-22T00:42:36.080392+0000","last_fullsized":"2023-08-22T00:42:36.080392+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083938+0000","last_change":"2023-08-22T00:42:36.081908+0000","last_active":"2023-08-22T00:42:36.083938+0000","last_peered":"2023-08-22T00:42:36.083938+0000","last_clean":"2023-08-22T00:42:36.083938+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.083938+0000","last_undegraded":"2023-08-22T00:42:36.083938+0000","last_fullsized":"2023-08-22T00:42:36.083938+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073379+0000","last_change":"2023-08-22T00:42:35.703347+0000","last_active":"2023-08-22T00:42:36.073379+0000","last_peered":"2023-08-22T00:42:36.073379+0000","last_clean":"2023-08-22T00:42:36.073379+0000","last_became_active":"2023-08-22T00:42:35.703000+0000","last_became_peered":"2023-08-22T00:42:35.703000+0000","last_unstale":"2023-08-22T00:42:36.073379+0000","last_undegraded":"2023-08-22T00:42:36.073379+0000","last_fullsized":"2023-08-22T00:42:36.073379+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088953+0000","last_change":"2023-08-22T00:42:36.083796+0000","last_active":"2023-08-22T00:42:36.088953+0000","last_peered":"2023-08-22T00:42:36.088953+0000","last_clean":"2023-08-22T00:42:36.088953+0000","last_became_active":"2023-08-22T00:42:36.083529+0000","last_became_peered":"2023-08-22T00:42:36.083529+0000","last_unstale":"2023-08-22T00:42:36.088953+0000","last_undegraded":"2023-08-22T00:42:36.088953+0000","last_fullsized":"2023-08-22T00:42:36.088953+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075331+0000","last_change":"2023-08-22T00:42:35.698174+0000","last_active":"2023-08-22T00:42:36.075331+0000","last_peered":"2023-08-22T00:42:36.075331+0000","last_clean":"2023-08-22T00:42:36.075331+0000","last_became_active":"2023-08-22T00:42:35.697278+0000","last_became_peered":"2023-08-22T00:42:35.697278+0000","last_unstale":"2023-08-22T00:42:36.075331+0000","last_undegraded":"2023-08-22T00:42:36.075331+0000","last_fullsized":"2023-08-22T00:42:36.075331+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085074+0000","last_change":"2023-08-22T00:42:36.081658+0000","last_active":"2023-08-22T00:42:36.085074+0000","last_peered":"2023-08-22T00:42:36.085074+0000","last_clean":"2023-08-22T00:42:36.085074+0000","last_became_active":"2023-08-22T00:42:36.080726+0000","last_became_peered":"2023-08-22T00:42:36.080726+0000","last_unstale":"2023-08-22T00:42:36.085074+0000","last_undegraded":"2023-08-22T00:42:36.085074+0000","last_fullsized":"2023-08-22T00:42:36.085074+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089151+0000","last_change":"2023-08-22T00:42:35.694698+0000","last_active":"2023-08-22T00:42:36.089151+0000","last_peered":"2023-08-22T00:42:36.089151+0000","last_clean":"2023-08-22T00:42:36.089151+0000","last_became_active":"2023-08-22T00:42:35.694410+0000","last_became_peered":"2023-08-22T00:42:35.694410+0000","last_unstale":"2023-08-22T00:42:36.089151+0000","last_undegraded":"2023-08-22T00:42:36.089151+0000","last_fullsized":"2023-08-22T00:42:36.089151+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089792+0000","last_change":"2023-08-22T00:42:36.087220+0000","last_active":"2023-08-22T00:42:36.089792+0000","last_peered":"2023-08-22T00:42:36.089792+0000","last_clean":"2023-08-22T00:42:36.089792+0000","last_became_active":"2023-08-22T00:42:36.086988+0000","last_became_peered":"2023-08-22T00:42:36.086988+0000","last_unstale":"2023-08-22T00:42:36.089792+0000","last_undegraded":"2023-08-22T00:42:36.089792+0000","last_fullsized":"2023-08-22T00:42:36.089792+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077513+0000","last_change":"2023-08-22T00:42:35.695029+0000","last_active":"2023-08-22T00:42:36.077513+0000","last_peered":"2023-08-22T00:42:36.077513+0000","last_clean":"2023-08-22T00:42:36.077513+0000","last_became_active":"2023-08-22T00:42:35.694732+0000","last_became_peered":"2023-08-22T00:42:35.694732+0000","last_unstale":"2023-08-22T00:42:36.077513+0000","last_undegraded":"2023-08-22T00:42:36.077513+0000","last_fullsized":"2023-08-22T00:42:36.077513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089382+0000","last_change":"2023-08-22T00:42:36.085368+0000","last_active":"2023-08-22T00:42:36.089382+0000","last_peered":"2023-08-22T00:42:36.089382+0000","last_clean":"2023-08-22T00:42:36.089382+0000","last_became_active":"2023-08-22T00:42:36.084691+0000","last_became_peered":"2023-08-22T00:42:36.084691+0000","last_unstale":"2023-08-22T00:42:36.089382+0000","last_undegraded":"2023-08-22T00:42:36.089382+0000","last_fullsized":"2023-08-22T00:42:36.089382+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067122+0000","last_change":"2023-08-22T00:42:35.708165+0000","last_active":"2023-08-22T00:42:36.067122+0000","last_peered":"2023-08-22T00:42:36.067122+0000","last_clean":"2023-08-22T00:42:36.067122+0000","last_became_active":"2023-08-22T00:42:35.707717+0000","last_became_peered":"2023-08-22T00:42:35.707717+0000","last_unstale":"2023-08-22T00:42:36.067122+0000","last_undegraded":"2023-08-22T00:42:36.067122+0000","last_fullsized":"2023-08-22T00:42:36.067122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082237+0000","last_change":"2023-08-22T00:42:36.073104+0000","last_active":"2023-08-22T00:42:36.082237+0000","last_peered":"2023-08-22T00:42:36.082237+0000","last_clean":"2023-08-22T00:42:36.082237+0000","last_became_active":"2023-08-22T00:42:36.072850+0000","last_became_peered":"2023-08-22T00:42:36.072850+0000","last_unstale":"2023-08-22T00:42:36.082237+0000","last_undegraded":"2023-08-22T00:42:36.082237+0000","last_fullsized":"2023-08-22T00:42:36.082237+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091024+0000","last_change":"2023-08-22T00:42:35.697336+0000","last_active":"2023-08-22T00:42:36.091024+0000","last_peered":"2023-08-22T00:42:36.091024+0000","last_clean":"2023-08-22T00:42:36.091024+0000","last_became_active":"2023-08-22T00:42:35.696771+0000","last_became_peered":"2023-08-22T00:42:35.696771+0000","last_unstale":"2023-08-22T00:42:36.091024+0000","last_undegraded":"2023-08-22T00:42:36.091024+0000","last_fullsized":"2023-08-22T00:42:36.091024+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095025+0000","last_change":"2023-08-22T00:42:36.091242+0000","last_active":"2023-08-22T00:42:36.095025+0000","last_peered":"2023-08-22T00:42:36.095025+0000","last_clean":"2023-08-22T00:42:36.095025+0000","last_became_active":"2023-08-22T00:42:36.090867+0000","last_became_peered":"2023-08-22T00:42:36.090867+0000","last_unstale":"2023-08-22T00:42:36.095025+0000","last_undegraded":"2023-08-22T00:42:36.095025+0000","last_fullsized":"2023-08-22T00:42:36.095025+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068842+0000","last_change":"2023-08-22T00:42:35.698537+0000","last_active":"2023-08-22T00:42:36.068842+0000","last_peered":"2023-08-22T00:42:36.068842+0000","last_clean":"2023-08-22T00:42:36.068842+0000","last_became_active":"2023-08-22T00:42:35.698261+0000","last_became_peered":"2023-08-22T00:42:35.698261+0000","last_unstale":"2023-08-22T00:42:36.068842+0000","last_undegraded":"2023-08-22T00:42:36.068842+0000","last_fullsized":"2023-08-22T00:42:36.068842+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084714+0000","last_change":"2023-08-22T00:42:36.078204+0000","last_active":"2023-08-22T00:42:36.084714+0000","last_peered":"2023-08-22T00:42:36.084714+0000","last_clean":"2023-08-22T00:42:36.084714+0000","last_became_active":"2023-08-22T00:42:36.077938+0000","last_became_peered":"2023-08-22T00:42:36.077938+0000","last_unstale":"2023-08-22T00:42:36.084714+0000","last_undegraded":"2023-08-22T00:42:36.084714+0000","last_fullsized":"2023-08-22T00:42:36.084714+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086257+0000","last_change":"2023-08-22T00:42:35.700351+0000","last_active":"2023-08-22T00:42:36.086257+0000","last_peered":"2023-08-22T00:42:36.086257+0000","last_clean":"2023-08-22T00:42:36.086257+0000","last_became_active":"2023-08-22T00:42:35.699937+0000","last_became_peered":"2023-08-22T00:42:35.699937+0000","last_unstale":"2023-08-22T00:42:36.086257+0000","last_undegraded":"2023-08-22T00:42:36.086257+0000","last_fullsized":"2023-08-22T00:42:36.086257+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089331+0000","last_change":"2023-08-22T00:42:36.084919+0000","last_active":"2023-08-22T00:42:36.089331+0000","last_peered":"2023-08-22T00:42:36.089331+0000","last_clean":"2023-08-22T00:42:36.089331+0000","last_became_active":"2023-08-22T00:42:36.084626+0000","last_became_peered":"2023-08-22T00:42:36.084626+0000","last_unstale":"2023-08-22T00:42:36.089331+0000","last_undegraded":"2023-08-22T00:42:36.089331+0000","last_fullsized":"2023-08-22T00:42:36.089331+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.697644+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.696923+0000","last_became_peered":"2023-08-22T00:42:35.696923+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084871+0000","last_change":"2023-08-22T00:42:36.079869+0000","last_active":"2023-08-22T00:42:36.084871+0000","last_peered":"2023-08-22T00:42:36.084871+0000","last_clean":"2023-08-22T00:42:36.084871+0000","last_became_active":"2023-08-22T00:42:36.079596+0000","last_became_peered":"2023-08-22T00:42:36.079596+0000","last_unstale":"2023-08-22T00:42:36.084871+0000","last_undegraded":"2023-08-22T00:42:36.084871+0000","last_fullsized":"2023-08-22T00:42:36.084871+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078456+0000","last_change":"2023-08-22T00:42:35.693985+0000","last_active":"2023-08-22T00:42:36.078456+0000","last_peered":"2023-08-22T00:42:36.078456+0000","last_clean":"2023-08-22T00:42:36.078456+0000","last_became_active":"2023-08-22T00:42:35.693441+0000","last_became_peered":"2023-08-22T00:42:35.693441+0000","last_unstale":"2023-08-22T00:42:36.078456+0000","last_undegraded":"2023-08-22T00:42:36.078456+0000","last_fullsized":"2023-08-22T00:42:36.078456+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089396+0000","last_change":"2023-08-22T00:42:36.086123+0000","last_active":"2023-08-22T00:42:36.089396+0000","last_peered":"2023-08-22T00:42:36.089396+0000","last_clean":"2023-08-22T00:42:36.089396+0000","last_became_active":"2023-08-22T00:42:36.085879+0000","last_became_peered":"2023-08-22T00:42:36.085879+0000","last_unstale":"2023-08-22T00:42:36.089396+0000","last_undegraded":"2023-08-22T00:42:36.089396+0000","last_fullsized":"2023-08-22T00:42:36.089396+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065509+0000","last_change":"2023-08-22T00:42:35.696870+0000","last_active":"2023-08-22T00:42:36.065509+0000","last_peered":"2023-08-22T00:42:36.065509+0000","last_clean":"2023-08-22T00:42:36.065509+0000","last_became_active":"2023-08-22T00:42:35.696586+0000","last_became_peered":"2023-08-22T00:42:35.696586+0000","last_unstale":"2023-08-22T00:42:36.065509+0000","last_undegraded":"2023-08-22T00:42:36.065509+0000","last_fullsized":"2023-08-22T00:42:36.065509+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082403+0000","last_change":"2023-08-22T00:42:36.079739+0000","last_active":"2023-08-22T00:42:36.082403+0000","last_peered":"2023-08-22T00:42:36.082403+0000","last_clean":"2023-08-22T00:42:36.082403+0000","last_became_active":"2023-08-22T00:42:36.079533+0000","last_became_peered":"2023-08-22T00:42:36.079533+0000","last_unstale":"2023-08-22T00:42:36.082403+0000","last_undegraded":"2023-08-22T00:42:36.082403+0000","last_fullsized":"2023-08-22T00:42:36.082403+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065547+0000","last_change":"2023-08-22T00:42:35.703851+0000","last_active":"2023-08-22T00:42:36.065547+0000","last_peered":"2023-08-22T00:42:36.065547+0000","last_clean":"2023-08-22T00:42:36.065547+0000","last_became_active":"2023-08-22T00:42:35.703351+0000","last_became_peered":"2023-08-22T00:42:35.703351+0000","last_unstale":"2023-08-22T00:42:36.065547+0000","last_undegraded":"2023-08-22T00:42:36.065547+0000","last_fullsized":"2023-08-22T00:42:36.065547+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.094006+0000","last_change":"2023-08-22T00:42:36.093092+0000","last_active":"2023-08-22T00:42:36.094006+0000","last_peered":"2023-08-22T00:42:36.094006+0000","last_clean":"2023-08-22T00:42:36.094006+0000","last_became_active":"2023-08-22T00:42:36.092838+0000","last_became_peered":"2023-08-22T00:42:36.092838+0000","last_unstale":"2023-08-22T00:42:36.094006+0000","last_undegraded":"2023-08-22T00:42:36.094006+0000","last_fullsized":"2023-08-22T00:42:36.094006+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.585513+0000","last_change":"2023-08-22T00:42:35.707578+0000","last_active":"2023-08-22T00:42:36.585513+0000","last_peered":"2023-08-22T00:42:36.585513+0000","last_clean":"2023-08-22T00:42:36.585513+0000","last_became_active":"2023-08-22T00:42:35.707312+0000","last_became_peered":"2023-08-22T00:42:35.707312+0000","last_unstale":"2023-08-22T00:42:36.585513+0000","last_undegraded":"2023-08-22T00:42:36.585513+0000","last_fullsized":"2023-08-22T00:42:36.585513+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.092444+0000","last_change":"2023-08-22T00:42:36.091325+0000","last_active":"2023-08-22T00:42:36.092444+0000","last_peered":"2023-08-22T00:42:36.092444+0000","last_clean":"2023-08-22T00:42:36.092444+0000","last_became_active":"2023-08-22T00:42:36.091084+0000","last_became_peered":"2023-08-22T00:42:36.091084+0000","last_unstale":"2023-08-22T00:42:36.092444+0000","last_undegraded":"2023-08-22T00:42:36.092444+0000","last_fullsized":"2023-08-22T00:42:36.092444+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061715+0000","last_change":"2023-08-22T00:42:35.700601+0000","last_active":"2023-08-22T00:42:36.061715+0000","last_peered":"2023-08-22T00:42:36.061715+0000","last_clean":"2023-08-22T00:42:36.061715+0000","last_became_active":"2023-08-22T00:42:35.699913+0000","last_became_peered":"2023-08-22T00:42:35.699913+0000","last_unstale":"2023-08-22T00:42:36.061715+0000","last_undegraded":"2023-08-22T00:42:36.061715+0000","last_fullsized":"2023-08-22T00:42:36.061715+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081847+0000","last_change":"2023-08-22T00:42:36.071045+0000","last_active":"2023-08-22T00:42:36.081847+0000","last_peered":"2023-08-22T00:42:36.081847+0000","last_clean":"2023-08-22T00:42:36.081847+0000","last_became_active":"2023-08-22T00:42:36.070755+0000","last_became_peered":"2023-08-22T00:42:36.070755+0000","last_unstale":"2023-08-22T00:42:36.081847+0000","last_undegraded":"2023-08-22T00:42:36.081847+0000","last_fullsized":"2023-08-22T00:42:36.081847+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065363+0000","last_change":"2023-08-22T00:42:35.693184+0000","last_active":"2023-08-22T00:42:36.065363+0000","last_peered":"2023-08-22T00:42:36.065363+0000","last_clean":"2023-08-22T00:42:36.065363+0000","last_became_active":"2023-08-22T00:42:35.692904+0000","last_became_peered":"2023-08-22T00:42:35.692904+0000","last_unstale":"2023-08-22T00:42:36.065363+0000","last_undegraded":"2023-08-22T00:42:36.065363+0000","last_fullsized":"2023-08-22T00:42:36.065363+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090607+0000","last_change":"2023-08-22T00:42:36.089844+0000","last_active":"2023-08-22T00:42:36.090607+0000","last_peered":"2023-08-22T00:42:36.090607+0000","last_clean":"2023-08-22T00:42:36.090607+0000","last_became_active":"2023-08-22T00:42:36.089541+0000","last_became_peered":"2023-08-22T00:42:36.089541+0000","last_unstale":"2023-08-22T00:42:36.090607+0000","last_undegraded":"2023-08-22T00:42:36.090607+0000","last_fullsized":"2023-08-22T00:42:36.090607+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078362+0000","last_change":"2023-08-22T00:42:35.702784+0000","last_active":"2023-08-22T00:42:36.078362+0000","last_peered":"2023-08-22T00:42:36.078362+0000","last_clean":"2023-08-22T00:42:36.078362+0000","last_became_active":"2023-08-22T00:42:35.702330+0000","last_became_peered":"2023-08-22T00:42:35.702330+0000","last_unstale":"2023-08-22T00:42:36.078362+0000","last_undegraded":"2023-08-22T00:42:36.078362+0000","last_fullsized":"2023-08-22T00:42:36.078362+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082483+0000","last_change":"2023-08-22T00:42:36.074647+0000","last_active":"2023-08-22T00:42:36.082483+0000","last_peered":"2023-08-22T00:42:36.082483+0000","last_clean":"2023-08-22T00:42:36.082483+0000","last_became_active":"2023-08-22T00:42:36.074358+0000","last_became_peered":"2023-08-22T00:42:36.074358+0000","last_unstale":"2023-08-22T00:42:36.082483+0000","last_undegraded":"2023-08-22T00:42:36.082483+0000","last_fullsized":"2023-08-22T00:42:36.082483+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065098+0000","last_change":"2023-08-22T00:42:35.692314+0000","last_active":"2023-08-22T00:42:36.065098+0000","last_peered":"2023-08-22T00:42:36.065098+0000","last_clean":"2023-08-22T00:42:36.065098+0000","last_became_active":"2023-08-22T00:42:35.692025+0000","last_became_peered":"2023-08-22T00:42:35.692025+0000","last_unstale":"2023-08-22T00:42:36.065098+0000","last_undegraded":"2023-08-22T00:42:36.065098+0000","last_fullsized":"2023-08-22T00:42:36.065098+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076235+0000","last_change":"2023-08-22T00:42:36.069799+0000","last_active":"2023-08-22T00:42:36.076235+0000","last_peered":"2023-08-22T00:42:36.076235+0000","last_clean":"2023-08-22T00:42:36.076235+0000","last_became_active":"2023-08-22T00:42:36.069542+0000","last_became_peered":"2023-08-22T00:42:36.069542+0000","last_unstale":"2023-08-22T00:42:36.076235+0000","last_undegraded":"2023-08-22T00:42:36.076235+0000","last_fullsized":"2023-08-22T00:42:36.076235+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.060768+0000","last_change":"2023-08-22T00:42:35.692998+0000","last_active":"2023-08-22T00:42:36.060768+0000","last_peered":"2023-08-22T00:42:36.060768+0000","last_clean":"2023-08-22T00:42:36.060768+0000","last_became_active":"2023-08-22T00:42:35.692737+0000","last_became_peered":"2023-08-22T00:42:35.692737+0000","last_unstale":"2023-08-22T00:42:36.060768+0000","last_undegraded":"2023-08-22T00:42:36.060768+0000","last_fullsized":"2023-08-22T00:42:36.060768+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091739+0000","last_change":"2023-08-22T00:42:36.091030+0000","last_active":"2023-08-22T00:42:36.091739+0000","last_peered":"2023-08-22T00:42:36.091739+0000","last_clean":"2023-08-22T00:42:36.091739+0000","last_became_active":"2023-08-22T00:42:36.090750+0000","last_became_peered":"2023-08-22T00:42:36.090750+0000","last_unstale":"2023-08-22T00:42:36.091739+0000","last_undegraded":"2023-08-22T00:42:36.091739+0000","last_fullsized":"2023-08-22T00:42:36.091739+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078352+0000","last_change":"2023-08-22T00:42:35.694202+0000","last_active":"2023-08-22T00:42:36.078352+0000","last_peered":"2023-08-22T00:42:36.078352+0000","last_clean":"2023-08-22T00:42:36.078352+0000","last_became_active":"2023-08-22T00:42:35.693927+0000","last_became_peered":"2023-08-22T00:42:35.693927+0000","last_unstale":"2023-08-22T00:42:36.078352+0000","last_undegraded":"2023-08-22T00:42:36.078352+0000","last_fullsized":"2023-08-22T00:42:36.078352+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082420+0000","last_change":"2023-08-22T00:42:36.080889+0000","last_active":"2023-08-22T00:42:36.082420+0000","last_peered":"2023-08-22T00:42:36.082420+0000","last_clean":"2023-08-22T00:42:36.082420+0000","last_became_active":"2023-08-22T00:42:36.080670+0000","last_became_peered":"2023-08-22T00:42:36.080670+0000","last_unstale":"2023-08-22T00:42:36.082420+0000","last_undegraded":"2023-08-22T00:42:36.082420+0000","last_fullsized":"2023-08-22T00:42:36.082420+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083383+0000","last_change":"2023-08-22T00:42:35.706207+0000","last_active":"2023-08-22T00:42:36.083383+0000","last_peered":"2023-08-22T00:42:36.083383+0000","last_clean":"2023-08-22T00:42:36.083383+0000","last_became_active":"2023-08-22T00:42:35.705967+0000","last_became_peered":"2023-08-22T00:42:35.705967+0000","last_unstale":"2023-08-22T00:42:36.083383+0000","last_undegraded":"2023-08-22T00:42:36.083383+0000","last_fullsized":"2023-08-22T00:42:36.083383+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091687+0000","last_change":"2023-08-22T00:42:36.090343+0000","last_active":"2023-08-22T00:42:36.091687+0000","last_peered":"2023-08-22T00:42:36.091687+0000","last_clean":"2023-08-22T00:42:36.091687+0000","last_became_active":"2023-08-22T00:42:36.090065+0000","last_became_peered":"2023-08-22T00:42:36.090065+0000","last_unstale":"2023-08-22T00:42:36.091687+0000","last_undegraded":"2023-08-22T00:42:36.091687+0000","last_fullsized":"2023-08-22T00:42:36.091687+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089588+0000","last_change":"2023-08-22T00:42:35.694428+0000","last_active":"2023-08-22T00:42:36.089588+0000","last_peered":"2023-08-22T00:42:36.089588+0000","last_clean":"2023-08-22T00:42:36.089588+0000","last_became_active":"2023-08-22T00:42:35.694058+0000","last_became_peered":"2023-08-22T00:42:35.694058+0000","last_unstale":"2023-08-22T00:42:36.089588+0000","last_undegraded":"2023-08-22T00:42:36.089588+0000","last_fullsized":"2023-08-22T00:42:36.089588+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089328+0000","last_change":"2023-08-22T00:42:36.085006+0000","last_active":"2023-08-22T00:42:36.089328+0000","last_peered":"2023-08-22T00:42:36.089328+0000","last_clean":"2023-08-22T00:42:36.089328+0000","last_became_active":"2023-08-22T00:42:36.084713+0000","last_became_peered":"2023-08-22T00:42:36.084713+0000","last_unstale":"2023-08-22T00:42:36.089328+0000","last_undegraded":"2023-08-22T00:42:36.089328+0000","last_fullsized":"2023-08-22T00:42:36.089328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085648+0000","last_change":"2023-08-22T00:42:35.693957+0000","last_active":"2023-08-22T00:42:36.085648+0000","last_peered":"2023-08-22T00:42:36.085648+0000","last_clean":"2023-08-22T00:42:36.085648+0000","last_became_active":"2023-08-22T00:42:35.693519+0000","last_became_peered":"2023-08-22T00:42:35.693519+0000","last_unstale":"2023-08-22T00:42:36.085648+0000","last_undegraded":"2023-08-22T00:42:36.085648+0000","last_fullsized":"2023-08-22T00:42:36.085648+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087699+0000","last_change":"2023-08-22T00:42:36.087113+0000","last_active":"2023-08-22T00:42:36.087699+0000","last_peered":"2023-08-22T00:42:36.087699+0000","last_clean":"2023-08-22T00:42:36.087699+0000","last_became_active":"2023-08-22T00:42:36.086845+0000","last_became_peered":"2023-08-22T00:42:36.086845+0000","last_unstale":"2023-08-22T00:42:36.087699+0000","last_undegraded":"2023-08-22T00:42:36.087699+0000","last_fullsized":"2023-08-22T00:42:36.087699+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075543+0000","last_change":"2023-08-22T00:42:35.698989+0000","last_active":"2023-08-22T00:42:36.075543+0000","last_peered":"2023-08-22T00:42:36.075543+0000","last_clean":"2023-08-22T00:42:36.075543+0000","last_became_active":"2023-08-22T00:42:35.698572+0000","last_became_peered":"2023-08-22T00:42:35.698572+0000","last_unstale":"2023-08-22T00:42:36.075543+0000","last_undegraded":"2023-08-22T00:42:36.075543+0000","last_fullsized":"2023-08-22T00:42:36.075543+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082405+0000","last_change":"2023-08-22T00:42:36.077109+0000","last_active":"2023-08-22T00:42:36.082405+0000","last_peered":"2023-08-22T00:42:36.082405+0000","last_clean":"2023-08-22T00:42:36.082405+0000","last_became_active":"2023-08-22T00:42:36.076846+0000","last_became_peered":"2023-08-22T00:42:36.076846+0000","last_unstale":"2023-08-22T00:42:36.082405+0000","last_undegraded":"2023-08-22T00:42:36.082405+0000","last_fullsized":"2023-08-22T00:42:36.082405+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064803+0000","last_change":"2023-08-22T00:42:35.703193+0000","last_active":"2023-08-22T00:42:36.064803+0000","last_peered":"2023-08-22T00:42:36.064803+0000","last_clean":"2023-08-22T00:42:36.064803+0000","last_became_active":"2023-08-22T00:42:35.702916+0000","last_became_peered":"2023-08-22T00:42:35.702916+0000","last_unstale":"2023-08-22T00:42:36.064803+0000","last_undegraded":"2023-08-22T00:42:36.064803+0000","last_fullsized":"2023-08-22T00:42:36.064803+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081698+0000","last_change":"2023-08-22T00:42:36.077408+0000","last_active":"2023-08-22T00:42:36.081698+0000","last_peered":"2023-08-22T00:42:36.081698+0000","last_clean":"2023-08-22T00:42:36.081698+0000","last_became_active":"2023-08-22T00:42:36.077181+0000","last_became_peered":"2023-08-22T00:42:36.077181+0000","last_unstale":"2023-08-22T00:42:36.081698+0000","last_undegraded":"2023-08-22T00:42:36.081698+0000","last_fullsized":"2023-08-22T00:42:36.081698+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075565+0000","last_change":"2023-08-22T00:42:35.694331+0000","last_active":"2023-08-22T00:42:36.075565+0000","last_peered":"2023-08-22T00:42:36.075565+0000","last_clean":"2023-08-22T00:42:36.075565+0000","last_became_active":"2023-08-22T00:42:35.693957+0000","last_became_peered":"2023-08-22T00:42:35.693957+0000","last_unstale":"2023-08-22T00:42:36.075565+0000","last_undegraded":"2023-08-22T00:42:36.075565+0000","last_fullsized":"2023-08-22T00:42:36.075565+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.080328+0000","last_change":"2023-08-22T00:42:36.074405+0000","last_active":"2023-08-22T00:42:36.080328+0000","last_peered":"2023-08-22T00:42:36.080328+0000","last_clean":"2023-08-22T00:42:36.080328+0000","last_became_active":"2023-08-22T00:42:36.074139+0000","last_became_peered":"2023-08-22T00:42:36.074139+0000","last_unstale":"2023-08-22T00:42:36.080328+0000","last_undegraded":"2023-08-22T00:42:36.080328+0000","last_fullsized":"2023-08-22T00:42:36.080328+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076266+0000","last_change":"2023-08-22T00:42:35.696055+0000","last_active":"2023-08-22T00:42:36.076266+0000","last_peered":"2023-08-22T00:42:36.076266+0000","last_clean":"2023-08-22T00:42:36.076266+0000","last_became_active":"2023-08-22T00:42:35.695791+0000","last_became_peered":"2023-08-22T00:42:35.695791+0000","last_unstale":"2023-08-22T00:42:36.076266+0000","last_undegraded":"2023-08-22T00:42:36.076266+0000","last_fullsized":"2023-08-22T00:42:36.076266+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086658+0000","last_change":"2023-08-22T00:42:36.070358+0000","last_active":"2023-08-22T00:42:36.086658+0000","last_peered":"2023-08-22T00:42:36.086658+0000","last_clean":"2023-08-22T00:42:36.086658+0000","last_became_active":"2023-08-22T00:42:36.070096+0000","last_became_peered":"2023-08-22T00:42:36.070096+0000","last_unstale":"2023-08-22T00:42:36.086658+0000","last_undegraded":"2023-08-22T00:42:36.086658+0000","last_fullsized":"2023-08-22T00:42:36.086658+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068690+0000","last_change":"2023-08-22T00:42:35.694037+0000","last_active":"2023-08-22T00:42:36.068690+0000","last_peered":"2023-08-22T00:42:36.068690+0000","last_clean":"2023-08-22T00:42:36.068690+0000","last_became_active":"2023-08-22T00:42:35.693656+0000","last_became_peered":"2023-08-22T00:42:35.693656+0000","last_unstale":"2023-08-22T00:42:36.068690+0000","last_undegraded":"2023-08-22T00:42:36.068690+0000","last_fullsized":"2023-08-22T00:42:36.068690+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089457+0000","last_change":"2023-08-22T00:42:36.087233+0000","last_active":"2023-08-22T00:42:36.089457+0000","last_peered":"2023-08-22T00:42:36.089457+0000","last_clean":"2023-08-22T00:42:36.089457+0000","last_became_active":"2023-08-22T00:42:36.086969+0000","last_became_peered":"2023-08-22T00:42:36.086969+0000","last_unstale":"2023-08-22T00:42:36.089457+0000","last_undegraded":"2023-08-22T00:42:36.089457+0000","last_fullsized":"2023-08-22T00:42:36.089457+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085670+0000","last_change":"2023-08-22T00:42:35.703653+0000","last_active":"2023-08-22T00:42:36.085670+0000","last_peered":"2023-08-22T00:42:36.085670+0000","last_clean":"2023-08-22T00:42:36.085670+0000","last_became_active":"2023-08-22T00:42:35.703058+0000","last_became_peered":"2023-08-22T00:42:35.703058+0000","last_unstale":"2023-08-22T00:42:36.085670+0000","last_undegraded":"2023-08-22T00:42:36.085670+0000","last_fullsized":"2023-08-22T00:42:36.085670+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095258+0000","last_change":"2023-08-22T00:42:36.090905+0000","last_active":"2023-08-22T00:42:36.095258+0000","last_peered":"2023-08-22T00:42:36.095258+0000","last_clean":"2023-08-22T00:42:36.095258+0000","last_became_active":"2023-08-22T00:42:36.090604+0000","last_became_peered":"2023-08-22T00:42:36.090604+0000","last_unstale":"2023-08-22T00:42:36.095258+0000","last_undegraded":"2023-08-22T00:42:36.095258+0000","last_fullsized":"2023-08-22T00:42:36.095258+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082438+0000","last_change":"2023-08-22T00:42:35.707915+0000","last_active":"2023-08-22T00:42:36.082438+0000","last_peered":"2023-08-22T00:42:36.082438+0000","last_clean":"2023-08-22T00:42:36.082438+0000","last_became_active":"2023-08-22T00:42:35.707622+0000","last_became_peered":"2023-08-22T00:42:35.707622+0000","last_unstale":"2023-08-22T00:42:36.082438+0000","last_undegraded":"2023-08-22T00:42:36.082438+0000","last_fullsized":"2023-08-22T00:42:36.082438+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083264+0000","last_change":"2023-08-22T00:42:36.081027+0000","last_active":"2023-08-22T00:42:36.083264+0000","last_peered":"2023-08-22T00:42:36.083264+0000","last_clean":"2023-08-22T00:42:36.083264+0000","last_became_active":"2023-08-22T00:42:36.080704+0000","last_became_peered":"2023-08-22T00:42:36.080704+0000","last_unstale":"2023-08-22T00:42:36.083264+0000","last_undegraded":"2023-08-22T00:42:36.083264+0000","last_fullsized":"2023-08-22T00:42:36.083264+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069133+0000","last_change":"2023-08-22T00:42:35.697534+0000","last_active":"2023-08-22T00:42:36.069133+0000","last_peered":"2023-08-22T00:42:36.069133+0000","last_clean":"2023-08-22T00:42:36.069133+0000","last_became_active":"2023-08-22T00:42:35.697068+0000","last_became_peered":"2023-08-22T00:42:35.697068+0000","last_unstale":"2023-08-22T00:42:36.069133+0000","last_undegraded":"2023-08-22T00:42:36.069133+0000","last_fullsized":"2023-08-22T00:42:36.069133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.095317+0000","last_change":"2023-08-22T00:42:36.090976+0000","last_active":"2023-08-22T00:42:36.095317+0000","last_peered":"2023-08-22T00:42:36.095317+0000","last_clean":"2023-08-22T00:42:36.095317+0000","last_became_active":"2023-08-22T00:42:36.090706+0000","last_became_peered":"2023-08-22T00:42:36.090706+0000","last_unstale":"2023-08-22T00:42:36.095317+0000","last_undegraded":"2023-08-22T00:42:36.095317+0000","last_fullsized":"2023-08-22T00:42:36.095317+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068926+0000","last_change":"2023-08-22T00:42:35.703709+0000","last_active":"2023-08-22T00:42:36.068926+0000","last_peered":"2023-08-22T00:42:36.068926+0000","last_clean":"2023-08-22T00:42:36.068926+0000","last_became_active":"2023-08-22T00:42:35.703366+0000","last_became_peered":"2023-08-22T00:42:35.703366+0000","last_unstale":"2023-08-22T00:42:36.068926+0000","last_undegraded":"2023-08-22T00:42:36.068926+0000","last_fullsized":"2023-08-22T00:42:36.068926+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082189+0000","last_change":"2023-08-22T00:42:36.072341+0000","last_active":"2023-08-22T00:42:36.082189+0000","last_peered":"2023-08-22T00:42:36.082189+0000","last_clean":"2023-08-22T00:42:36.082189+0000","last_became_active":"2023-08-22T00:42:36.072023+0000","last_became_peered":"2023-08-22T00:42:36.072023+0000","last_unstale":"2023-08-22T00:42:36.082189+0000","last_undegraded":"2023-08-22T00:42:36.082189+0000","last_fullsized":"2023-08-22T00:42:36.082189+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085393+0000","last_change":"2023-08-22T00:42:35.694175+0000","last_active":"2023-08-22T00:42:36.085393+0000","last_peered":"2023-08-22T00:42:36.085393+0000","last_clean":"2023-08-22T00:42:36.085393+0000","last_became_active":"2023-08-22T00:42:35.693860+0000","last_became_peered":"2023-08-22T00:42:35.693860+0000","last_unstale":"2023-08-22T00:42:36.085393+0000","last_undegraded":"2023-08-22T00:42:36.085393+0000","last_fullsized":"2023-08-22T00:42:36.085393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079353+0000","last_change":"2023-08-22T00:42:36.072895+0000","last_active":"2023-08-22T00:42:36.079353+0000","last_peered":"2023-08-22T00:42:36.079353+0000","last_clean":"2023-08-22T00:42:36.079353+0000","last_became_active":"2023-08-22T00:42:36.072645+0000","last_became_peered":"2023-08-22T00:42:36.072645+0000","last_unstale":"2023-08-22T00:42:36.079353+0000","last_undegraded":"2023-08-22T00:42:36.079353+0000","last_fullsized":"2023-08-22T00:42:36.079353+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068322+0000","last_change":"2023-08-22T00:42:35.698710+0000","last_active":"2023-08-22T00:42:36.068322+0000","last_peered":"2023-08-22T00:42:36.068322+0000","last_clean":"2023-08-22T00:42:36.068322+0000","last_became_active":"2023-08-22T00:42:35.697888+0000","last_became_peered":"2023-08-22T00:42:35.697888+0000","last_unstale":"2023-08-22T00:42:36.068322+0000","last_undegraded":"2023-08-22T00:42:36.068322+0000","last_fullsized":"2023-08-22T00:42:36.068322+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.083294+0000","last_change":"2023-08-22T00:42:36.074593+0000","last_active":"2023-08-22T00:42:36.083294+0000","last_peered":"2023-08-22T00:42:36.083294+0000","last_clean":"2023-08-22T00:42:36.083294+0000","last_became_active":"2023-08-22T00:42:36.074298+0000","last_became_peered":"2023-08-22T00:42:36.074298+0000","last_unstale":"2023-08-22T00:42:36.083294+0000","last_undegraded":"2023-08-22T00:42:36.083294+0000","last_fullsized":"2023-08-22T00:42:36.083294+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075522+0000","last_change":"2023-08-22T00:42:35.705084+0000","last_active":"2023-08-22T00:42:36.075522+0000","last_peered":"2023-08-22T00:42:36.075522+0000","last_clean":"2023-08-22T00:42:36.075522+0000","last_became_active":"2023-08-22T00:42:35.704800+0000","last_became_peered":"2023-08-22T00:42:35.704800+0000","last_unstale":"2023-08-22T00:42:36.075522+0000","last_undegraded":"2023-08-22T00:42:36.075522+0000","last_fullsized":"2023-08-22T00:42:36.075522+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086678+0000","last_change":"2023-08-22T00:42:36.079855+0000","last_active":"2023-08-22T00:42:36.086678+0000","last_peered":"2023-08-22T00:42:36.086678+0000","last_clean":"2023-08-22T00:42:36.086678+0000","last_became_active":"2023-08-22T00:42:36.079573+0000","last_became_peered":"2023-08-22T00:42:36.079573+0000","last_unstale":"2023-08-22T00:42:36.086678+0000","last_undegraded":"2023-08-22T00:42:36.086678+0000","last_fullsized":"2023-08-22T00:42:36.086678+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068516+0000","last_change":"2023-08-22T00:42:35.698450+0000","last_active":"2023-08-22T00:42:36.068516+0000","last_peered":"2023-08-22T00:42:36.068516+0000","last_clean":"2023-08-22T00:42:36.068516+0000","last_became_active":"2023-08-22T00:42:35.697970+0000","last_became_peered":"2023-08-22T00:42:35.697970+0000","last_unstale":"2023-08-22T00:42:36.068516+0000","last_undegraded":"2023-08-22T00:42:36.068516+0000","last_fullsized":"2023-08-22T00:42:36.068516+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081694+0000","last_change":"2023-08-22T00:42:36.077800+0000","last_active":"2023-08-22T00:42:36.081694+0000","last_peered":"2023-08-22T00:42:36.081694+0000","last_clean":"2023-08-22T00:42:36.081694+0000","last_became_active":"2023-08-22T00:42:36.077548+0000","last_became_peered":"2023-08-22T00:42:36.077548+0000","last_unstale":"2023-08-22T00:42:36.081694+0000","last_undegraded":"2023-08-22T00:42:36.081694+0000","last_fullsized":"2023-08-22T00:42:36.081694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.085559+0000","last_change":"2023-08-22T00:42:35.701893+0000","last_active":"2023-08-22T00:42:36.085559+0000","last_peered":"2023-08-22T00:42:36.085559+0000","last_clean":"2023-08-22T00:42:36.085559+0000","last_became_active":"2023-08-22T00:42:35.701618+0000","last_became_peered":"2023-08-22T00:42:35.701618+0000","last_unstale":"2023-08-22T00:42:36.085559+0000","last_undegraded":"2023-08-22T00:42:36.085559+0000","last_fullsized":"2023-08-22T00:42:36.085559+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.079412+0000","last_change":"2023-08-22T00:42:36.071437+0000","last_active":"2023-08-22T00:42:36.079412+0000","last_peered":"2023-08-22T00:42:36.079412+0000","last_clean":"2023-08-22T00:42:36.079412+0000","last_became_active":"2023-08-22T00:42:36.071073+0000","last_became_peered":"2023-08-22T00:42:36.071073+0000","last_unstale":"2023-08-22T00:42:36.079412+0000","last_undegraded":"2023-08-22T00:42:36.079412+0000","last_fullsized":"2023-08-22T00:42:36.079412+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065786+0000","last_change":"2023-08-22T00:42:35.705325+0000","last_active":"2023-08-22T00:42:36.065786+0000","last_peered":"2023-08-22T00:42:36.065786+0000","last_clean":"2023-08-22T00:42:36.065786+0000","last_became_active":"2023-08-22T00:42:35.705040+0000","last_became_peered":"2023-08-22T00:42:35.705040+0000","last_unstale":"2023-08-22T00:42:36.065786+0000","last_undegraded":"2023-08-22T00:42:36.065786+0000","last_fullsized":"2023-08-22T00:42:36.065786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089348+0000","last_change":"2023-08-22T00:42:36.085076+0000","last_active":"2023-08-22T00:42:36.089348+0000","last_peered":"2023-08-22T00:42:36.089348+0000","last_clean":"2023-08-22T00:42:36.089348+0000","last_became_active":"2023-08-22T00:42:36.084805+0000","last_became_peered":"2023-08-22T00:42:36.084805+0000","last_unstale":"2023-08-22T00:42:36.089348+0000","last_undegraded":"2023-08-22T00:42:36.089348+0000","last_fullsized":"2023-08-22T00:42:36.089348+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.073875+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.073875+0000","last_peered":"2023-08-22T00:42:36.073875+0000","last_clean":"2023-08-22T00:42:36.073875+0000","last_became_active":"2023-08-22T00:42:35.703299+0000","last_became_peered":"2023-08-22T00:42:35.703299+0000","last_unstale":"2023-08-22T00:42:36.073875+0000","last_undegraded":"2023-08-22T00:42:36.073875+0000","last_fullsized":"2023-08-22T00:42:36.073875+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077821+0000","last_change":"2023-08-22T00:42:36.073011+0000","last_active":"2023-08-22T00:42:36.077821+0000","last_peered":"2023-08-22T00:42:36.077821+0000","last_clean":"2023-08-22T00:42:36.077821+0000","last_became_active":"2023-08-22T00:42:36.072748+0000","last_became_peered":"2023-08-22T00:42:36.072748+0000","last_unstale":"2023-08-22T00:42:36.077821+0000","last_undegraded":"2023-08-22T00:42:36.077821+0000","last_fullsized":"2023-08-22T00:42:36.077821+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061097+0000","last_change":"2023-08-22T00:42:35.707981+0000","last_active":"2023-08-22T00:42:36.061097+0000","last_peered":"2023-08-22T00:42:36.061097+0000","last_clean":"2023-08-22T00:42:36.061097+0000","last_became_active":"2023-08-22T00:42:35.707707+0000","last_became_peered":"2023-08-22T00:42:35.707707+0000","last_unstale":"2023-08-22T00:42:36.061097+0000","last_undegraded":"2023-08-22T00:42:36.061097+0000","last_fullsized":"2023-08-22T00:42:36.061097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077525+0000","last_change":"2023-08-22T00:42:36.070339+0000","last_active":"2023-08-22T00:42:36.077525+0000","last_peered":"2023-08-22T00:42:36.077525+0000","last_clean":"2023-08-22T00:42:36.077525+0000","last_became_active":"2023-08-22T00:42:36.070079+0000","last_became_peered":"2023-08-22T00:42:36.070079+0000","last_unstale":"2023-08-22T00:42:36.077525+0000","last_undegraded":"2023-08-22T00:42:36.077525+0000","last_fullsized":"2023-08-22T00:42:36.077525+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078460+0000","last_change":"2023-08-22T00:42:35.702589+0000","last_active":"2023-08-22T00:42:36.078460+0000","last_peered":"2023-08-22T00:42:36.078460+0000","last_clean":"2023-08-22T00:42:36.078460+0000","last_became_active":"2023-08-22T00:42:35.701994+0000","last_became_peered":"2023-08-22T00:42:35.701994+0000","last_unstale":"2023-08-22T00:42:36.078460+0000","last_undegraded":"2023-08-22T00:42:36.078460+0000","last_fullsized":"2023-08-22T00:42:36.078460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091462+0000","last_change":"2023-08-22T00:42:36.089972+0000","last_active":"2023-08-22T00:42:36.091462+0000","last_peered":"2023-08-22T00:42:36.091462+0000","last_clean":"2023-08-22T00:42:36.091462+0000","last_became_active":"2023-08-22T00:42:36.089495+0000","last_became_peered":"2023-08-22T00:42:36.089495+0000","last_unstale":"2023-08-22T00:42:36.091462+0000","last_undegraded":"2023-08-22T00:42:36.091462+0000","last_fullsized":"2023-08-22T00:42:36.091462+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075343+0000","last_change":"2023-08-22T00:42:35.693692+0000","last_active":"2023-08-22T00:42:36.075343+0000","last_peered":"2023-08-22T00:42:36.075343+0000","last_clean":"2023-08-22T00:42:36.075343+0000","last_became_active":"2023-08-22T00:42:35.693368+0000","last_became_peered":"2023-08-22T00:42:35.693368+0000","last_unstale":"2023-08-22T00:42:36.075343+0000","last_undegraded":"2023-08-22T00:42:36.075343+0000","last_fullsized":"2023-08-22T00:42:36.075343+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.088974+0000","last_change":"2023-08-22T00:42:36.084024+0000","last_active":"2023-08-22T00:42:36.088974+0000","last_peered":"2023-08-22T00:42:36.088974+0000","last_clean":"2023-08-22T00:42:36.088974+0000","last_became_active":"2023-08-22T00:42:36.083758+0000","last_became_peered":"2023-08-22T00:42:36.083758+0000","last_unstale":"2023-08-22T00:42:36.088974+0000","last_undegraded":"2023-08-22T00:42:36.088974+0000","last_fullsized":"2023-08-22T00:42:36.088974+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076319+0000","last_change":"2023-08-22T00:42:35.703584+0000","last_active":"2023-08-22T00:42:36.076319+0000","last_peered":"2023-08-22T00:42:36.076319+0000","last_clean":"2023-08-22T00:42:36.076319+0000","last_became_active":"2023-08-22T00:42:35.703273+0000","last_became_peered":"2023-08-22T00:42:35.703273+0000","last_unstale":"2023-08-22T00:42:36.076319+0000","last_undegraded":"2023-08-22T00:42:36.076319+0000","last_fullsized":"2023-08-22T00:42:36.076319+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.087627+0000","last_change":"2023-08-22T00:42:36.086483+0000","last_active":"2023-08-22T00:42:36.087627+0000","last_peered":"2023-08-22T00:42:36.087627+0000","last_clean":"2023-08-22T00:42:36.087627+0000","last_became_active":"2023-08-22T00:42:36.086162+0000","last_became_peered":"2023-08-22T00:42:36.086162+0000","last_unstale":"2023-08-22T00:42:36.087627+0000","last_undegraded":"2023-08-22T00:42:36.087627+0000","last_fullsized":"2023-08-22T00:42:36.087627+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078081+0000","last_change":"2023-08-22T00:42:35.693579+0000","last_active":"2023-08-22T00:42:36.078081+0000","last_peered":"2023-08-22T00:42:36.078081+0000","last_clean":"2023-08-22T00:42:36.078081+0000","last_became_active":"2023-08-22T00:42:35.693213+0000","last_became_peered":"2023-08-22T00:42:35.693213+0000","last_unstale":"2023-08-22T00:42:36.078081+0000","last_undegraded":"2023-08-22T00:42:36.078081+0000","last_fullsized":"2023-08-22T00:42:36.078081+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082872+0000","last_change":"2023-08-22T00:42:36.079973+0000","last_active":"2023-08-22T00:42:36.082872+0000","last_peered":"2023-08-22T00:42:36.082872+0000","last_clean":"2023-08-22T00:42:36.082872+0000","last_became_active":"2023-08-22T00:42:36.079730+0000","last_became_peered":"2023-08-22T00:42:36.079730+0000","last_unstale":"2023-08-22T00:42:36.082872+0000","last_undegraded":"2023-08-22T00:42:36.082872+0000","last_fullsized":"2023-08-22T00:42:36.082872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.090735+0000","last_change":"2023-08-22T00:42:35.697425+0000","last_active":"2023-08-22T00:42:36.090735+0000","last_peered":"2023-08-22T00:42:36.090735+0000","last_clean":"2023-08-22T00:42:36.090735+0000","last_became_active":"2023-08-22T00:42:35.697041+0000","last_became_peered":"2023-08-22T00:42:35.697041+0000","last_unstale":"2023-08-22T00:42:36.090735+0000","last_undegraded":"2023-08-22T00:42:36.090735+0000","last_fullsized":"2023-08-22T00:42:36.090735+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075613+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:42:36.075613+0000","last_peered":"2023-08-22T00:42:36.075613+0000","last_clean":"2023-08-22T00:42:36.075613+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:42:36.075613+0000","last_undegraded":"2023-08-22T00:42:36.075613+0000","last_fullsized":"2023-08-22T00:42:36.075613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086586+0000","last_change":"2023-08-22T00:42:36.080857+0000","last_active":"2023-08-22T00:42:36.086586+0000","last_peered":"2023-08-22T00:42:36.086586+0000","last_clean":"2023-08-22T00:42:36.086586+0000","last_became_active":"2023-08-22T00:42:36.080591+0000","last_became_peered":"2023-08-22T00:42:36.080591+0000","last_unstale":"2023-08-22T00:42:36.086586+0000","last_undegraded":"2023-08-22T00:42:36.086586+0000","last_fullsized":"2023-08-22T00:42:36.086586+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.067217+0000","last_change":"2023-08-22T00:42:35.708363+0000","last_active":"2023-08-22T00:42:36.067217+0000","last_peered":"2023-08-22T00:42:36.067217+0000","last_clean":"2023-08-22T00:42:36.067217+0000","last_became_active":"2023-08-22T00:42:35.707698+0000","last_became_peered":"2023-08-22T00:42:35.707698+0000","last_unstale":"2023-08-22T00:42:36.067217+0000","last_undegraded":"2023-08-22T00:42:36.067217+0000","last_fullsized":"2023-08-22T00:42:36.067217+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064884+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:42:36.064884+0000","last_peered":"2023-08-22T00:42:36.064884+0000","last_clean":"2023-08-22T00:42:36.064884+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:42:36.064884+0000","last_undegraded":"2023-08-22T00:42:36.064884+0000","last_fullsized":"2023-08-22T00:42:36.064884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081502+0000","last_change":"2023-08-22T00:42:36.078160+0000","last_active":"2023-08-22T00:42:36.081502+0000","last_peered":"2023-08-22T00:42:36.081502+0000","last_clean":"2023-08-22T00:42:36.081502+0000","last_became_active":"2023-08-22T00:42:36.077878+0000","last_became_peered":"2023-08-22T00:42:36.077878+0000","last_unstale":"2023-08-22T00:42:36.081502+0000","last_undegraded":"2023-08-22T00:42:36.081502+0000","last_fullsized":"2023-08-22T00:42:36.081502+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086834+0000","last_change":"2023-08-22T00:42:35.698960+0000","last_active":"2023-08-22T00:42:36.086834+0000","last_peered":"2023-08-22T00:42:36.086834+0000","last_clean":"2023-08-22T00:42:36.086834+0000","last_became_active":"2023-08-22T00:42:35.698356+0000","last_became_peered":"2023-08-22T00:42:35.698356+0000","last_unstale":"2023-08-22T00:42:36.086834+0000","last_undegraded":"2023-08-22T00:42:36.086834+0000","last_fullsized":"2023-08-22T00:42:36.086834+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.065764+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:42:36.065764+0000","last_peered":"2023-08-22T00:42:36.065764+0000","last_clean":"2023-08-22T00:42:36.065764+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:42:36.065764+0000","last_undegraded":"2023-08-22T00:42:36.065764+0000","last_fullsized":"2023-08-22T00:42:36.065764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.086872+0000","last_change":"2023-08-22T00:42:36.081803+0000","last_active":"2023-08-22T00:42:36.086872+0000","last_peered":"2023-08-22T00:42:36.086872+0000","last_clean":"2023-08-22T00:42:36.086872+0000","last_became_active":"2023-08-22T00:42:36.081517+0000","last_became_peered":"2023-08-22T00:42:36.081517+0000","last_unstale":"2023-08-22T00:42:36.086872+0000","last_undegraded":"2023-08-22T00:42:36.086872+0000","last_fullsized":"2023-08-22T00:42:36.086872+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.078807+0000","last_change":"2023-08-22T00:42:35.696843+0000","last_active":"2023-08-22T00:42:36.078807+0000","last_peered":"2023-08-22T00:42:36.078807+0000","last_clean":"2023-08-22T00:42:36.078807+0000","last_became_active":"2023-08-22T00:42:35.696492+0000","last_became_peered":"2023-08-22T00:42:35.696492+0000","last_unstale":"2023-08-22T00:42:36.078807+0000","last_undegraded":"2023-08-22T00:42:36.078807+0000","last_fullsized":"2023-08-22T00:42:36.078807+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.064888+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:42:36.064888+0000","last_peered":"2023-08-22T00:42:36.064888+0000","last_clean":"2023-08-22T00:42:36.064888+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:42:36.064888+0000","last_undegraded":"2023-08-22T00:42:36.064888+0000","last_fullsized":"2023-08-22T00:42:36.064888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068613+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:42:36.068613+0000","last_peered":"2023-08-22T00:42:36.068613+0000","last_clean":"2023-08-22T00:42:36.068613+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:42:36.068613+0000","last_undegraded":"2023-08-22T00:42:36.068613+0000","last_fullsized":"2023-08-22T00:42:36.068613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.091836+0000","last_change":"2023-08-22T00:42:36.090141+0000","last_active":"2023-08-22T00:42:36.091836+0000","last_peered":"2023-08-22T00:42:36.091836+0000","last_clean":"2023-08-22T00:42:36.091836+0000","last_became_active":"2023-08-22T00:42:36.089871+0000","last_became_peered":"2023-08-22T00:42:36.089871+0000","last_unstale":"2023-08-22T00:42:36.091836+0000","last_undegraded":"2023-08-22T00:42:36.091836+0000","last_fullsized":"2023-08-22T00:42:36.091836+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.089810+0000","last_change":"2023-08-22T00:42:35.699372+0000","last_active":"2023-08-22T00:42:36.089810+0000","last_peered":"2023-08-22T00:42:36.089810+0000","last_clean":"2023-08-22T00:42:36.089810+0000","last_became_active":"2023-08-22T00:42:35.699107+0000","last_became_peered":"2023-08-22T00:42:35.699107+0000","last_unstale":"2023-08-22T00:42:36.089810+0000","last_undegraded":"2023-08-22T00:42:36.089810+0000","last_fullsized":"2023-08-22T00:42:36.089810+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.068527+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:42:36.068527+0000","last_peered":"2023-08-22T00:42:36.068527+0000","last_clean":"2023-08-22T00:42:36.068527+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:42:36.068527+0000","last_undegraded":"2023-08-22T00:42:36.068527+0000","last_fullsized":"2023-08-22T00:42:36.068527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.082150+0000","last_change":"2023-08-22T00:42:36.074900+0000","last_active":"2023-08-22T00:42:36.082150+0000","last_peered":"2023-08-22T00:42:36.082150+0000","last_clean":"2023-08-22T00:42:36.082150+0000","last_became_active":"2023-08-22T00:42:36.074649+0000","last_became_peered":"2023-08-22T00:42:36.074649+0000","last_unstale":"2023-08-22T00:42:36.082150+0000","last_undegraded":"2023-08-22T00:42:36.082150+0000","last_fullsized":"2023-08-22T00:42:36.082150+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075428+0000","last_change":"2023-08-22T00:42:35.698369+0000","last_active":"2023-08-22T00:42:36.075428+0000","last_peered":"2023-08-22T00:42:36.075428+0000","last_clean":"2023-08-22T00:42:36.075428+0000","last_became_active":"2023-08-22T00:42:35.697801+0000","last_became_peered":"2023-08-22T00:42:35.697801+0000","last_unstale":"2023-08-22T00:42:36.075428+0000","last_undegraded":"2023-08-22T00:42:36.075428+0000","last_fullsized":"2023-08-22T00:42:36.075428+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.069143+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:42:36.069143+0000","last_peered":"2023-08-22T00:42:36.069143+0000","last_clean":"2023-08-22T00:42:36.069143+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:42:36.069143+0000","last_undegraded":"2023-08-22T00:42:36.069143+0000","last_fullsized":"2023-08-22T00:42:36.069143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.081865+0000","last_change":"2023-08-22T00:42:36.076581+0000","last_active":"2023-08-22T00:42:36.081865+0000","last_peered":"2023-08-22T00:42:36.081865+0000","last_clean":"2023-08-22T00:42:36.081865+0000","last_became_active":"2023-08-22T00:42:36.076315+0000","last_became_peered":"2023-08-22T00:42:36.076315+0000","last_unstale":"2023-08-22T00:42:36.081865+0000","last_undegraded":"2023-08-22T00:42:36.081865+0000","last_fullsized":"2023-08-22T00:42:36.081865+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.061347+0000","last_change":"2023-08-22T00:42:35.705930+0000","last_active":"2023-08-22T00:42:36.061347+0000","last_peered":"2023-08-22T00:42:36.061347+0000","last_clean":"2023-08-22T00:42:36.061347+0000","last_became_active":"2023-08-22T00:42:35.705653+0000","last_became_peered":"2023-08-22T00:42:35.705653+0000","last_unstale":"2023-08-22T00:42:36.061347+0000","last_undegraded":"2023-08-22T00:42:36.061347+0000","last_fullsized":"2023-08-22T00:42:36.061347+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.075976+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:42:36.075976+0000","last_peered":"2023-08-22T00:42:36.075976+0000","last_clean":"2023-08-22T00:42:36.075976+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:42:36.075976+0000","last_undegraded":"2023-08-22T00:42:36.075976+0000","last_fullsized":"2023-08-22T00:42:36.075976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.076103+0000","last_change":"2023-08-22T00:42:36.068690+0000","last_active":"2023-08-22T00:42:36.076103+0000","last_peered":"2023-08-22T00:42:36.076103+0000","last_clean":"2023-08-22T00:42:36.076103+0000","last_became_active":"2023-08-22T00:42:36.068425+0000","last_became_peered":"2023-08-22T00:42:36.068425+0000","last_unstale":"2023-08-22T00:42:36.076103+0000","last_undegraded":"2023-08-22T00:42:36.076103+0000","last_fullsized":"2023-08-22T00:42:36.076103+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:35.671652+0000","last_clean_scrub_stamp":"2023-08-22T00:42:35.671652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.084337+0000","last_change":"2023-08-22T00:42:35.703353+0000","last_active":"2023-08-22T00:42:36.084337+0000","last_peered":"2023-08-22T00:42:36.084337+0000","last_clean":"2023-08-22T00:42:36.084337+0000","last_became_active":"2023-08-22T00:42:35.703030+0000","last_became_peered":"2023-08-22T00:42:35.703030+0000","last_unstale":"2023-08-22T00:42:36.084337+0000","last_undegraded":"2023-08-22T00:42:36.084337+0000","last_fullsized":"2023-08-22T00:42:36.084337+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:42:34.666777+0000","last_clean_scrub_stamp":"2023-08-22T00:42:34.666777+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-22T00:42:36.077594+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:42:36.077594+0000","last_peered":"2023-08-22T00:42:36.077594+0000","last_clean":"2023-08-22T00:42:36.077594+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:42:36.077594+0000","last_undegraded":"2023-08-22T00:42:36.077594+0000","last_fullsized":"2023-08-22T00:42:36.077594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.85999999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.28699999999999998},"max":{"1min":0.69899999999999995,"5min":0.71799999999999997,"15min":0.79700000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.32800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.753,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.80300000000000005,"15min":0.879},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83199999999999996},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.875},"last":0.751},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575279,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060192,"statfs":{"total":96636764160,"available":96317636608,"internally_reserved":0,"allocated":2318336,"data_stored":1233207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27700000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.83699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.82299999999999995},"last":0.627}]},{"osd":1,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.81200000000000006},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.25900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.77400000000000002,"15min":0.81599999999999995},"last":0.53800000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.501},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.79100000000000004},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.63500000000000001,"5min":0.66900000000000004,"15min":0.77300000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80400000000000005,"15min":1.234},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.79200000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.80600000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575279,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2314240,"data_stored":1232327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59299999999999997,"15min":0.61599999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54800000000000004,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.44,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.69199999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.25700000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.875,"15min":0.92500000000000004},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.01},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":1.004,"15min":1.014},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.95899999999999996},"last":0.69299999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.97199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.98599999999999999},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575279,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2310144,"data_stored":1232293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.63800000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.434,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.627},"last":0.29399999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.65300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.371}]},{"osd":4,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.40300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.78600000000000003,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.40699999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.64500000000000002},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.89000000000000001,"15min":1.0249999999999999},"last":0.495},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.79800000000000004,"5min":0.89400000000000002,"15min":0.98699999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":1.0389999999999999},"last":0.502},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575280,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064292,"statfs":{"total":96636764160,"available":96321835008,"internally_reserved":0,"allocated":2314240,"data_stored":1232383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47099999999999997,"5min":0.60499999999999998,"15min":0.64000000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.373}]},{"osd":1,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.622,"15min":0.72099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.254},"max":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.626},"last":0.24299999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54400000000000004,"5min":0.65500000000000003,"15min":0.748},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51500000000000001,"5min":0.64200000000000002,"15min":0.78400000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.434,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0069999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.40899999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.93300000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":0.88,"15min":1.1120000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":0.92300000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.82199999999999995,"5min":0.87,"15min":1.0549999999999999},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575279,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2318336,"data_stored":1233219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.60299999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.308},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46100000000000002},"min":{"1min":0.36799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.373},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.73099999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.378,"15min":0.378},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.95699999999999996,"15min":1.026},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.034},"last":0.499}]},{"osd":7,"last update":"Tue Aug 22 00:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575279,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2326528,"data_stored":1233561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.79500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.81299999999999994},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.373},"max":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78200000000000003,"15min":0.79700000000000004},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72599999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.748,"5min":0.748,"15min":0.79900000000000004},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575278,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064288,"statfs":{"total":96636764160,"available":96321830912,"internally_reserved":0,"allocated":2318336,"data_stored":1232869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.745},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:42:44.435 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:42:44.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:42:44.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.589+0000 7f9e931fc700 1 Processor -- start 2023-08-22T00:42:44.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.589+0000 7f9e931fc700 1 -- start start 2023-08-22T00:42:44.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e931fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9e8c062600 0x7f9e8c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e931fc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c1541c0 con 0x7f9e8c063b10 2023-08-22T00:42:44.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e931fc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c063fc0 con 0x7f9e8c157ab0 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e931fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ca860 con 0x7f9e8c062600 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e91799700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9e8c063b10 0x7f9e8c0acbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55608/0 (socket says 172.21.15.98:55608) 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e91799700 1 -- 172.21.15.98:0/1609650216 learned_addr learned my addr 172.21.15.98:0/1609650216 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/1609650216 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c062600 0x7f9e8c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775867071 0 0) 0x7f9e8c1541c0 con 0x7f9e8c063b10 2023-08-22T00:42:44.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e7c0033f0 con 0x7f9e8c063b10 2023-08-22T00:42:44.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786917808 0 0) 0x7f9e7c0033f0 con 0x7f9e8c063b10 2023-08-22T00:42:44.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c062600 msgr2=0x7f9e8c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 --2- 172.21.15.98:0/1609650216 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c062600 0x7f9e8c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 >> v1:172.21.15.118:6789/0 conn(0x7f9e8c157ab0 legacy=0x7f9e8c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c062a90 con 0x7f9e8c063b10 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.590+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9e840017f0 con 0x7f9e8c063b10 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 >> v1:172.21.15.98:6789/0 conn(0x7f9e8c063b10 legacy=0x7f9e8c0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e7c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e7c004690 0x7f9e7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e7c005000 0x7f9e7c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ca860 con 0x7f9e7c0038e0 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c00be00 con 0x7f9e7c005000 2023-08-22T00:42:44.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c00bfc0 con 0x7f9e7c004690 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e7c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e7c004690 0x7f9e7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e91799700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e7c005000 0x7f9e7c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 -- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e7c004690 msgr2=0x7f9e7c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e7c004690 0x7f9e7c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 -- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e7c005000 msgr2=0x7f9e7c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e7c005000 0x7f9e7c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 -- 172.21.15.98:0/1609650216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0033f0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e91799700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e7c005000 0x7f9e7c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e91799700 1 -- 172.21.15.98:0/1609650216 reap_dead start 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e90f98700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e7c003cc0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f9e80001820 tx=0x7f9e80007b90).ready entity=mon.0 client_cookie=390fc4551006fd66 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80007ea0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80012400 con 0x7f9e7c0038e0 2023-08-22T00:42:44.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.591+0000 7f9e8b7fe700 1 -- 172.21.15.98:0/1609650216 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800127a0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 -- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 msgr2=0x7f9e7c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e7c003cc0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f9e80001820 tx=0x7f9e80007b90).stop 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 -- 172.21.15.98:0/1609650216 shutdown_connections 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 --2- 172.21.15.98:0/1609650216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e7c003cc0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 -- 172.21.15.98:0/1609650216 >> 172.21.15.98:0/1609650216 conn(0x7f9e8c0cb600 msgr2=0x7f9e8c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 -- 172.21.15.98:0/1609650216 shutdown_connections 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.592+0000 7f9e931fc700 1 -- 172.21.15.98:0/1609650216 wait complete. 2023-08-22T00:42:44.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.593+0000 7f9e931fc700 1 Processor -- start 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.593+0000 7f9e931fc700 1 -- start start 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 0x7f9e8c0c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c0c13a0 0x7f9e8c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c1820 con 0x7f9e7c0038e0 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c156570 con 0x7f9e8c0ad110 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c1c70 con 0x7f9e8c0c13a0 2023-08-22T00:42:44.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51522/0 (socket says 172.21.15.98:51522) 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 -- 172.21.15.98:0/2838914086 learned_addr learned my addr 172.21.15.98:0/2838914086 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 0x7f9e8c0c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e91799700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c0c13a0 0x7f9e8c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 -- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c0c13a0 msgr2=0x7f9e8c0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c0c13a0 0x7f9e8c0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 -- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 msgr2=0x7f9e8c0c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 0x7f9e8c0c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 -- 172.21.15.98:0/2838914086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0c1f50 con 0x7f9e7c0038e0 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 0x7f9e8c0c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e90f98700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f9e80001e10 tx=0x7f9e80016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80007ea0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80007240 con 0x7f9e7c0038e0 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c0c2230 con 0x7f9e7c0038e0 2023-08-22T00:42:44.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800075e0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.594+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c147b90 con 0x7f9e7c0038e0 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c0c1780 con 0x7f9e7c0038e0 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9e800068b0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e88ff9700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 0x7f9e700613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9e8007aba0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 0x7f9e700613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.596+0000 7f9e8bfff700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 0x7f9e700613c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9e78006be0 tx=0x7f9e78008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.600+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e8004bdf0 con 0x7f9e7c0038e0 2023-08-22T00:42:44.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.825+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9e8c046c20 con 0x7f9e7c0038e0 2023-08-22T00:42:44.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.829+0000 7f9e88ff9700 1 -- 172.21.15.98:0/2838914086 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9e8004f410 con 0x7f9e7c0038e0 2023-08-22T00:42:44.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.830+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 msgr2=0x7f9e700613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.830+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 0x7f9e700613c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9e78006be0 tx=0x7f9e78008040).stop 2023-08-22T00:42:44.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.830+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 msgr2=0x7f9e8c155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f9e80001e10 tx=0x7f9e80016000).stop 2023-08-22T00:42:44.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 shutdown_connections 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9e7005ef00 0x7f9e700613c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c0c13a0 0x7f9e8c0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e7c0038e0 0x7f9e8c155c30 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 --2- 172.21.15.98:0/2838914086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0ad110 0x7f9e8c0c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 >> 172.21.15.98:0/2838914086 conn(0x7f9e8c0cb600 msgr2=0x7f9e8c147e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 shutdown_connections 2023-08-22T00:42:44.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.831+0000 7f9e931fc700 1 -- 172.21.15.98:0/2838914086 wait complete. 2023-08-22T00:42:44.834 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:42:44.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:42:44.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.958+0000 7fb2b06ec700 1 Processor -- start 2023-08-22T00:42:44.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.958+0000 7fb2b06ec700 1 -- start start 2023-08-22T00:42:44.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.959+0000 7fb2b06ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 0x7fb2a8063210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.959+0000 7fb2b06ec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 0x7fb2a814bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.959+0000 7fb2b06ec700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a80c1b10 con 0x7fb2a80bc000 2023-08-22T00:42:44.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.959+0000 7fb2b06ec700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a8063700 con 0x7fb2a814baf0 2023-08-22T00:42:44.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.959+0000 7fb2b06ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a814c440 con 0x7fb2a8062e30 2023-08-22T00:42:44.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 0x7fb2a8063210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2adc87700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 0x7fb2a814bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2aec89700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb2a80bc000 0x7fb2a80bc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:48212/0 (socket says 172.21.15.98:48212) 2023-08-22T00:42:44.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2aec89700 1 -- 172.21.15.98:0/721523751 learned_addr learned my addr 172.21.15.98:0/721523751 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:44.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 -- 172.21.15.98:0/721523751 >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 msgr2=0x7fb2a814bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:44.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 --2- 172.21.15.98:0/721523751 >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 0x7fb2a814bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 -- 172.21.15.98:0/721523751 >> v1:172.21.15.118:6789/0 conn(0x7fb2a80bc000 legacy=0x7fb2a80bc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 -- 172.21.15.98:0/721523751 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80bcd70 con 0x7fb2a8062e30 2023-08-22T00:42:44.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2adc87700 1 --2- 172.21.15.98:0/721523751 >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 0x7fb2a814bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:44.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ae488700 1 --2- 172.21.15.98:0/721523751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 0x7fb2a8063210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb298009760 tx=0x7fb298009060).ready entity=mon.2 client_cookie=16608f1461213208 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ad486700 1 -- 172.21.15.98:0/721523751 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800b590 con 0x7fb2a8062e30 2023-08-22T00:42:44.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ad486700 1 -- 172.21.15.98:0/721523751 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800b6f0 con 0x7fb2a8062e30 2023-08-22T00:42:44.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.960+0000 7fb2ad486700 1 -- 172.21.15.98:0/721523751 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800ba70 con 0x7fb2a8062e30 2023-08-22T00:42:44.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 -- 172.21.15.98:0/721523751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 msgr2=0x7fb2a8063210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/721523751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 0x7fb2a8063210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb298009760 tx=0x7fb298009060).stop 2023-08-22T00:42:44.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 -- 172.21.15.98:0/721523751 shutdown_connections 2023-08-22T00:42:44.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/721523751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a8062e30 0x7fb2a8063210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/721523751 >> v2:172.21.15.118:3300/0 conn(0x7fb2a814baf0 0x7fb2a814bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 -- 172.21.15.98:0/721523751 >> 172.21.15.98:0/721523751 conn(0x7fb2a80c3980 msgr2=0x7fb2a80c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:44.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 -- 172.21.15.98:0/721523751 shutdown_connections 2023-08-22T00:42:44.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.961+0000 7fb2b06ec700 1 -- 172.21.15.98:0/721523751 wait complete. 2023-08-22T00:42:44.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.963+0000 7fb2b06ec700 1 Processor -- start 2023-08-22T00:42:44.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.963+0000 7fb2b06ec700 1 -- start start 2023-08-22T00:42:44.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 0x7fb2a80ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 0x7fb2a8148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a8162210 con 0x7fb2a8062e30 2023-08-22T00:42:44.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a80be000 con 0x7fb2a814baf0 2023-08-22T00:42:44.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a80beb80 con 0x7fb2a80bc000 2023-08-22T00:42:44.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51528/0 (socket says 172.21.15.98:51528) 2023-08-22T00:42:44.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 -- 172.21.15.98:0/2885899001 learned_addr learned my addr 172.21.15.98:0/2885899001 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:44.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2aec89700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 0x7fb2a8148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2adc87700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 0x7fb2a80ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 -- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 msgr2=0x7fb2a80ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.978 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 0x7fb2a80ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 -- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 msgr2=0x7fb2a8148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:44.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 0x7fb2a8148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:44.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 -- 172.21.15.98:0/2885899001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40092a0 con 0x7fb2a8062e30 2023-08-22T00:42:44.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2aec89700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 0x7fb2a8148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:44.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2adc87700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 0x7fb2a80ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:44.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2ae488700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fb2a814c580 tx=0x7fb298017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800b860 con 0x7fb2a8062e30 2023-08-22T00:42:44.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800b9c0 con 0x7fb2a8062e30 2023-08-22T00:42:44.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2980092a0 con 0x7fb2a8062e30 2023-08-22T00:42:44.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29801b660 con 0x7fb2a8062e30 2023-08-22T00:42:44.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.964+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a80be250 con 0x7fb2a8062e30 2023-08-22T00:42:44.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.965+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a81472c0 con 0x7fb2a8062e30 2023-08-22T00:42:44.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.966+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb29801ba50 con 0x7fb2a8062e30 2023-08-22T00:42:44.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.966+0000 7fb29e7fc700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 0x7fb28c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:44.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.966+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb29807ba40 con 0x7fb2a8062e30 2023-08-22T00:42:44.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.966+0000 7fb2adc87700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 0x7fb28c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:44.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.966+0000 7fb2adc87700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 0x7fb28c0613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb2a4009270 tx=0x7fb2a4008040).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:44.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:44.971+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb29804cbd0 con 0x7fb2a8062e30 2023-08-22T00:42:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.170+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2a8047480 con 0x7fb2a8062e30 2023-08-22T00:42:45.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.171+0000 7fb29e7fc700 1 -- 172.21.15.98:0/2885899001 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fb298006b30 con 0x7fb2a8062e30 2023-08-22T00:42:45.173 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:42:45.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 msgr2=0x7fb28c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 0x7fb28c0613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb2a4009270 tx=0x7fb2a4008040).stop 2023-08-22T00:42:45.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 msgr2=0x7fb2a8161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fb2a814c580 tx=0x7fb298017000).stop 2023-08-22T00:42:45.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 shutdown_connections 2023-08-22T00:42:45.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb28c05ef30 0x7fb28c0613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2a814baf0 0x7fb2a8148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a8062e30 0x7fb2a8161d20 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 --2- 172.21.15.98:0/2885899001 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2a80bc000 0x7fb2a80ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 >> 172.21.15.98:0/2885899001 conn(0x7fb2a80c3980 msgr2=0x7fb2a80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 shutdown_connections 2023-08-22T00:42:45.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.173+0000 7fb2b06ec700 1 -- 172.21.15.98:0/2885899001 wait complete. 2023-08-22T00:42:45.179 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:42:45.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:42:36.057336+0000', 'modified': '2023-08-22T00:42:38.685301+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9360}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9360': {'gid': 9360, 'name': 'd', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6834/1912312380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 1912312380}, {'type': 'v1', 'addr': '172.21.15.118:6834', 'nonce': 1912312380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:42:45.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:42:45.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-22T00:42:45.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.710+0000 7f70cfb9a700 1 Processor -- start 2023-08-22T00:42:45.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.710+0000 7f70cfb9a700 1 -- start start 2023-08-22T00:42:45.712 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cfb9a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c80c5f50 0x7f70c8063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cfb9a700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c80bfe30 con 0x7f70c80c5b70 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cfb9a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c80636a0 con 0x7f70c8153f80 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cfb9a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c8063980 con 0x7f70c80c5f50 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cd936700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f70c80c5b70 0x7f70c8153870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55616/0 (socket says 172.21.15.98:55616) 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.711+0000 7f70cd936700 1 -- 172.21.15.98:0/1250209645 learned_addr learned my addr 172.21.15.98:0/1250209645 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70ce137700 1 --2- 172.21.15.98:0/1250209645 >> v2:172.21.15.118:3300/0 conn(0x7f70c80c5f50 0x7f70c8063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681648105 0 0) 0x7f70c80bfe30 con 0x7f70c80c5b70 2023-08-22T00:42:45.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b40033f0 con 0x7f70c80c5b70 2023-08-22T00:42:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877554518 0 0) 0x7f70b40033f0 con 0x7f70c80c5b70 2023-08-22T00:42:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 >> v2:172.21.15.118:3300/0 conn(0x7f70c80c5f50 msgr2=0x7f70c8063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 --2- 172.21.15.98:0/1250209645 >> v2:172.21.15.118:3300/0 conn(0x7f70c80c5f50 0x7f70c8063010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 >> v1:172.21.15.118:6789/0 conn(0x7f70c8153f80 legacy=0x7f70c80c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8063c60 con 0x7f70c80c5b70 2023-08-22T00:42:45.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f70b8001470 con 0x7f70c80c5b70 2023-08-22T00:42:45.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 >> v1:172.21.15.98:6789/0 conn(0x7f70c80c5b70 legacy=0x7f70c8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.718 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 0x7f70b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70b4004690 0x7f70b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b4005000 0x7f70b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.719 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8063980 con 0x7f70b40038e0 2023-08-22T00:42:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b400beb0 con 0x7f70b4004690 2023-08-22T00:42:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b400c070 con 0x7f70b4005000 2023-08-22T00:42:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 0x7f70b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd135700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70b4004690 0x7f70b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70ce137700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b4005000 0x7f70b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 -- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b4005000 msgr2=0x7f70b400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b4005000 0x7f70b400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 -- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70b4004690 msgr2=0x7f70b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70b4004690 0x7f70b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70ce137700 1 -- 172.21.15.98:0/1250209645 reap_dead start 2023-08-22T00:42:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd936700 1 -- 172.21.15.98:0/1250209645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40033f0 con 0x7f70b40038e0 2023-08-22T00:42:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.712+0000 7f70cd135700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70b4004690 0x7f70b4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cd936700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 0x7f70b4003d00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f70b800c160 tx=0x7f70c80bffc0).ready entity=mon.0 client_cookie=f6ae2b1cee6c1c8d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b800ca10 con 0x7f70b40038e0 2023-08-22T00:42:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b800cb70 con 0x7f70b40038e0 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cc934700 1 -- 172.21.15.98:0/1250209645 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80070d0 con 0x7f70b40038e0 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 -- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 msgr2=0x7f70b4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 0x7f70b4003d00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f70b800c160 tx=0x7f70c80bffc0).stop 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 -- 172.21.15.98:0/1250209645 shutdown_connections 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/1250209645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70b40038e0 0x7f70b4003d00 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 -- 172.21.15.98:0/1250209645 >> 172.21.15.98:0/1250209645 conn(0x7f70c80cb610 msgr2=0x7f70c80c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 -- 172.21.15.98:0/1250209645 shutdown_connections 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.713+0000 7f70cfb9a700 1 -- 172.21.15.98:0/1250209645 wait complete. 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.714+0000 7f70cfb9a700 1 Processor -- start 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.714+0000 7f70cfb9a700 1 -- start start 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b40038e0 0x7f70c80c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c80adaf0 0x7f70c80c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c80aec00 con 0x7f70c80c8e40 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c80c92a0 con 0x7f70c80adaf0 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cfb9a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c80adff0 con 0x7f70b40038e0 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51542/0 (socket says 172.21.15.98:51542) 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 -- 172.21.15.98:0/188830778 learned_addr learned my addr 172.21.15.98:0/188830778 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cd936700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b40038e0 0x7f70c80c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70cd135700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c80adaf0 0x7f70c80c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 -- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b40038e0 msgr2=0x7f70c80c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b40038e0 0x7f70c80c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 -- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c80adaf0 msgr2=0x7f70c80c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c80adaf0 0x7f70c80c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.715+0000 7f70ce137700 1 -- 172.21.15.98:0/188830778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c80ae2d0 con 0x7f70c80c8e40 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70ce137700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f70c80bfb40 tx=0x7f70c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70bdffb700 1 -- 172.21.15.98:0/188830778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000e070 con 0x7f70c80c8e40 2023-08-22T00:42:45.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70bdffb700 1 -- 172.21.15.98:0/188830778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0011b80 con 0x7f70c80c8e40 2023-08-22T00:42:45.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c80ae5b0 con 0x7f70c80c8e40 2023-08-22T00:42:45.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70bdffb700 1 -- 172.21.15.98:0/188830778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0016450 con 0x7f70c80c8e40 2023-08-22T00:42:45.728 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.716+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c80c0bd0 con 0x7f70c80c8e40 2023-08-22T00:42:45.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.717+0000 7f70bdffb700 1 -- 172.21.15.98:0/188830778 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f70c0016880 con 0x7f70c80c8e40 2023-08-22T00:42:45.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.718+0000 7f70bdffb700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 0x7f70ac061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.718+0000 7f70bdffb700 1 -- 172.21.15.98:0/188830778 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f70c007a540 con 0x7f70c80c8e40 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.718+0000 7f70cd936700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 0x7f70ac061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.718+0000 7f70cd936700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 0x7f70ac061420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f70c8151b90 tx=0x7f70b8015000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.720+0000 7f70e154eb80 1 Processor -- start 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.720+0000 7f70e154eb80 1 -- start start 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae31276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae3122f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae3063db0 con 0x55fae316ff60 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae3079030 con 0x55fae3122af0 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fae3079170 con 0x55fae31272c0 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51558/0 (socket says 172.21.15.98:51558) 2023-08-22T00:42:45.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 -- 172.21.15.98:0/2446643914 learned_addr learned my addr 172.21.15.98:0/2446643914 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd936700 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae31276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70ce137700 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae3122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 -- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 msgr2=0x55fae31276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae31276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 -- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 msgr2=0x55fae3122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae3122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 -- 172.21.15.98:0/2446643914 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fae304bb00 con 0x55fae316ff60 2023-08-22T00:42:45.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70cd135700 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f70c4003490 tx=0x7f70c4009040).ready entity=mon.0 client_cookie=eaa138195252c508 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70b2ffd700 1 -- 172.21.15.98:0/2446643914 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4013540 con 0x55fae316ff60 2023-08-22T00:42:45.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70b2ffd700 1 -- 172.21.15.98:0/2446643914 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40136a0 con 0x55fae316ff60 2023-08-22T00:42:45.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.721+0000 7f70b2ffd700 1 -- 172.21.15.98:0/2446643914 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4013a20 con 0x55fae316ff60 2023-08-22T00:42:45.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- 172.21.15.98:0/2446643914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 msgr2=0x55fae3122600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f70c4003490 tx=0x7f70c4009040).stop 2023-08-22T00:42:45.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- 172.21.15.98:0/2446643914 shutdown_connections 2023-08-22T00:42:45.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae31276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae3122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.738 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 --2- 172.21.15.98:0/2446643914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae316ff60 0x55fae3122600 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- 172.21.15.98:0/2446643914 >> 172.21.15.98:0/2446643914 conn(0x55fae2f91940 msgr2=0x55fae31703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- 172.21.15.98:0/2446643914 shutdown_connections 2023-08-22T00:42:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- 172.21.15.98:0/2446643914 wait complete. 2023-08-22T00:42:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.722+0000 7f70e154eb80 1 -- start start 2023-08-22T00:42:45.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 Processor -- start 2023-08-22T00:42:45.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae316b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 0x55fae3153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae30793f0 con 0x55fae3122af0 2023-08-22T00:42:45.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.723+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae3044920 con 0x55fae3153910 2023-08-22T00:42:45.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fae3152af0 con 0x55fae31272c0 2023-08-22T00:42:45.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70e154eb80 10 client.0 ll_register_callbacks cb 0x55fae3019ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:42:45.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51566/0 (socket says 172.21.15.98:51566) 2023-08-22T00:42:45.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 -- 172.21.15.98:0/3576429072 learned_addr learned my addr 172.21.15.98:0/3576429072 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd135700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae316b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70ce137700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 0x55fae3153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 -- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 msgr2=0x55fae316b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae316b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 -- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 msgr2=0x55fae3153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 0x55fae3153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 -- 172.21.15.98:0/3576429072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c400f040 con 0x55fae3122af0 2023-08-22T00:42:45.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd135700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae316b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:45.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70ce137700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 0x55fae3153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70cd936700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f70b8000cb0 tx=0x7f70b801e000).ready entity=mon.0 client_cookie=27cc1de0744b3084 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:42:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8004a10 con 0x55fae3122af0 2023-08-22T00:42:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f70b8004b70 con 0x55fae3122af0 2023-08-22T00:42:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fae3121aa0 con 0x55fae3122af0 2023-08-22T00:42:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b8013450 con 0x55fae3122af0 2023-08-22T00:42:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70e154eb80 10 client.9507 fetch_fsmap learned FSMap version 69 2023-08-22T00:42:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55fae3071f70 con 0x55fae3122af0 2023-08-22T00:42:45.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.724+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fae3121aa0 con 0x55fae3122af0 2023-08-22T00:42:45.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f70b80135b0 con 0x55fae3122af0 2023-08-22T00:42:45.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 10 client.9507 fetch_fsmap finished waiting for FSMap version 69 2023-08-22T00:42:45.748 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 10 client.9507 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 20 client.9507 populate_metadata read hostname 'smithi098' 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3152170 0x55fae31899d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 4 client.9507 mds_command: new command op to 9360 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 --> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fae2ee1ef0 con 0x55fae3152170 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70cd135700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3152170 0x55fae31899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70a7fff700 10 client.9507 ms_handle_connect on v2:172.21.15.118:6832/1912312380 2023-08-22T00:42:45.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.725+0000 7f70cd135700 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3152170 0x55fae31899d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=73742943d0b37854 server_cookie=b13baa19c34d3c81 in_seq=0 out_seq=0 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70a7fff700 1 -- 172.21.15.98:0/3576429072 <== mds.0 v2:172.21.15.118:6832/1912312380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55fae2ee1ef0 con 0x55fae3152170 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70a7fff700 10 client.9507 handle_command_reply: tid=0 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 client.9507 shutdown 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 msgr2=0x55fae314c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f70b8000cb0 tx=0x7f70b801e000).stop 2023-08-22T00:42:45.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 shutdown_connections 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3152170 0x55fae31899d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3153910 0x55fae3153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70a7fff700 0 client.9507 ms_handle_reset on v2:172.21.15.118:6832/1912312380 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3122af0 0x55fae314c520 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 --2- 172.21.15.98:0/3576429072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae31272c0 0x55fae316b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 >> 172.21.15.98:0/3576429072 conn(0x55fae2f91940 msgr2=0x55fae3125330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 shutdown_connections 2023-08-22T00:42:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 1 -- 172.21.15.98:0/3576429072 wait complete. 2023-08-22T00:42:45.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.726+0000 7f70e154eb80 20 client.9507 trim_cache size 0 max 16384 2023-08-22T00:42:45.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.742+0000 7f70e154eb80 1 Processor -- start 2023-08-22T00:42:45.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.742+0000 7f70e154eb80 1 -- start start 2023-08-22T00:42:45.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae317b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 0x55fae3122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae3156030 con 0x55fae31272c0 2023-08-22T00:42:45.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae311be30 con 0x55fae3122af0 2023-08-22T00:42:45.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fae317bee0 con 0x55fae3153910 2023-08-22T00:42:45.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51570/0 (socket says 172.21.15.98:51570) 2023-08-22T00:42:45.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 -- 172.21.15.98:0/357681739 learned_addr learned my addr 172.21.15.98:0/357681739 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70ce137700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 0x55fae3122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd936700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae317b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 -- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 msgr2=0x55fae3122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 0x55fae3122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 -- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 msgr2=0x55fae317b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.743+0000 7f70cd135700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae317b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70cd135700 1 -- 172.21.15.98:0/357681739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fae316c6b0 con 0x55fae31272c0 2023-08-22T00:42:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70ce137700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 0x55fae3122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70cd936700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae317b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70cd135700 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f70c4003be0 tx=0x7f70c401a000).ready entity=mon.0 client_cookie=93979159b93374f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70b37fe700 1 -- 172.21.15.98:0/357681739 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4029070 con 0x55fae31272c0 2023-08-22T00:42:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70b37fe700 1 -- 172.21.15.98:0/357681739 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4000d30 con 0x55fae31272c0 2023-08-22T00:42:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70b37fe700 1 -- 172.21.15.98:0/357681739 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4013810 con 0x55fae31272c0 2023-08-22T00:42:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 -- 172.21.15.98:0/357681739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 msgr2=0x55fae317b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f70c4003be0 tx=0x7f70c401a000).stop 2023-08-22T00:42:45.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 -- 172.21.15.98:0/357681739 shutdown_connections 2023-08-22T00:42:45.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3153910 0x55fae3122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae3122af0 0x55fae317b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 --2- 172.21.15.98:0/357681739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae31272c0 0x55fae317b9f0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 -- 172.21.15.98:0/357681739 >> 172.21.15.98:0/357681739 conn(0x55fae2f91940 msgr2=0x55fae31703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 -- 172.21.15.98:0/357681739 shutdown_connections 2023-08-22T00:42:45.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.744+0000 7f70e154eb80 1 -- 172.21.15.98:0/357681739 wait complete. 2023-08-22T00:42:45.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.745+0000 7f70e154eb80 1 -- start start 2023-08-22T00:42:45.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.745+0000 7f70e154eb80 1 Processor -- start 2023-08-22T00:42:45.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3122af0 0x55fae31c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae31272c0 0x55fae317e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae31283c0 con 0x55fae3153910 2023-08-22T00:42:45.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fae317ec60 con 0x55fae31272c0 2023-08-22T00:42:45.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fae31d21e0 con 0x55fae3122af0 2023-08-22T00:42:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70e154eb80 10 client.0 ll_register_callbacks cb 0x55fae3019ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:42:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51584/0 (socket says 172.21.15.98:51584) 2023-08-22T00:42:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 -- 172.21.15.98:0/132929833 learned_addr learned my addr 172.21.15.98:0/132929833 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70cd936700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3122af0 0x55fae31c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70cd135700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae31272c0 0x55fae317e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 -- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3122af0 msgr2=0x55fae31c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3122af0 0x55fae31c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 -- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae31272c0 msgr2=0x55fae317e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae31272c0 0x55fae317e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 -- 172.21.15.98:0/132929833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fae304bb00 con 0x55fae3153910 2023-08-22T00:42:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70ce137700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f70c0009fd0 tx=0x7f70c0022040).ready entity=mon.0 client_cookie=324fe52d6d60039 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:42:45.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.746+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c004ba30 con 0x55fae3153910 2023-08-22T00:42:45.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f70c004bb90 con 0x55fae3153910 2023-08-22T00:42:45.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c40136a0 con 0x55fae3153910 2023-08-22T00:42:45.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c007a0b0 con 0x55fae3153910 2023-08-22T00:42:45.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 10 client.9513 fetch_fsmap learned FSMap version 69 2023-08-22T00:42:45.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55fae306d580 con 0x55fae3153910 2023-08-22T00:42:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40136a0 con 0x55fae3153910 2023-08-22T00:42:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f70c004e810 con 0x55fae3153910 2023-08-22T00:42:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 10 client.9513 fetch_fsmap finished waiting for FSMap version 69 2023-08-22T00:42:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 10 client.9513 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-22T00:42:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 20 client.9513 populate_metadata read hostname 'smithi098' 2023-08-22T00:42:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3122ed0 0x55fae31232b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 4 client.9513 mds_command: new command op to 9360 tid=0[{"prefix": "status"}] 2023-08-22T00:42:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 --> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fae2f17040 con 0x55fae3122ed0 2023-08-22T00:42:45.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70cd936700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3122ed0 0x55fae31232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70a7fff700 10 client.9513 ms_handle_connect on v2:172.21.15.118:6832/1912312380 2023-08-22T00:42:45.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.747+0000 7f70cd936700 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3122ed0 0x55fae31232b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4ee9274a1e8190ee server_cookie=333c6da5bb945bd7 in_seq=0 out_seq=0 2023-08-22T00:42:45.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70a7fff700 1 -- 172.21.15.98:0/132929833 <== mds.0 v2:172.21.15.118:6832/1912312380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55fae2f17040 con 0x55fae3122ed0 2023-08-22T00:42:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70a7fff700 10 client.9513 handle_command_reply: tid=0 2023-08-22T00:42:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 client.9513 shutdown 2023-08-22T00:42:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 msgr2=0x55fae31d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f70c0009fd0 tx=0x7f70c0022040).stop 2023-08-22T00:42:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 shutdown_connections 2023-08-22T00:42:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fae3122af0 0x55fae31c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:6832/1912312380,v1:172.21.15.118:6834/1912312380] conn(0x55fae3122ed0 0x55fae31232b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fae3153910 0x55fae31d2670 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70a7fff700 0 client.9513 ms_handle_reset on v2:172.21.15.118:6832/1912312380 2023-08-22T00:42:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 --2- 172.21.15.98:0/132929833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fae31272c0 0x55fae317e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 >> 172.21.15.98:0/132929833 conn(0x55fae2f91940 msgr2=0x55fae31703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 shutdown_connections 2023-08-22T00:42:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 1 -- 172.21.15.98:0/132929833 wait complete. 2023-08-22T00:42:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70e154eb80 20 client.9513 trim_cache size 0 max 16384 2023-08-22T00:42:45.778 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:42:45.779 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:42:45.779 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:42:45.779 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 9360, 2023-08-22T00:42:45.780 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:42:45.780 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:42:45.780 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:42:45.780 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.6900021120000002, 2023-08-22T00:42:45.781 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 69, 2023-08-22T00:42:45.781 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 185, 2023-08-22T00:42:45.781 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 185, 2023-08-22T00:42:45.781 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.169975817999999 2023-08-22T00:42:45.782 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:42:45.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 msgr2=0x7f70ac061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 0x7f70ac061420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f70c8151b90 tx=0x7f70b8015000).stop 2023-08-22T00:42:45.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 msgr2=0x7f70c80af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f70c80bfb40 tx=0x7f70c000b040).stop 2023-08-22T00:42:45.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 shutdown_connections 2023-08-22T00:42:45.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f70ac05ef60 0x7f70ac061420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70b40038e0 0x7f70c80c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c80c8e40 0x7f70c80af090 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 --2- 172.21.15.98:0/188830778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c80adaf0 0x7f70c80c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.748+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 >> 172.21.15.98:0/188830778 conn(0x7f70c80cb610 msgr2=0x7f70c80c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.749+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 shutdown_connections 2023-08-22T00:42:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.749+0000 7f70cfb9a700 1 -- 172.21.15.98:0/188830778 wait complete. 2023-08-22T00:42:45.787 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:42:45.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.891+0000 7f19d6c6f700 1 Processor -- start 2023-08-22T00:42:45.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.891+0000 7f19d6c6f700 1 -- start start 2023-08-22T00:42:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d6c6f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19d00c1520 0x7f19d0063600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d6c6f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d0063af0 0x7f19d0154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d6c6f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d0063f80 con 0x7f19d00a6240 2023-08-22T00:42:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d6c6f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d014b570 con 0x7f19d00c1520 2023-08-22T00:42:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d6c6f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01513c0 con 0x7f19d0063af0 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19d00c1520 0x7f19d0063600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f19d00c1520 0x7f19d0063600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51592/0 (socket says 172.21.15.98:51592) 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 -- 172.21.15.98:0/4121157138 learned_addr learned my addr 172.21.15.98:0/4121157138 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19d520c700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d0063af0 0x7f19d0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 -- 172.21.15.98:0/4121157138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d0063af0 msgr2=0x7f19d0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d0063af0 0x7f19d0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.895 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 -- 172.21.15.98:0/4121157138 >> v1:172.21.15.118:6789/0 conn(0x7f19d00a6240 legacy=0x7f19d00a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:45.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 -- 172.21.15.98:0/4121157138 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00c1960 con 0x7f19d00c1520 2023-08-22T00:42:45.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cffff700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d00c1520 0x7f19d0063600 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f19bc006fd0 tx=0x7f19bc0090f0).ready entity=mon.0 client_cookie=97dd07d480e8683e server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cf7fe700 1 -- 172.21.15.98:0/4121157138 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00b600 con 0x7f19d00c1520 2023-08-22T00:42:45.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cf7fe700 1 -- 172.21.15.98:0/4121157138 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00b760 con 0x7f19d00c1520 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.892+0000 7f19cf7fe700 1 -- 172.21.15.98:0/4121157138 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00bae0 con 0x7f19d00c1520 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4121157138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d00c1520 msgr2=0x7f19d0063600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d00c1520 0x7f19d0063600 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f19bc006fd0 tx=0x7f19bc0090f0).stop 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4121157138 shutdown_connections 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d0063af0 0x7f19d0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4121157138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d00c1520 0x7f19d0063600 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4121157138 >> 172.21.15.98:0/4121157138 conn(0x7f19d00c4490 msgr2=0x7f19d0069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:45.897 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4121157138 shutdown_connections 2023-08-22T00:42:45.898 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.893+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4121157138 wait complete. 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.894+0000 7f19d6c6f700 1 Processor -- start 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 -- start start 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d00a6240 0x7f19d01642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19d00c1520 0x7f19d00bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0149120 con 0x7f19d0063af0 2023-08-22T00:42:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00ab840 con 0x7f19d00c1520 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.895+0000 7f19d6c6f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01647b0 con 0x7f19d00a6240 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51596/0 (socket says 172.21.15.98:51596) 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 -- 172.21.15.98:0/4263111219 learned_addr learned my addr 172.21.15.98:0/4263111219 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19cffff700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d00a6240 0x7f19d01642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d520c700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19d00c1520 0x7f19d00bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.901 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 -- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d00a6240 msgr2=0x7f19d01642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d00a6240 0x7f19d01642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 -- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19d00c1520 msgr2=0x7f19d00bdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19d00c1520 0x7f19d00bdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 -- 172.21.15.98:0/4263111219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc009370 con 0x7f19d0063af0 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d4a0b700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f19c400c4c0 tx=0x7f19c4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400ce70 con 0x7f19d0063af0 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4001e90 con 0x7f19d0063af0 2023-08-22T00:42:45.902 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d00be4b0 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4007270 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.896+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d0164d10 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.897+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0047480 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.897+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f19c40066a0 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.898+0000 7f19ccff9700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 0x7f19b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.898+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f19c40798e0 con 0x7f19d0063af0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.898+0000 7f19cffff700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 0x7f19b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.898+0000 7f19cffff700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 0x7f19b40613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f19bc009130 tx=0x7f19bc017000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:45.903+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19c404aa70 con 0x7f19d0063af0 2023-08-22T00:42:46.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.105+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19d0151680 con 0x7f19d0063af0 2023-08-22T00:42:46.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.105+0000 7f19ccff9700 1 -- 172.21.15.98:0/4263111219 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19c404e090 con 0x7f19d0063af0 2023-08-22T00:42:46.106 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:42:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 msgr2=0x7f19b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 0x7f19b40613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f19bc009130 tx=0x7f19bc017000).stop 2023-08-22T00:42:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 msgr2=0x7f19d0148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f19c400c4c0 tx=0x7f19c4007e00).stop 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 shutdown_connections 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f19b405ef30 0x7f19b40613f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19d00c1520 0x7f19d00bdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d0063af0 0x7f19d0148c30 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 --2- 172.21.15.98:0/4263111219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19d00a6240 0x7f19d01642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 >> 172.21.15.98:0/4263111219 conn(0x7f19d00c4490 msgr2=0x7f19d00c32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 shutdown_connections 2023-08-22T00:42:46.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:46.107+0000 7f19d6c6f700 1 -- 172.21.15.98:0/4263111219 wait complete. 2023-08-22T00:42:46.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:42:46.119 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:42:46.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:42:46.120 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:42:46.120 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:46.120 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:42:46.120 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:42:46.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:42:46.121 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:42:46.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.122 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:42:46.140 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.141 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:42:46.142 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 40340sec preferred_lft 40340sec 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:42:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:42:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.145 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:42:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:42:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:42:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:42:46.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.146 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:42:46.206 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:42:46.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.208 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:42:46.268 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:42:46.269 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:42:46.269 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:42:46.269 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:42:46.269 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:42:46.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.270 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:42:46.270 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:42:46.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:42:46.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:42:46.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:42:46.271 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:42:46.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.374 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:42:46.393 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:42:46.393 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:42:46.394 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:42:46.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:42:46.395 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:42:46.460 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:42:46.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:46.462 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:46.519 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:42:46.519 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:42:46.586 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:42:46.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:42:46.654 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:42:46.655 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:42:46.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:46.657 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:42:46.714 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:42:46.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:46.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:42:46.784 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:42:46.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:42:46.837 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:42:46.836+0000 7fea2f2b33c0 -1 init, newargv = 0x55cbdac15a10 newargc=15 2023-08-22T00:42:46.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[173545]: starting ceph client 2023-08-22T00:42:46.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[173545]: starting fuse 2023-08-22T00:42:46.853 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:42:46.854 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:42:46.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:46.855 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:42:46.913 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:42:46.913 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:42:46.914 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:42:46.914 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:42:46.914 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:42:46.914 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:42:46.915 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:42:46.915 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:42:46.915 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:42:46.916 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:42:46.916 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:42:46.916 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:42:46.917 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:42:46.917 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:42:46.917 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:42:46.917 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:42:46.918 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:42:46.918 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:42:46.918 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:42:46.919 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:42:46.919 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:42:46.919 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:42:46.919 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:42:46.920 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:42:46.920 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:42:46.920 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:42:46.921 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:42:46.921 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:42:46.921 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:42:47.035 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.173545.asok 2023-08-22T00:42:47.218 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.173545.asok 2023-08-22T00:42:47.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:47.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.173545.asok status 2023-08-22T00:42:47.368 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:42:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "173545", 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 9528, 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:42:47.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 9528 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 4138540656 2023-08-22T00:42:47.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 4138540656 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.9528 192.168.0.1:0/4138540656", 2023-08-22T00:42:47.372 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/4138540656", 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 69, 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 185, 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:42:47.373 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:42:47.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:47.378 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:42:47.379 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:47.397 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:42:47.397 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:47.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:47.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:42:47.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:42:47.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.623+0000 7fc5cb982700 1 Processor -- start 2023-08-22T00:42:47.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.623+0000 7fc5cb982700 1 -- start start 2023-08-22T00:42:47.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5cb982700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc5c4150b30 0x7fc5c40c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5cb982700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40be5d0 con 0x7fc5c4065870 2023-08-22T00:42:47.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5cb982700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c4067590 con 0x7fc5c4150750 2023-08-22T00:42:47.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5cb982700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c4067870 con 0x7fc5c4150b30 2023-08-22T00:42:47.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5c8f1d700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc5c4065870 0x7fc5c40bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55622/0 (socket says 172.21.15.98:55622) 2023-08-22T00:42:47.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.624+0000 7fc5c8f1d700 1 -- 172.21.15.98:0/1383612036 learned_addr learned my addr 172.21.15.98:0/1383612036 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c9f1f700 1 --2- 172.21.15.98:0/1383612036 >> v2:172.21.15.118:3300/0 conn(0x7fc5c4150b30 0x7fc5c40c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357383484 0 0) 0x7fc5c40be5d0 con 0x7fc5c4065870 2023-08-22T00:42:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b00033f0 con 0x7fc5c4065870 2023-08-22T00:42:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384550063 0 0) 0x7fc5b00033f0 con 0x7fc5c4065870 2023-08-22T00:42:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 >> v2:172.21.15.118:3300/0 conn(0x7fc5c4150b30 msgr2=0x7fc5c40c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:47.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 --2- 172.21.15.98:0/1383612036 >> v2:172.21.15.118:3300/0 conn(0x7fc5c4150b30 0x7fc5c40c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 >> v1:172.21.15.118:6789/0 conn(0x7fc5c4150750 legacy=0x7fc5c40a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4067b50 con 0x7fc5c4065870 2023-08-22T00:42:47.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc5c0001470 con 0x7fc5c4065870 2023-08-22T00:42:47.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 >> v1:172.21.15.98:6789/0 conn(0x7fc5c4065870 legacy=0x7fc5c40bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 0x7fc5b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b0004690 0x7fc5b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5b0005000 0x7fc5b000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4067870 con 0x7fc5b00038e0 2023-08-22T00:42:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000bf60 con 0x7fc5b0004690 2023-08-22T00:42:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000c0f0 con 0x7fc5b0005000 2023-08-22T00:42:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 0x7fc5b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c8f1d700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b0004690 0x7fc5b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c9f1f700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5b0005000 0x7fc5b000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 -- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5b0005000 msgr2=0x7fc5b000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5b0005000 0x7fc5b000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 -- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b0004690 msgr2=0x7fc5b0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b0004690 0x7fc5b0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c971e700 1 -- 172.21.15.98:0/1383612036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00033f0 con 0x7fc5b00038e0 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.625+0000 7fc5c9f1f700 1 -- 172.21.15.98:0/1383612036 reap_dead start 2023-08-22T00:42:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 0x7fc5b0003d00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fc5b4001730 tx=0x7fc5b4007bb0).ready entity=mon.0 client_cookie=e03cd19870d91615 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007020 con 0x7fc5b00038e0 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4007180 con 0x7fc5b00038e0 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5bbfff700 1 -- 172.21.15.98:0/1383612036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007520 con 0x7fc5b00038e0 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 -- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 msgr2=0x7fc5b0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 0x7fc5b0003d00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fc5b4001730 tx=0x7fc5b4007bb0).stop 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 -- 172.21.15.98:0/1383612036 shutdown_connections 2023-08-22T00:42:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1383612036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b00038e0 0x7fc5b0003d00 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 -- 172.21.15.98:0/1383612036 >> 172.21.15.98:0/1383612036 conn(0x7fc5c40c7800 msgr2=0x7fc5c40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 -- 172.21.15.98:0/1383612036 shutdown_connections 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.626+0000 7fc5cb982700 1 -- 172.21.15.98:0/1383612036 wait complete. 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.627+0000 7fc5cb982700 1 Processor -- start 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.627+0000 7fc5cb982700 1 -- start start 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 0x7fc5c4145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 0x7fc5c4141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4146640 con 0x7fc5c41421e0 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4145a30 con 0x7fc5b00038e0 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5cb982700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4145d10 con 0x7fc5c40a0fc0 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5c9f1f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5c9f1f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51614/0 (socket says 172.21.15.98:51614) 2023-08-22T00:42:47.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.628+0000 7fc5c9f1f700 1 -- 172.21.15.98:0/1452195887 learned_addr learned my addr 172.21.15.98:0/1452195887 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c8f1d700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 0x7fc5c4141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 0x7fc5c4145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 -- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 msgr2=0x7fc5c4141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 0x7fc5c4141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 -- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 msgr2=0x7fc5c4145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 0x7fc5c4145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 -- 172.21.15.98:0/1452195887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4145ff0 con 0x7fc5c41421e0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c8f1d700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 0x7fc5c4141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 0x7fc5c4145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5c9f1f700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fc5c40c2360 tx=0x7fc5bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00e040 con 0x7fc5c41421e0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00f040 con 0x7fc5c41421e0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c41462d0 con 0x7fc5c41421e0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00fe20 con 0x7fc5c41421e0 2023-08-22T00:42:47.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.629+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4160e50 con 0x7fc5c41421e0 2023-08-22T00:42:47.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.630+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c40c57e0 con 0x7fc5c41421e0 2023-08-22T00:42:47.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.630+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc5bc015660 con 0x7fc5c41421e0 2023-08-22T00:42:47.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.631+0000 7fc5b97fa700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 0x7fc5a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.631+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc5bc07ab70 con 0x7fc5c41421e0 2023-08-22T00:42:47.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.631+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 0x7fc5a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.631+0000 7fc5c971e700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 0x7fc5a80613f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc5b4001010 tx=0x7fc5b4015000).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.635+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5bc04bd00 con 0x7fc5c41421e0 2023-08-22T00:42:47.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.820+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c4146780 con 0x7fc5a805ef30 2023-08-22T00:42:47.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.822+0000 7fc5b97fa700 1 -- 172.21.15.98:0/1452195887 <== mgr.9183 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc5c4146780 con 0x7fc5a805ef30 2023-08-22T00:42:47.822 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:42:47.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:42:47.822 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:42:47.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:42:47.823 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 msgr2=0x7fc5a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 0x7fc5a80613f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc5b4001010 tx=0x7fc5b4015000).stop 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 msgr2=0x7fc5c4146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fc5c40c2360 tx=0x7fc5bc00b040).stop 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 shutdown_connections 2023-08-22T00:42:47.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc5a805ef30 0x7fc5a80613f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c41421e0 0x7fc5c4146ad0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5b00038e0 0x7fc5c4145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 --2- 172.21.15.98:0/1452195887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5c40a0fc0 0x7fc5c4141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.823+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 >> 172.21.15.98:0/1452195887 conn(0x7fc5c40c7800 msgr2=0x7fc5c40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.824+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 shutdown_connections 2023-08-22T00:42:47.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.824+0000 7fc5cb982700 1 -- 172.21.15.98:0/1452195887 wait complete. 2023-08-22T00:42:47.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:42:47.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.952+0000 7f8f05790700 1 Processor -- start 2023-08-22T00:42:47.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.952+0000 7f8f05790700 1 -- start start 2023-08-22T00:42:47.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8f05790700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f000c45b0 0x7f8f000c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8f05790700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8f000bef90 0x7f8f00068340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8f05790700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f00152b90 con 0x7f8f00067ec0 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8f05790700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f00068830 con 0x7f8f000bef90 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8f05790700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000c3f20 con 0x7f8f000c45b0 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8f000bef90 0x7f8f00068340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8efe7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8f00067ec0 0x7f8f000be880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55628/0 (socket says 172.21.15.98:55628) 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8f000bef90 0x7f8f00068340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51624/0 (socket says 172.21.15.98:51624) 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8efe7fc700 1 -- 172.21.15.98:0/2640070031 learned_addr learned my addr 172.21.15.98:0/2640070031 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8efeffd700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f000c45b0 0x7f8f000c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2640070031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f000c45b0 msgr2=0x7f8f000c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f000c45b0 0x7f8f000c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2640070031 >> v1:172.21.15.98:6789/0 conn(0x7f8f00067ec0 legacy=0x7f8f000be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2640070031 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00066fe0 con 0x7f8f000bef90 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8efdffb700 1 -- 172.21.15.98:0/2640070031 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239239831 0 0) 0x7f8f00152b90 con 0x7f8f00067ec0 2023-08-22T00:42:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.953+0000 7f8eff7fe700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000bef90 0x7f8f00068340 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f8ef8009e60 tx=0x7f8ef8009780).ready entity=mon.0 client_cookie=8ad8f81929aedc31 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8efdffb700 1 -- 172.21.15.98:0/2640070031 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800e070 con 0x7f8f000bef90 2023-08-22T00:42:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8efdffb700 1 -- 172.21.15.98:0/2640070031 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef800bb60 con 0x7f8f000bef90 2023-08-22T00:42:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8efdffb700 1 -- 172.21.15.98:0/2640070031 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8012410 con 0x7f8f000bef90 2023-08-22T00:42:47.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 -- 172.21.15.98:0/2640070031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000bef90 msgr2=0x7f8f00068340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000bef90 0x7f8f00068340 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f8ef8009e60 tx=0x7f8ef8009780).stop 2023-08-22T00:42:47.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 -- 172.21.15.98:0/2640070031 shutdown_connections 2023-08-22T00:42:47.958 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000bef90 0x7f8f00068340 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 --2- 172.21.15.98:0/2640070031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f000c45b0 0x7f8f000c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 -- 172.21.15.98:0/2640070031 >> 172.21.15.98:0/2640070031 conn(0x7f8f000c5e70 msgr2=0x7f8f000661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:47.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 -- 172.21.15.98:0/2640070031 shutdown_connections 2023-08-22T00:42:47.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.954+0000 7f8f05790700 1 -- 172.21.15.98:0/2640070031 wait complete. 2023-08-22T00:42:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.955+0000 7f8f05790700 1 Processor -- start 2023-08-22T00:42:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.955+0000 7f8f05790700 1 -- start start 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f00067ec0 0x7f8f000a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 0x7f8f0009f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00164f10 con 0x7f8f000c45b0 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000a10c0 con 0x7f8f000bef90 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8f05790700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000a04b0 con 0x7f8f00067ec0 2023-08-22T00:42:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51628/0 (socket says 172.21.15.98:51628) 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2426850541 learned_addr learned my addr 172.21.15.98:0/2426850541 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8efeffd700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f00067ec0 0x7f8f000a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.956+0000 7f8efe7fc700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 0x7f8f0009f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f00067ec0 msgr2=0x7f8f000a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f00067ec0 0x7f8f000a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 msgr2=0x7f8f0009f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 0x7f8f0009f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 -- 172.21.15.98:0/2426850541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8009a20 con 0x7f8f000c45b0 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8efe7fc700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 0x7f8f0009f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8eff7fe700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f8ef8011000 tx=0x7f8f00067170).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8012410 con 0x7f8f000c45b0 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef801d630 con 0x7f8f000c45b0 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef801d9f0 con 0x7f8f000c45b0 2023-08-22T00:42:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f000a0790 con 0x7f8f000c45b0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.957+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f000a0d50 con 0x7f8f000c45b0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.958+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f000a1230 con 0x7f8f000c45b0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.958+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 87) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8ef8003040 con 0x7f8f000c45b0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.959+0000 7f8ee6ffd700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 0x7f8eec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.959+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8ef807bee0 con 0x7f8f000c45b0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.959+0000 7f8efeffd700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 0x7f8eec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.959+0000 7f8efeffd700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 0x7f8eec0613f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ef4009b90 tx=0x7f8ef4009060).ready entity=mgr.9183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:47.963+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ef804d130 con 0x7f8f000c45b0 2023-08-22T00:42:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.166+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8f00068a10 con 0x7f8f000c45b0 2023-08-22T00:42:48.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.591+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 88) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f8ef8079a90 con 0x7f8f000c45b0 2023-08-22T00:42:48.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.592+0000 7f8ee6ffd700 1 -- 172.21.15.98:0/2426850541 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v88) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8ef8043700 con 0x7f8f000c45b0 2023-08-22T00:42:48.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 msgr2=0x7f8eec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 0x7f8eec0613f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ef4009b90 tx=0x7f8ef4009060).stop 2023-08-22T00:42:48.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 msgr2=0x7f8f0009fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.595 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f8ef8011000 tx=0x7f8f00067170).stop 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 shutdown_connections 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8eec05ef30 0x7f8eec0613f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f00067ec0 0x7f8f000a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f000c45b0 0x7f8f0009fc50 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 --2- 172.21.15.98:0/2426850541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f000bef90 0x7f8f0009f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 >> 172.21.15.98:0/2426850541 conn(0x7f8f000c5e70 msgr2=0x7f8f000a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 shutdown_connections 2023-08-22T00:42:48.596 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.595+0000 7f8f05790700 1 -- 172.21.15.98:0/2426850541 wait complete. 2023-08-22T00:42:48.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:42:48.730 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.730+0000 7f123bf64700 1 Processor -- start 2023-08-22T00:42:48.731 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.730+0000 7f123bf64700 1 -- start start 2023-08-22T00:42:48.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123bf64700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f123414e720 0x7f1234155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123bf64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123bf64700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340654a0 con 0x7f12340641b0 2023-08-22T00:42:48.733 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123bf64700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1234064660 con 0x7f123414e720 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123bf64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234064920 con 0x7f1234067d00 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123a501700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f1239d00700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f123414e720 0x7f1234155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123a501700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:34494/0 (socket says 172.21.15.98:34494) 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f1239d00700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f123414e720 0x7f1234155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:52796/0 (socket says 172.21.15.98:52796) 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f123a501700 1 -- 172.21.15.98:0/4182498004 learned_addr learned my addr 172.21.15.98:0/4182498004 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:48.734 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.731+0000 7f12394ff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f12340641b0 0x7f12340675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:48266/0 (socket says 172.21.15.98:48266) 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1239d00700 1 -- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 msgr2=0x7f12340c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1239d00700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1239d00700 1 -- 172.21.15.98:0/4182498004 >> v1:172.21.15.118:6789/0 conn(0x7f12340641b0 legacy=0x7f12340675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1239d00700 1 -- 172.21.15.98:0/4182498004 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234064c00 con 0x7f123414e720 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f123a501700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1239d00700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123414e720 0x7f1234155290 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f1230009760 tx=0x7f1230009060).ready entity=mon.1 client_cookie=43f49d92d158d026 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1238cfe700 1 -- 172.21.15.98:0/4182498004 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000f510 con 0x7f123414e720 2023-08-22T00:42:48.735 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1238cfe700 1 -- 172.21.15.98:0/4182498004 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000f670 con 0x7f123414e720 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.732+0000 7f1238cfe700 1 -- 172.21.15.98:0/4182498004 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000f9f0 con 0x7f123414e720 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 -- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123414e720 msgr2=0x7f1234155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123414e720 0x7f1234155290 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f1230009760 tx=0x7f1230009060).stop 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 -- 172.21.15.98:0/4182498004 shutdown_connections 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1234067d00 0x7f12340c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 --2- 172.21.15.98:0/4182498004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123414e720 0x7f1234155290 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.736 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 -- 172.21.15.98:0/4182498004 >> 172.21.15.98:0/4182498004 conn(0x7f12340c8950 msgr2=0x7f12340c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:48.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 -- 172.21.15.98:0/4182498004 shutdown_connections 2023-08-22T00:42:48.737 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.733+0000 7f123bf64700 1 -- 172.21.15.98:0/4182498004 wait complete. 2023-08-22T00:42:48.737 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:48.733+0000 7f13e80b4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:42:48.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.734+0000 7f123bf64700 1 Processor -- start 2023-08-22T00:42:48.739 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.734+0000 7f123bf64700 1 -- start start 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 0x7f12340aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1234067d00 0x7f1234065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340669d0 con 0x7f123414e720 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340aa460 con 0x7f1234067d00 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340a9fd0 con 0x7f12340641b0 2023-08-22T00:42:48.740 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f1239d00700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 0x7f12340aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51670/0 (socket says 172.21.15.98:51670) 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 -- 172.21.15.98:0/3967821343 learned_addr learned my addr 172.21.15.98:0/3967821343 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f12394ff700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1234067d00 0x7f1234065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 msgr2=0x7f12340aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 0x7f12340aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.741 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1234067d00 msgr2=0x7f1234065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1234067d00 0x7f1234065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 -- 172.21.15.98:0/3967821343 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c009ae0 con 0x7f123414e720 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f1239d00700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 0x7f12340aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123a501700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f122c00c0c0 tx=0x7f122c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00c9f0 con 0x7f123414e720 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00f040 con 0x7f123414e720 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.735+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12300092a0 con 0x7f123414e720 2023-08-22T00:42:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.736+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00cd60 con 0x7f123414e720 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.736+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340a9470 con 0x7f123414e720 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 88) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f122c014670 con 0x7f123414e720 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234069d50 con 0x7f123414e720 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f1229ffb700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 0x7f1218061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f1239d00700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 msgr2=0x7f1218061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f122c07a140 con 0x7f123414e720 2023-08-22T00:42:48.744 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.737+0000 7f1239d00700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 0x7f1218061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:48.744 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:48.738+0000 7f1cf9867680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:42:48.745 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.742+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f122c04a8f0 con 0x7f123414e720 2023-08-22T00:42:48.798 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:48.797+0000 7f13e80b4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:42:48.829 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:48.829+0000 7f1cf9867680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:42:48.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.938+0000 7f1239d00700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 msgr2=0x7f1218061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:48.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.938+0000 7f1239d00700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 0x7f1218061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:48.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.945+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f12340aa110 con 0x7f123414e720 2023-08-22T00:42:48.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.948+0000 7f1229ffb700 1 -- 172.21.15.98:0/3967821343 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f122c04b380 con 0x7f123414e720 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 msgr2=0x7f1218061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 0x7f1218061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 msgr2=0x7f12340664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f122c00c0c0 tx=0x7f122c00b040).stop 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 shutdown_connections 2023-08-22T00:42:48.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f121805ef50 0x7f1218061410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12340641b0 0x7f12340aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f123414e720 0x7f12340664e0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 --2- 172.21.15.98:0/3967821343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1234067d00 0x7f1234065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 >> 172.21.15.98:0/3967821343 conn(0x7f12340c8950 msgr2=0x7f12340bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 shutdown_connections 2023-08-22T00:42:48.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:48.950+0000 7f123bf64700 1 -- 172.21.15.98:0/3967821343 wait complete. 2023-08-22T00:42:48.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:48.963 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:42:48.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-22T00:42:49.069 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:49.068+0000 7f13e80b4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:42:49.116 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:49.116+0000 7f1cf9867680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:42:49.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.150+0000 7feb1383d700 1 Processor -- start 2023-08-22T00:42:49.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.151+0000 7feb1383d700 1 -- start start 2023-08-22T00:42:49.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.151+0000 7feb1383d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.151+0000 7feb1383d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c0a8c70 con 0x7feb0c154f60 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.151+0000 7feb1383d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c068210 con 0x7feb0c0673e0 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.151+0000 7feb1383d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0a86f0 con 0x7feb0c069430 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb115d9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7feb0c154f60 0x7feb0c068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:55640/0 (socket says 172.21.15.98:55640) 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb115d9700 1 -- 172.21.15.98:0/1855284891 learned_addr learned my addr 172.21.15.98:0/1855284891 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1855284891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:49.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499546617 0 0) 0x7feb0c0a8c70 con 0x7feb0c154f60 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf80033f0 con 0x7feb0c154f60 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11677665 0 0) 0x7feb0c068210 con 0x7feb0c0673e0 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb0c0a8c70 con 0x7feb0c0673e0 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb10dd8700 1 -- 172.21.15.98:0/1855284891 >> v1:172.21.15.118:6789/0 conn(0x7feb0c0673e0 legacy=0x7feb0c0a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb10dd8700 1 -- 172.21.15.98:0/1855284891 >> v1:172.21.15.98:6789/0 conn(0x7feb0c154f60 legacy=0x7feb0c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb10dd8700 1 -- 172.21.15.98:0/1855284891 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c067c50 con 0x7feb0c069430 2023-08-22T00:42:49.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1855284891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c066ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7feafc009790 tx=0x7feafc009060).ready entity=mon.2 client_cookie=c02b88f353ad44d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0090d0 con 0x7feb0c069430 2023-08-22T00:42:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f510 con 0x7feb0c069430 2023-08-22T00:42:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.152+0000 7feb03fff700 1 -- 172.21.15.98:0/1855284891 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00f890 con 0x7feb0c069430 2023-08-22T00:42:49.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 -- 172.21.15.98:0/1855284891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 msgr2=0x7feb0c066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 --2- 172.21.15.98:0/1855284891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c066ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7feafc009790 tx=0x7feafc009060).stop 2023-08-22T00:42:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 -- 172.21.15.98:0/1855284891 shutdown_connections 2023-08-22T00:42:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 --2- 172.21.15.98:0/1855284891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c066ef0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 -- 172.21.15.98:0/1855284891 >> 172.21.15.98:0/1855284891 conn(0x7feb0c0c5dd0 msgr2=0x7feb0c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 -- 172.21.15.98:0/1855284891 shutdown_connections 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.153+0000 7feb1383d700 1 -- 172.21.15.98:0/1855284891 wait complete. 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.154+0000 7feb1383d700 1 Processor -- start 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.154+0000 7feb1383d700 1 -- start start 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c0be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:49.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb0c154f60 0x7feb0c0beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0bf3c0 con 0x7feb0c0673e0 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c151c40 con 0x7feb0c154f60 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb1383d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0adec0 con 0x7feb0c069430 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb115d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb115d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51682/0 (socket says 172.21.15.98:51682) 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb115d9700 1 -- 172.21.15.98:0/1204343494 learned_addr learned my addr 172.21.15.98:0/1204343494 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb11dda700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb0c154f60 0x7feb0c0beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.155+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c0be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 msgr2=0x7feb0c0be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c0be9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb0c154f60 msgr2=0x7feb0c0beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb0c154f60 0x7feb0c0beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0092a0 con 0x7feb0c0673e0 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb115d9700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7feb0800c490 tx=0x7feb08007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:49.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080070d0 con 0x7feb0c0673e0 2023-08-22T00:42:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08007230 con 0x7feb0c0673e0 2023-08-22T00:42:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080075b0 con 0x7feb0c0673e0 2023-08-22T00:42:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c0ae1a0 con 0x7feb0c0673e0 2023-08-22T00:42:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.156+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c0ae760 con 0x7feb0c0673e0 2023-08-22T00:42:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.157+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 88) v1 ==== 75391+0+0 (secure 0 0 0) 0x7feb080059b0 con 0x7feb0c0673e0 2023-08-22T00:42:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.157+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c047480 con 0x7feb0c0673e0 2023-08-22T00:42:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.158+0000 7feb017fa700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.158+0000 7feb10dd8700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.158+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6474+0+0 (secure 0 0 0) 0x7feb08079810 con 0x7feb0c0673e0 2023-08-22T00:42:49.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.158+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:42:49.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.162+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb0804a9a0 con 0x7feb0c0673e0 2023-08-22T00:42:49.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.355+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0c06b0a0 con 0x7feaf005ef80 2023-08-22T00:42:49.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.359+0000 7feb10dd8700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:49.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.359+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:42:49.679 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:49.678+0000 7f13e80b4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:42:49.739 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:49.738+0000 7f1cf9867680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:42:49.750 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:49.750+0000 7f13e80b4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:42:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.760+0000 7feb10dd8700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:49.760+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:42:49.810 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:49.810+0000 7f1cf9867680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:42:49.935 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:49.935+0000 7f13e80b4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:42:49.997 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:49.997+0000 7f1cf9867680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:42:50.352 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.352+0000 7f13e80b4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:42:50.416 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:50.416+0000 7f1cf9867680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:42:50.454 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.454+0000 7f13e80b4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:50.519 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:50.519+0000 7f1cf9867680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:50.561+0000 7feb10dd8700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:50.561+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:42:50.606 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.605+0000 7f13e80b4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:50.671 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:50.671+0000 7f1cf9867680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:50.680 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.679+0000 7f13e80b4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:42:50.745 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:50.745+0000 7f1cf9867680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:42:50.746 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.746+0000 7f13e80b4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:42:50.813 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:50.813+0000 7f1cf9867680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:42:51.000 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:50.999+0000 7f13e80b4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:42:51.067 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:51.067+0000 7f1cf9867680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:42:51.181 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:51.181+0000 7f13e80b4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:51.249 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:51.249+0000 7f1cf9867680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:42:51.829 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:51.828+0000 7f13e80b4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:42:51.897 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:51.896+0000 7f13e80b4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:42:51.903 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:51.904+0000 7f1cf9867680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:42:51.971 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:51.971+0000 7f13e80b4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:42:51.973 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:51.974+0000 7f1cf9867680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:42:52.049 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.049+0000 7f1cf9867680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:42:52.120 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.119+0000 7f13e80b4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:42:52.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.162+0000 7feb10dd8700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:42:52.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.162+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:42:52.191 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.190+0000 7f13e80b4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:42:52.200 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.200+0000 7f1cf9867680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:42:52.272 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.272+0000 7f1cf9867680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:42:52.305 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.304+0000 7f13e80b4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:42:52.387 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.387+0000 7f1cf9867680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:42:52.412 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.412+0000 7f13e80b4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:52.496 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.496+0000 7f1cf9867680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:42:52.701 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.701+0000 7f13e80b4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:42:52.772 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:42:52.771+0000 7f13e80b4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:42:52.785 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.785+0000 7f1cf9867680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:42:52.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.841+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 89) v1 ==== 75391+0+0 (secure 0 0 0) 0x7feb08077300 con 0x7feb0c0673e0 2023-08-22T00:42:52.858 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.858+0000 7f1cf9867680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:42:52.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.880+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 90) v1 ==== 75113+0+0 (secure 0 0 0) 0x7feb08047110 con 0x7feb0c0673e0 2023-08-22T00:42:52.880 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.880+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf0061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:42:52.881 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:52.880+0000 7feb017fa700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:52.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.941+0000 7f1c73b10700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.941+0000 7f1c73b10700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.941+0000 7f1c73b10700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.941+0000 7f1c73b10700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.941 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.941+0000 7f1c73b10700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.942 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.942+0000 7f1c76b16700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.942 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.942+0000 7f1c76b16700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.942 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.942+0000 7f1c76b16700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.942 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.942+0000 7f1c76b16700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:52.942 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:42:52.942+0000 7f1c76b16700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:42:53.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.883+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 91) v1 ==== 75183+0+0 (secure 0 0 0) 0x7feb08046c60 con 0x7feb0c0673e0 2023-08-22T00:42:53.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.883+0000 7feb017fa700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf00613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:53.883 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.883+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0c06b0a0 con 0x7feaf005ef80 2023-08-22T00:42:53.884 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.884+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf00613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:53.886 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.885+0000 7feb10dd8700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf00613c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feb0c069870 tx=0x7feafc017000).ready entity=mgr.9552 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:53.896 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.896+0000 7feb017fa700 1 -- 172.21.15.98:0/1204343494 <== mgr.9552 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feb0c06b0a0 con 0x7feaf005ef80 2023-08-22T00:42:53.897 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:42:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 msgr2=0x7feaf00613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf00613c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feb0c069870 tx=0x7feafc017000).stop 2023-08-22T00:42:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 msgr2=0x7feb0c151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:53.899 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7feb0800c490 tx=0x7feb08007d00).stop 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 shutdown_connections 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feaf005ef80 0x7feaf00613c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb0c154f60 0x7feb0c0beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb0c0673e0 0x7feb0c151750 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 --2- 172.21.15.98:0/1204343494 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb0c069430 0x7feb0c0be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 >> 172.21.15.98:0/1204343494 conn(0x7feb0c0c5dd0 msgr2=0x7feb0c0c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 shutdown_connections 2023-08-22T00:42:53.900 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:53.899+0000 7feb1383d700 1 -- 172.21.15.98:0/1204343494 wait complete. 2023-08-22T00:42:53.913 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:42:53.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-22T00:42:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.038+0000 7f8304349700 1 Processor -- start 2023-08-22T00:42:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.038+0000 7f8304349700 1 -- start start 2023-08-22T00:42:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.039+0000 7f8304349700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 0x7f82fc0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f8304349700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82fc064820 0x7f82fc066000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f8304349700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82fc158970 con 0x7f82fc0c3230 2023-08-22T00:42:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f8304349700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82fc0c28b0 con 0x7f82fc064820 2023-08-22T00:42:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f8304349700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82fc158690 con 0x7f82fc153dd0 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82fc064820 0x7f82fc066000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82fc064820 0x7f82fc066000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46896/0 (socket says 172.21.15.98:46896) 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 -- 172.21.15.98:0/3390699099 learned_addr learned my addr 172.21.15.98:0/3390699099 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83020e5700 1 --2- 172.21.15.98:0/3390699099 >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 0x7f82fc0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 -- 172.21.15.98:0/3390699099 >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 msgr2=0x7f82fc0c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 --2- 172.21.15.98:0/3390699099 >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 0x7f82fc0c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 -- 172.21.15.98:0/3390699099 >> v1:172.21.15.118:6789/0 conn(0x7f82fc0c3230 legacy=0x7f82fc064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 -- 172.21.15.98:0/3390699099 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0c2260 con 0x7f82fc064820 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83020e5700 1 --2- 172.21.15.98:0/3390699099 >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 0x7f82fc0c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83028e6700 1 --2- 172.21.15.98:0/3390699099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc064820 0x7f82fc066000 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f82fc069670 tx=0x7f82f4009840).ready entity=mon.0 client_cookie=968f7000ebc94945 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83010e3700 1 -- 172.21.15.98:0/3390699099 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400e070 con 0x7f82fc064820 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83010e3700 1 -- 172.21.15.98:0/3390699099 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400ba10 con 0x7f82fc064820 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.040+0000 7f83010e3700 1 -- 172.21.15.98:0/3390699099 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400bd90 con 0x7f82fc064820 2023-08-22T00:42:54.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 -- 172.21.15.98:0/3390699099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc064820 msgr2=0x7f82fc066000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 --2- 172.21.15.98:0/3390699099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc064820 0x7f82fc066000 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f82fc069670 tx=0x7f82f4009840).stop 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 -- 172.21.15.98:0/3390699099 shutdown_connections 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 --2- 172.21.15.98:0/3390699099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc064820 0x7f82fc066000 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 --2- 172.21.15.98:0/3390699099 >> v2:172.21.15.118:3300/0 conn(0x7f82fc153dd0 0x7f82fc0c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 -- 172.21.15.98:0/3390699099 >> 172.21.15.98:0/3390699099 conn(0x7f82fc0c7820 msgr2=0x7f82fc0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 -- 172.21.15.98:0/3390699099 shutdown_connections 2023-08-22T00:42:54.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.041+0000 7f8304349700 1 -- 172.21.15.98:0/3390699099 wait complete. 2023-08-22T00:42:54.046 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.042+0000 7f8304349700 1 Processor -- start 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.042+0000 7f8304349700 1 -- start start 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82fc064820 0x7f82fc0acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 0x7f82fc0660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0c0860 con 0x7f82fc153dd0 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc066ab0 con 0x7f82fc0c3230 2023-08-22T00:42:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0aabf0 con 0x7f82fc064820 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46910/0 (socket says 172.21.15.98:46910) 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 -- 172.21.15.98:0/260836140 learned_addr learned my addr 172.21.15.98:0/260836140 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 -- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82fc064820 msgr2=0x7f82fc0acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82fc064820 0x7f82fc0acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 -- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 msgr2=0x7f82fc0660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83018e4700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 0x7f82fc0660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 0x7f82fc0660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 -- 172.21.15.98:0/260836140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f4009ae0 con 0x7f82fc153dd0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83018e4700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 0x7f82fc0660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f83028e6700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f82f4010000 tx=0x7f82f4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f401c400 con 0x7f82fc153dd0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f401c560 con 0x7f82fc153dd0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 -- 172.21.15.98:0/260836140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc0ad4d0 con 0x7f82fc153dd0 2023-08-22T00:42:54.049 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f401c900 con 0x7f82fc153dd0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.043+0000 7f8304349700 1 -- 172.21.15.98:0/260836140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc0c02a0 con 0x7f82fc153dd0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.045+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8005120 con 0x7f82fc153dd0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.045+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 91) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f82f401cd30 con 0x7f82fc153dd0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.045+0000 7f82f27fc700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 0x7f82e00611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.045+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f82f407ba00 con 0x7f82fc153dd0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.045+0000 7f83020e5700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 0x7f82e00611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.046+0000 7f83020e5700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 0x7f82e00611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f82ec006fd0 tx=0x7f82ec008040).ready entity=mgr.9552 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.051 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.049+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82f404cde0 con 0x7f82fc153dd0 2023-08-22T00:42:54.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:42:54.107 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:42:54.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.241+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f82d8002b30 con 0x7f82e005ed10 2023-08-22T00:42:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.246+0000 7f82f27fc700 1 -- 172.21.15.98:0/260836140 <== mgr.9552 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f82d8002b30 con 0x7f82e005ed10 2023-08-22T00:42:54.246 INFO:teuthology.orchestra.run.smithi098.stdout:Retention added to path snap_test_dir1 2023-08-22T00:42:54.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 msgr2=0x7f82e00611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 0x7f82e00611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f82ec006fd0 tx=0x7f82ec008040).stop 2023-08-22T00:42:54.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 msgr2=0x7f82fc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f82f4010000 tx=0x7f82f4009840).stop 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 shutdown_connections 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f82e005ed10 0x7f82e00611d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82fc064820 0x7f82fc0acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82fc153dd0 0x7f82fc0665c0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 --2- 172.21.15.98:0/260836140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82fc0c3230 0x7f82fc0660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 >> 172.21.15.98:0/260836140 conn(0x7f82fc0c7820 msgr2=0x7f82fc0c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:54.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 shutdown_connections 2023-08-22T00:42:54.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.248+0000 7f82dffff700 1 -- 172.21.15.98:0/260836140 wait complete. 2023-08-22T00:42:54.260 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-22T00:42:54.260 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-22-00_43_00 in ~6s... 2023-08-22T00:42:54.261 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-22T00:42:54.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-22T00:42:54.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.380+0000 7f7cfb024700 1 Processor -- start 2023-08-22T00:42:54.380 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.380+0000 7f7cfb024700 1 -- start start 2023-08-22T00:42:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cfb024700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cf414af10 0x7f7cf40c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cfb024700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7cf40c4430 0x7f7cf40aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cfb024700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40c3ab0 con 0x7f7cf40aaff0 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cfb024700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40a9270 con 0x7f7cf414af10 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cfb024700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40a9550 con 0x7f7cf40c4430 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cf414af10 0x7f7cf40c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7cf414af10 0x7f7cf40c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46916/0 (socket says 172.21.15.98:46916) 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/2820117089 learned_addr learned my addr 172.21.15.98:0/2820117089 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf3fff700 1 --2- 172.21.15.98:0/2820117089 >> v2:172.21.15.118:3300/0 conn(0x7f7cf40c4430 0x7f7cf40aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/2820117089 >> v2:172.21.15.118:3300/0 conn(0x7f7cf40c4430 msgr2=0x7f7cf40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 --2- 172.21.15.98:0/2820117089 >> v2:172.21.15.118:3300/0 conn(0x7f7cf40c4430 0x7f7cf40aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/2820117089 >> v1:172.21.15.118:6789/0 conn(0x7f7cf40aaff0 legacy=0x7f7cf40bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.381+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/2820117089 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40c3460 con 0x7f7cf414af10 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cf8dc0700 1 --2- 172.21.15.98:0/2820117089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf414af10 0x7f7cf40c3f40 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f7cf40c52d0 tx=0x7f7ce80090f0).ready entity=mon.0 client_cookie=1346eb555ced1ca4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cf37fe700 1 -- 172.21.15.98:0/2820117089 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800b5a0 con 0x7f7cf414af10 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cf37fe700 1 -- 172.21.15.98:0/2820117089 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce800b700 con 0x7f7cf414af10 2023-08-22T00:42:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cf37fe700 1 -- 172.21.15.98:0/2820117089 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800ba80 con 0x7f7cf414af10 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 -- 172.21.15.98:0/2820117089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf414af10 msgr2=0x7f7cf40c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 --2- 172.21.15.98:0/2820117089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf414af10 0x7f7cf40c3f40 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f7cf40c52d0 tx=0x7f7ce80090f0).stop 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 -- 172.21.15.98:0/2820117089 shutdown_connections 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 --2- 172.21.15.98:0/2820117089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf414af10 0x7f7cf40c3f40 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 --2- 172.21.15.98:0/2820117089 >> v2:172.21.15.118:3300/0 conn(0x7f7cf40c4430 0x7f7cf40aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 -- 172.21.15.98:0/2820117089 >> 172.21.15.98:0/2820117089 conn(0x7f7cf40c5300 msgr2=0x7f7cf40c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 -- 172.21.15.98:0/2820117089 shutdown_connections 2023-08-22T00:42:54.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.382+0000 7f7cfb024700 1 -- 172.21.15.98:0/2820117089 wait complete. 2023-08-22T00:42:54.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.383+0000 7f7cfb024700 1 Processor -- start 2023-08-22T00:42:54.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 -- start start 2023-08-22T00:42:54.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cf40c4430 0x7f7cf414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 0x7f7cf40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf414d5a0 con 0x7f7cf40aaff0 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40ad620 con 0x7f7cf414af10 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cfb024700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40adba0 con 0x7f7cf40c4430 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cf8dc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cf8dc0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46924/0 (socket says 172.21.15.98:46924) 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.384+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/3478588682 learned_addr learned my addr 172.21.15.98:0/3478588682 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:42:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf95c1700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 0x7f7cf40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cf40c4430 msgr2=0x7f7cf414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf3fff700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cf40c4430 0x7f7cf414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cf40c4430 0x7f7cf414c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 msgr2=0x7f7cf40ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 0x7f7cf40ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 -- 172.21.15.98:0/3478588682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8009370 con 0x7f7cf40aaff0 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf95c1700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 0x7f7cf40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf8dc0700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f7ce8009130 tx=0x7f7ce8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800ba80 con 0x7f7cf40aaff0 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8000c90 con 0x7f7cf40aaff0 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf414cfe0 con 0x7f7cf40aaff0 2023-08-22T00:42:54.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce801b640 con 0x7f7cf40aaff0 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.385+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40ad830 con 0x7f7cf40aaff0 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.386+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf40ade80 con 0x7f7cf40aaff0 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.386+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 91) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f7ce801b9b0 con 0x7f7cf40aaff0 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.387+0000 7f7cf0ff9700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 0x7f7cd8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.387+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6732+0+0 (secure 0 0 0) 0x7f7ce807b840 con 0x7f7cf40aaff0 2023-08-22T00:42:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.387+0000 7f7cf3fff700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 0x7f7cd8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:42:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.387+0000 7f7cf3fff700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 0x7f7cd8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7cf414eba0 tx=0x7f7ce0008040).ready entity=mgr.9552 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:42:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.391+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ce804ccd0 con 0x7f7cf40aaff0 2023-08-22T00:42:54.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.577+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cf4047480 con 0x7f7cd805ed40 2023-08-22T00:42:54.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.579+0000 7f7cf0ff9700 1 -- 172.21.15.98:0/3478588682 <== mgr.9552 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f7cf4047480 con 0x7f7cd805ed40 2023-08-22T00:42:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:42:54.580 INFO:teuthology.orchestra.run.smithi098.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-22T00:42:54.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 msgr2=0x7f7cd8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 0x7f7cd8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7cf414eba0 tx=0x7f7ce0008040).stop 2023-08-22T00:42:54.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 msgr2=0x7f7cf4168be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f7ce8009130 tx=0x7f7ce8015000).stop 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 shutdown_connections 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7cd805ed40 0x7f7cd8061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cf414af10 0x7f7cf40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cf40aaff0 0x7f7cf4168be0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 --2- 172.21.15.98:0/3478588682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cf40c4430 0x7f7cf414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:42:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 >> 172.21.15.98:0/3478588682 conn(0x7f7cf40c5300 msgr2=0x7f7cf40c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:42:54.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 shutdown_connections 2023-08-22T00:42:54.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:42:54.581+0000 7f7cfb024700 1 -- 172.21.15.98:0/3478588682 wait complete. 2023-08-22T00:42:54.593 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-22T00:42:54.593 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-22T00:42:54.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:54.594 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:42:55.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:55.619 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:42:56.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:56.646 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:42:57.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:57.675 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:42:58.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:58.704 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:42:59.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:42:59.734 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:00.250 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:43:00.249+0000 7f1c662f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:43:00.251 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:43:00.249+0000 7f1c662f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:43:00.251 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:43:00.249+0000 7f1c662f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:43:00.251 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:43:00.249+0000 7f1c662f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:43:00.251 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:43:00.249+0000 7f1c662f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:43:00.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:00.764 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:00.792 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:00.793 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-22-00_43_00_UTC'] 2023-08-22T00:43:00.793 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692664974.2607794, now = 1692664980.7936118, timo = 6 2023-08-22T00:43:01.794 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-08-22-00_43_00 in ~66s... 2023-08-22T00:43:01.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:01.795 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:01.822 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:02.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:02.825 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:02.852 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:03.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:03.854 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:03.881 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:04.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:04.883 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:04.911 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:05.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:05.912 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:05.938 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:06.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:06.940 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:06.967 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:07.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:07.969 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:07.996 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:08.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:08.998 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:09.025 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:10.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:10.027 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:10.054 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:11.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:11.056 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:11.083 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:12.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:12.086 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:12.113 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:13.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:13.115 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:13.143 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:14.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:14.145 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:14.173 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:15.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:15.175 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:16.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:16.205 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:16.232 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:17.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:17.234 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:17.262 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:18.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:18.264 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:18.292 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:19.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:19.294 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:19.322 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:20.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:20.324 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:20.351 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:21.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:21.353 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:21.380 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:22.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:22.382 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:22.409 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:23.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:23.411 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:23.437 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:24.177 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:43:24.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:43:24.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:24.440 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:24.467 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:25.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:25.470 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:25.497 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:26.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:26.499 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:26.526 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:27.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:27.528 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:27.555 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:28.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:28.558 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:28.585 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:29.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:29.587 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:29.614 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:30.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:30.616 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:30.643 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:31.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:31.645 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:31.674 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:32.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:32.676 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:32.703 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:33.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:33.705 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:33.732 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:34.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:34.734 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:34.761 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:35.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:35.763 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:35.791 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:36.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:36.792 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:36.819 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:37.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:37.821 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:37.849 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:38.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:38.851 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:38.880 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:39.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:39.882 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:39.910 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:40.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:40.912 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:40.941 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:41.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:41.942 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:41.971 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:42.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:42.973 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:43.000 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:44.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:44.002 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:44.029 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:45.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:45.032 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:46.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:46.061 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:46.088 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:47.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:47.090 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:47.118 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:48.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:48.119 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:48.147 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:49.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:49.148 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:49.176 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:50.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:50.178 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:50.205 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:51.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:51.207 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:51.235 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:52.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:52.236 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:52.265 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:53.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:53.266 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:54.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:54.295 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:54.322 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:54.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:43:54.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:43:55.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:55.325 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:55.351 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:56.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:56.354 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:56.381 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:57.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:57.383 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:57.411 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:58.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:58.413 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:58.441 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:43:59.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:43:59.443 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:43:59.470 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_43_00_UTC 2023-08-22T00:44:00.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:00.472 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:44:00.499 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_44_00_UTC 2023-08-22T00:44:00.500 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-08-22-00_43_00_UTC'] 2023-08-22T00:44:00.501 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692664974.2607794, now = 1692665040.5011446, timo = 66 2023-08-22T00:44:01.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-22T00:44:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.634+0000 7f7c6bd0d700 1 Processor -- start 2023-08-22T00:44:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.635+0000 7f7c6bd0d700 1 -- start start 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.635+0000 7f7c6bd0d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c640aa110 0x7f7c64067600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.635+0000 7f7c6bd0d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640a8c70 con 0x7f7c64154f60 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.635+0000 7f7c6bd0d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c64068210 con 0x7f7c64069430 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.635+0000 7f7c6bd0d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c640a86f0 con 0x7f7c640aa110 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c69aa9700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7c64154f60 0x7f7c64068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46716/0 (socket says 172.21.15.98:46716) 2023-08-22T00:44:01.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c6a2aa700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c640aa110 0x7f7c64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c69aa9700 1 -- 172.21.15.98:0/4011814951 learned_addr learned my addr 172.21.15.98:0/4011814951 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/4011814951 >> v1:172.21.15.118:6789/0 conn(0x7f7c64069430 legacy=0x7f7c64066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c68aa7700 1 -- 172.21.15.98:0/4011814951 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150896712 0 0) 0x7f7c640a8c70 con 0x7f7c64154f60 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/4011814951 >> v1:172.21.15.98:6789/0 conn(0x7f7c64154f60 legacy=0x7f7c64068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/4011814951 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64067c50 con 0x7f7c640aa110 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c6a2aa700 1 --2- 172.21.15.98:0/4011814951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c640aa110 0x7f7c64067600 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f7c5c009e60 tx=0x7f7c5c009780).ready entity=mon.0 client_cookie=5b1df423aa986278 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c68aa7700 1 -- 172.21.15.98:0/4011814951 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00e070 con 0x7f7c640aa110 2023-08-22T00:44:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c68aa7700 1 -- 172.21.15.98:0/4011814951 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00bbf0 con 0x7f7c640aa110 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.636+0000 7f7c68aa7700 1 -- 172.21.15.98:0/4011814951 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c012410 con 0x7f7c640aa110 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/4011814951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c640aa110 msgr2=0x7f7c64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/4011814951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c640aa110 0x7f7c64067600 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f7c5c009e60 tx=0x7f7c5c009780).stop 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/4011814951 shutdown_connections 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/4011814951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c640aa110 0x7f7c64067600 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/4011814951 >> 172.21.15.98:0/4011814951 conn(0x7f7c640c5dd0 msgr2=0x7f7c64068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:01.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/4011814951 shutdown_connections 2023-08-22T00:44:01.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.637+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/4011814951 wait complete. 2023-08-22T00:44:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.638+0000 7f7c6bd0d700 1 Processor -- start 2023-08-22T00:44:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.638+0000 7f7c6bd0d700 1 -- start start 2023-08-22T00:44:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 0x7f7c64064f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 0x7f7c640c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64156fb0 con 0x7f7c64154f60 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640c8280 con 0x7f7c640aa110 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64063fa0 con 0x7f7c64069430 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45842/0 (socket says 172.21.15.98:45842) 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/747258140 learned_addr learned my addr 172.21.15.98:0/747258140 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c69aa9700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 0x7f7c64064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c692a8700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 0x7f7c640c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 msgr2=0x7f7c64064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 0x7f7c64064f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 msgr2=0x7f7c640c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 0x7f7c640c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 -- 172.21.15.98:0/747258140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009a20 con 0x7f7c64154f60 2023-08-22T00:44:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c69aa9700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 0x7f7c64064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c692a8700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 0x7f7c640c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6a2aa700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f7c5c011000 tx=0x7f7c5c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0116d0 con 0x7f7c64154f60 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c011830 con 0x7f7c64154f60 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640641b0 con 0x7f7c64154f60 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.639+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c011bf0 con 0x7f7c64154f60 2023-08-22T00:44:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.640+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c64064770 con 0x7f7c64154f60 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.641+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c64047480 con 0x7f7c64154f60 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.641+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 93) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f7c5c01d420 con 0x7f7c64154f60 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.641+0000 7f7c59ffb700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 0x7f7c48061530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.641+0000 7f7c69aa9700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 0x7f7c48061530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.641+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f7c5c07c610 con 0x7f7c64154f60 2023-08-22T00:44:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.642+0000 7f7c69aa9700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 0x7f7c48061530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7c54001710 tx=0x7f7c54009040).ready entity=mgr.9552 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.646+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c5c04d370 con 0x7f7c64154f60 2023-08-22T00:44:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.833+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c6406b0a0 con 0x7f7c4805f070 2023-08-22T00:44:01.838 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.837+0000 7f7c59ffb700 1 -- 172.21.15.98:0/747258140 <== mgr.9552 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7c6406b0a0 con 0x7f7c4805f070 2023-08-22T00:44:01.839 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path snap_test_dir1 2023-08-22T00:44:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 msgr2=0x7f7c48061530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 0x7f7c48061530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7c54001710 tx=0x7f7c54009040).stop 2023-08-22T00:44:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 msgr2=0x7f7c640c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f7c5c011000 tx=0x7f7c5c009780).stop 2023-08-22T00:44:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 shutdown_connections 2023-08-22T00:44:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7c4805f070 0x7f7c48061530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c64069430 0x7f7c64064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c64154f60 0x7f7c640c7d90 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 --2- 172.21.15.98:0/747258140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c640aa110 0x7f7c640c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:01.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 >> 172.21.15.98:0/747258140 conn(0x7f7c640c5dd0 msgr2=0x7f7c641574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:01.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 shutdown_connections 2023-08-22T00:44:01.843 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:01.839+0000 7f7c6bd0d700 1 -- 172.21.15.98:0/747258140 wait complete. 2023-08-22T00:44:01.852 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-22T00:44:01.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:01.853 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:44:01.876 INFO:teuthology.orchestra.run.smithi098.stdout:scheduled-2023-08-22-00_44_00_UTC 2023-08-22T00:44:01.877 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-22-00_44_00_UTC 2023-08-22T00:44:01.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:01.878 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-22-00_44_00_UTC) 2023-08-22T00:44:01.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:01.946 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:44:02.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:44:02.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.163+0000 7f48cf383700 1 Processor -- start 2023-08-22T00:44:02.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.163+0000 7f48cf383700 1 -- start start 2023-08-22T00:44:02.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cf383700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 0x7f48c8062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cf383700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c8063f90 con 0x7f48c80c2620 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cf383700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c80656f0 con 0x7f48c8063380 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cf383700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80637e0 con 0x7f48c81505e0 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cd920700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f48c80c2620 0x7f48c8065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46720/0 (socket says 172.21.15.98:46720) 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cd920700 1 -- 172.21.15.98:0/3899852619 learned_addr learned my addr 172.21.15.98:0/3899852619 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cd11f700 1 --2- 172.21.15.98:0/3899852619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 0x7f48c8062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95518441 0 0) 0x7f48c8063f90 con 0x7f48c80c2620 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b40033f0 con 0x7f48c80c2620 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807864638 0 0) 0x7f48c80656f0 con 0x7f48c8063380 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c8063f90 con 0x7f48c8063380 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766088272 0 0) 0x7f48b40033f0 con 0x7f48c80c2620 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.164+0000 7f48cd11f700 1 -- 172.21.15.98:0/3899852619 >> v1:172.21.15.118:6789/0 conn(0x7f48c8063380 legacy=0x7f48c80c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cd11f700 1 -- 172.21.15.98:0/3899852619 >> v1:172.21.15.98:6789/0 conn(0x7f48c80c2620 legacy=0x7f48c8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cd11f700 1 -- 172.21.15.98:0/3899852619 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c81509c0 con 0x7f48c81505e0 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cd11f700 1 --2- 172.21.15.98:0/3899852619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 0x7f48c8062e90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f48c4009790 tx=0x7f48c4009060).ready entity=mon.2 client_cookie=b629ed739ca385ee server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00017f0 con 0x7f48c81505e0 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4011400 con 0x7f48c81505e0 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48bffff700 1 -- 172.21.15.98:0/3899852619 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4011780 con 0x7f48c81505e0 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 -- 172.21.15.98:0/3899852619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 msgr2=0x7f48c8062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 --2- 172.21.15.98:0/3899852619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 0x7f48c8062e90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f48c4009790 tx=0x7f48c4009060).stop 2023-08-22T00:44:02.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 -- 172.21.15.98:0/3899852619 shutdown_connections 2023-08-22T00:44:02.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 --2- 172.21.15.98:0/3899852619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c81505e0 0x7f48c8062e90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 -- 172.21.15.98:0/3899852619 >> 172.21.15.98:0/3899852619 conn(0x7f48c80c31d0 msgr2=0x7f48c80c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:02.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 -- 172.21.15.98:0/3899852619 shutdown_connections 2023-08-22T00:44:02.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.165+0000 7f48cf383700 1 -- 172.21.15.98:0/3899852619 wait complete. 2023-08-22T00:44:02.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.166+0000 7f48cf383700 1 Processor -- start 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.166+0000 7f48cf383700 1 -- start start 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c80c2620 0x7f48c81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48c81505e0 0x7f48c81624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8152050 con 0x7f48c8063380 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8163480 con 0x7f48c81505e0 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cf383700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8162ec0 con 0x7f48c80c2620 2023-08-22T00:44:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.167+0000 7f48cd11f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45856/0 (socket says 172.21.15.98:45856) 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 -- 172.21.15.98:0/3442317516 learned_addr learned my addr 172.21.15.98:0/3442317516 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cc91e700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c80c2620 0x7f48c81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd920700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48c81505e0 0x7f48c81624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 -- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c80c2620 msgr2=0x7f48c81524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c80c2620 0x7f48c81524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 -- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48c81505e0 msgr2=0x7f48c81624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48c81505e0 0x7f48c81624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 -- 172.21.15.98:0/3442317516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40092a0 con 0x7f48c8063380 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cd11f700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f48c8068820 tx=0x7f48c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4010920 con 0x7f48c8063380 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4010a80 con 0x7f48c8063380 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c81631a0 con 0x7f48c8063380 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4010e20 con 0x7f48c8063380 2023-08-22T00:44:02.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.168+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c80a1f00 con 0x7f48c8063380 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.169+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c8152330 con 0x7f48c8063380 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.169+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 93) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f48c401d640 con 0x7f48c8063380 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.170+0000 7f48bd7fa700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 0x7f48ac061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.170+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f48c407bab0 con 0x7f48c8063380 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.170+0000 7f48cc91e700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 0x7f48ac061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:02.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.170+0000 7f48cc91e700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 0x7f48ac061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f48c8153be0 tx=0x7f48b8009040).ready entity=mgr.9552 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:02.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.174+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48c404c980 con 0x7f48c8063380 2023-08-22T00:44:02.379 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.378+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f48c80650c0 con 0x7f48c8063380 2023-08-22T00:44:02.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.601+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f48c40792e0 con 0x7f48c8063380 2023-08-22T00:44:02.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.603+0000 7f48bd7fa700 1 -- 172.21.15.98:0/3442317516 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v94) v1 ==== 93+0+0 (secure 0 0 0) 0x7f48c4042300 con 0x7f48c8063380 2023-08-22T00:44:02.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 msgr2=0x7f48ac061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 0x7f48ac061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f48c8153be0 tx=0x7f48b8009040).stop 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 msgr2=0x7f48c80a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f48c8068820 tx=0x7f48c4016000).stop 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 shutdown_connections 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f48ac05f0a0 0x7f48ac061560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48c81505e0 0x7f48c81624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48c8063380 0x7f48c80a1a10 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 --2- 172.21.15.98:0/3442317516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48c80c2620 0x7f48c81524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:02.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 >> 172.21.15.98:0/3442317516 conn(0x7f48c80c31d0 msgr2=0x7f48c80c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:02.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 shutdown_connections 2023-08-22T00:44:02.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:02.605+0000 7f48cf383700 1 -- 172.21.15.98:0/3442317516 wait complete. 2023-08-22T00:44:02.619 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:44:02.619 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:02.657 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:02.701 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:44:02.701 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:44:02.702 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:44:02.702 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:02.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[173545]: fuse finished with error 0 and tester_r 0 2023-08-22T00:44:02.739 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:44:02.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:02.740 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:44:02.745 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:02.744+0000 7f4861d9d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:02.750 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:02.748+0000 7f459433f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:02.812 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:02.811+0000 7f4861d9d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:02.813 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:02.811+0000 7f459433f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:02.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:44:02.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:02.872 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:44:02.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:02.890 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:44:02.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:44:02.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:02.891 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:44:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:44:02.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:02.930 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:44:02.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:02.930 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:44:02.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:44:02.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:03.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.087+0000 7ff1f817c700 1 Processor -- start 2023-08-22T00:44:03.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.087+0000 7ff1f817c700 1 -- start start 2023-08-22T00:44:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 0x7ff1f0152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1f014c350 0x7ff1f01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 0x7ff1f00c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f0066510 con 0x7ff1f014c350 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f0153080 con 0x7ff1f00c3740 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f817c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00667b0 con 0x7ff1f014bf70 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1f014c350 0x7ff1f01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1f014c350 0x7ff1f01556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45882/0 (socket says 172.21.15.98:45882) 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 -- 172.21.15.98:0/3408030315 learned_addr learned my addr 172.21.15.98:0/3408030315 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5f18700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 0x7ff1f0152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f6719700 1 --2- 172.21.15.98:0/3408030315 >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 0x7ff1f00c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 -- 172.21.15.98:0/3408030315 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 msgr2=0x7ff1f0152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 0x7ff1f0152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 -- 172.21.15.98:0/3408030315 >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 msgr2=0x7ff1f00c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3408030315 >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 0x7ff1f00c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5717700 1 -- 172.21.15.98:0/3408030315 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0155ba0 con 0x7ff1f014c350 2023-08-22T00:44:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f5f18700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 0x7ff1f0152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.088+0000 7ff1f6719700 1 --2- 172.21.15.98:0/3408030315 >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 0x7ff1f00c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014c350 0x7ff1f01556b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff1f0063310 tx=0x7ff1e00090f0).ready entity=mon.0 client_cookie=dd8fd940a7c58a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f4f16700 1 -- 172.21.15.98:0/3408030315 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000b600 con 0x7ff1f014c350 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f4f16700 1 -- 172.21.15.98:0/3408030315 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e000b760 con 0x7ff1f014c350 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f4f16700 1 -- 172.21.15.98:0/3408030315 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000bae0 con 0x7ff1f014c350 2023-08-22T00:44:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 -- 172.21.15.98:0/3408030315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014c350 msgr2=0x7ff1f01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014c350 0x7ff1f01556b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff1f0063310 tx=0x7ff1e00090f0).stop 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 -- 172.21.15.98:0/3408030315 shutdown_connections 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f014bf70 0x7ff1f0152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3408030315 >> v2:172.21.15.118:3300/0 conn(0x7ff1f00c3740 0x7ff1f00c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3408030315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014c350 0x7ff1f01556b0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 -- 172.21.15.98:0/3408030315 >> 172.21.15.98:0/3408030315 conn(0x7ff1f00c5dc0 msgr2=0x7ff1f0068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 -- 172.21.15.98:0/3408030315 shutdown_connections 2023-08-22T00:44:03.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.089+0000 7ff1f817c700 1 -- 172.21.15.98:0/3408030315 wait complete. 2023-08-22T00:44:03.095 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:03.090+0000 7f459433f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:03.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.090+0000 7ff1f817c700 1 Processor -- start 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.090+0000 7ff1f817c700 1 -- start start 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f00c3740 0x7ff1f00a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f014c350 0x7ff1f014a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00a8a00 con 0x7ff1f014bf70 2023-08-22T00:44:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f01677b0 con 0x7ff1f014c350 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f817c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0167a90 con 0x7ff1f00c3740 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f5717700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f5717700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45894/0 (socket says 172.21.15.98:45894) 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f5717700 1 -- 172.21.15.98:0/3612891383 learned_addr learned my addr 172.21.15.98:0/3612891383 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f5f18700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f00c3740 0x7ff1f00a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.091+0000 7ff1f6719700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f014c350 0x7ff1f014a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f00c3740 msgr2=0x7ff1f00a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f00c3740 0x7ff1f00a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f014c350 msgr2=0x7ff1f014a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f014c350 0x7ff1f014a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 -- 172.21.15.98:0/3612891383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0009370 con 0x7ff1f014bf70 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f5717700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7ff1f006a490 tx=0x7ff1e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000bea0 con 0x7ff1f014bf70 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f0167d70 con 0x7ff1f014bf70 2023-08-22T00:44:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f0168330 con 0x7ff1f014bf70 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e001b410 con 0x7ff1f014bf70 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.092+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000bae0 con 0x7ff1f014bf70 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.093+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d0005120 con 0x7ff1f014bf70 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.093+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7ff1e001b580 con 0x7ff1f014bf70 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.094+0000 7ff1e5ffb700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 0x7ff1d4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.094+0000 7ff1f5f18700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 msgr2=0x7ff1d4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.094+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7ff1e007b650 con 0x7ff1f014bf70 2023-08-22T00:44:03.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.094+0000 7ff1f5f18700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 0x7ff1d4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:03.102 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:03.098+0000 7f4861d9d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:03.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.098+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1e004c5d0 con 0x7ff1f014bf70 2023-08-22T00:44:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.295+0000 7ff1f5f18700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 msgr2=0x7ff1d4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.295+0000 7ff1f5f18700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 0x7ff1d4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:03.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.309+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1d00057f0 con 0x7ff1f014bf70 2023-08-22T00:44:03.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.309+0000 7ff1e5ffb700 1 -- 172.21.15.98:0/3612891383 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7ff1e001f020 con 0x7ff1f014bf70 2023-08-22T00:44:03.310 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:03.311 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:44:03.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 msgr2=0x7ff1d4061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 0x7ff1d4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 msgr2=0x7ff1f014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7ff1f006a490 tx=0x7ff1e0017000).stop 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 shutdown_connections 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1d405f050 0x7ff1d4061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1f00c3740 0x7ff1f00a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f014c350 0x7ff1f014a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 --2- 172.21.15.98:0/3612891383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f014bf70 0x7ff1f014ed60 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 >> 172.21.15.98:0/3612891383 conn(0x7ff1f00c5dc0 msgr2=0x7ff1f01492e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 shutdown_connections 2023-08-22T00:44:03.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.311+0000 7ff1f817c700 1 -- 172.21.15.98:0/3612891383 wait complete. 2023-08-22T00:44:03.314 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:44:03.326 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:03.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.442+0000 7fd08c8dc700 1 Processor -- start 2023-08-22T00:44:03.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.442+0000 7fd08c8dc700 1 -- start start 2023-08-22T00:44:03.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.443+0000 7fd08c8dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814c350 0x7fd088152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.443+0000 7fd08c8dc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0880c3e50 0x7fd0881556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.443+0000 7fd08c8dc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd088153080 con 0x7fd08814bf70 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.443+0000 7fd08c8dc700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd088066510 con 0x7fd0880c3e50 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.443+0000 7fd08c8dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880667b0 con 0x7fd08814c350 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0880c3e50 0x7fd0881556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08659c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd08814bf70 0x7fd0880c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46736/0 (socket says 172.21.15.98:46736) 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08659c700 1 -- 172.21.15.98:0/4163471525 learned_addr learned my addr 172.21.15.98:0/4163471525 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:03.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd085d9b700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814c350 0x7fd088152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 -- 172.21.15.98:0/4163471525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814c350 msgr2=0x7fd088152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814c350 0x7fd088152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 -- 172.21.15.98:0/4163471525 >> v1:172.21.15.98:6789/0 conn(0x7fd08814bf70 legacy=0x7fd0880c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 -- 172.21.15.98:0/4163471525 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088155ba0 con 0x7fd0880c3e50 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08559a700 1 -- 172.21.15.98:0/4163471525 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528927356 0 0) 0x7fd088153080 con 0x7fd08814bf70 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd086d9d700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0880c3e50 0x7fd0881556b0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fd080009e60 tx=0x7fd080009780).ready entity=mon.0 client_cookie=5b3e30fdb30d879d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08559a700 1 -- 172.21.15.98:0/4163471525 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000e070 con 0x7fd0880c3e50 2023-08-22T00:44:03.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08559a700 1 -- 172.21.15.98:0/4163471525 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000bb60 con 0x7fd0880c3e50 2023-08-22T00:44:03.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.444+0000 7fd08559a700 1 -- 172.21.15.98:0/4163471525 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080012410 con 0x7fd0880c3e50 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 -- 172.21.15.98:0/4163471525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0880c3e50 msgr2=0x7fd0881556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0880c3e50 0x7fd0881556b0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fd080009e60 tx=0x7fd080009780).stop 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 -- 172.21.15.98:0/4163471525 shutdown_connections 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0880c3e50 0x7fd0881556b0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/4163471525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814c350 0x7fd088152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 -- 172.21.15.98:0/4163471525 >> 172.21.15.98:0/4163471525 conn(0x7fd0880c5dc0 msgr2=0x7fd088068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 -- 172.21.15.98:0/4163471525 shutdown_connections 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.445+0000 7fd08c8dc700 1 -- 172.21.15.98:0/4163471525 wait complete. 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.446+0000 7fd08c8dc700 1 Processor -- start 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.446+0000 7fd08c8dc700 1 -- start start 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0880c3e50 0x7fd0881497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814bf70 0x7fd088150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088151340 con 0x7fd08814c350 2023-08-22T00:44:03.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c1ff0 con 0x7fd0880c3e50 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.447+0000 7fd08c8dc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c13e0 con 0x7fd08814bf70 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45914/0 (socket says 172.21.15.98:45914) 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 -- 172.21.15.98:0/1639370783 learned_addr learned my addr 172.21.15.98:0/1639370783 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd085d9b700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814bf70 0x7fd088150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd08659c700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0880c3e50 0x7fd0881497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 -- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814bf70 msgr2=0x7fd088150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814bf70 0x7fd088150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 -- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0880c3e50 msgr2=0x7fd0881497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0880c3e50 0x7fd0881497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 -- 172.21.15.98:0/1639370783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009a20 con 0x7fd08814c350 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd086d9d700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fd08806a490 tx=0x7fd080009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080012410 con 0x7fd08814c350 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08001d630 con 0x7fd08814c350 2023-08-22T00:44:03.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08001d9f0 con 0x7fd08814c350 2023-08-22T00:44:03.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0880c16c0 con 0x7fd08814c350 2023-08-22T00:44:03.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.448+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0880c1c80 con 0x7fd08814c350 2023-08-22T00:44:03.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fd080003040 con 0x7fd08814c350 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0880c2380 con 0x7fd08814c350 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd0767fc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 0x7fd068061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd08659c700 1 -- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 msgr2=0x7fd068061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fd08007c310 con 0x7fd08814c350 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.450+0000 7fd08659c700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 0x7fd068061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:03.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.454+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd08004d0d0 con 0x7fd08814c350 2023-08-22T00:44:03.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.622+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0880c2180 con 0x7fd08814c350 2023-08-22T00:44:03.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.623+0000 7fd0767fc700 1 -- 172.21.15.98:0/1639370783 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+17741 (secure 0 0 0) 0x7fd0800506f0 con 0x7fd08814c350 2023-08-22T00:44:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:03.625 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":188,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:43:54.631740+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1170451421":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1589005932":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1080851051":"2023-08-23T00:42:52.871903+0000","172.21.15.98:6833/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1927881826":"2023-08-23T00:42:52.871903+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:03.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 msgr2=0x7fd068061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 0x7fd068061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 msgr2=0x7fd088150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fd08806a490 tx=0x7fd080009780).stop 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 shutdown_connections 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd06805f050 0x7fd068061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08814c350 0x7fd088150e50 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0880c3e50 0x7fd0881497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 --2- 172.21.15.98:0/1639370783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd08814bf70 0x7fd088150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 >> 172.21.15.98:0/1639370783 conn(0x7fd0880c5dc0 msgr2=0x7fd08814a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 shutdown_connections 2023-08-22T00:44:03.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.625+0000 7fd08c8dc700 1 -- 172.21.15.98:0/1639370783 wait complete. 2023-08-22T00:44:03.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:42:34.603327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:42:35.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:44:03.644 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:44:03.704 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:03.703+0000 7f459433f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:03.752 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:03.747+0000 7f4861d9d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:03.776 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:03.775+0000 7f459433f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:03.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.788+0000 7fc44c061700 1 Processor -- start 2023-08-22T00:44:03.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.788+0000 7fc44c061700 1 -- start start 2023-08-22T00:44:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44c061700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44c061700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44c061700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc444151e80 con 0x7fc4440c7370 2023-08-22T00:44:03.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44c061700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc444066b90 con 0x7fc44414b250 2023-08-22T00:44:03.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44c061700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc444065560 con 0x7fc44414ae70 2023-08-22T00:44:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc449dfd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.789+0000 7fc44a5fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:49008/0 (socket says 172.21.15.98:49008) 2023-08-22T00:44:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc44a5fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40016/0 (socket says 172.21.15.98:40016) 2023-08-22T00:44:03.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 -- 172.21.15.98:0/2598464533 learned_addr learned my addr 172.21.15.98:0/2598464533 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:03.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 -- 172.21.15.98:0/2598464533 >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 msgr2=0x7fc4440c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 --2- 172.21.15.98:0/2598464533 >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 -- 172.21.15.98:0/2598464533 >> v1:172.21.15.118:6789/0 conn(0x7fc4440c7370 legacy=0x7fc4440c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc448dfb700 1 -- 172.21.15.98:0/2598464533 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502132269 0 0) 0x7fc444151e80 con 0x7fc4440c7370 2023-08-22T00:44:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 -- 172.21.15.98:0/2598464533 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444150fb0 con 0x7fc44414ae70 2023-08-22T00:44:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc44a5fe700 1 --2- 172.21.15.98:0/2598464533 >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc449dfd700 1 --2- 172.21.15.98:0/2598464533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc440006fd0 tx=0x7fc44000b3b0).ready entity=mon.2 client_cookie=f8b27c4bb936a335 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc448dfb700 1 -- 172.21.15.98:0/2598464533 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000da70 con 0x7fc44414ae70 2023-08-22T00:44:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc448dfb700 1 -- 172.21.15.98:0/2598464533 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000dbd0 con 0x7fc44414ae70 2023-08-22T00:44:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.790+0000 7fc448dfb700 1 -- 172.21.15.98:0/2598464533 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440010470 con 0x7fc44414ae70 2023-08-22T00:44:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 -- 172.21.15.98:0/2598464533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 msgr2=0x7fc4440c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 --2- 172.21.15.98:0/2598464533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc440006fd0 tx=0x7fc44000b3b0).stop 2023-08-22T00:44:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 -- 172.21.15.98:0/2598464533 shutdown_connections 2023-08-22T00:44:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 --2- 172.21.15.98:0/2598464533 >> v2:172.21.15.118:3300/0 conn(0x7fc44414b250 0x7fc4440c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 --2- 172.21.15.98:0/2598464533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc44414ae70 0x7fc4440c6e80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 -- 172.21.15.98:0/2598464533 >> 172.21.15.98:0/2598464533 conn(0x7fc4440c7800 msgr2=0x7fc4440c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 -- 172.21.15.98:0/2598464533 shutdown_connections 2023-08-22T00:44:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.791+0000 7fc44c061700 1 -- 172.21.15.98:0/2598464533 wait complete. 2023-08-22T00:44:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.792+0000 7fc44c061700 1 Processor -- start 2023-08-22T00:44:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.792+0000 7fc44c061700 1 -- start start 2023-08-22T00:44:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4440c7370 0x7fc44414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc44414ae70 0x7fc4440c0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440aa7b0 con 0x7fc44414b250 2023-08-22T00:44:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440ab010 con 0x7fc44414ae70 2023-08-22T00:44:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44c061700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44414a880 con 0x7fc4440c7370 2023-08-22T00:44:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45924/0 (socket says 172.21.15.98:45924) 2023-08-22T00:44:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 -- 172.21.15.98:0/340635806 learned_addr learned my addr 172.21.15.98:0/340635806 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc449dfd700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4440c7370 0x7fc44414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc4495fc700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc44414ae70 0x7fc4440c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 -- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4440c7370 msgr2=0x7fc44414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4440c7370 0x7fc44414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 -- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc44414ae70 msgr2=0x7fc4440c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc44414ae70 0x7fc4440c0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 -- 172.21.15.98:0/340635806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009a20 con 0x7fc44414b250 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.793+0000 7fc44a5fe700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fc43c009ef0 tx=0x7fc43c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.794+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00cb70 con 0x7fc44414b250 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.794+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c00f040 con 0x7fc44414b250 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.794+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44000b610 con 0x7fc44414b250 2023-08-22T00:44:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.794+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c013400 con 0x7fc44414b250 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.794+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4440aa9c0 con 0x7fc44414b250 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.795+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4440668a0 con 0x7fc44414b250 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.795+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fc43c0137b0 con 0x7fc44414b250 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.796+0000 7fc439ffb700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 0x7fc428061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.796+0000 7fc449dfd700 1 -- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 msgr2=0x7fc428061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.796+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fc43c07add0 con 0x7fc44414b250 2023-08-22T00:44:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.796+0000 7fc449dfd700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 0x7fc428061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.800+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43c04bb90 con 0x7fc44414b250 2023-08-22T00:44:03.823 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:03.823+0000 7f4861d9d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:03.964 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:03.964+0000 7f459433f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:03.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.992+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc4440ab1a0 con 0x7fc44414b250 2023-08-22T00:44:03.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.992+0000 7fc439ffb700 1 -- 172.21.15.98:0/340635806 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v188) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc43c04f1b0 con 0x7fc44414b250 2023-08-22T00:44:03.993 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:44:03.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 msgr2=0x7fc428061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 0x7fc428061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 msgr2=0x7fc4440acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fc43c009ef0 tx=0x7fc43c00b040).stop 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 shutdown_connections 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc42805f050 0x7fc428061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4440c7370 0x7fc44414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc44414b250 0x7fc4440acb00 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 --2- 172.21.15.98:0/340635806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc44414ae70 0x7fc4440c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:03.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 >> 172.21.15.98:0/340635806 conn(0x7fc4440c7800 msgr2=0x7fc4440bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:03.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 shutdown_connections 2023-08-22T00:44:03.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:03.994+0000 7fc44c061700 1 -- 172.21.15.98:0/340635806 wait complete. 2023-08-22T00:44:04.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:44:04.037 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.036+0000 7f4861d9d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.131+0000 7f7705568700 1 Processor -- start 2023-08-22T00:44:04.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.131+0000 7f7705568700 1 -- start start 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f7705568700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700154170 0x7f7700158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f7705568700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7700064320 0x7f77000c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f7705568700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000bcf30 con 0x7f7700063ea0 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f7705568700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7700154550 con 0x7f7700064320 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f7705568700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700158b00 con 0x7f7700154170 2023-08-22T00:44:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76ff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7700064320 0x7f77000c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76ff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7700064320 0x7f77000c1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45934/0 (socket says 172.21.15.98:45934) 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76ff7fe700 1 -- 172.21.15.98:0/3657879714 learned_addr learned my addr 172.21.15.98:0/3657879714 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76feffd700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700154170 0x7f7700158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76ff7fe700 1 -- 172.21.15.98:0/3657879714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700154170 msgr2=0x7f7700158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.132+0000 7f76ff7fe700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700154170 0x7f7700158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76ff7fe700 1 -- 172.21.15.98:0/3657879714 >> v1:172.21.15.118:6789/0 conn(0x7f7700063ea0 legacy=0x7f77000c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76ff7fe700 1 -- 172.21.15.98:0/3657879714 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000676b0 con 0x7f7700064320 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76ff7fe700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700064320 0x7f77000c1cf0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f76f8009f20 tx=0x7f76f8009840).ready entity=mon.0 client_cookie=8dddfba099f03af5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76fdffb700 1 -- 172.21.15.98:0/3657879714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800e070 con 0x7f7700064320 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76fdffb700 1 -- 172.21.15.98:0/3657879714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f800b9d0 con 0x7f7700064320 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f76fdffb700 1 -- 172.21.15.98:0/3657879714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800bd50 con 0x7f7700064320 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 -- 172.21.15.98:0/3657879714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700064320 msgr2=0x7f77000c1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700064320 0x7f77000c1cf0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f76f8009f20 tx=0x7f76f8009840).stop 2023-08-22T00:44:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 -- 172.21.15.98:0/3657879714 shutdown_connections 2023-08-22T00:44:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700064320 0x7f77000c1cf0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 --2- 172.21.15.98:0/3657879714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700154170 0x7f7700158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 -- 172.21.15.98:0/3657879714 >> 172.21.15.98:0/3657879714 conn(0x7f7700069680 msgr2=0x7f7700069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 -- 172.21.15.98:0/3657879714 shutdown_connections 2023-08-22T00:44:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.133+0000 7f7705568700 1 -- 172.21.15.98:0/3657879714 wait complete. 2023-08-22T00:44:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.135+0000 7f7705568700 1 Processor -- start 2023-08-22T00:44:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.135+0000 7f7705568700 1 -- start start 2023-08-22T00:44:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.135+0000 7f7705568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7700063ea0 0x7f7700141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700064320 0x7f77000a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000a4e50 con 0x7f7700154170 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000a4240 con 0x7f7700063ea0 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000a4520 con 0x7f7700064320 2023-08-22T00:44:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45948/0 (socket says 172.21.15.98:45948) 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 -- 172.21.15.98:0/1151024297 learned_addr learned my addr 172.21.15.98:0/1151024297 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76feffd700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7700063ea0 0x7f7700141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76fe7fc700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700064320 0x7f77000a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 -- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700064320 msgr2=0x7f77000a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700064320 0x7f77000a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 -- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7700063ea0 msgr2=0x7f7700141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7700063ea0 0x7f7700141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 -- 172.21.15.98:0/1151024297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009ae0 con 0x7f7700154170 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76ff7fe700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f7700069390 tx=0x7f76f8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800b640 con 0x7f7700154170 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f80092e0 con 0x7f7700154170 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77000a4800 con 0x7f7700154170 2023-08-22T00:44:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f801d660 con 0x7f7700154170 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.136+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77000a3dc0 con 0x7f7700154170 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.137+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77000a4ca0 con 0x7f7700154170 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.138+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f76f801da50 con 0x7f7700154170 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.138+0000 7f76e6ffd700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 0x7f76ec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.138+0000 7f76feffd700 1 -- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 msgr2=0x7f76ec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.138+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f76f807bf20 con 0x7f7700154170 2023-08-22T00:44:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.138+0000 7f76feffd700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 0x7f76ec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.146+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76f804cce0 con 0x7f7700154170 2023-08-22T00:44:04.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.313+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77000a3fe0 con 0x7f7700154170 2023-08-22T00:44:04.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.314+0000 7f76e6ffd700 1 -- 172.21.15.98:0/1151024297 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76f8050300 con 0x7f7700154170 2023-08-22T00:44:04.315 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 msgr2=0x7f76ec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 0x7f76ec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 msgr2=0x7f77000666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f7700069390 tx=0x7f76f8009840).stop 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 shutdown_connections 2023-08-22T00:44:04.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f76ec05f050 0x7f76ec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7700154170 0x7f77000666a0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7700063ea0 0x7f7700141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 --2- 172.21.15.98:0/1151024297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7700064320 0x7f77000a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.315+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 >> 172.21.15.98:0/1151024297 conn(0x7f7700069680 msgr2=0x7f77000c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.316+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 shutdown_connections 2023-08-22T00:44:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.316+0000 7f7705568700 1 -- 172.21.15.98:0/1151024297 wait complete. 2023-08-22T00:44:04.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:44:04.388 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:04.387+0000 7f459433f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:04.487 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.486+0000 7f4861d9d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:04.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.489+0000 7f496f247700 1 Processor -- start 2023-08-22T00:44:04.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.489+0000 7f496f247700 1 -- start start 2023-08-22T00:44:04.491 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:04.490+0000 7f459433f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496f247700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496f247700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680654a0 con 0x7f4968067d00 2023-08-22T00:44:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496f247700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4968064920 con 0x7f49680641b0 2023-08-22T00:44:04.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496f247700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4968064c00 con 0x7f496814e720 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496d7e4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4968067d00 0x7f49680c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46738/0 (socket says 172.21.15.98:46738) 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.490+0000 7f496d7e4700 1 -- 172.21.15.98:0/1629068668 learned_addr learned my addr 172.21.15.98:0/1629068668 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f496cfe3700 1 --2- 172.21.15.98:0/1629068668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412920212 0 0) 0x7f49680654a0 con 0x7f4968067d00 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49580033f0 con 0x7f4968067d00 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109667100 0 0) 0x7f4968064920 con 0x7f49680641b0 2023-08-22T00:44:04.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49680654a0 con 0x7f49680641b0 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f496cfe3700 1 -- 172.21.15.98:0/1629068668 >> v1:172.21.15.118:6789/0 conn(0x7f49680641b0 legacy=0x7f49680675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f496cfe3700 1 -- 172.21.15.98:0/1629068668 >> v1:172.21.15.98:6789/0 conn(0x7f4968067d00 legacy=0x7f49680c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f496cfe3700 1 -- 172.21.15.98:0/1629068668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968064ee0 con 0x7f496814e720 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f496cfe3700 1 --2- 172.21.15.98:0/1629068668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968155290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f495c009790 tx=0x7f495c009060).ready entity=mon.2 client_cookie=c633daa5d40f1b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00f510 con 0x7f496814e720 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00f670 con 0x7f496814e720 2023-08-22T00:44:04.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.491+0000 7f49677fe700 1 -- 172.21.15.98:0/1629068668 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00f9f0 con 0x7f496814e720 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 -- 172.21.15.98:0/1629068668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 msgr2=0x7f4968155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 --2- 172.21.15.98:0/1629068668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968155290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f495c009790 tx=0x7f495c009060).stop 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 -- 172.21.15.98:0/1629068668 shutdown_connections 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 --2- 172.21.15.98:0/1629068668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968155290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 -- 172.21.15.98:0/1629068668 >> 172.21.15.98:0/1629068668 conn(0x7f49680c8950 msgr2=0x7f49680c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 -- 172.21.15.98:0/1629068668 shutdown_connections 2023-08-22T00:44:04.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.492+0000 7f496f247700 1 -- 172.21.15.98:0/1629068668 wait complete. 2023-08-22T00:44:04.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.493+0000 7f496f247700 1 Processor -- start 2023-08-22T00:44:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.493+0000 7f496f247700 1 -- start start 2023-08-22T00:44:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 0x7f4968167c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968168140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968168630 con 0x7f49680641b0 2023-08-22T00:44:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c1700 con 0x7f4968067d00 2023-08-22T00:44:04.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496f247700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c0af0 con 0x7f496814e720 2023-08-22T00:44:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45962/0 (socket says 172.21.15.98:45962) 2023-08-22T00:44:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 -- 172.21.15.98:0/3894619916 learned_addr learned my addr 172.21.15.98:0/3894619916 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496d7e4700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968168140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f4967fff700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 0x7f4968167c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 -- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 msgr2=0x7f4968168140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968168140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 -- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 msgr2=0x7f4968167c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 0x7f4968167c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 -- 172.21.15.98:0/3894619916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0092a0 con 0x7f49680641b0 2023-08-22T00:44:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f4967fff700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 0x7f4968167c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:04.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.494+0000 7f496cfe3700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f4968157d10 tx=0x7f495c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.495+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00f7e0 con 0x7f49680641b0 2023-08-22T00:44:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.495+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49680c0dd0 con 0x7f49680641b0 2023-08-22T00:44:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.495+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00f940 con 0x7f49680641b0 2023-08-22T00:44:04.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.495+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c01c670 con 0x7f49680641b0 2023-08-22T00:44:04.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.495+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680c1390 con 0x7f49680641b0 2023-08-22T00:44:04.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.496+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680c19e0 con 0x7f49680641b0 2023-08-22T00:44:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.497+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f495c01ca20 con 0x7f49680641b0 2023-08-22T00:44:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.497+0000 7f4964ff9700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 0x7f494c0614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.497+0000 7f4967fff700 1 -- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 msgr2=0x7f494c0614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:04.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.497+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f495c07c290 con 0x7f49680641b0 2023-08-22T00:44:04.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.497+0000 7f4967fff700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 0x7f494c0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:04.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.504+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f495c04d160 con 0x7f49680641b0 2023-08-22T00:44:04.600 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.599+0000 7f4861d9d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:04.646 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:04.645+0000 7f459433f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:04.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.673+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4968069d50 con 0x7f49680641b0 2023-08-22T00:44:04.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.673+0000 7f4964ff9700 1 -- 172.21.15.98:0/3894619916 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v188) v1 ==== 104+0+11 (secure 0 0 0) 0x7f495c020020 con 0x7f49680641b0 2023-08-22T00:44:04.675 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:44:04.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 msgr2=0x7f494c0614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:04.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 0x7f494c0614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 msgr2=0x7f49680c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f4968157d10 tx=0x7f495c017000).stop 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 shutdown_connections 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f494c05f020 0x7f494c0614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f496814e720 0x7f4968168140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49680641b0 0x7f49680c1b90 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 --2- 172.21.15.98:0/3894619916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4968067d00 0x7f4968167c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 >> 172.21.15.98:0/3894619916 conn(0x7f49680c8950 msgr2=0x7f496814da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:04.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 shutdown_connections 2023-08-22T00:44:04.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.675+0000 7f496f247700 1 -- 172.21.15.98:0/3894619916 wait complete. 2023-08-22T00:44:04.690 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:44:04.720 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:04.720+0000 7f459433f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:04.762 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.761+0000 7f4861d9d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:04.788 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:04.787+0000 7f459433f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:04.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.811+0000 7f9f513c1700 1 Processor -- start 2023-08-22T00:44:04.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.811+0000 7f9f513c1700 1 -- start start 2023-08-22T00:44:04.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f513c1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f4c06a870 0x7f9f4c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f513c1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9f4c066200 0x7f9f4c063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f513c1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c0c5ae0 con 0x7f9f4c151830 2023-08-22T00:44:04.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f513c1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c0c4ed0 con 0x7f9f4c066200 2023-08-22T00:44:04.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f513c1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c0c51b0 con 0x7f9f4c06a870 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f4b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9f4c066200 0x7f9f4c063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f4b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9f4c066200 0x7f9f4c063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45976/0 (socket says 172.21.15.98:45976) 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.812+0000 7f9f4b7fe700 1 -- 172.21.15.98:0/388856302 learned_addr learned my addr 172.21.15.98:0/388856302 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4a7fc700 1 --2- 172.21.15.98:0/388856302 >> v2:172.21.15.118:3300/0 conn(0x7f9f4c06a870 0x7f9f4c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4b7fe700 1 -- 172.21.15.98:0/388856302 >> v2:172.21.15.118:3300/0 conn(0x7f9f4c06a870 msgr2=0x7f9f4c151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4b7fe700 1 --2- 172.21.15.98:0/388856302 >> v2:172.21.15.118:3300/0 conn(0x7f9f4c06a870 0x7f9f4c151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4b7fe700 1 -- 172.21.15.98:0/388856302 >> v1:172.21.15.118:6789/0 conn(0x7f9f4c151830 legacy=0x7f9f4c0a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4b7fe700 1 -- 172.21.15.98:0/388856302 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0c5490 con 0x7f9f4c066200 2023-08-22T00:44:04.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f4b7fe700 1 --2- 172.21.15.98:0/388856302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c066200 0x7f9f4c063ea0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f9f4c068fc0 tx=0x7f9f44009840).ready entity=mon.0 client_cookie=670e01b074eb8079 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f49ffb700 1 -- 172.21.15.98:0/388856302 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400e070 con 0x7f9f4c066200 2023-08-22T00:44:04.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f49ffb700 1 -- 172.21.15.98:0/388856302 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400ba20 con 0x7f9f4c066200 2023-08-22T00:44:04.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.813+0000 7f9f49ffb700 1 -- 172.21.15.98:0/388856302 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400bda0 con 0x7f9f4c066200 2023-08-22T00:44:04.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 -- 172.21.15.98:0/388856302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c066200 msgr2=0x7f9f4c063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 --2- 172.21.15.98:0/388856302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c066200 0x7f9f4c063ea0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f9f4c068fc0 tx=0x7f9f44009840).stop 2023-08-22T00:44:04.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 -- 172.21.15.98:0/388856302 shutdown_connections 2023-08-22T00:44:04.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 --2- 172.21.15.98:0/388856302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c066200 0x7f9f4c063ea0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 --2- 172.21.15.98:0/388856302 >> v2:172.21.15.118:3300/0 conn(0x7f9f4c06a870 0x7f9f4c151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 -- 172.21.15.98:0/388856302 >> 172.21.15.98:0/388856302 conn(0x7f9f4c0c4570 msgr2=0x7f9f4c069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:04.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 -- 172.21.15.98:0/388856302 shutdown_connections 2023-08-22T00:44:04.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.814+0000 7f9f513c1700 1 -- 172.21.15.98:0/388856302 wait complete. 2023-08-22T00:44:04.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.815+0000 7f9f513c1700 1 Processor -- start 2023-08-22T00:44:04.818 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.816+0000 7f9f513c1700 1 -- start start 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c066200 0x7f9f4c0ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4c151830 0x7f9f4c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0aa400 con 0x7f9f4c06a870 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0aa6c0 con 0x7f9f4c066200 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0aa9a0 con 0x7f9f4c151830 2023-08-22T00:44:04.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45980/0 (socket says 172.21.15.98:45980) 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 -- 172.21.15.98:0/3922695029 learned_addr learned my addr 172.21.15.98:0/3922695029 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4affd700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c066200 0x7f9f4c0ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4b7fe700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4c151830 0x7f9f4c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 -- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4c151830 msgr2=0x7f9f4c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4c151830 0x7f9f4c154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 -- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c066200 msgr2=0x7f9f4c0ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c066200 0x7f9f4c0ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 -- 172.21.15.98:0/3922695029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44009ae0 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f4a7fc700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f9f4000e950 tx=0x7f9f40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40012600 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40012760 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40012ae0 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.817+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c0aac80 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.818+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0ab240 con 0x7f9f4c06a870 2023-08-22T00:44:04.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c068990 con 0x7f9f4c06a870 2023-08-22T00:44:04.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f9f4001b400 con 0x7f9f4c06a870 2023-08-22T00:44:04.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f32ffd700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 0x7f9f380614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:04.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f4affd700 1 -- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 msgr2=0x7f9f380614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f9f4007a900 con 0x7f9f4c06a870 2023-08-22T00:44:04.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.819+0000 7f9f4affd700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 0x7f9f380614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:04.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.827+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f4004b7d0 con 0x7f9f4c06a870 2023-08-22T00:44:04.846 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.845+0000 7f4861d9d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:04.916 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:04.915+0000 7f4861d9d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:04.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.995+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f4c0c5770 con 0x7f9f4c06a870 2023-08-22T00:44:04.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.996+0000 7f9f32ffd700 1 -- 172.21.15.98:0/3922695029 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v188) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f400160a0 con 0x7f9f4c06a870 2023-08-22T00:44:04.997 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 msgr2=0x7f9f380614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 0x7f9f380614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 msgr2=0x7f9f4c0a8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f9f4000e950 tx=0x7f9f40009060).stop 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 shutdown_connections 2023-08-22T00:44:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9f3805f020 0x7f9f380614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4c151830 0x7f9f4c154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c066200 0x7f9f4c0ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 --2- 172.21.15.98:0/3922695029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f4c06a870 0x7f9f4c0a8910 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.997+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 >> 172.21.15.98:0/3922695029 conn(0x7f9f4c0c4570 msgr2=0x7f9f4c150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.998+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 shutdown_connections 2023-08-22T00:44:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:04.998+0000 7f9f513c1700 1 -- 172.21.15.98:0/3922695029 wait complete. 2023-08-22T00:44:05.011 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:05.043 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:05.043+0000 7f459433f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:05.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.127+0000 7f8110935700 1 Processor -- start 2023-08-22T00:44:05.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.127+0000 7f8110935700 1 -- start start 2023-08-22T00:44:05.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f8110935700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f810c0c3490 0x7f810c0bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f8110935700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c151e40 con 0x7f810c0a61b0 2023-08-22T00:44:05.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f8110935700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0c4f80 con 0x7f810c0a6590 2023-08-22T00:44:05.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f8110935700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c151620 con 0x7f810c0c3490 2023-08-22T00:44:05.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f810a59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f810c0a61b0 0x7f810c150f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46752/0 (socket says 172.21.15.98:46752) 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f810a59c700 1 -- 172.21.15.98:0/2126743677 learned_addr learned my addr 172.21.15.98:0/2126743677 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f810ad9d700 1 --2- 172.21.15.98:0/2126743677 >> v2:172.21.15.118:3300/0 conn(0x7f810c0c3490 0x7f810c0bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002959996 0 0) 0x7f810c151e40 con 0x7f810c0a61b0 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.129+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f40033f0 con 0x7f810c0a61b0 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810ad9d700 1 -- 172.21.15.98:0/2126743677 >> v1:172.21.15.118:6789/0 conn(0x7f810c0a6590 legacy=0x7f810c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188559091 0 0) 0x7f810c0c4f80 con 0x7f810c0a6590 2023-08-22T00:44:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810ad9d700 1 -- 172.21.15.98:0/2126743677 >> v1:172.21.15.98:6789/0 conn(0x7f810c0a61b0 legacy=0x7f810c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810ad9d700 1 -- 172.21.15.98:0/2126743677 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c151880 con 0x7f810c0c3490 2023-08-22T00:44:05.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810ad9d700 1 --2- 172.21.15.98:0/2126743677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0c3490 0x7f810c0bbe40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8104009e60 tx=0x7f8104009780).ready entity=mon.1 client_cookie=d5048a1565fc55b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400e070 con 0x7f810c0c3490 2023-08-22T00:44:05.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400bb60 con 0x7f810c0c3490 2023-08-22T00:44:05.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.130+0000 7f810959a700 1 -- 172.21.15.98:0/2126743677 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400bee0 con 0x7f810c0c3490 2023-08-22T00:44:05.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 -- 172.21.15.98:0/2126743677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0c3490 msgr2=0x7f810c0bbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 --2- 172.21.15.98:0/2126743677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0c3490 0x7f810c0bbe40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8104009e60 tx=0x7f8104009780).stop 2023-08-22T00:44:05.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 -- 172.21.15.98:0/2126743677 shutdown_connections 2023-08-22T00:44:05.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 --2- 172.21.15.98:0/2126743677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0c3490 0x7f810c0bbe40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 -- 172.21.15.98:0/2126743677 >> 172.21.15.98:0/2126743677 conn(0x7f810c0c3980 msgr2=0x7f810c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 -- 172.21.15.98:0/2126743677 shutdown_connections 2023-08-22T00:44:05.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.131+0000 7f8110935700 1 -- 172.21.15.98:0/2126743677 wait complete. 2023-08-22T00:44:05.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.133+0000 7f8110935700 1 Processor -- start 2023-08-22T00:44:05.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.133+0000 7f8110935700 1 -- start start 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 0x7f810c0bf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0be000 con 0x7f810c0c3490 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c162340 con 0x7f810c0a61b0 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8110935700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c164e60 con 0x7f810c0a6590 2023-08-22T00:44:05.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f810ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f810a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f810a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:40072/0 (socket says 172.21.15.98:40072) 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8109d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 0x7f810c0bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f810ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45990/0 (socket says 172.21.15.98:45990) 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f810a59c700 1 -- 172.21.15.98:0/4038959377 learned_addr learned my addr 172.21.15.98:0/4038959377 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8109d9b700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 msgr2=0x7f810c161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.134+0000 7f8109d9b700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8109d9b700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 msgr2=0x7f810c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8109d9b700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8109d9b700 1 -- 172.21.15.98:0/4038959377 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104009a20 con 0x7f810c0a6590 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f810ad9d700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f810a59c700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8109d9b700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 0x7f810c0bf450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f810c0a6990 tx=0x7f8100007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100012400 con 0x7f810c0a6590 2023-08-22T00:44:05.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100012580 con 0x7f810c0a6590 2023-08-22T00:44:05.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c165140 con 0x7f810c0a6590 2023-08-22T00:44:05.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100012940 con 0x7f810c0a6590 2023-08-22T00:44:05.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.135+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c165700 con 0x7f810c0a6590 2023-08-22T00:44:05.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.136+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0be170 con 0x7f810c0a6590 2023-08-22T00:44:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.136+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f8100012cb0 con 0x7f810c0a6590 2023-08-22T00:44:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.136+0000 7f80fa7fc700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 0x7f80ec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.136+0000 7f810a59c700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 msgr2=0x7f80ec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.137+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f8100079870 con 0x7f810c0a6590 2023-08-22T00:44:05.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.137+0000 7f810a59c700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 0x7f80ec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:05.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.141+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f810c0be170 con 0x7f810c0a6590 2023-08-22T00:44:05.190 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:05.189+0000 7f4861d9d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:05.230 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:05.229+0000 7f459433f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:05.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.338+0000 7f810a59c700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 msgr2=0x7f80ec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:05.339 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.338+0000 7f810a59c700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 0x7f80ec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:05.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.353+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f810c0be170 con 0x7f810c0a6590 2023-08-22T00:44:05.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.354+0000 7f80fa7fc700 1 -- 172.21.15.98:0/4038959377 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f810c0be170 con 0x7f810c0a6590 2023-08-22T00:44:05.355 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:05.356 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:44:05.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 msgr2=0x7f80ec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 0x7f80ec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 msgr2=0x7f810c0bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 0x7f810c0bf450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f810c0a6990 tx=0x7f8100007bb0).stop 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 shutdown_connections 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f80ec05f050 0x7f80ec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:05.359 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f810c0c3490 0x7f810c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f810c0a61b0 0x7f810c161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 --2- 172.21.15.98:0/4038959377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f810c0a6590 0x7f810c0bf450 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 >> 172.21.15.98:0/4038959377 conn(0x7f810c0c3980 msgr2=0x7f810c066040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 shutdown_connections 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.357+0000 7f8110935700 1 -- 172.21.15.98:0/4038959377 wait complete. 2023-08-22T00:44:05.360 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:44:05.376 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:05.383 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:05.383+0000 7f4861d9d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:05.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.494+0000 7f7664263700 1 Processor -- start 2023-08-22T00:44:05.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.494+0000 7f7664263700 1 -- start start 2023-08-22T00:44:05.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7664263700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f765c0aa040 0x7f765c0c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7664263700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c062a10 con 0x7f765c0a9c60 2023-08-22T00:44:05.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7664263700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0c1230 con 0x7f765c153f70 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7664263700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0c1050 con 0x7f765c0aa040 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7662800700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f765c0aa040 0x7f765c0c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7661fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f765c0a9c60 0x7f765c153860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46766/0 (socket says 172.21.15.98:46766) 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7661fff700 1 -- 172.21.15.98:0/3033495737 learned_addr learned my addr 172.21.15.98:0/3033495737 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7662800700 1 -- 172.21.15.98:0/3033495737 >> v1:172.21.15.118:6789/0 conn(0x7f765c153f70 legacy=0x7f765c062ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7662800700 1 -- 172.21.15.98:0/3033495737 >> v1:172.21.15.98:6789/0 conn(0x7f765c0a9c60 legacy=0x7f765c153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7660ffd700 1 -- 172.21.15.98:0/3033495737 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35397590 0 0) 0x7f765c062a10 con 0x7f765c0a9c60 2023-08-22T00:44:05.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7662800700 1 -- 172.21.15.98:0/3033495737 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0c1510 con 0x7f765c0aa040 2023-08-22T00:44:05.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.495+0000 7f7662800700 1 --2- 172.21.15.98:0/3033495737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c0aa040 0x7f765c0c0b60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f7654009e60 tx=0x7f7654009780).ready entity=mon.0 client_cookie=a716c36f72994550 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7660ffd700 1 -- 172.21.15.98:0/3033495737 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400e070 con 0x7f765c0aa040 2023-08-22T00:44:05.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7660ffd700 1 -- 172.21.15.98:0/3033495737 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400bc30 con 0x7f765c0aa040 2023-08-22T00:44:05.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7660ffd700 1 -- 172.21.15.98:0/3033495737 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654012410 con 0x7f765c0aa040 2023-08-22T00:44:05.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 -- 172.21.15.98:0/3033495737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c0aa040 msgr2=0x7f765c0c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 --2- 172.21.15.98:0/3033495737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c0aa040 0x7f765c0c0b60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f7654009e60 tx=0x7f7654009780).stop 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 -- 172.21.15.98:0/3033495737 shutdown_connections 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 --2- 172.21.15.98:0/3033495737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c0aa040 0x7f765c0c0b60 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 -- 172.21.15.98:0/3033495737 >> 172.21.15.98:0/3033495737 conn(0x7f765c0cb5a0 msgr2=0x7f765c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 -- 172.21.15.98:0/3033495737 shutdown_connections 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.496+0000 7f7664263700 1 -- 172.21.15.98:0/3033495737 wait complete. 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.497+0000 7f7664263700 1 Processor -- start 2023-08-22T00:44:05.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 -- start start 2023-08-22T00:44:05.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c0a9c60 0x7f765c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f765c0aa040 0x7f765c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c154410 con 0x7f765c153f70 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c154660 con 0x7f765c0a9c60 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7664263700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c154940 con 0x7f765c0aa040 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7662800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7662800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46014/0 (socket says 172.21.15.98:46014) 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7662800700 1 -- 172.21.15.98:0/1001433502 learned_addr learned my addr 172.21.15.98:0/1001433502 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:05.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f7661fff700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c0a9c60 0x7f765c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.498+0000 7f76617fe700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f765c0aa040 0x7f765c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 -- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f765c0aa040 msgr2=0x7f765c0abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f765c0aa040 0x7f765c0abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 -- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c0a9c60 msgr2=0x7f765c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c0a9c60 0x7f765c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 -- 172.21.15.98:0/1001433502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654009a20 con 0x7f765c153f70 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7662800700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f765400b6c0 tx=0x7f7654009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765401d630 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765401d790 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c154c20 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765401db30 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.499+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c0ac020 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.500+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f7654027460 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.501+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c047480 con 0x7f765c153f70 2023-08-22T00:44:05.505 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.501+0000 7f7651ffb700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 0x7f76400614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.501+0000 7f7661fff700 1 -- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 msgr2=0x7f76400614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:05.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.501+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f765407c6f0 con 0x7f765c153f70 2023-08-22T00:44:05.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.501+0000 7f7661fff700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 0x7f76400614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:05.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.505+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f765404d450 con 0x7f765c153f70 2023-08-22T00:44:05.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.690+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f765c0cb9b0 con 0x7f765c153f70 2023-08-22T00:44:05.692 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.691+0000 7f7651ffb700 1 -- 172.21.15.98:0/1001433502 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+17741 (secure 0 0 0) 0x7f7654050a70 con 0x7f765c153f70 2023-08-22T00:44:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:05.693 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":188,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:43:54.631740+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1170451421":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1589005932":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1080851051":"2023-08-23T00:42:52.871903+0000","172.21.15.98:6833/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1927881826":"2023-08-23T00:42:52.871903+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 msgr2=0x7f76400614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 0x7f76400614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 msgr2=0x7f765c146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f765400b6c0 tx=0x7f7654009780).stop 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 shutdown_connections 2023-08-22T00:44:05.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f764005f020 0x7f76400614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765c153f70 0x7f765c146950 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c0a9c60 0x7f765c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 --2- 172.21.15.98:0/1001433502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f765c0aa040 0x7f765c0abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.693+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 >> 172.21.15.98:0/1001433502 conn(0x7f765c0cb5a0 msgr2=0x7f765c0ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.694+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 shutdown_connections 2023-08-22T00:44:05.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.694+0000 7f7664263700 1 -- 172.21.15.98:0/1001433502 wait complete. 2023-08-22T00:44:05.707 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:44:05.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:05.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.865+0000 7ff721965700 1 Processor -- start 2023-08-22T00:44:05.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.865+0000 7ff721965700 1 -- start start 2023-08-22T00:44:05.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff721965700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff71c150c50 0x7ff71c0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff721965700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff71c151030 0x7ff71c151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff721965700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0645b0 con 0x7ff71c0bc6d0 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff721965700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c063fa0 con 0x7ff71c151030 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff721965700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c151f30 con 0x7ff71c150c50 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff71c151030 0x7ff71c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff71c151030 0x7ff71c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46020/0 (socket says 172.21.15.98:46020) 2023-08-22T00:44:05.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 -- 172.21.15.98:0/1933920034 learned_addr learned my addr 172.21.15.98:0/1933920034 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71affd700 1 --2- 172.21.15.98:0/1933920034 >> v2:172.21.15.118:3300/0 conn(0x7ff71c150c50 0x7ff71c0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 -- 172.21.15.98:0/1933920034 >> v2:172.21.15.118:3300/0 conn(0x7ff71c150c50 msgr2=0x7ff71c0c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 --2- 172.21.15.98:0/1933920034 >> v2:172.21.15.118:3300/0 conn(0x7ff71c150c50 0x7ff71c0c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 -- 172.21.15.98:0/1933920034 >> v1:172.21.15.118:6789/0 conn(0x7ff71c0bc6d0 legacy=0x7ff71c0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 -- 172.21.15.98:0/1933920034 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c152210 con 0x7ff71c151030 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff71b7fe700 1 --2- 172.21.15.98:0/1933920034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c151030 0x7ff71c151470 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7ff71c0c5540 tx=0x7ff714009840).ready entity=mon.0 client_cookie=684edf0882ef8532 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.869 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.866+0000 7ff719ffb700 1 -- 172.21.15.98:0/1933920034 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71400e070 con 0x7ff71c151030 2023-08-22T00:44:05.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff719ffb700 1 -- 172.21.15.98:0/1933920034 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71400ba20 con 0x7ff71c151030 2023-08-22T00:44:05.870 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff719ffb700 1 -- 172.21.15.98:0/1933920034 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71400bda0 con 0x7ff71c151030 2023-08-22T00:44:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 -- 172.21.15.98:0/1933920034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c151030 msgr2=0x7ff71c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 --2- 172.21.15.98:0/1933920034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c151030 0x7ff71c151470 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7ff71c0c5540 tx=0x7ff714009840).stop 2023-08-22T00:44:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 -- 172.21.15.98:0/1933920034 shutdown_connections 2023-08-22T00:44:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 --2- 172.21.15.98:0/1933920034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c151030 0x7ff71c151470 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 --2- 172.21.15.98:0/1933920034 >> v2:172.21.15.118:3300/0 conn(0x7ff71c150c50 0x7ff71c0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 -- 172.21.15.98:0/1933920034 >> 172.21.15.98:0/1933920034 conn(0x7ff71c0c7770 msgr2=0x7ff71c0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 -- 172.21.15.98:0/1933920034 shutdown_connections 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.867+0000 7ff721965700 1 -- 172.21.15.98:0/1933920034 wait complete. 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 Processor -- start 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 -- start start 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff71c0bc6d0 0x7ff71c13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff71c151030 0x7ff71c0a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0ad2a0 con 0x7ff71c150c50 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0a7c30 con 0x7ff71c0bc6d0 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff721965700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0a4de0 con 0x7ff71c151030 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff71a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff71a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46034/0 (socket says 172.21.15.98:46034) 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.869+0000 7ff71a7fc700 1 -- 172.21.15.98:0/1839035600 learned_addr learned my addr 172.21.15.98:0/1839035600 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:05.874 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71affd700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff71c0bc6d0 0x7ff71c13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71b7fe700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff71c151030 0x7ff71c0a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff71c151030 msgr2=0x7ff71c0a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff71c151030 0x7ff71c0a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff71c0bc6d0 msgr2=0x7ff71c13dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff71c0bc6d0 0x7ff71c13dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 -- 172.21.15.98:0/1839035600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714009ae0 con 0x7ff71c150c50 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff71a7fc700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7ff71000c4c0 tx=0x7ff710007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:05.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71000ce10 con 0x7ff71c150c50 2023-08-22T00:44:05.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710007020 con 0x7ff71c150c50 2023-08-22T00:44:05.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0acfc0 con 0x7ff71c150c50 2023-08-22T00:44:05.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100073c0 con 0x7ff71c150c50 2023-08-22T00:44:05.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.870+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c0a4a70 con 0x7ff71c150c50 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.871+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c047480 con 0x7ff71c150c50 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.871+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7ff7100068b0 con 0x7ff71c150c50 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.872+0000 7ff702ffd700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 0x7ff7080614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.872+0000 7ff71affd700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 msgr2=0x7ff7080614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.872+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7ff710079710 con 0x7ff71c150c50 2023-08-22T00:44:05.877 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.872+0000 7ff71affd700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 0x7ff7080614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:05.878 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:05.876+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7100478f0 con 0x7ff71c150c50 2023-08-22T00:44:05.885 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:05.885+0000 7f459433f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:05.955 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:05.955+0000 7f459433f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:06.030 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.030+0000 7f459433f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:06.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.073+0000 7ff71affd700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 msgr2=0x7ff7080614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:06.074 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.073+0000 7ff71affd700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 0x7ff7080614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:06.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.081+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff71c064240 con 0x7ff71c150c50 2023-08-22T00:44:06.082 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.081+0000 7f4861d9d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:06.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.081+0000 7ff702ffd700 1 -- 172.21.15.98:0/1839035600 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7ff71004a5e0 con 0x7ff71c150c50 2023-08-22T00:44:06.083 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:06.083 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:44:06.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 msgr2=0x7ff7080614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 0x7ff7080614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 msgr2=0x7ff71c0a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7ff71000c4c0 tx=0x7ff710007dd0).stop 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 shutdown_connections 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff70805f020 0x7ff7080614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff71c151030 0x7ff71c0a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff71c0bc6d0 0x7ff71c13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 --2- 172.21.15.98:0/1839035600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff71c150c50 0x7ff71c0a7250 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 >> 172.21.15.98:0/1839035600 conn(0x7ff71c0c7770 msgr2=0x7ff71c0c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 shutdown_connections 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.083+0000 7ff721965700 1 -- 172.21.15.98:0/1839035600 wait complete. 2023-08-22T00:44:06.086 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:44:06.096 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:06.158 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.157+0000 7f4861d9d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:06.176 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.175+0000 7f459433f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.214+0000 7f3906174700 1 Processor -- start 2023-08-22T00:44:06.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.214+0000 7f3906174700 1 -- start start 2023-08-22T00:44:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f3906174700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39001505b0 0x7f3900150990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f3906174700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3900063fa0 0x7f3900064420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.217 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f3906174700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39000c5d10 con 0x7f39000c2940 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f3906174700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39000c6d20 con 0x7f39001505b0 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f3906174700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39000c6890 con 0x7f3900063fa0 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.215+0000 7f38ff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39001505b0 0x7f3900150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39001505b0 0x7f3900150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46050/0 (socket says 172.21.15.98:46050) 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 -- 172.21.15.98:0/788560751 learned_addr learned my addr 172.21.15.98:0/788560751 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38feffd700 1 --2- 172.21.15.98:0/788560751 >> v2:172.21.15.118:3300/0 conn(0x7f3900063fa0 0x7f3900064420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 -- 172.21.15.98:0/788560751 >> v2:172.21.15.118:3300/0 conn(0x7f3900063fa0 msgr2=0x7f3900064420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:06.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/788560751 >> v2:172.21.15.118:3300/0 conn(0x7f3900063fa0 0x7f3900064420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 -- 172.21.15.98:0/788560751 >> v1:172.21.15.118:6789/0 conn(0x7f39000c2940 legacy=0x7f39000c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 -- 172.21.15.98:0/788560751 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000c5f60 con 0x7f39001505b0 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/788560751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f3900150990 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f38f0009f20 tx=0x7f38f0009840).ready entity=mon.0 client_cookie=809d52592e9fa832 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38fe7fc700 1 -- 172.21.15.98:0/788560751 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000e070 con 0x7f39001505b0 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38fe7fc700 1 -- 172.21.15.98:0/788560751 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000b990 con 0x7f39001505b0 2023-08-22T00:44:06.219 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.216+0000 7f38fe7fc700 1 -- 172.21.15.98:0/788560751 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000bd10 con 0x7f39001505b0 2023-08-22T00:44:06.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 -- 172.21.15.98:0/788560751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 msgr2=0x7f3900150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 --2- 172.21.15.98:0/788560751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f3900150990 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f38f0009f20 tx=0x7f38f0009840).stop 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 -- 172.21.15.98:0/788560751 shutdown_connections 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 --2- 172.21.15.98:0/788560751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f3900150990 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 --2- 172.21.15.98:0/788560751 >> v2:172.21.15.118:3300/0 conn(0x7f3900063fa0 0x7f3900064420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 -- 172.21.15.98:0/788560751 >> 172.21.15.98:0/788560751 conn(0x7f39000c3990 msgr2=0x7f39000c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 -- 172.21.15.98:0/788560751 shutdown_connections 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.217+0000 7f3906174700 1 -- 172.21.15.98:0/788560751 wait complete. 2023-08-22T00:44:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.218+0000 7f3906174700 1 Processor -- start 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.218+0000 7f3906174700 1 -- start start 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 0x7f39000ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39000c2940 0x7f3900147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39000acab0 con 0x7f39001505b0 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39000abea0 con 0x7f3900063fa0 2023-08-22T00:44:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f3906174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39000ac180 con 0x7f39000c2940 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38fffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38fffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46058/0 (socket says 172.21.15.98:46058) 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38fffff700 1 -- 172.21.15.98:0/2248480502 learned_addr learned my addr 172.21.15.98:0/2248480502 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 0x7f39000ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38feffd700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39000c2940 0x7f3900147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39000c2940 msgr2=0x7f3900147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39000c2940 0x7f3900147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 msgr2=0x7f39000bf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38ff7fe700 1 -- 172.21.15.98:0/2248480502 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009ae0 con 0x7f3900063fa0 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.219+0000 7f38fffff700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f38ff7fe700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 0x7f39000ab650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f38f0013000 tx=0x7f3900150eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f00092e0 con 0x7f3900063fa0 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000bb00 con 0x7f3900063fa0 2023-08-22T00:44:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f001c400 con 0x7f3900063fa0 2023-08-22T00:44:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39000ac460 con 0x7f3900063fa0 2023-08-22T00:44:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.220+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39000abb40 con 0x7f3900063fa0 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f38f001c7b0 con 0x7f3900063fa0 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900047480 con 0x7f3900063fa0 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f38f77fe700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 0x7f38e0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f38feffd700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 msgr2=0x7f38e0061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f38f007bb80 con 0x7f3900063fa0 2023-08-22T00:44:06.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.221+0000 7f38feffd700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 0x7f38e0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:06.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.226+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38f004c900 con 0x7f3900063fa0 2023-08-22T00:44:06.240 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.239+0000 7f4861d9d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:06.247 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.247+0000 7f459433f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:06.363 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.362+0000 7f459433f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:06.395 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.394+0000 7f4861d9d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.422+0000 7f38feffd700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 msgr2=0x7f38e0061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.422+0000 7f38feffd700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 0x7f38e0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.435+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39000c6240 con 0x7f3900063fa0 2023-08-22T00:44:06.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.436+0000 7f38f77fe700 1 -- 172.21.15.98:0/2248480502 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f38f004ff20 con 0x7f3900063fa0 2023-08-22T00:44:06.437 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:06.437 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:42:36.057336+0000","modified":"2023-08-22T00:42:38.685301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1912312380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1912312380},{"type":"v1","addr":"172.21.15.118:6834","nonce":1912312380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-22T00:44:06.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 msgr2=0x7f38e0061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:06.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 0x7f38e0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 msgr2=0x7f39000ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 0x7f39000ab650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f38f0013000 tx=0x7f3900150eb0).stop 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 shutdown_connections 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f38e005f080 0x7f38e0061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39001505b0 0x7f39000bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3900063fa0 0x7f39000ab650 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 --2- 172.21.15.98:0/2248480502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39000c2940 0x7f3900147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 >> 172.21.15.98:0/2248480502 conn(0x7f39000c3990 msgr2=0x7f3900066230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 shutdown_connections 2023-08-22T00:44:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.438+0000 7f3906174700 1 -- 172.21.15.98:0/2248480502 wait complete. 2023-08-22T00:44:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 69 2023-08-22T00:44:06.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:06.470 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.470+0000 7f459433f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:06.471 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.470+0000 7f4861d9d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:06.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.570+0000 7fa2ad4b2700 1 Processor -- start 2023-08-22T00:44:06.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.570+0000 7fa2ad4b2700 1 -- start start 2023-08-22T00:44:06.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2ad4b2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 0x7fa2a8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2ad4b2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2a80c3e50 0x7fa2a81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2ad4b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a8153080 con 0x7fa2a814c350 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2ad4b2700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a8066510 con 0x7fa2a80c3e50 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2ad4b2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a80667b0 con 0x7fa2a814bf70 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2a80c3e50 0x7fa2a81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2a80c3e50 0x7fa2a81556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46072/0 (socket says 172.21.15.98:46072) 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 -- 172.21.15.98:0/65401191 learned_addr learned my addr 172.21.15.98:0/65401191 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:06.574 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a6ffd700 1 --2- 172.21.15.98:0/65401191 >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 0x7fa2a8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 -- 172.21.15.98:0/65401191 >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 msgr2=0x7fa2a8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 --2- 172.21.15.98:0/65401191 >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 0x7fa2a8152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 -- 172.21.15.98:0/65401191 >> v1:172.21.15.118:6789/0 conn(0x7fa2a814c350 legacy=0x7fa2a80c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 -- 172.21.15.98:0/65401191 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8155ba0 con 0x7fa2a80c3e50 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a6ffd700 1 --2- 172.21.15.98:0/65401191 >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 0x7fa2a8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a77fe700 1 --2- 172.21.15.98:0/65401191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a80c3e50 0x7fa2a81556b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7fa2a8153280 tx=0x7fa2a0009840).ready entity=mon.0 client_cookie=cbf13e5266a39d08 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.575 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a5ffb700 1 -- 172.21.15.98:0/65401191 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000e070 con 0x7fa2a80c3e50 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a5ffb700 1 -- 172.21.15.98:0/65401191 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000ba50 con 0x7fa2a80c3e50 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.571+0000 7fa2a5ffb700 1 -- 172.21.15.98:0/65401191 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000bdd0 con 0x7fa2a80c3e50 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/65401191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a80c3e50 msgr2=0x7fa2a81556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/65401191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a80c3e50 0x7fa2a81556b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7fa2a8153280 tx=0x7fa2a0009840).stop 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/65401191 shutdown_connections 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/65401191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a80c3e50 0x7fa2a81556b0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/65401191 >> v2:172.21.15.118:3300/0 conn(0x7fa2a814bf70 0x7fa2a8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/65401191 >> 172.21.15.98:0/65401191 conn(0x7fa2a80c5dc0 msgr2=0x7fa2a8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/65401191 shutdown_connections 2023-08-22T00:44:06.577 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.572+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/65401191 wait complete. 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.573+0000 7fa2ad4b2700 1 Processor -- start 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.573+0000 7fa2ad4b2700 1 -- start start 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2a80c3e50 0x7fa2a8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2a814c350 0x7fa2a8064e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8065b60 con 0x7fa2a814bf70 2023-08-22T00:44:06.579 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8148fa0 con 0x7fa2a814c350 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2ad4b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8153450 con 0x7fa2a80c3e50 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2a67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2a67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46088/0 (socket says 172.21.15.98:46088) 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2a67fc700 1 -- 172.21.15.98:0/3837555762 learned_addr learned my addr 172.21.15.98:0/3837555762 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2a77fe700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2a814c350 0x7fa2a8064e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.574+0000 7fa2a6ffd700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2a80c3e50 0x7fa2a8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.580 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 -- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2a80c3e50 msgr2=0x7fa2a8148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2a80c3e50 0x7fa2a8148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 -- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2a814c350 msgr2=0x7fa2a8064e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2a814c350 0x7fa2a8064e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 -- 172.21.15.98:0/3837555762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0009ae0 con 0x7fa2a814bf70 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2a67fc700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fa29c00c440 tx=0x7fa29c007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0123f0 con 0x7fa2a814bf70 2023-08-22T00:44:06.581 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c012550 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a8065880 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0128f0 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.575+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a81539d0 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a81532b0 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fa29c012c60 con 0x7fa2a814bf70 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa28effd700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 0x7fa294061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa2a6ffd700 1 -- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 msgr2=0x7fa294061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:06.582 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fa29c079750 con 0x7fa2a814bf70 2023-08-22T00:44:06.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.576+0000 7fa2a6ffd700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 0x7fa294061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:06.583 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.580+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa29c0478f0 con 0x7fa2a814bf70 2023-08-22T00:44:06.596 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.595+0000 7f4861d9d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:06.713 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:06.712+0000 7f4861d9d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:06.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.762+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2a8047480 con 0x7fa2a814bf70 2023-08-22T00:44:06.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.763+0000 7fa28effd700 1 -- 172.21.15.98:0/3837555762 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+17852 (secure 0 0 0) 0x7fa2a81532b0 con 0x7fa2a814bf70 2023-08-22T00:44:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:06.764 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":189,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:06.609039+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:42:34.603327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-08-22T00:42:35.014248+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":189,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6832/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1170451421":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1589005932":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1080851051":"2023-08-23T00:42:52.871903+0000","172.21.15.98:6833/169458":"2023-08-23T00:42:52.871903+0000","172.21.15.98:0/1927881826":"2023-08-23T00:42:52.871903+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.764+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 msgr2=0x7fa294061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.764+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 0x7fa294061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.764+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 msgr2=0x7fa2a814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.764+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fa29c00c440 tx=0x7fa29c007d80).stop 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 shutdown_connections 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29405f050 0x7fa294061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2a80c3e50 0x7fa2a8148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2a814c350 0x7fa2a8064e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 --2- 172.21.15.98:0/3837555762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a814bf70 0x7fa2a814f990 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 >> 172.21.15.98:0/3837555762 conn(0x7fa2a80c5dc0 msgr2=0x7fa2a8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 shutdown_connections 2023-08-22T00:44:06.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.765+0000 7fa2ad4b2700 1 -- 172.21.15.98:0/3837555762 wait complete. 2023-08-22T00:44:06.769 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.768+0000 7f459433f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:06.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:44:06.840 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:06.840+0000 7f459433f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:06.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.942+0000 7ff1661b2700 1 Processor -- start 2023-08-22T00:44:06.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.942+0000 7ff1661b2700 1 -- start start 2023-08-22T00:44:06.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff1661b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff1600c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff1661b2700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600bd3b0 con 0x7ff160153f10 2023-08-22T00:44:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff1661b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600bd690 con 0x7ff1600be450 2023-08-22T00:44:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff1661b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600a6440 con 0x7ff1600656c0 2023-08-22T00:44:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff160153f10 0x7ff1600bcb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46770/0 (socket says 172.21.15.98:46770) 2023-08-22T00:44:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15f7fe700 1 -- 172.21.15.98:0/2910370918 learned_addr learned my addr 172.21.15.98:0/2910370918 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15ffff700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff1600c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495822424 0 0) 0x7ff1600bd3b0 con 0x7ff160153f10 2023-08-22T00:44:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1480033f0 con 0x7ff160153f10 2023-08-22T00:44:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1260558349 0 0) 0x7ff1480033f0 con 0x7ff160153f10 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 msgr2=0x7ff1600c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff1600c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 >> v1:172.21.15.118:6789/0 conn(0x7ff1600be450 legacy=0x7ff160064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600bd970 con 0x7ff160153f10 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff150001470 con 0x7ff160153f10 2023-08-22T00:44:06.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 >> v1:172.21.15.98:6789/0 conn(0x7ff160153f10 legacy=0x7ff1600bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff148003910 0x7ff148003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff148004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff148004b80 0x7ff148005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600a6440 con 0x7ff148003910 2023-08-22T00:44:06.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14800b8e0 con 0x7ff148004b80 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14800ba50 con 0x7ff1600656c0 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.943+0000 7ff15f7fe700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff148003910 0x7ff148003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15effd700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff148004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15ffff700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff148004b80 0x7ff148005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 -- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 msgr2=0x7ff148004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:06.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600656c0 0x7ff148004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 -- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff148004b80 msgr2=0x7ff148005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:06.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff148004b80 0x7ff148005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:06.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 -- 172.21.15.98:0/2910370918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480033f0 con 0x7ff148003910 2023-08-22T00:44:06.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15f7fe700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff148003910 0x7ff148003cf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7ff15000c190 tx=0x7ff150001e70).ready entity=mon.0 client_cookie=497f4a0de1b1e409 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150007a40 con 0x7ff148003910 2023-08-22T00:44:06.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15000ca60 con 0x7ff148003910 2023-08-22T00:44:06.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.944+0000 7ff15e7fc700 1 -- 172.21.15.98:0/2910370918 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000cde0 con 0x7ff148003910 2023-08-22T00:44:06.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 -- 172.21.15.98:0/2910370918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff148003910 msgr2=0x7ff148003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 --2- 172.21.15.98:0/2910370918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff148003910 0x7ff148003cf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7ff15000c190 tx=0x7ff150001e70).stop 2023-08-22T00:44:06.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff15ffff700 1 -- 172.21.15.98:0/2910370918 reap_dead start 2023-08-22T00:44:06.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 -- 172.21.15.98:0/2910370918 shutdown_connections 2023-08-22T00:44:06.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 -- 172.21.15.98:0/2910370918 >> 172.21.15.98:0/2910370918 conn(0x7ff1600c42e0 msgr2=0x7ff1600c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:06.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 -- 172.21.15.98:0/2910370918 shutdown_connections 2023-08-22T00:44:06.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.945+0000 7ff1661b2700 1 -- 172.21.15.98:0/2910370918 wait complete. 2023-08-22T00:44:06.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.946+0000 7ff1661b2700 1 Processor -- start 2023-08-22T00:44:06.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.946+0000 7ff1661b2700 1 -- start start 2023-08-22T00:44:06.959 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff160150860 0x7ff1600a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600a9f60 0x7ff1601513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601545b0 con 0x7ff160151890 2023-08-22T00:44:06.960 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160151d10 con 0x7ff1600a9f60 2023-08-22T00:44:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600a8250 con 0x7ff160150860 2023-08-22T00:44:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46118/0 (socket says 172.21.15.98:46118) 2023-08-22T00:44:06.961 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 -- 172.21.15.98:0/4012282856 learned_addr learned my addr 172.21.15.98:0/4012282856 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 -- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff160150860 msgr2=0x7ff1600a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff160150860 0x7ff1600a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 -- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600a9f60 msgr2=0x7ff1601513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:06.962 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600a9f60 0x7ff1601513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:06.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 -- 172.21.15.98:0/4012282856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600a8530 con 0x7ff160151890 2023-08-22T00:44:06.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff15ffff700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7ff160095880 tx=0x7ff15800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:06.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800e040 con 0x7ff160151890 2023-08-22T00:44:06.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800f040 con 0x7ff160151890 2023-08-22T00:44:06.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600a8810 con 0x7ff160151890 2023-08-22T00:44:06.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800fe20 con 0x7ff160151890 2023-08-22T00:44:06.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.947+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff160150c40 con 0x7ff160151890 2023-08-22T00:44:06.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.948+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff160069460 con 0x7ff160151890 2023-08-22T00:44:06.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.949+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 94) v1 ==== 75488+0+0 (secure 0 0 0) 0x7ff158015660 con 0x7ff160151890 2023-08-22T00:44:06.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.949+0000 7ff1477fe700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 0x7ff14c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:06.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.949+0000 7ff15f7fe700 1 -- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 msgr2=0x7ff14c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:06.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.949+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff15807b0d0 con 0x7ff160151890 2023-08-22T00:44:06.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.949+0000 7ff15f7fe700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 0x7ff14c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:06.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:06.954+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff15804be60 con 0x7ff160151890 2023-08-22T00:44:07.031 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.030+0000 7f4861d9d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:07.107 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.106+0000 7f4861d9d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:07.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:07.125+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 95) v1 ==== 75096+0+0 (secure 0 0 0) 0x7ff1580787c0 con 0x7ff160151890 2023-08-22T00:44:07.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:07.126+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 msgr2=0x7ff14c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:07.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:07.126+0000 7ff1477fe700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 0x7ff14c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:07.187 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.186+0000 7f47e1851700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.187 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.186+0000 7f47e1851700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.187 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.186+0000 7f47e1851700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.188 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.186+0000 7f47e1851700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.188 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.186+0000 7f47e1851700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.189 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.188+0000 7f47e4857700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.189 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.188+0000 7f47e4857700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.190 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.188+0000 7f47e4857700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.190 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.188+0000 7f47e4857700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.190 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:07.188+0000 7f47e4857700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:07.191+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff160156000 con 0x7ff160151890 2023-08-22T00:44:08.122 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:44:08.121+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:44:08.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.124+0000 7ff1477fe700 1 -- 172.21.15.98:0/4012282856 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff160156000 con 0x7ff160151890 2023-08-22T00:44:08.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 msgr2=0x7ff1600c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:08.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7ff160095880 tx=0x7ff15800b040).stop 2023-08-22T00:44:08.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 shutdown_connections 2023-08-22T00:44:08.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff14c05f050 0x7ff14c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:08.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff160150860 0x7ff1600a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:08.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff160151890 0x7ff1600c58f0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 --2- 172.21.15.98:0/4012282856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600a9f60 0x7ff1601513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:08.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 >> 172.21.15.98:0/4012282856 conn(0x7ff1600c42e0 msgr2=0x7ff1601529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:08.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 shutdown_connections 2023-08-22T00:44:08.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.127+0000 7ff1661b2700 1 -- 172.21.15.98:0/4012282856 wait complete. 2023-08-22T00:44:08.132 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:44:08.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:44:08.163 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:44:08.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 Processor -- start 2023-08-22T00:44:08.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 -- start start 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5dc153dd0 0x7fb5dc0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5dc064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc064a90 con 0x7fb5dc064600 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc158970 con 0x7fb5dc153dd0 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.271+0000 7fb5e15f5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c28b0 con 0x7fb5dc0c3230 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5db7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb5dc064600 0x7fb5dc066000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46786/0 (socket says 172.21.15.98:46786) 2023-08-22T00:44:08.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3940161733 learned_addr learned my addr 172.21.15.98:0/3940161733 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3940161733 >> v2:172.21.15.118:3300/0 conn(0x7fb5dc153dd0 0x7fb5dc0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5dc064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569156039 0 0) 0x7fb5d4001490 con 0x7fb5dc064600 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c80033f0 con 0x7fb5dc064600 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515422494 0 0) 0x7fb5c80033f0 con 0x7fb5dc064600 2023-08-22T00:44:08.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 msgr2=0x7fb5dc064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5dc064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 >> v2:172.21.15.118:3300/0 conn(0x7fb5dc153dd0 msgr2=0x7fb5dc0c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 --2- 172.21.15.98:0/3940161733 >> v2:172.21.15.118:3300/0 conn(0x7fb5dc153dd0 0x7fb5dc0c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc158690 con 0x7fb5dc064600 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fb5d4001980 con 0x7fb5dc064600 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 >> v1:172.21.15.98:6789/0 conn(0x7fb5dc064600 legacy=0x7fb5dc066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c80038e0 0x7fb5c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c8004690 0x7fb5c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc158970 con 0x7fb5c8004690 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c28b0 con 0x7fb5c80038e0 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800b8e0 con 0x7fb5dc0c3230 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c8004690 0x7fb5c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c80038e0 0x7fb5c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.272+0000 7fb5db7fe700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 -- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 msgr2=0x7fb5c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0c3230 0x7fb5c8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 -- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c80038e0 msgr2=0x7fb5c8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c80038e0 0x7fb5c8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 -- 172.21.15.98:0/3940161733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80033f0 con 0x7fb5c8004690 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c8004690 0x7fb5c8004b10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fb5c4009a80 tx=0x7fb5c4009060).ready entity=mon.0 client_cookie=a2649d0a6d7436a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4009430 con 0x7fb5c8004690 2023-08-22T00:44:08.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c400e640 con 0x7fb5c8004690 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5d9ffb700 1 -- 172.21.15.98:0/3940161733 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400e9c0 con 0x7fb5c8004690 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3940161733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c8004690 msgr2=0x7fb5c8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3940161733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c8004690 0x7fb5c8004b10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fb5c4009a80 tx=0x7fb5c4009060).stop 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3940161733 reap_dead start 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3940161733 shutdown_connections 2023-08-22T00:44:08.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3940161733 >> 172.21.15.98:0/3940161733 conn(0x7fb5dc0c7820 msgr2=0x7fb5dc0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:08.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3940161733 shutdown_connections 2023-08-22T00:44:08.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.273+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3940161733 wait complete. 2023-08-22T00:44:08.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 Processor -- start 2023-08-22T00:44:08.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 -- start start 2023-08-22T00:44:08.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 0x7fb5dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 0x7fb5dc0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0abf80 con 0x7fb5dc0c1610 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1566d0 con 0x7fb5c8004690 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.275+0000 7fb5e15f5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1569b0 con 0x7fb5dc0be8c0 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46240/0 (socket says 172.21.15.98:46240) 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3595575542 learned_addr learned my addr 172.21.15.98:0/3595575542 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 0x7fb5dc0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 0x7fb5dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 msgr2=0x7fb5dc0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 0x7fb5dc0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 msgr2=0x7fb5dc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:08.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 0x7fb5dc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 -- 172.21.15.98:0/3595575542 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0ab930 con 0x7fb5dc0c1610 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5da7fc700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 0x7fb5dc0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 0x7fb5dc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5db7fe700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fb5dc067f90 tx=0x7fb5d4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400f8a0 con 0x7fb5dc0c1610 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400fa00 con 0x7fb5dc0c1610 2023-08-22T00:44:08.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0abc10 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400fdc0 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.276+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc156180 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.277+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0ac130 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.277+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 96) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fb5d4012560 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.278+0000 7fb5d2ffd700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 0x7fb5bc0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.278+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 7162+0+0 (secure 0 0 0) 0x7fb5d4079960 con 0x7fb5dc0c1610 2023-08-22T00:44:08.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.278+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 0x7fb5bc0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:08.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.278+0000 7fb5daffd700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 0x7fb5bc0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb5cc009270 tx=0x7fb5cc008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:08.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.282+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5dc0ac130 con 0x7fb5dc0c1610 2023-08-22T00:44:08.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:08.482+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5dc064a90 con 0x7fb5dc0c1610 2023-08-22T00:44:09.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.133+0000 7fb5d2ffd700 1 -- 172.21.15.98:0/3595575542 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5dc064a90 con 0x7fb5dc0c1610 2023-08-22T00:44:09.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.135+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 msgr2=0x7fb5bc0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.135+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 0x7fb5bc0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb5cc009270 tx=0x7fb5cc008040).stop 2023-08-22T00:44:09.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.135+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 msgr2=0x7fb5dc0a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fb5dc067f90 tx=0x7fb5d4007c80).stop 2023-08-22T00:44:09.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 shutdown_connections 2023-08-22T00:44:09.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fb5bc05ecf0 0x7fb5bc0611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5dc0c1610 0x7fb5dc0a9760 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5c8004690 0x7fb5dc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 --2- 172.21.15.98:0/3595575542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5dc0be8c0 0x7fb5dc0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 >> 172.21.15.98:0/3595575542 conn(0x7fb5dc0c7820 msgr2=0x7fb5dc0652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:09.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 shutdown_connections 2023-08-22T00:44:09.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.136+0000 7fb5e15f5700 1 -- 172.21.15.98:0/3595575542 wait complete. 2023-08-22T00:44:09.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:44:09.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.273+0000 7f7ea3559700 1 Processor -- start 2023-08-22T00:44:09.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.273+0000 7f7ea3559700 1 -- start start 2023-08-22T00:44:09.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea3559700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e9c0c29d0 0x7f7e9c155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea3559700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e9c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea3559700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c063f60 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea3559700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c154c00 con 0x7f7e9c0c29d0 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea3559700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1545f0 con 0x7f7e9c0bbcd0 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea12f5700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7e9c0c25f0 0x7f7e9c0bb5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46798/0 (socket says 172.21.15.98:46798) 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea12f5700 1 -- 172.21.15.98:0/1983693624 learned_addr learned my addr 172.21.15.98:0/1983693624 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea0af4700 1 --2- 172.21.15.98:0/1983693624 >> v2:172.21.15.118:3300/0 conn(0x7f7e9c0c29d0 0x7f7e9c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018943851 0 0) 0x7f7e9c063f60 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7ea1af6700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e9c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e880033f0 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328384765 0 0) 0x7f7e880033f0 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 msgr2=0x7f7e9c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e9c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 >> v2:172.21.15.118:3300/0 conn(0x7f7e9c0c29d0 msgr2=0x7f7e9c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.274+0000 7f7e93fff700 1 --2- 172.21.15.98:0/1983693624 >> v2:172.21.15.118:3300/0 conn(0x7f7e9c0c29d0 0x7f7e9c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c151bd0 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f7e98001470 con 0x7f7e9c0c25f0 2023-08-22T00:44:09.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 >> v1:172.21.15.98:6789/0 conn(0x7f7e9c0c25f0 legacy=0x7f7e9c0bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e880038e0 0x7f7e88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e88004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e88004b80 0x7f7e88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c154c00 con 0x7f7e880038e0 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1545f0 con 0x7f7e88004b80 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800b8e0 con 0x7f7e9c0bbcd0 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e880038e0 0x7f7e88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea0af4700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e88004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea1af6700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e88004b80 0x7f7e88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 -- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 msgr2=0x7f7e88004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:09.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bbcd0 0x7f7e88004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 -- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e88004b80 msgr2=0x7f7e88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:09.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e88004b80 0x7f7e88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 -- 172.21.15.98:0/1983693624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880033f0 con 0x7f7e880038e0 2023-08-22T00:44:09.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e880038e0 0x7f7e88003d00 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f7e9800c210 tx=0x7f7e9c154b70).ready entity=mon.0 client_cookie=37027c932c7838dd server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:09.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007a60 con 0x7f7e880038e0 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9800cae0 con 0x7f7e880038e0 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.275+0000 7f7e93fff700 1 -- 172.21.15.98:0/1983693624 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9800ce60 con 0x7f7e880038e0 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 -- 172.21.15.98:0/1983693624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e880038e0 msgr2=0x7f7e88003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 --2- 172.21.15.98:0/1983693624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e880038e0 0x7f7e88003d00 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f7e9800c210 tx=0x7f7e9c154b70).stop 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea1af6700 1 -- 172.21.15.98:0/1983693624 reap_dead start 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 -- 172.21.15.98:0/1983693624 shutdown_connections 2023-08-22T00:44:09.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 -- 172.21.15.98:0/1983693624 >> 172.21.15.98:0/1983693624 conn(0x7f7e9c0c7170 msgr2=0x7f7e9c0c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:09.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 -- 172.21.15.98:0/1983693624 shutdown_connections 2023-08-22T00:44:09.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.276+0000 7f7ea3559700 1 -- 172.21.15.98:0/1983693624 wait complete. 2023-08-22T00:44:09.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.277+0000 7f7ea3559700 1 Processor -- start 2023-08-22T00:44:09.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.278+0000 7f7ea3559700 1 -- start start 2023-08-22T00:44:09.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e880038e0 0x7f7e9c14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bf0d0 0x7f7e9c0bf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c162120 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c165670 con 0x7f7e880038e0 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c14a790 con 0x7f7e9c0bf0d0 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46252/0 (socket says 172.21.15.98:46252) 2023-08-22T00:44:09.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 -- 172.21.15.98:0/735942387 learned_addr learned my addr 172.21.15.98:0/735942387 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e880038e0 0x7f7e9c14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 -- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bf0d0 msgr2=0x7f7e9c0bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea1af6700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bf0d0 0x7f7e9c0bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bf0d0 0x7f7e9c0bf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 -- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e880038e0 msgr2=0x7f7e9c14a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e880038e0 0x7f7e9c14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 -- 172.21.15.98:0/735942387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c14b340 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea0af4700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f7e8c0119a0 tx=0x7f7e8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00f940 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00faa0 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00fe20 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c1658c0 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.279+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c165e80 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.280+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0bd730 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.281+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 96) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f7e8c014650 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.281+0000 7f7e917fa700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 0x7f7e800611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.281+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 7162+0+0 (secure 0 0 0) 0x7f7e8c07aac0 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.281+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 0x7f7e800611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.281+0000 7f7ea12f5700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 0x7f7e800611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7e98000fd0 tx=0x7f7e98015000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.285+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e9c0bd730 con 0x7f7e9c14a9d0 2023-08-22T00:44:09.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:09.445+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e9c0bd730 con 0x7f7e9c14a9d0 2023-08-22T00:44:10.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.135+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7e8c078650 con 0x7f7e9c14a9d0 2023-08-22T00:44:10.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.147+0000 7f7e917fa700 1 -- 172.21.15.98:0/735942387 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7e8c070470 con 0x7f7e9c14a9d0 2023-08-22T00:44:10.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 msgr2=0x7f7e800611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 0x7f7e800611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7e98000fd0 tx=0x7f7e98015000).stop 2023-08-22T00:44:10.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 msgr2=0x7f7e9c14ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f7e8c0119a0 tx=0x7f7e8c009060).stop 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 shutdown_connections 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e8005ecf0 0x7f7e800611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e9c0bf0d0 0x7f7e9c0bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e880038e0 0x7f7e9c14a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 --2- 172.21.15.98:0/735942387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e9c14a9d0 0x7f7e9c14ae50 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.150+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 >> 172.21.15.98:0/735942387 conn(0x7f7e9c0c7170 msgr2=0x7f7e9c14b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:10.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.151+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 shutdown_connections 2023-08-22T00:44:10.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.151+0000 7f7ea3559700 1 -- 172.21.15.98:0/735942387 wait complete. 2023-08-22T00:44:10.152 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:44:10.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:44:10.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.293+0000 7fe817323700 1 Processor -- start 2023-08-22T00:44:10.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.294+0000 7fe817323700 1 -- start start 2023-08-22T00:44:10.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.294+0000 7fe817323700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe810151bf0 0x7fe810064a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:10.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.294+0000 7fe817323700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe810064f50 con 0x7fe810151100 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe817323700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8100aa190 con 0x7fe810065530 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe817323700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100bdfe0 con 0x7fe810151bf0 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe810151bf0 0x7fe810064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8150bf700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe810151100 0x7fe8101514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44622/0 (socket says 172.21.15.98:44622) 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe810151bf0 0x7fe810064a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34488/0 (socket says 172.21.15.98:34488) 2023-08-22T00:44:10.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8150bf700 1 -- 172.21.15.98:0/2529997335 learned_addr learned my addr 172.21.15.98:0/2529997335 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:10.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 -- 172.21.15.98:0/2529997335 >> v1:172.21.15.118:6789/0 conn(0x7fe810065530 legacy=0x7fe8100bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:10.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 -- 172.21.15.98:0/2529997335 >> v1:172.21.15.98:6789/0 conn(0x7fe810151100 legacy=0x7fe8101514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 -- 172.21.15.98:0/2529997335 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100645d0 con 0x7fe810151bf0 2023-08-22T00:44:10.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe807fff700 1 -- 172.21.15.98:0/2529997335 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330873928 0 0) 0x7fe80c001110 con 0x7fe810151100 2023-08-22T00:44:10.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe8148be700 1 --2- 172.21.15.98:0/2529997335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe810064a60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fe800009760 tx=0x7fe800009060).ready entity=mon.0 client_cookie=830f50243871e862 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:10.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe807fff700 1 -- 172.21.15.98:0/2529997335 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000b520 con 0x7fe810151bf0 2023-08-22T00:44:10.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe807fff700 1 -- 172.21.15.98:0/2529997335 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000b680 con 0x7fe810151bf0 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.295+0000 7fe807fff700 1 -- 172.21.15.98:0/2529997335 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000ba00 con 0x7fe810151bf0 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 -- 172.21.15.98:0/2529997335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 msgr2=0x7fe810064a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 --2- 172.21.15.98:0/2529997335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe810064a60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fe800009760 tx=0x7fe800009060).stop 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 -- 172.21.15.98:0/2529997335 shutdown_connections 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 --2- 172.21.15.98:0/2529997335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe810064a60 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 -- 172.21.15.98:0/2529997335 >> 172.21.15.98:0/2529997335 conn(0x7fe81006a910 msgr2=0x7fe810065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:10.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 -- 172.21.15.98:0/2529997335 shutdown_connections 2023-08-22T00:44:10.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.296+0000 7fe817323700 1 -- 172.21.15.98:0/2529997335 wait complete. 2023-08-22T00:44:10.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.297+0000 7fe817323700 1 Processor -- start 2023-08-22T00:44:10.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.297+0000 7fe817323700 1 -- start start 2023-08-22T00:44:10.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.298+0000 7fe817323700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe810065530 0x7fe8101475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:10.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.298+0000 7fe817323700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe810151100 0x7fe810154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:10.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.298+0000 7fe817323700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.298+0000 7fe817323700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810156490 con 0x7fe810151bf0 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.298+0000 7fe817323700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810155880 con 0x7fe810151100 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe817323700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe810155b60 con 0x7fe810065530 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34490/0 (socket says 172.21.15.98:34490) 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 -- 172.21.15.98:0/2429170337 learned_addr learned my addr 172.21.15.98:0/2429170337 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:10.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8150bf700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe810065530 0x7fe8101475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8148be700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe810151100 0x7fe810154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 -- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe810065530 msgr2=0x7fe8101475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe810065530 0x7fe8101475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 -- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe810151100 msgr2=0x7fe810154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe810151100 0x7fe810154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 -- 172.21.15.98:0/2429170337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000092a0 con 0x7fe810151bf0 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8158c0700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fe80800dd70 tx=0x7fe80800b5b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:10.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800ece0 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800ee80 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe810155e40 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808017420 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.299+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe810147ae0 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.300+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe810156640 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.300+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe808014020 con 0x7fe810151bf0 2023-08-22T00:44:10.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.301+0000 7fe8057fa700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 0x7fe7f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:10.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.301+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe80807c100 con 0x7fe810151bf0 2023-08-22T00:44:10.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.301+0000 7fe8150bf700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 0x7fe7f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:10.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.301+0000 7fe8150bf700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 0x7fe7f40613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe80c001660 tx=0x7fe80c009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:10.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.305+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe810156640 con 0x7fe810151bf0 2023-08-22T00:44:10.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:10.466+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8101565d0 con 0x7fe810151bf0 2023-08-22T00:44:11.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.150+0000 7fe8057fa700 1 -- 172.21.15.98:0/2429170337 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe80801c020 con 0x7fe810151bf0 2023-08-22T00:44:11.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.153+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 msgr2=0x7fe7f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.153+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 0x7fe7f40613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe80c001660 tx=0x7fe80c009040).stop 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.153+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 msgr2=0x7fe81014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.153+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fe80800dd70 tx=0x7fe80800b5b0).stop 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 shutdown_connections 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe7f405ef30 0x7fe7f40613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe810065530 0x7fe8101475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe810151bf0 0x7fe81014db50 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 --2- 172.21.15.98:0/2429170337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe810151100 0x7fe810154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 >> 172.21.15.98:0/2429170337 conn(0x7fe81006a910 msgr2=0x7fe810152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 shutdown_connections 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.154+0000 7fe817323700 1 -- 172.21.15.98:0/2429170337 wait complete. 2023-08-22T00:44:11.155 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:44:11.168 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:44:11.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.291+0000 7f91a14a0700 1 Processor -- start 2023-08-22T00:44:11.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.291+0000 7f91a14a0700 1 -- start start 2023-08-22T00:44:11.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f91a14a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f919c065730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f91a14a0700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c066780 con 0x7f919c0c34c0 2023-08-22T00:44:11.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f91a14a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0c3dd0 con 0x7f919c0c3940 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f91a14a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c2100 con 0x7f919c1507e0 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f919a7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f919c0c34c0 0x7f919c0c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44624/0 (socket says 172.21.15.98:44624) 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f919a7fc700 1 -- 172.21.15.98:0/3568815859 learned_addr learned my addr 172.21.15.98:0/3568815859 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f919affd700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f919c065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397487690 0 0) 0x7f919c066780 con 0x7f919c0c34c0 2023-08-22T00:44:11.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91840033f0 con 0x7f919c0c34c0 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707174061 0 0) 0x7f91840033f0 con 0x7f919c0c34c0 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 msgr2=0x7f919c065730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f919c065730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 >> v1:172.21.15.118:6789/0 conn(0x7f919c0c3940 legacy=0x7f919c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c066130 con 0x7f919c0c34c0 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f9190001470 con 0x7f919c0c34c0 2023-08-22T00:44:11.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 >> v1:172.21.15.98:6789/0 conn(0x7f919c0c34c0 legacy=0x7f919c0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f9184003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9184003e00 0x7f9184004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f9184005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c2100 con 0x7f9184004b80 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918400b8e0 con 0x7f9184003e00 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.292+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918400baa0 con 0x7f919c1507e0 2023-08-22T00:44:11.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f9184005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919affd700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f9184003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9184003e00 0x7f9184004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 -- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 msgr2=0x7f9184003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c1507e0 0x7f9184003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 -- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9184003e00 msgr2=0x7f9184004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9184003e00 0x7f9184004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 -- 172.21.15.98:0/3568815859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840033f0 con 0x7f9184004b80 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9184003e00 0x7f9184004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f9184005000 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f919c0c1a50 tx=0x7f9194007f10).ready entity=mon.0 client_cookie=4144ee24a3cacd99 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940017e0 con 0x7f9184004b80 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919400c6a0 con 0x7f9184004b80 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f9199ffb700 1 -- 172.21.15.98:0/3568815859 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400ca20 con 0x7f9184004b80 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f91a14a0700 1 -- 172.21.15.98:0/3568815859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 msgr2=0x7f9184005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3568815859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f9184005000 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f919c0c1a50 tx=0x7f9194007f10).stop 2023-08-22T00:44:11.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.293+0000 7f919b7fe700 1 -- 172.21.15.98:0/3568815859 reap_dead start 2023-08-22T00:44:11.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.294+0000 7f91a14a0700 1 -- 172.21.15.98:0/3568815859 shutdown_connections 2023-08-22T00:44:11.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.294+0000 7f91a14a0700 1 -- 172.21.15.98:0/3568815859 >> 172.21.15.98:0/3568815859 conn(0x7f919c0c7800 msgr2=0x7f919c0c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.294+0000 7f91a14a0700 1 -- 172.21.15.98:0/3568815859 shutdown_connections 2023-08-22T00:44:11.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.294+0000 7f91a14a0700 1 -- 172.21.15.98:0/3568815859 wait complete. 2023-08-22T00:44:11.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.295+0000 7f91a14a0700 1 Processor -- start 2023-08-22T00:44:11.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.295+0000 7f91a14a0700 1 -- start start 2023-08-22T00:44:11.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.295+0000 7f91a14a0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 0x7f919c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 0x7f919c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0ab540 con 0x7f9184004b80 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0aa8c0 con 0x7f919c14d6e0 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0aaba0 con 0x7f919c14ef50 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34494/0 (socket says 172.21.15.98:34494) 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 -- 172.21.15.98:0/3661893462 learned_addr learned my addr 172.21.15.98:0/3661893462 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:11.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 0x7f919c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 -- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 msgr2=0x7f919c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 0x7f919c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 0x7f919c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 -- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 msgr2=0x7f919c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 0x7f919c14ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 -- 172.21.15.98:0/3661893462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0aae80 con 0x7f9184004b80 2023-08-22T00:44:11.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 0x7f919c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919b7fe700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 0x7f919c0a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f919affd700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f918c0119c0 tx=0x7f918c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00f8e0 con 0x7f9184004b80 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c00fa40 con 0x7f9184004b80 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c0ab160 con 0x7f9184004b80 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00fdc0 con 0x7f9184004b80 2023-08-22T00:44:11.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.296+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c0bee20 con 0x7f9184004b80 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.297+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c069220 con 0x7f9184004b80 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.297+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f918c014650 con 0x7f9184004b80 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.298+0000 7f9182ffd700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 0x7f9188061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.298+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f918c07ac40 con 0x7f9184004b80 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.298+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 0x7f9188061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.298+0000 7f919a7fc700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 0x7f9188061420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9190001d00 tx=0x7f9190001db0).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.302+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f918c080020 con 0x7f9184004b80 2023-08-22T00:44:11.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.464+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f919c046c20 con 0x7f9184004b80 2023-08-22T00:44:11.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.468+0000 7f9182ffd700 1 -- 172.21.15.98:0/3661893462 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f918c04beb0 con 0x7f9184004b80 2023-08-22T00:44:11.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 msgr2=0x7f9188061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 0x7f9188061420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9190001d00 tx=0x7f9190001db0).stop 2023-08-22T00:44:11.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 msgr2=0x7f919c14d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f918c0119c0 tx=0x7f918c009060).stop 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 shutdown_connections 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f918805ef60 0x7f9188061420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f919c14ef50 0x7f919c0a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9184004b80 0x7f919c14d1f0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 --2- 172.21.15.98:0/3661893462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c14d6e0 0x7f919c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 >> 172.21.15.98:0/3661893462 conn(0x7f919c0c7800 msgr2=0x7f919c0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 shutdown_connections 2023-08-22T00:44:11.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.470+0000 7f91a14a0700 1 -- 172.21.15.98:0/3661893462 wait complete. 2023-08-22T00:44:11.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:44:11.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.599+0000 7f231211d700 1 Processor -- start 2023-08-22T00:44:11.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.599+0000 7f231211d700 1 -- start start 2023-08-22T00:44:11.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f231211d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f230c0bea40 0x7f230c0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f231211d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 0x7f230c068910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f231211d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c0c3f00 con 0x7f230c0c4390 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f231211d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0c47f0 con 0x7f230c0bea40 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f231211d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c32f0 con 0x7f230c153f10 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f230c0c4390 0x7f230c153800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44628/0 (socket says 172.21.15.98:44628) 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230affd700 1 -- 172.21.15.98:0/1276086583 learned_addr learned my addr 172.21.15.98:0/1276086583 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1276086583 >> v2:172.21.15.118:3300/0 conn(0x7f230c0bea40 0x7f230c0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230bfff700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 0x7f230c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792096238 0 0) 0x7f230c0c3f00 con 0x7f230c0c4390 2023-08-22T00:44:11.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f80033f0 con 0x7f230c0c4390 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396538799 0 0) 0x7f22f80033f0 con 0x7f230c0c4390 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230b7fe700 1 -- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 msgr2=0x7f230c068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 0x7f230c068910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230b7fe700 1 -- 172.21.15.98:0/1276086583 >> v1:172.21.15.98:6789/0 conn(0x7f230c0c4390 legacy=0x7f230c153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230b7fe700 1 -- 172.21.15.98:0/1276086583 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0c35d0 con 0x7f230c0bea40 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.600+0000 7f230bfff700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 0x7f230c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c0bee20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f22fc009e60 tx=0x7f22fc009780).ready entity=mon.1 client_cookie=66171d5b56b5be44 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00e070 con 0x7f230c0bea40 2023-08-22T00:44:11.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc00b7a0 con 0x7f230c0bea40 2023-08-22T00:44:11.604 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f230a7fc700 1 -- 172.21.15.98:0/1276086583 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4001470 con 0x7f230c0bea40 2023-08-22T00:44:11.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f231211d700 1 -- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 msgr2=0x7f230c0bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.601+0000 7f231211d700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c0bee20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f22fc009e60 tx=0x7f22fc009780).stop 2023-08-22T00:44:11.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 -- 172.21.15.98:0/1276086583 shutdown_connections 2023-08-22T00:44:11.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c153f10 0x7f230c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 --2- 172.21.15.98:0/1276086583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c0bee20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 -- 172.21.15.98:0/1276086583 >> 172.21.15.98:0/1276086583 conn(0x7f230c0c5e80 msgr2=0x7f230c0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 -- 172.21.15.98:0/1276086583 shutdown_connections 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.602+0000 7f231211d700 1 -- 172.21.15.98:0/1276086583 wait complete. 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.603+0000 7f231211d700 1 Processor -- start 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.603+0000 7f231211d700 1 -- start start 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c0c4390 0x7f230c0a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c161bd0 con 0x7f230c153f10 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c151f90 con 0x7f230c0bea40 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f231211d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c152270 con 0x7f230c0c4390 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f230bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f230bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34508/0 (socket says 172.21.15.98:34508) 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f230bfff700 1 -- 172.21.15.98:0/1283488051 learned_addr learned my addr 172.21.15.98:0/1283488051 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:11.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.604+0000 7f230affd700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c0c4390 0x7f230c0a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 -- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c0c4390 msgr2=0x7f230c0a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c0c4390 0x7f230c0a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 -- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 msgr2=0x7f230c1519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c1519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 -- 172.21.15.98:0/1283488051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040092a0 con 0x7f230c153f10 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f230bfff700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f230400e900 tx=0x7f2304009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304012600 con 0x7f230c153f10 2023-08-22T00:44:11.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304012760 con 0x7f230c153f10 2023-08-22T00:44:11.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304012b00 con 0x7f230c153f10 2023-08-22T00:44:11.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc009a20 con 0x7f230c153f10 2023-08-22T00:44:11.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.605+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c152830 con 0x7f230c153f10 2023-08-22T00:44:11.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.606+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c161d80 con 0x7f230c153f10 2023-08-22T00:44:11.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.606+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f230401b400 con 0x7f230c153f10 2023-08-22T00:44:11.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.606+0000 7f23037fe700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 0x7f22ec0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.607+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f230407a440 con 0x7f230c153f10 2023-08-22T00:44:11.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.607+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 0x7f22ec0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.607+0000 7f230b7fe700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 0x7f22ec0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f22fc009870 tx=0x7f22fc009780).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.611+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f230c161d80 con 0x7f230c153f10 2023-08-22T00:44:11.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.774+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f230c0aa9c0 con 0x7f230c153f10 2023-08-22T00:44:11.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.780+0000 7f23037fe700 1 -- 172.21.15.98:0/1283488051 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f230404b650 con 0x7f230c153f10 2023-08-22T00:44:11.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 msgr2=0x7f22ec0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 0x7f22ec0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f22fc009870 tx=0x7f22fc009780).stop 2023-08-22T00:44:11.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 msgr2=0x7f230c0aa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f230400e900 tx=0x7f2304009060).stop 2023-08-22T00:44:11.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 shutdown_connections 2023-08-22T00:44:11.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f22ec05ef00 0x7f22ec0613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f230c153f10 0x7f230c0aa0b0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0bea40 0x7f230c1519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 --2- 172.21.15.98:0/1283488051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f230c0c4390 0x7f230c0a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 >> 172.21.15.98:0/1283488051 conn(0x7f230c0c5e80 msgr2=0x7f230c0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 shutdown_connections 2023-08-22T00:44:11.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.782+0000 7f231211d700 1 -- 172.21.15.98:0/1283488051 wait complete. 2023-08-22T00:44:11.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-22T00:44:11.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.911+0000 7fa6c11cd700 1 Processor -- start 2023-08-22T00:44:11.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.911+0000 7fa6c11cd700 1 -- start start 2023-08-22T00:44:11.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.911+0000 7fa6c11cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6bc1550e0 0x7fa6bc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6c11cd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0bd750 con 0x7fa6bc066400 2023-08-22T00:44:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6c11cd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0a7030 con 0x7fa6bc153cf0 2023-08-22T00:44:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6c11cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0c2010 con 0x7fa6bc1550e0 2023-08-22T00:44:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6bb59e700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa6bc066400 0x7fa6bc0bdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44640/0 (socket says 172.21.15.98:44640) 2023-08-22T00:44:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6bb59e700 1 -- 172.21.15.98:0/3446835846 learned_addr learned my addr 172.21.15.98:0/3446835846 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3446835846 >> v2:172.21.15.118:3300/0 conn(0x7fa6bc1550e0 0x7fa6bc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388979059 0 0) 0x7fa6bc0bd750 con 0x7fa6bc066400 2023-08-22T00:44:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a40033f0 con 0x7fa6bc066400 2023-08-22T00:44:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 967100576 0 0) 0x7fa6a40033f0 con 0x7fa6bc066400 2023-08-22T00:44:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 >> v2:172.21.15.118:3300/0 conn(0x7fa6bc1550e0 msgr2=0x7fa6bc065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 --2- 172.21.15.98:0/3446835846 >> v2:172.21.15.118:3300/0 conn(0x7fa6bc1550e0 0x7fa6bc065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 >> v1:172.21.15.118:6789/0 conn(0x7fa6bc153cf0 legacy=0x7fa6bc1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0a6d50 con 0x7fa6bc066400 2023-08-22T00:44:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fa6b40017f0 con 0x7fa6bc066400 2023-08-22T00:44:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 >> v1:172.21.15.98:6789/0 conn(0x7fa6bc066400 legacy=0x7fa6bc0bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 0x7fa6a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6a4004690 0x7fa6a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a4005000 0x7fa6a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0c2010 con 0x7fa6a40038e0 2023-08-22T00:44:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a400beb0 con 0x7fa6a4005000 2023-08-22T00:44:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a400c070 con 0x7fa6a4004690 2023-08-22T00:44:11.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 0x7fa6a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.912+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6a4004690 0x7fa6a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bb59e700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a4005000 0x7fa6a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 -- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6a4004690 msgr2=0x7fa6a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6a4004690 0x7fa6a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 -- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a4005000 msgr2=0x7fa6a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:11.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a4005000 0x7fa6a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 -- 172.21.15.98:0/3446835846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a40033f0 con 0x7fa6a40038e0 2023-08-22T00:44:11.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6a4004690 0x7fa6a4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:11.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bb59e700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a4005000 0x7fa6a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bb59e700 1 -- 172.21.15.98:0/3446835846 reap_dead start 2023-08-22T00:44:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 0x7fa6a4003d00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fa6ac001730 tx=0x7fa6ac007bb0).ready entity=mon.0 client_cookie=2d74d29f6b8d3288 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007020 con 0x7fa6a40038e0 2023-08-22T00:44:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac007180 con 0x7fa6a40038e0 2023-08-22T00:44:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6b9d9b700 1 -- 172.21.15.98:0/3446835846 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007520 con 0x7fa6a40038e0 2023-08-22T00:44:11.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 msgr2=0x7fa6a4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 0x7fa6a4003d00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fa6ac001730 tx=0x7fa6ac007bb0).stop 2023-08-22T00:44:11.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3446835846 shutdown_connections 2023-08-22T00:44:11.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3446835846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6a40038e0 0x7fa6a4003d00 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3446835846 >> 172.21.15.98:0/3446835846 conn(0x7fa6bc0c7770 msgr2=0x7fa6bc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:11.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3446835846 shutdown_connections 2023-08-22T00:44:11.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.913+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3446835846 wait complete. 2023-08-22T00:44:11.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 Processor -- start 2023-08-22T00:44:11.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 -- start start 2023-08-22T00:44:11.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 0x7fa6bc0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6bc0aac10 0x7fa6bc063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc14db10 con 0x7fa6bc163a40 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0a7590 con 0x7fa6a40038e0 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.915+0000 7fa6c11cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0633f0 con 0x7fa6bc0aac10 2023-08-22T00:44:11.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34526/0 (socket says 172.21.15.98:34526) 2023-08-22T00:44:11.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 -- 172.21.15.98:0/3609882812 learned_addr learned my addr 172.21.15.98:0/3609882812 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:11.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 0x7fa6bc0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6bb59e700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6bc0aac10 0x7fa6bc063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 -- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6bc0aac10 msgr2=0x7fa6bc063ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6bc0aac10 0x7fa6bc063ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 -- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 msgr2=0x7fa6bc0a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:11.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 0x7fa6bc0a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:11.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 -- 172.21.15.98:0/3609882812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0636d0 con 0x7fa6bc163a40 2023-08-22T00:44:11.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 0x7fa6bc0a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:11.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6ba59c700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fa6b00115c0 tx=0x7fa6b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0013620 con 0x7fa6bc163a40 2023-08-22T00:44:11.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0013780 con 0x7fa6bc163a40 2023-08-22T00:44:11.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc0639b0 con 0x7fa6bc163a40 2023-08-22T00:44:11.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0013b00 con 0x7fa6bc163a40 2023-08-22T00:44:11.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.916+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc0a7870 con 0x7fa6bc163a40 2023-08-22T00:44:11.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.917+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc047480 con 0x7fa6bc163a40 2023-08-22T00:44:11.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.917+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa6b0015480 con 0x7fa6bc163a40 2023-08-22T00:44:11.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.918+0000 7fa6a2ffd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 0x7fa6a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:11.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.918+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fa6b007a660 con 0x7fa6bc163a40 2023-08-22T00:44:11.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.918+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 0x7fa6a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:11.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.918+0000 7fa6bad9d700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 0x7fa6a80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa6ac001010 tx=0x7fa6ac015000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:11.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:11.922+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6b004b870 con 0x7fa6bc163a40 2023-08-22T00:44:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:12.153+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fa6bc0bd100 con 0x7fa6bc163a40 2023-08-22T00:44:13.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.154+0000 7fa6a2ffd700 1 -- 172.21.15.98:0/3609882812 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1334) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa6b004ee90 con 0x7fa6bc163a40 2023-08-22T00:44:13.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 msgr2=0x7fa6a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 0x7fa6a80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa6ac001010 tx=0x7fa6ac015000).stop 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 msgr2=0x7fa6bc0aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fa6b00115c0 tx=0x7fa6b0008040).stop 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 shutdown_connections 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa6a805ef30 0x7fa6a80613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6bc0aac10 0x7fa6bc063ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6a40038e0 0x7fa6bc0a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 --2- 172.21.15.98:0/3609882812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc163a40 0x7fa6bc0aa720 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 >> 172.21.15.98:0/3609882812 conn(0x7fa6bc0c7770 msgr2=0x7fa6bc0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:13.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 shutdown_connections 2023-08-22T00:44:13.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.157+0000 7fa6c11cd700 1 -- 172.21.15.98:0/3609882812 wait complete. 2023-08-22T00:44:13.172 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-08-22T00:44:13.173 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-08-22T00:44:13.174 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-08-22T00:44:13.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-22T00:44:13.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.298+0000 7fed3610e700 1 Processor -- start 2023-08-22T00:44:13.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.298+0000 7fed3610e700 1 -- start start 2023-08-22T00:44:13.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed3610e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed30153f40 0x7fed30157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed3610e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed300a8410 con 0x7fed300a9140 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed3610e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed300a8cb0 con 0x7fed30153b60 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed3610e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed301586a0 con 0x7fed30153f40 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed2ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fed300a9140 0x7fed30157e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44644/0 (socket says 172.21.15.98:44644) 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed2ffff700 1 -- 172.21.15.98:0/1303755548 learned_addr learned my addr 172.21.15.98:0/1303755548 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed2effd700 1 --2- 172.21.15.98:0/1303755548 >> v2:172.21.15.118:3300/0 conn(0x7fed30153f40 0x7fed30157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360071143 0 0) 0x7fed300a8410 con 0x7fed300a9140 2023-08-22T00:44:13.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.299+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c0033f0 con 0x7fed300a9140 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193626159 0 0) 0x7fed1c0033f0 con 0x7fed300a9140 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 >> v2:172.21.15.118:3300/0 conn(0x7fed30153f40 msgr2=0x7fed30157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 --2- 172.21.15.98:0/1303755548 >> v2:172.21.15.118:3300/0 conn(0x7fed30153f40 0x7fed30157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 >> v1:172.21.15.118:6789/0 conn(0x7fed30153b60 legacy=0x7fed30068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300a8660 con 0x7fed300a9140 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fed280017f0 con 0x7fed300a9140 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 >> v1:172.21.15.98:6789/0 conn(0x7fed300a9140 legacy=0x7fed30157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0038e0 0x7fed1c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 0x7fed1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c005000 0x7fed1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301586a0 con 0x7fed1c004690 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c00beb0 con 0x7fed1c005000 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c00c070 con 0x7fed1c0038e0 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 0x7fed1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2ffff700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c005000 0x7fed1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2f7fe700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0038e0 0x7fed1c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 -- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0038e0 msgr2=0x7fed1c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0038e0 0x7fed1c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 -- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c005000 msgr2=0x7fed1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c005000 0x7fed1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2ffff700 1 -- 172.21.15.98:0/1303755548 reap_dead start 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 -- 172.21.15.98:0/1303755548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c0033f0 con 0x7fed1c004690 2023-08-22T00:44:13.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2effd700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 0x7fed1c004b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7fed20009a80 tx=0x7fed20009060).ready entity=mon.0 client_cookie=94be5e75e960143a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20009430 con 0x7fed1c004690 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.300+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000e640 con 0x7fed1c004690 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed2e7fc700 1 -- 172.21.15.98:0/1303755548 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e9c0 con 0x7fed1c004690 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 -- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 msgr2=0x7fed1c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 0x7fed1c004b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7fed20009a80 tx=0x7fed20009060).stop 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 -- 172.21.15.98:0/1303755548 shutdown_connections 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 --2- 172.21.15.98:0/1303755548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c004690 0x7fed1c004b10 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 -- 172.21.15.98:0/1303755548 >> 172.21.15.98:0/1303755548 conn(0x7fed300c5dc0 msgr2=0x7fed30068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:13.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 -- 172.21.15.98:0/1303755548 shutdown_connections 2023-08-22T00:44:13.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.301+0000 7fed3610e700 1 -- 172.21.15.98:0/1303755548 wait complete. 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.303+0000 7fed3610e700 1 Processor -- start 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.303+0000 7fed3610e700 1 -- start start 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c004690 0x7fed3014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed301543d0 0x7fed30154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300c0c00 con 0x7fed300be870 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300c0940 con 0x7fed1c004690 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300bf1e0 con 0x7fed301543d0 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34540/0 (socket says 172.21.15.98:34540) 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 -- 172.21.15.98:0/808463546 learned_addr learned my addr 172.21.15.98:0/808463546 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2f7fe700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c004690 0x7fed3014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 -- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed301543d0 msgr2=0x7fed30154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed301543d0 0x7fed30154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 -- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c004690 msgr2=0x7fed3014b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c004690 0x7fed3014b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 -- 172.21.15.98:0/808463546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed301559e0 con 0x7fed300be870 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed2effd700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fed20003030 tx=0x7fed2001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000ed70 con 0x7fed300be870 2023-08-22T00:44:13.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000eed0 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3014b980 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000ea00 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.304+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed30155420 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.305+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed300c0d70 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.306+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fed2002e440 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.306+0000 7fed277fe700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 0x7fed100613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.306+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fed2007b930 con 0x7fed300be870 2023-08-22T00:44:13.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.306+0000 7fed2f7fe700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 0x7fed100613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:13.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.307+0000 7fed2f7fe700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 0x7fed100613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed18000c00 tx=0x7fed18009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:13.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.310+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed300c0d70 con 0x7fed300be870 2023-08-22T00:44:13.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:13.535+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fed30151e00 con 0x7fed300be870 2023-08-22T00:44:14.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.156+0000 7fed277fe700 1 -- 172.21.15.98:0/808463546 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1335) v1 ==== 158+0+0 (secure 0 0 0) 0x7fed200160e0 con 0x7fed300be870 2023-08-22T00:44:14.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 msgr2=0x7fed100613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 0x7fed100613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed18000c00 tx=0x7fed18009040).stop 2023-08-22T00:44:14.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 msgr2=0x7fed300becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fed20003030 tx=0x7fed2001a000).stop 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 shutdown_connections 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fed1005ef30 0x7fed100613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed301543d0 0x7fed30154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed1c004690 0x7fed3014b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 --2- 172.21.15.98:0/808463546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed300be870 0x7fed300becf0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 >> 172.21.15.98:0/808463546 conn(0x7fed300c5dc0 msgr2=0x7fed301516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 shutdown_connections 2023-08-22T00:44:14.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.159+0000 7fed3610e700 1 -- 172.21.15.98:0/808463546 wait complete. 2023-08-22T00:44:14.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-22T00:44:14.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.299+0000 7f39ab137700 1 Processor -- start 2023-08-22T00:44:14.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.299+0000 7f39ab137700 1 -- start start 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39ab137700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39a414e720 0x7f39a4155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39ab137700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39a4067d00 0x7f39a40c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39ab137700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a40654a0 con 0x7f39a40641b0 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39ab137700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a4064660 con 0x7f39a4067d00 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39ab137700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a4064920 con 0x7f39a414e720 2023-08-22T00:44:14.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39a96d4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39a4067d00 0x7f39a40c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39a3fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f39a40641b0 0x7f39a40675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44648/0 (socket says 172.21.15.98:44648) 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39a96d4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f39a4067d00 0x7f39a40c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34548/0 (socket says 172.21.15.98:34548) 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39a3fff700 1 -- 172.21.15.98:0/4223523410 learned_addr learned my addr 172.21.15.98:0/4223523410 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.300+0000 7f39a8ed3700 1 --2- 172.21.15.98:0/4223523410 >> v2:172.21.15.118:3300/0 conn(0x7f39a414e720 0x7f39a4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a96d4700 1 -- 172.21.15.98:0/4223523410 >> v2:172.21.15.118:3300/0 conn(0x7f39a414e720 msgr2=0x7f39a4155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a96d4700 1 --2- 172.21.15.98:0/4223523410 >> v2:172.21.15.118:3300/0 conn(0x7f39a414e720 0x7f39a4155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a96d4700 1 -- 172.21.15.98:0/4223523410 >> v1:172.21.15.98:6789/0 conn(0x7f39a40641b0 legacy=0x7f39a40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a96d4700 1 -- 172.21.15.98:0/4223523410 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4064c00 con 0x7f39a4067d00 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a37fe700 1 -- 172.21.15.98:0/4223523410 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397310618 0 0) 0x7f39a40654a0 con 0x7f39a40641b0 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a96d4700 1 --2- 172.21.15.98:0/4223523410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40c3b70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f39a4069bc0 tx=0x7f399c009780).ready entity=mon.0 client_cookie=81081a8e71f0a6f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a37fe700 1 -- 172.21.15.98:0/4223523410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00e070 con 0x7f39a4067d00 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a37fe700 1 -- 172.21.15.98:0/4223523410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00bc30 con 0x7f39a4067d00 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39a37fe700 1 -- 172.21.15.98:0/4223523410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c012410 con 0x7f39a4067d00 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 -- 172.21.15.98:0/4223523410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 msgr2=0x7f39a40c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 --2- 172.21.15.98:0/4223523410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40c3b70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f39a4069bc0 tx=0x7f399c009780).stop 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 -- 172.21.15.98:0/4223523410 shutdown_connections 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 --2- 172.21.15.98:0/4223523410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40c3b70 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 --2- 172.21.15.98:0/4223523410 >> v2:172.21.15.118:3300/0 conn(0x7f39a414e720 0x7f39a4155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 -- 172.21.15.98:0/4223523410 >> 172.21.15.98:0/4223523410 conn(0x7f39a40c8950 msgr2=0x7f39a40c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.301+0000 7f39ab137700 1 -- 172.21.15.98:0/4223523410 shutdown_connections 2023-08-22T00:44:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.302+0000 7f39ab137700 1 -- 172.21.15.98:0/4223523410 wait complete. 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.303+0000 7f39ab137700 1 Processor -- start 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.303+0000 7f39ab137700 1 -- start start 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.303+0000 7f39ab137700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a40641b0 0x7f39a41416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.303+0000 7f39ab137700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a414e720 0x7f39a40ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4141be0 con 0x7f39a4067d00 2023-08-22T00:44:14.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40ac8d0 con 0x7f39a40641b0 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40abcc0 con 0x7f39a414e720 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34562/0 (socket says 172.21.15.98:34562) 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 -- 172.21.15.98:0/3698134715 learned_addr learned my addr 172.21.15.98:0/3698134715 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a8ed3700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a40641b0 0x7f39a41416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a96d4700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a414e720 0x7f39a40ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 -- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a414e720 msgr2=0x7f39a40ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a414e720 0x7f39a40ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 -- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a40641b0 msgr2=0x7f39a41416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a40641b0 0x7f39a41416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 -- 172.21.15.98:0/3698134715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c009a20 con 0x7f39a4067d00 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a3fff700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f3990001eb0 tx=0x7f3990007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900072e0 con 0x7f39a4067d00 2023-08-22T00:44:14.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3990007440 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40abfa0 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900057a0 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.304+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a40ac560 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.305+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a40aca80 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.306+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3990005b90 con 0x7f39a4067d00 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.306+0000 7f39a0ff9700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 0x7f39880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.306+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f39900798e0 con 0x7f39a4067d00 2023-08-22T00:44:14.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.306+0000 7f39a8ed3700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 0x7f39880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.306+0000 7f39a8ed3700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 0x7f39880613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3998006fd0 tx=0x7f3998008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.310+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39a40aca80 con 0x7f39a4067d00 2023-08-22T00:44:14.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.472+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f39a40aca40 con 0x7f39a4067d00 2023-08-22T00:44:14.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.476+0000 7f39a0ff9700 1 -- 172.21.15.98:0/3698134715 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3990018070 con 0x7f39a4067d00 2023-08-22T00:44:14.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 msgr2=0x7f39880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 0x7f39880613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3998006fd0 tx=0x7f3998008040).stop 2023-08-22T00:44:14.478 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 msgr2=0x7f39a40adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f3990001eb0 tx=0x7f3990007e90).stop 2023-08-22T00:44:14.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 shutdown_connections 2023-08-22T00:44:14.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f398805ef30 0x7f39880613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a414e720 0x7f39a40ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a40641b0 0x7f39a41416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 --2- 172.21.15.98:0/3698134715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39a4067d00 0x7f39a40adb30 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 >> 172.21.15.98:0/3698134715 conn(0x7f39a40c8950 msgr2=0x7f39a40c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:14.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 shutdown_connections 2023-08-22T00:44:14.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.478+0000 7f39ab137700 1 -- 172.21.15.98:0/3698134715 wait complete. 2023-08-22T00:44:14.490 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:44:14.490 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:14.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:14.577 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:44:14.577 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-22T00:44:14.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:14.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.693+0000 7f54cd82f700 1 Processor -- start 2023-08-22T00:44:14.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.693+0000 7f54cd82f700 1 -- start start 2023-08-22T00:44:14.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54cd82f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54c814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54cd82f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f54c80c5a90 0x7f54c80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54cd82f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c8155260 con 0x7f54c81544f0 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54cd82f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80c17b0 con 0x7f54c80c5a90 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54cd82f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80bf9e0 con 0x7f54c814e0d0 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54c77fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f54c81544f0 0x7f54c8154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44654/0 (socket says 172.21.15.98:44654) 2023-08-22T00:44:14.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.694+0000 7f54c77fe700 1 -- 172.21.15.98:0/1031569612 learned_addr learned my addr 172.21.15.98:0/1031569612 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c67fc700 1 --2- 172.21.15.98:0/1031569612 >> v2:172.21.15.118:3300/0 conn(0x7f54c80c5a90 0x7f54c80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c6ffd700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54c814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730715351 0 0) 0x7f54c8155260 con 0x7f54c81544f0 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b00033f0 con 0x7f54c81544f0 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930151461 0 0) 0x7f54b00033f0 con 0x7f54c81544f0 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 msgr2=0x7f54c814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:14.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54c814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 >> v2:172.21.15.118:3300/0 conn(0x7f54c80c5a90 msgr2=0x7f54c80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 --2- 172.21.15.98:0/1031569612 >> v2:172.21.15.118:3300/0 conn(0x7f54c80c5a90 0x7f54c80c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80bfcc0 con 0x7f54c81544f0 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f54c00017f0 con 0x7f54c81544f0 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 >> v1:172.21.15.98:6789/0 conn(0x7f54c81544f0 legacy=0x7f54c8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54b00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54b0003e10 0x7f54b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c17b0 con 0x7f54b0004b80 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80bf9e0 con 0x7f54b0003e10 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b000b8e0 con 0x7f54c814e0d0 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c67fc700 1 --2- 172.21.15.98:0/1031569612 >> v2:172.21.15.118:3300/0 conn(0x7f54c80c5a90 0x7f54c80c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c6ffd700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54b00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c67fc700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54b0003e10 0x7f54b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 -- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 msgr2=0x7f54b00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c814e0d0 0x7f54b00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 -- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54b0003e10 msgr2=0x7f54b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54b0003e10 0x7f54b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.695+0000 7f54c77fe700 1 -- 172.21.15.98:0/1031569612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00033f0 con 0x7f54b0004b80 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54c77fe700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54b0005000 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f54c000c560 tx=0x7f54c0001d90).ready entity=mon.0 client_cookie=cb732e3a3ff66bf1 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000ce50 con 0x7f54b0004b80 2023-08-22T00:44:14.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0005b20 con 0x7f54b0004b80 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54c5ffb700 1 -- 172.21.15.98:0/1031569612 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00070d0 con 0x7f54b0004b80 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 -- 172.21.15.98:0/1031569612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 msgr2=0x7f54b0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 --2- 172.21.15.98:0/1031569612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54b0005000 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f54c000c560 tx=0x7f54c0001d90).stop 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54c77fe700 1 -- 172.21.15.98:0/1031569612 reap_dead start 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 -- 172.21.15.98:0/1031569612 shutdown_connections 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 -- 172.21.15.98:0/1031569612 >> 172.21.15.98:0/1031569612 conn(0x7f54c80caa80 msgr2=0x7f54c80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 -- 172.21.15.98:0/1031569612 shutdown_connections 2023-08-22T00:44:14.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.696+0000 7f54cd82f700 1 -- 172.21.15.98:0/1031569612 wait complete. 2023-08-22T00:44:14.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 Processor -- start 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 -- start start 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c80b00a0 0x7f54c80c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c80b0520 0x7f54c80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c4110 con 0x7f54b0004b80 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c1cc0 con 0x7f54c80b00a0 2023-08-22T00:44:14.705 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.698+0000 7f54cd82f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c1fa0 con 0x7f54c80b0520 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34578/0 (socket says 172.21.15.98:34578) 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 -- 172.21.15.98:0/3142608041 learned_addr learned my addr 172.21.15.98:0/3142608041 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c67fc700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c80b00a0 0x7f54c80c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c77fe700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c80b0520 0x7f54c80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 -- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c80b0520 msgr2=0x7f54c80c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.706 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c80b0520 0x7f54c80c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 -- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c80b00a0 msgr2=0x7f54c80c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c80b00a0 0x7f54c80c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 -- 172.21.15.98:0/3142608041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80c2280 con 0x7f54b0004b80 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54c6ffd700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f54b80119c0 tx=0x7f54b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800f8e0 con 0x7f54b0004b80 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800fa40 con 0x7f54b0004b80 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c80c2560 con 0x7f54b0004b80 2023-08-22T00:44:14.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800fdc0 con 0x7f54b0004b80 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.699+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c8147180 con 0x7f54b0004b80 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.700+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c8047480 con 0x7f54b0004b80 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.701+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f54b8014650 con 0x7f54b0004b80 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.701+0000 7f54aeffd700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 0x7f54b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.701+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f54b807ac40 con 0x7f54b0004b80 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.701+0000 7f54c67fc700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 0x7f54b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:14.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.701+0000 7f54c67fc700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 0x7f54b40613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54c80ac510 tx=0x7f54bc008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:14.709 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.705+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54b8080020 con 0x7f54b0004b80 2023-08-22T00:44:14.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.906+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54c80ca740 con 0x7f54b0004b80 2023-08-22T00:44:14.908 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.907+0000 7f54aeffd700 1 -- 172.21.15.98:0/3142608041 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f54b804beb0 con 0x7f54b0004b80 2023-08-22T00:44:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:14.909 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/435139561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":435139561},{"type":"v1","addr":"172.21.15.118:6835","nonce":435139561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2185996125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2185996125},{"type":"v1","addr":"172.21.15.98:6836","nonce":2185996125}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8791,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4097792561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4097792561},{"type":"v1","addr":"172.21.15.118:6834","nonce":4097792561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":9354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1101470581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1101470581},{"type":"v1","addr":"172.21.15.98:6837","nonce":1101470581}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-08-22T00:44:14.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 msgr2=0x7f54b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 0x7f54b40613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54c80ac510 tx=0x7f54bc008040).stop 2023-08-22T00:44:14.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 msgr2=0x7f54c8146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f54b80119c0 tx=0x7f54b8009060).stop 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 shutdown_connections 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f54b405ef30 0x7f54b40613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54c80b0520 0x7f54c80c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b0004b80 0x7f54c8146c90 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 --2- 172.21.15.98:0/3142608041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54c80b00a0 0x7f54c80c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:14.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 >> 172.21.15.98:0/3142608041 conn(0x7f54c80caa80 msgr2=0x7f54c8064560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:14.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 shutdown_connections 2023-08-22T00:44:14.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:14.909+0000 7f54cd82f700 1 -- 172.21.15.98:0/3142608041 wait complete. 2023-08-22T00:44:14.912 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 71 2023-08-22T00:44:14.921 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-22T00:44:14.921 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-22T00:44:14.922 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:44:14.922 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:44:14.922 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-22T00:44:14.922 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-22T00:44:14.923 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:44:14.923 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:44:14.923 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-22T00:44:14.924 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-22T00:44:14.924 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:44:14.925 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:44:14.925 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-22T00:44:14.925 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-22T00:44:14.926 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:44:14.926 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:44:14.930 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:44:14.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-22T00:44:14.931 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:44:14.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-22T00:44:14.937 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:44:14.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-22T00:44:14.938 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:44:14.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-22T00:44:14.972 INFO:tasks.ceph.mds.a:Started 2023-08-22T00:44:14.973 DEBUG:teuthology.parallel:result is None 2023-08-22T00:44:14.974 INFO:tasks.ceph.mds.c:Started 2023-08-22T00:44:14.975 DEBUG:teuthology.parallel:result is None 2023-08-22T00:44:14.980 INFO:tasks.ceph.mds.b:Started 2023-08-22T00:44:14.981 DEBUG:teuthology.parallel:result is None 2023-08-22T00:44:14.982 INFO:tasks.ceph.mds.d:Started 2023-08-22T00:44:14.982 DEBUG:teuthology.parallel:result is None 2023-08-22T00:44:14.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-22T00:44:15.048 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2023-08-22T00:44:15.048 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:44:15.062 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-08-22T00:44:15.062 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-08-22T00:44:15.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.107+0000 7f9bbf961700 1 Processor -- start 2023-08-22T00:44:15.108 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.107+0000 7f9bbf961700 1 -- start start 2023-08-22T00:44:15.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbf961700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9bb80bcf90 0x7f9bb80a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbf961700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80bbef0 con 0x7f9bb80645b0 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbf961700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80bc1d0 con 0x7f9bb8151890 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbf961700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80bc4b0 con 0x7f9bb80bcf90 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbdefe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9bb80bcf90 0x7f9bb80a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbdefe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9bb80bcf90 0x7f9bb80a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34624/0 (socket says 172.21.15.98:34624) 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbcefc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9bb80645b0 0x7f9bb80a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44682/0 (socket says 172.21.15.98:44682) 2023-08-22T00:44:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.108+0000 7f9bbdefe700 1 -- 172.21.15.98:0/2216777552 learned_addr learned my addr 172.21.15.98:0/2216777552 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbdefe700 1 -- 172.21.15.98:0/2216777552 >> v1:172.21.15.118:6789/0 conn(0x7f9bb8151890 legacy=0x7f9bb8063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbdefe700 1 -- 172.21.15.98:0/2216777552 >> v1:172.21.15.98:6789/0 conn(0x7f9bb80645b0 legacy=0x7f9bb80a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9baffff700 1 -- 172.21.15.98:0/2216777552 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795667 0 0) 0x7f9bb80bbef0 con 0x7f9bb80645b0 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbdefe700 1 -- 172.21.15.98:0/2216777552 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80bc790 con 0x7f9bb80bcf90 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbdefe700 1 --2- 172.21.15.98:0/2216777552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb80a54c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f9bb4006fd0 tx=0x7f9bb40090f0).ready entity=mon.0 client_cookie=247ac0cedc260fe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9baffff700 1 -- 172.21.15.98:0/2216777552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400b600 con 0x7f9bb80bcf90 2023-08-22T00:44:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9baffff700 1 -- 172.21.15.98:0/2216777552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400b760 con 0x7f9bb80bcf90 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9baffff700 1 -- 172.21.15.98:0/2216777552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400bae0 con 0x7f9bb80bcf90 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbf961700 1 -- 172.21.15.98:0/2216777552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 msgr2=0x7f9bb80a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.109+0000 7f9bbf961700 1 --2- 172.21.15.98:0/2216777552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb80a54c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f9bb4006fd0 tx=0x7f9bb40090f0).stop 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.110+0000 7f9bbf961700 1 -- 172.21.15.98:0/2216777552 shutdown_connections 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.110+0000 7f9bbf961700 1 --2- 172.21.15.98:0/2216777552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb80a54c0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.110+0000 7f9bbf961700 1 -- 172.21.15.98:0/2216777552 >> 172.21.15.98:0/2216777552 conn(0x7f9bb8069680 msgr2=0x7f9bb8069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.110+0000 7f9bbf961700 1 -- 172.21.15.98:0/2216777552 shutdown_connections 2023-08-22T00:44:15.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.110+0000 7f9bbf961700 1 -- 172.21.15.98:0/2216777552 wait complete. 2023-08-22T00:44:15.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.111+0000 7f9bbf961700 1 Processor -- start 2023-08-22T00:44:15.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.111+0000 7f9bbf961700 1 -- start start 2023-08-22T00:44:15.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb80645b0 0x7f9bb80a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:15.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:15.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 0x7f9bb8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:15.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8162620 con 0x7f9bb80bcf90 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80a6ed0 con 0x7f9bb8151890 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80a71b0 con 0x7f9bb80645b0 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34636/0 (socket says 172.21.15.98:34636) 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 -- 172.21.15.98:0/3989216741 learned_addr learned my addr 172.21.15.98:0/3989216741 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbd6fd700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb80645b0 0x7f9bb80a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:15.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbdefe700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 0x7f9bb8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 -- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb80645b0 msgr2=0x7f9bb80a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb80645b0 0x7f9bb80a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 -- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 msgr2=0x7f9bb8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 0x7f9bb8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 -- 172.21.15.98:0/3989216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009370 con 0x7f9bb80bcf90 2023-08-22T00:44:15.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbdefe700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 0x7f9bb8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbcefc700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f9ba800c420 tx=0x7f9ba8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800ce80 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80072e0 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80a7490 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80056e0 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.112+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb80a9070 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.113+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8068320 con 0x7f9bb80bcf90 2023-08-22T00:44:15.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.114+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9ba8005a90 con 0x7f9bb80bcf90 2023-08-22T00:44:15.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.114+0000 7f9bad7fa700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 0x7f9b9c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:15.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.114+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f9ba8079690 con 0x7f9bb80bcf90 2023-08-22T00:44:15.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.114+0000 7f9bbd6fd700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 0x7f9b9c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:15.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.115+0000 7f9bbd6fd700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 0x7f9b9c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9bb0002c70 tx=0x7f9bb00014c0).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:15.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.118+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ba804a900 con 0x7f9bb80bcf90 2023-08-22T00:44:15.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:15.296+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9bb80bca70 con 0x7f9bb80bcf90 2023-08-22T00:44:16.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.162+0000 7f9bad7fa700 1 -- 172.21.15.98:0/3989216741 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v199) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ba804df20 con 0x7f9bb80bcf90 2023-08-22T00:44:16.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 msgr2=0x7f9b9c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 0x7f9b9c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9bb0002c70 tx=0x7f9bb00014c0).stop 2023-08-22T00:44:16.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 msgr2=0x7f9bb81636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f9ba800c420 tx=0x7f9ba8007bb0).stop 2023-08-22T00:44:16.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 shutdown_connections 2023-08-22T00:44:16.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9b9c05ef30 0x7f9b9c0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb80645b0 0x7f9bb80a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb8151890 0x7f9bb8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 --2- 172.21.15.98:0/3989216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb80bcf90 0x7f9bb81636a0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 >> 172.21.15.98:0/3989216741 conn(0x7f9bb8069680 msgr2=0x7f9bb80c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:16.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 shutdown_connections 2023-08-22T00:44:16.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.165+0000 7f9bbf961700 1 -- 172.21.15.98:0/3989216741 wait complete. 2023-08-22T00:44:16.169 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2023-08-22T00:44:16.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-22T00:44:16.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.301+0000 7ff1d1b08700 1 Processor -- start 2023-08-22T00:44:16.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.301+0000 7ff1d1b08700 1 -- start start 2023-08-22T00:44:16.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1cc151cd0 0x7ff1cc0a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc063ce0 0x7ff1cc1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 0x7ff1cc155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc1562b0 con 0x7ff1cc151cd0 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc064930 con 0x7ff1cc064160 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1d1b08700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0a4c00 con 0x7ff1cc063ce0 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1cb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1cc151cd0 0x7ff1cc0a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.302+0000 7ff1cb7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff1cc151cd0 0x7ff1cc0a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34650/0 (socket says 172.21.15.98:34650) 2023-08-22T00:44:16.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 -- 172.21.15.98:0/1336178898 learned_addr learned my addr 172.21.15.98:0/1336178898 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cbfff700 1 --2- 172.21.15.98:0/1336178898 >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 0x7ff1cc155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1caffd700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc063ce0 0x7ff1cc1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 -- 172.21.15.98:0/1336178898 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc063ce0 msgr2=0x7ff1cc1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc063ce0 0x7ff1cc1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 -- 172.21.15.98:0/1336178898 >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 msgr2=0x7ff1cc155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/1336178898 >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 0x7ff1cc155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 -- 172.21.15.98:0/1336178898 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc064650 con 0x7ff1cc151cd0 2023-08-22T00:44:16.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cbfff700 1 --2- 172.21.15.98:0/1336178898 >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 0x7ff1cc155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc151cd0 0x7ff1cc0a4710 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7ff1cc069ef0 tx=0x7ff1c00090f0).ready entity=mon.0 client_cookie=75f9ab28dcc5850 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1ca7fc700 1 -- 172.21.15.98:0/1336178898 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000b600 con 0x7ff1cc151cd0 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1ca7fc700 1 -- 172.21.15.98:0/1336178898 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000b760 con 0x7ff1cc151cd0 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.303+0000 7ff1ca7fc700 1 -- 172.21.15.98:0/1336178898 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000bae0 con 0x7ff1cc151cd0 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 -- 172.21.15.98:0/1336178898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc151cd0 msgr2=0x7ff1cc0a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc151cd0 0x7ff1cc0a4710 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7ff1cc069ef0 tx=0x7ff1c00090f0).stop 2023-08-22T00:44:16.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 -- 172.21.15.98:0/1336178898 shutdown_connections 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/1336178898 >> v2:172.21.15.118:3300/0 conn(0x7ff1cc064160 0x7ff1cc155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc151cd0 0x7ff1cc0a4710 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/1336178898 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc063ce0 0x7ff1cc1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 -- 172.21.15.98:0/1336178898 >> 172.21.15.98:0/1336178898 conn(0x7ff1cc0c7770 msgr2=0x7ff1cc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 -- 172.21.15.98:0/1336178898 shutdown_connections 2023-08-22T00:44:16.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.304+0000 7ff1d1b08700 1 -- 172.21.15.98:0/1336178898 wait complete. 2023-08-22T00:44:16.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.305+0000 7ff1d1b08700 1 Processor -- start 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.305+0000 7ff1d1b08700 1 -- start start 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1cc063ce0 0x7ff1cc0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc151cd0 0x7ff1cc164930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc139b50 con 0x7ff1cc064160 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c2260 con 0x7ff1cc063ce0 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c24e0 con 0x7ff1cc151cd0 2023-08-22T00:44:16.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34658/0 (socket says 172.21.15.98:34658) 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 -- 172.21.15.98:0/429201468 learned_addr learned my addr 172.21.15.98:0/429201468 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1cbfff700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc151cd0 0x7ff1cc164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1cc063ce0 0x7ff1cc0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 -- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc151cd0 msgr2=0x7ff1cc164930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc151cd0 0x7ff1cc164930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 -- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1cc063ce0 msgr2=0x7ff1cc0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1cc063ce0 0x7ff1cc0c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 -- 172.21.15.98:0/429201468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0009370 con 0x7ff1cc064160 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1caffd700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7ff1bc00d860 tx=0x7ff1bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011590 con 0x7ff1cc064160 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0116f0 con 0x7ff1cc064160 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0c27c0 con 0x7ff1cc064160 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011a70 con 0x7ff1cc064160 2023-08-22T00:44:16.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.306+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0c2d80 con 0x7ff1cc064160 2023-08-22T00:44:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.307+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc047480 con 0x7ff1cc064160 2023-08-22T00:44:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.308+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff1bc012420 con 0x7ff1cc064160 2023-08-22T00:44:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.308+0000 7ff1b37fe700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 0x7ff1b80613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.308+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7ff1bc079850 con 0x7ff1cc064160 2023-08-22T00:44:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.308+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 0x7ff1b80613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.308+0000 7ff1cb7fe700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 0x7ff1b80613c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff1cc095070 tx=0x7ff1c0017000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.312+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1bc04acb0 con 0x7ff1cc064160 2023-08-22T00:44:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.535+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff1cc066040 con 0x7ff1cc064160 2023-08-22T00:44:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.536+0000 7ff1b37fe700 1 -- 172.21.15.98:0/429201468 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff1bc011e60 con 0x7ff1cc064160 2023-08-22T00:44:16.537 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:16.537 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:44:16.537 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2023-08-22T00:44:16.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.538 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2023-08-22T00:44:16.538 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nkx1N1HBAAtuFi418KgMeHiZtKoh48GQ==", 2023-08-22T00:44:16.539 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.539 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.539 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:44:16.539 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:44:16.539 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkwB8WKRAAzqbMD64FYyVAs16pOwJoRg==", 2023-08-22T00:44:16.540 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nk/sl7IxAAfRpq4GnLEuta9M22usMI4Q==", 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.542 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkCVSxMBAAvL0YblvD7Vh1gC5k8iNwiw==", 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.543 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:44:16.544 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:44:16.544 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.545 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2023-08-22T00:44:16.545 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDD++NkUoZmExAA9BrcbatZJWer/ygZz7DSdw==", 2023-08-22T00:44:16.545 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.545 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.546 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.546 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.547 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2023-08-22T00:44:16.547 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDG++NkihOyERAAdDuuFrk7TuLLS4hCtpETPQ==", 2023-08-22T00:44:16.547 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.548 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.548 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.548 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.548 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.549 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2023-08-22T00:44:16.550 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDJ++NkOsG/DxAA8qCJ7coWtdELmC2/LyLgKA==", 2023-08-22T00:44:16.550 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.550 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.551 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.551 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.552 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2023-08-22T00:44:16.552 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDM++Nk1CxFDhAA/hKXN1MfLE03kySgeUtxdA==", 2023-08-22T00:44:16.552 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.553 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQ++NkOmbqGhAAcfooexPXQbITVhX5nlsflw==", 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.555 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2023-08-22T00:44:16.555 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDT++NkbReNGBAA8e79VLKEPIQDTmeMl00E+g==", 2023-08-22T00:44:16.555 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.556 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.556 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.556 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDW++NkujT2FhAAuP6D0cBuDEL9Aw1Bbf1UEQ==", 2023-08-22T00:44:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.558 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZ++NkbRhVFBAA3vVZDhIg09keugkul8qnJA==", 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkGT4LNRAAl/tWy/eaiVTkffTDITLrZA==", 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow r", 2023-08-22T00:44:16.560 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++NkYgSyAhAAz608wpMZbmVxBy+b82RuzQ==", 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkX9uROhAAPwdP/nIJiJYJPOEpaiPdsQ==", 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:44:16.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDA++Nk1u8tCBAAcGBXMzqPGLoe+UTHSY/J1g==", 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.564 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2023-08-22T00:44:16.565 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC+++NkJ9lGNBAA/XYNlnlBwGPaNGjsTJ7HNA==", 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++Nky3TKGBAAkB24WA/TmkrDZttrZJeJaw==", 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:44:16.567 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC/++NkgpTRDxAA4NF9yIQuRIGgao1U9M/7cw==", 2023-08-22T00:44:16.568 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-08-22T00:44:16.569 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:44:16.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 msgr2=0x7ff1b80613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 0x7ff1b80613c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff1cc095070 tx=0x7ff1c0017000).stop 2023-08-22T00:44:16.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 msgr2=0x7ff1cc0c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.571 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7ff1bc00d860 tx=0x7ff1bc008040).stop 2023-08-22T00:44:16.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 shutdown_connections 2023-08-22T00:44:16.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff1b805ef00 0x7ff1b80613c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1cc151cd0 0x7ff1cc164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1cc063ce0 0x7ff1cc0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.572 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 --2- 172.21.15.98:0/429201468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1cc064160 0x7ff1cc0c1d70 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 >> 172.21.15.98:0/429201468 conn(0x7ff1cc0c7770 msgr2=0x7ff1cc149390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:16.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 shutdown_connections 2023-08-22T00:44:16.573 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.537+0000 7ff1d1b08700 1 -- 172.21.15.98:0/429201468 wait complete. 2023-08-22T00:44:16.574 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:16.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.690+0000 7f0077888700 1 Processor -- start 2023-08-22T00:44:16.693 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.690+0000 7f0077888700 1 -- start start 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0077888700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007014bf70 0x7f0070152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0077888700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007014c350 0x7f00701556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0077888700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0070153080 con 0x7f00700c3740 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0077888700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0070066510 con 0x7f007014bf70 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0077888700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00700667b0 con 0x7f007014c350 2023-08-22T00:44:16.694 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0075624700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007014bf70 0x7f0070152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0075624700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f007014bf70 0x7f0070152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34670/0 (socket says 172.21.15.98:34670) 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.691+0000 7f0075624700 1 -- 172.21.15.98:0/2855153858 learned_addr learned my addr 172.21.15.98:0/2855153858 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0074e23700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007014c350 0x7f00701556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0075624700 1 -- 172.21.15.98:0/2855153858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007014c350 msgr2=0x7f00701556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0075624700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007014c350 0x7f00701556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0075624700 1 -- 172.21.15.98:0/2855153858 >> v1:172.21.15.118:6789/0 conn(0x7f00700c3740 legacy=0x7f00700aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:16.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0075624700 1 -- 172.21.15.98:0/2855153858 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070155ba0 con 0x7f007014bf70 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0075624700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014bf70 0x7f0070152b90 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f006c006fd0 tx=0x7f006c0090f0).ready entity=mon.0 client_cookie=36ae7b11976a42f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0067fff700 1 -- 172.21.15.98:0/2855153858 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00b600 con 0x7f007014bf70 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0067fff700 1 -- 172.21.15.98:0/2855153858 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00b760 con 0x7f007014bf70 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0067fff700 1 -- 172.21.15.98:0/2855153858 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00bae0 con 0x7f007014bf70 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0077888700 1 -- 172.21.15.98:0/2855153858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014bf70 msgr2=0x7f0070152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0077888700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014bf70 0x7f0070152b90 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f006c006fd0 tx=0x7f006c0090f0).stop 2023-08-22T00:44:16.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0077888700 1 -- 172.21.15.98:0/2855153858 shutdown_connections 2023-08-22T00:44:16.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.692+0000 7f0077888700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014bf70 0x7f0070152b90 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.693+0000 7f0077888700 1 --2- 172.21.15.98:0/2855153858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f007014c350 0x7f00701556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.693+0000 7f0077888700 1 -- 172.21.15.98:0/2855153858 >> 172.21.15.98:0/2855153858 conn(0x7f00700c5dc0 msgr2=0x7f0070068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:16.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.693+0000 7f0077888700 1 -- 172.21.15.98:0/2855153858 shutdown_connections 2023-08-22T00:44:16.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.693+0000 7f0077888700 1 -- 172.21.15.98:0/2855153858 wait complete. 2023-08-22T00:44:16.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.694+0000 7f0077888700 1 Processor -- start 2023-08-22T00:44:16.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.694+0000 7f0077888700 1 -- start start 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 0x7f007014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 0x7f0070148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070153340 con 0x7f007014c350 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070153620 con 0x7f007014bf70 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070153c70 con 0x7f00700c3740 2023-08-22T00:44:16.700 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34678/0 (socket says 172.21.15.98:34678) 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 -- 172.21.15.98:0/2747214639 learned_addr learned my addr 172.21.15.98:0/2747214639 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075624700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 0x7f007014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0074e23700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 0x7f0070148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 -- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 msgr2=0x7f007014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 0x7f007014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 -- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 msgr2=0x7f0070148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.701 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 0x7f0070148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 -- 172.21.15.98:0/2747214639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009370 con 0x7f007014c350 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0074e23700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 0x7f0070148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075624700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 0x7f007014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0075e25700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f006800c810 tx=0x7f0068002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068010510 con 0x7f007014c350 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00680106b0 con 0x7f007014c350 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068010a70 con 0x7f007014c350 2023-08-22T00:44:16.702 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070153f50 con 0x7f007014c350 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.695+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0070149160 con 0x7f007014c350 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.696+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070047480 con 0x7f007014c350 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.697+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f006801b400 con 0x7f007014c350 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.697+0000 7f00657fa700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 0x7f00540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.697+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7f0068079cb0 con 0x7f007014c350 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.697+0000 7f0075624700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 0x7f00540613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:16.703 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.697+0000 7f0075624700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 0x7f00540613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f006c00b3c0 tx=0x7f006c017000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:16.704 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.701+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f006804b110 con 0x7f007014c350 2023-08-22T00:44:16.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.863+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0070155e00 con 0x7f007014c350 2023-08-22T00:44:16.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.863+0000 7f00657fa700 1 -- 172.21.15.98:0/2747214639 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+14099 (secure 0 0 0) 0x7f0068010e60 con 0x7f007014c350 2023-08-22T00:44:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:16.864 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":199,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:16.156611+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:16.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 msgr2=0x7f00540613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 0x7f00540613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f006c00b3c0 tx=0x7f006c017000).stop 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 msgr2=0x7f00700a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f006800c810 tx=0x7f0068002560).stop 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 shutdown_connections 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f005405ef30 0x7f00540613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00700c3740 0x7f007014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007014c350 0x7f00700a87f0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 --2- 172.21.15.98:0/2747214639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f007014bf70 0x7f0070148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:16.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 >> 172.21.15.98:0/2747214639 conn(0x7f00700c5dc0 msgr2=0x7f00700c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:16.867 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 shutdown_connections 2023-08-22T00:44:16.868 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.865+0000 7f0077888700 1 -- 172.21.15.98:0/2747214639 wait complete. 2023-08-22T00:44:16.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-22T00:44:16.878 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:44:16.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.997+0000 7f8d984fa700 1 Processor -- start 2023-08-22T00:44:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.997+0000 7f8d984fa700 1 -- start start 2023-08-22T00:44:16.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d984fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d900c3c10 0x7f8d90154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d984fa700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d90151e80 con 0x7f8d9014ae70 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d984fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d90065560 con 0x7f8d9014b250 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d984fa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d90066b90 con 0x7f8d900c3c10 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d96296700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8d9014ae70 0x7f8d900c6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44694/0 (socket says 172.21.15.98:44694) 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.998+0000 7f8d96296700 1 -- 172.21.15.98:0/2477347189 learned_addr learned my addr 172.21.15.98:0/2477347189 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:16.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96a97700 1 --2- 172.21.15.98:0/2477347189 >> v2:172.21.15.118:3300/0 conn(0x7f8d900c3c10 0x7f8d90154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888678736 0 0) 0x7f8d90151e80 con 0x7f8d9014ae70 2023-08-22T00:44:17.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7c0033f0 con 0x7f8d9014ae70 2023-08-22T00:44:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2002388599 0 0) 0x7f8d7c0033f0 con 0x7f8d9014ae70 2023-08-22T00:44:17.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 >> v2:172.21.15.118:3300/0 conn(0x7f8d900c3c10 msgr2=0x7f8d90154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 --2- 172.21.15.98:0/2477347189 >> v2:172.21.15.118:3300/0 conn(0x7f8d900c3c10 0x7f8d90154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 >> v1:172.21.15.118:6789/0 conn(0x7f8d9014b250 legacy=0x7f8d900c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900c7590 con 0x7f8d9014ae70 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8d80001470 con 0x7f8d9014ae70 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 >> v1:172.21.15.98:6789/0 conn(0x7f8d9014ae70 legacy=0x7f8d900c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 0x7f8d7c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d7c005000 0x7f8d7c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90066b90 con 0x7f8d7c0038e0 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c00bf60 con 0x7f8d7c005000 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c00c0f0 con 0x7f8d7c004690 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 0x7f8d7c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95a95700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96a97700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d7c005000 0x7f8d7c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 -- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c004690 msgr2=0x7f8d7c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 -- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d7c005000 msgr2=0x7f8d7c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d7c005000 0x7f8d7c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 -- 172.21.15.98:0/2477347189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0033f0 con 0x7f8d7c0038e0 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d95a95700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96a97700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d7c005000 0x7f8d7c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:17.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96a97700 1 -- 172.21.15.98:0/2477347189 reap_dead start 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:16.999+0000 7f8d96296700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 0x7f8d7c003d00 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f8d8000c190 tx=0x7f8d80001e50).ready entity=mon.0 client_cookie=b761d86594074722 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80007a20 con 0x7f8d7c0038e0 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000cac0 con 0x7f8d7c0038e0 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d95294700 1 -- 172.21.15.98:0/2477347189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000ce40 con 0x7f8d7c0038e0 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 -- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 msgr2=0x7f8d7c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 0x7f8d7c003d00 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f8d8000c190 tx=0x7f8d80001e50).stop 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 -- 172.21.15.98:0/2477347189 shutdown_connections 2023-08-22T00:44:17.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 --2- 172.21.15.98:0/2477347189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d7c0038e0 0x7f8d7c003d00 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 -- 172.21.15.98:0/2477347189 >> 172.21.15.98:0/2477347189 conn(0x7f8d900c7800 msgr2=0x7f8d900c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 -- 172.21.15.98:0/2477347189 shutdown_connections 2023-08-22T00:44:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.000+0000 7f8d984fa700 1 -- 172.21.15.98:0/2477347189 wait complete. 2023-08-22T00:44:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.002+0000 7f8d984fa700 1 Processor -- start 2023-08-22T00:44:17.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.002+0000 7f8d984fa700 1 -- start start 2023-08-22T00:44:17.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c0038e0 0x7f8d90162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.009 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9014dbe0 0x7f8d900aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9014e060 con 0x7f8d90162a00 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9014d260 con 0x7f8d9014dbe0 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90164760 con 0x7f8d7c0038e0 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34688/0 (socket says 172.21.15.98:34688) 2023-08-22T00:44:17.010 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 -- 172.21.15.98:0/1383124692 learned_addr learned my addr 172.21.15.98:0/1383124692 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d96296700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c0038e0 0x7f8d90162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d96a97700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9014dbe0 0x7f8d900aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 -- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c0038e0 msgr2=0x7f8d90162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c0038e0 0x7f8d90162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 -- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9014dbe0 msgr2=0x7f8d900aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9014dbe0 0x7f8d900aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 -- 172.21.15.98:0/1383124692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9014c650 con 0x7f8d90162a00 2023-08-22T00:44:17.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d95a95700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f8d8c001560 tx=0x7f8d8c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c012730 con 0x7f8d90162a00 2023-08-22T00:44:17.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c012890 con 0x7f8d90162a00 2023-08-22T00:44:17.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9014c930 con 0x7f8d90162a00 2023-08-22T00:44:17.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c012c10 con 0x7f8d90162a00 2023-08-22T00:44:17.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.003+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9014cef0 con 0x7f8d90162a00 2023-08-22T00:44:17.013 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.004+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d90069220 con 0x7f8d90162a00 2023-08-22T00:44:17.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.005+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8d8c01b400 con 0x7f8d90162a00 2023-08-22T00:44:17.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.005+0000 7f8d867fc700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 0x7f8d740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.005+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7f8d8c07c290 con 0x7f8d90162a00 2023-08-22T00:44:17.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.005+0000 7f8d96296700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 0x7f8d740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.005+0000 7f8d96296700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 0x7f8d740613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8d900a7870 tx=0x7f8d80015000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.009+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d8c04d6f0 con 0x7f8d90162a00 2023-08-22T00:44:17.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.167+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d900ad7c0 con 0x7f8d90162a00 2023-08-22T00:44:17.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.167+0000 7f8d867fc700 1 -- 172.21.15.98:0/1383124692 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v199) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d8c050d10 con 0x7f8d90162a00 2023-08-22T00:44:17.168 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:44:17.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 msgr2=0x7f8d740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 0x7f8d740613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8d900a7870 tx=0x7f8d80015000).stop 2023-08-22T00:44:17.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 msgr2=0x7f8d9014d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.169 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f8d8c001560 tx=0x7f8d8c009040).stop 2023-08-22T00:44:17.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 shutdown_connections 2023-08-22T00:44:17.170 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8d7405ef30 0x7f8d740613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d7c0038e0 0x7f8d90162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9014dbe0 0x7f8d900aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 --2- 172.21.15.98:0/1383124692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d90162a00 0x7f8d9014d6f0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 >> 172.21.15.98:0/1383124692 conn(0x7f8d900c7800 msgr2=0x7f8d9014f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 shutdown_connections 2023-08-22T00:44:17.171 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.169+0000 7f8d984fa700 1 -- 172.21.15.98:0/1383124692 wait complete. 2023-08-22T00:44:17.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:44:17.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.300+0000 7f8d0cb19700 1 Processor -- start 2023-08-22T00:44:17.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.300+0000 7f8d0cb19700 1 -- start start 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d0cb19700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8d080645b0 0x7f8d08158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d0cb19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d080666a0 0x7f8d08066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d0cb19700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080bcf30 con 0x7f8d08154170 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d0cb19700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08154550 con 0x7f8d080645b0 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d0cb19700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08158b00 con 0x7f8d080666a0 2023-08-22T00:44:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8d080645b0 0x7f8d08158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8d080645b0 0x7f8d08158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34696/0 (socket says 172.21.15.98:34696) 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 -- 172.21.15.98:0/3131804132 learned_addr learned my addr 172.21.15.98:0/3131804132 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d06d9d700 1 --2- 172.21.15.98:0/3131804132 >> v2:172.21.15.118:3300/0 conn(0x7f8d080666a0 0x7f8d08066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 -- 172.21.15.98:0/3131804132 >> v2:172.21.15.118:3300/0 conn(0x7f8d080666a0 msgr2=0x7f8d08066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 --2- 172.21.15.98:0/3131804132 >> v2:172.21.15.118:3300/0 conn(0x7f8d080666a0 0x7f8d08066ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 -- 172.21.15.98:0/3131804132 >> v1:172.21.15.118:6789/0 conn(0x7f8d08154170 legacy=0x7f8d08063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 -- 172.21.15.98:0/3131804132 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080c2990 con 0x7f8d080645b0 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.301+0000 7f8d05d9b700 1 --2- 172.21.15.98:0/3131804132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d080645b0 0x7f8d08158610 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f8d0806b570 tx=0x7f8cfc0090f0).ready entity=mon.0 client_cookie=f8c1102ab3187eba server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0559a700 1 -- 172.21.15.98:0/3131804132 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc00b520 con 0x7f8d080645b0 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0559a700 1 -- 172.21.15.98:0/3131804132 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc00b680 con 0x7f8d080645b0 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0559a700 1 -- 172.21.15.98:0/3131804132 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc00ba00 con 0x7f8d080645b0 2023-08-22T00:44:17.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 -- 172.21.15.98:0/3131804132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d080645b0 msgr2=0x7f8d08158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/3131804132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d080645b0 0x7f8d08158610 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f8d0806b570 tx=0x7f8cfc0090f0).stop 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 -- 172.21.15.98:0/3131804132 shutdown_connections 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/3131804132 >> v2:172.21.15.118:3300/0 conn(0x7f8d080666a0 0x7f8d08066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/3131804132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d080645b0 0x7f8d08158610 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 -- 172.21.15.98:0/3131804132 >> 172.21.15.98:0/3131804132 conn(0x7f8d08069680 msgr2=0x7f8d08069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 -- 172.21.15.98:0/3131804132 shutdown_connections 2023-08-22T00:44:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.302+0000 7f8d0cb19700 1 -- 172.21.15.98:0/3131804132 wait complete. 2023-08-22T00:44:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.303+0000 7f8d0cb19700 1 Processor -- start 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.303+0000 7f8d0cb19700 1 -- start start 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d080645b0 0x7f8d08146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d080666a0 0x7f8d08156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08147370 con 0x7f8d08154170 2023-08-22T00:44:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080a9f90 con 0x7f8d080645b0 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0cb19700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080a5240 con 0x7f8d080666a0 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d06d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d06d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34698/0 (socket says 172.21.15.98:34698) 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d06d9d700 1 -- 172.21.15.98:0/4128234771 learned_addr learned my addr 172.21.15.98:0/4128234771 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d05d9b700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d080666a0 0x7f8d08156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d0659c700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d080645b0 0x7f8d08146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.304+0000 7f8d06d9d700 1 -- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d080666a0 msgr2=0x7f8d08156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d06d9d700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d080666a0 0x7f8d08156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d06d9d700 1 -- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d080645b0 msgr2=0x7f8d08146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d06d9d700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d080645b0 0x7f8d08146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d06d9d700 1 -- 172.21.15.98:0/4128234771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc009370 con 0x7f8d08154170 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d06d9d700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7f8d00009ec0 tx=0x7f8d0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000cb70 con 0x7f8d08154170 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000f040 con 0x7f8d08154170 2023-08-22T00:44:17.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d080a6d60 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000cee0 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.305+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d080a4910 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.306+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08068600 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.306+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8d00013610 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.306+0000 7f8cf67fc700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 0x7f8ce80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.307+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7f8d0007a5c0 con 0x7f8d08154170 2023-08-22T00:44:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.307+0000 7f8d0659c700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 0x7f8ce80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.307+0000 7f8d0659c700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 0x7f8ce80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8d08063870 tx=0x7f8cf8009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.311+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d0004ba80 con 0x7f8d08154170 2023-08-22T00:44:17.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.469+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d080a5380 con 0x7f8d08154170 2023-08-22T00:44:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.470+0000 7f8cf67fc700 1 -- 172.21.15.98:0/4128234771 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v199) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d0004f0a0 con 0x7f8d08154170 2023-08-22T00:44:17.472 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:44:17.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 msgr2=0x7f8ce80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 0x7f8ce80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8d08063870 tx=0x7f8cf8009040).stop 2023-08-22T00:44:17.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 msgr2=0x7f8d08157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7f8d00009ec0 tx=0x7f8d0000b040).stop 2023-08-22T00:44:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 shutdown_connections 2023-08-22T00:44:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8ce805ef30 0x7f8ce80613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d08154170 0x7f8d08157960 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d080645b0 0x7f8d08146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 --2- 172.21.15.98:0/4128234771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d080666a0 0x7f8d08156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 >> 172.21.15.98:0/4128234771 conn(0x7f8d08069680 msgr2=0x7f8d08066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 shutdown_connections 2023-08-22T00:44:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.472+0000 7f8d0cb19700 1 -- 172.21.15.98:0/4128234771 wait complete. 2023-08-22T00:44:17.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-22T00:44:17.599 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.599+0000 7f2a33a77700 1 Processor -- start 2023-08-22T00:44:17.600 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.599+0000 7f2a33a77700 1 -- start start 2023-08-22T00:44:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a33a77700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2a2c153f10 0x7f2a2c150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.601 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a33a77700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c26b0 0x7f2a2c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a33a77700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0c2220 con 0x7f2a2c150040 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a33a77700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0c5bd0 con 0x7f2a2c153f10 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a33a77700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0c1ef0 con 0x7f2a2c0c26b0 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2a2c153f10 0x7f2a2c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2a2c153f10 0x7f2a2c150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34714/0 (socket says 172.21.15.98:34714) 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 -- 172.21.15.98:0/3742170231 learned_addr learned my addr 172.21.15.98:0/3742170231 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.602 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31813700 1 --1- 172.21.15.98:0/3742170231 >> v1:172.21.15.98:6789/0 conn(0x7f2a2c150040 0x7f2a2c0c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44696/0 (socket says 172.21.15.98:44696) 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a32014700 1 --2- 172.21.15.98:0/3742170231 >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c26b0 0x7f2a2c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 -- 172.21.15.98:0/3742170231 >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c26b0 msgr2=0x7f2a2c0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 --2- 172.21.15.98:0/3742170231 >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c26b0 0x7f2a2c0c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 -- 172.21.15.98:0/3742170231 >> v1:172.21.15.98:6789/0 conn(0x7f2a2c150040 legacy=0x7f2a2c0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 -- 172.21.15.98:0/3742170231 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0c5e30 con 0x7f2a2c153f10 2023-08-22T00:44:17.603 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.600+0000 7f2a31012700 1 --2- 172.21.15.98:0/3742170231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c153f10 0x7f2a2c150420 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f2a2c0c4cd0 tx=0x7f2a1c0090f0).ready entity=mon.0 client_cookie=ce66a1c5ae7637cb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a30811700 1 -- 172.21.15.98:0/3742170231 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00b520 con 0x7f2a2c153f10 2023-08-22T00:44:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a30811700 1 -- 172.21.15.98:0/3742170231 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00b680 con 0x7f2a2c153f10 2023-08-22T00:44:17.608 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a30811700 1 -- 172.21.15.98:0/3742170231 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ba00 con 0x7f2a2c153f10 2023-08-22T00:44:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 -- 172.21.15.98:0/3742170231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c153f10 msgr2=0x7f2a2c150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3742170231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c153f10 0x7f2a2c150420 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f2a2c0c4cd0 tx=0x7f2a1c0090f0).stop 2023-08-22T00:44:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 -- 172.21.15.98:0/3742170231 shutdown_connections 2023-08-22T00:44:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3742170231 >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c26b0 0x7f2a2c0c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3742170231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c153f10 0x7f2a2c150420 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 -- 172.21.15.98:0/3742170231 >> 172.21.15.98:0/3742170231 conn(0x7f2a2c0c7140 msgr2=0x7f2a2c0c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 -- 172.21.15.98:0/3742170231 shutdown_connections 2023-08-22T00:44:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.602+0000 7f2a33a77700 1 -- 172.21.15.98:0/3742170231 wait complete. 2023-08-22T00:44:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.603+0000 7f2a33a77700 1 Processor -- start 2023-08-22T00:44:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.603+0000 7f2a33a77700 1 -- start start 2023-08-22T00:44:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a2c0c26b0 0x7f2a2c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c153f10 0x7f2a2c1657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1440a0 con 0x7f2a2c150040 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c144380 con 0x7f2a2c153f10 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a33a77700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c144660 con 0x7f2a2c0c26b0 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a31012700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a31012700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34728/0 (socket says 172.21.15.98:34728) 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a31012700 1 -- 172.21.15.98:0/3944070518 learned_addr learned my addr 172.21.15.98:0/3944070518 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.604+0000 7f2a31813700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a2c0c26b0 0x7f2a2c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a32014700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c153f10 0x7f2a2c1657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 -- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a2c0c26b0 msgr2=0x7f2a2c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a2c0c26b0 0x7f2a2c1459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 -- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c153f10 msgr2=0x7f2a2c1657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c153f10 0x7f2a2c1657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 -- 172.21.15.98:0/3944070518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009370 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a31012700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f2a2c0c4140 tx=0x7f2a1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00b7f0 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00b950 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c144940 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c01d680 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.605+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c145ee0 con 0x7f2a2c150040 2023-08-22T00:44:17.614 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.606+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c047480 con 0x7f2a2c150040 2023-08-22T00:44:17.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.606+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2a1c01d9f0 con 0x7f2a2c150040 2023-08-22T00:44:17.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.607+0000 7f2a21ffb700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 0x7f2a100613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.607+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7f2a1c07b9f0 con 0x7f2a2c150040 2023-08-22T00:44:17.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.607+0000 7f2a31813700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 0x7f2a100613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.615 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.607+0000 7f2a31813700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 0x7f2a100613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a2c0bc6c0 tx=0x7f2a28007bf0).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.611+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a1c04ceb0 con 0x7f2a2c150040 2023-08-22T00:44:17.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.774+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2a2c154d70 con 0x7f2a2c150040 2023-08-22T00:44:17.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.774+0000 7f2a21ffb700 1 -- 172.21.15.98:0/3944070518 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v199) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2a1c021070 con 0x7f2a2c150040 2023-08-22T00:44:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:17.775 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "device_health_metrics" 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 2, 2023-08-22T00:44:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": "rbd" 2023-08-22T00:44:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:17.777 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:44:17.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 msgr2=0x7f2a100613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 0x7f2a100613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a2c0bc6c0 tx=0x7f2a28007bf0).stop 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 msgr2=0x7f2a2c149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f2a2c0c4140 tx=0x7f2a1c017000).stop 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 shutdown_connections 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2a1005ef30 0x7f2a100613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a2c0c26b0 0x7f2a2c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c153f10 0x7f2a2c1657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 --2- 172.21.15.98:0/3944070518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c150040 0x7f2a2c149de0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 >> 172.21.15.98:0/3944070518 conn(0x7f2a2c0c7140 msgr2=0x7f2a2c064e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 shutdown_connections 2023-08-22T00:44:17.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.776+0000 7f2a33a77700 1 -- 172.21.15.98:0/3944070518 wait complete. 2023-08-22T00:44:17.789 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-22T00:44:17.789 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-22T00:44:17.910 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.910+0000 7f46ee096700 1 Processor -- start 2023-08-22T00:44:17.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.910+0000 7f46ee096700 1 -- start start 2023-08-22T00:44:17.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46ee096700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46e8067880 0x7f46e8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46ee096700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e8065d20 con 0x7f46e80645b0 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46ee096700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e8151a30 con 0x7f46e80c34f0 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46ee096700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e8151ec0 con 0x7f46e8067880 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46e7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f46e80645b0 0x7f46e8154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44708/0 (socket says 172.21.15.98:44708) 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46e7fff700 1 -- 172.21.15.98:0/3695592758 learned_addr learned my addr 172.21.15.98:0/3695592758 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:17.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.911+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> v2:172.21.15.118:3300/0 conn(0x7f46e8067880 0x7f46e8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371401465 0 0) 0x7f46e8065d20 con 0x7f46e80645b0 2023-08-22T00:44:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d40033f0 con 0x7f46e80645b0 2023-08-22T00:44:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858332748 0 0) 0x7f46d40033f0 con 0x7f46e80645b0 2023-08-22T00:44:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 >> v2:172.21.15.118:3300/0 conn(0x7f46e8067880 msgr2=0x7f46e8067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 --2- 172.21.15.98:0/3695592758 >> v2:172.21.15.118:3300/0 conn(0x7f46e8067880 0x7f46e8067c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 >> v1:172.21.15.118:6789/0 conn(0x7f46e80c34f0 legacy=0x7f46e8063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80c2520 con 0x7f46e80645b0 2023-08-22T00:44:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f46e0001470 con 0x7f46e80645b0 2023-08-22T00:44:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> v2:172.21.15.118:3300/0 conn(0x7f46e8067880 0x7f46e8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:17.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 >> v1:172.21.15.98:6789/0 conn(0x7f46e80645b0 legacy=0x7f46e8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 0x7f46d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4004690 0x7f46d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4005000 0x7f46d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8151ec0 con 0x7f46d40038e0 2023-08-22T00:44:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400beb0 con 0x7f46d4004690 2023-08-22T00:44:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400c070 con 0x7f46d4005000 2023-08-22T00:44:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 0x7f46d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e6ffd700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4004690 0x7f46d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e7fff700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4005000 0x7f46d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 -- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4005000 msgr2=0x7f46d400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4005000 0x7f46d400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 -- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4004690 msgr2=0x7f46d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4004690 0x7f46d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 -- 172.21.15.98:0/3695592758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40033f0 con 0x7f46d40038e0 2023-08-22T00:44:17.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e6ffd700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4004690 0x7f46d4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:17.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e7fff700 1 -- 172.21.15.98:0/3695592758 reap_dead start 2023-08-22T00:44:17.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.912+0000 7f46e77fe700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 0x7f46d4003d00 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f46d800e3c0 tx=0x7f46d800b040).ready entity=mon.0 client_cookie=621161b33e068394 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8009c50 con 0x7f46d40038e0 2023-08-22T00:44:17.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800f040 con 0x7f46d40038e0 2023-08-22T00:44:17.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46e67fc700 1 -- 172.21.15.98:0/3695592758 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800ee80 con 0x7f46d40038e0 2023-08-22T00:44:17.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 -- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 msgr2=0x7f46d4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 0x7f46d4003d00 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f46d800e3c0 tx=0x7f46d800b040).stop 2023-08-22T00:44:17.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 -- 172.21.15.98:0/3695592758 shutdown_connections 2023-08-22T00:44:17.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 --2- 172.21.15.98:0/3695592758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d40038e0 0x7f46d4003d00 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 -- 172.21.15.98:0/3695592758 >> 172.21.15.98:0/3695592758 conn(0x7f46e80c4470 msgr2=0x7f46e80695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:17.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 -- 172.21.15.98:0/3695592758 shutdown_connections 2023-08-22T00:44:17.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.913+0000 7f46ee096700 1 -- 172.21.15.98:0/3695592758 wait complete. 2023-08-22T00:44:17.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.914+0000 7f46ee096700 1 Processor -- start 2023-08-22T00:44:17.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.914+0000 7f46ee096700 1 -- start start 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d40038e0 0x7f46e80a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e80ac1a0 0x7f46e8163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80be120 con 0x7f46e80c4a70 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80c53e0 con 0x7f46d40038e0 2023-08-22T00:44:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46ee096700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80a7f80 con 0x7f46e80ac1a0 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46e77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d40038e0 0x7f46e80a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34742/0 (socket says 172.21.15.98:34742) 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46e6ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e80ac1a0 0x7f46e8163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.915+0000 7f46e7fff700 1 -- 172.21.15.98:0/164474754 learned_addr learned my addr 172.21.15.98:0/164474754 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 -- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e80ac1a0 msgr2=0x7f46e8163a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e80ac1a0 0x7f46e8163a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 -- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d40038e0 msgr2=0x7f46e80a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d40038e0 0x7f46e80a79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 -- 172.21.15.98:0/164474754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80a8260 con 0x7f46e80c4a70 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46e7fff700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f46e0000c00 tx=0x7f46e0000f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010450 con 0x7f46e80c4a70 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e00105b0 con 0x7f46e80c4a70 2023-08-22T00:44:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010950 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80a8540 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.916+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e80a92d0 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.917+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e8047480 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.918+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f46e0010cc0 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.918+0000 7f46df7fe700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 0x7f46c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.918+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5650+0+0 (secure 0 0 0) 0x7f46e0079590 con 0x7f46e80c4a70 2023-08-22T00:44:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.918+0000 7f46e77fe700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 0x7f46c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.919+0000 7f46e77fe700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 0x7f46c80613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f46d8009430 tx=0x7f46d801a000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:17.922+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46e004aa50 con 0x7f46e80c4a70 2023-08-22T00:44:18.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.082+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f46e814b220 con 0x7f46e80c4a70 2023-08-22T00:44:18.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.605+0000 7f46df7fe700 1 -- 172.21.15.98:0/164474754 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v200) v1 ==== 152+0+0 (secure 0 0 0) 0x7f46e001b020 con 0x7f46e80c4a70 2023-08-22T00:44:18.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.608+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 msgr2=0x7f46c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.608+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 0x7f46c80613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f46d8009430 tx=0x7f46d801a000).stop 2023-08-22T00:44:18.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.608+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 msgr2=0x7f46e80c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.608+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f46e0000c00 tx=0x7f46e0000f80).stop 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 shutdown_connections 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f46c805ef30 0x7f46c80613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46e80c4a70 0x7f46e80c4ef0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d40038e0 0x7f46e80a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 --2- 172.21.15.98:0/164474754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46e80ac1a0 0x7f46e8163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 >> 172.21.15.98:0/164474754 conn(0x7f46e80c4470 msgr2=0x7f46e80a5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:18.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.609+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 shutdown_connections 2023-08-22T00:44:18.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.610+0000 7f46ee096700 1 -- 172.21.15.98:0/164474754 wait complete. 2023-08-22T00:44:18.615 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2023-08-22T00:44:18.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-22T00:44:18.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.754+0000 7f379d97f700 1 Processor -- start 2023-08-22T00:44:18.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.754+0000 7f379d97f700 1 -- start start 2023-08-22T00:44:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f379d97f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f37980645b0 0x7f3798158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f379d97f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f37980666a0 0x7f3798066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f379d97f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37980bcf30 con 0x7f3798154170 2023-08-22T00:44:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f379d97f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3798154550 con 0x7f37980645b0 2023-08-22T00:44:18.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f379d97f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3798158b00 con 0x7f37980666a0 2023-08-22T00:44:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f37980645b0 0x7f3798158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f37980645b0 0x7f3798158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34758/0 (socket says 172.21.15.98:34758) 2023-08-22T00:44:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f3796ffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3798154170 0x7f3798063ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44720/0 (socket says 172.21.15.98:44720) 2023-08-22T00:44:18.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 -- 172.21.15.98:0/2982493630 learned_addr learned my addr 172.21.15.98:0/2982493630 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37977fe700 1 --2- 172.21.15.98:0/2982493630 >> v2:172.21.15.118:3300/0 conn(0x7f37980666a0 0x7f3798066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 -- 172.21.15.98:0/2982493630 >> v2:172.21.15.118:3300/0 conn(0x7f37980666a0 msgr2=0x7f3798066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 --2- 172.21.15.98:0/2982493630 >> v2:172.21.15.118:3300/0 conn(0x7f37980666a0 0x7f3798066ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 -- 172.21.15.98:0/2982493630 >> v1:172.21.15.98:6789/0 conn(0x7f3798154170 legacy=0x7f3798063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f37967fc700 1 -- 172.21.15.98:0/2982493630 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980c2990 con 0x7f37980645b0 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.755+0000 7f3795ffb700 1 -- 172.21.15.98:0/2982493630 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537818911 0 0) 0x7f37980bcf30 con 0x7f3798154170 2023-08-22T00:44:18.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f37967fc700 1 --2- 172.21.15.98:0/2982493630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37980645b0 0x7f3798158610 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f379806b570 tx=0x7f37880090f0).ready entity=mon.0 client_cookie=f02d7229ae9204fe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f3795ffb700 1 -- 172.21.15.98:0/2982493630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800b520 con 0x7f37980645b0 2023-08-22T00:44:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f3795ffb700 1 -- 172.21.15.98:0/2982493630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800b680 con 0x7f37980645b0 2023-08-22T00:44:18.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f3795ffb700 1 -- 172.21.15.98:0/2982493630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800ba00 con 0x7f37980645b0 2023-08-22T00:44:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 -- 172.21.15.98:0/2982493630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37980645b0 msgr2=0x7f3798158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 --2- 172.21.15.98:0/2982493630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37980645b0 0x7f3798158610 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f379806b570 tx=0x7f37880090f0).stop 2023-08-22T00:44:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 -- 172.21.15.98:0/2982493630 shutdown_connections 2023-08-22T00:44:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 --2- 172.21.15.98:0/2982493630 >> v2:172.21.15.118:3300/0 conn(0x7f37980666a0 0x7f3798066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 --2- 172.21.15.98:0/2982493630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37980645b0 0x7f3798158610 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 -- 172.21.15.98:0/2982493630 >> 172.21.15.98:0/2982493630 conn(0x7f3798069680 msgr2=0x7f3798069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 -- 172.21.15.98:0/2982493630 shutdown_connections 2023-08-22T00:44:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.756+0000 7f379d97f700 1 -- 172.21.15.98:0/2982493630 wait complete. 2023-08-22T00:44:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.758+0000 7f379d97f700 1 Processor -- start 2023-08-22T00:44:18.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.758+0000 7f379d97f700 1 -- start start 2023-08-22T00:44:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37980645b0 0x7f3798146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 0x7f3798157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3798158600 con 0x7f3798154170 2023-08-22T00:44:18.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980a38d0 con 0x7f37980666a0 2023-08-22T00:44:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f379d97f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37980a9010 con 0x7f37980645b0 2023-08-22T00:44:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34766/0 (socket says 172.21.15.98:34766) 2023-08-22T00:44:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 -- 172.21.15.98:0/2091580901 learned_addr learned my addr 172.21.15.98:0/2091580901 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:18.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37967fc700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 0x7f3798157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 -- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37980645b0 msgr2=0x7f3798146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f3796ffd700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37980645b0 0x7f3798146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37980645b0 0x7f3798146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 -- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 msgr2=0x7f3798157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 0x7f3798157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37977fe700 1 -- 172.21.15.98:0/2091580901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009370 con 0x7f3798154170 2023-08-22T00:44:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.759+0000 7f37967fc700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 0x7f3798157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f37977fe700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f3790009e90 tx=0x7f379000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000cc20 con 0x7f3798154170 2023-08-22T00:44:18.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000f040 con 0x7f3798154170 2023-08-22T00:44:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790013400 con 0x7f3798154170 2023-08-22T00:44:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37980a92f0 con 0x7f3798154170 2023-08-22T00:44:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.760+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37980a98b0 con 0x7f3798154170 2023-08-22T00:44:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.761+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37980a3a40 con 0x7f3798154170 2023-08-22T00:44:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.761+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f37900137b0 con 0x7f3798154170 2023-08-22T00:44:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.762+0000 7f377effd700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 0x7f37840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.762+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f379007a8c0 con 0x7f3798154170 2023-08-22T00:44:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.762+0000 7f3796ffd700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 0x7f37840613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.762+0000 7f3796ffd700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 0x7f37840613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f378c001540 tx=0x7f378c009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.766+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f379004bc10 con 0x7f3798154170 2023-08-22T00:44:18.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:18.926+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3798046c20 con 0x7f3798154170 2023-08-22T00:44:19.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.611+0000 7f377effd700 1 -- 172.21.15.98:0/2091580901 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v201) v1 ==== 170+0+0 (secure 0 0 0) 0x7f379004f230 con 0x7f3798154170 2023-08-22T00:44:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.616+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 msgr2=0x7f37840613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.616+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 0x7f37840613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f378c001540 tx=0x7f378c009040).stop 2023-08-22T00:44:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.616+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 msgr2=0x7f3798158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.617 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.616+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f3790009e90 tx=0x7f379000b040).stop 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 shutdown_connections 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f378405ef30 0x7f37840613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37980645b0 0x7f3798146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3798154170 0x7f3798158110 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 --2- 172.21.15.98:0/2091580901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37980666a0 0x7f3798157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.618+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 >> 172.21.15.98:0/2091580901 conn(0x7f3798069680 msgr2=0x7f37981521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:19.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.622+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 shutdown_connections 2023-08-22T00:44:19.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.623+0000 7f379d97f700 1 -- 172.21.15.98:0/2091580901 wait complete. 2023-08-22T00:44:19.635 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2023-08-22T00:44:19.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-22T00:44:19.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.770+0000 7f9cb3ffb700 1 Processor -- start 2023-08-22T00:44:19.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.770+0000 7f9cb3ffb700 1 -- start start 2023-08-22T00:44:19.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb3ffb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cac14e720 0x7f9cac155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb3ffb700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cac067d00 0x7f9cac0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb3ffb700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0654a0 con 0x7f9cac0641b0 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb3ffb700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac064660 con 0x7f9cac067d00 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb3ffb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac064920 con 0x7f9cac14e720 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cac067d00 0x7f9cac0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cac067d00 0x7f9cac0c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34772/0 (socket says 172.21.15.98:34772) 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 -- 172.21.15.98:0/2219549408 learned_addr learned my addr 172.21.15.98:0/2219549408 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb1596700 1 --1- 172.21.15.98:0/2219549408 >> v1:172.21.15.98:6789/0 conn(0x7f9cac0641b0 0x7f9cac0675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:44722/0 (socket says 172.21.15.98:44722) 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb1d97700 1 --2- 172.21.15.98:0/2219549408 >> v2:172.21.15.118:3300/0 conn(0x7f9cac14e720 0x7f9cac155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 -- 172.21.15.98:0/2219549408 >> v2:172.21.15.118:3300/0 conn(0x7f9cac14e720 msgr2=0x7f9cac155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 --2- 172.21.15.98:0/2219549408 >> v2:172.21.15.118:3300/0 conn(0x7f9cac14e720 0x7f9cac155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 -- 172.21.15.98:0/2219549408 >> v1:172.21.15.98:6789/0 conn(0x7f9cac0641b0 legacy=0x7f9cac0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb0d95700 1 -- 172.21.15.98:0/2219549408 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679808330 0 0) 0x7f9cac0654a0 con 0x7f9cac0641b0 2023-08-22T00:44:19.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 -- 172.21.15.98:0/2219549408 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac064c00 con 0x7f9cac067d00 2023-08-22T00:44:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb2598700 1 --2- 172.21.15.98:0/2219549408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac067d00 0x7f9cac0c3b70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f9cac069bc0 tx=0x7f9ca4009840).ready entity=mon.0 client_cookie=49af2318eb974268 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb0d95700 1 -- 172.21.15.98:0/2219549408 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400e070 con 0x7f9cac067d00 2023-08-22T00:44:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb0d95700 1 -- 172.21.15.98:0/2219549408 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400ba50 con 0x7f9cac067d00 2023-08-22T00:44:19.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.771+0000 7f9cb0d95700 1 -- 172.21.15.98:0/2219549408 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400bdd0 con 0x7f9cac067d00 2023-08-22T00:44:19.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/2219549408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac067d00 msgr2=0x7f9cac0c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/2219549408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac067d00 0x7f9cac0c3b70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f9cac069bc0 tx=0x7f9ca4009840).stop 2023-08-22T00:44:19.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/2219549408 shutdown_connections 2023-08-22T00:44:19.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/2219549408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac067d00 0x7f9cac0c3b70 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/2219549408 >> v2:172.21.15.118:3300/0 conn(0x7f9cac14e720 0x7f9cac155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/2219549408 >> 172.21.15.98:0/2219549408 conn(0x7f9cac0c8950 msgr2=0x7f9cac0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:19.779 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/2219549408 shutdown_connections 2023-08-22T00:44:19.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.772+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/2219549408 wait complete. 2023-08-22T00:44:19.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.773+0000 7f9cb3ffb700 1 Processor -- start 2023-08-22T00:44:19.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.773+0000 7f9cb3ffb700 1 -- start start 2023-08-22T00:44:19.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cac067d00 0x7f9cac0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 0x7f9cac0beca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac167df0 con 0x7f9cac0641b0 2023-08-22T00:44:19.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac168c10 con 0x7f9cac067d00 2023-08-22T00:44:19.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb3ffb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac168000 con 0x7f9cac14e720 2023-08-22T00:44:19.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34782/0 (socket says 172.21.15.98:34782) 2023-08-22T00:44:19.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 -- 172.21.15.98:0/628824650 learned_addr learned my addr 172.21.15.98:0/628824650 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:19.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1596700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cac067d00 0x7f9cac0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb2598700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 0x7f9cac0beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 -- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 msgr2=0x7f9cac0beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 0x7f9cac0beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 -- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cac067d00 msgr2=0x7f9cac0c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cac067d00 0x7f9cac0c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 -- 172.21.15.98:0/628824650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009ae0 con 0x7f9cac0641b0 2023-08-22T00:44:19.783 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb2598700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 0x7f9cac0beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:19.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.774+0000 7f9cb1d97700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f9ca800d8c0 tx=0x7f9ca8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:19.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.775+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80125f0 con 0x7f9cac0641b0 2023-08-22T00:44:19.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.775+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca8012750 con 0x7f9cac0641b0 2023-08-22T00:44:19.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.775+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac1682e0 con 0x7f9cac0641b0 2023-08-22T00:44:19.784 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.775+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8012ad0 con 0x7f9cac0641b0 2023-08-22T00:44:19.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.775+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac1688a0 con 0x7f9cac0641b0 2023-08-22T00:44:19.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.776+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac1556a0 con 0x7f9cac0641b0 2023-08-22T00:44:19.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.776+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9ca8013480 con 0x7f9cac0641b0 2023-08-22T00:44:19.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.776+0000 7f9ca1ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 0x7f9c900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:19.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.776+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6402+0+0 (secure 0 0 0) 0x7f9ca807a180 con 0x7f9cac0641b0 2023-08-22T00:44:19.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.776+0000 7f9cb1596700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 0x7f9c900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:19.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.777+0000 7f9cb1596700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 0x7f9c900613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9cac167d50 tx=0x7f9c9c007d70).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:19.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.781+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ca804b2f0 con 0x7f9cac0641b0 2023-08-22T00:44:19.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.985+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9cac069d50 con 0x7f9cac0641b0 2023-08-22T00:44:19.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.990+0000 7f9ca1ffb700 1 -- 172.21.15.98:0/628824650 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9ca804e910 con 0x7f9cac0641b0 2023-08-22T00:44:19.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 msgr2=0x7f9c900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 0x7f9c900613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9cac167d50 tx=0x7f9c9c007d70).stop 2023-08-22T00:44:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 msgr2=0x7f9cac0c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:19.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f9ca800d8c0 tx=0x7f9ca8008040).stop 2023-08-22T00:44:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 shutdown_connections 2023-08-22T00:44:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9c9005ef30 0x7f9c900613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cac14e720 0x7f9cac0beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cac0641b0 0x7f9cac0c03e0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 --2- 172.21.15.98:0/628824650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cac067d00 0x7f9cac0c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:19.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:19.994+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 >> 172.21.15.98:0/628824650 conn(0x7f9cac0c8950 msgr2=0x7f9cac0c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.003+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 shutdown_connections 2023-08-22T00:44:20.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.003+0000 7f9cb3ffb700 1 -- 172.21.15.98:0/628824650 wait complete. 2023-08-22T00:44:20.018 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 24 and data pool 25 2023-08-22T00:44:20.026 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:20.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.141+0000 7fe9cf66b700 1 Processor -- start 2023-08-22T00:44:20.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.142+0000 7fe9cf66b700 1 -- start start 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cf66b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9c8153b60 0x7fe9c8068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cf66b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9c80a9140 0x7fe9c8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cf66b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c80a8410 con 0x7fe9c8153f40 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cf66b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80a8cb0 con 0x7fe9c8153b60 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cf66b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c81586a0 con 0x7fe9c80a9140 2023-08-22T00:44:20.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9c8153b60 0x7fe9c8068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9c8153b60 0x7fe9c8068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34786/0 (socket says 172.21.15.98:34786) 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 -- 172.21.15.98:0/566191608 learned_addr learned my addr 172.21.15.98:0/566191608 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cdc08700 1 --2- 172.21.15.98:0/566191608 >> v2:172.21.15.118:3300/0 conn(0x7fe9c80a9140 0x7fe9c8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 -- 172.21.15.98:0/566191608 >> v2:172.21.15.118:3300/0 conn(0x7fe9c80a9140 msgr2=0x7fe9c8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 --2- 172.21.15.98:0/566191608 >> v2:172.21.15.118:3300/0 conn(0x7fe9c80a9140 0x7fe9c8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 -- 172.21.15.98:0/566191608 >> v1:172.21.15.118:6789/0 conn(0x7fe9c8153f40 legacy=0x7fe9c8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 -- 172.21.15.98:0/566191608 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80a8660 con 0x7fe9c8153b60 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9cd407700 1 --2- 172.21.15.98:0/566191608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c8153b60 0x7fe9c8068d40 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fe9c80a8c20 tx=0x7fe9c40090f0).ready entity=mon.0 client_cookie=8068aca72e9dac88 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9bbfff700 1 -- 172.21.15.98:0/566191608 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400b5a0 con 0x7fe9c8153b60 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9bbfff700 1 -- 172.21.15.98:0/566191608 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400b700 con 0x7fe9c8153b60 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.143+0000 7fe9bbfff700 1 -- 172.21.15.98:0/566191608 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400ba80 con 0x7fe9c8153b60 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 -- 172.21.15.98:0/566191608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c8153b60 msgr2=0x7fe9c8068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/566191608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c8153b60 0x7fe9c8068d40 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fe9c80a8c20 tx=0x7fe9c40090f0).stop 2023-08-22T00:44:20.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 -- 172.21.15.98:0/566191608 shutdown_connections 2023-08-22T00:44:20.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/566191608 >> v2:172.21.15.118:3300/0 conn(0x7fe9c80a9140 0x7fe9c8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/566191608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c8153b60 0x7fe9c8068d40 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 -- 172.21.15.98:0/566191608 >> 172.21.15.98:0/566191608 conn(0x7fe9c80c5dc0 msgr2=0x7fe9c8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 -- 172.21.15.98:0/566191608 shutdown_connections 2023-08-22T00:44:20.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.144+0000 7fe9cf66b700 1 -- 172.21.15.98:0/566191608 wait complete. 2023-08-22T00:44:20.150 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.145+0000 7fe9cf66b700 1 Processor -- start 2023-08-22T00:44:20.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.145+0000 7fe9cf66b700 1 -- start start 2023-08-22T00:44:20.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c8153b60 0x7fe9c8065930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9c8153f40 0x7fe9c8156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8155de0 con 0x7fe9c80a9140 2023-08-22T00:44:20.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80c1330 con 0x7fe9c8153b60 2023-08-22T00:44:20.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cf66b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80c0a00 con 0x7fe9c8153f40 2023-08-22T00:44:20.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34802/0 (socket says 172.21.15.98:34802) 2023-08-22T00:44:20.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 -- 172.21.15.98:0/3883701514 learned_addr learned my addr 172.21.15.98:0/3883701514 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:20.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cdc08700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9c8153f40 0x7fe9c8156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9ccc06700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c8153b60 0x7fe9c8065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 -- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9c8153f40 msgr2=0x7fe9c8156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9c8153f40 0x7fe9c8156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 -- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c8153b60 msgr2=0x7fe9c8065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c8153b60 0x7fe9c8065930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.146+0000 7fe9cd407700 1 -- 172.21.15.98:0/3883701514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009370 con 0x7fe9c80a9140 2023-08-22T00:44:20.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9cd407700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fe9c4009130 tx=0x7fe9c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400bec0 con 0x7fe9c80a9140 2023-08-22T00:44:20.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400b870 con 0x7fe9c80a9140 2023-08-22T00:44:20.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c80c0ce0 con 0x7fe9c80a9140 2023-08-22T00:44:20.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400ba00 con 0x7fe9c80a9140 2023-08-22T00:44:20.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.147+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c8151d10 con 0x7fe9c80a9140 2023-08-22T00:44:20.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.148+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c8047480 con 0x7fe9c80a9140 2023-08-22T00:44:20.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.148+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe9c4021020 con 0x7fe9c80a9140 2023-08-22T00:44:20.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.148+0000 7fe9b97fa700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 0x7fe9ac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.149+0000 7fe9ccc06700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 0x7fe9ac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.156 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.149+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe9c407b610 con 0x7fe9c80a9140 2023-08-22T00:44:20.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.149+0000 7fe9ccc06700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 0x7fe9ac0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe9c80c7c90 tx=0x7fe9bc008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.153+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe9c404c840 con 0x7fe9c80a9140 2023-08-22T00:44:20.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.314+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9c80a8940 con 0x7fe9c80a9140 2023-08-22T00:44:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.315+0000 7fe9b97fa700 1 -- 172.21.15.98:0/3883701514 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17332 (secure 0 0 0) 0x7fe9c4029090 con 0x7fe9c80a9140 2023-08-22T00:44:20.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:20.320 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":202,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:19.985556+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:20.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 msgr2=0x7fe9ac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 0x7fe9ac0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe9c80c7c90 tx=0x7fe9bc008040).stop 2023-08-22T00:44:20.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 msgr2=0x7fe9c8151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fe9c4009130 tx=0x7fe9c4015000).stop 2023-08-22T00:44:20.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 shutdown_connections 2023-08-22T00:44:20.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe9ac05ef30 0x7fe9ac0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9c8153f40 0x7fe9c8156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9c80a9140 0x7fe9c8151820 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 --2- 172.21.15.98:0/3883701514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c8153b60 0x7fe9c8065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 >> 172.21.15.98:0/3883701514 conn(0x7fe9c80c5dc0 msgr2=0x7fe9c81526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 shutdown_connections 2023-08-22T00:44:20.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.317+0000 7fe9cf66b700 1 -- 172.21.15.98:0/3883701514 wait complete. 2023-08-22T00:44:20.330 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:20.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.445+0000 7f630598e700 1 Processor -- start 2023-08-22T00:44:20.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.445+0000 7f630598e700 1 -- start start 2023-08-22T00:44:20.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f630598e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f630014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f630598e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f63001544f0 0x7f6300154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f630598e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6300155260 con 0x7f63000c5a90 2023-08-22T00:44:20.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f630598e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000c17b0 con 0x7f63001544f0 2023-08-22T00:44:20.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f630598e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000bf9e0 con 0x7f630014e0d0 2023-08-22T00:44:20.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fe7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f63000c5a90 0x7f63000c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58076/0 (socket says 172.21.15.98:58076) 2023-08-22T00:44:20.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fe7fc700 1 -- 172.21.15.98:0/2010271939 learned_addr learned my addr 172.21.15.98:0/2010271939 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:20.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62ff7fe700 1 --2- 172.21.15.98:0/2010271939 >> v2:172.21.15.118:3300/0 conn(0x7f63001544f0 0x7f6300154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62feffd700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f630014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823440787 0 0) 0x7f6300155260 con 0x7f63000c5a90 2023-08-22T00:44:20.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e80033f0 con 0x7f63000c5a90 2023-08-22T00:44:20.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3150373391 0 0) 0x7f62e80033f0 con 0x7f63000c5a90 2023-08-22T00:44:20.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 msgr2=0x7f630014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f630014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 >> v2:172.21.15.118:3300/0 conn(0x7f63001544f0 msgr2=0x7f6300154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 --2- 172.21.15.98:0/2010271939 >> v2:172.21.15.118:3300/0 conn(0x7f63001544f0 0x7f6300154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000bfcc0 con 0x7f63000c5a90 2023-08-22T00:44:20.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f62f4001470 con 0x7f63000c5a90 2023-08-22T00:44:20.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 >> v1:172.21.15.98:6789/0 conn(0x7f63000c5a90 legacy=0x7f63000c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f62e80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62e8003e10 0x7f62e8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8004b80 0x7f62e8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000c17b0 con 0x7f62e8003e10 2023-08-22T00:44:20.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000bf9e0 con 0x7f62e8004b80 2023-08-22T00:44:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800b8e0 con 0x7f630014e0d0 2023-08-22T00:44:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.446+0000 7f62fe7fc700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62e8003e10 0x7f62e8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62feffd700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f62e80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62ff7fe700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8004b80 0x7f62e8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 -- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 msgr2=0x7f62e80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f630014e0d0 0x7f62e80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 -- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8004b80 msgr2=0x7f62e8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8004b80 0x7f62e8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 -- 172.21.15.98:0/2010271939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80033f0 con 0x7f62e8003e10 2023-08-22T00:44:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fe7fc700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62e8003e10 0x7f62e8004690 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f62f400c240 tx=0x7f63000c68f0).ready entity=mon.0 client_cookie=24d763d2de583b6f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4007a60 con 0x7f62e8003e10 2023-08-22T00:44:20.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f400cad0 con 0x7f62e8003e10 2023-08-22T00:44:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62fdffb700 1 -- 172.21.15.98:0/2010271939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400ce50 con 0x7f62e8003e10 2023-08-22T00:44:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f630598e700 1 -- 172.21.15.98:0/2010271939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62e8003e10 msgr2=0x7f62e8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f630598e700 1 --2- 172.21.15.98:0/2010271939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62e8003e10 0x7f62e8004690 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f62f400c240 tx=0x7f63000c68f0).stop 2023-08-22T00:44:20.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f62ff7fe700 1 -- 172.21.15.98:0/2010271939 reap_dead start 2023-08-22T00:44:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f630598e700 1 -- 172.21.15.98:0/2010271939 shutdown_connections 2023-08-22T00:44:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.447+0000 7f630598e700 1 -- 172.21.15.98:0/2010271939 >> 172.21.15.98:0/2010271939 conn(0x7f63000caa80 msgr2=0x7f63000cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.448+0000 7f630598e700 1 -- 172.21.15.98:0/2010271939 shutdown_connections 2023-08-22T00:44:20.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.448+0000 7f630598e700 1 -- 172.21.15.98:0/2010271939 wait complete. 2023-08-22T00:44:20.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.449+0000 7f630598e700 1 Processor -- start 2023-08-22T00:44:20.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.449+0000 7f630598e700 1 -- start start 2023-08-22T00:44:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8003e10 0x7f630014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63000c4b10 0x7f630014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300151b20 con 0x7f630014f690 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300151da0 con 0x7f62e8003e10 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f630598e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6300152080 con 0x7f63000c4b10 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55032/0 (socket says 172.21.15.98:55032) 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 -- 172.21.15.98:0/4082180059 learned_addr learned my addr 172.21.15.98:0/4082180059 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:20.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62feffd700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8003e10 0x7f630014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62fe7fc700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63000c4b10 0x7f630014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 -- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63000c4b10 msgr2=0x7f630014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63000c4b10 0x7f630014f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.450+0000 7f62ff7fe700 1 -- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8003e10 msgr2=0x7f630014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62ff7fe700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8003e10 0x7f630014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62ff7fe700 1 -- 172.21.15.98:0/4082180059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300152360 con 0x7f630014f690 2023-08-22T00:44:20.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62ff7fe700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f63000c5280 tx=0x7f62f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800e040 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800f040 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300152640 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800fe20 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.451+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63000c2010 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.452+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300047480 con 0x7f630014f690 2023-08-22T00:44:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.452+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f62f8015660 con 0x7f630014f690 2023-08-22T00:44:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.452+0000 7f62e6ffd700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 0x7f62ec0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.453+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f62f807ac50 con 0x7f630014f690 2023-08-22T00:44:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.453+0000 7f62feffd700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 0x7f62ec0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.453+0000 7f62feffd700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 0x7f62ec0613c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f62f0006c40 tx=0x7f62f0008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.457+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62f804bdc0 con 0x7f630014f690 2023-08-22T00:44:20.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.620+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63000bffa0 con 0x7f630014f690 2023-08-22T00:44:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.621+0000 7f62e6ffd700 1 -- 172.21.15.98:0/4082180059 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17332 (secure 0 0 0) 0x7f62f804f3e0 con 0x7f630014f690 2023-08-22T00:44:20.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:20.623 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":202,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:19.985556+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 msgr2=0x7f62ec0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 0x7f62ec0613c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f62f0006c40 tx=0x7f62f0008040).stop 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 msgr2=0x7f63000c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f63000c5280 tx=0x7f62f800b040).stop 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 shutdown_connections 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f62ec05ef00 0x7f62ec0613c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f630014f690 0x7f63000c1b20 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62e8003e10 0x7f630014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 --2- 172.21.15.98:0/4082180059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63000c4b10 0x7f630014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 >> 172.21.15.98:0/4082180059 conn(0x7f63000caa80 msgr2=0x7f63000c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 shutdown_connections 2023-08-22T00:44:20.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.623+0000 7f630598e700 1 -- 172.21.15.98:0/4082180059 wait complete. 2023-08-22T00:44:20.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-22T00:44:20.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.753+0000 7fc3c751b700 1 Processor -- start 2023-08-22T00:44:20.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 -- start start 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3c014ae70 0x7fc3c00c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c00c7370 0x7fc3c00c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c0151e80 con 0x7fc3c014b250 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c0066b90 con 0x7fc3c014ae70 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c751b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0065560 con 0x7fc3c00c7370 2023-08-22T00:44:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.754+0000 7fc3c52b7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3c014ae70 0x7fc3c00c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc3c014ae70 0x7fc3c00c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55044/0 (socket says 172.21.15.98:55044) 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 -- 172.21.15.98:0/3579564660 learned_addr learned my addr 172.21.15.98:0/3579564660 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c5ab8700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc3c014b250 0x7fc3c00c39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58086/0 (socket says 172.21.15.98:58086) 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c4ab6700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c00c7370 0x7fc3c00c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 -- 172.21.15.98:0/3579564660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c00c7370 msgr2=0x7fc3c00c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c00c7370 0x7fc3c00c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 -- 172.21.15.98:0/3579564660 >> v1:172.21.15.98:6789/0 conn(0x7fc3c014b250 legacy=0x7fc3c00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 -- 172.21.15.98:0/3579564660 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0150fb0 con 0x7fc3c014ae70 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3b7fff700 1 -- 172.21.15.98:0/3579564660 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325427584 0 0) 0x7fc3c0151e80 con 0x7fc3c014b250 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c52b7700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014ae70 0x7fc3c00c6e80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7fc3b0006fd0 tx=0x7fc3b00090f0).ready entity=mon.0 client_cookie=b2b70d4954b93841 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3b7fff700 1 -- 172.21.15.98:0/3579564660 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000b580 con 0x7fc3c014ae70 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3b7fff700 1 -- 172.21.15.98:0/3579564660 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b000b6e0 con 0x7fc3c014ae70 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3b7fff700 1 -- 172.21.15.98:0/3579564660 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000ba60 con 0x7fc3c014ae70 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c751b700 1 -- 172.21.15.98:0/3579564660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014ae70 msgr2=0x7fc3c00c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.755+0000 7fc3c751b700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014ae70 0x7fc3c00c6e80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7fc3b0006fd0 tx=0x7fc3b00090f0).stop 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 -- 172.21.15.98:0/3579564660 shutdown_connections 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014ae70 0x7fc3c00c6e80 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 --2- 172.21.15.98:0/3579564660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c00c7370 0x7fc3c00c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 -- 172.21.15.98:0/3579564660 >> 172.21.15.98:0/3579564660 conn(0x7fc3c00c7800 msgr2=0x7fc3c00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 -- 172.21.15.98:0/3579564660 shutdown_connections 2023-08-22T00:44:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.756+0000 7fc3c751b700 1 -- 172.21.15.98:0/3579564660 wait complete. 2023-08-22T00:44:20.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.757+0000 7fc3c751b700 1 Processor -- start 2023-08-22T00:44:20.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.757+0000 7fc3c751b700 1 -- start start 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c00c7370 0x7fc3c0168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c014ae70 0x7fc3c01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0165610 con 0x7fc3c014b250 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0164a00 con 0x7fc3c00c7370 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0164ce0 con 0x7fc3c014ae70 2023-08-22T00:44:20.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55046/0 (socket says 172.21.15.98:55046) 2023-08-22T00:44:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 -- 172.21.15.98:0/365052253 learned_addr learned my addr 172.21.15.98:0/365052253 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c4ab6700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c014ae70 0x7fc3c01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c52b7700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c00c7370 0x7fc3c0168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 -- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c014ae70 msgr2=0x7fc3c01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c014ae70 0x7fc3c01500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 -- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c00c7370 msgr2=0x7fc3c0168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c00c7370 0x7fc3c0168600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 -- 172.21.15.98:0/365052253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009370 con 0x7fc3c014b250 2023-08-22T00:44:20.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c5ab8700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fc3b800c810 tx=0x7fc3b8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8005c70 con 0x7fc3c014b250 2023-08-22T00:44:20.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005df0 con 0x7fc3c014b250 2023-08-22T00:44:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007360 con 0x7fc3c014b250 2023-08-22T00:44:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c0164fc0 con 0x7fc3c014b250 2023-08-22T00:44:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.758+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c0168af0 con 0x7fc3c014b250 2023-08-22T00:44:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.759+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c0069220 con 0x7fc3c014b250 2023-08-22T00:44:20.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.760+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc3b8007710 con 0x7fc3c014b250 2023-08-22T00:44:20.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.760+0000 7fc3b57fa700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 0x7fc3a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:20.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.760+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fc3b807a1d0 con 0x7fc3c014b250 2023-08-22T00:44:20.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.760+0000 7fc3c52b7700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 0x7fc3a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:20.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.760+0000 7fc3c52b7700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 0x7fc3a40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc3b0009130 tx=0x7fc3b0017000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:20.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.764+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3b804b340 con 0x7fc3c014b250 2023-08-22T00:44:20.964 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.963+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3c0151270 con 0x7fc3c014b250 2023-08-22T00:44:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.991+0000 7fc3b57fa700 1 -- 172.21.15.98:0/365052253 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3b804e960 con 0x7fc3c014b250 2023-08-22T00:44:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 msgr2=0x7fc3a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 0x7fc3a40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc3b0009130 tx=0x7fc3b0017000).stop 2023-08-22T00:44:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 msgr2=0x7fc3c00c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fc3b800c810 tx=0x7fc3b8007f30).stop 2023-08-22T00:44:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 shutdown_connections 2023-08-22T00:44:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc3a405ef30 0x7fc3a40613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3c014b250 0x7fc3c00c09f0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c00c7370 0x7fc3c0168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 --2- 172.21.15.98:0/365052253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c014ae70 0x7fc3c01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 >> 172.21.15.98:0/365052253 conn(0x7fc3c00c7800 msgr2=0x7fc3c00c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 shutdown_connections 2023-08-22T00:44:20.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:20.993+0000 7fc3c751b700 1 -- 172.21.15.98:0/365052253 wait complete. 2023-08-22T00:44:21.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-22T00:44:21.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.125+0000 7ff8abf9d700 1 Processor -- start 2023-08-22T00:44:21.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.126+0000 7ff8abf9d700 1 -- start start 2023-08-22T00:44:21.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.126+0000 7ff8abf9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff8a4066150 0x7ff8a4066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.126+0000 7ff8abf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff8a40c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8abf9d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40c69b0 con 0x7ff8a40c5360 2023-08-22T00:44:21.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8abf9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a41542c0 con 0x7ff8a4066150 2023-08-22T00:44:21.130 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8abf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c57f0 con 0x7ff8a4157890 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a9538700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff8a40c5360 0x7ff8a40c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58098/0 (socket says 172.21.15.98:58098) 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a9538700 1 -- 172.21.15.98:0/2474122729 learned_addr learned my addr 172.21.15.98:0/2474122729 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff8a40c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2474122729 >> v2:172.21.15.118:3300/0 conn(0x7ff8a4066150 0x7ff8a4066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966297982 0 0) 0x7ff8a40c69b0 con 0x7ff8a40c5360 2023-08-22T00:44:21.131 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8900033f0 con 0x7ff8a40c5360 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101541822 0 0) 0x7ff8900033f0 con 0x7ff8a40c5360 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 msgr2=0x7ff8a40c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff8a40c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 >> v2:172.21.15.118:3300/0 conn(0x7ff8a4066150 msgr2=0x7ff8a4066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 --2- 172.21.15.98:0/2474122729 >> v2:172.21.15.118:3300/0 conn(0x7ff8a4066150 0x7ff8a4066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40c5ad0 con 0x7ff8a40c5360 2023-08-22T00:44:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff8a0001470 con 0x7ff8a40c5360 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 >> v1:172.21.15.98:6789/0 conn(0x7ff8a40c5360 legacy=0x7ff8a40c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8900038e0 0x7ff890003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff890004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff890004b80 0x7ff890005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41542c0 con 0x7ff890004b80 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c57f0 con 0x7ff8900038e0 2023-08-22T00:44:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89000b8e0 con 0x7ff8a4157890 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff890004b80 0x7ff890005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.127+0000 7ff8a9538700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff890004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8900038e0 0x7ff890003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 msgr2=0x7ff890004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff890004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8900038e0 msgr2=0x7ff890003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:21.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8900038e0 0x7ff890003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2474122729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900033f0 con 0x7ff890004b80 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a9538700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a4157890 0x7ff890004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8900038e0 0x7ff890003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff890004b80 0x7ff890005000 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7ff89c00e210 tx=0x7ff89c00b040).ready entity=mon.0 client_cookie=c1350a157d814163 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c009ac0 con 0x7ff890004b80 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c00f040 con 0x7ff890004b80 2023-08-22T00:44:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8a8d37700 1 -- 172.21.15.98:0/2474122729 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00ecd0 con 0x7ff890004b80 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2474122729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff890004b80 msgr2=0x7ff890005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2474122729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff890004b80 0x7ff890005000 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7ff89c00e210 tx=0x7ff89c00b040).stop 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2474122729 reap_dead start 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2474122729 shutdown_connections 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2474122729 >> 172.21.15.98:0/2474122729 conn(0x7ff8a40c7800 msgr2=0x7ff8a40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2474122729 shutdown_connections 2023-08-22T00:44:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.128+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2474122729 wait complete. 2023-08-22T00:44:21.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 Processor -- start 2023-08-22T00:44:21.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 -- start start 2023-08-22T00:44:21.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff890004b80 0x7ff8a414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a40aba10 0x7ff8a4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40a38d0 con 0x7ff8a40abe90 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4155ef0 con 0x7ff890004b80 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8abf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41561d0 con 0x7ff8a40aba10 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8aa53a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8aa53a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55068/0 (socket says 172.21.15.98:55068) 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.130+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2711129283 learned_addr learned my addr 172.21.15.98:0/2711129283 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff890004b80 0x7ff8a414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8a9538700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a40aba10 0x7ff8a4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a40aba10 msgr2=0x7ff8a4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a40aba10 0x7ff8a4155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff890004b80 msgr2=0x7ff8a414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff890004b80 0x7ff8a414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 -- 172.21.15.98:0/2711129283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a41564b0 con 0x7ff8a40abe90 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8aa53a700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff8900044c0 tx=0x7ff89c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c021030 con 0x7ff8a40abe90 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c009ac0 con 0x7ff8a40abe90 2023-08-22T00:44:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c013e70 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a40a3b20 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.131+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a414fae0 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.132+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a40a3d10 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.132+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff89c024070 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.133+0000 7ff899ffb700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 0x7ff8880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.133+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7ff89c022070 con 0x7ff8a40abe90 2023-08-22T00:44:21.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.133+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 0x7ff8880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:21.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.133+0000 7ff8a9d39700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 0x7ff8880613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff894006f70 tx=0x7ff894008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:21.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.137+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff89c04c790 con 0x7ff8a40abe90 2023-08-22T00:44:21.343 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.342+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8a40c5db0 con 0x7ff8a40abe90 2023-08-22T00:44:22.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:21.999+0000 7ff899ffb700 1 -- 172.21.15.98:0/2711129283 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff89c04fdb0 con 0x7ff8a40abe90 2023-08-22T00:44:22.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 msgr2=0x7ff8880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 0x7ff8880613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff894006f70 tx=0x7ff894008040).stop 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 msgr2=0x7ff8a4155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff8900044c0 tx=0x7ff89c01a000).stop 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 shutdown_connections 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff88805ef30 0x7ff8880613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8a40abe90 0x7ff8a4155960 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff890004b80 0x7ff8a414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 --2- 172.21.15.98:0/2711129283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8a40aba10 0x7ff8a4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 >> 172.21.15.98:0/2711129283 conn(0x7ff8a40c7800 msgr2=0x7ff8a414fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 shutdown_connections 2023-08-22T00:44:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.001+0000 7ff8abf9d700 1 -- 172.21.15.98:0/2711129283 wait complete. 2023-08-22T00:44:22.015 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:22.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.133+0000 7f0fd6f28700 1 Processor -- start 2023-08-22T00:44:22.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.133+0000 7f0fd6f28700 1 -- start start 2023-08-22T00:44:22.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd6f28700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0fd00c61a0 0x7f0fd014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd6f28700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00c17b0 con 0x7f0fd014e0d0 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd6f28700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd0155260 con 0x7f0fd01544f0 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd6f28700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00bf9e0 con 0x7f0fd00c61a0 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fcffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0fd00c61a0 0x7f0fd014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd4cc4700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0fd014e0d0 0x7f0fd00c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58108/0 (socket says 172.21.15.98:58108) 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fd4cc4700 1 -- 172.21.15.98:0/1011902877 learned_addr learned my addr 172.21.15.98:0/1011902877 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:22.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.134+0000 7f0fcffff700 1 --2- 172.21.15.98:0/1011902877 >> v2:172.21.15.98:3300/0 conn(0x7f0fd00c61a0 0x7f0fd014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55074/0 (socket says 172.21.15.98:55074) 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcffff700 1 -- 172.21.15.98:0/1011902877 >> v1:172.21.15.118:6789/0 conn(0x7f0fd01544f0 legacy=0x7f0fd01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcffff700 1 -- 172.21.15.98:0/1011902877 >> v1:172.21.15.98:6789/0 conn(0x7f0fd014e0d0 legacy=0x7f0fd00c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcf7fe700 1 -- 172.21.15.98:0/1011902877 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098414519 0 0) 0x7f0fd00c17b0 con 0x7f0fd014e0d0 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcffff700 1 -- 172.21.15.98:0/1011902877 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00bfcc0 con 0x7f0fd00c61a0 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcffff700 1 --2- 172.21.15.98:0/1011902877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd00c61a0 0x7f0fd014e4b0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f0fbc009760 tx=0x7f0fbc009060).ready entity=mon.0 client_cookie=577ddafa3170dc41 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcf7fe700 1 -- 172.21.15.98:0/1011902877 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00b520 con 0x7f0fd00c61a0 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcf7fe700 1 -- 172.21.15.98:0/1011902877 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc00b680 con 0x7f0fd00c61a0 2023-08-22T00:44:22.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fcf7fe700 1 -- 172.21.15.98:0/1011902877 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00ba00 con 0x7f0fd00c61a0 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1011902877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd00c61a0 msgr2=0x7f0fd014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1011902877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd00c61a0 0x7f0fd014e4b0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f0fbc009760 tx=0x7f0fbc009060).stop 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1011902877 shutdown_connections 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1011902877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd00c61a0 0x7f0fd014e4b0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1011902877 >> 172.21.15.98:0/1011902877 conn(0x7f0fd00caa80 msgr2=0x7f0fd00cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1011902877 shutdown_connections 2023-08-22T00:44:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.135+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1011902877 wait complete. 2023-08-22T00:44:22.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 Processor -- start 2023-08-22T00:44:22.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 -- start start 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fd00c61a0 0x7f0fd0149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd014e0d0 0x7f0fd014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0151070 con 0x7f0fd01544f0 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0150460 con 0x7f0fd014e0d0 2023-08-22T00:44:22.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.137+0000 7f0fd6f28700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0150740 con 0x7f0fd00c61a0 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55088/0 (socket says 172.21.15.98:55088) 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 -- 172.21.15.98:0/1824529716 learned_addr learned my addr 172.21.15.98:0/1824529716 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd4cc4700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fd00c61a0 0x7f0fd0149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fcffff700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd014e0d0 0x7f0fd014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 -- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fd00c61a0 msgr2=0x7f0fd0149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fd00c61a0 0x7f0fd0149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 -- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd014e0d0 msgr2=0x7f0fd014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd014e0d0 0x7f0fd014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 -- 172.21.15.98:0/1824529716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0092a0 con 0x7f0fd01544f0 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd54c5700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f0fc800b7e0 tx=0x7f0fc8009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800d620 con 0x7f0fd01544f0 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800d7c0 con 0x7f0fd01544f0 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0150a20 con 0x7f0fd01544f0 2023-08-22T00:44:22.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800db80 con 0x7f0fd01544f0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.138+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd0149c60 con 0x7f0fd01544f0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.139+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd0047480 con 0x7f0fd01544f0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.139+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0fc800f480 con 0x7f0fd01544f0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.140+0000 7f0fccff9700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 0x7f0fb40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.140+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f0fc807a3a0 con 0x7f0fd01544f0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.140+0000 7f0fd4cc4700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 0x7f0fb40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.140+0000 7f0fd4cc4700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 0x7f0fb40613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fc4007fd0 tx=0x7f0fc4009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.144+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fc804b4b0 con 0x7f0fd01544f0 2023-08-22T00:44:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.348+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fd0064ef0 con 0x7f0fd01544f0 2023-08-22T00:44:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.348+0000 7f0fccff9700 1 -- 172.21.15.98:0/1824529716 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f0fc804ead0 con 0x7f0fd01544f0 2023-08-22T00:44:22.350 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:22.350 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:22.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 msgr2=0x7f0fb40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 0x7f0fb40613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fc4007fd0 tx=0x7f0fc4009040).stop 2023-08-22T00:44:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 msgr2=0x7f0fd01527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f0fc800b7e0 tx=0x7f0fc8009310).stop 2023-08-22T00:44:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 shutdown_connections 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0fb405ef00 0x7f0fb40613c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fd00c61a0 0x7f0fd0149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fd01544f0 0x7f0fd01527f0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 --2- 172.21.15.98:0/1824529716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd014e0d0 0x7f0fd014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 >> 172.21.15.98:0/1824529716 conn(0x7f0fd00caa80 msgr2=0x7f0fd00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 shutdown_connections 2023-08-22T00:44:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.350+0000 7f0fd6f28700 1 -- 172.21.15.98:0/1824529716 wait complete. 2023-08-22T00:44:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:22.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:22.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.478+0000 7f0e52bb8700 1 Processor -- start 2023-08-22T00:44:22.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.478+0000 7f0e52bb8700 1 -- start start 2023-08-22T00:44:22.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e52bb8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e4c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e52bb8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c158bf0 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e52bb8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c157d90 con 0x7f0e4c066620 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e52bb8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c157fe0 con 0x7f0e4c151d60 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0e4c0a6e50 0x7f0e4c065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58110/0 (socket says 172.21.15.98:58110) 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4bfff700 1 -- 172.21.15.98:0/479637272 learned_addr learned my addr 172.21.15.98:0/479637272 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e50954700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e4c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267376978 0 0) 0x7f0e4c158bf0 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c0033f0 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479846497 0 0) 0x7f0e3c0033f0 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 msgr2=0x7f0e4c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e4c155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 >> v1:172.21.15.118:6789/0 conn(0x7f0e4c066620 legacy=0x7f0e4c0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c1582c0 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.479+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f0e38001470 con 0x7f0e4c0a6e50 2023-08-22T00:44:22.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 >> v1:172.21.15.98:6789/0 conn(0x7f0e4c0a6e50 legacy=0x7f0e4c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e3c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c003e00 0x7f0e3c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c004b80 0x7f0e3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c157fe0 con 0x7f0e3c003e00 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c00b8e0 con 0x7f0e3c004b80 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c00baa0 con 0x7f0e4c151d60 2023-08-22T00:44:22.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c003e00 0x7f0e3c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e50954700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e3c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e51155700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c004b80 0x7f0e3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 -- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 msgr2=0x7f0e3c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e3c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 -- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c004b80 msgr2=0x7f0e3c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e3c004b80 0x7f0e3c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 -- 172.21.15.98:0/479637272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0033f0 con 0x7f0e3c003e00 2023-08-22T00:44:22.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e50954700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e4c151d60 0x7f0e3c003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4bfff700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c003e00 0x7f0e3c004690 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f0e3800c160 tx=0x7f0e38001e70).ready entity=mon.0 client_cookie=77215db00297e751 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38007a40 con 0x7f0e3c003e00 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3800ca90 con 0x7f0e3c003e00 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.480+0000 7f0e4b7fe700 1 -- 172.21.15.98:0/479637272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800ce50 con 0x7f0e3c003e00 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 -- 172.21.15.98:0/479637272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c003e00 msgr2=0x7f0e3c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/479637272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e3c003e00 0x7f0e3c004690 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f0e3800c160 tx=0x7f0e38001e70).stop 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e51155700 1 -- 172.21.15.98:0/479637272 reap_dead start 2023-08-22T00:44:22.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 -- 172.21.15.98:0/479637272 shutdown_connections 2023-08-22T00:44:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 -- 172.21.15.98:0/479637272 >> 172.21.15.98:0/479637272 conn(0x7f0e4c06a980 msgr2=0x7f0e4c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 -- 172.21.15.98:0/479637272 shutdown_connections 2023-08-22T00:44:22.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.481+0000 7f0e52bb8700 1 -- 172.21.15.98:0/479637272 wait complete. 2023-08-22T00:44:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.482+0000 7f0e52bb8700 1 Processor -- start 2023-08-22T00:44:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.482+0000 7f0e52bb8700 1 -- start start 2023-08-22T00:44:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c003e00 0x7f0e4c165e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e4c166340 0x7f0e4c0a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0a46f0 con 0x7f0e4c167d50 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0aa2e0 con 0x7f0e4c166340 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e52bb8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0a3a70 con 0x7f0e3c003e00 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55110/0 (socket says 172.21.15.98:55110) 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 -- 172.21.15.98:0/4059288628 learned_addr learned my addr 172.21.15.98:0/4059288628 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e50954700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c003e00 0x7f0e4c165e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e4bfff700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e4c166340 0x7f0e4c0a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 -- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c003e00 msgr2=0x7f0e4c165e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c003e00 0x7f0e4c165e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 -- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e4c166340 msgr2=0x7f0e4c0a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e4c166340 0x7f0e4c0a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 -- 172.21.15.98:0/4059288628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0a3d50 con 0x7f0e4c167d50 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e51155700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f0e4c046df0 tx=0x7f0e44009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440030d0 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44003230 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.483+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44001850 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.484+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0a4030 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.484+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c168250 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.485+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c0a4830 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.485+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0e44001c40 con 0x7f0e4c167d50 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.485+0000 7f0e48ff9700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 0x7f0e300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.485+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f0e44079610 con 0x7f0e4c167d50 2023-08-22T00:44:22.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.485+0000 7f0e50954700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 0x7f0e300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.486+0000 7f0e50954700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 0x7f0e300613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0e4c157030 tx=0x7f0e40008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.489+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e4c0a4830 con 0x7f0e4c167d50 2023-08-22T00:44:22.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.652+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e4c0a4830 con 0x7f0e4c167d50 2023-08-22T00:44:22.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.653+0000 7f0e48ff9700 1 -- 172.21.15.98:0/4059288628 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+17319 (secure 0 0 0) 0x7f0e4c0a4830 con 0x7f0e4c167d50 2023-08-22T00:44:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:22.656 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":203,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:20.987623+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:22.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 msgr2=0x7f0e300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 0x7f0e300613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0e4c157030 tx=0x7f0e40008040).stop 2023-08-22T00:44:22.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 msgr2=0x7f0e4c0a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f0e4c046df0 tx=0x7f0e44009040).stop 2023-08-22T00:44:22.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 shutdown_connections 2023-08-22T00:44:22.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0e3005ef30 0x7f0e300613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3c003e00 0x7f0e4c165e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e4c167d50 0x7f0e4c0a91d0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 --2- 172.21.15.98:0/4059288628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e4c166340 0x7f0e4c0a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 >> 172.21.15.98:0/4059288628 conn(0x7f0e4c06a980 msgr2=0x7f0e4c0c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 shutdown_connections 2023-08-22T00:44:22.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.655+0000 7f0e52bb8700 1 -- 172.21.15.98:0/4059288628 wait complete. 2023-08-22T00:44:22.669 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-22T00:44:22.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:22.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.785+0000 7effa1814700 1 Processor -- start 2023-08-22T00:44:22.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.785+0000 7effa1814700 1 -- start start 2023-08-22T00:44:22.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7effa1814700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c64a0 0x7eff9c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7effa1814700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0c2030 0x7eff9c0bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7effa1814700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0bcd40 con 0x7eff9c154260 2023-08-22T00:44:22.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7effa1814700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0c24b0 con 0x7eff9c0c2030 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7effa1814700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c14e7b0 con 0x7eff9c0c64a0 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7eff9b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0c2030 0x7eff9c0bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7eff9b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7eff9c0c2030 0x7eff9c0bc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55126/0 (socket says 172.21.15.98:55126) 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.786+0000 7eff9b7fe700 1 -- 172.21.15.98:0/1946399784 learned_addr learned my addr 172.21.15.98:0/1946399784 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9a7fc700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c64a0 0x7eff9c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9b7fe700 1 -- 172.21.15.98:0/1946399784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c64a0 msgr2=0x7eff9c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9b7fe700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c64a0 0x7eff9c154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.789 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9b7fe700 1 -- 172.21.15.98:0/1946399784 >> v1:172.21.15.118:6789/0 conn(0x7eff9c154260 legacy=0x7eff9c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:22.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9b7fe700 1 -- 172.21.15.98:0/1946399784 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0c4fb0 con 0x7eff9c0c2030 2023-08-22T00:44:22.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff9b7fe700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0c2030 0x7eff9c0bc850 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7eff94009f50 tx=0x7eff94009840).ready entity=mon.0 client_cookie=4615dcd67254e7fe server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff99ffb700 1 -- 172.21.15.98:0/1946399784 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400e070 con 0x7eff9c0c2030 2023-08-22T00:44:22.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff99ffb700 1 -- 172.21.15.98:0/1946399784 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400bac0 con 0x7eff9c0c2030 2023-08-22T00:44:22.790 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7eff99ffb700 1 -- 172.21.15.98:0/1946399784 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400be40 con 0x7eff9c0c2030 2023-08-22T00:44:22.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 -- 172.21.15.98:0/1946399784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0c2030 msgr2=0x7eff9c0bc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0c2030 0x7eff9c0bc850 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7eff94009f50 tx=0x7eff94009840).stop 2023-08-22T00:44:22.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 -- 172.21.15.98:0/1946399784 shutdown_connections 2023-08-22T00:44:22.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c0c2030 0x7eff9c0bc850 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 --2- 172.21.15.98:0/1946399784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c64a0 0x7eff9c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 -- 172.21.15.98:0/1946399784 >> 172.21.15.98:0/1946399784 conn(0x7eff9c0c3980 msgr2=0x7eff9c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 -- 172.21.15.98:0/1946399784 shutdown_connections 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.787+0000 7effa1814700 1 -- 172.21.15.98:0/1946399784 wait complete. 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 Processor -- start 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 -- start start 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c2030 0x7eff9c0beb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0c64a0 0x7eff9c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c14e030 con 0x7eff9c154260 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0a5450 con 0x7eff9c0c64a0 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.789+0000 7effa1814700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0a5a10 con 0x7eff9c0c2030 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55130/0 (socket says 172.21.15.98:55130) 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 -- 172.21.15.98:0/257908091 learned_addr learned my addr 172.21.15.98:0/257908091 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:22.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9affd700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c2030 0x7eff9c0beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9a7fc700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0c64a0 0x7eff9c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 -- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c2030 msgr2=0x7eff9c0beb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c2030 0x7eff9c0beb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 -- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0c64a0 msgr2=0x7eff9c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0c64a0 0x7eff9c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 -- 172.21.15.98:0/257908091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94009ae0 con 0x7eff9c154260 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff9b7fe700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7eff94013ce0 tx=0x7eff94009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940084e0 con 0x7eff9c154260 2023-08-22T00:44:22.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94008640 con 0x7eff9c154260 2023-08-22T00:44:22.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c164bd0 con 0x7eff9c154260 2023-08-22T00:44:22.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94008a00 con 0x7eff9c154260 2023-08-22T00:44:22.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.790+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0bf4b0 con 0x7eff9c154260 2023-08-22T00:44:22.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.791+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c047480 con 0x7eff9c154260 2023-08-22T00:44:22.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.791+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7eff94003040 con 0x7eff9c154260 2023-08-22T00:44:22.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.792+0000 7eff82ffd700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 0x7eff880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:22.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.792+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7eff9407c000 con 0x7eff9c154260 2023-08-22T00:44:22.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.792+0000 7eff9affd700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 0x7eff880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:22.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.792+0000 7eff9affd700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 0x7eff880613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7eff9000b7f0 tx=0x7eff90008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:22.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.796+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff9404d170 con 0x7eff9c154260 2023-08-22T00:44:22.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.954+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff9c0a5b50 con 0x7eff8805ef30 2023-08-22T00:44:22.965 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.964+0000 7eff82ffd700 1 -- 172.21.15.98:0/257908091 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350611 (secure 0 0 0) 0x7eff9000b3d0 con 0x7eff8805ef30 2023-08-22T00:44:22.968 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 msgr2=0x7eff880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 0x7eff880613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7eff9000b7f0 tx=0x7eff90008040).stop 2023-08-22T00:44:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 msgr2=0x7eff9c1646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7eff94013ce0 tx=0x7eff94009840).stop 2023-08-22T00:44:22.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 shutdown_connections 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7eff8805ef30 0x7eff880613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff9c0c2030 0x7eff9c0beb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9c154260 0x7eff9c1646e0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 --2- 172.21.15.98:0/257908091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff9c0c64a0 0x7eff9c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 >> 172.21.15.98:0/257908091 conn(0x7eff9c0c3980 msgr2=0x7eff9c156840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 shutdown_connections 2023-08-22T00:44:22.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:22.967+0000 7effa1814700 1 -- 172.21.15.98:0/257908091 wait complete. 2023-08-22T00:44:22.972 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:22.980 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:44:21.136132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453568,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752521152,"statfs":{"total":773094113280,"available":770581659648,"internally_reserved":0,"allocated":19922944,"data_stored":10643632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006285"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749188+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:15.749188+0000","last_peered":"2023-08-22T00:44:15.749188+0000","last_clean":"2023-08-22T00:44:15.749188+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:15.749188+0000","last_undegraded":"2023-08-22T00:44:15.749188+0000","last_fullsized":"2023-08-22T00:44:15.749188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.101293+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:15.101293+0000","last_peered":"2023-08-22T00:44:15.101293+0000","last_clean":"2023-08-22T00:44:15.101293+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:15.101293+0000","last_undegraded":"2023-08-22T00:44:15.101293+0000","last_fullsized":"2023-08-22T00:44:15.101293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749190+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:15.749190+0000","last_peered":"2023-08-22T00:44:15.749190+0000","last_clean":"2023-08-22T00:44:15.749190+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:15.749190+0000","last_undegraded":"2023-08-22T00:44:15.749190+0000","last_fullsized":"2023-08-22T00:44:15.749190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088854+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:15.088854+0000","last_peered":"2023-08-22T00:44:15.088854+0000","last_clean":"2023-08-22T00:44:15.088854+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:15.088854+0000","last_undegraded":"2023-08-22T00:44:15.088854+0000","last_fullsized":"2023-08-22T00:44:15.088854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088872+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:15.088872+0000","last_peered":"2023-08-22T00:44:15.088872+0000","last_clean":"2023-08-22T00:44:15.088872+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:15.088872+0000","last_undegraded":"2023-08-22T00:44:15.088872+0000","last_fullsized":"2023-08-22T00:44:15.088872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088855+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:15.088855+0000","last_peered":"2023-08-22T00:44:15.088855+0000","last_clean":"2023-08-22T00:44:15.088855+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:15.088855+0000","last_undegraded":"2023-08-22T00:44:15.088855+0000","last_fullsized":"2023-08-22T00:44:15.088855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.099873+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:15.099873+0000","last_peered":"2023-08-22T00:44:15.099873+0000","last_clean":"2023-08-22T00:44:15.099873+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:15.099873+0000","last_undegraded":"2023-08-22T00:44:15.099873+0000","last_fullsized":"2023-08-22T00:44:15.099873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.58099999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060024,"statfs":{"total":96636764160,"available":96317464576,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.375,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.61599999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.57799999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.252},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.438,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.105},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":1.131}]},{"osd":6,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.44,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.95899999999999996},"last":1.0700000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54600000000000004,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38700000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.51300000000000001,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.372},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":0.65300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59699999999999998,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63700000000000001,"15min":0.65500000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.67500000000000004,"15min":0.69399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.307}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.318}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.54900000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69599999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.754}]},{"osd":1,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.65600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.63400000000000001,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69399999999999995,"5min":0.77200000000000002,"15min":0.79300000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.745},"last":0.47299999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:22.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.134+0000 7fe99c86c700 1 Processor -- start 2023-08-22T00:44:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.134+0000 7fe99c86c700 1 -- start start 2023-08-22T00:44:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99c86c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 0x7fe9981551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99c86c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9980c52d0 0x7fe998065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99c86c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe998063fd0 con 0x7fe998066400 2023-08-22T00:44:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99c86c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980c62e0 con 0x7fe9980c52d0 2023-08-22T00:44:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99c86c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998064290 con 0x7fe99814e660 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9980c52d0 0x7fe998065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9980c52d0 0x7fe998065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55146/0 (socket says 172.21.15.98:55146) 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 -- 172.21.15.98:0/1233772299 learned_addr learned my addr 172.21.15.98:0/1233772299 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe99659c700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 0x7fe9981551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 -- 172.21.15.98:0/1233772299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 msgr2=0x7fe9981551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 0x7fe9981551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 -- 172.21.15.98:0/1233772299 >> v1:172.21.15.118:6789/0 conn(0x7fe998066400 legacy=0x7fe998157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.135+0000 7fe995d9b700 1 -- 172.21.15.98:0/1233772299 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998066870 con 0x7fe9980c52d0 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.136+0000 7fe99659c700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 0x7fe9981551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.136+0000 7fe995d9b700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9980c52d0 0x7fe998065f10 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fe980009810 tx=0x7fe980009060).ready entity=mon.0 client_cookie=ff02b59819ba65f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.136+0000 7fe99559a700 1 -- 172.21.15.98:0/1233772299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980005880 con 0x7fe9980c52d0 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.136+0000 7fe99559a700 1 -- 172.21.15.98:0/1233772299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800059e0 con 0x7fe9980c52d0 2023-08-22T00:44:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.136+0000 7fe99559a700 1 -- 172.21.15.98:0/1233772299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980005d60 con 0x7fe9980c52d0 2023-08-22T00:44:23.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 -- 172.21.15.98:0/1233772299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9980c52d0 msgr2=0x7fe998065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9980c52d0 0x7fe998065f10 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fe980009810 tx=0x7fe980009060).stop 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 -- 172.21.15.98:0/1233772299 shutdown_connections 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe99814e660 0x7fe9981551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 --2- 172.21.15.98:0/1233772299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9980c52d0 0x7fe998065f10 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 -- 172.21.15.98:0/1233772299 >> 172.21.15.98:0/1233772299 conn(0x7fe99806a960 msgr2=0x7fe9980c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 -- 172.21.15.98:0/1233772299 shutdown_connections 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.137+0000 7fe99c86c700 1 -- 172.21.15.98:0/1233772299 wait complete. 2023-08-22T00:44:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.138+0000 7fe99c86c700 1 Processor -- start 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.138+0000 7fe99c86c700 1 -- start start 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe998066400 0x7fe9980a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9980c52d0 0x7fe99814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980a7c20 con 0x7fe99814e660 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980aa250 con 0x7fe998066400 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980a98c0 con 0x7fe9980c52d0 2023-08-22T00:44:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55156/0 (socket says 172.21.15.98:55156) 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 -- 172.21.15.98:0/875994539 learned_addr learned my addr 172.21.15.98:0/875994539 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe995d9b700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9980c52d0 0x7fe99814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99659c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe998066400 0x7fe9980a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 -- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9980c52d0 msgr2=0x7fe99814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9980c52d0 0x7fe99814b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 -- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe998066400 msgr2=0x7fe9980a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe998066400 0x7fe9980a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 -- 172.21.15.98:0/875994539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980009300 con 0x7fe99814e660 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe996d9d700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7fe99000c790 tx=0x7fe9900015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000e4a0 con 0x7fe99814e660 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000e600 con 0x7fe99814e660 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.139+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980ab9f0 con 0x7fe99814e660 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.140+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000e980 con 0x7fe99814e660 2023-08-22T00:44:23.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.140+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980a8c00 con 0x7fe99814e660 2023-08-22T00:44:23.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.140+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998047480 con 0x7fe99814e660 2023-08-22T00:44:23.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.141+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe99001b3b0 con 0x7fe99814e660 2023-08-22T00:44:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.141+0000 7fe98e7fc700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 0x7fe9780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.141+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe9900796e0 con 0x7fe99814e660 2023-08-22T00:44:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.141+0000 7fe99659c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 0x7fe9780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.142+0000 7fe99659c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 0x7fe9780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe9980ad940 tx=0x7fe988008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.145+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe9900488f0 con 0x7fe99814e660 2023-08-22T00:44:23.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.303+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9980c6490 con 0x7fe97805ef30 2023-08-22T00:44:23.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.312+0000 7fe98e7fc700 1 -- 172.21.15.98:0/875994539 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350611 (secure 0 0 0) 0x7fe9980c6490 con 0x7fe97805ef30 2023-08-22T00:44:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:23.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.315+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 msgr2=0x7fe9780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.315+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 0x7fe9780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe9980ad940 tx=0x7fe988008040).stop 2023-08-22T00:44:23.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.315+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 msgr2=0x7fe9980abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.315+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7fe99000c790 tx=0x7fe9900015e0).stop 2023-08-22T00:44:23.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.315+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 shutdown_connections 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe97805ef30 0x7fe9780613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe99814e660 0x7fe9980abcc0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe998066400 0x7fe9980a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 --2- 172.21.15.98:0/875994539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9980c52d0 0x7fe99814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 >> 172.21.15.98:0/875994539 conn(0x7fe99806a960 msgr2=0x7fe9980bc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 shutdown_connections 2023-08-22T00:44:23.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.316+0000 7fe99c86c700 1 -- 172.21.15.98:0/875994539 wait complete. 2023-08-22T00:44:23.322 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:23.329 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:44:23.136416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453568,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752521152,"statfs":{"total":773094113280,"available":770581659648,"internally_reserved":0,"allocated":19922944,"data_stored":10643632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006285"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749188+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:15.749188+0000","last_peered":"2023-08-22T00:44:15.749188+0000","last_clean":"2023-08-22T00:44:15.749188+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:15.749188+0000","last_undegraded":"2023-08-22T00:44:15.749188+0000","last_fullsized":"2023-08-22T00:44:15.749188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.101293+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:15.101293+0000","last_peered":"2023-08-22T00:44:15.101293+0000","last_clean":"2023-08-22T00:44:15.101293+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:15.101293+0000","last_undegraded":"2023-08-22T00:44:15.101293+0000","last_fullsized":"2023-08-22T00:44:15.101293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749190+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:15.749190+0000","last_peered":"2023-08-22T00:44:15.749190+0000","last_clean":"2023-08-22T00:44:15.749190+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:15.749190+0000","last_undegraded":"2023-08-22T00:44:15.749190+0000","last_fullsized":"2023-08-22T00:44:15.749190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088854+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:15.088854+0000","last_peered":"2023-08-22T00:44:15.088854+0000","last_clean":"2023-08-22T00:44:15.088854+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:15.088854+0000","last_undegraded":"2023-08-22T00:44:15.088854+0000","last_fullsized":"2023-08-22T00:44:15.088854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088872+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:15.088872+0000","last_peered":"2023-08-22T00:44:15.088872+0000","last_clean":"2023-08-22T00:44:15.088872+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:15.088872+0000","last_undegraded":"2023-08-22T00:44:15.088872+0000","last_fullsized":"2023-08-22T00:44:15.088872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088855+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:15.088855+0000","last_peered":"2023-08-22T00:44:15.088855+0000","last_clean":"2023-08-22T00:44:15.088855+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:15.088855+0000","last_undegraded":"2023-08-22T00:44:15.088855+0000","last_fullsized":"2023-08-22T00:44:15.088855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.099873+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:15.099873+0000","last_peered":"2023-08-22T00:44:15.099873+0000","last_clean":"2023-08-22T00:44:15.099873+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:15.099873+0000","last_undegraded":"2023-08-22T00:44:15.099873+0000","last_fullsized":"2023-08-22T00:44:15.099873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.58099999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060024,"statfs":{"total":96636764160,"available":96317464576,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.375,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.61599999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.57799999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.252},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.438,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.105},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":1.131}]},{"osd":6,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.44,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.95899999999999996},"last":1.0700000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54600000000000004,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38700000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.51300000000000001,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.372},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":0.65300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59699999999999998,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63700000000000001,"15min":0.65500000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.67500000000000004,"15min":0.69399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.307}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.318}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.54900000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69599999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.754}]},{"osd":1,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.65600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.63400000000000001,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69399999999999995,"5min":0.77200000000000002,"15min":0.79300000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.745},"last":0.47299999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:23.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:23.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.484+0000 7fa609794700 1 Processor -- start 2023-08-22T00:44:23.485 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.484+0000 7fa609794700 1 -- start start 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa609794700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 0x7fa6041584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa609794700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6040bd750 con 0x7fa604066370 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa609794700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6040a7030 con 0x7fa604065f10 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa609794700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040c2010 con 0x7fa604153cf0 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa6037fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa604066370 0x7fa6040c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58124/0 (socket says 172.21.15.98:58124) 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa6037fe700 1 -- 172.21.15.98:0/439836829 learned_addr learned my addr 172.21.15.98:0/439836829 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:23.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa602ffd700 1 --2- 172.21.15.98:0/439836829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 0x7fa6041584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909356476 0 0) 0x7fa6040bd750 con 0x7fa604066370 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ec0033f0 con 0x7fa604066370 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254121440 0 0) 0x7fa5ec0033f0 con 0x7fa604066370 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa602ffd700 1 -- 172.21.15.98:0/439836829 >> v1:172.21.15.118:6789/0 conn(0x7fa604065f10 legacy=0x7fa6040bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa602ffd700 1 -- 172.21.15.98:0/439836829 >> v1:172.21.15.98:6789/0 conn(0x7fa604066370 legacy=0x7fa6040c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.485+0000 7fa602ffd700 1 -- 172.21.15.98:0/439836829 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040a6d50 con 0x7fa604153cf0 2023-08-22T00:44:23.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa602ffd700 1 --2- 172.21.15.98:0/439836829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 0x7fa6041584e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa5f4009790 tx=0x7fa5f4009060).ready entity=mon.2 client_cookie=320959edbfb97f6c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0017f0 con 0x7fa604153cf0 2023-08-22T00:44:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4012410 con 0x7fa604153cf0 2023-08-22T00:44:23.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa601ffb700 1 -- 172.21.15.98:0/439836829 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4012790 con 0x7fa604153cf0 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 -- 172.21.15.98:0/439836829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 msgr2=0x7fa6041584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 --2- 172.21.15.98:0/439836829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 0x7fa6041584e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa5f4009790 tx=0x7fa5f4009060).stop 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 -- 172.21.15.98:0/439836829 shutdown_connections 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 --2- 172.21.15.98:0/439836829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604153cf0 0x7fa6041584e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 -- 172.21.15.98:0/439836829 >> 172.21.15.98:0/439836829 conn(0x7fa6040c7770 msgr2=0x7fa6040c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:23.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 -- 172.21.15.98:0/439836829 shutdown_connections 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.486+0000 7fa609794700 1 -- 172.21.15.98:0/439836829 wait complete. 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 Processor -- start 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 -- start start 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604065f10 0x7fa6040bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa604153cf0 0x7fa60414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040ab180 con 0x7fa604066370 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040ad830 con 0x7fa604153cf0 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa609794700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040aa850 con 0x7fa604065f10 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa6027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa6027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55168/0 (socket says 172.21.15.98:55168) 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.488+0000 7fa6027fc700 1 -- 172.21.15.98:0/744866307 learned_addr learned my addr 172.21.15.98:0/744866307 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa602ffd700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604065f10 0x7fa6040bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6037fe700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa604153cf0 0x7fa60414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 -- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604065f10 msgr2=0x7fa6040bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604065f10 0x7fa6040bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 -- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa604153cf0 msgr2=0x7fa60414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa604153cf0 0x7fa60414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 -- 172.21.15.98:0/744866307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40092a0 con 0x7fa604066370 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa6027fc700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fa5f800c440 tx=0x7fa5f8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8007020 con 0x7fa604066370 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80071a0 con 0x7fa604066370 2023-08-22T00:44:23.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6040aab30 con 0x7fa604066370 2023-08-22T00:44:23.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8007560 con 0x7fa604066370 2023-08-22T00:44:23.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.489+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6040bf720 con 0x7fa604066370 2023-08-22T00:44:23.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.490+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6040ab2f0 con 0x7fa604066370 2023-08-22T00:44:23.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.490+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa5f80068b0 con 0x7fa604066370 2023-08-22T00:44:23.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.491+0000 7fa5eaffd700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 0x7fa5f00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.491+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa5f8079470 con 0x7fa604066370 2023-08-22T00:44:23.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.491+0000 7fa602ffd700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 0x7fa5f00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.491+0000 7fa602ffd700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 0x7fa5f00613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa5f40096e0 tx=0x7fa5f4009060).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.495+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5f80478f0 con 0x7fa604066370 2023-08-22T00:44:23.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.655+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa604047480 con 0x7fa5f005ef30 2023-08-22T00:44:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.664+0000 7fa5eaffd700 1 -- 172.21.15.98:0/744866307 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350611 (secure 0 0 0) 0x7fa604047480 con 0x7fa5f005ef30 2023-08-22T00:44:23.668 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:23.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 msgr2=0x7fa5f00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 0x7fa5f00613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa5f40096e0 tx=0x7fa5f4009060).stop 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 msgr2=0x7fa6040ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fa5f800c440 tx=0x7fa5f8007dd0).stop 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 shutdown_connections 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa5f005ef30 0x7fa5f00613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa604065f10 0x7fa6040bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa604153cf0 0x7fa60414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 --2- 172.21.15.98:0/744866307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa604066370 0x7fa6040ad340 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 >> 172.21.15.98:0/744866307 conn(0x7fa6040c7770 msgr2=0x7fa6041540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:23.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 shutdown_connections 2023-08-22T00:44:23.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.667+0000 7fa609794700 1 -- 172.21.15.98:0/744866307 wait complete. 2023-08-22T00:44:23.672 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:23.680 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:44:23.136416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453568,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752521152,"statfs":{"total":773094113280,"available":770581659648,"internally_reserved":0,"allocated":19922944,"data_stored":10643632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006285"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749188+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:15.749188+0000","last_peered":"2023-08-22T00:44:15.749188+0000","last_clean":"2023-08-22T00:44:15.749188+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:15.749188+0000","last_undegraded":"2023-08-22T00:44:15.749188+0000","last_fullsized":"2023-08-22T00:44:15.749188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.101293+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:15.101293+0000","last_peered":"2023-08-22T00:44:15.101293+0000","last_clean":"2023-08-22T00:44:15.101293+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:15.101293+0000","last_undegraded":"2023-08-22T00:44:15.101293+0000","last_fullsized":"2023-08-22T00:44:15.101293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749190+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:15.749190+0000","last_peered":"2023-08-22T00:44:15.749190+0000","last_clean":"2023-08-22T00:44:15.749190+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:15.749190+0000","last_undegraded":"2023-08-22T00:44:15.749190+0000","last_fullsized":"2023-08-22T00:44:15.749190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088854+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:15.088854+0000","last_peered":"2023-08-22T00:44:15.088854+0000","last_clean":"2023-08-22T00:44:15.088854+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:15.088854+0000","last_undegraded":"2023-08-22T00:44:15.088854+0000","last_fullsized":"2023-08-22T00:44:15.088854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088872+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:15.088872+0000","last_peered":"2023-08-22T00:44:15.088872+0000","last_clean":"2023-08-22T00:44:15.088872+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:15.088872+0000","last_undegraded":"2023-08-22T00:44:15.088872+0000","last_fullsized":"2023-08-22T00:44:15.088872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088855+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:15.088855+0000","last_peered":"2023-08-22T00:44:15.088855+0000","last_clean":"2023-08-22T00:44:15.088855+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:15.088855+0000","last_undegraded":"2023-08-22T00:44:15.088855+0000","last_fullsized":"2023-08-22T00:44:15.088855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.099873+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:15.099873+0000","last_peered":"2023-08-22T00:44:15.099873+0000","last_clean":"2023-08-22T00:44:15.099873+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:15.099873+0000","last_undegraded":"2023-08-22T00:44:15.099873+0000","last_fullsized":"2023-08-22T00:44:15.099873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.58099999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060024,"statfs":{"total":96636764160,"available":96317464576,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.375,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.61599999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.57799999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.252},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.438,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.105},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":1.131}]},{"osd":6,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.44,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.95899999999999996},"last":1.0700000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54600000000000004,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38700000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.51300000000000001,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.372},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":0.65300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59699999999999998,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63700000000000001,"15min":0.65500000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.67500000000000004,"15min":0.69399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.307}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.318}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.54900000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69599999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.754}]},{"osd":1,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.65600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.63400000000000001,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69399999999999995,"5min":0.77200000000000002,"15min":0.79300000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.745},"last":0.47299999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-08-22T00:44:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-08-22T00:44:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-08-22T00:44:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-08-22T00:44:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-08-22T00:44:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-08-22T00:44:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-08-22T00:44:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-08-22T00:44:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-08-22T00:44:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-08-22T00:44:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-08-22T00:44:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-08-22T00:44:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-08-22T00:44:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-08-22T00:44:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-08-22T00:44:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-08-22T00:44:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-08-22T00:44:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-08-22T00:44:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-08-22T00:44:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-08-22T00:44:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-08-22T00:44:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-08-22T00:44:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-08-22T00:44:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-08-22T00:44:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-08-22T00:44:23.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-08-22T00:44:23.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-08-22T00:44:23.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-08-22T00:44:23.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-08-22T00:44:23.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-08-22T00:44:23.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-08-22T00:44:23.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-08-22T00:44:23.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-08-22T00:44:23.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-08-22T00:44:23.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-08-22T00:44:23.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-08-22T00:44:23.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-08-22T00:44:23.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-08-22T00:44:23.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-08-22T00:44:23.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-08-22T00:44:23.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-08-22T00:44:23.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-08-22T00:44:23.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-08-22T00:44:23.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-08-22T00:44:23.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-08-22T00:44:23.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-08-22T00:44:23.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-08-22T00:44:23.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-08-22T00:44:23.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-08-22T00:44:23.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-08-22T00:44:23.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-08-22T00:44:23.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-08-22T00:44:23.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-08-22T00:44:23.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-08-22T00:44:23.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-08-22T00:44:23.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-08-22T00:44:23.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-08-22T00:44:23.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-08-22T00:44:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-08-22T00:44:23.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-08-22T00:44:23.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-08-22T00:44:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-08-22T00:44:23.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-08-22T00:44:23.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-08-22T00:44:23.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-08-22T00:44:23.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-08-22T00:44:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-08-22T00:44:23.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-08-22T00:44:23.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-08-22T00:44:23.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-08-22T00:44:23.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-08-22T00:44:23.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-08-22T00:44:23.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-08-22T00:44:23.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-08-22T00:44:23.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-08-22T00:44:23.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-08-22T00:44:23.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-08-22T00:44:23.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-08-22T00:44:23.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-08-22T00:44:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-08-22T00:44:23.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-08-22T00:44:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-08-22T00:44:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-08-22T00:44:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-08-22T00:44:23.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-08-22T00:44:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-08-22T00:44:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-08-22T00:44:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-08-22T00:44:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-08-22T00:44:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-08-22T00:44:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-08-22T00:44:23.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-08-22T00:44:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-08-22T00:44:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-08-22T00:44:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-08-22T00:44:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-08-22T00:44:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-08-22T00:44:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-08-22T00:44:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-08-22T00:44:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-08-22T00:44:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-08-22T00:44:23.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-08-22T00:44:23.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-08-22T00:44:23.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-08-22T00:44:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-08-22T00:44:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-08-22T00:44:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-08-22T00:44:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-08-22T00:44:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-08-22T00:44:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-08-22T00:44:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-08-22T00:44:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-08-22T00:44:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-08-22T00:44:23.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-08-22T00:44:23.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-08-22T00:44:23.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-08-22T00:44:23.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-08-22T00:44:23.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-08-22T00:44:23.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-08-22T00:44:23.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-08-22T00:44:23.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-08-22T00:44:23.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-08-22T00:44:23.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-08-22T00:44:23.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-08-22T00:44:23.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-08-22T00:44:23.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-08-22T00:44:23.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-08-22T00:44:23.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:19.602888+0000', 'last_change': '2023-08-22T00:44:19.602888+0000', 'last_active': '2023-08-22T00:44:19.602888+0000', 'last_peered': '2023-08-22T00:44:19.602888+0000', 'last_clean': '2023-08-22T00:44:19.602888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:19.602888+0000', 'last_undegraded': '2023-08-22T00:44:19.602888+0000', 'last_fullsized': '2023-08-22T00:44:19.602888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:19.602888+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-08-22T00:44:23.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-22T00:44:18.600433+0000', 'last_change': '2023-08-22T00:44:18.600433+0000', 'last_active': '2023-08-22T00:44:18.600433+0000', 'last_peered': '2023-08-22T00:44:18.600433+0000', 'last_clean': '2023-08-22T00:44:18.600433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-22T00:44:18.600433+0000', 'last_undegraded': '2023-08-22T00:44:18.600433+0000', 'last_fullsized': '2023-08-22T00:44:18.600433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'last_clean_scrub_stamp': '2023-08-22T00:44:18.600433+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-22T00:44:23.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-22T00:44:23.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.925+0000 7fabd896f700 1 Processor -- start 2023-08-22T00:44:23.926 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.925+0000 7fabd896f700 1 -- start start 2023-08-22T00:44:23.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd896f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabd414e0d0 0x7fabd414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd896f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd40c17b0 con 0x7fabd40c5a90 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd896f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd4155260 con 0x7fabd41544f0 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd896f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40bf9e0 con 0x7fabd414e0d0 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd1d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fabd40c5a90 0x7fabd40c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58140/0 (socket says 172.21.15.98:58140) 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd1d9b700 1 -- 172.21.15.98:0/240460426 learned_addr learned my addr 172.21.15.98:0/240460426 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96050763 0 0) 0x7fabd40c17b0 con 0x7fabd40c5a90 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd259c700 1 --2- 172.21.15.98:0/240460426 >> v2:172.21.15.118:3300/0 conn(0x7fabd414e0d0 0x7fabd414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.926+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc0033f0 con 0x7fabd40c5a90 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165726537 0 0) 0x7fabbc0033f0 con 0x7fabd40c5a90 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 >> v2:172.21.15.118:3300/0 conn(0x7fabd414e0d0 msgr2=0x7fabd414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 --2- 172.21.15.98:0/240460426 >> v2:172.21.15.118:3300/0 conn(0x7fabd414e0d0 0x7fabd414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 >> v1:172.21.15.118:6789/0 conn(0x7fabd41544f0 legacy=0x7fabd41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40bfcc0 con 0x7fabd40c5a90 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fabc4001470 con 0x7fabd40c5a90 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 >> v1:172.21.15.98:6789/0 conn(0x7fabd40c5a90 legacy=0x7fabd40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabbc0038e0 0x7fabbc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabbc004690 0x7fabbc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabbc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40bf9e0 con 0x7fabbc005000 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc00bf60 con 0x7fabbc0038e0 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc00c0f0 con 0x7fabbc004690 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabbc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd259c700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabbc0038e0 0x7fabbc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd1d9b700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabbc004690 0x7fabbc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 -- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabbc004690 msgr2=0x7fabbc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabbc004690 0x7fabbc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 -- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabbc0038e0 msgr2=0x7fabbc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabbc0038e0 0x7fabbc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 -- 172.21.15.98:0/240460426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0033f0 con 0x7fabbc005000 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 -- 172.21.15.98:0/240460426 reap_dead start 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd2d9d700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabbc00b8e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fabcc001e30 tx=0x7fabcc007f30).ready entity=mon.0 client_cookie=be38d8a1934c5524 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc006a20 con 0x7fabbc005000 2023-08-22T00:44:23.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc006b80 con 0x7fabbc005000 2023-08-22T00:44:23.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.927+0000 7fabd159a700 1 -- 172.21.15.98:0/240460426 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00c5d0 con 0x7fabbc005000 2023-08-22T00:44:23.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 -- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 msgr2=0x7fabbc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabbc00b8e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fabcc001e30 tx=0x7fabcc007f30).stop 2023-08-22T00:44:23.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 -- 172.21.15.98:0/240460426 shutdown_connections 2023-08-22T00:44:23.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 --2- 172.21.15.98:0/240460426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabbc00b8e0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 -- 172.21.15.98:0/240460426 >> 172.21.15.98:0/240460426 conn(0x7fabd40caa80 msgr2=0x7fabd40cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:23.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 -- 172.21.15.98:0/240460426 shutdown_connections 2023-08-22T00:44:23.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.928+0000 7fabd896f700 1 -- 172.21.15.98:0/240460426 wait complete. 2023-08-22T00:44:23.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.929+0000 7fabd896f700 1 Processor -- start 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.929+0000 7fabd896f700 1 -- start start 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabd41578e0 0x7fabd4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabd40af3b0 0x7fabd40af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40c2dc0 con 0x7fabbc005000 2023-08-22T00:44:23.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4158250 con 0x7fabd41578e0 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd896f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b0120 con 0x7fabd40af3b0 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55174/0 (socket says 172.21.15.98:55174) 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 -- 172.21.15.98:0/3999553109 learned_addr learned my addr 172.21.15.98:0/3999553109 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd2d9d700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabd40af3b0 0x7fabd40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd1d9b700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabd41578e0 0x7fabd4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 -- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabd40af3b0 msgr2=0x7fabd40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabd40af3b0 0x7fabd40af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 -- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabd41578e0 msgr2=0x7fabd4157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabd41578e0 0x7fabd4157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.930+0000 7fabd259c700 1 -- 172.21.15.98:0/3999553109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40c2770 con 0x7fabbc005000 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabd259c700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7fabc80119f0 tx=0x7fabc8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800f6e0 con 0x7fabbc005000 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800f840 con 0x7fabbc005000 2023-08-22T00:44:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800fbc0 con 0x7fabbc005000 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd40c2a50 con 0x7fabbc005000 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.931+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd40afd20 con 0x7fabbc005000 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.932+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd40c30a0 con 0x7fabbc005000 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.932+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fabc8014440 con 0x7fabbc005000 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.932+0000 7fabc27fc700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 0x7fabb40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.932+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fabc807a5c0 con 0x7fabbc005000 2023-08-22T00:44:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.933+0000 7fabd1d9b700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 0x7fabb40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.933+0000 7fabd1d9b700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 0x7fabb40613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fabc4000e10 tx=0x7fabc4007040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:23.937+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fabc804b6d0 con 0x7fabbc005000 2023-08-22T00:44:24.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.159+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fabd4047480 con 0x7fabbc005000 2023-08-22T00:44:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.159+0000 7fabc27fc700 1 -- 172.21.15.98:0/3999553109 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1027 (secure 0 0 0) 0x7fabc804ecf0 con 0x7fabbc005000 2023-08-22T00:44:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:24.161 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2312,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":203,"num_osds":8,"num_up_osds":8,"osd_up_since":1692662760,"num_in_osds":8,"osd_in_since":1692662753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2512453632,"bytes_avail":770581659648,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":75,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9810}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-08-22T00:43:54.903045+0000","services":{}},"progress_events":{}} 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 msgr2=0x7fabb40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 0x7fabb40613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fabc4000e10 tx=0x7fabc4007040).stop 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 msgr2=0x7fabd4166e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7fabc80119f0 tx=0x7fabc8009060).stop 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 shutdown_connections 2023-08-22T00:44:24.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fabb405ef30 0x7fabb40613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabd40af3b0 0x7fabd40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabbc005000 0x7fabd4166e60 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 --2- 172.21.15.98:0/3999553109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabd41578e0 0x7fabd4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.161+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 >> 172.21.15.98:0/3999553109 conn(0x7fabd40caa80 msgr2=0x7fabd40c06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.162+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 shutdown_connections 2023-08-22T00:44:24.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.162+0000 7fabd896f700 1 -- 172.21.15.98:0/3999553109 wait complete. 2023-08-22T00:44:24.174 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-22T00:44:24.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:24.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.289+0000 7f71b86d7700 1 Processor -- start 2023-08-22T00:44:24.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.289+0000 7f71b86d7700 1 -- start start 2023-08-22T00:44:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b86d7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71b0153cf0 0x7f71b01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b86d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b0065f10 0x7f71b0066370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b86d7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00bd750 con 0x7f71b00bdbe0 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b86d7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00a7030 con 0x7f71b0153cf0 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b86d7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c2010 con 0x7f71b0065f10 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b6473700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71b0153cf0 0x7f71b01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b6473700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71b0153cf0 0x7f71b01584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55182/0 (socket says 172.21.15.98:55182) 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b6473700 1 -- 172.21.15.98:0/2459989651 learned_addr learned my addr 172.21.15.98:0/2459989651 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b6c74700 1 --1- 172.21.15.98:0/2459989651 >> v1:172.21.15.98:6789/0 conn(0x7f71b00bdbe0 0x7f71b00c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58146/0 (socket says 172.21.15.98:58146) 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.290+0000 7f71b5c72700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b0065f10 0x7f71b0066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b6473700 1 -- 172.21.15.98:0/2459989651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b0065f10 msgr2=0x7f71b0066370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b6473700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b0065f10 0x7f71b0066370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b6473700 1 -- 172.21.15.98:0/2459989651 >> v1:172.21.15.98:6789/0 conn(0x7f71b00bdbe0 legacy=0x7f71b00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b6473700 1 -- 172.21.15.98:0/2459989651 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00a6d50 con 0x7f71b0153cf0 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b5471700 1 -- 172.21.15.98:0/2459989651 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257825251 0 0) 0x7f71b00bd750 con 0x7f71b00bdbe0 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b6473700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0153cf0 0x7f71b01584e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f71a0006fd0 tx=0x7f71a00090f0).ready entity=mon.0 client_cookie=dca29648f9ea3ee8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b5471700 1 -- 172.21.15.98:0/2459989651 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000b580 con 0x7f71b0153cf0 2023-08-22T00:44:24.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b5471700 1 -- 172.21.15.98:0/2459989651 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000b6e0 con 0x7f71b0153cf0 2023-08-22T00:44:24.295 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b5471700 1 -- 172.21.15.98:0/2459989651 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000ba60 con 0x7f71b0153cf0 2023-08-22T00:44:24.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 -- 172.21.15.98:0/2459989651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0153cf0 msgr2=0x7f71b01584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0153cf0 0x7f71b01584e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f71a0006fd0 tx=0x7f71a00090f0).stop 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 -- 172.21.15.98:0/2459989651 shutdown_connections 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0153cf0 0x7f71b01584e0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2459989651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b0065f10 0x7f71b0066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 -- 172.21.15.98:0/2459989651 >> 172.21.15.98:0/2459989651 conn(0x7f71b00c7770 msgr2=0x7f71b00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 -- 172.21.15.98:0/2459989651 shutdown_connections 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.291+0000 7f71b86d7700 1 -- 172.21.15.98:0/2459989651 wait complete. 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 Processor -- start 2023-08-22T00:44:24.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 -- start start 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b00bdbe0 0x7f71b0167c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b0153cf0 0x7f71b01680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01685e0 con 0x7f71b0065f10 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01570a0 con 0x7f71b0153cf0 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b86d7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b014ce40 con 0x7f71b00bdbe0 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b6473700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b6473700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55194/0 (socket says 172.21.15.98:55194) 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.293+0000 7f71b6473700 1 -- 172.21.15.98:0/2806053342 learned_addr learned my addr 172.21.15.98:0/2806053342 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b5c72700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b00bdbe0 0x7f71b0167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6c74700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b0153cf0 0x7f71b01680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 -- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b00bdbe0 msgr2=0x7f71b0167c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b00bdbe0 0x7f71b0167c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 -- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b0153cf0 msgr2=0x7f71b01680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b0153cf0 0x7f71b01680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 -- 172.21.15.98:0/2806053342 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0009370 con 0x7f71b0065f10 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b6473700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f71a0009130 tx=0x7f71a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0000bc0 con 0x7f71b0065f10 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000b850 con 0x7f71b0065f10 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0000d20 con 0x7f71b0065f10 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b014d120 con 0x7f71b0065f10 2023-08-22T00:44:24.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.294+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b014d6e0 con 0x7f71b0065f10 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.295+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b0047480 con 0x7f71b0065f10 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.295+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f71a001bb00 con 0x7f71b0065f10 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.296+0000 7f71a67fc700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 0x7f71940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.296+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f71a007bba0 con 0x7f71b0065f10 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.296+0000 7f71b5c72700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 0x7f71940613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:24.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.296+0000 7f71b5c72700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 0x7f71940613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f71b00c7510 tx=0x7f71ac009060).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:24.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.300+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71a004cdc0 con 0x7f71b0065f10 2023-08-22T00:44:24.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:44:24.449 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:44:24.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.455+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71b00bd100 con 0x7f719405ef30 2023-08-22T00:44:24.466 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.465+0000 7f71a67fc700 1 -- 172.21.15.98:0/2806053342 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350611 (secure 0 0 0) 0x7f71b00bd100 con 0x7f719405ef30 2023-08-22T00:44:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 msgr2=0x7f71940613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 0x7f71940613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f71b00c7510 tx=0x7f71ac009060).stop 2023-08-22T00:44:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 msgr2=0x7f71b014b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:24.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f71a0009130 tx=0x7f71a0017000).stop 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 shutdown_connections 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f719405ef30 0x7f71940613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b0153cf0 0x7f71b01680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71b0065f10 0x7f71b014b810 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 --2- 172.21.15.98:0/2806053342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71b00bdbe0 0x7f71b0167c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 >> 172.21.15.98:0/2806053342 conn(0x7f71b00c7770 msgr2=0x7f71b00a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:24.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 shutdown_connections 2023-08-22T00:44:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:24.469+0000 7f71b86d7700 1 -- 172.21.15.98:0/2806053342 wait complete. 2023-08-22T00:44:24.473 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:24.482 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-22T00:44:23.136416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453568,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752521152,"statfs":{"total":773094113280,"available":770581659648,"internally_reserved":0,"allocated":19922944,"data_stored":10643632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006285"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749188+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:15.749188+0000","last_peered":"2023-08-22T00:44:15.749188+0000","last_clean":"2023-08-22T00:44:15.749188+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:15.749188+0000","last_undegraded":"2023-08-22T00:44:15.749188+0000","last_fullsized":"2023-08-22T00:44:15.749188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.101293+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:15.101293+0000","last_peered":"2023-08-22T00:44:15.101293+0000","last_clean":"2023-08-22T00:44:15.101293+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:15.101293+0000","last_undegraded":"2023-08-22T00:44:15.101293+0000","last_fullsized":"2023-08-22T00:44:15.101293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749190+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:15.749190+0000","last_peered":"2023-08-22T00:44:15.749190+0000","last_clean":"2023-08-22T00:44:15.749190+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:15.749190+0000","last_undegraded":"2023-08-22T00:44:15.749190+0000","last_fullsized":"2023-08-22T00:44:15.749190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088854+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:15.088854+0000","last_peered":"2023-08-22T00:44:15.088854+0000","last_clean":"2023-08-22T00:44:15.088854+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:15.088854+0000","last_undegraded":"2023-08-22T00:44:15.088854+0000","last_fullsized":"2023-08-22T00:44:15.088854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088872+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:15.088872+0000","last_peered":"2023-08-22T00:44:15.088872+0000","last_clean":"2023-08-22T00:44:15.088872+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:15.088872+0000","last_undegraded":"2023-08-22T00:44:15.088872+0000","last_fullsized":"2023-08-22T00:44:15.088872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.088855+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:15.088855+0000","last_peered":"2023-08-22T00:44:15.088855+0000","last_clean":"2023-08-22T00:44:15.088855+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:15.088855+0000","last_undegraded":"2023-08-22T00:44:15.088855+0000","last_fullsized":"2023-08-22T00:44:15.088855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.749293+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:15.749293+0000","last_peered":"2023-08-22T00:44:15.749293+0000","last_clean":"2023-08-22T00:44:15.749293+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:15.749293+0000","last_undegraded":"2023-08-22T00:44:15.749293+0000","last_fullsized":"2023-08-22T00:44:15.749293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:19.602888+0000","last_change":"2023-08-22T00:44:19.602888+0000","last_active":"2023-08-22T00:44:19.602888+0000","last_peered":"2023-08-22T00:44:19.602888+0000","last_clean":"2023-08-22T00:44:19.602888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:19.602888+0000","last_undegraded":"2023-08-22T00:44:19.602888+0000","last_fullsized":"2023-08-22T00:44:19.602888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-22T00:44:18.600433+0000","last_change":"2023-08-22T00:44:18.600433+0000","last_active":"2023-08-22T00:44:18.600433+0000","last_peered":"2023-08-22T00:44:18.600433+0000","last_clean":"2023-08-22T00:44:18.600433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-22T00:44:18.600433+0000","last_undegraded":"2023-08-22T00:44:18.600433+0000","last_fullsized":"2023-08-22T00:44:18.600433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-22T00:44:15.099873+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:15.099873+0000","last_peered":"2023-08-22T00:44:15.099873+0000","last_clean":"2023-08-22T00:44:15.099873+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:15.099873+0000","last_undegraded":"2023-08-22T00:44:15.099873+0000","last_fullsized":"2023-08-22T00:44:15.099873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.58099999999999996}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060024,"statfs":{"total":96636764160,"available":96317464576,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834575297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.375,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.61599999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.57799999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.252},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.438,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.105},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":1.131}]},{"osd":6,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.44,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.95899999999999996},"last":1.0700000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54600000000000004,"5min":0.66300000000000003,"15min":0.71199999999999997},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38700000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.51300000000000001,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.372},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":0.65300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.90100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59699999999999998,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.84699999999999998,"15min":0.93899999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.95999999999999996},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63700000000000001,"15min":0.65500000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.67500000000000004,"15min":0.69399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.307}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.318}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303624,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068216,"statfs":{"total":96636764160,"available":96325853184,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.54900000000000004}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46600000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1330454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69599999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.754}]},{"osd":1,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.65600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.63400000000000001,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69399999999999995,"5min":0.77200000000000002,"15min":0.79300000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.745},"last":0.47299999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:25.481 INFO:tasks.ceph.mds.a.smithi098.stderr:2023-08-22T00:44:25.480+0000 7f938cd44700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:44:27.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:27.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.619+0000 7fd34278c700 1 Processor -- start 2023-08-22T00:44:27.621 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.619+0000 7fd34278c700 1 -- start start 2023-08-22T00:44:27.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd34278c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 0x7fd33c152150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd34278c700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0634b0 con 0x7fd33c0660d0 2023-08-22T00:44:27.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd34278c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0bd680 con 0x7fd33c0664b0 2023-08-22T00:44:27.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd34278c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0bde30 con 0x7fd33c064950 2023-08-22T00:44:27.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd33bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd33c0660d0 0x7fd33c0a6a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58160/0 (socket says 172.21.15.98:58160) 2023-08-22T00:44:27.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.620+0000 7fd33bfff700 1 -- 172.21.15.98:0/2264038228 learned_addr learned my addr 172.21.15.98:0/2264038228 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:27.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd340d29700 1 --2- 172.21.15.98:0/2264038228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 0x7fd33c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994854020 0 0) 0x7fd33c0634b0 con 0x7fd33c0660d0 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3280033f0 con 0x7fd33c0660d0 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533191035 0 0) 0x7fd33c0bd680 con 0x7fd33c0664b0 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c0634b0 con 0x7fd33c0664b0 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd340d29700 1 -- 172.21.15.98:0/2264038228 >> v1:172.21.15.118:6789/0 conn(0x7fd33c0664b0 legacy=0x7fd33c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd340d29700 1 -- 172.21.15.98:0/2264038228 >> v1:172.21.15.98:6789/0 conn(0x7fd33c0660d0 legacy=0x7fd33c0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd340d29700 1 -- 172.21.15.98:0/2264038228 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0be110 con 0x7fd33c064950 2023-08-22T00:44:27.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd340d29700 1 --2- 172.21.15.98:0/2264038228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 0x7fd33c152150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd33c064de0 tx=0x7fd334009780).ready entity=mon.2 client_cookie=c5803e71b7097c62 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400e070 con 0x7fd33c064950 2023-08-22T00:44:27.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400bab0 con 0x7fd33c064950 2023-08-22T00:44:27.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.621+0000 7fd33affd700 1 -- 172.21.15.98:0/2264038228 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400be30 con 0x7fd33c064950 2023-08-22T00:44:27.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 -- 172.21.15.98:0/2264038228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 msgr2=0x7fd33c152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 --2- 172.21.15.98:0/2264038228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 0x7fd33c152150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd33c064de0 tx=0x7fd334009780).stop 2023-08-22T00:44:27.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 -- 172.21.15.98:0/2264038228 shutdown_connections 2023-08-22T00:44:27.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 --2- 172.21.15.98:0/2264038228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c064950 0x7fd33c152150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 -- 172.21.15.98:0/2264038228 >> 172.21.15.98:0/2264038228 conn(0x7fd33c06a980 msgr2=0x7fd33c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:27.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 -- 172.21.15.98:0/2264038228 shutdown_connections 2023-08-22T00:44:27.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.622+0000 7fd34278c700 1 -- 172.21.15.98:0/2264038228 wait complete. 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.623+0000 7fd34278c700 1 Processor -- start 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.623+0000 7fd34278c700 1 -- start start 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd33c064950 0x7fd33c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c0660d0 0x7fd33c0c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c14a100 con 0x7fd33c0664b0 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c162750 con 0x7fd33c064950 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd34278c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c161e40 con 0x7fd33c0660d0 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd340d29700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd340d29700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55198/0 (socket says 172.21.15.98:55198) 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd340d29700 1 -- 172.21.15.98:0/2520627999 learned_addr learned my addr 172.21.15.98:0/2520627999 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd33b7fe700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c0660d0 0x7fd33c0c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.624+0000 7fd33bfff700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd33c064950 0x7fd33c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 -- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c0660d0 msgr2=0x7fd33c0c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c0660d0 0x7fd33c0c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 -- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd33c064950 msgr2=0x7fd33c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd33c064950 0x7fd33c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 -- 172.21.15.98:0/2520627999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009a20 con 0x7fd33c0664b0 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd340d29700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7fd33400b610 tx=0x7fd334009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334013e50 con 0x7fd33c0664b0 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33401d630 con 0x7fd33c0664b0 2023-08-22T00:44:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0c1540 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33401d9d0 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.625+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c1623e0 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.626+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd334003040 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.627+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c1628e0 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.627+0000 7fd333fff700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 0x7fd31c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.627+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd33407bdf0 con 0x7fd33c0664b0 2023-08-22T00:44:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.627+0000 7fd33bfff700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 0x7fd31c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.627+0000 7fd33bfff700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 0x7fd31c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd324005750 tx=0x7fd324009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.632+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd33404cf60 con 0x7fd33c0664b0 2023-08-22T00:44:27.792 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.790+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd33c047480 con 0x7fd31c05ef30 2023-08-22T00:44:27.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.799+0000 7fd333fff700 1 -- 172.21.15.98:0/2520627999 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362454 (secure 0 0 0) 0x7fd33c047480 con 0x7fd31c05ef30 2023-08-22T00:44:27.804 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:27.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 msgr2=0x7fd31c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 0x7fd31c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd324005750 tx=0x7fd324009040).stop 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 msgr2=0x7fd33c0a9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7fd33400b610 tx=0x7fd334009780).stop 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 shutdown_connections 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fd31c05ef30 0x7fd31c0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd33c0664b0 0x7fd33c0a9090 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd33c064950 0x7fd33c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 --2- 172.21.15.98:0/2520627999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd33c0660d0 0x7fd33c0c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 >> 172.21.15.98:0/2520627999 conn(0x7fd33c06a980 msgr2=0x7fd33c0a7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 shutdown_connections 2023-08-22T00:44:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.803+0000 7fd34278c700 1 -- 172.21.15.98:0/2520627999 wait complete. 2023-08-22T00:44:27.808 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:27.816 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-22T00:44:27.137555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":249,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454016,"kb_used_data":19904,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520704,"statfs":{"total":773094113280,"available":770581200896,"internally_reserved":0,"allocated":20381696,"data_stored":10874700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007017"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012769+0000","last_change":"2023-08-22T00:44:20.005008+0000","last_active":"2023-08-22T00:44:20.012769+0000","last_peered":"2023-08-22T00:44:20.012769+0000","last_clean":"2023-08-22T00:44:20.012769+0000","last_became_active":"2023-08-22T00:44:20.004563+0000","last_became_peered":"2023-08-22T00:44:20.004563+0000","last_unstale":"2023-08-22T00:44:20.012769+0000","last_undegraded":"2023-08-22T00:44:20.012769+0000","last_fullsized":"2023-08-22T00:44:20.012769+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015838+0000","last_change":"2023-08-22T00:44:19.633471+0000","last_active":"2023-08-22T00:44:20.015838+0000","last_peered":"2023-08-22T00:44:20.015838+0000","last_clean":"2023-08-22T00:44:20.015838+0000","last_became_active":"2023-08-22T00:44:19.631342+0000","last_became_peered":"2023-08-22T00:44:19.631342+0000","last_unstale":"2023-08-22T00:44:20.015838+0000","last_undegraded":"2023-08-22T00:44:20.015838+0000","last_fullsized":"2023-08-22T00:44:20.015838+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013806+0000","last_change":"2023-08-22T00:44:20.013045+0000","last_active":"2023-08-22T00:44:20.013806+0000","last_peered":"2023-08-22T00:44:20.013806+0000","last_clean":"2023-08-22T00:44:20.013806+0000","last_became_active":"2023-08-22T00:44:20.012760+0000","last_became_peered":"2023-08-22T00:44:20.012760+0000","last_unstale":"2023-08-22T00:44:20.013806+0000","last_undegraded":"2023-08-22T00:44:20.013806+0000","last_fullsized":"2023-08-22T00:44:20.013806+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.001793+0000","last_change":"2023-08-22T00:44:19.625512+0000","last_active":"2023-08-22T00:44:20.001793+0000","last_peered":"2023-08-22T00:44:20.001793+0000","last_clean":"2023-08-22T00:44:20.001793+0000","last_became_active":"2023-08-22T00:44:19.625189+0000","last_became_peered":"2023-08-22T00:44:19.625189+0000","last_unstale":"2023-08-22T00:44:20.001793+0000","last_undegraded":"2023-08-22T00:44:20.001793+0000","last_fullsized":"2023-08-22T00:44:20.001793+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012576+0000","last_change":"2023-08-22T00:44:20.004584+0000","last_active":"2023-08-22T00:44:20.012576+0000","last_peered":"2023-08-22T00:44:20.012576+0000","last_clean":"2023-08-22T00:44:20.012576+0000","last_became_active":"2023-08-22T00:44:20.004280+0000","last_became_peered":"2023-08-22T00:44:20.004280+0000","last_unstale":"2023-08-22T00:44:20.012576+0000","last_undegraded":"2023-08-22T00:44:20.012576+0000","last_fullsized":"2023-08-22T00:44:20.012576+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.002067+0000","last_change":"2023-08-22T00:44:19.630662+0000","last_active":"2023-08-22T00:44:20.002067+0000","last_peered":"2023-08-22T00:44:20.002067+0000","last_clean":"2023-08-22T00:44:20.002067+0000","last_became_active":"2023-08-22T00:44:19.630385+0000","last_became_peered":"2023-08-22T00:44:19.630385+0000","last_unstale":"2023-08-22T00:44:20.002067+0000","last_undegraded":"2023-08-22T00:44:20.002067+0000","last_fullsized":"2023-08-22T00:44:20.002067+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.001232+0000","last_change":"2023-08-22T00:44:19.999582+0000","last_active":"2023-08-22T00:44:20.001232+0000","last_peered":"2023-08-22T00:44:20.001232+0000","last_clean":"2023-08-22T00:44:20.001232+0000","last_became_active":"2023-08-22T00:44:19.999046+0000","last_became_peered":"2023-08-22T00:44:19.999046+0000","last_unstale":"2023-08-22T00:44:20.001232+0000","last_undegraded":"2023-08-22T00:44:20.001232+0000","last_fullsized":"2023-08-22T00:44:20.001232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017337+0000","last_change":"2023-08-22T00:44:19.629507+0000","last_active":"2023-08-22T00:44:20.017337+0000","last_peered":"2023-08-22T00:44:20.017337+0000","last_clean":"2023-08-22T00:44:20.017337+0000","last_became_active":"2023-08-22T00:44:19.628364+0000","last_became_peered":"2023-08-22T00:44:19.628364+0000","last_unstale":"2023-08-22T00:44:20.017337+0000","last_undegraded":"2023-08-22T00:44:20.017337+0000","last_fullsized":"2023-08-22T00:44:20.017337+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.007269+0000","last_change":"2023-08-22T00:44:20.001957+0000","last_active":"2023-08-22T00:44:20.007269+0000","last_peered":"2023-08-22T00:44:20.007269+0000","last_clean":"2023-08-22T00:44:20.007269+0000","last_became_active":"2023-08-22T00:44:20.001682+0000","last_became_peered":"2023-08-22T00:44:20.001682+0000","last_unstale":"2023-08-22T00:44:20.007269+0000","last_undegraded":"2023-08-22T00:44:20.007269+0000","last_fullsized":"2023-08-22T00:44:20.007269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.010731+0000","last_change":"2023-08-22T00:44:19.634801+0000","last_active":"2023-08-22T00:44:20.010731+0000","last_peered":"2023-08-22T00:44:20.010731+0000","last_clean":"2023-08-22T00:44:20.010731+0000","last_became_active":"2023-08-22T00:44:19.634566+0000","last_became_peered":"2023-08-22T00:44:19.634566+0000","last_unstale":"2023-08-22T00:44:20.010731+0000","last_undegraded":"2023-08-22T00:44:20.010731+0000","last_fullsized":"2023-08-22T00:44:20.010731+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013996+0000","last_change":"2023-08-22T00:44:20.008599+0000","last_active":"2023-08-22T00:44:20.013996+0000","last_peered":"2023-08-22T00:44:20.013996+0000","last_clean":"2023-08-22T00:44:20.013996+0000","last_became_active":"2023-08-22T00:44:20.008324+0000","last_became_peered":"2023-08-22T00:44:20.008324+0000","last_unstale":"2023-08-22T00:44:20.013996+0000","last_undegraded":"2023-08-22T00:44:20.013996+0000","last_fullsized":"2023-08-22T00:44:20.013996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016057+0000","last_change":"2023-08-22T00:44:19.631982+0000","last_active":"2023-08-22T00:44:20.016057+0000","last_peered":"2023-08-22T00:44:20.016057+0000","last_clean":"2023-08-22T00:44:20.016057+0000","last_became_active":"2023-08-22T00:44:19.631694+0000","last_became_peered":"2023-08-22T00:44:19.631694+0000","last_unstale":"2023-08-22T00:44:20.016057+0000","last_undegraded":"2023-08-22T00:44:20.016057+0000","last_fullsized":"2023-08-22T00:44:20.016057+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.021542+0000","last_change":"2023-08-22T00:44:20.014692+0000","last_active":"2023-08-22T00:44:20.021542+0000","last_peered":"2023-08-22T00:44:20.021542+0000","last_clean":"2023-08-22T00:44:20.021542+0000","last_became_active":"2023-08-22T00:44:20.014480+0000","last_became_peered":"2023-08-22T00:44:20.014480+0000","last_unstale":"2023-08-22T00:44:20.021542+0000","last_undegraded":"2023-08-22T00:44:20.021542+0000","last_fullsized":"2023-08-22T00:44:20.021542+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.990096+0000","last_change":"2023-08-22T00:44:19.629821+0000","last_active":"2023-08-22T00:44:19.990096+0000","last_peered":"2023-08-22T00:44:19.990096+0000","last_clean":"2023-08-22T00:44:19.990096+0000","last_became_active":"2023-08-22T00:44:19.629366+0000","last_became_peered":"2023-08-22T00:44:19.629366+0000","last_unstale":"2023-08-22T00:44:19.990096+0000","last_undegraded":"2023-08-22T00:44:19.990096+0000","last_fullsized":"2023-08-22T00:44:19.990096+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017938+0000","last_change":"2023-08-22T00:44:20.015036+0000","last_active":"2023-08-22T00:44:20.017938+0000","last_peered":"2023-08-22T00:44:20.017938+0000","last_clean":"2023-08-22T00:44:20.017938+0000","last_became_active":"2023-08-22T00:44:20.014818+0000","last_became_peered":"2023-08-22T00:44:20.014818+0000","last_unstale":"2023-08-22T00:44:20.017938+0000","last_undegraded":"2023-08-22T00:44:20.017938+0000","last_fullsized":"2023-08-22T00:44:20.017938+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.989271+0000","last_change":"2023-08-22T00:44:19.630995+0000","last_active":"2023-08-22T00:44:19.989271+0000","last_peered":"2023-08-22T00:44:19.989271+0000","last_clean":"2023-08-22T00:44:19.989271+0000","last_became_active":"2023-08-22T00:44:19.630560+0000","last_became_peered":"2023-08-22T00:44:19.630560+0000","last_unstale":"2023-08-22T00:44:19.989271+0000","last_undegraded":"2023-08-22T00:44:19.989271+0000","last_fullsized":"2023-08-22T00:44:19.989271+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012965+0000","last_change":"2023-08-22T00:44:20.006903+0000","last_active":"2023-08-22T00:44:20.012965+0000","last_peered":"2023-08-22T00:44:20.012965+0000","last_clean":"2023-08-22T00:44:20.012965+0000","last_became_active":"2023-08-22T00:44:20.005338+0000","last_became_peered":"2023-08-22T00:44:20.005338+0000","last_unstale":"2023-08-22T00:44:20.012965+0000","last_undegraded":"2023-08-22T00:44:20.012965+0000","last_fullsized":"2023-08-22T00:44:20.012965+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.990584+0000","last_change":"2023-08-22T00:44:19.630275+0000","last_active":"2023-08-22T00:44:19.990584+0000","last_peered":"2023-08-22T00:44:19.990584+0000","last_clean":"2023-08-22T00:44:19.990584+0000","last_became_active":"2023-08-22T00:44:19.629987+0000","last_became_peered":"2023-08-22T00:44:19.629987+0000","last_unstale":"2023-08-22T00:44:19.990584+0000","last_undegraded":"2023-08-22T00:44:19.990584+0000","last_fullsized":"2023-08-22T00:44:19.990584+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.001501+0000","last_change":"2023-08-22T00:44:19.996637+0000","last_active":"2023-08-22T00:44:20.001501+0000","last_peered":"2023-08-22T00:44:20.001501+0000","last_clean":"2023-08-22T00:44:20.001501+0000","last_became_active":"2023-08-22T00:44:19.996324+0000","last_became_peered":"2023-08-22T00:44:19.996324+0000","last_unstale":"2023-08-22T00:44:20.001501+0000","last_undegraded":"2023-08-22T00:44:20.001501+0000","last_fullsized":"2023-08-22T00:44:20.001501+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991160+0000","last_change":"2023-08-22T00:44:19.636565+0000","last_active":"2023-08-22T00:44:19.991160+0000","last_peered":"2023-08-22T00:44:19.991160+0000","last_clean":"2023-08-22T00:44:19.991160+0000","last_became_active":"2023-08-22T00:44:19.636346+0000","last_became_peered":"2023-08-22T00:44:19.636346+0000","last_unstale":"2023-08-22T00:44:19.991160+0000","last_undegraded":"2023-08-22T00:44:19.991160+0000","last_fullsized":"2023-08-22T00:44:19.991160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013496+0000","last_change":"2023-08-22T00:44:20.008925+0000","last_active":"2023-08-22T00:44:20.013496+0000","last_peered":"2023-08-22T00:44:20.013496+0000","last_clean":"2023-08-22T00:44:20.013496+0000","last_became_active":"2023-08-22T00:44:20.008649+0000","last_became_peered":"2023-08-22T00:44:20.008649+0000","last_unstale":"2023-08-22T00:44:20.013496+0000","last_undegraded":"2023-08-22T00:44:20.013496+0000","last_fullsized":"2023-08-22T00:44:20.013496+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.993641+0000","last_change":"2023-08-22T00:44:19.637603+0000","last_active":"2023-08-22T00:44:19.993641+0000","last_peered":"2023-08-22T00:44:19.993641+0000","last_clean":"2023-08-22T00:44:19.993641+0000","last_became_active":"2023-08-22T00:44:19.637330+0000","last_became_peered":"2023-08-22T00:44:19.637330+0000","last_unstale":"2023-08-22T00:44:19.993641+0000","last_undegraded":"2023-08-22T00:44:19.993641+0000","last_fullsized":"2023-08-22T00:44:19.993641+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.018069+0000","last_change":"2023-08-22T00:44:20.015080+0000","last_active":"2023-08-22T00:44:20.018069+0000","last_peered":"2023-08-22T00:44:20.018069+0000","last_clean":"2023-08-22T00:44:20.018069+0000","last_became_active":"2023-08-22T00:44:20.014263+0000","last_became_peered":"2023-08-22T00:44:20.014263+0000","last_unstale":"2023-08-22T00:44:20.018069+0000","last_undegraded":"2023-08-22T00:44:20.018069+0000","last_fullsized":"2023-08-22T00:44:20.018069+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.34","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.020315+0000","last_change":"2023-08-22T00:44:19.635668+0000","last_active":"2023-08-22T00:44:20.020315+0000","last_peered":"2023-08-22T00:44:20.020315+0000","last_clean":"2023-08-22T00:44:20.020315+0000","last_became_active":"2023-08-22T00:44:19.635372+0000","last_became_peered":"2023-08-22T00:44:19.635372+0000","last_unstale":"2023-08-22T00:44:20.020315+0000","last_undegraded":"2023-08-22T00:44:20.020315+0000","last_fullsized":"2023-08-22T00:44:20.020315+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.009310+0000","last_change":"2023-08-22T00:44:20.007217+0000","last_active":"2023-08-22T00:44:20.009310+0000","last_peered":"2023-08-22T00:44:20.009310+0000","last_clean":"2023-08-22T00:44:20.009310+0000","last_became_active":"2023-08-22T00:44:20.006866+0000","last_became_peered":"2023-08-22T00:44:20.006866+0000","last_unstale":"2023-08-22T00:44:20.009310+0000","last_undegraded":"2023-08-22T00:44:20.009310+0000","last_fullsized":"2023-08-22T00:44:20.009310+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.008543+0000","last_change":"2023-08-22T00:44:19.622389+0000","last_active":"2023-08-22T00:44:20.008543+0000","last_peered":"2023-08-22T00:44:20.008543+0000","last_clean":"2023-08-22T00:44:20.008543+0000","last_became_active":"2023-08-22T00:44:19.622128+0000","last_became_peered":"2023-08-22T00:44:19.622128+0000","last_unstale":"2023-08-22T00:44:20.008543+0000","last_undegraded":"2023-08-22T00:44:20.008543+0000","last_fullsized":"2023-08-22T00:44:20.008543+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.014688+0000","last_change":"2023-08-22T00:44:20.011409+0000","last_active":"2023-08-22T00:44:20.014688+0000","last_peered":"2023-08-22T00:44:20.014688+0000","last_clean":"2023-08-22T00:44:20.014688+0000","last_became_active":"2023-08-22T00:44:20.011081+0000","last_became_peered":"2023-08-22T00:44:20.011081+0000","last_unstale":"2023-08-22T00:44:20.014688+0000","last_undegraded":"2023-08-22T00:44:20.014688+0000","last_fullsized":"2023-08-22T00:44:20.014688+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.000982+0000","last_change":"2023-08-22T00:44:19.638248+0000","last_active":"2023-08-22T00:44:20.000982+0000","last_peered":"2023-08-22T00:44:20.000982+0000","last_clean":"2023-08-22T00:44:20.000982+0000","last_became_active":"2023-08-22T00:44:19.637024+0000","last_became_peered":"2023-08-22T00:44:19.637024+0000","last_unstale":"2023-08-22T00:44:20.000982+0000","last_undegraded":"2023-08-22T00:44:20.000982+0000","last_fullsized":"2023-08-22T00:44:20.000982+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013587+0000","last_change":"2023-08-22T00:44:20.009879+0000","last_active":"2023-08-22T00:44:20.013587+0000","last_peered":"2023-08-22T00:44:20.013587+0000","last_clean":"2023-08-22T00:44:20.013587+0000","last_became_active":"2023-08-22T00:44:20.009581+0000","last_became_peered":"2023-08-22T00:44:20.009581+0000","last_unstale":"2023-08-22T00:44:20.013587+0000","last_undegraded":"2023-08-22T00:44:20.013587+0000","last_fullsized":"2023-08-22T00:44:20.013587+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991086+0000","last_change":"2023-08-22T00:44:19.634999+0000","last_active":"2023-08-22T00:44:19.991086+0000","last_peered":"2023-08-22T00:44:19.991086+0000","last_clean":"2023-08-22T00:44:19.991086+0000","last_became_active":"2023-08-22T00:44:19.634757+0000","last_became_peered":"2023-08-22T00:44:19.634757+0000","last_unstale":"2023-08-22T00:44:19.991086+0000","last_undegraded":"2023-08-22T00:44:19.991086+0000","last_fullsized":"2023-08-22T00:44:19.991086+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012224+0000","last_change":"2023-08-22T00:44:20.000699+0000","last_active":"2023-08-22T00:44:20.012224+0000","last_peered":"2023-08-22T00:44:20.012224+0000","last_clean":"2023-08-22T00:44:20.012224+0000","last_became_active":"2023-08-22T00:44:20.000420+0000","last_became_peered":"2023-08-22T00:44:20.000420+0000","last_unstale":"2023-08-22T00:44:20.012224+0000","last_undegraded":"2023-08-22T00:44:20.012224+0000","last_fullsized":"2023-08-22T00:44:20.012224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017596+0000","last_change":"2023-08-22T00:44:19.622610+0000","last_active":"2023-08-22T00:44:20.017596+0000","last_peered":"2023-08-22T00:44:20.017596+0000","last_clean":"2023-08-22T00:44:20.017596+0000","last_became_active":"2023-08-22T00:44:19.621866+0000","last_became_peered":"2023-08-22T00:44:19.621866+0000","last_unstale":"2023-08-22T00:44:20.017596+0000","last_undegraded":"2023-08-22T00:44:20.017596+0000","last_fullsized":"2023-08-22T00:44:20.017596+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.011855+0000","last_change":"2023-08-22T00:44:20.008845+0000","last_active":"2023-08-22T00:44:20.011855+0000","last_peered":"2023-08-22T00:44:20.011855+0000","last_clean":"2023-08-22T00:44:20.011855+0000","last_became_active":"2023-08-22T00:44:20.008546+0000","last_became_peered":"2023-08-22T00:44:20.008546+0000","last_unstale":"2023-08-22T00:44:20.011855+0000","last_undegraded":"2023-08-22T00:44:20.011855+0000","last_fullsized":"2023-08-22T00:44:20.011855+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.990679+0000","last_change":"2023-08-22T00:44:19.631553+0000","last_active":"2023-08-22T00:44:19.990679+0000","last_peered":"2023-08-22T00:44:19.990679+0000","last_clean":"2023-08-22T00:44:19.990679+0000","last_became_active":"2023-08-22T00:44:19.631281+0000","last_became_peered":"2023-08-22T00:44:19.631281+0000","last_unstale":"2023-08-22T00:44:19.990679+0000","last_undegraded":"2023-08-22T00:44:19.990679+0000","last_fullsized":"2023-08-22T00:44:19.990679+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016232+0000","last_change":"2023-08-22T00:44:20.013312+0000","last_active":"2023-08-22T00:44:20.016232+0000","last_peered":"2023-08-22T00:44:20.016232+0000","last_clean":"2023-08-22T00:44:20.016232+0000","last_became_active":"2023-08-22T00:44:20.013043+0000","last_became_peered":"2023-08-22T00:44:20.013043+0000","last_unstale":"2023-08-22T00:44:20.016232+0000","last_undegraded":"2023-08-22T00:44:20.016232+0000","last_fullsized":"2023-08-22T00:44:20.016232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.993533+0000","last_change":"2023-08-22T00:44:19.628284+0000","last_active":"2023-08-22T00:44:19.993533+0000","last_peered":"2023-08-22T00:44:19.993533+0000","last_clean":"2023-08-22T00:44:19.993533+0000","last_became_active":"2023-08-22T00:44:19.628058+0000","last_became_peered":"2023-08-22T00:44:19.628058+0000","last_unstale":"2023-08-22T00:44:19.993533+0000","last_undegraded":"2023-08-22T00:44:19.993533+0000","last_fullsized":"2023-08-22T00:44:19.993533+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016441+0000","last_change":"2023-08-22T00:44:20.013457+0000","last_active":"2023-08-22T00:44:20.016441+0000","last_peered":"2023-08-22T00:44:20.016441+0000","last_clean":"2023-08-22T00:44:20.016441+0000","last_became_active":"2023-08-22T00:44:20.013185+0000","last_became_peered":"2023-08-22T00:44:20.013185+0000","last_unstale":"2023-08-22T00:44:20.016441+0000","last_undegraded":"2023-08-22T00:44:20.016441+0000","last_fullsized":"2023-08-22T00:44:20.016441+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.010109+0000","last_change":"2023-08-22T00:44:19.634204+0000","last_active":"2023-08-22T00:44:20.010109+0000","last_peered":"2023-08-22T00:44:20.010109+0000","last_clean":"2023-08-22T00:44:20.010109+0000","last_became_active":"2023-08-22T00:44:19.633916+0000","last_became_peered":"2023-08-22T00:44:19.633916+0000","last_unstale":"2023-08-22T00:44:20.010109+0000","last_undegraded":"2023-08-22T00:44:20.010109+0000","last_fullsized":"2023-08-22T00:44:20.010109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015427+0000","last_change":"2023-08-22T00:44:20.008311+0000","last_active":"2023-08-22T00:44:20.015427+0000","last_peered":"2023-08-22T00:44:20.015427+0000","last_clean":"2023-08-22T00:44:20.015427+0000","last_became_active":"2023-08-22T00:44:20.008034+0000","last_became_peered":"2023-08-22T00:44:20.008034+0000","last_unstale":"2023-08-22T00:44:20.015427+0000","last_undegraded":"2023-08-22T00:44:20.015427+0000","last_fullsized":"2023-08-22T00:44:20.015427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.995898+0000","last_change":"2023-08-22T00:44:19.627896+0000","last_active":"2023-08-22T00:44:19.995898+0000","last_peered":"2023-08-22T00:44:19.995898+0000","last_clean":"2023-08-22T00:44:19.995898+0000","last_became_active":"2023-08-22T00:44:19.627618+0000","last_became_peered":"2023-08-22T00:44:19.627618+0000","last_unstale":"2023-08-22T00:44:19.995898+0000","last_undegraded":"2023-08-22T00:44:19.995898+0000","last_fullsized":"2023-08-22T00:44:19.995898+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017122+0000","last_change":"2023-08-22T00:44:20.007413+0000","last_active":"2023-08-22T00:44:20.017122+0000","last_peered":"2023-08-22T00:44:20.017122+0000","last_clean":"2023-08-22T00:44:20.017122+0000","last_became_active":"2023-08-22T00:44:20.006950+0000","last_became_peered":"2023-08-22T00:44:20.006950+0000","last_unstale":"2023-08-22T00:44:20.017122+0000","last_undegraded":"2023-08-22T00:44:20.017122+0000","last_fullsized":"2023-08-22T00:44:20.017122+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012258+0000","last_change":"2023-08-22T00:44:19.633239+0000","last_active":"2023-08-22T00:44:20.012258+0000","last_peered":"2023-08-22T00:44:20.012258+0000","last_clean":"2023-08-22T00:44:20.012258+0000","last_became_active":"2023-08-22T00:44:19.632963+0000","last_became_peered":"2023-08-22T00:44:19.632963+0000","last_unstale":"2023-08-22T00:44:20.012258+0000","last_undegraded":"2023-08-22T00:44:20.012258+0000","last_fullsized":"2023-08-22T00:44:20.012258+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013964+0000","last_change":"2023-08-22T00:44:20.008305+0000","last_active":"2023-08-22T00:44:20.013964+0000","last_peered":"2023-08-22T00:44:20.013964+0000","last_clean":"2023-08-22T00:44:20.013964+0000","last_became_active":"2023-08-22T00:44:20.008122+0000","last_became_peered":"2023-08-22T00:44:20.008122+0000","last_unstale":"2023-08-22T00:44:20.013964+0000","last_undegraded":"2023-08-22T00:44:20.013964+0000","last_fullsized":"2023-08-22T00:44:20.013964+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999124+0000","last_change":"2023-08-22T00:44:19.638614+0000","last_active":"2023-08-22T00:44:19.999124+0000","last_peered":"2023-08-22T00:44:19.999124+0000","last_clean":"2023-08-22T00:44:19.999124+0000","last_became_active":"2023-08-22T00:44:19.638346+0000","last_became_peered":"2023-08-22T00:44:19.638346+0000","last_unstale":"2023-08-22T00:44:19.999124+0000","last_undegraded":"2023-08-22T00:44:19.999124+0000","last_fullsized":"2023-08-22T00:44:19.999124+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013562+0000","last_change":"2023-08-22T00:44:20.009445+0000","last_active":"2023-08-22T00:44:20.013562+0000","last_peered":"2023-08-22T00:44:20.013562+0000","last_clean":"2023-08-22T00:44:20.013562+0000","last_became_active":"2023-08-22T00:44:20.009195+0000","last_became_peered":"2023-08-22T00:44:20.009195+0000","last_unstale":"2023-08-22T00:44:20.013562+0000","last_undegraded":"2023-08-22T00:44:20.013562+0000","last_fullsized":"2023-08-22T00:44:20.013562+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.000337+0000","last_change":"2023-08-22T00:44:19.631560+0000","last_active":"2023-08-22T00:44:20.000337+0000","last_peered":"2023-08-22T00:44:20.000337+0000","last_clean":"2023-08-22T00:44:20.000337+0000","last_became_active":"2023-08-22T00:44:19.631263+0000","last_became_peered":"2023-08-22T00:44:19.631263+0000","last_unstale":"2023-08-22T00:44:20.000337+0000","last_undegraded":"2023-08-22T00:44:20.000337+0000","last_fullsized":"2023-08-22T00:44:20.000337+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015039+0000","last_change":"2023-08-22T00:44:20.007417+0000","last_active":"2023-08-22T00:44:20.015039+0000","last_peered":"2023-08-22T00:44:20.015039+0000","last_clean":"2023-08-22T00:44:20.015039+0000","last_became_active":"2023-08-22T00:44:20.007052+0000","last_became_peered":"2023-08-22T00:44:20.007052+0000","last_unstale":"2023-08-22T00:44:20.015039+0000","last_undegraded":"2023-08-22T00:44:20.015039+0000","last_fullsized":"2023-08-22T00:44:20.015039+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.001728+0000","last_change":"2023-08-22T00:44:19.626642+0000","last_active":"2023-08-22T00:44:20.001728+0000","last_peered":"2023-08-22T00:44:20.001728+0000","last_clean":"2023-08-22T00:44:20.001728+0000","last_became_active":"2023-08-22T00:44:19.621496+0000","last_became_peered":"2023-08-22T00:44:19.621496+0000","last_unstale":"2023-08-22T00:44:20.001728+0000","last_undegraded":"2023-08-22T00:44:20.001728+0000","last_fullsized":"2023-08-22T00:44:20.001728+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015739+0000","last_change":"2023-08-22T00:44:20.010883+0000","last_active":"2023-08-22T00:44:20.015739+0000","last_peered":"2023-08-22T00:44:20.015739+0000","last_clean":"2023-08-22T00:44:20.015739+0000","last_became_active":"2023-08-22T00:44:20.010592+0000","last_became_peered":"2023-08-22T00:44:20.010592+0000","last_unstale":"2023-08-22T00:44:20.015739+0000","last_undegraded":"2023-08-22T00:44:20.015739+0000","last_fullsized":"2023-08-22T00:44:20.015739+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.996341+0000","last_change":"2023-08-22T00:44:19.625121+0000","last_active":"2023-08-22T00:44:19.996341+0000","last_peered":"2023-08-22T00:44:19.996341+0000","last_clean":"2023-08-22T00:44:19.996341+0000","last_became_active":"2023-08-22T00:44:19.624838+0000","last_became_peered":"2023-08-22T00:44:19.624838+0000","last_unstale":"2023-08-22T00:44:19.996341+0000","last_undegraded":"2023-08-22T00:44:19.996341+0000","last_fullsized":"2023-08-22T00:44:19.996341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.014478+0000","last_change":"2023-08-22T00:44:20.009555+0000","last_active":"2023-08-22T00:44:20.014478+0000","last_peered":"2023-08-22T00:44:20.014478+0000","last_clean":"2023-08-22T00:44:20.014478+0000","last_became_active":"2023-08-22T00:44:20.009225+0000","last_became_peered":"2023-08-22T00:44:20.009225+0000","last_unstale":"2023-08-22T00:44:20.014478+0000","last_undegraded":"2023-08-22T00:44:20.014478+0000","last_fullsized":"2023-08-22T00:44:20.014478+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.996199+0000","last_change":"2023-08-22T00:44:19.631179+0000","last_active":"2023-08-22T00:44:19.996199+0000","last_peered":"2023-08-22T00:44:19.996199+0000","last_clean":"2023-08-22T00:44:19.996199+0000","last_became_active":"2023-08-22T00:44:19.630899+0000","last_became_peered":"2023-08-22T00:44:19.630899+0000","last_unstale":"2023-08-22T00:44:19.996199+0000","last_undegraded":"2023-08-22T00:44:19.996199+0000","last_fullsized":"2023-08-22T00:44:19.996199+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.011357+0000","last_change":"2023-08-22T00:44:20.005309+0000","last_active":"2023-08-22T00:44:20.011357+0000","last_peered":"2023-08-22T00:44:20.011357+0000","last_clean":"2023-08-22T00:44:20.011357+0000","last_became_active":"2023-08-22T00:44:20.005051+0000","last_became_peered":"2023-08-22T00:44:20.005051+0000","last_unstale":"2023-08-22T00:44:20.011357+0000","last_undegraded":"2023-08-22T00:44:20.011357+0000","last_fullsized":"2023-08-22T00:44:20.011357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999499+0000","last_change":"2023-08-22T00:44:19.637907+0000","last_active":"2023-08-22T00:44:19.999499+0000","last_peered":"2023-08-22T00:44:19.999499+0000","last_clean":"2023-08-22T00:44:19.999499+0000","last_became_active":"2023-08-22T00:44:19.637575+0000","last_became_peered":"2023-08-22T00:44:19.637575+0000","last_unstale":"2023-08-22T00:44:19.999499+0000","last_undegraded":"2023-08-22T00:44:19.999499+0000","last_fullsized":"2023-08-22T00:44:19.999499+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.001252+0000","last_change":"2023-08-22T00:44:19.999736+0000","last_active":"2023-08-22T00:44:20.001252+0000","last_peered":"2023-08-22T00:44:20.001252+0000","last_clean":"2023-08-22T00:44:20.001252+0000","last_became_active":"2023-08-22T00:44:19.999388+0000","last_became_peered":"2023-08-22T00:44:19.999388+0000","last_unstale":"2023-08-22T00:44:20.001252+0000","last_undegraded":"2023-08-22T00:44:20.001252+0000","last_fullsized":"2023-08-22T00:44:20.001252+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.998366+0000","last_change":"2023-08-22T00:44:19.633674+0000","last_active":"2023-08-22T00:44:19.998366+0000","last_peered":"2023-08-22T00:44:19.998366+0000","last_clean":"2023-08-22T00:44:19.998366+0000","last_became_active":"2023-08-22T00:44:19.633241+0000","last_became_peered":"2023-08-22T00:44:19.633241+0000","last_unstale":"2023-08-22T00:44:19.998366+0000","last_undegraded":"2023-08-22T00:44:19.998366+0000","last_fullsized":"2023-08-22T00:44:19.998366+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.004862+0000","last_change":"2023-08-22T00:44:19.997650+0000","last_active":"2023-08-22T00:44:20.004862+0000","last_peered":"2023-08-22T00:44:20.004862+0000","last_clean":"2023-08-22T00:44:20.004862+0000","last_became_active":"2023-08-22T00:44:19.997373+0000","last_became_peered":"2023-08-22T00:44:19.997373+0000","last_unstale":"2023-08-22T00:44:20.004862+0000","last_undegraded":"2023-08-22T00:44:20.004862+0000","last_fullsized":"2023-08-22T00:44:20.004862+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999049+0000","last_change":"2023-08-22T00:44:19.626778+0000","last_active":"2023-08-22T00:44:19.999049+0000","last_peered":"2023-08-22T00:44:19.999049+0000","last_clean":"2023-08-22T00:44:19.999049+0000","last_became_active":"2023-08-22T00:44:19.626501+0000","last_became_peered":"2023-08-22T00:44:19.626501+0000","last_unstale":"2023-08-22T00:44:19.999049+0000","last_undegraded":"2023-08-22T00:44:19.999049+0000","last_fullsized":"2023-08-22T00:44:19.999049+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012258+0000","last_change":"2023-08-22T00:44:20.000471+0000","last_active":"2023-08-22T00:44:20.012258+0000","last_peered":"2023-08-22T00:44:20.012258+0000","last_clean":"2023-08-22T00:44:20.012258+0000","last_became_active":"2023-08-22T00:44:19.998661+0000","last_became_peered":"2023-08-22T00:44:19.998661+0000","last_unstale":"2023-08-22T00:44:20.012258+0000","last_undegraded":"2023-08-22T00:44:20.012258+0000","last_fullsized":"2023-08-22T00:44:20.012258+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.990719+0000","last_change":"2023-08-22T00:44:19.638634+0000","last_active":"2023-08-22T00:44:19.990719+0000","last_peered":"2023-08-22T00:44:19.990719+0000","last_clean":"2023-08-22T00:44:19.990719+0000","last_became_active":"2023-08-22T00:44:19.638351+0000","last_became_peered":"2023-08-22T00:44:19.638351+0000","last_unstale":"2023-08-22T00:44:19.990719+0000","last_undegraded":"2023-08-22T00:44:19.990719+0000","last_fullsized":"2023-08-22T00:44:19.990719+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016191+0000","last_change":"2023-08-22T00:44:20.011448+0000","last_active":"2023-08-22T00:44:20.016191+0000","last_peered":"2023-08-22T00:44:20.016191+0000","last_clean":"2023-08-22T00:44:20.016191+0000","last_became_active":"2023-08-22T00:44:20.011264+0000","last_became_peered":"2023-08-22T00:44:20.011264+0000","last_unstale":"2023-08-22T00:44:20.016191+0000","last_undegraded":"2023-08-22T00:44:20.016191+0000","last_fullsized":"2023-08-22T00:44:20.016191+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991239+0000","last_change":"2023-08-22T00:44:19.626392+0000","last_active":"2023-08-22T00:44:19.991239+0000","last_peered":"2023-08-22T00:44:19.991239+0000","last_clean":"2023-08-22T00:44:19.991239+0000","last_became_active":"2023-08-22T00:44:19.626105+0000","last_became_peered":"2023-08-22T00:44:19.626105+0000","last_unstale":"2023-08-22T00:44:19.991239+0000","last_undegraded":"2023-08-22T00:44:19.991239+0000","last_fullsized":"2023-08-22T00:44:19.991239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.007377+0000","last_change":"2023-08-22T00:44:20.001688+0000","last_active":"2023-08-22T00:44:20.007377+0000","last_peered":"2023-08-22T00:44:20.007377+0000","last_clean":"2023-08-22T00:44:20.007377+0000","last_became_active":"2023-08-22T00:44:20.001380+0000","last_became_peered":"2023-08-22T00:44:20.001380+0000","last_unstale":"2023-08-22T00:44:20.007377+0000","last_undegraded":"2023-08-22T00:44:20.007377+0000","last_fullsized":"2023-08-22T00:44:20.007377+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.993329+0000","last_change":"2023-08-22T00:44:19.626756+0000","last_active":"2023-08-22T00:44:19.993329+0000","last_peered":"2023-08-22T00:44:19.993329+0000","last_clean":"2023-08-22T00:44:19.993329+0000","last_became_active":"2023-08-22T00:44:19.626492+0000","last_became_peered":"2023-08-22T00:44:19.626492+0000","last_unstale":"2023-08-22T00:44:19.993329+0000","last_undegraded":"2023-08-22T00:44:19.993329+0000","last_fullsized":"2023-08-22T00:44:19.993329+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.007983+0000","last_change":"2023-08-22T00:44:20.006069+0000","last_active":"2023-08-22T00:44:20.007983+0000","last_peered":"2023-08-22T00:44:20.007983+0000","last_clean":"2023-08-22T00:44:20.007983+0000","last_became_active":"2023-08-22T00:44:20.005669+0000","last_became_peered":"2023-08-22T00:44:20.005669+0000","last_unstale":"2023-08-22T00:44:20.007983+0000","last_undegraded":"2023-08-22T00:44:20.007983+0000","last_fullsized":"2023-08-22T00:44:20.007983+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.004938+0000","last_change":"2023-08-22T00:44:19.631673+0000","last_active":"2023-08-22T00:44:20.004938+0000","last_peered":"2023-08-22T00:44:20.004938+0000","last_clean":"2023-08-22T00:44:20.004938+0000","last_became_active":"2023-08-22T00:44:19.630940+0000","last_became_peered":"2023-08-22T00:44:19.630940+0000","last_unstale":"2023-08-22T00:44:20.004938+0000","last_undegraded":"2023-08-22T00:44:20.004938+0000","last_fullsized":"2023-08-22T00:44:20.004938+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.021518+0000","last_change":"2023-08-22T00:44:20.017568+0000","last_active":"2023-08-22T00:44:20.021518+0000","last_peered":"2023-08-22T00:44:20.021518+0000","last_clean":"2023-08-22T00:44:20.021518+0000","last_became_active":"2023-08-22T00:44:20.017322+0000","last_became_peered":"2023-08-22T00:44:20.017322+0000","last_unstale":"2023-08-22T00:44:20.021518+0000","last_undegraded":"2023-08-22T00:44:20.021518+0000","last_fullsized":"2023-08-22T00:44:20.021518+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.996301+0000","last_change":"2023-08-22T00:44:19.625622+0000","last_active":"2023-08-22T00:44:19.996301+0000","last_peered":"2023-08-22T00:44:19.996301+0000","last_clean":"2023-08-22T00:44:19.996301+0000","last_became_active":"2023-08-22T00:44:19.621639+0000","last_became_peered":"2023-08-22T00:44:19.621639+0000","last_unstale":"2023-08-22T00:44:19.996301+0000","last_undegraded":"2023-08-22T00:44:19.996301+0000","last_fullsized":"2023-08-22T00:44:19.996301+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.018303+0000","last_change":"2023-08-22T00:44:20.017092+0000","last_active":"2023-08-22T00:44:20.018303+0000","last_peered":"2023-08-22T00:44:20.018303+0000","last_clean":"2023-08-22T00:44:20.018303+0000","last_became_active":"2023-08-22T00:44:20.015846+0000","last_became_peered":"2023-08-22T00:44:20.015846+0000","last_unstale":"2023-08-22T00:44:20.018303+0000","last_undegraded":"2023-08-22T00:44:20.018303+0000","last_fullsized":"2023-08-22T00:44:20.018303+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012454+0000","last_change":"2023-08-22T00:44:19.622996+0000","last_active":"2023-08-22T00:44:20.012454+0000","last_peered":"2023-08-22T00:44:20.012454+0000","last_clean":"2023-08-22T00:44:20.012454+0000","last_became_active":"2023-08-22T00:44:19.622709+0000","last_became_peered":"2023-08-22T00:44:19.622709+0000","last_unstale":"2023-08-22T00:44:20.012454+0000","last_undegraded":"2023-08-22T00:44:20.012454+0000","last_fullsized":"2023-08-22T00:44:20.012454+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016278+0000","last_change":"2023-08-22T00:44:20.013116+0000","last_active":"2023-08-22T00:44:20.016278+0000","last_peered":"2023-08-22T00:44:20.016278+0000","last_clean":"2023-08-22T00:44:20.016278+0000","last_became_active":"2023-08-22T00:44:20.012866+0000","last_became_peered":"2023-08-22T00:44:20.012866+0000","last_unstale":"2023-08-22T00:44:20.016278+0000","last_undegraded":"2023-08-22T00:44:20.016278+0000","last_fullsized":"2023-08-22T00:44:20.016278+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.010365+0000","last_change":"2023-08-22T00:44:19.636000+0000","last_active":"2023-08-22T00:44:20.010365+0000","last_peered":"2023-08-22T00:44:20.010365+0000","last_clean":"2023-08-22T00:44:20.010365+0000","last_became_active":"2023-08-22T00:44:19.635795+0000","last_became_peered":"2023-08-22T00:44:19.635795+0000","last_unstale":"2023-08-22T00:44:20.010365+0000","last_undegraded":"2023-08-22T00:44:20.010365+0000","last_fullsized":"2023-08-22T00:44:20.010365+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.009937+0000","last_change":"2023-08-22T00:44:20.006534+0000","last_active":"2023-08-22T00:44:20.009937+0000","last_peered":"2023-08-22T00:44:20.009937+0000","last_clean":"2023-08-22T00:44:20.009937+0000","last_became_active":"2023-08-22T00:44:20.006271+0000","last_became_peered":"2023-08-22T00:44:20.006271+0000","last_unstale":"2023-08-22T00:44:20.009937+0000","last_undegraded":"2023-08-22T00:44:20.009937+0000","last_fullsized":"2023-08-22T00:44:20.009937+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.008309+0000","last_change":"2023-08-22T00:44:19.632012+0000","last_active":"2023-08-22T00:44:20.008309+0000","last_peered":"2023-08-22T00:44:20.008309+0000","last_clean":"2023-08-22T00:44:20.008309+0000","last_became_active":"2023-08-22T00:44:19.631511+0000","last_became_peered":"2023-08-22T00:44:19.631511+0000","last_unstale":"2023-08-22T00:44:20.008309+0000","last_undegraded":"2023-08-22T00:44:20.008309+0000","last_fullsized":"2023-08-22T00:44:20.008309+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017935+0000","last_change":"2023-08-22T00:44:20.014770+0000","last_active":"2023-08-22T00:44:20.017935+0000","last_peered":"2023-08-22T00:44:20.017935+0000","last_clean":"2023-08-22T00:44:20.017935+0000","last_became_active":"2023-08-22T00:44:20.014507+0000","last_became_peered":"2023-08-22T00:44:20.014507+0000","last_unstale":"2023-08-22T00:44:20.017935+0000","last_undegraded":"2023-08-22T00:44:20.017935+0000","last_fullsized":"2023-08-22T00:44:20.017935+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.000877+0000","last_change":"2023-08-22T00:44:19.637735+0000","last_active":"2023-08-22T00:44:20.000877+0000","last_peered":"2023-08-22T00:44:20.000877+0000","last_clean":"2023-08-22T00:44:20.000877+0000","last_became_active":"2023-08-22T00:44:19.637439+0000","last_became_peered":"2023-08-22T00:44:19.637439+0000","last_unstale":"2023-08-22T00:44:20.000877+0000","last_undegraded":"2023-08-22T00:44:20.000877+0000","last_fullsized":"2023-08-22T00:44:20.000877+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012712+0000","last_change":"2023-08-22T00:44:20.007923+0000","last_active":"2023-08-22T00:44:20.012712+0000","last_peered":"2023-08-22T00:44:20.012712+0000","last_clean":"2023-08-22T00:44:20.012712+0000","last_became_active":"2023-08-22T00:44:20.006364+0000","last_became_peered":"2023-08-22T00:44:20.006364+0000","last_unstale":"2023-08-22T00:44:20.012712+0000","last_undegraded":"2023-08-22T00:44:20.012712+0000","last_fullsized":"2023-08-22T00:44:20.012712+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.995428+0000","last_change":"2023-08-22T00:44:19.623496+0000","last_active":"2023-08-22T00:44:19.995428+0000","last_peered":"2023-08-22T00:44:19.995428+0000","last_clean":"2023-08-22T00:44:19.995428+0000","last_became_active":"2023-08-22T00:44:19.623213+0000","last_became_peered":"2023-08-22T00:44:19.623213+0000","last_unstale":"2023-08-22T00:44:19.995428+0000","last_undegraded":"2023-08-22T00:44:19.995428+0000","last_fullsized":"2023-08-22T00:44:19.995428+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015599+0000","last_change":"2023-08-22T00:44:20.011210+0000","last_active":"2023-08-22T00:44:20.015599+0000","last_peered":"2023-08-22T00:44:20.015599+0000","last_clean":"2023-08-22T00:44:20.015599+0000","last_became_active":"2023-08-22T00:44:20.010893+0000","last_became_peered":"2023-08-22T00:44:20.010893+0000","last_unstale":"2023-08-22T00:44:20.015599+0000","last_undegraded":"2023-08-22T00:44:20.015599+0000","last_fullsized":"2023-08-22T00:44:20.015599+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013259+0000","last_change":"2023-08-22T00:44:19.630268+0000","last_active":"2023-08-22T00:44:20.013259+0000","last_peered":"2023-08-22T00:44:20.013259+0000","last_clean":"2023-08-22T00:44:20.013259+0000","last_became_active":"2023-08-22T00:44:19.629997+0000","last_became_peered":"2023-08-22T00:44:19.629997+0000","last_unstale":"2023-08-22T00:44:20.013259+0000","last_undegraded":"2023-08-22T00:44:20.013259+0000","last_fullsized":"2023-08-22T00:44:20.013259+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.015649+0000","last_change":"2023-08-22T00:44:20.011270+0000","last_active":"2023-08-22T00:44:20.015649+0000","last_peered":"2023-08-22T00:44:20.015649+0000","last_clean":"2023-08-22T00:44:20.015649+0000","last_became_active":"2023-08-22T00:44:20.010816+0000","last_became_peered":"2023-08-22T00:44:20.010816+0000","last_unstale":"2023-08-22T00:44:20.015649+0000","last_undegraded":"2023-08-22T00:44:20.015649+0000","last_fullsized":"2023-08-22T00:44:20.015649+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017181+0000","last_change":"2023-08-22T00:44:19.632859+0000","last_active":"2023-08-22T00:44:20.017181+0000","last_peered":"2023-08-22T00:44:20.017181+0000","last_clean":"2023-08-22T00:44:20.017181+0000","last_became_active":"2023-08-22T00:44:19.632574+0000","last_became_peered":"2023-08-22T00:44:19.632574+0000","last_unstale":"2023-08-22T00:44:20.017181+0000","last_undegraded":"2023-08-22T00:44:20.017181+0000","last_fullsized":"2023-08-22T00:44:20.017181+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.014770+0000","last_change":"2023-08-22T00:44:20.013228+0000","last_active":"2023-08-22T00:44:20.014770+0000","last_peered":"2023-08-22T00:44:20.014770+0000","last_clean":"2023-08-22T00:44:20.014770+0000","last_became_active":"2023-08-22T00:44:20.012950+0000","last_became_peered":"2023-08-22T00:44:20.012950+0000","last_unstale":"2023-08-22T00:44:20.014770+0000","last_undegraded":"2023-08-22T00:44:20.014770+0000","last_fullsized":"2023-08-22T00:44:20.014770+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017443+0000","last_change":"2023-08-22T00:44:19.622525+0000","last_active":"2023-08-22T00:44:20.017443+0000","last_peered":"2023-08-22T00:44:20.017443+0000","last_clean":"2023-08-22T00:44:20.017443+0000","last_became_active":"2023-08-22T00:44:19.622273+0000","last_became_peered":"2023-08-22T00:44:19.622273+0000","last_unstale":"2023-08-22T00:44:20.017443+0000","last_undegraded":"2023-08-22T00:44:20.017443+0000","last_fullsized":"2023-08-22T00:44:20.017443+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013523+0000","last_change":"2023-08-22T00:44:20.009044+0000","last_active":"2023-08-22T00:44:20.013523+0000","last_peered":"2023-08-22T00:44:20.013523+0000","last_clean":"2023-08-22T00:44:20.013523+0000","last_became_active":"2023-08-22T00:44:20.008768+0000","last_became_peered":"2023-08-22T00:44:20.008768+0000","last_unstale":"2023-08-22T00:44:20.013523+0000","last_undegraded":"2023-08-22T00:44:20.013523+0000","last_fullsized":"2023-08-22T00:44:20.013523+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999605+0000","last_change":"2023-08-22T00:44:19.630164+0000","last_active":"2023-08-22T00:44:19.999605+0000","last_peered":"2023-08-22T00:44:19.999605+0000","last_clean":"2023-08-22T00:44:19.999605+0000","last_became_active":"2023-08-22T00:44:19.629847+0000","last_became_peered":"2023-08-22T00:44:19.629847+0000","last_unstale":"2023-08-22T00:44:19.999605+0000","last_undegraded":"2023-08-22T00:44:19.999605+0000","last_fullsized":"2023-08-22T00:44:19.999605+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012519+0000","last_change":"2023-08-22T00:44:20.004501+0000","last_active":"2023-08-22T00:44:20.012519+0000","last_peered":"2023-08-22T00:44:20.012519+0000","last_clean":"2023-08-22T00:44:20.012519+0000","last_became_active":"2023-08-22T00:44:20.004191+0000","last_became_peered":"2023-08-22T00:44:20.004191+0000","last_unstale":"2023-08-22T00:44:20.012519+0000","last_undegraded":"2023-08-22T00:44:20.012519+0000","last_fullsized":"2023-08-22T00:44:20.012519+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.006274+0000","last_change":"2023-08-22T00:44:19.632497+0000","last_active":"2023-08-22T00:44:20.006274+0000","last_peered":"2023-08-22T00:44:20.006274+0000","last_clean":"2023-08-22T00:44:20.006274+0000","last_became_active":"2023-08-22T00:44:19.632226+0000","last_became_peered":"2023-08-22T00:44:19.632226+0000","last_unstale":"2023-08-22T00:44:20.006274+0000","last_undegraded":"2023-08-22T00:44:20.006274+0000","last_fullsized":"2023-08-22T00:44:20.006274+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017096+0000","last_change":"2023-08-22T00:44:20.005755+0000","last_active":"2023-08-22T00:44:20.017096+0000","last_peered":"2023-08-22T00:44:20.017096+0000","last_clean":"2023-08-22T00:44:20.017096+0000","last_became_active":"2023-08-22T00:44:20.005501+0000","last_became_peered":"2023-08-22T00:44:20.005501+0000","last_unstale":"2023-08-22T00:44:20.017096+0000","last_undegraded":"2023-08-22T00:44:20.017096+0000","last_fullsized":"2023-08-22T00:44:20.017096+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.007071+0000","last_change":"2023-08-22T00:44:19.632223+0000","last_active":"2023-08-22T00:44:20.007071+0000","last_peered":"2023-08-22T00:44:20.007071+0000","last_clean":"2023-08-22T00:44:20.007071+0000","last_became_active":"2023-08-22T00:44:19.631957+0000","last_became_peered":"2023-08-22T00:44:19.631957+0000","last_unstale":"2023-08-22T00:44:20.007071+0000","last_undegraded":"2023-08-22T00:44:20.007071+0000","last_fullsized":"2023-08-22T00:44:20.007071+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016907+0000","last_change":"2023-08-22T00:44:20.011020+0000","last_active":"2023-08-22T00:44:20.016907+0000","last_peered":"2023-08-22T00:44:20.016907+0000","last_clean":"2023-08-22T00:44:20.016907+0000","last_became_active":"2023-08-22T00:44:20.010752+0000","last_became_peered":"2023-08-22T00:44:20.010752+0000","last_unstale":"2023-08-22T00:44:20.016907+0000","last_undegraded":"2023-08-22T00:44:20.016907+0000","last_fullsized":"2023-08-22T00:44:20.016907+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.995784+0000","last_change":"2023-08-22T00:44:19.621710+0000","last_active":"2023-08-22T00:44:19.995784+0000","last_peered":"2023-08-22T00:44:19.995784+0000","last_clean":"2023-08-22T00:44:19.995784+0000","last_became_active":"2023-08-22T00:44:19.621421+0000","last_became_peered":"2023-08-22T00:44:19.621421+0000","last_unstale":"2023-08-22T00:44:19.995784+0000","last_undegraded":"2023-08-22T00:44:19.995784+0000","last_fullsized":"2023-08-22T00:44:19.995784+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012663+0000","last_change":"2023-08-22T00:44:20.007343+0000","last_active":"2023-08-22T00:44:20.012663+0000","last_peered":"2023-08-22T00:44:20.012663+0000","last_clean":"2023-08-22T00:44:20.012663+0000","last_became_active":"2023-08-22T00:44:20.007058+0000","last_became_peered":"2023-08-22T00:44:20.007058+0000","last_unstale":"2023-08-22T00:44:20.012663+0000","last_undegraded":"2023-08-22T00:44:20.012663+0000","last_fullsized":"2023-08-22T00:44:20.012663+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.990199+0000","last_change":"2023-08-22T00:44:19.629638+0000","last_active":"2023-08-22T00:44:19.990199+0000","last_peered":"2023-08-22T00:44:19.990199+0000","last_clean":"2023-08-22T00:44:19.990199+0000","last_became_active":"2023-08-22T00:44:19.629041+0000","last_became_peered":"2023-08-22T00:44:19.629041+0000","last_unstale":"2023-08-22T00:44:19.990199+0000","last_undegraded":"2023-08-22T00:44:19.990199+0000","last_fullsized":"2023-08-22T00:44:19.990199+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.006143+0000","last_change":"2023-08-22T00:44:20.004811+0000","last_active":"2023-08-22T00:44:20.006143+0000","last_peered":"2023-08-22T00:44:20.006143+0000","last_clean":"2023-08-22T00:44:20.006143+0000","last_became_active":"2023-08-22T00:44:20.004542+0000","last_became_peered":"2023-08-22T00:44:20.004542+0000","last_unstale":"2023-08-22T00:44:20.006143+0000","last_undegraded":"2023-08-22T00:44:20.006143+0000","last_fullsized":"2023-08-22T00:44:20.006143+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991600+0000","last_change":"2023-08-22T00:44:19.625542+0000","last_active":"2023-08-22T00:44:19.991600+0000","last_peered":"2023-08-22T00:44:19.991600+0000","last_clean":"2023-08-22T00:44:19.991600+0000","last_became_active":"2023-08-22T00:44:19.625315+0000","last_became_peered":"2023-08-22T00:44:19.625315+0000","last_unstale":"2023-08-22T00:44:19.991600+0000","last_undegraded":"2023-08-22T00:44:19.991600+0000","last_fullsized":"2023-08-22T00:44:19.991600+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.006169+0000","last_change":"2023-08-22T00:44:20.004401+0000","last_active":"2023-08-22T00:44:20.006169+0000","last_peered":"2023-08-22T00:44:20.006169+0000","last_clean":"2023-08-22T00:44:20.006169+0000","last_became_active":"2023-08-22T00:44:20.004123+0000","last_became_peered":"2023-08-22T00:44:20.004123+0000","last_unstale":"2023-08-22T00:44:20.006169+0000","last_undegraded":"2023-08-22T00:44:20.006169+0000","last_fullsized":"2023-08-22T00:44:20.006169+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.014265+0000","last_change":"2023-08-22T00:44:19.629410+0000","last_active":"2023-08-22T00:44:20.014265+0000","last_peered":"2023-08-22T00:44:20.014265+0000","last_clean":"2023-08-22T00:44:20.014265+0000","last_became_active":"2023-08-22T00:44:19.629135+0000","last_became_peered":"2023-08-22T00:44:19.629135+0000","last_unstale":"2023-08-22T00:44:20.014265+0000","last_undegraded":"2023-08-22T00:44:20.014265+0000","last_fullsized":"2023-08-22T00:44:20.014265+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.021667+0000","last_change":"2023-08-22T00:44:20.016979+0000","last_active":"2023-08-22T00:44:20.021667+0000","last_peered":"2023-08-22T00:44:20.021667+0000","last_clean":"2023-08-22T00:44:20.021667+0000","last_became_active":"2023-08-22T00:44:20.016603+0000","last_became_peered":"2023-08-22T00:44:20.016603+0000","last_unstale":"2023-08-22T00:44:20.021667+0000","last_undegraded":"2023-08-22T00:44:20.021667+0000","last_fullsized":"2023-08-22T00:44:20.021667+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.996354+0000","last_change":"2023-08-22T00:44:19.628602+0000","last_active":"2023-08-22T00:44:19.996354+0000","last_peered":"2023-08-22T00:44:19.996354+0000","last_clean":"2023-08-22T00:44:19.996354+0000","last_became_active":"2023-08-22T00:44:19.628333+0000","last_became_peered":"2023-08-22T00:44:19.628333+0000","last_unstale":"2023-08-22T00:44:19.996354+0000","last_undegraded":"2023-08-22T00:44:19.996354+0000","last_fullsized":"2023-08-22T00:44:19.996354+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013663+0000","last_change":"2023-08-22T00:44:20.009441+0000","last_active":"2023-08-22T00:44:20.013663+0000","last_peered":"2023-08-22T00:44:20.013663+0000","last_clean":"2023-08-22T00:44:20.013663+0000","last_became_active":"2023-08-22T00:44:20.008992+0000","last_became_peered":"2023-08-22T00:44:20.008992+0000","last_unstale":"2023-08-22T00:44:20.013663+0000","last_undegraded":"2023-08-22T00:44:20.013663+0000","last_fullsized":"2023-08-22T00:44:20.013663+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.002518+0000","last_change":"2023-08-22T00:44:19.632874+0000","last_active":"2023-08-22T00:44:20.002518+0000","last_peered":"2023-08-22T00:44:20.002518+0000","last_clean":"2023-08-22T00:44:20.002518+0000","last_became_active":"2023-08-22T00:44:19.632606+0000","last_became_peered":"2023-08-22T00:44:19.632606+0000","last_unstale":"2023-08-22T00:44:20.002518+0000","last_undegraded":"2023-08-22T00:44:20.002518+0000","last_fullsized":"2023-08-22T00:44:20.002518+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.014046+0000","last_change":"2023-08-22T00:44:20.011885+0000","last_active":"2023-08-22T00:44:20.014046+0000","last_peered":"2023-08-22T00:44:20.014046+0000","last_clean":"2023-08-22T00:44:20.014046+0000","last_became_active":"2023-08-22T00:44:20.011549+0000","last_became_peered":"2023-08-22T00:44:20.011549+0000","last_unstale":"2023-08-22T00:44:20.014046+0000","last_undegraded":"2023-08-22T00:44:20.014046+0000","last_fullsized":"2023-08-22T00:44:20.014046+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.998471+0000","last_change":"2023-08-22T00:44:19.633476+0000","last_active":"2023-08-22T00:44:19.998471+0000","last_peered":"2023-08-22T00:44:19.998471+0000","last_clean":"2023-08-22T00:44:19.998471+0000","last_became_active":"2023-08-22T00:44:19.632860+0000","last_became_peered":"2023-08-22T00:44:19.632860+0000","last_unstale":"2023-08-22T00:44:19.998471+0000","last_undegraded":"2023-08-22T00:44:19.998471+0000","last_fullsized":"2023-08-22T00:44:19.998471+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012002+0000","last_change":"2023-08-22T00:44:20.009352+0000","last_active":"2023-08-22T00:44:20.012002+0000","last_peered":"2023-08-22T00:44:20.012002+0000","last_clean":"2023-08-22T00:44:20.012002+0000","last_became_active":"2023-08-22T00:44:20.009037+0000","last_became_peered":"2023-08-22T00:44:20.009037+0000","last_unstale":"2023-08-22T00:44:20.012002+0000","last_undegraded":"2023-08-22T00:44:20.012002+0000","last_fullsized":"2023-08-22T00:44:20.012002+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991120+0000","last_change":"2023-08-22T00:44:19.633050+0000","last_active":"2023-08-22T00:44:19.991120+0000","last_peered":"2023-08-22T00:44:19.991120+0000","last_clean":"2023-08-22T00:44:19.991120+0000","last_became_active":"2023-08-22T00:44:19.632754+0000","last_became_peered":"2023-08-22T00:44:19.632754+0000","last_unstale":"2023-08-22T00:44:19.991120+0000","last_undegraded":"2023-08-22T00:44:19.991120+0000","last_fullsized":"2023-08-22T00:44:19.991120+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012296+0000","last_change":"2023-08-22T00:44:20.011098+0000","last_active":"2023-08-22T00:44:20.012296+0000","last_peered":"2023-08-22T00:44:20.012296+0000","last_clean":"2023-08-22T00:44:20.012296+0000","last_became_active":"2023-08-22T00:44:20.010839+0000","last_became_peered":"2023-08-22T00:44:20.010839+0000","last_unstale":"2023-08-22T00:44:20.012296+0000","last_undegraded":"2023-08-22T00:44:20.012296+0000","last_fullsized":"2023-08-22T00:44:20.012296+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991854+0000","last_change":"2023-08-22T00:44:19.635584+0000","last_active":"2023-08-22T00:44:19.991854+0000","last_peered":"2023-08-22T00:44:19.991854+0000","last_clean":"2023-08-22T00:44:19.991854+0000","last_became_active":"2023-08-22T00:44:19.635274+0000","last_became_peered":"2023-08-22T00:44:19.635274+0000","last_unstale":"2023-08-22T00:44:19.991854+0000","last_undegraded":"2023-08-22T00:44:19.991854+0000","last_fullsized":"2023-08-22T00:44:19.991854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.012643+0000","last_change":"2023-08-22T00:44:20.005439+0000","last_active":"2023-08-22T00:44:20.012643+0000","last_peered":"2023-08-22T00:44:20.012643+0000","last_clean":"2023-08-22T00:44:20.012643+0000","last_became_active":"2023-08-22T00:44:20.005113+0000","last_became_peered":"2023-08-22T00:44:20.005113+0000","last_unstale":"2023-08-22T00:44:20.012643+0000","last_undegraded":"2023-08-22T00:44:20.012643+0000","last_fullsized":"2023-08-22T00:44:20.012643+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991710+0000","last_change":"2023-08-22T00:44:19.622780+0000","last_active":"2023-08-22T00:44:19.991710+0000","last_peered":"2023-08-22T00:44:19.991710+0000","last_clean":"2023-08-22T00:44:19.991710+0000","last_became_active":"2023-08-22T00:44:19.622456+0000","last_became_peered":"2023-08-22T00:44:19.622456+0000","last_unstale":"2023-08-22T00:44:19.991710+0000","last_undegraded":"2023-08-22T00:44:19.991710+0000","last_fullsized":"2023-08-22T00:44:19.991710+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016173+0000","last_change":"2023-08-22T00:44:20.013001+0000","last_active":"2023-08-22T00:44:20.016173+0000","last_peered":"2023-08-22T00:44:20.016173+0000","last_clean":"2023-08-22T00:44:20.016173+0000","last_became_active":"2023-08-22T00:44:20.012713+0000","last_became_peered":"2023-08-22T00:44:20.012713+0000","last_unstale":"2023-08-22T00:44:20.016173+0000","last_undegraded":"2023-08-22T00:44:20.016173+0000","last_fullsized":"2023-08-22T00:44:20.016173+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.989362+0000","last_change":"2023-08-22T00:44:19.628449+0000","last_active":"2023-08-22T00:44:19.989362+0000","last_peered":"2023-08-22T00:44:19.989362+0000","last_clean":"2023-08-22T00:44:19.989362+0000","last_became_active":"2023-08-22T00:44:19.628183+0000","last_became_peered":"2023-08-22T00:44:19.628183+0000","last_unstale":"2023-08-22T00:44:19.989362+0000","last_undegraded":"2023-08-22T00:44:19.989362+0000","last_fullsized":"2023-08-22T00:44:19.989362+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016575+0000","last_change":"2023-08-22T00:44:20.007940+0000","last_active":"2023-08-22T00:44:20.016575+0000","last_peered":"2023-08-22T00:44:20.016575+0000","last_clean":"2023-08-22T00:44:20.016575+0000","last_became_active":"2023-08-22T00:44:20.007667+0000","last_became_peered":"2023-08-22T00:44:20.007667+0000","last_unstale":"2023-08-22T00:44:20.016575+0000","last_undegraded":"2023-08-22T00:44:20.016575+0000","last_fullsized":"2023-08-22T00:44:20.016575+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.008215+0000","last_change":"2023-08-22T00:44:19.626601+0000","last_active":"2023-08-22T00:44:20.008215+0000","last_peered":"2023-08-22T00:44:20.008215+0000","last_clean":"2023-08-22T00:44:20.008215+0000","last_became_active":"2023-08-22T00:44:19.626203+0000","last_became_peered":"2023-08-22T00:44:19.626203+0000","last_unstale":"2023-08-22T00:44:20.008215+0000","last_undegraded":"2023-08-22T00:44:20.008215+0000","last_fullsized":"2023-08-22T00:44:20.008215+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.989501+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:19.989501+0000","last_peered":"2023-08-22T00:44:19.989501+0000","last_clean":"2023-08-22T00:44:19.989501+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:19.989501+0000","last_undegraded":"2023-08-22T00:44:19.989501+0000","last_fullsized":"2023-08-22T00:44:19.989501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.016850+0000","last_change":"2023-08-22T00:44:20.011415+0000","last_active":"2023-08-22T00:44:20.016850+0000","last_peered":"2023-08-22T00:44:20.016850+0000","last_clean":"2023-08-22T00:44:20.016850+0000","last_became_active":"2023-08-22T00:44:20.011139+0000","last_became_peered":"2023-08-22T00:44:20.011139+0000","last_unstale":"2023-08-22T00:44:20.016850+0000","last_undegraded":"2023-08-22T00:44:20.016850+0000","last_fullsized":"2023-08-22T00:44:20.016850+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.997091+0000","last_change":"2023-08-22T00:44:19.630796+0000","last_active":"2023-08-22T00:44:19.997091+0000","last_peered":"2023-08-22T00:44:19.997091+0000","last_clean":"2023-08-22T00:44:19.997091+0000","last_became_active":"2023-08-22T00:44:19.630526+0000","last_became_peered":"2023-08-22T00:44:19.630526+0000","last_unstale":"2023-08-22T00:44:19.997091+0000","last_undegraded":"2023-08-22T00:44:19.997091+0000","last_fullsized":"2023-08-22T00:44:19.997091+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":168,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991966+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:19.991966+0000","last_peered":"2023-08-22T00:44:19.991966+0000","last_clean":"2023-08-22T00:44:19.991966+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:19.991966+0000","last_undegraded":"2023-08-22T00:44:19.991966+0000","last_fullsized":"2023-08-22T00:44:19.991966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.017112+0000","last_change":"2023-08-22T00:44:20.007251+0000","last_active":"2023-08-22T00:44:20.017112+0000","last_peered":"2023-08-22T00:44:20.017112+0000","last_clean":"2023-08-22T00:44:20.017112+0000","last_became_active":"2023-08-22T00:44:20.006622+0000","last_became_peered":"2023-08-22T00:44:20.006622+0000","last_unstale":"2023-08-22T00:44:20.017112+0000","last_undegraded":"2023-08-22T00:44:20.017112+0000","last_fullsized":"2023-08-22T00:44:20.017112+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.998367+0000","last_change":"2023-08-22T00:44:19.632759+0000","last_active":"2023-08-22T00:44:19.998367+0000","last_peered":"2023-08-22T00:44:19.998367+0000","last_clean":"2023-08-22T00:44:19.998367+0000","last_became_active":"2023-08-22T00:44:19.632490+0000","last_became_peered":"2023-08-22T00:44:19.632490+0000","last_unstale":"2023-08-22T00:44:19.998367+0000","last_undegraded":"2023-08-22T00:44:19.998367+0000","last_fullsized":"2023-08-22T00:44:19.998367+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.997070+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:19.997070+0000","last_peered":"2023-08-22T00:44:19.997070+0000","last_clean":"2023-08-22T00:44:19.997070+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:19.997070+0000","last_undegraded":"2023-08-22T00:44:19.997070+0000","last_fullsized":"2023-08-22T00:44:19.997070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.021601+0000","last_change":"2023-08-22T00:44:20.016350+0000","last_active":"2023-08-22T00:44:20.021601+0000","last_peered":"2023-08-22T00:44:20.021601+0000","last_clean":"2023-08-22T00:44:20.021601+0000","last_became_active":"2023-08-22T00:44:20.016089+0000","last_became_peered":"2023-08-22T00:44:20.016089+0000","last_unstale":"2023-08-22T00:44:20.021601+0000","last_undegraded":"2023-08-22T00:44:20.021601+0000","last_fullsized":"2023-08-22T00:44:20.021601+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999384+0000","last_change":"2023-08-22T00:44:19.628470+0000","last_active":"2023-08-22T00:44:19.999384+0000","last_peered":"2023-08-22T00:44:19.999384+0000","last_clean":"2023-08-22T00:44:19.999384+0000","last_became_active":"2023-08-22T00:44:19.628177+0000","last_became_peered":"2023-08-22T00:44:19.628177+0000","last_unstale":"2023-08-22T00:44:19.999384+0000","last_undegraded":"2023-08-22T00:44:19.999384+0000","last_fullsized":"2023-08-22T00:44:19.999384+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991228+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:19.991228+0000","last_peered":"2023-08-22T00:44:19.991228+0000","last_clean":"2023-08-22T00:44:19.991228+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:19.991228+0000","last_undegraded":"2023-08-22T00:44:19.991228+0000","last_fullsized":"2023-08-22T00:44:19.991228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.997370+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:19.997370+0000","last_peered":"2023-08-22T00:44:19.997370+0000","last_clean":"2023-08-22T00:44:19.997370+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:19.997370+0000","last_undegraded":"2023-08-22T00:44:19.997370+0000","last_fullsized":"2023-08-22T00:44:19.997370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013696+0000","last_change":"2023-08-22T00:44:20.010380+0000","last_active":"2023-08-22T00:44:20.013696+0000","last_peered":"2023-08-22T00:44:20.013696+0000","last_clean":"2023-08-22T00:44:20.013696+0000","last_became_active":"2023-08-22T00:44:20.010067+0000","last_became_peered":"2023-08-22T00:44:20.010067+0000","last_unstale":"2023-08-22T00:44:20.013696+0000","last_undegraded":"2023-08-22T00:44:20.013696+0000","last_fullsized":"2023-08-22T00:44:20.013696+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.995572+0000","last_change":"2023-08-22T00:44:19.627080+0000","last_active":"2023-08-22T00:44:19.995572+0000","last_peered":"2023-08-22T00:44:19.995572+0000","last_clean":"2023-08-22T00:44:19.995572+0000","last_became_active":"2023-08-22T00:44:19.626775+0000","last_became_peered":"2023-08-22T00:44:19.626775+0000","last_unstale":"2023-08-22T00:44:19.995572+0000","last_undegraded":"2023-08-22T00:44:19.995572+0000","last_fullsized":"2023-08-22T00:44:19.995572+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.997239+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:19.997239+0000","last_peered":"2023-08-22T00:44:19.997239+0000","last_clean":"2023-08-22T00:44:19.997239+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:19.997239+0000","last_undegraded":"2023-08-22T00:44:19.997239+0000","last_fullsized":"2023-08-22T00:44:19.997239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013988+0000","last_change":"2023-08-22T00:44:20.010377+0000","last_active":"2023-08-22T00:44:20.013988+0000","last_peered":"2023-08-22T00:44:20.013988+0000","last_clean":"2023-08-22T00:44:20.013988+0000","last_became_active":"2023-08-22T00:44:20.010103+0000","last_became_peered":"2023-08-22T00:44:20.010103+0000","last_unstale":"2023-08-22T00:44:20.013988+0000","last_undegraded":"2023-08-22T00:44:20.013988+0000","last_fullsized":"2023-08-22T00:44:20.013988+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.009697+0000","last_change":"2023-08-22T00:44:19.631487+0000","last_active":"2023-08-22T00:44:20.009697+0000","last_peered":"2023-08-22T00:44:20.009697+0000","last_clean":"2023-08-22T00:44:20.009697+0000","last_became_active":"2023-08-22T00:44:19.630551+0000","last_became_peered":"2023-08-22T00:44:19.630551+0000","last_unstale":"2023-08-22T00:44:20.009697+0000","last_undegraded":"2023-08-22T00:44:20.009697+0000","last_fullsized":"2023-08-22T00:44:20.009697+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.999712+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:19.999712+0000","last_peered":"2023-08-22T00:44:19.999712+0000","last_clean":"2023-08-22T00:44:19.999712+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:19.999712+0000","last_undegraded":"2023-08-22T00:44:19.999712+0000","last_fullsized":"2023-08-22T00:44:19.999712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.013579+0000","last_change":"2023-08-22T00:44:20.011564+0000","last_active":"2023-08-22T00:44:20.013579+0000","last_peered":"2023-08-22T00:44:20.013579+0000","last_clean":"2023-08-22T00:44:20.013579+0000","last_became_active":"2023-08-22T00:44:20.011306+0000","last_became_peered":"2023-08-22T00:44:20.011306+0000","last_unstale":"2023-08-22T00:44:20.013579+0000","last_undegraded":"2023-08-22T00:44:20.013579+0000","last_fullsized":"2023-08-22T00:44:20.013579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991228+0000","last_change":"2023-08-22T00:44:19.623204+0000","last_active":"2023-08-22T00:44:19.991228+0000","last_peered":"2023-08-22T00:44:19.991228+0000","last_clean":"2023-08-22T00:44:19.991228+0000","last_became_active":"2023-08-22T00:44:19.622915+0000","last_became_peered":"2023-08-22T00:44:19.622915+0000","last_unstale":"2023-08-22T00:44:19.991228+0000","last_undegraded":"2023-08-22T00:44:19.991228+0000","last_fullsized":"2023-08-22T00:44:19.991228+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.991238+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:19.991238+0000","last_peered":"2023-08-22T00:44:19.991238+0000","last_clean":"2023-08-22T00:44:19.991238+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:19.991238+0000","last_undegraded":"2023-08-22T00:44:19.991238+0000","last_fullsized":"2023-08-22T00:44:19.991238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.018565+0000","last_change":"2023-08-22T00:44:20.017955+0000","last_active":"2023-08-22T00:44:20.018565+0000","last_peered":"2023-08-22T00:44:20.018565+0000","last_clean":"2023-08-22T00:44:20.018565+0000","last_became_active":"2023-08-22T00:44:20.017582+0000","last_became_peered":"2023-08-22T00:44:20.017582+0000","last_unstale":"2023-08-22T00:44:20.018565+0000","last_undegraded":"2023-08-22T00:44:20.018565+0000","last_fullsized":"2023-08-22T00:44:20.018565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:19.602888+0000","last_clean_scrub_stamp":"2023-08-22T00:44:19.602888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:20.006738+0000","last_change":"2023-08-22T00:44:19.638643+0000","last_active":"2023-08-22T00:44:20.006738+0000","last_peered":"2023-08-22T00:44:20.006738+0000","last_clean":"2023-08-22T00:44:20.006738+0000","last_became_active":"2023-08-22T00:44:19.638404+0000","last_became_peered":"2023-08-22T00:44:19.638404+0000","last_unstale":"2023-08-22T00:44:20.006738+0000","last_undegraded":"2023-08-22T00:44:20.006738+0000","last_fullsized":"2023-08-22T00:44:20.006738+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:44:18.600433+0000","last_clean_scrub_stamp":"2023-08-22T00:44:18.600433+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-22T00:44:19.992224+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:19.992224+0000","last_peered":"2023-08-22T00:44:19.992224+0000","last_clean":"2023-08-22T00:44:19.992224+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:19.992224+0000","last_undegraded":"2023-08-22T00:44:19.992224+0000","last_fullsized":"2023-08-22T00:44:19.992224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575298,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2547712,"data_stored":1359687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.495}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575298,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059972,"statfs":{"total":96636764160,"available":96317411328,"internally_reserved":0,"allocated":2543616,"data_stored":1359315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64600000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.44700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575298,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303684,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068156,"statfs":{"total":96636764160,"available":96325791744,"internally_reserved":0,"allocated":2551808,"data_stored":1359475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.375,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.61599999999999999},"last":0.35899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.57799999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.438,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.443}]},{"osd":3,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40999999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.3180000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.94299999999999995},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.44,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.95899999999999996},"last":1.3560000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575298,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1358783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.51300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.49299999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.47999999999999998,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42399999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.626,"15min":0.65300000000000002},"last":0.442},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.93500000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.82199999999999995,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575299,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2547712,"data_stored":1358873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.374}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.433}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.624},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.52500000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.5}]}]},{"osd":3,"up_from":13,"seq":55834575298,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1358885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.246},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.311},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.36199999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.503},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575298,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064056,"statfs":{"total":96636764160,"available":96321593344,"internally_reserved":0,"allocated":2555904,"data_stored":1360851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48699999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64200000000000002}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.498}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.435}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575297,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1358831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.5}]},{"osd":1,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.373}]},{"osd":4,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.745},"last":0.34599999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.48299999999999998}]},{"osd":7,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:27.825 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-22T00:44:27.826 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-22T00:44:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 Processor -- start 2023-08-22T00:44:27.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 -- start start 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c94155140 0x7f2c940a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c940a9fb0 0x7f2c94063610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c94062600 con 0x7f2c94153d50 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c94063180 con 0x7f2c94155140 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.978+0000 7f2c9999e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94062850 con 0x7f2c940a9fb0 2023-08-22T00:44:27.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c94155140 0x7f2c940a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c9899c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2c94153d50 0x7f2c940bfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:58164/0 (socket says 172.21.15.98:58164) 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c9899c700 1 -- 172.21.15.98:0/3359169262 learned_addr learned my addr 172.21.15.98:0/3359169262 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c9919d700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c940a9fb0 0x7f2c94063610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 -- 172.21.15.98:0/3359169262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c940a9fb0 msgr2=0x7f2c94063610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c940a9fb0 0x7f2c94063610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 -- 172.21.15.98:0/3359169262 >> v1:172.21.15.98:6789/0 conn(0x7f2c94153d50 legacy=0x7f2c940bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 -- 172.21.15.98:0/3359169262 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94062b30 con 0x7f2c94155140 2023-08-22T00:44:27.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c937fe700 1 -- 172.21.15.98:0/3359169262 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650932159 0 0) 0x7f2c94062600 con 0x7f2c94153d50 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c93fff700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c94155140 0x7f2c940a9ac0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f2c80009760 tx=0x7f2c80009060).ready entity=mon.0 client_cookie=7edb93f308302942 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c937fe700 1 -- 172.21.15.98:0/3359169262 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000b580 con 0x7f2c94155140 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c937fe700 1 -- 172.21.15.98:0/3359169262 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8000b6e0 con 0x7f2c94155140 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.979+0000 7f2c937fe700 1 -- 172.21.15.98:0/3359169262 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000ba60 con 0x7f2c94155140 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 -- 172.21.15.98:0/3359169262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c94155140 msgr2=0x7f2c940a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c94155140 0x7f2c940a9ac0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f2c80009760 tx=0x7f2c80009060).stop 2023-08-22T00:44:27.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 -- 172.21.15.98:0/3359169262 shutdown_connections 2023-08-22T00:44:27.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c940a9fb0 0x7f2c94063610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 --2- 172.21.15.98:0/3359169262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c94155140 0x7f2c940a9ac0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 -- 172.21.15.98:0/3359169262 >> 172.21.15.98:0/3359169262 conn(0x7f2c940c7590 msgr2=0x7f2c940c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:27.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 -- 172.21.15.98:0/3359169262 shutdown_connections 2023-08-22T00:44:27.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.980+0000 7f2c9999e700 1 -- 172.21.15.98:0/3359169262 wait complete. 2023-08-22T00:44:27.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.981+0000 7f2c9999e700 1 Processor -- start 2023-08-22T00:44:27.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.981+0000 7f2c9999e700 1 -- start start 2023-08-22T00:44:27.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c94153d50 0x7f2c94144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 0x7f2c940c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c4ac0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94144cf0 con 0x7f2c94155140 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9999e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94157ef0 con 0x7f2c94153d50 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9899c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9899c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55214/0 (socket says 172.21.15.98:55214) 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.982+0000 7f2c9899c700 1 -- 172.21.15.98:0/2549239513 learned_addr learned my addr 172.21.15.98:0/2549239513 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:27.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c93fff700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c94153d50 0x7f2c94144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9919d700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 0x7f2c940c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 -- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c94153d50 msgr2=0x7f2c94144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c94153d50 0x7f2c94144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 -- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 msgr2=0x7f2c940c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 0x7f2c940c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 -- 172.21.15.98:0/2549239513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800092a0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9919d700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 0x7f2c940c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:27.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9899c700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f2c8800c4e0 tx=0x7f2c88007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880072e0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88007440 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880057a0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c941581d0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.983+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94158790 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.984+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9414f9d0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.984+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2c88005bd0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.985+0000 7f2c90ff9700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 0x7f2c780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:27.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.985+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f2c88079aa0 con 0x7f2c940a9fb0 2023-08-22T00:44:27.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.985+0000 7f2c93fff700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 0x7f2c780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:27.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.985+0000 7f2c93fff700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 0x7f2c780613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2c80009760 tx=0x7f2c80017000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:27.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:27.989+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c8804ac10 con 0x7f2c940a9fb0 2023-08-22T00:44:28.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.217+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2c94062e10 con 0x7f2c940a9fb0 2023-08-22T00:44:28.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.221+0000 7f2c90ff9700 1 -- 172.21.15.98:0/2549239513 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2c8804e230 con 0x7f2c940a9fb0 2023-08-22T00:44:28.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 msgr2=0x7f2c780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 0x7f2c780613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2c80009760 tx=0x7f2c80017000).stop 2023-08-22T00:44:28.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 msgr2=0x7f2c94155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.224 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f2c8800c4e0 tx=0x7f2c88007c70).stop 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 shutdown_connections 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c7805ef30 0x7f2c780613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94155140 0x7f2c940c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c940a9fb0 0x7f2c94155850 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 --2- 172.21.15.98:0/2549239513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c94153d50 0x7f2c94144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 >> 172.21.15.98:0/2549239513 conn(0x7f2c940c7590 msgr2=0x7f2c9414df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 shutdown_connections 2023-08-22T00:44:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.223+0000 7f2c9999e700 1 -- 172.21.15.98:0/2549239513 wait complete. 2023-08-22T00:44:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2023-08-22T00:44:28.236 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:28.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.351+0000 7f7e50744700 1 Processor -- start 2023-08-22T00:44:28.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.351+0000 7f7e50744700 1 -- start start 2023-08-22T00:44:28.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e50744700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e48157ae0 0x7f7e480c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e50744700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e50744700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480a8440 con 0x7f7e480a9170 2023-08-22T00:44:28.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e50744700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e480a9620 con 0x7f7e48157ae0 2023-08-22T00:44:28.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e50744700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480a8ce0 con 0x7f7e480aad10 2023-08-22T00:44:28.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e4e4e0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e48157ae0 0x7f7e480c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.352+0000 7f7e4ece1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4ece1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:47314/0 (socket says 172.21.15.98:47314) 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4ece1700 1 -- 172.21.15.98:0/2142391277 learned_addr learned my addr 172.21.15.98:0/2142391277 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e48157ae0 0x7f7e480c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:56674/0 (socket says 172.21.15.98:56674) 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4dcdf700 1 --1- 172.21.15.98:0/2142391277 >> v1:172.21.15.118:6789/0 conn(0x7f7e480a9170 0x7f7e48157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:37836/0 (socket says 172.21.15.98:37836) 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 -- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 msgr2=0x7f7e480bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 -- 172.21.15.98:0/2142391277 >> v1:172.21.15.118:6789/0 conn(0x7f7e480a9170 legacy=0x7f7e48157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 -- 172.21.15.98:0/2142391277 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480c45b0 con 0x7f7e48157ae0 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4d4de700 1 -- 172.21.15.98:0/2142391277 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254408640 0 0) 0x7f7e480a8440 con 0x7f7e480a9170 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4ece1700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4e4e0700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e48157ae0 0x7f7e480c3f90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f7e38009760 tx=0x7f7e38009060).ready entity=mon.1 client_cookie=a9f5fd5001bde4a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4d4de700 1 -- 172.21.15.98:0/2142391277 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380090d0 con 0x7f7e48157ae0 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4d4de700 1 -- 172.21.15.98:0/2142391277 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800f510 con 0x7f7e48157ae0 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.353+0000 7f7e4d4de700 1 -- 172.21.15.98:0/2142391277 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800f890 con 0x7f7e48157ae0 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 -- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e48157ae0 msgr2=0x7f7e480c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e48157ae0 0x7f7e480c3f90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f7e38009760 tx=0x7f7e38009060).stop 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 -- 172.21.15.98:0/2142391277 shutdown_connections 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e480bd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 --2- 172.21.15.98:0/2142391277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e48157ae0 0x7f7e480c3f90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 -- 172.21.15.98:0/2142391277 >> 172.21.15.98:0/2142391277 conn(0x7f7e480c5330 msgr2=0x7f7e480c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 -- 172.21.15.98:0/2142391277 shutdown_connections 2023-08-22T00:44:28.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.354+0000 7f7e50744700 1 -- 172.21.15.98:0/2142391277 wait complete. 2023-08-22T00:44:28.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.355+0000 7f7e50744700 1 Processor -- start 2023-08-22T00:44:28.360 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.355+0000 7f7e50744700 1 -- start start 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e480a9170 0x7f7e48157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e48142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e481597b0 con 0x7f7e48157ae0 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48158710 con 0x7f7e480a9170 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e50744700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e481589f0 con 0x7f7e480aad10 2023-08-22T00:44:28.361 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55224/0 (socket says 172.21.15.98:55224) 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 -- 172.21.15.98:0/1795675206 learned_addr learned my addr 172.21.15.98:0/1795675206 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4e4e0700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e480a9170 0x7f7e48157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4dcdf700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e48142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 -- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 msgr2=0x7f7e48142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e48142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 -- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e480a9170 msgr2=0x7f7e48157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.362 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e480a9170 0x7f7e48157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 -- 172.21.15.98:0/1795675206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009ae0 con 0x7f7e48157ae0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.356+0000 7f7e4ece1700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f7e40009fd0 tx=0x7f7e4000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.357+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400092e0 con 0x7f7e48157ae0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.357+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000f040 con 0x7f7e48157ae0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.357+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380092a0 con 0x7f7e48157ae0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.357+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000cbd0 con 0x7f7e48157ae0 2023-08-22T00:44:28.363 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.357+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e48158fb0 con 0x7f7e48157ae0 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.358+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e48047480 con 0x7f7e48157ae0 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.358+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7e40007400 con 0x7f7e48157ae0 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.358+0000 7f7e3e7fc700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 0x7f7e2c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.358+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f7e4007a040 con 0x7f7e48157ae0 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.358+0000 7f7e4e4e0700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 0x7f7e2c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:28.364 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.359+0000 7f7e4e4e0700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 0x7f7e2c0613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7e38009fd0 tx=0x7f7e38017000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:28.365 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.362+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e4004a8f0 con 0x7f7e48157ae0 2023-08-22T00:44:28.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.564+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e480a8690 con 0x7f7e48157ae0 2023-08-22T00:44:28.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.564+0000 7f7e3e7fc700 1 -- 172.21.15.98:0/1795675206 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f7e4004b200 con 0x7f7e48157ae0 2023-08-22T00:44:28.566 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:28.566 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:28.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 msgr2=0x7f7e2c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 0x7f7e2c0613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7e38009fd0 tx=0x7f7e38017000).stop 2023-08-22T00:44:28.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 msgr2=0x7f7e480ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f7e40009fd0 tx=0x7f7e4000b040).stop 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 shutdown_connections 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7e2c05ef00 0x7f7e2c0613c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e48157ae0 0x7f7e480ad890 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e480a9170 0x7f7e48157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 --2- 172.21.15.98:0/1795675206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e480aad10 0x7f7e48142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:28.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 >> 172.21.15.98:0/1795675206 conn(0x7f7e480c5330 msgr2=0x7f7e481556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:28.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 shutdown_connections 2023-08-22T00:44:28.569 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:28.566+0000 7f7e50744700 1 -- 172.21.15.98:0/1795675206 wait complete. 2023-08-22T00:44:28.569 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:28.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-22T00:44:19.985888+0000', 'modified': '2023-08-22T00:44:21.995612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9810}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9810': {'gid': 9810, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/743825487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6835', 'nonce': 743825487}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 743825487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-22T00:44:28.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-22T00:44:28.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-22T00:44:29.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.101+0000 7f1de2101700 1 Processor -- start 2023-08-22T00:44:29.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.101+0000 7f1de2101700 1 -- start start 2023-08-22T00:44:29.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1de2101700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 0x7f1ddc0c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1de2101700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ddc0aa170 0x7f1ddc062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1de2101700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc0c1460 con 0x7f1ddc0c5ea0 2023-08-22T00:44:29.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1de2101700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c6370 con 0x7f1ddc0aa170 2023-08-22T00:44:29.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1de2101700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c0b30 con 0x7f1ddc153b80 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ddc0aa170 0x7f1ddc062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1ddc0aa170 0x7f1ddc062600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55238/0 (socket says 172.21.15.98:55238) 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 -- 172.21.15.98:0/4069605044 learned_addr learned my addr 172.21.15.98:0/4069605044 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 -- 172.21.15.98:0/4069605044 >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 msgr2=0x7f1ddc0c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/4069605044 >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 0x7f1ddc0c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/4069605044 >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 0x7f1ddc0c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 -- 172.21.15.98:0/4069605044 >> v1:172.21.15.118:6789/0 conn(0x7f1ddc0c5ea0 legacy=0x7f1ddc0a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 -- 172.21.15.98:0/4069605044 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0c0e10 con 0x7f1ddc0aa170 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/4069605044 >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 0x7f1ddc0c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/4069605044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc062600 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f1ddc06b080 tx=0x7f1dd4009840).ready entity=mon.0 client_cookie=d9012412cfcd9593 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1dda7fc700 1 -- 172.21.15.98:0/4069605044 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400e070 con 0x7f1ddc0aa170 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1dda7fc700 1 -- 172.21.15.98:0/4069605044 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400ba10 con 0x7f1ddc0aa170 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.102+0000 7f1dda7fc700 1 -- 172.21.15.98:0/4069605044 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400bd90 con 0x7f1ddc0aa170 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 -- 172.21.15.98:0/4069605044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 msgr2=0x7f1ddc062600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 --2- 172.21.15.98:0/4069605044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc062600 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f1ddc06b080 tx=0x7f1dd4009840).stop 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 -- 172.21.15.98:0/4069605044 shutdown_connections 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 --2- 172.21.15.98:0/4069605044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc062600 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 --2- 172.21.15.98:0/4069605044 >> v2:172.21.15.118:3300/0 conn(0x7f1ddc153b80 0x7f1ddc0c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 -- 172.21.15.98:0/4069605044 >> 172.21.15.98:0/4069605044 conn(0x7f1ddc0cb5a0 msgr2=0x7f1ddc0c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 -- 172.21.15.98:0/4069605044 shutdown_connections 2023-08-22T00:44:29.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.103+0000 7f1de2101700 1 -- 172.21.15.98:0/4069605044 wait complete. 2023-08-22T00:44:29.109 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.104+0000 7f1de2101700 1 Processor -- start 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.104+0000 7f1de2101700 1 -- start start 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 0x7f1ddc0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ddc153b80 0x7f1ddc0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b06e0 con 0x7f1ddc0aa170 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b09c0 con 0x7f1ddc153b80 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1de2101700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc163af0 con 0x7f1ddc0c5ea0 2023-08-22T00:44:29.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55242/0 (socket says 172.21.15.98:55242) 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/405692135 learned_addr learned my addr 172.21.15.98:0/405692135 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ddc153b80 0x7f1ddc0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 0x7f1ddc0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 msgr2=0x7f1ddc0ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 0x7f1ddc0ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ddc153b80 msgr2=0x7f1ddc0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ddc153b80 0x7f1ddc0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/405692135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4009ae0 con 0x7f1ddc0aa170 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 0x7f1ddc0ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.105+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f1dd000c880 tx=0x7f1dd0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.106+0000 7f1dc37fe700 1 -- 172.21.15.98:0/405692135 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0010580 con 0x7f1ddc0aa170 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.106+0000 7f1dc37fe700 1 -- 172.21.15.98:0/405692135 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd00106e0 con 0x7f1ddc0aa170 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.106+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc163dd0 con 0x7f1ddc0aa170 2023-08-22T00:44:29.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.106+0000 7f1dc37fe700 1 -- 172.21.15.98:0/405692135 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0010a60 con 0x7f1ddc0aa170 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.106+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc14cce0 con 0x7f1ddc0aa170 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.107+0000 7f1dc37fe700 1 -- 172.21.15.98:0/405692135 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1dd001b460 con 0x7f1ddc0aa170 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.107+0000 7f1dc37fe700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 0x7f1dc80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.107+0000 7f1dc37fe700 1 -- 172.21.15.98:0/405692135 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f1dd007a050 con 0x7f1ddc0aa170 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.107+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 0x7f1dc80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.108+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 0x7f1dc80613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1ddc0636d0 tx=0x7f1dcc009040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.109+0000 7f1df3ab5b80 1 Processor -- start 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 -- start start 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f5f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1e9bdb0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1eb1030 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1eb1170 con 0x55b2f1f5f2c0 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.110+0000 7f1ddaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55248/0 (socket says 172.21.15.98:55248) 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 -- 172.21.15.98:0/3466454175 learned_addr learned my addr 172.21.15.98:0/3466454175 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f5f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 -- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 msgr2=0x55b2f1f5f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f5f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 -- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 msgr2=0x55b2f1f5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 -- 172.21.15.98:0/3466454175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2f1e83b00 con 0x55b2f1fa7f60 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f1dcc0136f0 tx=0x7f1dcc013000).ready entity=mon.0 client_cookie=9c6ca54dd0011e8b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1dc0ff9700 1 -- 172.21.15.98:0/3466454175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00e6f0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1dc0ff9700 1 -- 172.21.15.98:0/3466454175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00e850 con 0x55b2f1fa7f60 2023-08-22T00:44:29.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.111+0000 7f1dc0ff9700 1 -- 172.21.15.98:0/3466454175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00ebd0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/3466454175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 msgr2=0x55b2f1f5a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f1dcc0136f0 tx=0x7f1dcc013000).stop 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/3466454175 shutdown_connections 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f5f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/3466454175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f5a600 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/3466454175 >> 172.21.15.98:0/3466454175 conn(0x55b2f1dc9940 msgr2=0x55b2f1fa83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/3466454175 shutdown_connections 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/3466454175 wait complete. 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 -- start start 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.112+0000 7f1df3ab5b80 1 Processor -- start 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f86e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f8a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1eb13f0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1e7c920 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1f8d550 con 0x55b2f1f5f2c0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1df3ab5b80 10 client.0 ll_register_callbacks cb 0x55b2f1e51ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1ddbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1ddbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55254/0 (socket says 172.21.15.98:55254) 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.113+0000 7f1ddbfff700 1 -- 172.21.15.98:0/947283517 learned_addr learned my addr 172.21.15.98:0/947283517 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f86e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f8a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 -- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 msgr2=0x55b2f1f8a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f8a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 -- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 msgr2=0x55b2f1f86e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f86e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 -- 172.21.15.98:0/947283517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc00f040 con 0x55b2f1fa7f60 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f8a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f1dd4009540 tx=0x7f1ddc0c13d0).ready entity=mon.0 client_cookie=8b646cf2aec9f01f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4013b40 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f1dd4013ca0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2f1f59aa0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd4013e60 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 10 client.9990 fetch_fsmap learned FSMap version 75 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55b2f1ea9f70 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2f1f59aa0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1dd4020680 con 0x55b2f1fa7f60 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 10 client.9990 fetch_fsmap finished waiting for FSMap version 75 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 10 client.9990 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 20 client.9990 populate_metadata read hostname 'smithi098' 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1f88a20 0x55b2f1f88e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 4 client.9990 mds_command: new command op to 9810 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 --> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2f1d19ef0 con 0x55b2f1f88a20 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.114+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1f88a20 0x55b2f1f88e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1db9ffb700 10 client.9990 ms_handle_connect on v2:172.21.15.98:6835/743825487 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1f88a20 0x55b2f1f88e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7be02c6b05895f3d server_cookie=bc3c39efbb115da6 in_seq=0 out_seq=0 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1db9ffb700 1 -- 172.21.15.98:0/947283517 <== mds.0 v2:172.21.15.98:6835/743825487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55b2f1d19ef0 con 0x55b2f1f88a20 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1db9ffb700 10 client.9990 handle_command_reply: tid=0 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 client.9990 shutdown 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 msgr2=0x55b2f1f8c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f1dd4009540 tx=0x7f1ddc0c13d0).stop 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 shutdown_connections 2023-08-22T00:44:29.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1f88a20 0x55b2f1f88e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1fa7f60 0x55b2f1f8c440 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1db9ffb700 0 client.9990 ms_handle_reset on v2:172.21.15.98:6835/743825487 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f86e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/947283517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f8a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.115+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 >> 172.21.15.98:0/947283517 conn(0x55b2f1dc9940 msgr2=0x55b2f1f5d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.116+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 shutdown_connections 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.116+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/947283517 wait complete. 2023-08-22T00:44:29.128 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.116+0000 7f1df3ab5b80 20 client.9990 trim_cache size 0 max 16384 2023-08-22T00:44:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 Processor -- start 2023-08-22T00:44:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 -- start start 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f9fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1fa7f60 0x55b2f1fa0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1fa4940 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1e9cbf0 con 0x55b2f1fa7f60 2023-08-22T00:44:29.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.132+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1f614f0 con 0x55b2f1f5f2c0 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55268/0 (socket says 172.21.15.98:55268) 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/2828716821 learned_addr learned my addr 172.21.15.98:0/2828716821 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f9fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1fa7f60 0x55b2f1fa0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 msgr2=0x55b2f1f9fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f9fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1fa7f60 msgr2=0x55b2f1fa0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1fa7f60 0x55b2f1fa0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/2828716821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2f1ea5580 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f1dd00782e0 tx=0x7f1dd000cf90).ready entity=mon.0 client_cookie=6507b4b725b591c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1dc17fa700 1 -- 172.21.15.98:0/2828716821 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0078430 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1dc17fa700 1 -- 172.21.15.98:0/2828716821 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0053040 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.133+0000 7f1dc17fa700 1 -- 172.21.15.98:0/2828716821 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd004d1c0 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/2828716821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 msgr2=0x55b2f1f5b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f1dd00782e0 tx=0x7f1dd000cf90).stop 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/2828716821 shutdown_connections 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1fa7f60 0x55b2f1fa0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f5b420 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/2828716821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1f5f2c0 0x55b2f1f9fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/2828716821 >> 172.21.15.98:0/2828716821 conn(0x55b2f1dc9940 msgr2=0x55b2f1f5a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/2828716821 shutdown_connections 2023-08-22T00:44:29.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/2828716821 wait complete. 2023-08-22T00:44:29.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 -- start start 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.134+0000 7f1df3ab5b80 1 Processor -- start 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5f2c0 0x55b2f2009070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1fa7f60 0x55b2f1fa83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1f56020 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f200af20 con 0x55b2f1f5f2c0 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f1fa7370 con 0x55b2f1fa7f60 2023-08-22T00:44:29.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1df3ab5b80 10 client.0 ll_register_callbacks cb 0x55b2f1e51ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55278/0 (socket says 172.21.15.98:55278) 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/1897013370 learned_addr learned my addr 172.21.15.98:0/1897013370 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5f2c0 0x55b2f2009070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.135+0000 7f1ddbfff700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1fa7f60 0x55b2f1fa83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1fa7f60 msgr2=0x55b2f1fa83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1fa7f60 0x55b2f1fa83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5f2c0 msgr2=0x55b2f2009070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5f2c0 0x55b2f2009070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 -- 172.21.15.98:0/1897013370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc14cce0 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddb7fe700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f1dd0078330 tx=0x7f1dd005f000).ready entity=mon.0 client_cookie=9a63407b6ab2401b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0010c40 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f1dd0067df0 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dcc00e850 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd0010da0 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 10 client.9996 fetch_fsmap learned FSMap version 75 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55b2f1ea52d0 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00e850 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1dd004e310 con 0x55b2f1f5aaf0 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 10 client.9996 fetch_fsmap finished waiting for FSMap version 75 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 10 client.9996 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-22T00:44:29.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 20 client.9996 populate_metadata read hostname 'smithi098' 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1fa29d0 0x55b2f1fa2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 4 client.9996 mds_command: new command op to 9810 tid=0[{"prefix": "status"}] 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 --> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2f1d4f040 con 0x55b2f1fa29d0 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.136+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1fa29d0 0x55b2f1fa2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1db9ffb700 10 client.9996 ms_handle_connect on v2:172.21.15.98:6835/743825487 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1ddaffd700 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1fa29d0 0x55b2f1fa2db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f2b449fee9feabcd server_cookie=81a457929253985f in_seq=0 out_seq=0 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1db9ffb700 1 -- 172.21.15.98:0/1897013370 <== mds.0 v2:172.21.15.98:6835/743825487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55b2f1d4f040 con 0x55b2f1fa29d0 2023-08-22T00:44:29.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1db9ffb700 10 client.9996 handle_command_reply: tid=0 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 client.9996 shutdown 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 msgr2=0x55b2f1f897d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f1dd0078330 tx=0x7f1dd005f000).stop 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 shutdown_connections 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:6835/743825487,v1:172.21.15.98:6837/743825487] conn(0x55b2f1fa29d0 0x55b2f1fa2db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b2f1fa7f60 0x55b2f1fa83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1db9ffb700 0 client.9996 ms_handle_reset on v2:172.21.15.98:6835/743825487 2023-08-22T00:44:29.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2f1f5aaf0 0x55b2f1f897d0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 --2- 172.21.15.98:0/1897013370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b2f1f5f2c0 0x55b2f2009070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 >> 172.21.15.98:0/1897013370 conn(0x55b2f1dc9940 msgr2=0x55b2f1f5d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 shutdown_connections 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 1 -- 172.21.15.98:0/1897013370 wait complete. 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.137+0000 7f1df3ab5b80 20 client.9996 trim_cache size 0 max 16384 2023-08-22T00:44:29.148 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "1e61d47e-5294-4f44-ba3b-d3c83a49a88d", 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 9810, 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2023-08-22T00:44:29.149 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.1505856879999996, 2023-08-22T00:44:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 75, 2023-08-22T00:44:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 203, 2023-08-22T00:44:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 203, 2023-08-22T00:44:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 14.088281415999999 2023-08-22T00:44:29.150 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:44:29.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 msgr2=0x7f1dc80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.151 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 0x7f1dc80613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1ddc0636d0 tx=0x7f1dcc009040).stop 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 msgr2=0x7f1ddc1645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f1dd000c880 tx=0x7f1dd0008040).stop 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 shutdown_connections 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f1dc805ef30 0x7f1dc80613f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ddc153b80 0x7f1ddc0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ddc0aa170 0x7f1ddc1645d0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.152 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 --2- 172.21.15.98:0/405692135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ddc0c5ea0 0x7f1ddc0ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 >> 172.21.15.98:0/405692135 conn(0x7f1ddc0cb5a0 msgr2=0x7f1ddc14de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 shutdown_connections 2023-08-22T00:44:29.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.138+0000 7f1de2101700 1 -- 172.21.15.98:0/405692135 wait complete. 2023-08-22T00:44:29.153 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:44:29.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.257+0000 7fa00b694700 1 Processor -- start 2023-08-22T00:44:29.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.257+0000 7fa00b694700 1 -- start start 2023-08-22T00:44:29.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa00414e240 0x7fa0040c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa0040c1b30 0x7fa0040656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004065bd0 0x7fa004157860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040c1fe0 con 0x7fa00414e240 2023-08-22T00:44:29.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa004066040 con 0x7fa0040c1b30 2023-08-22T00:44:29.260 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa00b694700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040c2200 con 0x7fa004065bd0 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa00414e240 0x7fa0040c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa00414e240 0x7fa0040c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55292/0 (socket says 172.21.15.98:55292) 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 -- 172.21.15.98:0/3917914219 learned_addr learned my addr 172.21.15.98:0/3917914219 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa008c2f700 1 --2- 172.21.15.98:0/3917914219 >> v2:172.21.15.118:3300/0 conn(0x7fa0040c1b30 0x7fa0040656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009c31700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004065bd0 0x7fa004157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 -- 172.21.15.98:0/3917914219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004065bd0 msgr2=0x7fa004157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004065bd0 0x7fa004157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.261 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 -- 172.21.15.98:0/3917914219 >> v2:172.21.15.118:3300/0 conn(0x7fa0040c1b30 msgr2=0x7fa0040656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 --2- 172.21.15.98:0/3917914219 >> v2:172.21.15.118:3300/0 conn(0x7fa0040c1b30 0x7fa0040656e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 -- 172.21.15.98:0/3917914219 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040c24e0 con 0x7fa00414e240 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.258+0000 7fa009430700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa00414e240 0x7fa0040c1640 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fa004151e90 tx=0x7fa0000090f0).ready entity=mon.0 client_cookie=8ce7e53365547ad server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7f9ffbfff700 1 -- 172.21.15.98:0/3917914219 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000f510 con 0x7fa00414e240 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7f9ffbfff700 1 -- 172.21.15.98:0/3917914219 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000f670 con 0x7fa00414e240 2023-08-22T00:44:29.262 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7f9ffbfff700 1 -- 172.21.15.98:0/3917914219 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000f9f0 con 0x7fa00414e240 2023-08-22T00:44:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 -- 172.21.15.98:0/3917914219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa00414e240 msgr2=0x7fa0040c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa00414e240 0x7fa0040c1640 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fa004151e90 tx=0x7fa0000090f0).stop 2023-08-22T00:44:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 -- 172.21.15.98:0/3917914219 shutdown_connections 2023-08-22T00:44:29.265 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa004065bd0 0x7fa004157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 --2- 172.21.15.98:0/3917914219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa00414e240 0x7fa0040c1640 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 --2- 172.21.15.98:0/3917914219 >> v2:172.21.15.118:3300/0 conn(0x7fa0040c1b30 0x7fa0040656e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 -- 172.21.15.98:0/3917914219 >> 172.21.15.98:0/3917914219 conn(0x7fa0040c3a30 msgr2=0x7fa0040c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 -- 172.21.15.98:0/3917914219 shutdown_connections 2023-08-22T00:44:29.266 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.259+0000 7fa00b694700 1 -- 172.21.15.98:0/3917914219 wait complete. 2023-08-22T00:44:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.260+0000 7fa00b694700 1 Processor -- start 2023-08-22T00:44:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.260+0000 7fa00b694700 1 -- start start 2023-08-22T00:44:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.267 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040c1b30 0x7fa00414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa00414e240 0x7fa004153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040ac2e0 con 0x7fa004065bd0 2023-08-22T00:44:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00414fe40 con 0x7fa0040c1b30 2023-08-22T00:44:29.268 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa00b694700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00414f230 con 0x7fa00414e240 2023-08-22T00:44:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa009430700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa009430700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55304/0 (socket says 172.21.15.98:55304) 2023-08-22T00:44:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.261+0000 7fa009430700 1 -- 172.21.15.98:0/3462492369 learned_addr learned my addr 172.21.15.98:0/3462492369 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:29.269 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 -- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa00414e240 msgr2=0x7fa004153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009c31700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa00414e240 0x7fa004153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa008c2f700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040c1b30 0x7fa00414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa00414e240 0x7fa004153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.270 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 -- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040c1b30 msgr2=0x7fa00414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040c1b30 0x7fa00414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 -- 172.21.15.98:0/3462492369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009370 con 0x7fa004065bd0 2023-08-22T00:44:29.271 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa009430700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fa00000fba0 tx=0x7fa000017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000011ca0 con 0x7fa004065bd0 2023-08-22T00:44:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa000011e00 con 0x7fa004065bd0 2023-08-22T00:44:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00414f510 con 0x7fa004065bd0 2023-08-22T00:44:29.272 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00001c670 con 0x7fa004065bd0 2023-08-22T00:44:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.262+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00414fad0 con 0x7fa004065bd0 2023-08-22T00:44:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.263+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004150120 con 0x7fa004065bd0 2023-08-22T00:44:29.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.263+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa00001ca60 con 0x7fa004065bd0 2023-08-22T00:44:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.263+0000 7f9ff97fa700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 0x7f9fe80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.264+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa00007b290 con 0x7fa004065bd0 2023-08-22T00:44:29.274 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.264+0000 7fa008c2f700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 0x7f9fe80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.264+0000 7fa008c2f700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 0x7f9fe80613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9ff4009270 tx=0x7f9ff4008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:29.275 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.268+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa00004c3a0 con 0x7fa004065bd0 2023-08-22T00:44:29.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.468+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa004047480 con 0x7fa004065bd0 2023-08-22T00:44:29.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.468+0000 7f9ff97fa700 1 -- 172.21.15.98:0/3462492369 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa000022020 con 0x7fa004065bd0 2023-08-22T00:44:29.470 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:44:29.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 msgr2=0x7f9fe80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 0x7f9fe80613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9ff4009270 tx=0x7f9ff4008040).stop 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 msgr2=0x7fa0041502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fa00000fba0 tx=0x7fa000017000).stop 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 shutdown_connections 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f9fe805ef30 0x7f9fe80613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa00414e240 0x7fa004153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa004065bd0 0x7fa0041502d0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 --2- 172.21.15.98:0/3462492369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0040c1b30 0x7fa00414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 >> 172.21.15.98:0/3462492369 conn(0x7fa0040c3a30 msgr2=0x7fa0040bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 shutdown_connections 2023-08-22T00:44:29.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:29.470+0000 7fa00b694700 1 -- 172.21.15.98:0/3462492369 wait complete. 2023-08-22T00:44:29.482 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:44:29.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:44:29.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:44:29.483 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:44:29.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:29.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:44:29.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:44:29.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:44:29.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:29.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.487 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:44:29.506 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:44:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:44:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:44:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:44:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.507 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:44:29.508 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:44:29.509 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:29.509 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:44:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:44:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 40236sec preferred_lft 40236sec 2023-08-22T00:44:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:44:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.510 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:44:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:44:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:44:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.511 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:44:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:44:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:44:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.512 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:44:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:44:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:44:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:29.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.514 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:44:29.572 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:44:29.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.574 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:44:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:44:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:44:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:44:29.635 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:44:29.636 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:44:29.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.637 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:44:29.637 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:44:29.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:44:29.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:44:29.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:44:29.640 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:44:29.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.741 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:44:29.760 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:44:29.760 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:44:29.760 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:29.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:29.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:44:29.828 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:44:29.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:29.829 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:29.886 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:29.886 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:44:29.953 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:44:29.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:44:30.021 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:44:30.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:44:30.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:30.023 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:44:30.081 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:44:30.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:30.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:44:30.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:44:30.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:44:30.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:44:30.205+0000 7f6f9ca893c0 -1 init, newargv = 0x55c5f095cef0 newargc=15 2023-08-22T00:44:30.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[178947]: starting ceph client 2023-08-22T00:44:30.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[178947]: starting fuse 2023-08-22T00:44:30.219 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:44:30.220 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:44:30.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:30.221 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:44:30.279 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:44:30.279 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:44:30.280 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:44:30.280 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:44:30.280 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:44:30.281 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:44:30.281 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:44:30.281 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:30.282 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:44:30.282 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:44:30.282 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:44:30.282 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:44:30.283 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:30.283 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:44:30.283 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:44:30.284 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:44:30.284 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:44:30.284 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:30.285 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:44:30.285 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:44:30.285 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:44:30.285 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:44:30.286 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:44:30.286 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:44:30.286 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:44:30.287 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:44:30.287 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:30.287 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:44:30.287 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:44:30.402 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.178947.asok 2023-08-22T00:44:30.585 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.178947.asok 2023-08-22T00:44:30.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:30.585 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.178947.asok status 2023-08-22T00:44:30.737 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:44:30.737 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "178947", 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:44:30.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 10008, 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 10008 2023-08-22T00:44:30.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3419888993 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:30.740 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3419888993 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.10008 192.168.0.1:0/3419888993", 2023-08-22T00:44:30.741 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/3419888993", 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 75, 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 203, 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:44:30.742 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:44:30.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:30.747 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:44:30.747 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:30.766 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:44:30.766 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:30.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:30.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:30.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-22T00:44:30.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.989+0000 7feb1d567700 1 Processor -- start 2023-08-22T00:44:30.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.989+0000 7feb1d567700 1 -- start start 2023-08-22T00:44:30.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb1d567700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb180c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:30.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb1d567700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180bfe30 con 0x7feb18063010 2023-08-22T00:44:30.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb1d567700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180636a0 con 0x7feb180c5b70 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb1d567700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb180634c0 con 0x7feb18153f80 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb177fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7feb18063010 0x7feb180c0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51820/0 (socket says 172.21.15.98:51820) 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb177fe700 1 -- 172.21.15.98:0/2039386967 learned_addr learned my addr 172.21.15.98:0/2039386967 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829526299 0 0) 0x7feb180bfe30 con 0x7feb18063010 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb000033f0 con 0x7feb18063010 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb167fc700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb180c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:30.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550948246 0 0) 0x7feb000033f0 con 0x7feb18063010 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 msgr2=0x7feb180c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb180c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 >> v1:172.21.15.118:6789/0 conn(0x7feb180c5b70 legacy=0x7feb18153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18063980 con 0x7feb18063010 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7feb100017f0 con 0x7feb18063010 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 >> v1:172.21.15.98:6789/0 conn(0x7feb18063010 legacy=0x7feb180c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb00003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:30.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb00004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb00004b80 0x7feb00005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180634c0 con 0x7feb00003e40 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0000b990 con 0x7feb00004b80 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.990+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0000bb50 con 0x7feb18153f80 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb00004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb16ffd700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb00003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb177fe700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb00004b80 0x7feb00005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:30.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 -- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 msgr2=0x7feb00003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb18153f80 0x7feb00003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 -- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb00004b80 msgr2=0x7feb00005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb00004b80 0x7feb00005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 -- 172.21.15.98:0/2039386967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000033f0 con 0x7feb00003e40 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb167fc700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb00004690 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7feb0c009a80 tx=0x7feb0c009060).ready entity=mon.0 client_cookie=37c87ac3b6c80f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:30.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c009430 con 0x7feb00003e40 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00e640 con 0x7feb00003e40 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb15ffb700 1 -- 172.21.15.98:0/2039386967 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00e9c0 con 0x7feb00003e40 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb1d567700 1 -- 172.21.15.98:0/2039386967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 msgr2=0x7feb00004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.991+0000 7feb1d567700 1 --2- 172.21.15.98:0/2039386967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb00004690 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7feb0c009a80 tx=0x7feb0c009060).stop 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.992+0000 7feb177fe700 1 -- 172.21.15.98:0/2039386967 reap_dead start 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.992+0000 7feb1d567700 1 -- 172.21.15.98:0/2039386967 shutdown_connections 2023-08-22T00:44:30.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.992+0000 7feb1d567700 1 -- 172.21.15.98:0/2039386967 >> 172.21.15.98:0/2039386967 conn(0x7feb180cb610 msgr2=0x7feb180c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.992+0000 7feb1d567700 1 -- 172.21.15.98:0/2039386967 shutdown_connections 2023-08-22T00:44:31.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.992+0000 7feb1d567700 1 -- 172.21.15.98:0/2039386967 wait complete. 2023-08-22T00:44:31.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.993+0000 7feb1d567700 1 Processor -- start 2023-08-22T00:44:31.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.993+0000 7feb1d567700 1 -- start start 2023-08-22T00:44:31.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb180a53e0 0x7feb180a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 0x7feb180c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18152d40 con 0x7feb00003e40 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180a5d50 con 0x7feb180c1be0 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c28f0 con 0x7feb180a53e0 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38932/0 (socket says 172.21.15.98:38932) 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 -- 172.21.15.98:0/2032178312 learned_addr learned my addr 172.21.15.98:0/2032178312 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:31.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 -- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb180a53e0 msgr2=0x7feb180a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb180a53e0 0x7feb180a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb177fe700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 0x7feb180c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 -- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 msgr2=0x7feb180c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 0x7feb180c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 -- 172.21.15.98:0/2032178312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180c2bd0 con 0x7feb00003e40 2023-08-22T00:44:31.005 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb177fe700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 0x7feb180c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb16ffd700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7feb080028c0 tx=0x7feb08007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800f6c0 con 0x7feb00003e40 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800f820 con 0x7feb00003e40 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb180c2eb0 con 0x7feb00003e40 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800fba0 con 0x7feb00003e40 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.994+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb180c3470 con 0x7feb00003e40 2023-08-22T00:44:31.006 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.995+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb180a2a30 con 0x7feb00003e40 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.996+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7feb0801d3b0 con 0x7feb00003e40 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.996+0000 7feafeffd700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 0x7feb040613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.996+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7feb08079df0 con 0x7feb00003e40 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.996+0000 7feb167fc700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 0x7feb040613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:30.996+0000 7feb167fc700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 0x7feb040613f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7feb0c009840 tx=0x7feb0c01a000).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.007 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.000+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb0804afb0 con 0x7feb00003e40 2023-08-22T00:44:31.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.185+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feb180c6350 con 0x7feb0405ef30 2023-08-22T00:44:31.187 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.186+0000 7feafeffd700 1 -- 172.21.15.98:0/2032178312 <== mgr.9630 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7feb180c6350 con 0x7feb0405ef30 2023-08-22T00:44:31.187 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2023-08-22T00:44:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-08-22T00:44:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2023-08-22T00:44:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:31.188 INFO:teuthology.orchestra.run.smithi098.stdout:] 2023-08-22T00:44:31.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 msgr2=0x7feb040613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 0x7feb040613f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7feb0c009840 tx=0x7feb0c01a000).stop 2023-08-22T00:44:31.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 msgr2=0x7feb18152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7feb080028c0 tx=0x7feb08007bb0).stop 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 shutdown_connections 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7feb0405ef30 0x7feb040613f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb180c1be0 0x7feb180c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb00003e40 0x7feb18152850 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 --2- 172.21.15.98:0/2032178312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb180a53e0 0x7feb180a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 >> 172.21.15.98:0/2032178312 conn(0x7feb180cb610 msgr2=0x7feb180c01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 shutdown_connections 2023-08-22T00:44:31.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.188+0000 7feb1d567700 1 -- 172.21.15.98:0/2032178312 wait complete. 2023-08-22T00:44:31.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-22T00:44:31.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.319+0000 7f4611b9d700 1 Processor -- start 2023-08-22T00:44:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.319+0000 7f4611b9d700 1 -- start start 2023-08-22T00:44:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 0x7f460c0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f460c064290 0x7f460c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f460c0c3550 0x7f460c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c155420 con 0x7f460c0c3550 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c1558d0 con 0x7f460c064290 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4611b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c062fd0 con 0x7f460c14e9e0 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f460c0c3550 0x7f460c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f460c0c3550 0x7f460c154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38938/0 (socket says 172.21.15.98:38938) 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 -- 172.21.15.98:0/1007931424 learned_addr learned my addr 172.21.15.98:0/1007931424 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f460bfff700 1 --2- 172.21.15.98:0/1007931424 >> v2:172.21.15.118:3300/0 conn(0x7f460c064290 0x7f460c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4610b9b700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 0x7f460c0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 -- 172.21.15.98:0/1007931424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 msgr2=0x7f460c0c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 0x7f460c0c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 -- 172.21.15.98:0/1007931424 >> v2:172.21.15.118:3300/0 conn(0x7f460c064290 msgr2=0x7f460c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 --2- 172.21.15.98:0/1007931424 >> v2:172.21.15.118:3300/0 conn(0x7f460c064290 0x7f460c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 -- 172.21.15.98:0/1007931424 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c064750 con 0x7f460c0c3550 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f4610b9b700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 0x7f460c0c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:31.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.320+0000 7f461139c700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c0c3550 0x7f460c154f30 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f460c064ca0 tx=0x7f4604009840).ready entity=mon.0 client_cookie=eb7706bbf8ddea02 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f460b7fe700 1 -- 172.21.15.98:0/1007931424 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460400e070 con 0x7f460c0c3550 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f460b7fe700 1 -- 172.21.15.98:0/1007931424 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460400ba20 con 0x7f460c0c3550 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f460b7fe700 1 -- 172.21.15.98:0/1007931424 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460400bda0 con 0x7f460c0c3550 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 -- 172.21.15.98:0/1007931424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c0c3550 msgr2=0x7f460c154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c0c3550 0x7f460c154f30 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f460c064ca0 tx=0x7f4604009840).stop 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 -- 172.21.15.98:0/1007931424 shutdown_connections 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c14e9e0 0x7f460c0c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 --2- 172.21.15.98:0/1007931424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c0c3550 0x7f460c154f30 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 --2- 172.21.15.98:0/1007931424 >> v2:172.21.15.118:3300/0 conn(0x7f460c064290 0x7f460c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 -- 172.21.15.98:0/1007931424 >> 172.21.15.98:0/1007931424 conn(0x7f460c0c3a20 msgr2=0x7f460c0c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 -- 172.21.15.98:0/1007931424 shutdown_connections 2023-08-22T00:44:31.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.321+0000 7f4611b9d700 1 -- 172.21.15.98:0/1007931424 wait complete. 2023-08-22T00:44:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.322+0000 7f4611b9d700 1 Processor -- start 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.322+0000 7f4611b9d700 1 -- start start 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f460c064290 0x7f460c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c0c3550 0x7f460c0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0ac320 con 0x7f460c14e9e0 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0ab090 con 0x7f460c064290 2023-08-22T00:44:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4611b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0ab370 con 0x7f460c0c3550 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f461139c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f461139c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38952/0 (socket says 172.21.15.98:38952) 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f461139c700 1 -- 172.21.15.98:0/3396397330 learned_addr learned my addr 172.21.15.98:0/3396397330 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f4610b9b700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f460c064290 0x7f460c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.323+0000 7f460bfff700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c0c3550 0x7f460c0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 -- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c0c3550 msgr2=0x7f460c0ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c0c3550 0x7f460c0ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 -- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f460c064290 msgr2=0x7f460c14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f460c064290 0x7f460c14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 -- 172.21.15.98:0/3396397330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4604009ae0 con 0x7f460c14e9e0 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f461139c700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f460400b6c0 tx=0x7f4604009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040032f0 con 0x7f460c14e9e0 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46040092e0 con 0x7f460c14e9e0 2023-08-22T00:44:31.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c0abcd0 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460401d670 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.324+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c14b7f0 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.325+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c14ba10 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.326+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4604003040 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.326+0000 7f4608ff9700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 0x7f45f00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.326+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f460407b890 con 0x7f460c14e9e0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.326+0000 7f4610b9b700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 0x7f45f00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.327+0000 7f4610b9b700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 0x7f45f00613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4600006d80 tx=0x7f4600008040).ready entity=mgr.9630 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.330+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f460404cac0 con 0x7f460c14e9e0 2023-08-22T00:44:31.533 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.532+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f460c063260 con 0x7f460c14e9e0 2023-08-22T00:44:31.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.648+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 98) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f4604079420 con 0x7f460c14e9e0 2023-08-22T00:44:31.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.649+0000 7f4608ff9700 1 -- 172.21.15.98:0/3396397330 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v98) v1 ==== 92+0+0 (secure 0 0 0) 0x7f4604047dd0 con 0x7f460c14e9e0 2023-08-22T00:44:31.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 msgr2=0x7f45f00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 0x7f45f00613f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4600006d80 tx=0x7f4600008040).stop 2023-08-22T00:44:31.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 msgr2=0x7f460c0c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f460400b6c0 tx=0x7f4604009840).stop 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 shutdown_connections 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45f005ef30 0x7f45f00613f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f460c14e9e0 0x7f460c0c0170 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f460c064290 0x7f460c14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 --2- 172.21.15.98:0/3396397330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f460c0c3550 0x7f460c0ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.653 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 >> 172.21.15.98:0/3396397330 conn(0x7f460c0c3a20 msgr2=0x7f460c1549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 shutdown_connections 2023-08-22T00:44:31.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.651+0000 7f4611b9d700 1 -- 172.21.15.98:0/3396397330 wait complete. 2023-08-22T00:44:31.665 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-22T00:44:31.790 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:31.789+0000 7f2d1d4e0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:31.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.789+0000 7f6bd4777700 1 Processor -- start 2023-08-22T00:44:31.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.789+0000 7f6bd4777700 1 -- start start 2023-08-22T00:44:31.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd4777700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd4777700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc1541c0 con 0x7f6bcc062600 2023-08-22T00:44:31.793 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd4777700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc062a90 con 0x7f6bcc157ab0 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd4777700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0ca860 con 0x7f6bcc0ad300 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1d12700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6bcc062600 0x7f6bcc0acbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51840/0 (socket says 172.21.15.98:51840) 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1d12700 1 -- 172.21.15.98:0/484220575 learned_addr learned my addr 172.21.15.98:0/484220575 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd2d14700 1 --2- 172.21.15.98:0/484220575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23109904 0 0) 0x7f6bcc1541c0 con 0x7f6bcc062600 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb80033f0 con 0x7f6bcc062600 2023-08-22T00:44:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554317096 0 0) 0x7f6bcc062a90 con 0x7f6bcc157ab0 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc1541c0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd2d14700 1 -- 172.21.15.98:0/484220575 >> v1:172.21.15.118:6789/0 conn(0x7f6bcc157ab0 legacy=0x7f6bcc0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd2d14700 1 -- 172.21.15.98:0/484220575 >> v1:172.21.15.98:6789/0 conn(0x7f6bcc062600 legacy=0x7f6bcc0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2252220735 0 0) 0x7f6bb80033f0 con 0x7f6bcc062600 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.790+0000 7f6bd2d14700 1 -- 172.21.15.98:0/484220575 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc062d70 con 0x7f6bcc0ad300 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd2d14700 1 --2- 172.21.15.98:0/484220575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc157e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bc4009e90 tx=0x7f6bc4009780).ready entity=mon.2 client_cookie=6ca7da7ecd559bc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400e070 con 0x7f6bcc0ad300 2023-08-22T00:44:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400b7a0 con 0x7f6bcc0ad300 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd1511700 1 -- 172.21.15.98:0/484220575 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc001470 con 0x7f6bcc0ad300 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 -- 172.21.15.98:0/484220575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 msgr2=0x7f6bcc157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 --2- 172.21.15.98:0/484220575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc157e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bc4009e90 tx=0x7f6bc4009780).stop 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 -- 172.21.15.98:0/484220575 shutdown_connections 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 --2- 172.21.15.98:0/484220575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc157e90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 -- 172.21.15.98:0/484220575 >> 172.21.15.98:0/484220575 conn(0x7f6bcc0cb600 msgr2=0x7f6bcc0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.796 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 -- 172.21.15.98:0/484220575 shutdown_connections 2023-08-22T00:44:31.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.791+0000 7f6bd4777700 1 -- 172.21.15.98:0/484220575 wait complete. 2023-08-22T00:44:31.797 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:31.792+0000 7fcade6fe680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.792+0000 7f6bd4777700 1 Processor -- start 2023-08-22T00:44:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 -- start start 2023-08-22T00:44:31.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc0ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 0x7f6bcc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc14ccb0 con 0x7f6bcc1481e0 2023-08-22T00:44:31.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0aad70 con 0x7f6bcc157ab0 2023-08-22T00:44:31.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd4777700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0aaff0 con 0x7f6bcc0ad300 2023-08-22T00:44:31.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd1d12700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd2513700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc0ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd2d14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 0x7f6bcc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:31.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd1d12700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:45208/0 (socket says 172.21.15.98:45208) 2023-08-22T00:44:31.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.793+0000 7f6bd1d12700 1 -- 172.21.15.98:0/589872340 learned_addr learned my addr 172.21.15.98:0/589872340 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:31.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 -- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 msgr2=0x7f6bcc0ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc0ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 -- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 msgr2=0x7f6bcc0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 0x7f6bcc0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 -- 172.21.15.98:0/589872340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009a20 con 0x7f6bcc157ab0 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd2513700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc0ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd2d14700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 0x7f6bcc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd1d12700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f6bbc00c810 tx=0x7f6bbc001a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:31.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0072e0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc007440 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0ab2d0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0057a0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.794+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc14c8d0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.795+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc14ce60 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.795+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 98) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f6bbc005b50 con 0x7f6bcc157ab0 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.796+0000 7f6bc27fc700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 0x7f6bb0061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.796+0000 7f6bd2513700 1 -- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 msgr2=0x7f6bb0061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.796+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f6bbc079a90 con 0x7f6bcc157ab0 2023-08-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.796+0000 7f6bd2513700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 0x7f6bb0061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.800+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bcc14ce60 con 0x7f6bcc157ab0 2023-08-22T00:44:31.854 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:31.853+0000 7f2d1d4e0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:31.859 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:31.858+0000 7fcade6fe680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:31.972 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.971+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6bcc14ce20 con 0x7f6bcc157ab0 2023-08-22T00:44:31.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.975+0000 7f6bc27fc700 1 -- 172.21.15.98:0/589872340 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6bbc04aba0 con 0x7f6bcc157ab0 2023-08-22T00:44:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 msgr2=0x7f6bb0061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 0x7f6bb0061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 msgr2=0x7f6bcc0aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f6bbc00c810 tx=0x7f6bbc001a20).stop 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 shutdown_connections 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f6bb005ef50 0x7f6bb0061410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bcc0ad300 0x7f6bcc0ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bcc1481e0 0x7f6bcc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 --2- 172.21.15.98:0/589872340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bcc157ab0 0x7f6bcc0aa880 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:31.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 >> 172.21.15.98:0/589872340 conn(0x7f6bcc0cb600 msgr2=0x7f6bcc0a9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:31.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 shutdown_connections 2023-08-22T00:44:31.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:31.977+0000 7f6bd4777700 1 -- 172.21.15.98:0/589872340 wait complete. 2023-08-22T00:44:31.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:31.991 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-22T00:44:32.015 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-22T00:44:32.126 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:32.126+0000 7f2d1d4e0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:32.149 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:32.148+0000 7fcade6fe680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:32.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.177+0000 7f52a7c24700 1 Processor -- start 2023-08-22T00:44:32.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 -- start start 2023-08-22T00:44:32.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 0x7f52a00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52a0158260 0x7f52a01586d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a00c7f60 con 0x7f52a00c1230 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a0155610 con 0x7f52a0158260 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.178+0000 7f52a7c24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0157dd0 con 0x7f52a00c1610 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52a0158260 0x7f52a01586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:32.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a59c0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f52a00c1230 0x7f52a0154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51850/0 (socket says 172.21.15.98:51850) 2023-08-22T00:44:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f52a0158260 0x7f52a01586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38984/0 (socket says 172.21.15.98:38984) 2023-08-22T00:44:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a59c0700 1 -- 172.21.15.98:0/810369473 learned_addr learned my addr 172.21.15.98:0/810369473 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a51bf700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 0x7f52a00c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:32.183 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 -- 172.21.15.98:0/810369473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 msgr2=0x7f52a00c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 0x7f52a00c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 -- 172.21.15.98:0/810369473 >> v1:172.21.15.98:6789/0 conn(0x7f52a00c1230 legacy=0x7f52a0154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 -- 172.21.15.98:0/810369473 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0154d70 con 0x7f52a0158260 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a49be700 1 -- 172.21.15.98:0/810369473 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646655745 0 0) 0x7f52a00c7f60 con 0x7f52a00c1230 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a51bf700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 0x7f52a00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a61c1700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a0158260 0x7f52a01586d0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f5298009e60 tx=0x7f5298009780).ready entity=mon.0 client_cookie=7744c560aae373a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:32.184 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a49be700 1 -- 172.21.15.98:0/810369473 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529800e070 con 0x7f52a0158260 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a49be700 1 -- 172.21.15.98:0/810369473 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529800bc30 con 0x7f52a0158260 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.179+0000 7f52a49be700 1 -- 172.21.15.98:0/810369473 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298012410 con 0x7f52a0158260 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 -- 172.21.15.98:0/810369473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a0158260 msgr2=0x7f52a01586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a0158260 0x7f52a01586d0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f5298009e60 tx=0x7f5298009780).stop 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 -- 172.21.15.98:0/810369473 shutdown_connections 2023-08-22T00:44:32.185 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a0158260 0x7f52a01586d0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 --2- 172.21.15.98:0/810369473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a00c1610 0x7f52a00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 -- 172.21.15.98:0/810369473 >> 172.21.15.98:0/810369473 conn(0x7f52a00645e0 msgr2=0x7f52a00649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 -- 172.21.15.98:0/810369473 shutdown_connections 2023-08-22T00:44:32.186 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.180+0000 7f52a7c24700 1 -- 172.21.15.98:0/810369473 wait complete. 2023-08-22T00:44:32.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.181+0000 7f52a7c24700 1 Processor -- start 2023-08-22T00:44:32.188 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.181+0000 7f52a7c24700 1 -- start start 2023-08-22T00:44:32.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52a00c1610 0x7f52a00af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a0158260 0x7f52a0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00cb700 con 0x7f52a00c1230 2023-08-22T00:44:32.189 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0144b30 con 0x7f52a00c1610 2023-08-22T00:44:32.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00b06b0 con 0x7f52a0158260 2023-08-22T00:44:32.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:32.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38996/0 (socket says 172.21.15.98:38996) 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 -- 172.21.15.98:0/2612976570 learned_addr learned my addr 172.21.15.98:0/2612976570 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a61c1700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a0158260 0x7f52a0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52a00c1610 0x7f52a00af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a0158260 msgr2=0x7f52a0151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a0158260 0x7f52a0151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52a00c1610 msgr2=0x7f52a00af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:32.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52a00c1610 0x7f52a00af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298009a20 con 0x7f52a00c1230 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a59c0700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f529c00c510 tx=0x7f529c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00ce80 con 0x7f52a00c1230 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c0072e0 con 0x7f52a00c1230 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a00afaa0 con 0x7f52a00c1230 2023-08-22T00:44:32.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.182+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c007660 con 0x7f52a00c1230 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.183+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a00b0060 con 0x7f52a00c1230 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.184+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a0047480 con 0x7f52a00c1230 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.184+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 98) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f529c0059b0 con 0x7f52a00c1230 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.185+0000 7f5295ffb700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.185+0000 7f52a51bf700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.185+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f529c079940 con 0x7f52a00c1230 2023-08-22T00:44:32.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.185+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:32.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.189+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f529c04a9f0 con 0x7f52a00c1230 2023-08-22T00:44:32.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.386+0000 7f52a51bf700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:32.387 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.386+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:32.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.395+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a0155050 con 0x7f528405ef80 2023-08-22T00:44:32.734 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:32.733+0000 7f2d1d4e0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:32.782 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:32.780+0000 7fcade6fe680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:32.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.787+0000 7f52a51bf700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:32.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:32.787+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-22T00:44:32.806 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:32.805+0000 7f2d1d4e0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:32.852 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:32.851+0000 7fcade6fe680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:32.990 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:32.990+0000 7f2d1d4e0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:33.041 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.035+0000 7fcade6fe680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:33.410 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:33.409+0000 7f2d1d4e0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:33.458 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.457+0000 7fcade6fe680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:33.512 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:33.512+0000 7f2d1d4e0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:33.561 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.560+0000 7fcade6fe680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:33.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:33.588+0000 7f52a51bf700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:33.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:33.588+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-22T00:44:33.664 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:33.663+0000 7f2d1d4e0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:33.715 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.714+0000 7fcade6fe680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:33.739 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:33.738+0000 7f2d1d4e0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:33.792 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.791+0000 7fcade6fe680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:33.806 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:33.805+0000 7f2d1d4e0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:33.859 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:33.858+0000 7fcade6fe680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:34.058 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:34.056+0000 7f2d1d4e0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:34.115 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:34.114+0000 7fcade6fe680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:34.242 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:34.240+0000 7f2d1d4e0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:34.298 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:34.297+0000 7fcade6fe680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:34.894 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:34.892+0000 7f2d1d4e0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:34.950 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:34.948+0000 7fcade6fe680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:34.963 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:34.961+0000 7f2d1d4e0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:35.019 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.018+0000 7fcade6fe680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:35.039 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.036+0000 7f2d1d4e0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:35.096 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.095+0000 7fcade6fe680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:35.187 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.185+0000 7f2d1d4e0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:35.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.189+0000 7f52a51bf700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:35.191 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.189+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-22T00:44:35.244 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.243+0000 7fcade6fe680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:35.257 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.256+0000 7f2d1d4e0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:35.315 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.314+0000 7fcade6fe680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:35.372 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.370+0000 7f2d1d4e0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:35.430 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.429+0000 7fcade6fe680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:35.479 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.478+0000 7f2d1d4e0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:35.539 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.537+0000 7fcade6fe680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:35.772 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.771+0000 7f2d1d4e0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:35.832 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.831+0000 7fcade6fe680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:35.844 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:35.842+0000 7f2d1d4e0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:35.904 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.903+0000 7fcade6fe680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:35.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.912+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 99) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f529c077350 con 0x7f52a00c1230 2023-08-22T00:44:35.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.923+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 100) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f529c042bc0 con 0x7f52a00c1230 2023-08-22T00:44:35.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.923+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f5284061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:35.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:35.923+0000 7f5295ffb700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f5284061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:35.987 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca589a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.987 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca589a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.987 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca589a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca589a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca589a7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca5c1ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca5c1ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca5c1ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca5c1ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:35.988 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:35.986+0000 7fca5c1ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:36.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.929+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 101) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f529c042710 con 0x7f52a00c1230 2023-08-22T00:44:36.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.929+0000 7f5295ffb700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f52840613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:36.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.929+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a0155050 con 0x7f528405ef80 2023-08-22T00:44:36.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.930+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f52840613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:36.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.932+0000 7f52a51bf700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f52840613c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5290008010 tx=0x7f5290008040).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:36.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.949+0000 7f5295ffb700 1 -- 172.21.15.98:0/2612976570 <== mgr.10032 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f52a0155050 con 0x7f528405ef80 2023-08-22T00:44:36.950 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path snap_test_dir1 2023-08-22T00:44:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 msgr2=0x7f52840613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f52840613c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5290008010 tx=0x7f5290008040).stop 2023-08-22T00:44:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 msgr2=0x7f52a0144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:36.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f529c00c510 tx=0x7f529c007c70).stop 2023-08-22T00:44:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 shutdown_connections 2023-08-22T00:44:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f528405ef80 0x7f52840613c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52a0158260 0x7f52a0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:36.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a00c1230 0x7f52a0144640 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 --2- 172.21.15.98:0/2612976570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52a00c1610 0x7f52a00af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 >> 172.21.15.98:0/2612976570 conn(0x7f52a00645e0 msgr2=0x7f52a00aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 shutdown_connections 2023-08-22T00:44:36.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:36.951+0000 7f52a7c24700 1 -- 172.21.15.98:0/2612976570 wait complete. 2023-08-22T00:44:36.967 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-22T00:44:36.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-22T00:44:37.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.092+0000 7fcf22323700 1 Processor -- start 2023-08-22T00:44:37.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.092+0000 7fcf22323700 1 -- start start 2023-08-22T00:44:37.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf22323700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf1c152c30 0x7fcf1c0630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf22323700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c0c2410 0x7fcf1c065fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf22323700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c1524c0 con 0x7fcf1c0635d0 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf22323700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c065b70 con 0x7fcf1c152c30 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf22323700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c063c50 con 0x7fcf1c0c2410 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf1bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf1c152c30 0x7fcf1c0630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf1b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcf1c0635d0 0x7fcf1c0c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51866/0 (socket says 172.21.15.98:51866) 2023-08-22T00:44:37.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf1b7fe700 1 -- 172.21.15.98:0/2587049576 learned_addr learned my addr 172.21.15.98:0/2587049576 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:37.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.093+0000 7fcf208c0700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c0c2410 0x7fcf1c065fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1bfff700 1 -- 172.21.15.98:0/2587049576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c0c2410 msgr2=0x7fcf1c065fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:37.097 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c0c2410 0x7fcf1c065fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1bfff700 1 -- 172.21.15.98:0/2587049576 >> v1:172.21.15.98:6789/0 conn(0x7fcf1c0635d0 legacy=0x7fcf1c0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1bfff700 1 -- 172.21.15.98:0/2587049576 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c063f30 con 0x7fcf1c152c30 2023-08-22T00:44:37.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1affd700 1 -- 172.21.15.98:0/2587049576 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354521835 0 0) 0x7fcf1c1524c0 con 0x7fcf1c0635d0 2023-08-22T00:44:37.098 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c152c30 0x7fcf1c0630e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fcf10009760 tx=0x7fcf10009060).ready entity=mon.0 client_cookie=4b8c31af13f43dad server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1affd700 1 -- 172.21.15.98:0/2587049576 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000b580 con 0x7fcf1c152c30 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1affd700 1 -- 172.21.15.98:0/2587049576 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000b6e0 con 0x7fcf1c152c30 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf1affd700 1 -- 172.21.15.98:0/2587049576 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000ba60 con 0x7fcf1c152c30 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 -- 172.21.15.98:0/2587049576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c152c30 msgr2=0x7fcf1c0630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c152c30 0x7fcf1c0630e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fcf10009760 tx=0x7fcf10009060).stop 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 -- 172.21.15.98:0/2587049576 shutdown_connections 2023-08-22T00:44:37.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c0c2410 0x7fcf1c065fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 --2- 172.21.15.98:0/2587049576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c152c30 0x7fcf1c0630e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 -- 172.21.15.98:0/2587049576 >> 172.21.15.98:0/2587049576 conn(0x7fcf1c0c3a60 msgr2=0x7fcf1c0c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:37.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 -- 172.21.15.98:0/2587049576 shutdown_connections 2023-08-22T00:44:37.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.094+0000 7fcf22323700 1 -- 172.21.15.98:0/2587049576 wait complete. 2023-08-22T00:44:37.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.096+0000 7fcf22323700 1 Processor -- start 2023-08-22T00:44:37.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.096+0000 7fcf22323700 1 -- start start 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.096+0000 7fcf22323700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 0x7fcf1c0a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.096+0000 7fcf22323700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c152c30 0x7fcf1c1372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0aa460 con 0x7fcf1c0c2410 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0a8050 con 0x7fcf1c0635d0 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0a8bd0 con 0x7fcf1c152c30 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39104/0 (socket says 172.21.15.98:39104) 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 -- 172.21.15.98:0/119275558 learned_addr learned my addr 172.21.15.98:0/119275558 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf208c0700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c152c30 0x7fcf1c1372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 0x7fcf1c0a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 -- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c152c30 msgr2=0x7fcf1c1372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c152c30 0x7fcf1c1372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 -- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 msgr2=0x7fcf1c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 0x7fcf1c0a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 -- 172.21.15.98:0/119275558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100092a0 con 0x7fcf1c0c2410 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 0x7fcf1c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf1b7fe700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7fcf0c00c510 tx=0x7fcf0c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0072e0 con 0x7fcf1c0c2410 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c007440 con 0x7fcf1c0c2410 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c163170 con 0x7fcf1c0c2410 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0057a0 con 0x7fcf1c0c2410 2023-08-22T00:44:37.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.097+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c0a8350 con 0x7fcf1c0c2410 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.098+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c068970 con 0x7fcf1c0c2410 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.098+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 101) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fcf0c005bd0 con 0x7fcf1c0c2410 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.099+0000 7fcf03fff700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 0x7fcf080611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.099+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fcf0c079650 con 0x7fcf1c0c2410 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.099+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 0x7fcf080611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:37.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.099+0000 7fcf1bfff700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 0x7fcf080611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcf1c0a9a60 tx=0x7fcf10017000).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:37.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.103+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf0c04aa10 con 0x7fcf1c0c2410 2023-08-22T00:44:37.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.290+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf1c0a8920 con 0x7fcf0805ed10 2023-08-22T00:44:37.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.295+0000 7fcf03fff700 1 -- 172.21.15.98:0/119275558 <== mgr.10032 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fcf1c0a8920 con 0x7fcf0805ed10 2023-08-22T00:44:37.296 INFO:teuthology.orchestra.run.smithi098.stdout:Retention added to path snap_test_dir1 2023-08-22T00:44:37.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.296+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 msgr2=0x7fcf080611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.296+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 0x7fcf080611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcf1c0a9a60 tx=0x7fcf10017000).stop 2023-08-22T00:44:37.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.296+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 msgr2=0x7fcf1c162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:37.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.296+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7fcf0c00c510 tx=0x7fcf0c007c70).stop 2023-08-22T00:44:37.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 shutdown_connections 2023-08-22T00:44:37.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fcf0805ed10 0x7fcf080611d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf1c152c30 0x7fcf1c1372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1c0635d0 0x7fcf1c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 --2- 172.21.15.98:0/119275558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf1c0c2410 0x7fcf1c162c80 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 >> 172.21.15.98:0/119275558 conn(0x7fcf1c0c3a60 msgr2=0x7fcf1c14ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 shutdown_connections 2023-08-22T00:44:37.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:37.297+0000 7fcf22323700 1 -- 172.21.15.98:0/119275558 wait complete. 2023-08-22T00:44:37.312 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-22T00:44:37.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-22T00:44:37.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-22T00:44:37.363 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2023-08-22T00:44:37.363 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2023-08-22T00:44:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2023-08-22T00:44:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-22T00:44:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2023-08-22T00:44:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2023-08-22T00:44:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-22T00:44:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2023-08-22T00:44:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2023-08-22T00:44:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2023-08-22T00:44:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2023-08-22T00:44:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2023-08-22T00:44:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2023-08-22T00:44:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2023-08-22T00:44:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2023-08-22T00:44:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-22T00:44:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-22T00:44:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2023-08-22T00:44:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-22T00:44:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2023-08-22T00:44:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2023-08-22T00:44:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.98,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.373 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2023-08-22T00:44:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2023-08-22T00:44:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2023-08-22T00:44:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2023-08-22T00:44:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2023-08-22T00:44:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2023-08-22T00:44:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2023-08-22T00:44:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2023-08-22T00:44:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2023-08-22T00:44:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2023-08-22T00:44:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2023-08-22T00:44:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2023-08-22T00:44:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2023-08-22T00:44:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 20 2023-08-22T00:44:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 20 2023-08-22T00:44:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:44:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2023-08-22T00:44:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 10 2023-08-22T00:44:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2023-08-22T00:44:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:44:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: debug finisher = 20 2023-08-22T00:44:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2023-08-22T00:44:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon op complaint time = 120 2023-08-22T00:44:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 600 2023-08-22T00:44:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = "" 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: client snapdir = .snap 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2023-08-22T00:44:37.388 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mds] 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: debug mds = 20 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-08-22T00:44:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug frag = True 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug scatterstat = True 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: mds op complaint time = 180 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: mds verify scatter = True 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-08-22T00:44:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-08-22T00:44:37.391 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-08-22T00:44:37.392 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-08-22T00:44:37.393 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-08-22T00:44:37.394 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-08-22T00:44:37.395 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-08-22T00:44:37.396 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.98,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 1e61d47e-5294-4f44-ba3b-d3c83a49a88d 2023-08-22T00:44:37.397 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-08-22T00:44:37.398 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-08-22T00:44:37.399 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-08-22T00:44:37.400 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2023-08-22T00:44:37.401 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-08-22T00:44:37.402 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:44:37.403 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: debug finisher = 20 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-08-22T00:44:37.404 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-08-22T00:44:37.405 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-22T00:44:37.406 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-22T00:44:37.407 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout: client snapdir = .snap 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-08-22T00:44:37.408 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-08-22T00:44:37.409 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-08-22T00:44:37.410 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-08-22T00:44:37.411 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:44:37.411 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:44:37.411 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:37.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[178947]: fuse finished with error 0 and tester_r 0 2023-08-22T00:44:37.470 INFO:teuthology.orchestra.run:waiting for 900 2023-08-22T00:44:43.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:44:43.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:43.573 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:44:43.597 DEBUG:teuthology.orchestra.run.smithi098:> ceph fs ls 2023-08-22T00:44:43.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.747+0000 7f2eb2531700 1 Processor -- start 2023-08-22T00:44:43.749 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eb2531700 1 -- start start 2023-08-22T00:44:43.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eb2531700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2eac0a8030 0x7f2eac0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:43.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eb2531700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0c4090 con 0x7f2eac0c6950 2023-08-22T00:44:43.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eb2531700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac154550 con 0x7f2eac0be4c0 2023-08-22T00:44:43.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eb2531700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0c6db0 con 0x7f2eac0a8030 2023-08-22T00:44:43.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.748+0000 7f2eab7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2eac0c6950 0x7f2eac0c8060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50798/0 (socket says 172.21.15.98:50798) 2023-08-22T00:44:43.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eab7fe700 1 -- 172.21.15.98:0/2590672764 learned_addr learned my addr 172.21.15.98:0/2590672764 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:43.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eabfff700 1 --2- 172.21.15.98:0/2590672764 >> v2:172.21.15.118:3300/0 conn(0x7f2eac0a8030 0x7f2eac0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:43.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eaaffd700 1 -- 172.21.15.98:0/2590672764 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338160485 0 0) 0x7f2eac0c4090 con 0x7f2eac0c6950 2023-08-22T00:44:43.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eaaffd700 1 -- 172.21.15.98:0/2590672764 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e940033f0 con 0x7f2eac0c6950 2023-08-22T00:44:43.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eabfff700 1 -- 172.21.15.98:0/2590672764 >> v1:172.21.15.118:6789/0 conn(0x7f2eac0be4c0 legacy=0x7f2eac063720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eabfff700 1 -- 172.21.15.98:0/2590672764 >> v1:172.21.15.98:6789/0 conn(0x7f2eac0c6950 legacy=0x7f2eac0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eabfff700 1 -- 172.21.15.98:0/2590672764 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0c8770 con 0x7f2eac0a8030 2023-08-22T00:44:43.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eabfff700 1 --2- 172.21.15.98:0/2590672764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac0c4c10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f2e9c006fd0 tx=0x7f2e9c006f40).ready entity=mon.1 client_cookie=43af1460280a4fc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:43.756 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eaaffd700 1 -- 172.21.15.98:0/2590672764 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c005880 con 0x7f2eac0a8030 2023-08-22T00:44:43.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eaaffd700 1 -- 172.21.15.98:0/2590672764 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0059e0 con 0x7f2eac0a8030 2023-08-22T00:44:43.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.749+0000 7f2eaaffd700 1 -- 172.21.15.98:0/2590672764 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c005d60 con 0x7f2eac0a8030 2023-08-22T00:44:43.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 -- 172.21.15.98:0/2590672764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 msgr2=0x7f2eac0c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 --2- 172.21.15.98:0/2590672764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac0c4c10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f2e9c006fd0 tx=0x7f2e9c006f40).stop 2023-08-22T00:44:43.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 -- 172.21.15.98:0/2590672764 shutdown_connections 2023-08-22T00:44:43.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 --2- 172.21.15.98:0/2590672764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac0c4c10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 -- 172.21.15.98:0/2590672764 >> 172.21.15.98:0/2590672764 conn(0x7f2eac092050 msgr2=0x7f2eac062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:43.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 -- 172.21.15.98:0/2590672764 shutdown_connections 2023-08-22T00:44:43.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.750+0000 7f2eb2531700 1 -- 172.21.15.98:0/2590672764 wait complete. 2023-08-22T00:44:43.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.751+0000 7f2eb2531700 1 Processor -- start 2023-08-22T00:44:43.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.752+0000 7f2eb2531700 1 -- start start 2023-08-22T00:44:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.752+0000 7f2eb2531700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.752+0000 7f2eb2531700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 0x7f2eac1633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac153700 con 0x7f2eac0be4c0 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0aa1d0 con 0x7f2eac0a8030 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0a8e30 con 0x7f2eac0c6950 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47578/0 (socket says 172.21.15.98:47578) 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 -- 172.21.15.98:0/595500041 learned_addr learned my addr 172.21.15.98:0/595500041 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:43.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eabfff700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb0ace700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 0x7f2eac1633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 -- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 msgr2=0x7f2eac1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 0x7f2eac1633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 -- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 msgr2=0x7f2eac156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 -- 172.21.15.98:0/595500041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009250 con 0x7f2eac0be4c0 2023-08-22T00:44:43.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eabfff700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb0ace700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 0x7f2eac1633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eab7fe700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f2ea000c420 tx=0x7f2ea0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00072e0 con 0x7f2eac0be4c0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0007440 con 0x7f2eac0be4c0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0a9110 con 0x7f2eac0be4c0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00057a0 con 0x7f2eac0be4c0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.753+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac0aa420 con 0x7f2eac0be4c0 2023-08-22T00:44:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.754+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac047480 con 0x7f2eac0be4c0 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.755+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 102) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f2ea0005bd0 con 0x7f2eac0be4c0 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.755+0000 7f2e93fff700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 0x7f2e980614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.755+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f2ea0079ba0 con 0x7f2eac0be4c0 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.755+0000 7f2eabfff700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 0x7f2e980614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.755+0000 7f2eabfff700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 0x7f2e980614d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2e9c006d00 tx=0x7f2e9c016000).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:43.767 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.759+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ea004ab90 con 0x7f2eac0be4c0 2023-08-22T00:44:43.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.961+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2eac05fd10 con 0x7f2eac0be4c0 2023-08-22T00:44:43.963 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.962+0000 7f2e93fff700 1 -- 172.21.15.98:0/595500041 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ea004e1b0 con 0x7f2eac0be4c0 2023-08-22T00:44:43.963 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-22T00:44:43.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 msgr2=0x7f2e980614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 0x7f2e980614d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2e9c006d00 tx=0x7f2e9c016000).stop 2023-08-22T00:44:43.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 msgr2=0x7f2eac0a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:43.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f2ea000c420 tx=0x7f2ea0007c80).stop 2023-08-22T00:44:43.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 shutdown_connections 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2e9805f010 0x7f2e980614d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2eac0c6950 0x7f2eac1633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eac0a8030 0x7f2eac156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 --2- 172.21.15.98:0/595500041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eac0be4c0 0x7f2eac0a8530 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 >> 172.21.15.98:0/595500041 conn(0x7f2eac092050 msgr2=0x7f2eac066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 shutdown_connections 2023-08-22T00:44:43.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:43.964+0000 7f2eb2531700 1 -- 172.21.15.98:0/595500041 wait complete. 2023-08-22T00:44:43.976 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-22T00:44:43.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-22T00:44:43.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-08-22T00:44:43.977 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-22T00:44:43.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:43.977 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-22T00:44:43.978 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-22T00:44:43.978 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-22T00:44:43.978 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:43.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:43.979 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-08-22T00:44:43.998 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-22T00:44:43.999 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-22T00:44:43.999 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-08-22T00:44:43.999 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:43.999 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:44.000 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 40222sec preferred_lft 40222sec 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-22T00:44:44.002 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::3096:d8ff:fe86:5f70/64 scope link 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 06:93:8e:3a:4a:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::493:8eff:fe3a:4a4a/64 scope link 2023-08-22T00:44:44.003 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.004 INFO:teuthology.orchestra.run.smithi098.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-22T00:44:44.004 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 26:be:fb:03:cf:b1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:44:44.004 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::24be:fbff:fe03:cfb1/64 scope link 2023-08-22T00:44:44.004 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-08-22T00:44:44.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:44.005 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-22T00:44:44.065 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-08-22T00:44:44.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:44.068 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-08-22T00:44:44.126 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-08-22T00:44:44.127 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-22T00:44:44.127 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-22T00:44:44.127 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-22T00:44:44.127 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-22T00:44:44.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:44.128 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-08-22T00:44:44.128 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-08-22T00:44:44.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-22T00:44:44.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-22T00:44:44.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-22T00:44:44.130 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-08-22T00:44:44.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:44.232 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:44:44.250 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:44:44.250 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:44:44.250 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:44.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:44.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-08-22T00:44:44.317 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-22T00:44:44.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:44.319 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:44.376 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-22T00:44:44.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:44:44.444 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:44:44.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:44:44.511 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:44:44.512 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:44:44.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:44.513 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:44:44.571 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-22T00:44:44.572 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:44.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-08-22T00:44:44.641 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-22T00:44:44.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-22T00:44:44.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2023-08-22T00:44:44.694+0000 7fca8bdcc3c0 -1 init, newargv = 0x55737ae6ba90 newargc=15 2023-08-22T00:44:44.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[179999]: starting ceph client 2023-08-22T00:44:44.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[179999]: starting fuse 2023-08-22T00:44:44.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-22T00:44:44.713 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-22T00:44:44.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:44.714 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-08-22T00:44:44.771 INFO:teuthology.orchestra.run.smithi098.stdout:46 2023-08-22T00:44:44.771 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-22T00:44:44.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-22T00:44:44.772 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-08-22T00:44:44.772 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-08-22T00:44:44.773 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-08-22T00:44:44.773 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-08-22T00:44:44.773 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:44.773 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-08-22T00:44:44.774 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-22T00:44:44.774 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-08-22T00:44:44.774 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-22T00:44:44.775 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:44.775 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-08-22T00:44:44.775 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-08-22T00:44:44.776 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-08-22T00:44:44.776 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-08-22T00:44:44.776 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:44.777 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-08-22T00:44:44.777 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-22T00:44:44.777 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-22T00:44:44.777 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-22T00:44:44.778 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-08-22T00:44:44.778 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-08-22T00:44:44.778 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-08-22T00:44:44.779 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-22T00:44:44.779 DEBUG:teuthology.orchestra.run.smithi098:> 2023-08-22T00:44:44.779 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2023-08-22T00:44:44.779 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-08-22T00:44:44.894 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.179999.asok 2023-08-22T00:44:45.076 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.179999.asok 2023-08-22T00:44:45.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:45.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.179999.asok status 2023-08-22T00:44:45.228 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:44:45.228 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-08-22T00:44:45.228 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "b36cacbf4a85bad07ce8507b71923096132ebbad", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 16.2.13-562-gb36cacbf (b36cacbf4a85bad07ce8507b71923096132ebbad) pacific (stable)", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "179999", 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:45.229 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 10101, 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 10101 2023-08-22T00:44:45.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:45.231 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:44:45.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:44:45.231 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:44:45.231 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3441224270 2023-08-22T00:44:45.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-08-22T00:44:45.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3441224270 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-08-22T00:44:45.233 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.10101 192.168.0.1:0/3441224270", 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/3441224270", 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 75, 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 204, 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-08-22T00:44:45.234 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-08-22T00:44:45.235 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:44:45.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:45.239 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-08-22T00:44:45.239 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:45.257 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-08-22T00:44:45.257 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:45.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:45.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:45.324 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-22-00_45_00 in ~23s... 2023-08-22T00:44:45.324 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-22T00:44:45.325 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-22T00:44:45.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.482+0000 7f3df7c0e700 1 Processor -- start 2023-08-22T00:44:45.484 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.482+0000 7f3df7c0e700 1 -- start start 2023-08-22T00:44:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df0069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 0x7f3df0062f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3df0063470 0x7f3df0157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00bdec0 con 0x7f3df0063470 2023-08-22T00:44:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00bbf70 con 0x7f3df0069c50 2023-08-22T00:44:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df7c0e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c22b0 con 0x7f3df014e8d0 2023-08-22T00:44:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df61ab700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3df0063470 0x7f3df0157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df61ab700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3df0063470 0x7f3df0157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47580/0 (socket says 172.21.15.98:47580) 2023-08-22T00:44:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df61ab700 1 -- 172.21.15.98:0/1459910864 learned_addr learned my addr 172.21.15.98:0/1459910864 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df59aa700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df0069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df51a9700 1 --2- 172.21.15.98:0/1459910864 >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 0x7f3df0062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df61ab700 1 -- 172.21.15.98:0/1459910864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 msgr2=0x7f3df0069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.483+0000 7f3df61ab700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df0069760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df61ab700 1 -- 172.21.15.98:0/1459910864 >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 msgr2=0x7f3df0062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df61ab700 1 --2- 172.21.15.98:0/1459910864 >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 0x7f3df0062f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df61ab700 1 -- 172.21.15.98:0/1459910864 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0063900 con 0x7f3df0063470 2023-08-22T00:44:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df51a9700 1 --2- 172.21.15.98:0/1459910864 >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 0x7f3df0062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df61ab700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df0157bd0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3df00650e0 tx=0x7f3de8009840).ready entity=mon.0 client_cookie=f20ba9c86f4477df server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df49a8700 1 -- 172.21.15.98:0/1459910864 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800e070 con 0x7f3df0063470 2023-08-22T00:44:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df49a8700 1 -- 172.21.15.98:0/1459910864 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800ba50 con 0x7f3df0063470 2023-08-22T00:44:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df49a8700 1 -- 172.21.15.98:0/1459910864 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800bdd0 con 0x7f3df0063470 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 -- 172.21.15.98:0/1459910864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 msgr2=0x7f3df0157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df0157bd0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3df00650e0 tx=0x7f3de8009840).stop 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 -- 172.21.15.98:0/1459910864 shutdown_connections 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df0069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/1459910864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df0157bd0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/1459910864 >> v2:172.21.15.118:3300/0 conn(0x7f3df0069c50 0x7f3df0062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 -- 172.21.15.98:0/1459910864 >> 172.21.15.98:0/1459910864 conn(0x7f3df00c3ab0 msgr2=0x7f3df00c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 -- 172.21.15.98:0/1459910864 shutdown_connections 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.484+0000 7f3df7c0e700 1 -- 172.21.15.98:0/1459910864 wait complete. 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.485+0000 7f3df7c0e700 1 Processor -- start 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 -- start start 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3df0069c50 0x7f3df00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df00acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00a8300 con 0x7f3df0063470 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00a79d0 con 0x7f3df0069c50 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df7c0e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00a7cb0 con 0x7f3df014e8d0 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df59aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df59aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47590/0 (socket says 172.21.15.98:47590) 2023-08-22T00:44:45.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.486+0000 7f3df59aa700 1 -- 172.21.15.98:0/2604245083 learned_addr learned my addr 172.21.15.98:0/2604245083 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df51a9700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3df0069c50 0x7f3df00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df61ab700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df00acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 -- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 msgr2=0x7f3df00acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df00acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 -- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3df0069c50 msgr2=0x7f3df00ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3df0069c50 0x7f3df00ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 -- 172.21.15.98:0/2604245083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009ae0 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df61ab700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df00acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df59aa700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f3de000d890 tx=0x7f3de0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00125f0 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0012750 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00a7f90 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0012ad0 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.487+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00acfb0 con 0x7f3df0063470 2023-08-22T00:44:45.502 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.488+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df0047480 con 0x7f3df0063470 2023-08-22T00:44:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.488+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 102) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f3de0013480 con 0x7f3df0063470 2023-08-22T00:44:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.489+0000 7f3de5ffb700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 0x7f3dd40614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.489+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f3de007a180 con 0x7f3df0063470 2023-08-22T00:44:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.489+0000 7f3df51a9700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 0x7f3dd40614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.489+0000 7f3df51a9700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 0x7f3dd40614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3dec006d80 tx=0x7f3dec008040).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.493+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3de004b110 con 0x7f3df0063470 2023-08-22T00:44:45.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.678+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3df005e8d0 con 0x7f3dd405f010 2023-08-22T00:44:45.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.680+0000 7f3de5ffb700 1 -- 172.21.15.98:0/2604245083 <== mgr.10032 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f3df005e8d0 con 0x7f3dd405f010 2023-08-22T00:44:45.682 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:45.683 INFO:teuthology.orchestra.run.smithi098.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-22T00:44:45.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 msgr2=0x7f3dd40614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 0x7f3dd40614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3dec006d80 tx=0x7f3dec008040).stop 2023-08-22T00:44:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 msgr2=0x7f3df014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f3de000d890 tx=0x7f3de0008040).stop 2023-08-22T00:44:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 shutdown_connections 2023-08-22T00:44:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3dd405f010 0x7f3dd40614d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3df014e8d0 0x7f3df00acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df0063470 0x7f3df014df90 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 --2- 172.21.15.98:0/2604245083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3df0069c50 0x7f3df00ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 >> 172.21.15.98:0/2604245083 conn(0x7f3df00c3ab0 msgr2=0x7f3df00c2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 shutdown_connections 2023-08-22T00:44:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.682+0000 7f3df7c0e700 1 -- 172.21.15.98:0/2604245083 wait complete. 2023-08-22T00:44:45.696 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-22T00:44:45.696 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-22T00:44:45.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-22T00:44:45.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.815+0000 7f1281d6f700 1 Processor -- start 2023-08-22T00:44:45.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.815+0000 7f1281d6f700 1 -- start start 2023-08-22T00:44:45.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f1281d6f700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f127c151a00 0x7f127c067c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f1281d6f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 0x7f127c094dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f1281d6f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0677f0 con 0x7f127c151de0 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f1281d6f700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c066be0 con 0x7f127c151a00 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f1281d6f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c066ec0 con 0x7f127c0bd0e0 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f127b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f127c151a00 0x7f127c067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f127b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f127c151a00 0x7f127c067c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47600/0 (socket says 172.21.15.98:47600) 2023-08-22T00:44:45.820 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f127affd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f127c151de0 0x7f127c066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50800/0 (socket says 172.21.15.98:50800) 2023-08-22T00:44:45.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.816+0000 7f127b7fe700 1 -- 172.21.15.98:0/2427026174 learned_addr learned my addr 172.21.15.98:0/2427026174 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:45.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127bfff700 1 --2- 172.21.15.98:0/2427026174 >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 0x7f127c094dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127b7fe700 1 -- 172.21.15.98:0/2427026174 >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 msgr2=0x7f127c094dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:45.821 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127b7fe700 1 --2- 172.21.15.98:0/2427026174 >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 0x7f127c094dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127b7fe700 1 -- 172.21.15.98:0/2427026174 >> v1:172.21.15.98:6789/0 conn(0x7f127c151de0 legacy=0x7f127c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127b7fe700 1 -- 172.21.15.98:0/2427026174 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0671a0 con 0x7f127c151a00 2023-08-22T00:44:45.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127a7fc700 1 -- 172.21.15.98:0/2427026174 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015525084 0 0) 0x7f127c0677f0 con 0x7f127c151de0 2023-08-22T00:44:45.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127bfff700 1 --2- 172.21.15.98:0/2427026174 >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 0x7f127c094dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:45.822 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127b7fe700 1 --2- 172.21.15.98:0/2427026174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151a00 0x7f127c067c80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f127c0bd560 tx=0x7f12700090f0).ready entity=mon.0 client_cookie=33533b396d5e4311 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127a7fc700 1 -- 172.21.15.98:0/2427026174 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000b600 con 0x7f127c151a00 2023-08-22T00:44:45.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127a7fc700 1 -- 172.21.15.98:0/2427026174 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000b760 con 0x7f127c151a00 2023-08-22T00:44:45.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f127a7fc700 1 -- 172.21.15.98:0/2427026174 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000bae0 con 0x7f127c151a00 2023-08-22T00:44:45.823 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f1281d6f700 1 -- 172.21.15.98:0/2427026174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151a00 msgr2=0x7f127c067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.817+0000 7f1281d6f700 1 --2- 172.21.15.98:0/2427026174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151a00 0x7f127c067c80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f127c0bd560 tx=0x7f12700090f0).stop 2023-08-22T00:44:45.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 -- 172.21.15.98:0/2427026174 shutdown_connections 2023-08-22T00:44:45.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 --2- 172.21.15.98:0/2427026174 >> v2:172.21.15.118:3300/0 conn(0x7f127c0bd0e0 0x7f127c094dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 --2- 172.21.15.98:0/2427026174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151a00 0x7f127c067c80 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 -- 172.21.15.98:0/2427026174 >> 172.21.15.98:0/2427026174 conn(0x7f127c0c4350 msgr2=0x7f127c0c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 -- 172.21.15.98:0/2427026174 shutdown_connections 2023-08-22T00:44:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.818+0000 7f1281d6f700 1 -- 172.21.15.98:0/2427026174 wait complete. 2023-08-22T00:44:45.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.819+0000 7f1281d6f700 1 Processor -- start 2023-08-22T00:44:45.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.819+0000 7f1281d6f700 1 -- start start 2023-08-22T00:44:45.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 0x7f127c0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f127c151a00 0x7f127c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c17a0 con 0x7f127c151de0 2023-08-22T00:44:45.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0bf640 con 0x7f127c0bd0e0 2023-08-22T00:44:45.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f1281d6f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0bf920 con 0x7f127c151a00 2023-08-22T00:44:45.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f127bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f127bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47608/0 (socket says 172.21.15.98:47608) 2023-08-22T00:44:45.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.820+0000 7f127bfff700 1 -- 172.21.15.98:0/1915150666 learned_addr learned my addr 172.21.15.98:0/1915150666 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:45.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127affd700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f127c151a00 0x7f127c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127b7fe700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 0x7f127c0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 -- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f127c151a00 msgr2=0x7f127c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f127c151a00 0x7f127c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.831 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 -- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 msgr2=0x7f127c0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 0x7f127c0c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 -- 172.21.15.98:0/1915150666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009370 con 0x7f127c151de0 2023-08-22T00:44:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127b7fe700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 0x7f127c0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f127bfff700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f127400a380 tx=0x7f1274007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400ae10 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400d650 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400d9d0 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0bfc00 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.821+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0c01c0 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.822+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c047480 con 0x7f127c151de0 2023-08-22T00:44:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.822+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 102) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f1274013070 con 0x7f127c151de0 2023-08-22T00:44:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.823+0000 7f12637fe700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 0x7f12680614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.823+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f127407ae30 con 0x7f127c151de0 2023-08-22T00:44:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.823+0000 7f127b7fe700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 0x7f12680614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.823+0000 7f127b7fe700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 0x7f12680614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1270009130 tx=0x7f1270017000).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:45.827+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f127404be20 con 0x7f127c151de0 2023-08-22T00:44:46.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.014+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c067480 con 0x7f126805f010 2023-08-22T00:44:46.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.018+0000 7f12637fe700 1 -- 172.21.15.98:0/1915150666 <== mgr.10032 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f127c067480 con 0x7f126805f010 2023-08-22T00:44:46.020 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule removed for path snap_test_dir1 2023-08-22T00:44:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 msgr2=0x7f12680614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 0x7f12680614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1270009130 tx=0x7f1270017000).stop 2023-08-22T00:44:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 msgr2=0x7f127c165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f127400a380 tx=0x7f1274007900).stop 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 shutdown_connections 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f126805f010 0x7f12680614d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f127c151de0 0x7f127c165550 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f127c0bd0e0 0x7f127c0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 --2- 172.21.15.98:0/1915150666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f127c151a00 0x7f127c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 >> 172.21.15.98:0/1915150666 conn(0x7f127c0c4350 msgr2=0x7f127c066390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:46.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 shutdown_connections 2023-08-22T00:44:46.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.020+0000 7f1281d6f700 1 -- 172.21.15.98:0/1915150666 wait complete. 2023-08-22T00:44:46.033 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-22T00:44:46.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:46.034 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-22T00:44:46.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-22T00:44:46.058 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-22T00:44:46.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-22T00:44:46.277 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.276+0000 7fe7aabbd700 1 Processor -- start 2023-08-22T00:44:46.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.276+0000 7fe7aabbd700 1 -- start start 2023-08-22T00:44:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7aabbd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7a4151a00 0x7fe7a4067c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7aabbd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe7a4151de0 0x7fe7a4066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7aabbd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a40677f0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7aabbd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a4066be0 con 0x7fe7a4151de0 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7aabbd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a4066ec0 con 0x7fe7a4151a00 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7a3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe7a4151de0 0x7fe7a4066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:46.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7a3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe7a4151de0 0x7fe7a4066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47610/0 (socket says 172.21.15.98:47610) 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.277+0000 7fe7a3fff700 1 -- 172.21.15.98:0/3228058977 learned_addr learned my addr 172.21.15.98:0/3228058977 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a3fff700 1 -- 172.21.15.98:0/3228058977 >> v2:172.21.15.118:3300/0 conn(0x7fe7a4151a00 msgr2=0x7fe7a4067c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a3fff700 1 --2- 172.21.15.98:0/3228058977 >> v2:172.21.15.118:3300/0 conn(0x7fe7a4151a00 0x7fe7a4067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a3fff700 1 -- 172.21.15.98:0/3228058977 >> v1:172.21.15.118:6789/0 conn(0x7fe7a40bd0e0 legacy=0x7fe7a4094dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a3fff700 1 -- 172.21.15.98:0/3228058977 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40671a0 con 0x7fe7a4151de0 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a3fff700 1 --2- 172.21.15.98:0/3228058977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a4151de0 0x7fe7a4066390 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7fe7a4069b10 tx=0x7fe78c0090f0).ready entity=mon.0 client_cookie=63826f2d0299d853 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a37fe700 1 -- 172.21.15.98:0/3228058977 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00b5a0 con 0x7fe7a4151de0 2023-08-22T00:44:46.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a37fe700 1 -- 172.21.15.98:0/3228058977 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00b700 con 0x7fe7a4151de0 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7a37fe700 1 -- 172.21.15.98:0/3228058977 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00ba80 con 0x7fe7a4151de0 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 -- 172.21.15.98:0/3228058977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a4151de0 msgr2=0x7fe7a4066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/3228058977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a4151de0 0x7fe7a4066390 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7fe7a4069b10 tx=0x7fe78c0090f0).stop 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 -- 172.21.15.98:0/3228058977 shutdown_connections 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/3228058977 >> v2:172.21.15.118:3300/0 conn(0x7fe7a4151a00 0x7fe7a4067c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/3228058977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a4151de0 0x7fe7a4066390 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 -- 172.21.15.98:0/3228058977 >> 172.21.15.98:0/3228058977 conn(0x7fe7a40c4350 msgr2=0x7fe7a40c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 -- 172.21.15.98:0/3228058977 shutdown_connections 2023-08-22T00:44:46.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.278+0000 7fe7aabbd700 1 -- 172.21.15.98:0/3228058977 wait complete. 2023-08-22T00:44:46.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.280+0000 7fe7aabbd700 1 Processor -- start 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.280+0000 7fe7aabbd700 1 -- start start 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.280+0000 7fe7aabbd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7a4151a00 0x7fe7a4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7a4151de0 0x7fe7a4165b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41625b0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41665d0 con 0x7fe7a4151de0 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41668b0 con 0x7fe7a4151a00 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47616/0 (socket says 172.21.15.98:47616) 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 -- 172.21.15.98:0/833942076 learned_addr learned my addr 172.21.15.98:0/833942076 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a3fff700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7a4151a00 0x7fe7a4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a915a700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7a4151de0 0x7fe7a4165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 -- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7a4151a00 msgr2=0x7fe7a4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7a4151a00 0x7fe7a4154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 -- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7a4151de0 msgr2=0x7fe7a4165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7a4151de0 0x7fe7a4165b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 -- 172.21.15.98:0/833942076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009370 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a8959700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7fe79c00bc30 tx=0x7fe79c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00c7a0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c010070 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a41627d0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00c960 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.281+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a41634c0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.282+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4166af0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.283+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 102) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fe79c00ccd0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.283+0000 7fe7a0ff9700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 0x7fe7840614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.283+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fe79c079c80 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.283+0000 7fe7a3fff700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 0x7fe7840614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.283+0000 7fe7a3fff700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 0x7fe7840614d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe7a4152270 tx=0x7fe78c015000).ready entity=mgr.10032 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:46.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.287+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7a4166af0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.489+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe7a4166af0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.622+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fe79c0775d0 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.624+0000 7fe7a0ff9700 1 -- 172.21.15.98:0/833942076 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v103) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe79c071a10 con 0x7fe7a40bd0e0 2023-08-22T00:44:46.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 msgr2=0x7fe7840614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 0x7fe7840614d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe7a4152270 tx=0x7fe78c015000).stop 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 msgr2=0x7fe7a4162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7fe79c00bc30 tx=0x7fe79c009840).stop 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 shutdown_connections 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe78405f010 0x7fe7840614d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7a4151de0 0x7fe7a4165b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7a40bd0e0 0x7fe7a4162fd0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 --2- 172.21.15.98:0/833942076 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7a4151a00 0x7fe7a4154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 >> 172.21.15.98:0/833942076 conn(0x7fe7a40c4350 msgr2=0x7fe7a40642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 shutdown_connections 2023-08-22T00:44:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:46.626+0000 7fe7aabbd700 1 -- 172.21.15.98:0/833942076 wait complete. 2023-08-22T00:44:46.643 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-22T00:44:46.644 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:46.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-22T00:44:46.734 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-22T00:44:46.735 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-08-22T00:44:46.735 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-22T00:44:46.736 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-22T00:44:46.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[179999]: fuse finished with error 0 and tester_r 0 2023-08-22T00:44:46.771 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:44:46.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:46.772 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-22T00:44:46.773 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:46.769+0000 7fc7551fa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:46.775 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:46.774+0000 7f37471db680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-22T00:44:46.834 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:46.832+0000 7fc7551fa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:46.841 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:46.839+0000 7f37471db680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-22T00:44:46.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:44:46.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:46.894 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-22T00:44:46.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-08-22T00:44:46.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:44:46.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:46.917 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-22T00:44:46.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:46.936 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-22T00:44:46.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:44:46.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:46.937 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-22T00:44:46.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:44:46.973 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-22T00:44:46.973 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:47.095 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.094+0000 7f6007f45700 1 Processor -- start 2023-08-22T00:44:47.096 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.094+0000 7f6007f45700 1 -- start start 2023-08-22T00:44:47.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6007f45700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60000aae30 0x7f60000c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6007f45700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000688c0 0x7f6000068d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.099 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6007f45700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6000069260 con 0x7f60000c5b70 2023-08-22T00:44:47.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6007f45700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000c6390 con 0x7f60000aae30 2023-08-22T00:44:47.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6007f45700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6000152070 con 0x7f60000688c0 2023-08-22T00:44:47.100 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6005ce1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60000aae30 0x7f60000c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6005ce1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60000aae30 0x7f60000c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47636/0 (socket says 172.21.15.98:47636) 2023-08-22T00:44:47.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f6005ce1700 1 -- 172.21.15.98:0/1607015365 learned_addr learned my addr 172.21.15.98:0/1607015365 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:47.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.095+0000 7f60064e2700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000688c0 0x7f6000068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6005ce1700 1 -- 172.21.15.98:0/1607015365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000688c0 msgr2=0x7f6000068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:47.101 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6005ce1700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000688c0 0x7f6000068d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6005ce1700 1 -- 172.21.15.98:0/1607015365 >> v1:172.21.15.118:6789/0 conn(0x7f60000c5b70 legacy=0x7f60000c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6004cdf700 1 -- 172.21.15.98:0/1607015365 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653563595 0 0) 0x7f5ff0001110 con 0x7f60000c5b70 2023-08-22T00:44:47.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6005ce1700 1 -- 172.21.15.98:0/1607015365 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000c4140 con 0x7f60000aae30 2023-08-22T00:44:47.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6005ce1700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000aae30 0x7f60000c39d0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f5ffc006fd0 tx=0x7f5ffc0090f0).ready entity=mon.0 client_cookie=5d837ca150ca11b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.102 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6004cdf700 1 -- 172.21.15.98:0/1607015365 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00b610 con 0x7f60000aae30 2023-08-22T00:44:47.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6004cdf700 1 -- 172.21.15.98:0/1607015365 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc00b770 con 0x7f60000aae30 2023-08-22T00:44:47.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6004cdf700 1 -- 172.21.15.98:0/1607015365 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00baf0 con 0x7f60000aae30 2023-08-22T00:44:47.103 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 -- 172.21.15.98:0/1607015365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000aae30 msgr2=0x7f60000c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000aae30 0x7f60000c39d0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f5ffc006fd0 tx=0x7f5ffc0090f0).stop 2023-08-22T00:44:47.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 -- 172.21.15.98:0/1607015365 shutdown_connections 2023-08-22T00:44:47.104 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000688c0 0x7f6000068d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 --2- 172.21.15.98:0/1607015365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000aae30 0x7f60000c39d0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.096+0000 7f6007f45700 1 -- 172.21.15.98:0/1607015365 >> 172.21.15.98:0/1607015365 conn(0x7f60000c9490 msgr2=0x7f60000c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.105 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.097+0000 7f6007f45700 1 -- 172.21.15.98:0/1607015365 shutdown_connections 2023-08-22T00:44:47.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.097+0000 7f6007f45700 1 -- 172.21.15.98:0/1607015365 wait complete. 2023-08-22T00:44:47.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 Processor -- start 2023-08-22T00:44:47.106 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 -- start start 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000aae30 0x7f60000a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60000c5b70 0x7f60000a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000a4dc0 con 0x7f60000688c0 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6000065980 con 0x7f60000c5b70 2023-08-22T00:44:47.110 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.098+0000 7f6007f45700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000654f0 con 0x7f60000aae30 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47648/0 (socket says 172.21.15.98:47648) 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 -- 172.21.15.98:0/283431939 learned_addr learned my addr 172.21.15.98:0/283431939 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f60064e2700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60000c5b70 0x7f60000a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f60054e0700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000aae30 0x7f60000a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000aae30 msgr2=0x7f60000a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.111 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000aae30 0x7f60000a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60000c5b70 msgr2=0x7f60000a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60000c5b70 0x7f60000a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 -- 172.21.15.98:0/283431939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009370 con 0x7f60000688c0 2023-08-22T00:44:47.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6005ce1700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5ffc009ea0 tx=0x7f5ffc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00beb0 con 0x7f60000688c0 2023-08-22T00:44:47.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc00b8e0 con 0x7f60000688c0 2023-08-22T00:44:47.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000648e0 con 0x7f60000688c0 2023-08-22T00:44:47.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc01c670 con 0x7f60000688c0 2023-08-22T00:44:47.114 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.099+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6000064ea0 con 0x7f60000688c0 2023-08-22T00:44:47.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.100+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60000657d0 con 0x7f60000688c0 2023-08-22T00:44:47.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.101+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f5ffc01ca20 con 0x7f60000688c0 2023-08-22T00:44:47.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.101+0000 7f5ff5ffb700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 0x7f5fe4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.101+0000 7f60054e0700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 msgr2=0x7f5fe4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:47.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.101+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f5ffc07bd60 con 0x7f60000688c0 2023-08-22T00:44:47.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.101+0000 7f60054e0700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 0x7f5fe4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:47.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.106+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ffc04cd50 con 0x7f60000688c0 2023-08-22T00:44:47.119 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:47.114+0000 7fc7551fa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:47.129 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:47.128+0000 7f37471db680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-22T00:44:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.302+0000 7f60054e0700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 msgr2=0x7f5fe4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:47.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.302+0000 7f60054e0700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 0x7f5fe4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:47.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.318+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6000047480 con 0x7f60000688c0 2023-08-22T00:44:47.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.319+0000 7f5ff5ffb700 1 -- 172.21.15.98:0/283431939 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f5ffc050370 con 0x7f60000688c0 2023-08-22T00:44:47.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:47.321 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:47.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 msgr2=0x7f5fe4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:47.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 0x7f5fe4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 msgr2=0x7f6000063f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5ffc009ea0 tx=0x7f5ffc017000).stop 2023-08-22T00:44:47.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 shutdown_connections 2023-08-22T00:44:47.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f5fe405efc0 0x7f5fe4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60000c5b70 0x7f60000a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60000688c0 0x7f6000063f70 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 --2- 172.21.15.98:0/283431939 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60000aae30 0x7f60000a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 >> 172.21.15.98:0/283431939 conn(0x7f60000c9490 msgr2=0x7f60001514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 shutdown_connections 2023-08-22T00:44:47.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.321+0000 7f6007f45700 1 -- 172.21.15.98:0/283431939 wait complete. 2023-08-22T00:44:47.328 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:47.336 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:47.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.455+0000 7fa54c5f9700 1 Processor -- start 2023-08-22T00:44:47.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.455+0000 7fa54c5f9700 1 -- start start 2023-08-22T00:44:47.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54c5f9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5440c5b70 0x7fa5440c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54c5f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54c5f9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440c4140 con 0x7fa5440aae30 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54c5f9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440c6390 con 0x7fa5440c5b70 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54c5f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa544152070 con 0x7fa5440688c0 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5440c5b70 0x7fa5440c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54ab96700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5440c5b70 0x7fa5440c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:47274/0 (socket says 172.21.15.98:47274) 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54ab96700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:55602/0 (socket says 172.21.15.98:55602) 2023-08-22T00:44:47.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 -- 172.21.15.98:0/1962832874 learned_addr learned my addr 172.21.15.98:0/1962832874 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:47.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54a395700 1 --1- 172.21.15.98:0/1962832874 >> v1:172.21.15.118:6789/0 conn(0x7fa5440aae30 0x7fa5440c7d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:41440/0 (socket says 172.21.15.98:41440) 2023-08-22T00:44:47.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 -- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 msgr2=0x7fa544068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:47.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 -- 172.21.15.98:0/1962832874 >> v1:172.21.15.118:6789/0 conn(0x7fa5440aae30 legacy=0x7fa5440c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549393700 1 -- 172.21.15.98:0/1962832874 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180072685 0 0) 0x7fa5440c4140 con 0x7fa5440aae30 2023-08-22T00:44:47.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 -- 172.21.15.98:0/1962832874 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440c7900 con 0x7fa5440c5b70 2023-08-22T00:44:47.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa54ab96700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:47.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549b94700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440c5b70 0x7fa5440c39d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa534006fd0 tx=0x7fa5340090f0).ready entity=mon.1 client_cookie=65545f6e773ad1a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549393700 1 -- 172.21.15.98:0/1962832874 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b610 con 0x7fa5440c5b70 2023-08-22T00:44:47.467 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549393700 1 -- 172.21.15.98:0/1962832874 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b770 con 0x7fa5440c5b70 2023-08-22T00:44:47.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.457+0000 7fa549393700 1 -- 172.21.15.98:0/1962832874 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400baf0 con 0x7fa5440c5b70 2023-08-22T00:44:47.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 -- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440c5b70 msgr2=0x7fa5440c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.468 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440c5b70 0x7fa5440c39d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa534006fd0 tx=0x7fa5340090f0).stop 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 -- 172.21.15.98:0/1962832874 shutdown_connections 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440688c0 0x7fa544068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/1962832874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440c5b70 0x7fa5440c39d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 -- 172.21.15.98:0/1962832874 >> 172.21.15.98:0/1962832874 conn(0x7fa5440c9490 msgr2=0x7fa5440c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 -- 172.21.15.98:0/1962832874 shutdown_connections 2023-08-22T00:44:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.458+0000 7fa54c5f9700 1 -- 172.21.15.98:0/1962832874 wait complete. 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.459+0000 7fa54c5f9700 1 Processor -- start 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.459+0000 7fa54c5f9700 1 -- start start 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 0x7fa544153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440aae30 0x7fa5440c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa544153d40 con 0x7fa5440c5b70 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440642e0 con 0x7fa5440688c0 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54c5f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c2380 con 0x7fa5440aae30 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54ab96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54a395700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 0x7fa544153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54ab96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47658/0 (socket says 172.21.15.98:47658) 2023-08-22T00:44:47.471 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54ab96700 1 -- 172.21.15.98:0/3425877549 learned_addr learned my addr 172.21.15.98:0/3425877549 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:47.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa549b94700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440aae30 0x7fa5440c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54a395700 1 -- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440aae30 msgr2=0x7fa5440c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54a395700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440aae30 0x7fa5440c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.460+0000 7fa54a395700 1 -- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 msgr2=0x7fa54414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.472 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54a395700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54a395700 1 -- 172.21.15.98:0/3425877549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009a20 con 0x7fa5440688c0 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54ab96700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54a395700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 0x7fa544153850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fa54000c440 tx=0x7fa540007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400070d0 con 0x7fa5440688c0 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540007230 con 0x7fa5440688c0 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400056e0 con 0x7fa5440688c0 2023-08-22T00:44:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa534009370 con 0x7fa5440688c0 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.461+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5440c28b0 con 0x7fa5440688c0 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.462+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544062940 con 0x7fa5440688c0 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.462+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fa540005a90 con 0x7fa5440688c0 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.462+0000 7fa53a7fc700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 0x7fa528061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.462+0000 7fa549b94700 1 -- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 msgr2=0x7fa528061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.463+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fa540079940 con 0x7fa5440688c0 2023-08-22T00:44:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.463+0000 7fa549b94700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 0x7fa528061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:47.475 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.467+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa54004a930 con 0x7fa5440688c0 2023-08-22T00:44:47.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.633+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa544047480 con 0x7fa5440688c0 2023-08-22T00:44:47.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.634+0000 7fa53a7fc700 1 -- 172.21.15.98:0/3425877549 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17688 (secure 0 0 0) 0x7fa54004df50 con 0x7fa5440688c0 2023-08-22T00:44:47.635 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:47.636 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":204,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:35.917960+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:6832/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1540437146":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/4280173716":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3051248189":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1757469699":"2023-08-23T00:44:35.917919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 msgr2=0x7fa528061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 0x7fa528061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 msgr2=0x7fa544153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 0x7fa544153850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fa54000c440 tx=0x7fa540007bd0).stop 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 shutdown_connections 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa52805efc0 0x7fa528061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5440c5b70 0x7fa54414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5440688c0 0x7fa544153850 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 --2- 172.21.15.98:0/3425877549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5440aae30 0x7fa5440c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 >> 172.21.15.98:0/3425877549 conn(0x7fa5440c9490 msgr2=0x7fa544150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 shutdown_connections 2023-08-22T00:44:47.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.636+0000 7fa54c5f9700 1 -- 172.21.15.98:0/3425877549 wait complete. 2023-08-22T00:44:47.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-22T00:06:00.072840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-22T00:06:02.532310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-22T00:44:18.107388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '202', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-08-22T00:44:18.950774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '203', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-22T00:44:47.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-22T00:44:47.731 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:47.725+0000 7fc7551fa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:47.769 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:47.768+0000 7f37471db680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-22T00:44:47.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.796+0000 7f8122d5f700 1 Processor -- start 2023-08-22T00:44:47.797 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.796+0000 7f8122d5f700 1 -- start start 2023-08-22T00:44:47.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8122d5f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 0x7f811c069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8122d5f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 0x7f811c0bc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8122d5f700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c06a0e0 con 0x7f811c0c1ef0 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8122d5f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c153430 con 0x7f811c152440 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8122d5f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c1528c0 con 0x7f811c069c50 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8120afb700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f811c0c1ef0 0x7f811c0c22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50804/0 (socket says 172.21.15.98:50804) 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f8120afb700 1 -- 172.21.15.98:0/1335333065 learned_addr learned my addr 172.21.15.98:0/1335333065 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f811bfff700 1 --2- 172.21.15.98:0/1335333065 >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 0x7f811c069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 --2- 172.21.15.98:0/1335333065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 0x7f811c0bc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f811b7fe700 1 -- 172.21.15.98:0/1335333065 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13050387 0 0) 0x7f811c06a0e0 con 0x7f811c0c1ef0 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f811b7fe700 1 -- 172.21.15.98:0/1335333065 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f810c0033f0 con 0x7f811c0c1ef0 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 -- 172.21.15.98:0/1335333065 >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 msgr2=0x7f811c069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 --2- 172.21.15.98:0/1335333065 >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 0x7f811c069760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 -- 172.21.15.98:0/1335333065 >> v1:172.21.15.98:6789/0 conn(0x7f811c0c1ef0 legacy=0x7f811c0c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 -- 172.21.15.98:0/1335333065 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c152b90 con 0x7f811c069c50 2023-08-22T00:44:47.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f811bfff700 1 --2- 172.21.15.98:0/1335333065 >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 0x7f811c069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.797+0000 7f81212fc700 1 --2- 172.21.15.98:0/1335333065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 0x7f811c0bc610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8114009e60 tx=0x7f8114009780).ready entity=mon.2 client_cookie=8354c0b5d51ee738 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f811b7fe700 1 -- 172.21.15.98:0/1335333065 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400e070 con 0x7f811c069c50 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f811b7fe700 1 -- 172.21.15.98:0/1335333065 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400bab0 con 0x7f811c069c50 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f811b7fe700 1 -- 172.21.15.98:0/1335333065 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400be30 con 0x7f811c069c50 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 -- 172.21.15.98:0/1335333065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 msgr2=0x7f811c0bc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 --2- 172.21.15.98:0/1335333065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 0x7f811c0bc610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8114009e60 tx=0x7f8114009780).stop 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 -- 172.21.15.98:0/1335333065 shutdown_connections 2023-08-22T00:44:47.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 --2- 172.21.15.98:0/1335333065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c069c50 0x7f811c0bc610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 --2- 172.21.15.98:0/1335333065 >> v2:172.21.15.118:3300/0 conn(0x7f811c152440 0x7f811c069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 -- 172.21.15.98:0/1335333065 >> 172.21.15.98:0/1335333065 conn(0x7f811c0c3ab0 msgr2=0x7f811c0c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 -- 172.21.15.98:0/1335333065 shutdown_connections 2023-08-22T00:44:47.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.798+0000 7f8122d5f700 1 -- 172.21.15.98:0/1335333065 wait complete. 2023-08-22T00:44:47.804 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:47.797+0000 7fc7551fa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.799+0000 7f8122d5f700 1 Processor -- start 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 -- start start 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 0x7f811c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c152440 0x7f811c0a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0c5950 con 0x7f811c069c50 2023-08-22T00:44:47.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c157570 con 0x7f811c0c1ef0 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8122d5f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c156960 con 0x7f811c152440 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8120afb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8120afb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47660/0 (socket says 172.21.15.98:47660) 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f8120afb700 1 -- 172.21.15.98:0/2645970744 learned_addr learned my addr 172.21.15.98:0/2645970744 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.800+0000 7f811bfff700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 0x7f811c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f81212fc700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c152440 0x7f811c0a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:47.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 -- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c152440 msgr2=0x7f811c0a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c152440 0x7f811c0a71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 -- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 msgr2=0x7f811c0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 0x7f811c0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 -- 172.21.15.98:0/2645970744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080092a0 con 0x7f811c069c50 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f811bfff700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 0x7f811c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8120afb700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f811000c590 tx=0x7f8110007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:47.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100072e0 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110007440 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8114009a20 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100057a0 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.801+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c156f20 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.802+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c047480 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.803+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f8110005bd0 con 0x7f811c069c50 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.803+0000 7f8118ff9700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 0x7f8100061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:47.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.803+0000 7f811bfff700 1 -- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 msgr2=0x7f8100061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:47.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.803+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f8110079b30 con 0x7f811c069c50 2023-08-22T00:44:47.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.803+0000 7f811bfff700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 0x7f8100061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:47.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.807+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f811004aba0 con 0x7f811c069c50 2023-08-22T00:44:47.844 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:47.843+0000 7f37471db680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-22T00:44:47.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.975+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f811c0c4810 con 0x7f811c069c50 2023-08-22T00:44:47.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.975+0000 7f8118ff9700 1 -- 172.21.15.98:0/2645970744 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v204) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8110018020 con 0x7f811c069c50 2023-08-22T00:44:47.977 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2023-08-22T00:44:47.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 msgr2=0x7f8100061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:47.979 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 0x7f8100061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 msgr2=0x7f811c0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f811000c590 tx=0x7f8110007c80).stop 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 shutdown_connections 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f810005efc0 0x7f8100061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811c152440 0x7f811c0a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c069c50 0x7f811c0c4f70 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 --2- 172.21.15.98:0/2645970744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811c0c1ef0 0x7f811c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:47.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.977+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 >> 172.21.15.98:0/2645970744 conn(0x7f811c0c3ab0 msgr2=0x7f811c14be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:47.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.978+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 shutdown_connections 2023-08-22T00:44:47.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:47.978+0000 7f8122d5f700 1 -- 172.21.15.98:0/2645970744 wait complete. 2023-08-22T00:44:47.984 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:47.982+0000 7fc7551fa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:47.991 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-22T00:44:48.042 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.041+0000 7f37471db680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-22T00:44:48.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.112+0000 7fc877cb7700 1 Processor -- start 2023-08-22T00:44:48.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.112+0000 7fc877cb7700 1 -- start start 2023-08-22T00:44:48.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc877cb7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc8700bd0e0 0x7fc8700679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc877cb7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 0x7fc8700951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc877cb7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700956c0 con 0x7fc8700bd4c0 2023-08-22T00:44:48.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc877cb7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8700c3620 con 0x7fc8700bd0e0 2023-08-22T00:44:48.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc877cb7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700bd950 con 0x7fc870094d40 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc875252700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc8700bd4c0 0x7fc870064f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50810/0 (socket says 172.21.15.98:50810) 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc875252700 1 -- 172.21.15.98:0/2697892262 learned_addr learned my addr 172.21.15.98:0/2697892262 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc876254700 1 --2- 172.21.15.98:0/2697892262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 0x7fc8700951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc875a53700 1 --2- 172.21.15.98:0/2697892262 >> v2:172.21.15.118:3300/0 conn(0x7fc8700bd0e0 0x7fc8700679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.113+0000 7fc874a51700 1 -- 172.21.15.98:0/2697892262 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148089631 0 0) 0x7fc8700956c0 con 0x7fc8700bd4c0 2023-08-22T00:44:48.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc874a51700 1 -- 172.21.15.98:0/2697892262 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c0033f0 con 0x7fc8700bd4c0 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc876254700 1 -- 172.21.15.98:0/2697892262 >> v2:172.21.15.118:3300/0 conn(0x7fc8700bd0e0 msgr2=0x7fc8700679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc876254700 1 --2- 172.21.15.98:0/2697892262 >> v2:172.21.15.118:3300/0 conn(0x7fc8700bd0e0 0x7fc8700679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc876254700 1 -- 172.21.15.98:0/2697892262 >> v1:172.21.15.98:6789/0 conn(0x7fc8700bd4c0 legacy=0x7fc870064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc876254700 1 -- 172.21.15.98:0/2697892262 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870065760 con 0x7fc870094d40 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc876254700 1 --2- 172.21.15.98:0/2697892262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 0x7fc8700951d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc868009e60 tx=0x7fc868009780).ready entity=mon.2 client_cookie=f5d267ab39e2885d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc874a51700 1 -- 172.21.15.98:0/2697892262 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800e070 con 0x7fc870094d40 2023-08-22T00:44:48.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc874a51700 1 -- 172.21.15.98:0/2697892262 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800bab0 con 0x7fc870094d40 2023-08-22T00:44:48.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.114+0000 7fc874a51700 1 -- 172.21.15.98:0/2697892262 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800be30 con 0x7fc870094d40 2023-08-22T00:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 -- 172.21.15.98:0/2697892262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 msgr2=0x7fc8700951d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 --2- 172.21.15.98:0/2697892262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 0x7fc8700951d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc868009e60 tx=0x7fc868009780).stop 2023-08-22T00:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 -- 172.21.15.98:0/2697892262 shutdown_connections 2023-08-22T00:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 --2- 172.21.15.98:0/2697892262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc870094d40 0x7fc8700951d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 --2- 172.21.15.98:0/2697892262 >> v2:172.21.15.118:3300/0 conn(0x7fc8700bd0e0 0x7fc8700679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 -- 172.21.15.98:0/2697892262 >> 172.21.15.98:0/2697892262 conn(0x7fc8700c4350 msgr2=0x7fc8700c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 -- 172.21.15.98:0/2697892262 shutdown_connections 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.115+0000 7fc877cb7700 1 -- 172.21.15.98:0/2697892262 wait complete. 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.116+0000 7fc877cb7700 1 Processor -- start 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.116+0000 7fc877cb7700 1 -- start start 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8700bd0e0 0x7fc8700aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8700bd4c0 0x7fc8701451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700abbe0 con 0x7fc870094d40 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700aad50 con 0x7fc8700bd4c0 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700aafd0 con 0x7fc8700bd0e0 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47662/0 (socket says 172.21.15.98:47662) 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 -- 172.21.15.98:0/1260056954 learned_addr learned my addr 172.21.15.98:0/1260056954 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:48.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc876254700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8700bd4c0 0x7fc8701451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875252700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8700bd0e0 0x7fc8700aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 -- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8700bd0e0 msgr2=0x7fc8700aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8700bd0e0 0x7fc8700aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 -- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8700bd4c0 msgr2=0x7fc8701451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8700bd4c0 0x7fc8701451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 -- 172.21.15.98:0/1260056954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009a20 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc875a53700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fc86000e930 tx=0x7fc860009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860012600 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860012760 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8700ab2b0 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.117+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860012ae0 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.118+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700ab870 con 0x7fc870094d40 2023-08-22T00:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8700abec0 con 0x7fc870094d40 2023-08-22T00:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fc86001b400 con 0x7fc870094d40 2023-08-22T00:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc865ffb700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 0x7fc854061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc875252700 1 -- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 msgr2=0x7fc854061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fc86007a780 con 0x7fc870094d40 2023-08-22T00:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.119+0000 7fc875252700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 0x7fc854061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:48.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.123+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc86004b710 con 0x7fc870094d40 2023-08-22T00:44:48.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.292+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc870047480 con 0x7fc870094d40 2023-08-22T00:44:48.294 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.293+0000 7fc865ffb700 1 -- 172.21.15.98:0/1260056954 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v204) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc86004ed30 con 0x7fc870094d40 2023-08-22T00:44:48.294 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 8 2023-08-22T00:44:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 msgr2=0x7fc854061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 0x7fc854061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 msgr2=0x7fc8700bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fc86000e930 tx=0x7fc860009060).stop 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 shutdown_connections 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fc85405efc0 0x7fc854061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8700bd4c0 0x7fc8701451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc870094d40 0x7fc8700bf600 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 --2- 172.21.15.98:0/1260056954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8700bd0e0 0x7fc8700aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 >> 172.21.15.98:0/1260056954 conn(0x7fc8700c4350 msgr2=0x7fc8700c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:48.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 shutdown_connections 2023-08-22T00:44:48.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.295+0000 7fc877cb7700 1 -- 172.21.15.98:0/1260056954 wait complete. 2023-08-22T00:44:48.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-22T00:44:48.405 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:48.404+0000 7fc7551fa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:48.429 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.428+0000 7f7246f85700 1 Processor -- start 2023-08-22T00:44:48.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.428+0000 7f7246f85700 1 -- start start 2023-08-22T00:44:48.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7246f85700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72400bd0e0 0x7f72400679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7246f85700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 0x7f72400951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7246f85700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72400956c0 con 0x7f72400bd4c0 2023-08-22T00:44:48.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7246f85700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400c3620 con 0x7f72400bd0e0 2023-08-22T00:44:48.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7246f85700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400bd950 con 0x7f7240094d40 2023-08-22T00:44:48.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72400bd0e0 0x7f72400679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f72400bd0e0 0x7f72400679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47674/0 (socket says 172.21.15.98:47674) 2023-08-22T00:44:48.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 -- 172.21.15.98:0/429544467 learned_addr learned my addr 172.21.15.98:0/429544467 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:48.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f723ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f72400bd4c0 0x7f7240064f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50824/0 (socket says 172.21.15.98:50824) 2023-08-22T00:44:48.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7245522700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 0x7f72400951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 -- 172.21.15.98:0/429544467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 msgr2=0x7f72400951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 0x7f72400951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 -- 172.21.15.98:0/429544467 >> v1:172.21.15.98:6789/0 conn(0x7f72400bd4c0 legacy=0x7f7240064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 -- 172.21.15.98:0/429544467 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240065760 con 0x7f72400bd0e0 2023-08-22T00:44:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f723f7fe700 1 -- 172.21.15.98:0/429544467 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913065990 0 0) 0x7f72400956c0 con 0x7f72400bd4c0 2023-08-22T00:44:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7245522700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 0x7f72400951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.429+0000 7f7244d21700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd0e0 0x7f72400679a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f7234006fd0 tx=0x7f72340090f0).ready entity=mon.0 client_cookie=8e4645f99621441a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f723f7fe700 1 -- 172.21.15.98:0/429544467 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723400b600 con 0x7f72400bd0e0 2023-08-22T00:44:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f723f7fe700 1 -- 172.21.15.98:0/429544467 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723400b760 con 0x7f72400bd0e0 2023-08-22T00:44:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f723f7fe700 1 -- 172.21.15.98:0/429544467 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723400bae0 con 0x7f72400bd0e0 2023-08-22T00:44:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 -- 172.21.15.98:0/429544467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd0e0 msgr2=0x7f72400679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd0e0 0x7f72400679a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f7234006fd0 tx=0x7f72340090f0).stop 2023-08-22T00:44:48.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 -- 172.21.15.98:0/429544467 shutdown_connections 2023-08-22T00:44:48.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7240094d40 0x7f72400951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.443 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 --2- 172.21.15.98:0/429544467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd0e0 0x7f72400679a0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 -- 172.21.15.98:0/429544467 >> 172.21.15.98:0/429544467 conn(0x7f72400c4350 msgr2=0x7f72400c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 -- 172.21.15.98:0/429544467 shutdown_connections 2023-08-22T00:44:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.430+0000 7f7246f85700 1 -- 172.21.15.98:0/429544467 wait complete. 2023-08-22T00:44:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.431+0000 7f7246f85700 1 Processor -- start 2023-08-22T00:44:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 -- start start 2023-08-22T00:44:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7240094d40 0x7f724014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72400bd0e0 0x7f72400aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400abec0 con 0x7f72400bd4c0 2023-08-22T00:44:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400ab2b0 con 0x7f7240094d40 2023-08-22T00:44:48.446 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.432+0000 7f7246f85700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400ab590 con 0x7f72400bd0e0 2023-08-22T00:44:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47676/0 (socket says 172.21.15.98:47676) 2023-08-22T00:44:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 -- 172.21.15.98:0/1875651246 learned_addr learned my addr 172.21.15.98:0/1875651246 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f723ffff700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72400bd0e0 0x7f72400aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.447 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7244d21700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7240094d40 0x7f724014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 -- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72400bd0e0 msgr2=0x7f72400aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72400bd0e0 0x7f72400aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.448 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 -- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7240094d40 msgr2=0x7f724014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7240094d40 0x7f724014b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 -- 172.21.15.98:0/1875651246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234009370 con 0x7f72400bd4c0 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7245522700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f723800d180 tx=0x7f7238009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800dcc0 con 0x7f72400bd4c0 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723800f040 con 0x7f72400bd4c0 2023-08-22T00:44:48.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72400ab870 con 0x7f72400bd4c0 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238013620 con 0x7f72400bd4c0 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.433+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72400c17c0 con 0x7f72400bd4c0 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.434+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72400ac030 con 0x7f72400bd4c0 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.434+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f7238013a10 con 0x7f72400bd4c0 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.435+0000 7f723cff9700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 0x7f7224061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.435+0000 7f7244d21700 1 -- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 msgr2=0x7f7224061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:48.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.435+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f723807a9a0 con 0x7f72400bd4c0 2023-08-22T00:44:48.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.435+0000 7f7244d21700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 0x7f7224061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:48.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.439+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f723804b820 con 0x7f72400bd4c0 2023-08-22T00:44:48.486 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.485+0000 7f37471db680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-22T00:44:48.508 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:48.508+0000 7fc7551fa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:48.594 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.593+0000 7f37471db680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:48.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.605+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7240047480 con 0x7f72400bd4c0 2023-08-22T00:44:48.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.606+0000 7f723cff9700 1 -- 172.21.15.98:0/1875651246 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v204) v1 ==== 104+0+11 (secure 0 0 0) 0x7f723804ee40 con 0x7f72400bd4c0 2023-08-22T00:44:48.608 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:44:48.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 msgr2=0x7f7224061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:48.609 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 0x7f7224061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:48.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 msgr2=0x7f72400a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f723800d180 tx=0x7f7238009a50).stop 2023-08-22T00:44:48.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 shutdown_connections 2023-08-22T00:44:48.610 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f722405efc0 0x7f7224061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:48.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72400bd4c0 0x7f72400a9530 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7240094d40 0x7f724014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.611 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 --2- 172.21.15.98:0/1875651246 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72400bd0e0 0x7f72400aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 >> 172.21.15.98:0/1875651246 conn(0x7f72400c4350 msgr2=0x7f72400c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:48.612 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 shutdown_connections 2023-08-22T00:44:48.613 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.608+0000 7f7246f85700 1 -- 172.21.15.98:0/1875651246 wait complete. 2023-08-22T00:44:48.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-22T00:44:48.660 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:48.660+0000 7fc7551fa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:48.735 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:48.734+0000 7fc7551fa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:48.750 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.749+0000 7f034fc3e700 1 Processor -- start 2023-08-22T00:44:48.751 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.749+0000 7f034fc3e700 1 -- start start 2023-08-22T00:44:48.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034fc3e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03480c34e0 0x7f03480688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.752 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034fc3e700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c45d0 con 0x7f0348153c30 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034fc3e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c39c0 con 0x7f0348068db0 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034fc3e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480c3ca0 con 0x7f03480c34e0 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034d9da700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0348153c30 0x7f0348154d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:50838/0 (socket says 172.21.15.98:50838) 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034d9da700 1 -- 172.21.15.98:0/1358463094 learned_addr learned my addr 172.21.15.98:0/1358463094 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034d1d9700 1 --2- 172.21.15.98:0/1358463094 >> v2:172.21.15.118:3300/0 conn(0x7f03480c34e0 0x7f03480688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.753 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.750+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265574340 0 0) 0x7f03480c45d0 con 0x7f0348153c30 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03340033f0 con 0x7f0348153c30 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034d1d9700 1 -- 172.21.15.98:0/1358463094 >> v1:172.21.15.118:6789/0 conn(0x7f0348068db0 legacy=0x7f03480c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229957025 0 0) 0x7f03480c39c0 con 0x7f0348068db0 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034d1d9700 1 -- 172.21.15.98:0/1358463094 >> v1:172.21.15.98:6789/0 conn(0x7f0348153c30 legacy=0x7f0348154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034d1d9700 1 -- 172.21.15.98:0/1358463094 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480c3f80 con 0x7f03480c34e0 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034d1d9700 1 --2- 172.21.15.98:0/1358463094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03480688c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0338009760 tx=0x7f0338009060).ready entity=mon.1 client_cookie=ba313340ff75dff7 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.754 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344001470 con 0x7f03480c34e0 2023-08-22T00:44:48.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338012410 con 0x7f03480c34e0 2023-08-22T00:44:48.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.751+0000 7f034c9d8700 1 -- 172.21.15.98:0/1358463094 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338012790 con 0x7f03480c34e0 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 -- 172.21.15.98:0/1358463094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 msgr2=0x7f03480688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 --2- 172.21.15.98:0/1358463094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03480688c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0338009760 tx=0x7f0338009060).stop 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 -- 172.21.15.98:0/1358463094 shutdown_connections 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 --2- 172.21.15.98:0/1358463094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03480688c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 -- 172.21.15.98:0/1358463094 >> 172.21.15.98:0/1358463094 conn(0x7f03480c9490 msgr2=0x7f03480c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:48.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 -- 172.21.15.98:0/1358463094 shutdown_connections 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.752+0000 7f034fc3e700 1 -- 172.21.15.98:0/1358463094 wait complete. 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.753+0000 7f034fc3e700 1 Processor -- start 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 -- start start 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 0x7f034814f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03481651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034814fc20 con 0x7f0348153c30 2023-08-22T00:44:48.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480a3bb0 con 0x7f03480c34e0 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034fc3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480a3e50 con 0x7f0348068db0 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034e1db700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034e1db700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47678/0 (socket says 172.21.15.98:47678) 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034d9da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 0x7f034814f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 -- 172.21.15.98:0/3361060466 learned_addr learned my addr 172.21.15.98:0/3361060466 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.754+0000 7f034d1d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03481651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:48.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 -- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 msgr2=0x7f034814f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 0x7f034814f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 -- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 msgr2=0x7f03481651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03481651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 -- 172.21.15.98:0/3361060466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380092a0 con 0x7f0348153c30 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034d9da700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 0x7f034814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034e1db700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f034000c760 tx=0x7f0340007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000e4a0 con 0x7f0348153c30 2023-08-22T00:44:48.760 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000e620 con 0x7f0348153c30 2023-08-22T00:44:48.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03480a4130 con 0x7f0348153c30 2023-08-22T00:44:48.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000e9e0 con 0x7f0348153c30 2023-08-22T00:44:48.761 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.755+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480a46f0 con 0x7f0348153c30 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f0340012400 con 0x7f0348153c30 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0348047480 con 0x7f0348153c30 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f033dffb700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 0x7f032c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f034d9da700 1 -- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 msgr2=0x7f032c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f0340079d70 con 0x7f0348153c30 2023-08-22T00:44:48.762 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.757+0000 7f034d9da700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 0x7f032c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:48.763 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.760+0000 7f37471db680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:48.763 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.761+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f034004ad00 con 0x7f0348153c30 2023-08-22T00:44:48.806 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:48.805+0000 7fc7551fa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:48.846 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.844+0000 7f37471db680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-22T00:44:48.915 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:48.914+0000 7f37471db680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-22T00:44:49.054 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.937+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03480c4260 con 0x7f0348153c30 2023-08-22T00:44:49.055 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.937+0000 7f033dffb700 1 -- 172.21.15.98:0/3361060466 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v204) v1 ==== 100+0+11 (secure 0 0 0) 0x7f034004e320 con 0x7f0348153c30 2023-08-22T00:44:49.055 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2023-08-22T00:44:49.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 msgr2=0x7f032c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:49.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 0x7f032c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.056 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 msgr2=0x7f0348152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f034000c760 tx=0x7f0340007f10).stop 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 shutdown_connections 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f032c05efc0 0x7f032c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0348068db0 0x7f034814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0348153c30 0x7f0348152110 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 --2- 172.21.15.98:0/3361060466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03480c34e0 0x7f03481651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 >> 172.21.15.98:0/3361060466 conn(0x7f03480c9490 msgr2=0x7f0348065600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 shutdown_connections 2023-08-22T00:44:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:48.939+0000 7f034fc3e700 1 -- 172.21.15.98:0/3361060466 wait complete. 2023-08-22T00:44:49.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:49.061 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:49.059+0000 7fc7551fa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:49.189 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:49.188+0000 7f37471db680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-22T00:44:49.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.189+0000 7f982e868700 1 Processor -- start 2023-08-22T00:44:49.190 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.189+0000 7f982e868700 1 -- start start 2023-08-22T00:44:49.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982e868700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9828153da0 0x7f98280c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982e868700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f98280aa250 0x7f9828062a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982e868700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280c9fb0 con 0x7f98280c6380 2023-08-22T00:44:49.192 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982e868700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98280625d0 con 0x7f9828153da0 2023-08-22T00:44:49.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982e868700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98280ca290 con 0x7f98280aa250 2023-08-22T00:44:49.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9828153da0 0x7f98280c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.193 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9828153da0 0x7f98280c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47684/0 (socket says 172.21.15.98:47684) 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 -- 172.21.15.98:0/3837707810 learned_addr learned my addr 172.21.15.98:0/3837707810 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f982ce05700 1 --2- 172.21.15.98:0/3837707810 >> v2:172.21.15.118:3300/0 conn(0x7f98280aa250 0x7f9828062a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 -- 172.21.15.98:0/3837707810 >> v2:172.21.15.118:3300/0 conn(0x7f98280aa250 msgr2=0x7f9828062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9826ffd700 1 -- 172.21.15.98:0/3837707810 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006289053 0 0) 0x7f98280c9fb0 con 0x7f98280c6380 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 --2- 172.21.15.98:0/3837707810 >> v2:172.21.15.118:3300/0 conn(0x7f98280aa250 0x7f9828062a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 -- 172.21.15.98:0/3837707810 >> v1:172.21.15.118:6789/0 conn(0x7f98280c6380 legacy=0x7f98280a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.190+0000 7f9827fff700 1 -- 172.21.15.98:0/3837707810 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280ca570 con 0x7f9828153da0 2023-08-22T00:44:49.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f9827fff700 1 --2- 172.21.15.98:0/3837707810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c5e90 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f98280aa9b0 tx=0x7f98180090f0).ready entity=mon.0 client_cookie=88da33f8b7ad8740 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f9826ffd700 1 -- 172.21.15.98:0/3837707810 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800b520 con 0x7f9828153da0 2023-08-22T00:44:49.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f9826ffd700 1 -- 172.21.15.98:0/3837707810 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800b680 con 0x7f9828153da0 2023-08-22T00:44:49.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f9826ffd700 1 -- 172.21.15.98:0/3837707810 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800ba20 con 0x7f9828153da0 2023-08-22T00:44:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 -- 172.21.15.98:0/3837707810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 msgr2=0x7f98280c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 --2- 172.21.15.98:0/3837707810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c5e90 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f98280aa9b0 tx=0x7f98180090f0).stop 2023-08-22T00:44:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 -- 172.21.15.98:0/3837707810 shutdown_connections 2023-08-22T00:44:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 --2- 172.21.15.98:0/3837707810 >> v2:172.21.15.118:3300/0 conn(0x7f98280aa250 0x7f9828062a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 --2- 172.21.15.98:0/3837707810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c5e90 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 -- 172.21.15.98:0/3837707810 >> 172.21.15.98:0/3837707810 conn(0x7f98280cb6b0 msgr2=0x7f98280c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 -- 172.21.15.98:0/3837707810 shutdown_connections 2023-08-22T00:44:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.191+0000 7f982e868700 1 -- 172.21.15.98:0/3837707810 wait complete. 2023-08-22T00:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 Processor -- start 2023-08-22T00:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 -- start start 2023-08-22T00:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98280aa250 0x7f9828159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98280c6380 0x7f9828150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828157790 con 0x7f9828153da0 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828167da0 con 0x7f98280aa250 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.193+0000 7f982e868700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828168080 con 0x7f98280c6380 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47698/0 (socket says 172.21.15.98:47698) 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 -- 172.21.15.98:0/2573075172 learned_addr learned my addr 172.21.15.98:0/2573075172 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f9827fff700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98280aa250 0x7f9828159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.201 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f98277fe700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98280c6380 0x7f9828150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98280c6380 msgr2=0x7f9828150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98280c6380 0x7f9828150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98280aa250 msgr2=0x7f9828159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98280aa250 0x7f9828159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 -- 172.21.15.98:0/2573075172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818009370 con 0x7f9828153da0 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982ce05700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f9820009e90 tx=0x7f982000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000caa0 con 0x7f9828153da0 2023-08-22T00:44:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000f040 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9828168360 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000ce10 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.194+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828159920 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.195+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9828168880 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.196+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f9820013610 con 0x7f9828153da0 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.197+0000 7f980ffff700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 0x7f9814061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.197+0000 7f9827fff700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 msgr2=0x7f9814061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.197+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f982007b610 con 0x7f9828153da0 2023-08-22T00:44:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.197+0000 7f9827fff700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 0x7f9814061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.200+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f982004c570 con 0x7f9828153da0 2023-08-22T00:44:49.245 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:49.244+0000 7fc7551fa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:49.381 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:49.379+0000 7f37471db680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-22T00:44:49.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.398+0000 7f9827fff700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 msgr2=0x7f9814061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:49.399 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.398+0000 7f9827fff700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 0x7f9814061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:49.411 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.410+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9828168880 con 0x7f9828153da0 2023-08-22T00:44:49.412 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.410+0000 7f980ffff700 1 -- 172.21.15.98:0/2573075172 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f9828168880 con 0x7f9828153da0 2023-08-22T00:44:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:49.413 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:49.414 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 msgr2=0x7f9814061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:49.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 0x7f9814061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 msgr2=0x7f98280c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.415 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f9820009e90 tx=0x7f982000b040).stop 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 shutdown_connections 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f981405efc0 0x7f9814061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9828153da0 0x7f98280c0d50 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98280aa250 0x7f9828159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 --2- 172.21.15.98:0/2573075172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98280c6380 0x7f9828150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 >> 172.21.15.98:0/2573075172 conn(0x7f98280cb6b0 msgr2=0x7f9828152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 shutdown_connections 2023-08-22T00:44:49.417 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.412+0000 7f982e868700 1 -- 172.21.15.98:0/2573075172 wait complete. 2023-08-22T00:44:49.417 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:49.426 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:49.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.544+0000 7f3f7e101700 1 Processor -- start 2023-08-22T00:44:49.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.544+0000 7f3f7e101700 1 -- start start 2023-08-22T00:44:49.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f7e101700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780ac9b0 0x7f3f780bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f7e101700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f780c73b0 0x7f3f780c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f7e101700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780c57e0 con 0x7f3f780c4c50 2023-08-22T00:44:49.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f7e101700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f780c42d0 con 0x7f3f780c73b0 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f7e101700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78065930 con 0x7f3f780ac9b0 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f76ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f780c73b0 0x7f3f780c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f76ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f780c73b0 0x7f3f780c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47712/0 (socket says 172.21.15.98:47712) 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f76ffd700 1 -- 172.21.15.98:0/2292848908 learned_addr learned my addr 172.21.15.98:0/2292848908 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.545+0000 7f3f777fe700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780ac9b0 0x7f3f780bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f76ffd700 1 -- 172.21.15.98:0/2292848908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780ac9b0 msgr2=0x7f3f780bc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f76ffd700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780ac9b0 0x7f3f780bc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f76ffd700 1 -- 172.21.15.98:0/2292848908 >> v1:172.21.15.118:6789/0 conn(0x7f3f780c4c50 legacy=0x7f3f780acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f76ffd700 1 -- 172.21.15.98:0/2292848908 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780c5a30 con 0x7f3f780c73b0 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f76ffd700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780c73b0 0x7f3f780c4760 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f3f6c006fd0 tx=0x7f3f6c0090f0).ready entity=mon.0 client_cookie=c674911603f38e6a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f767fc700 1 -- 172.21.15.98:0/2292848908 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00b580 con 0x7f3f780c73b0 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f767fc700 1 -- 172.21.15.98:0/2292848908 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00b6e0 con 0x7f3f780c73b0 2023-08-22T00:44:49.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f767fc700 1 -- 172.21.15.98:0/2292848908 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00ba60 con 0x7f3f780c73b0 2023-08-22T00:44:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 -- 172.21.15.98:0/2292848908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780c73b0 msgr2=0x7f3f780c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780c73b0 0x7f3f780c4760 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f3f6c006fd0 tx=0x7f3f6c0090f0).stop 2023-08-22T00:44:49.550 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 -- 172.21.15.98:0/2292848908 shutdown_connections 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780ac9b0 0x7f3f780bc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 --2- 172.21.15.98:0/2292848908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780c73b0 0x7f3f780c4760 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 -- 172.21.15.98:0/2292848908 >> 172.21.15.98:0/2292848908 conn(0x7f3f780aa960 msgr2=0x7f3f780aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.546+0000 7f3f7e101700 1 -- 172.21.15.98:0/2292848908 shutdown_connections 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.547+0000 7f3f7e101700 1 -- 172.21.15.98:0/2292848908 wait complete. 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.548+0000 7f3f7e101700 1 Processor -- start 2023-08-22T00:44:49.551 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.549+0000 7f3f7e101700 1 -- start start 2023-08-22T00:44:49.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780c4c50 0x7f3f78156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780c73b0 0x7f3f780a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780bf710 con 0x7f3f780ac9b0 2023-08-22T00:44:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780beb00 con 0x7f3f780c73b0 2023-08-22T00:44:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f7e101700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780bede0 con 0x7f3f780c4c50 2023-08-22T00:44:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47720/0 (socket says 172.21.15.98:47720) 2023-08-22T00:44:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 -- 172.21.15.98:0/1207340128 learned_addr learned my addr 172.21.15.98:0/1207340128 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f76ffd700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780c4c50 0x7f3f78156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f77fff700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780c73b0 0x7f3f780a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780c4c50 msgr2=0x7f3f78156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780c4c50 0x7f3f78156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780c73b0 msgr2=0x7f3f780a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780c73b0 0x7f3f780a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 -- 172.21.15.98:0/1207340128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009370 con 0x7f3f780ac9b0 2023-08-22T00:44:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f777fe700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f3f6800e950 tx=0x7f3f68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.550+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68012600 con 0x7f3f780ac9b0 2023-08-22T00:44:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.551+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68012760 con 0x7f3f780ac9b0 2023-08-22T00:44:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.551+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f780bf0c0 con 0x7f3f780ac9b0 2023-08-22T00:44:49.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.551+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68012ae0 con 0x7f3f780ac9b0 2023-08-22T00:44:49.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.551+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f78142860 con 0x7f3f780ac9b0 2023-08-22T00:44:49.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.552+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780bf9f0 con 0x7f3f780ac9b0 2023-08-22T00:44:49.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.552+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f3f6801b400 con 0x7f3f780ac9b0 2023-08-22T00:44:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.552+0000 7f3f5f7fe700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 0x7f3f64061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.552+0000 7f3f76ffd700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 msgr2=0x7f3f64061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.553+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f3f6807a830 con 0x7f3f780ac9b0 2023-08-22T00:44:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.553+0000 7f3f76ffd700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 0x7f3f64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.556+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f6804b820 con 0x7f3f780ac9b0 2023-08-22T00:44:49.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.754+0000 7f3f76ffd700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 msgr2=0x7f3f64061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:49.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.754+0000 7f3f76ffd700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 0x7f3f64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:49.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.776+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f78047480 con 0x7f3f780ac9b0 2023-08-22T00:44:49.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.776+0000 7f3f5f7fe700 1 -- 172.21.15.98:0/1207340128 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17688 (secure 0 0 0) 0x7f3f68016090 con 0x7f3f780ac9b0 2023-08-22T00:44:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:49.778 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":204,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:35.917960+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:6832/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1540437146":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/4280173716":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3051248189":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1757469699":"2023-08-23T00:44:35.917919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 msgr2=0x7f3f64061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 0x7f3f64061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 msgr2=0x7f3f78142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f3f6800e950 tx=0x7f3f68009060).stop 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 shutdown_connections 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3f6405efc0 0x7f3f64061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780c73b0 0x7f3f780a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f780ac9b0 0x7f3f78142370 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 --2- 172.21.15.98:0/1207340128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f780c4c50 0x7f3f78156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 >> 172.21.15.98:0/1207340128 conn(0x7f3f780aa960 msgr2=0x7f3f780c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 shutdown_connections 2023-08-22T00:44:49.782 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.778+0000 7f3f7e101700 1 -- 172.21.15.98:0/1207340128 wait complete. 2023-08-22T00:44:49.792 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:44:49.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:49.893 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:49.893+0000 7fc7551fa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:49.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.914+0000 7fa2b21cd700 1 Processor -- start 2023-08-22T00:44:49.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.914+0000 7fa2b21cd700 1 -- start start 2023-08-22T00:44:49.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2b21cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa2ac0c5b70 0x7fa2ac0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2b21cd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2ac0688c0 0x7fa2ac068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2b21cd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0c4140 con 0x7fa2ac0aae30 2023-08-22T00:44:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2b21cd700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c6390 con 0x7fa2ac0688c0 2023-08-22T00:44:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2b21cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac152070 con 0x7fa2ac0c5b70 2023-08-22T00:44:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2abfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2ac0688c0 0x7fa2ac068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2abfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2ac0688c0 0x7fa2ac068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47722/0 (socket says 172.21.15.98:47722) 2023-08-22T00:44:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2abfff700 1 -- 172.21.15.98:0/1802939771 learned_addr learned my addr 172.21.15.98:0/1802939771 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.915+0000 7fa2aaffd700 1 --2- 172.21.15.98:0/1802939771 >> v2:172.21.15.118:3300/0 conn(0x7fa2ac0c5b70 0x7fa2ac0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2abfff700 1 -- 172.21.15.98:0/1802939771 >> v2:172.21.15.118:3300/0 conn(0x7fa2ac0c5b70 msgr2=0x7fa2ac0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:49.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2abfff700 1 --2- 172.21.15.98:0/1802939771 >> v2:172.21.15.118:3300/0 conn(0x7fa2ac0c5b70 0x7fa2ac0c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2abfff700 1 -- 172.21.15.98:0/1802939771 >> v1:172.21.15.118:6789/0 conn(0x7fa2ac0aae30 legacy=0x7fa2ac0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2abfff700 1 -- 172.21.15.98:0/1802939771 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0c7900 con 0x7fa2ac0688c0 2023-08-22T00:44:49.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2aa7fc700 1 -- 172.21.15.98:0/1802939771 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160555415 0 0) 0x7fa2ac0c4140 con 0x7fa2ac0aae30 2023-08-22T00:44:49.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2abfff700 1 --2- 172.21.15.98:0/1802939771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac068d50 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fa2ac06a260 tx=0x7fa2a4009840).ready entity=mon.0 client_cookie=4298d9e477b03476 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2aa7fc700 1 -- 172.21.15.98:0/1802939771 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400e070 con 0x7fa2ac0688c0 2023-08-22T00:44:49.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2aa7fc700 1 -- 172.21.15.98:0/1802939771 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400bab0 con 0x7fa2ac0688c0 2023-08-22T00:44:49.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2aa7fc700 1 -- 172.21.15.98:0/1802939771 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400be30 con 0x7fa2ac0688c0 2023-08-22T00:44:49.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1802939771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0688c0 msgr2=0x7fa2ac068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1802939771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac068d50 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fa2ac06a260 tx=0x7fa2a4009840).stop 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1802939771 shutdown_connections 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1802939771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac068d50 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1802939771 >> v2:172.21.15.118:3300/0 conn(0x7fa2ac0c5b70 0x7fa2ac0c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.916+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1802939771 >> 172.21.15.98:0/1802939771 conn(0x7fa2ac0c9490 msgr2=0x7fa2ac0c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.917+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1802939771 shutdown_connections 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.917+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1802939771 wait complete. 2023-08-22T00:44:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.918+0000 7fa2b21cd700 1 Processor -- start 2023-08-22T00:44:49.929 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.918+0000 7fa2b21cd700 1 -- start start 2023-08-22T00:44:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 0x7fa2ac1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c1200 con 0x7fa2ac0c5b70 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c05f0 con 0x7fa2ac0688c0 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2b21cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c08d0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47732/0 (socket says 172.21.15.98:47732) 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2abfff700 1 -- 172.21.15.98:0/1760068118 learned_addr learned my addr 172.21.15.98:0/1760068118 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2aaffd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 0x7fa2ac1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.919+0000 7fa2ab7fe700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac0688c0 msgr2=0x7fa2ac144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 msgr2=0x7fa2ac161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:49.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 -- 172.21.15.98:0/1760068118 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009ae0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2abfff700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:49.934 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2aaffd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 0x7fa2ac1507b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa2a000e6d0 tx=0x7fa2a0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:49.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0012600 con 0x7fa2ac0aae30 2023-08-22T00:44:49.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a0012760 con 0x7fa2ac0aae30 2023-08-22T00:44:49.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0012ae0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.935 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0c0bb0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.920+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac144900 con 0x7fa2ac0aae30 2023-08-22T00:44:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.921+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac0c13b0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.921+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fa2a001b400 con 0x7fa2ac0aae30 2023-08-22T00:44:49.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.922+0000 7fa2937fe700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 0x7fa298061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:49.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.922+0000 7fa2ab7fe700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 msgr2=0x7fa298061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:49.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.922+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fa2a007a650 con 0x7fa2ac0aae30 2023-08-22T00:44:49.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.922+0000 7fa2ab7fe700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 0x7fa298061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:49.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:49.930+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2ac0c13b0 con 0x7fa2ac0aae30 2023-08-22T00:44:49.967 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:49.967+0000 7fc7551fa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:50.043 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.043+0000 7fc7551fa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:50.111 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.110+0000 7f37471db680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-22T00:44:50.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.123+0000 7fa2ab7fe700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 msgr2=0x7fa298061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:50.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.123+0000 7fa2ab7fe700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 0x7fa298061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:50.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.142+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2ac0c0a10 con 0x7fa2ac0aae30 2023-08-22T00:44:50.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.142+0000 7fa2937fe700 1 -- 172.21.15.98:0/1760068118 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fa2ac0c0a10 con 0x7fa2ac0aae30 2023-08-22T00:44:50.144 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:50.144 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 msgr2=0x7fa298061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 0x7fa298061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 msgr2=0x7fa2ac1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 0x7fa2ac1507b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa2a000e6d0 tx=0x7fa2a0009060).stop 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 shutdown_connections 2023-08-22T00:44:50.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa29805efc0 0x7fa298061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2ac0c5b70 0x7fa2ac161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac0688c0 0x7fa2ac144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 --2- 172.21.15.98:0/1760068118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2ac0aae30 0x7fa2ac1507b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 >> 172.21.15.98:0/1760068118 conn(0x7fa2ac0c9490 msgr2=0x7fa2ac1556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 shutdown_connections 2023-08-22T00:44:50.147 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.144+0000 7fa2b21cd700 1 -- 172.21.15.98:0/1760068118 wait complete. 2023-08-22T00:44:50.148 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:50.158 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:44:50.189 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.188+0000 7f37471db680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-22T00:44:50.192 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.191+0000 7fc7551fa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:50.262 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.262+0000 7fc7551fa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:50.269 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.268+0000 7f37471db680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-22T00:44:50.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 Processor -- start 2023-08-22T00:44:50.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 -- start start 2023-08-22T00:44:50.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d98153e00 0x7f3d980c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d980c6520 0x7f3d980688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.283 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3d98068db0 0x7f3d98157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980c7a50 con 0x7f3d98068db0 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980c75c0 con 0x7f3d980c6520 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.280+0000 7f3d9d3e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981553b0 con 0x7f3d98153e00 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3d98068db0 0x7f3d98157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3d98068db0 0x7f3d98157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48390/0 (socket says 172.21.15.98:48390) 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 -- 172.21.15.98:0/829264678 learned_addr learned my addr 172.21.15.98:0/829264678 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:50.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d96ffd700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d98153e00 0x7f3d980c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d967fc700 1 --2- 172.21.15.98:0/829264678 >> v2:172.21.15.118:3300/0 conn(0x7f3d980c6520 0x7f3d980688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 -- 172.21.15.98:0/829264678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d98153e00 msgr2=0x7f3d980c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d98153e00 0x7f3d980c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 -- 172.21.15.98:0/829264678 >> v2:172.21.15.118:3300/0 conn(0x7f3d980c6520 msgr2=0x7f3d980688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 --2- 172.21.15.98:0/829264678 >> v2:172.21.15.118:3300/0 conn(0x7f3d980c6520 0x7f3d980688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 -- 172.21.15.98:0/829264678 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980691d0 con 0x7f3d98068db0 2023-08-22T00:44:50.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d977fe700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98068db0 0x7f3d98157980 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f3d9805ee70 tx=0x7f3d90009840).ready entity=mon.0 client_cookie=fc3c03601f173043 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d95ffb700 1 -- 172.21.15.98:0/829264678 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000e070 con 0x7f3d98068db0 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d95ffb700 1 -- 172.21.15.98:0/829264678 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000b970 con 0x7f3d98068db0 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.281+0000 7f3d95ffb700 1 -- 172.21.15.98:0/829264678 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000bcf0 con 0x7f3d98068db0 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/829264678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98068db0 msgr2=0x7f3d98157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98068db0 0x7f3d98157980 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f3d9805ee70 tx=0x7f3d90009840).stop 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/829264678 shutdown_connections 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d98153e00 0x7f3d980c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/829264678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98068db0 0x7f3d98157980 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/829264678 >> v2:172.21.15.118:3300/0 conn(0x7f3d980c6520 0x7f3d980688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/829264678 >> 172.21.15.98:0/829264678 conn(0x7f3d980c9490 msgr2=0x7f3d980c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:50.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/829264678 shutdown_connections 2023-08-22T00:44:50.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.282+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/829264678 wait complete. 2023-08-22T00:44:50.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.283+0000 7f3d9d3e1700 1 Processor -- start 2023-08-22T00:44:50.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.283+0000 7f3d9d3e1700 1 -- start start 2023-08-22T00:44:50.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d98068db0 0x7f3d980ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.289 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 0x7f3d98166df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 0x7f3d980adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980aa1e0 con 0x7f3d98153e00 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980ac870 con 0x7f3d98068db0 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d9d3e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980abc70 con 0x7f3d980a91e0 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d967fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 0x7f3d98166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d967fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 0x7f3d98166df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48392/0 (socket says 172.21.15.98:48392) 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d967fc700 1 -- 172.21.15.98:0/965390882 learned_addr learned my addr 172.21.15.98:0/965390882 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:50.290 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 0x7f3d980adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d96ffd700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d98068db0 0x7f3d980ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d98068db0 msgr2=0x7f3d980ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d98068db0 0x7f3d980ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 msgr2=0x7f3d98166df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 0x7f3d98166df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.284+0000 7f3d977fe700 1 -- 172.21.15.98:0/965390882 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90009ae0 con 0x7f3d980a91e0 2023-08-22T00:44:50.291 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d977fe700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 0x7f3d980adee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3d90013000 tx=0x7f3d90009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000bee0 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000bcf0 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9001d6b0 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d980aca80 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.285+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d980aa980 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.286+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d98047480 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.287+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f3d90003040 con 0x7f3d980a91e0 2023-08-22T00:44:50.292 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.287+0000 7f3d7effd700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 0x7f3d84061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.287+0000 7f3d96ffd700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 msgr2=0x7f3d84061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.287+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f3d9007b120 con 0x7f3d980a91e0 2023-08-22T00:44:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.287+0000 7f3d96ffd700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 0x7f3d84061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:50.293 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.291+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d9004c0b0 con 0x7f3d980a91e0 2023-08-22T00:44:50.379 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.378+0000 7fc7551fa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:50.425 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.424+0000 7f37471db680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-22T00:44:50.485 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.484+0000 7fc7551fa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:50.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.488+0000 7f3d96ffd700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 msgr2=0x7f3d84061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:50.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.488+0000 7f3d96ffd700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 0x7f3d84061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-22T00:44:50.499 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.498+0000 7f37471db680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-22T00:44:50.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.502+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d981541e0 con 0x7f3d980a91e0 2023-08-22T00:44:50.504 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.503+0000 7f3d7effd700 1 -- 172.21.15.98:0/965390882 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f3d90022070 con 0x7f3d980a91e0 2023-08-22T00:44:50.504 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:50.504 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":75,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-22T00:44:19.985888+0000","modified":"2023-08-22T00:44:21.995612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9810":{"gid":9810,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/743825487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":743825487},{"type":"v1","addr":"172.21.15.98:6837","nonce":743825487}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-22T00:44:50.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 msgr2=0x7f3d84061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:50.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 0x7f3d84061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 msgr2=0x7f3d980adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.506 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 0x7f3d980adee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3d90013000 tx=0x7f3d90009840).stop 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 shutdown_connections 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f3d8405efc0 0x7f3d84061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d980a91e0 0x7f3d980adee0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d98068db0 0x7f3d980ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 --2- 172.21.15.98:0/965390882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d98153e00 0x7f3d98166df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 >> 172.21.15.98:0/965390882 conn(0x7f3d980c9490 msgr2=0x7f3d98064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:50.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 shutdown_connections 2023-08-22T00:44:50.508 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.505+0000 7f3d9d3e1700 1 -- 172.21.15.98:0/965390882 wait complete. 2023-08-22T00:44:50.508 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 75 2023-08-22T00:44:50.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:50.621 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.620+0000 7f37471db680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-22T00:44:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.678+0000 7f2c8ce5d700 1 Processor -- start 2023-08-22T00:44:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.678+0000 7f2c8ce5d700 1 -- start start 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8ce5d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c88150b20 0x7f2c880c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8ce5d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c880a9030 0x7f2c88154760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8ce5d700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c880c3dd0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8ce5d700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c880c2ec0 con 0x7f2c880a9030 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8ce5d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880c65b0 con 0x7f2c88150b20 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2c880a9030 0x7f2c88154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c85d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2c880a8bb0 0x7f2c880625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60138/0 (socket says 172.21.15.98:60138) 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c85d9b700 1 -- 172.21.15.98:0/947770569 learned_addr learned my addr 172.21.15.98:0/947770569 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8659c700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c88150b20 0x7f2c880c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 -- 172.21.15.98:0/947770569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c88150b20 msgr2=0x7f2c880c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c88150b20 0x7f2c880c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 -- 172.21.15.98:0/947770569 >> v1:172.21.15.98:6789/0 conn(0x7f2c880a8bb0 legacy=0x7f2c880625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c8559a700 1 -- 172.21.15.98:0/947770569 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790854844 0 0) 0x7f2c880c3dd0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 -- 172.21.15.98:0/947770569 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880c2840 con 0x7f2c880a9030 2023-08-22T00:44:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.679+0000 7f2c86d9d700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c880a9030 0x7f2c88154760 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f2c80009e60 tx=0x7f2c80009780).ready entity=mon.0 client_cookie=98d4245a3bef39f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8559a700 1 -- 172.21.15.98:0/947770569 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000e070 con 0x7f2c880a9030 2023-08-22T00:44:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8559a700 1 -- 172.21.15.98:0/947770569 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8000bb60 con 0x7f2c880a9030 2023-08-22T00:44:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8559a700 1 -- 172.21.15.98:0/947770569 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80012410 con 0x7f2c880a9030 2023-08-22T00:44:50.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/947770569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c880a9030 msgr2=0x7f2c88154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c880a9030 0x7f2c88154760 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f2c80009e60 tx=0x7f2c80009780).stop 2023-08-22T00:44:50.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/947770569 shutdown_connections 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c880a9030 0x7f2c88154760 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/947770569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c88150b20 0x7f2c880c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/947770569 >> 172.21.15.98:0/947770569 conn(0x7f2c880c7290 msgr2=0x7f2c880c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/947770569 shutdown_connections 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.680+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/947770569 wait complete. 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.681+0000 7f2c8ce5d700 1 Processor -- start 2023-08-22T00:44:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 -- start start 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 0x7f2c8813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880a9030 0x7f2c8813b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 0x7f2c8813ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88139b60 con 0x7f2c88150b20 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88139e40 con 0x7f2c880a9030 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8ce5d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8813a120 con 0x7f2c880a8bb0 2023-08-22T00:44:50.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c86d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 0x7f2c8813ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c8659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 0x7f2c8813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c86d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 0x7f2c8813ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48424/0 (socket says 172.21.15.98:48424) 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c86d9d700 1 -- 172.21.15.98:0/3436321200 learned_addr learned my addr 172.21.15.98:0/3436321200 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.682+0000 7f2c85d9b700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880a9030 0x7f2c8813b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 -- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880a9030 msgr2=0x7f2c8813b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880a9030 0x7f2c8813b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 -- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 msgr2=0x7f2c8813ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.688 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 0x7f2c8813ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 -- 172.21.15.98:0/3436321200 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80009a20 con 0x7f2c880a8bb0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8659c700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 0x7f2c8813ac00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2c78010b10 tx=0x7f2c78009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780098c0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78009a20 con 0x7f2c880a8bb0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8813a400 con 0x7f2c880a8bb0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78009da0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.683+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8813bf30 con 0x7f2c880a8bb0 2023-08-22T00:44:50.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.684+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2c78017070 con 0x7f2c880a8bb0 2023-08-22T00:44:50.690 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.684+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c88047480 con 0x7f2c880a8bb0 2023-08-22T00:44:50.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.685+0000 7f2c767fc700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 0x7f2c68061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:50.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.685+0000 7f2c85d9b700 1 -- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 msgr2=0x7f2c68061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:50.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.685+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f2c7807c3b0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.685+0000 7f2c85d9b700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 0x7f2c68061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:50.691 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.689+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c7804d2a0 con 0x7f2c880a8bb0 2023-08-22T00:44:50.749 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:50.748+0000 7f37471db680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-22T00:44:50.776 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.775+0000 7fc7551fa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:50.847 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-08-22T00:44:50.846+0000 7fc7551fa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:50.871 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.870+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c8813a260 con 0x7f2c880a8bb0 2023-08-22T00:44:50.872 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.871+0000 7f2c767fc700 1 -- 172.21.15.98:0/3436321200 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17688 (secure 0 0 0) 0x7f2c8813a260 con 0x7f2c880a8bb0 2023-08-22T00:44:50.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:50.873 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":204,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:35.917960+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-08-22T00:44:18.107388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-08-22T00:44:18.950774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6833/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:6832/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1540437146":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/4280173716":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3051248189":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1757469699":"2023-08-23T00:44:35.917919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.873+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 msgr2=0x7f2c68061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.873+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 0x7f2c68061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.873+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 msgr2=0x7f2c8813ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.873+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 0x7f2c8813ac00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2c78010b10 tx=0x7f2c78009060).stop 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 shutdown_connections 2023-08-22T00:44:50.875 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2c6805efc0 0x7f2c68061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880a8bb0 0x7f2c8813ac00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88150b20 0x7f2c8813ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 --2- 172.21.15.98:0/3436321200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880a9030 0x7f2c8813b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 >> 172.21.15.98:0/3436321200 conn(0x7f2c880c7290 msgr2=0x7f2c8814a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 shutdown_connections 2023-08-22T00:44:50.876 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:50.874+0000 7f2c8ce5d700 1 -- 172.21.15.98:0/3436321200 wait complete. 2023-08-22T00:44:50.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-22T00:44:51.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.010+0000 7f51c1324700 1 Processor -- start 2023-08-22T00:44:51.012 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.010+0000 7f51c1324700 1 -- start start 2023-08-22T00:44:51.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51c1324700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 0x7f51bc0a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51c1324700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51bc068fd0 0x7f51bc0a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.014 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51c1324700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc1537e0 con 0x7f51bc0c65e0 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51c1324700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc1535d0 con 0x7f51bc068fd0 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51c1324700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc153ac0 con 0x7f51bc0c8310 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51ba7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f51bc0c65e0 0x7f51bc0688c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60148/0 (socket says 172.21.15.98:60148) 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51ba7fc700 1 -- 172.21.15.98:0/3662639331 learned_addr learned my addr 172.21.15.98:0/3662639331 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/3662639331 >> v2:172.21.15.118:3300/0 conn(0x7f51bc068fd0 0x7f51bc0a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.011+0000 7f51baffd700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 0x7f51bc0a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:51.015 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736286572 0 0) 0x7f51bc1537e0 con 0x7f51bc0c65e0 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a40033f0 con 0x7f51bc0c65e0 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073879081 0 0) 0x7f51a40033f0 con 0x7f51bc0c65e0 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51bb7fe700 1 -- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 msgr2=0x7f51bc0a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 0x7f51bc0a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51bb7fe700 1 -- 172.21.15.98:0/3662639331 >> v1:172.21.15.98:6789/0 conn(0x7f51bc0c65e0 legacy=0x7f51bc0688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:51.016 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51bb7fe700 1 -- 172.21.15.98:0/3662639331 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc153da0 con 0x7f51bc068fd0 2023-08-22T00:44:51.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51baffd700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 0x7f51bc0a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:51.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc068fd0 0x7f51bc0a7fc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f51b4009e60 tx=0x7f51b4009780).ready entity=mon.1 client_cookie=e16648e47ee1b8e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:51.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400e070 con 0x7f51bc068fd0 2023-08-22T00:44:51.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b400b7a0 con 0x7f51bc068fd0 2023-08-22T00:44:51.017 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.012+0000 7f51b9ffb700 1 -- 172.21.15.98:0/3662639331 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0015f0 con 0x7f51bc068fd0 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 -- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc068fd0 msgr2=0x7f51bc0a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc068fd0 0x7f51bc0a7fc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f51b4009e60 tx=0x7f51b4009780).stop 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 -- 172.21.15.98:0/3662639331 shutdown_connections 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc068fd0 0x7f51bc0a7fc0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 --2- 172.21.15.98:0/3662639331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc0c8310 0x7f51bc0a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:51.018 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 -- 172.21.15.98:0/3662639331 >> 172.21.15.98:0/3662639331 conn(0x7f51bc0680e0 msgr2=0x7f51bc0c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:51.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 -- 172.21.15.98:0/3662639331 shutdown_connections 2023-08-22T00:44:51.019 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.013+0000 7f51c1324700 1 -- 172.21.15.98:0/3662639331 wait complete. 2023-08-22T00:44:51.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.014+0000 7f51c1324700 1 Processor -- start 2023-08-22T00:44:51.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.014+0000 7f51c1324700 1 -- start start 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc068fd0 0x7f51bc0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc0c65e0 0x7f51bc0c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc147e60 con 0x7f51bc0c8310 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0c0c30 con 0x7f51bc0c65e0 2023-08-22T00:44:51.022 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0a76f0 con 0x7f51bc068fd0 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48440/0 (socket says 172.21.15.98:48440) 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 -- 172.21.15.98:0/2125455774 learned_addr learned my addr 172.21.15.98:0/2125455774 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51baffd700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc068fd0 0x7f51bc0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51ba7fc700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc0c65e0 0x7f51bc0c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 -- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc068fd0 msgr2=0x7f51bc0a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:51.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc068fd0 0x7f51bc0a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 -- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc0c65e0 msgr2=0x7f51bc0c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc0c65e0 0x7f51bc0c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 -- 172.21.15.98:0/2125455774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00092a0 con 0x7f51bc0c8310 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51bb7fe700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f51bc063f00 tx=0x7f51b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b401e430 con 0x7f51bc0c8310 2023-08-22T00:44:51.024 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b401e590 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b4009a20 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b401e930 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.015+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0c0300 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.016+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc047480 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.017+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 103) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f51b4003040 con 0x7f51bc0c8310 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.017+0000 7f51a2ffd700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 0x7f51a8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:51.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.017+0000 7f51baffd700 1 -- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 msgr2=0x7f51a8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6832/169458 2023-08-22T00:44:51.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.017+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f51b407c240 con 0x7f51bc0c8310 2023-08-22T00:44:51.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.017+0000 7f51baffd700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 0x7f51a8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-22T00:44:51.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.021+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f51b404d120 con 0x7f51bc0c8310 2023-08-22T00:44:51.060 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.058+0000 7f37471db680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-22T00:44:51.134 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.133+0000 7f37471db680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-22T00:44:51.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.153+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 104) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f51b4079a80 con 0x7f51bc0c8310 2023-08-22T00:44:51.154 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.153+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 msgr2=0x7f51a8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-22T00:44:51.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.153+0000 7f51a2ffd700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 0x7f51a8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:51.217 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.216+0000 7f36c5c8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.218 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.216+0000 7f36c5c8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.218 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.216+0000 7f36c5c8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.218 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.216+0000 7f36c5c8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.218 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.216+0000 7f36c5c8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.218 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.217+0000 7f36c9c95700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.219 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.217+0000 7f36c9c95700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.219 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.217+0000 7f36c9c95700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.219 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.217+0000 7f36c9c95700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.219 INFO:tasks.ceph.mgr.y.smithi098.stderr:2023-08-22T00:44:51.217+0000 7f36c9c95700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-22T00:44:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:51.254+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f51bc154080 con 0x7f51bc0c8310 2023-08-22T00:44:52.150 INFO:tasks.ceph.mon.a.smithi098.stderr:2023-08-22T00:44:52.149+0000 7fb131155700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-22T00:44:52.153 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.152+0000 7f51a2ffd700 1 -- 172.21.15.98:0/2125455774 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7f51b4053110 con 0x7f51bc0c8310 2023-08-22T00:44:52.156 INFO:tasks.ceph.mds.a.smithi098.stderr: -3684> 2023-08-22T00:44:25.480+0000 7f938cd44700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-22T00:44:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.155+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 msgr2=0x7f51bc0c15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:52.157 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.155+0000 7f51c1324700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f51bc063f00 tx=0x7f51b4009780).stop 2023-08-22T00:44:52.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 shutdown_connections 2023-08-22T00:44:52.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f51a805efc0 0x7f51a8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:44:52.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51bc068fd0 0x7f51bc0a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51bc0c8310 0x7f51bc0c15b0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 --2- 172.21.15.98:0/2125455774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51bc0c65e0 0x7f51bc0c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.158+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 >> 172.21.15.98:0/2125455774 conn(0x7f51bc0680e0 msgr2=0x7f51bc0bdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:52.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.161+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 shutdown_connections 2023-08-22T00:44:52.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.162+0000 7f51c1324700 1 -- 172.21.15.98:0/2125455774 wait complete. 2023-08-22T00:44:52.165 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-22T00:44:52.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-22T00:44:52.187 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2023-08-22T00:44:52.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.298+0000 7fce659c8700 1 Processor -- start 2023-08-22T00:44:52.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.298+0000 7fce659c8700 1 -- start start 2023-08-22T00:44:52.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce659c8700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce6014e8d0 0x7fce60069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce659c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 0x7fce600c2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce659c8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600bbf70 con 0x7fce60069c50 2023-08-22T00:44:52.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce659c8700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600bdec0 con 0x7fce6014e8d0 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce659c8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600c22b0 con 0x7fce60063690 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce6014e8d0 0x7fce60069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fce6014e8d0 0x7fce60069760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48552/0 (socket says 172.21.15.98:48552) 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 -- 172.21.15.98:0/2861828686 learned_addr learned my addr 172.21.15.98:0/2861828686 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 -- 172.21.15.98:0/2861828686 >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 msgr2=0x7fce600c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5f7fe700 1 --2- 172.21.15.98:0/2861828686 >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 0x7fce600c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 --2- 172.21.15.98:0/2861828686 >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 0x7fce600c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 -- 172.21.15.98:0/2861828686 >> v1:172.21.15.118:6789/0 conn(0x7fce60069c50 legacy=0x7fce60062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 -- 172.21.15.98:0/2861828686 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6006a220 con 0x7fce6014e8d0 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5f7fe700 1 --2- 172.21.15.98:0/2861828686 >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 0x7fce600c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5effd700 1 --2- 172.21.15.98:0/2861828686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce60069760 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fce60069660 tx=0x7fce500090f0).ready entity=mon.0 client_cookie=e8d25d05f26cb6b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5dffb700 1 -- 172.21.15.98:0/2861828686 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000b5a0 con 0x7fce6014e8d0 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5dffb700 1 -- 172.21.15.98:0/2861828686 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000b700 con 0x7fce6014e8d0 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.299+0000 7fce5dffb700 1 -- 172.21.15.98:0/2861828686 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000ba80 con 0x7fce6014e8d0 2023-08-22T00:44:52.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 -- 172.21.15.98:0/2861828686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 msgr2=0x7fce60069760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 --2- 172.21.15.98:0/2861828686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce60069760 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fce60069660 tx=0x7fce500090f0).stop 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 -- 172.21.15.98:0/2861828686 shutdown_connections 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 --2- 172.21.15.98:0/2861828686 >> v2:172.21.15.118:3300/0 conn(0x7fce60063690 0x7fce600c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 --2- 172.21.15.98:0/2861828686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce60069760 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 -- 172.21.15.98:0/2861828686 >> 172.21.15.98:0/2861828686 conn(0x7fce600c3ab0 msgr2=0x7fce600c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 -- 172.21.15.98:0/2861828686 shutdown_connections 2023-08-22T00:44:52.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.300+0000 7fce659c8700 1 -- 172.21.15.98:0/2861828686 wait complete. 2023-08-22T00:44:52.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.301+0000 7fce659c8700 1 Processor -- start 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.301+0000 7fce659c8700 1 -- start start 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce60063690 0x7fce600a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce60069c50 0x7fce6014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600acac0 con 0x7fce6014e8d0 2023-08-22T00:44:52.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600a8040 con 0x7fce60063690 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce659c8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600acf50 con 0x7fce60069c50 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48562/0 (socket says 172.21.15.98:48562) 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 -- 172.21.15.98:0/2282305510 learned_addr learned my addr 172.21.15.98:0/2282305510 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5effd700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce60063690 0x7fce600a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5e7fc700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce60069c50 0x7fce6014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 -- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce60069c50 msgr2=0x7fce6014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce60069c50 0x7fce6014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 -- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce60063690 msgr2=0x7fce600a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce60063690 0x7fce600a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 -- 172.21.15.98:0/2282305510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009370 con 0x7fce6014e8d0 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.302+0000 7fce5f7fe700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7fce5800cef0 tx=0x7fce58007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.303+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800ad20 con 0x7fce6014e8d0 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.303+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5800ae80 con 0x7fce6014e8d0 2023-08-22T00:44:52.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.303+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce600ac190 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.303+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58016610 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.303+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600ac750 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.304+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce60047480 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.304+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 105) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fce5801f3f0 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.304+0000 7fce46ffd700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 0x7fce4c061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.304+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 7061+0+0 (secure 0 0 0) 0x7fce5807a5a0 con 0x7fce6014e8d0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.304+0000 7fce5effd700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 0x7fce4c061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:52.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.305+0000 7fce5effd700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 0x7fce4c061180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fce50006df0 tx=0x7fce50015000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:52.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.308+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce5804b7d0 con 0x7fce6014e8d0 2023-08-22T00:44:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:52.510+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fce6006a500 con 0x7fce6014e8d0 2023-08-22T00:44:53.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.160+0000 7fce46ffd700 1 -- 172.21.15.98:0/2282305510 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce5804edf0 con 0x7fce6014e8d0 2023-08-22T00:44:53.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 msgr2=0x7fce4c061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 0x7fce4c061180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fce50006df0 tx=0x7fce50015000).stop 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 msgr2=0x7fce600a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7fce5800cef0 tx=0x7fce58007860).stop 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 shutdown_connections 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fce4c05ecc0 0x7fce4c061180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce6014e8d0 0x7fce600a71b0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce60063690 0x7fce600a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 --2- 172.21.15.98:0/2282305510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce60069c50 0x7fce6014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 >> 172.21.15.98:0/2282305510 conn(0x7fce600c3ab0 msgr2=0x7fce600c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:53.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 shutdown_connections 2023-08-22T00:44:53.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.163+0000 7fce659c8700 1 -- 172.21.15.98:0/2282305510 wait complete. 2023-08-22T00:44:53.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-22T00:44:53.341 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.340+0000 7ffa09505700 1 Processor -- start 2023-08-22T00:44:53.342 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.340+0000 7ffa09505700 1 -- start start 2023-08-22T00:44:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa09505700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04154020 0x7ffa040625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa09505700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffa04062ac0 0x7ffa04062f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa09505700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa04063f10 con 0x7ffa04153c40 2023-08-22T00:44:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa09505700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040c6230 con 0x7ffa04062ac0 2023-08-22T00:44:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa09505700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040638c0 con 0x7ffa04154020 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffa04062ac0 0x7ffa04062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffa04062ac0 0x7ffa04062f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48566/0 (socket says 172.21.15.98:48566) 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 -- 172.21.15.98:0/1433860279 learned_addr learned my addr 172.21.15.98:0/1433860279 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa027fc700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04154020 0x7ffa040625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 -- 172.21.15.98:0/1433860279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04154020 msgr2=0x7ffa040625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04154020 0x7ffa040625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 -- 172.21.15.98:0/1433860279 >> v1:172.21.15.118:6789/0 conn(0x7ffa04153c40 legacy=0x7ffa040c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.341+0000 7ffa037fe700 1 -- 172.21.15.98:0/1433860279 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04063ba0 con 0x7ffa04062ac0 2023-08-22T00:44:53.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa037fe700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04062ac0 0x7ffa04062f20 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7ff9fc009f20 tx=0x7ff9fc009840).ready entity=mon.0 client_cookie=ea3b8148a85f3adb server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:53.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa01ffb700 1 -- 172.21.15.98:0/1433860279 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00e070 con 0x7ffa04062ac0 2023-08-22T00:44:53.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa01ffb700 1 -- 172.21.15.98:0/1433860279 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00ba80 con 0x7ffa04062ac0 2023-08-22T00:44:53.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa01ffb700 1 -- 172.21.15.98:0/1433860279 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00be00 con 0x7ffa04062ac0 2023-08-22T00:44:53.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 -- 172.21.15.98:0/1433860279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04062ac0 msgr2=0x7ffa04062f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.348 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04062ac0 0x7ffa04062f20 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7ff9fc009f20 tx=0x7ff9fc009840).stop 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 -- 172.21.15.98:0/1433860279 shutdown_connections 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04062ac0 0x7ffa04062f20 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 --2- 172.21.15.98:0/1433860279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04154020 0x7ffa040625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 -- 172.21.15.98:0/1433860279 >> 172.21.15.98:0/1433860279 conn(0x7ffa040c80c0 msgr2=0x7ffa04081fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 -- 172.21.15.98:0/1433860279 shutdown_connections 2023-08-22T00:44:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.342+0000 7ffa09505700 1 -- 172.21.15.98:0/1433860279 wait complete. 2023-08-22T00:44:53.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 Processor -- start 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 -- start start 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04062ac0 0x7ffa04145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 0x7ffa040af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b0690 con 0x7ffa04153c40 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040afa80 con 0x7ffa04154020 2023-08-22T00:44:53.352 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa09505700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040afd60 con 0x7ffa04062ac0 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48578/0 (socket says 172.21.15.98:48578) 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.344+0000 7ffa027fc700 1 -- 172.21.15.98:0/28476120 learned_addr learned my addr 172.21.15.98:0/28476120 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa02ffd700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04062ac0 0x7ffa04145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa037fe700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 0x7ffa040af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 -- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04062ac0 msgr2=0x7ffa04145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04062ac0 0x7ffa04145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.353 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 -- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 msgr2=0x7ffa040af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:53.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 0x7ffa040af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:53.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 -- 172.21.15.98:0/28476120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc009ae0 con 0x7ffa04153c40 2023-08-22T00:44:53.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa037fe700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 0x7ffa040af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:44:53.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa027fc700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7ff9f400d890 tx=0x7ff9f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f40125f0 con 0x7ffa04153c40 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4012750 con 0x7ffa04153c40 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa040b0040 con 0x7ffa04153c40 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4012ad0 con 0x7ffa04153c40 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.345+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa04157730 con 0x7ffa04153c40 2023-08-22T00:44:53.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.346+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04047480 con 0x7ffa04153c40 2023-08-22T00:44:53.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.346+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 105) v1 ==== 75166+0+0 (secure 0 0 0) 0x7ff9f4013480 con 0x7ffa04153c40 2023-08-22T00:44:53.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.347+0000 7ff9eaffd700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 0x7ff9f00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:53.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.347+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 7061+0+0 (secure 0 0 0) 0x7ff9f4079d20 con 0x7ffa04153c40 2023-08-22T00:44:53.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.347+0000 7ffa02ffd700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 0x7ff9f00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:53.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.347+0000 7ffa02ffd700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 0x7ff9f00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff9f80036d0 tx=0x7ff9f8009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:53.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.351+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9f404af50 con 0x7ffa04153c40 2023-08-22T00:44:53.513 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:53.512+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffa04063410 con 0x7ffa04153c40 2023-08-22T00:44:54.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.163+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff9f4077910 con 0x7ffa04153c40 2023-08-22T00:44:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.171+0000 7ff9eaffd700 1 -- 172.21.15.98:0/28476120 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v208) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff9f4071cf0 con 0x7ffa04153c40 2023-08-22T00:44:54.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 msgr2=0x7ff9f00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 0x7ff9f00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff9f80036d0 tx=0x7ff9f8009040).stop 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 msgr2=0x7ffa040aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7ff9f400d890 tx=0x7ff9f4008040).stop 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 shutdown_connections 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff9f005ecf0 0x7ff9f00611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa04062ac0 0x7ffa04145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa04154020 0x7ffa040af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 --2- 172.21.15.98:0/28476120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa04153c40 0x7ffa040aef10 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.174+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 >> 172.21.15.98:0/28476120 conn(0x7ffa040c80c0 msgr2=0x7ffa040ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.175+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 shutdown_connections 2023-08-22T00:44:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.175+0000 7ffa09505700 1 -- 172.21.15.98:0/28476120 wait complete. 2023-08-22T00:44:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2023-08-22T00:44:54.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-22T00:44:54.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.316+0000 7ff2a6846700 1 Processor -- start 2023-08-22T00:44:54.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.316+0000 7ff2a6846700 1 -- start start 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.316+0000 7ff2a6846700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff2a0153c40 0x7ff2a0154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.316+0000 7ff2a6846700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0158150 0x7ff2a00bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff2a6846700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a0063f10 con 0x7ff2a00c5a70 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff2a6846700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00c6230 con 0x7ff2a0153c40 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff2a6846700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00638c0 con 0x7ff2a0158150 2023-08-22T00:44:54.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff2a4de3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0158150 0x7ff2a00bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff2a0153c40 0x7ff2a0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff297fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff2a00c5a70 0x7ff2a0157a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:49750/0 (socket says 172.21.15.98:49750) 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff297fff700 1 -- 172.21.15.98:0/3834195206 learned_addr learned my addr 172.21.15.98:0/3834195206 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29f7fe700 1 -- 172.21.15.98:0/3834195206 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712472209 0 0) 0x7ff2a0063f10 con 0x7ff2a00c5a70 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29f7fe700 1 -- 172.21.15.98:0/3834195206 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff28c0033f0 con 0x7ff2a00c5a70 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 -- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0158150 msgr2=0x7ff2a00bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:54.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 --2- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0158150 0x7ff2a00bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 -- 172.21.15.98:0/3834195206 >> v1:172.21.15.118:6789/0 conn(0x7ff2a00c5a70 legacy=0x7ff2a0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 -- 172.21.15.98:0/3834195206 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0063ba0 con 0x7ff2a0153c40 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.317+0000 7ff29ffff700 1 --2- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0153c40 0x7ff2a0154020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7ff290009760 tx=0x7ff290009060).ready entity=mon.1 client_cookie=749e297a24f32b21 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff29f7fe700 1 -- 172.21.15.98:0/3834195206 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000d4a0 con 0x7ff2a0153c40 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff29f7fe700 1 -- 172.21.15.98:0/3834195206 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000d600 con 0x7ff2a0153c40 2023-08-22T00:44:54.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff29f7fe700 1 -- 172.21.15.98:0/3834195206 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000d980 con 0x7ff2a0153c40 2023-08-22T00:44:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 -- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0153c40 msgr2=0x7ff2a0154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 --2- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0153c40 0x7ff2a0154020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7ff290009760 tx=0x7ff290009060).stop 2023-08-22T00:44:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 -- 172.21.15.98:0/3834195206 shutdown_connections 2023-08-22T00:44:54.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 --2- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0158150 0x7ff2a00bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 --2- 172.21.15.98:0/3834195206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0153c40 0x7ff2a0154020 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 -- 172.21.15.98:0/3834195206 >> 172.21.15.98:0/3834195206 conn(0x7ff2a00c80c0 msgr2=0x7ff2a0081fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 -- 172.21.15.98:0/3834195206 shutdown_connections 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.318+0000 7ff2a6846700 1 -- 172.21.15.98:0/3834195206 wait complete. 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.319+0000 7ff2a6846700 1 Processor -- start 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.319+0000 7ff2a6846700 1 -- start start 2023-08-22T00:44:54.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0153c40 0x7ff2a00af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 0x7ff2a00afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00b0280 con 0x7ff2a00c5a70 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0164220 con 0x7ff2a0158150 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a6846700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0165030 con 0x7ff2a0153c40 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff29ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff29ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48588/0 (socket says 172.21.15.98:48588) 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff29ffff700 1 -- 172.21.15.98:0/1549336082 learned_addr learned my addr 172.21.15.98:0/1549336082 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff297fff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0153c40 0x7ff2a00af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.320+0000 7ff2a4de3700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 0x7ff2a00afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 -- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0153c40 msgr2=0x7ff2a00af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0153c40 0x7ff2a00af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 -- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 msgr2=0x7ff2a00afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 0x7ff2a00afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:54.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 -- 172.21.15.98:0/1549336082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900092a0 con 0x7ff2a00c5a70 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff2a4de3700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 0x7ff2a00afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29ffff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7ff290011fb0 tx=0x7ff290016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000dd30 con 0x7ff2a00c5a70 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000de90 con 0x7ff2a00c5a70 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0164440 con 0x7ff2a00c5a70 2023-08-22T00:44:54.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000d980 con 0x7ff2a00c5a70 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.321+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a01649e0 con 0x7ff2a00c5a70 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.322+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a0047480 con 0x7ff2a00c5a70 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.322+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff29001d640 con 0x7ff2a00c5a70 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.323+0000 7ff29cff9700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 0x7ff2800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.323+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff29007b860 con 0x7ff2a00c5a70 2023-08-22T00:44:54.329 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.323+0000 7ff297fff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 0x7ff2800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:54.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.323+0000 7ff297fff700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 0x7ff2800613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff2a00a9df0 tx=0x7ff288009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:54.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.327+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff29004c960 con 0x7ff2a00c5a70 2023-08-22T00:44:54.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:54.495+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff2a00635e0 con 0x7ff2a00c5a70 2023-08-22T00:44:54.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:44:54.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:44:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.174+0000 7ff29cff9700 1 -- 172.21.15.98:0/1549336082 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v209) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff29004ff80 con 0x7ff2a00c5a70 2023-08-22T00:44:55.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 msgr2=0x7ff2800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 0x7ff2800613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff2a00a9df0 tx=0x7ff288009040).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 msgr2=0x7ff2a014d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7ff290011fb0 tx=0x7ff290016000).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 shutdown_connections 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff28005ef30 0x7ff2800613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0158150 0x7ff2a00afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2a00c5a70 0x7ff2a014d4f0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 --2- 172.21.15.98:0/1549336082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2a0153c40 0x7ff2a00af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 >> 172.21.15.98:0/1549336082 conn(0x7ff2a00c80c0 msgr2=0x7ff2a00a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 shutdown_connections 2023-08-22T00:44:55.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.177+0000 7ff2a6846700 1 -- 172.21.15.98:0/1549336082 wait complete. 2023-08-22T00:44:55.180 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2023-08-22T00:44:55.193 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-22T00:44:55.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.313+0000 7ff89ab29700 1 Processor -- start 2023-08-22T00:44:55.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.313+0000 7ff89ab29700 1 -- start start 2023-08-22T00:44:55.317 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff89ab29700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff894154660 0x7ff8940bc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff89ab29700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8941583d0 con 0x7ff894155150 2023-08-22T00:44:55.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff89ab29700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940bcf10 con 0x7ff894064f80 2023-08-22T00:44:55.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff89ab29700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89414e9f0 con 0x7ff894154660 2023-08-22T00:44:55.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8990c6700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff894155150 0x7ff89415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60174/0 (socket says 172.21.15.98:60174) 2023-08-22T00:44:55.318 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8990c6700 1 -- 172.21.15.98:0/1452089645 learned_addr learned my addr 172.21.15.98:0/1452089645 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:55.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8988c5700 1 --2- 172.21.15.98:0/1452089645 >> v2:172.21.15.118:3300/0 conn(0x7ff894154660 0x7ff8940bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585259003 0 0) 0x7ff8941583d0 con 0x7ff894155150 2023-08-22T00:44:55.319 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8840033f0 con 0x7ff894155150 2023-08-22T00:44:55.320 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2805201777 0 0) 0x7ff8840033f0 con 0x7ff894155150 2023-08-22T00:44:55.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 >> v2:172.21.15.118:3300/0 conn(0x7ff894154660 msgr2=0x7ff8940bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:55.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 --2- 172.21.15.98:0/1452089645 >> v2:172.21.15.118:3300/0 conn(0x7ff894154660 0x7ff8940bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.321 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 >> v1:172.21.15.118:6789/0 conn(0x7ff894064f80 legacy=0x7ff894154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894157aa0 con 0x7ff894155150 2023-08-22T00:44:55.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7ff88c0017f0 con 0x7ff894155150 2023-08-22T00:44:55.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 >> v1:172.21.15.98:6789/0 conn(0x7ff894155150 legacy=0x7ff89415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8840038e0 0x7ff884003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff884005000 0x7ff88400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400be80 con 0x7ff884004690 2023-08-22T00:44:55.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400bff0 con 0x7ff884005000 2023-08-22T00:44:55.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400c1b0 con 0x7ff8840038e0 2023-08-22T00:44:55.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.314+0000 7ff893fff700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8988c5700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8840038e0 0x7ff884003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8990c6700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff884005000 0x7ff88400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 -- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8840038e0 msgr2=0x7ff884003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8840038e0 0x7ff884003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 -- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff884005000 msgr2=0x7ff88400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:55.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff884005000 0x7ff88400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 -- 172.21.15.98:0/1452089645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840033f0 con 0x7ff884004690 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8990c6700 1 -- 172.21.15.98:0/1452089645 reap_dead start 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8988c5700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8840038e0 0x7ff884003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff893fff700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff884004b10 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7ff880001730 tx=0x7ff880007bb0).ready entity=mon.0 client_cookie=808f023a577ca22d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880007020 con 0x7ff884004690 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880007180 con 0x7ff884004690 2023-08-22T00:44:55.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff8937fe700 1 -- 172.21.15.98:0/1452089645 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880007520 con 0x7ff884004690 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff89ab29700 1 -- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 msgr2=0x7ff884004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff89ab29700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff884004b10 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7ff880001730 tx=0x7ff880007bb0).stop 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff89ab29700 1 -- 172.21.15.98:0/1452089645 shutdown_connections 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff89ab29700 1 --2- 172.21.15.98:0/1452089645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.315+0000 7ff89ab29700 1 -- 172.21.15.98:0/1452089645 >> 172.21.15.98:0/1452089645 conn(0x7ff8940c4350 msgr2=0x7ff8940c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.316+0000 7ff89ab29700 1 -- 172.21.15.98:0/1452089645 shutdown_connections 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.316+0000 7ff89ab29700 1 -- 172.21.15.98:0/1452089645 wait complete. 2023-08-22T00:44:55.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.317+0000 7ff89ab29700 1 Processor -- start 2023-08-22T00:44:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.317+0000 7ff89ab29700 1 -- start start 2023-08-22T00:44:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8940a4fb0 0x7ff89414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8940c6380 0x7ff8940c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940ab280 con 0x7ff884004690 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940c6cf0 con 0x7ff8940c6380 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940a7240 con 0x7ff8940a4fb0 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48604/0 (socket says 172.21.15.98:48604) 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 -- 172.21.15.98:0/3824728321 learned_addr learned my addr 172.21.15.98:0/3824728321 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff893fff700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8940a4fb0 0x7ff89414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8990c6700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8940c6380 0x7ff8940c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 -- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8940a4fb0 msgr2=0x7ff89414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8940a4fb0 0x7ff89414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 -- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8940c6380 msgr2=0x7ff8940c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8940c6380 0x7ff8940c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 -- 172.21.15.98:0/3824728321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940a7520 con 0x7ff884004690 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff8988c5700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7ff8880115c0 tx=0x7ff888008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888013620 con 0x7ff884004690 2023-08-22T00:44:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888013780 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940a7800 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888013b00 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.318+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940a7dc0 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.319+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894047480 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.320+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff888015480 con 0x7ff884004690 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.320+0000 7ff890ff9700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 0x7ff8780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.320+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7ff88807a720 con 0x7ff884004690 2023-08-22T00:44:55.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.320+0000 7ff893fff700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 0x7ff8780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.321+0000 7ff893fff700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 0x7ff8780613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff894167670 tx=0x7ff880015000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.334 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.324+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff88804b950 con 0x7ff884004690 2023-08-22T00:44:55.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.488+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff894157d80 con 0x7ff884004690 2023-08-22T00:44:55.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.491+0000 7ff890ff9700 1 -- 172.21.15.98:0/3824728321 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff888078e60 con 0x7ff884004690 2023-08-22T00:44:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 msgr2=0x7ff8780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 0x7ff8780613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff894167670 tx=0x7ff880015000).stop 2023-08-22T00:44:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 msgr2=0x7ff8940aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7ff8880115c0 tx=0x7ff888008040).stop 2023-08-22T00:44:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 shutdown_connections 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff87805ef30 0x7ff8780613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8940c6380 0x7ff8940c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff884004690 0x7ff8940aad90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 --2- 172.21.15.98:0/3824728321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8940a4fb0 0x7ff89414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.493+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 >> 172.21.15.98:0/3824728321 conn(0x7ff8940c4350 msgr2=0x7ff894155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.494+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 shutdown_connections 2023-08-22T00:44:55.496 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.494+0000 7ff89ab29700 1 -- 172.21.15.98:0/3824728321 wait complete. 2023-08-22T00:44:55.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-22T00:44:55.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.631+0000 7f677f526700 1 Processor -- start 2023-08-22T00:44:55.633 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.631+0000 7f677f526700 1 -- start start 2023-08-22T00:44:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677f526700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f677814e8d0 0x7f6778069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677f526700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f6778062f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677f526700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67780bbf70 con 0x7f6778063470 2023-08-22T00:44:55.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677f526700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67780bdec0 con 0x7f677814e8d0 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677f526700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780c22b0 con 0x7f6778069c50 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677d2c2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f677814e8d0 0x7f6778069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677d2c2700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f677814e8d0 0x7f6778069760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48610/0 (socket says 172.21.15.98:48610) 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677d2c2700 1 -- 172.21.15.98:0/4116285868 learned_addr learned my addr 172.21.15.98:0/4116285868 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.632+0000 7f677cac1700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f6778062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677d2c2700 1 -- 172.21.15.98:0/4116285868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 msgr2=0x7f6778062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:55.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677d2c2700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f6778062f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677d2c2700 1 -- 172.21.15.98:0/4116285868 >> v1:172.21.15.118:6789/0 conn(0x7f6778063470 legacy=0x7f6778157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677d2c2700 1 -- 172.21.15.98:0/4116285868 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780638e0 con 0x7f677814e8d0 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677d2c2700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f6778069760 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f6774006fd0 tx=0x7f67740090f0).ready entity=mon.0 client_cookie=dbbd6a1d721136ea server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f676ffff700 1 -- 172.21.15.98:0/4116285868 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400b580 con 0x7f677814e8d0 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f676ffff700 1 -- 172.21.15.98:0/4116285868 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400b6e0 con 0x7f677814e8d0 2023-08-22T00:44:55.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f676ffff700 1 -- 172.21.15.98:0/4116285868 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400ba60 con 0x7f677814e8d0 2023-08-22T00:44:55.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677f526700 1 -- 172.21.15.98:0/4116285868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 msgr2=0x7f6778069760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677f526700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f6778069760 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f6774006fd0 tx=0x7f67740090f0).stop 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677f526700 1 -- 172.21.15.98:0/4116285868 shutdown_connections 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.633+0000 7f677f526700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f6778069760 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.634+0000 7f677f526700 1 --2- 172.21.15.98:0/4116285868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f6778062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.634+0000 7f677f526700 1 -- 172.21.15.98:0/4116285868 >> 172.21.15.98:0/4116285868 conn(0x7f67780c3ab0 msgr2=0x7f67780c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.634+0000 7f677f526700 1 -- 172.21.15.98:0/4116285868 shutdown_connections 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.634+0000 7f677f526700 1 -- 172.21.15.98:0/4116285868 wait complete. 2023-08-22T00:44:55.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.635+0000 7f677f526700 1 Processor -- start 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.635+0000 7f677f526700 1 -- start start 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6778063470 0x7f67780a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f677814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67780ab630 con 0x7f677814e8d0 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67780a99b0 con 0x7f6778063470 2023-08-22T00:44:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677f526700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780a6d20 con 0x7f6778069c50 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677dac3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677dac3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48624/0 (socket says 172.21.15.98:48624) 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677dac3700 1 -- 172.21.15.98:0/580220130 learned_addr learned my addr 172.21.15.98:0/580220130 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677cac1700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f677814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.636+0000 7f677d2c2700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6778063470 0x7f67780a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 -- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 msgr2=0x7f677814cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f677814cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 -- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6778063470 msgr2=0x7f67780a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6778063470 0x7f67780a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 -- 172.21.15.98:0/580220130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009370 con 0x7f677814e8d0 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677dac3700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f677000c7c0 tx=0x7f6770001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000e4a0 con 0x7f677814e8d0 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677000e600 con 0x7f677814e8d0 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67780aad90 con 0x7f677814e8d0 2023-08-22T00:44:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000e980 con 0x7f677814e8d0 2023-08-22T00:44:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.637+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67780ab350 con 0x7f677814e8d0 2023-08-22T00:44:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.638+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67780a6af0 con 0x7f677814e8d0 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.638+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f67700123f0 con 0x7f677814e8d0 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.639+0000 7f676d7fa700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 0x7f675c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.639+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6770079850 con 0x7f677814e8d0 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.639+0000 7f677d2c2700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 0x7f675c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.639+0000 7f677d2c2700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 0x7f675c0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6774009fd0 tx=0x7f6774017000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.644 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.643+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f67700478f0 con 0x7f677814e8d0 2023-08-22T00:44:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.805+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6778047480 con 0x7f677814e8d0 2023-08-22T00:44:55.810 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.809+0000 7f676d7fa700 1 -- 172.21.15.98:0/580220130 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v41) v1 ==== 120+0+0 (secure 0 0 0) 0x7f67780a6af0 con 0x7f677814e8d0 2023-08-22T00:44:55.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 msgr2=0x7f675c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 0x7f675c0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6774009fd0 tx=0x7f6774017000).stop 2023-08-22T00:44:55.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 msgr2=0x7f67780aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f677000c7c0 tx=0x7f6770001510).stop 2023-08-22T00:44:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 shutdown_connections 2023-08-22T00:44:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f675c05ef30 0x7f675c0613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f677814e8d0 0x7f67780aba20 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6778063470 0x7f67780a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 --2- 172.21.15.98:0/580220130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6778069c50 0x7f677814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 >> 172.21.15.98:0/580220130 conn(0x7f67780c3ab0 msgr2=0x7f67780c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 shutdown_connections 2023-08-22T00:44:55.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.811+0000 7f677f526700 1 -- 172.21.15.98:0/580220130 wait complete. 2023-08-22T00:44:55.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-22T00:44:55.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.940+0000 7f0d1a594700 1 Processor -- start 2023-08-22T00:44:55.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.940+0000 7f0d1a594700 1 -- start start 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d1a594700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d140ac9b0 0x7f0d140bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d1a594700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c73b0 0x7f0d140c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d1a594700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d140c57e0 con 0x7f0d140c4c50 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d1a594700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d140c42d0 con 0x7f0d140ac9b0 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d1a594700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14065930 con 0x7f0d140c73b0 2023-08-22T00:44:55.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d13fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d140ac9b0 0x7f0d140bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d13fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d140ac9b0 0x7f0d140bc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48630/0 (socket says 172.21.15.98:48630) 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d13fff700 1 -- 172.21.15.98:0/4058702164 learned_addr learned my addr 172.21.15.98:0/4058702164 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.941+0000 7f0d137fe700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c73b0 0x7f0d140c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d13fff700 1 -- 172.21.15.98:0/4058702164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c73b0 msgr2=0x7f0d140c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d13fff700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c73b0 0x7f0d140c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d13fff700 1 -- 172.21.15.98:0/4058702164 >> v1:172.21.15.118:6789/0 conn(0x7f0d140c4c50 legacy=0x7f0d140acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d13fff700 1 -- 172.21.15.98:0/4058702164 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140c5a30 con 0x7f0d140ac9b0 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d13fff700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d140bc840 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7f0d08006fd0 tx=0x7f0d080090f0).ready entity=mon.0 client_cookie=1193b26728fc9a74 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d12ffd700 1 -- 172.21.15.98:0/4058702164 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800b600 con 0x7f0d140ac9b0 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d12ffd700 1 -- 172.21.15.98:0/4058702164 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800b760 con 0x7f0d140ac9b0 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d12ffd700 1 -- 172.21.15.98:0/4058702164 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800bae0 con 0x7f0d140ac9b0 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 -- 172.21.15.98:0/4058702164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 msgr2=0x7f0d140bc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d140bc840 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7f0d08006fd0 tx=0x7f0d080090f0).stop 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 -- 172.21.15.98:0/4058702164 shutdown_connections 2023-08-22T00:44:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d140bc840 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 --2- 172.21.15.98:0/4058702164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c73b0 0x7f0d140c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 -- 172.21.15.98:0/4058702164 >> 172.21.15.98:0/4058702164 conn(0x7f0d140aa960 msgr2=0x7f0d140aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:55.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 -- 172.21.15.98:0/4058702164 shutdown_connections 2023-08-22T00:44:55.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.942+0000 7f0d1a594700 1 -- 172.21.15.98:0/4058702164 wait complete. 2023-08-22T00:44:55.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.943+0000 7f0d1a594700 1 Processor -- start 2023-08-22T00:44:55.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 -- start start 2023-08-22T00:44:55.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c4c50 0x7f0d14092780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d140c73b0 0x7f0d1415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140c1790 con 0x7f0d140ac9b0 2023-08-22T00:44:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140931b0 con 0x7f0d140c73b0 2023-08-22T00:44:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.944+0000 7f0d1a594700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14093490 con 0x7f0d140c4c50 2023-08-22T00:44:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48638/0 (socket says 172.21.15.98:48638) 2023-08-22T00:44:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 -- 172.21.15.98:0/2006461948 learned_addr learned my addr 172.21.15.98:0/2006461948 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:55.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d137fe700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c4c50 0x7f0d14092780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d18b31700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d140c73b0 0x7f0d1415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 -- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c4c50 msgr2=0x7f0d14092780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c4c50 0x7f0d14092780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 -- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d140c73b0 msgr2=0x7f0d1415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:55.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d140c73b0 0x7f0d1415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:55.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 -- 172.21.15.98:0/2006461948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009370 con 0x7f0d140ac9b0 2023-08-22T00:44:55.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d13fff700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f0d14069a10 tx=0x7f0d08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800bea0 con 0x7f0d140ac9b0 2023-08-22T00:44:55.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800b8d0 con 0x7f0d140ac9b0 2023-08-22T00:44:55.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14093770 con 0x7f0d140ac9b0 2023-08-22T00:44:55.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0801c670 con 0x7f0d140ac9b0 2023-08-22T00:44:55.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.945+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14093d30 con 0x7f0d140ac9b0 2023-08-22T00:44:55.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.946+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d14093f50 con 0x7f0d140ac9b0 2023-08-22T00:44:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.947+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0d0801ca20 con 0x7f0d140ac9b0 2023-08-22T00:44:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.947+0000 7f0cfbfff700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 0x7f0d000613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.947+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f0d0807c0f0 con 0x7f0d140ac9b0 2023-08-22T00:44:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.947+0000 7f0d137fe700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 0x7f0d000613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.948+0000 7f0d137fe700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 0x7f0d000613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0d1414ab20 tx=0x7f0d04008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:55.956 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:55.951+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d08050e70 con 0x7f0d140ac9b0 2023-08-22T00:44:56.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:56.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f0d14047480 con 0x7f0d140ac9b0 2023-08-22T00:44:57.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.176+0000 7f0cfbfff700 1 -- 172.21.15.98:0/2006461948 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1372) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0d0802a020 con 0x7f0d140ac9b0 2023-08-22T00:44:57.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 msgr2=0x7f0d000613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 0x7f0d000613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0d1414ab20 tx=0x7f0d04008040).stop 2023-08-22T00:44:57.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 msgr2=0x7f0d14145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f0d14069a10 tx=0x7f0d08017000).stop 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 shutdown_connections 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0d0005ef00 0x7f0d000613c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d140c73b0 0x7f0d1415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d140ac9b0 0x7f0d14145cc0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 --2- 172.21.15.98:0/2006461948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d140c4c50 0x7f0d14092780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 >> 172.21.15.98:0/2006461948 conn(0x7f0d140aa960 msgr2=0x7f0d14062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:57.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 shutdown_connections 2023-08-22T00:44:57.182 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.179+0000 7f0d1a594700 1 -- 172.21.15.98:0/2006461948 wait complete. 2023-08-22T00:44:57.195 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-08-22T00:44:57.196 INFO:tasks.cephfs_test_runner: 2023-08-22T00:44:57.196 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-22T00:44:57.196 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2279.890s 2023-08-22T00:44:57.197 INFO:tasks.cephfs_test_runner: 2023-08-22T00:44:57.197 INFO:tasks.cephfs_test_runner:OK 2023-08-22T00:44:57.197 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-22T00:44:57.220 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-08-22T00:44:57.251 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-08-22T00:44:57.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.252 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-08-22T00:44:57.276 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-22T00:44:57.276 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-22T00:44:57.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-22T00:44:57.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-22T00:44:57.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-08-22T00:44:57.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.508 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-08-22T00:44:57.531 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-22T00:44:57.532 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-22T00:44:57.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.533 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-22T00:44:57.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-22T00:44:57.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-22T00:44:57.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-08-22T00:44:57.800 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-22T00:44:57.818 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-22T00:44:57.818 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:57.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.938+0000 7fc01b2d8700 1 Processor -- start 2023-08-22T00:44:57.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.938+0000 7fc01b2d8700 1 -- start start 2023-08-22T00:44:57.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc01b2d8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc014150cf0 0x7fc0140a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc01b2d8700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140c51d0 con 0x7fc014150910 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc01b2d8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140c1050 con 0x7fc0140c5660 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc01b2d8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140c4320 con 0x7fc014150cf0 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc019074700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc014150910 0x7fc0140c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60182/0 (socket says 172.21.15.98:60182) 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc019074700 1 -- 172.21.15.98:0/1046627725 learned_addr learned my addr 172.21.15.98:0/1046627725 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc018873700 1 --2- 172.21.15.98:0/1046627725 >> v2:172.21.15.118:3300/0 conn(0x7fc014150cf0 0x7fc0140a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329449003 0 0) 0x7fc0140c51d0 con 0x7fc014150910 2023-08-22T00:44:57.943 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0000033f0 con 0x7fc014150910 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 85625877 0 0) 0x7fc0000033f0 con 0x7fc014150910 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 >> v2:172.21.15.118:3300/0 conn(0x7fc014150cf0 msgr2=0x7fc0140a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 --2- 172.21.15.98:0/1046627725 >> v2:172.21.15.118:3300/0 conn(0x7fc014150cf0 0x7fc0140a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 >> v1:172.21.15.118:6789/0 conn(0x7fc0140c5660 legacy=0x7fc01415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140c45c0 con 0x7fc014150910 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fc010001470 con 0x7fc014150910 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 >> v1:172.21.15.98:6789/0 conn(0x7fc014150910 legacy=0x7fc0140c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.944 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.939+0000 7fc00bfff700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000038e0 0x7fc000003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 0x7fc000004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc000005000 0x7fc00000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c4320 con 0x7fc000004690 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000beb0 con 0x7fc0000038e0 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000c070 con 0x7fc000005000 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 0x7fc000004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc019074700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000038e0 0x7fc000003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc019875700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc000005000 0x7fc00000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 -- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc000005000 msgr2=0x7fc00000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc000005000 0x7fc00000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 -- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000038e0 msgr2=0x7fc000003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000038e0 0x7fc000003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc019875700 1 -- 172.21.15.98:0/1046627725 reap_dead start 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 -- 172.21.15.98:0/1046627725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000033f0 con 0x7fc000004690 2023-08-22T00:44:57.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc019074700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000038e0 0x7fc000003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc018873700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 0x7fc000004b10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fc004009a80 tx=0x7fc004009060).ready entity=mon.0 client_cookie=3c1b69b2e703e7b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004009430 con 0x7fc000004690 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400e640 con 0x7fc000004690 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.940+0000 7fc00bfff700 1 -- 172.21.15.98:0/1046627725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400e9c0 con 0x7fc000004690 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 -- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 msgr2=0x7fc000004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 0x7fc000004b10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fc004009a80 tx=0x7fc004009060).stop 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 -- 172.21.15.98:0/1046627725 shutdown_connections 2023-08-22T00:44:57.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/1046627725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc000004690 0x7fc000004b10 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 -- 172.21.15.98:0/1046627725 >> 172.21.15.98:0/1046627725 conn(0x7fc0140c7290 msgr2=0x7fc0140c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:57.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 -- 172.21.15.98:0/1046627725 shutdown_connections 2023-08-22T00:44:57.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.941+0000 7fc01b2d8700 1 -- 172.21.15.98:0/1046627725 wait complete. 2023-08-22T00:44:57.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.942+0000 7fc01b2d8700 1 Processor -- start 2023-08-22T00:44:57.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.942+0000 7fc01b2d8700 1 -- start start 2023-08-22T00:44:57.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000004690 0x7fc0141662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc014139510 0x7fc0141499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0141630b0 con 0x7fc0141543f0 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014154870 con 0x7fc000004690 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc01b2d8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc014162430 con 0x7fc014139510 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48658/0 (socket says 172.21.15.98:48658) 2023-08-22T00:44:57.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 -- 172.21.15.98:0/3936869464 learned_addr learned my addr 172.21.15.98:0/3936869464 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc019074700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000004690 0x7fc0141662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc019875700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc014139510 0x7fc0141499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 -- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc014139510 msgr2=0x7fc0141499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc014139510 0x7fc0141499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 -- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000004690 msgr2=0x7fc0141662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000004690 0x7fc0141662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 -- 172.21.15.98:0/3936869464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014162710 con 0x7fc0141543f0 2023-08-22T00:44:57.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.943+0000 7fc018873700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7fc00000be80 tx=0x7fc00401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.944+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400ed70 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.944+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400eed0 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.944+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0141629f0 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.944+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400e9c0 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.944+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc014149ee0 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.945+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc014155da0 con 0x7fc0141543f0 2023-08-22T00:44:57.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.945+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc00402e440 con 0x7fc0141543f0 2023-08-22T00:44:57.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.945+0000 7fc0097fa700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 0x7fbff80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:57.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.945+0000 7fc019074700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 0x7fbff80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:57.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.945+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fc00407b920 con 0x7fc0141543f0 2023-08-22T00:44:57.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.946+0000 7fc019074700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 0x7fbff80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc010000e50 tx=0x7fc010001e50).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:57.954 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:57.950+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc00404ca90 con 0x7fc0141543f0 2023-08-22T00:44:58.112 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.111+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc014047480 con 0x7fc0141543f0 2023-08-22T00:44:58.113 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.112+0000 7fc0097fa700 1 -- 172.21.15.98:0/3936869464 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+14905 (secure 0 0 0) 0x7fc004016020 con 0x7fc0141543f0 2023-08-22T00:44:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:58.114 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":209,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:55.170856+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6837/743825487":"2023-08-23T00:44:51.256180+0000","172.21.15.98:0/2138564250":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/1667709328":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/198785877":"2023-08-23T00:44:51.147679+0000","172.21.15.98:6835/743825487":"2023-08-23T00:44:51.256180+0000","172.21.15.98:0/2260716115":"2023-08-23T00:44:51.147679+0000","172.21.15.98:6833/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:6832/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1540437146":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3413779450":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/4280173716":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3051248189":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1757469699":"2023-08-23T00:44:35.917919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:58.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 msgr2=0x7fbff80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 0x7fbff80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc010000e50 tx=0x7fc010001e50).stop 2023-08-22T00:44:58.115 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 msgr2=0x7fc014139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7fc00000be80 tx=0x7fc00401a000).stop 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 shutdown_connections 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbff805ef30 0x7fbff80613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc014139510 0x7fc0141499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000004690 0x7fc0141662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 --2- 172.21.15.98:0/3936869464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0141543f0 0x7fc014139020 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.116 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 >> 172.21.15.98:0/3936869464 conn(0x7fc0140c7290 msgr2=0x7fc0140bccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 shutdown_connections 2023-08-22T00:44:58.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.114+0000 7fc01b2d8700 1 -- 172.21.15.98:0/3936869464 wait complete. 2023-08-22T00:44:58.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-22T00:44:58.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.243+0000 7fbeb3796700 1 Processor -- start 2023-08-22T00:44:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.243+0000 7fbeb3796700 1 -- start start 2023-08-22T00:44:58.248 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb3796700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbeac0ac9b0 0x7fbeac0bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb3796700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbeac0c4e70 0x7fbeac0acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb3796700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0c57e0 con 0x7fbeac0c73b0 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb3796700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac0c42d0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb3796700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac065930 con 0x7fbeac0c4e70 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb1532700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbeac0ac9b0 0x7fbeac0bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb0d31700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbeac0c73b0 0x7fbeac0c4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60190/0 (socket says 172.21.15.98:60190) 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.244+0000 7fbeb0d31700 1 -- 172.21.15.98:0/3274115490 learned_addr learned my addr 172.21.15.98:0/3274115490 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:58.249 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1d33700 1 --2- 172.21.15.98:0/3274115490 >> v2:172.21.15.118:3300/0 conn(0x7fbeac0c4e70 0x7fbeac0acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1532700 1 -- 172.21.15.98:0/3274115490 >> v2:172.21.15.118:3300/0 conn(0x7fbeac0c4e70 msgr2=0x7fbeac0acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1532700 1 --2- 172.21.15.98:0/3274115490 >> v2:172.21.15.118:3300/0 conn(0x7fbeac0c4e70 0x7fbeac0acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1532700 1 -- 172.21.15.98:0/3274115490 >> v1:172.21.15.98:6789/0 conn(0x7fbeac0c73b0 legacy=0x7fbeac0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbea3fff700 1 -- 172.21.15.98:0/3274115490 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633205686 0 0) 0x7fbeac0c57e0 con 0x7fbeac0c73b0 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1532700 1 -- 172.21.15.98:0/3274115490 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0c5a30 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb1532700 1 --2- 172.21.15.98:0/3274115490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac0bc840 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fbeac0be910 tx=0x7fbe9c009060).ready entity=mon.0 client_cookie=138288b6efb17f90 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.250 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbea3fff700 1 -- 172.21.15.98:0/3274115490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b580 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbea3fff700 1 -- 172.21.15.98:0/3274115490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b6e0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbea3fff700 1 -- 172.21.15.98:0/3274115490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00ba60 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb3796700 1 -- 172.21.15.98:0/3274115490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 msgr2=0x7fbeac0bc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb3796700 1 --2- 172.21.15.98:0/3274115490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac0bc840 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fbeac0be910 tx=0x7fbe9c009060).stop 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb3796700 1 -- 172.21.15.98:0/3274115490 shutdown_connections 2023-08-22T00:44:58.251 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb3796700 1 --2- 172.21.15.98:0/3274115490 >> v2:172.21.15.118:3300/0 conn(0x7fbeac0c4e70 0x7fbeac0acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.245+0000 7fbeb3796700 1 --2- 172.21.15.98:0/3274115490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac0bc840 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.246+0000 7fbeb3796700 1 -- 172.21.15.98:0/3274115490 >> 172.21.15.98:0/3274115490 conn(0x7fbeac0aa960 msgr2=0x7fbeac0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.246+0000 7fbeb3796700 1 -- 172.21.15.98:0/3274115490 shutdown_connections 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.246+0000 7fbeb3796700 1 -- 172.21.15.98:0/3274115490 wait complete. 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.247+0000 7fbeb3796700 1 Processor -- start 2023-08-22T00:44:58.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.247+0000 7fbeb3796700 1 -- start start 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbeac0c4e70 0x7fbeac0a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbeac0c73b0 0x7fbeac0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac095250 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0a9420 con 0x7fbeac0c4e70 2023-08-22T00:44:58.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac094610 con 0x7fbeac0c73b0 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48674/0 (socket says 172.21.15.98:48674) 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 -- 172.21.15.98:0/110412797 learned_addr learned my addr 172.21.15.98:0/110412797 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb0d31700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbeac0c4e70 0x7fbeac0a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1d33700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbeac0c73b0 0x7fbeac0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 -- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbeac0c73b0 msgr2=0x7fbeac0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbeac0c73b0 0x7fbeac0a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 -- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbeac0c4e70 msgr2=0x7fbeac0a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbeac0c4e70 0x7fbeac0a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 -- 172.21.15.98:0/110412797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0092a0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb1532700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fbe9c009fd0 tx=0x7fbe9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b850 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b9b0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.257 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c01b660 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0948b0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.248+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac094e70 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.249+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac095570 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.250+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbe9c01ba90 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.250+0000 7fbea17fa700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 0x7fbe900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.250+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fbe9c07bad0 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.250+0000 7fbeb0d31700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 0x7fbe900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.258 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.250+0000 7fbeb0d31700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 0x7fbe900613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fbeac0c1980 tx=0x7fbea8009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.259 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.254+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbeac095570 con 0x7fbeac0ac9b0 2023-08-22T00:44:58.413 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.412+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbeac095570 con 0x7fbe9005ef30 2023-08-22T00:44:58.416 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.415+0000 7fbea17fa700 1 -- 172.21.15.98:0/110412797 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71524 (secure 0 0 0) 0x7fbeac095570 con 0x7fbe9005ef30 2023-08-22T00:44:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:58.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 msgr2=0x7fbe900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 0x7fbe900613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fbeac0c1980 tx=0x7fbea8009040).stop 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 msgr2=0x7fbeac091c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fbe9c009fd0 tx=0x7fbe9c017000).stop 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 shutdown_connections 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbe9005ef30 0x7fbe900613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbeac0c73b0 0x7fbeac0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbeac0ac9b0 0x7fbeac091c20 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.419 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 --2- 172.21.15.98:0/110412797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbeac0c4e70 0x7fbeac0a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 >> 172.21.15.98:0/110412797 conn(0x7fbeac0aa960 msgr2=0x7fbeac063a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 shutdown_connections 2023-08-22T00:44:58.420 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.417+0000 7fbeb3796700 1 -- 172.21.15.98:0/110412797 wait complete. 2023-08-22T00:44:58.420 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:58.430 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-22T00:44:57.162911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454312,"kb_used_data":20200,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520408,"statfs":{"total":773094113280,"available":770580897792,"internally_reserved":0,"allocated":20684800,"data_stored":11056311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12447,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-70,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004358"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154023+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:51.154023+0000","last_peered":"2023-08-22T00:44:51.154023+0000","last_clean":"2023-08-22T00:44:51.154023+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:51.154023+0000","last_undegraded":"2023-08-22T00:44:51.154023+0000","last_fullsized":"2023-08-22T00:44:51.154023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157662+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:51.157662+0000","last_peered":"2023-08-22T00:44:51.157662+0000","last_clean":"2023-08-22T00:44:51.157662+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:51.157662+0000","last_undegraded":"2023-08-22T00:44:51.157662+0000","last_fullsized":"2023-08-22T00:44:51.157662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.208857+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:51.208857+0000","last_peered":"2023-08-22T00:44:51.208857+0000","last_clean":"2023-08-22T00:44:51.208857+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:51.208857+0000","last_undegraded":"2023-08-22T00:44:51.208857+0000","last_fullsized":"2023-08-22T00:44:51.208857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157572+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:51.157572+0000","last_peered":"2023-08-22T00:44:51.157572+0000","last_clean":"2023-08-22T00:44:51.157572+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:51.157572+0000","last_undegraded":"2023-08-22T00:44:51.157572+0000","last_fullsized":"2023-08-22T00:44:51.157572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158057+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:51.158057+0000","last_peered":"2023-08-22T00:44:51.158057+0000","last_clean":"2023-08-22T00:44:51.158057+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:51.158057+0000","last_undegraded":"2023-08-22T00:44:51.158057+0000","last_fullsized":"2023-08-22T00:44:51.158057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158018+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:51.158018+0000","last_peered":"2023-08-22T00:44:51.158018+0000","last_clean":"2023-08-22T00:44:51.158018+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:51.158018+0000","last_undegraded":"2023-08-22T00:44:51.158018+0000","last_fullsized":"2023-08-22T00:44:51.158018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158384+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:51.158384+0000","last_peered":"2023-08-22T00:44:51.158384+0000","last_clean":"2023-08-22T00:44:51.158384+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:51.158384+0000","last_undegraded":"2023-08-22T00:44:51.158384+0000","last_fullsized":"2023-08-22T00:44:51.158384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154497+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:51.154497+0000","last_peered":"2023-08-22T00:44:51.154497+0000","last_clean":"2023-08-22T00:44:51.154497+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:51.154497+0000","last_undegraded":"2023-08-22T00:44:51.154497+0000","last_fullsized":"2023-08-22T00:44:51.154497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":193,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154810+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:51.154810+0000","last_peered":"2023-08-22T00:44:51.154810+0000","last_clean":"2023-08-22T00:44:51.154810+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:51.154810+0000","last_undegraded":"2023-08-22T00:44:51.154810+0000","last_fullsized":"2023-08-22T00:44:51.154810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064020,"statfs":{"total":96636764160,"available":96321556480,"internally_reserved":0,"allocated":2592768,"data_stored":1391021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.433}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.441}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.39500000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.36399999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.45300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2584576,"data_stored":1381433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.752}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303720,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068120,"statfs":{"total":96636764160,"available":96325754880,"internally_reserved":0,"allocated":2588672,"data_stored":1381492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.433},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58099999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.33600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":1.01},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78100000000000003,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2555904,"data_stored":1365993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.51300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.47999999999999998,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.309}]},{"osd":3,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.626,"15min":0.65300000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.438}]},{"osd":5,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.93500000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.82199999999999995,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.42299999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.45400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2584576,"data_stored":1380890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.27600000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.379},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303716,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068124,"statfs":{"total":96636764160,"available":96325758976,"internally_reserved":0,"allocated":2584576,"data_stored":1380902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.435},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.372},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.45200000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307832,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064008,"statfs":{"total":96636764160,"available":96321544192,"internally_reserved":0,"allocated":2605056,"data_stored":1392908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.372}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.313},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307816,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064024,"statfs":{"total":96636764160,"available":96321560576,"internally_reserved":0,"allocated":2588672,"data_stored":1381672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":1.869}]},{"osd":1,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":3.3109999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":3.351}]},{"osd":3,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":3.4129999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":1.714}]},{"osd":4,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":1.163},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.745},"last":0.46700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":3.3809999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":1.222}]},{"osd":7,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":3.4409999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:58.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:58.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.547+0000 7f25c5bd5700 1 Processor -- start 2023-08-22T00:44:58.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 -- start start 2023-08-22T00:44:58.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 0x7f25c00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25c00bdfe0 0x7f25c00c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00c6110 con 0x7f25c00c44a0 2023-08-22T00:44:58.553 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00be430 con 0x7f25c00bdfe0 2023-08-22T00:44:58.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.548+0000 7f25c5bd5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00be650 con 0x7f25c00ab480 2023-08-22T00:44:58.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25c00bdfe0 0x7f25c00c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.554 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25beffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 0x7f25c00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25c00bdfe0 0x7f25c00c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.98:58850/0 (socket says 172.21.15.98:58850) 2023-08-22T00:44:58.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 -- 172.21.15.98:0/3332637130 learned_addr learned my addr 172.21.15.98:0/3332637130 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:58.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25beffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 0x7f25c00c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.98:56480/0 (socket says 172.21.15.98:56480) 2023-08-22T00:44:58.555 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bf7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f25c00c44a0 0x7f25c00c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:49780/0 (socket says 172.21.15.98:49780) 2023-08-22T00:44:58.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 -- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 msgr2=0x7f25c00c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:58.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 --2- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 0x7f25c00c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 -- 172.21.15.98:0/3332637130 >> v1:172.21.15.118:6789/0 conn(0x7f25c00c44a0 legacy=0x7f25c00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.556 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 -- 172.21.15.98:0/3332637130 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00c57e0 con 0x7f25c00bdfe0 2023-08-22T00:44:58.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25bffff700 1 --2- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00bdfe0 0x7f25c00c1ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f25b8009f20 tx=0x7f25b8009840).ready entity=mon.1 client_cookie=2333fdce47e86ef4 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25be7fc700 1 -- 172.21.15.98:0/3332637130 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800e070 con 0x7f25c00bdfe0 2023-08-22T00:44:58.557 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25be7fc700 1 -- 172.21.15.98:0/3332637130 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800b9d0 con 0x7f25c00bdfe0 2023-08-22T00:44:58.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.549+0000 7f25be7fc700 1 -- 172.21.15.98:0/3332637130 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800bd50 con 0x7f25c00bdfe0 2023-08-22T00:44:58.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 -- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00bdfe0 msgr2=0x7f25c00c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00bdfe0 0x7f25c00c1ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f25b8009f20 tx=0x7f25b8009840).stop 2023-08-22T00:44:58.558 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 -- 172.21.15.98:0/3332637130 shutdown_connections 2023-08-22T00:44:58.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00bdfe0 0x7f25c00c1ee0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/3332637130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00ab480 0x7f25c00c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 -- 172.21.15.98:0/3332637130 >> 172.21.15.98:0/3332637130 conn(0x7f25c00aa960 msgr2=0x7f25c00aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.559 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 -- 172.21.15.98:0/3332637130 shutdown_connections 2023-08-22T00:44:58.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.550+0000 7f25c5bd5700 1 -- 172.21.15.98:0/3332637130 wait complete. 2023-08-22T00:44:58.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.551+0000 7f25c5bd5700 1 Processor -- start 2023-08-22T00:44:58.560 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.551+0000 7f25c5bd5700 1 -- start start 2023-08-22T00:44:58.563 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 0x7f25c01618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00bdfe0 0x7f25c00a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00a5720 con 0x7f25c00c44a0 2023-08-22T00:44:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0165820 con 0x7f25c00ab480 2023-08-22T00:44:58.564 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25c5bd5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00a4f10 con 0x7f25c00bdfe0 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25bf7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 0x7f25c01618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48678/0 (socket says 172.21.15.98:48678) 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25bffff700 1 -- 172.21.15.98:0/2899875057 learned_addr learned my addr 172.21.15.98:0/2899875057 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.552+0000 7f25beffd700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00bdfe0 0x7f25c00a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 -- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00bdfe0 msgr2=0x7f25c00a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.565 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00bdfe0 0x7f25c00a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 -- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 msgr2=0x7f25c01618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 0x7f25c01618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 -- 172.21.15.98:0/2899875057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009ae0 con 0x7f25c00c44a0 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bf7fe700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 0x7f25c01618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25bffff700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f25b800b610 tx=0x7f25b8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80092e0 con 0x7f25c00c44a0 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b801e470 con 0x7f25c00c44a0 2023-08-22T00:44:58.566 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00a51c0 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b801e830 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.553+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0165d10 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.554+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c0047480 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.554+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f25b8003040 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.554+0000 7f25b77fe700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 0x7f25a00613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.555+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f25b807b400 con 0x7f25c00c44a0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.555+0000 7f25bf7fe700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 0x7f25a00613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.567 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.555+0000 7f25bf7fe700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 0x7f25a00613c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f25a8007fd0 tx=0x7f25a8007d30).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.568 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.559+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f25b804c740 con 0x7f25c00c44a0 2023-08-22T00:44:58.717 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.716+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25c00c5ac0 con 0x7f25a005ef00 2023-08-22T00:44:58.720 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.719+0000 7f25b77fe700 1 -- 172.21.15.98:0/2899875057 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71524 (secure 0 0 0) 0x7f25c00c5ac0 con 0x7f25a005ef00 2023-08-22T00:44:58.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:58.722 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 msgr2=0x7f25a00613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 0x7f25a00613c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f25a8007fd0 tx=0x7f25a8007d30).stop 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 msgr2=0x7f25c01673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f25b800b610 tx=0x7f25b8009840).stop 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 shutdown_connections 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f25a005ef00 0x7f25a00613c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c00c44a0 0x7f25c01673d0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.723 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25c00ab480 0x7f25c01618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 --2- 172.21.15.98:0/2899875057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25c00bdfe0 0x7f25c00a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 >> 172.21.15.98:0/2899875057 conn(0x7f25c00aa960 msgr2=0x7f25c00c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 shutdown_connections 2023-08-22T00:44:58.724 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.721+0000 7f25c5bd5700 1 -- 172.21.15.98:0/2899875057 wait complete. 2023-08-22T00:44:58.724 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:58.734 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-22T00:44:57.162911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454312,"kb_used_data":20200,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520408,"statfs":{"total":773094113280,"available":770580897792,"internally_reserved":0,"allocated":20684800,"data_stored":11056311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12447,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-70,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004358"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154023+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:51.154023+0000","last_peered":"2023-08-22T00:44:51.154023+0000","last_clean":"2023-08-22T00:44:51.154023+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:51.154023+0000","last_undegraded":"2023-08-22T00:44:51.154023+0000","last_fullsized":"2023-08-22T00:44:51.154023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157662+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:51.157662+0000","last_peered":"2023-08-22T00:44:51.157662+0000","last_clean":"2023-08-22T00:44:51.157662+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:51.157662+0000","last_undegraded":"2023-08-22T00:44:51.157662+0000","last_fullsized":"2023-08-22T00:44:51.157662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.208857+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:51.208857+0000","last_peered":"2023-08-22T00:44:51.208857+0000","last_clean":"2023-08-22T00:44:51.208857+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:51.208857+0000","last_undegraded":"2023-08-22T00:44:51.208857+0000","last_fullsized":"2023-08-22T00:44:51.208857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157572+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:51.157572+0000","last_peered":"2023-08-22T00:44:51.157572+0000","last_clean":"2023-08-22T00:44:51.157572+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:51.157572+0000","last_undegraded":"2023-08-22T00:44:51.157572+0000","last_fullsized":"2023-08-22T00:44:51.157572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158057+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:51.158057+0000","last_peered":"2023-08-22T00:44:51.158057+0000","last_clean":"2023-08-22T00:44:51.158057+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:51.158057+0000","last_undegraded":"2023-08-22T00:44:51.158057+0000","last_fullsized":"2023-08-22T00:44:51.158057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158018+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:51.158018+0000","last_peered":"2023-08-22T00:44:51.158018+0000","last_clean":"2023-08-22T00:44:51.158018+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:51.158018+0000","last_undegraded":"2023-08-22T00:44:51.158018+0000","last_fullsized":"2023-08-22T00:44:51.158018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158384+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:51.158384+0000","last_peered":"2023-08-22T00:44:51.158384+0000","last_clean":"2023-08-22T00:44:51.158384+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:51.158384+0000","last_undegraded":"2023-08-22T00:44:51.158384+0000","last_fullsized":"2023-08-22T00:44:51.158384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154497+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:51.154497+0000","last_peered":"2023-08-22T00:44:51.154497+0000","last_clean":"2023-08-22T00:44:51.154497+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:51.154497+0000","last_undegraded":"2023-08-22T00:44:51.154497+0000","last_fullsized":"2023-08-22T00:44:51.154497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":193,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154810+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:51.154810+0000","last_peered":"2023-08-22T00:44:51.154810+0000","last_clean":"2023-08-22T00:44:51.154810+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:51.154810+0000","last_undegraded":"2023-08-22T00:44:51.154810+0000","last_fullsized":"2023-08-22T00:44:51.154810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064020,"statfs":{"total":96636764160,"available":96321556480,"internally_reserved":0,"allocated":2592768,"data_stored":1391021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.433}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.441}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.39500000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.36399999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.45300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2584576,"data_stored":1381433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.752}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303720,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068120,"statfs":{"total":96636764160,"available":96325754880,"internally_reserved":0,"allocated":2588672,"data_stored":1381492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.433},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58099999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.33600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":1.01},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78100000000000003,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2555904,"data_stored":1365993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.51300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.47999999999999998,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.309}]},{"osd":3,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.626,"15min":0.65300000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.438}]},{"osd":5,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.93500000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.82199999999999995,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.42299999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.45400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2584576,"data_stored":1380890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.27600000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.379},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303716,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068124,"statfs":{"total":96636764160,"available":96325758976,"internally_reserved":0,"allocated":2584576,"data_stored":1380902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.435},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.372},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.45200000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307832,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064008,"statfs":{"total":96636764160,"available":96321544192,"internally_reserved":0,"allocated":2605056,"data_stored":1392908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.372}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.313},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307816,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064024,"statfs":{"total":96636764160,"available":96321560576,"internally_reserved":0,"allocated":2588672,"data_stored":1381672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":1.869}]},{"osd":1,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":3.3109999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":3.351}]},{"osd":3,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":3.4129999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":1.714}]},{"osd":4,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":1.163},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.745},"last":0.46700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":3.3809999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":1.222}]},{"osd":7,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":3.4409999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:58.736 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-22T00:44:58.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:44:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.851+0000 7fe147104700 1 Processor -- start 2023-08-22T00:44:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 -- start start 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 0x7fe1400c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1400bdfe0 0x7fe1400c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1400c6110 con 0x7fe1400c44a0 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1400be3f0 con 0x7fe1400bdfe0 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.852+0000 7fe147104700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1400be650 con 0x7fe1400ab480 2023-08-22T00:44:58.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1400bdfe0 0x7fe1400c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1400bdfe0 0x7fe1400c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48692/0 (socket says 172.21.15.98:48692) 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 -- 172.21.15.98:0/1233213746 learned_addr learned my addr 172.21.15.98:0/1233213746 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe144ea0700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe1400c44a0 0x7fe1400c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60204/0 (socket says 172.21.15.98:60204) 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13ffff700 1 --2- 172.21.15.98:0/1233213746 >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 0x7fe1400c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 -- 172.21.15.98:0/1233213746 >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 msgr2=0x7fe1400c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 --2- 172.21.15.98:0/1233213746 >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 0x7fe1400c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 -- 172.21.15.98:0/1233213746 >> v1:172.21.15.98:6789/0 conn(0x7fe1400c44a0 legacy=0x7fe1400c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13f7fe700 1 -- 172.21.15.98:0/1233213746 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738680007 0 0) 0x7fe1400c6110 con 0x7fe1400c44a0 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 -- 172.21.15.98:0/1233213746 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400c57e0 con 0x7fe1400bdfe0 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13ffff700 1 --2- 172.21.15.98:0/1233213746 >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 0x7fe1400c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe1456a1700 1 --2- 172.21.15.98:0/1233213746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400bdfe0 0x7fe1400c1ee0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fe140068560 tx=0x7fe138009840).ready entity=mon.0 client_cookie=f96d78891e57063c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13f7fe700 1 -- 172.21.15.98:0/1233213746 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800e070 con 0x7fe1400bdfe0 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13f7fe700 1 -- 172.21.15.98:0/1233213746 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800ba50 con 0x7fe1400bdfe0 2023-08-22T00:44:58.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.853+0000 7fe13f7fe700 1 -- 172.21.15.98:0/1233213746 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800bdd0 con 0x7fe1400bdfe0 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 -- 172.21.15.98:0/1233213746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400bdfe0 msgr2=0x7fe1400c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 --2- 172.21.15.98:0/1233213746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400bdfe0 0x7fe1400c1ee0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fe140068560 tx=0x7fe138009840).stop 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 -- 172.21.15.98:0/1233213746 shutdown_connections 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 --2- 172.21.15.98:0/1233213746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400bdfe0 0x7fe1400c1ee0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 --2- 172.21.15.98:0/1233213746 >> v2:172.21.15.118:3300/0 conn(0x7fe1400ab480 0x7fe1400c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 -- 172.21.15.98:0/1233213746 >> 172.21.15.98:0/1233213746 conn(0x7fe1400aa960 msgr2=0x7fe1400aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:58.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 -- 172.21.15.98:0/1233213746 shutdown_connections 2023-08-22T00:44:58.859 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.854+0000 7fe147104700 1 -- 172.21.15.98:0/1233213746 wait complete. 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.855+0000 7fe147104700 1 Processor -- start 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.855+0000 7fe147104700 1 -- start start 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1400ab480 0x7fe1401638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1400bdfe0 0x7fe1400920e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.861 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400a75c0 con 0x7fe1400c44a0 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400a6c90 con 0x7fe1400ab480 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400a6f70 con 0x7fe1400bdfe0 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48704/0 (socket says 172.21.15.98:48704) 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 -- 172.21.15.98:0/1437006866 learned_addr learned my addr 172.21.15.98:0/1437006866 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe144ea0700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1400ab480 0x7fe1401638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 -- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1400bdfe0 msgr2=0x7fe1400920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.862 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe13ffff700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1400bdfe0 0x7fe1400920e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1400bdfe0 0x7fe1400920e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 -- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1400ab480 msgr2=0x7fe1401638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1400ab480 0x7fe1401638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 -- 172.21.15.98:0/1437006866 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138009ae0 con 0x7fe1400c44a0 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe1456a1700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7fe138009fd0 tx=0x7fe138009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380032d0 con 0x7fe1400c44a0 2023-08-22T00:44:58.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380092e0 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13801d620 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1400a7250 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.856+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400a5530 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.857+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400a7730 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.858+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe13801da50 con 0x7fe1400c44a0 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.858+0000 7fe13cff9700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 0x7fe1240613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:58.864 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.858+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fe13807bd20 con 0x7fe1400c44a0 2023-08-22T00:44:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.858+0000 7fe144ea0700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 0x7fe1240613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.859+0000 7fe144ea0700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 0x7fe1240613c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1340015d0 tx=0x7fe134009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:58.862+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe13804cfb0 con 0x7fe1400c44a0 2023-08-22T00:44:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.020+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1400a6e00 con 0x7fe12405ef00 2023-08-22T00:44:59.023 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.022+0000 7fe13cff9700 1 -- 172.21.15.98:0/1437006866 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71524 (secure 0 0 0) 0x7fe1400a6e00 con 0x7fe12405ef00 2023-08-22T00:44:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:59.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 msgr2=0x7fe1240613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 0x7fe1240613c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1340015d0 tx=0x7fe134009040).stop 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 msgr2=0x7fe1400645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7fe138009fd0 tx=0x7fe138009840).stop 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 shutdown_connections 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe12405ef00 0x7fe1240613c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1400c44a0 0x7fe1400645a0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1400ab480 0x7fe1401638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 --2- 172.21.15.98:0/1437006866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1400bdfe0 0x7fe1400920e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 >> 172.21.15.98:0/1437006866 conn(0x7fe1400aa960 msgr2=0x7fe140065190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:59.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 shutdown_connections 2023-08-22T00:44:59.027 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.024+0000 7fe147104700 1 -- 172.21.15.98:0/1437006866 wait complete. 2023-08-22T00:44:59.027 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:44:59.037 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-22T00:44:57.162911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454312,"kb_used_data":20200,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520408,"statfs":{"total":773094113280,"available":770580897792,"internally_reserved":0,"allocated":20684800,"data_stored":11056311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12447,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-70,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004358"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154023+0000","last_change":"2023-08-22T00:06:04.199726+0000","last_active":"2023-08-22T00:44:51.154023+0000","last_peered":"2023-08-22T00:44:51.154023+0000","last_clean":"2023-08-22T00:44:51.154023+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:44:51.154023+0000","last_undegraded":"2023-08-22T00:44:51.154023+0000","last_fullsized":"2023-08-22T00:44:51.154023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157662+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:51.157662+0000","last_peered":"2023-08-22T00:44:51.157662+0000","last_clean":"2023-08-22T00:44:51.157662+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:51.157662+0000","last_undegraded":"2023-08-22T00:44:51.157662+0000","last_fullsized":"2023-08-22T00:44:51.157662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.208857+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:51.208857+0000","last_peered":"2023-08-22T00:44:51.208857+0000","last_clean":"2023-08-22T00:44:51.208857+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:51.208857+0000","last_undegraded":"2023-08-22T00:44:51.208857+0000","last_fullsized":"2023-08-22T00:44:51.208857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.157572+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:51.157572+0000","last_peered":"2023-08-22T00:44:51.157572+0000","last_clean":"2023-08-22T00:44:51.157572+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:51.157572+0000","last_undegraded":"2023-08-22T00:44:51.157572+0000","last_fullsized":"2023-08-22T00:44:51.157572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158057+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:51.158057+0000","last_peered":"2023-08-22T00:44:51.158057+0000","last_clean":"2023-08-22T00:44:51.158057+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:51.158057+0000","last_undegraded":"2023-08-22T00:44:51.158057+0000","last_fullsized":"2023-08-22T00:44:51.158057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158018+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:51.158018+0000","last_peered":"2023-08-22T00:44:51.158018+0000","last_clean":"2023-08-22T00:44:51.158018+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:51.158018+0000","last_undegraded":"2023-08-22T00:44:51.158018+0000","last_fullsized":"2023-08-22T00:44:51.158018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.158384+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:51.158384+0000","last_peered":"2023-08-22T00:44:51.158384+0000","last_clean":"2023-08-22T00:44:51.158384+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:51.158384+0000","last_undegraded":"2023-08-22T00:44:51.158384+0000","last_fullsized":"2023-08-22T00:44:51.158384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154497+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:51.154497+0000","last_peered":"2023-08-22T00:44:51.154497+0000","last_clean":"2023-08-22T00:44:51.154497+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:51.154497+0000","last_undegraded":"2023-08-22T00:44:51.154497+0000","last_fullsized":"2023-08-22T00:44:51.154497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":193,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-22T00:44:51.154810+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:51.154810+0000","last_peered":"2023-08-22T00:44:51.154810+0000","last_clean":"2023-08-22T00:44:51.154810+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:51.154810+0000","last_undegraded":"2023-08-22T00:44:51.154810+0000","last_fullsized":"2023-08-22T00:44:51.154810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064020,"statfs":{"total":96636764160,"available":96321556480,"internally_reserved":0,"allocated":2592768,"data_stored":1391021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.433}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.441}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.39500000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.36399999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.45300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2584576,"data_stored":1381433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.752}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303720,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068120,"statfs":{"total":96636764160,"available":96325754880,"internally_reserved":0,"allocated":2588672,"data_stored":1381492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.433},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58099999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.33600000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":1.01},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78100000000000003,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2555904,"data_stored":1365993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.51300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.47999999999999998,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.309}]},{"osd":3,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.626,"15min":0.65300000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.438}]},{"osd":5,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.93500000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.82199999999999995,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.42299999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.45400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2584576,"data_stored":1380890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.27600000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.379},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303716,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068124,"statfs":{"total":96636764160,"available":96325758976,"internally_reserved":0,"allocated":2584576,"data_stored":1380902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.435},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.372},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.45200000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307832,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064008,"statfs":{"total":96636764160,"available":96321544192,"internally_reserved":0,"allocated":2605056,"data_stored":1392908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.372}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.313},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307816,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064024,"statfs":{"total":96636764160,"available":96321560576,"internally_reserved":0,"allocated":2588672,"data_stored":1381672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":1.869}]},{"osd":1,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":3.3109999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63200000000000001}]},{"osd":2,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":3.351}]},{"osd":3,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":3.4129999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":1.714}]},{"osd":4,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":1.163},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.745},"last":0.46700000000000003}]},{"osd":6,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":3.3809999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":1.222}]},{"osd":7,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":3.4409999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:44:59.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-22T00:44:59.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.154+0000 7f7c13b77700 1 Processor -- start 2023-08-22T00:44:59.155 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.154+0000 7f7c13b77700 1 -- start start 2023-08-22T00:44:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c13b77700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c0c0ac9b0 0x7f7c0c0bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c13b77700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c0c0c73b0 0x7f7c0c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c13b77700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0c57e0 con 0x7f7c0c0c4c50 2023-08-22T00:44:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c13b77700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c42d0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c13b77700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c065930 con 0x7f7c0c0c73b0 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7c0c0ac9b0 0x7f7c0c0bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c12114700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7c0c0c4c50 0x7f7c0c0acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:60214/0 (socket says 172.21.15.98:60214) 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c12114700 1 -- 172.21.15.98:0/3778097429 learned_addr learned my addr 172.21.15.98:0/3778097429 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 -- 172.21.15.98:0/3778097429 >> v2:172.21.15.118:3300/0 conn(0x7f7c0c0c73b0 msgr2=0x7f7c0c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:44:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11112700 1 --2- 172.21.15.98:0/3778097429 >> v2:172.21.15.118:3300/0 conn(0x7f7c0c0c73b0 0x7f7c0c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c10911700 1 -- 172.21.15.98:0/3778097429 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034605522 0 0) 0x7f7c0c0c57e0 con 0x7f7c0c0c4c50 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 --2- 172.21.15.98:0/3778097429 >> v2:172.21.15.118:3300/0 conn(0x7f7c0c0c73b0 0x7f7c0c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 -- 172.21.15.98:0/3778097429 >> v1:172.21.15.98:6789/0 conn(0x7f7c0c0c4c50 legacy=0x7f7c0c0acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 -- 172.21.15.98:0/3778097429 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0c5a30 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c11913700 1 --2- 172.21.15.98:0/3778097429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0bc840 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7f7c0c0be820 tx=0x7f7c08009060).ready entity=mon.0 client_cookie=8ad12ec02b661d6f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c10911700 1 -- 172.21.15.98:0/3778097429 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800b580 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c10911700 1 -- 172.21.15.98:0/3778097429 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b6e0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.155+0000 7f7c10911700 1 -- 172.21.15.98:0/3778097429 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800ba60 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 -- 172.21.15.98:0/3778097429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 msgr2=0x7f7c0c0bc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 --2- 172.21.15.98:0/3778097429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0bc840 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7f7c0c0be820 tx=0x7f7c08009060).stop 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 -- 172.21.15.98:0/3778097429 shutdown_connections 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 --2- 172.21.15.98:0/3778097429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0bc840 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 --2- 172.21.15.98:0/3778097429 >> v2:172.21.15.118:3300/0 conn(0x7f7c0c0c73b0 0x7f7c0c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 -- 172.21.15.98:0/3778097429 >> 172.21.15.98:0/3778097429 conn(0x7f7c0c0aa960 msgr2=0x7f7c0c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:59.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 -- 172.21.15.98:0/3778097429 shutdown_connections 2023-08-22T00:44:59.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.156+0000 7f7c13b77700 1 -- 172.21.15.98:0/3778097429 wait complete. 2023-08-22T00:44:59.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.157+0000 7f7c13b77700 1 Processor -- start 2023-08-22T00:44:59.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.157+0000 7f7c13b77700 1 -- start start 2023-08-22T00:44:59.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c0c0c4c50 0x7f7c0c149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.164 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 0x7f7c0c165760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c0ad0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0bfec0 con 0x7f7c0c0c73b0 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c13b77700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c01a0 con 0x7f7c0c0c4c50 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48730/0 (socket says 172.21.15.98:48730) 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 -- 172.21.15.98:0/121349591 learned_addr learned my addr 172.21.15.98:0/121349591 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c12114700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 0x7f7c0c165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11112700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c0c0c4c50 0x7f7c0c149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 -- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c0c0c4c50 msgr2=0x7f7c0c149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c0c0c4c50 0x7f7c0c149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 -- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 msgr2=0x7f7c0c165760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 0x7f7c0c165760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 -- 172.21.15.98:0/121349591 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080092a0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c12114700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 0x7f7c0c165760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c11913700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f7c0c069a10 tx=0x7f7c08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.158+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800b850 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.159+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b9b0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.159+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801b660 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.159+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c0c0480 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.159+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c0918d0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.160+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c047480 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.160+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7c0801ba10 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.161+0000 7f7c01ffb700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 0x7f7bf0061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:44:59.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.161+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f7c0807c060 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.161+0000 7f7c11112700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 0x7f7bf0061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:44:59.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.161+0000 7f7c11112700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 0x7f7bf0061420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7c0c14ae30 tx=0x7f7bfc008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:44:59.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.164+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c0804d2f0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.326+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c0c0655e0 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.328 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.327+0000 7f7c01ffb700 1 -- 172.21.15.98:0/121349591 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+14905 (secure 0 0 0) 0x7f7c08029020 con 0x7f7c0c0ac9b0 2023-08-22T00:44:59.328 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:44:59.328 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":209,"fsid":"1e61d47e-5294-4f44-ba3b-d3c83a49a88d","created":"2023-08-22T00:05:51.342374+0000","modified":"2023-08-22T00:44:55.170856+0000","last_up_change":"2023-08-22T00:06:00.041320+0000","last_in_change":"2023-08-22T00:05:53.798203+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-22T00:06:00.072840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-22T00:06:02.532310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54428ccb-cd3d-4e94-89af-33cd114c4cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":118497},{"type":"v1","addr":"172.21.15.98:6809","nonce":118497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":118497},{"type":"v1","addr":"172.21.15.98:6811","nonce":118497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":118497},{"type":"v1","addr":"172.21.15.98:6815","nonce":118497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":118497},{"type":"v1","addr":"172.21.15.98:6813","nonce":118497}]},"public_addr":"172.21.15.98:6809/118497","cluster_addr":"172.21.15.98:6811/118497","heartbeat_back_addr":"172.21.15.98:6815/118497","heartbeat_front_addr":"172.21.15.98:6813/118497","state":["exists","up"]},{"osd":1,"uuid":"42b43cff-eb9a-4397-a186-1a7ef671bf51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":118496},{"type":"v1","addr":"172.21.15.98:6801","nonce":118496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":118496},{"type":"v1","addr":"172.21.15.98:6803","nonce":118496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":118496},{"type":"v1","addr":"172.21.15.98:6807","nonce":118496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":118496},{"type":"v1","addr":"172.21.15.98:6805","nonce":118496}]},"public_addr":"172.21.15.98:6801/118496","cluster_addr":"172.21.15.98:6803/118496","heartbeat_back_addr":"172.21.15.98:6807/118496","heartbeat_front_addr":"172.21.15.98:6805/118496","state":["exists","up"]},{"osd":2,"uuid":"4832bf14-be35-44c8-b575-aa4046e2f6ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":118500},{"type":"v1","addr":"172.21.15.98:6817","nonce":118500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":118500},{"type":"v1","addr":"172.21.15.98:6819","nonce":118500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":118500},{"type":"v1","addr":"172.21.15.98:6823","nonce":118500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":118500},{"type":"v1","addr":"172.21.15.98:6821","nonce":118500}]},"public_addr":"172.21.15.98:6817/118500","cluster_addr":"172.21.15.98:6819/118500","heartbeat_back_addr":"172.21.15.98:6823/118500","heartbeat_front_addr":"172.21.15.98:6821/118500","state":["exists","up"]},{"osd":3,"uuid":"655026d5-05ea-4515-977d-63f4ecf40f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":118512},{"type":"v1","addr":"172.21.15.98:6825","nonce":118512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":118512},{"type":"v1","addr":"172.21.15.98:6827","nonce":118512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":118512},{"type":"v1","addr":"172.21.15.98:6831","nonce":118512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":118512},{"type":"v1","addr":"172.21.15.98:6829","nonce":118512}]},"public_addr":"172.21.15.98:6825/118512","cluster_addr":"172.21.15.98:6827/118512","heartbeat_back_addr":"172.21.15.98:6831/118512","heartbeat_front_addr":"172.21.15.98:6829/118512","state":["exists","up"]},{"osd":4,"uuid":"6e5f7031-d1cb-494e-bf0d-e42c54c825c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":118777},{"type":"v1","addr":"172.21.15.118:6818","nonce":118777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":118777},{"type":"v1","addr":"172.21.15.118:6822","nonce":118777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":118777},{"type":"v1","addr":"172.21.15.118:6830","nonce":118777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":118777},{"type":"v1","addr":"172.21.15.118:6826","nonce":118777}]},"public_addr":"172.21.15.118:6818/118777","cluster_addr":"172.21.15.118:6822/118777","heartbeat_back_addr":"172.21.15.118:6830/118777","heartbeat_front_addr":"172.21.15.118:6826/118777","state":["exists","up"]},{"osd":5,"uuid":"44ecb76c-5e72-4d65-96f4-e5f06015e549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":118771},{"type":"v1","addr":"172.21.15.118:6819","nonce":118771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":118771},{"type":"v1","addr":"172.21.15.118:6823","nonce":118771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":118771},{"type":"v1","addr":"172.21.15.118:6831","nonce":118771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":118771},{"type":"v1","addr":"172.21.15.118:6827","nonce":118771}]},"public_addr":"172.21.15.118:6819/118771","cluster_addr":"172.21.15.118:6823/118771","heartbeat_back_addr":"172.21.15.118:6831/118771","heartbeat_front_addr":"172.21.15.118:6827/118771","state":["exists","up"]},{"osd":6,"uuid":"a4ce6bf0-82c9-405e-a13a-b0a9115f24f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":118768},{"type":"v1","addr":"172.21.15.118:6801","nonce":118768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":118768},{"type":"v1","addr":"172.21.15.118:6803","nonce":118768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":118768},{"type":"v1","addr":"172.21.15.118:6807","nonce":118768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":118768},{"type":"v1","addr":"172.21.15.118:6805","nonce":118768}]},"public_addr":"172.21.15.118:6801/118768","cluster_addr":"172.21.15.118:6803/118768","heartbeat_back_addr":"172.21.15.118:6807/118768","heartbeat_front_addr":"172.21.15.118:6805/118768","state":["exists","up"]},{"osd":7,"uuid":"5b36e6d3-ac74-4e97-b2c1-936084855dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":118770},{"type":"v1","addr":"172.21.15.118:6809","nonce":118770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":118770},{"type":"v1","addr":"172.21.15.118:6811","nonce":118770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":118770},{"type":"v1","addr":"172.21.15.118:6815","nonce":118770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":118770},{"type":"v1","addr":"172.21.15.118:6813","nonce":118770}]},"public_addr":"172.21.15.118:6809/118770","cluster_addr":"172.21.15.118:6811/118770","heartbeat_back_addr":"172.21.15.118:6815/118770","heartbeat_front_addr":"172.21.15.118:6813/118770","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.958629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.934168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.928098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:59.028333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.962891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.999952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.917237+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-22T00:05:58.949398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6837/743825487":"2023-08-23T00:44:51.256180+0000","172.21.15.98:0/2138564250":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/1667709328":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/198785877":"2023-08-23T00:44:51.147679+0000","172.21.15.98:6835/743825487":"2023-08-23T00:44:51.256180+0000","172.21.15.98:0/2260716115":"2023-08-23T00:44:51.147679+0000","172.21.15.98:6833/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:6832/169458":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1540437146":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3413779450":"2023-08-23T00:44:51.147679+0000","172.21.15.98:0/4280173716":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/3051248189":"2023-08-23T00:44:35.917919+0000","172.21.15.98:0/1757469699":"2023-08-23T00:44:35.917919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 msgr2=0x7f7bf0061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 0x7f7bf0061420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7c0c14ae30 tx=0x7f7bfc008040).stop 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 msgr2=0x7f7c0c0c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f7c0c069a10 tx=0x7f7c08017000).stop 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 shutdown_connections 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7bf005ef60 0x7f7bf0061420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.330 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c0c0c73b0 0x7f7c0c165760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c0c0ac9b0 0x7f7c0c0c0f60 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 --2- 172.21.15.98:0/121349591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c0c0c4c50 0x7f7c0c149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:44:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.328+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 >> 172.21.15.98:0/121349591 conn(0x7f7c0c0aa960 msgr2=0x7f7c0c0638b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:44:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.329+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 shutdown_connections 2023-08-22T00:44:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:44:59.329+0000 7f7c13b77700 1 -- 172.21.15.98:0/121349591 wait complete. 2023-08-22T00:45:00.342 INFO:tasks.ceph:Scrubbing osd.0 2023-08-22T00:45:00.343 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:00.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.475+0000 7f0eecab9700 1 Processor -- start 2023-08-22T00:45:00.477 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.475+0000 7f0eecab9700 1 -- start start 2023-08-22T00:45:00.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.476+0000 7f0eecab9700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0ee8065690 0x7f0ee80bc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.479 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.476+0000 7f0eecab9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 0x7f0ee8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.476+0000 7f0eecab9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee81583d0 con 0x7f0ee8154660 2023-08-22T00:45:00.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.476+0000 7f0eecab9700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee814e9f0 con 0x7f0ee8065690 2023-08-22T00:45:00.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.476+0000 7f0eecab9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80bcd00 con 0x7f0ee8154a40 2023-08-22T00:45:00.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0ee8065690 0x7f0ee80bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.480 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0ee8065690 0x7f0ee80bc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42542/0 (socket says 172.21.15.98:42542) 2023-08-22T00:45:00.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 -- 172.21.15.98:0/1353862571 learned_addr learned my addr 172.21.15.98:0/1353862571 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:00.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee6d9d700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 0x7f0ee8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 -- 172.21.15.98:0/1353862571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 msgr2=0x7f0ee8154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:00.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 0x7f0ee8154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.481 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 -- 172.21.15.98:0/1353862571 >> v1:172.21.15.118:6789/0 conn(0x7f0ee8154660 legacy=0x7f0ee8064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 -- 172.21.15.98:0/1353862571 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee81553a0 con 0x7f0ee8065690 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee6d9d700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 0x7f0ee8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee5d9b700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8065690 0x7f0ee80bc810 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7f0ed8009830 tx=0x7f0ed80090f0).ready entity=mon.0 client_cookie=b41167c0f52286af server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee559a700 1 -- 172.21.15.98:0/1353862571 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800b600 con 0x7f0ee8065690 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee559a700 1 -- 172.21.15.98:0/1353862571 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800b760 con 0x7f0ee8065690 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.477+0000 7f0ee559a700 1 -- 172.21.15.98:0/1353862571 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800bae0 con 0x7f0ee8065690 2023-08-22T00:45:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 -- 172.21.15.98:0/1353862571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8065690 msgr2=0x7f0ee80bc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8065690 0x7f0ee80bc810 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7f0ed8009830 tx=0x7f0ed80090f0).stop 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 -- 172.21.15.98:0/1353862571 shutdown_connections 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8154a40 0x7f0ee8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 --2- 172.21.15.98:0/1353862571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8065690 0x7f0ee80bc810 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 -- 172.21.15.98:0/1353862571 >> 172.21.15.98:0/1353862571 conn(0x7f0ee80c4350 msgr2=0x7f0ee80c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 -- 172.21.15.98:0/1353862571 shutdown_connections 2023-08-22T00:45:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.478+0000 7f0eecab9700 1 -- 172.21.15.98:0/1353862571 wait complete. 2023-08-22T00:45:00.486 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.479+0000 7f0eecab9700 1 Processor -- start 2023-08-22T00:45:00.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.479+0000 7f0eecab9700 1 -- start start 2023-08-22T00:45:00.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8065690 0x7f0ee80a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee8154660 0x7f0ee814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 0x7f0ee814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.487 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80a7b40 con 0x7f0ee8154a40 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80a7e20 con 0x7f0ee8154660 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80a8100 con 0x7f0ee8065690 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 0x7f0ee814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 0x7f0ee814f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42550/0 (socket says 172.21.15.98:42550) 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 -- 172.21.15.98:0/3033633608 learned_addr learned my addr 172.21.15.98:0/3033633608 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 -- 172.21.15.98:0/3033633608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8065690 msgr2=0x7f0ee80a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ee8065690 0x7f0ee80a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:00.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 -- 172.21.15.98:0/3033633608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee8154660 msgr2=0x7f0ee814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee8154660 0x7f0ee814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:00.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009370 con 0x7f0ee8154a40 2023-08-22T00:45:00.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ee6d9d700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 0x7f0ee814f100 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7f0ee000cef0 tx=0x7f0ee0007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.489 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000ae00 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0016400 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0016780 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee80a83e0 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.480+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee80a7730 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.481+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ee80a7f90 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0ee00203f0 con 0x7f0ee8154a40 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0ec805ef30 0x7f0ec80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f0ee007aaa0 con 0x7f0ee8154a40 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ee659c700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0ec805ef30 0x7f0ec80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7f0ec8065ef0 0x7f0ec8068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ec8068a10 con 0x7f0ec8065ef0 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ee007f240 con 0x7f0ee8154a40 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ee5d9b700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7f0ec8065ef0 0x7f0ec8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.482+0000 7f0ee659c700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0ec805ef30 0x7f0ec80613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0edc002510 tx=0x7f0edc0079a0).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.483+0000 7f0ee5d9b700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7f0ec8065ef0 0x7f0ec8068390 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.492 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.483+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== osd.0 v2:172.21.15.98:6808/118497 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0ec8068a10 con 0x7f0ec8065ef0 2023-08-22T00:45:00.497 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.496+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 --> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ee8047480 con 0x7f0ec8065ef0 2023-08-22T00:45:00.498 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.496+0000 7f0ed67fc700 1 -- 172.21.15.98:0/3033633608 <== osd.0 v2:172.21.15.98:6808/118497 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0ee8047480 con 0x7f0ec8065ef0 2023-08-22T00:45:00.498 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:00.498 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7f0ec8065ef0 msgr2=0x7f0ec8068390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6808/118497,v1:172.21.15.98:6809/118497] conn(0x7f0ec8065ef0 0x7f0ec8068390 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0ec805ef30 msgr2=0x7f0ec80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f0ec805ef30 0x7f0ec80613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0edc002510 tx=0x7f0edc0079a0).stop 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 msgr2=0x7f0ee814f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 --2- 172.21.15.98:0/3033633608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee8154a40 0x7f0ee814f100 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7f0ee000cef0 tx=0x7f0ee0007860).stop 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0ee6d9d700 1 -- 172.21.15.98:0/3033633608 reap_dead start 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 shutdown_connections 2023-08-22T00:45:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 >> 172.21.15.98:0/3033633608 conn(0x7f0ee80c4350 msgr2=0x7f0ee8152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 shutdown_connections 2023-08-22T00:45:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.497+0000 7f0eecab9700 1 -- 172.21.15.98:0/3033633608 wait complete. 2023-08-22T00:45:00.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-22T00:45:00.626 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.625+0000 7f21ddff4700 1 Processor -- start 2023-08-22T00:45:00.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.625+0000 7f21ddff4700 1 -- start start 2023-08-22T00:45:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21ddff4700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21d8150c00 0x7f21d80bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21ddff4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d80c7400 0x7f21d8064530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21ddff4700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d8065bf0 con 0x7f21d8064a20 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21ddff4700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80640a0 con 0x7f21d8150c00 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21ddff4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80c5c10 con 0x7f21d80c7400 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d77fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21d8150c00 0x7f21d80bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f21d8064a20 0x7f21d80c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33952/0 (socket says 172.21.15.98:33952) 2023-08-22T00:45:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d7fff700 1 -- 172.21.15.98:0/3524301180 learned_addr learned my addr 172.21.15.98:0/3524301180 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d6ffd700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d80c7400 0x7f21d8064530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d77fe700 1 -- 172.21.15.98:0/3524301180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d80c7400 msgr2=0x7f21d8064530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d77fe700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d80c7400 0x7f21d8064530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.626+0000 7f21d77fe700 1 -- 172.21.15.98:0/3524301180 >> v1:172.21.15.98:6789/0 conn(0x7f21d8064a20 legacy=0x7f21d80c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d77fe700 1 -- 172.21.15.98:0/3524301180 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8065630 con 0x7f21d8150c00 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d67fc700 1 -- 172.21.15.98:0/3524301180 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370429263 0 0) 0x7f21d8065bf0 con 0x7f21d8064a20 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d77fe700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d80bc8b0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f21c0006fd0 tx=0x7f21c0006f40).ready entity=mon.0 client_cookie=842db0a9969e209f server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.630 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d67fc700 1 -- 172.21.15.98:0/3524301180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0005880 con 0x7f21d8150c00 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d67fc700 1 -- 172.21.15.98:0/3524301180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c00059e0 con 0x7f21d8150c00 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21d67fc700 1 -- 172.21.15.98:0/3524301180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0005d60 con 0x7f21d8150c00 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 -- 172.21.15.98:0/3524301180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 msgr2=0x7f21d80bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d80bc8b0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f21c0006fd0 tx=0x7f21c0006f40).stop 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 -- 172.21.15.98:0/3524301180 shutdown_connections 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d80bc8b0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 --2- 172.21.15.98:0/3524301180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d80c7400 0x7f21d8064530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 -- 172.21.15.98:0/3524301180 >> 172.21.15.98:0/3524301180 conn(0x7f21d80aa9d0 msgr2=0x7f21d80aadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 -- 172.21.15.98:0/3524301180 shutdown_connections 2023-08-22T00:45:00.632 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.627+0000 7f21ddff4700 1 -- 172.21.15.98:0/3524301180 wait complete. 2023-08-22T00:45:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 Processor -- start 2023-08-22T00:45:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 -- start start 2023-08-22T00:45:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 0x7f21d80a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80c7400 0x7f21d813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80a9b20 con 0x7f21d8150c00 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80a8f10 con 0x7f21d80c7400 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.629+0000 7f21ddff4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80a91f0 con 0x7f21d8064a20 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42558/0 (socket says 172.21.15.98:42558) 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 -- 172.21.15.98:0/1296681783 learned_addr learned my addr 172.21.15.98:0/1296681783 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:00.635 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d6ffd700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80c7400 0x7f21d813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d77fe700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 0x7f21d80a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 -- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 msgr2=0x7f21d80a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 0x7f21d80a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 -- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80c7400 msgr2=0x7f21d813f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80c7400 0x7f21d813f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 -- 172.21.15.98:0/1296681783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0009250 con 0x7f21d8150c00 2023-08-22T00:45:00.636 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d77fe700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 0x7f21d80a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21d7fff700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f21d000c810 tx=0x7f21d00014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0005d30 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0005e90 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80a94d0 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0007320 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.630+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d813f7d0 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.631+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d8047480 con 0x7f21d8150c00 2023-08-22T00:45:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.631+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f21d0007750 con 0x7f21d8150c00 2023-08-22T00:45:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.632+0000 7f21cf7fe700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 0x7f21b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.632+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f21d007a000 con 0x7f21d8150c00 2023-08-22T00:45:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.632+0000 7f21d77fe700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 0x7f21b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.632+0000 7f21d77fe700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 0x7f21b80613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f21c000b340 tx=0x7f21c0016000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.636+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21d004b230 con 0x7f21d8150c00 2023-08-22T00:45:00.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.796+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d8065910 con 0x7f21b805ef30 2023-08-22T00:45:00.798 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.796+0000 7f21cf7fe700 1 -- 172.21.15.98:0/1296681783 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21d8065910 con 0x7f21b805ef30 2023-08-22T00:45:00.799 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 msgr2=0x7f21b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 0x7f21b80613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f21c000b340 tx=0x7f21c0016000).stop 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 msgr2=0x7f21d8145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f21d000c810 tx=0x7f21d00014d0).stop 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 shutdown_connections 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f21b805ef30 0x7f21b80613f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21d8064a20 0x7f21d80a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21d8150c00 0x7f21d8145e70 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 --2- 172.21.15.98:0/1296681783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80c7400 0x7f21d813f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 >> 172.21.15.98:0/1296681783 conn(0x7f21d80aa9d0 msgr2=0x7f21d8066f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 shutdown_connections 2023-08-22T00:45:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.798+0000 7f21ddff4700 1 -- 172.21.15.98:0/1296681783 wait complete. 2023-08-22T00:45:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 0 to deep-scrub 2023-08-22T00:45:00.811 INFO:tasks.ceph:Scrubbing osd.1 2023-08-22T00:45:00.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.929+0000 7f2f25614700 1 Processor -- start 2023-08-22T00:45:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.929+0000 7f2f25614700 1 -- start start 2023-08-22T00:45:00.931 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f25614700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2f2014e8d0 0x7f2f20069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f25614700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200bbf70 con 0x7f2f20063690 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f25614700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200c22b0 con 0x7f2f20069c50 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f25614700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200bdec0 con 0x7f2f2014e8d0 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2f2014e8d0 0x7f2f20069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f2f20063690 0x7f2f200c2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33958/0 (socket says 172.21.15.98:33958) 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1f7fe700 1 -- 172.21.15.98:0/3116943678 learned_addr learned my addr 172.21.15.98:0/3116943678 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:00.932 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 --2- 172.21.15.98:0/3116943678 >> v2:172.21.15.98:3300/0 conn(0x7f2f2014e8d0 0x7f2f20069760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42570/0 (socket says 172.21.15.98:42570) 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 -- 172.21.15.98:0/3116943678 >> v1:172.21.15.118:6789/0 conn(0x7f2f20069c50 legacy=0x7f2f20062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 -- 172.21.15.98:0/3116943678 >> v1:172.21.15.98:6789/0 conn(0x7f2f20063690 legacy=0x7f2f200c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 -- 172.21.15.98:0/3116943678 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2006a220 con 0x7f2f2014e8d0 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1dffb700 1 -- 172.21.15.98:0/3116943678 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015126274 0 0) 0x7f2f200bbf70 con 0x7f2f20063690 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1effd700 1 --2- 172.21.15.98:0/3116943678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f2014e8d0 0x7f2f20069760 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f2f10009760 tx=0x7f2f10009060).ready entity=mon.0 client_cookie=ac6cf7c71a4d3294 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1dffb700 1 -- 172.21.15.98:0/3116943678 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000b520 con 0x7f2f2014e8d0 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1dffb700 1 -- 172.21.15.98:0/3116943678 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000b680 con 0x7f2f2014e8d0 2023-08-22T00:45:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.930+0000 7f2f1dffb700 1 -- 172.21.15.98:0/3116943678 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000ba00 con 0x7f2f2014e8d0 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 -- 172.21.15.98:0/3116943678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f2014e8d0 msgr2=0x7f2f20069760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 --2- 172.21.15.98:0/3116943678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f2014e8d0 0x7f2f20069760 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f2f10009760 tx=0x7f2f10009060).stop 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 -- 172.21.15.98:0/3116943678 shutdown_connections 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 --2- 172.21.15.98:0/3116943678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f2014e8d0 0x7f2f20069760 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 -- 172.21.15.98:0/3116943678 >> 172.21.15.98:0/3116943678 conn(0x7f2f200c3ab0 msgr2=0x7f2f200c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 -- 172.21.15.98:0/3116943678 shutdown_connections 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.931+0000 7f2f25614700 1 -- 172.21.15.98:0/3116943678 wait complete. 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.932+0000 7f2f25614700 1 Processor -- start 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.932+0000 7f2f25614700 1 -- start start 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f20063690 0x7f2f2014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 0x7f2f200c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f2014e8d0 0x7f2f200c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200c5820 con 0x7f2f20069c50 2023-08-22T00:45:00.937 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20156d50 con 0x7f2f20063690 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f25614700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201575b0 con 0x7f2f2014e8d0 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 0x7f2f200c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 0x7f2f200c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42584/0 (socket says 172.21.15.98:42584) 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 -- 172.21.15.98:0/1695920768 learned_addr learned my addr 172.21.15.98:0/1695920768 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1effd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f20063690 0x7f2f2014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1f7fe700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f2014e8d0 0x7f2f200c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 -- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f2014e8d0 msgr2=0x7f2f200c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.938 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f2014e8d0 0x7f2f200c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 -- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f20063690 msgr2=0x7f2f2014bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f20063690 0x7f2f2014bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100092a0 con 0x7f2f20069c50 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1effd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f20063690 0x7f2f2014bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.933+0000 7f2f1e7fc700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 0x7f2f200c4e40 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f2f1400b460 tx=0x7f2f14006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14012410 con 0x7f2f20069c50 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14012590 con 0x7f2f20069c50 2023-08-22T00:45:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20168ce0 con 0x7f2f20069c50 2023-08-22T00:45:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14012950 con 0x7f2f20069c50 2023-08-22T00:45:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20157240 con 0x7f2f20069c50 2023-08-22T00:45:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.934+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f20047480 con 0x7f2f20069c50 2023-08-22T00:45:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2f14012d00 con 0x7f2f20069c50 2023-08-22T00:45:00.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2f0c05ef30 0x7f2f0c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2f14079e60 con 0x7f2f20069c50 2023-08-22T00:45:00.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f1effd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2f0c05ef30 0x7f2f0c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.941 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2f0c065f70 0x7f2f0c068410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f0c068a90 con 0x7f2f0c065f70 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.935+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f1407f370 con 0x7f2f20069c50 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.936+0000 7f2f1f7fe700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2f0c065f70 0x7f2f0c068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.936+0000 7f2f1effd700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2f0c05ef30 0x7f2f0c0613f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f10009270 tx=0x7f2f10017000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.936+0000 7f2f1f7fe700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2f0c065f70 0x7f2f0c068410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.936+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== osd.1 v2:172.21.15.98:6800/118496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2f0c068a90 con 0x7f2f0c065f70 2023-08-22T00:45:00.950 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.949+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 --> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2f20157720 con 0x7f2f0c065f70 2023-08-22T00:45:00.951 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f06ffd700 1 -- 172.21.15.98:0/1695920768 <== osd.1 v2:172.21.15.98:6800/118496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2f20157720 con 0x7f2f0c065f70 2023-08-22T00:45:00.951 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:00.951 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:00.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2f0c065f70 msgr2=0x7f2f0c068410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6800/118496,v1:172.21.15.98:6801/118496] conn(0x7f2f0c065f70 0x7f2f0c068410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:00.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2f0c05ef30 msgr2=0x7f2f0c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2f0c05ef30 0x7f2f0c0613f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f10009270 tx=0x7f2f10017000).stop 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 msgr2=0x7f2f200c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 --2- 172.21.15.98:0/1695920768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f20069c50 0x7f2f200c4e40 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f2f1400b460 tx=0x7f2f14006f20).stop 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f1f7fe700 1 -- 172.21.15.98:0/1695920768 reap_dead start 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 shutdown_connections 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 >> 172.21.15.98:0/1695920768 conn(0x7f2f200c3ab0 msgr2=0x7f2f200c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 shutdown_connections 2023-08-22T00:45:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:00.950+0000 7f2f25614700 1 -- 172.21.15.98:0/1695920768 wait complete. 2023-08-22T00:45:00.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-22T00:45:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.078+0000 7fbbc8928700 1 Processor -- start 2023-08-22T00:45:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.078+0000 7fbbc8928700 1 -- start start 2023-08-22T00:45:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc8928700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 0x7fbbc40a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc8928700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 0x7fbbc40a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc8928700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40a7470 con 0x7fbbc4153690 2023-08-22T00:45:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc8928700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40a6de0 con 0x7fbbc4153ea0 2023-08-22T00:45:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc8928700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40a6350 con 0x7fbbc40c2670 2023-08-22T00:45:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 0x7fbbc40a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbbc4153690 0x7fbbc40c1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.98:53512/0 (socket says 172.21.15.98:53512) 2023-08-22T00:45:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 0x7fbbc40a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc259c700 1 -- 172.21.15.98:0/850845568 learned_addr learned my addr 172.21.15.98:0/850845568 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:01.082 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/850845568 >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 msgr2=0x7fbbc40a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 --2- 172.21.15.98:0/850845568 >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 0x7fbbc40a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/850845568 >> v1:172.21.15.118:6789/0 conn(0x7fbbc4153690 legacy=0x7fbbc40c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/850845568 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc41543f0 con 0x7fbbc40c2670 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc2d9d700 1 --2- 172.21.15.98:0/850845568 >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 0x7fbbc40a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.079+0000 7fbbc1d9b700 1 --2- 172.21.15.98:0/850845568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 0x7fbbc40a7900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbbb8009760 tx=0x7fbbb8009060).ready entity=mon.2 client_cookie=695d40982d042842 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc159a700 1 -- 172.21.15.98:0/850845568 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800f510 con 0x7fbbc40c2670 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc159a700 1 -- 172.21.15.98:0/850845568 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb800f670 con 0x7fbbc40c2670 2023-08-22T00:45:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc159a700 1 -- 172.21.15.98:0/850845568 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800f9f0 con 0x7fbbc40c2670 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 -- 172.21.15.98:0/850845568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 msgr2=0x7fbbc40a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 --2- 172.21.15.98:0/850845568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 0x7fbbc40a7900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbbb8009760 tx=0x7fbbb8009060).stop 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 -- 172.21.15.98:0/850845568 shutdown_connections 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 --2- 172.21.15.98:0/850845568 >> v2:172.21.15.118:3300/0 conn(0x7fbbc4153ea0 0x7fbbc40a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 --2- 172.21.15.98:0/850845568 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40c2670 0x7fbbc40a7900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 -- 172.21.15.98:0/850845568 >> 172.21.15.98:0/850845568 conn(0x7fbbc40c7300 msgr2=0x7fbbc40c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 -- 172.21.15.98:0/850845568 shutdown_connections 2023-08-22T00:45:01.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.080+0000 7fbbc8928700 1 -- 172.21.15.98:0/850845568 wait complete. 2023-08-22T00:45:01.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.081+0000 7fbbc8928700 1 Processor -- start 2023-08-22T00:45:01.085 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.081+0000 7fbbc8928700 1 -- start start 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbc40c2670 0x7fbbc414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc4153ea0 0x7fbbc40a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40a42b0 con 0x7fbbc4153690 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c3ab0 con 0x7fbbc40c2670 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc8928700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40bbec0 con 0x7fbbc4153ea0 2023-08-22T00:45:01.087 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42588/0 (socket says 172.21.15.98:42588) 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/4227067177 learned_addr learned my addr 172.21.15.98:0/4227067177 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc259c700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbc40c2670 0x7fbbc414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.082+0000 7fbbc2d9d700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc4153ea0 0x7fbbc40a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc4153ea0 msgr2=0x7fbbc40a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc4153ea0 0x7fbbc40a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.088 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbc40c2670 msgr2=0x7fbbc414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbc40c2670 0x7fbbc414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 -- 172.21.15.98:0/4227067177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009a20 con 0x7fbbc4153690 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc1d9b700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7fbbc40c0dd0 tx=0x7fbbb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800f510 con 0x7fbbc4153690 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb800f7e0 con 0x7fbbc4153690 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80092a0 con 0x7fbbc4153690 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb801b410 con 0x7fbbc4153690 2023-08-22T00:45:01.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.083+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc40a44b0 con 0x7fbbc4153690 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.084+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc4047480 con 0x7fbbc4153690 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.084+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbbb801b840 con 0x7fbbc4153690 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.085+0000 7fbbb27fc700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 0x7fbba40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.085+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fbbb807b700 con 0x7fbbc4153690 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.085+0000 7fbbc259c700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 0x7fbba40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.085+0000 7fbbc259c700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 0x7fbba40613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbbb4007fd0 tx=0x7fbbb4009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.089+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbbb804c990 con 0x7fbbc4153690 2023-08-22T00:45:01.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.251+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbc40bc000 con 0x7fbba405ef30 2023-08-22T00:45:01.252 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.251+0000 7fbbb27fc700 1 -- 172.21.15.98:0/4227067177 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbc40bc000 con 0x7fbba405ef30 2023-08-22T00:45:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 msgr2=0x7fbba40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 0x7fbba40613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbbb4007fd0 tx=0x7fbbb4009040).stop 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 msgr2=0x7fbbc40a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7fbbc40c0dd0 tx=0x7fbbb8017000).stop 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 shutdown_connections 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fbba405ef30 0x7fbba40613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc4153ea0 0x7fbbc40a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbc40c2670 0x7fbbc414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 --2- 172.21.15.98:0/4227067177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbc4153690 0x7fbbc40a38d0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 >> 172.21.15.98:0/4227067177 conn(0x7fbbc40c7300 msgr2=0x7fbbc40bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 shutdown_connections 2023-08-22T00:45:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.253+0000 7fbbc8928700 1 -- 172.21.15.98:0/4227067177 wait complete. 2023-08-22T00:45:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 1 to deep-scrub 2023-08-22T00:45:01.266 INFO:tasks.ceph:Scrubbing osd.2 2023-08-22T00:45:01.266 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.385+0000 7f663da5b700 1 Processor -- start 2023-08-22T00:45:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.385+0000 7f663da5b700 1 -- start start 2023-08-22T00:45:01.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f663da5b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6638153c40 0x7f6638154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f663da5b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638158150 0x7f66380bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.388 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f663da5b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6638063f10 con 0x7f66380c5a70 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f663da5b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380c6230 con 0x7f6638153c40 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f663da5b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380638c0 con 0x7f6638158150 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6638153c40 0x7f6638154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6638153c40 0x7f6638154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42590/0 (socket says 172.21.15.98:42590) 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 -- 172.21.15.98:0/4233457862 learned_addr learned my addr 172.21.15.98:0/4233457862 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f66377fe700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638158150 0x7f66380bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 -- 172.21.15.98:0/4233457862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638158150 msgr2=0x7f66380bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.389 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638158150 0x7f66380bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 -- 172.21.15.98:0/4233457862 >> v1:172.21.15.118:6789/0 conn(0x7f66380c5a70 legacy=0x7f6638157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 -- 172.21.15.98:0/4233457862 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638063ba0 con 0x7f6638153c40 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.386+0000 7f6636ffd700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638153c40 0x7f6638154020 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f662c006fd0 tx=0x7f662c0090f0).ready entity=mon.0 client_cookie=6f38c45cb2e5d291 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f6635ffb700 1 -- 172.21.15.98:0/4233457862 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00b600 con 0x7f6638153c40 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f6635ffb700 1 -- 172.21.15.98:0/4233457862 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00b760 con 0x7f6638153c40 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f6635ffb700 1 -- 172.21.15.98:0/4233457862 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00bae0 con 0x7f6638153c40 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 -- 172.21.15.98:0/4233457862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638153c40 msgr2=0x7f6638154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638153c40 0x7f6638154020 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f662c006fd0 tx=0x7f662c0090f0).stop 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 -- 172.21.15.98:0/4233457862 shutdown_connections 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638158150 0x7f66380bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 --2- 172.21.15.98:0/4233457862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638153c40 0x7f6638154020 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 -- 172.21.15.98:0/4233457862 >> 172.21.15.98:0/4233457862 conn(0x7f66380c80c0 msgr2=0x7f6638081fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 -- 172.21.15.98:0/4233457862 shutdown_connections 2023-08-22T00:45:01.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.387+0000 7f663da5b700 1 -- 172.21.15.98:0/4233457862 wait complete. 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.388+0000 7f663da5b700 1 Processor -- start 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.388+0000 7f663da5b700 1 -- start start 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66380c5a70 0x7f663814d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638153c40 0x7f66380c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 0x7f66380c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381650b0 con 0x7f6638158150 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380c12d0 con 0x7f66380c5a70 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f663da5b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638164430 con 0x7f6638153c40 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f66377fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 0x7f66380c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f66377fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 0x7f66380c0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42600/0 (socket says 172.21.15.98:42600) 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f66377fe700 1 -- 172.21.15.98:0/3277853023 learned_addr learned my addr 172.21.15.98:0/3277853023 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f66367fc700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638153c40 0x7f66380c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.389+0000 7f6636ffd700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66380c5a70 0x7f663814d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 -- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638153c40 msgr2=0x7f66380c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6638153c40 0x7f66380c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 -- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66380c5a70 msgr2=0x7f663814d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66380c5a70 0x7f663814d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009370 con 0x7f6638158150 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f66377fe700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 0x7f66380c0de0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f6630007f20 tx=0x7f6630009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000eb90 con 0x7f6638158150 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000ecf0 con 0x7f6638158150 2023-08-22T00:45:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6638164710 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630014610 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.390+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6638164cd0 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.391+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66381534d0 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.391+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6630014980 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f661effd700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f662405ef00 0x7f66240613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f663007a410 con 0x7f6638158150 2023-08-22T00:45:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f6636ffd700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f662405ef00 0x7f66240613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f661effd700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f6624065ec0 0x7f6624068360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66240689e0 con 0x7f6624065ec0 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7f663007ca60 con 0x7f6638158150 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f66367fc700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f6624065ec0 0x7f6624068360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f6636ffd700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f662405ef00 0x7f66240613c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f662c009130 tx=0x7f662c017000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.392+0000 7f66367fc700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f6624065ec0 0x7f6624068360 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.393+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== osd.2 v2:172.21.15.98:6816/118500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f66240689e0 con 0x7f6624065ec0 2023-08-22T00:45:01.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 --> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6638047480 con 0x7f6624065ec0 2023-08-22T00:45:01.407 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f661effd700 1 -- 172.21.15.98:0/3277853023 <== osd.2 v2:172.21.15.98:6816/118500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6638047480 con 0x7f6624065ec0 2023-08-22T00:45:01.407 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:01.408 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f6624065ec0 msgr2=0x7f6624068360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6816/118500,v1:172.21.15.98:6817/118500] conn(0x7f6624065ec0 0x7f6624068360 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f662405ef00 msgr2=0x7f66240613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f662405ef00 0x7f66240613c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f662c009130 tx=0x7f662c017000).stop 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 msgr2=0x7f66380c0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 --2- 172.21.15.98:0/3277853023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638158150 0x7f66380c0de0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f6630007f20 tx=0x7f6630009860).stop 2023-08-22T00:45:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f66377fe700 1 -- 172.21.15.98:0/3277853023 reap_dead start 2023-08-22T00:45:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 shutdown_connections 2023-08-22T00:45:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 >> 172.21.15.98:0/3277853023 conn(0x7f66380c80c0 msgr2=0x7f66380625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 shutdown_connections 2023-08-22T00:45:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.406+0000 7f663da5b700 1 -- 172.21.15.98:0/3277853023 wait complete. 2023-08-22T00:45:01.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-22T00:45:01.535 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.534+0000 7f2de5c55700 1 Processor -- start 2023-08-22T00:45:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.534+0000 7f2de5c55700 1 -- start start 2023-08-22T00:45:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2de0150340 0x7f2de00668b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de00653d0 0x7f2de00bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2de0066da0 0x7f2de00bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de00bd7d0 con 0x7f2de0066da0 2023-08-22T00:45:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de01540f0 con 0x7f2de0150340 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2de5c55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0154390 con 0x7f2de00653d0 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2de0066da0 0x7f2de00bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2de0066da0 0x7f2de00bd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42606/0 (socket says 172.21.15.98:42606) 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 -- 172.21.15.98:0/4029988406 learned_addr learned my addr 172.21.15.98:0/4029988406 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddeffd700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de00653d0 0x7f2de00bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddf7fe700 1 --2- 172.21.15.98:0/4029988406 >> v2:172.21.15.118:3300/0 conn(0x7f2de0150340 0x7f2de00668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 -- 172.21.15.98:0/4029988406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de00653d0 msgr2=0x7f2de00bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de00653d0 0x7f2de00bcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 -- 172.21.15.98:0/4029988406 >> v2:172.21.15.118:3300/0 conn(0x7f2de0150340 msgr2=0x7f2de00668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 --2- 172.21.15.98:0/4029988406 >> v2:172.21.15.118:3300/0 conn(0x7f2de0150340 0x7f2de00668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 -- 172.21.15.98:0/4029988406 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0154670 con 0x7f2de0066da0 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2ddffff700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0066da0 0x7f2de00bd2e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f2de00a99a0 tx=0x7f2dd800ba50).ready entity=mon.0 client_cookie=753faf697b2f7ec server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.535+0000 7f2dde7fc700 1 -- 172.21.15.98:0/4029988406 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8010070 con 0x7f2de0066da0 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2dde7fc700 1 -- 172.21.15.98:0/4029988406 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800de90 con 0x7f2de0066da0 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2dde7fc700 1 -- 172.21.15.98:0/4029988406 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800b2e0 con 0x7f2de0066da0 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 -- 172.21.15.98:0/4029988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0066da0 msgr2=0x7f2de00bd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0066da0 0x7f2de00bd2e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f2de00a99a0 tx=0x7f2dd800ba50).stop 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 -- 172.21.15.98:0/4029988406 shutdown_connections 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0066da0 0x7f2de00bd2e0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 --2- 172.21.15.98:0/4029988406 >> v2:172.21.15.118:3300/0 conn(0x7f2de0150340 0x7f2de00668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 --2- 172.21.15.98:0/4029988406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de00653d0 0x7f2de00bcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 -- 172.21.15.98:0/4029988406 >> 172.21.15.98:0/4029988406 conn(0x7f2de00c3710 msgr2=0x7f2de00c3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 -- 172.21.15.98:0/4029988406 shutdown_connections 2023-08-22T00:45:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.536+0000 7f2de5c55700 1 -- 172.21.15.98:0/4029988406 wait complete. 2023-08-22T00:45:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.537+0000 7f2de5c55700 1 Processor -- start 2023-08-22T00:45:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.537+0000 7f2de5c55700 1 -- start start 2023-08-22T00:45:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de0066da0 0x7f2de01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 0x7f2de014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0151c50 con 0x7f2de00653d0 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0160ce0 con 0x7f2de0150340 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2de5c55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de01513b0 con 0x7f2de0066da0 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2ddf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.545 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2ddf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42614/0 (socket says 172.21.15.98:42614) 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2ddf7fe700 1 -- 172.21.15.98:0/1387746536 learned_addr learned my addr 172.21.15.98:0/1387746536 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2ddeffd700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de0066da0 0x7f2de01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.538+0000 7f2ddffff700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 0x7f2de014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 -- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de0066da0 msgr2=0x7f2de01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de0066da0 0x7f2de01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 -- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 msgr2=0x7f2de014e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 0x7f2de014e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 -- 172.21.15.98:0/1387746536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd800bcf0 con 0x7f2de00653d0 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddffff700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 0x7f2de014e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2ddf7fe700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f2dc800d890 tx=0x7f2dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011590 con 0x7f2de00653d0 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc80116f0 con 0x7f2de00653d0 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de0151690 con 0x7f2de00653d0 2023-08-22T00:45:01.547 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011a70 con 0x7f2de00653d0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.539+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de0143ec0 con 0x7f2de00653d0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.540+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de0160fc0 con 0x7f2de00653d0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.540+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2dc8012420 con 0x7f2de00653d0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.540+0000 7f2dd77fe700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 0x7f2dc00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.540+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2dc8079960 con 0x7f2de00653d0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.541+0000 7f2ddeffd700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 0x7f2dc00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.541+0000 7f2ddeffd700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 0x7f2dc00613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2de014f6e0 tx=0x7f2dd0008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.549 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.544+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2dc804ab90 con 0x7f2de00653d0 2023-08-22T00:45:01.707 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.706+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2de0160ab0 con 0x7f2dc005ef30 2023-08-22T00:45:01.708 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.707+0000 7f2dd77fe700 1 -- 172.21.15.98:0/1387746536 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2de0160ab0 con 0x7f2dc005ef30 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 msgr2=0x7f2dc00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 0x7f2dc00613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2de014f6e0 tx=0x7f2dd0008040).stop 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 msgr2=0x7f2de01439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f2dc800d890 tx=0x7f2dc8008040).stop 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 shutdown_connections 2023-08-22T00:45:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f2dc005ef30 0x7f2dc00613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2de0150340 0x7f2de014e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de00653d0 0x7f2de01439d0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 --2- 172.21.15.98:0/1387746536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2de0066da0 0x7f2de01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.708+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 >> 172.21.15.98:0/1387746536 conn(0x7f2de00c3710 msgr2=0x7f2de00693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.709+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 shutdown_connections 2023-08-22T00:45:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.709+0000 7f2de5c55700 1 -- 172.21.15.98:0/1387746536 wait complete. 2023-08-22T00:45:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 2 to deep-scrub 2023-08-22T00:45:01.721 INFO:tasks.ceph:Scrubbing osd.3 2023-08-22T00:45:01.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:01.847 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.840+0000 7f817df2b700 1 Processor -- start 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 -- start start 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8178151ae0 0x7f8178151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81780c7b50 0x7f81780c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81780c76c0 con 0x7f81780c3f30 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780c86f0 con 0x7f81780c7b50 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.841+0000 7f817df2b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780c3720 con 0x7f8178151ae0 2023-08-22T00:45:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81780c7b50 0x7f81780c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f81780c7b50 0x7f81780c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42626/0 (socket says 172.21.15.98:42626) 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 -- 172.21.15.98:0/2184696629 learned_addr learned my addr 172.21.15.98:0/2184696629 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f81777fe700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8178151ae0 0x7f8178151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 -- 172.21.15.98:0/2184696629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8178151ae0 msgr2=0x7f8178151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8178151ae0 0x7f8178151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 -- 172.21.15.98:0/2184696629 >> v1:172.21.15.118:6789/0 conn(0x7f81780c3f30 legacy=0x7f81780688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 -- 172.21.15.98:0/2184696629 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780c3440 con 0x7f81780c7b50 2023-08-22T00:45:01.849 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f8176ffd700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f81780c3a40 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f8168006fd0 tx=0x7f81680090f0).ready entity=mon.0 client_cookie=9ec922b152e74a3a server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f81767fc700 1 -- 172.21.15.98:0/2184696629 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800b600 con 0x7f81780c7b50 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f81767fc700 1 -- 172.21.15.98:0/2184696629 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800b760 con 0x7f81780c7b50 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.842+0000 7f81767fc700 1 -- 172.21.15.98:0/2184696629 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800bb00 con 0x7f81780c7b50 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 -- 172.21.15.98:0/2184696629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 msgr2=0x7f81780c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f81780c3a40 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f8168006fd0 tx=0x7f81680090f0).stop 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 -- 172.21.15.98:0/2184696629 shutdown_connections 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8178151ae0 0x7f8178151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.850 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 --2- 172.21.15.98:0/2184696629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f81780c3a40 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 -- 172.21.15.98:0/2184696629 >> 172.21.15.98:0/2184696629 conn(0x7f81780c9490 msgr2=0x7f81780c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 -- 172.21.15.98:0/2184696629 shutdown_connections 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.843+0000 7f817df2b700 1 -- 172.21.15.98:0/2184696629 wait complete. 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.844+0000 7f817df2b700 1 Processor -- start 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.844+0000 7f817df2b700 1 -- start start 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81780c3f30 0x7f817814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f8178164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8178151ae0 0x7f8178165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178165730 con 0x7f81780c7b50 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817814e2a0 con 0x7f8178151ae0 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817814e580 con 0x7f81780c3f30 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f8178164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f8178164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42628/0 (socket says 172.21.15.98:42628) 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 -- 172.21.15.98:0/1595016275 learned_addr learned my addr 172.21.15.98:0/1595016275 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.852 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f81777fe700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81780c3f30 0x7f817814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8177fff700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8178151ae0 0x7f8178165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 -- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81780c3f30 msgr2=0x7f817814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81780c3f30 0x7f817814d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 -- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8178151ae0 msgr2=0x7f8178165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8178151ae0 0x7f8178165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009370 con 0x7f81780c7b50 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8177fff700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8178151ae0 0x7f8178165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:45:01.853 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f8176ffd700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f8178164d50 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f817806a330 tx=0x7f8168017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800bec0 con 0x7f81780c7b50 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800b8d0 con 0x7f81780c7b50 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.845+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817814e860 con 0x7f81780c7b50 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.846+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168024470 con 0x7f81780c7b50 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.846+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817814de20 con 0x7f81780c7b50 2023-08-22T00:45:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.846+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f817814e040 con 0x7f81780c7b50 2023-08-22T00:45:01.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8168021070 con 0x7f81780c7b50 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f816405ef30 0x7f81640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f816807bcd0 con 0x7f81780c7b50 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f81777fe700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f816405ef30 0x7f81640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f8164065ef0 0x7f8164068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8164068a10 con 0x7f8164065ef0 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.847+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816807c0b0 con 0x7f81780c7b50 2023-08-22T00:45:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.848+0000 7f8177fff700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f8164065ef0 0x7f8164068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.848+0000 7f81777fe700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f816405ef30 0x7f81640613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f81780abb70 tx=0x7f816c008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.848+0000 7f8177fff700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f8164065ef0 0x7f8164068390 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.848+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== osd.3 v2:172.21.15.98:6824/118512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8164068a10 con 0x7f8164065ef0 2023-08-22T00:45:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.861+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 --> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8178047480 con 0x7f8164065ef0 2023-08-22T00:45:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f815f7fe700 1 -- 172.21.15.98:0/1595016275 <== osd.3 v2:172.21.15.98:6824/118512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8178047480 con 0x7f8164065ef0 2023-08-22T00:45:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:01.864 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:01.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f8164065ef0 msgr2=0x7f8164068390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6824/118512,v1:172.21.15.98:6825/118512] conn(0x7f8164065ef0 0x7f8164068390 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f816405ef30 msgr2=0x7f81640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f816405ef30 0x7f81640613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f81780abb70 tx=0x7f816c008040).stop 2023-08-22T00:45:01.865 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 msgr2=0x7f8178164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 --2- 172.21.15.98:0/1595016275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81780c7b50 0x7f8178164d50 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f817806a330 tx=0x7f8168017000).stop 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f8177fff700 1 -- 172.21.15.98:0/1595016275 reap_dead start 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 shutdown_connections 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 >> 172.21.15.98:0/1595016275 conn(0x7f81780c9490 msgr2=0x7f81780aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 shutdown_connections 2023-08-22T00:45:01.866 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.862+0000 7f817df2b700 1 -- 172.21.15.98:0/1595016275 wait complete. 2023-08-22T00:45:01.874 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-22T00:45:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.990+0000 7f75a1e07700 1 Processor -- start 2023-08-22T00:45:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.990+0000 7f75a1e07700 1 -- start start 2023-08-22T00:45:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f75a1e07700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f759c0c3e90 0x7f759c062ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f75a1e07700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f759c154900 0x7f759c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f75a1e07700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c153760 con 0x7f759c0a5d40 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f75a1e07700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0a6ba0 con 0x7f759c0c3e90 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f75a1e07700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0a8d20 con 0x7f759c154900 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f759c0c3e90 0x7f759c062ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f759c0c3e90 0x7f759c062ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42630/0 (socket says 172.21.15.98:42630) 2023-08-22T00:45:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 -- 172.21.15.98:0/3676857238 learned_addr learned my addr 172.21.15.98:0/3676857238 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759bfff700 1 --2- 172.21.15.98:0/3676857238 >> v2:172.21.15.118:3300/0 conn(0x7f759c154900 0x7f759c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 -- 172.21.15.98:0/3676857238 >> v2:172.21.15.118:3300/0 conn(0x7f759c154900 msgr2=0x7f759c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 --2- 172.21.15.98:0/3676857238 >> v2:172.21.15.118:3300/0 conn(0x7f759c154900 0x7f759c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 -- 172.21.15.98:0/3676857238 >> v1:172.21.15.118:6789/0 conn(0x7f759c0a5d40 legacy=0x7f759c0625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 -- 172.21.15.98:0/3676857238 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0651d0 con 0x7f759c0c3e90 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759affd700 1 --2- 172.21.15.98:0/3676857238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c0c3e90 0x7f759c062ce0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f759c0ba320 tx=0x7f758c0090f0).ready entity=mon.0 client_cookie=9c8a10f76699fa28 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:01.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759a7fc700 1 -- 172.21.15.98:0/3676857238 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00b5a0 con 0x7f759c0c3e90 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759a7fc700 1 -- 172.21.15.98:0/3676857238 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00b700 con 0x7f759c0c3e90 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.991+0000 7f759a7fc700 1 -- 172.21.15.98:0/3676857238 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00ba80 con 0x7f759c0c3e90 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 -- 172.21.15.98:0/3676857238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c0c3e90 msgr2=0x7f759c062ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 --2- 172.21.15.98:0/3676857238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c0c3e90 0x7f759c062ce0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f759c0ba320 tx=0x7f758c0090f0).stop 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 -- 172.21.15.98:0/3676857238 shutdown_connections 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 --2- 172.21.15.98:0/3676857238 >> v2:172.21.15.118:3300/0 conn(0x7f759c154900 0x7f759c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 --2- 172.21.15.98:0/3676857238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c0c3e90 0x7f759c062ce0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 -- 172.21.15.98:0/3676857238 >> 172.21.15.98:0/3676857238 conn(0x7f759c0c7300 msgr2=0x7f759c0c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 -- 172.21.15.98:0/3676857238 shutdown_connections 2023-08-22T00:45:01.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.992+0000 7f75a1e07700 1 -- 172.21.15.98:0/3676857238 wait complete. 2023-08-22T00:45:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.993+0000 7f75a1e07700 1 Processor -- start 2023-08-22T00:45:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.993+0000 7f75a1e07700 1 -- start start 2023-08-22T00:45:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f759c0a5d40 0x7f759c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f759c0c3e90 0x7f759c144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0bd5f0 con 0x7f759c154900 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0c0910 con 0x7f759c0a5d40 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f75a1e07700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0bd160 con 0x7f759c0c3e90 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f759bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f759bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42640/0 (socket says 172.21.15.98:42640) 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f759bfff700 1 -- 172.21.15.98:0/1492270744 learned_addr learned my addr 172.21.15.98:0/1492270744 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.001 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f759b7fe700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f759c0a5d40 0x7f759c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.994+0000 7f759affd700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f759c0c3e90 0x7f759c144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 -- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f759c0c3e90 msgr2=0x7f759c144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f759c0c3e90 0x7f759c144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 -- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f759c0a5d40 msgr2=0x7f759c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f759c0a5d40 0x7f759c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 -- 172.21.15.98:0/1492270744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009370 con 0x7f759c154900 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f759bfff700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7594009fa0 tx=0x7f7594009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.002 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400ebc0 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400ed20 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c0ba750 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594014610 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.995+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c0bcdf0 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.996+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c0bc970 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.996+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f759401d3b0 con 0x7f759c154900 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.997+0000 7f75837fe700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 0x7f75880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.003 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.997+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f759407a480 con 0x7f759c154900 2023-08-22T00:45:02.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.997+0000 7f759b7fe700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 0x7f75880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:01.997+0000 7f759b7fe700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 0x7f75880613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f759c065b00 tx=0x7f7590008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.004 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.001+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f759c0bc970 con 0x7f759c154900 2023-08-22T00:45:02.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.164+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f759c0bc970 con 0x7f758805ef30 2023-08-22T00:45:02.165 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.164+0000 7f75837fe700 1 -- 172.21.15.98:0/1492270744 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f759c0bc970 con 0x7f758805ef30 2023-08-22T00:45:02.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 msgr2=0x7f75880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 0x7f75880613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f759c065b00 tx=0x7f7590008040).stop 2023-08-22T00:45:02.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 msgr2=0x7f759c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.167 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7594009fa0 tx=0x7f7594009900).stop 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 shutdown_connections 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f758805ef30 0x7f75880613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f759c154900 0x7f759c1515a0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f759c0a5d40 0x7f759c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 --2- 172.21.15.98:0/1492270744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f759c0c3e90 0x7f759c144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 >> 172.21.15.98:0/1492270744 conn(0x7f759c0c7300 msgr2=0x7f759c154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 shutdown_connections 2023-08-22T00:45:02.168 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.166+0000 7f75a1e07700 1 -- 172.21.15.98:0/1492270744 wait complete. 2023-08-22T00:45:02.169 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 3 to deep-scrub 2023-08-22T00:45:02.179 INFO:tasks.ceph:Scrubbing osd.4 2023-08-22T00:45:02.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:02.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.299+0000 7fe63e249700 1 Processor -- start 2023-08-22T00:45:02.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 -- start start 2023-08-22T00:45:02.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe638154920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6380c4380 0x7fe6380c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe638151860 con 0x7fe638150460 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638154e10 con 0x7fe6380c4380 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.300+0000 7fe63e249700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380c1ef0 con 0x7fe638150080 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6380c4380 0x7fe6380c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6380c4380 0x7fe6380c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42642/0 (socket says 172.21.15.98:42642) 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe637fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe638150460 0x7fe6380c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33960/0 (socket says 172.21.15.98:33960) 2023-08-22T00:45:02.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 -- 172.21.15.98:0/3987963006 learned_addr learned my addr 172.21.15.98:0/3987963006 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe6377fe700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe638154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 -- 172.21.15.98:0/3987963006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 msgr2=0x7fe638154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe638154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 -- 172.21.15.98:0/3987963006 >> v1:172.21.15.98:6789/0 conn(0x7fe638150460 legacy=0x7fe6380c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 -- 172.21.15.98:0/3987963006 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638150fc0 con 0x7fe6380c4380 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe6367fc700 1 -- 172.21.15.98:0/3987963006 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157371518 0 0) 0x7fe638151860 con 0x7fe638150460 2023-08-22T00:45:02.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe636ffd700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6380c4380 0x7fe6380c4800 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7fe628006fd0 tx=0x7fe62800a160).ready entity=mon.0 client_cookie=f2bc1b0dec3bc72b server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe6367fc700 1 -- 172.21.15.98:0/3987963006 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800f240 con 0x7fe6380c4380 2023-08-22T00:45:02.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe6367fc700 1 -- 172.21.15.98:0/3987963006 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62800f3a0 con 0x7fe6380c4380 2023-08-22T00:45:02.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.301+0000 7fe6367fc700 1 -- 172.21.15.98:0/3987963006 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800e770 con 0x7fe6380c4380 2023-08-22T00:45:02.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 -- 172.21.15.98:0/3987963006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6380c4380 msgr2=0x7fe6380c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6380c4380 0x7fe6380c4800 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7fe628006fd0 tx=0x7fe62800a160).stop 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 -- 172.21.15.98:0/3987963006 shutdown_connections 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe638154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 --2- 172.21.15.98:0/3987963006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6380c4380 0x7fe6380c4800 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 -- 172.21.15.98:0/3987963006 >> 172.21.15.98:0/3987963006 conn(0x7fe6380c7250 msgr2=0x7fe6380c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 -- 172.21.15.98:0/3987963006 shutdown_connections 2023-08-22T00:45:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.302+0000 7fe63e249700 1 -- 172.21.15.98:0/3987963006 wait complete. 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.303+0000 7fe63e249700 1 Processor -- start 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.303+0000 7fe63e249700 1 -- start start 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6380c4380 0x7fe638157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe63813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 0x7fe6380bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814e040 con 0x7fe638150460 2023-08-22T00:45:02.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814be40 con 0x7fe6380c4380 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.304+0000 7fe63e249700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381580e0 con 0x7fe638150080 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 0x7fe6380bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 0x7fe6380bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42650/0 (socket says 172.21.15.98:42650) 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 -- 172.21.15.98:0/1682955579 learned_addr learned my addr 172.21.15.98:0/1682955579 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe636ffd700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe63813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe6377fe700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6380c4380 0x7fe638157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 -- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 msgr2=0x7fe63813d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe638150080 0x7fe63813d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 -- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6380c4380 msgr2=0x7fe638157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6380c4380 0x7fe638157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62800f800 con 0x7fe638150460 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe637fff700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 0x7fe6380bd8a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7fe63000c760 tx=0x7fe630001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630005c70 con 0x7fe638150460 2023-08-22T00:45:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630005dd0 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63814b5c0 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630007340 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.305+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63814bb60 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.306+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe638047480 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.306+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe6300076f0 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe62f7fe700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe61805ef60 0x7fe618061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fe63007a080 con 0x7fe638150460 2023-08-22T00:45:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe6377fe700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe61805ef60 0x7fe618061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe62f7fe700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7fe618065fa0 0x7fe618068440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe618068ac0 con 0x7fe618065fa0 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63007c500 con 0x7fe638150460 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe6377fe700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe61805ef60 0x7fe618061420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe620009200 tx=0x7fe620008040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe636ffd700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7fe618065fa0 0x7fe618068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.307+0000 7fe636ffd700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7fe618065fa0 0x7fe618068440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.315 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.308+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== osd.4 v2:172.21.15.118:6816/118777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe618068ac0 con 0x7fe618065fa0 2023-08-22T00:45:02.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.321+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 --> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe6381512a0 con 0x7fe618065fa0 2023-08-22T00:45:02.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.321+0000 7fe62f7fe700 1 -- 172.21.15.98:0/1682955579 <== osd.4 v2:172.21.15.118:6816/118777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe6381512a0 con 0x7fe618065fa0 2023-08-22T00:45:02.323 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:02.323 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:02.323 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:02.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7fe618065fa0 msgr2=0x7fe618068440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.324 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.118:6816/118777,v1:172.21.15.118:6818/118777] conn(0x7fe618065fa0 0x7fe618068440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe61805ef60 msgr2=0x7fe618061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe61805ef60 0x7fe618061420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe620009200 tx=0x7fe620008040).stop 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 msgr2=0x7fe6380bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 --2- 172.21.15.98:0/1682955579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe638150460 0x7fe6380bd8a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7fe63000c760 tx=0x7fe630001520).stop 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe637fff700 1 -- 172.21.15.98:0/1682955579 reap_dead start 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 shutdown_connections 2023-08-22T00:45:02.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 >> 172.21.15.98:0/1682955579 conn(0x7fe6380c7250 msgr2=0x7fe6380c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 shutdown_connections 2023-08-22T00:45:02.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.322+0000 7fe63e249700 1 -- 172.21.15.98:0/1682955579 wait complete. 2023-08-22T00:45:02.334 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-22T00:45:02.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.449+0000 7f7b62dd7700 1 Processor -- start 2023-08-22T00:45:02.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 -- start start 2023-08-22T00:45:02.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad170 0x7f7b5c062fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7b5c0ad550 0x7f7b5c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0635c0 con 0x7f7b5c154310 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0c8d60 con 0x7f7b5c0ad550 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.450+0000 7f7b62dd7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0638a0 con 0x7f7b5c0ad170 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7b5c0ad550 0x7f7b5c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b61374700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7b5c154310 0x7f7b5c154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33966/0 (socket says 172.21.15.98:33966) 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b61374700 1 -- 172.21.15.98:0/3843612862 learned_addr learned my addr 172.21.15.98:0/3843612862 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b60b73700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad170 0x7f7b5c062fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 -- 172.21.15.98:0/3843612862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad170 msgr2=0x7f7b5c062fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:02.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad170 0x7f7b5c062fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.455 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 -- 172.21.15.98:0/3843612862 >> v1:172.21.15.98:6789/0 conn(0x7f7b5c154310 legacy=0x7f7b5c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 -- 172.21.15.98:0/3843612862 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c063b80 con 0x7f7b5c0ad550 2023-08-22T00:45:02.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5b7fe700 1 -- 172.21.15.98:0/3843612862 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516146695 0 0) 0x7f7b5c0635c0 con 0x7f7b5c154310 2023-08-22T00:45:02.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad550 0x7f7b5c0c5dd0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f7b48009760 tx=0x7f7b48009060).ready entity=mon.0 client_cookie=e21375ca4eea246c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5b7fe700 1 -- 172.21.15.98:0/3843612862 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b480090d0 con 0x7f7b5c0ad550 2023-08-22T00:45:02.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5b7fe700 1 -- 172.21.15.98:0/3843612862 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800f510 con 0x7f7b5c0ad550 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.451+0000 7f7b5b7fe700 1 -- 172.21.15.98:0/3843612862 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800f890 con 0x7f7b5c0ad550 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3843612862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad550 msgr2=0x7f7b5c0c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad550 0x7f7b5c0c5dd0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f7b48009760 tx=0x7f7b48009060).stop 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3843612862 shutdown_connections 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad170 0x7f7b5c062fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3843612862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad550 0x7f7b5c0c5dd0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3843612862 >> 172.21.15.98:0/3843612862 conn(0x7f7b5c081fe0 msgr2=0x7f7b5c0823f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3843612862 shutdown_connections 2023-08-22T00:45:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.452+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3843612862 wait complete. 2023-08-22T00:45:02.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.453+0000 7f7b62dd7700 1 Processor -- start 2023-08-22T00:45:02.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.453+0000 7f7b62dd7700 1 -- start start 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 0x7f7b5c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 0x7f7b5c0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0af8b0 con 0x7f7b5c0ad170 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0afb90 con 0x7f7b5c154310 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0afe70 con 0x7f7b5c0ad550 2023-08-22T00:45:02.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42670/0 (socket says 172.21.15.98:42670) 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 -- 172.21.15.98:0/3688663553 learned_addr learned my addr 172.21.15.98:0/3688663553 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b61374700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 0x7f7b5c0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 0x7f7b5c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 -- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 msgr2=0x7f7b5c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 0x7f7b5c0aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.462 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 -- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 msgr2=0x7f7b5c0af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 0x7f7b5c0af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 -- 172.21.15.98:0/3688663553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480092a0 con 0x7f7b5c0ad170 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b61374700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 0x7f7b5c0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 0x7f7b5c0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b60b73700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f7b5000e900 tx=0x7f7b50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000c640 con 0x7f7b5c0ad170 2023-08-22T00:45:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000c7a0 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c0b0150 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.454+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000cb20 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.455+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c0af540 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c0b0670 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7b5001b400 con 0x7f7b5c0ad170 2023-08-22T00:45:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b58ff9700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 0x7f7b400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f7b5007a440 con 0x7f7b5c0ad170 2023-08-22T00:45:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 0x7f7b400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.456+0000 7f7b5bfff700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 0x7f7b400613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7b5c083ea0 tx=0x7f7b48017000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.460+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b5c0b0670 con 0x7f7b5c0ad170 2023-08-22T00:45:02.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.624+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b5c047480 con 0x7f7b4005ef30 2023-08-22T00:45:02.625 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.624+0000 7f7b58ff9700 1 -- 172.21.15.98:0/3688663553 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b5c047480 con 0x7f7b4005ef30 2023-08-22T00:45:02.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 msgr2=0x7f7b400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 0x7f7b400613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7b5c083ea0 tx=0x7f7b48017000).stop 2023-08-22T00:45:02.627 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 msgr2=0x7f7b5c144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f7b5000e900 tx=0x7f7b50009060).stop 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 shutdown_connections 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f7b4005ef30 0x7f7b400613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b5c154310 0x7f7b5c0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b5c0ad170 0x7f7b5c144ae0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 --2- 172.21.15.98:0/3688663553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b5c0ad550 0x7f7b5c0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.628 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 >> 172.21.15.98:0/3688663553 conn(0x7f7b5c081fe0 msgr2=0x7f7b5c1527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 shutdown_connections 2023-08-22T00:45:02.629 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.626+0000 7f7b62dd7700 1 -- 172.21.15.98:0/3688663553 wait complete. 2023-08-22T00:45:02.629 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 4 to deep-scrub 2023-08-22T00:45:02.639 INFO:tasks.ceph:Scrubbing osd.5 2023-08-22T00:45:02.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.758+0000 7f68c74fa700 1 Processor -- start 2023-08-22T00:45:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.758+0000 7f68c74fa700 1 -- start start 2023-08-22T00:45:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c74fa700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68c0153a30 0x7f68c0153e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c74fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68c00688c0 0x7f68c0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c74fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c0069240 con 0x7f68c00c7700 2023-08-22T00:45:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c74fa700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00c6660 con 0x7f68c0153a30 2023-08-22T00:45:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c74fa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00c6940 con 0x7f68c00688c0 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68c0153a30 0x7f68c0153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68c0153a30 0x7f68c0153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42676/0 (socket says 172.21.15.98:42676) 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 -- 172.21.15.98:0/3002970418 learned_addr learned my addr 172.21.15.98:0/3002970418 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5a97700 1 --2- 172.21.15.98:0/3002970418 >> v2:172.21.15.118:3300/0 conn(0x7f68c00688c0 0x7f68c0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 -- 172.21.15.98:0/3002970418 >> v2:172.21.15.118:3300/0 conn(0x7f68c00688c0 msgr2=0x7f68c0068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 --2- 172.21.15.98:0/3002970418 >> v2:172.21.15.118:3300/0 conn(0x7f68c00688c0 0x7f68c0068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 -- 172.21.15.98:0/3002970418 >> v1:172.21.15.118:6789/0 conn(0x7f68c00c7700 legacy=0x7f68c00c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 -- 172.21.15.98:0/3002970418 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00c6c20 con 0x7f68c0153a30 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68c5296700 1 --2- 172.21.15.98:0/3002970418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c0153e10 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f68c00c8350 tx=0x7f68bc0090f0).ready entity=mon.0 client_cookie=3c024ac604edb016 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68b3fff700 1 -- 172.21.15.98:0/3002970418 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00b5a0 con 0x7f68c0153a30 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68b3fff700 1 -- 172.21.15.98:0/3002970418 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00b700 con 0x7f68c0153a30 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.759+0000 7f68b3fff700 1 -- 172.21.15.98:0/3002970418 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00ba80 con 0x7f68c0153a30 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 -- 172.21.15.98:0/3002970418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 msgr2=0x7f68c0153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 --2- 172.21.15.98:0/3002970418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c0153e10 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f68c00c8350 tx=0x7f68bc0090f0).stop 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 -- 172.21.15.98:0/3002970418 shutdown_connections 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 --2- 172.21.15.98:0/3002970418 >> v2:172.21.15.118:3300/0 conn(0x7f68c00688c0 0x7f68c0068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 --2- 172.21.15.98:0/3002970418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c0153e10 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 -- 172.21.15.98:0/3002970418 >> 172.21.15.98:0/3002970418 conn(0x7f68c00c9420 msgr2=0x7f68c00c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 -- 172.21.15.98:0/3002970418 shutdown_connections 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.760+0000 7f68c74fa700 1 -- 172.21.15.98:0/3002970418 wait complete. 2023-08-22T00:45:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.761+0000 7f68c74fa700 1 Processor -- start 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.761+0000 7f68c74fa700 1 -- start start 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68c00688c0 0x7f68c014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68c00c7700 0x7f68c00c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c00a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0151420 con 0x7f68c0153a30 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0164310 con 0x7f68c00688c0 2023-08-22T00:45:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c74fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0164550 con 0x7f68c00c7700 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c5a97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c00a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c5a97700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c00a7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42684/0 (socket says 172.21.15.98:42684) 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c5a97700 1 -- 172.21.15.98:0/1409971413 learned_addr learned my addr 172.21.15.98:0/1409971413 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c5296700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68c00688c0 0x7f68c014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c4a95700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68c00c7700 0x7f68c00c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.762+0000 7f68c5a97700 1 -- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68c00c7700 msgr2=0x7f68c00c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c5a97700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68c00c7700 0x7f68c00c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c5a97700 1 -- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68c00688c0 msgr2=0x7f68c014f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c5a97700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68c00688c0 0x7f68c014f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c5a97700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009370 con 0x7f68c0153a30 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c5a97700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c00a7e00 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f68b800cde0 tx=0x7f68b80077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800a970 con 0x7f68c0153a30 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800aad0 con 0x7f68c0153a30 2023-08-22T00:45:02.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c014f550 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800ae50 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.763+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c01647c0 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.764+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68c00aea20 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.764+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f68b800d040 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.764+0000 7f68b17fa700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f68a405ef30 0x7f68a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.764+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f68b807a0d0 con 0x7f68c0153a30 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68c5296700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f68a405ef30 0x7f68a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68b17fa700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7f68a4065f70 0x7f68a4068410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a4068a90 con 0x7f68a4065f70 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68b807c5b0 con 0x7f68c0153a30 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68c5296700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f68a405ef30 0x7f68a40613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f68bc009130 tx=0x7f68bc015000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68c4a95700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7f68a4065f70 0x7f68a4068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.765+0000 7f68c4a95700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7f68a4065f70 0x7f68a4068410 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.766+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== osd.5 v2:172.21.15.118:6817/118771 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f68a4068a90 con 0x7f68a4065f70 2023-08-22T00:45:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.779+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 --> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68c0047480 con 0x7f68a4065f70 2023-08-22T00:45:02.780 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.779+0000 7f68b17fa700 1 -- 172.21.15.98:0/1409971413 <== osd.5 v2:172.21.15.118:6817/118771 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f68c0047480 con 0x7f68a4065f70 2023-08-22T00:45:02.783 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:02.784 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:02.785 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7f68a4065f70 msgr2=0x7f68a4068410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.118:6817/118771,v1:172.21.15.118:6819/118771] conn(0x7f68a4065f70 0x7f68a4068410 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f68a405ef30 msgr2=0x7f68a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f68a405ef30 0x7f68a40613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f68bc009130 tx=0x7f68bc015000).stop 2023-08-22T00:45:02.786 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 msgr2=0x7f68c00a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 --2- 172.21.15.98:0/1409971413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c0153a30 0x7f68c00a7e00 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f68b800cde0 tx=0x7f68b80077d0).stop 2023-08-22T00:45:02.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c5a97700 1 -- 172.21.15.98:0/1409971413 reap_dead start 2023-08-22T00:45:02.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 shutdown_connections 2023-08-22T00:45:02.787 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 >> 172.21.15.98:0/1409971413 conn(0x7f68c00c9420 msgr2=0x7f68c0065410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 shutdown_connections 2023-08-22T00:45:02.788 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.780+0000 7f68c74fa700 1 -- 172.21.15.98:0/1409971413 wait complete. 2023-08-22T00:45:02.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-22T00:45:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.910+0000 7ff884204700 1 Processor -- start 2023-08-22T00:45:02.912 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.910+0000 7ff884204700 1 -- start start 2023-08-22T00:45:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff884204700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff884204700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c0bd070 con 0x7ff87c0bc890 2023-08-22T00:45:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff884204700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c0c5fb0 con 0x7ff87c065690 2023-08-22T00:45:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff884204700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0bdd80 con 0x7ff87c13a3b0 2023-08-22T00:45:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff88179f700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff87c0bc890 0x7ff87c064f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33976/0 (socket says 172.21.15.98:33976) 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.911+0000 7ff88179f700 1 -- 172.21.15.98:0/1006913151 learned_addr learned my addr 172.21.15.98:0/1006913151 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff881fa0700 1 --2- 172.21.15.98:0/1006913151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745404825 0 0) 0x7ff87c0bd070 con 0x7ff87c0bc890 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8680033f0 con 0x7ff87c0bc890 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff881fa0700 1 -- 172.21.15.98:0/1006913151 >> v1:172.21.15.118:6789/0 conn(0x7ff87c065690 legacy=0x7ff87c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672620872 0 0) 0x7ff87c0c5fb0 con 0x7ff87c065690 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff881fa0700 1 -- 172.21.15.98:0/1006913151 >> v1:172.21.15.98:6789/0 conn(0x7ff87c0bc890 legacy=0x7ff87c064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff881fa0700 1 -- 172.21.15.98:0/1006913151 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c158990 con 0x7ff87c13a3b0 2023-08-22T00:45:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff881fa0700 1 --2- 172.21.15.98:0/1006913151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c1584a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff86c009760 tx=0x7ff86c006f40).ready entity=mon.2 client_cookie=5aa80996b17c6e3d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c005880 con 0x7ff87c13a3b0 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0059e0 con 0x7ff87c13a3b0 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.912+0000 7ff880f9e700 1 -- 172.21.15.98:0/1006913151 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c005d60 con 0x7ff87c13a3b0 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 -- 172.21.15.98:0/1006913151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 msgr2=0x7ff87c1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 --2- 172.21.15.98:0/1006913151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c1584a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff86c009760 tx=0x7ff86c006f40).stop 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 -- 172.21.15.98:0/1006913151 shutdown_connections 2023-08-22T00:45:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 --2- 172.21.15.98:0/1006913151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c1584a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 -- 172.21.15.98:0/1006913151 >> 172.21.15.98:0/1006913151 conn(0x7ff87c0c8400 msgr2=0x7ff87c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 -- 172.21.15.98:0/1006913151 shutdown_connections 2023-08-22T00:45:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.913+0000 7ff884204700 1 -- 172.21.15.98:0/1006913151 wait complete. 2023-08-22T00:45:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.914+0000 7ff884204700 1 Processor -- start 2023-08-22T00:45:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.914+0000 7ff884204700 1 -- start start 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 0x7ff87c067070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c13d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c067cc0 con 0x7ff87c065690 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c067560 con 0x7ff87c0bc890 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff884204700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c139010 con 0x7ff87c13a3b0 2023-08-22T00:45:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff881fa0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff881fa0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42700/0 (socket says 172.21.15.98:42700) 2023-08-22T00:45:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.915+0000 7ff881fa0700 1 -- 172.21.15.98:0/751918239 learned_addr learned my addr 172.21.15.98:0/751918239 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 -- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 msgr2=0x7ff87c13d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff88179f700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 0x7ff87c067070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff8827a1700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c13d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c13d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 -- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 msgr2=0x7ff87c067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 0x7ff87c067070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 -- 172.21.15.98:0/751918239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009250 con 0x7ff87c065690 2023-08-22T00:45:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff88179f700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 0x7ff87c067070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff881fa0700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7ff86c009e00 tx=0x7ff86c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c005d60 con 0x7ff87c065690 2023-08-22T00:45:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00f510 con 0x7ff87c065690 2023-08-22T00:45:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c0a98d0 con 0x7ff87c065690 2023-08-22T00:45:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00f8b0 con 0x7ff87c065690 2023-08-22T00:45:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.916+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c0a8fa0 con 0x7ff87c065690 2023-08-22T00:45:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.917+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c047480 con 0x7ff87c065690 2023-08-22T00:45:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.918+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff86c00fc60 con 0x7ff87c065690 2023-08-22T00:45:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.918+0000 7ff871ffb700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 0x7ff8600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.918+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7ff86c07b460 con 0x7ff87c065690 2023-08-22T00:45:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.918+0000 7ff88179f700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 0x7ff8600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.919+0000 7ff88179f700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 0x7ff8600613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff878005750 tx=0x7ff878009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:02.922+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff86c04c6f0 con 0x7ff87c065690 2023-08-22T00:45:03.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.083+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff87c0953f0 con 0x7ff86005ef30 2023-08-22T00:45:03.089 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.083+0000 7ff871ffb700 1 -- 172.21.15.98:0/751918239 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff87c0953f0 con 0x7ff86005ef30 2023-08-22T00:45:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 msgr2=0x7ff8600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 0x7ff8600613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff878005750 tx=0x7ff878009040).stop 2023-08-22T00:45:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 msgr2=0x7ff87c1391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7ff86c009e00 tx=0x7ff86c015000).stop 2023-08-22T00:45:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 shutdown_connections 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7ff86005ef30 0x7ff8600613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87c13a3b0 0x7ff87c13d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff87c065690 0x7ff87c1391e0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 --2- 172.21.15.98:0/751918239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87c0bc890 0x7ff87c067070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 >> 172.21.15.98:0/751918239 conn(0x7ff87c0c8400 msgr2=0x7ff87c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 shutdown_connections 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.085+0000 7ff884204700 1 -- 172.21.15.98:0/751918239 wait complete. 2023-08-22T00:45:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 5 to deep-scrub 2023-08-22T00:45:03.098 INFO:tasks.ceph:Scrubbing osd.6 2023-08-22T00:45:03.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:03.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.217+0000 7fa77a13c700 1 Processor -- start 2023-08-22T00:45:03.218 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.217+0000 7fa77a13c700 1 -- start start 2023-08-22T00:45:03.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa77a13c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774153c30 0x7fa774154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa77a13c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa774068fd0 0x7fa7740c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.220 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa77a13c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7740c45d0 con 0x7fa7740c34e0 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa77a13c700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa774155270 con 0x7fa774068fd0 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa77a13c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c39c0 con 0x7fa774153c30 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa774068fd0 0x7fa7740c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa774068fd0 0x7fa7740c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42704/0 (socket says 172.21.15.98:42704) 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 -- 172.21.15.98:0/287682119 learned_addr learned my addr 172.21.15.98:0/287682119 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 -- 172.21.15.98:0/287682119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774153c30 msgr2=0x7fa774154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 --2- 172.21.15.98:0/287682119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774153c30 0x7fa774154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:03.221 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 -- 172.21.15.98:0/287682119 >> v1:172.21.15.118:6789/0 conn(0x7fa7740c34e0 legacy=0x7fa7740688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 -- 172.21.15.98:0/287682119 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740c3ca0 con 0x7fa774068fd0 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa773fff700 1 --2- 172.21.15.98:0/287682119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774068fd0 0x7fa7740c65c0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fa76c009f20 tx=0x7fa76c009840).ready entity=mon.0 client_cookie=f28962ace938d7ed server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa7727fc700 1 -- 172.21.15.98:0/287682119 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00e070 con 0x7fa774068fd0 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa7727fc700 1 -- 172.21.15.98:0/287682119 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c00ba40 con 0x7fa774068fd0 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.218+0000 7fa7727fc700 1 -- 172.21.15.98:0/287682119 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00bdc0 con 0x7fa774068fd0 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 -- 172.21.15.98:0/287682119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774068fd0 msgr2=0x7fa7740c65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.222 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 --2- 172.21.15.98:0/287682119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774068fd0 0x7fa7740c65c0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fa76c009f20 tx=0x7fa76c009840).stop 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 -- 172.21.15.98:0/287682119 shutdown_connections 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 --2- 172.21.15.98:0/287682119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774068fd0 0x7fa7740c65c0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 --2- 172.21.15.98:0/287682119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774153c30 0x7fa774154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 -- 172.21.15.98:0/287682119 >> 172.21.15.98:0/287682119 conn(0x7fa7740c9490 msgr2=0x7fa7740c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 -- 172.21.15.98:0/287682119 shutdown_connections 2023-08-22T00:45:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.219+0000 7fa77a13c700 1 -- 172.21.15.98:0/287682119 wait complete. 2023-08-22T00:45:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.220+0000 7fa77a13c700 1 Processor -- start 2023-08-22T00:45:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.220+0000 7fa77a13c700 1 -- start start 2023-08-22T00:45:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774068fd0 0x7fa77414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7740c34e0 0x7fa7740bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 0x7fa774150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77414f0b0 con 0x7fa774153c30 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c1bd0 con 0x7fa7740c34e0 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa77a13c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c0dc0 con 0x7fa774068fd0 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa773fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 0x7fa774150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa773fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 0x7fa774150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42712/0 (socket says 172.21.15.98:42712) 2023-08-22T00:45:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa773fff700 1 -- 172.21.15.98:0/2705274664 learned_addr learned my addr 172.21.15.98:0/2705274664 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa7737fe700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774068fd0 0x7fa77414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa772ffd700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7740c34e0 0x7fa7740bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.221+0000 7fa773fff700 1 -- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774068fd0 msgr2=0x7fa77414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa773fff700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa774068fd0 0x7fa77414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa773fff700 1 -- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7740c34e0 msgr2=0x7fa7740bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa773fff700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7740c34e0 0x7fa7740bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa773fff700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009ae0 con 0x7fa774153c30 2023-08-22T00:45:03.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa773fff700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 0x7fa774150db0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7fa77406acf0 tx=0x7fa76c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00bdc0 con 0x7fa774153c30 2023-08-22T00:45:03.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0092e0 con 0x7fa774153c30 2023-08-22T00:45:03.231 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7740c0800 con 0x7fa774153c30 2023-08-22T00:45:03.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c01c650 con 0x7fa774153c30 2023-08-22T00:45:03.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.222+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7740c1860 con 0x7fa774153c30 2023-08-22T00:45:03.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.223+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa774047480 con 0x7fa774153c30 2023-08-22T00:45:03.232 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.223+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa76c01c9c0 con 0x7fa774153c30 2023-08-22T00:45:03.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.223+0000 7fa75b7fe700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa76005ef30 0x7fa7600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fa76c07b970 con 0x7fa774153c30 2023-08-22T00:45:03.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa7737fe700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa76005ef30 0x7fa7600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.233 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa75b7fe700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7fa760065ef0 0x7fa760068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa760068a10 con 0x7fa760065ef0 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa76c080240 con 0x7fa774153c30 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa7737fe700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa76005ef30 0x7fa7600613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa7740ab370 tx=0x7fa764009060).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa772ffd700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7fa760065ef0 0x7fa760068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.224+0000 7fa772ffd700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7fa760065ef0 0x7fa760068390 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.234 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.225+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== osd.6 v2:172.21.15.118:6800/118768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa760068a10 con 0x7fa760065ef0 2023-08-22T00:45:03.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.238+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 --> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa7740c3f80 con 0x7fa760065ef0 2023-08-22T00:45:03.239 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.238+0000 7fa75b7fe700 1 -- 172.21.15.98:0/2705274664 <== osd.6 v2:172.21.15.118:6800/118768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa7740c3f80 con 0x7fa760065ef0 2023-08-22T00:45:03.240 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:03.240 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:03.240 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:03.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7fa760065ef0 msgr2=0x7fa760068390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.241 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.118:6800/118768,v1:172.21.15.118:6801/118768] conn(0x7fa760065ef0 0x7fa760068390 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa76005ef30 msgr2=0x7fa7600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fa76005ef30 0x7fa7600613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa7740ab370 tx=0x7fa764009060).stop 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 msgr2=0x7fa774150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 --2- 172.21.15.98:0/2705274664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa774153c30 0x7fa774150db0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7fa77406acf0 tx=0x7fa76c009840).stop 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa773fff700 1 -- 172.21.15.98:0/2705274664 reap_dead start 2023-08-22T00:45:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 shutdown_connections 2023-08-22T00:45:03.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 >> 172.21.15.98:0/2705274664 conn(0x7fa7740c9490 msgr2=0x7fa774154010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 shutdown_connections 2023-08-22T00:45:03.243 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.239+0000 7fa77a13c700 1 -- 172.21.15.98:0/2705274664 wait complete. 2023-08-22T00:45:03.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-22T00:45:03.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.368+0000 7f48690ec700 1 Processor -- start 2023-08-22T00:45:03.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.368+0000 7f48690ec700 1 -- start start 2023-08-22T00:45:03.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f48690ec700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48640673a0 0x7f4864151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f48690ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 0x7f48641527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.372 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f48690ec700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48641534d0 con 0x7f4864151a40 2023-08-22T00:45:03.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f48690ec700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4864153a90 con 0x7f48640673a0 2023-08-22T00:45:03.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f48690ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4864152e30 con 0x7f4864152310 2023-08-22T00:45:03.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48640673a0 0x7f4864151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f48640673a0 0x7f4864151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42728/0 (socket says 172.21.15.98:42728) 2023-08-22T00:45:03.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 -- 172.21.15.98:0/2681250912 learned_addr learned my addr 172.21.15.98:0/2681250912 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486359e700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 0x7f48641527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.374 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 -- 172.21.15.98:0/2681250912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 msgr2=0x7f48641527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:03.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 0x7f48641527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 -- 172.21.15.98:0/2681250912 >> v1:172.21.15.118:6789/0 conn(0x7f4864151a40 legacy=0x7f4864066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:03.375 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 -- 172.21.15.98:0/2681250912 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864153110 con 0x7f48640673a0 2023-08-22T00:45:03.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486359e700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 0x7f48641527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:03.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f486259c700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48640673a0 0x7f4864151e20 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7f4854006fd0 tx=0x7f48540090f0).ready entity=mon.0 client_cookie=e92c57ba17b94b14 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.376 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f4861d9b700 1 -- 172.21.15.98:0/2681250912 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400b600 con 0x7f48640673a0 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f4861d9b700 1 -- 172.21.15.98:0/2681250912 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400b760 con 0x7f48640673a0 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.369+0000 7f4861d9b700 1 -- 172.21.15.98:0/2681250912 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400bae0 con 0x7f48640673a0 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 -- 172.21.15.98:0/2681250912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48640673a0 msgr2=0x7f4864151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48640673a0 0x7f4864151e20 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7f4854006fd0 tx=0x7f48540090f0).stop 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 -- 172.21.15.98:0/2681250912 shutdown_connections 2023-08-22T00:45:03.377 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864152310 0x7f48641527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 --2- 172.21.15.98:0/2681250912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48640673a0 0x7f4864151e20 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 -- 172.21.15.98:0/2681250912 >> 172.21.15.98:0/2681250912 conn(0x7f48640659a0 msgr2=0x7f4864065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 -- 172.21.15.98:0/2681250912 shutdown_connections 2023-08-22T00:45:03.378 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.370+0000 7f48690ec700 1 -- 172.21.15.98:0/2681250912 wait complete. 2023-08-22T00:45:03.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.371+0000 7f48690ec700 1 Processor -- start 2023-08-22T00:45:03.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.371+0000 7f48690ec700 1 -- start start 2023-08-22T00:45:03.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 0x7f48640aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 0x7f48640a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640abd80 con 0x7f4864152310 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640aa600 con 0x7f48640673a0 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f48690ec700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48640a49d0 con 0x7f4864151a40 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42738/0 (socket says 172.21.15.98:42738) 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 -- 172.21.15.98:0/1532991403 learned_addr learned my addr 172.21.15.98:0/1532991403 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.382 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486259c700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 0x7f48640a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f4862d9d700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 0x7f48640aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 -- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 msgr2=0x7f48640a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 0x7f48640a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 -- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 msgr2=0x7f48640aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 0x7f48640aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486359e700 1 -- 172.21.15.98:0/1532991403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009370 con 0x7f4864152310 2023-08-22T00:45:03.385 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f4862d9d700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 0x7f48640aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:03.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.372+0000 7f486259c700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 0x7f48640a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:03.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f486359e700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f485c00cef0 tx=0x7f485c007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c00ae00 con 0x7f4864152310 2023-08-22T00:45:03.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c016400 con 0x7f4864152310 2023-08-22T00:45:03.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48640abfb0 con 0x7f4864152310 2023-08-22T00:45:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c016780 con 0x7f4864152310 2023-08-22T00:45:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.373+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48640ac850 con 0x7f4864152310 2023-08-22T00:45:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.374+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48640ac3b0 con 0x7f4864152310 2023-08-22T00:45:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.374+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f485c0203f0 con 0x7f4864152310 2023-08-22T00:45:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.375+0000 7f484affd700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 0x7f48500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.375+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f485c07adf0 con 0x7f4864152310 2023-08-22T00:45:03.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.375+0000 7f4862d9d700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 0x7f48500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.375+0000 7f4862d9d700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 0x7f48500613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f48580026f0 tx=0x7f4858009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.378+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f485c04c0e0 con 0x7f4864152310 2023-08-22T00:45:03.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.537+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4864153720 con 0x7f485005ef30 2023-08-22T00:45:03.539 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.537+0000 7f484affd700 1 -- 172.21.15.98:0/1532991403 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4864153720 con 0x7f485005ef30 2023-08-22T00:45:03.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 msgr2=0x7f48500613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 0x7f48500613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f48580026f0 tx=0x7f4858009040).stop 2023-08-22T00:45:03.540 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 msgr2=0x7f4864140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f485c00cef0 tx=0x7f485c007860).stop 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 shutdown_connections 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f485005ef30 0x7f48500613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4864152310 0x7f4864140660 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48640673a0 0x7f48640aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 --2- 172.21.15.98:0/1532991403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4864151a40 0x7f48640a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.541 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 >> 172.21.15.98:0/1532991403 conn(0x7f48640659a0 msgr2=0x7f48640a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 shutdown_connections 2023-08-22T00:45:03.542 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.539+0000 7f48690ec700 1 -- 172.21.15.98:0/1532991403 wait complete. 2023-08-22T00:45:03.542 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 6 to deep-scrub 2023-08-22T00:45:03.552 INFO:tasks.ceph:Scrubbing osd.7 2023-08-22T00:45:03.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-22T00:45:03.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.673+0000 7effd5b96700 1 Processor -- start 2023-08-22T00:45:03.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.673+0000 7effd5b96700 1 -- start start 2023-08-22T00:45:03.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effd5b96700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7effd0153c40 0x7effd0154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effd5b96700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd00bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effd5b96700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd0063f10 con 0x7effd00c5a70 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effd5b96700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00c6230 con 0x7effd0153c40 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effd5b96700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd00638c0 con 0x7effd0158150 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7effd0153c40 0x7effd0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7effd0153c40 0x7effd0154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42750/0 (socket says 172.21.15.98:42750) 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 -- 172.21.15.98:0/1880417717 learned_addr learned my addr 172.21.15.98:0/1880417717 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effceffd700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7effd00c5a70 0x7effd0157a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33982/0 (socket says 172.21.15.98:33982) 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 -- 172.21.15.98:0/1880417717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 msgr2=0x7effd00bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcffff700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd00bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd00bfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effce7fc700 1 -- 172.21.15.98:0/1880417717 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914095061 0 0) 0x7effd0063f10 con 0x7effd00c5a70 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.674+0000 7effcf7fe700 1 -- 172.21.15.98:0/1880417717 >> v1:172.21.15.98:6789/0 conn(0x7effd00c5a70 legacy=0x7effd0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effcf7fe700 1 -- 172.21.15.98:0/1880417717 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0063ba0 con 0x7effd0153c40 2023-08-22T00:45:03.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effcf7fe700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd0153c40 0x7effd0154020 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7effc0006fd0 tx=0x7effc00090f0).ready entity=mon.0 client_cookie=a19e3cfc30f547d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effce7fc700 1 -- 172.21.15.98:0/1880417717 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000b600 con 0x7effd0153c40 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effce7fc700 1 -- 172.21.15.98:0/1880417717 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000b760 con 0x7effd0153c40 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effce7fc700 1 -- 172.21.15.98:0/1880417717 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000bae0 con 0x7effd0153c40 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 -- 172.21.15.98:0/1880417717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd0153c40 msgr2=0x7effd0154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd0153c40 0x7effd0154020 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7effc0006fd0 tx=0x7effc00090f0).stop 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 -- 172.21.15.98:0/1880417717 shutdown_connections 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd00bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 --2- 172.21.15.98:0/1880417717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd0153c40 0x7effd0154020 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 -- 172.21.15.98:0/1880417717 >> 172.21.15.98:0/1880417717 conn(0x7effd00c80c0 msgr2=0x7effd0081fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 -- 172.21.15.98:0/1880417717 shutdown_connections 2023-08-22T00:45:03.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.675+0000 7effd5b96700 1 -- 172.21.15.98:0/1880417717 wait complete. 2023-08-22T00:45:03.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 Processor -- start 2023-08-22T00:45:03.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 -- start start 2023-08-22T00:45:03.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 0x7effd01453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd0153c40 0x7effd0167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd0167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0168250 con 0x7effd00c5a70 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0156a10 con 0x7effd0153c40 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effd5b96700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd0164120 con 0x7effd0158150 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 0x7effd01453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 0x7effd01453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42752/0 (socket says 172.21.15.98:42752) 2023-08-22T00:45:03.683 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.677+0000 7effcf7fe700 1 -- 172.21.15.98:0/3443222178 learned_addr learned my addr 172.21.15.98:0/3443222178 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effceffd700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd0153c40 0x7effd0167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcffff700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd0167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 -- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 msgr2=0x7effd0167d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd0167d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 -- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd0153c40 msgr2=0x7effd0167870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd0153c40 0x7effd0167870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.684 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009370 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcffff700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd0158150 0x7effd0167d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effcf7fe700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 0x7effd01453e0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7effd0083ef0 tx=0x7effc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000bae0 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0000c90 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc001c650 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd0155e00 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.678+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd01563c0 con 0x7effd00c5a70 2023-08-22T00:45:03.685 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.679+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effd0047480 con 0x7effd00c5a70 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.679+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7effc001ca00 con 0x7effd00c5a70 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effc77fe700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7effb005ef30 0x7effb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7effc007be30 con 0x7effd00c5a70 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effceffd700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7effb005ef30 0x7effb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effc77fe700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7effb0065e70 0x7effb0068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effb0068990 con 0x7effb0065e70 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc007e460 con 0x7effd00c5a70 2023-08-22T00:45:03.686 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effcffff700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7effb0065e70 0x7effb0068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effceffd700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7effb005ef30 0x7effb00613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7effd01549f0 tx=0x7effb8007180).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.680+0000 7effcffff700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7effb0065e70 0x7effb0068310 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.687 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.681+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== osd.7 v2:172.21.15.118:6808/118770 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7effb0068990 con 0x7effb0065e70 2023-08-22T00:45:03.695 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.694+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 --> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effd0156cf0 con 0x7effb0065e70 2023-08-22T00:45:03.696 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effc77fe700 1 -- 172.21.15.98:0/3443222178 <== osd.7 v2:172.21.15.118:6808/118770 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7effd0156cf0 con 0x7effb0065e70 2023-08-22T00:45:03.696 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-08-22T00:45:03.696 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-22T00:45:03.696 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-08-22T00:45:03.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7effb0065e70 msgr2=0x7effb0068310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.697 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.118:6808/118770,v1:172.21.15.118:6809/118770] conn(0x7effb0065e70 0x7effb0068310 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7effb005ef30 msgr2=0x7effb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7effb005ef30 0x7effb00613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7effd01549f0 tx=0x7effb8007180).stop 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 msgr2=0x7effd01453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 --2- 172.21.15.98:0/3443222178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd00c5a70 0x7effd01453e0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7effd0083ef0 tx=0x7effc0017000).stop 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effcffff700 1 -- 172.21.15.98:0/3443222178 reap_dead start 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 shutdown_connections 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 >> 172.21.15.98:0/3443222178 conn(0x7effd00c80c0 msgr2=0x7effd00aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.698 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 shutdown_connections 2023-08-22T00:45:03.699 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.695+0000 7effd5b96700 1 -- 172.21.15.98:0/3443222178 wait complete. 2023-08-22T00:45:03.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-22T00:45:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.824+0000 7faa521bf700 1 Processor -- start 2023-08-22T00:45:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.824+0000 7faa521bf700 1 -- start start 2023-08-22T00:45:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa521bf700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faa4c0c5850 0x7faa4c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa521bf700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c0c5360 con 0x7faa4c0c78e0 2023-08-22T00:45:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa521bf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c0c7700 con 0x7faa4c152020 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa521bf700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0c7140 con 0x7faa4c0c5850 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faa4c0c5850 0x7faa4c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4b7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7faa4c0c78e0 0x7faa4c0c4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33988/0 (socket says 172.21.15.98:33988) 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4bfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faa4c0c5850 0x7faa4c0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42754/0 (socket says 172.21.15.98:42754) 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4b7fe700 1 -- 172.21.15.98:0/3877984961 learned_addr learned my addr 172.21.15.98:0/3877984961 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4bfff700 1 -- 172.21.15.98:0/3877984961 >> v1:172.21.15.118:6789/0 conn(0x7faa4c152020 legacy=0x7faa4c065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4bfff700 1 -- 172.21.15.98:0/3877984961 >> v1:172.21.15.98:6789/0 conn(0x7faa4c0c78e0 legacy=0x7faa4c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4bfff700 1 -- 172.21.15.98:0/3877984961 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0c7420 con 0x7faa4c0c5850 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.825+0000 7faa4a7fc700 1 -- 172.21.15.98:0/3877984961 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980373227 0 0) 0x7faa4c0c5360 con 0x7faa4c0c78e0 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa4bfff700 1 --2- 172.21.15.98:0/3877984961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c0c5850 0x7faa4c0c5ce0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7faa44009e60 tx=0x7faa44009780).ready entity=mon.0 client_cookie=34f852fee2413458 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa4a7fc700 1 -- 172.21.15.98:0/3877984961 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400e070 con 0x7faa4c0c5850 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa4a7fc700 1 -- 172.21.15.98:0/3877984961 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400bc30 con 0x7faa4c0c5850 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa4a7fc700 1 -- 172.21.15.98:0/3877984961 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44012410 con 0x7faa4c0c5850 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 -- 172.21.15.98:0/3877984961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c0c5850 msgr2=0x7faa4c0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 --2- 172.21.15.98:0/3877984961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c0c5850 0x7faa4c0c5ce0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7faa44009e60 tx=0x7faa44009780).stop 2023-08-22T00:45:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 -- 172.21.15.98:0/3877984961 shutdown_connections 2023-08-22T00:45:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 --2- 172.21.15.98:0/3877984961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c0c5850 0x7faa4c0c5ce0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 -- 172.21.15.98:0/3877984961 >> 172.21.15.98:0/3877984961 conn(0x7faa4c0aa9d0 msgr2=0x7faa4c0aadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 -- 172.21.15.98:0/3877984961 shutdown_connections 2023-08-22T00:45:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.826+0000 7faa521bf700 1 -- 172.21.15.98:0/3877984961 wait complete. 2023-08-22T00:45:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.827+0000 7faa521bf700 1 Processor -- start 2023-08-22T00:45:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 -- start start 2023-08-22T00:45:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa4c0c5850 0x7faa4c095160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa4c0c78e0 0x7faa4c0aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ab790 con 0x7faa4c152020 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c095650 con 0x7faa4c0c5850 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa521bf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0a8f30 con 0x7faa4c0c78e0 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42770/0 (socket says 172.21.15.98:42770) 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.828+0000 7faa4bfff700 1 -- 172.21.15.98:0/4083390931 learned_addr learned my addr 172.21.15.98:0/4083390931 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4b7fe700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa4c0c5850 0x7faa4c095160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4affd700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa4c0c78e0 0x7faa4c0aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 -- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa4c0c78e0 msgr2=0x7faa4c0aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa4c0c78e0 0x7faa4c0aadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 -- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa4c0c5850 msgr2=0x7faa4c095160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa4c0c5850 0x7faa4c095160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 -- 172.21.15.98:0/4083390931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009a20 con 0x7faa4c152020 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa4bfff700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7faa4400b6c0 tx=0x7faa44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440064a0 con 0x7faa4c152020 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44006600 con 0x7faa4c152020 2023-08-22T00:45:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440069a0 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c0a9210 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.829+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0a97d0 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.830+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c047480 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.831+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7faa4401d630 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.831+0000 7faa437fe700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 0x7faa2c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.831+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7faa4407cea0 con 0x7faa4c152020 2023-08-22T00:45:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.831+0000 7faa4b7fe700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 0x7faa2c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:03.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.831+0000 7faa4b7fe700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 0x7faa2c0613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa34000c00 tx=0x7faa34009040).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:03.837 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.835+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa4404e2a0 con 0x7faa4c152020 2023-08-22T00:45:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.995+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7faa4c0c4450 con 0x7faa2c05ef00 2023-08-22T00:45:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.995+0000 7faa437fe700 1 -- 172.21.15.98:0/4083390931 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa4c0c4450 con 0x7faa2c05ef00 2023-08-22T00:45:03.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 msgr2=0x7faa2c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 0x7faa2c0613c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa34000c00 tx=0x7faa34009040).stop 2023-08-22T00:45:03.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 msgr2=0x7faa4c0ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:03.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7faa4400b6c0 tx=0x7faa44009780).stop 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 shutdown_connections 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7faa2c05ef00 0x7faa2c0613c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa4c152020 0x7faa4c0ab2a0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa4c0c5850 0x7faa4c095160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 --2- 172.21.15.98:0/4083390931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa4c0c78e0 0x7faa4c0aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 >> 172.21.15.98:0/4083390931 conn(0x7faa4c0aa9d0 msgr2=0x7faa4c151730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 shutdown_connections 2023-08-22T00:45:03.999 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:03.997+0000 7faa521bf700 1 -- 172.21.15.98:0/4083390931 wait complete. 2023-08-22T00:45:04.000 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 7 to deep-scrub 2023-08-22T00:45:04.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:45:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.125+0000 7f8c3f2fd700 1 Processor -- start 2023-08-22T00:45:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.125+0000 7f8c3f2fd700 1 -- start start 2023-08-22T00:45:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3f2fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c380c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3f2fd700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380c6110 con 0x7f8c380ab480 2023-08-22T00:45:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3f2fd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380be650 con 0x7f8c380c44a0 2023-08-22T00:45:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3f2fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380c57e0 con 0x7f8c380c25f0 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3c898700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8c380ab480 0x7f8c380c1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:33992/0 (socket says 172.21.15.98:33992) 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3c898700 1 -- 172.21.15.98:0/1455602755 learned_addr learned my addr 172.21.15.98:0/1455602755 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c3d89a700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c380c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350621121 0 0) 0x7f8c380c6110 con 0x7f8c380ab480 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c240033f0 con 0x7f8c380ab480 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280923343 0 0) 0x7f8c380be650 con 0x7f8c380c44a0 2023-08-22T00:45:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c380c6110 con 0x7f8c380c44a0 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202909955 0 0) 0x7f8c240033f0 con 0x7f8c380ab480 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 msgr2=0x7f8c380c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c380c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 >> v1:172.21.15.118:6789/0 conn(0x7f8c380c44a0 legacy=0x7f8c380c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380c5ac0 con 0x7f8c380ab480 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7f8c28001470 con 0x7f8c380ab480 2023-08-22T00:45:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 >> v1:172.21.15.98:6789/0 conn(0x7f8c380ab480 legacy=0x7f8c380c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c24003aa0 0x7f8c24003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24004690 0x7f8c24004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c24005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380c57e0 con 0x7f8c24003aa0 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2400b910 con 0x7f8c24004690 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.126+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2400bad0 con 0x7f8c380c25f0 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c24003aa0 0x7f8c24003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3c898700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24004690 0x7f8c24004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d89a700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c24005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 -- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 msgr2=0x7f8c24005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c25f0 0x7f8c24005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 -- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24004690 msgr2=0x7f8c24004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24004690 0x7f8c24004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 -- 172.21.15.98:0/1455602755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240033f0 con 0x7f8c24003aa0 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c3d099700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c24003aa0 0x7f8c24003ea0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f8c340018d0 tx=0x7f8c34007bb0).ready entity=mon.0 client_cookie=520bd3074469316d server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34007020 con 0x7f8c24003aa0 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34007180 con 0x7f8c24003aa0 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.127+0000 7f8c2ffff700 1 -- 172.21.15.98:0/1455602755 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34007500 con 0x7f8c24003aa0 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/1455602755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c24003aa0 msgr2=0x7f8c24003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/1455602755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c24003aa0 0x7f8c24003ea0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f8c340018d0 tx=0x7f8c34007bb0).stop 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3d89a700 1 -- 172.21.15.98:0/1455602755 reap_dead start 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/1455602755 shutdown_connections 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/1455602755 >> 172.21.15.98:0/1455602755 conn(0x7f8c380aa960 msgr2=0x7f8c380aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/1455602755 shutdown_connections 2023-08-22T00:45:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.128+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/1455602755 wait complete. 2023-08-22T00:45:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.129+0000 7f8c3f2fd700 1 Processor -- start 2023-08-22T00:45:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.129+0000 7f8c3f2fd700 1 -- start start 2023-08-22T00:45:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24003aa0 0x7f8c381637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c0800 0x7f8c380946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381576d0 con 0x7f8c381470f0 2023-08-22T00:45:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380c0c80 con 0x7f8c24003aa0 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3f2fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38095450 con 0x7f8c380c0800 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42796/0 (socket says 172.21.15.98:42796) 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 -- 172.21.15.98:0/4035777013 learned_addr learned my addr 172.21.15.98:0/4035777013 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3d099700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24003aa0 0x7f8c381637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3d89a700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c0800 0x7f8c380946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 -- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c0800 msgr2=0x7f8c380946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c0800 0x7f8c380946e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 -- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24003aa0 msgr2=0x7f8c381637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24003aa0 0x7f8c381637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 -- 172.21.15.98:0/4035777013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38095730 con 0x7f8c381470f0 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c3c898700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7f8c280076f0 tx=0x7f8c28001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.130+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280114c0 con 0x7f8c381470f0 2023-08-22T00:45:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.131+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28011620 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.131+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280119c0 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.131+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c38157080 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.131+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38163ca0 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.131+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c38163ec0 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.132+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8c2801d3b0 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.132+0000 7f8c2d7fa700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 0x7f8c1c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.132+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f8c280798b0 con 0x7f8c381470f0 2023-08-22T00:45:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.132+0000 7f8c3d099700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 0x7f8c1c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.133+0000 7f8c3d099700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 0x7f8c1c0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c34007960 tx=0x7f8c34016000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.136+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c38163ec0 con 0x7f8c381470f0 2023-08-22T00:45:04.296 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.295+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c38163ec0 con 0x7f8c1c05ef30 2023-08-22T00:45:04.298 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.297+0000 7f8c2d7fa700 1 -- 172.21.15.98:0/4035777013 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71543 (secure 0 0 0) 0x7f8c38163ec0 con 0x7f8c1c05ef30 2023-08-22T00:45:04.299 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:45:04.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 msgr2=0x7f8c1c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 0x7f8c1c0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c34007960 tx=0x7f8c34016000).stop 2023-08-22T00:45:04.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 msgr2=0x7f8c380c0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7f8c280076f0 tx=0x7f8c28001df0).stop 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 shutdown_connections 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f8c1c05ef30 0x7f8c1c0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c380c0800 0x7f8c380946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c24003aa0 0x7f8c381637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 --2- 172.21.15.98:0/4035777013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c381470f0 0x7f8c380c0310 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:04.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 >> 172.21.15.98:0/4035777013 conn(0x7f8c380aa960 msgr2=0x7f8c38064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 shutdown_connections 2023-08-22T00:45:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:04.299+0000 7f8c3f2fd700 1 -- 172.21.15.98:0/4035777013 wait complete. 2023-08-22T00:45:04.305 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:45:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-08-22T00:45:03.163877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2454592,"kb_used_data":20480,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520128,"statfs":{"total":773094113280,"available":770580611072,"internally_reserved":0,"allocated":20971520,"data_stored":11219984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12447,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-70,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004358"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:01.552636+0000","last_change":"2023-08-22T00:45:01.552636+0000","last_active":"2023-08-22T00:45:01.552636+0000","last_peered":"2023-08-22T00:45:01.552636+0000","last_clean":"2023-08-22T00:45:01.552636+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:45:01.552636+0000","last_undegraded":"2023-08-22T00:45:01.552636+0000","last_fullsized":"2023-08-22T00:45:01.552636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:01.552565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:01.552565+0000","last_clean_scrub_stamp":"2023-08-22T00:45:01.552565+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.547703+0000","last_change":"2023-08-22T00:06:04.138293+0000","last_active":"2023-08-22T00:44:54.547703+0000","last_peered":"2023-08-22T00:44:54.547703+0000","last_clean":"2023-08-22T00:44:54.547703+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:44:54.547703+0000","last_undegraded":"2023-08-22T00:44:54.547703+0000","last_fullsized":"2023-08-22T00:44:54.547703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.548072+0000","last_change":"2023-08-22T00:06:04.138230+0000","last_active":"2023-08-22T00:44:54.548072+0000","last_peered":"2023-08-22T00:44:54.548072+0000","last_clean":"2023-08-22T00:44:54.548072+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:44:54.548072+0000","last_undegraded":"2023-08-22T00:44:54.548072+0000","last_fullsized":"2023-08-22T00:44:54.548072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.547599+0000","last_change":"2023-08-22T00:06:04.138535+0000","last_active":"2023-08-22T00:44:54.547599+0000","last_peered":"2023-08-22T00:44:54.547599+0000","last_clean":"2023-08-22T00:44:54.547599+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:44:54.547599+0000","last_undegraded":"2023-08-22T00:44:54.547599+0000","last_fullsized":"2023-08-22T00:44:54.547599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":166,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.174735+0000","last_change":"2023-08-22T00:06:02.904927+0000","last_active":"2023-08-22T00:44:54.174735+0000","last_peered":"2023-08-22T00:44:54.174735+0000","last_clean":"2023-08-22T00:44:54.174735+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:44:54.174735+0000","last_undegraded":"2023-08-22T00:44:54.174735+0000","last_fullsized":"2023-08-22T00:44:54.174735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:01.042723+0000","last_clean_scrub_stamp":"2023-08-22T00:06:01.042723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.174646+0000","last_change":"2023-08-22T00:06:04.138309+0000","last_active":"2023-08-22T00:44:54.174646+0000","last_peered":"2023-08-22T00:44:54.174646+0000","last_clean":"2023-08-22T00:44:54.174646+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:44:54.174646+0000","last_undegraded":"2023-08-22T00:44:54.174646+0000","last_fullsized":"2023-08-22T00:44:54.174646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.176874+0000","last_change":"2023-08-22T00:06:04.199665+0000","last_active":"2023-08-22T00:44:54.176874+0000","last_peered":"2023-08-22T00:44:54.176874+0000","last_clean":"2023-08-22T00:44:54.176874+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:44:54.176874+0000","last_undegraded":"2023-08-22T00:44:54.176874+0000","last_fullsized":"2023-08-22T00:44:54.176874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.348999+0000","last_change":"2023-08-22T00:06:04.133780+0000","last_active":"2023-08-22T00:44:54.348999+0000","last_peered":"2023-08-22T00:44:54.348999+0000","last_clean":"2023-08-22T00:44:54.348999+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:44:54.348999+0000","last_undegraded":"2023-08-22T00:44:54.348999+0000","last_fullsized":"2023-08-22T00:44:54.348999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-08-22T00:44:54.547384+0000","last_change":"2023-08-22T00:06:04.133560+0000","last_active":"2023-08-22T00:44:54.547384+0000","last_peered":"2023-08-22T00:44:54.547384+0000","last_clean":"2023-08-22T00:44:54.547384+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:44:54.547384+0000","last_undegraded":"2023-08-22T00:44:54.547384+0000","last_fullsized":"2023-08-22T00:44:54.547384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:06:03.111857+0000","last_clean_scrub_stamp":"2023-08-22T00:06:03.111857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.89800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78700000000000003},"last":0.627}]},{"osd":2,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.879},"last":0.67500000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.78400000000000003,"15min":0.83199999999999996},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.89100000000000001},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575304,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059896,"statfs":{"total":96636764160,"available":96317333504,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.83699999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.80700000000000005},"last":0.438},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81599999999999995},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81999999999999995},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45000000000000001}]},{"osd":5,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.234},"last":0.62}]},{"osd":7,"last update":"Tue Aug 22 00:44:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"last":0.63300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28799999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58099999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38200000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.313},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":1.01},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.004},"last":0.504},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78100000000000003,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575304,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.22600000000000001},"max":{"1min":0.51300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.36899999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.47999999999999998,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.38},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.40999999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.626,"15min":0.65300000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.93500000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.42899999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.82199999999999995,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.48699999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.505},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575305,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.71799999999999997},"last":0.313}]},{"osd":1,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.42499999999999999},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.622,"15min":0.72099999999999997},"last":0.247},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.39100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.29299999999999998}]},{"osd":3,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.748},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.60899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.79300000000000004,"5min":0.88,"15min":1.1120000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":0.85199999999999998,"15min":1.0549999999999999},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575304,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.316},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.223},"max":{"1min":0.623,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.57499999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.37}]},{"osd":2,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.25800000000000001},"max":{"1min":0.58299999999999996,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.73099999999999998},"last":0.40000000000000002}]},{"osd":4,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84699999999999998,"5min":1,"15min":1},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.86199999999999999,"15min":0.92400000000000004},"last":0.497},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88300000000000001,"5min":0.93500000000000005,"15min":1.026},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":1.034},"last":0.49099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82999999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.64100000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.375,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.753,"15min":0.81200000000000006},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.622,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.505}]},{"osd":6,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71099999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:44:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77200000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.59099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.315}]},{"osd":2,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.80000000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.499},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78600000000000003},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.745},"last":0.52400000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Aug 22 00:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.84999999999999998},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:45:04.317 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.318 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.318 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.318 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-22T00:06:01.042723+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=1, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.318 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.318 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.319 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.319 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-22T00:06:03.111857+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=6, tm_sec=3, tm_wday=1, tm_yday=234, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=22, tm_hour=0, tm_min=44, tm_sec=59, tm_wday=1, tm_yday=234, tm_isdst=0) 2023-08-22T00:45:04.319 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-22T00:45:24.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-22T00:45:24.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.448+0000 7f4621d26700 1 Processor -- start 2023-08-22T00:45:24.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.448+0000 7f4621d26700 1 -- start start 2023-08-22T00:45:24.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f4621d26700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f461c065830 0x7f461c0639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.450 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f4621d26700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c063470 con 0x7f461c062fa0 2023-08-22T00:45:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f4621d26700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0c22a0 con 0x7f461c150110 2023-08-22T00:45:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f4621d26700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c063e90 con 0x7f461c065830 2023-08-22T00:45:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f461affd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f461c065830 0x7f461c0639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f461bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f461c062fa0 0x7f461c0c4320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39150/0 (socket says 172.21.15.98:39150) 2023-08-22T00:45:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.449+0000 7f461bfff700 1 -- 172.21.15.98:0/1991174361 learned_addr learned my addr 172.21.15.98:0/1991174361 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:24.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461affd700 1 -- 172.21.15.98:0/1991174361 >> v1:172.21.15.118:6789/0 conn(0x7f461c150110 legacy=0x7f461c065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461affd700 1 -- 172.21.15.98:0/1991174361 >> v1:172.21.15.98:6789/0 conn(0x7f461c062fa0 legacy=0x7f461c0c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461affd700 1 -- 172.21.15.98:0/1991174361 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0c2580 con 0x7f461c065830 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461affd700 1 --2- 172.21.15.98:0/1991174361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c065830 0x7f461c0639a0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f4610009760 tx=0x7f4610009060).ready entity=mon.0 client_cookie=667d4f0cbfadf07c server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461a7fc700 1 -- 172.21.15.98:0/1991174361 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610010620 con 0x7f461c065830 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461a7fc700 1 -- 172.21.15.98:0/1991174361 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610010780 con 0x7f461c065830 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f461a7fc700 1 -- 172.21.15.98:0/1991174361 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610010b00 con 0x7f461c065830 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f4621d26700 1 -- 172.21.15.98:0/1991174361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c065830 msgr2=0x7f461c0639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f4621d26700 1 --2- 172.21.15.98:0/1991174361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c065830 0x7f461c0639a0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f4610009760 tx=0x7f4610009060).stop 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f4621d26700 1 -- 172.21.15.98:0/1991174361 shutdown_connections 2023-08-22T00:45:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f4621d26700 1 --2- 172.21.15.98:0/1991174361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c065830 0x7f461c0639a0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.450+0000 7f4621d26700 1 -- 172.21.15.98:0/1991174361 >> 172.21.15.98:0/1991174361 conn(0x7f461c0c7290 msgr2=0x7f461c0c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:24.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.451+0000 7f4621d26700 1 -- 172.21.15.98:0/1991174361 shutdown_connections 2023-08-22T00:45:24.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.451+0000 7f4621d26700 1 -- 172.21.15.98:0/1991174361 wait complete. 2023-08-22T00:45:24.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.452+0000 7f4621d26700 1 Processor -- start 2023-08-22T00:45:24.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.452+0000 7f4621d26700 1 -- start start 2023-08-22T00:45:24.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.456 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 0x7f461c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f461c150110 0x7f461c162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c14c430 con 0x7f461c062fa0 2023-08-22T00:45:24.457 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c162cb0 con 0x7f461c150110 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c162f90 con 0x7f461c065830 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60974/0 (socket says 172.21.15.98:60974) 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 -- 172.21.15.98:0/2793139964 learned_addr learned my addr 172.21.15.98:0/2793139964 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461bfff700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f461c150110 0x7f461c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461affd700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 0x7f461c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 -- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 msgr2=0x7f461c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 0x7f461c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 -- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f461c150110 msgr2=0x7f461c162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f461c150110 0x7f461c162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 -- 172.21.15.98:0/2793139964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100092a0 con 0x7f461c062fa0 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461affd700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 0x7f461c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f461b7fe700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f460c00c440 tx=0x7f460c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c007020 con 0x7f461c062fa0 2023-08-22T00:45:24.459 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c007180 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c14c6f0 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c007520 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.453+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c144310 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.454+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c14cc10 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.455+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f460c0068b0 con 0x7f461c062fa0 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.455+0000 7f46037fe700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 0x7f46080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.455+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f460c0793c0 con 0x7f461c062fa0 2023-08-22T00:45:24.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.455+0000 7f461affd700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 0x7f46080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.455+0000 7f461affd700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 0x7f46080613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f461c14e140 tx=0x7f4610018000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.461 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.459+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f460c0478f0 con 0x7f461c062fa0 2023-08-22T00:45:24.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:24.593 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:24.618 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.616+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 --> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f461c14c570 con 0x7f460805ef30 2023-08-22T00:45:24.620 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.619+0000 7f46037fe700 1 -- 172.21.15.98:0/2793139964 <== mgr.9085 v2:172.21.15.98:6832/169458 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71008 (secure 0 0 0) 0x7f46100108f0 con 0x7f460805ef30 2023-08-22T00:45:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:45:24.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 msgr2=0x7f46080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 0x7f46080613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f461c14e140 tx=0x7f4610018000).stop 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 msgr2=0x7f461c138170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f460c00c440 tx=0x7f460c007e00).stop 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 shutdown_connections 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f460805ef30 0x7f46080613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f461c150110 0x7f461c162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f461c062fa0 0x7f461c138170 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 --2- 172.21.15.98:0/2793139964 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f461c065830 0x7f461c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.621+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 >> 172.21.15.98:0/2793139964 conn(0x7f461c0c7290 msgr2=0x7f461c0aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.622+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 shutdown_connections 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.622+0000 7f4621d26700 1 -- 172.21.15.98:0/2793139964 wait complete. 2023-08-22T00:45:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2023-08-22T00:45:24.634 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-22T00:45:23.168264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2454592,"kb_used_data":20480,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520128,"statfs":{"total":773094113280,"available":770580611072,"internally_reserved":0,"allocated":20971520,"data_stored":11219984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12447,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-70,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004358"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:01.552636+0000","last_change":"2023-08-22T00:45:01.552636+0000","last_active":"2023-08-22T00:45:01.552636+0000","last_peered":"2023-08-22T00:45:01.552636+0000","last_clean":"2023-08-22T00:45:01.552636+0000","last_became_active":"2023-08-22T00:06:04.199395+0000","last_became_peered":"2023-08-22T00:06:04.199395+0000","last_unstale":"2023-08-22T00:45:01.552636+0000","last_undegraded":"2023-08-22T00:45:01.552636+0000","last_fullsized":"2023-08-22T00:45:01.552636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:01.552565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:01.552565+0000","last_clean_scrub_stamp":"2023-08-22T00:45:01.552565+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:05.129342+0000","last_change":"2023-08-22T00:45:05.129342+0000","last_active":"2023-08-22T00:45:05.129342+0000","last_peered":"2023-08-22T00:45:05.129342+0000","last_clean":"2023-08-22T00:45:05.129342+0000","last_became_active":"2023-08-22T00:06:04.137996+0000","last_became_peered":"2023-08-22T00:06:04.137996+0000","last_unstale":"2023-08-22T00:45:05.129342+0000","last_undegraded":"2023-08-22T00:45:05.129342+0000","last_fullsized":"2023-08-22T00:45:05.129342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:05.129248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:05.129248+0000","last_clean_scrub_stamp":"2023-08-22T00:45:05.129248+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:07.759896+0000","last_change":"2023-08-22T00:45:07.759896+0000","last_active":"2023-08-22T00:45:07.759896+0000","last_peered":"2023-08-22T00:45:07.759896+0000","last_clean":"2023-08-22T00:45:07.759896+0000","last_became_active":"2023-08-22T00:06:04.137867+0000","last_became_peered":"2023-08-22T00:06:04.137867+0000","last_unstale":"2023-08-22T00:45:07.759896+0000","last_undegraded":"2023-08-22T00:45:07.759896+0000","last_fullsized":"2023-08-22T00:45:07.759896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:07.759745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:07.759745+0000","last_clean_scrub_stamp":"2023-08-22T00:45:07.759745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:06.090818+0000","last_change":"2023-08-22T00:45:06.090818+0000","last_active":"2023-08-22T00:45:06.090818+0000","last_peered":"2023-08-22T00:45:06.090818+0000","last_clean":"2023-08-22T00:45:06.090818+0000","last_became_active":"2023-08-22T00:06:04.138034+0000","last_became_peered":"2023-08-22T00:06:04.138034+0000","last_unstale":"2023-08-22T00:45:06.090818+0000","last_undegraded":"2023-08-22T00:45:06.090818+0000","last_fullsized":"2023-08-22T00:45:06.090818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:06.090719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:06.090719+0000","last_clean_scrub_stamp":"2023-08-22T00:45:06.090719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:04.246235+0000","last_change":"2023-08-22T00:45:04.246235+0000","last_active":"2023-08-22T00:45:04.246235+0000","last_peered":"2023-08-22T00:45:04.246235+0000","last_clean":"2023-08-22T00:45:04.246235+0000","last_became_active":"2023-08-22T00:06:02.904628+0000","last_became_peered":"2023-08-22T00:06:02.904628+0000","last_unstale":"2023-08-22T00:45:04.246235+0000","last_undegraded":"2023-08-22T00:45:04.246235+0000","last_fullsized":"2023-08-22T00:45:04.246235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:04.246130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:04.246130+0000","last_clean_scrub_stamp":"2023-08-22T00:45:04.246130+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:07.286515+0000","last_change":"2023-08-22T00:45:07.286515+0000","last_active":"2023-08-22T00:45:07.286515+0000","last_peered":"2023-08-22T00:45:07.286515+0000","last_clean":"2023-08-22T00:45:07.286515+0000","last_became_active":"2023-08-22T00:06:04.138012+0000","last_became_peered":"2023-08-22T00:06:04.138012+0000","last_unstale":"2023-08-22T00:45:07.286515+0000","last_undegraded":"2023-08-22T00:45:07.286515+0000","last_fullsized":"2023-08-22T00:45:07.286515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:07.286410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:07.286410+0000","last_clean_scrub_stamp":"2023-08-22T00:45:07.286410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:10.335538+0000","last_change":"2023-08-22T00:45:10.335538+0000","last_active":"2023-08-22T00:45:10.335538+0000","last_peered":"2023-08-22T00:45:10.335538+0000","last_clean":"2023-08-22T00:45:10.335538+0000","last_became_active":"2023-08-22T00:06:04.199372+0000","last_became_peered":"2023-08-22T00:06:04.199372+0000","last_unstale":"2023-08-22T00:45:10.335538+0000","last_undegraded":"2023-08-22T00:45:10.335538+0000","last_fullsized":"2023-08-22T00:45:10.335538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:10.335448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:10.335448+0000","last_clean_scrub_stamp":"2023-08-22T00:45:10.335448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:02.577142+0000","last_change":"2023-08-22T00:45:02.577142+0000","last_active":"2023-08-22T00:45:02.577142+0000","last_peered":"2023-08-22T00:45:02.577142+0000","last_clean":"2023-08-22T00:45:02.577142+0000","last_became_active":"2023-08-22T00:06:04.133511+0000","last_became_peered":"2023-08-22T00:06:04.133511+0000","last_unstale":"2023-08-22T00:45:02.577142+0000","last_undegraded":"2023-08-22T00:45:02.577142+0000","last_fullsized":"2023-08-22T00:45:02.577142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:02.577053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:02.577053+0000","last_clean_scrub_stamp":"2023-08-22T00:45:02.577053+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-08-22T00:45:07.153251+0000","last_change":"2023-08-22T00:45:07.153251+0000","last_active":"2023-08-22T00:45:07.153251+0000","last_peered":"2023-08-22T00:45:07.153251+0000","last_clean":"2023-08-22T00:45:07.153251+0000","last_became_active":"2023-08-22T00:06:04.133266+0000","last_became_peered":"2023-08-22T00:06:04.133266+0000","last_unstale":"2023-08-22T00:45:07.153251+0000","last_undegraded":"2023-08-22T00:45:07.153251+0000","last_fullsized":"2023-08-22T00:45:07.153251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-22T00:45:07.153151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-22T00:45:07.153151+0000","last_clean_scrub_stamp":"2023-08-22T00:45:07.153151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575308,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.32200000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76300000000000001,"5min":0.81499999999999995,"15min":0.85999999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.57299999999999995},"min":{"1min":0.39700000000000002,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72399999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71099999999999997,"5min":0.77300000000000002,"15min":0.83899999999999997},"last":0.753}]},{"osd":3,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.50700000000000001,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.40999999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.80500000000000005},"last":0.439},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51300000000000001}]},{"osd":6,"last update":"Tue Aug 22 00:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.46999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575308,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059896,"statfs":{"total":96636764160,"available":96317333504,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.33400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.624}]},{"osd":2,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.25900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53500000000000003}]},{"osd":3,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54900000000000004}]},{"osd":4,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48299999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60799999999999998}]},{"osd":5,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.504,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.84299999999999997,"15min":1.234},"last":0.502}]},{"osd":7,"last update":"Tue Aug 22 00:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575308,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65700000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":0.70099999999999996,"15min":0.71299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58099999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46899999999999997}]},{"osd":3,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.434},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41999999999999998}]},{"osd":4,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":1.01},"last":0.745},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Aug 22 00:44:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78100000000000003,"5min":0.96899999999999997,"15min":0.97199999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575308,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.46400000000000002,"5min":0.55500000000000005,"15min":0.63300000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.502,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.5,"5min":0.626,"15min":0.65300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55500000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.5}]},{"osd":4,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.61499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.96999999999999997},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.60699999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.93500000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.90600000000000003,"15min":0.95699999999999996},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60699999999999998,"15min":0.63},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.91500000000000004,"15min":1.0249999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78400000000000003,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79600000000000004,"5min":0.90600000000000003,"15min":1.0389999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83699999999999997,"5min":0.93000000000000005,"15min":1.0680000000000001},"last":0.69999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575309,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39900000000000002,"15min":0.41299999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.56299999999999994,"5min":0.63500000000000001,"15min":0.71799999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41399999999999998,"15min":0.42399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.59699999999999998,"15min":0.72099999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.379,"15min":0.39100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.626},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":0.88300000000000001,"15min":0.92000000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84499999999999997,"5min":0.88800000000000001,"15min":0.94899999999999995},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83399999999999996,"5min":0.85199999999999998,"15min":1.0069999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":0.91500000000000004,"15min":0.99199999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61699999999999999,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.93300000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.51900000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.85699999999999998,"5min":0.88,"15min":1.1120000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Aug 22 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":0.92300000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.39200000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.0549999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575308,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35299999999999998,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52400000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38300000000000001,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41299999999999998,"15min":0.41199999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.223},"max":{"1min":0.55700000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.43099999999999999,"15min":0.439},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.24299999999999999},"max":{"1min":0.60999999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.501}]},{"osd":2,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.25800000000000001},"max":{"1min":0.56399999999999995,"5min":0.67700000000000005,"15min":0.70699999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.46100000000000002},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.73099999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81899999999999995,"5min":1,"15min":1},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.94699999999999995,"15min":0.97499999999999998},"last":0.747}]},{"osd":5,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.92400000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84399999999999997,"5min":0.93500000000000005,"15min":1.026},"last":0.77700000000000002}]},{"osd":6,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.95399999999999996,"15min":1.034},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Aug 22 00:45:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40500000000000003},"max":{"1min":0.77800000000000002,"5min":1.03,"15min":1.03},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.82099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.27500000000000002},"max":{"1min":0.67500000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.73999999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.374}]},{"osd":1,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81299999999999994},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71999999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.70099999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":0.77500000000000002,"15min":0.80200000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":0.753,"15min":0.81200000000000006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68600000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42999999999999999}]},{"osd":5,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.77300000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.70399999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.442}]},{"osd":6,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.317,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.58899999999999997,"5min":0.74299999999999999,"15min":0.77000000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.52000000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58099999999999996}]},{"osd":7,"last update":"Tue Aug 22 00:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73999999999999999,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]}]},{"osd":5,"up_from":13,"seq":55834575307,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307848,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063992,"statfs":{"total":96636764160,"available":96321527808,"internally_reserved":0,"allocated":2621440,"data_stored":1402498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.3109999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53400000000000003,"15min":0.55400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70899999999999996},"last":0.308}]},{"osd":6,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.55100000000000005},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Aug 22 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.40699999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.371},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.433,"5min":0.317,"15min":0.317},"max":{"1min":3.4409999999999998,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-22T00:45:24.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-22T00:45:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.799+0000 7f45dddde700 1 Processor -- start 2023-08-22T00:45:24.800 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.799+0000 7f45dddde700 1 -- start start 2023-08-22T00:45:24.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45dddde700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 0x7f45d80c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45dddde700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45d8151ab0 0x7f45d80a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.804 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45dddde700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80c2e00 con 0x7f45d80a8ce0 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45dddde700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80a9110 con 0x7f45d8151ab0 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45dddde700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d8151f30 con 0x7f45d814b070 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45d8151ab0 0x7f45d80a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45d8151ab0 0x7f45d80a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60988/0 (socket says 172.21.15.98:60988) 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 -- 172.21.15.98:0/12968234 learned_addr learned my addr 172.21.15.98:0/12968234 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d7fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f45d80a8ce0 0x7f45d80c43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39158/0 (socket says 172.21.15.98:39158) 2023-08-22T00:45:24.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 -- 172.21.15.98:0/12968234 >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 msgr2=0x7f45d80c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:24.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d77fe700 1 --2- 172.21.15.98:0/12968234 >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 0x7f45d80c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 --2- 172.21.15.98:0/12968234 >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 0x7f45d80c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 -- 172.21.15.98:0/12968234 >> v1:172.21.15.98:6789/0 conn(0x7f45d80a8ce0 legacy=0x7f45d80c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d67fc700 1 -- 172.21.15.98:0/12968234 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498493758 0 0) 0x7f45d80c2e00 con 0x7f45d80a8ce0 2023-08-22T00:45:24.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 -- 172.21.15.98:0/12968234 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80c60e0 con 0x7f45d8151ab0 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d77fe700 1 --2- 172.21.15.98:0/12968234 >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 0x7f45d80c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d6ffd700 1 --2- 172.21.15.98:0/12968234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d8151ab0 0x7f45d80a87f0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f45d8068860 tx=0x7f45c00090f0).ready entity=mon.0 client_cookie=e4c561a122075856 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d67fc700 1 -- 172.21.15.98:0/12968234 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000b600 con 0x7f45d8151ab0 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d67fc700 1 -- 172.21.15.98:0/12968234 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c000b760 con 0x7f45d8151ab0 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.800+0000 7f45d67fc700 1 -- 172.21.15.98:0/12968234 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000bae0 con 0x7f45d8151ab0 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 -- 172.21.15.98:0/12968234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d8151ab0 msgr2=0x7f45d80a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 --2- 172.21.15.98:0/12968234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d8151ab0 0x7f45d80a87f0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f45d8068860 tx=0x7f45c00090f0).stop 2023-08-22T00:45:24.807 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 -- 172.21.15.98:0/12968234 shutdown_connections 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 --2- 172.21.15.98:0/12968234 >> v2:172.21.15.118:3300/0 conn(0x7f45d814b070 0x7f45d80c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 --2- 172.21.15.98:0/12968234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d8151ab0 0x7f45d80a87f0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 -- 172.21.15.98:0/12968234 >> 172.21.15.98:0/12968234 conn(0x7f45d80c7250 msgr2=0x7f45d80c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 -- 172.21.15.98:0/12968234 shutdown_connections 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.801+0000 7f45dddde700 1 -- 172.21.15.98:0/12968234 wait complete. 2023-08-22T00:45:24.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.802+0000 7f45dddde700 1 Processor -- start 2023-08-22T00:45:24.809 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.802+0000 7f45dddde700 1 -- start start 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45d814b070 0x7f45d8149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45d8151ab0 0x7f45d814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d814ee50 con 0x7f45d80a8ce0 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d814f130 con 0x7f45d814b070 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45dddde700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d814f410 con 0x7f45d8151ab0 2023-08-22T00:45:24.811 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60996/0 (socket says 172.21.15.98:60996) 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 -- 172.21.15.98:0/3022345797 learned_addr learned my addr 172.21.15.98:0/3022345797 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d6ffd700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45d814b070 0x7f45d8149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d7fff700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45d8151ab0 0x7f45d814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 -- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45d8151ab0 msgr2=0x7f45d814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45d8151ab0 0x7f45d814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.812 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 -- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45d814b070 msgr2=0x7f45d8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45d814b070 0x7f45d8149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.803+0000 7f45d77fe700 1 -- 172.21.15.98:0/3022345797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0009370 con 0x7f45d80a8ce0 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45d77fe700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7f45c800a520 tx=0x7f45c8007960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8008590 con 0x7f45d80a8ce0 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c80086f0 con 0x7f45d80a8ce0 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d814f6f0 con 0x7f45d80a8ce0 2023-08-22T00:45:24.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8008a70 con 0x7f45d80a8ce0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.804+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80bfd50 con 0x7f45d80a8ce0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.805+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8047480 con 0x7f45d80a8ce0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.805+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f45c8015440 con 0x7f45d80a8ce0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.805+0000 7f45cf7fe700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 0x7f45b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.805+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f45c807b020 con 0x7f45d80a8ce0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.806+0000 7f45d6ffd700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 0x7f45b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:24.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.806+0000 7f45d6ffd700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 0x7f45b80613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f45c0009130 tx=0x7f45c0017000).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:24.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.810+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45c804c250 con 0x7f45d80a8ce0 2023-08-22T00:45:24.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.970+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f45d80c63c0 con 0x7f45d80a8ce0 2023-08-22T00:45:24.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.976+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45c8007ac0 con 0x7f45d80a8ce0 2023-08-22T00:45:24.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.976+0000 7f45cf7fe700 1 -- 172.21.15.98:0/3022345797 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v42)=0 v42) v1 ==== 123+0+0 (secure 0 0 0) 0x7f45c804f870 con 0x7f45d80a8ce0 2023-08-22T00:45:24.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.978+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 msgr2=0x7f45b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.980 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.978+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 0x7f45b80613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f45c0009130 tx=0x7f45c0017000).stop 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.978+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 msgr2=0x7f45d814d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7f45c800a520 tx=0x7f45c8007960).stop 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 shutdown_connections 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7f45b805ef30 0x7f45b80613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45d8151ab0 0x7f45d814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.981 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45d80a8ce0 0x7f45d814d040 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 --2- 172.21.15.98:0/3022345797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45d814b070 0x7f45d8149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:24.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 >> 172.21.15.98:0/3022345797 conn(0x7f45d80c7250 msgr2=0x7f45d814a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:24.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 shutdown_connections 2023-08-22T00:45:24.982 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:24.979+0000 7f45dddde700 1 -- 172.21.15.98:0/3022345797 wait complete. 2023-08-22T00:45:24.992 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-22T00:45:24.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-22T00:45:25.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.105+0000 7fe9774fc700 1 Processor -- start 2023-08-22T00:45:25.107 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.106+0000 7fe9774fc700 1 -- start start 2023-08-22T00:45:25.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe9774fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe970150910 0x7fe9700c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe9774fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9700c5660 0x7fe97015a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe9774fc700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9700c51d0 con 0x7fe970150cf0 2023-08-22T00:45:25.117 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe9774fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700c1050 con 0x7fe970150910 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe9774fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c4320 con 0x7fe9700c5660 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe974a97700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe970150cf0 0x7fe9700a8880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:39162/0 (socket says 172.21.15.98:39162) 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe974a97700 1 -- 172.21.15.98:0/3145547941 learned_addr learned my addr 172.21.15.98:0/3145547941 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe975a99700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9700c5660 0x7fe97015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363510273 0 0) 0x7fe9700c51d0 con 0x7fe970150cf0 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe975298700 1 --2- 172.21.15.98:0/3145547941 >> v2:172.21.15.118:3300/0 conn(0x7fe970150910 0x7fe9700c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c0033f0 con 0x7fe970150cf0 2023-08-22T00:45:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943975264 0 0) 0x7fe95c0033f0 con 0x7fe970150cf0 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9700c5660 msgr2=0x7fe97015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9700c5660 0x7fe97015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 >> v2:172.21.15.118:3300/0 conn(0x7fe970150910 msgr2=0x7fe9700c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 --2- 172.21.15.98:0/3145547941 >> v2:172.21.15.118:3300/0 conn(0x7fe970150910 0x7fe9700c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700c45c0 con 0x7fe970150cf0 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 675577057 0 0) 0x7fe964001470 con 0x7fe970150cf0 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 >> v1:172.21.15.98:6789/0 conn(0x7fe970150cf0 legacy=0x7fe9700a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.119 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe95c0038e0 0x7fe95c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe95c004690 0x7fe95c004ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe95c004fc0 0x7fe95c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c1050 con 0x7fe95c004fc0 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c4320 con 0x7fe95c0038e0 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c004460 con 0x7fe95c004690 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.107+0000 7fe975a99700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe95c004fc0 0x7fe95c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.120 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975298700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe95c0038e0 0x7fe95c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe974a97700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe95c004690 0x7fe95c004ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 -- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe95c004690 msgr2=0x7fe95c004ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe95c004690 0x7fe95c004ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 -- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe95c0038e0 msgr2=0x7fe95c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe95c0038e0 0x7fe95c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 -- 172.21.15.98:0/3145547941 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0033f0 con 0x7fe95c004fc0 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe975a99700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe95c004fc0 0x7fe95c00b8e0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fe9700c2510 tx=0x7fe96800b040).ready entity=mon.0 client_cookie=cc0317970dfa7867 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:25.121 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968017070 con 0x7fe95c004fc0 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe96800f040 con 0x7fe95c004fc0 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe963fff700 1 -- 172.21.15.98:0/3145547941 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ec80 con 0x7fe95c004fc0 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe9774fc700 1 -- 172.21.15.98:0/3145547941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe95c004fc0 msgr2=0x7fe95c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.108+0000 7fe9774fc700 1 --2- 172.21.15.98:0/3145547941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe95c004fc0 0x7fe95c00b8e0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fe9700c2510 tx=0x7fe96800b040).stop 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.109+0000 7fe975a99700 1 -- 172.21.15.98:0/3145547941 reap_dead start 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.109+0000 7fe9774fc700 1 -- 172.21.15.98:0/3145547941 shutdown_connections 2023-08-22T00:45:25.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.109+0000 7fe9774fc700 1 -- 172.21.15.98:0/3145547941 >> 172.21.15.98:0/3145547941 conn(0x7fe9700c7290 msgr2=0x7fe9700c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.109+0000 7fe9774fc700 1 -- 172.21.15.98:0/3145547941 shutdown_connections 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.109+0000 7fe9774fc700 1 -- 172.21.15.98:0/3145547941 wait complete. 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.110+0000 7fe9774fc700 1 Processor -- start 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.110+0000 7fe9774fc700 1 -- start start 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe97014dad0 0x7fe970068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.123 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe970069380 0x7fe9700651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970152a40 con 0x7fe97014a2e0 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97014df50 con 0x7fe970069380 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970069800 con 0x7fe97014dad0 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32782/0 (socket says 172.21.15.98:32782) 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 -- 172.21.15.98:0/370252815 learned_addr learned my addr 172.21.15.98:0/370252815 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 -- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe97014dad0 msgr2=0x7fe970068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe97014dad0 0x7fe970068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 -- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe970069380 msgr2=0x7fe9700651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe970069380 0x7fe9700651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 -- 172.21.15.98:0/370252815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97014d120 con 0x7fe97014a2e0 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe975298700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fe96c0119c0 tx=0x7fe96c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00f940 con 0x7fe97014a2e0 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe96c00faa0 con 0x7fe97014a2e0 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97014e780 con 0x7fe97014a2e0 2023-08-22T00:45:25.125 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00fe80 con 0x7fe97014a2e0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.111+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97014e4a0 con 0x7fe97014a2e0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.112+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97014a6c0 con 0x7fe97014a2e0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.113+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 106) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe96c014650 con 0x7fe97014a2e0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.113+0000 7fe9617fa700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 0x7fe9540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.113+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fe96c07a920 con 0x7fe97014a2e0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.113+0000 7fe974a97700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 0x7fe9540613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-22T00:45:25.126 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.113+0000 7fe974a97700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 0x7fe9540613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe964000e10 tx=0x7fe964001e90).ready entity=mgr.9085 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-22T00:45:25.127 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.117+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe96c04bc70 con 0x7fe97014a2e0 2023-08-22T00:45:25.322 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.321+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe970047480 con 0x7fe97014a2e0 2023-08-22T00:45:25.323 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.322+0000 7fe9617fa700 1 -- 172.21.15.98:0/370252815 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+3536 (secure 0 0 0) 0x7fe96c04f290 con 0x7fe97014a2e0 2023-08-22T00:45:25.323 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-22T00:45:25.323 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2514517946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2514517946},{"type":"v1","addr":"172.21.15.118:6834","nonce":2514517946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3558638305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3558638305},{"type":"v1","addr":"172.21.15.118:6835","nonce":3558638305}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2740705612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2740705612},{"type":"v1","addr":"172.21.15.98:6836","nonce":2740705612}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":10233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1432854657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1432854657},{"type":"v1","addr":"172.21.15.98:6837","nonce":1432854657}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[]} 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.323+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 msgr2=0x7fe9540613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.323+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 0x7fe9540613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe964000e10 tx=0x7fe964001e90).stop 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.323+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 msgr2=0x7fe97014d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.323+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fe96c0119c0 tx=0x7fe96c009060).stop 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 shutdown_connections 2023-08-22T00:45:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:6832/169458,v1:172.21.15.98:6833/169458] conn(0x7fe95405ef30 0x7fe9540613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe970069380 0x7fe9700651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe97014a2e0 0x7fe97014d5e0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 --2- 172.21.15.98:0/370252815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe97014dad0 0x7fe970068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 >> 172.21.15.98:0/370252815 conn(0x7fe9700c7290 msgr2=0x7fe9700c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 shutdown_connections 2023-08-22T00:45:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2023-08-22T00:45:25.324+0000 7fe9774fc700 1 -- 172.21.15.98:0/370252815 wait complete. 2023-08-22T00:45:25.327 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 77 2023-08-22T00:45:25.336 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-22T00:45:25.337 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-22T00:45:25.337 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-22T00:45:25.337 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.345 INFO:tasks.ceph.mds.a:Stopped 2023-08-22T00:45:25.346 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-22T00:45:25.346 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.393 INFO:tasks.ceph.mds.c:Stopped 2023-08-22T00:45:25.394 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-22T00:45:25.394 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.404 INFO:tasks.ceph.mds.b:Stopped 2023-08-22T00:45:25.405 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-22T00:45:25.405 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.455 INFO:tasks.ceph.mds.d:Stopped 2023-08-22T00:45:25.456 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-22T00:45:25.457 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-22T00:45:25.457 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.494 INFO:tasks.ceph.osd.0:Stopped 2023-08-22T00:45:25.494 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-22T00:45:25.495 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.561 INFO:tasks.ceph.osd.1:Stopped 2023-08-22T00:45:25.561 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-22T00:45:25.562 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.625 INFO:tasks.ceph.osd.2:Stopped 2023-08-22T00:45:25.626 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-22T00:45:25.626 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.691 INFO:tasks.ceph.osd.3:Stopped 2023-08-22T00:45:25.692 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-22T00:45:25.692 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.728 INFO:tasks.ceph.osd.4:Stopped 2023-08-22T00:45:25.728 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-22T00:45:25.728 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.802 INFO:tasks.ceph.osd.5:Stopped 2023-08-22T00:45:25.803 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-22T00:45:25.803 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.873 INFO:tasks.ceph.osd.6:Stopped 2023-08-22T00:45:25.874 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-22T00:45:25.874 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.945 INFO:tasks.ceph.osd.7:Stopped 2023-08-22T00:45:25.945 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-22T00:45:25.945 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-22T00:45:25.946 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:25.971 INFO:tasks.ceph.mgr.y:Stopped 2023-08-22T00:45:25.973 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-22T00:45:25.973 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:26.009 INFO:tasks.ceph.mgr.x:Stopped 2023-08-22T00:45:26.010 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-22T00:45:26.010 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-22T00:45:26.010 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:26.025 INFO:tasks.ceph.mon.a:Stopped 2023-08-22T00:45:26.025 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-22T00:45:26.026 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:26.063 INFO:tasks.ceph.mon.b:Stopped 2023-08-22T00:45:26.063 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-22T00:45:26.064 INFO:teuthology.orchestra.run:waiting for 300 2023-08-22T00:45:26.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-08-22T00:45:26.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-08-22T00:45:26.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-08-22T00:45:26.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-08-22T00:45:26.118 INFO:tasks.ceph.mon.c:Stopped 2023-08-22T00:45:26.118 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-22T00:45:26.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-22T00:45:26.150 INFO:teuthology.orchestra.run.smithi098.stdout:2023-08-22T00:08:31.238469+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-22T00:45:26.150 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-22T00:45:26.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-22T00:45:26.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-22T00:45:26.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-22T00:45:26.362 INFO:teuthology.orchestra.run.smithi098.stdout:2023-08-22T00:08:31.238469+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-22T00:45:26.363 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:45:26.363 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-22T00:45:26.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:45:26.638 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-22T00:45:26.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:45:26.752 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-22T00:45:26.828 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:45:26.829 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-22T00:45:26.906 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:45:26.906 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-22T00:45:27.104 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:45:27.104 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-22T00:45:27.208 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:45:27.209 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-22T00:45:27.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:45:27.295 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-22T00:45:27.364 INFO:tasks.ceph:Archiving mon data... 2023-08-22T00:45:27.365 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/data/mon.a.tgz 2023-08-22T00:45:27.366 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-08-22T00:45:27.386 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.oWkZiUbGRe 2023-08-22T00:45:27.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oWkZiUbGRe 2023-08-22T00:45:27.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.oWkZiUbGRe 2023-08-22T00:45:28.004 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.oWkZiUbGRe is 2MB 2023-08-22T00:45:28.140 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.oWkZiUbGRe 2023-08-22T00:45:28.159 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/data/mon.b.tgz 2023-08-22T00:45:28.159 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-08-22T00:45:28.181 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.4yTuva1AMB 2023-08-22T00:45:28.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4yTuva1AMB 2023-08-22T00:45:28.793 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.4yTuva1AMB 2023-08-22T00:45:28.883 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.4yTuva1AMB is 3MB 2023-08-22T00:45:29.014 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.4yTuva1AMB 2023-08-22T00:45:29.032 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/data/mon.c.tgz 2023-08-22T00:45:29.032 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-08-22T00:45:29.088 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.MKbdoHvgiv 2023-08-22T00:45:29.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MKbdoHvgiv 2023-08-22T00:45:29.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.MKbdoHvgiv 2023-08-22T00:45:29.730 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.MKbdoHvgiv is 3MB 2023-08-22T00:45:29.864 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.MKbdoHvgiv 2023-08-22T00:45:29.882 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-22T00:45:29.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-22T00:45:29.886 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-22T00:45:29.953 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-22T00:45:29.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-22T00:45:29.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-22T00:45:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-22T00:45:30.021 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-22T00:45:30.027 INFO:tasks.ceph:Archiving crash dumps... 2023-08-22T00:45:30.028 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi098/crash 2023-08-22T00:45:30.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-22T00:45:30.070 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi118/crash 2023-08-22T00:45:30.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-22T00:45:30.104 INFO:tasks.ceph:Shutting down logrotate 2023-08-22T00:45:30.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:30.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:30.214 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:30.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-22T00:45:30.272 INFO:tasks.ceph:Compressing logs... 2023-08-22T00:45:30.273 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-22T00:45:30.288 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-22T00:45:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163851.log 2023-08-22T00:45:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122905.log 2023-08-22T00:45:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163851.log: /var/log/ceph/ceph-client.admin.122905.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163851.log.gz 2023-08-22T00:45:30.315 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122905.log.gz 2023-08-22T00:45:30.315 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122954.log 2023-08-22T00:45:30.329 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158472.log 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173746.log 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158472.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122954.log.gz 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135208.log 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158472.log.gz 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126335.log 2023-08-22T00:45:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169409.log 88.6% 2023-08-22T00:45:30.331 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173746.log.gz 2023-08-22T00:45:30.331 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.135208.log.gz 2023-08-22T00:45:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157359.log 2023-08-22T00:45:30.331 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126335.log.gz 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133095.log 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.169409.log: /var/log/ceph/ceph-client.admin.157359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129106.log 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169409.log.gz 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157359.log.gz 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151378.log 2023-08-22T00:45:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133095.log.gz 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128714.log 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151378.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129106.log.gz 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158729.log 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151378.log.gz 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171691.log 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158729.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128714.log.gz 2023-08-22T00:45:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131819.log 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158729.log.gz/var/log/ceph/ceph-client.admin.171691.log: 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125257.log 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171691.log.gz 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175935.log 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125257.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131819.log.gz 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176583.log 2023-08-22T00:45:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.175935.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125257.log.gz 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135640.log 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.175935.log.gz 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158827.log 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135640.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176583.log.gz 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128371.log 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158827.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135640.log.gz 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154965.log 2023-08-22T00:45:30.335 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158827.log.gz 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132803.log 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154965.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128371.log.gz 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178080.log 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5%/var/log/ceph/ceph-client.admin.132803.log: -- replaced with /var/log/ceph/ceph-client.admin.154965.log.gz 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172102.log 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.132803.log.gz 2023-08-22T00:45:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162013.log 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178080.log: /var/log/ceph/ceph-client.admin.172102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150737.log 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178080.log.gz 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130271.log 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172102.log.gz 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150737.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162013.log.gz 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111612.log 2023-08-22T00:45:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130271.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150737.log.gz 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174128.log 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130271.log.gz 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.tmp-client.admin.111612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176163.log 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111612.log.gz 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.174128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155660.log 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176163.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174128.log.gz 2023-08-22T00:45:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141771.log 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176163.log.gz 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133537.log 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155660.log: /var/log/ceph/ceph-client.admin.141771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163029.log 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155660.log.gz 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133537.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141771.log.gz 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129621.log 2023-08-22T00:45:30.339 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.133537.log.gz 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173191.log 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131147.log 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163029.log.gz 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173191.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129621.log.gz 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162792.log 2023-08-22T00:45:30.340 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173191.log.gz 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142668.log 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131147.log.gz 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180941.log 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142668.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162792.log.gz 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181518.log 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180941.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142668.log.gz 2023-08-22T00:45:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153577.log 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180941.log.gz 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152669.log 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181518.log.gz 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151478.log 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152669.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153577.log.gz 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150588.log 2023-08-22T00:45:30.342 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152669.log.gz 2023-08-22T00:45:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147454.log 2023-08-22T00:45:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151478.log.gz 2023-08-22T00:45:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159319.log 2023-08-22T00:45:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147454.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150588.log.gz 2023-08-22T00:45:30.344 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176481.log 2023-08-22T00:45:30.344 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147454.log.gz 2023-08-22T00:45:30.344 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155310.log 2023-08-22T00:45:30.344 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.159319.log.gz 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137298.log 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155310.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.176481.log.gz 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177165.log 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155310.log.gz 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.137298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182607.log 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137298.log.gz 2023-08-22T00:45:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165231.log 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182607.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177165.log.gz 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139997.log 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182607.log.gz 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166821.log 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165231.log.gz 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154916.log 2023-08-22T00:45:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166821.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139997.log.gz 2023-08-22T00:45:30.347 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135352.log 2023-08-22T00:45:30.355 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118342.log 2023-08-22T00:45:30.355 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118593.log 2023-08-22T00:45:30.355 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.118342.log.gz 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118593.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.123619.log 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118593.log.gz 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118391.log 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.123619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123052.log 2023-08-22T00:45:30.356 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118642.log 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.3.123619.log.gz 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118391.log.gz 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.123052.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118438.log 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118642.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123052.log.gz 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.118642.log.gz 2023-08-22T00:45:30.357 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118438.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118438.log.gz 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118544.log 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.122898.log 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118544.log: /var/log/ceph/ceph-client.1.122898.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.118544.log.gz 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118495.log 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118495.log: 89.7% -- replaced with /var/log/ceph/ceph-client.1.122898.log.gz 2023-08-22T00:45:30.358 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118293.log 2023-08-22T00:45:30.359 INFO:teuthology.orchestra.run.smithi118.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.118495.log.gz 2023-08-22T00:45:30.359 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-22T00:45:30.359 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.118293.log: /var/log/ceph/ceph-mon.c.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118293.log.gz 2023-08-22T00:45:30.359 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122279.log 2023-08-22T00:45:30.363 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-22T00:45:30.364 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.122279.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122279.log.gz 2023-08-22T00:45:30.364 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-22T00:45:30.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-22T00:45:30.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-22T00:45:30.377 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-22T00:45:30.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-22T00:45:30.394 INFO:teuthology.orchestra.run.smithi118.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-22T00:45:30.419 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166821.log.gz 2023-08-22T00:45:30.419 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151674.log 2023-08-22T00:45:30.419 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172400.log 2023-08-22T00:45:30.419 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154916.log.gz 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151674.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.135352.log.gz 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166770.log 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151674.log.gz 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157461.log 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172400.log.gz 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130557.log 2023-08-22T00:45:30.420 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168640.log 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166770.log.gz 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157461.log.gz 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125796.log 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130557.log.gz 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153214.log 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168640.log: /var/log/ceph/ceph-client.admin.125796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133837.log 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.168640.log.gz 2023-08-22T00:45:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124276.log 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125796.log.gz 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133837.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.153214.log.gz 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158374.log 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133837.log.gz 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-client.admin.124276.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.181970.log 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131575.log 2023-08-22T00:45:30.422 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124276.log.gz 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158374.log.gz 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133168.log 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181970.log.gz 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165342.log 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133168.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131575.log.gz 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161961.log 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165342.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.133168.log.gz-5 2023-08-22T00:45:30.423 INFO:teuthology.orchestra.run.smithi098.stderr:--verbose -- /var/log/ceph/ceph-client.admin.163655.log 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165342.log.gz 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181872.log 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163655.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.161961.log.gz 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170874.log 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181872.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163655.log.gz 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149935.log 2023-08-22T00:45:30.424 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181872.log.gz 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154003.log 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149935.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170874.log.gz 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146944.log 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.149935.log.gz 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167043.log 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154003.log.gz 2023-08-22T00:45:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178398.log 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167043.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146944.log.gz 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142064.log 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167043.log.gz 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159025.log 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1%/var/log/ceph/ceph-client.admin.142064.log: -- replaced with /var/log/ceph/ceph-client.admin.178398.log.gz 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152017.log 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159025.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142064.log.gz 2023-08-22T00:45:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128910.log 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159025.log.gz 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158236.log 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166525.log 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.152017.log.gz 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158236.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128910.log.gz 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172996.log 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158236.log.gz 2023-08-22T00:45:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139390.log 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166525.log.gz 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182656.log 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172996.log.gz 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131096.log 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139390.log.gz/var/log/ceph/ceph-client.admin.182656.log: 2023-08-22T00:45:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125649.log 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.182656.log.gz 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142741.log 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131096.log: /var/log/ceph/ceph-client.admin.125649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145765.log 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131096.log.gz 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125649.log.gz 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129204.log 2023-08-22T00:45:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.145765.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142741.log.gz 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178545.log 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129204.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145765.log.gz 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163802.log 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129204.log.gz 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141624.log 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122173.log 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141624.log: 91.0% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178545.log.gz -- replaced with /var/log/ceph/ceph-client.admin.163802.log.gz 2023-08-22T00:45:30.430 INFO:teuthology.orchestra.run.smithi098.stderr: 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130606.log 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.141624.log.gz 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152620.log 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133737.log 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122173.log.gz 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130606.log.gz 2023-08-22T00:45:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153681.log 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180249.log 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152620.log.gz 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133737.log.gz 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172200.log 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153681.log.gz 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125992.log 2023-08-22T00:45:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180249.log: /var/log/ceph/ceph-client.admin.172200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162064.log 2023-08-22T00:45:30.433 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180249.log.gz 2023-08-22T00:45:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131477.log 88.7% 2023-08-22T00:45:30.433 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172200.log.gz 2023-08-22T00:45:30.433 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162064.log: gzip 87.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.125992.log.gz-- 2023-08-22T00:45:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147356.log 2023-08-22T00:45:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131477.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162064.log.gz 2023-08-22T00:45:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-22T00:45:30.434 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131477.log.gz 2023-08-22T00:45:30.434 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149986.log 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.147356.log.gz 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173143.log 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159172.log 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.149986.log.gz 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166163.log 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166623.log 2023-08-22T00:45:30.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159172.log: /var/log/ceph/ceph-client.admin.166163.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.173143.log.gz 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157254.log 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159172.log.gz 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149381.log 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166163.log.gz 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166623.log: /var/log/ceph/ceph-client.admin.157254.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166623.log.gz 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162169.log 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157254.log.gz 2023-08-22T00:45:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141081.log 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149381.log: /var/log/ceph/ceph-client.admin.162169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133687.log 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149381.log.gz 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162169.log.gz 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171964.log 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141081.log.gz 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131355.log 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.133687.log.gz 2023-08-22T00:45:30.437 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176214.log 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171964.log: /var/log/ceph/ceph-client.admin.131355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149026.log 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171964.log.gz 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131355.log.gz 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156337.log 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154659.log 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149026.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176214.log.gz 2023-08-22T00:45:30.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156337.log: gzip 89.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.149026.log.gz-- 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122025.log 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156337.log.gz 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154150.log 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154659.log.gz 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122025.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150441.log 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122025.log.gz 2023-08-22T00:45:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153526.log 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167631.log 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154150.log.gz 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150441.log.gz 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139945.log 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171495.log 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153526.log.gz 2023-08-22T00:45:30.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158927.log 2023-08-22T00:45:30.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171495.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139945.log.gz 2023-08-22T00:45:30.441 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124718.log 2023-08-22T00:45:30.441 INFO:teuthology.orchestra.run.smithi098.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.167631.log.gz 2023-08-22T00:45:30.442 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171495.log.gz 2023-08-22T00:45:30.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171446.log 2023-08-22T00:45:30.442 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-client.admin.124718.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.141179.log 2023-08-22T00:45:30.442 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158927.log.gz 2023-08-22T00:45:30.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171446.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.124718.log.gz-5 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:--verbose -- /var/log/ceph/ceph-client.admin.170536.log 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171446.log.gz 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180681.log 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170536.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141179.log.gz 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124325.log 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180681.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170536.log.gz 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124325.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.180681.log.gz 2023-08-22T00:45:30.443 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124325.log.gz 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153880.log 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124767.log 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180733.log 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153880.log.gz 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150294.log 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124767.log.gz 2023-08-22T00:45:30.444 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161805.log 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180733.log: /var/log/ceph/ceph-client.admin.150294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178276.log 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180733.log.gz 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150294.log.gz 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156691.log 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161805.log.gz 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150091.log 2023-08-22T00:45:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124522.log 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178276.log.gz 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158778.log 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.156691.log.gz 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124522.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.150091.log.gz-5 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:--verbose -- /var/log/ceph/ceph-client.admin.182313.log 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158778.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124522.log.gz 2023-08-22T00:45:30.446 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129670.log 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158778.log.gz 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165446.log 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182313.log: /var/log/ceph/ceph-client.admin.129670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171238.log 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182313.log.gz 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165446.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129670.log.gz 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165446.log.gz 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171238.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171238.log.gz 2023-08-22T00:45:30.447 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130998.log 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135496.log 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172645.log 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182875.log 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130998.log.gz 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135496.log.gz 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129057.log 2023-08-22T00:45:30.448 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172645.log.gz 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172151.log 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182875.log: /var/log/ceph/ceph-client.admin.129057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125159.log 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182875.log.gz 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125747.log 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129057.log.gz 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172151.log.gz 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148374.log 2023-08-22T00:45:30.449 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125159.log.gz 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182705.log 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125747.log: /var/log/ceph/ceph-client.admin.148374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149779.log 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125747.log.gz 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182705.log: /var/log/ceph/ceph-client.admin.149779.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182705.log.gz 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.148374.log.gz 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149779.log.gz 2023-08-22T00:45:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135424.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179345.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163176.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135424.log.gz 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151072.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178178.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163176.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179345.log.gz 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147982.log 2023-08-22T00:45:30.451 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163176.log.gz 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151072.log.gz 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179530.log 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178178.log.gz 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158976.log 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147982.log.gz 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148129.log 2023-08-22T00:45:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179530.log: /var/log/ceph/ceph-client.admin.158976.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.179530.log.gz 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176325.log 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158976.log.gz 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-client.admin.148129.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.140934.log 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161350.log 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148129.log.gz 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140934.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.176325.log.gz 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155359.log 2023-08-22T00:45:30.453 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.140934.log.gz 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182264.log 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166872.log 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155359.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161350.log.gz 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.152419.log 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155359.log.gz 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182264.log.gz 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149883.log 2023-08-22T00:45:30.454 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.152419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172849.log 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.166872.log.gz 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133887.log 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149883.log.gz 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161468.log 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.0.152419.log.gz 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172849.log.gz 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145939.log 2023-08-22T00:45:30.455 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129781.log 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133887.log.gz 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.145939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124865.log 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161468.log.gz 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145939.log.gz 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155016.log 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129781.log.gz 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128420.log 2023-08-22T00:45:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124865.log: /var/log/ceph/ceph-client.admin.155016.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124865.log.gz 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141673.log 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155016.log.gz 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128420.log.gz 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176920.log 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124816.log 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141673.log: /var/log/ceph/ceph-client.admin.176920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177576.log 2023-08-22T00:45:30.457 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141673.log.gz 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124816.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.176920.log.gz 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171082.log 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124816.log.gz 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128321.log 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154561.log 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177576.log.gz 2023-08-22T00:45:30.458 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176273.log 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171082.log.gz 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154561.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128321.log.gz 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.154561.log.gz 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176273.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176273.log.gz 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141032.log 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181097.log 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175817.log 2023-08-22T00:45:30.459 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141032.log.gz 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.181097.log.gz 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.175817.log: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.175817.log.gz 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147735.log 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179645.log 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157816.log 2023-08-22T00:45:30.460 INFO:teuthology.orchestra.run.smithi098.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147735.log.gz 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181420.log 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151870.log 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157816.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179645.log.gz 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122359.log 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157816.log.gz 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147835.log 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181420.log.gz 2023-08-22T00:45:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122359.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.151870.log.gz 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165602.log 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122359.log.gz 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124571.log 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118502.log 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147835.log.gz 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124571.log: gzip -5 --verbose 88.3%-- /var/log/ceph/ceph-client.admin.130026.log 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.165602.log.gz 2023-08-22T00:45:30.462 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124571.log.gz 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.118502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163078.log 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118502.log.gz 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129400.log 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130026.log: /var/log/ceph/ceph-client.admin.163078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177018.log 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130026.log.gz 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163078.log.gz 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136254.log 2023-08-22T00:45:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-client.admin.177018.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.131428.log 2023-08-22T00:45:30.464 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129400.log.gz 2023-08-22T00:45:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.136254.log: 87.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.177018.log.gz--verbose 2023-08-22T00:45:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:-- /var/log/ceph/ceph-client.admin.176532.log 2023-08-22T00:45:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140152.log 2023-08-22T00:45:30.464 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136254.log.gz 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131428.log.gz 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131526.log 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176532.log.gz 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149617.log 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140152.log: /var/log/ceph/ceph-client.admin.131526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172743.log 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140152.log.gz 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131526.log.gz 2023-08-22T00:45:30.465 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140049.log 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172743.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.149617.log.gz 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154324.log 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172743.log.gz 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176871.log 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154324.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140049.log.gz 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135784.log 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154324.log.gz 2023-08-22T00:45:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151170.log 2023-08-22T00:45:30.467 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124424.log 2023-08-22T00:45:30.468 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176871.log.gz 2023-08-22T00:45:30.468 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135784.log.gz 2023-08-22T00:45:30.468 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176376.log 2023-08-22T00:45:30.468 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172053.log 2023-08-22T00:45:30.468 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151170.log.gz 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124424.log: /var/log/ceph/ceph-client.admin.176376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149099.log 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124424.log.gz 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176376.log.gz 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158521.log 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131673.log 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149099.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172053.log.gz 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130655.log 2023-08-22T00:45:30.469 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149099.log.gz 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131673.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158521.log.gz 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168234.log 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130655.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.131673.log.gz 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171289.log 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130655.log.gz 2023-08-22T00:45:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166114.log 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121956.log 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171289.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168234.log.gz 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126384.log 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171289.log.gz 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166114.log.gz 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.121956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152794.log 2023-08-22T00:45:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167533.log 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126384.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121956.log.gz 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141575.log 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126384.log.gz 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152794.log.gz 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172694.log 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181676.log 2023-08-22T00:45:30.472 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141575.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167533.log.gz 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162715.log 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141575.log.gz 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172694.log.gz 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157202.log 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162715.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181676.log.gz 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130704.log 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157202.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.162715.log.gz--verbose 2023-08-22T00:45:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:-- /var/log/ceph/ceph-client.admin.124473.log 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157202.log.gz 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135856.log 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165006.log 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130704.log.gz 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163225.log 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124473.log.gz 2023-08-22T00:45:30.474 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.135856.log.gz 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149728.log 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133587.log 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165006.log.gz 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149728.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.163225.log.gz 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166016.log 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149728.log.gz 2023-08-22T00:45:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146043.log 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.133587.log.gz 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129253.log 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162568.log 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166016.log.gz 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129253.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.146043.log.gz 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172498.log 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161695.log 2023-08-22T00:45:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162568.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129253.log.gz 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172498.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162568.log.gz 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141477.log 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133241.log 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161695.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172498.log.gz 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141477.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161695.log.gz 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130320.log 2023-08-22T00:45:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133241.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141477.log.gz 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130320.log: gzip -5 --verbose 88.0%-- /var/log/ceph/ceph-client.admin.126188.log -- replaced with /var/log/ceph/ceph-client.admin.133241.log.gz 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr: 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-osd.3.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.118627.log 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130320.log.gz 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166337.log 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.118627.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126188.log.gz 2023-08-22T00:45:30.478 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.118627.log.gz 2023-08-22T00:45:30.479 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166337.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166337.log.gz 2023-08-22T00:45:30.479 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139626.log 2023-08-22T00:45:30.479 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141526.log 2023-08-22T00:45:30.479 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159123.log 2023-08-22T00:45:30.479 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141526.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139626.log.gz 2023-08-22T00:45:30.480 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141526.log.gz 2023-08-22T00:45:30.480 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159123.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159123.log.gz 2023-08-22T00:45:30.480 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150037.log 2023-08-22T00:45:30.480 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123150.log 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161753.log 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123150.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.150037.log.gz 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123150.log.gz 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161753.log.gz 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163127.log 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.127903.log 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153474.log 2023-08-22T00:45:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.2.127903.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.163127.log.gz 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128861.log 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.2.127903.log.gz 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153474.log.gz 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146699.log 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177241.log 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128861.log: /var/log/ceph/ceph-client.admin.146699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180785.log 2023-08-22T00:45:30.482 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128861.log.gz 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146699.log.gz 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151427.log 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180785.log: gzip 88.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.177241.log.gz-- 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168456.log 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.180785.log.gz 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151427.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151427.log.gz 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168456.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168456.log.gz 2023-08-22T00:45:30.483 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125600.log 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129977.log 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160142.log 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125600.log.gz 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143001.log 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.160142.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129977.log.gz 2023-08-22T00:45:30.484 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160142.log.gz 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.143001.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143001.log.gz 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139684.log 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128665.log 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139684.log: /var/log/ceph/ceph-client.admin.128665.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139684.log.gz 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166212.log 2023-08-22T00:45:30.485 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128665.log.gz 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162220.log 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177478.log 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166212.log.gz 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177478.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162220.log.gz 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177478.log.gz 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182068.log 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180572.log 2023-08-22T00:45:30.486 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182068.log: /var/log/ceph/ceph-client.admin.180572.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.182068.log.gz 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180572.log.gz 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124375.log 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165498.log 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162666.log 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165498.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124375.log.gz 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162666.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165498.log.gz 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162666.log.gz 2023-08-22T00:45:30.487 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167092.log 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159819.log 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135712.log 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167092.log.gz 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.159819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165967.log 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132949.log 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.135712.log.gz 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165967.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165967.log.gz 2023-08-22T00:45:30.488 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158423.log 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132949.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132949.log.gz 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158423.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158423.log.gz 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167435.log 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155163.log 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167435.log: /var/log/ceph/ceph-client.admin.155163.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167435.log.gz 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155163.log.gz 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126237.log 2023-08-22T00:45:30.489 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122074.log 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126237.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126237.log.gz 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122074.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122074.log.gz 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118162.log 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146650.log 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.118162.log: /var/log/ceph/ceph-client.admin.146650.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118162.log.gz 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146650.log.gz 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157963.log 2023-08-22T00:45:30.490 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135087.log 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157963.log: /var/log/ceph/ceph-client.admin.135087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157963.log.gz 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135087.log.gz 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138694.log 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147786.log 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.138694.log: /var/log/ceph/ceph-client.admin.147786.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138694.log.gz 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147786.log.gz 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129155.log 2023-08-22T00:45:30.491 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128763.log 2023-08-22T00:45:30.492 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129155.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129155.log.gz 2023-08-22T00:45:30.492 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128763.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128763.log.gz 2023-08-22T00:45:30.492 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156740.log 2023-08-22T00:45:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.5.log: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-22T00:45:30.515 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151527.log 2023-08-22T00:45:30.516 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156740.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.156740.log.gz/var/log/ceph/ceph-client.admin.151527.log: 2023-08-22T00:45:30.516 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151527.log.gz 2023-08-22T00:45:30.516 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173795.log 2023-08-22T00:45:30.516 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171593.log 2023-08-22T00:45:30.516 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173795.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173795.log.gz 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171593.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171593.log.gz 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164625.log 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129572.log 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164625.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164625.log.gz 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129572.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129572.log.gz 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156215.log 2023-08-22T00:45:30.517 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167337.log 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156215.log: /var/log/ceph/ceph-client.admin.167337.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156215.log.gz 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167337.log.gz 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131771.log 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145992.log 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131771.log: /var/log/ceph/ceph-client.admin.145992.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.131771.log.gz 2023-08-22T00:45:30.518 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145992.log.gz 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167582.log 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127206.log 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167582.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167582.log.gz 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.127206.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.127206.log.gz 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172349.log 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147405.log 2023-08-22T00:45:30.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172349.log: /var/log/ceph/ceph-client.admin.147405.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172349.log.gz 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133314.log 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147405.log.gz 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182509.log 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133314.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133314.log.gz 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182509.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182509.log.gz 2023-08-22T00:45:30.520 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173045.log 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147307.log 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173045.log: /var/log/ceph/ceph-client.admin.147307.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173045.log.gz 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147307.log.gz 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164503.log 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151121.log 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164503.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164503.log.gz 2023-08-22T00:45:30.521 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151121.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151121.log.gz 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172596.log 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128272.log 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172596.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172596.log.gz 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128272.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128272.log.gz 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155114.log 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181725.log 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155114.log: /var/log/ceph/ceph-client.admin.181725.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155114.log.gz 2023-08-22T00:45:30.522 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181725.log.gz 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161642.log 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163482.log 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161642.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161642.log.gz 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152742.log 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163482.log.gz 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133022.log 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152742.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152742.log.gz 2023-08-22T00:45:30.523 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133022.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133022.log.gz 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168283.log 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157566.log 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168283.log: /var/log/ceph/ceph-client.admin.157566.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168283.log.gz 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157566.log.gz 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.148776.log 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.159819.log.gz 2023-08-22T00:45:30.524 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133487.log 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.148776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155506.log 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133487.log: /var/log/ceph/ceph-client.admin.155506.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133487.log.gz 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155506.log.gz 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135038.log 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134940.log 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125061.log 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.148776.log.gz 2023-08-22T00:45:30.525 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135038.log.gz 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134940.log: /var/log/ceph/ceph-client.admin.125061.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134940.log.gz 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167239.log 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125061.log.gz 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146310.log 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167239.log: /var/log/ceph/ceph-client.admin.146310.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.167239.log.gz 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.146310.log.gz 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178496.log 2023-08-22T00:45:30.526 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171740.log 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178496.log: /var/log/ceph/ceph-client.admin.171740.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178496.log.gz 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.171740.log.gz 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151821.log 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158012.log 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151821.log: /var/log/ceph/ceph-client.admin.158012.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151821.log.gz 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158012.log.gz 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182558.log 2023-08-22T00:45:30.527 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122707.log 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132876.log 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182558.log.gz 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132876.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122707.log.gz 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132876.log.gz 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157767.log 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153423.log 2023-08-22T00:45:30.528 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128174.log 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157767.log.gz 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128174.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153423.log.gz 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124914.log 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128174.log.gz 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170815.log 2023-08-22T00:45:30.529 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124914.log: /var/log/ceph/ceph-client.admin.170815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124914.log.gz 2023-08-22T00:45:30.530 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.170815.log.gz 2023-08-22T00:45:30.530 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171184.log 2023-08-22T00:45:30.530 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162470.log 2023-08-22T00:45:30.530 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182755.log 2023-08-22T00:45:30.530 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162470.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171184.log.gz 2023-08-22T00:45:30.531 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182755.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162470.log.gz 2023-08-22T00:45:30.531 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.182755.log.gz 2023-08-22T00:45:30.531 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140499.log 2023-08-22T00:45:30.531 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126090.log 2023-08-22T00:45:30.531 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167679.log 2023-08-22T00:45:30.532 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140499.log.gz 2023-08-22T00:45:30.532 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167679.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126090.log.gz 2023-08-22T00:45:30.532 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167679.log.gz 2023-08-22T00:45:30.532 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148325.log 2023-08-22T00:45:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123052.log 2023-08-22T00:45:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:gzip /var/log/ceph/ceph-client.admin.148325.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126041.log 2023-08-22T00:45:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123052.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148325.log.gz 2023-08-22T00:45:30.533 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126041.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123052.log.gz 2023-08-22T00:45:30.533 INFO:teuthology.orchestra.run.smithi098.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126041.log.gz 2023-08-22T00:45:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122507.log 2023-08-22T00:45:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140450.log 2023-08-22T00:45:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122507.log: /var/log/ceph/ceph-client.admin.140450.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122507.log.gz 2023-08-22T00:45:30.534 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140450.log.gz 2023-08-22T00:45:30.534 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148977.log 2023-08-22T00:45:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125355.log 2023-08-22T00:45:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148977.log: /var/log/ceph/ceph-client.admin.125355.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148977.log.gz 2023-08-22T00:45:30.535 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125355.log.gz 2023-08-22T00:45:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141820.log 2023-08-22T00:45:30.535 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123101.log 2023-08-22T00:45:30.536 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141820.log: /var/log/ceph/ceph-client.admin.123101.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141820.log.gz 2023-08-22T00:45:30.536 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181298.log 2023-08-22T00:45:30.536 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123101.log.gz 2023-08-22T00:45:30.536 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127336.log 2023-08-22T00:45:30.536 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181298.log: /var/log/ceph/ceph-client.admin.127336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181298.log.gz 2023-08-22T00:45:30.537 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127336.log.gz 2023-08-22T00:45:30.537 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172898.log 2023-08-22T00:45:30.537 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157307.log 2023-08-22T00:45:30.537 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172898.log: /var/log/ceph/ceph-client.admin.157307.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172898.log.gz 2023-08-22T00:45:30.537 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157307.log.gz 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139737.log 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181047.log 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130124.log 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139737.log.gz 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181047.log: /var/log/ceph/ceph-client.admin.130124.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.181047.log.gz 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130124.log.gz 2023-08-22T00:45:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133387.log 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156789.log 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141918.log 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156789.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133387.log.gz 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141918.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156789.log.gz 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141918.log.gz 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180623.log 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151919.log 2023-08-22T00:45:30.539 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182019.log 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151919.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.180623.log.gz 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182019.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151919.log.gz 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.182019.log.gz 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128518.log 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179197.log 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160069.log 2023-08-22T00:45:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179197.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128518.log.gz 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.160069.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179197.log.gz 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146993.log 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160069.log.gz 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128567.log 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146993.log: /var/log/ceph/ceph-client.admin.128567.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146993.log.gz 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128567.log.gz 2023-08-22T00:45:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179999.log 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124178.log 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.179999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136950.log 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124178.log: /var/log/ceph/ceph-client.admin.136950.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124178.log.gz 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136950.log.gz 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126490.log 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166921.log 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126490.log: /var/log/ceph/ceph-client.admin.166921.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.179999.log.gz 2023-08-22T00:45:30.542 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166921.log.gz 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.126490.log.gz 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125943.log 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123247.log 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162421.log 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125943.log.gz 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162421.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123247.log.gz 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162421.log.gz 2023-08-22T00:45:30.543 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158621.log 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181774.log 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132173.log 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181774.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158621.log.gz 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.132173.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181774.log.gz 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180993.log 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177116.log 2023-08-22T00:45:30.544 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180993.log: /var/log/ceph/ceph-client.admin.177116.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180993.log.gz 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177116.log.gz 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171544.log 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174202.log 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171544.log: /var/log/ceph/ceph-client.admin.174202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171544.log.gz 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174202.log.gz 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150661.log 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130753.log 2023-08-22T00:45:30.545 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150661.log: /var/log/ceph/ceph-client.admin.130753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150661.log.gz 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130753.log.gz 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163582.log 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177625.log 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163582.log: /var/log/ceph/ceph-client.admin.177625.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163582.log.gz 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177625.log.gz 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128469.log 2023-08-22T00:45:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126139.log 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128469.log: /var/log/ceph/ceph-client.admin.126139.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128469.log.gz 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126139.log.gz 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150392.log 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140746.log 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150392.log: /var/log/ceph/ceph-client.admin.140746.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150392.log.gz 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140746.log.gz 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164552.log 2023-08-22T00:45:30.547 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173094.log 2023-08-22T00:45:30.548 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164552.log: /var/log/ceph/ceph-client.admin.173094.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164552.log.gz 2023-08-22T00:45:30.548 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173094.log.gz 2023-08-22T00:45:30.548 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154610.log 2023-08-22T00:45:30.548 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176969.log 2023-08-22T00:45:30.548 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154610.log: /var/log/ceph/ceph-client.admin.176969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154610.log.gz 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176969.log.gz 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147503.log 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165910.log 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147503.log: /var/log/ceph/ceph-client.admin.165910.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147503.log.gz 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165910.log.gz 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159270.log 2023-08-22T00:45:30.549 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139573.log 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159270.log: /var/log/ceph/ceph-client.admin.139573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159270.log.gz 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139573.log.gz 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134989.log 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141330.log 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134989.log: /var/log/ceph/ceph-client.admin.141330.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134989.log.gz 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141330.log.gz 2023-08-22T00:45:30.550 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172947.log 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125894.log 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172947.log: /var/log/ceph/ceph-client.admin.125894.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172947.log.gz 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125894.log.gz 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159221.log 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122605.log 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159221.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159221.log.gz 2023-08-22T00:45:30.551 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177982.log 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122605.log.gz 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158878.log 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177982.log: /var/log/ceph/ceph-client.admin.158878.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177982.log.gz 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158878.log.gz 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181823.log 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177882.log 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181823.log: /var/log/ceph/ceph-client.admin.177882.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181823.log.gz 2023-08-22T00:45:30.552 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177882.log.gz 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146258.log 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146361.log 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146258.log: /var/log/ceph/ceph-client.admin.146361.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146258.log.gz 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146361.log.gz 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140352.log 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129720.log 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140352.log: /var/log/ceph/ceph-client.admin.129720.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140352.log.gz 2023-08-22T00:45:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178031.log 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129720.log.gz 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160020.log 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178031.log: /var/log/ceph/ceph-client.admin.160020.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178031.log.gz 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160020.log.gz 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149830.log 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139841.log 2023-08-22T00:45:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149830.log: /var/log/ceph/ceph-client.admin.139841.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.149830.log.gz 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.139841.log.gz 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153318.log 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125845.log 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153318.log: /var/log/ceph/ceph-client.admin.125845.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153318.log.gz 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125845.log.gz 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182362.log 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170764.log 2023-08-22T00:45:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182362.log: /var/log/ceph/ceph-client.admin.170764.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182362.log.gz 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.170764.log.gz 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151329.log 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141967.log 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151329.log: /var/log/ceph/ceph-client.admin.141967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151329.log.gz 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141967.log.gz 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133437.log 2023-08-22T00:45:30.556 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165653.log 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133437.log: /var/log/ceph/ceph-client.admin.165653.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133437.log.gz 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165653.log.gz 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122556.log 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150836.log 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122556.log: /var/log/ceph/ceph-client.admin.150836.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122556.log.gz 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150836.log.gz 2023-08-22T00:45:30.557 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153954.log 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177429.log 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153954.log: /var/log/ceph/ceph-client.admin.177429.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153954.log.gz 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177429.log.gz 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173545.log 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151968.log 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.173545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182117.log 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151968.log: /var/log/ceph/ceph-client.admin.182117.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151968.log.gz 2023-08-22T00:45:30.558 INFO:teuthology.orchestra.run.smithi098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182117.log.gz 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122805.log 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122805.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122805.log.gz 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179148.log 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179148.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179148.log.gz 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125502.log 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125502.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125502.log.gz 2023-08-22T00:45:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176637.log 2023-08-22T00:45:30.560 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176637.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176637.log.gz 2023-08-22T00:45:30.560 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147933.log 2023-08-22T00:45:30.567 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147933.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147933.log.gz 2023-08-22T00:45:30.567 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134891.log 2023-08-22T00:45:30.567 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134891.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134891.log.gz 2023-08-22T00:45:30.567 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130949.log 2023-08-22T00:45:30.567 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130949.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130949.log.gz 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162519.log 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162519.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162519.log.gz 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147605.log 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147605.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147605.log.gz 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152977.log 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152977.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152977.log.gz 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170073.log 2023-08-22T00:45:30.568 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170073.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170073.log.gz 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163753.log 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163753.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163753.log.gz 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140302.log 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140302.log.gz 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150343.log 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150343.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150343.log.gz 2023-08-22T00:45:30.569 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180200.log 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180200.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180200.log.gz 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165394.log 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165394.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.165394.log.gz 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139894.log 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139894.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139894.log.gz 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165551.log 2023-08-22T00:45:30.570 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157914.log 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165551.log: /var/log/ceph/ceph-client.admin.157914.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165551.log.gz 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157914.log.gz 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150974.log 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150974.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150974.log.gz 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157718.log 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157718.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157718.log.gz 2023-08-22T00:45:30.571 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161857.log 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161857.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.161857.log.gz 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135136.log 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135136.log.gz 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167484.log 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125208.log 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167484.log: /var/log/ceph/ceph-client.admin.125208.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167484.log.gz 2023-08-22T00:45:30.572 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125208.log.gz 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163384.log 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163384.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163384.log.gz 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178227.log 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178227.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.178227.log.gz 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140401.log 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140401.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140401.log.gz 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146895.log 2023-08-22T00:45:30.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146895.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146895.log.gz 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163533.log 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163533.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163533.log.gz 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170024.log 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170024.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.170024.log.gz 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155408.log 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155408.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155408.log.gz 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154708.log 2023-08-22T00:45:30.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154708.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154708.log.gz 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162980.log 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162980.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162980.log.gz 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156574.log 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170926.log 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156574.log: /var/log/ceph/ceph-client.admin.170926.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156574.log.gz 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.170926.log.gz 2023-08-22T00:45:30.575 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125110.log 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125110.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125110.log.gz 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167141.log 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167141.log.gz 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168033.log 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.168033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156264.log 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.173545.log.gz 2023-08-22T00:45:30.576 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156264.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156264.log.gz 2023-08-22T00:45:30.577 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-22T00:45:30.577 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163327.log 2023-08-22T00:45:30.581 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163327.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.163327.log.gz 2023-08-22T00:45:30.582 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-22T00:45:30.584 INFO:teuthology.orchestra.run.smithi098.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.168033.log.gz 2023-08-22T00:45:30.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.a.log: 93.9% -- replaced with /var/log/ceph/ceph-client.0.132173.log.gz 2023-08-22T00:45:30.596 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165758.log 2023-08-22T00:45:30.597 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165758.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165758.log.gz 2023-08-22T00:45:30.597 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150539.log 2023-08-22T00:45:30.598 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150539.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150539.log.gz 2023-08-22T00:45:30.598 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122756.log 2023-08-22T00:45:30.599 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122756.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122756.log.gz 2023-08-22T00:45:30.599 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140670.log 2023-08-22T00:45:30.600 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140670.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140670.log.gz 2023-08-22T00:45:30.600 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182411.log 2023-08-22T00:45:30.601 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182411.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182411.log.gz 2023-08-22T00:45:30.601 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130802.log 2023-08-22T00:45:30.602 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130802.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130802.log.gz 2023-08-22T00:45:30.602 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139042.log 2023-08-22T00:45:30.603 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139042.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139042.log.gz 2023-08-22T00:45:30.603 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166065.log 2023-08-22T00:45:30.604 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166065.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166065.log.gz 2023-08-22T00:45:30.604 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181248.log 2023-08-22T00:45:30.605 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181248.log.gz 2023-08-22T00:45:30.605 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122310.log 2023-08-22T00:45:30.606 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122310.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122310.log.gz 2023-08-22T00:45:30.606 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125012.log 2023-08-22T00:45:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125012.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125012.log.gz 2023-08-22T00:45:30.608 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141722.log 2023-08-22T00:45:30.608 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141722.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141722.log.gz 2023-08-22T00:45:30.609 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137996.log 2023-08-22T00:45:30.609 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.137996.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137996.log.gz 2023-08-22T00:45:30.610 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.164302.log 2023-08-22T00:45:30.612 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.164302.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.164302.log.gz 2023-08-22T00:45:30.612 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134818.log 2023-08-22T00:45:30.613 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134818.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134818.log.gz 2023-08-22T00:45:30.613 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129879.log 2023-08-22T00:45:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129879.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129879.log.gz 2023-08-22T00:45:30.615 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146517.log 2023-08-22T00:45:30.615 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146517.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.146517.log.gz 2023-08-22T00:45:30.616 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147554.log 2023-08-22T00:45:30.616 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147554.log.gz 2023-08-22T00:45:30.617 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157039.log 2023-08-22T00:45:30.617 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157039.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157039.log.gz 2023-08-22T00:45:30.618 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146797.log 2023-08-22T00:45:30.618 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146797.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146797.log.gz 2023-08-22T00:45:30.619 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172547.log 2023-08-22T00:45:30.620 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172547.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172547.log.gz 2023-08-22T00:45:30.620 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141230.log 2023-08-22T00:45:30.621 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141230.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141230.log.gz 2023-08-22T00:45:30.621 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137647.log 2023-08-22T00:45:30.622 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.137647.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.137647.log.gz 2023-08-22T00:45:30.622 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154199.log 2023-08-22T00:45:30.623 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154199.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154199.log.gz 2023-08-22T00:45:30.623 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-22T00:45:30.629 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149175.log 2023-08-22T00:45:30.630 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149175.log.gz 2023-08-22T00:45:30.630 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177776.log 2023-08-22T00:45:30.631 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177776.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177776.log.gz 2023-08-22T00:45:30.631 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158672.log 2023-08-22T00:45:30.632 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158672.log.gz 2023-08-22T00:45:30.632 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128959.log 2023-08-22T00:45:30.634 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128959.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128959.log.gz 2023-08-22T00:45:30.634 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157410.log 2023-08-22T00:45:30.635 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157410.log.gz 2023-08-22T00:45:30.635 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126614.log 2023-08-22T00:45:30.636 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126614.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126614.log.gz 2023-08-22T00:45:30.636 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146154.log 2023-08-22T00:45:30.637 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146154.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146154.log.gz 2023-08-22T00:45:30.638 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158570.log 2023-08-22T00:45:30.639 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158570.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158570.log.gz 2023-08-22T00:45:30.639 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153630.log 2023-08-22T00:45:30.640 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153630.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.153630.log.gz 2023-08-22T00:45:30.640 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154248.log 2023-08-22T00:45:30.641 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154248.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154248.log.gz 2023-08-22T00:45:30.641 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126286.log 2023-08-22T00:45:30.642 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126286.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126286.log.gz 2023-08-22T00:45:30.643 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167386.log 2023-08-22T00:45:30.643 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-22T00:45:30.644 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167386.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167386.log.gz 2023-08-22T00:45:30.644 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160427.log 2023-08-22T00:45:30.645 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.160427.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.160427.log.gz 2023-08-22T00:45:30.645 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165706.log 2023-08-22T00:45:30.646 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165706.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165706.log.gz 2023-08-22T00:45:30.646 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142016.log 2023-08-22T00:45:30.647 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142016.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.142016.log.gz 2023-08-22T00:45:30.647 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140548.log 2023-08-22T00:45:30.648 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140548.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.140548.log.gz 2023-08-22T00:45:30.648 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180345.log 2023-08-22T00:45:30.649 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180345.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180345.log.gz 2023-08-22T00:45:30.649 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124963.log 2023-08-22T00:45:30.650 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124963.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124963.log.gz 2023-08-22T00:45:30.650 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150490.log 2023-08-22T00:45:30.651 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150490.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150490.log.gz 2023-08-22T00:45:30.651 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148031.log 2023-08-22T00:45:30.652 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148031.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148031.log.gz 2023-08-22T00:45:30.652 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125404.log 2023-08-22T00:45:30.653 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125404.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125404.log.gz 2023-08-22T00:45:30.653 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134671.log 2023-08-22T00:45:30.654 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134671.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.134671.log.gz 2023-08-22T00:45:30.654 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176821.log 2023-08-22T00:45:30.655 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176821.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176821.log.gz 2023-08-22T00:45:30.655 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125698.log 2023-08-22T00:45:30.656 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125698.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125698.log.gz 2023-08-22T00:45:30.656 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123199.log 2023-08-22T00:45:30.657 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123199.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.123199.log.gz 2023-08-22T00:45:30.657 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130222.log 2023-08-22T00:45:30.658 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130222.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130222.log.gz 2023-08-22T00:45:30.658 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141428.log 2023-08-22T00:45:30.659 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141428.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141428.log.gz 2023-08-22T00:45:30.659 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153267.log 2023-08-22T00:45:30.660 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153267.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153267.log.gz 2023-08-22T00:45:30.660 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163948.log 2023-08-22T00:45:30.661 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163948.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163948.log.gz 2023-08-22T00:45:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132596.log 2023-08-22T00:45:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.132596.log.gz 2023-08-22T00:45:30.662 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2023-08-22T00:45:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124227.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2023-08-22T00:45:30.663 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166574.log 2023-08-22T00:45:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166574.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166574.log.gz 2023-08-22T00:45:30.664 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135905.log 2023-08-22T00:45:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135905.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135905.log.gz 2023-08-22T00:45:30.665 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141130.log 2023-08-22T00:45:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141130.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141130.log.gz 2023-08-22T00:45:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178947.log 2023-08-22T00:45:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.178947.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.178947.log.gz 2023-08-22T00:45:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148276.log 2023-08-22T00:45:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148276.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.148276.log.gz 2023-08-22T00:45:30.670 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-22T00:45:30.674 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147169.log 2023-08-22T00:45:30.675 INFO:teuthology.orchestra.run.smithi098.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-22T00:45:30.676 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147169.log.gz 2023-08-22T00:45:30.676 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151023.log 2023-08-22T00:45:30.677 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151023.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151023.log.gz 2023-08-22T00:45:30.677 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129302.log 2023-08-22T00:45:30.678 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129302.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129302.log.gz 2023-08-22T00:45:30.678 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135568.log 2023-08-22T00:45:30.679 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135568.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135568.log.gz 2023-08-22T00:45:30.679 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151772.log 2023-08-22T00:45:30.680 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151772.log.gz 2023-08-22T00:45:30.680 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166436.log 2023-08-22T00:45:30.681 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166436.log.gz 2023-08-22T00:45:30.681 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172298.log 2023-08-22T00:45:30.682 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172298.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172298.log.gz 2023-08-22T00:45:30.682 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150142.log 2023-08-22T00:45:30.683 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150142.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150142.log.gz 2023-08-22T00:45:30.683 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167288.log 2023-08-22T00:45:30.684 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167288.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.167288.log.gz 2023-08-22T00:45:30.684 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176429.log 2023-08-22T00:45:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176429.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176429.log.gz 2023-08-22T00:45:30.685 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.156014.log 2023-08-22T00:45:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.156014.log: 94.1% -- replaced with /var/log/ceph/ceph-client.0.156014.log.gz 2023-08-22T00:45:30.687 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166261.log 2023-08-22T00:45:30.688 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166261.log.gz 2023-08-22T00:45:30.688 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151576.log 2023-08-22T00:45:30.689 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151576.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151576.log.gz 2023-08-22T00:45:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154101.log 2023-08-22T00:45:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154101.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154101.log.gz 2023-08-22T00:45:30.690 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162115.log 2023-08-22T00:45:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162115.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162115.log.gz 2023-08-22T00:45:30.691 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154859.log 2023-08-22T00:45:30.692 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154859.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154859.log.gz 2023-08-22T00:45:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164700.log 2023-08-22T00:45:30.693 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164700.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164700.log.gz 2023-08-22T00:45:30.694 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146102.log 2023-08-22T00:45:30.694 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146102.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146102.log.gz 2023-08-22T00:45:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122458.log 2023-08-22T00:45:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122458.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122458.log.gz 2023-08-22T00:45:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139789.log 2023-08-22T00:45:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139789.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139789.log.gz 2023-08-22T00:45:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164885.log 2023-08-22T00:45:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164885.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164885.log.gz 2023-08-22T00:45:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160218.log 2023-08-22T00:45:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.160218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160218.log.gz 2023-08-22T00:45:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146846.log 2023-08-22T00:45:30.700 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146846.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146846.log.gz 2023-08-22T00:45:30.700 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165283.log 2023-08-22T00:45:30.701 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165283.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165283.log.gz 2023-08-22T00:45:30.701 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148178.log 2023-08-22T00:45:30.702 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148178.log.gz 2023-08-22T00:45:30.702 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149564.log 2023-08-22T00:45:30.703 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149564.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149564.log.gz 2023-08-22T00:45:30.703 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180838.log 2023-08-22T00:45:30.704 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180838.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180838.log.gz 2023-08-22T00:45:30.704 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181469.log 2023-08-22T00:45:30.705 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181469.log.gz 2023-08-22T00:45:30.705 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132423.log 2023-08-22T00:45:30.706 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132423.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132423.log.gz 2023-08-22T00:45:30.706 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143051.log 2023-08-22T00:45:30.707 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.143051.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143051.log.gz 2023-08-22T00:45:30.707 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158325.log 2023-08-22T00:45:30.708 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158325.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158325.log.gz 2023-08-22T00:45:30.708 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151723.log 2023-08-22T00:45:30.709 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151723.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151723.log.gz 2023-08-22T00:45:30.709 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123003.log 2023-08-22T00:45:30.709 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123003.log.gz 2023-08-22T00:45:30.709 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136602.log 2023-08-22T00:45:30.710 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.136602.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.136602.log.gz 2023-08-22T00:45:30.710 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171030.log 2023-08-22T00:45:30.711 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171030.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171030.log.gz 2023-08-22T00:45:30.712 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166672.log 2023-08-22T00:45:30.712 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166672.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166672.log.gz 2023-08-22T00:45:30.713 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148422.log 2023-08-22T00:45:30.713 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148422.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148422.log.gz 2023-08-22T00:45:30.713 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148080.log 2023-08-22T00:45:30.714 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148080.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148080.log.gz 2023-08-22T00:45:30.714 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159417.log 2023-08-22T00:45:30.716 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159417.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.159417.log.gz 2023-08-22T00:45:30.716 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138345.log 2023-08-22T00:45:30.717 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.138345.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138345.log.gz 2023-08-22T00:45:30.717 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155261.log 2023-08-22T00:45:30.718 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155261.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155261.log.gz 2023-08-22T00:45:30.718 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141869.log 2023-08-22T00:45:30.719 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141869.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141869.log.gz 2023-08-22T00:45:30.719 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.142418.log 2023-08-22T00:45:30.722 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.142418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141281.log 2023-08-22T00:45:30.725 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141281.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141281.log.gz 2023-08-22T00:45:30.726 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154757.log 2023-08-22T00:45:30.728 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154757.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154757.log.gz 2023-08-22T00:45:30.728 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147686.log 2023-08-22T00:45:30.729 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147686.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147686.log.gz 2023-08-22T00:45:30.729 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142816.log 2023-08-22T00:45:30.730 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142816.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142816.log.gz 2023-08-22T00:45:30.730 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176688.log 2023-08-22T00:45:30.732 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176688.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176688.log.gz 2023-08-22T00:45:30.732 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161908.log 2023-08-22T00:45:30.733 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.161908.log.gz 2023-08-22T00:45:30.733 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155612.log 2023-08-22T00:45:30.734 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155612.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.155612.log.gz 2023-08-22T00:45:30.735 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177674.log 2023-08-22T00:45:30.736 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177674.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177674.log.gz 2023-08-22T00:45:30.736 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133787.log 2023-08-22T00:45:30.737 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133787.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.133787.log.gz 2023-08-22T00:45:30.737 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146412.log 2023-08-22T00:45:30.738 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146412.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146412.log.gz 2023-08-22T00:45:30.739 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155563.log 2023-08-22T00:45:30.740 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155563.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155563.log.gz 2023-08-22T00:45:30.740 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125551.log 2023-08-22T00:45:30.741 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125551.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125551.log.gz 2023-08-22T00:45:30.741 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181921.log 2023-08-22T00:45:30.742 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181921.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181921.log.gz 2023-08-22T00:45:30.742 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151272.log 2023-08-22T00:45:30.744 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151272.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151272.log.gz 2023-08-22T00:45:30.744 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154808.log 2023-08-22T00:45:30.745 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154808.log.gz 2023-08-22T00:45:30.745 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140983.log 2023-08-22T00:45:30.746 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140983.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140983.log.gz 2023-08-22T00:45:30.746 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130075.log 2023-08-22T00:45:30.747 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130075.log.gz 2023-08-22T00:45:30.748 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129928.log 2023-08-22T00:45:30.749 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129928.log.gz 2023-08-22T00:45:30.749 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154052.log 2023-08-22T00:45:30.750 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154052.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154052.log.gz 2023-08-22T00:45:30.750 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128616.log 2023-08-22T00:45:30.751 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128616.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128616.log.gz 2023-08-22T00:45:30.751 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132374.log 2023-08-22T00:45:30.752 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132374.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132374.log.gz 2023-08-22T00:45:30.753 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157091.log 2023-08-22T00:45:30.754 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157091.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157091.log.gz 2023-08-22T00:45:30.754 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163704.log 2023-08-22T00:45:30.755 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163704.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163704.log.gz 2023-08-22T00:45:30.755 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125453.log 2023-08-22T00:45:30.756 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125453.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125453.log.gz 2023-08-22T00:45:30.756 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146205.log 2023-08-22T00:45:30.758 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146205.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146205.log.gz 2023-08-22T00:45:30.758 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166721.log 2023-08-22T00:45:30.759 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166721.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.166721.log.gz 2023-08-22T00:45:30.759 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165180.log 2023-08-22T00:45:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165180.log.gz 2023-08-22T00:45:30.760 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181347.log 2023-08-22T00:45:30.761 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.181347.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181347.log.gz 2023-08-22T00:45:30.762 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122656.log 2023-08-22T00:45:30.763 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122656.log.gz 2023-08-22T00:45:30.763 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155212.log 2023-08-22T00:45:30.764 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155212.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155212.log.gz 2023-08-22T00:45:30.764 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157865.log 2023-08-22T00:45:30.765 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157865.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157865.log.gz 2023-08-22T00:45:30.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171642.log 2023-08-22T00:45:30.766 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171642.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171642.log.gz 2023-08-22T00:45:30.767 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162371.log 2023-08-22T00:45:30.768 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162371.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162371.log.gz 2023-08-22T00:45:30.768 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124620.log 2023-08-22T00:45:30.769 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124620.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124620.log.gz 2023-08-22T00:45:30.769 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134769.log 2023-08-22T00:45:30.770 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134769.log.gz 2023-08-22T00:45:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159465.log 2023-08-22T00:45:30.772 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159465.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159465.log.gz 2023-08-22T00:45:30.772 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147884.log 2023-08-22T00:45:30.773 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147884.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147884.log.gz 2023-08-22T00:45:30.773 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169952.log 2023-08-22T00:45:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.169952.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.169952.log.gz 2023-08-22T00:45:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158061.log 2023-08-22T00:45:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158061.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158061.log.gz 2023-08-22T00:45:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140597.log 2023-08-22T00:45:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140597.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140597.log.gz 2023-08-22T00:45:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122261.log 2023-08-22T00:45:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122261.log.gz 2023-08-22T00:45:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168356.log 2023-08-22T00:45:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.168356.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168356.log.gz 2023-08-22T00:45:30.780 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178325.log 2023-08-22T00:45:30.781 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178325.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178325.log.gz 2023-08-22T00:45:30.781 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134720.log 2023-08-22T00:45:30.782 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134720.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134720.log.gz 2023-08-22T00:45:30.782 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133637.log 2023-08-22T00:45:30.783 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133637.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133637.log.gz 2023-08-22T00:45:30.783 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156964.log 2023-08-22T00:45:30.784 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156964.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156964.log.gz 2023-08-22T00:45:30.785 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162617.log 2023-08-22T00:45:30.786 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162617.log.gz 2023-08-22T00:45:30.786 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129830.log 2023-08-22T00:45:30.787 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129830.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129830.log.gz 2023-08-22T00:45:30.788 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141379.log 2023-08-22T00:45:30.788 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141379.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141379.log.gz 2023-08-22T00:45:30.789 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171865.log 2023-08-22T00:45:30.790 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171865.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171865.log.gz 2023-08-22T00:45:30.790 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142619.log 2023-08-22T00:45:30.791 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142619.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142619.log.gz 2023-08-22T00:45:30.791 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170711.log 2023-08-22T00:45:30.792 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170711.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170711.log.gz 2023-08-22T00:45:30.793 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173943.log 2023-08-22T00:45:30.794 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173943.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173943.log.gz 2023-08-22T00:45:30.794 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166970.log 2023-08-22T00:45:30.795 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.166970.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166970.log.gz 2023-08-22T00:45:30.795 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163900.log 2023-08-22T00:45:30.796 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163900.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.163900.log.gz 2023-08-22T00:45:30.797 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159074.log 2023-08-22T00:45:30.798 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159074.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159074.log.gz 2023-08-22T00:45:30.798 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146748.log 2023-08-22T00:45:30.799 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146748.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146748.log.gz 2023-08-22T00:45:30.799 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149675.log 2023-08-22T00:45:30.800 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149675.log.gz 2023-08-22T00:45:30.801 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182826.log 2023-08-22T00:45:30.802 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182826.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182826.log.gz 2023-08-22T00:45:30.802 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151221.log 2023-08-22T00:45:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151221.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151221.log.gz 2023-08-22T00:45:30.803 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164934.log 2023-08-22T00:45:30.804 INFO:teuthology.orchestra.run.smithi098.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.0.142418.log.gz 2023-08-22T00:45:30.804 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172792.log 2023-08-22T00:45:30.804 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164934.log.gz 2023-08-22T00:45:30.805 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172792.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172792.log.gz 2023-08-22T00:45:30.805 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128223.log 2023-08-22T00:45:30.806 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130369.log 2023-08-22T00:45:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128223.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128223.log.gz/var/log/ceph/ceph-client.admin.130369.log: 2023-08-22T00:45:30.807 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130369.log.gz 2023-08-22T00:45:30.807 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177725.log 2023-08-22T00:45:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177725.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177725.log.gz 2023-08-22T00:45:30.808 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163433.log 2023-08-22T00:45:30.811 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171133.log 2023-08-22T00:45:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163433.log: /var/log/ceph/ceph-client.admin.171133.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163433.log.gz 2023-08-22T00:45:30.812 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171133.log.gz 2023-08-22T00:45:30.812 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177833.log 2023-08-22T00:45:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177833.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177833.log.gz 2023-08-22T00:45:30.813 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140845.log 2023-08-22T00:45:30.814 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140845.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140845.log.gz 2023-08-22T00:45:30.814 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129351.log 2023-08-22T00:45:30.815 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129351.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129351.log.gz 2023-08-22T00:45:30.815 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145624.log 2023-08-22T00:45:30.816 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.145624.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145624.log.gz 2023-08-22T00:45:30.816 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131047.log 2023-08-22T00:45:30.817 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131047.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131047.log.gz 2023-08-22T00:45:30.817 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177340.log 2023-08-22T00:45:30.818 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177340.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.177340.log.gz 2023-08-22T00:45:30.818 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180891.log 2023-08-22T00:45:30.819 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180891.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180891.log.gz 2023-08-22T00:45:30.819 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171789.log 2023-08-22T00:45:30.820 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.171789.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171789.log.gz 2023-08-22T00:45:30.820 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131722.log 2023-08-22T00:45:30.821 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131722.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131722.log.gz 2023-08-22T00:45:30.821 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150925.log 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130851.log 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150925.log: /var/log/ceph/ceph-client.admin.130851.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150925.log.gz 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130851.log.gz 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151625.log 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151625.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.151625.log.gz 2023-08-22T00:45:30.824 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170977.log 2023-08-22T00:45:30.825 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.170977.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170977.log.gz 2023-08-22T00:45:30.825 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129008.log 2023-08-22T00:45:30.825 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176110.log 2023-08-22T00:45:30.826 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129008.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129008.log.gz 2023-08-22T00:45:30.826 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.176110.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176110.log.gz 2023-08-22T00:45:30.827 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177931.log 2023-08-22T00:45:30.827 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177931.log.gz 2023-08-22T00:45:30.827 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130468.log 2023-08-22T00:45:30.828 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163276.log 2023-08-22T00:45:30.828 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130468.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130468.log.gz 2023-08-22T00:45:30.829 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153370.log 2023-08-22T00:45:30.829 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.163276.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163276.log.gz 2023-08-22T00:45:30.830 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172249.log 2023-08-22T00:45:30.830 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153370.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153370.log.gz 2023-08-22T00:45:30.831 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147258.log 2023-08-22T00:45:30.832 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172249.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172249.log.gz 2023-08-22T00:45:30.833 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122856.log 2023-08-22T00:45:30.833 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147258.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147258.log.gz 2023-08-22T00:45:30.833 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162891.log 2023-08-22T00:45:30.834 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122856.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122856.log.gz 2023-08-22T00:45:30.834 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-22T00:45:30.835 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162891.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162891.log.gz 2023-08-22T00:45:30.835 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125306.log 2023-08-22T00:45:30.849 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.125306.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125306.log.gz 2023-08-22T00:45:30.849 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182166.log 2023-08-22T00:45:30.850 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182166.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182166.log.gz 2023-08-22T00:45:30.850 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182215.log 2023-08-22T00:45:30.851 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182215.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182215.log.gz 2023-08-22T00:45:30.851 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173868.log 2023-08-22T00:45:30.852 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.173868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173868.log.gz 2023-08-22T00:45:30.853 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131198.log 2023-08-22T00:45:30.854 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131198.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131198.log.gz 2023-08-22T00:45:30.854 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131624.log 2023-08-22T00:45:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131624.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131624.log.gz 2023-08-22T00:45:30.855 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178593.log 2023-08-22T00:45:30.856 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178593.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178593.log.gz 2023-08-22T00:45:30.857 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159368.log 2023-08-22T00:45:30.858 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159368.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159368.log.gz 2023-08-22T00:45:30.858 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148227.log 2023-08-22T00:45:30.859 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148227.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.148227.log.gz 2023-08-22T00:45:30.859 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177527.log 2023-08-22T00:45:30.860 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177527.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177527.log.gz 2023-08-22T00:45:30.860 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177067.log 2023-08-22T00:45:30.861 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.177067.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177067.log.gz 2023-08-22T00:45:30.862 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156389.log 2023-08-22T00:45:30.863 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156389.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156389.log.gz 2023-08-22T00:45:30.863 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180519.log 2023-08-22T00:45:30.864 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180519.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180519.log.gz 2023-08-22T00:45:30.864 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130173.log 2023-08-22T00:45:30.865 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130173.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130173.log.gz 2023-08-22T00:45:30.865 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123886.log 2023-08-22T00:45:30.869 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123886.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.123886.log.gz 2023-08-22T00:45:30.869 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155457.log 2023-08-22T00:45:30.870 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155457.log.gz 2023-08-22T00:45:30.870 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157514.log 2023-08-22T00:45:30.871 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157514.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157514.log.gz 2023-08-22T00:45:30.871 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126441.log 2023-08-22T00:45:30.872 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126441.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126441.log.gz 2023-08-22T00:45:30.873 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178129.log 2023-08-22T00:45:30.874 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178129.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178129.log.gz 2023-08-22T00:45:30.874 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178447.log 2023-08-22T00:45:30.875 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178447.log.gz 2023-08-22T00:45:30.875 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172449.log 2023-08-22T00:45:30.876 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.172449.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172449.log.gz 2023-08-22T00:45:30.877 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128812.log 2023-08-22T00:45:30.878 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128812.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128812.log.gz 2023-08-22T00:45:30.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153151.log 2023-08-22T00:45:30.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153151.log.gz 2023-08-22T00:45:30.879 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154512.log 2023-08-22T00:45:30.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154512.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154512.log.gz 2023-08-22T00:45:30.880 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169360.log 2023-08-22T00:45:30.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.169360.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169360.log.gz 2023-08-22T00:45:30.882 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135280.log 2023-08-22T00:45:30.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135280.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135280.log.gz 2023-08-22T00:45:30.883 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158137.log 2023-08-22T00:45:30.884 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158137.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158137.log.gz 2023-08-22T00:45:30.884 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179270.log 2023-08-22T00:45:30.885 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179270.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.179270.log.gz 2023-08-22T00:45:30.885 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131304.log 2023-08-22T00:45:30.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131304.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131304.log.gz 2023-08-22T00:45:30.887 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153813.log 2023-08-22T00:45:30.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153813.log.gz 2023-08-22T00:45:30.888 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146466.log 2023-08-22T00:45:30.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146466.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146466.log.gz 2023-08-22T00:45:30.889 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155065.log 2023-08-22T00:45:30.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155065.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155065.log.gz 2023-08-22T00:45:30.891 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182460.log 2023-08-22T00:45:30.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182460.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.182460.log.gz 2023-08-22T00:45:30.892 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132496.log 2023-08-22T00:45:30.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132496.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132496.log.gz 2023-08-22T00:45:30.893 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131255.log 2023-08-22T00:45:30.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131255.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131255.log.gz 2023-08-22T00:45:30.894 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140102.log 2023-08-22T00:45:30.895 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140102.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140102.log.gz 2023-08-22T00:45:30.896 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124669.log 2023-08-22T00:45:30.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124669.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124669.log.gz 2023-08-22T00:45:30.897 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154423.log 2023-08-22T00:45:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154423.log.gz 2023-08-22T00:45:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167190.log 2023-08-22T00:45:30.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167190.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167190.log.gz 2023-08-22T00:45:30.900 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147070.log 2023-08-22T00:45:30.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147070.log.gz 2023-08-22T00:45:30.901 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157150.log 2023-08-22T00:45:30.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157150.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157150.log.gz 2023-08-22T00:45:30.902 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122409.log 2023-08-22T00:45:30.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122409.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122409.log.gz 2023-08-22T00:45:30.903 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130900.log 2023-08-22T00:45:30.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130900.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130900.log.gz 2023-08-22T00:45:30.905 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152065.log 2023-08-22T00:45:30.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152065.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152065.log.gz 2023-08-22T00:45:30.908 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-22T00:45:30.946 INFO:teuthology.orchestra.run.smithi118.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-22T00:45:31.069 INFO:teuthology.orchestra.run.smithi118.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-22T00:45:31.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-08-22T00:45:31.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-08-22T00:45:31.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-08-22T00:45:31.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-08-22T00:45:31.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-08-22T00:45:31.180 INFO:teuthology.orchestra.run.smithi098.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-22T00:45:31.487 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-22T00:45:32.204 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-22T00:45:32.252 INFO:teuthology.orchestra.run.smithi118.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-22T00:45:32.258 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-22T00:45:32.347 INFO:teuthology.orchestra.run.smithi118.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-22T00:45:32.375 INFO:teuthology.orchestra.run.smithi118.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-22T00:45:32.388 INFO:teuthology.orchestra.run.smithi118.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-22T00:45:32.390 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-08-22T00:45:32.390 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m2.061s 2023-08-22T00:45:32.390 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m9.574s 2023-08-22T00:45:32.390 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m0.354s 2023-08-22T00:45:32.656 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-22T00:45:32.715 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-22T00:45:32.999 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-22T00:45:33.000 INFO:teuthology.orchestra.run.smithi098.stderr: 2023-08-22T00:45:33.000 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m2.697s 2023-08-22T00:45:33.001 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m12.284s 2023-08-22T00:45:33.001 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.812s 2023-08-22T00:45:33.001 INFO:tasks.ceph:Archiving logs... 2023-08-22T00:45:33.001 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi098/log 2023-08-22T00:45:33.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-22T00:45:35.195 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi118/log 2023-08-22T00:45:35.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-22T00:45:36.391 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-22T00:45:36.400 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-22T00:45:36.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-22T00:45:36.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-22T00:45:36.496 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-22T00:45:36.533 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-22T00:45:36.533 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-22T00:45:36.536 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-22T00:45:36.554 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-08-22T00:45:36.557 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-08-22T00:45:36.559 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-22T00:45:36.559 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-08-22T00:45:36.559 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +764us[ +760us] +/- 71ms 2023-08-22T00:45:36.560 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1464us[-1468us] +/- 49ms 2023-08-22T00:45:36.560 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +1512us[+1512us] +/- 82ms 2023-08-22T00:45:36.560 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:45:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-22T00:45:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-08-22T00:45:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +805us[ +805us] +/- 71ms 2023-08-22T00:45:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1437us[-1450us] +/- 49ms 2023-08-22T00:45:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1534us[+1521us] +/- 82ms 2023-08-22T00:45:36.563 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-22T00:45:36.564 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-22T00:45:36.582 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-22T00:45:36.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-22T00:45:36.622 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-22T00:45:36.670 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-22T00:45:36.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-22T00:45:36.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:45:36.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-22T00:45:36.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:45:36.837 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-22T00:45:36.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-22T00:45:36.872 INFO:teuthology.task.internal:Duration was 3005.528830 seconds 2023-08-22T00:45:36.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-22T00:45:36.889 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-22T00:45:36.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-22T00:45:36.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-22T00:45:36.939 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-22T00:45:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-22T00:45:37.061 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-22T00:45:37.061 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2023-08-22T00:45:37.062 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-22T00:45:37.085 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-08-22T00:45:37.086 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-22T00:45:37.109 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-22T00:45:37.110 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-22T00:45:37.127 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-22T00:45:37.189 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-22T00:45:37.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-22T00:45:37.192 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-22T00:45:37.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-22T00:45:37.316 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-22T00:45:37.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-22T00:45:37.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-22T00:45:37.372 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-22T00:45:37.388 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-22T00:45:37.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2023-08-22T00:45:37.439 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-08-22T00:45:37.452 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-22T00:45:37.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:45:37.486 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-22T00:45:37.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-22T00:45:37.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-22T00:45:37.522 INFO:teuthology.task.internal:Transferring archived files... 2023-08-22T00:45:37.523 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi098 2023-08-22T00:45:37.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-22T00:45:37.561 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555/remote/smithi118 2023-08-22T00:45:37.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-22T00:45:37.599 INFO:teuthology.task.internal:Removing archive directory... 2023-08-22T00:45:37.600 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-22T00:45:37.602 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-22T00:45:37.652 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-22T00:45:37.666 INFO:teuthology.task.internal:Not uploading archives. 2023-08-22T00:45:37.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-22T00:45:37.687 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-22T00:45:37.687 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-22T00:45:37.690 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-22T00:45:37.705 INFO:teuthology.orchestra.run.smithi098.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 22 00:45 /home/ubuntu/cephtest 2023-08-22T00:45:37.710 INFO:teuthology.orchestra.run.smithi118.stdout: 525343 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 22 00:45 /home/ubuntu/cephtest 2023-08-22T00:45:37.711 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-22T00:45:37.727 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-22T00:45:37.757 INFO:teuthology.nuke:Checking targets against current locks 2023-08-22T00:45:37.782 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-22T00:45:37.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-22T00:45:37.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 23:46:24.272215', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZiQnS8g/mK3OoJng0ZrkMuUxfkOntvjaU3QE/0efvSB4xyzBhZc/Pri5NlPQiivydYoE3e7eoJEXc9oFdH88UZQ57UIRhkJq8kK0wEZ9/plkWiVw9eNbpgnfDZaDm/GPkpePhvBo3RU5atdC+bEpJkYncSvJ66TfcqWE8RYDCscBYkzWyYKnukAzhd7fKuCrJ+80KfKQ4waFfjJcfD3D5dkla/GeIZpOBFNdxXJeWNmmfGVZ23eNr7Ulex9BkDkpZOxLoOai/Dz27nTM8XqIEdQOjSN6U1rjV+Sy+6fDy+TP7wv6cwHHsX+h5sb+CFkXluc5QwtS3/echKMe2BWysXdqAoV474Js1Q+498oEyYzXbXiSa08YISUkfTxrdIRcP7S7uyefePb4bN+XDecJJLIdjrZKBUgiX3b74LC+dKC9L6dBtAKzdtiAtmrHtnK2DxGGOFAuiNqv8pzZuZ52oOQFPWla9l44b7zKDMtJO4vfYr2TeD0FlWuZaM1n+Pdc='} 2023-08-22T00:45:37.806 DEBUG:teuthology.nuke:shortname: smithi118 2023-08-22T00:45:37.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-22T00:45:37.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi/7374555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 23:46:24.270396', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPu6U/zzJVSgMnmMq53VpQaUD0olSxj2DPoArhWeVzRR6ItaVcKqoMR/L48Vs6pQrz9Eb562pQAOj/+bPNgL4g='} 2023-08-22T00:45:37.858 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-22T00:45:37.860 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T00:45:37.876 INFO:teuthology.orchestra.console.smithi118:Power off 2023-08-22T00:45:37.877 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T00:45:37.891 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-22T00:45:37.892 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:37.905 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-08-22T00:45:37.906 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:37.917 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-22T00:45:37.932 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-08-22T00:45:41.918 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:41.933 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:42.030 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-22T00:45:42.044 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-08-22T00:45:46.036 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:46.047 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T00:45:46.150 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-22T00:45:46.160 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-08-22T00:45:46.252 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-22T00:45:46.262 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-08-22T00:45:46.366 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3005.528830051422 failure_reason: '"2023-08-22T00:08:31.238469+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-08-22T00:45:46.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T00:45:46.445 INFO:teuthology.run:FAIL